2023-10-06T02:41:30.438 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T02:41:30.438 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --verbose --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/orig.config.yaml 2023-10-06T02:41:30.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:41:30.573 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} email: yweinste@redhat.com first_in_suite: false job_id: '7412169' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Scrub error on inode sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBITBtx/bAIfyuUxsJSZLm5tJ/nDGLxprgfTsd+TBPEy+03FL+DlHWu+7cPjzJhjwdIafE1YdQgc72qKkxh3BDiA= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBOUjOfNyhN4aTGrezCVYR0S/G4/6ct0vMeX2ZhrQNTNb8jS0cORCRQAZu85HmmxslxEVey2UnGO2BuePk6ORJ8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_multimds_misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T02:41:30.574 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T02:41:30.574 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T02:41:30.575 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T02:41:30.576 INFO:teuthology.task.internal:Checking packages... 2023-10-06T02:41:30.599 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T02:41:30.599 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T02:41:30.599 INFO:teuthology.packaging:ref: None 2023-10-06T02:41:30.599 INFO:teuthology.packaging:tag: None 2023-10-06T02:41:30.599 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:41:30.599 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:41:30.599 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:41:30.757 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.gf1e315a9 2023-10-06T02:41:30.757 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T02:41:30.763 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T02:41:30.763 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T02:41:30.806 INFO:teuthology.task.internal:Saving configuration 2023-10-06T02:41:30.822 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T02:41:30.839 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:41:30.865 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:36:33.642162', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBITBtx/bAIfyuUxsJSZLm5tJ/nDGLxprgfTsd+TBPEy+03FL+DlHWu+7cPjzJhjwdIafE1YdQgc72qKkxh3BDiA='} 2023-10-06T02:41:30.890 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:36:33.643464', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBOUjOfNyhN4aTGrezCVYR0S/G4/6ct0vMeX2ZhrQNTNb8jS0cORCRQAZu85HmmxslxEVey2UnGO2BuePk6ORJ8='} 2023-10-06T02:41:30.890 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T02:41:30.896 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T02:41:30.896 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T02:41:30.897 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T02:41:30.996 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcb29f7fb80>, signals=[15]) 2023-10-06T02:41:30.996 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T02:41:31.002 INFO:teuthology.task.internal:Opening connections... 2023-10-06T02:41:31.002 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:41:31.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:41:31.073 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T02:41:31.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:41:31.139 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T02:41:31.147 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-10-06T02:41:31.165 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-10-06T02:41:31.165 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-10-06T02:41:31.222 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T02:41:31.223 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T02:41:31.223 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2023-10-06T02:41:31.223 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2023-10-06T02:41:31.223 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.4" 2023-10-06T02:41:31.223 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:41:31.223 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T02:41:31.223 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-10-06T02:41:31.223 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T02:41:31.224 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T02:41:31.224 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T02:41:31.224 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:41:31.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:41:31.224 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:41:31.224 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T02:41:31.225 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T02:41:31.225 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T02:41:31.225 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-10-06T02:41:31.248 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-10-06T02:41:31.266 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-10-06T02:41:31.267 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-10-06T02:41:31.323 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T02:41:31.323 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T02:41:31.323 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel" 2023-10-06T02:41:31.323 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora" 2023-10-06T02:41:31.323 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.4" 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T02:41:31.324 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T02:41:31.325 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T02:41:31.325 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-10-06T02:41:31.349 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T02:41:31.358 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T02:41:31.414 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T02:41:31.414 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:41:31.417 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:41:31.432 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T02:41:31.438 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T02:41:31.439 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:41:31.473 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:41:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T02:41:31.489 INFO:teuthology.orchestra.run.smithi131.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T02:41:31.490 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T02:41:31.545 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T02:41:31.560 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T02:41:31.560 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T02:41:31.560 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T02:41:31.561 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:41:31.561 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:41:31.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:41:31.577 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-10-06T02:41:31.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:41:31.578 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-10-06T02:41:31.634 INFO:teuthology.orchestra.run.smithi131.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:41:31.634 INFO:teuthology.task.kernel:Running kernel on smithi131: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:41:31.634 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y kernel 2023-10-06T02:41:31.635 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:41:31.636 INFO:teuthology.task.kernel:Running kernel on smithi084: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T02:41:31.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2023-10-06T02:41:33.046 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T02:41:33.047 INFO:teuthology.orchestra.run.smithi131.stdout:Unable to read consumer identity 2023-10-06T02:41:33.161 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T02:41:33.161 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-10-06T02:41:34.522 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-10-06T02:41:34.543 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-06T02:41:38.154 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 16 MB 00:03 2023-10-06T02:41:39.099 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 16 MB 00:04 2023-10-06T02:41:41.464 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-06T02:41:42.194 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T02:41:42.195 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T02:41:42.195 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T02:41:42.334 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-10-06T02:41:42.335 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2023-10-06T02:41:42.335 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-10-06T02:41:42.395 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T02:41:42.443 DEBUG:teuthology.orchestra.run.smithi131:> echo no | sudo yum reinstall kernel || true 2023-10-06T02:41:42.789 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T02:41:42.789 INFO:teuthology.orchestra.run.smithi131.stdout:Unable to read consumer identity 2023-10-06T02:41:43.085 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:41:41 AM UTC. 2023-10-06T02:41:43.114 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T02:41:43.114 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T02:41:43.114 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T02:41:43.227 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:41:43.228 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:41:43.228 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:41:43.255 INFO:teuthology.orchestra.run.smithi131.stderr:Error: No packages marked for reinstall. 2023-10-06T02:41:43.272 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-10-06T02:41:43.273 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2023-10-06T02:41:43.274 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-10-06T02:41:43.305 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum reinstall -y kernel || true 2023-10-06T02:41:43.380 DEBUG:teuthology.orchestra.run.smithi084:> echo no | sudo yum reinstall kernel || true 2023-10-06T02:41:43.649 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T02:41:43.649 INFO:teuthology.orchestra.run.smithi131.stdout:Unable to read consumer identity 2023-10-06T02:41:43.726 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T02:41:43.727 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-10-06T02:41:43.938 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:41:41 AM UTC. 2023-10-06T02:41:44.014 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:41:42 AM UTC. 2023-10-06T02:41:44.068 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:41:44.068 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:41:44.068 INFO:teuthology.orchestra.run.smithi131.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:41:44.085 INFO:teuthology.orchestra.run.smithi131.stderr:Error: No packages marked for reinstall. 2023-10-06T02:41:44.134 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:41:44.146 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:41:44.146 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:41:44.146 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:41:44.166 INFO:teuthology.orchestra.run.smithi084.stderr:Error: No packages marked for reinstall. 2023-10-06T02:41:44.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum reinstall -y kernel || true 2023-10-06T02:41:44.260 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:44.260 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:44.260 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:44.260 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:41:44.261 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:41:44.261 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T02:41:44.261 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:41:44.261 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:41:44.386 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:44.387 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:44.387 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2023-10-06T02:41:44.414 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2023-10-06T02:41:44.414 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2023-10-06T02:41:44.414 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.02 2023-10-06T02:41:44.414 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 99.el8_4.1 2023-10-06T02:41:44.414 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2023-10-06T02:41:44.414 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T02:41:44.414 INFO:teuthology.orchestra.run.smithi131.stdout:Group : System Environment/Base 2023-10-06T02:41:44.415 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 9264631 2023-10-06T02:41:44.415 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2023-10-06T02:41:44.415 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T02:41:44.415 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T02:41:44.415 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T02:41:44.415 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T02:41:44.415 INFO:teuthology.orchestra.run.smithi131.stdout:Relocations : (not relocatable) 2023-10-06T02:41:44.415 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : Red Hat, Inc. 2023-10-06T02:41:44.415 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : Red Hat, Inc. 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:41:44.416 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:41:44.417 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:41:44.418 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:44.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:41:44.557 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T02:41:44.557 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-10-06T02:41:44.839 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 02:41:42 AM UTC. 2023-10-06T02:41:44.977 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T02:41:44.977 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:41:44.978 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T02:41:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:Error: No packages marked for reinstall. 2023-10-06T02:41:45.040 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:41:45.167 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:45.167 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:45.167 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:45.168 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:41:45.168 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:41:45.168 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T02:41:45.168 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:41:45.168 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:41:45.292 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:45.292 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:45.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2023-10-06T02:41:45.319 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2023-10-06T02:41:45.319 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2023-10-06T02:41:45.319 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.02 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 99.el8_4.1 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:Group : System Environment/Base 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 9264631 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T02:41:45.320 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T02:41:45.321 INFO:teuthology.orchestra.run.smithi084.stdout:Relocations : (not relocatable) 2023-10-06T02:41:45.321 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : Red Hat, Inc. 2023-10-06T02:41:45.321 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : Red Hat, Inc. 2023-10-06T02:41:45.321 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:41:45.321 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2023-10-06T02:41:45.321 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2023-10-06T02:41:45.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:41:45.321 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:41:45.322 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:41:45.322 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:41:45.322 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2023-10-06T02:41:45.322 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:41:45.322 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:41:45.323 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:41:45.323 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:45.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:41:45.810 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2023-10-06T02:41:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2023-10-06T02:41:48.224 INFO:teuthology.orchestra.run.smithi131.stderr:done 2023-10-06T02:41:48.226 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-10-06T02:41:48.239 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.t0IpDsDeq1 2023-10-06T02:41:48.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.t0IpDsDeq1 2023-10-06T02:41:48.314 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.t0IpDsDeq1 2023-10-06T02:41:48.471 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.t0IpDsDeq1 is 6KB 2023-10-06T02:41:48.520 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.t0IpDsDeq1 2023-10-06T02:41:48.534 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:41:48.602 INFO:teuthology.orchestra.run.smithi131.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T02:41:48.602 INFO:teuthology.orchestra.run.smithi131.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T02:41:48.602 INFO:teuthology.orchestra.run.smithi131.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T02:41:48.602 INFO:teuthology.orchestra.run.smithi131.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T02:41:48.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:48.626 INFO:teuthology.orchestra.run.smithi084.stderr:done 2023-10-06T02:41:48.628 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-10-06T02:41:48.642 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.7zDjGCXbjo 2023-10-06T02:41:48.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7zDjGCXbjo 2023-10-06T02:41:48.713 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.7zDjGCXbjo 2023-10-06T02:41:48.766 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2023-10-06T02:41:48.865 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.7zDjGCXbjo is 6KB 2023-10-06T02:41:48.914 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.7zDjGCXbjo 2023-10-06T02:41:48.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:41:49.011 INFO:teuthology.orchestra.run.smithi084.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T02:41:49.011 INFO:teuthology.orchestra.run.smithi084.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T02:41:49.011 INFO:teuthology.orchestra.run.smithi084.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T02:41:49.011 INFO:teuthology.orchestra.run.smithi084.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T02:41:49.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T02:41:49.197 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2023-10-06T02:42:18.794 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T02:42:18.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T02:42:18.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:42:19.201 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T02:42:19.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T02:42:19.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:42:37.310 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-06T02:42:37.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-06T02:42:46.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T02:42:46.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:42:46.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T02:42:46.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:42:49.370 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-06T02:42:49.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-06T02:43:01.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T02:43:01.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:43:01.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T02:43:01.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:43:20.062 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-10-06T02:43:33.433 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-10-06T02:43:33.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T02:43:33.968 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T02:43:33.968 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-10-06T02:43:34.112 INFO:teuthology.orchestra.run.smithi131.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T02:43:34.112 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:43:34.112 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:43:34.112 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T02:43:35.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T02:43:35.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:43:35.120 DEBUG:teuthology.parallel:result is None 2023-10-06T02:43:35.518 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-10-06T02:43:35.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T02:43:35.773 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T02:43:35.773 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-10-06T02:43:35.827 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T02:43:35.828 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T02:43:35.828 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:43:35.828 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T02:43:36.828 DEBUG:teuthology.parallel:result is None 2023-10-06T02:43:36.829 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T02:43:36.836 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T02:43:36.836 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:43:36.878 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:43:37.118 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T02:43:37.128 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T02:43:37.157 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T02:43:37.158 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:43:37.204 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:43:37.511 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T02:43:37.517 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T02:43:37.518 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:43:37.573 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:43:37.643 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:43:37.661 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:43:38.203 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:43:38.470 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:43:38.498 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T02:43:38.506 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T02:43:38.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:43:38.531 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:43:38.773 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T02:43:38.782 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T02:43:38.782 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:43:38.797 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:43:38.811 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:43:38.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:43:38.951 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:43:38.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:43:39.033 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:43:39.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:43:39.097 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:43:39.139 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:43:39.200 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:43:39.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:43:39.281 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:43:39.281 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:43:39.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2023-10-06T02:43:39.347 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2023-10-06T02:43:39.439 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:43:39.591 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:43:39.870 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T02:43:39.879 INFO:teuthology.task.internal:Starting timer... 2023-10-06T02:43:39.879 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T02:43:39.907 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T02:43:39.940 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T02:43:39.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2023-10-06T02:43:40.012 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: [ OK ] 2023-10-06T02:43:40.015 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2023-10-06T02:43:40.073 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: [ OK ] 2023-10-06T02:43:40.075 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T02:43:40.075 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2023-10-06T02:43:40.133 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2023-10-06T02:43:40.133 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2023-10-06T02:43:40.158 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2023-10-06T02:43:40.158 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive'} 2023-10-06T02:43:40.158 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:43:40.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:43:40.184 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:43:40.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:43:40.223 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T02:43:40.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:43:40.249 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:43:40.296 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T02:43:40.308 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T02:43:40.308 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T02:43:40.325 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T02:43:40.326 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T02:52:02.351 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2023-10-06T02:52:02.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T02:52:02.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:52:02.419 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-10-06T02:52:02.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-10-06T02:52:02.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T02:52:02.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:52:02.553 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-10-06T02:52:02.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-06T02:52:02.622 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T02:52:02.633 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T02:52:02.633 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:52:02.634 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:52:02.636 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:52:02.636 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:52:02.663 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T02:52:02.676 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T02:52:02.688 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T02:52:02.702 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T02:52:02.715 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2023-10-06T02:52:02.725 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2023-10-06T02:52:02.736 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2023-10-06T02:52:02.739 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T02:52:02.745 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2023-10-06T02:52:02.752 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T02:52:02.759 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T02:52:02.773 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T02:52:02.818 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2023-10-06T02:52:02.820 INFO:teuthology.orchestra.run.smithi084.stdout:210 Number of sources = 4 2023-10-06T02:52:02.820 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:52:02.820 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-10-06T02:52:02.820 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:52:02.820 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:52:02.821 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:52:02.821 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:52:02.834 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2023-10-06T02:52:02.836 INFO:teuthology.orchestra.run.smithi131.stdout:210 Number of sources = 4 2023-10-06T02:52:02.836 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T02:52:02.836 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-10-06T02:52:02.836 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:52:02.837 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:52:02.837 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:52:02.837 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T02:52:02.838 INFO:teuthology.run_tasks:Running task install... 2023-10-06T02:52:02.845 DEBUG:teuthology.task.install:project ceph 2023-10-06T02:52:02.846 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T02:52:02.846 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T02:52:02.846 INFO:teuthology.task.install:Using flavor: default 2023-10-06T02:52:02.851 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T02:52:02.852 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T02:52:02.852 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T02:52:02.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:52:02.854 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T02:52:02.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:52:03.004 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T02:52:03.004 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T02:52:03.083 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T02:52:03.083 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T02:52:03.173 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T02:52:03.174 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:52:03.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T02:52:03.196 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T02:52:03.196 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:52:03.196 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T02:52:03.198 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T02:52:03.199 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T02:52:03.222 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T02:52:03.223 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T02:52:03.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T02:52:03.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T02:52:03.338 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T02:52:03.363 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T02:52:03.401 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2023-10-06T02:52:03.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2023-10-06T02:52:03.426 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2023-10-06T02:52:03.427 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2023-10-06T02:52:03.792 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T02:52:03.817 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T02:52:04.123 INFO:teuthology.orchestra.run.smithi131.stdout:44 files removed 2023-10-06T02:52:04.568 INFO:teuthology.orchestra.run.smithi084.stdout:44 files removed 2023-10-06T02:52:04.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T02:52:04.569 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T02:52:04.918 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-10-06T02:52:05.038 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-10-06T02:52:05.688 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 250 kB/s | 78 kB 00:00 2023-10-06T02:52:05.982 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 247 kB/s | 78 kB 00:00 2023-10-06T02:52:06.032 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-06T02:52:06.081 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-06T02:52:06.307 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-10-06T02:52:06.413 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 4.8 kB/s | 1.4 kB 00:00 2023-10-06T02:52:06.419 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-06T02:52:06.525 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-06T02:52:07.084 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-10-06T02:52:07.422 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-10-06T02:52:10.369 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 1.6 MB/s | 24 kB 00:00 2023-10-06T02:52:10.740 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-06T02:52:10.749 INFO:teuthology.orchestra.run.smithi084.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 128 MB/s | 38 MB 00:00 2023-10-06T02:52:11.119 INFO:teuthology.orchestra.run.smithi131.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 128 MB/s | 38 MB 00:00 2023-10-06T02:52:16.221 INFO:teuthology.orchestra.run.smithi084.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 116 MB/s | 33 MB 00:00 2023-10-06T02:52:16.649 INFO:teuthology.orchestra.run.smithi131.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 117 MB/s | 33 MB 00:00 2023-10-06T02:52:24.271 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:52:24.271 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:52:24.282 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T02:52:24.283 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T02:52:24.283 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T02:52:24.284 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T02:52:24.286 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T02:52:24.288 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T02:52:24.289 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T02:52:24.486 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:52:24.487 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T02:52:24.498 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T02:52:24.498 INFO:teuthology.orchestra.run.smithi131.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T02:52:24.499 INFO:teuthology.orchestra.run.smithi131.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T02:52:24.500 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T02:52:24.502 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T02:52:24.504 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T02:52:24.505 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T02:52:24.771 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-10-06T02:52:24.782 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================================================== 2023-10-06T02:52:24.782 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2023-10-06T02:52:24.782 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================================================== 2023-10-06T02:52:24.782 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2023-10-06T02:52:24.782 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T02:52:24.782 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T02:52:24.782 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T02:52:24.783 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T02:52:24.784 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2023-10-06T02:52:24.785 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T02:52:24.786 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T02:52:24.787 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T02:52:24.788 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T02:52:24.789 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T02:52:24.790 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T02:52:24.790 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T02:52:24.790 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T02:52:24.790 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T02:52:24.790 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T02:52:24.790 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T02:52:24.790 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:52:24.790 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T02:52:24.790 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T02:52:24.791 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T02:52:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:52:24.793 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2023-10-06T02:52:24.794 INFO:teuthology.orchestra.run.smithi084.stdout:====================================================================================================================== 2023-10-06T02:52:24.794 INFO:teuthology.orchestra.run.smithi084.stdout:Install 118 Packages 2023-10-06T02:52:24.794 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2023-10-06T02:52:24.794 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:52:24.794 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 201 M 2023-10-06T02:52:24.795 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2023-10-06T02:52:24.977 INFO:teuthology.orchestra.run.smithi084.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 42 kB/s | 6.4 kB 00:00 2023-10-06T02:52:24.991 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-10-06T02:52:25.003 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================================== 2023-10-06T02:52:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-10-06T02:52:25.003 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================================== 2023-10-06T02:52:25.003 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2023-10-06T02:52:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T02:52:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T02:52:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T02:52:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T02:52:25.005 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T02:52:25.006 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2023-10-06T02:52:25.007 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T02:52:25.007 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T02:52:25.007 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-10-06T02:52:25.007 INFO:teuthology.orchestra.run.smithi131.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T02:52:25.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T02:52:25.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T02:52:25.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T02:52:25.007 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T02:52:25.008 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T02:52:25.009 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T02:52:25.010 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T02:52:25.011 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T02:52:25.012 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T02:52:25.013 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T02:52:25.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T02:52:25.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T02:52:25.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T02:52:25.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T02:52:25.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T02:52:25.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T02:52:25.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T02:52:25.014 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T02:52:25.014 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T02:52:25.015 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T02:52:25.015 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T02:52:25.015 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T02:52:25.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:52:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-10-06T02:52:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================================== 2023-10-06T02:52:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:Install 118 Packages 2023-10-06T02:52:25.015 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 2 Packages 2023-10-06T02:52:25.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:52:25.016 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 201 M 2023-10-06T02:52:25.016 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-10-06T02:52:25.251 INFO:teuthology.orchestra.run.smithi084.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 3.1 MB/s | 876 kB 00:00 2023-10-06T02:52:25.292 INFO:teuthology.orchestra.run.smithi131.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 49 kB/s | 6.4 kB 00:00 2023-10-06T02:52:25.302 INFO:teuthology.orchestra.run.smithi084.stdout:(3/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 11 MB/s | 5.2 MB 00:00 2023-10-06T02:52:25.303 INFO:teuthology.orchestra.run.smithi084.stdout:(4/120): ceph-immutable-object-cache-17.2.6-129 3.0 MB/s | 162 kB 00:00 2023-10-06T02:52:25.505 INFO:teuthology.orchestra.run.smithi084.stdout:(5/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 11 MB/s | 2.3 MB 00:00 2023-10-06T02:52:25.552 INFO:teuthology.orchestra.run.smithi084.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 6.3 MB/s | 1.6 MB 00:00 2023-10-06T02:52:25.850 INFO:teuthology.orchestra.run.smithi084.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 11 MB/s | 3.9 MB 00:00 2023-10-06T02:52:26.187 INFO:teuthology.orchestra.run.smithi131.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 981 kB/s | 876 kB 00:00 2023-10-06T02:52:26.408 INFO:teuthology.orchestra.run.smithi131.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 729 kB/s | 162 kB 00:00 2023-10-06T02:52:27.088 INFO:teuthology.orchestra.run.smithi131.stdout:(4/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 2.7 MB/s | 5.2 MB 00:01 2023-10-06T02:52:27.426 INFO:teuthology.orchestra.run.smithi131.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 4.7 MB/s | 1.6 MB 00:00 2023-10-06T02:52:27.891 INFO:teuthology.orchestra.run.smithi084.stdout:(8/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 7.1 MB/s | 17 MB 00:02 2023-10-06T02:52:27.989 INFO:teuthology.orchestra.run.smithi131.stdout:(6/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 7.0 MB/s | 3.9 MB 00:00 2023-10-06T02:52:27.996 INFO:teuthology.orchestra.run.smithi131.stdout:(7/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-10-06T02:52:28.007 INFO:teuthology.orchestra.run.smithi084.stdout:(9/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el8 7.8 MB/s | 17 MB 00:02 2023-10-06T02:52:28.008 INFO:teuthology.orchestra.run.smithi084.stdout:(10/120): ceph-selinux-17.2.6-1296.g736ac5ba.el 209 kB/s | 24 kB 00:00 2023-10-06T02:52:28.091 INFO:teuthology.orchestra.run.smithi084.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 3.0 MB/s | 255 kB 00:00 2023-10-06T02:52:28.157 INFO:teuthology.orchestra.run.smithi084.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 381 kB/s | 25 kB 00:00 2023-10-06T02:52:28.300 INFO:teuthology.orchestra.run.smithi084.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 5.4 MB/s | 797 kB 00:00 2023-10-06T02:52:28.371 INFO:teuthology.orchestra.run.smithi084.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.4 MB/s | 174 kB 00:00 2023-10-06T02:52:28.440 INFO:teuthology.orchestra.run.smithi084.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 1.9 MB/s | 130 kB 00:00 2023-10-06T02:52:28.523 INFO:teuthology.orchestra.run.smithi084.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 6.0 MB/s | 507 kB 00:00 2023-10-06T02:52:28.758 INFO:teuthology.orchestra.run.smithi084.stdout:(17/120): ceph-common-17.2.6-1296.g736ac5ba.el8 6.0 MB/s | 23 MB 00:03 2023-10-06T02:52:28.840 INFO:teuthology.orchestra.run.smithi084.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 547 kB/s | 45 kB 00:00 2023-10-06T02:52:28.925 INFO:teuthology.orchestra.run.smithi084.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 1.3 MB/s | 115 kB 00:00 2023-10-06T02:52:29.012 INFO:teuthology.orchestra.run.smithi084.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 2.1 MB/s | 190 kB 00:00 2023-10-06T02:52:29.104 INFO:teuthology.orchestra.run.smithi084.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 3.9 MB/s | 371 kB 00:00 2023-10-06T02:52:29.180 INFO:teuthology.orchestra.run.smithi084.stdout:(22/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 8.5 MB/s | 5.6 MB 00:00 2023-10-06T02:52:29.192 INFO:teuthology.orchestra.run.smithi084.stdout:(23/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 4.0 MB/s | 358 kB 00:00 2023-10-06T02:52:29.241 INFO:teuthology.orchestra.run.smithi084.stdout:(24/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 1.7 MB/s | 107 kB 00:00 2023-10-06T02:52:29.255 INFO:teuthology.orchestra.run.smithi084.stdout:(25/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.4 MB/s | 90 kB 00:00 2023-10-06T02:52:29.343 INFO:teuthology.orchestra.run.smithi084.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 1.9 MB/s | 173 kB 00:00 2023-10-06T02:52:29.426 INFO:teuthology.orchestra.run.smithi084.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 278 kB/s | 23 kB 00:00 2023-10-06T02:52:29.512 INFO:teuthology.orchestra.run.smithi084.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.4 MB/s | 121 kB 00:00 2023-10-06T02:52:29.654 INFO:teuthology.orchestra.run.smithi084.stdout:(29/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 8.4 MB/s | 3.5 MB 00:00 2023-10-06T02:52:29.927 INFO:teuthology.orchestra.run.smithi084.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 4.1 MB/s | 1.7 MB 00:00 2023-10-06T02:52:30.009 INFO:teuthology.orchestra.run.smithi084.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 2.8 MB/s | 238 kB 00:00 2023-10-06T02:52:30.077 INFO:teuthology.orchestra.run.smithi084.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 696 kB/s | 47 kB 00:00 2023-10-06T02:52:30.145 INFO:teuthology.orchestra.run.smithi084.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 217 kB/s | 14 kB 00:00 2023-10-06T02:52:30.222 INFO:teuthology.orchestra.run.smithi084.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.4 MB/s | 267 kB 00:00 2023-10-06T02:52:30.293 INFO:teuthology.orchestra.run.smithi084.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.1 MB/s | 80 kB 00:00 2023-10-06T02:52:30.363 INFO:teuthology.orchestra.run.smithi084.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 259 kB/s | 18 kB 00:00 2023-10-06T02:52:30.423 INFO:teuthology.orchestra.run.smithi084.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 9.6 MB/s | 7.4 MB 00:00 2023-10-06T02:52:30.552 INFO:teuthology.orchestra.run.smithi084.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 457 kB/s | 59 kB 00:00 2023-10-06T02:52:30.564 INFO:teuthology.orchestra.run.smithi084.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2023-10-06T02:52:30.612 INFO:teuthology.orchestra.run.smithi084.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2023-10-06T02:52:30.633 INFO:teuthology.orchestra.run.smithi084.stdout:(41/120): python3-asyncssh-2.7.0-2.el8.noarch.r 6.7 MB/s | 476 kB 00:00 2023-10-06T02:52:30.647 INFO:teuthology.orchestra.run.smithi084.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.2 MB/s | 44 kB 00:00 2023-10-06T02:52:30.670 INFO:teuthology.orchestra.run.smithi084.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 5.0 MB/s | 185 kB 00:00 2023-10-06T02:52:30.676 INFO:teuthology.orchestra.run.smithi131.stdout:(8/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 6.2 MB/s | 17 MB 00:02 2023-10-06T02:52:30.681 INFO:teuthology.orchestra.run.smithi084.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 987 kB/s | 33 kB 00:00 2023-10-06T02:52:30.698 INFO:teuthology.orchestra.run.smithi131.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 1.1 MB/s | 24 kB 00:00 2023-10-06T02:52:30.700 INFO:teuthology.orchestra.run.smithi084.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 545 kB/s | 16 kB 00:00 2023-10-06T02:52:30.735 INFO:teuthology.orchestra.run.smithi084.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 3.1 MB/s | 173 kB 00:00 2023-10-06T02:52:30.742 INFO:teuthology.orchestra.run.smithi084.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 9.0 MB/s | 384 kB 00:00 2023-10-06T02:52:30.772 INFO:teuthology.orchestra.run.smithi084.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 372 kB/s | 11 kB 00:00 2023-10-06T02:52:30.773 INFO:teuthology.orchestra.run.smithi084.stdout:(49/120): python3-google-auth-1.1.1-10.el8.noar 2.1 MB/s | 81 kB 00:00 2023-10-06T02:52:30.802 INFO:teuthology.orchestra.run.smithi084.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 591 kB/s | 18 kB 00:00 2023-10-06T02:52:30.832 INFO:teuthology.orchestra.run.smithi084.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.6 MB/s | 49 kB 00:00 2023-10-06T02:52:30.863 INFO:teuthology.orchestra.run.smithi084.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.9 MB/s | 59 kB 00:00 2023-10-06T02:52:30.888 INFO:teuthology.orchestra.run.smithi084.stdout:(53/120): python3-kubernetes-11.0.0-6.el8.noarc 10 MB/s | 1.2 MB 00:00 2023-10-06T02:52:30.894 INFO:teuthology.orchestra.run.smithi084.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.9 MB/s | 60 kB 00:00 2023-10-06T02:52:30.922 INFO:teuthology.orchestra.run.smithi084.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 8.2 MB/s | 283 kB 00:00 2023-10-06T02:52:30.924 INFO:teuthology.orchestra.run.smithi084.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 524 kB/s | 16 kB 00:00 2023-10-06T02:52:30.953 INFO:teuthology.orchestra.run.smithi084.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.1 MB/s | 34 kB 00:00 2023-10-06T02:52:30.960 INFO:teuthology.orchestra.run.smithi084.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 5.4 MB/s | 196 kB 00:00 2023-10-06T02:52:30.983 INFO:teuthology.orchestra.run.smithi084.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 2.1 MB/s | 64 kB 00:00 2023-10-06T02:52:30.990 INFO:teuthology.orchestra.run.smithi084.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 628 kB/s | 19 kB 00:00 2023-10-06T02:52:31.014 INFO:teuthology.orchestra.run.smithi084.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 772 kB/s | 24 kB 00:00 2023-10-06T02:52:31.021 INFO:teuthology.orchestra.run.smithi084.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 959 kB/s | 29 kB 00:00 2023-10-06T02:52:31.045 INFO:teuthology.orchestra.run.smithi084.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 889 kB/s | 27 kB 00:00 2023-10-06T02:52:31.059 INFO:teuthology.orchestra.run.smithi084.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 6.6 MB/s | 255 kB 00:00 2023-10-06T02:52:31.079 INFO:teuthology.orchestra.run.smithi084.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 7.3 MB/s | 251 kB 00:00 2023-10-06T02:52:31.090 INFO:teuthology.orchestra.run.smithi084.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.9 MB/s | 61 kB 00:00 2023-10-06T02:52:31.110 INFO:teuthology.orchestra.run.smithi084.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 2.7 MB/s | 85 kB 00:00 2023-10-06T02:52:31.120 INFO:teuthology.orchestra.run.smithi084.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 766 kB/s | 23 kB 00:00 2023-10-06T02:52:31.124 INFO:teuthology.orchestra.run.smithi084.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 20 MB/s | 70 kB 00:00 2023-10-06T02:52:31.152 INFO:teuthology.orchestra.run.smithi084.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 666 kB/s | 19 kB 00:00 2023-10-06T02:52:31.165 INFO:teuthology.orchestra.run.smithi084.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.3 MB/s | 43 kB 00:00 2023-10-06T02:52:31.179 INFO:teuthology.orchestra.run.smithi084.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2023-10-06T02:52:31.193 INFO:teuthology.orchestra.run.smithi084.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 15 MB/s | 220 kB 00:00 2023-10-06T02:52:31.203 INFO:teuthology.orchestra.run.smithi084.stdout:(74/120): thrift-0.13.0-2.el8.x86_64.rpm 19 MB/s | 1.7 MB 00:00 2023-10-06T02:52:31.205 INFO:teuthology.orchestra.run.smithi084.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.8 MB/s | 48 kB 00:00 2023-10-06T02:52:31.219 INFO:teuthology.orchestra.run.smithi084.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.1 MB/s | 43 kB 00:00 2023-10-06T02:52:31.235 INFO:teuthology.orchestra.run.smithi084.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.1 MB/s | 229 kB 00:00 2023-10-06T02:52:31.248 INFO:teuthology.orchestra.run.smithi084.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2023-10-06T02:52:31.259 INFO:teuthology.orchestra.run.smithi084.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 59 MB/s | 2.3 MB 00:00 2023-10-06T02:52:31.266 INFO:teuthology.orchestra.run.smithi084.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 32 MB/s | 605 kB 00:00 2023-10-06T02:52:31.273 INFO:teuthology.orchestra.run.smithi084.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.9 MB/s | 83 kB 00:00 2023-10-06T02:52:31.279 INFO:teuthology.orchestra.run.smithi084.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.5 MB/s | 59 kB 00:00 2023-10-06T02:52:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2023-10-06T02:52:31.292 INFO:teuthology.orchestra.run.smithi084.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 3.0 MB/s | 38 kB 00:00 2023-10-06T02:52:31.301 INFO:teuthology.orchestra.run.smithi084.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.1 MB/s | 86 kB 00:00 2023-10-06T02:52:31.305 INFO:teuthology.orchestra.run.smithi084.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2023-10-06T02:52:31.315 INFO:teuthology.orchestra.run.smithi084.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.4 MB/s | 47 kB 00:00 2023-10-06T02:52:31.327 INFO:teuthology.orchestra.run.smithi084.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 26 MB/s | 559 kB 00:00 2023-10-06T02:52:31.335 INFO:teuthology.orchestra.run.smithi084.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 30 MB/s | 639 kB 00:00 2023-10-06T02:52:31.340 INFO:teuthology.orchestra.run.smithi084.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.2 MB/s | 70 kB 00:00 2023-10-06T02:52:31.350 INFO:teuthology.orchestra.run.smithi084.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-06T02:52:31.354 INFO:teuthology.orchestra.run.smithi084.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 6.7 MB/s | 97 kB 00:00 2023-10-06T02:52:31.369 INFO:teuthology.orchestra.run.smithi084.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.1 MB/s | 44 kB 00:00 2023-10-06T02:52:31.381 INFO:teuthology.orchestra.run.smithi084.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.1 MB/s | 27 kB 00:00 2023-10-06T02:52:31.396 INFO:teuthology.orchestra.run.smithi084.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2023-10-06T02:52:31.413 INFO:teuthology.orchestra.run.smithi084.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-06T02:52:31.431 INFO:teuthology.orchestra.run.smithi084.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-10-06T02:52:31.512 INFO:teuthology.orchestra.run.smithi084.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 60 MB/s | 4.8 MB 00:00 2023-10-06T02:52:31.525 INFO:teuthology.orchestra.run.smithi084.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-06T02:52:31.633 INFO:teuthology.orchestra.run.smithi084.stdout:(100/120): python3-scipy-1.0.0-20.module+el8.1. 52 MB/s | 15 MB 00:00 2023-10-06T02:52:31.642 INFO:teuthology.orchestra.run.smithi084.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 5.7 MB/s | 688 kB 00:00 2023-10-06T02:52:31.651 INFO:teuthology.orchestra.run.smithi084.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2023-10-06T02:52:31.659 INFO:teuthology.orchestra.run.smithi084.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 13 MB/s | 225 kB 00:00 2023-10-06T02:52:31.668 INFO:teuthology.orchestra.run.smithi084.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 7.6 MB/s | 126 kB 00:00 2023-10-06T02:52:31.684 INFO:teuthology.orchestra.run.smithi084.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T02:52:31.704 INFO:teuthology.orchestra.run.smithi084.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 27 MB/s | 538 kB 00:00 2023-10-06T02:52:31.722 INFO:teuthology.orchestra.run.smithi084.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 59 MB/s | 3.7 MB 00:00 2023-10-06T02:52:31.726 INFO:teuthology.orchestra.run.smithi084.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-10-06T02:52:31.740 INFO:teuthology.orchestra.run.smithi084.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 8.9 MB/s | 157 kB 00:00 2023-10-06T02:52:31.746 INFO:teuthology.orchestra.run.smithi084.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 5.4 MB/s | 110 kB 00:00 2023-10-06T02:52:31.759 INFO:teuthology.orchestra.run.smithi084.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 1.5 MB/s | 20 kB 00:00 2023-10-06T02:52:31.761 INFO:teuthology.orchestra.run.smithi084.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2023-10-06T02:52:31.775 INFO:teuthology.orchestra.run.smithi084.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.7 MB/s | 54 kB 00:00 2023-10-06T02:52:31.782 INFO:teuthology.orchestra.run.smithi084.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 30 MB/s | 709 kB 00:00 2023-10-06T02:52:31.855 INFO:teuthology.orchestra.run.smithi084.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 60 MB/s | 4.7 MB 00:00 2023-10-06T02:52:31.873 INFO:teuthology.orchestra.run.smithi084.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 51 MB/s | 4.6 MB 00:00 2023-10-06T02:52:31.881 INFO:teuthology.orchestra.run.smithi084.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 27 MB/s | 713 kB 00:00 2023-10-06T02:52:32.603 INFO:teuthology.orchestra.run.smithi084.stdout:(118/120): librados2-17.2.6-1296.g736ac5ba.el8. 4.7 MB/s | 3.5 MB 00:00 2023-10-06T02:52:32.895 INFO:teuthology.orchestra.run.smithi084.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 3.5 MB/s | 3.6 MB 00:01 2023-10-06T02:52:33.671 INFO:teuthology.orchestra.run.smithi084.stdout:(120/120): ceph-test-17.2.6-1296.g736ac5ba.el8. 9.1 MB/s | 52 MB 00:05 2023-10-06T02:52:33.675 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:52:33.676 INFO:teuthology.orchestra.run.smithi084.stdout:Total 23 MB/s | 201 MB 00:08 2023-10-06T02:52:33.704 INFO:teuthology.orchestra.run.smithi131.stdout:(10/120): ceph-common-17.2.6-1296.g736ac5ba.el8 2.7 MB/s | 23 MB 00:08 2023-10-06T02:52:33.728 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2023-10-06T02:52:33.843 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2023-10-06T02:52:33.843 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2023-10-06T02:52:33.845 INFO:teuthology.orchestra.run.smithi131.stdout:(11/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 2.9 MB/s | 17 MB 00:05 2023-10-06T02:52:33.847 INFO:teuthology.orchestra.run.smithi131.stdout:(12/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 1.7 MB/s | 255 kB 00:00 2023-10-06T02:52:33.866 INFO:teuthology.orchestra.run.smithi131.stdout:(13/120): libcephfs-devel-17.2.6-1296.g736ac5ba 1.2 MB/s | 25 kB 00:00 2023-10-06T02:52:33.889 INFO:teuthology.orchestra.run.smithi131.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 7.8 MB/s | 174 kB 00:00 2023-10-06T02:52:33.913 INFO:teuthology.orchestra.run.smithi131.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 5.2 MB/s | 130 kB 00:00 2023-10-06T02:52:33.951 INFO:teuthology.orchestra.run.smithi131.stdout:(16/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 7.5 MB/s | 797 kB 00:00 2023-10-06T02:52:33.989 INFO:teuthology.orchestra.run.smithi131.stdout:(17/120): libradosstriper1-17.2.6-1296.g736ac5b 6.5 MB/s | 507 kB 00:00 2023-10-06T02:52:34.011 INFO:teuthology.orchestra.run.smithi131.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 2.1 MB/s | 45 kB 00:00 2023-10-06T02:52:34.034 INFO:teuthology.orchestra.run.smithi131.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 4.8 MB/s | 115 kB 00:00 2023-10-06T02:52:34.081 INFO:teuthology.orchestra.run.smithi131.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 4.1 MB/s | 190 kB 00:00 2023-10-06T02:52:34.152 INFO:teuthology.orchestra.run.smithi131.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 5.1 MB/s | 371 kB 00:00 2023-10-06T02:52:34.204 INFO:teuthology.orchestra.run.smithi131.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 6.8 MB/s | 358 kB 00:00 2023-10-06T02:52:34.227 INFO:teuthology.orchestra.run.smithi131.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 4.4 MB/s | 107 kB 00:00 2023-10-06T02:52:34.251 INFO:teuthology.orchestra.run.smithi131.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 3.7 MB/s | 90 kB 00:00 2023-10-06T02:52:34.647 INFO:teuthology.orchestra.run.smithi131.stdout:(25/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 8.0 MB/s | 5.6 MB 00:00 2023-10-06T02:52:34.682 INFO:teuthology.orchestra.run.smithi131.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 5.0 MB/s | 173 kB 00:00 2023-10-06T02:52:34.703 INFO:teuthology.orchestra.run.smithi131.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 1.1 MB/s | 23 kB 00:00 2023-10-06T02:52:34.728 INFO:teuthology.orchestra.run.smithi131.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 4.7 MB/s | 121 kB 00:00 2023-10-06T02:52:34.751 INFO:teuthology.orchestra.run.smithi131.stdout:(29/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 6.9 MB/s | 3.5 MB 00:00 2023-10-06T02:52:34.941 INFO:teuthology.orchestra.run.smithi131.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 8.0 MB/s | 1.7 MB 00:00 2023-10-06T02:52:34.991 INFO:teuthology.orchestra.run.smithi131.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 4.7 MB/s | 238 kB 00:00 2023-10-06T02:52:35.014 INFO:teuthology.orchestra.run.smithi131.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 2.1 MB/s | 47 kB 00:00 2023-10-06T02:52:35.035 INFO:teuthology.orchestra.run.smithi131.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 671 kB/s | 14 kB 00:00 2023-10-06T02:52:35.086 INFO:teuthology.orchestra.run.smithi131.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 5.2 MB/s | 267 kB 00:00 2023-10-06T02:52:35.110 INFO:teuthology.orchestra.run.smithi131.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 3.3 MB/s | 80 kB 00:00 2023-10-06T02:52:35.132 INFO:teuthology.orchestra.run.smithi131.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 843 kB/s | 18 kB 00:00 2023-10-06T02:52:35.536 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2023-10-06T02:52:35.540 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2023-10-06T02:52:35.702 INFO:teuthology.orchestra.run.smithi131.stdout:(37/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 10 MB/s | 52 MB 00:05 2023-10-06T02:52:35.845 INFO:teuthology.orchestra.run.smithi131.stdout:(38/120): ceph-mgr-diskprediction-local-17.2.6- 6.8 MB/s | 7.4 MB 00:01 2023-10-06T02:52:36.193 INFO:teuthology.orchestra.run.smithi131.stdout:(39/120): liboath-2.6.2-3.el8.x86_64.rpm 120 kB/s | 59 kB 00:00 2023-10-06T02:52:36.226 INFO:teuthology.orchestra.run.smithi131.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 280 kB/s | 306 kB 00:01 2023-10-06T02:52:36.333 INFO:teuthology.orchestra.run.smithi131.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 409 kB/s | 44 kB 00:00 2023-10-06T02:52:36.359 INFO:teuthology.orchestra.run.smithi131.stdout:(42/120): libunwind-1.3.1-3.el8.x86_64.rpm 146 kB/s | 75 kB 00:00 2023-10-06T02:52:36.472 INFO:teuthology.orchestra.run.smithi131.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-06T02:52:36.483 INFO:teuthology.orchestra.run.smithi131.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 267 kB/s | 33 kB 00:00 2023-10-06T02:52:36.573 INFO:teuthology.orchestra.run.smithi131.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-10-06T02:52:36.589 INFO:teuthology.orchestra.run.smithi131.stdout:(46/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2023-10-06T02:52:36.705 INFO:teuthology.orchestra.run.smithi131.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 699 kB/s | 81 kB 00:00 2023-10-06T02:52:36.710 INFO:teuthology.orchestra.run.smithi131.stdout:(48/120): python3-cheroot-8.5.2-1.el8.noarch.rp 760 kB/s | 173 kB 00:00 2023-10-06T02:52:36.772 INFO:teuthology.orchestra.run.smithi131.stdout:(49/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.9 MB/s | 384 kB 00:00 2023-10-06T02:52:36.803 INFO:teuthology.orchestra.run.smithi131.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 114 kB/s | 11 kB 00:00 2023-10-06T02:52:36.810 INFO:teuthology.orchestra.run.smithi131.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-10-06T02:52:36.905 INFO:teuthology.orchestra.run.smithi131.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 475 kB/s | 49 kB 00:00 2023-10-06T02:52:36.922 INFO:teuthology.orchestra.run.smithi131.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 529 kB/s | 59 kB 00:00 2023-10-06T02:52:37.011 INFO:teuthology.orchestra.run.smithi131.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 573 kB/s | 60 kB 00:00 2023-10-06T02:52:37.062 INFO:teuthology.orchestra.run.smithi131.stdout:(55/120): python3-kubernetes-11.0.0-6.el8.noarc 4.0 MB/s | 1.2 MB 00:00 2023-10-06T02:52:37.094 INFO:teuthology.orchestra.run.smithi131.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-10-06T02:52:37.109 INFO:teuthology.orchestra.run.smithi131.stdout:(57/120): python3-portend-2.6-1.el8.noarch.rpm 159 kB/s | 16 kB 00:00 2023-10-06T02:52:37.161 INFO:teuthology.orchestra.run.smithi131.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 340 kB/s | 34 kB 00:00 2023-10-06T02:52:37.214 INFO:teuthology.orchestra.run.smithi131.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 614 kB/s | 64 kB 00:00 2023-10-06T02:52:37.231 INFO:teuthology.orchestra.run.smithi131.stdout:(60/120): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-10-06T02:52:37.259 INFO:teuthology.orchestra.run.smithi131.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 191 kB/s | 19 kB 00:00 2023-10-06T02:52:37.313 INFO:teuthology.orchestra.run.smithi131.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 242 kB/s | 24 kB 00:00 2023-10-06T02:52:37.332 INFO:teuthology.orchestra.run.smithi131.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 288 kB/s | 29 kB 00:00 2023-10-06T02:52:37.358 INFO:teuthology.orchestra.run.smithi131.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 281 kB/s | 27 kB 00:00 2023-10-06T02:52:37.444 INFO:teuthology.orchestra.run.smithi131.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-10-06T02:52:37.458 INFO:teuthology.orchestra.run.smithi131.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 612 kB/s | 61 kB 00:00 2023-10-06T02:52:37.481 INFO:teuthology.orchestra.run.smithi131.stdout:(67/120): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-10-06T02:52:37.553 INFO:teuthology.orchestra.run.smithi131.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 783 kB/s | 85 kB 00:00 2023-10-06T02:52:37.556 INFO:teuthology.orchestra.run.smithi131.stdout:(69/120): python3-zc-lockfile-2.0-2.el8.noarch. 234 kB/s | 23 kB 00:00 2023-10-06T02:52:37.558 INFO:teuthology.orchestra.run.smithi131.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 14 MB/s | 70 kB 00:00 2023-10-06T02:52:37.590 INFO:teuthology.orchestra.run.smithi131.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 561 kB/s | 19 kB 00:00 2023-10-06T02:52:37.597 INFO:teuthology.orchestra.run.smithi131.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2023-10-06T02:52:37.609 INFO:teuthology.orchestra.run.smithi131.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 8.1 MB/s | 155 kB 00:00 2023-10-06T02:52:37.622 INFO:teuthology.orchestra.run.smithi131.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.6 MB/s | 220 kB 00:00 2023-10-06T02:52:37.626 INFO:teuthology.orchestra.run.smithi131.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.8 MB/s | 48 kB 00:00 2023-10-06T02:52:37.641 INFO:teuthology.orchestra.run.smithi131.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 2.9 MB/s | 43 kB 00:00 2023-10-06T02:52:37.643 INFO:teuthology.orchestra.run.smithi131.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 11 MB/s | 229 kB 00:00 2023-10-06T02:52:37.661 INFO:teuthology.orchestra.run.smithi131.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.0 MB/s | 18 kB 00:00 2023-10-06T02:52:37.686 INFO:teuthology.orchestra.run.smithi131.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 52 MB/s | 2.3 MB 00:00 2023-10-06T02:52:37.691 INFO:teuthology.orchestra.run.smithi131.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 20 MB/s | 605 kB 00:00 2023-10-06T02:52:37.703 INFO:teuthology.orchestra.run.smithi131.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 4.7 MB/s | 83 kB 00:00 2023-10-06T02:52:37.707 INFO:teuthology.orchestra.run.smithi131.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.5 MB/s | 59 kB 00:00 2023-10-06T02:52:37.724 INFO:teuthology.orchestra.run.smithi131.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 8.2 MB/s | 169 kB 00:00 2023-10-06T02:52:37.730 INFO:teuthology.orchestra.run.smithi131.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 1.6 MB/s | 38 kB 00:00 2023-10-06T02:52:37.740 INFO:teuthology.orchestra.run.smithi131.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.2 MB/s | 86 kB 00:00 2023-10-06T02:52:37.748 INFO:teuthology.orchestra.run.smithi131.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.2 MB/s | 58 kB 00:00 2023-10-06T02:52:37.758 INFO:teuthology.orchestra.run.smithi131.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.6 MB/s | 47 kB 00:00 2023-10-06T02:52:37.779 INFO:teuthology.orchestra.run.smithi131.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 18 MB/s | 559 kB 00:00 2023-10-06T02:52:37.794 INFO:teuthology.orchestra.run.smithi131.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 17 MB/s | 639 kB 00:00 2023-10-06T02:52:37.803 INFO:teuthology.orchestra.run.smithi131.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 3.0 MB/s | 70 kB 00:00 2023-10-06T02:52:37.814 INFO:teuthology.orchestra.run.smithi131.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 9.7 MB/s | 200 kB 00:00 2023-10-06T02:52:37.823 INFO:teuthology.orchestra.run.smithi131.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 4.7 MB/s | 97 kB 00:00 2023-10-06T02:52:37.834 INFO:teuthology.orchestra.run.smithi131.stdout:(93/120): thrift-0.13.0-2.el8.x86_64.rpm 4.9 MB/s | 1.7 MB 00:00 2023-10-06T02:52:37.841 INFO:teuthology.orchestra.run.smithi131.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.5 MB/s | 44 kB 00:00 2023-10-06T02:52:37.856 INFO:teuthology.orchestra.run.smithi131.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-10-06T02:52:37.871 INFO:teuthology.orchestra.run.smithi131.stdout:(96/120): python3-jsonpatch-1.21-2.el8.noarch.r 729 kB/s | 27 kB 00:00 2023-10-06T02:52:37.878 INFO:teuthology.orchestra.run.smithi131.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 14 MB/s | 320 kB 00:00 2023-10-06T02:52:37.896 INFO:teuthology.orchestra.run.smithi131.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 18 MB/s | 457 kB 00:00 2023-10-06T02:52:37.915 INFO:teuthology.orchestra.run.smithi131.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.0 MB/s | 39 kB 00:00 2023-10-06T02:52:37.943 INFO:teuthology.orchestra.run.smithi131.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2023-10-06T02:52:37.971 INFO:teuthology.orchestra.run.smithi131.stdout:(101/120): python3-babel-2.5.1-5.el8.noarch.rpm 52 MB/s | 4.8 MB 00:00 2023-10-06T02:52:37.974 INFO:teuthology.orchestra.run.smithi131.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 8.2 MB/s | 259 kB 00:00 2023-10-06T02:52:37.995 INFO:teuthology.orchestra.run.smithi131.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.6 MB/s | 225 kB 00:00 2023-10-06T02:52:37.995 INFO:teuthology.orchestra.run.smithi131.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 5.9 MB/s | 126 kB 00:00 2023-10-06T02:52:38.011 INFO:teuthology.orchestra.run.smithi131.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T02:52:38.114 INFO:teuthology.orchestra.run.smithi131.stdout:(106/120): python3-scipy-1.0.0-20.module+el8.1. 49 MB/s | 15 MB 00:00 2023-10-06T02:52:38.122 INFO:teuthology.orchestra.run.smithi131.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 4.7 MB/s | 538 kB 00:00 2023-10-06T02:52:38.132 INFO:teuthology.orchestra.run.smithi131.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 16 MB/s | 302 kB 00:00 2023-10-06T02:52:38.136 INFO:teuthology.orchestra.run.smithi131.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-10-06T02:52:38.146 INFO:teuthology.orchestra.run.smithi131.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 8.2 MB/s | 110 kB 00:00 2023-10-06T02:52:38.162 INFO:teuthology.orchestra.run.smithi131.stdout:(111/120): python3-numpy-1.14.3-9.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-10-06T02:52:38.162 INFO:teuthology.orchestra.run.smithi131.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.2 MB/s | 20 kB 00:00 2023-10-06T02:52:38.165 INFO:teuthology.orchestra.run.smithi131.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 12 MB/s | 353 kB 00:00 2023-10-06T02:52:38.178 INFO:teuthology.orchestra.run.smithi131.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.5 MB/s | 54 kB 00:00 2023-10-06T02:52:38.187 INFO:teuthology.orchestra.run.smithi131.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 28 MB/s | 709 kB 00:00 2023-10-06T02:52:38.213 INFO:teuthology.orchestra.run.smithi131.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 27 MB/s | 713 kB 00:00 2023-10-06T02:52:38.246 INFO:teuthology.orchestra.run.smithi131.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 58 MB/s | 4.7 MB 00:00 2023-10-06T02:52:38.267 INFO:teuthology.orchestra.run.smithi131.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 52 MB/s | 4.6 MB 00:00 2023-10-06T02:52:39.361 INFO:teuthology.orchestra.run.smithi131.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 3.2 MB/s | 3.6 MB 00:01 2023-10-06T02:52:39.692 INFO:teuthology.orchestra.run.smithi131.stdout:(120/120): librados2-17.2.6-1296.g736ac5ba.el8. 2.3 MB/s | 3.5 MB 00:01 2023-10-06T02:52:39.698 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:52:39.699 INFO:teuthology.orchestra.run.smithi131.stdout:Total 14 MB/s | 201 MB 00:14 2023-10-06T02:52:39.749 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-10-06T02:52:39.862 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-10-06T02:52:39.862 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-10-06T02:52:40.202 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2023-10-06T02:52:40.460 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T02:52:40.631 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:52:40.771 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:52:40.972 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:52:41.381 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:52:41.580 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:52:41.608 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-10-06T02:52:41.613 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-10-06T02:52:41.966 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:52:42.188 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:52:42.297 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:52:42.505 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:52:42.584 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:52:42.801 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:52:43.110 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T02:52:43.790 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T02:52:43.963 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:52:44.124 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:52:44.350 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T02:52:44.545 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T02:52:44.721 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:52:44.858 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:52:45.036 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:52:45.136 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:52:45.308 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T02:52:45.592 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T02:52:45.861 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T02:52:46.041 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T02:52:46.086 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-10-06T02:52:46.221 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:52:46.314 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T02:52:46.353 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:52:46.537 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:52:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:52:46.673 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T02:52:46.880 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:52:47.088 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:52:47.249 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T02:52:47.287 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:52:47.447 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:52:47.821 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:52:47.850 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:52:48.012 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:52:48.089 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:52:48.223 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T02:52:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:52:48.501 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:52:48.714 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:52:48.739 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:52:49.015 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T02:52:49.053 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T02:52:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T02:52:49.528 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T02:52:49.685 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T02:52:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T02:52:49.848 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T02:52:49.905 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:52:50.002 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:52:50.060 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T02:52:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T02:52:50.342 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T02:52:50.445 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T02:52:50.653 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T02:52:50.671 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:52:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:52:50.903 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:52:50.962 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:52:51.061 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T02:52:51.243 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T02:52:51.512 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T02:52:51.737 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T02:52:51.919 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T02:52:52.063 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:52:52.194 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T02:52:52.729 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:52:52.974 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:52:53.268 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T02:52:53.343 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T02:52:53.463 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:52:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T02:52:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:52:54.352 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T02:52:54.698 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T02:52:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T02:52:54.947 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T02:52:55.165 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T02:52:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T02:52:55.380 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T02:52:55.490 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T02:52:55.612 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T02:52:55.774 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T02:52:55.792 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T02:52:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T02:52:56.077 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T02:52:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T02:52:56.317 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T02:52:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T02:52:56.493 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T02:52:56.652 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T02:52:56.707 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T02:52:56.888 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T02:52:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T02:52:57.068 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:52:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:52:57.148 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:52:57.327 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T02:52:57.482 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T02:52:57.676 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T02:52:57.840 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T02:52:58.037 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T02:52:58.204 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T02:52:58.373 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T02:52:58.577 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T02:52:58.780 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T02:52:59.114 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T02:52:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T02:52:59.389 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T02:52:59.578 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T02:52:59.665 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T02:52:59.928 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T02:53:00.110 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T02:53:00.272 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T02:53:00.514 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T02:53:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T02:53:00.784 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T02:53:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T02:53:01.000 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T02:53:01.150 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T02:53:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T02:53:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T02:53:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T02:53:01.501 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T02:53:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T02:53:01.738 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T02:53:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T02:53:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T02:53:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T02:53:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T02:53:02.348 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T02:53:02.393 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T02:53:02.574 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T02:53:02.610 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T02:53:02.796 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T02:53:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T02:53:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T02:53:03.026 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T02:53:03.232 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T02:53:03.307 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T02:53:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:53:03.513 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T02:53:03.541 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T02:53:03.678 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T02:53:03.749 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T02:53:03.836 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T02:53:03.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T02:53:04.001 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T02:53:04.174 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T02:53:04.388 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T02:53:04.556 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T02:53:04.698 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T02:53:04.909 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T02:53:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T02:53:05.122 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T02:53:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T02:53:05.428 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T02:53:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T02:53:05.692 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T02:53:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T02:53:05.983 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T02:53:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T02:53:06.263 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T02:53:06.411 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T02:53:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T02:53:06.623 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T02:53:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T02:53:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T02:53:07.041 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T02:53:07.103 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T02:53:07.233 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T02:53:07.276 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T02:53:07.482 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T02:53:07.646 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T02:53:07.844 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T02:53:08.056 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T02:53:08.321 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T02:53:08.547 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T02:53:08.716 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T02:53:08.955 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T02:53:09.189 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T02:53:09.399 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T02:53:09.680 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T02:53:09.951 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T02:53:10.159 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T02:53:10.435 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T02:53:11.639 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T02:53:11.949 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T02:53:12.222 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T02:53:12.291 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:53:12.524 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:53:12.550 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T02:53:12.861 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T02:53:13.105 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:53:13.236 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T02:53:13.407 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:53:13.489 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T02:53:13.499 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:53:13.623 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:53:13.727 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T02:53:13.960 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T02:53:18.945 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:53:19.209 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:53:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T02:53:20.073 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:53:20.161 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T02:53:20.308 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:53:31.286 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:53:31.286 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2023-10-06T02:53:31.286 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2023-10-06T02:53:31.286 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-10-06T02:53:31.286 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /run 2023-10-06T02:53:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2023-10-06T02:53:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2023-10-06T02:53:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2023-10-06T02:53:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2023-10-06T02:53:31.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-10-06T02:53:31.287 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:53:31.653 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:53:33.141 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:53:33.327 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:53:33.556 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:53:33.727 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:53:34.126 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:53:34.302 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:53:34.319 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:53:37.185 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:53:37.329 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:53:37.491 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T02:53:37.725 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T02:53:37.925 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:53:38.049 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T02:53:38.049 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2023-10-06T02:53:38.050 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2023-10-06T02:53:38.050 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-10-06T02:53:38.050 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /run 2023-10-06T02:53:38.050 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2023-10-06T02:53:38.050 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2023-10-06T02:53:38.050 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2023-10-06T02:53:38.050 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2023-10-06T02:53:38.050 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-10-06T02:53:38.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:53:38.139 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:53:38.359 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:53:38.423 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:53:39.327 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:53:39.509 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:53:39.607 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:53:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T02:53:39.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T02:53:40.094 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:53:40.126 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:53:40.162 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:53:40.325 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T02:53:40.326 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:53:40.336 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:53:40.489 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:53:40.911 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T02:53:41.089 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:53:41.106 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T02:53:41.938 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T02:53:42.150 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:53:42.227 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:53:42.384 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:53:42.427 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:53:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:53:42.939 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:53:43.117 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:53:43.895 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:53:44.147 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T02:53:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T02:53:44.473 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T02:53:44.671 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:53:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T02:53:45.102 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:53:46.078 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T02:53:46.288 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:53:46.389 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T02:53:46.774 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T02:53:46.977 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:53:47.014 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T02:53:47.221 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:53:47.232 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T02:53:48.024 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:53:48.825 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T02:53:48.984 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T02:53:49.101 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:53:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T02:53:49.313 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T02:53:49.429 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:53:49.473 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T02:53:49.492 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T02:53:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:53:49.753 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T02:53:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:53:49.909 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:53:49.995 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T02:53:50.086 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T02:53:50.228 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T02:53:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:53:50.390 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T02:53:50.555 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T02:53:50.815 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T02:53:51.031 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:53:51.083 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:53:51.248 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:53:51.256 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:53:51.417 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T02:53:51.417 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:53:51.601 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:53:51.601 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:53:52.534 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:53:52.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T02:53:52.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T02:53:52.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T02:53:52.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T02:53:52.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T02:53:52.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T02:53:52.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T02:53:52.541 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T02:53:52.542 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T02:53:52.543 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T02:53:52.544 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T02:53:54.747 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:53:54.748 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:38 ago on Fri 06 Oct 2023 02:52:16 AM UTC. 2023-10-06T02:53:55.168 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T02:53:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T02:53:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T02:53:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T02:53:56.828 INFO:teuthology.orchestra.run.smithi084.stdout:Installed products updated. 2023-10-06T02:53:56.958 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.959 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.960 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T02:53:56.961 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T02:53:56.962 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.5-12.el8.x86_64 2023-10-06T02:53:56.962 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T02:53:56.962 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T02:53:56.962 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T02:53:56.962 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.962 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.962 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.962 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T02:53:56.962 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T02:53:56.963 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T02:53:56.964 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T02:53:56.964 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T02:53:56.964 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T02:53:56.964 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T02:53:56.964 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T02:53:56.964 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T02:53:56.964 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T02:53:56.965 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T02:53:56.965 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T02:53:56.965 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T02:53:56.965 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T02:53:56.965 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T02:53:56.965 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T02:53:56.965 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T02:53:56.965 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T02:53:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T02:53:56.967 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T02:53:56.967 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T02:53:56.967 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T02:53:56.967 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T02:53:56.967 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T02:53:56.967 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T02:53:56.967 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T02:53:56.968 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T02:53:56.969 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T02:53:56.970 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T02:53:56.971 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T02:53:56.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:53:56.971 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-10-06T02:53:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T02:53:57.227 DEBUG:teuthology.parallel:result is None 2023-10-06T02:53:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:53:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T02:53:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T02:53:57.557 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T02:53:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T02:53:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T02:53:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T02:53:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:53:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T02:53:58.627 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:53:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T02:53:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T02:53:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:53:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T02:53:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:53:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T02:53:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T02:53:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T02:53:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T02:53:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T02:53:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T02:53:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T02:53:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T02:53:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T02:53:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T02:53:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T02:53:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T02:53:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T02:53:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T02:53:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T02:53:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T02:54:02.054 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T02:54:02.054 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:46 ago on Fri 06 Oct 2023 02:52:16 AM UTC. 2023-10-06T02:54:04.022 INFO:teuthology.orchestra.run.smithi131.stdout:Installed products updated. 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.216 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.217 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T02:54:04.218 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: jq-1.5-12.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T02:54:04.219 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T02:54:04.220 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.221 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T02:54:04.222 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T02:54:04.223 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T02:54:04.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T02:54:04.225 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T02:54:04.226 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T02:54:04.226 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T02:54:04.226 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T02:54:04.226 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T02:54:04.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:04.226 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-10-06T02:54:04.482 DEBUG:teuthology.parallel:result is None 2023-10-06T02:54:04.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:54:04.622 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T02:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T02:54:04.647 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T02:54:04.647 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T02:54:04.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:54:04.796 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T02:54:04.817 INFO:teuthology.orchestra.run.smithi131.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T02:54:04.817 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T02:54:04.817 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T02:54:04.817 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T02:54:04.818 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:04.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:54:04.859 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:04.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:54:04.898 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T02:54:04.898 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:04.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:54:04.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:54:04.990 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:04.991 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:54:05.015 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:54:05.080 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T02:54:05.080 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:05.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:54:05.104 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:54:05.169 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:05.169 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:54:05.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:54:05.258 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T02:54:05.258 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:05.258 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:54:05.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:54:05.346 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:05.347 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:54:05.370 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:54:05.434 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T02:54:05.498 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T02:54:05.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2023-10-06T02:54:05.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2023-10-06T02:54:05.525 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T02:54:05.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:54:05.565 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:54:05.590 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T02:54:05.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:54:05.630 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:54:05.675 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T02:54:05.676 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T02:54:05.676 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T02:54:05.676 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:05.676 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:54:05.724 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:05.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:05.858 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:05.858 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:54:05.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:05.984 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:06.014 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T02:54:06.014 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Scrub error on inode'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T02:54:06.015 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412169', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Scrub error on inode'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBITBtx/bAIfyuUxsJSZLm5tJ/nDGLxprgfTsd+TBPEy+03FL+DlHWu+7cPjzJhjwdIafE1YdQgc72qKkxh3BDiA=', 'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBOUjOfNyhN4aTGrezCVYR0S/G4/6ct0vMeX2ZhrQNTNb8jS0cORCRQAZu85HmmxslxEVey2UnGO2BuePk6ORJ8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_multimds_misc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T02:54:06.015 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:54:06.017 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:54:06.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:54:06.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:54:06.127 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:06.127 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:54:06.150 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:54:06.150 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2023-10-06T02:54:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:54:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:54:06.205 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 219558 Links: 1 2023-10-06T02:54:06.206 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:54:06.206 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:54:06.206 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-10-06 02:53:52.067431068 +0000 2023-10-06T02:54:06.206 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-10-06 02:51:30.915579206 +0000 2023-10-06T02:54:06.206 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-10-06 02:51:30.915579206 +0000 2023-10-06T02:54:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-10-06T02:54:06.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:54:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-10-06T02:54:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-10-06T02:54:06.269 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000248122 s, 2.1 MB/s 2023-10-06T02:54:06.269 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:54:06.325 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2023-10-06T02:54:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:54:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:54:06.380 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 219600 Links: 1 2023-10-06T02:54:06.380 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:54:06.380 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:54:06.380 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-10-06 02:53:52.067431068 +0000 2023-10-06T02:54:06.381 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-10-06 02:51:31.414571046 +0000 2023-10-06T02:54:06.381 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-10-06 02:51:31.414571046 +0000 2023-10-06T02:54:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-10-06T02:54:06.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:54:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-10-06T02:54:06.443 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-10-06T02:54:06.443 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000244418 s, 2.1 MB/s 2023-10-06T02:54:06.444 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:54:06.499 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2023-10-06T02:54:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:54:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:54:06.553 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 219760 Links: 1 2023-10-06T02:54:06.553 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:54:06.553 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:54:06.553 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-10-06 02:53:52.067431068 +0000 2023-10-06T02:54:06.553 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-10-06 02:51:31.932562575 +0000 2023-10-06T02:54:06.553 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-10-06 02:51:31.932562575 +0000 2023-10-06T02:54:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-10-06T02:54:06.554 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:54:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-10-06T02:54:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-10-06T02:54:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000252699 s, 2.0 MB/s 2023-10-06T02:54:06.617 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:54:06.673 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2023-10-06T02:54:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:54:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:54:06.728 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 213998 Links: 1 2023-10-06T02:54:06.728 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:54:06.728 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:54:06.728 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-10-06 02:53:52.067431068 +0000 2023-10-06T02:54:06.729 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-10-06 02:51:32.433554383 +0000 2023-10-06T02:54:06.729 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-10-06 02:51:32.433554383 +0000 2023-10-06T02:54:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-10-06T02:54:06.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:54:06.791 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-10-06T02:54:06.791 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-10-06T02:54:06.791 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000195852 s, 2.6 MB/s 2023-10-06T02:54:06.792 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:54:06.848 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:06.848 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:06.848 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:54:06.865 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:54:06.866 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2023-10-06T02:54:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:54:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:54:06.922 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 214732 Links: 1 2023-10-06T02:54:06.922 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:54:06.923 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:54:06.923 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-10-06 02:53:59.469439147 +0000 2023-10-06T02:54:06.923 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-10-06 02:51:30.908851004 +0000 2023-10-06T02:54:06.923 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-10-06 02:51:30.908851004 +0000 2023-10-06T02:54:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-10-06T02:54:06.923 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:54:06.989 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-10-06T02:54:06.989 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-10-06T02:54:06.989 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000301029 s, 1.7 MB/s 2023-10-06T02:54:06.990 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:54:07.048 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2023-10-06T02:54:07.105 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:54:07.105 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:54:07.105 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 217039 Links: 1 2023-10-06T02:54:07.105 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:54:07.105 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:54:07.105 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-10-06 02:53:59.469439147 +0000 2023-10-06T02:54:07.105 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-10-06 02:51:31.391840732 +0000 2023-10-06T02:54:07.106 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-10-06 02:51:31.391840732 +0000 2023-10-06T02:54:07.106 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-10-06T02:54:07.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:54:07.171 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-10-06T02:54:07.172 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-10-06T02:54:07.172 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000318075 s, 1.6 MB/s 2023-10-06T02:54:07.173 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:54:07.230 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2023-10-06T02:54:07.287 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:54:07.287 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:54:07.287 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 220013 Links: 1 2023-10-06T02:54:07.287 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:54:07.287 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:54:07.287 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-10-06 02:53:59.469439147 +0000 2023-10-06T02:54:07.287 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-10-06 02:51:31.883830268 +0000 2023-10-06T02:54:07.288 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-10-06 02:51:31.883830268 +0000 2023-10-06T02:54:07.288 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-10-06T02:54:07.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:54:07.353 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-10-06T02:54:07.353 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-10-06T02:54:07.353 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000265958 s, 1.9 MB/s 2023-10-06T02:54:07.354 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:54:07.411 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2023-10-06T02:54:07.467 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:54:07.467 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:54:07.468 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 220072 Links: 1 2023-10-06T02:54:07.468 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:54:07.468 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T02:54:07.468 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-10-06 02:53:59.469439147 +0000 2023-10-06T02:54:07.468 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-10-06 02:51:32.393819422 +0000 2023-10-06T02:54:07.468 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-10-06 02:51:32.393819422 +0000 2023-10-06T02:54:07.468 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-10-06T02:54:07.468 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:54:07.531 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-10-06T02:54:07.531 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-10-06T02:54:07.531 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000199792 s, 2.6 MB/s 2023-10-06T02:54:07.532 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:54:07.588 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:07.588 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:54:07.588 INFO:tasks.ceph:Generating config... 2023-10-06T02:54:07.589 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T02:54:07.590 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T02:54:07.590 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T02:54:07.590 INFO:tasks.ceph:[client] pid file = 2023-10-06T02:54:07.590 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T02:54:07.590 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T02:54:07.590 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T02:54:07.590 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T02:54:07.590 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T02:54:07.590 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T02:54:07.591 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T02:54:07.592 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T02:54:07.592 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T02:54:07.593 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T02:54:07.593 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T02:54:07.593 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T02:54:07.593 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T02:54:07.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T02:54:07.646 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T02:54:07.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T02:54:07.686 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:54:07.750 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.b', '172.21.15.131'), ('mon.c', '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]')] 2023-10-06T02:54:07.751 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T02:54:07.752 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:07.752 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:54:07.805 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --add b 172.21.15.131 --addv c '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:07.886 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:07.886 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid 3949ddc0-2086-4c8d-802f-a1ccf3555047 2023-10-06T02:54:07.886 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = octopus 2023-10-06T02:54:07.886 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2023-10-06T02:54:07.886 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 3949ddc0-2086-4c8d-802f-a1ccf3555047 2023-10-06T02:54:07.886 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2023-10-06T02:54:07.885779+0000 2023-10-06T02:54:07.886 INFO:teuthology.orchestra.run.smithi084.stdout:created 2023-10-06T02:54:07.885779+0000 2023-10-06T02:54:07.886 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 15 (octopus) 2023-10-06T02:54:07.887 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2023-10-06T02:54:07.887 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2023-10-06T02:54:07.887 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2023-10-06T02:54:07.887 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-10-06T02:54:07.887 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T02:54:07.888 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:54:07.943 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3949ddc0-2086-4c8d-802f-a1ccf3555047... 2023-10-06T02:54:07.944 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:54:07.985 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:54:08.025 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2023-10-06T02:54:08.025 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2023-10-06T02:54:08.025 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:54:08.025 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2023-10-06T02:54:08.025 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.025 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2023-10-06T02:54:08.025 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.026 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2023-10-06T02:54:08.027 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2023-10-06T02:54:08.028 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on skipped message = False 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 3949ddc0-2086-4c8d-802f-a1ccf3555047 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.029 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.030 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2023-10-06T02:54:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2023-10-06T02:54:08.032 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2023-10-06T02:54:08.033 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:54:08.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2023-10-06T02:54:08.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-10-06T02:54:08.036 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2023-10-06T02:54:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2023-10-06T02:54:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-10-06T02:54:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-10-06T02:54:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-10-06T02:54:08.038 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2023-10-06T02:54:08.038 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2023-10-06T02:54:08.039 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:54:08.039 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2023-10-06T02:54:08.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.039 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2023-10-06T02:54:08.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.039 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2023-10-06T02:54:08.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.039 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2023-10-06T02:54:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.042 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:54:08.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.042 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2023-10-06T02:54:08.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.042 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2023-10-06T02:54:08.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.043 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2023-10-06T02:54:08.043 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2023-10-06T02:54:08.043 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2023-10-06T02:54:08.043 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.84,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on skipped message = False 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 3949ddc0-2086-4c8d-802f-a1ccf3555047 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2023-10-06T02:54:08.044 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2023-10-06T02:54:08.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 20 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 20 2023-10-06T02:54:08.046 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 10 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T02:54:08.047 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2023-10-06T02:54:08.048 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:54:08.049 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2023-10-06T02:54:08.050 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = "" 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2023-10-06T02:54:08.051 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-10-06T02:54:08.052 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-10-06T02:54:08.054 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T02:54:08.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T02:54:08.143 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T02:54:08.144 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:08.144 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T02:54:08.158 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:08.158 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T02:54:08.214 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:54:08.214 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:08.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:54:08.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:54:08.288 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:08.288 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:08.343 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T02:54:08.343 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:08.343 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:54:08.343 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:54:08.377 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:08.377 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:08.432 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T02:54:08.432 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T02:54:08.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:54:08.479 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:54:08.482 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:54:08.560 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:54:08.563 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T02:54:08.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:54:08.610 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:54:08.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T02:54:08.637 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:54:08.725 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:54:08.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T02:54:08.751 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:54:08.799 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:54:08.801 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T02:54:08.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:54:08.913 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:54:08.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T02:54:08.940 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T02:54:08.940 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T02:54:08.977 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T02:54:08.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T02:54:09.067 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T02:54:09.079 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T02:54:09.117 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T02:54:09.130 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T02:54:09.208 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T02:54:09.220 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T02:54:09.220 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:54:09.221 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T02:54:09.245 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:09.245 INFO:tasks.ceph:role: osd.0 2023-10-06T02:54:09.245 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:54:09.245 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:54:09.317 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:54:09.317 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:54:09.317 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:54:09.317 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2023-10-06T02:54:09.317 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:54:09.317 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:54:09.317 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:54:09.318 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:54:09.318 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:54:09.318 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:54:09.751 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-10-06T02:54:09.753 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-10-06T02:54:09.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T02:54:09.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T02:54:09.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T02:54:10.023 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:10.023 INFO:tasks.ceph:role: osd.1 2023-10-06T02:54:10.023 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:54:10.024 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:54:10.094 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:54:10.095 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:54:10.095 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:54:10.095 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2023-10-06T02:54:10.095 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:54:10.096 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:54:10.096 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:54:10.096 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:54:10.096 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:54:10.096 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:54:10.521 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-10-06T02:54:10.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-10-06T02:54:10.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T02:54:10.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T02:54:10.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T02:54:10.720 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:10.721 INFO:tasks.ceph:role: osd.2 2023-10-06T02:54:10.721 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:54:10.721 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:54:10.792 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:54:10.792 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:54:10.792 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:54:10.792 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2023-10-06T02:54:10.793 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:54:10.793 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:54:10.793 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:54:10.793 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:54:10.793 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:54:10.793 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:54:11.240 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-10-06T02:54:11.242 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-10-06T02:54:11.242 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T02:54:11.386 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T02:54:11.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T02:54:11.478 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:11.478 INFO:tasks.ceph:role: osd.3 2023-10-06T02:54:11.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:54:11.479 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:54:11.550 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:54:11.550 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:54:11.550 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:54:11.550 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2023-10-06T02:54:11.550 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:54:11.551 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:54:11.551 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:54:11.551 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:54:11.552 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:54:11.552 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:54:11.989 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-10-06T02:54:11.991 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-10-06T02:54:11.991 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T02:54:12.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T02:54:12.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:12.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:12.554+0000 7fb215fa7540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T02:54:12.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:12.554+0000 7fb215fa7540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T02:54:12.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:12.554+0000 7fb215fa7540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:54:12.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:12.554+0000 7fb215fa7540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:54:12.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:12.554+0000 7fb215fa7540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:54:12.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:12.555+0000 7fb215fa7540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T02:54:13.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:13.083+0000 7fb215fa7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:13.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:13.847+0000 7fb215fa7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:14.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:14.608+0000 7fb215fa7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:15.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T02:54:15.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:15.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:15.514+0000 7f82f5d21540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T02:54:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:15.514+0000 7f82f5d21540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T02:54:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:15.514+0000 7f82f5d21540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:54:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:15.514+0000 7f82f5d21540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:54:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:15.514+0000 7f82f5d21540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T02:54:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:15.515+0000 7f82f5d21540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T02:54:16.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:16.038+0000 7f82f5d21540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:16.801+0000 7f82f5d21540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:17.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:17.567+0000 7f82f5d21540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:18.359 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T02:54:18.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:18.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:18.507+0000 7fe8267d0540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T02:54:18.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:18.507+0000 7fe8267d0540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T02:54:18.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:18.507+0000 7fe8267d0540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:54:18.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:18.507+0000 7fe8267d0540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:54:18.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:18.507+0000 7fe8267d0540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T02:54:18.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:18.508+0000 7fe8267d0540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T02:54:19.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:19.035+0000 7fe8267d0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:19.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:19.800+0000 7fe8267d0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:20.564+0000 7fe8267d0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:21.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T02:54:21.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:21.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:21.510+0000 7fdeb09ff540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T02:54:21.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:21.510+0000 7fdeb09ff540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T02:54:21.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:21.510+0000 7fdeb09ff540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:54:21.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:21.510+0000 7fdeb09ff540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:54:21.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:21.510+0000 7fdeb09ff540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T02:54:21.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:21.511+0000 7fdeb09ff540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T02:54:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:22.034+0000 7fdeb09ff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:22.800+0000 7fdeb09ff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:23.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:23.566+0000 7fdeb09ff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:24.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T02:54:24.385 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T02:54:24.413 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:24.413 INFO:tasks.ceph:role: osd.4 2023-10-06T02:54:24.413 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T02:54:24.413 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:54:24.485 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:54:24.486 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:54:24.486 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:54:24.486 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 2023-10-06T02:54:24.486 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:54:24.486 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:54:24.486 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:54:24.486 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:54:24.486 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:54:24.486 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:54:24.913 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-10-06T02:54:24.916 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-10-06T02:54:24.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T02:54:25.078 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T02:54:25.118 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T02:54:25.184 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:25.184 INFO:tasks.ceph:role: osd.5 2023-10-06T02:54:25.184 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T02:54:25.184 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:54:25.256 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:54:25.256 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:54:25.257 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:54:25.257 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 2023-10-06T02:54:25.257 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:54:25.257 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:54:25.257 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:54:25.257 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:54:25.257 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:54:25.257 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:54:25.682 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-10-06T02:54:25.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-10-06T02:54:25.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T02:54:25.795 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T02:54:25.826 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T02:54:25.892 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:25.892 INFO:tasks.ceph:role: osd.6 2023-10-06T02:54:25.892 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T02:54:25.892 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:54:25.965 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:54:25.966 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:54:25.966 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:54:25.966 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 2023-10-06T02:54:25.966 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:54:25.966 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:54:25.966 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:54:25.966 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:54:25.966 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:54:25.966 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:54:26.415 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-10-06T02:54:26.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-10-06T02:54:26.419 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T02:54:26.588 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T02:54:26.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T02:54:26.689 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:54:26.689 INFO:tasks.ceph:role: osd.7 2023-10-06T02:54:26.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T02:54:26.690 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:54:26.764 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:54:26.764 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:54:26.764 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:54:26.764 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 2023-10-06T02:54:26.765 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:54:26.765 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:54:26.765 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:54:26.765 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:54:26.765 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:54:26.765 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:54:27.199 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-10-06T02:54:27.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-10-06T02:54:27.202 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T02:54:27.366 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T02:54:27.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:27.666 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:27.664+0000 7f24979a7540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T02:54:27.666 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:27.664+0000 7f24979a7540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T02:54:27.666 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:27.664+0000 7f24979a7540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:54:27.666 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:27.664+0000 7f24979a7540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:54:27.666 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:27.664+0000 7f24979a7540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T02:54:27.667 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:27.665+0000 7f24979a7540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T02:54:28.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:28.188+0000 7f24979a7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:28.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:28.952+0000 7f24979a7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:29.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:29.715+0000 7f24979a7540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:30.513 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T02:54:30.539 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:30.622 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:30.620+0000 7f6aa11c3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T02:54:30.623 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:30.621+0000 7f6aa11c3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T02:54:30.623 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:30.621+0000 7f6aa11c3540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:54:30.623 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:30.621+0000 7f6aa11c3540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:54:30.623 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:30.621+0000 7f6aa11c3540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T02:54:30.623 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:30.621+0000 7f6aa11c3540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T02:54:31.146 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:31.145+0000 7f6aa11c3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:31.909 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:31.908+0000 7f6aa11c3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:32.672 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:32.670+0000 7f6aa11c3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:33.464 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T02:54:33.533 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:33.619 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:33.617+0000 7f98ec3ee540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T02:54:33.619 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:33.617+0000 7f98ec3ee540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T02:54:33.619 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:33.617+0000 7f98ec3ee540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:54:33.619 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:33.617+0000 7f98ec3ee540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:54:33.619 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:33.617+0000 7f98ec3ee540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T02:54:33.620 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:33.618+0000 7f98ec3ee540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T02:54:34.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:34.146+0000 7f98ec3ee540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:34.911 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:34.910+0000 7f98ec3ee540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:35.674 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:35.673+0000 7f98ec3ee540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:36.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:36.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:54:36.472 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T02:54:36.498 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:36.581 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:36.579+0000 7f76168f4540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T02:54:36.581 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:36.579+0000 7f76168f4540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T02:54:36.581 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:36.579+0000 7f76168f4540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:54:36.581 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:36.579+0000 7f76168f4540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:54:36.582 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:36.579+0000 7f76168f4540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T02:54:36.582 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:36.580+0000 7f76168f4540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T02:54:37.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:37.102+0000 7f76168f4540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:37.866 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:37.864+0000 7f76168f4540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:38.632 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:38.630+0000 7f76168f4540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:54:39.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T02:54:39.493 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T02:54:39.493 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:39.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T02:54:39.521 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:39.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T02:54:39.588 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:39.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T02:54:39.653 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:39.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T02:54:39.718 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:39.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T02:54:39.783 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:39.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T02:54:39.847 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:39.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T02:54:39.911 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:39.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T02:54:39.937 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:39.937 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T02:54:40.002 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:40.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T02:54:40.067 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:40.067 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T02:54:40.131 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:40.131 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T02:54:40.195 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:40.195 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T02:54:40.259 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:40.259 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T02:54:40.323 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:40.323 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T02:54:40.337 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:40.337 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T02:54:40.391 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:40.391 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T02:54:40.406 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:40.406 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T02:54:40.461 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T02:54:40.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:54:40.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T02:54:40.504 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2023-10-06T02:54:40.504 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDQdh9lW/KSHBAAEvgj/BAe20tCp8uwBEIVbA== 2023-10-06T02:54:40.504 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-10-06T02:54:40.504 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDQdh9lFrNmJBAAeVhw9betN9snqLPgSK9efw== 2023-10-06T02:54:40.504 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDQdh9lSCo1KxAAuETY4PeWDJS3bGzqTpHLpQ== 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDUdh9lV3sRIRAAoUtG7F6EMyew6CX3NaNufw== 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDXdh9ls5OxHhAAanGTRmjW75UAwrqzL0CIdw== 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDadh9lQeJTHhAAFeayQY1F10UDCck78/ja4w== 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDddh9l+cx8HhAAeAcoLzCUiCC+9O+WZYYTsA== 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDQdh9ly2pdIRAAX7YmT9B/MzoD8xJH347ruQ== 2023-10-06T02:54:40.505 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDQdh9lbi6hLxAAICzxeAsbJ5rhbyMBkPcrAQ== 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDQdh9lvPxyNhAAKlqBTG/Fr8/2Rf+lcGQxIg== 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDjdh9lA4upJxAAdFHhR2/rMyG2NbQEu7JpLw== 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDmdh9lOGETJRAA7nLtgcumxqfum8cirnbaRA== 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDpdh9lSbDhJBAAnMWhjKSKYcLaZeRk9drdgA== 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDsdh9lImOeIhAAPUO3jy2/cPZW+eKukBywcw== 2023-10-06T02:54:40.506 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-10-06T02:54:40.507 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDQdh9lRRw/OhAAwavsq3e0HeVF3/G4SX0v+A== 2023-10-06T02:54:40.507 INFO:teuthology.orchestra.run.smithi084.stdout:[client.2] 2023-10-06T02:54:40.507 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDRdh9lxOX6AxAAWDpHCodRcEc2/YF5yqnkQg== 2023-10-06T02:54:40.507 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2023-10-06T02:54:40.507 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDRdh9lftv/BhAAo8sb1EG96nHv77bn3af/dg== 2023-10-06T02:54:40.507 INFO:teuthology.orchestra.run.smithi084.stdout:[client.3] 2023-10-06T02:54:40.507 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDRdh9lheJnDBAAqAQeFxMQ9Qv108TLz65mVw== 2023-10-06T02:54:40.523 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2023-10-06T02:54:40.523 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDQdh9lW/KSHBAAEvgj/BAe20tCp8uwBEIVbA== 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDQdh9lFrNmJBAAeVhw9betN9snqLPgSK9efw== 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDQdh9lSCo1KxAAuETY4PeWDJS3bGzqTpHLpQ== 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDUdh9lV3sRIRAAoUtG7F6EMyew6CX3NaNufw== 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDXdh9ls5OxHhAAanGTRmjW75UAwrqzL0CIdw== 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDadh9lQeJTHhAAFeayQY1F10UDCck78/ja4w== 2023-10-06T02:54:40.524 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDddh9l+cx8HhAAeAcoLzCUiCC+9O+WZYYTsA== 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDQdh9ly2pdIRAAX7YmT9B/MzoD8xJH347ruQ== 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDQdh9lbi6hLxAAICzxeAsbJ5rhbyMBkPcrAQ== 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDQdh9lvPxyNhAAKlqBTG/Fr8/2Rf+lcGQxIg== 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDjdh9lA4upJxAAdFHhR2/rMyG2NbQEu7JpLw== 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDmdh9lOGETJRAA7nLtgcumxqfum8cirnbaRA== 2023-10-06T02:54:40.525 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDpdh9lSbDhJBAAnMWhjKSKYcLaZeRk9drdgA== 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDsdh9lImOeIhAAPUO3jy2/cPZW+eKukBywcw== 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDQdh9lRRw/OhAAwavsq3e0HeVF3/G4SX0v+A== 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout:[client.2] 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDRdh9lxOX6AxAAWDpHCodRcEc2/YF5yqnkQg== 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDRdh9lftv/BhAAo8sb1EG96nHv77bn3af/dg== 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout:[client.3] 2023-10-06T02:54:40.526 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDRdh9lheJnDBAAqAQeFxMQ9Qv108TLz65mVw== 2023-10-06T02:54:40.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:54:40.551 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:54:40.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:54:40.618 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:54:40.668 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:54:40.670 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:54:40.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:40.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:40.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:40.771 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:40.817 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:40.819 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:40.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:40.868 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:40.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:54:40.917 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T02:54:40.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:54:40.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:54:41.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:54:41.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T02:54:41.069 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:41.071 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:41.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:41.120 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:41.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:41.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:41.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:41.219 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T02:54:41.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:54:41.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:54:41.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:54:41.321 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:54:41.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:54:41.373 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:54:41.423 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:54:41.425 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T02:54:41.475 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T02:54:41.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T02:54:41.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:54:41.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T02:54:41.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T02:54:41.638 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:54:41.728 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T02:54:41.752 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T02:54:41.816 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T02:54:41.907 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T02:54:41.931 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:41.933 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:54:41.985 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T02:54:41.986 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T02:54:41.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T02:54:41.988 INFO:tasks.ceph.mon.a:Started 2023-10-06T02:54:41.988 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T02:54:41.988 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T02:54:42.029 INFO:tasks.ceph.mon.b:Started 2023-10-06T02:54:42.029 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T02:54:42.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T02:54:42.031 INFO:tasks.ceph.mon.c:Started 2023-10-06T02:54:42.031 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T02:54:42.031 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T02:54:42.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T02:54:42.033 INFO:tasks.ceph.mgr.y:Started 2023-10-06T02:54:42.034 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T02:54:42.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T02:54:42.036 INFO:tasks.ceph.mgr.x:Started 2023-10-06T02:54:42.036 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T02:54:42.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T02:54:42.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.149+0000 7efec7980700 1 Processor -- start 2023-10-06T02:54:42.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.149+0000 7efec7980700 1 -- start start 2023-10-06T02:54:42.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.150+0000 7efec7980700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 0x7efec0158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:42.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.150+0000 7efec7980700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec01411c0 con 0x7efec0067c10 2023-10-06T02:54:42.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.150+0000 7efec7980700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec0157aa0 con 0x7efec0140630 2023-10-06T02:54:42.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.150+0000 7efec7980700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c9970 con 0x7efec0067840 2023-10-06T02:54:42.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.150+0000 7efec4f1b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efec0067c10 0x7efec015af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51078/0 (socket says 172.21.15.84:51078) 2023-10-06T02:54:42.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.150+0000 7efec4f1b700 1 -- 172.21.15.84:0/409507416 learned_addr learned my addr 172.21.15.84:0/409507416 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:54:42.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.151+0000 7efec571c700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 0x7efec0158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:42.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.151+0000 7efec571c700 1 -- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 msgr2=0x7efec0158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T02:54:42.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.151+0000 7efec571c700 1 -- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 msgr2=0x7efec0158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T02:54:42.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.151+0000 7efec571c700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 0x7efec0158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T02:54:42.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.151+0000 7efec571c700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 0x7efec0158510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T02:54:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.324+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438640209 0 0) 0x7efec01411c0 con 0x7efec0067c10 2023-10-06T02:54:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.324+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea8003570 con 0x7efec0067c10 2023-10-06T02:54:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312463610 0 0) 0x7efec0157aa0 con 0x7efec0140630 2023-10-06T02:54:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec01411c0 con 0x7efec0140630 2023-10-06T02:54:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1534263698 0 0) 0x7efec01411c0 con 0x7efec0140630 2023-10-06T02:54:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 msgr2=0x7efec0158510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:54:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 0x7efec0158510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 >> v1:172.21.15.84:6789/0 conn(0x7efec0067c10 legacy=0x7efec015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec015bac0 con 0x7efec0140630 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7efeb8001470 con 0x7efec0140630 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 >> v1:172.21.15.131:6789/0 conn(0x7efec0140630 legacy=0x7efec0140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8003c20 0x7efea8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efea8004810 0x7efea8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 0x7efea8005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c9970 con 0x7efea8003c20 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea800bbf0 con 0x7efea8004810 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea800bdb0 con 0x7efec0067840 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efec571c700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8003c20 0x7efea8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efec4f1b700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efea8004810 0x7efea8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efec5f1d700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 0x7efea8005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efec571c700 1 -- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 msgr2=0x7efea8005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efec571c700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec0067840 0x7efea8005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efec571c700 1 -- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efea8004810 msgr2=0x7efea8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efec571c700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efea8004810 0x7efea8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.325+0000 7efec571c700 1 -- 172.21.15.84:0/409507416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec01411c0 con 0x7efea8003c20 2023-10-06T02:54:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.326+0000 7efec571c700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8003c20 0x7efea8004010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efeb0007440 tx=0x7efeb0009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1a3e084d571618 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.327+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0009a30 con 0x7efea8003c20 2023-10-06T02:54:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.327+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb0007cf0 con 0x7efea8003c20 2023-10-06T02:54:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.327+0000 7efebffff700 1 -- 172.21.15.84:0/409507416 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0014630 con 0x7efea8003c20 2023-10-06T02:54:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.327+0000 7efec7980700 1 -- 172.21.15.84:0/409507416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8003c20 msgr2=0x7efea8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.327+0000 7efec7980700 1 --2- 172.21.15.84:0/409507416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8003c20 0x7efea8004010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efeb0007440 tx=0x7efeb0009720 comp rx=0 tx=0).stop 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.328+0000 7efec5f1d700 1 -- 172.21.15.84:0/409507416 reap_dead start 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.328+0000 7efec7980700 1 -- 172.21.15.84:0/409507416 shutdown_connections 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.328+0000 7efec7980700 1 -- 172.21.15.84:0/409507416 >> 172.21.15.84:0/409507416 conn(0x7efec00cd1e0 msgr2=0x7efec00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.328+0000 7efec7980700 1 -- 172.21.15.84:0/409507416 shutdown_connections 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.328+0000 7efec7980700 1 -- 172.21.15.84:0/409507416 wait complete. 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.329+0000 7efec7980700 1 Processor -- start 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.329+0000 7efec7980700 1 -- start start 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec7980700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8003c20 0x7efec00a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec7980700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efec0167240 0x7efec016b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec7980700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec01676b0 0x7efec016b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec7980700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c4e40 con 0x7efea8003c20 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec7980700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c5090 con 0x7efec0167240 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec7980700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c5370 con 0x7efec01676b0 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec4f1b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efec0167240 0x7efec016b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec4f1b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efec0167240 0x7efec016b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:54518/0 (socket says 172.21.15.84:54518) 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec4f1b700 1 -- 172.21.15.84:0/2689358599 learned_addr learned my addr 172.21.15.84:0/2689358599 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec4f1b700 1 -- 172.21.15.84:0/2689358599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec01676b0 msgr2=0x7efec016b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec4f1b700 1 --2- 172.21.15.84:0/2689358599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec01676b0 0x7efec016b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec4f1b700 1 -- 172.21.15.84:0/2689358599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8003c20 msgr2=0x7efec00a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec4f1b700 1 --2- 172.21.15.84:0/2689358599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8003c20 0x7efec00a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.330+0000 7efec4f1b700 1 -- 172.21.15.84:0/2689358599 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec00c5650 con 0x7efec0167240 2023-10-06T02:54:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.331+0000 7efec4f1b700 1 --2- 172.21.15.84:0/2689358599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efec0167240 0x7efec016b0a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efeb40016a0 tx=0x7efeb4007de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.331+0000 7efebd7fa700 1 -- 172.21.15.84:0/2689358599 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4018030 con 0x7efec0167240 2023-10-06T02:54:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.331+0000 7efebd7fa700 1 -- 172.21.15.84:0/2689358599 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb400f610 con 0x7efec0167240 2023-10-06T02:54:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.331+0000 7efec7980700 1 -- 172.21.15.84:0/2689358599 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec00c5930 con 0x7efec0167240 2023-10-06T02:54:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.331+0000 7efebd7fa700 1 -- 172.21.15.84:0/2689358599 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb400f9d0 con 0x7efec0167240 2023-10-06T02:54:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.331+0000 7efec7980700 1 -- 172.21.15.84:0/2689358599 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec00a5a10 con 0x7efec0167240 2023-10-06T02:54:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.331+0000 7efebd7fa700 1 -- 172.21.15.84:0/2689358599 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7efeb401b070 con 0x7efec0167240 2023-10-06T02:54:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.331+0000 7efebd7fa700 1 -- 172.21.15.84:0/2689358599 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7efeb4019070 con 0x7efec0167240 2023-10-06T02:54:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.332+0000 7efec7980700 1 -- 172.21.15.84:0/2689358599 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec00b2990 con 0x7efec0167240 2023-10-06T02:54:42.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.334+0000 7efebd7fa700 1 -- 172.21.15.84:0/2689358599 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7efeb401e470 con 0x7efec0167240 2023-10-06T02:54:42.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.417+0000 7efec7980700 1 -- 172.21.15.84:0/2689358599 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7efec0064ad0 con 0x7efec0167240 2023-10-06T02:54:42.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.425+0000 7efebd7fa700 1 -- 172.21.15.84:0/2689358599 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7efeb401e920 con 0x7efec0167240 2023-10-06T02:54:42.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.425+0000 7efec7980700 1 -- 172.21.15.84:0/2689358599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efec0167240 msgr2=0x7efec016b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:42.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.425+0000 7efec7980700 1 --2- 172.21.15.84:0/2689358599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efec0167240 0x7efec016b0a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efeb40016a0 tx=0x7efeb4007de0 comp rx=0 tx=0).stop 2023-10-06T02:54:42.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.426+0000 7efec7980700 1 -- 172.21.15.84:0/2689358599 shutdown_connections 2023-10-06T02:54:42.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.426+0000 7efec7980700 1 --2- 172.21.15.84:0/2689358599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efec01676b0 0x7efec016b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:42.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.426+0000 7efec7980700 1 --2- 172.21.15.84:0/2689358599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efea8003c20 0x7efec00a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:42.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.426+0000 7efec7980700 1 --2- 172.21.15.84:0/2689358599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efec0167240 0x7efec016b0a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:42.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.426+0000 7efec7980700 1 -- 172.21.15.84:0/2689358599 >> 172.21.15.84:0/2689358599 conn(0x7efec00cd1e0 msgr2=0x7efec013fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:42.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.426+0000 7efec7980700 1 -- 172.21.15.84:0/2689358599 shutdown_connections 2023-10-06T02:54:42.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:42.426+0000 7efec7980700 1 -- 172.21.15.84:0/2689358599 wait complete. 2023-10-06T02:54:42.428 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2023-10-06T02:54:42.439 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T02:54:42.439 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:42.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T02:54:42.464 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:42.464 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T02:54:42.529 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:42.529 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T02:54:42.595 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-10-06T02:54:42.595 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T02:54:42.660 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:42.660 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T02:54:42.685 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:42.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T02:54:42.750 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:42.751 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T02:54:42.814 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-10-06T02:54:42.815 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T02:54:42.878 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new dfca9df4-043d-4160-b70d-bf7668e5b982 0 2023-10-06T02:54:43.035 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.033+0000 7f91766a6700 1 Processor -- start 2023-10-06T02:54:43.035 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.033+0000 7f91766a6700 1 -- start start 2023-10-06T02:54:43.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.034+0000 7f91766a6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9170157690 0x7f91700c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.034+0000 7f91766a6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91700c8b30 con 0x7f9170156bb0 2023-10-06T02:54:43.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.034+0000 7f91766a6700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91700c8e10 con 0x7f917006a570 2023-10-06T02:54:43.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.034+0000 7f91766a6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917006c1c0 con 0x7f9170157690 2023-10-06T02:54:43.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.034+0000 7f9174c43700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f917006a570 0x7f91700cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:35858/0 (socket says 172.21.15.131:35858) 2023-10-06T02:54:43.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.034+0000 7f9174c43700 1 -- 172.21.15.131:0/4016379212 learned_addr learned my addr 172.21.15.131:0/4016379212 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-10-06T02:54:43.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916f7fe700 1 --2- 172.21.15.131:0/4016379212 >> v2:172.21.15.84:3300/0 conn(0x7f9170157690 0x7f91700c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329016334 0 0) 0x7f91700c8e10 con 0x7f917006a570 2023-10-06T02:54:43.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9158003570 con 0x7f917006a570 2023-10-06T02:54:43.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100133036 0 0) 0x7f91700c8b30 con 0x7f9170156bb0 2023-10-06T02:54:43.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91700c8e10 con 0x7f9170156bb0 2023-10-06T02:54:43.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1519853923 0 0) 0x7f9158003570 con 0x7f917006a570 2023-10-06T02:54:43.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 >> v2:172.21.15.84:3300/0 conn(0x7f9170157690 msgr2=0x7f91700c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 --2- 172.21.15.131:0/4016379212 >> v2:172.21.15.84:3300/0 conn(0x7f9170157690 0x7f91700c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 >> v1:172.21.15.84:6789/0 conn(0x7f9170156bb0 legacy=0x7f9170156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700c90f0 con 0x7f917006a570 2023-10-06T02:54:43.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916f7fe700 1 --2- 172.21.15.131:0/4016379212 >> v2:172.21.15.84:3300/0 conn(0x7f9170157690 0x7f91700c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:43.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f91680017f0 con 0x7f917006a570 2023-10-06T02:54:43.044 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 >> v1:172.21.15.131:6789/0 conn(0x7f917006a570 legacy=0x7f91700cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.044 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9158003bf0 0x7f9158003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.044 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f9158004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.044 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91580051c0 0x7f915800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.044 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915800c080 con 0x7f9158003bf0 2023-10-06T02:54:43.044 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915800c1f0 con 0x7f9158004810 2023-10-06T02:54:43.044 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915800c3b0 con 0x7f91580051c0 2023-10-06T02:54:43.044 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916f7fe700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f9158004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.044 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f9174c43700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91580051c0 0x7f915800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916f7fe700 1 -- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91580051c0 msgr2=0x7f915800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916f7fe700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91580051c0 0x7f915800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916f7fe700 1 -- 172.21.15.131:0/4016379212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9158003bf0 msgr2=0x7f9158003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916f7fe700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9158003bf0 0x7f9158003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f916f7fe700 1 -- 172.21.15.131:0/4016379212 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158003570 con 0x7f9158004810 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f9174c43700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91580051c0 0x7f915800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.035+0000 7f9174c43700 1 -- 172.21.15.131:0/4016379212 reap_dead start 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.036+0000 7f916f7fe700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f9158004c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9160009df0 tx=0x7f91600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57b52e39910829af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.036+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160009740 con 0x7f9158004810 2023-10-06T02:54:43.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.036+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916000e920 con 0x7f9158004810 2023-10-06T02:54:43.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.036+0000 7f916effd700 1 -- 172.21.15.131:0/4016379212 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000ece0 con 0x7f9158004810 2023-10-06T02:54:43.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.036+0000 7f91766a6700 1 -- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 msgr2=0x7f9158004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.036+0000 7f91766a6700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f9158004c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9160009df0 tx=0x7f91600091a0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.036+0000 7f91766a6700 1 -- 172.21.15.131:0/4016379212 shutdown_connections 2023-10-06T02:54:43.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.036+0000 7f91766a6700 1 --2- 172.21.15.131:0/4016379212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f9158004c80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.036+0000 7f91766a6700 1 -- 172.21.15.131:0/4016379212 >> 172.21.15.131:0/4016379212 conn(0x7f91700cd1e0 msgr2=0x7f91700cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:43.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.037+0000 7f91766a6700 1 -- 172.21.15.131:0/4016379212 shutdown_connections 2023-10-06T02:54:43.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.037+0000 7f91766a6700 1 -- 172.21.15.131:0/4016379212 wait complete. 2023-10-06T02:54:43.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.038+0000 7f91766a6700 1 Processor -- start 2023-10-06T02:54:43.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.038+0000 7f91766a6700 1 -- start start 2023-10-06T02:54:43.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.038+0000 7f91766a6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f917014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.038+0000 7f91766a6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9170153070 0x7f9170155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.038+0000 7f91766a6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91701534e0 0x7f9170155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.038+0000 7f91766a6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91700b1f60 con 0x7f9170153070 2023-10-06T02:54:43.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.038+0000 7f91766a6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9170152be0 con 0x7f9158004810 2023-10-06T02:54:43.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f91766a6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91700b1c80 con 0x7f91701534e0 2023-10-06T02:54:43.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f917014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f9174c43700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91701534e0 0x7f9170155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f917014e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52116/0 (socket says 172.21.15.131:52116) 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916ffff700 1 -- 172.21.15.131:0/2639332836 learned_addr learned my addr 172.21.15.131:0/2639332836 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916f7fe700 1 --2- 172.21.15.131:0/2639332836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9170153070 0x7f9170155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916ffff700 1 -- 172.21.15.131:0/2639332836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91701534e0 msgr2=0x7f9170155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916ffff700 1 --2- 172.21.15.131:0/2639332836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91701534e0 0x7f9170155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916ffff700 1 -- 172.21.15.131:0/2639332836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9170153070 msgr2=0x7f9170155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916ffff700 1 --2- 172.21.15.131:0/2639332836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9170153070 0x7f9170155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916ffff700 1 -- 172.21.15.131:0/2639332836 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170152590 con 0x7f9158004810 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f916ffff700 1 --2- 172.21.15.131:0/2639332836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f917014e040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f916400c5b0 tx=0x7f9164007da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f9157fff700 1 -- 172.21.15.131:0/2639332836 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640105c0 con 0x7f9158004810 2023-10-06T02:54:43.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f9157fff700 1 -- 172.21.15.131:0/2639332836 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9164010720 con 0x7f9158004810 2023-10-06T02:54:43.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f91766a6700 1 -- 172.21.15.131:0/2639332836 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9170152870 con 0x7f9158004810 2023-10-06T02:54:43.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f9157fff700 1 -- 172.21.15.131:0/2639332836 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164010ae0 con 0x7f9158004810 2023-10-06T02:54:43.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f91766a6700 1 -- 172.21.15.131:0/2639332836 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91700b0f70 con 0x7f9158004810 2023-10-06T02:54:43.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f9157fff700 1 -- 172.21.15.131:0/2639332836 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9164013700 con 0x7f9158004810 2023-10-06T02:54:43.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.039+0000 7f9157fff700 1 -- 172.21.15.131:0/2639332836 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f916401d790 con 0x7f9158004810 2023-10-06T02:54:43.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.040+0000 7f91766a6700 1 -- 172.21.15.131:0/2639332836 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91701523f0 con 0x7f9158004810 2023-10-06T02:54:43.050 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.042+0000 7f9157fff700 1 -- 172.21.15.131:0/2639332836 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f91701523f0 con 0x7f9158004810 2023-10-06T02:54:43.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.126+0000 7f91766a6700 1 -- 172.21.15.131:0/2639332836 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dfca9df4-043d-4160-b70d-bf7668e5b982", "id": 0} v 0) v1 -- 0x7f9170064ad0 con 0x7f9158004810 2023-10-06T02:54:43.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.131+0000 7f9157fff700 1 -- 172.21.15.131:0/2639332836 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dfca9df4-043d-4160-b70d-bf7668e5b982", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9164018070 con 0x7f9158004810 2023-10-06T02:54:43.132 INFO:teuthology.orchestra.run.smithi131.stdout:0 2023-10-06T02:54:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.132+0000 7f91766a6700 1 -- 172.21.15.131:0/2639332836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 msgr2=0x7f917014e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.132+0000 7f91766a6700 1 --2- 172.21.15.131:0/2639332836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f917014e040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f916400c5b0 tx=0x7f9164007da0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.132+0000 7f91766a6700 1 -- 172.21.15.131:0/2639332836 shutdown_connections 2023-10-06T02:54:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.132+0000 7f91766a6700 1 --2- 172.21.15.131:0/2639332836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9158004810 0x7f917014e040 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.132+0000 7f91766a6700 1 --2- 172.21.15.131:0/2639332836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91701534e0 0x7f9170155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.132+0000 7f91766a6700 1 --2- 172.21.15.131:0/2639332836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9170153070 0x7f9170155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.132+0000 7f91766a6700 1 -- 172.21.15.131:0/2639332836 >> 172.21.15.131:0/2639332836 conn(0x7f91700cd1e0 msgr2=0x7f917006ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.132+0000 7f91766a6700 1 -- 172.21.15.131:0/2639332836 shutdown_connections 2023-10-06T02:54:43.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.132+0000 7f91766a6700 1 -- 172.21.15.131:0/2639332836 wait complete. 2023-10-06T02:54:43.145 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 396db709-743f-4643-bcee-b9a1fa52d1b0 1 2023-10-06T02:54:43.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.259+0000 7fb67a674700 1 Processor -- start 2023-10-06T02:54:43.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.259+0000 7fb67a674700 1 -- start start 2023-10-06T02:54:43.263 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb67a674700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740b2a90 0x7fb6740cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb67a674700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6740cb980 0x7fb6740ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb67a674700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6740ced90 0x7fb6740c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb67a674700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6740cbdf0 con 0x7fb6740cb980 2023-10-06T02:54:43.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb67a674700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6740b2e60 con 0x7fb6740ced90 2023-10-06T02:54:43.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb67a674700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740cf5d0 con 0x7fb6740b2a90 2023-10-06T02:54:43.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb673fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740b2a90 0x7fb6740cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb678c11700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6740ced90 0x7fb6740c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb673fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740b2a90 0x7fb6740cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:39662/0 (socket says 172.21.15.131:39662) 2023-10-06T02:54:43.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb678c11700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6740ced90 0x7fb6740c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52128/0 (socket says 172.21.15.131:52128) 2023-10-06T02:54:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb673fff700 1 -- 172.21.15.131:0/1665842008 learned_addr learned my addr 172.21.15.131:0/1665842008 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb6737fe700 1 --2- 172.21.15.131:0/1665842008 >> v2:172.21.15.84:3300/0 conn(0x7fb6740cb980 0x7fb6740ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb673fff700 1 -- 172.21.15.131:0/1665842008 >> v2:172.21.15.131:3300/0 conn(0x7fb6740ced90 msgr2=0x7fb6740c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb673fff700 1 --2- 172.21.15.131:0/1665842008 >> v2:172.21.15.131:3300/0 conn(0x7fb6740ced90 0x7fb6740c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb673fff700 1 -- 172.21.15.131:0/1665842008 >> v2:172.21.15.84:3300/0 conn(0x7fb6740cb980 msgr2=0x7fb6740ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb673fff700 1 --2- 172.21.15.131:0/1665842008 >> v2:172.21.15.84:3300/0 conn(0x7fb6740cb980 0x7fb6740ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb673fff700 1 -- 172.21.15.131:0/1665842008 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6740cf8b0 con 0x7fb6740b2a90 2023-10-06T02:54:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb678c11700 1 --2- 172.21.15.131:0/1665842008 >> v2:172.21.15.131:3300/0 conn(0x7fb6740ced90 0x7fb6740c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:43.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.260+0000 7fb673fff700 1 --2- 172.21.15.131:0/1665842008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740b2a90 0x7fb6740cb440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb67408a6e0 tx=0x7fb668009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8838370da46e29ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb672ffd700 1 -- 172.21.15.131:0/1665842008 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668005c10 con 0x7fb6740b2a90 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb672ffd700 1 -- 172.21.15.131:0/1665842008 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb668005d70 con 0x7fb6740b2a90 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb672ffd700 1 -- 172.21.15.131:0/1665842008 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668006260 con 0x7fb6740b2a90 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb67a674700 1 -- 172.21.15.131:0/1665842008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740b2a90 msgr2=0x7fb6740cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb67a674700 1 --2- 172.21.15.131:0/1665842008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740b2a90 0x7fb6740cb440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb67408a6e0 tx=0x7fb668009220 comp rx=0 tx=0).stop 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb67a674700 1 -- 172.21.15.131:0/1665842008 shutdown_connections 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb67a674700 1 --2- 172.21.15.131:0/1665842008 >> v2:172.21.15.131:3300/0 conn(0x7fb6740ced90 0x7fb6740c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb67a674700 1 --2- 172.21.15.131:0/1665842008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740b2a90 0x7fb6740cb440 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb67a674700 1 --2- 172.21.15.131:0/1665842008 >> v2:172.21.15.84:3300/0 conn(0x7fb6740cb980 0x7fb6740ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb67a674700 1 -- 172.21.15.131:0/1665842008 >> 172.21.15.131:0/1665842008 conn(0x7fb674099740 msgr2=0x7fb67406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:43.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb67a674700 1 -- 172.21.15.131:0/1665842008 shutdown_connections 2023-10-06T02:54:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.261+0000 7fb67a674700 1 -- 172.21.15.131:0/1665842008 wait complete. 2023-10-06T02:54:43.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.262+0000 7fb67a674700 1 Processor -- start 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb67a674700 1 -- start start 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb67a674700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6740b2a90 0x7fb67416a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb67a674700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6740cb980 0x7fb6740caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb67a674700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740ced90 0x7fb67414af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb67a674700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67415be30 con 0x7fb6740cb980 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb67a674700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67415e210 con 0x7fb6740b2a90 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb67a674700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67415ed50 con 0x7fb6740ced90 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb673fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6740b2a90 0x7fb67416a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb678c11700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740ced90 0x7fb67414af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb673fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6740b2a90 0x7fb67416a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52132/0 (socket says 172.21.15.131:52132) 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb673fff700 1 -- 172.21.15.131:0/1341764747 learned_addr learned my addr 172.21.15.131:0/1341764747 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.263+0000 7fb6737fe700 1 --2- 172.21.15.131:0/1341764747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6740cb980 0x7fb6740caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb673fff700 1 -- 172.21.15.131:0/1341764747 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740ced90 msgr2=0x7fb67414af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb673fff700 1 --2- 172.21.15.131:0/1341764747 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740ced90 0x7fb67414af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb673fff700 1 -- 172.21.15.131:0/1341764747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6740cb980 msgr2=0x7fb6740caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb673fff700 1 --2- 172.21.15.131:0/1341764747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6740cb980 0x7fb6740caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb673fff700 1 -- 172.21.15.131:0/1341764747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c009a20 con 0x7fb6740b2a90 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb673fff700 1 --2- 172.21.15.131:0/1341764747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6740b2a90 0x7fb67416a360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb668009f50 tx=0x7fb668016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb65bfff700 1 -- 172.21.15.131:0/1341764747 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668011750 con 0x7fb6740b2a90 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb65bfff700 1 -- 172.21.15.131:0/1341764747 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb668020070 con 0x7fb6740b2a90 2023-10-06T02:54:43.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb67a674700 1 -- 172.21.15.131:0/1341764747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb668009480 con 0x7fb6740b2a90 2023-10-06T02:54:43.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb65bfff700 1 -- 172.21.15.131:0/1341764747 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668011ae0 con 0x7fb6740b2a90 2023-10-06T02:54:43.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb67a674700 1 -- 172.21.15.131:0/1341764747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67415e700 con 0x7fb6740b2a90 2023-10-06T02:54:43.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb65bfff700 1 -- 172.21.15.131:0/1341764747 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb668022030 con 0x7fb6740b2a90 2023-10-06T02:54:43.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.264+0000 7fb65bfff700 1 -- 172.21.15.131:0/1341764747 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fb668025430 con 0x7fb6740b2a90 2023-10-06T02:54:43.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.265+0000 7fb67a674700 1 -- 172.21.15.131:0/1341764747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6740cde50 con 0x7fb6740b2a90 2023-10-06T02:54:43.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.267+0000 7fb65bfff700 1 -- 172.21.15.131:0/1341764747 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb66802e850 con 0x7fb6740b2a90 2023-10-06T02:54:43.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.350+0000 7fb67a674700 1 -- 172.21.15.131:0/1341764747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "396db709-743f-4643-bcee-b9a1fa52d1b0", "id": 1} v 0) v1 -- 0x7fb674064ad0 con 0x7fb6740b2a90 2023-10-06T02:54:43.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.354+0000 7fb65bfff700 1 -- 172.21.15.131:0/1341764747 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "396db709-743f-4643-bcee-b9a1fa52d1b0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb66802e9f0 con 0x7fb6740b2a90 2023-10-06T02:54:43.355 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T02:54:43.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.354+0000 7fb67a674700 1 -- 172.21.15.131:0/1341764747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6740b2a90 msgr2=0x7fb67416a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.354+0000 7fb67a674700 1 --2- 172.21.15.131:0/1341764747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6740b2a90 0x7fb67416a360 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb668009f50 tx=0x7fb668016000 comp rx=0 tx=0).stop 2023-10-06T02:54:43.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.355+0000 7fb67a674700 1 -- 172.21.15.131:0/1341764747 shutdown_connections 2023-10-06T02:54:43.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.355+0000 7fb67a674700 1 --2- 172.21.15.131:0/1341764747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6740b2a90 0x7fb67416a360 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.355+0000 7fb67a674700 1 --2- 172.21.15.131:0/1341764747 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6740ced90 0x7fb67414af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.355+0000 7fb67a674700 1 --2- 172.21.15.131:0/1341764747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6740cb980 0x7fb6740caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.355+0000 7fb67a674700 1 -- 172.21.15.131:0/1341764747 >> 172.21.15.131:0/1341764747 conn(0x7fb674099740 msgr2=0x7fb6740b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:43.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.355+0000 7fb67a674700 1 -- 172.21.15.131:0/1341764747 shutdown_connections 2023-10-06T02:54:43.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.355+0000 7fb67a674700 1 -- 172.21.15.131:0/1341764747 wait complete. 2023-10-06T02:54:43.367 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 1176651d-f222-4264-8e7a-149a1088fd92 2 2023-10-06T02:54:43.484 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.483+0000 7f26ed233700 1 Processor -- start 2023-10-06T02:54:43.484 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.483+0000 7f26ed233700 1 -- start start 2023-10-06T02:54:43.488 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.483+0000 7f26ed233700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26e80cbb50 0x7f26e80ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.488 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.483+0000 7f26ed233700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e80b2e60 con 0x7f26e80b2a90 2023-10-06T02:54:43.488 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26ed233700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e80cf5d0 con 0x7f26e80c6610 2023-10-06T02:54:43.488 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26ed233700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e80cf8b0 con 0x7f26e80cbb50 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e759e700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f26e80c6610 0x7f26e80ced90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:35870/0 (socket says 172.21.15.131:35870) 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e759e700 1 -- 172.21.15.131:0/1324920875 learned_addr learned my addr 172.21.15.131:0/1324920875 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e659c700 1 --2- 172.21.15.131:0/1324920875 >> v2:172.21.15.84:3300/0 conn(0x7f26e80cbb50 0x7f26e80ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629785800 0 0) 0x7f26e80cf5d0 con 0x7f26e80c6610 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d0003570 con 0x7f26e80c6610 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016886145 0 0) 0x7f26e80b2e60 con 0x7f26e80b2a90 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e80cf5d0 con 0x7f26e80b2a90 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2619753844 0 0) 0x7f26d0003570 con 0x7f26e80c6610 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 >> v2:172.21.15.84:3300/0 conn(0x7f26e80cbb50 msgr2=0x7f26e80ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 --2- 172.21.15.131:0/1324920875 >> v2:172.21.15.84:3300/0 conn(0x7f26e80cbb50 0x7f26e80ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 >> v1:172.21.15.84:6789/0 conn(0x7f26e80b2a90 legacy=0x7f26e80cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e80cfb90 con 0x7f26e80c6610 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f26e00017f0 con 0x7f26e80c6610 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 >> v1:172.21.15.131:6789/0 conn(0x7f26e80c6610 legacy=0x7f26e80ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26d0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d0004810 0x7f26d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26d0005230 0x7f26d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80cf8b0 con 0x7f26d0004810 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d000c200 con 0x7f26d0003bf0 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d000c3c0 con 0x7f26d0005230 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e659c700 1 --2- 172.21.15.131:0/1324920875 >> v2:172.21.15.84:3300/0 conn(0x7f26e80cbb50 0x7f26e80ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e6d9d700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26d0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e759e700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26d0005230 0x7f26d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.484+0000 7f26e659c700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d0004810 0x7f26d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e6d9d700 1 -- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26d0005230 msgr2=0x7f26d000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e6d9d700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26d0005230 0x7f26d000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e6d9d700 1 -- 172.21.15.131:0/1324920875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d0004810 msgr2=0x7f26d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e6d9d700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d0004810 0x7f26d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e6d9d700 1 -- 172.21.15.131:0/1324920875 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d0003570 con 0x7f26d0003bf0 2023-10-06T02:54:43.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e759e700 1 -- 172.21.15.131:0/1324920875 reap_dead start 2023-10-06T02:54:43.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e6d9d700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26d0003fe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f26d80010a0 tx=0x7f26d8007d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac8d07960bbc2ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8001420 con 0x7f26d0003bf0 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800c5d0 con 0x7f26d0003bf0 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26e5d9b700 1 -- 172.21.15.131:0/1324920875 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800c990 con 0x7f26d0003bf0 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26ed233700 1 -- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 msgr2=0x7f26d0003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26ed233700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26d0003fe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f26d80010a0 tx=0x7f26d8007d60 comp rx=0 tx=0).stop 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26ed233700 1 -- 172.21.15.131:0/1324920875 shutdown_connections 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26ed233700 1 --2- 172.21.15.131:0/1324920875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26d0003fe0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.485+0000 7f26ed233700 1 -- 172.21.15.131:0/1324920875 >> 172.21.15.131:0/1324920875 conn(0x7f26e8099740 msgr2=0x7f26e806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.486+0000 7f26ed233700 1 -- 172.21.15.131:0/1324920875 shutdown_connections 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.486+0000 7f26ed233700 1 -- 172.21.15.131:0/1324920875 wait complete. 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.487+0000 7f26ed233700 1 Processor -- start 2023-10-06T02:54:43.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.487+0000 7f26ed233700 1 -- start start 2023-10-06T02:54:43.494 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.487+0000 7f26ed233700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26e80c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.494 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.487+0000 7f26ed233700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e80c99f0 0x7f26e81582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.487+0000 7f26ed233700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80d01c0 0x7f26e80d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ed233700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80d0b70 con 0x7f26e80d01c0 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ed233700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80cada0 con 0x7f26d0003bf0 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ed233700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e81587f0 con 0x7f26e80c99f0 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26e80c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26e80c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52140/0 (socket says 172.21.15.131:52140) 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e659c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e80c99f0 0x7f26e81582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e6d9d700 1 -- 172.21.15.131:0/651161099 learned_addr learned my addr 172.21.15.131:0/651161099 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e759e700 1 --2- 172.21.15.131:0/651161099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80d01c0 0x7f26e80d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e6d9d700 1 -- 172.21.15.131:0/651161099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e80c99f0 msgr2=0x7f26e81582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e6d9d700 1 --2- 172.21.15.131:0/651161099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e80c99f0 0x7f26e81582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e6d9d700 1 -- 172.21.15.131:0/651161099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80d01c0 msgr2=0x7f26e80d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e6d9d700 1 --2- 172.21.15.131:0/651161099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80d01c0 0x7f26e80d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e6d9d700 1 -- 172.21.15.131:0/651161099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e80cb230 con 0x7f26d0003bf0 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26e6d9d700 1 --2- 172.21.15.131:0/651161099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26e80c91c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c3c0 tx=0x7f26d8015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ceffd700 1 -- 172.21.15.131:0/651161099 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800cd00 con 0x7f26d0003bf0 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ceffd700 1 -- 172.21.15.131:0/651161099 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800ce80 con 0x7f26d0003bf0 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ceffd700 1 -- 172.21.15.131:0/651161099 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800c990 con 0x7f26d0003bf0 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ed233700 1 -- 172.21.15.131:0/651161099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e80ca190 con 0x7f26d0003bf0 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ed233700 1 -- 172.21.15.131:0/651161099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e80ca750 con 0x7f26d0003bf0 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ceffd700 1 -- 172.21.15.131:0/651161099 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f26d8019030 con 0x7f26d0003bf0 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.488+0000 7f26ceffd700 1 -- 172.21.15.131:0/651161099 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f26d801e400 con 0x7f26d0003bf0 2023-10-06T02:54:43.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.489+0000 7f26ed233700 1 -- 172.21.15.131:0/651161099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e80cb080 con 0x7f26d0003bf0 2023-10-06T02:54:43.497 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.491+0000 7f26ceffd700 1 -- 172.21.15.131:0/651161099 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f26d802b020 con 0x7f26d0003bf0 2023-10-06T02:54:43.498 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:43.497+0000 7ff6af56a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:54:43.523 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:43.522+0000 7f8a584a1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T02:54:43.574 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.572+0000 7f26ed233700 1 -- 172.21.15.131:0/651161099 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1176651d-f222-4264-8e7a-149a1088fd92", "id": 2} v 0) v1 -- 0x7f26e8064ad0 con 0x7f26d0003bf0 2023-10-06T02:54:43.577 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.576+0000 7f26ceffd700 1 -- 172.21.15.131:0/651161099 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1176651d-f222-4264-8e7a-149a1088fd92", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f26d8017070 con 0x7f26d0003bf0 2023-10-06T02:54:43.578 INFO:teuthology.orchestra.run.smithi131.stdout:2 2023-10-06T02:54:43.578 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.577+0000 7f26ed233700 1 -- 172.21.15.131:0/651161099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 msgr2=0x7f26e80c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.579 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.577+0000 7f26ed233700 1 --2- 172.21.15.131:0/651161099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26e80c91c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c3c0 tx=0x7f26d8015000 comp rx=0 tx=0).stop 2023-10-06T02:54:43.579 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.577+0000 7f26ed233700 1 -- 172.21.15.131:0/651161099 shutdown_connections 2023-10-06T02:54:43.579 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.577+0000 7f26ed233700 1 --2- 172.21.15.131:0/651161099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d0003bf0 0x7f26e80c91c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.579 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.577+0000 7f26ed233700 1 --2- 172.21.15.131:0/651161099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80d01c0 0x7f26e80d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.579 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.577+0000 7f26ed233700 1 --2- 172.21.15.131:0/651161099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e80c99f0 0x7f26e81582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.579 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.577+0000 7f26ed233700 1 -- 172.21.15.131:0/651161099 >> 172.21.15.131:0/651161099 conn(0x7f26e8099740 msgr2=0x7f26e8158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:43.579 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.577+0000 7f26ed233700 1 -- 172.21.15.131:0/651161099 shutdown_connections 2023-10-06T02:54:43.579 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.577+0000 7f26ed233700 1 -- 172.21.15.131:0/651161099 wait complete. 2023-10-06T02:54:43.590 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new c1da6611-16bc-4542-83ab-ca50875e9bfe 3 2023-10-06T02:54:43.631 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:43.629+0000 7ff6af56a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:54:43.660 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:43.658+0000 7f8a584a1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T02:54:43.705 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:43.704+0000 7ff6af56a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:54:43.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.705+0000 7f6b4d802700 1 Processor -- start 2023-10-06T02:54:43.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.705+0000 7f6b4d802700 1 -- start start 2023-10-06T02:54:43.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b4d802700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6b48158ba0 0x7f6b48068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b4d802700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b48068b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b4d802700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4806b380 con 0x7f6b48069a60 2023-10-06T02:54:43.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b4d802700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4806a770 con 0x7f6b48158ba0 2023-10-06T02:54:43.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b4d802700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4806aa50 con 0x7f6b48158f70 2023-10-06T02:54:43.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b467fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b48068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b467fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b48068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:39704/0 (socket says 172.21.15.131:39704) 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b467fc700 1 -- 172.21.15.131:0/2380443773 learned_addr learned my addr 172.21.15.131:0/2380443773 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b46ffd700 1 --2- 172.21.15.131:0/2380443773 >> v2:172.21.15.84:3300/0 conn(0x7f6b48158ba0 0x7f6b48068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b467fc700 1 -- 172.21.15.131:0/2380443773 >> v2:172.21.15.84:3300/0 conn(0x7f6b48158ba0 msgr2=0x7f6b48068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b467fc700 1 --2- 172.21.15.131:0/2380443773 >> v2:172.21.15.84:3300/0 conn(0x7f6b48158ba0 0x7f6b48068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b467fc700 1 -- 172.21.15.131:0/2380443773 >> v1:172.21.15.84:6789/0 conn(0x7f6b48069a60 legacy=0x7f6b48069f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b467fc700 1 -- 172.21.15.131:0/2380443773 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4806ad30 con 0x7f6b48158f70 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b467fc700 1 --2- 172.21.15.131:0/2380443773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b48068b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b380099b0 tx=0x7f6b38009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0fffe69c932dd74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b45ffb700 1 -- 172.21.15.131:0/2380443773 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b38009ea0 con 0x7f6b48158f70 2023-10-06T02:54:43.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b45ffb700 1 -- 172.21.15.131:0/2380443773 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3800c970 con 0x7f6b48158f70 2023-10-06T02:54:43.710 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.706+0000 7f6b45ffb700 1 -- 172.21.15.131:0/2380443773 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800cd10 con 0x7f6b48158f70 2023-10-06T02:54:43.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.707+0000 7f6b4d802700 1 -- 172.21.15.131:0/2380443773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 msgr2=0x7f6b48068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.707+0000 7f6b4d802700 1 --2- 172.21.15.131:0/2380443773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b48068b40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b380099b0 tx=0x7f6b38009250 comp rx=0 tx=0).stop 2023-10-06T02:54:43.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.707+0000 7f6b4d802700 1 -- 172.21.15.131:0/2380443773 shutdown_connections 2023-10-06T02:54:43.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.707+0000 7f6b4d802700 1 --2- 172.21.15.131:0/2380443773 >> v2:172.21.15.84:3300/0 conn(0x7f6b48158ba0 0x7f6b48068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.707+0000 7f6b4d802700 1 --2- 172.21.15.131:0/2380443773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b48068b40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.707+0000 7f6b4d802700 1 -- 172.21.15.131:0/2380443773 >> 172.21.15.131:0/2380443773 conn(0x7f6b480c9cd0 msgr2=0x7f6b4806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.707+0000 7f6b4d802700 1 -- 172.21.15.131:0/2380443773 shutdown_connections 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.707+0000 7f6b4d802700 1 -- 172.21.15.131:0/2380443773 wait complete. 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.708+0000 7f6b4d802700 1 Processor -- start 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.708+0000 7f6b4d802700 1 -- start start 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b4d802700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b48069a60 0x7f6b481548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b4d802700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48158ba0 0x7f6b480a5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b4d802700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b480a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b4d802700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4816a5c0 con 0x7f6b48069a60 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b4d802700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b481699b0 con 0x7f6b48158ba0 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b4d802700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b48169c90 con 0x7f6b48158f70 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b477fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b480a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b467fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48158ba0 0x7f6b480a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b477fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b480a5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:39714/0 (socket says 172.21.15.131:39714) 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b477fe700 1 -- 172.21.15.131:0/3764897451 learned_addr learned my addr 172.21.15.131:0/3764897451 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b467fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48158ba0 0x7f6b480a5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52150/0 (socket says 172.21.15.131:52150) 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b46ffd700 1 --2- 172.21.15.131:0/3764897451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b48069a60 0x7f6b481548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b477fe700 1 -- 172.21.15.131:0/3764897451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48158ba0 msgr2=0x7f6b480a5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b477fe700 1 --2- 172.21.15.131:0/3764897451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48158ba0 0x7f6b480a5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b477fe700 1 -- 172.21.15.131:0/3764897451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b48069a60 msgr2=0x7f6b481548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b477fe700 1 --2- 172.21.15.131:0/3764897451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b48069a60 0x7f6b481548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b477fe700 1 -- 172.21.15.131:0/3764897451 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380094f0 con 0x7f6b48158f70 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.709+0000 7f6b467fc700 1 --2- 172.21.15.131:0/3764897451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48158ba0 0x7f6b480a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:43.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.710+0000 7f6b477fe700 1 --2- 172.21.15.131:0/3764897451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b480a5a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000c840 tx=0x7f6b40001670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.710+0000 7f6b2effd700 1 -- 172.21.15.131:0/3764897451 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40012630 con 0x7f6b48158f70 2023-10-06T02:54:43.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.710+0000 7f6b2effd700 1 -- 172.21.15.131:0/3764897451 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b400127b0 con 0x7f6b48158f70 2023-10-06T02:54:43.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.710+0000 7f6b4d802700 1 -- 172.21.15.131:0/3764897451 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b48169f70 con 0x7f6b48158f70 2023-10-06T02:54:43.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.710+0000 7f6b2effd700 1 -- 172.21.15.131:0/3764897451 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40012b70 con 0x7f6b48158f70 2023-10-06T02:54:43.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.710+0000 7f6b4d802700 1 -- 172.21.15.131:0/3764897451 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b481696a0 con 0x7f6b48158f70 2023-10-06T02:54:43.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.710+0000 7f6b2effd700 1 -- 172.21.15.131:0/3764897451 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6b4001b400 con 0x7f6b48158f70 2023-10-06T02:54:43.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.710+0000 7f6b2effd700 1 -- 172.21.15.131:0/3764897451 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f6b4001bb50 con 0x7f6b48158f70 2023-10-06T02:54:43.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.711+0000 7f6b4d802700 1 -- 172.21.15.131:0/3764897451 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4805f270 con 0x7f6b48158f70 2023-10-06T02:54:43.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.713+0000 7f6b2effd700 1 -- 172.21.15.131:0/3764897451 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6b4001b6b0 con 0x7f6b48158f70 2023-10-06T02:54:43.739 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:43.738+0000 7f8a584a1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T02:54:43.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.796+0000 7f6b4d802700 1 -- 172.21.15.131:0/3764897451 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c1da6611-16bc-4542-83ab-ca50875e9bfe", "id": 3} v 0) v1 -- 0x7f6b480b27a0 con 0x7f6b48158f70 2023-10-06T02:54:43.801 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.799+0000 7f6b2effd700 1 -- 172.21.15.131:0/3764897451 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1da6611-16bc-4542-83ab-ca50875e9bfe", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b4001b8d0 con 0x7f6b48158f70 2023-10-06T02:54:43.801 INFO:teuthology.orchestra.run.smithi131.stdout:3 2023-10-06T02:54:43.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.800+0000 7f6b4d802700 1 -- 172.21.15.131:0/3764897451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 msgr2=0x7f6b480a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.800+0000 7f6b4d802700 1 --2- 172.21.15.131:0/3764897451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b480a5a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000c840 tx=0x7f6b40001670 comp rx=0 tx=0).stop 2023-10-06T02:54:43.803 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.801+0000 7f6b4d802700 1 -- 172.21.15.131:0/3764897451 shutdown_connections 2023-10-06T02:54:43.803 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.801+0000 7f6b4d802700 1 --2- 172.21.15.131:0/3764897451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b48158f70 0x7f6b480a5a80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.803 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.801+0000 7f6b4d802700 1 --2- 172.21.15.131:0/3764897451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b48069a60 0x7f6b481548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.803 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.801+0000 7f6b4d802700 1 --2- 172.21.15.131:0/3764897451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b48158ba0 0x7f6b480a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.803 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.801+0000 7f6b4d802700 1 -- 172.21.15.131:0/3764897451 >> 172.21.15.131:0/3764897451 conn(0x7f6b480c9cd0 msgr2=0x7f6b480ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:43.803 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.801+0000 7f6b4d802700 1 -- 172.21.15.131:0/3764897451 shutdown_connections 2023-10-06T02:54:43.803 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.801+0000 7f6b4d802700 1 -- 172.21.15.131:0/3764897451 wait complete. 2023-10-06T02:54:43.814 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 8a93456a-cf71-4d0d-9d72-43bbc0cf6a72 4 2023-10-06T02:54:43.889 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:43.887+0000 7ff6af56a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:54:43.929 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.928+0000 7f957a2a0700 1 Processor -- start 2023-10-06T02:54:43.930 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.928+0000 7f957a2a0700 1 -- start start 2023-10-06T02:54:43.932 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f957a2a0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95740b2a90 0x7f95740cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.932 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f957a2a0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f95740cb980 0x7f95740ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.932 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f957a2a0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95740cbdf0 con 0x7f95740ced90 2023-10-06T02:54:43.932 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f957a2a0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95740b2e60 con 0x7f95740b2a90 2023-10-06T02:54:43.932 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f957a2a0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95740cf5d0 con 0x7f95740cb980 2023-10-06T02:54:43.932 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f95737fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f95740cb980 0x7f95740ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f957883d700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f95740ced90 0x7f95740c5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:35874/0 (socket says 172.21.15.131:35874) 2023-10-06T02:54:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f957883d700 1 -- 172.21.15.131:0/3715264783 learned_addr learned my addr 172.21.15.131:0/3715264783 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-10-06T02:54:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f9573fff700 1 --2- 172.21.15.131:0/3715264783 >> v2:172.21.15.84:3300/0 conn(0x7f95740b2a90 0x7f95740cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f95737fe700 1 -- 172.21.15.131:0/3715264783 >> v2:172.21.15.84:3300/0 conn(0x7f95740b2a90 msgr2=0x7f95740cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f95737fe700 1 --2- 172.21.15.131:0/3715264783 >> v2:172.21.15.84:3300/0 conn(0x7f95740b2a90 0x7f95740cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f95737fe700 1 -- 172.21.15.131:0/3715264783 >> v1:172.21.15.131:6789/0 conn(0x7f95740ced90 legacy=0x7f95740c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f95737fe700 1 -- 172.21.15.131:0/3715264783 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95740cf8b0 con 0x7f95740cb980 2023-10-06T02:54:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f9572ffd700 1 -- 172.21.15.131:0/3715264783 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031348954 0 0) 0x7f95740cbdf0 con 0x7f95740ced90 2023-10-06T02:54:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.929+0000 7f95737fe700 1 --2- 172.21.15.131:0/3715264783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 0x7f95740ce850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9574088cd0 tx=0x7f95640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d02d6e29707dc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f9572ffd700 1 -- 172.21.15.131:0/3715264783 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011630 con 0x7f95740cb980 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f9572ffd700 1 -- 172.21.15.131:0/3715264783 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564011790 con 0x7f95740cb980 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f9572ffd700 1 -- 172.21.15.131:0/3715264783 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011b30 con 0x7f95740cb980 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f957a2a0700 1 -- 172.21.15.131:0/3715264783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 msgr2=0x7f95740ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f957a2a0700 1 --2- 172.21.15.131:0/3715264783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 0x7f95740ce850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9574088cd0 tx=0x7f95640091a0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f957a2a0700 1 -- 172.21.15.131:0/3715264783 shutdown_connections 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f957a2a0700 1 --2- 172.21.15.131:0/3715264783 >> v2:172.21.15.84:3300/0 conn(0x7f95740b2a90 0x7f95740cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f957a2a0700 1 --2- 172.21.15.131:0/3715264783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 0x7f95740ce850 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f957a2a0700 1 -- 172.21.15.131:0/3715264783 >> 172.21.15.131:0/3715264783 conn(0x7f9574099740 msgr2=0x7f957406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f957a2a0700 1 -- 172.21.15.131:0/3715264783 shutdown_connections 2023-10-06T02:54:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.930+0000 7f957a2a0700 1 -- 172.21.15.131:0/3715264783 wait complete. 2023-10-06T02:54:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.931+0000 7f957a2a0700 1 Processor -- start 2023-10-06T02:54:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.931+0000 7f957a2a0700 1 -- start start 2023-10-06T02:54:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f957a2a0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95740b2a90 0x7f957416a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f957a2a0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 0x7f9574159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f957a2a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95740ced90 0x7f95740c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f957a2a0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95740c8350 con 0x7f95740ced90 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f957a2a0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957416a9e0 con 0x7f95740cb980 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f957a2a0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95740c7740 con 0x7f95740b2a90 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f95737fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 0x7f9574159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f9573fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95740b2a90 0x7f957416a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f95737fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 0x7f9574159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52172/0 (socket says 172.21.15.131:52172) 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f95737fe700 1 -- 172.21.15.131:0/186652113 learned_addr learned my addr 172.21.15.131:0/186652113 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.932+0000 7f957883d700 1 --2- 172.21.15.131:0/186652113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95740ced90 0x7f95740c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f95737fe700 1 -- 172.21.15.131:0/186652113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95740b2a90 msgr2=0x7f957416a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f95737fe700 1 --2- 172.21.15.131:0/186652113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95740b2a90 0x7f957416a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f95737fe700 1 -- 172.21.15.131:0/186652113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95740ced90 msgr2=0x7f95740c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f95737fe700 1 --2- 172.21.15.131:0/186652113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95740ced90 0x7f95740c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f95737fe700 1 -- 172.21.15.131:0/186652113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9564009420 con 0x7f95740cb980 2023-10-06T02:54:43.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f9573fff700 1 --2- 172.21.15.131:0/186652113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95740b2a90 0x7f957416a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:43.938 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f8a584a1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:54:43.939 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f95737fe700 1 --2- 172.21.15.131:0/186652113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 0x7f9574159070 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f95740cf710 tx=0x7f9564017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f955bfff700 1 -- 172.21.15.131:0/186652113 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564000d10 con 0x7f95740cb980 2023-10-06T02:54:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f955bfff700 1 -- 172.21.15.131:0/186652113 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564011b10 con 0x7f95740cb980 2023-10-06T02:54:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f957a2a0700 1 -- 172.21.15.131:0/186652113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95740c7a20 con 0x7f95740cb980 2023-10-06T02:54:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f955bfff700 1 -- 172.21.15.131:0/186652113 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564025640 con 0x7f95740cb980 2023-10-06T02:54:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f957a2a0700 1 -- 172.21.15.131:0/186652113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95740c7fe0 con 0x7f95740cb980 2023-10-06T02:54:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f955bfff700 1 -- 172.21.15.131:0/186652113 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9564025cb0 con 0x7f95740cb980 2023-10-06T02:54:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.933+0000 7f955bfff700 1 -- 172.21.15.131:0/186652113 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f956402edb0 con 0x7f95740cb980 2023-10-06T02:54:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.934+0000 7f957a2a0700 1 -- 172.21.15.131:0/186652113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9574089320 con 0x7f95740cb980 2023-10-06T02:54:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:43.936+0000 7f955bfff700 1 -- 172.21.15.131:0/186652113 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9564033060 con 0x7f95740cb980 2023-10-06T02:54:44.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.018+0000 7f957a2a0700 1 -- 172.21.15.131:0/186652113 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8a93456a-cf71-4d0d-9d72-43bbc0cf6a72", "id": 4} v 0) v1 -- 0x7f95740c84c0 con 0x7f95740cb980 2023-10-06T02:54:44.023 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.022+0000 7f955bfff700 1 -- 172.21.15.131:0/186652113 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a93456a-cf71-4d0d-9d72-43bbc0cf6a72", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9564015020 con 0x7f95740cb980 2023-10-06T02:54:44.023 INFO:teuthology.orchestra.run.smithi131.stdout:4 2023-10-06T02:54:44.024 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.023+0000 7f957a2a0700 1 -- 172.21.15.131:0/186652113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 msgr2=0x7f9574159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.023+0000 7f957a2a0700 1 --2- 172.21.15.131:0/186652113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 0x7f9574159070 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f95740cf710 tx=0x7f9564017000 comp rx=0 tx=0).stop 2023-10-06T02:54:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.023+0000 7f957a2a0700 1 -- 172.21.15.131:0/186652113 shutdown_connections 2023-10-06T02:54:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.023+0000 7f957a2a0700 1 --2- 172.21.15.131:0/186652113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95740ced90 0x7f95740c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.023+0000 7f957a2a0700 1 --2- 172.21.15.131:0/186652113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95740b2a90 0x7f957416a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.023+0000 7f957a2a0700 1 --2- 172.21.15.131:0/186652113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95740cb980 0x7f9574159070 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.023+0000 7f957a2a0700 1 -- 172.21.15.131:0/186652113 >> 172.21.15.131:0/186652113 conn(0x7f9574099740 msgr2=0x7f957415e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.023+0000 7f957a2a0700 1 -- 172.21.15.131:0/186652113 shutdown_connections 2023-10-06T02:54:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.023+0000 7f957a2a0700 1 -- 172.21.15.131:0/186652113 wait complete. 2023-10-06T02:54:44.036 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e 5 2023-10-06T02:54:44.061 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:44.059+0000 7ff6af56a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:54:44.115 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:44.114+0000 7f8a584a1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T02:54:44.137 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:44.136+0000 7ff6af56a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:54:44.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.151+0000 7f1c15dd3700 1 Processor -- start 2023-10-06T02:54:44.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.151+0000 7f1c15dd3700 1 -- start start 2023-10-06T02:54:44.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c15dd3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1c10142f20 0x7f1c1006b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c15dd3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c100675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c15dd3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1c10067b30 0x7f1c100c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c15dd3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c10067fd0 con 0x7f1c10142f20 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c15dd3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1006b1b0 con 0x7f1c10067b30 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c15dd3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c101432f0 con 0x7f1c1006bb80 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0effd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c100675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0effd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c100675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:39722/0 (socket says 172.21.15.131:39722) 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0ffff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1c10067b30 0x7f1c100c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0effd700 1 -- 172.21.15.131:0/3484652762 learned_addr learned my addr 172.21.15.131:0/3484652762 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0f7fe700 1 --2- 172.21.15.131:0/3484652762 >> v2:172.21.15.84:3300/0 conn(0x7f1c10142f20 0x7f1c1006b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0effd700 1 -- 172.21.15.131:0/3484652762 >> v2:172.21.15.131:3300/0 conn(0x7f1c10067b30 msgr2=0x7f1c100c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0effd700 1 --2- 172.21.15.131:0/3484652762 >> v2:172.21.15.131:3300/0 conn(0x7f1c10067b30 0x7f1c100c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0effd700 1 -- 172.21.15.131:0/3484652762 >> v2:172.21.15.84:3300/0 conn(0x7f1c10142f20 msgr2=0x7f1c1006b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0effd700 1 --2- 172.21.15.131:0/3484652762 >> v2:172.21.15.84:3300/0 conn(0x7f1c10142f20 0x7f1c1006b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0effd700 1 -- 172.21.15.131:0/3484652762 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100cba10 con 0x7f1c1006bb80 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0ffff700 1 --2- 172.21.15.131:0/3484652762 >> v2:172.21.15.131:3300/0 conn(0x7f1c10067b30 0x7f1c100c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0f7fe700 1 --2- 172.21.15.131:0/3484652762 >> v2:172.21.15.84:3300/0 conn(0x7f1c10142f20 0x7f1c1006b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0effd700 1 --2- 172.21.15.131:0/3484652762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c100675f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006a080 tx=0x7f1c04009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dab1bbb02d5b0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0e7fc700 1 -- 172.21.15.131:0/3484652762 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04009e70 con 0x7f1c1006bb80 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0e7fc700 1 -- 172.21.15.131:0/3484652762 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0400b860 con 0x7f1c1006bb80 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.152+0000 7f1c0e7fc700 1 -- 172.21.15.131:0/3484652762 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400bc00 con 0x7f1c1006bb80 2023-10-06T02:54:44.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.153+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3484652762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 msgr2=0x7f1c100675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.153+0000 7f1c15dd3700 1 --2- 172.21.15.131:0/3484652762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c100675f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006a080 tx=0x7f1c04009250 comp rx=0 tx=0).stop 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.153+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3484652762 shutdown_connections 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.153+0000 7f1c15dd3700 1 --2- 172.21.15.131:0/3484652762 >> v2:172.21.15.131:3300/0 conn(0x7f1c10067b30 0x7f1c100c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.153+0000 7f1c15dd3700 1 --2- 172.21.15.131:0/3484652762 >> v2:172.21.15.84:3300/0 conn(0x7f1c10142f20 0x7f1c1006b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.153+0000 7f1c15dd3700 1 --2- 172.21.15.131:0/3484652762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c100675f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.153+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3484652762 >> 172.21.15.131:0/3484652762 conn(0x7f1c100cd1f0 msgr2=0x7f1c100cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.153+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3484652762 shutdown_connections 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.153+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3484652762 wait complete. 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.154+0000 7f1c15dd3700 1 Processor -- start 2023-10-06T02:54:44.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.154+0000 7f1c15dd3700 1 -- start start 2023-10-06T02:54:44.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c15dd3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c10067b30 0x7f1c100b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c15dd3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c10156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c15dd3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c10142f20 0x7f1c100b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c15dd3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c8af0 con 0x7f1c10067b30 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c15dd3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1015d970 con 0x7f1c10142f20 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c15dd3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c84a0 con 0x7f1c1006bb80 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0effd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c10156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c10142f20 0x7f1c100b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0effd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c10156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:39736/0 (socket says 172.21.15.131:39736) 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c10142f20 0x7f1c100b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52186/0 (socket says 172.21.15.131:52186) 2023-10-06T02:54:44.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0effd700 1 -- 172.21.15.131:0/3923773491 learned_addr learned my addr 172.21.15.131:0/3923773491 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0f7fe700 1 --2- 172.21.15.131:0/3923773491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c10067b30 0x7f1c100b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0effd700 1 -- 172.21.15.131:0/3923773491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c10142f20 msgr2=0x7f1c100b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0effd700 1 --2- 172.21.15.131:0/3923773491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c10142f20 0x7f1c100b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0effd700 1 -- 172.21.15.131:0/3923773491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c10067b30 msgr2=0x7f1c100b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0effd700 1 --2- 172.21.15.131:0/3923773491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c10067b30 0x7f1c100b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0effd700 1 -- 172.21.15.131:0/3923773491 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08009a20 con 0x7f1c1006bb80 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.155+0000 7f1c0ffff700 1 --2- 172.21.15.131:0/3923773491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c10142f20 0x7f1c100b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.156+0000 7f1c0effd700 1 --2- 172.21.15.131:0/3923773491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c10156dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009290 tx=0x7f1c04017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.156+0000 7f1bf77fe700 1 -- 172.21.15.131:0/3923773491 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04000d10 con 0x7f1c1006bb80 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.156+0000 7f1bf77fe700 1 -- 172.21.15.131:0/3923773491 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0400bbe0 con 0x7f1c1006bb80 2023-10-06T02:54:44.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.156+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3923773491 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c040094f0 con 0x7f1c1006bb80 2023-10-06T02:54:44.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.156+0000 7f1bf77fe700 1 -- 172.21.15.131:0/3923773491 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0401a680 con 0x7f1c1006bb80 2023-10-06T02:54:44.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.156+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3923773491 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c100c81b0 con 0x7f1c1006bb80 2023-10-06T02:54:44.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.156+0000 7f1bf77fe700 1 -- 172.21.15.131:0/3923773491 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1c0401acb0 con 0x7f1c1006bb80 2023-10-06T02:54:44.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.156+0000 7f1bf77fe700 1 -- 172.21.15.131:0/3923773491 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f1c0401bd70 con 0x7f1c1006bb80 2023-10-06T02:54:44.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.157+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3923773491 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c10064ad0 con 0x7f1c1006bb80 2023-10-06T02:54:44.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.159+0000 7f1bf77fe700 1 -- 172.21.15.131:0/3923773491 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1c0402a060 con 0x7f1c1006bb80 2023-10-06T02:54:44.197 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:44.195+0000 7f8a584a1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T02:54:44.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.242+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3923773491 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e", "id": 5} v 0) v1 -- 0x7f1c100c8c30 con 0x7f1c1006bb80 2023-10-06T02:54:44.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.246+0000 7f1bf77fe700 1 -- 172.21.15.131:0/3923773491 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c04020030 con 0x7f1c1006bb80 2023-10-06T02:54:44.247 INFO:teuthology.orchestra.run.smithi131.stdout:5 2023-10-06T02:54:44.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.247+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3923773491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 msgr2=0x7f1c10156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.247+0000 7f1c15dd3700 1 --2- 172.21.15.131:0/3923773491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c10156dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009290 tx=0x7f1c04017000 comp rx=0 tx=0).stop 2023-10-06T02:54:44.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.247+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3923773491 shutdown_connections 2023-10-06T02:54:44.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.247+0000 7f1c15dd3700 1 --2- 172.21.15.131:0/3923773491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c10142f20 0x7f1c100b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.247+0000 7f1c15dd3700 1 --2- 172.21.15.131:0/3923773491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c10067b30 0x7f1c100b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.247+0000 7f1c15dd3700 1 --2- 172.21.15.131:0/3923773491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1006bb80 0x7f1c10156dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.247+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3923773491 >> 172.21.15.131:0/3923773491 conn(0x7f1c100cd1f0 msgr2=0x7f1c100ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:44.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.247+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3923773491 shutdown_connections 2023-10-06T02:54:44.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.247+0000 7f1c15dd3700 1 -- 172.21.15.131:0/3923773491 wait complete. 2023-10-06T02:54:44.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 9fa47ca3-7fc5-45e2-be9c-c719c312e400 6 2023-10-06T02:54:44.271 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:44.270+0000 7ff6af56a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:54:44.341 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:44.340+0000 7f8a584a1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T02:54:44.367 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:44.365+0000 7ff6af56a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:54:44.379 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.378+0000 7ffb4d952700 1 Processor -- start 2023-10-06T02:54:44.380 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.378+0000 7ffb4d952700 1 -- start start 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb4d952700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb480ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb4d952700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb480b2e60 con 0x7ffb480c6610 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb4d952700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb480cf5d0 con 0x7ffb480b2a90 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb4d952700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480cf8b0 con 0x7ffb480cbb50 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb467fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb480ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb467fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb480ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:39752/0 (socket says 172.21.15.131:39752) 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb467fc700 1 -- 172.21.15.131:0/646251872 learned_addr learned my addr 172.21.15.131:0/646251872 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb46ffd700 1 --1- 172.21.15.131:0/646251872 >> v1:172.21.15.131:6789/0 conn(0x7ffb480b2a90 0x7ffb480cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:35876/0 (socket says 172.21.15.131:35876) 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb467fc700 1 -- 172.21.15.131:0/646251872 >> v1:172.21.15.131:6789/0 conn(0x7ffb480b2a90 legacy=0x7ffb480cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb467fc700 1 -- 172.21.15.131:0/646251872 >> v1:172.21.15.84:6789/0 conn(0x7ffb480c6610 legacy=0x7ffb480ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb45ffb700 1 -- 172.21.15.131:0/646251872 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761411598 0 0) 0x7ffb480cf5d0 con 0x7ffb480b2a90 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb467fc700 1 -- 172.21.15.131:0/646251872 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480cfb90 con 0x7ffb480cbb50 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb467fc700 1 --2- 172.21.15.131:0/646251872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb480ce850 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb380099e0 tx=0x7ffb38009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49172b357bd02f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.379+0000 7ffb45ffb700 1 -- 172.21.15.131:0/646251872 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3800b860 con 0x7ffb480cbb50 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.380+0000 7ffb45ffb700 1 -- 172.21.15.131:0/646251872 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3800b9c0 con 0x7ffb480cbb50 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.380+0000 7ffb45ffb700 1 -- 172.21.15.131:0/646251872 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3800bd80 con 0x7ffb480cbb50 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.380+0000 7ffb4d952700 1 -- 172.21.15.131:0/646251872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 msgr2=0x7ffb480ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.380+0000 7ffb4d952700 1 --2- 172.21.15.131:0/646251872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb480ce850 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb380099e0 tx=0x7ffb38009250 comp rx=0 tx=0).stop 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.380+0000 7ffb4d952700 1 -- 172.21.15.131:0/646251872 shutdown_connections 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.380+0000 7ffb4d952700 1 --2- 172.21.15.131:0/646251872 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb480ce850 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.380+0000 7ffb4d952700 1 -- 172.21.15.131:0/646251872 >> 172.21.15.131:0/646251872 conn(0x7ffb48099740 msgr2=0x7ffb4806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:44.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.380+0000 7ffb4d952700 1 -- 172.21.15.131:0/646251872 shutdown_connections 2023-10-06T02:54:44.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.380+0000 7ffb4d952700 1 -- 172.21.15.131:0/646251872 wait complete. 2023-10-06T02:54:44.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.381+0000 7ffb4d952700 1 Processor -- start 2023-10-06T02:54:44.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.381+0000 7ffb4d952700 1 -- start start 2023-10-06T02:54:44.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb4d952700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb480b2a90 0x7ffb4815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb4d952700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb480c6610 0x7ffb48169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb4d952700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb4814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb4d952700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb481585e0 con 0x7ffb480b2a90 2023-10-06T02:54:44.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb4d952700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4816ab90 con 0x7ffb480c6610 2023-10-06T02:54:44.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb4d952700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4814c6a0 con 0x7ffb480cbb50 2023-10-06T02:54:44.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb467fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb480c6610 0x7ffb48169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb477fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb4814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb467fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb480c6610 0x7ffb48169bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52190/0 (socket says 172.21.15.131:52190) 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb477fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb4814c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:39766/0 (socket says 172.21.15.131:39766) 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb467fc700 1 -- 172.21.15.131:0/346293504 learned_addr learned my addr 172.21.15.131:0/346293504 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.382+0000 7ffb46ffd700 1 --2- 172.21.15.131:0/346293504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb480b2a90 0x7ffb4815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb477fe700 1 -- 172.21.15.131:0/346293504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb480c6610 msgr2=0x7ffb48169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb477fe700 1 --2- 172.21.15.131:0/346293504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb480c6610 0x7ffb48169bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb477fe700 1 -- 172.21.15.131:0/346293504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb480b2a90 msgr2=0x7ffb4815eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb477fe700 1 --2- 172.21.15.131:0/346293504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb480b2a90 0x7ffb4815eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb477fe700 1 -- 172.21.15.131:0/346293504 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb380094f0 con 0x7ffb480cbb50 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb467fc700 1 --2- 172.21.15.131:0/346293504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb480c6610 0x7ffb48169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb477fe700 1 --2- 172.21.15.131:0/346293504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb4814c160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000c860 tx=0x7ffb40001690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb2effd700 1 -- 172.21.15.131:0/346293504 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40012630 con 0x7ffb480cbb50 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb2effd700 1 -- 172.21.15.131:0/346293504 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb40012790 con 0x7ffb480cbb50 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb4d952700 1 -- 172.21.15.131:0/346293504 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4816a2f0 con 0x7ffb480cbb50 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb2effd700 1 -- 172.21.15.131:0/346293504 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40012b50 con 0x7ffb480cbb50 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb4d952700 1 -- 172.21.15.131:0/346293504 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4816a8b0 con 0x7ffb480cbb50 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb2effd700 1 -- 172.21.15.131:0/346293504 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ffb4001b400 con 0x7ffb480cbb50 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.383+0000 7ffb2effd700 1 -- 172.21.15.131:0/346293504 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7ffb4001a9a0 con 0x7ffb480cbb50 2023-10-06T02:54:44.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.384+0000 7ffb4d952700 1 -- 172.21.15.131:0/346293504 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb48064ad0 con 0x7ffb480cbb50 2023-10-06T02:54:44.389 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.387+0000 7ffb2effd700 1 -- 172.21.15.131:0/346293504 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ffb4001b8e0 con 0x7ffb480cbb50 2023-10-06T02:54:44.443 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:44.441+0000 7f8a584a1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T02:54:44.472 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.470+0000 7ffb4d952700 1 -- 172.21.15.131:0/346293504 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9fa47ca3-7fc5-45e2-be9c-c719c312e400", "id": 6} v 0) v1 -- 0x7ffb4804bb80 con 0x7ffb480cbb50 2023-10-06T02:54:44.478 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.477+0000 7ffb2effd700 1 -- 172.21.15.131:0/346293504 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9fa47ca3-7fc5-45e2-be9c-c719c312e400", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffb4001ba80 con 0x7ffb480cbb50 2023-10-06T02:54:44.478 INFO:teuthology.orchestra.run.smithi131.stdout:6 2023-10-06T02:54:44.479 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.478+0000 7ffb4d952700 1 -- 172.21.15.131:0/346293504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 msgr2=0x7ffb4814c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.479 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.478+0000 7ffb4d952700 1 --2- 172.21.15.131:0/346293504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb4814c160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000c860 tx=0x7ffb40001690 comp rx=0 tx=0).stop 2023-10-06T02:54:44.479 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.478+0000 7ffb4d952700 1 -- 172.21.15.131:0/346293504 shutdown_connections 2023-10-06T02:54:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.478+0000 7ffb4d952700 1 --2- 172.21.15.131:0/346293504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb480cbb50 0x7ffb4814c160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.478+0000 7ffb4d952700 1 --2- 172.21.15.131:0/346293504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb480b2a90 0x7ffb4815eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.478+0000 7ffb4d952700 1 --2- 172.21.15.131:0/346293504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb480c6610 0x7ffb48169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.478+0000 7ffb4d952700 1 -- 172.21.15.131:0/346293504 >> 172.21.15.131:0/346293504 conn(0x7ffb48099740 msgr2=0x7ffb48158db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.478+0000 7ffb4d952700 1 -- 172.21.15.131:0/346293504 shutdown_connections 2023-10-06T02:54:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.478+0000 7ffb4d952700 1 -- 172.21.15.131:0/346293504 wait complete. 2023-10-06T02:54:44.491 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new fe714779-3084-492d-9e94-004259b0e53a 7 2023-10-06T02:54:44.606 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.604+0000 7efd66726700 1 Processor -- start 2023-10-06T02:54:44.606 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.604+0000 7efd66726700 1 -- start start 2023-10-06T02:54:44.608 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.605+0000 7efd66726700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efd60156f00 0x7efd6015a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.605+0000 7efd66726700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600675f0 0x7efd60067a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.605+0000 7efd66726700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd60067f90 con 0x7efd601572d0 2023-10-06T02:54:44.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.605+0000 7efd66726700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6015da60 con 0x7efd60156f00 2023-10-06T02:54:44.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.605+0000 7efd66726700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6006c9e0 con 0x7efd600675f0 2023-10-06T02:54:44.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.605+0000 7efd5ffff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efd60156f00 0x7efd6015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.605+0000 7efd64cc3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600675f0 0x7efd60067a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.605+0000 7efd5ffff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efd60156f00 0x7efd6015a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52198/0 (socket says 172.21.15.131:52198) 2023-10-06T02:54:44.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.605+0000 7efd5ffff700 1 -- 172.21.15.131:0/3515720428 learned_addr learned my addr 172.21.15.131:0/3515720428 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:44.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd64cc3700 1 -- 172.21.15.131:0/3515720428 >> v2:172.21.15.131:3300/0 conn(0x7efd60156f00 msgr2=0x7efd6015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:44.610 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd64cc3700 1 --2- 172.21.15.131:0/3515720428 >> v2:172.21.15.131:3300/0 conn(0x7efd60156f00 0x7efd6015a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.610 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd64cc3700 1 -- 172.21.15.131:0/3515720428 >> v1:172.21.15.131:6789/0 conn(0x7efd601572d0 legacy=0x7efd600cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.610 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd64cc3700 1 -- 172.21.15.131:0/3515720428 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600cb690 con 0x7efd600675f0 2023-10-06T02:54:44.610 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd5ffff700 1 --2- 172.21.15.131:0/3515720428 >> v2:172.21.15.131:3300/0 conn(0x7efd60156f00 0x7efd6015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:44.610 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd64cc3700 1 --2- 172.21.15.131:0/3515720428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600675f0 0x7efd60067a50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd58009e60 tx=0x7efd58009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f67810c22f4c2ead server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:44.610 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd5effd700 1 -- 172.21.15.131:0/3515720428 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800e070 con 0x7efd600675f0 2023-10-06T02:54:44.610 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd5effd700 1 -- 172.21.15.131:0/3515720428 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800bb60 con 0x7efd600675f0 2023-10-06T02:54:44.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd5effd700 1 -- 172.21.15.131:0/3515720428 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58012430 con 0x7efd600675f0 2023-10-06T02:54:44.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd66726700 1 -- 172.21.15.131:0/3515720428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600675f0 msgr2=0x7efd60067a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.606+0000 7efd66726700 1 --2- 172.21.15.131:0/3515720428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600675f0 0x7efd60067a50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd58009e60 tx=0x7efd58009780 comp rx=0 tx=0).stop 2023-10-06T02:54:44.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.607+0000 7efd66726700 1 -- 172.21.15.131:0/3515720428 shutdown_connections 2023-10-06T02:54:44.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.607+0000 7efd66726700 1 --2- 172.21.15.131:0/3515720428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600675f0 0x7efd60067a50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.607+0000 7efd66726700 1 --2- 172.21.15.131:0/3515720428 >> v2:172.21.15.131:3300/0 conn(0x7efd60156f00 0x7efd6015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.607+0000 7efd66726700 1 -- 172.21.15.131:0/3515720428 >> 172.21.15.131:0/3515720428 conn(0x7efd600cd1e0 msgr2=0x7efd600cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:44.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.607+0000 7efd66726700 1 -- 172.21.15.131:0/3515720428 shutdown_connections 2023-10-06T02:54:44.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.607+0000 7efd66726700 1 -- 172.21.15.131:0/3515720428 wait complete. 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.608+0000 7efd66726700 1 Processor -- start 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.608+0000 7efd66726700 1 -- start start 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.608+0000 7efd66726700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd600675f0 0x7efd601554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.608+0000 7efd66726700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd60156f00 0x7efd6015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd66726700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600affa0 0x7efd6006a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd66726700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd600b0410 con 0x7efd60156f00 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd66726700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd600b06f0 con 0x7efd600675f0 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd66726700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600b09d0 con 0x7efd600affa0 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd600675f0 0x7efd601554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd600675f0 0x7efd601554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52210/0 (socket says 172.21.15.131:52210) 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5ffff700 1 -- 172.21.15.131:0/4182397556 learned_addr learned my addr 172.21.15.131:0/4182397556 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd64cc3700 1 --2- 172.21.15.131:0/4182397556 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600affa0 0x7efd6006a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5f7fe700 1 --2- 172.21.15.131:0/4182397556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd60156f00 0x7efd6015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5ffff700 1 -- 172.21.15.131:0/4182397556 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600affa0 msgr2=0x7efd6006a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5ffff700 1 --2- 172.21.15.131:0/4182397556 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600affa0 0x7efd6006a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5ffff700 1 -- 172.21.15.131:0/4182397556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd60156f00 msgr2=0x7efd6015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5ffff700 1 --2- 172.21.15.131:0/4182397556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd60156f00 0x7efd6015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5ffff700 1 -- 172.21.15.131:0/4182397556 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500094f0 con 0x7efd600675f0 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd5ffff700 1 --2- 172.21.15.131:0/4182397556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd600675f0 0x7efd601554b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efd5000ec50 tx=0x7efd50009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:44.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd47fff700 1 -- 172.21.15.131:0/4182397556 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5000c920 con 0x7efd600675f0 2023-10-06T02:54:44.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd47fff700 1 -- 172.21.15.131:0/4182397556 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5000ca80 con 0x7efd600675f0 2023-10-06T02:54:44.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd66726700 1 -- 172.21.15.131:0/4182397556 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd58009a20 con 0x7efd600675f0 2023-10-06T02:54:44.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd47fff700 1 -- 172.21.15.131:0/4182397556 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5000ce00 con 0x7efd600675f0 2023-10-06T02:54:44.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd66726700 1 -- 172.21.15.131:0/4182397556 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd600b0f90 con 0x7efd600675f0 2023-10-06T02:54:44.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd47fff700 1 -- 172.21.15.131:0/4182397556 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7efd50005c80 con 0x7efd600675f0 2023-10-06T02:54:44.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.609+0000 7efd47fff700 1 -- 172.21.15.131:0/4182397556 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7efd50013c20 con 0x7efd600675f0 2023-10-06T02:54:44.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.610+0000 7efd66726700 1 -- 172.21.15.131:0/4182397556 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd60064ad0 con 0x7efd600675f0 2023-10-06T02:54:44.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.612+0000 7efd47fff700 1 -- 172.21.15.131:0/4182397556 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7efd50021060 con 0x7efd600675f0 2023-10-06T02:54:44.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.694+0000 7efd66726700 1 -- 172.21.15.131:0/4182397556 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe714779-3084-492d-9e94-004259b0e53a", "id": 7} v 0) v1 -- 0x7efd6004bb80 con 0x7efd600675f0 2023-10-06T02:54:44.701 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.700+0000 7efd47fff700 1 -- 172.21.15.131:0/4182397556 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe714779-3084-492d-9e94-004259b0e53a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7efd50017070 con 0x7efd600675f0 2023-10-06T02:54:44.701 INFO:teuthology.orchestra.run.smithi131.stdout:7 2023-10-06T02:54:44.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.701+0000 7efd66726700 1 -- 172.21.15.131:0/4182397556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd600675f0 msgr2=0x7efd601554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.701+0000 7efd66726700 1 --2- 172.21.15.131:0/4182397556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd600675f0 0x7efd601554b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efd5000ec50 tx=0x7efd50009250 comp rx=0 tx=0).stop 2023-10-06T02:54:44.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.701+0000 7efd66726700 1 -- 172.21.15.131:0/4182397556 shutdown_connections 2023-10-06T02:54:44.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.701+0000 7efd66726700 1 --2- 172.21.15.131:0/4182397556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd600675f0 0x7efd601554b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.701+0000 7efd66726700 1 --2- 172.21.15.131:0/4182397556 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd600affa0 0x7efd6006a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.701+0000 7efd66726700 1 --2- 172.21.15.131:0/4182397556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd60156f00 0x7efd6015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.701+0000 7efd66726700 1 -- 172.21.15.131:0/4182397556 >> 172.21.15.131:0/4182397556 conn(0x7efd600cd1e0 msgr2=0x7efd600c1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:44.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.701+0000 7efd66726700 1 -- 172.21.15.131:0/4182397556 shutdown_connections 2023-10-06T02:54:44.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-10-06T02:54:44.701+0000 7efd66726700 1 -- 172.21.15.131:0/4182397556 wait complete. 2023-10-06T02:54:44.714 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T02:54:44.714 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T02:54:44.717 INFO:tasks.ceph.osd.0:Started 2023-10-06T02:54:44.717 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T02:54:44.717 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T02:54:44.719 INFO:tasks.ceph.osd.1:Started 2023-10-06T02:54:44.719 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T02:54:44.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T02:54:44.721 INFO:tasks.ceph.osd.2:Started 2023-10-06T02:54:44.721 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T02:54:44.721 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T02:54:44.723 INFO:tasks.ceph.osd.3:Started 2023-10-06T02:54:44.723 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T02:54:44.723 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T02:54:44.725 INFO:tasks.ceph.osd.4:Started 2023-10-06T02:54:44.725 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T02:54:44.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T02:54:44.727 INFO:tasks.ceph.osd.5:Started 2023-10-06T02:54:44.727 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T02:54:44.728 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T02:54:44.729 INFO:tasks.ceph.osd.6:Started 2023-10-06T02:54:44.730 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T02:54:44.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T02:54:44.731 INFO:tasks.ceph.osd.7:Started 2023-10-06T02:54:44.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:54:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.874+0000 7f05b9a90700 1 Processor -- start 2023-10-06T02:54:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.874+0000 7f05b9a90700 1 -- start start 2023-10-06T02:54:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b9a90700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f05b40b49e0 0x7f05b40aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b9a90700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 0x7f05b40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b9a90700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b40b0ca0 con 0x7f05b41595a0 2023-10-06T02:54:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b9a90700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b40b0f80 con 0x7f05b40b49e0 2023-10-06T02:54:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b9a90700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40b1260 con 0x7f05b40b07a0 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b2ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f05b40b49e0 0x7f05b40aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 0x7f05b40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b2ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f05b40b49e0 0x7f05b40aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:54560/0 (socket says 172.21.15.84:54560) 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b2ffd700 1 -- 172.21.15.84:0/2533329205 learned_addr learned my addr 172.21.15.84:0/2533329205 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.875+0000 7f05b37fe700 1 --1- 172.21.15.84:0/2533329205 >> v1:172.21.15.131:6789/0 conn(0x7f05b41595a0 0x7f05b40aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:57318/0 (socket says 172.21.15.84:57318) 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b2ffd700 1 -- 172.21.15.84:0/2533329205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 msgr2=0x7f05b40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b2ffd700 1 --2- 172.21.15.84:0/2533329205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 0x7f05b40b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b2ffd700 1 -- 172.21.15.84:0/2533329205 >> v1:172.21.15.131:6789/0 conn(0x7f05b41595a0 legacy=0x7f05b40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b2ffd700 1 -- 172.21.15.84:0/2533329205 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40b1540 con 0x7f05b40b49e0 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b3fff700 1 --2- 172.21.15.84:0/2533329205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 0x7f05b40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b27fc700 1 -- 172.21.15.84:0/2533329205 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382775041 0 0) 0x7f05b40b0ca0 con 0x7f05b41595a0 2023-10-06T02:54:44.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b2ffd700 1 --2- 172.21.15.84:0/2533329205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b40b49e0 0x7f05b40aac80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f05a40099e0 tx=0x7f05a4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e80c5ac4e608cc1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b27fc700 1 -- 172.21.15.84:0/2533329205 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400b820 con 0x7f05b40b49e0 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b27fc700 1 -- 172.21.15.84:0/2533329205 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a400b980 con 0x7f05b40b49e0 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b27fc700 1 -- 172.21.15.84:0/2533329205 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400bd20 con 0x7f05b40b49e0 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b9a90700 1 -- 172.21.15.84:0/2533329205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b40b49e0 msgr2=0x7f05b40aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b9a90700 1 --2- 172.21.15.84:0/2533329205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b40b49e0 0x7f05b40aac80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f05a40099e0 tx=0x7f05a4009250 comp rx=0 tx=0).stop 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b9a90700 1 -- 172.21.15.84:0/2533329205 shutdown_connections 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b9a90700 1 --2- 172.21.15.84:0/2533329205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 0x7f05b40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b9a90700 1 --2- 172.21.15.84:0/2533329205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b40b49e0 0x7f05b40aac80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b9a90700 1 -- 172.21.15.84:0/2533329205 >> 172.21.15.84:0/2533329205 conn(0x7f05b4099830 msgr2=0x7f05b406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b9a90700 1 -- 172.21.15.84:0/2533329205 shutdown_connections 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.876+0000 7f05b9a90700 1 -- 172.21.15.84:0/2533329205 wait complete. 2023-10-06T02:54:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.878+0000 7f05b9a90700 1 Processor -- start 2023-10-06T02:54:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.878+0000 7f05b9a90700 1 -- start start 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.878+0000 7f05b9a90700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 0x7f05b409d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.878+0000 7f05b9a90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40b49e0 0x7f05b414a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.878+0000 7f05b9a90700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b41595a0 0x7f05b409b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.878+0000 7f05b9a90700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b415b9d0 con 0x7f05b40b49e0 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.878+0000 7f05b9a90700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b409dbf0 con 0x7f05b41595a0 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.878+0000 7f05b9a90700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b409ded0 con 0x7f05b40b07a0 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.878+0000 7f05b2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40b49e0 0x7f05b414a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b37fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 0x7f05b409d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40b49e0 0x7f05b414a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55236/0 (socket says 172.21.15.84:55236) 2023-10-06T02:54:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b2ffd700 1 -- 172.21.15.84:0/3562464353 learned_addr learned my addr 172.21.15.84:0/3562464353 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:54:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b3fff700 1 --2- 172.21.15.84:0/3562464353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b41595a0 0x7f05b409b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b2ffd700 1 -- 172.21.15.84:0/3562464353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 msgr2=0x7f05b409d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b2ffd700 1 --2- 172.21.15.84:0/3562464353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 0x7f05b409d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b2ffd700 1 -- 172.21.15.84:0/3562464353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b41595a0 msgr2=0x7f05b409b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b2ffd700 1 --2- 172.21.15.84:0/3562464353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b41595a0 0x7f05b409b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b2ffd700 1 -- 172.21.15.84:0/3562464353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac009a20 con 0x7f05b40b49e0 2023-10-06T02:54:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b2ffd700 1 --2- 172.21.15.84:0/3562464353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40b49e0 0x7f05b414a890 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006fd0 tx=0x7f05a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05ab7fe700 1 -- 172.21.15.84:0/3562464353 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a4011de0 con 0x7f05b40b49e0 2023-10-06T02:54:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05ab7fe700 1 -- 172.21.15.84:0/3562464353 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a4024440 con 0x7f05b40b49e0 2023-10-06T02:54:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b9a90700 1 -- 172.21.15.84:0/3562464353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a40094f0 con 0x7f05b40b49e0 2023-10-06T02:54:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05ab7fe700 1 -- 172.21.15.84:0/3562464353 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a4024800 con 0x7f05b40b49e0 2023-10-06T02:54:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05b9a90700 1 -- 172.21.15.84:0/3562464353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b415b660 con 0x7f05b40b49e0 2023-10-06T02:54:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05ab7fe700 1 -- 172.21.15.84:0/3562464353 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f05a402d440 con 0x7f05b40b49e0 2023-10-06T02:54:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.879+0000 7f05ab7fe700 1 -- 172.21.15.84:0/3562464353 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f05a4024df0 con 0x7f05b40b49e0 2023-10-06T02:54:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.880+0000 7f05b9a90700 1 -- 172.21.15.84:0/3562464353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b415bb40 con 0x7f05b40b49e0 2023-10-06T02:54:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.882+0000 7f05ab7fe700 1 -- 172.21.15.84:0/3562464353 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f05a4015020 con 0x7f05b40b49e0 2023-10-06T02:54:44.915 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:44.912+0000 7ff6af56a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:54:44.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.951+0000 7f05b9a90700 1 -- 172.21.15.84:0/3562464353 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05b4064ad0 con 0x7f05b40b49e0 2023-10-06T02:54:44.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.951+0000 7f05ab7fe700 1 -- 172.21.15.84:0/3562464353 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f05a402d6f0 con 0x7f05b40b49e0 2023-10-06T02:54:44.953 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:54:44.953 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:54:44.696833+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:54:44.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.952+0000 7f05b9a90700 1 -- 172.21.15.84:0/3562464353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40b49e0 msgr2=0x7f05b414a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:44.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.952+0000 7f05b9a90700 1 --2- 172.21.15.84:0/3562464353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40b49e0 0x7f05b414a890 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006fd0 tx=0x7f05a4017000 comp rx=0 tx=0).stop 2023-10-06T02:54:44.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.952+0000 7f05b9a90700 1 -- 172.21.15.84:0/3562464353 shutdown_connections 2023-10-06T02:54:44.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.952+0000 7f05b9a90700 1 --2- 172.21.15.84:0/3562464353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05b41595a0 0x7f05b409b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.952+0000 7f05b9a90700 1 --2- 172.21.15.84:0/3562464353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f05b40b07a0 0x7f05b409d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.952+0000 7f05b9a90700 1 --2- 172.21.15.84:0/3562464353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05b40b49e0 0x7f05b414a890 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:44.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.952+0000 7f05b9a90700 1 -- 172.21.15.84:0/3562464353 >> 172.21.15.84:0/3562464353 conn(0x7f05b4099830 msgr2=0x7f05b4069390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:44.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.953+0000 7f05b9a90700 1 -- 172.21.15.84:0/3562464353 shutdown_connections 2023-10-06T02:54:44.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:54:44.953+0000 7f05b9a90700 1 -- 172.21.15.84:0/3562464353 wait complete. 2023-10-06T02:54:44.966 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T02:54:44.966 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T02:54:44.993 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:44.992+0000 7ff6af56a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:54:44.994 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:44.993+0000 7f8a584a1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T02:54:45.071 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:45.069+0000 7ff6af56a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:54:45.072 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:45.070+0000 7f8a584a1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T02:54:45.152 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:45.149+0000 7f8a584a1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T02:54:45.326 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-10-06T02:54:45.319+0000 7efe587e8540 -1 Falling back to public interface 2023-10-06T02:54:45.327 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-10-06T02:54:45.325+0000 7faad1cb1540 -1 Falling back to public interface 2023-10-06T02:54:45.331 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-10-06T02:54:45.330+0000 7fa50912d540 -1 Falling back to public interface 2023-10-06T02:54:45.337 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-10-06T02:54:45.335+0000 7efcba4b1540 -1 Falling back to public interface 2023-10-06T02:54:45.339 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-10-06T02:54:45.337+0000 7fd4d6363540 -1 Falling back to public interface 2023-10-06T02:54:45.342 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-10-06T02:54:45.340+0000 7f3e34e35540 -1 Falling back to public interface 2023-10-06T02:54:45.345 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-10-06T02:54:45.344+0000 7fe79f330540 -1 Falling back to public interface 2023-10-06T02:54:45.348 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-10-06T02:54:45.347+0000 7f42cb5f5540 -1 Falling back to public interface 2023-10-06T02:54:45.648 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:45.647+0000 7ff6af56a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T02:54:45.726 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:45.721+0000 7f8a584a1180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T02:54:45.772 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:54:45.785 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:45.784+0000 7ff6af56a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:54:45.861 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:45.859+0000 7f8a584a1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T02:54:45.879 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.877+0000 7f66e4d8f700 1 Processor -- start 2023-10-06T02:54:45.879 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.877+0000 7f66e4d8f700 1 -- start start 2023-10-06T02:54:45.881 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.878+0000 7f66e4d8f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66e00c87b0 0x7f66e015a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:45.881 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.878+0000 7f66e4d8f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66e006c2f0 0x7f66e0156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:45.882 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.878+0000 7f66e4d8f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e00b07f0 con 0x7f66e01561a0 2023-10-06T02:54:45.882 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.878+0000 7f66e4d8f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e015a5e0 con 0x7f66e006c2f0 2023-10-06T02:54:45.882 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.878+0000 7f66e4d8f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e015a8c0 con 0x7f66e00c87b0 2023-10-06T02:54:45.882 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.878+0000 7f66ded9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66e006c2f0 0x7f66e0156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:45.882 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.878+0000 7f66de59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f66e01561a0 0x7f66e00c80a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:60246/0 (socket says 172.21.15.84:60246) 2023-10-06T02:54:45.882 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.878+0000 7f66de59c700 1 -- 172.21.15.84:0/1368696286 learned_addr learned my addr 172.21.15.84:0/1368696286 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:54:45.882 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66ded9d700 1 -- 172.21.15.84:0/1368696286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66e00c87b0 msgr2=0x7f66e015a000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:54:45.882 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66ded9d700 1 --2- 172.21.15.84:0/1368696286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66e00c87b0 0x7f66e015a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66ded9d700 1 -- 172.21.15.84:0/1368696286 >> v1:172.21.15.84:6789/0 conn(0x7f66e01561a0 legacy=0x7f66e00c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66dd59a700 1 -- 172.21.15.84:0/1368696286 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217015935 0 0) 0x7f66e00b07f0 con 0x7f66e01561a0 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66ded9d700 1 -- 172.21.15.84:0/1368696286 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e015aba0 con 0x7f66e006c2f0 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66ded9d700 1 --2- 172.21.15.84:0/1368696286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 0x7f66e0156570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009e60 tx=0x7f66d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c436da60c9af8cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66dd59a700 1 -- 172.21.15.84:0/1368696286 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800e070 con 0x7f66e006c2f0 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66dd59a700 1 -- 172.21.15.84:0/1368696286 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800bc30 con 0x7f66e006c2f0 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66dd59a700 1 -- 172.21.15.84:0/1368696286 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8012430 con 0x7f66e006c2f0 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66e4d8f700 1 -- 172.21.15.84:0/1368696286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 msgr2=0x7f66e0156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.879+0000 7f66e4d8f700 1 --2- 172.21.15.84:0/1368696286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 0x7f66e0156570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009e60 tx=0x7f66d8009780 comp rx=0 tx=0).stop 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.880+0000 7f66e4d8f700 1 -- 172.21.15.84:0/1368696286 shutdown_connections 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.880+0000 7f66e4d8f700 1 --2- 172.21.15.84:0/1368696286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 0x7f66e0156570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:45.883 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.880+0000 7f66e4d8f700 1 --2- 172.21.15.84:0/1368696286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66e00c87b0 0x7f66e015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:45.884 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.880+0000 7f66e4d8f700 1 -- 172.21.15.84:0/1368696286 >> 172.21.15.84:0/1368696286 conn(0x7f66e006e6c0 msgr2=0x7f66e006eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:45.884 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.880+0000 7f66e4d8f700 1 -- 172.21.15.84:0/1368696286 shutdown_connections 2023-10-06T02:54:45.884 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.880+0000 7f66e4d8f700 1 -- 172.21.15.84:0/1368696286 wait complete. 2023-10-06T02:54:45.886 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.881+0000 7f66e4d8f700 1 Processor -- start 2023-10-06T02:54:45.886 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.881+0000 7f66e4d8f700 1 -- start start 2023-10-06T02:54:45.886 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.881+0000 7f66e4d8f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 0x7f66e0144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:45.886 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.881+0000 7f66e4d8f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66e00c87b0 0x7f66e00c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:45.886 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.881+0000 7f66e4d8f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66e01561a0 0x7f66e006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:45.886 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.881+0000 7f66e4d8f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c4f70 con 0x7f66e006c2f0 2023-10-06T02:54:45.886 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.881+0000 7f66e4d8f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c4360 con 0x7f66e01561a0 2023-10-06T02:54:45.886 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.881+0000 7f66e4d8f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c4640 con 0x7f66e00c87b0 2023-10-06T02:54:45.887 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.881+0000 7f66de59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 0x7f66e0144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:45.887 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66de59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 0x7f66e0144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55260/0 (socket says 172.21.15.84:55260) 2023-10-06T02:54:45.887 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66de59c700 1 -- 172.21.15.84:0/4039283801 learned_addr learned my addr 172.21.15.84:0/4039283801 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:54:45.887 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66ded9d700 1 --2- 172.21.15.84:0/4039283801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66e01561a0 0x7f66e006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:45.887 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66de59c700 1 -- 172.21.15.84:0/4039283801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66e00c87b0 msgr2=0x7f66e00c39f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:54:45.887 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66de59c700 1 --2- 172.21.15.84:0/4039283801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66e00c87b0 0x7f66e00c39f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:45.887 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66de59c700 1 -- 172.21.15.84:0/4039283801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66e01561a0 msgr2=0x7f66e006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:45.887 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66de59c700 1 --2- 172.21.15.84:0/4039283801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66e01561a0 0x7f66e006ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:45.888 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66de59c700 1 -- 172.21.15.84:0/4039283801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8009a20 con 0x7f66e006c2f0 2023-10-06T02:54:45.888 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66ded9d700 1 --2- 172.21.15.84:0/4039283801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66e01561a0 0x7f66e006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:54:45.888 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66de59c700 1 --2- 172.21.15.84:0/4039283801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 0x7f66e0144f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f66d000c5b0 tx=0x7f66d0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:45.888 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66ce7fc700 1 -- 172.21.15.84:0/4039283801 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0005b30 con 0x7f66e006c2f0 2023-10-06T02:54:45.888 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66ce7fc700 1 -- 172.21.15.84:0/4039283801 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d0005c90 con 0x7f66e006c2f0 2023-10-06T02:54:45.888 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66e4d8f700 1 -- 172.21.15.84:0/4039283801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e00c4920 con 0x7f66e006c2f0 2023-10-06T02:54:45.888 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66ce7fc700 1 -- 172.21.15.84:0/4039283801 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0007300 con 0x7f66e006c2f0 2023-10-06T02:54:45.888 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.882+0000 7f66e4d8f700 1 -- 172.21.15.84:0/4039283801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e00c3f30 con 0x7f66e006c2f0 2023-10-06T02:54:45.888 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.883+0000 7f66ce7fc700 1 -- 172.21.15.84:0/4039283801 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f66d001c6c0 con 0x7f66e006c2f0 2023-10-06T02:54:45.889 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.883+0000 7f66ce7fc700 1 -- 172.21.15.84:0/4039283801 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f66d00076f0 con 0x7f66e006c2f0 2023-10-06T02:54:45.889 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.883+0000 7f66e4d8f700 1 -- 172.21.15.84:0/4039283801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e0064ad0 con 0x7f66e006c2f0 2023-10-06T02:54:45.889 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.885+0000 7f66ce7fc700 1 -- 172.21.15.84:0/4039283801 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f66d0017070 con 0x7f66e006c2f0 2023-10-06T02:54:45.889 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:45.887+0000 7ff6af56a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:54:45.954 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:45.952+0000 7f8a584a1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T02:54:45.955 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.954+0000 7f66e4d8f700 1 -- 172.21.15.84:0/4039283801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66e015ae80 con 0x7f66e006c2f0 2023-10-06T02:54:45.956 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.955+0000 7f66ce7fc700 1 -- 172.21.15.84:0/4039283801 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f66d001cba0 con 0x7f66e006c2f0 2023-10-06T02:54:45.956 INFO:teuthology.misc.health.smithi084.stdout: 2023-10-06T02:54:45.956 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:54:44.696833+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:54:45.957 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.956+0000 7f66e4d8f700 1 -- 172.21.15.84:0/4039283801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 msgr2=0x7f66e0144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:45.957 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.956+0000 7f66e4d8f700 1 --2- 172.21.15.84:0/4039283801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 0x7f66e0144f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f66d000c5b0 tx=0x7f66d0001070 comp rx=0 tx=0).stop 2023-10-06T02:54:45.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.956+0000 7f66e4d8f700 1 -- 172.21.15.84:0/4039283801 shutdown_connections 2023-10-06T02:54:45.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.956+0000 7f66e4d8f700 1 --2- 172.21.15.84:0/4039283801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66e01561a0 0x7f66e006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:45.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.956+0000 7f66e4d8f700 1 --2- 172.21.15.84:0/4039283801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66e006c2f0 0x7f66e0144f00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:45.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.956+0000 7f66e4d8f700 1 --2- 172.21.15.84:0/4039283801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66e00c87b0 0x7f66e00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:45.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.956+0000 7f66e4d8f700 1 -- 172.21.15.84:0/4039283801 >> 172.21.15.84:0/4039283801 conn(0x7f66e006e6c0 msgr2=0x7f66e0152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:45.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.956+0000 7f66e4d8f700 1 -- 172.21.15.84:0/4039283801 shutdown_connections 2023-10-06T02:54:45.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:45.956+0000 7f66e4d8f700 1 -- 172.21.15.84:0/4039283801 wait complete. 2023-10-06T02:54:45.969 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T02:54:46.137 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:46.135+0000 7ff6af56a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T02:54:46.205 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:46.204+0000 7f8a584a1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T02:54:46.215 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:46.214+0000 7ff6af56a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:54:46.282 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:46.281+0000 7f8a584a1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T02:54:47.037 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:47.035+0000 7ff6af56a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T02:54:47.109 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:47.107+0000 7ff6af56a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:54:47.125 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:47.123+0000 7f8a584a1180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T02:54:47.181 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:47.180+0000 7ff6af56a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:54:47.198 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:47.197+0000 7f8a584a1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T02:54:47.273 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:47.272+0000 7f8a584a1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T02:54:47.314 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:47.313+0000 7ff6af56a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:54:47.399 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:47.397+0000 7ff6af56a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:54:47.406 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:47.404+0000 7f8a584a1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T02:54:47.490 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:47.488+0000 7f8a584a1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T02:54:47.550 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:47.548+0000 7ff6af56a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:54:47.625 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:47.623+0000 7ff6af56a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:54:47.642 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:47.641+0000 7f8a584a1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T02:54:47.703 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:47.702+0000 7ff6af56a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:54:47.716 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:47.715+0000 7f8a584a1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T02:54:47.777 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:47.776+0000 7ff6af56a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:54:47.794 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:47.793+0000 7f8a584a1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T02:54:47.882 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-10-06T02:54:47.880+0000 7f8a584a1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T02:54:48.801 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:48.800+0000 7ff66896e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T02:54:48.801 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-10-06T02:54:48.800+0000 7ff66896e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T02:54:48.818 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-10-06T02:54:48.816+0000 7faad1cb1540 -1 osd.4 0 log_to_monitors true 2023-10-06T02:54:48.846 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-10-06T02:54:48.844+0000 7fd4d6363540 -1 osd.0 0 log_to_monitors true 2023-10-06T02:54:48.871 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-10-06T02:54:48.869+0000 7efcba4b1540 -1 osd.7 0 log_to_monitors true 2023-10-06T02:54:48.872 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-10-06T02:54:48.871+0000 7fa50912d540 -1 osd.5 0 log_to_monitors true 2023-10-06T02:54:48.878 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-10-06T02:54:48.876+0000 7f3e34e35540 -1 osd.1 0 log_to_monitors true 2023-10-06T02:54:48.879 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-10-06T02:54:48.877+0000 7efe587e8540 -1 osd.2 0 log_to_monitors true 2023-10-06T02:54:48.888 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-10-06T02:54:48.886+0000 7f42cb5f5540 -1 osd.3 0 log_to_monitors true 2023-10-06T02:54:48.899 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-10-06T02:54:48.898+0000 7fe79f330540 -1 osd.6 0 log_to_monitors true 2023-10-06T02:54:52.764 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-10-06T02:54:52.762+0000 7faac88d3700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T02:54:52.768 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-10-06T02:54:52.767+0000 7faac16ca700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:54:52.774 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:54:52.790 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-10-06T02:54:52.788+0000 7fe795f52700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T02:54:52.795 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-10-06T02:54:52.793+0000 7fe78ed49700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:54:52.839 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-10-06T02:54:52.838+0000 7efcb10d3700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T02:54:52.843 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-10-06T02:54:52.842+0000 7efca9eca700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:54:52.848 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-10-06T02:54:52.845+0000 7fd4ccf85700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T02:54:52.855 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-10-06T02:54:52.854+0000 7fd4c5d7c700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:54:52.857 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-10-06T02:54:52.856+0000 7fa4ffd4f700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T02:54:52.858 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-10-06T02:54:52.855+0000 7f42c2217700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T02:54:52.862 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-10-06T02:54:52.860+0000 7fa4f8b46700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:54:52.862 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-10-06T02:54:52.860+0000 7f42bb00e700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:54:52.874 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-10-06T02:54:52.872+0000 7efe4f40a700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T02:54:52.879 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-10-06T02:54:52.878+0000 7efe48201700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:54:52.883 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-10-06T02:54:52.881+0000 7f3e2d25a700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T02:54:52.886 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-10-06T02:54:52.885+0000 7f3e2484e700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T02:54:52.951 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.949+0000 7f6920a3f700 1 Processor -- start 2023-10-06T02:54:52.951 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.949+0000 7f6920a3f700 1 -- start start 2023-10-06T02:54:52.953 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f6920a3f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f691c159900 0x7f691c0aba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:52.953 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f6920a3f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691c0abf40 con 0x7f691c159530 2023-10-06T02:54:52.953 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f6920a3f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691c0c8180 con 0x7f691c06af20 2023-10-06T02:54:52.953 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f6920a3f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691c0c9b60 con 0x7f691c159900 2023-10-06T02:54:52.953 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f691ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f691c159530 0x7f691c0acdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57886/0 (socket says 172.21.15.84:57886) 2023-10-06T02:54:52.953 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f691ad9d700 1 -- 172.21.15.84:0/1296129298 learned_addr learned my addr 172.21.15.84:0/1296129298 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f6913fff700 1 --2- 172.21.15.84:0/1296129298 >> v2:172.21.15.84:3300/0 conn(0x7f691c159900 0x7f691c0aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f691a59c700 1 -- 172.21.15.84:0/1296129298 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546027846 0 0) 0x7f691c0abf40 con 0x7f691c159530 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f691a59c700 1 -- 172.21.15.84:0/1296129298 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6908003570 con 0x7f691c159530 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f6913fff700 1 -- 172.21.15.84:0/1296129298 >> v1:172.21.15.131:6789/0 conn(0x7f691c06af20 legacy=0x7f691c06d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f6913fff700 1 -- 172.21.15.84:0/1296129298 >> v1:172.21.15.84:6789/0 conn(0x7f691c159530 legacy=0x7f691c0acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.950+0000 7f6913fff700 1 -- 172.21.15.84:0/1296129298 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0c7850 con 0x7f691c159900 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f6913fff700 1 --2- 172.21.15.84:0/1296129298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 0x7f691c0aba00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6904009910 tx=0x7f69040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bd5e1b3be8c08b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f691a59c700 1 -- 172.21.15.84:0/1296129298 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400b640 con 0x7f691c159900 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f691a59c700 1 -- 172.21.15.84:0/1296129298 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690400b7a0 con 0x7f691c159900 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f691a59c700 1 -- 172.21.15.84:0/1296129298 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400bb60 con 0x7f691c159900 2023-10-06T02:54:52.954 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f6920a3f700 1 -- 172.21.15.84:0/1296129298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 msgr2=0x7f691c0aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:52.955 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f6920a3f700 1 --2- 172.21.15.84:0/1296129298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 0x7f691c0aba00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6904009910 tx=0x7f69040091a0 comp rx=0 tx=0).stop 2023-10-06T02:54:52.955 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f6920a3f700 1 -- 172.21.15.84:0/1296129298 shutdown_connections 2023-10-06T02:54:52.955 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f6920a3f700 1 --2- 172.21.15.84:0/1296129298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 0x7f691c0aba00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:52.955 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f6920a3f700 1 -- 172.21.15.84:0/1296129298 >> 172.21.15.84:0/1296129298 conn(0x7f691c0cd260 msgr2=0x7f691c0c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:52.955 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f6920a3f700 1 -- 172.21.15.84:0/1296129298 shutdown_connections 2023-10-06T02:54:52.955 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.951+0000 7f6920a3f700 1 -- 172.21.15.84:0/1296129298 wait complete. 2023-10-06T02:54:52.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.952+0000 7f6920a3f700 1 Processor -- start 2023-10-06T02:54:52.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.952+0000 7f6920a3f700 1 -- start start 2023-10-06T02:54:52.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f6920a3f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f691c06af20 0x7f691c143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:52.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f6920a3f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f691c159530 0x7f691c157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:52.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f6920a3f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 0x7f691c0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:52.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f6920a3f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0b0450 con 0x7f691c159900 2023-10-06T02:54:52.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f6920a3f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c143760 con 0x7f691c06af20 2023-10-06T02:54:52.958 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f6920a3f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0af880 con 0x7f691c159530 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f691b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 0x7f691c0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f691b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 0x7f691c0b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57648/0 (socket says 172.21.15.84:57648) 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f691b59e700 1 -- 172.21.15.84:0/1633371863 learned_addr learned my addr 172.21.15.84:0/1633371863 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f691ad9d700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f691c06af20 0x7f691c143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f6913fff700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f691c159530 0x7f691c157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f691b59e700 1 -- 172.21.15.84:0/1633371863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f691c159530 msgr2=0x7f691c157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f691b59e700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f691c159530 0x7f691c157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.953+0000 7f691b59e700 1 -- 172.21.15.84:0/1633371863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f691c06af20 msgr2=0x7f691c143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.954+0000 7f691b59e700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f691c06af20 0x7f691c143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.954+0000 7f691b59e700 1 -- 172.21.15.84:0/1633371863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904009420 con 0x7f691c159900 2023-10-06T02:54:52.959 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.954+0000 7f691b59e700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 0x7f691c0b08e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f691400ed50 tx=0x7f691400c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.954+0000 7f6912ffd700 1 -- 172.21.15.84:0/1633371863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914004120 con 0x7f691c159900 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.954+0000 7f6912ffd700 1 -- 172.21.15.84:0/1633371863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6914011470 con 0x7f691c159900 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.954+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691c0afb20 con 0x7f691c159900 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.954+0000 7f6912ffd700 1 -- 172.21.15.84:0/1633371863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914011830 con 0x7f691c159900 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.954+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691c0b00e0 con 0x7f691c159900 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.955+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691c064ad0 con 0x7f691c159900 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.955+0000 7f6912ffd700 1 -- 172.21.15.84:0/1633371863 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f6914011ba0 con 0x7f691c159900 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.956+0000 7f6912ffd700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68fc066ea0 0x7f68fc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.956+0000 7f691ad9d700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68fc066ea0 0x7f68fc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.956+0000 7f6912ffd700 1 -- 172.21.15.84:0/1633371863 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f6914015070 con 0x7f691c159900 2023-10-06T02:54:52.960 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.956+0000 7f691ad9d700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68fc066ea0 0x7f68fc069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f690c007fd0 tx=0x7f690c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:54:52.961 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:52.960+0000 7f6912ffd700 1 -- 172.21.15.84:0/1633371863 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6914053ee0 con 0x7f691c159900 2023-10-06T02:54:53.148 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.147+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f691c0c7b30 con 0x7f691c159900 2023-10-06T02:54:53.149 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.147+0000 7f6912ffd700 1 -- 172.21.15.84:0/1633371863 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f691401e070 con 0x7f691c159900 2023-10-06T02:54:53.149 INFO:teuthology.misc.health.smithi084.stdout: 2023-10-06T02:54:53.149 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":12,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:54:50.797087+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:54:53.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.149+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68fc066ea0 msgr2=0x7f68fc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:53.151 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.149+0000 7f6920a3f700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68fc066ea0 0x7f68fc069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f690c007fd0 tx=0x7f690c009040 comp rx=0 tx=0).stop 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.149+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 msgr2=0x7f691c0b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.149+0000 7f6920a3f700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 0x7f691c0b08e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f691400ed50 tx=0x7f691400c570 comp rx=0 tx=0).stop 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.150+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 shutdown_connections 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.150+0000 7f6920a3f700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68fc066ea0 0x7f68fc069350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.150+0000 7f6920a3f700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f691c06af20 0x7f691c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.150+0000 7f6920a3f700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f691c159900 0x7f691c0b08e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.150+0000 7f6920a3f700 1 --2- 172.21.15.84:0/1633371863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f691c159530 0x7f691c157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.150+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 >> 172.21.15.84:0/1633371863 conn(0x7f691c0cd260 msgr2=0x7f691c0caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.150+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 shutdown_connections 2023-10-06T02:54:53.152 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:54:53.150+0000 7f6920a3f700 1 -- 172.21.15.84:0/1633371863 wait complete. 2023-10-06T02:54:53.162 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T02:54:59.969 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:00.084 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.082+0000 7f5da7249700 1 Processor -- start 2023-10-06T02:55:00.084 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.082+0000 7f5da7249700 1 -- start start 2023-10-06T02:55:00.085 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5da7249700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5da00b2950 0x7f5da00cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.085 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5da7249700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da0159c10 con 0x7f5da00cfd70 2023-10-06T02:55:00.085 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5da7249700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da00d02b0 con 0x7f5da00cbd70 2023-10-06T02:55:00.085 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5da7249700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da00c5c50 con 0x7f5da00b2950 2023-10-06T02:55:00.085 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5da4fe5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5da00b2950 0x7f5da00cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.085 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5d9ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5da00cfd70 0x7f5da00cb660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57896/0 (socket says 172.21.15.84:57896) 2023-10-06T02:55:00.086 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5d9ffff700 1 -- 172.21.15.84:0/1331996287 learned_addr learned my addr 172.21.15.84:0/1331996287 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:00.086 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5da4fe5700 1 -- 172.21.15.84:0/1331996287 >> v1:172.21.15.131:6789/0 conn(0x7f5da00cbd70 legacy=0x7f5da00c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:00.086 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5da4fe5700 1 -- 172.21.15.84:0/1331996287 >> v1:172.21.15.84:6789/0 conn(0x7f5da00cfd70 legacy=0x7f5da00cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:00.086 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5d9f7fe700 1 -- 172.21.15.84:0/1331996287 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954115238 0 0) 0x7f5da0159c10 con 0x7f5da00cfd70 2023-10-06T02:55:00.086 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5da4fe5700 1 -- 172.21.15.84:0/1331996287 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da00c5320 con 0x7f5da00b2950 2023-10-06T02:55:00.086 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.083+0000 7f5da4fe5700 1 --2- 172.21.15.84:0/1331996287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00b2950 0x7f5da00cf830 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d940098d0 tx=0x7f5d94009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147b7feb9e28d33c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:00.086 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5d9f7fe700 1 -- 172.21.15.84:0/1331996287 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94009e70 con 0x7f5da00b2950 2023-10-06T02:55:00.086 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5d9f7fe700 1 -- 172.21.15.84:0/1331996287 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d94005c10 con 0x7f5da00b2950 2023-10-06T02:55:00.086 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5d9f7fe700 1 -- 172.21.15.84:0/1331996287 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9400b610 con 0x7f5da00b2950 2023-10-06T02:55:00.087 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5da7249700 1 -- 172.21.15.84:0/1331996287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00b2950 msgr2=0x7f5da00cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:00.087 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5da7249700 1 --2- 172.21.15.84:0/1331996287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00b2950 0x7f5da00cf830 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d940098d0 tx=0x7f5d94009120 comp rx=0 tx=0).stop 2023-10-06T02:55:00.087 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5da7249700 1 -- 172.21.15.84:0/1331996287 shutdown_connections 2023-10-06T02:55:00.087 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5da7249700 1 --2- 172.21.15.84:0/1331996287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00b2950 0x7f5da00cf830 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.087 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5da7249700 1 -- 172.21.15.84:0/1331996287 >> 172.21.15.84:0/1331996287 conn(0x7f5da0099750 msgr2=0x7f5da006cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:00.088 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5da7249700 1 -- 172.21.15.84:0/1331996287 shutdown_connections 2023-10-06T02:55:00.088 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.084+0000 7f5da7249700 1 -- 172.21.15.84:0/1331996287 wait complete. 2023-10-06T02:55:00.088 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.085+0000 7f5da7249700 1 Processor -- start 2023-10-06T02:55:00.088 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da7249700 1 -- start start 2023-10-06T02:55:00.089 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da7249700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da00b2950 0x7f5da0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.089 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da7249700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da00cbd70 0x7f5da00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da7249700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00cfd70 0x7f5da0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da7249700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da015d630 con 0x7f5da00cfd70 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da7249700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da015d910 con 0x7f5da00b2950 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da7249700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0154560 con 0x7f5da00cbd70 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da57e6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00cfd70 0x7f5da0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da57e6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00cfd70 0x7f5da0154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57676/0 (socket says 172.21.15.84:57676) 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.086+0000 7f5da57e6700 1 -- 172.21.15.84:0/718133536 learned_addr learned my addr 172.21.15.84:0/718133536 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5da4fe5700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da00b2950 0x7f5da0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5d9ffff700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da00cbd70 0x7f5da00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5da57e6700 1 -- 172.21.15.84:0/718133536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da00cbd70 msgr2=0x7f5da00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:00.090 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5da57e6700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da00cbd70 0x7f5da00b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5da57e6700 1 -- 172.21.15.84:0/718133536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da00b2950 msgr2=0x7f5da0151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5da57e6700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da00b2950 0x7f5da0151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5da57e6700 1 -- 172.21.15.84:0/718133536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940093c0 con 0x7f5da00cfd70 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5da57e6700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00cfd70 0x7f5da0154d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800c890 tx=0x7f5d980026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5d9cff9700 1 -- 172.21.15.84:0/718133536 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98012630 con 0x7f5da00cfd70 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5d9cff9700 1 -- 172.21.15.84:0/718133536 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d98012790 con 0x7f5da00cfd70 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da0154840 con 0x7f5da00cfd70 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5d9cff9700 1 -- 172.21.15.84:0/718133536 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98012b50 con 0x7f5da00cfd70 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.087+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da0154180 con 0x7f5da00cfd70 2023-10-06T02:55:00.091 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.088+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da0154a30 con 0x7f5da00cfd70 2023-10-06T02:55:00.092 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.088+0000 7f5d9cff9700 1 -- 172.21.15.84:0/718133536 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d9800a420 con 0x7f5da00cfd70 2023-10-06T02:55:00.092 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.089+0000 7f5d9cff9700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d84066f30 0x7f5d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.092 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.089+0000 7f5d9cff9700 1 -- 172.21.15.84:0/718133536 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5d980845a0 con 0x7f5da00cfd70 2023-10-06T02:55:00.092 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.089+0000 7f5da4fe5700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d84066f30 0x7f5d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.092 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.089+0000 7f5da4fe5700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d84066f30 0x7f5d840693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009390 tx=0x7f5d94015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:00.097 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.093+0000 7f5d9cff9700 1 -- 172.21.15.84:0/718133536 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d98051b60 con 0x7f5da00cfd70 2023-10-06T02:55:00.278 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.276+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5da0064ad0 con 0x7f5da00cfd70 2023-10-06T02:55:00.279 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.277+0000 7f5d9cff9700 1 -- 172.21.15.84:0/718133536 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f5d98055180 con 0x7f5da00cfd70 2023-10-06T02:55:00.279 INFO:teuthology.misc.health.smithi084.stdout: 2023-10-06T02:55:00.279 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":16,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:54:56.798429+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:00.281 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d84066f30 msgr2=0x7f5d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:00.281 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d84066f30 0x7f5d840693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009390 tx=0x7f5d94015000 comp rx=0 tx=0).stop 2023-10-06T02:55:00.281 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00cfd70 msgr2=0x7f5da0154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:00.281 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00cfd70 0x7f5da0154d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800c890 tx=0x7f5d980026a0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.282 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 shutdown_connections 2023-10-06T02:55:00.282 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d84066f30 0x7f5d840693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.282 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5da00b2950 0x7f5da0151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.282 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5da00cfd70 0x7f5da0154d60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.282 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 --2- 172.21.15.84:0/718133536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5da00cbd70 0x7f5da00b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.282 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 >> 172.21.15.84:0/718133536 conn(0x7f5da0099750 msgr2=0x7f5da00c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:00.282 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 shutdown_connections 2023-10-06T02:55:00.282 INFO:teuthology.misc.health.smithi084.stderr:2023-10-06T02:55:00.279+0000 7f5da7249700 1 -- 172.21.15.84:0/718133536 wait complete. 2023-10-06T02:55:00.292 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T02:55:00.292 INFO:tasks.ceph:Creating RBD pool 2023-10-06T02:55:00.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T02:55:00.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.403+0000 7ff550907700 1 Processor -- start 2023-10-06T02:55:00.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.403+0000 7ff550907700 1 -- start start 2023-10-06T02:55:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.403+0000 7ff550907700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 0x7ff54c157530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.403+0000 7ff550907700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff54c06b4b0 0x7ff54c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.403+0000 7ff550907700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff54c06b900 0x7ff54c06ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.403+0000 7ff550907700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c0c7d10 con 0x7ff54c06b900 2023-10-06T02:55:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.403+0000 7ff550907700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c06bda0 con 0x7ff54c06b4b0 2023-10-06T02:55:00.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.403+0000 7ff550907700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c06c080 con 0x7ff54c150820 2023-10-06T02:55:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff54c06b900 0x7ff54c06ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff54c06b900 0x7ff54c06ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57692/0 (socket says 172.21.15.84:57692) 2023-10-06T02:55:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54ad9d700 1 -- 172.21.15.84:0/3560296243 learned_addr learned my addr 172.21.15.84:0/3560296243 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54a59c700 1 --2- 172.21.15.84:0/3560296243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 0x7ff54c157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff541d9b700 1 --2- 172.21.15.84:0/3560296243 >> v2:172.21.15.131:3300/0 conn(0x7ff54c06b4b0 0x7ff54c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54ad9d700 1 -- 172.21.15.84:0/3560296243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 msgr2=0x7ff54c157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54ad9d700 1 --2- 172.21.15.84:0/3560296243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 0x7ff54c157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54ad9d700 1 -- 172.21.15.84:0/3560296243 >> v2:172.21.15.131:3300/0 conn(0x7ff54c06b4b0 msgr2=0x7ff54c06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54ad9d700 1 --2- 172.21.15.84:0/3560296243 >> v2:172.21.15.131:3300/0 conn(0x7ff54c06b4b0 0x7ff54c06e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54ad9d700 1 -- 172.21.15.84:0/3560296243 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c0c79a0 con 0x7ff54c06b900 2023-10-06T02:55:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54a59c700 1 --2- 172.21.15.84:0/3560296243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 0x7ff54c157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:00.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff541d9b700 1 --2- 172.21.15.84:0/3560296243 >> v2:172.21.15.131:3300/0 conn(0x7ff54c06b4b0 0x7ff54c06e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff54ad9d700 1 --2- 172.21.15.84:0/3560296243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 0x7ff54c06ea00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0cacd0 tx=0x7ff54400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d50b16e84253bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff549d9b700 1 -- 172.21.15.84:0/3560296243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544010070 con 0x7ff54c06b900 2023-10-06T02:55:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff549d9b700 1 -- 172.21.15.84:0/3560296243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54400de90 con 0x7ff54c06b900 2023-10-06T02:55:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.404+0000 7ff549d9b700 1 -- 172.21.15.84:0/3560296243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54400b320 con 0x7ff54c06b900 2023-10-06T02:55:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.405+0000 7ff550907700 1 -- 172.21.15.84:0/3560296243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 msgr2=0x7ff54c06ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.405+0000 7ff550907700 1 --2- 172.21.15.84:0/3560296243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 0x7ff54c06ea00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0cacd0 tx=0x7ff54400ba50 comp rx=0 tx=0).stop 2023-10-06T02:55:00.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.405+0000 7ff550907700 1 -- 172.21.15.84:0/3560296243 shutdown_connections 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.405+0000 7ff550907700 1 --2- 172.21.15.84:0/3560296243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 0x7ff54c06ea00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.405+0000 7ff550907700 1 --2- 172.21.15.84:0/3560296243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 0x7ff54c157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.405+0000 7ff550907700 1 --2- 172.21.15.84:0/3560296243 >> v2:172.21.15.131:3300/0 conn(0x7ff54c06b4b0 0x7ff54c06e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.405+0000 7ff550907700 1 -- 172.21.15.84:0/3560296243 >> 172.21.15.84:0/3560296243 conn(0x7ff54c0691d0 msgr2=0x7ff54c0cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.405+0000 7ff550907700 1 -- 172.21.15.84:0/3560296243 shutdown_connections 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.405+0000 7ff550907700 1 -- 172.21.15.84:0/3560296243 wait complete. 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.406+0000 7ff550907700 1 Processor -- start 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.406+0000 7ff550907700 1 -- start start 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff550907700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff54c06b4b0 0x7ff54c0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff550907700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 0x7ff54c14dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff550907700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 0x7ff54c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff550907700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c0af130 con 0x7ff54c06b900 2023-10-06T02:55:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff550907700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c0af3d0 con 0x7ff54c06b4b0 2023-10-06T02:55:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff550907700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c0b0000 con 0x7ff54c150820 2023-10-06T02:55:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff541d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 0x7ff54c14dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff541d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 0x7ff54c14dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57696/0 (socket says 172.21.15.84:57696) 2023-10-06T02:55:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff541d9b700 1 -- 172.21.15.84:0/3724847858 learned_addr learned my addr 172.21.15.84:0/3724847858 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff54a59c700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff54c06b4b0 0x7ff54c0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff54ad9d700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 0x7ff54c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff541d9b700 1 -- 172.21.15.84:0/3724847858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 msgr2=0x7ff54c0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff541d9b700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 0x7ff54c0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff541d9b700 1 -- 172.21.15.84:0/3724847858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff54c06b4b0 msgr2=0x7ff54c0aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff541d9b700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff54c06b4b0 0x7ff54c0aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff541d9b700 1 -- 172.21.15.84:0/3724847858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54400bcf0 con 0x7ff54c06b900 2023-10-06T02:55:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff541d9b700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 0x7ff54c14dbb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff53400c880 tx=0x7ff534008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff542ffd700 1 -- 172.21.15.84:0/3724847858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534011600 con 0x7ff54c06b900 2023-10-06T02:55:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff542ffd700 1 -- 172.21.15.84:0/3724847858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff534011760 con 0x7ff54c06b900 2023-10-06T02:55:00.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c0b02e0 con 0x7ff54c06b900 2023-10-06T02:55:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff542ffd700 1 -- 172.21.15.84:0/3724847858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534011ae0 con 0x7ff54c06b900 2023-10-06T02:55:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.407+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c0b08a0 con 0x7ff54c06b900 2023-10-06T02:55:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.408+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c064ad0 con 0x7ff54c06b900 2023-10-06T02:55:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.409+0000 7ff542ffd700 1 -- 172.21.15.84:0/3724847858 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff534010350 con 0x7ff54c06b900 2023-10-06T02:55:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.409+0000 7ff542ffd700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.409+0000 7ff542ffd700 1 -- 172.21.15.84:0/3724847858 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff534084220 con 0x7ff54c06b900 2023-10-06T02:55:00.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.409+0000 7ff54a59c700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:00.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.409+0000 7ff54a59c700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff53c006fd0 tx=0x7ff53c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:00.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.413+0000 7ff542ffd700 1 -- 172.21.15.84:0/3724847858 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff534055270 con 0x7ff54c06b900 2023-10-06T02:55:00.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:00.595+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7ff54c150bf0 con 0x7ff54c06b900 2023-10-06T02:55:01.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.103+0000 7ff542ffd700 1 -- 172.21.15.84:0/3724847858 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7ff534054e00 con 0x7ff54c06b900 2023-10-06T02:55:01.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 msgr2=0x7ff52c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:01.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff53c006fd0 tx=0x7ff53c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:01.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 msgr2=0x7ff54c14dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:01.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 0x7ff54c14dbb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff53400c880 tx=0x7ff534008040 comp rx=0 tx=0).stop 2023-10-06T02:55:01.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 shutdown_connections 2023-10-06T02:55:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff54c06b4b0 0x7ff54c0aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff54c150820 0x7ff54c0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 --2- 172.21.15.84:0/3724847858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff54c06b900 0x7ff54c14dbb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 >> 172.21.15.84:0/3724847858 conn(0x7ff54c0691d0 msgr2=0x7ff54c155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 shutdown_connections 2023-10-06T02:55:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.106+0000 7ff550907700 1 -- 172.21.15.84:0/3724847858 wait complete. 2023-10-06T02:55:01.109 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'rbd' created 2023-10-06T02:55:01.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T02:55:01.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.237+0000 7ffa941e0700 1 Processor -- start 2023-10-06T02:55:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.237+0000 7ffa941e0700 1 -- start start 2023-10-06T02:55:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa941e0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa8c15cf50 0x7ffa8c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa941e0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa8c0cceb0 0x7ffa8c0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa941e0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8c0c8970 con 0x7ffa8c15cb80 2023-10-06T02:55:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa941e0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8c0c8f30 con 0x7ffa8c15cf50 2023-10-06T02:55:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa941e0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0cf290 con 0x7ffa8c0cceb0 2023-10-06T02:55:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa9177b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa8c15cf50 0x7ffa8c0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa9177b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa8c15cf50 0x7ffa8c0ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57704/0 (socket says 172.21.15.84:57704) 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa91f7c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ffa8c15cb80 0x7ffa8c0cc7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57898/0 (socket says 172.21.15.84:57898) 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa9177b700 1 -- 172.21.15.84:0/4100622465 learned_addr learned my addr 172.21.15.84:0/4100622465 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa9177b700 1 -- 172.21.15.84:0/4100622465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa8c0cceb0 msgr2=0x7ffa8c0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa9177b700 1 --2- 172.21.15.84:0/4100622465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa8c0cceb0 0x7ffa8c0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa9177b700 1 -- 172.21.15.84:0/4100622465 >> v1:172.21.15.84:6789/0 conn(0x7ffa8c15cb80 legacy=0x7ffa8c0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa9177b700 1 -- 172.21.15.84:0/4100622465 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c0c42a0 con 0x7ffa8c15cf50 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa9177b700 1 --2- 172.21.15.84:0/4100622465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 0x7ffa8c0ced50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa800099b0 tx=0x7ffa80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d553cc3f8bc2bfc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa90f7a700 1 -- 172.21.15.84:0/4100622465 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000b860 con 0x7ffa8c15cf50 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa90f7a700 1 -- 172.21.15.84:0/4100622465 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000b9c0 con 0x7ffa8c15cf50 2023-10-06T02:55:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.238+0000 7ffa90f7a700 1 -- 172.21.15.84:0/4100622465 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000bd60 con 0x7ffa8c15cf50 2023-10-06T02:55:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.239+0000 7ffa941e0700 1 -- 172.21.15.84:0/4100622465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 msgr2=0x7ffa8c0ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.239+0000 7ffa941e0700 1 --2- 172.21.15.84:0/4100622465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 0x7ffa8c0ced50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa800099b0 tx=0x7ffa80009250 comp rx=0 tx=0).stop 2023-10-06T02:55:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.239+0000 7ffa941e0700 1 -- 172.21.15.84:0/4100622465 shutdown_connections 2023-10-06T02:55:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.239+0000 7ffa941e0700 1 --2- 172.21.15.84:0/4100622465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa8c0cceb0 0x7ffa8c0c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.239+0000 7ffa941e0700 1 --2- 172.21.15.84:0/4100622465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 0x7ffa8c0ced50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.239+0000 7ffa941e0700 1 -- 172.21.15.84:0/4100622465 >> 172.21.15.84:0/4100622465 conn(0x7ffa8c088000 msgr2=0x7ffa8c0ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.239+0000 7ffa941e0700 1 -- 172.21.15.84:0/4100622465 shutdown_connections 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.239+0000 7ffa941e0700 1 -- 172.21.15.84:0/4100622465 wait complete. 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.240+0000 7ffa941e0700 1 Processor -- start 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.240+0000 7ffa941e0700 1 -- start start 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa941e0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa8c0cceb0 0x7ffa8c0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa941e0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa8c15cb80 0x7ffa8c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa941e0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 0x7ffa8c15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa941e0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c16ecc0 con 0x7ffa8c15cf50 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa941e0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0c57f0 con 0x7ffa8c15cb80 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa941e0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0b2c90 con 0x7ffa8c0cceb0 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa9277d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 0x7ffa8c15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa9277d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 0x7ffa8c15ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57716/0 (socket says 172.21.15.84:57716) 2023-10-06T02:55:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa9277d700 1 -- 172.21.15.84:0/3863865317 learned_addr learned my addr 172.21.15.84:0/3863865317 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa91f7c700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa8c0cceb0 0x7ffa8c0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa9177b700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa8c15cb80 0x7ffa8c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa9277d700 1 -- 172.21.15.84:0/3863865317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa8c0cceb0 msgr2=0x7ffa8c0b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa9277d700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa8c0cceb0 0x7ffa8c0b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa9277d700 1 -- 172.21.15.84:0/3863865317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa8c15cb80 msgr2=0x7ffa8c0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa9277d700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa8c15cb80 0x7ffa8c0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.241+0000 7ffa9277d700 1 -- 172.21.15.84:0/3863865317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800094f0 con 0x7ffa8c15cf50 2023-10-06T02:55:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.242+0000 7ffa9277d700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 0x7ffa8c15ec00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00bc60 tx=0x7ffa7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.242+0000 7ffa89ffb700 1 -- 172.21.15.84:0/3863865317 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0092e0 con 0x7ffa8c15cf50 2023-10-06T02:55:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.242+0000 7ffa89ffb700 1 -- 172.21.15.84:0/3863865317 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c00c630 con 0x7ffa8c15cf50 2023-10-06T02:55:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.242+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c0c7c00 con 0x7ffa8c15cf50 2023-10-06T02:55:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.242+0000 7ffa89ffb700 1 -- 172.21.15.84:0/3863865317 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00c9f0 con 0x7ffa8c15cf50 2023-10-06T02:55:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.242+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c0c5480 con 0x7ffa8c15cf50 2023-10-06T02:55:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.243+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c064ad0 con 0x7ffa8c15cf50 2023-10-06T02:55:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.243+0000 7ffa89ffb700 1 -- 172.21.15.84:0/3863865317 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa7c012070 con 0x7ffa8c15cf50 2023-10-06T02:55:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.244+0000 7ffa89ffb700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa78066f30 0x7ffa780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.244+0000 7ffa89ffb700 1 -- 172.21.15.84:0/3863865317 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7ffa7c083ee0 con 0x7ffa8c15cf50 2023-10-06T02:55:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.244+0000 7ffa91f7c700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa78066f30 0x7ffa780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.244+0000 7ffa91f7c700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa78066f30 0x7ffa780693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c15b0d0 tx=0x7ffa84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.248+0000 7ffa89ffb700 1 -- 172.21.15.84:0/3863865317 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa7c051350 con 0x7ffa8c15cf50 2023-10-06T02:55:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:01.430+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffa8c04bb80 con 0x7ffa8c15cf50 2023-10-06T02:55:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.112+0000 7ffa89ffb700 1 -- 172.21.15.84:0/3863865317 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7ffa7c054970 con 0x7ffa8c15cf50 2023-10-06T02:55:02.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa78066f30 msgr2=0x7ffa780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa78066f30 0x7ffa780693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c15b0d0 tx=0x7ffa84009040 comp rx=0 tx=0).stop 2023-10-06T02:55:02.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 msgr2=0x7ffa8c15ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 0x7ffa8c15ec00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00bc60 tx=0x7ffa7c009840 comp rx=0 tx=0).stop 2023-10-06T02:55:02.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 shutdown_connections 2023-10-06T02:55:02.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa78066f30 0x7ffa780693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c15cf50 0x7ffa8c15ec00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa8c0cceb0 0x7ffa8c0b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 --2- 172.21.15.84:0/3863865317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa8c15cb80 0x7ffa8c0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 >> 172.21.15.84:0/3863865317 conn(0x7ffa8c088000 msgr2=0x7ffa8c068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:02.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 shutdown_connections 2023-10-06T02:55:02.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.115+0000 7ffa941e0700 1 -- 172.21.15.84:0/3863865317 wait complete. 2023-10-06T02:55:02.121 INFO:teuthology.orchestra.run.smithi084.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T02:55:02.129 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T02:55:02.130 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:55:02.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:55:02.132 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:55:02.132 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:55:02.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:55:02.134 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:55:02.134 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:55:02.135 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:55:02.137 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:55:02.137 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:55:02.137 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:55:02.140 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:55:02.140 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T02:55:02.140 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:02.206 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T02:55:02.206 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T02:55:02.221 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T02:55:02.221 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T02:55:02.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.259+0000 7f97bad52700 1 Processor -- start 2023-10-06T02:55:02.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.259+0000 7f97bad52700 1 -- start start 2023-10-06T02:55:02.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97bad52700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f97b4156390 0x7f97b40cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97bad52700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 0x7f97b40c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97bad52700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b406c9e0 con 0x7f97b40cc750 2023-10-06T02:55:02.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97bad52700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b406c7d0 con 0x7f97b4156390 2023-10-06T02:55:02.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97bad52700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b40ccbd0 con 0x7f97b406c370 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f97b40cc750 0x7f97b406bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57906/0 (socket says 172.21.15.84:57906) 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b3fff700 1 -- 172.21.15.84:0/808311374 learned_addr learned my addr 172.21.15.84:0/808311374 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b8aee700 1 --2- 172.21.15.84:0/808311374 >> v2:172.21.15.131:3300/0 conn(0x7f97b4156390 0x7f97b40cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b92ef700 1 --2- 172.21.15.84:0/808311374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 0x7f97b40c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b37fe700 1 -- 172.21.15.84:0/808311374 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462643405 0 0) 0x7f97b406c9e0 con 0x7f97b40cc750 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b37fe700 1 -- 172.21.15.84:0/808311374 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97a4003570 con 0x7f97b40cc750 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b8aee700 1 -- 172.21.15.84:0/808311374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 msgr2=0x7f97b40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b8aee700 1 --2- 172.21.15.84:0/808311374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 0x7f97b40c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b8aee700 1 -- 172.21.15.84:0/808311374 >> v1:172.21.15.84:6789/0 conn(0x7f97b40cc750 legacy=0x7f97b406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.260+0000 7f97b8aee700 1 -- 172.21.15.84:0/808311374 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4156b60 con 0x7f97b4156390 2023-10-06T02:55:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97b8aee700 1 --2- 172.21.15.84:0/808311374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b4156390 0x7f97b40cc210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97a80098e0 tx=0x7f97a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4130cbcb50651325 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:02.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97b37fe700 1 -- 172.21.15.84:0/808311374 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8011630 con 0x7f97b4156390 2023-10-06T02:55:02.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97b37fe700 1 -- 172.21.15.84:0/808311374 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a8011790 con 0x7f97b4156390 2023-10-06T02:55:02.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97b37fe700 1 -- 172.21.15.84:0/808311374 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8011b30 con 0x7f97b4156390 2023-10-06T02:55:02.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97bad52700 1 -- 172.21.15.84:0/808311374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b4156390 msgr2=0x7f97b40cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97bad52700 1 --2- 172.21.15.84:0/808311374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b4156390 0x7f97b40cc210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97a80098e0 tx=0x7f97a80091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97bad52700 1 -- 172.21.15.84:0/808311374 shutdown_connections 2023-10-06T02:55:02.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97bad52700 1 --2- 172.21.15.84:0/808311374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 0x7f97b40c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97bad52700 1 --2- 172.21.15.84:0/808311374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b4156390 0x7f97b40cc210 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97bad52700 1 -- 172.21.15.84:0/808311374 >> 172.21.15.84:0/808311374 conn(0x7f97b40cdef0 msgr2=0x7f97b40c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:02.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97bad52700 1 -- 172.21.15.84:0/808311374 shutdown_connections 2023-10-06T02:55:02.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.261+0000 7f97bad52700 1 -- 172.21.15.84:0/808311374 wait complete. 2023-10-06T02:55:02.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.262+0000 7f97bad52700 1 Processor -- start 2023-10-06T02:55:02.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97bad52700 1 -- start start 2023-10-06T02:55:02.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97bad52700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 0x7f97b41587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97bad52700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b40cc750 0x7f97b4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97bad52700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b4156390 0x7f97b41678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97bad52700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b41596e0 con 0x7f97b4156390 2023-10-06T02:55:02.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97bad52700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b4159980 con 0x7f97b40cc750 2023-10-06T02:55:02.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97bad52700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b41681a0 con 0x7f97b406c370 2023-10-06T02:55:02.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97b92ef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b4156390 0x7f97b41678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97b92ef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b4156390 0x7f97b41678e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57750/0 (socket says 172.21.15.84:57750) 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.263+0000 7f97b92ef700 1 -- 172.21.15.84:0/1302890127 learned_addr learned my addr 172.21.15.84:0/1302890127 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b3fff700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b40cc750 0x7f97b4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b8aee700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 0x7f97b41587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b92ef700 1 -- 172.21.15.84:0/1302890127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 msgr2=0x7f97b41587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b92ef700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 0x7f97b41587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b92ef700 1 -- 172.21.15.84:0/1302890127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b40cc750 msgr2=0x7f97b4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b92ef700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b40cc750 0x7f97b4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b92ef700 1 -- 172.21.15.84:0/1302890127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8009420 con 0x7f97b4156390 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b92ef700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b4156390 0x7f97b41678e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009e90 tx=0x7f97ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b0ff9700 1 -- 172.21.15.84:0/1302890127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00cb70 con 0x7f97b4156390 2023-10-06T02:55:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b0ff9700 1 -- 172.21.15.84:0/1302890127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac00f040 con 0x7f97b4156390 2023-10-06T02:55:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b4168480 con 0x7f97b4156390 2023-10-06T02:55:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97b0ff9700 1 -- 172.21.15.84:0/1302890127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac014480 con 0x7f97b4156390 2023-10-06T02:55:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.264+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b41523a0 con 0x7f97b4156390 2023-10-06T02:55:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.265+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b4159af0 con 0x7f97b4156390 2023-10-06T02:55:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.265+0000 7f97b0ff9700 1 -- 172.21.15.84:0/1302890127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97ac014830 con 0x7f97b4156390 2023-10-06T02:55:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.266+0000 7f97b0ff9700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9798066f30 0x7f97980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.266+0000 7f97b8aee700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9798066f30 0x7f97980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.266+0000 7f97b0ff9700 1 -- 172.21.15.84:0/1302890127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f97ac084ff0 con 0x7f97b4156390 2023-10-06T02:55:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.266+0000 7f97b8aee700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9798066f30 0x7f97980693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97a80091e0 tx=0x7f97a8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:02.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.270+0000 7f97b0ff9700 1 -- 172.21.15.84:0/1302890127 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97ac052450 con 0x7f97b4156390 2023-10-06T02:55:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.457+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97b4064ad0 con 0x7f97b4156390 2023-10-06T02:55:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.458+0000 7f97b0ff9700 1 -- 172.21.15.84:0/1302890127 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13660 (secure 0 0 0) 0x7f97ac055a70 con 0x7f97b4156390 2023-10-06T02:55:02.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:02.459 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:02.103195+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:02.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9798066f30 msgr2=0x7f97980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9798066f30 0x7f97980693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97a80091e0 tx=0x7f97a8017000 comp rx=0 tx=0).stop 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b4156390 msgr2=0x7f97b41678e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b4156390 0x7f97b41678e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009e90 tx=0x7f97ac00b040 comp rx=0 tx=0).stop 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 shutdown_connections 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9798066f30 0x7f97980693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97b4156390 0x7f97b41678e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97b406c370 0x7f97b41587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 --2- 172.21.15.84:0/1302890127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b40cc750 0x7f97b4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 >> 172.21.15.84:0/1302890127 conn(0x7f97b40cdef0 msgr2=0x7f97b40c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 shutdown_connections 2023-10-06T02:55:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.460+0000 7f97bad52700 1 -- 172.21.15.84:0/1302890127 wait complete. 2023-10-06T02:55:02.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:55:02.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.589+0000 7f8c6759e700 1 Processor -- start 2023-10-06T02:55:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.589+0000 7f8c6759e700 1 -- start start 2023-10-06T02:55:02.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8c680cd400 0x7f8c680ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680b2a30 0x7f8c680cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680cc9b0 con 0x7f8c680b2660 2023-10-06T02:55:02.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c680cf560 con 0x7f8c680cd400 2023-10-06T02:55:02.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680cbda0 con 0x7f8c680b2a30 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8c680b2660 0x7f8c680cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38426/0 (socket says 172.21.15.84:38426) 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6659c700 1 -- 172.21.15.84:0/1769313524 learned_addr learned my addr 172.21.15.84:0/1769313524 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c65d9b700 1 --2- 172.21.15.84:0/1769313524 >> v2:172.21.15.84:3300/0 conn(0x7f8c680cd400 0x7f8c680ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c66d9d700 1 --2- 172.21.15.84:0/1769313524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680b2a30 0x7f8c680cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6559a700 1 -- 172.21.15.84:0/1769313524 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026698613 0 0) 0x7f8c680cc9b0 con 0x7f8c680b2660 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6559a700 1 -- 172.21.15.84:0/1769313524 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c50003570 con 0x7f8c680b2660 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c65d9b700 1 -- 172.21.15.84:0/1769313524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680b2a30 msgr2=0x7f8c680cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c65d9b700 1 --2- 172.21.15.84:0/1769313524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680b2a30 0x7f8c680cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c65d9b700 1 -- 172.21.15.84:0/1769313524 >> v1:172.21.15.84:6789/0 conn(0x7f8c680b2660 legacy=0x7f8c680cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c6559a700 1 -- 172.21.15.84:0/1769313524 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3048589801 0 0) 0x7f8c50003570 con 0x7f8c680b2660 2023-10-06T02:55:02.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.590+0000 7f8c65d9b700 1 -- 172.21.15.84:0/1769313524 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680cc080 con 0x7f8c680cd400 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c65d9b700 1 --2- 172.21.15.84:0/1769313524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680cd400 0x7f8c680ceae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0098e0 tx=0x7f8c5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e9c6084debf92c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6559a700 1 -- 172.21.15.84:0/1769313524 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580015f0 con 0x7f8c680cd400 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6559a700 1 -- 172.21.15.84:0/1769313524 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c011420 con 0x7f8c680cd400 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6559a700 1 -- 172.21.15.84:0/1769313524 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0117c0 con 0x7f8c680cd400 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6759e700 1 -- 172.21.15.84:0/1769313524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680cd400 msgr2=0x7f8c680ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6759e700 1 --2- 172.21.15.84:0/1769313524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680cd400 0x7f8c680ceae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0098e0 tx=0x7f8c5c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6759e700 1 -- 172.21.15.84:0/1769313524 shutdown_connections 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6759e700 1 --2- 172.21.15.84:0/1769313524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680b2a30 0x7f8c680cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6759e700 1 --2- 172.21.15.84:0/1769313524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680cd400 0x7f8c680ceae0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6759e700 1 -- 172.21.15.84:0/1769313524 >> 172.21.15.84:0/1769313524 conn(0x7f8c68099560 msgr2=0x7f8c6806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:02.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6759e700 1 -- 172.21.15.84:0/1769313524 shutdown_connections 2023-10-06T02:55:02.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.591+0000 7f8c6759e700 1 -- 172.21.15.84:0/1769313524 wait complete. 2023-10-06T02:55:02.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.592+0000 7f8c6759e700 1 Processor -- start 2023-10-06T02:55:02.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6759e700 1 -- start start 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680b2660 0x7f8c681534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c680b2a30 0x7f8c680b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680cd400 0x7f8c68154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6815a690 con 0x7f8c680b2660 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68159d80 con 0x7f8c680b2a30 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6815a040 con 0x7f8c680cd400 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680b2660 0x7f8c681534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680b2660 0x7f8c681534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55288/0 (socket says 172.21.15.84:55288) 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c6659c700 1 -- 172.21.15.84:0/213102731 learned_addr learned my addr 172.21.15.84:0/213102731 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c65d9b700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c680b2a30 0x7f8c680b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.593+0000 7f8c66d9d700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680cd400 0x7f8c68154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c6659c700 1 -- 172.21.15.84:0/213102731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680cd400 msgr2=0x7f8c68154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c6659c700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680cd400 0x7f8c68154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c6659c700 1 -- 172.21.15.84:0/213102731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c680b2a30 msgr2=0x7f8c680b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c6659c700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c680b2a30 0x7f8c680b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c6659c700 1 -- 172.21.15.84:0/213102731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009420 con 0x7f8c680b2660 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c66d9d700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680cd400 0x7f8c68154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c6659c700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680b2660 0x7f8c681534b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800cb60 tx=0x7f8c580013b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c567fc700 1 -- 172.21.15.84:0/213102731 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c580070f0 con 0x7f8c680b2660 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c567fc700 1 -- 172.21.15.84:0/213102731 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58007270 con 0x7f8c680b2660 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c567fc700 1 -- 172.21.15.84:0/213102731 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007630 con 0x7f8c680b2660 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6815a320 con 0x7f8c680b2660 2023-10-06T02:55:02.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.594+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c680b3610 con 0x7f8c680b2660 2023-10-06T02:55:02.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.595+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c680890f0 con 0x7f8c680b2660 2023-10-06T02:55:02.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.595+0000 7f8c567fc700 1 -- 172.21.15.84:0/213102731 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c58005a00 con 0x7f8c680b2660 2023-10-06T02:55:02.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.596+0000 7f8c567fc700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8c48066f30 0x7f8c480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.596+0000 7f8c65d9b700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8c48066f30 0x7f8c480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.596+0000 7f8c567fc700 1 -- 172.21.15.84:0/213102731 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8c58083fc0 con 0x7f8c680b2660 2023-10-06T02:55:02.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.596+0000 7f8c65d9b700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8c48066f30 0x7f8c480693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8c680cd800 tx=0x7f8c5c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:02.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.600+0000 7f8c567fc700 1 -- 172.21.15.84:0/213102731 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c580514a0 con 0x7f8c680b2660 2023-10-06T02:55:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.781+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8c6805f270 con 0x7f8c680b2660 2023-10-06T02:55:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.781+0000 7f8c567fc700 1 -- 172.21.15.84:0/213102731 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8c580570a0 con 0x7f8c680b2660 2023-10-06T02:55:02.784 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:55:02.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8c48066f30 msgr2=0x7f8c480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8c48066f30 0x7f8c480693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8c680cd800 tx=0x7f8c5c016000 comp rx=0 tx=0).stop 2023-10-06T02:55:02.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680b2660 msgr2=0x7f8c681534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680b2660 0x7f8c681534b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800cb60 tx=0x7f8c580013b0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 shutdown_connections 2023-10-06T02:55:02.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8c48066f30 0x7f8c480693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c680cd400 0x7f8c68154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c680b2660 0x7f8c681534b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 --2- 172.21.15.84:0/213102731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c680b2a30 0x7f8c680b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 >> 172.21.15.84:0/213102731 conn(0x7f8c68099560 msgr2=0x7f8c68156390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:02.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 shutdown_connections 2023-10-06T02:55:02.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.784+0000 7f8c6759e700 1 -- 172.21.15.84:0/213102731 wait complete. 2023-10-06T02:55:02.797 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:02.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.912+0000 7fa2e9656700 1 Processor -- start 2023-10-06T02:55:02.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.912+0000 7fa2e9656700 1 -- start start 2023-10-06T02:55:02.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.913+0000 7fa2e9656700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40cd980 0x7fa2e4159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.913+0000 7fa2e9656700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2e40b4a60 0x7fa2e40d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.913+0000 7fa2e9656700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e40b5f30 con 0x7fa2e40d0850 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.913+0000 7fa2e9656700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e40b3640 con 0x7fa2e40b4a60 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.913+0000 7fa2e9656700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40d0c90 con 0x7fa2e40cd980 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.913+0000 7fa2da7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2e40b4a60 0x7fa2e40d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.913+0000 7fa2e37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa2e40d0850 0x7fa2e415ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38436/0 (socket says 172.21.15.84:38436) 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.913+0000 7fa2e37fe700 1 -- 172.21.15.84:0/2091303064 learned_addr learned my addr 172.21.15.84:0/2091303064 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2e2ffd700 1 --2- 172.21.15.84:0/2091303064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40cd980 0x7fa2e4159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2da7fc700 1 -- 172.21.15.84:0/2091303064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40cd980 msgr2=0x7fa2e4159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2da7fc700 1 --2- 172.21.15.84:0/2091303064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40cd980 0x7fa2e4159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2da7fc700 1 -- 172.21.15.84:0/2091303064 >> v1:172.21.15.84:6789/0 conn(0x7fa2e40d0850 legacy=0x7fa2e415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2da7fc700 1 -- 172.21.15.84:0/2091303064 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40b63c0 con 0x7fa2e40b4a60 2023-10-06T02:55:02.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2e27fc700 1 -- 172.21.15.84:0/2091303064 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225435888 0 0) 0x7fa2e40b5f30 con 0x7fa2e40d0850 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2e2ffd700 1 --2- 172.21.15.84:0/2091303064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40cd980 0x7fa2e4159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2da7fc700 1 --2- 172.21.15.84:0/2091303064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40b4a60 0x7fa2e40d0310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0098e0 tx=0x7fa2cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49e6de5080b5dc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2e27fc700 1 -- 172.21.15.84:0/2091303064 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc009e80 con 0x7fa2e40b4a60 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2e27fc700 1 -- 172.21.15.84:0/2091303064 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc00b860 con 0x7fa2e40b4a60 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2e27fc700 1 -- 172.21.15.84:0/2091303064 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00bbe0 con 0x7fa2e40b4a60 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2e9656700 1 -- 172.21.15.84:0/2091303064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40b4a60 msgr2=0x7fa2e40d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.914+0000 7fa2e9656700 1 --2- 172.21.15.84:0/2091303064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40b4a60 0x7fa2e40d0310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0098e0 tx=0x7fa2cc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.915+0000 7fa2e9656700 1 -- 172.21.15.84:0/2091303064 shutdown_connections 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.915+0000 7fa2e9656700 1 --2- 172.21.15.84:0/2091303064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40cd980 0x7fa2e4159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.915+0000 7fa2e9656700 1 --2- 172.21.15.84:0/2091303064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40b4a60 0x7fa2e40d0310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.915+0000 7fa2e9656700 1 -- 172.21.15.84:0/2091303064 >> 172.21.15.84:0/2091303064 conn(0x7fa2e406ed20 msgr2=0x7fa2e406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:02.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.915+0000 7fa2e9656700 1 -- 172.21.15.84:0/2091303064 shutdown_connections 2023-10-06T02:55:02.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.915+0000 7fa2e9656700 1 -- 172.21.15.84:0/2091303064 wait complete. 2023-10-06T02:55:02.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.916+0000 7fa2e9656700 1 Processor -- start 2023-10-06T02:55:02.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.916+0000 7fa2e9656700 1 -- start start 2023-10-06T02:55:02.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.916+0000 7fa2e9656700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2e40b4a60 0x7fa2e41495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.916+0000 7fa2e9656700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40cd980 0x7fa2e40b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.916+0000 7fa2e9656700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40d0850 0x7fa2e41587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.916+0000 7fa2e9656700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40b2ca0 con 0x7fa2e40cd980 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2e9656700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40b2090 con 0x7fa2e40b4a60 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2e9656700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40b2370 con 0x7fa2e40d0850 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2da7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40cd980 0x7fa2e40b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2da7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40cd980 0x7fa2e40b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55312/0 (socket says 172.21.15.84:55312) 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2da7fc700 1 -- 172.21.15.84:0/4230477408 learned_addr learned my addr 172.21.15.84:0/4230477408 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2e2ffd700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2e40b4a60 0x7fa2e41495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2e37fe700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40d0850 0x7fa2e41587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2da7fc700 1 -- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40d0850 msgr2=0x7fa2e41587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2da7fc700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40d0850 0x7fa2e41587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2da7fc700 1 -- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2e40b4a60 msgr2=0x7fa2e41495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2da7fc700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2e40b4a60 0x7fa2e41495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2da7fc700 1 -- 172.21.15.84:0/4230477408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc009420 con 0x7fa2e40cd980 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2e37fe700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40d0850 0x7fa2e41587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2e2ffd700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2e40b4a60 0x7fa2e41495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2da7fc700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40cd980 0x7fa2e40b12f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4089150 tx=0x7fa2cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2db7fe700 1 -- 172.21.15.84:0/4230477408 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00bbe0 con 0x7fa2e40cd980 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2db7fe700 1 -- 172.21.15.84:0/4230477408 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc011420 con 0x7fa2e40cd980 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e40b2650 con 0x7fa2e40cd980 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2db7fe700 1 -- 172.21.15.84:0/4230477408 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0117a0 con 0x7fa2e40cd980 2023-10-06T02:55:02.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.917+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e4149ae0 con 0x7fa2e40cd980 2023-10-06T02:55:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.918+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e4064ad0 con 0x7fa2e40cd980 2023-10-06T02:55:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.918+0000 7fa2db7fe700 1 -- 172.21.15.84:0/4230477408 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2cc011bd0 con 0x7fa2e40cd980 2023-10-06T02:55:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.919+0000 7fa2db7fe700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.919+0000 7fa2db7fe700 1 -- 172.21.15.84:0/4230477408 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa2cc085ce0 con 0x7fa2e40cd980 2023-10-06T02:55:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.919+0000 7fa2e2ffd700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.919+0000 7fa2e2ffd700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2c4066f30 0x7fa2c40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4006f00 tx=0x7fa2d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:02.923+0000 7fa2db7fe700 1 -- 172.21.15.84:0/4230477408 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2cc053140 con 0x7fa2e40cd980 2023-10-06T02:55:03.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.106+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa2e40b5320 con 0x7fa2e40cd980 2023-10-06T02:55:03.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.106+0000 7fa2db7fe700 1 -- 172.21.15.84:0/4230477408 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa2cc015020 con 0x7fa2e40cd980 2023-10-06T02:55:03.108 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:55:03.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2c4066f30 msgr2=0x7fa2c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2c4066f30 0x7fa2c40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4006f00 tx=0x7fa2d4008040 comp rx=0 tx=0).stop 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40cd980 msgr2=0x7fa2e40b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40cd980 0x7fa2e40b12f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4089150 tx=0x7fa2cc017000 comp rx=0 tx=0).stop 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 shutdown_connections 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2e40b4a60 0x7fa2e41495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2e40d0850 0x7fa2e41587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 --2- 172.21.15.84:0/4230477408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2e40cd980 0x7fa2e40b12f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 >> 172.21.15.84:0/4230477408 conn(0x7fa2e406ed20 msgr2=0x7fa2e415a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:03.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 shutdown_connections 2023-10-06T02:55:03.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.109+0000 7fa2e9656700 1 -- 172.21.15.84:0/4230477408 wait complete. 2023-10-06T02:55:03.123 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.238+0000 7f72c7fff700 1 Processor -- start 2023-10-06T02:55:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.238+0000 7f72c7fff700 1 -- start start 2023-10-06T02:55:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c7fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72c80afc60 0x7f72c80b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c81572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c7fff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80cd300 con 0x7f72c80ce000 2023-10-06T02:55:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c7fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c81577f0 con 0x7f72c80afc60 2023-10-06T02:55:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80cc6f0 con 0x7f72c8156e50 2023-10-06T02:55:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c6ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72c80afc60 0x7f72c80b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c77fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c81572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c77fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c81572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:56524/0 (socket says 172.21.15.84:56524) 2023-10-06T02:55:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72be7fc700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f72c80ce000 0x7f72c80cbcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:34328/0 (socket says 172.21.15.84:34328) 2023-10-06T02:55:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c6ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72c80afc60 0x7f72c80b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:35224/0 (socket says 172.21.15.84:35224) 2023-10-06T02:55:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.239+0000 7f72c77fe700 1 -- 172.21.15.84:0/1369080429 learned_addr learned my addr 172.21.15.84:0/1369080429 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c77fe700 1 -- 172.21.15.84:0/1369080429 >> v2:172.21.15.131:3300/0 conn(0x7f72c80afc60 msgr2=0x7f72c80b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c77fe700 1 --2- 172.21.15.84:0/1369080429 >> v2:172.21.15.131:3300/0 conn(0x7f72c80afc60 0x7f72c80b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c77fe700 1 -- 172.21.15.84:0/1369080429 >> v1:172.21.15.131:6789/0 conn(0x7f72c80ce000 legacy=0x7f72c80cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c77fe700 1 -- 172.21.15.84:0/1369080429 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80cc9d0 con 0x7f72c8156e50 2023-10-06T02:55:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c77fe700 1 --2- 172.21.15.84:0/1369080429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c81572b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009f20 tx=0x7f72c0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d48fd3ab0af7848 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c67fc700 1 -- 172.21.15.84:0/1369080429 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c000e070 con 0x7f72c8156e50 2023-10-06T02:55:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c67fc700 1 -- 172.21.15.84:0/1369080429 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c000b9d0 con 0x7f72c8156e50 2023-10-06T02:55:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c67fc700 1 -- 172.21.15.84:0/1369080429 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00092e0 con 0x7f72c8156e50 2023-10-06T02:55:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c7fff700 1 -- 172.21.15.84:0/1369080429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 msgr2=0x7f72c81572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.240+0000 7f72c7fff700 1 --2- 172.21.15.84:0/1369080429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c81572b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009f20 tx=0x7f72c0009840 comp rx=0 tx=0).stop 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.241+0000 7f72c7fff700 1 -- 172.21.15.84:0/1369080429 shutdown_connections 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.241+0000 7f72c7fff700 1 --2- 172.21.15.84:0/1369080429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c81572b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.241+0000 7f72c7fff700 1 --2- 172.21.15.84:0/1369080429 >> v2:172.21.15.131:3300/0 conn(0x7f72c80afc60 0x7f72c80b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.241+0000 7f72c7fff700 1 -- 172.21.15.84:0/1369080429 >> 172.21.15.84:0/1369080429 conn(0x7f72c80675f0 msgr2=0x7f72c80679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.241+0000 7f72c7fff700 1 -- 172.21.15.84:0/1369080429 shutdown_connections 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.241+0000 7f72c7fff700 1 -- 172.21.15.84:0/1369080429 wait complete. 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.242+0000 7f72c7fff700 1 Processor -- start 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.242+0000 7f72c7fff700 1 -- start start 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.242+0000 7f72c7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72c80afc60 0x7f72c8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.242+0000 7f72c7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72c80ce000 0x7f72c8146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c80c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c7fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8147340 con 0x7f72c80afc60 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c7fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80ca0e0 con 0x7f72c80ce000 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8068f50 con 0x7f72c8156e50 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72c80afc60 0x7f72c8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72c80afc60 0x7f72c8068890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55320/0 (socket says 172.21.15.84:55320) 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c6ffd700 1 -- 172.21.15.84:0/186798444 learned_addr learned my addr 172.21.15.84:0/186798444 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72be7fc700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72c80ce000 0x7f72c8146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c77fe700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c80c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c6ffd700 1 -- 172.21.15.84:0/186798444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 msgr2=0x7f72c80c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c6ffd700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c80c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c6ffd700 1 -- 172.21.15.84:0/186798444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72c80ce000 msgr2=0x7f72c8146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c6ffd700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72c80ce000 0x7f72c8146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c6ffd700 1 -- 172.21.15.84:0/186798444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c0009ae0 con 0x7f72c80afc60 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c6ffd700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72c80afc60 0x7f72c8068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72b800ec80 tx=0x7f72b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72bf7fe700 1 -- 172.21.15.84:0/186798444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b800c850 con 0x7f72c80afc60 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72bf7fe700 1 -- 172.21.15.84:0/186798444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b800c9b0 con 0x7f72c80afc60 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c8069230 con 0x7f72c80afc60 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72bf7fe700 1 -- 172.21.15.84:0/186798444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b800cd50 con 0x7f72c80afc60 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.243+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c80697f0 con 0x7f72c80afc60 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.244+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c8069e40 con 0x7f72c80afc60 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.245+0000 7f72bf7fe700 1 -- 172.21.15.84:0/186798444 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72b8013680 con 0x7f72c80afc60 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.245+0000 7f72bf7fe700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f72a8066f30 0x7f72a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.245+0000 7f72bf7fe700 1 -- 172.21.15.84:0/186798444 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f72b8084560 con 0x7f72c80afc60 2023-10-06T02:55:03.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.245+0000 7f72be7fc700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f72a8066f30 0x7f72a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.245+0000 7f72be7fc700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f72a8066f30 0x7f72a80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72c8068820 tx=0x7f72b0007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:03.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.250+0000 7f72bf7fe700 1 -- 172.21.15.84:0/186798444 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72b80519c0 con 0x7f72c80afc60 2023-10-06T02:55:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.477+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72c805f270 con 0x7f72c80afc60 2023-10-06T02:55:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.478+0000 7f72bf7fe700 1 -- 172.21.15.84:0/186798444 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f72b8017de0 con 0x7f72c80afc60 2023-10-06T02:55:03.480 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:03.480 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T02:55:03.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f72a8066f30 msgr2=0x7f72a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f72a8066f30 0x7f72a80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72c8068820 tx=0x7f72b0007e70 comp rx=0 tx=0).stop 2023-10-06T02:55:03.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72c80afc60 msgr2=0x7f72c8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72c80afc60 0x7f72c8068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72b800ec80 tx=0x7f72b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 shutdown_connections 2023-10-06T02:55:03.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f72a8066f30 0x7f72a80693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f72c8156e50 0x7f72c80c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72c80afc60 0x7f72c8068890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 --2- 172.21.15.84:0/186798444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72c80ce000 0x7f72c8146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 >> 172.21.15.84:0/186798444 conn(0x7f72c80675f0 msgr2=0x7f72c80b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:03.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 shutdown_connections 2023-10-06T02:55:03.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.480+0000 7f72c7fff700 1 -- 172.21.15.84:0/186798444 wait complete. 2023-10-06T02:55:03.483 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2023-10-06T02:55:03.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e33ca9700 1 Processor -- start 2023-10-06T02:55:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e33ca9700 1 -- start start 2023-10-06T02:55:03.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e33ca9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2e2c0b49e0 0x7f2e2c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e33ca9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2e2c0b07a0 0x7f2e2c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e33ca9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c0b0ca0 con 0x7f2e2c1595a0 2023-10-06T02:55:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e33ca9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0b0f80 con 0x7f2e2c0b07a0 2023-10-06T02:55:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e33ca9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0b1260 con 0x7f2e2c0b49e0 2023-10-06T02:55:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e32246700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2e2c0b07a0 0x7f2e2c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e31a45700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2e2c1595a0 0x7f2e2c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38438/0 (socket says 172.21.15.84:38438) 2023-10-06T02:55:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e31a45700 1 -- 172.21.15.84:0/2406636353 learned_addr learned my addr 172.21.15.84:0/2406636353 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e31244700 1 --2- 172.21.15.84:0/2406636353 >> v2:172.21.15.131:3300/0 conn(0x7f2e2c0b49e0 0x7f2e2c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e32246700 1 -- 172.21.15.84:0/2406636353 >> v2:172.21.15.131:3300/0 conn(0x7f2e2c0b49e0 msgr2=0x7f2e2c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e32246700 1 --2- 172.21.15.84:0/2406636353 >> v2:172.21.15.131:3300/0 conn(0x7f2e2c0b49e0 0x7f2e2c0aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e32246700 1 -- 172.21.15.84:0/2406636353 >> v1:172.21.15.84:6789/0 conn(0x7f2e2c1595a0 legacy=0x7f2e2c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e30a43700 1 -- 172.21.15.84:0/2406636353 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700308413 0 0) 0x7f2e2c0b0ca0 con 0x7f2e2c1595a0 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e32246700 1 -- 172.21.15.84:0/2406636353 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c0b1540 con 0x7f2e2c0b07a0 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e31244700 1 --2- 172.21.15.84:0/2406636353 >> v2:172.21.15.131:3300/0 conn(0x7f2e2c0b49e0 0x7f2e2c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e32246700 1 --2- 172.21.15.84:0/2406636353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c0b07a0 0x7f2e2c0b1c00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009e60 tx=0x7f2e24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4586fe142e043e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e30a43700 1 -- 172.21.15.84:0/2406636353 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400e070 con 0x7f2e2c0b07a0 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e30a43700 1 -- 172.21.15.84:0/2406636353 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2400bbf0 con 0x7f2e2c0b07a0 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.607+0000 7f2e30a43700 1 -- 172.21.15.84:0/2406636353 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24012430 con 0x7f2e2c0b07a0 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.608+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2406636353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c0b07a0 msgr2=0x7f2e2c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.608+0000 7f2e33ca9700 1 --2- 172.21.15.84:0/2406636353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c0b07a0 0x7f2e2c0b1c00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009e60 tx=0x7f2e24009780 comp rx=0 tx=0).stop 2023-10-06T02:55:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.608+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2406636353 shutdown_connections 2023-10-06T02:55:03.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.608+0000 7f2e33ca9700 1 --2- 172.21.15.84:0/2406636353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c0b07a0 0x7f2e2c0b1c00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.608+0000 7f2e33ca9700 1 --2- 172.21.15.84:0/2406636353 >> v2:172.21.15.131:3300/0 conn(0x7f2e2c0b49e0 0x7f2e2c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.608+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2406636353 >> 172.21.15.84:0/2406636353 conn(0x7f2e2c099830 msgr2=0x7f2e2c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:03.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.608+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2406636353 shutdown_connections 2023-10-06T02:55:03.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.608+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2406636353 wait complete. 2023-10-06T02:55:03.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.609+0000 7f2e33ca9700 1 Processor -- start 2023-10-06T02:55:03.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.609+0000 7f2e33ca9700 1 -- start start 2023-10-06T02:55:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e33ca9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2c0b07a0 0x7f2e2c09dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e33ca9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c0b49e0 0x7f2e2c1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e33ca9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1595a0 0x7f2e2c09b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e33ca9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c09e0f0 con 0x7f2e2c1595a0 2023-10-06T02:55:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e33ca9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c099f90 con 0x7f2e2c0b49e0 2023-10-06T02:55:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e33ca9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c09adf0 con 0x7f2e2c0b07a0 2023-10-06T02:55:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e32246700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1595a0 0x7f2e2c09b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e32246700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1595a0 0x7f2e2c09b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55334/0 (socket says 172.21.15.84:55334) 2023-10-06T02:55:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e32246700 1 -- 172.21.15.84:0/2688648528 learned_addr learned my addr 172.21.15.84:0/2688648528 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e31244700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c0b49e0 0x7f2e2c1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e31a45700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2c0b07a0 0x7f2e2c09dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e32246700 1 -- 172.21.15.84:0/2688648528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2c0b07a0 msgr2=0x7f2e2c09dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e32246700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2c0b07a0 0x7f2e2c09dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e32246700 1 -- 172.21.15.84:0/2688648528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c0b49e0 msgr2=0x7f2e2c1589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e32246700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c0b49e0 0x7f2e2c1589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e32246700 1 -- 172.21.15.84:0/2688648528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009a20 con 0x7f2e2c1595a0 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e31a45700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2c0b07a0 0x7f2e2c09dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e32246700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1595a0 0x7f2e2c09b280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400b6c0 tx=0x7f2e24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e21ffb700 1 -- 172.21.15.84:0/2688648528 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2401d630 con 0x7f2e2c1595a0 2023-10-06T02:55:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e21ffb700 1 -- 172.21.15.84:0/2688648528 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2401d790 con 0x7f2e2c1595a0 2023-10-06T02:55:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c09a1e0 con 0x7f2e2c1595a0 2023-10-06T02:55:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.610+0000 7f2e21ffb700 1 -- 172.21.15.84:0/2688648528 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2401db50 con 0x7f2e2c1595a0 2023-10-06T02:55:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.611+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c09a7a0 con 0x7f2e2c1595a0 2023-10-06T02:55:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.611+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c064ad0 con 0x7f2e2c1595a0 2023-10-06T02:55:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.612+0000 7f2e21ffb700 1 -- 172.21.15.84:0/2688648528 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e24024070 con 0x7f2e2c1595a0 2023-10-06T02:55:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.612+0000 7f2e21ffb700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e10066f30 0x7f2e100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.612+0000 7f2e21ffb700 1 -- 172.21.15.84:0/2688648528 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2e24086d50 con 0x7f2e2c1595a0 2023-10-06T02:55:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.612+0000 7f2e31a45700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e10066f30 0x7f2e100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.613+0000 7f2e31a45700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e10066f30 0x7f2e100693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e28001810 tx=0x7f2e28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:03.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.617+0000 7f2e21ffb700 1 -- 172.21.15.84:0/2688648528 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e24054110 con 0x7f2e2c1595a0 2023-10-06T02:55:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.802+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e2c0b1820 con 0x7f2e2c1595a0 2023-10-06T02:55:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.803+0000 7f2e21ffb700 1 -- 172.21.15.84:0/2688648528 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13647 (secure 0 0 0) 0x7f2e24009880 con 0x7f2e2c1595a0 2023-10-06T02:55:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:03.805 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:03.109650+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:03.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e10066f30 msgr2=0x7f2e100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e10066f30 0x7f2e100693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e28001810 tx=0x7f2e28009040 comp rx=0 tx=0).stop 2023-10-06T02:55:03.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1595a0 msgr2=0x7f2e2c09b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1595a0 0x7f2e2c09b280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400b6c0 tx=0x7f2e24019000 comp rx=0 tx=0).stop 2023-10-06T02:55:03.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 shutdown_connections 2023-10-06T02:55:03.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e10066f30 0x7f2e100693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e2c1595a0 0x7f2e2c09b280 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e2c0b07a0 0x7f2e2c09dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 --2- 172.21.15.84:0/2688648528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e2c0b49e0 0x7f2e2c1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 >> 172.21.15.84:0/2688648528 conn(0x7f2e2c099830 msgr2=0x7f2e2c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:03.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 shutdown_connections 2023-10-06T02:55:03.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.805+0000 7f2e33ca9700 1 -- 172.21.15.84:0/2688648528 wait complete. 2023-10-06T02:55:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:55:03.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:03.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.936+0000 7f210bc09700 1 Processor -- start 2023-10-06T02:55:03.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.936+0000 7f210bc09700 1 -- start start 2023-10-06T02:55:03.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.937+0000 7f210bc09700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21040b0680 0x7f21040ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.937+0000 7f210bc09700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f21040c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.937+0000 7f210bc09700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21040ccad0 con 0x7f21040b0a50 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.937+0000 7f210bc09700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21040ca7d0 con 0x7f21040b0680 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.937+0000 7f210bc09700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21040c5400 con 0x7f21040cc630 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f210a1a6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f21040c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21099a5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21040b0680 0x7f21040ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f210a1a6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f21040c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:56534/0 (socket says 172.21.15.84:56534) 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21099a5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21040b0680 0x7f21040ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:35260/0 (socket says 172.21.15.84:35260) 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f210a1a6700 1 -- 172.21.15.84:0/1976352219 learned_addr learned my addr 172.21.15.84:0/1976352219 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21099a5700 1 -- 172.21.15.84:0/1976352219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 msgr2=0x7f21040c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:03.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21099a5700 1 --2- 172.21.15.84:0/1976352219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f21040c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21099a5700 1 -- 172.21.15.84:0/1976352219 >> v1:172.21.15.131:6789/0 conn(0x7f21040b0a50 legacy=0x7f21040cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21099a5700 1 -- 172.21.15.84:0/1976352219 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21040ccd40 con 0x7f21040b0680 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f210a1a6700 1 --2- 172.21.15.84:0/1976352219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f21040c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21099a5700 1 --2- 172.21.15.84:0/1976352219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21040b0680 0x7f21040ced10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2100009eb0 tx=0x7f2100009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17341c325f7e578d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21089a3700 1 -- 172.21.15.84:0/1976352219 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000e070 con 0x7f21040b0680 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21089a3700 1 -- 172.21.15.84:0/1976352219 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210000bc30 con 0x7f21040b0680 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.938+0000 7f21089a3700 1 -- 172.21.15.84:0/1976352219 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2100012430 con 0x7f21040b0680 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.939+0000 7f210bc09700 1 -- 172.21.15.84:0/1976352219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21040b0680 msgr2=0x7f21040ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.939+0000 7f210bc09700 1 --2- 172.21.15.84:0/1976352219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21040b0680 0x7f21040ced10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2100009eb0 tx=0x7f2100009780 comp rx=0 tx=0).stop 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.939+0000 7f210bc09700 1 -- 172.21.15.84:0/1976352219 shutdown_connections 2023-10-06T02:55:03.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.939+0000 7f210bc09700 1 --2- 172.21.15.84:0/1976352219 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f21040c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.939+0000 7f210bc09700 1 --2- 172.21.15.84:0/1976352219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21040b0680 0x7f21040ced10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.939+0000 7f210bc09700 1 -- 172.21.15.84:0/1976352219 >> 172.21.15.84:0/1976352219 conn(0x7f2104088000 msgr2=0x7f21040ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.939+0000 7f210bc09700 1 -- 172.21.15.84:0/1976352219 shutdown_connections 2023-10-06T02:55:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.939+0000 7f210bc09700 1 -- 172.21.15.84:0/1976352219 wait complete. 2023-10-06T02:55:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.941+0000 7f210bc09700 1 Processor -- start 2023-10-06T02:55:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.941+0000 7f210bc09700 1 -- start start 2023-10-06T02:55:03.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f210bc09700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21040b0680 0x7f210414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f210bc09700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21040b0a50 0x7f21040b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f210bc09700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f2104168110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f210bc09700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2104150430 con 0x7f21040b0a50 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f210bc09700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040b35f0 con 0x7f21040b0680 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f210bc09700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2104151220 con 0x7f21040cc630 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21091a4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21040b0a50 0x7f21040b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21091a4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21040b0a50 0x7f21040b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55342/0 (socket says 172.21.15.84:55342) 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21091a4700 1 -- 172.21.15.84:0/1400826455 learned_addr learned my addr 172.21.15.84:0/1400826455 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f210a1a6700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f2104168110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21099a5700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21040b0680 0x7f210414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21091a4700 1 -- 172.21.15.84:0/1400826455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 msgr2=0x7f2104168110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21091a4700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f2104168110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21091a4700 1 -- 172.21.15.84:0/1400826455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21040b0680 msgr2=0x7f210414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21091a4700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21040b0680 0x7f210414fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21091a4700 1 -- 172.21.15.84:0/1400826455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc0094f0 con 0x7f21040b0a50 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f21091a4700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21040b0a50 0x7f21040b30b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20f400c510 tx=0x7f20f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f20f9ffb700 1 -- 172.21.15.84:0/1400826455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4011590 con 0x7f21040b0a50 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f20f9ffb700 1 -- 172.21.15.84:0/1400826455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f4011710 con 0x7f21040b0a50 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2100009a20 con 0x7f21040b0a50 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f20f9ffb700 1 -- 172.21.15.84:0/1400826455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4011ad0 con 0x7f21040b0a50 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.942+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21041517e0 con 0x7f21040b0a50 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.943+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2104064ad0 con 0x7f21040b0a50 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.943+0000 7f20f9ffb700 1 -- 172.21.15.84:0/1400826455 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20f401b3b0 con 0x7f21040b0a50 2023-10-06T02:55:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.943+0000 7f20f9ffb700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f20e8066f30 0x7f20e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.943+0000 7f21099a5700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f20e8066f30 0x7f20e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.944+0000 7f20f9ffb700 1 -- 172.21.15.84:0/1400826455 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f20f4083810 con 0x7f21040b0a50 2023-10-06T02:55:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.944+0000 7f21099a5700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f20e8066f30 0x7f20e80693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2100009eb0 tx=0x7f2100019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:03.948+0000 7f20f9ffb700 1 -- 172.21.15.84:0/1400826455 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20f4050c70 con 0x7f21040b0a50 2023-10-06T02:55:04.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.130+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21040cd020 con 0x7f21040b0a50 2023-10-06T02:55:04.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.131+0000 7f20f9ffb700 1 -- 172.21.15.84:0/1400826455 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20f4017070 con 0x7f21040b0a50 2023-10-06T02:55:04.132 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:55:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f20e8066f30 msgr2=0x7f20e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f20e8066f30 0x7f20e80693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2100009eb0 tx=0x7f2100019000 comp rx=0 tx=0).stop 2023-10-06T02:55:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21040b0a50 msgr2=0x7f21040b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21040b0a50 0x7f21040b30b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20f400c510 tx=0x7f20f400c8d0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 shutdown_connections 2023-10-06T02:55:04.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f20e8066f30 0x7f20e80693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21040b0680 0x7f210414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21040cc630 0x7f2104168110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 --2- 172.21.15.84:0/1400826455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21040b0a50 0x7f21040b30b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 >> 172.21.15.84:0/1400826455 conn(0x7f2104088000 msgr2=0x7f21040cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 shutdown_connections 2023-10-06T02:55:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.133+0000 7f210bc09700 1 -- 172.21.15.84:0/1400826455 wait complete. 2023-10-06T02:55:04.146 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:04.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.262+0000 7f47f5b89700 1 Processor -- start 2023-10-06T02:55:04.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.262+0000 7f47f5b89700 1 -- start start 2023-10-06T02:55:04.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47f5b89700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47f01598e0 0x7f47f00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47f5b89700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f47f00cbcb0 0x7f47f00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47f5b89700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f00cf610 con 0x7f47f0159510 2023-10-06T02:55:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47f5b89700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f00cf8f0 con 0x7f47f01598e0 2023-10-06T02:55:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47f5b89700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f00cfbd0 con 0x7f47f00cbcb0 2023-10-06T02:55:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47eeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47f01598e0 0x7f47f00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47eeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47f01598e0 0x7f47f00ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55352/0 (socket says 172.21.15.84:55352) 2023-10-06T02:55:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47eeffd700 1 -- 172.21.15.84:0/2890976713 learned_addr learned my addr 172.21.15.84:0/2890976713 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47effff700 1 --2- 172.21.15.84:0/2890976713 >> v2:172.21.15.131:3300/0 conn(0x7f47f00cbcb0 0x7f47f00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47eeffd700 1 -- 172.21.15.84:0/2890976713 >> v2:172.21.15.131:3300/0 conn(0x7f47f00cbcb0 msgr2=0x7f47f00ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:04.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47eeffd700 1 --2- 172.21.15.84:0/2890976713 >> v2:172.21.15.131:3300/0 conn(0x7f47f00cbcb0 0x7f47f00ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47eeffd700 1 -- 172.21.15.84:0/2890976713 >> v1:172.21.15.131:6789/0 conn(0x7f47f0159510 legacy=0x7f47f00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47eeffd700 1 -- 172.21.15.84:0/2890976713 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f00cfeb0 con 0x7f47f01598e0 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.263+0000 7f47eeffd700 1 --2- 172.21.15.84:0/2890976713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f01598e0 0x7f47f00ce820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f47f006f990 tx=0x7f47e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc91c757bb422b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47ee7fc700 1 -- 172.21.15.84:0/2890976713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e400b820 con 0x7f47f01598e0 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47ee7fc700 1 -- 172.21.15.84:0/2890976713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e400b980 con 0x7f47f01598e0 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47ee7fc700 1 -- 172.21.15.84:0/2890976713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e400bd20 con 0x7f47f01598e0 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47f5b89700 1 -- 172.21.15.84:0/2890976713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f01598e0 msgr2=0x7f47f00ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47f5b89700 1 --2- 172.21.15.84:0/2890976713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f01598e0 0x7f47f00ce820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f47f006f990 tx=0x7f47e4009250 comp rx=0 tx=0).stop 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47f5b89700 1 -- 172.21.15.84:0/2890976713 shutdown_connections 2023-10-06T02:55:04.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47f5b89700 1 --2- 172.21.15.84:0/2890976713 >> v2:172.21.15.131:3300/0 conn(0x7f47f00cbcb0 0x7f47f00ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47f5b89700 1 --2- 172.21.15.84:0/2890976713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f01598e0 0x7f47f00ce820 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47f5b89700 1 -- 172.21.15.84:0/2890976713 >> 172.21.15.84:0/2890976713 conn(0x7f47f0089e90 msgr2=0x7f47f00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47f5b89700 1 -- 172.21.15.84:0/2890976713 shutdown_connections 2023-10-06T02:55:04.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.264+0000 7f47f5b89700 1 -- 172.21.15.84:0/2890976713 wait complete. 2023-10-06T02:55:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.265+0000 7f47f5b89700 1 Processor -- start 2023-10-06T02:55:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.265+0000 7f47f5b89700 1 -- start start 2023-10-06T02:55:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47f5b89700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47f00cbcb0 0x7f47f0155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47f5b89700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0159510 0x7f47f014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47f5b89700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47f01598e0 0x7f47f0159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47f5b89700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f014f940 con 0x7f47f0159510 2023-10-06T02:55:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47f5b89700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01557b0 con 0x7f47f01598e0 2023-10-06T02:55:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47f5b89700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f0154e80 con 0x7f47f00cbcb0 2023-10-06T02:55:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47eeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0159510 0x7f47f014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47eeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0159510 0x7f47f014d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55360/0 (socket says 172.21.15.84:55360) 2023-10-06T02:55:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47eeffd700 1 -- 172.21.15.84:0/2471906531 learned_addr learned my addr 172.21.15.84:0/2471906531 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47ef7fe700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47f00cbcb0 0x7f47f0155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47eeffd700 1 -- 172.21.15.84:0/2471906531 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47f00cbcb0 msgr2=0x7f47f0155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47eeffd700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47f00cbcb0 0x7f47f0155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47eeffd700 1 -- 172.21.15.84:0/2471906531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47f01598e0 msgr2=0x7f47f0159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47effff700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47f01598e0 0x7f47f0159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47eeffd700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47f01598e0 0x7f47f0159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47eeffd700 1 -- 172.21.15.84:0/2471906531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e40094f0 con 0x7f47f0159510 2023-10-06T02:55:04.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47effff700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47f01598e0 0x7f47f0159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:04.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.266+0000 7f47eeffd700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0159510 0x7f47f014d980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009290 tx=0x7f47e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:04.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.267+0000 7f47d77fe700 1 -- 172.21.15.84:0/2471906531 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4011e20 con 0x7f47f0159510 2023-10-06T02:55:04.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.267+0000 7f47d77fe700 1 -- 172.21.15.84:0/2471906531 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e4020070 con 0x7f47f0159510 2023-10-06T02:55:04.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.267+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f0155160 con 0x7f47f0159510 2023-10-06T02:55:04.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.267+0000 7f47d77fe700 1 -- 172.21.15.84:0/2471906531 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e401b6a0 con 0x7f47f0159510 2023-10-06T02:55:04.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.267+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f015b530 con 0x7f47f0159510 2023-10-06T02:55:04.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.268+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f0155920 con 0x7f47f0159510 2023-10-06T02:55:04.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.268+0000 7f47d77fe700 1 -- 172.21.15.84:0/2471906531 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47e4022030 con 0x7f47f0159510 2023-10-06T02:55:04.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.268+0000 7f47d77fe700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47dc066f60 0x7f47dc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.268+0000 7f47d77fe700 1 -- 172.21.15.84:0/2471906531 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f47e4086300 con 0x7f47f0159510 2023-10-06T02:55:04.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.268+0000 7f47ef7fe700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47dc066f60 0x7f47dc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.269+0000 7f47ef7fe700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47dc066f60 0x7f47dc069410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47e0003870 tx=0x7f47e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:04.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.272+0000 7f47d77fe700 1 -- 172.21.15.84:0/2471906531 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47e40536c0 con 0x7f47f0159510 2023-10-06T02:55:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.453+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47f0155920 con 0x7f47f0159510 2023-10-06T02:55:04.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.454+0000 7f47d77fe700 1 -- 172.21.15.84:0/2471906531 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47e4056ce0 con 0x7f47f0159510 2023-10-06T02:55:04.456 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:55:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47dc066f60 msgr2=0x7f47dc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47dc066f60 0x7f47dc069410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f47e0003870 tx=0x7f47e0009040 comp rx=0 tx=0).stop 2023-10-06T02:55:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0159510 msgr2=0x7f47f014d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0159510 0x7f47f014d980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009290 tx=0x7f47e4016000 comp rx=0 tx=0).stop 2023-10-06T02:55:04.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 shutdown_connections 2023-10-06T02:55:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47dc066f60 0x7f47dc069410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47f01598e0 0x7f47f0159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47f00cbcb0 0x7f47f0155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 --2- 172.21.15.84:0/2471906531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0159510 0x7f47f014d980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 >> 172.21.15.84:0/2471906531 conn(0x7f47f0089e90 msgr2=0x7f47f00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:04.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 shutdown_connections 2023-10-06T02:55:04.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.456+0000 7f47f5b89700 1 -- 172.21.15.84:0/2471906531 wait complete. 2023-10-06T02:55:04.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:55:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.581+0000 7fb6a6e6f700 1 Processor -- start 2023-10-06T02:55:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.581+0000 7fb6a6e6f700 1 -- start start 2023-10-06T02:55:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.581+0000 7fb6a6e6f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6a015a8b0 0x7fb6a00ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.581+0000 7fb6a6e6f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a00cdb80 con 0x7fb6a00c8f60 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.581+0000 7fb6a6e6f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a00ccf70 con 0x7fb6a015ac80 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.581+0000 7fb6a6e6f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a00cd250 con 0x7fb6a015a8b0 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.581+0000 7fb6a540c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb6a00c8f60 0x7fb6a00ab400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38440/0 (socket says 172.21.15.84:38440) 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.581+0000 7fb6a540c700 1 -- 172.21.15.84:0/1143465263 learned_addr learned my addr 172.21.15.84:0/1143465263 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.581+0000 7fb6a4c0b700 1 --2- 172.21.15.84:0/1143465263 >> v2:172.21.15.131:3300/0 conn(0x7fb6a015a8b0 0x7fb6a00ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6977fe700 1 -- 172.21.15.84:0/1143465263 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111469571 0 0) 0x7fb6a00cdb80 con 0x7fb6a00c8f60 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6977fe700 1 -- 172.21.15.84:0/1143465263 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb688003570 con 0x7fb6a00c8f60 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6977fe700 1 -- 172.21.15.84:0/1143465263 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220914894 0 0) 0x7fb6a00ccf70 con 0x7fb6a015ac80 2023-10-06T02:55:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6977fe700 1 -- 172.21.15.84:0/1143465263 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a00cdb80 con 0x7fb6a015ac80 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6977fe700 1 -- 172.21.15.84:0/1143465263 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2282535813 0 0) 0x7fb688003570 con 0x7fb6a00c8f60 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6a4c0b700 1 -- 172.21.15.84:0/1143465263 >> v1:172.21.15.131:6789/0 conn(0x7fb6a015ac80 legacy=0x7fb6a00c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6a4c0b700 1 -- 172.21.15.84:0/1143465263 >> v1:172.21.15.84:6789/0 conn(0x7fb6a00c8f60 legacy=0x7fb6a00ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6a4c0b700 1 -- 172.21.15.84:0/1143465263 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a00cd530 con 0x7fb6a015a8b0 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6a4c0b700 1 --2- 172.21.15.84:0/1143465263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015a8b0 0x7fb6a00ce9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009eb0 tx=0x7fb69c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b09791569b3208d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6977fe700 1 -- 172.21.15.84:0/1143465263 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00e070 con 0x7fb6a015a8b0 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6977fe700 1 -- 172.21.15.84:0/1143465263 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c00b870 con 0x7fb6a015a8b0 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.582+0000 7fb6977fe700 1 -- 172.21.15.84:0/1143465263 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698001470 con 0x7fb6a015a8b0 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.583+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1143465263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015a8b0 msgr2=0x7fb6a00ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.583+0000 7fb6a6e6f700 1 --2- 172.21.15.84:0/1143465263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015a8b0 0x7fb6a00ce9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009eb0 tx=0x7fb69c009780 comp rx=0 tx=0).stop 2023-10-06T02:55:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.583+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1143465263 shutdown_connections 2023-10-06T02:55:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.583+0000 7fb6a6e6f700 1 --2- 172.21.15.84:0/1143465263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015a8b0 0x7fb6a00ce9c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.583+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1143465263 >> 172.21.15.84:0/1143465263 conn(0x7fb6a0067dd0 msgr2=0x7fb6a00ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.583+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1143465263 shutdown_connections 2023-10-06T02:55:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.583+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1143465263 wait complete. 2023-10-06T02:55:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.584+0000 7fb6a6e6f700 1 Processor -- start 2023-10-06T02:55:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.584+0000 7fb6a6e6f700 1 -- start start 2023-10-06T02:55:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a6e6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a00c8f60 0x7fb6a0167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a6e6f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a8b0 0x7fb6a01524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a6e6f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015ac80 0x7fb6a01588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a6e6f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a0153960 con 0x7fb6a00c8f60 2023-10-06T02:55:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a6e6f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a0152ce0 con 0x7fb6a015ac80 2023-10-06T02:55:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a6e6f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a0152fc0 con 0x7fb6a015a8b0 2023-10-06T02:55:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a4c0b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a00c8f60 0x7fb6a0167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a4c0b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a00c8f60 0x7fb6a0167c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55370/0 (socket says 172.21.15.84:55370) 2023-10-06T02:55:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a4c0b700 1 -- 172.21.15.84:0/1910119919 learned_addr learned my addr 172.21.15.84:0/1910119919 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb697fff700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a8b0 0x7fb6a01524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a540c700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015ac80 0x7fb6a01588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a4c0b700 1 -- 172.21.15.84:0/1910119919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a8b0 msgr2=0x7fb6a01524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a4c0b700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a8b0 0x7fb6a01524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a4c0b700 1 -- 172.21.15.84:0/1910119919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015ac80 msgr2=0x7fb6a01588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a4c0b700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015ac80 0x7fb6a01588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a4c0b700 1 -- 172.21.15.84:0/1910119919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c009a20 con 0x7fb6a00c8f60 2023-10-06T02:55:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a540c700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015ac80 0x7fb6a01588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a4c0b700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a00c8f60 0x7fb6a0167c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0099f0 tx=0x7fb69c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:04.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb694ff9700 1 -- 172.21.15.84:0/1910119919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c000fe0 con 0x7fb6a00c8f60 2023-10-06T02:55:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb694ff9700 1 -- 172.21.15.84:0/1910119919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c013ca0 con 0x7fb6a00c8f60 2023-10-06T02:55:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb694ff9700 1 -- 172.21.15.84:0/1910119919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c026650 con 0x7fb6a00c8f60 2023-10-06T02:55:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a01532a0 con 0x7fb6a00c8f60 2023-10-06T02:55:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.585+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a01529f0 con 0x7fb6a00c8f60 2023-10-06T02:55:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.586+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a0153aa0 con 0x7fb6a00c8f60 2023-10-06T02:55:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.587+0000 7fb694ff9700 1 -- 172.21.15.84:0/1910119919 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb69c019030 con 0x7fb6a00c8f60 2023-10-06T02:55:04.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.587+0000 7fb694ff9700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb68c066f30 0x7fb68c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.587+0000 7fb694ff9700 1 -- 172.21.15.84:0/1910119919 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb69c085fc0 con 0x7fb6a00c8f60 2023-10-06T02:55:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.587+0000 7fb697fff700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb68c066f30 0x7fb68c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.587+0000 7fb697fff700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb68c066f30 0x7fb68c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6a006f600 tx=0x7fb690009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:04.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.591+0000 7fb694ff9700 1 -- 172.21.15.84:0/1910119919 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb69c0b75a0 con 0x7fb6a00c8f60 2023-10-06T02:55:04.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.778+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb6a0064ad0 con 0x7fb6a00c8f60 2023-10-06T02:55:04.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.778+0000 7fb694ff9700 1 -- 172.21.15.84:0/1910119919 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb69c02b090 con 0x7fb6a00c8f60 2023-10-06T02:55:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:04.779 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T02:55:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T02:55:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T02:55:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T02:55:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T02:55:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:04.781 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T02:55:04.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb68c066f30 msgr2=0x7fb68c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb68c066f30 0x7fb68c0693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6a006f600 tx=0x7fb690009040 comp rx=0 tx=0).stop 2023-10-06T02:55:04.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a00c8f60 msgr2=0x7fb6a0167c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a00c8f60 0x7fb6a0167c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0099f0 tx=0x7fb69c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 shutdown_connections 2023-10-06T02:55:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb68c066f30 0x7fb68c0693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a015ac80 0x7fb6a01588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a00c8f60 0x7fb6a0167c70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 --2- 172.21.15.84:0/1910119919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a8b0 0x7fb6a01524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 >> 172.21.15.84:0/1910119919 conn(0x7fb6a0067dd0 msgr2=0x7fb6a0155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 shutdown_connections 2023-10-06T02:55:04.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.780+0000 7fb6a6e6f700 1 -- 172.21.15.84:0/1910119919 wait complete. 2023-10-06T02:55:04.792 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:55:04.793 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:55:04.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.909+0000 7fe6b4d53700 1 Processor -- start 2023-10-06T02:55:04.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.909+0000 7fe6b4d53700 1 -- start start 2023-10-06T02:55:04.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6b4d53700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b015a780 0x7fe6b00aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6b4d53700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b00b2d20 con 0x7fe6b006ed20 2023-10-06T02:55:04.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6b4d53700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b00b0450 con 0x7fe6b00b23a0 2023-10-06T02:55:04.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6b4d53700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b006fb80 con 0x7fe6b015a780 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6ae59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe6b006ed20 0x7fe6b006f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38450/0 (socket says 172.21.15.84:38450) 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6ae59c700 1 -- 172.21.15.84:0/1100587708 learned_addr learned my addr 172.21.15.84:0/1100587708 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6aed9d700 1 --2- 172.21.15.84:0/1100587708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b015a780 0x7fe6b00aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6add9b700 1 -- 172.21.15.84:0/1100587708 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920056601 0 0) 0x7fe6b00b2d20 con 0x7fe6b006ed20 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6add9b700 1 -- 172.21.15.84:0/1100587708 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe69c003570 con 0x7fe6b006ed20 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6add9b700 1 -- 172.21.15.84:0/1100587708 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268696647 0 0) 0x7fe6b00b0450 con 0x7fe6b00b23a0 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.910+0000 7fe6add9b700 1 -- 172.21.15.84:0/1100587708 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b00b2d20 con 0x7fe6b00b23a0 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6aed9d700 1 -- 172.21.15.84:0/1100587708 >> v1:172.21.15.131:6789/0 conn(0x7fe6b00b23a0 legacy=0x7fe6b00b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6add9b700 1 -- 172.21.15.84:0/1100587708 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2624352694 0 0) 0x7fe69c003570 con 0x7fe6b006ed20 2023-10-06T02:55:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6aed9d700 1 -- 172.21.15.84:0/1100587708 >> v1:172.21.15.84:6789/0 conn(0x7fe6b006ed20 legacy=0x7fe6b006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6aed9d700 1 -- 172.21.15.84:0/1100587708 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b00b2a40 con 0x7fe6b015a780 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6aed9d700 1 --2- 172.21.15.84:0/1100587708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b015a780 0x7fe6b00aee20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009e90 tx=0x7fe6a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=635528214a2a799 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6add9b700 1 -- 172.21.15.84:0/1100587708 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800e070 con 0x7fe6b015a780 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6add9b700 1 -- 172.21.15.84:0/1100587708 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a800b870 con 0x7fe6b015a780 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6add9b700 1 -- 172.21.15.84:0/1100587708 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0001470 con 0x7fe6b015a780 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6b4d53700 1 -- 172.21.15.84:0/1100587708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b015a780 msgr2=0x7fe6b00aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6b4d53700 1 --2- 172.21.15.84:0/1100587708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b015a780 0x7fe6b00aee20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009e90 tx=0x7fe6a8009780 comp rx=0 tx=0).stop 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6b4d53700 1 -- 172.21.15.84:0/1100587708 shutdown_connections 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6b4d53700 1 --2- 172.21.15.84:0/1100587708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b015a780 0x7fe6b00aee20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6b4d53700 1 -- 172.21.15.84:0/1100587708 >> 172.21.15.84:0/1100587708 conn(0x7fe6b0068330 msgr2=0x7fe6b0068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:04.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6b4d53700 1 -- 172.21.15.84:0/1100587708 shutdown_connections 2023-10-06T02:55:04.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.911+0000 7fe6b4d53700 1 -- 172.21.15.84:0/1100587708 wait complete. 2023-10-06T02:55:04.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6b4d53700 1 Processor -- start 2023-10-06T02:55:04.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6b4d53700 1 -- start start 2023-10-06T02:55:04.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6b4d53700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b006ed20 0x7fe6b00c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6b4d53700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b00b23a0 0x7fe6b00c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6b4d53700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6b015a780 0x7fe6b015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6b4d53700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b00cec00 con 0x7fe6b006ed20 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6b4d53700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b00ca300 con 0x7fe6b015a780 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6b4d53700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b00ca5e0 con 0x7fe6b00b23a0 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6ae59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b006ed20 0x7fe6b00c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.913+0000 7fe6ae59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b006ed20 0x7fe6b00c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55378/0 (socket says 172.21.15.84:55378) 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6ae59c700 1 -- 172.21.15.84:0/420955124 learned_addr learned my addr 172.21.15.84:0/420955124 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6aed9d700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6b015a780 0x7fe6b015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6a5d9b700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b00b23a0 0x7fe6b00c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6ae59c700 1 -- 172.21.15.84:0/420955124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b00b23a0 msgr2=0x7fe6b00c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6ae59c700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b00b23a0 0x7fe6b00c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6ae59c700 1 -- 172.21.15.84:0/420955124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6b015a780 msgr2=0x7fe6b015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6ae59c700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6b015a780 0x7fe6b015e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6ae59c700 1 -- 172.21.15.84:0/420955124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8009a20 con 0x7fe6b006ed20 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6ae59c700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b006ed20 0x7fe6b00c6610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000cb70 tx=0x7fe6a0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6a6ffd700 1 -- 172.21.15.84:0/420955124 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0007150 con 0x7fe6b006ed20 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6a6ffd700 1 -- 172.21.15.84:0/420955124 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a00072b0 con 0x7fe6b006ed20 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6a6ffd700 1 -- 172.21.15.84:0/420955124 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0007670 con 0x7fe6b006ed20 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b00ca8c0 con 0x7fe6b006ed20 2023-10-06T02:55:04.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.914+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b00c6b50 con 0x7fe6b006ed20 2023-10-06T02:55:04.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.915+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b0064ad0 con 0x7fe6b006ed20 2023-10-06T02:55:04.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.915+0000 7fe6a6ffd700 1 -- 172.21.15.84:0/420955124 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6a0004a40 con 0x7fe6b006ed20 2023-10-06T02:55:04.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.916+0000 7fe6a6ffd700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe690066f30 0x7fe6900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:04.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.916+0000 7fe6a5d9b700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe690066f30 0x7fe6900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:04.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.916+0000 7fe6a6ffd700 1 -- 172.21.15.84:0/420955124 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe6a0083610 con 0x7fe6b006ed20 2023-10-06T02:55:04.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.916+0000 7fe6a5d9b700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe690066f30 0x7fe6900693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00cd960 tx=0x7fe698007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:04.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:04.920+0000 7fe6a6ffd700 1 -- 172.21.15.84:0/420955124 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6a0054580 con 0x7fe6b006ed20 2023-10-06T02:55:05.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.102+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe6b004bb80 con 0x7fe6b006ed20 2023-10-06T02:55:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.216+0000 7fe6a6ffd700 1 -- 172.21.15.84:0/420955124 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe6a00180b0 con 0x7fe6b006ed20 2023-10-06T02:55:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.220+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe690066f30 msgr2=0x7fe6900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.220+0000 7fe6b4d53700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe690066f30 0x7fe6900693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00cd960 tx=0x7fe698007d50 comp rx=0 tx=0).stop 2023-10-06T02:55:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.220+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b006ed20 msgr2=0x7fe6b00c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.220+0000 7fe6b4d53700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b006ed20 0x7fe6b00c6610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000cb70 tx=0x7fe6a0001ab0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.220+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 shutdown_connections 2023-10-06T02:55:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.220+0000 7fe6b4d53700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe690066f30 0x7fe6900693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.220+0000 7fe6b4d53700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6b015a780 0x7fe6b015e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.221+0000 7fe6b4d53700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6b006ed20 0x7fe6b00c6610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.221+0000 7fe6b4d53700 1 --2- 172.21.15.84:0/420955124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6b00b23a0 0x7fe6b00c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.221+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 >> 172.21.15.84:0/420955124 conn(0x7fe6b0068330 msgr2=0x7fe6b015b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.221+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 shutdown_connections 2023-10-06T02:55:05.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.221+0000 7fe6b4d53700 1 -- 172.21.15.84:0/420955124 wait complete. 2023-10-06T02:55:05.223 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T02:55:05.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T02:55:05.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.355+0000 7f72233f0700 1 Processor -- start 2023-10-06T02:55:05.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.355+0000 7f72233f0700 1 -- start start 2023-10-06T02:55:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f72233f0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f721c1598e0 0x7f721c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f72233f0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f721c0cbcb0 0x7f721c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f72233f0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0cf610 con 0x7f721c159510 2023-10-06T02:55:05.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f72233f0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0cf8f0 con 0x7f721c0cbcb0 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f72233f0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0cfbd0 con 0x7f721c1598e0 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f722198d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f721c0cbcb0 0x7f721c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f722198d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f721c0cbcb0 0x7f721c0ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55394/0 (socket says 172.21.15.84:55394) 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f722198d700 1 -- 172.21.15.84:0/280699601 learned_addr learned my addr 172.21.15.84:0/280699601 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f722098b700 1 --2- 172.21.15.84:0/280699601 >> v2:172.21.15.131:3300/0 conn(0x7f721c1598e0 0x7f721c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.356+0000 7f722198d700 1 -- 172.21.15.84:0/280699601 >> v2:172.21.15.131:3300/0 conn(0x7f721c1598e0 msgr2=0x7f721c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f722198d700 1 --2- 172.21.15.84:0/280699601 >> v2:172.21.15.131:3300/0 conn(0x7f721c1598e0 0x7f721c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f722198d700 1 -- 172.21.15.84:0/280699601 >> v1:172.21.15.131:6789/0 conn(0x7f721c159510 legacy=0x7f721c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f722198d700 1 -- 172.21.15.84:0/280699601 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0cfeb0 con 0x7f721c0cbcb0 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f722198d700 1 --2- 172.21.15.84:0/280699601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c0cbcb0 0x7f721c0ced60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f721c0c73b0 tx=0x7f7214009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154aa2fe58fbb08f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f7213fff700 1 -- 172.21.15.84:0/280699601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400e070 con 0x7f721c0cbcb0 2023-10-06T02:55:05.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f7213fff700 1 -- 172.21.15.84:0/280699601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400ba50 con 0x7f721c0cbcb0 2023-10-06T02:55:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f7213fff700 1 -- 172.21.15.84:0/280699601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140092e0 con 0x7f721c0cbcb0 2023-10-06T02:55:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f72233f0700 1 -- 172.21.15.84:0/280699601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c0cbcb0 msgr2=0x7f721c0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f72233f0700 1 --2- 172.21.15.84:0/280699601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c0cbcb0 0x7f721c0ced60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f721c0c73b0 tx=0x7f7214009840 comp rx=0 tx=0).stop 2023-10-06T02:55:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f72233f0700 1 -- 172.21.15.84:0/280699601 shutdown_connections 2023-10-06T02:55:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f72233f0700 1 --2- 172.21.15.84:0/280699601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c0cbcb0 0x7f721c0ced60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f72233f0700 1 --2- 172.21.15.84:0/280699601 >> v2:172.21.15.131:3300/0 conn(0x7f721c1598e0 0x7f721c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f72233f0700 1 -- 172.21.15.84:0/280699601 >> 172.21.15.84:0/280699601 conn(0x7f721c089e90 msgr2=0x7f721c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f72233f0700 1 -- 172.21.15.84:0/280699601 shutdown_connections 2023-10-06T02:55:05.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.357+0000 7f72233f0700 1 -- 172.21.15.84:0/280699601 wait complete. 2023-10-06T02:55:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.358+0000 7f72233f0700 1 Processor -- start 2023-10-06T02:55:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.359+0000 7f72233f0700 1 -- start start 2023-10-06T02:55:05.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.359+0000 7f72233f0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0cbcb0 0x7f721c14b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.359+0000 7f72233f0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c159510 0x7f721c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.359+0000 7f72233f0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f721c1598e0 0x7f721c149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.359+0000 7f72233f0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0c89d0 con 0x7f721c159510 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.359+0000 7f72233f0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0c8cb0 con 0x7f721c0cbcb0 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.359+0000 7f72233f0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0c8f90 con 0x7f721c1598e0 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.359+0000 7f722098b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c159510 0x7f721c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722098b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c159510 0x7f721c0c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55402/0 (socket says 172.21.15.84:55402) 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722098b700 1 -- 172.21.15.84:0/1879365510 learned_addr learned my addr 172.21.15.84:0/1879365510 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722198d700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f721c1598e0 0x7f721c149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722118c700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0cbcb0 0x7f721c14b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:05.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722098b700 1 -- 172.21.15.84:0/1879365510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f721c1598e0 msgr2=0x7f721c149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722098b700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f721c1598e0 0x7f721c149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722098b700 1 -- 172.21.15.84:0/1879365510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0cbcb0 msgr2=0x7f721c14b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722098b700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0cbcb0 0x7f721c14b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722098b700 1 -- 172.21.15.84:0/1879365510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214009ae0 con 0x7f721c159510 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f722098b700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c159510 0x7f721c0c7fc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d890 tx=0x7f720c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f72117fa700 1 -- 172.21.15.84:0/1879365510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c012630 con 0x7f721c159510 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f72117fa700 1 -- 172.21.15.84:0/1879365510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c012790 con 0x7f721c159510 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c0c9270 con 0x7f721c159510 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f72117fa700 1 -- 172.21.15.84:0/1879365510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c012b30 con 0x7f721c159510 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.360+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c14b790 con 0x7f721c159510 2023-10-06T02:55:05.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.361+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c064ad0 con 0x7f721c159510 2023-10-06T02:55:05.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.361+0000 7f72117fa700 1 -- 172.21.15.84:0/1879365510 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f720c014430 con 0x7f721c159510 2023-10-06T02:55:05.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.362+0000 7f72117fa700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7200066f30 0x7f72000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:05.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.362+0000 7f72117fa700 1 -- 172.21.15.84:0/1879365510 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f720c0840a0 con 0x7f721c159510 2023-10-06T02:55:05.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.362+0000 7f722118c700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7200066f30 0x7f72000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:05.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.362+0000 7f722118c700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7200066f30 0x7f72000693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7218003a80 tx=0x7f7218007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:05.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.366+0000 7f72117fa700 1 -- 172.21.15.84:0/1879365510 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f720c04d5a0 con 0x7f721c159510 2023-10-06T02:55:05.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:05.549+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f721c0cf2a0 con 0x7f721c159510 2023-10-06T02:55:06.102 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:55:06.104 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:55:06.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.227+0000 7f72117fa700 1 -- 172.21.15.84:0/1879365510 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f720c054ed0 con 0x7f721c159510 2023-10-06T02:55:06.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.233+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7200066f30 msgr2=0x7f72000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:06.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.233+0000 7f72233f0700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7200066f30 0x7f72000693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7218003a80 tx=0x7f7218007ec0 comp rx=0 tx=0).stop 2023-10-06T02:55:06.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.233+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c159510 msgr2=0x7f721c0c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:06.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.233+0000 7f72233f0700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c159510 0x7f721c0c7fc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f720c00d890 tx=0x7f720c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:06.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.234+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 shutdown_connections 2023-10-06T02:55:06.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.234+0000 7f72233f0700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7200066f30 0x7f72000693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:06.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.234+0000 7f72233f0700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0cbcb0 0x7f721c14b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:06.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.234+0000 7f72233f0700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f721c1598e0 0x7f721c149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:06.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.234+0000 7f72233f0700 1 --2- 172.21.15.84:0/1879365510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f721c159510 0x7f721c0c7fc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:06.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.234+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 >> 172.21.15.84:0/1879365510 conn(0x7f721c089e90 msgr2=0x7f721c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:06.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.236+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 shutdown_connections 2023-10-06T02:55:06.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.236+0000 7f72233f0700 1 -- 172.21.15.84:0/1879365510 wait complete. 2023-10-06T02:55:06.239 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T02:55:06.254 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:55:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.372+0000 7f7a83268700 1 Processor -- start 2023-10-06T02:55:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.372+0000 7f7a83268700 1 -- start start 2023-10-06T02:55:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.373+0000 7f7a83268700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a7c1598e0 0x7f7a7c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.373+0000 7f7a83268700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c0cf610 con 0x7f7a7c159510 2023-10-06T02:55:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.373+0000 7f7a83268700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c0cf8f0 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.373+0000 7f7a83268700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0cfbd0 con 0x7f7a7c1598e0 2023-10-06T02:55:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a81004700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a7c159510 0x7f7a7c0cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38462/0 (socket says 172.21.15.84:38462) 2023-10-06T02:55:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a81004700 1 -- 172.21.15.84:0/3353734973 learned_addr learned my addr 172.21.15.84:0/3353734973 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a80803700 1 --2- 172.21.15.84:0/3353734973 >> v2:172.21.15.84:3300/0 conn(0x7f7a7c1598e0 0x7f7a7c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a73fff700 1 -- 172.21.15.84:0/3353734973 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744491966 0 0) 0x7f7a7c0cf610 con 0x7f7a7c159510 2023-10-06T02:55:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a73fff700 1 -- 172.21.15.84:0/3353734973 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a68003570 con 0x7f7a7c159510 2023-10-06T02:55:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a80803700 1 -- 172.21.15.84:0/3353734973 >> v1:172.21.15.131:6789/0 conn(0x7f7a7c0cbcb0 legacy=0x7f7a7c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a80803700 1 -- 172.21.15.84:0/3353734973 >> v1:172.21.15.84:6789/0 conn(0x7f7a7c159510 legacy=0x7f7a7c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a80803700 1 -- 172.21.15.84:0/3353734973 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0cfeb0 con 0x7f7a7c1598e0 2023-10-06T02:55:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a80803700 1 --2- 172.21.15.84:0/3353734973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c1598e0 0x7f7a7c0ce820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0098e0 tx=0x7f7a6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b967d313b9090b27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a73fff700 1 -- 172.21.15.84:0/3353734973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c00b640 con 0x7f7a7c1598e0 2023-10-06T02:55:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a73fff700 1 -- 172.21.15.84:0/3353734973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c00b7a0 con 0x7f7a7c1598e0 2023-10-06T02:55:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.374+0000 7f7a73fff700 1 -- 172.21.15.84:0/3353734973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c00bb40 con 0x7f7a7c1598e0 2023-10-06T02:55:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.375+0000 7f7a83268700 1 -- 172.21.15.84:0/3353734973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c1598e0 msgr2=0x7f7a7c0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.375+0000 7f7a83268700 1 --2- 172.21.15.84:0/3353734973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c1598e0 0x7f7a7c0ce820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0098e0 tx=0x7f7a6c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.375+0000 7f7a83268700 1 -- 172.21.15.84:0/3353734973 shutdown_connections 2023-10-06T02:55:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.375+0000 7f7a83268700 1 --2- 172.21.15.84:0/3353734973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c1598e0 0x7f7a7c0ce820 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.375+0000 7f7a83268700 1 -- 172.21.15.84:0/3353734973 >> 172.21.15.84:0/3353734973 conn(0x7f7a7c089e90 msgr2=0x7f7a7c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.375+0000 7f7a83268700 1 -- 172.21.15.84:0/3353734973 shutdown_connections 2023-10-06T02:55:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.375+0000 7f7a83268700 1 -- 172.21.15.84:0/3353734973 wait complete. 2023-10-06T02:55:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.376+0000 7f7a83268700 1 Processor -- start 2023-10-06T02:55:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.376+0000 7f7a83268700 1 -- start start 2023-10-06T02:55:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a83268700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0cbcb0 0x7f7a7c150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a83268700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a7c159510 0x7f7a7c149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a83268700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a7c1598e0 0x7f7a7c1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a83268700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c16aef0 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a83268700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c151500 con 0x7f7a7c159510 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a83268700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c149c60 con 0x7f7a7c1598e0 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81004700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0cbcb0 0x7f7a7c150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81004700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0cbcb0 0x7f7a7c150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55424/0 (socket says 172.21.15.84:55424) 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81004700 1 -- 172.21.15.84:0/3261506945 learned_addr learned my addr 172.21.15.84:0/3261506945 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a80803700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a7c159510 0x7f7a7c149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81805700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a7c1598e0 0x7f7a7c1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81004700 1 -- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a7c1598e0 msgr2=0x7f7a7c1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81004700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a7c1598e0 0x7f7a7c1525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81004700 1 -- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a7c159510 msgr2=0x7f7a7c149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81004700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a7c159510 0x7f7a7c149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81004700 1 -- 172.21.15.84:0/3261506945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c009420 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a80803700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a7c159510 0x7f7a7c149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81805700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a7c1598e0 0x7f7a7c1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.377+0000 7f7a81004700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0cbcb0 0x7f7a7c150fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800c7c0 tx=0x7f7a78007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.378+0000 7f7a717fa700 1 -- 172.21.15.84:0/3261506945 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a78005b30 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.378+0000 7f7a717fa700 1 -- 172.21.15.84:0/3261506945 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a78005c90 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.378+0000 7f7a717fa700 1 -- 172.21.15.84:0/3261506945 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a78007340 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.378+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c16a2e0 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.378+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c16a8a0 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.378+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c064ad0 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.379+0000 7f7a717fa700 1 -- 172.21.15.84:0/3261506945 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a7801b400 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.379+0000 7f7a717fa700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a60066f30 0x7f7a600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.379+0000 7f7a717fa700 1 -- 172.21.15.84:0/3261506945 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f7a78084140 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.379+0000 7f7a80803700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a60066f30 0x7f7a600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.380+0000 7f7a80803700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a60066f30 0x7f7a600693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0098e0 tx=0x7f7a6c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.384+0000 7f7a717fa700 1 -- 172.21.15.84:0/3261506945 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a78051330 con 0x7f7a7c0cbcb0 2023-10-06T02:55:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:06.613+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7a7c0c66e0 con 0x7f7a7c0cbcb0 2023-10-06T02:55:07.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.224+0000 7f7a717fa700 1 -- 172.21.15.84:0/3261506945 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7a78054950 con 0x7f7a7c0cbcb0 2023-10-06T02:55:07.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a60066f30 msgr2=0x7f7a600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a60066f30 0x7f7a600693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0098e0 tx=0x7f7a6c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0cbcb0 msgr2=0x7f7a7c150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0cbcb0 0x7f7a7c150fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800c7c0 tx=0x7f7a78007e00 comp rx=0 tx=0).stop 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 shutdown_connections 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a60066f30 0x7f7a600693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a7c1598e0 0x7f7a7c1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a7c0cbcb0 0x7f7a7c150fc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 --2- 172.21.15.84:0/3261506945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a7c159510 0x7f7a7c149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 >> 172.21.15.84:0/3261506945 conn(0x7f7a7c089e90 msgr2=0x7f7a7c15d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 shutdown_connections 2023-10-06T02:55:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.227+0000 7f7a83268700 1 -- 172.21.15.84:0/3261506945 wait complete. 2023-10-06T02:55:07.229 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T02:55:07.242 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T02:55:07.242 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T02:55:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.361+0000 7f6fe3fff700 1 Processor -- start 2023-10-06T02:55:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.361+0000 7f6fe3fff700 1 -- start start 2023-10-06T02:55:07.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6fe4069b60 0x7f6fe40b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:07.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe40b1750 0x7f6fe40cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:07.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe3fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe40696d0 con 0x7f6fe40ccc80 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe3fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe40b1bf0 con 0x7f6fe4069b60 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe3fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40cd050 con 0x7f6fe40b1750 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe2ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6fe40ccc80 0x7f6fe406d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38476/0 (socket says 172.21.15.84:38476) 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe2ffd700 1 -- 172.21.15.84:0/2712735496 learned_addr learned my addr 172.21.15.84:0/2712735496 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fda7fc700 1 --2- 172.21.15.84:0/2712735496 >> v2:172.21.15.84:3300/0 conn(0x7f6fe4069b60 0x7f6fe40b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe37fe700 1 --2- 172.21.15.84:0/2712735496 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe40b1750 0x7f6fe40cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe27fc700 1 -- 172.21.15.84:0/2712735496 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975080825 0 0) 0x7f6fe40696d0 con 0x7f6fe40ccc80 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe27fc700 1 -- 172.21.15.84:0/2712735496 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd0003570 con 0x7f6fe40ccc80 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fda7fc700 1 -- 172.21.15.84:0/2712735496 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe40b1750 msgr2=0x7f6fe40cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fda7fc700 1 --2- 172.21.15.84:0/2712735496 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe40b1750 0x7f6fe40cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fda7fc700 1 -- 172.21.15.84:0/2712735496 >> v1:172.21.15.84:6789/0 conn(0x7f6fe40ccc80 legacy=0x7f6fe406d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fda7fc700 1 -- 172.21.15.84:0/2712735496 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4159810 con 0x7f6fe4069b60 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.362+0000 7f6fe37fe700 1 --2- 172.21.15.84:0/2712735496 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe40b1750 0x7f6fe40cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fda7fc700 1 --2- 172.21.15.84:0/2712735496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe4069b60 0x7f6fe40b1210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0098e0 tx=0x7f6fcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe94f10c4e6aea63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe27fc700 1 -- 172.21.15.84:0/2712735496 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00b640 con 0x7f6fe4069b60 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe27fc700 1 -- 172.21.15.84:0/2712735496 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc00b7a0 con 0x7f6fe4069b60 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe27fc700 1 -- 172.21.15.84:0/2712735496 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00bb40 con 0x7f6fe4069b60 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe3fff700 1 -- 172.21.15.84:0/2712735496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe4069b60 msgr2=0x7f6fe40b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe3fff700 1 --2- 172.21.15.84:0/2712735496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe4069b60 0x7f6fe40b1210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0098e0 tx=0x7f6fcc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe3fff700 1 -- 172.21.15.84:0/2712735496 shutdown_connections 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe3fff700 1 --2- 172.21.15.84:0/2712735496 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe40b1750 0x7f6fe40cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe3fff700 1 --2- 172.21.15.84:0/2712735496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe4069b60 0x7f6fe40b1210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe3fff700 1 -- 172.21.15.84:0/2712735496 >> 172.21.15.84:0/2712735496 conn(0x7f6fe40675f0 msgr2=0x7f6fe40679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:07.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe3fff700 1 -- 172.21.15.84:0/2712735496 shutdown_connections 2023-10-06T02:55:07.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.363+0000 7f6fe3fff700 1 -- 172.21.15.84:0/2712735496 wait complete. 2023-10-06T02:55:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.364+0000 7f6fe3fff700 1 Processor -- start 2023-10-06T02:55:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fe3fff700 1 -- start start 2023-10-06T02:55:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fe3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe4069b60 0x7f6fe4150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fe3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe40b1750 0x7f6fe40ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fe3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe40ccc80 0x7f6fe40ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fe3fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe415a190 con 0x7f6fe40b1750 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fe3fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe41525f0 con 0x7f6fe40ccc80 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fe3fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe41528d0 con 0x7f6fe4069b60 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fda7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe40b1750 0x7f6fe40ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fda7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe40b1750 0x7f6fe40ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55432/0 (socket says 172.21.15.84:55432) 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.365+0000 7f6fda7fc700 1 -- 172.21.15.84:0/342737994 learned_addr learned my addr 172.21.15.84:0/342737994 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fe2ffd700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe4069b60 0x7f6fe4150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fe37fe700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe40ccc80 0x7f6fe40ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fda7fc700 1 -- 172.21.15.84:0/342737994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe4069b60 msgr2=0x7f6fe4150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:07.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fda7fc700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe4069b60 0x7f6fe4150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fda7fc700 1 -- 172.21.15.84:0/342737994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe40ccc80 msgr2=0x7f6fe40ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fda7fc700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe40ccc80 0x7f6fe40ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fda7fc700 1 -- 172.21.15.84:0/342737994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc009420 con 0x7f6fe40b1750 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fe37fe700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe40ccc80 0x7f6fe40ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fda7fc700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe40b1750 0x7f6fe40ae030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc013000 tx=0x7f6fcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fdb7fe700 1 -- 172.21.15.84:0/342737994 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc01bda0 con 0x7f6fe40b1750 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fdb7fe700 1 -- 172.21.15.84:0/342737994 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc011420 con 0x7f6fe40b1750 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe4152bb0 con 0x7f6fe40b1750 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fdb7fe700 1 -- 172.21.15.84:0/342737994 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0117e0 con 0x7f6fe40b1750 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.366+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe4151010 con 0x7f6fe40b1750 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.367+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe415a340 con 0x7f6fe40b1750 2023-10-06T02:55:07.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.367+0000 7f6fdb7fe700 1 -- 172.21.15.84:0/342737994 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fcc011b90 con 0x7f6fe40b1750 2023-10-06T02:55:07.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.367+0000 7f6fdb7fe700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fc4066f30 0x7f6fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:07.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.368+0000 7f6fe2ffd700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fc4066f30 0x7f6fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:07.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.368+0000 7f6fdb7fe700 1 -- 172.21.15.84:0/342737994 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6fcc085b80 con 0x7f6fe40b1750 2023-10-06T02:55:07.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.368+0000 7f6fe2ffd700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fc4066f30 0x7f6fc40693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40058d0 tx=0x7f6fd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:07.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.372+0000 7f6fdb7fe700 1 -- 172.21.15.84:0/342737994 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fe415a340 con 0x7f6fe40b1750 2023-10-06T02:55:07.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:07.564+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f6fe4159f60 con 0x7f6fe40b1750 2023-10-06T02:55:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.094+0000 7f6fdb7fe700 1 -- 172.21.15.84:0/342737994 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f6fcc052c90 con 0x7f6fe40b1750 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fc4066f30 msgr2=0x7f6fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fc4066f30 0x7f6fc40693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40058d0 tx=0x7f6fd4009040 comp rx=0 tx=0).stop 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe40b1750 msgr2=0x7f6fe40ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe40b1750 0x7f6fe40ae030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc013000 tx=0x7f6fcc017000 comp rx=0 tx=0).stop 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 shutdown_connections 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fc4066f30 0x7f6fc40693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe40ccc80 0x7f6fe40ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe4069b60 0x7f6fe4150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 --2- 172.21.15.84:0/342737994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe40b1750 0x7f6fe40ae030 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 >> 172.21.15.84:0/342737994 conn(0x7f6fe40675f0 msgr2=0x7f6fe4063660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 shutdown_connections 2023-10-06T02:55:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.097+0000 7f6fe3fff700 1 -- 172.21.15.84:0/342737994 wait complete. 2023-10-06T02:55:08.110 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:55:08.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.236+0000 7feca70ea700 1 Processor -- start 2023-10-06T02:55:08.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.236+0000 7feca70ea700 1 -- start start 2023-10-06T02:55:08.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.237+0000 7feca70ea700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feca00cbc40 0x7feca0164180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:08.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.237+0000 7feca70ea700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca00afbe0 con 0x7feca0159340 2023-10-06T02:55:08.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.237+0000 7feca70ea700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca00cf820 con 0x7feca0159710 2023-10-06T02:55:08.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.237+0000 7feca70ea700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca00cfb00 con 0x7feca00cbc40 2023-10-06T02:55:08.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.237+0000 7feca5687700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feca00cbc40 0x7feca0164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:08.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.237+0000 7feca4e86700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feca0159340 0x7feca00af4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38486/0 (socket says 172.21.15.84:38486) 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.237+0000 7feca4e86700 1 -- 172.21.15.84:0/2008239502 learned_addr learned my addr 172.21.15.84:0/2008239502 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca5687700 1 -- 172.21.15.84:0/2008239502 >> v1:172.21.15.131:6789/0 conn(0x7feca0159710 legacy=0x7feca00cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca5687700 1 -- 172.21.15.84:0/2008239502 >> v1:172.21.15.84:6789/0 conn(0x7feca0159340 legacy=0x7feca00af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca5687700 1 -- 172.21.15.84:0/2008239502 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00cfde0 con 0x7feca00cbc40 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7fec977fe700 1 -- 172.21.15.84:0/2008239502 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886638653 0 0) 0x7fec9c001610 con 0x7feca0159340 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca5687700 1 --2- 172.21.15.84:0/2008239502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca00cbc40 0x7feca0164180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec98009910 tx=0x7fec980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfb296fa6d012d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7fec977fe700 1 -- 172.21.15.84:0/2008239502 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800b7e0 con 0x7feca00cbc40 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7fec977fe700 1 -- 172.21.15.84:0/2008239502 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800b940 con 0x7feca00cbc40 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7fec977fe700 1 -- 172.21.15.84:0/2008239502 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800bce0 con 0x7feca00cbc40 2023-10-06T02:55:08.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca70ea700 1 -- 172.21.15.84:0/2008239502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca00cbc40 msgr2=0x7feca0164180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:08.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca70ea700 1 --2- 172.21.15.84:0/2008239502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca00cbc40 0x7feca0164180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec98009910 tx=0x7fec980091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:08.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca70ea700 1 -- 172.21.15.84:0/2008239502 shutdown_connections 2023-10-06T02:55:08.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca70ea700 1 --2- 172.21.15.84:0/2008239502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca00cbc40 0x7feca0164180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:08.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca70ea700 1 -- 172.21.15.84:0/2008239502 >> 172.21.15.84:0/2008239502 conn(0x7feca0099720 msgr2=0x7feca006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:08.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.238+0000 7feca70ea700 1 -- 172.21.15.84:0/2008239502 shutdown_connections 2023-10-06T02:55:08.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.239+0000 7feca70ea700 1 -- 172.21.15.84:0/2008239502 wait complete. 2023-10-06T02:55:08.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.240+0000 7feca70ea700 1 Processor -- start 2023-10-06T02:55:08.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.240+0000 7feca70ea700 1 -- start start 2023-10-06T02:55:08.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.240+0000 7feca70ea700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca00cbc40 0x7feca015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:08.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.240+0000 7feca70ea700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feca0159340 0x7feca00c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:08.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.240+0000 7feca70ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca0159710 0x7feca016cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:08.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.240+0000 7feca70ea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca013e7c0 con 0x7feca0159710 2023-10-06T02:55:08.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.240+0000 7feca70ea700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca015ca80 con 0x7feca0159340 2023-10-06T02:55:08.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.240+0000 7feca70ea700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca0151f00 con 0x7feca00cbc40 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca5687700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca0159710 0x7feca016cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca5687700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca0159710 0x7feca016cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55438/0 (socket says 172.21.15.84:55438) 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca5687700 1 -- 172.21.15.84:0/949815765 learned_addr learned my addr 172.21.15.84:0/949815765 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7fec97fff700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feca0159340 0x7feca00c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca4e86700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca00cbc40 0x7feca015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca5687700 1 -- 172.21.15.84:0/949815765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca00cbc40 msgr2=0x7feca015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca5687700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca00cbc40 0x7feca015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca5687700 1 -- 172.21.15.84:0/949815765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feca0159340 msgr2=0x7feca00c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca5687700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feca0159340 0x7feca00c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca5687700 1 -- 172.21.15.84:0/949815765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98009420 con 0x7feca0159710 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca5687700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca0159710 0x7feca016cf90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec980093f0 tx=0x7fec98016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7fec94ff9700 1 -- 172.21.15.84:0/949815765 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800bed0 con 0x7feca0159710 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7fec94ff9700 1 -- 172.21.15.84:0/949815765 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec98020070 con 0x7feca0159710 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca0154850 con 0x7feca0159710 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7fec94ff9700 1 -- 172.21.15.84:0/949815765 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9801b6a0 con 0x7feca0159710 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.241+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca015d850 con 0x7feca0159710 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.242+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca0064ad0 con 0x7feca0159710 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.242+0000 7fec94ff9700 1 -- 172.21.15.84:0/949815765 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec98022030 con 0x7feca0159710 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.243+0000 7fec94ff9700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec8c066f30 0x7fec8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.243+0000 7fec94ff9700 1 -- 172.21.15.84:0/949815765 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6284+0+0 (secure 0 0 0) 0x7fec98086600 con 0x7feca0159710 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.243+0000 7feca4e86700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec8c066f30 0x7fec8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.243+0000 7feca4e86700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec8c066f30 0x7fec8c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feca0141b00 tx=0x7fec9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:08.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.247+0000 7fec94ff9700 1 -- 172.21.15.84:0/949815765 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec98053630 con 0x7feca0159710 2023-10-06T02:55:08.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:08.428+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feca0064ad0 con 0x7feca0159710 2023-10-06T02:55:10.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.233+0000 7fec94ff9700 1 -- 172.21.15.84:0/949815765 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7fec98056c50 con 0x7feca0159710 2023-10-06T02:55:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.238+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec8c066f30 msgr2=0x7fec8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.238+0000 7feca70ea700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec8c066f30 0x7fec8c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feca0141b00 tx=0x7fec9c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.238+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca0159710 msgr2=0x7feca016cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.238+0000 7feca70ea700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca0159710 0x7feca016cf90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec980093f0 tx=0x7fec98016000 comp rx=0 tx=0).stop 2023-10-06T02:55:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.239+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 shutdown_connections 2023-10-06T02:55:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.239+0000 7feca70ea700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec8c066f30 0x7fec8c0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.239+0000 7feca70ea700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feca0159710 0x7feca016cf90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.239+0000 7feca70ea700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feca00cbc40 0x7feca015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.239+0000 7feca70ea700 1 --2- 172.21.15.84:0/949815765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feca0159340 0x7feca00c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.240+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 >> 172.21.15.84:0/949815765 conn(0x7feca0099720 msgr2=0x7feca00c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.242+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 shutdown_connections 2023-10-06T02:55:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.243+0000 7feca70ea700 1 -- 172.21.15.84:0/949815765 wait complete. 2023-10-06T02:55:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' created 2023-10-06T02:55:10.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T02:55:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.383+0000 7fa60e10b700 1 Processor -- start 2023-10-06T02:55:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.383+0000 7fa60e10b700 1 -- start start 2023-10-06T02:55:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa60e10b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa60815a780 0x7fa6080aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa60e10b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6080b2d20 con 0x7fa6080b23a0 2023-10-06T02:55:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa60e10b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6080b0450 con 0x7fa60806ed20 2023-10-06T02:55:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa60e10b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60806fb80 con 0x7fa60815a780 2023-10-06T02:55:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa606ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa6080b23a0 0x7fa6080b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38492/0 (socket says 172.21.15.84:38492) 2023-10-06T02:55:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa606ffd700 1 -- 172.21.15.84:0/2751231809 learned_addr learned my addr 172.21.15.84:0/2751231809 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529570649 0 0) 0x7fa6080b2d20 con 0x7fa6080b23a0 2023-10-06T02:55:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa607fff700 1 --2- 172.21.15.84:0/2751231809 >> v2:172.21.15.131:3300/0 conn(0x7fa60815a780 0x7fa6080aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f0003570 con 0x7fa6080b23a0 2023-10-06T02:55:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3622419996 0 0) 0x7fa5f0003570 con 0x7fa6080b23a0 2023-10-06T02:55:10.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 >> v2:172.21.15.131:3300/0 conn(0x7fa60815a780 msgr2=0x7fa6080aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:10.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa6067fc700 1 --2- 172.21.15.84:0/2751231809 >> v2:172.21.15.131:3300/0 conn(0x7fa60815a780 0x7fa6080aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.384+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 >> v1:172.21.15.131:6789/0 conn(0x7fa60806ed20 legacy=0x7fa60806f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:10.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6080b2a40 con 0x7fa6080b23a0 2023-10-06T02:55:10.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fa5fc001470 con 0x7fa6080b23a0 2023-10-06T02:55:10.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa607fff700 1 --2- 172.21.15.84:0/2751231809 >> v2:172.21.15.131:3300/0 conn(0x7fa60815a780 0x7fa6080aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 >> v1:172.21.15.84:6789/0 conn(0x7fa6080b23a0 legacy=0x7fa6080b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5f0003a60 0x7fa5f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5f0004810 0x7fa5f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa5f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f000c160 con 0x7fa5f00052e0 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f000c2d0 con 0x7fa5f0004810 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f000c490 con 0x7fa5f0003a60 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa607fff700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa5f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa606ffd700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5f0004810 0x7fa5f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6077fe700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5f0003a60 0x7fa5f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:10.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa607fff700 1 -- 172.21.15.84:0/2751231809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5f0003a60 msgr2=0x7fa5f0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa607fff700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5f0003a60 0x7fa5f0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa607fff700 1 -- 172.21.15.84:0/2751231809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5f0004810 msgr2=0x7fa5f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa607fff700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5f0004810 0x7fa5f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa607fff700 1 -- 172.21.15.84:0/2751231809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0003570 con 0x7fa5f00052e0 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa607fff700 1 -- 172.21.15.84:0/2751231809 reap_dead start 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa607fff700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa5f000ba60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa600007580 tx=0x7fa6000097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0adde9c4b2fd548 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600009ae0 con 0x7fa5f00052e0 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600007dd0 con 0x7fa5f00052e0 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.385+0000 7fa6067fc700 1 -- 172.21.15.84:0/2751231809 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600014650 con 0x7fa5f00052e0 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.386+0000 7fa60e10b700 1 -- 172.21.15.84:0/2751231809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 msgr2=0x7fa5f000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.386+0000 7fa60e10b700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa5f000ba60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa600007580 tx=0x7fa6000097d0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.386+0000 7fa60e10b700 1 -- 172.21.15.84:0/2751231809 shutdown_connections 2023-10-06T02:55:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.386+0000 7fa60e10b700 1 --2- 172.21.15.84:0/2751231809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa5f000ba60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.386+0000 7fa60e10b700 1 -- 172.21.15.84:0/2751231809 >> 172.21.15.84:0/2751231809 conn(0x7fa608068330 msgr2=0x7fa608068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.386+0000 7fa60e10b700 1 -- 172.21.15.84:0/2751231809 shutdown_connections 2023-10-06T02:55:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.386+0000 7fa60e10b700 1 -- 172.21.15.84:0/2751231809 wait complete. 2023-10-06T02:55:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.387+0000 7fa60e10b700 1 Processor -- start 2023-10-06T02:55:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.387+0000 7fa60e10b700 1 -- start start 2023-10-06T02:55:10.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa60e10b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa6080c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa60e10b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa608156150 0x7fa6080d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa60e10b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080a8720 0x7fa6080a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa60e10b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080a80f0 con 0x7fa5f00052e0 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa60e10b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080d14b0 con 0x7fa6080a8720 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa60e10b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080a90d0 con 0x7fa608156150 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa6077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa6080c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa6077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa6080c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55446/0 (socket says 172.21.15.84:55446) 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa6077fe700 1 -- 172.21.15.84:0/2064716349 learned_addr learned my addr 172.21.15.84:0/2064716349 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa606ffd700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa608156150 0x7fa6080d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa6077fe700 1 -- 172.21.15.84:0/2064716349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa608156150 msgr2=0x7fa6080d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa6077fe700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa608156150 0x7fa6080d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa6077fe700 1 -- 172.21.15.84:0/2064716349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080a8720 msgr2=0x7fa6080a8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa607fff700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080a8720 0x7fa6080a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa6077fe700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080a8720 0x7fa6080a8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa6077fe700 1 -- 172.21.15.84:0/2064716349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6080ce210 con 0x7fa5f00052e0 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa6077fe700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa6080c6e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80029b0 tx=0x7fa5f8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa5ef7fe700 1 -- 172.21.15.84:0/2064716349 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800f870 con 0x7fa5f00052e0 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa5ef7fe700 1 -- 172.21.15.84:0/2064716349 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f800f9d0 con 0x7fa5f00052e0 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa5ef7fe700 1 -- 172.21.15.84:0/2064716349 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800fd70 con 0x7fa5f00052e0 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.388+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6081565c0 con 0x7fa5f00052e0 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.389+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6080a7b30 con 0x7fa5f00052e0 2023-10-06T02:55:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.389+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa608064ad0 con 0x7fa5f00052e0 2023-10-06T02:55:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.390+0000 7fa5ef7fe700 1 -- 172.21.15.84:0/2064716349 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5f8013600 con 0x7fa5f00052e0 2023-10-06T02:55:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.390+0000 7fa5ef7fe700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.390+0000 7fa5ef7fe700 1 -- 172.21.15.84:0/2064716349 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa5f8084db0 con 0x7fa5f00052e0 2023-10-06T02:55:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.390+0000 7fa606ffd700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.391+0000 7fa606ffd700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0015a0 tx=0x7fa5fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.394+0000 7fa5ef7fe700 1 -- 172.21.15.84:0/2064716349 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5f8051bf0 con 0x7fa5f00052e0 2023-10-06T02:55:10.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:10.576+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa6080cdfe0 con 0x7fa5f00052e0 2023-10-06T02:55:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.235+0000 7fa5ef7fe700 1 -- 172.21.15.84:0/2064716349 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa5f8055210 con 0x7fa5f00052e0 2023-10-06T02:55:11.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.239+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5f4066f30 msgr2=0x7fa5f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:11.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.239+0000 7fa60e10b700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0015a0 tx=0x7fa5fc009040 comp rx=0 tx=0).stop 2023-10-06T02:55:11.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.239+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 msgr2=0x7fa6080c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:11.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.239+0000 7fa60e10b700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa6080c6e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80029b0 tx=0x7fa5f8007d30 comp rx=0 tx=0).stop 2023-10-06T02:55:11.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.250+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 shutdown_connections 2023-10-06T02:55:11.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.250+0000 7fa60e10b700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:11.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.250+0000 7fa60e10b700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080a8720 0x7fa6080a8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:11.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.250+0000 7fa60e10b700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5f00052e0 0x7fa6080c6e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:11.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.250+0000 7fa60e10b700 1 --2- 172.21.15.84:0/2064716349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa608156150 0x7fa6080d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:11.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.250+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 >> 172.21.15.84:0/2064716349 conn(0x7fa608068330 msgr2=0x7fa6081580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.251+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 shutdown_connections 2023-10-06T02:55:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.252+0000 7fa60e10b700 1 -- 172.21.15.84:0/2064716349 wait complete. 2023-10-06T02:55:11.261 INFO:teuthology.orchestra.run.smithi084.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T02:55:11.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T02:55:11.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.387+0000 7faf8f185700 1 Processor -- start 2023-10-06T02:55:11.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.387+0000 7faf8f185700 1 -- start start 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8f185700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf880b2660 0x7faf880cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8f185700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880cf1f0 0x7faf880cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8f185700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf880cc9b0 con 0x7faf880b2a30 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8f185700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880cbda0 con 0x7faf880b2660 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8f185700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf880cc080 con 0x7faf880cf1f0 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8e183700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf880b2660 0x7faf880cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8d982700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faf880b2a30 0x7faf880ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38508/0 (socket says 172.21.15.84:38508) 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8d982700 1 -- 172.21.15.84:0/3656750062 learned_addr learned my addr 172.21.15.84:0/3656750062 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8e984700 1 --2- 172.21.15.84:0/3656750062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880cf1f0 0x7faf880cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8d181700 1 -- 172.21.15.84:0/3656750062 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167582047 0 0) 0x7faf880cc9b0 con 0x7faf880b2a30 2023-10-06T02:55:11.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8d181700 1 -- 172.21.15.84:0/3656750062 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf74003570 con 0x7faf880b2a30 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8e183700 1 -- 172.21.15.84:0/3656750062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880cf1f0 msgr2=0x7faf880cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8e183700 1 --2- 172.21.15.84:0/3656750062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880cf1f0 0x7faf880cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8e183700 1 -- 172.21.15.84:0/3656750062 >> v1:172.21.15.84:6789/0 conn(0x7faf880b2a30 legacy=0x7faf880ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.388+0000 7faf8e183700 1 -- 172.21.15.84:0/3656750062 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880cc360 con 0x7faf880b2660 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8e183700 1 --2- 172.21.15.84:0/3656750062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880b2660 0x7faf880cccf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf840098d0 tx=0x7faf84009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e508631380c454 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8d181700 1 -- 172.21.15.84:0/3656750062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84005c10 con 0x7faf880b2660 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8d181700 1 -- 172.21.15.84:0/3656750062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf84005d70 con 0x7faf880b2660 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8d181700 1 -- 172.21.15.84:0/3656750062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84006260 con 0x7faf880b2660 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8f185700 1 -- 172.21.15.84:0/3656750062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880b2660 msgr2=0x7faf880cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8f185700 1 --2- 172.21.15.84:0/3656750062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880b2660 0x7faf880cccf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faf840098d0 tx=0x7faf84009120 comp rx=0 tx=0).stop 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8f185700 1 -- 172.21.15.84:0/3656750062 shutdown_connections 2023-10-06T02:55:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8f185700 1 --2- 172.21.15.84:0/3656750062 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880cf1f0 0x7faf880cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8f185700 1 --2- 172.21.15.84:0/3656750062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880b2660 0x7faf880cccf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8f185700 1 -- 172.21.15.84:0/3656750062 >> 172.21.15.84:0/3656750062 conn(0x7faf88099560 msgr2=0x7faf8806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8f185700 1 -- 172.21.15.84:0/3656750062 shutdown_connections 2023-10-06T02:55:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.389+0000 7faf8f185700 1 -- 172.21.15.84:0/3656750062 wait complete. 2023-10-06T02:55:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.390+0000 7faf8f185700 1 Processor -- start 2023-10-06T02:55:11.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.390+0000 7faf8f185700 1 -- start start 2023-10-06T02:55:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8f185700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf880b2660 0x7faf8816a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:11.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8f185700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880b2a30 0x7faf880b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8f185700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880cf1f0 0x7faf880b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8f185700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880c84b0 con 0x7faf880cf1f0 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8f185700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880b3b30 con 0x7faf880b2660 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8f185700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf880b3200 con 0x7faf880b2a30 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8e984700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880cf1f0 0x7faf880b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8e984700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880cf1f0 0x7faf880b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55474/0 (socket says 172.21.15.84:55474) 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8e984700 1 -- 172.21.15.84:0/1587796054 learned_addr learned my addr 172.21.15.84:0/1587796054 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8d982700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880b2a30 0x7faf880b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8e183700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf880b2660 0x7faf8816a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8e984700 1 -- 172.21.15.84:0/1587796054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880b2a30 msgr2=0x7faf880b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8e984700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880b2a30 0x7faf880b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8e984700 1 -- 172.21.15.84:0/1587796054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf880b2660 msgr2=0x7faf8816a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.391+0000 7faf8e984700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf880b2660 0x7faf8816a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.392+0000 7faf8e984700 1 -- 172.21.15.84:0/1587796054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840093c0 con 0x7faf880cf1f0 2023-10-06T02:55:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.392+0000 7faf8e183700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf880b2660 0x7faf8816a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.392+0000 7faf8e984700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880cf1f0 0x7faf880b5ba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf80009ec0 tx=0x7faf8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.392+0000 7faf7e7fc700 1 -- 172.21.15.84:0/1587796054 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8000cc20 con 0x7faf880cf1f0 2023-10-06T02:55:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.392+0000 7faf7e7fc700 1 -- 172.21.15.84:0/1587796054 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8000f040 con 0x7faf880cf1f0 2023-10-06T02:55:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.392+0000 7faf7e7fc700 1 -- 172.21.15.84:0/1587796054 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80014480 con 0x7faf880cf1f0 2023-10-06T02:55:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.392+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf880b34e0 con 0x7faf880cf1f0 2023-10-06T02:55:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.392+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8816ab60 con 0x7faf880cf1f0 2023-10-06T02:55:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.393+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf880b3cc0 con 0x7faf880cf1f0 2023-10-06T02:55:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.393+0000 7faf7e7fc700 1 -- 172.21.15.84:0/1587796054 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf80014830 con 0x7faf880cf1f0 2023-10-06T02:55:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.394+0000 7faf7e7fc700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf6c066f30 0x7faf6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.394+0000 7faf8e183700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf6c066f30 0x7faf6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.394+0000 7faf7e7fc700 1 -- 172.21.15.84:0/1587796054 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6777+0+0 (secure 0 0 0) 0x7faf80085640 con 0x7faf880cf1f0 2023-10-06T02:55:11.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.394+0000 7faf8e183700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf6c066f30 0x7faf6c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf84009160 tx=0x7faf84016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:11.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.398+0000 7faf7e7fc700 1 -- 172.21.15.84:0/1587796054 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf80055f10 con 0x7faf880cf1f0 2023-10-06T02:55:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:11.622+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7faf8805f270 con 0x7faf880cf1f0 2023-10-06T02:55:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.270+0000 7faf7e7fc700 1 -- 172.21.15.84:0/1587796054 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7faf80055aa0 con 0x7faf880cf1f0 2023-10-06T02:55:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf6c066f30 msgr2=0x7faf6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf6c066f30 0x7faf6c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf84009160 tx=0x7faf84016000 comp rx=0 tx=0).stop 2023-10-06T02:55:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880cf1f0 msgr2=0x7faf880b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880cf1f0 0x7faf880b5ba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faf80009ec0 tx=0x7faf8000b040 comp rx=0 tx=0).stop 2023-10-06T02:55:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 shutdown_connections 2023-10-06T02:55:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf6c066f30 0x7faf6c0693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf880b2660 0x7faf8816a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf880cf1f0 0x7faf880b5ba0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 --2- 172.21.15.84:0/1587796054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf880b2a30 0x7faf880b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 >> 172.21.15.84:0/1587796054 conn(0x7faf88099560 msgr2=0x7faf880687a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 shutdown_connections 2023-10-06T02:55:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.273+0000 7faf8f185700 1 -- 172.21.15.84:0/1587796054 wait complete. 2023-10-06T02:55:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:added data pool 5 to fsmap 2023-10-06T02:55:12.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:12.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.400+0000 7f58573cb700 1 Processor -- start 2023-10-06T02:55:12.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.400+0000 7f58573cb700 1 -- start start 2023-10-06T02:55:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.401+0000 7f58573cb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5850159480 0x7f58500b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.401+0000 7f58573cb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58500b2140 0x7f58500b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.401+0000 7f58573cb700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58500cb7e0 con 0x7f58500b3610 2023-10-06T02:55:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.401+0000 7f58573cb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500b08a0 con 0x7f58500b2140 2023-10-06T02:55:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.401+0000 7f58573cb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500cb190 con 0x7f5850159480 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.401+0000 7f5856bca700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58500b2140 0x7f58500b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.401+0000 7f5856bca700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58500b2140 0x7f58500b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50780/0 (socket says 172.21.15.84:50780) 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.401+0000 7f5856bca700 1 -- 172.21.15.84:0/3739738521 learned_addr learned my addr 172.21.15.84:0/3739738521 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.401+0000 7f58563c9700 1 --2- 172.21.15.84:0/3739738521 >> v2:172.21.15.131:3300/0 conn(0x7f5850159480 0x7f58500b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f5856bca700 1 -- 172.21.15.84:0/3739738521 >> v2:172.21.15.131:3300/0 conn(0x7f5850159480 msgr2=0x7f58500b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f5856bca700 1 --2- 172.21.15.84:0/3739738521 >> v2:172.21.15.131:3300/0 conn(0x7f5850159480 0x7f58500b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f5856bca700 1 -- 172.21.15.84:0/3739738521 >> v1:172.21.15.131:6789/0 conn(0x7f58500b3610 legacy=0x7f58500cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f5856bca700 1 -- 172.21.15.84:0/3739738521 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500cb470 con 0x7f58500b2140 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58563c9700 1 --2- 172.21.15.84:0/3739738521 >> v2:172.21.15.131:3300/0 conn(0x7f5850159480 0x7f58500b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f5856bca700 1 --2- 172.21.15.84:0/3739738521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 0x7f58500b2560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f585006fa30 tx=0x7f5848009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f06d7e278ae285 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58553c7700 1 -- 172.21.15.84:0/3739738521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584800e070 con 0x7f58500b2140 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58553c7700 1 -- 172.21.15.84:0/3739738521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584800ba50 con 0x7f58500b2140 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58553c7700 1 -- 172.21.15.84:0/3739738521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480092e0 con 0x7f58500b2140 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58573cb700 1 -- 172.21.15.84:0/3739738521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 msgr2=0x7f58500b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58573cb700 1 --2- 172.21.15.84:0/3739738521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 0x7f58500b2560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f585006fa30 tx=0x7f5848009840 comp rx=0 tx=0).stop 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58573cb700 1 -- 172.21.15.84:0/3739738521 shutdown_connections 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58573cb700 1 --2- 172.21.15.84:0/3739738521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 0x7f58500b2560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58573cb700 1 --2- 172.21.15.84:0/3739738521 >> v2:172.21.15.131:3300/0 conn(0x7f5850159480 0x7f58500b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.402+0000 7f58573cb700 1 -- 172.21.15.84:0/3739738521 >> 172.21.15.84:0/3739738521 conn(0x7f585006ed20 msgr2=0x7f585006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.403+0000 7f58573cb700 1 -- 172.21.15.84:0/3739738521 shutdown_connections 2023-10-06T02:55:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.403+0000 7f58573cb700 1 -- 172.21.15.84:0/3739738521 wait complete. 2023-10-06T02:55:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58573cb700 1 Processor -- start 2023-10-06T02:55:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58573cb700 1 -- start start 2023-10-06T02:55:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58573cb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 0x7f5850155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58573cb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58500b3610 0x7f585015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58573cb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5850159480 0x7f585016c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58573cb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5850166b70 con 0x7f58500b2140 2023-10-06T02:55:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58573cb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585015bf20 con 0x7f58500b3610 2023-10-06T02:55:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58573cb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585015c200 con 0x7f5850159480 2023-10-06T02:55:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58563c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 0x7f5850155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58563c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 0x7f5850155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50784/0 (socket says 172.21.15.84:50784) 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f58563c9700 1 -- 172.21.15.84:0/1233023680 learned_addr learned my addr 172.21.15.84:0/1233023680 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.404+0000 7f5856bca700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5850159480 0x7f585016c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f5855bc8700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58500b3610 0x7f585015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58563c9700 1 -- 172.21.15.84:0/1233023680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5850159480 msgr2=0x7f585016c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58563c9700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5850159480 0x7f585016c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58563c9700 1 -- 172.21.15.84:0/1233023680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58500b3610 msgr2=0x7f585015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58563c9700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58500b3610 0x7f585015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58563c9700 1 -- 172.21.15.84:0/1233023680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848009ae0 con 0x7f58500b2140 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f5856bca700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5850159480 0x7f585016c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:12.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58563c9700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 0x7f5850155420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f584c00d860 tx=0x7f584c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58467fc700 1 -- 172.21.15.84:0/1233023680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c0125f0 con 0x7f58500b2140 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58467fc700 1 -- 172.21.15.84:0/1233023680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c012750 con 0x7f58500b2140 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5850166dc0 con 0x7f58500b2140 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58467fc700 1 -- 172.21.15.84:0/1233023680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c012ad0 con 0x7f58500b2140 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.405+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5850155960 con 0x7f58500b2140 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.406+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585005f270 con 0x7f58500b2140 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.406+0000 7f58467fc700 1 -- 172.21.15.84:0/1233023680 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f584c014430 con 0x7f58500b2140 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.407+0000 7f58467fc700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5834066f30 0x7f58340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.407+0000 7f5855bc8700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5834066f30 0x7f58340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.407+0000 7f58467fc700 1 -- 172.21.15.84:0/1233023680 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f584c084d70 con 0x7f58500b2140 2023-10-06T02:55:12.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.407+0000 7f5855bc8700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5834066f30 0x7f58340693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5850158880 tx=0x7f5840009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:12.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.411+0000 7f58467fc700 1 -- 172.21.15.84:0/1233023680 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f584c051b90 con 0x7f58500b2140 2023-10-06T02:55:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.640+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5850159850 con 0x7f58500b2140 2023-10-06T02:55:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.640+0000 7f58467fc700 1 -- 172.21.15.84:0/1233023680 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4596 (secure 0 0 0) 0x7f584c0551b0 con 0x7f58500b2140 2023-10-06T02:55:12.641 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:12.641 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:12.263022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T02:55:12.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5834066f30 msgr2=0x7f58340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5834066f30 0x7f58340693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5850158880 tx=0x7f5840009040 comp rx=0 tx=0).stop 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 msgr2=0x7f5850155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 0x7f5850155420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f584c00d860 tx=0x7f584c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 shutdown_connections 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5834066f30 0x7f58340693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5850159480 0x7f585016c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58500b2140 0x7f5850155420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 --2- 172.21.15.84:0/1233023680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58500b3610 0x7f585015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 >> 172.21.15.84:0/1233023680 conn(0x7f585006ed20 msgr2=0x7f58500b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 shutdown_connections 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.642+0000 7f58573cb700 1 -- 172.21.15.84:0/1233023680 wait complete. 2023-10-06T02:55:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-10-06T02:55:12.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.767+0000 7f3e2396e700 1 Processor -- start 2023-10-06T02:55:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.768+0000 7f3e2396e700 1 -- start start 2023-10-06T02:55:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.768+0000 7f3e2396e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e1c068600 0x7f3e1c068a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.768+0000 7f3e2396e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c068fb0 con 0x7f3e1c0aa460 2023-10-06T02:55:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.768+0000 7f3e2396e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c0a9fd0 con 0x7f3e1c159690 2023-10-06T02:55:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.768+0000 7f3e2396e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1c0abfe0 con 0x7f3e1c068600 2023-10-06T02:55:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e20f09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e1c068600 0x7f3e1c068a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e21f0b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3e1c0aa460 0x7f3e1c0aa8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36566/0 (socket says 172.21.15.84:36566) 2023-10-06T02:55:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e21f0b700 1 -- 172.21.15.84:0/580884041 learned_addr learned my addr 172.21.15.84:0/580884041 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e20f09700 1 -- 172.21.15.84:0/580884041 >> v1:172.21.15.131:6789/0 conn(0x7f3e1c159690 legacy=0x7f3e1c0ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e20f09700 1 -- 172.21.15.84:0/580884041 >> v1:172.21.15.84:6789/0 conn(0x7f3e1c0aa460 legacy=0x7f3e1c0aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e13fff700 1 -- 172.21.15.84:0/580884041 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031665520 0 0) 0x7f3e1c068fb0 con 0x7f3e1c0aa460 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e20f09700 1 -- 172.21.15.84:0/580884041 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0abd00 con 0x7f3e1c068600 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e20f09700 1 --2- 172.21.15.84:0/580884041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c068600 0x7f3e1c068a70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0098e0 tx=0x7f3e0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654cfedfaeafbb42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e13fff700 1 -- 172.21.15.84:0/580884041 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c009e80 con 0x7f3e1c068600 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e13fff700 1 -- 172.21.15.84:0/580884041 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00b820 con 0x7f3e1c068600 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.769+0000 7f3e13fff700 1 -- 172.21.15.84:0/580884041 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00bba0 con 0x7f3e1c068600 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.770+0000 7f3e2396e700 1 -- 172.21.15.84:0/580884041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c068600 msgr2=0x7f3e1c068a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.770+0000 7f3e2396e700 1 --2- 172.21.15.84:0/580884041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c068600 0x7f3e1c068a70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0098e0 tx=0x7f3e0c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.770+0000 7f3e2396e700 1 -- 172.21.15.84:0/580884041 shutdown_connections 2023-10-06T02:55:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.770+0000 7f3e2396e700 1 --2- 172.21.15.84:0/580884041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c068600 0x7f3e1c068a70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.770+0000 7f3e2396e700 1 -- 172.21.15.84:0/580884041 >> 172.21.15.84:0/580884041 conn(0x7f3e1c06de80 msgr2=0x7f3e1c06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.770+0000 7f3e2396e700 1 -- 172.21.15.84:0/580884041 shutdown_connections 2023-10-06T02:55:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.770+0000 7f3e2396e700 1 -- 172.21.15.84:0/580884041 wait complete. 2023-10-06T02:55:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.771+0000 7f3e2396e700 1 Processor -- start 2023-10-06T02:55:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.771+0000 7f3e2396e700 1 -- start start 2023-10-06T02:55:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e2396e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e1c068600 0x7f3e1c151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e2396e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c0aa460 0x7f3e1c14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e2396e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e1c159690 0x7f3e1c14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e2396e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c1698f0 con 0x7f3e1c0aa460 2023-10-06T02:55:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e2396e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c14f850 con 0x7f3e1c068600 2023-10-06T02:55:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e2396e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c169bb0 con 0x7f3e1c159690 2023-10-06T02:55:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e20f09700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c0aa460 0x7f3e1c14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e20f09700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c0aa460 0x7f3e1c14ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50790/0 (socket says 172.21.15.84:50790) 2023-10-06T02:55:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e20f09700 1 -- 172.21.15.84:0/289671292 learned_addr learned my addr 172.21.15.84:0/289671292 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e21f0b700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e1c159690 0x7f3e1c14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e2170a700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e1c068600 0x7f3e1c151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e20f09700 1 -- 172.21.15.84:0/289671292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e1c159690 msgr2=0x7f3e1c14e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e20f09700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e1c159690 0x7f3e1c14e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e20f09700 1 -- 172.21.15.84:0/289671292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e1c068600 msgr2=0x7f3e1c151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e20f09700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e1c068600 0x7f3e1c151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e20f09700 1 -- 172.21.15.84:0/289671292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009420 con 0x7f3e1c0aa460 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e20f09700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c0aa460 0x7f3e1c14ff70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0030c0 tx=0x7f3e0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e117fa700 1 -- 172.21.15.84:0/289671292 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00b990 con 0x7f3e1c0aa460 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e117fa700 1 -- 172.21.15.84:0/289671292 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c020070 con 0x7f3e1c0aa460 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c169e90 con 0x7f3e1c0aa460 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.772+0000 7f3e117fa700 1 -- 172.21.15.84:0/289671292 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c01b450 con 0x7f3e1c0aa460 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.773+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c151a40 con 0x7f3e1c0aa460 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.773+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1c16a3b0 con 0x7f3e1c0aa460 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.774+0000 7f3e117fa700 1 -- 172.21.15.84:0/289671292 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e0c022030 con 0x7f3e1c0aa460 2023-10-06T02:55:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.774+0000 7f3e117fa700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e00066f30 0x7f3e000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.774+0000 7f3e117fa700 1 -- 172.21.15.84:0/289671292 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3e0c086790 con 0x7f3e1c0aa460 2023-10-06T02:55:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.774+0000 7f3e2170a700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e00066f30 0x7f3e000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.775+0000 7f3e2170a700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e00066f30 0x7f3e000693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800f430 tx=0x7f3e18002ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.778+0000 7f3e117fa700 1 -- 172.21.15.84:0/289671292 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e1c16a3b0 con 0x7f3e1c0aa460 2023-10-06T02:55:12.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.963+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e1c16a3b0 con 0x7f3e1c0aa460 2023-10-06T02:55:12.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.964+0000 7f3e117fa700 1 -- 172.21.15.84:0/289671292 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f3e1c16a3b0 con 0x7f3e1c0aa460 2023-10-06T02:55:12.964 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:12.965 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.965+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e00066f30 msgr2=0x7f3e000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.965+0000 7f3e2396e700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e00066f30 0x7f3e000693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800f430 tx=0x7f3e18002ad0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c0aa460 msgr2=0x7f3e1c14ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c0aa460 0x7f3e1c14ff70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0030c0 tx=0x7f3e0c016000 comp rx=0 tx=0).stop 2023-10-06T02:55:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 shutdown_connections 2023-10-06T02:55:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e00066f30 0x7f3e000693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e1c068600 0x7f3e1c151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e1c159690 0x7f3e1c14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 --2- 172.21.15.84:0/289671292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e1c0aa460 0x7f3e1c14ff70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:12.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 >> 172.21.15.84:0/289671292 conn(0x7f3e1c06de80 msgr2=0x7f3e1c069b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:12.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 shutdown_connections 2023-10-06T02:55:12.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:12.966+0000 7f3e2396e700 1 -- 172.21.15.84:0/289671292 wait complete. 2023-10-06T02:55:12.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:13.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.091+0000 7fbf1c09c700 1 Processor -- start 2023-10-06T02:55:13.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.091+0000 7fbf1c09c700 1 -- start start 2023-10-06T02:55:13.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1c09c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbf140b2620 0x7fbf140b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1c09c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b29f0 0x7fbf14159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1c09c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf141596a0 0x7fbf14068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1c09c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf140cbfe0 con 0x7fbf141596a0 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1c09c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf140cb3d0 con 0x7fbf140b2620 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1c09c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140cb6b0 con 0x7fbf140b29f0 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1a639700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf141596a0 0x7fbf14068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1a639700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf141596a0 0x7fbf14068580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50804/0 (socket says 172.21.15.84:50804) 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1a639700 1 -- 172.21.15.84:0/2131021549 learned_addr learned my addr 172.21.15.84:0/2131021549 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf19637700 1 --2- 172.21.15.84:0/2131021549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b29f0 0x7fbf14159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1a639700 1 -- 172.21.15.84:0/2131021549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b29f0 msgr2=0x7fbf14159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf19e38700 1 --2- 172.21.15.84:0/2131021549 >> v2:172.21.15.131:3300/0 conn(0x7fbf140b2620 0x7fbf140b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1a639700 1 --2- 172.21.15.84:0/2131021549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b29f0 0x7fbf14159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1a639700 1 -- 172.21.15.84:0/2131021549 >> v2:172.21.15.131:3300/0 conn(0x7fbf140b2620 msgr2=0x7fbf140b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.092+0000 7fbf1a639700 1 --2- 172.21.15.84:0/2131021549 >> v2:172.21.15.131:3300/0 conn(0x7fbf140b2620 0x7fbf140b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1a639700 1 -- 172.21.15.84:0/2131021549 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf140cb990 con 0x7fbf141596a0 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1a639700 1 --2- 172.21.15.84:0/2131021549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf141596a0 0x7fbf14068580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf140d0460 tx=0x7fbf0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0557b7f56eb057c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf18e36700 1 -- 172.21.15.84:0/2131021549 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00e070 con 0x7fbf141596a0 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf18e36700 1 -- 172.21.15.84:0/2131021549 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c00ba50 con 0x7fbf141596a0 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf18e36700 1 -- 172.21.15.84:0/2131021549 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0092e0 con 0x7fbf141596a0 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1c09c700 1 -- 172.21.15.84:0/2131021549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf141596a0 msgr2=0x7fbf14068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/2131021549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf141596a0 0x7fbf14068580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf140d0460 tx=0x7fbf0c009840 comp rx=0 tx=0).stop 2023-10-06T02:55:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1c09c700 1 -- 172.21.15.84:0/2131021549 shutdown_connections 2023-10-06T02:55:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/2131021549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf141596a0 0x7fbf14068580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/2131021549 >> v2:172.21.15.131:3300/0 conn(0x7fbf140b2620 0x7fbf140b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/2131021549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b29f0 0x7fbf14159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1c09c700 1 -- 172.21.15.84:0/2131021549 >> 172.21.15.84:0/2131021549 conn(0x7fbf1406ed20 msgr2=0x7fbf1406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1c09c700 1 -- 172.21.15.84:0/2131021549 shutdown_connections 2023-10-06T02:55:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.093+0000 7fbf1c09c700 1 -- 172.21.15.84:0/2131021549 wait complete. 2023-10-06T02:55:13.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.094+0000 7fbf1c09c700 1 Processor -- start 2023-10-06T02:55:13.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.094+0000 7fbf1c09c700 1 -- start start 2023-10-06T02:55:13.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf1c09c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b2620 0x7fbf1415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf1c09c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf140b29f0 0x7fbf140c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf1c09c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf141596a0 0x7fbf140cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf1c09c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140c9020 con 0x7fbf140b29f0 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf1c09c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140c7f40 con 0x7fbf141596a0 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf1c09c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140c8220 con 0x7fbf140b2620 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf19637700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf140b29f0 0x7fbf140c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf19637700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf140b29f0 0x7fbf140c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50816/0 (socket says 172.21.15.84:50816) 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf19637700 1 -- 172.21.15.84:0/3394421253 learned_addr learned my addr 172.21.15.84:0/3394421253 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf1a639700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf141596a0 0x7fbf140cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.095+0000 7fbf19e38700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b2620 0x7fbf1415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf19637700 1 -- 172.21.15.84:0/3394421253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b2620 msgr2=0x7fbf1415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf19637700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b2620 0x7fbf1415e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf19637700 1 -- 172.21.15.84:0/3394421253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf141596a0 msgr2=0x7fbf140cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf19637700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf141596a0 0x7fbf140cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf19637700 1 -- 172.21.15.84:0/3394421253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c009ae0 con 0x7fbf140b29f0 2023-10-06T02:55:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf19637700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf140b29f0 0x7fbf140c7510 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c7d0 tx=0x7fbf04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf09ffb700 1 -- 172.21.15.84:0/3394421253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04011600 con 0x7fbf140b29f0 2023-10-06T02:55:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf09ffb700 1 -- 172.21.15.84:0/3394421253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04011760 con 0x7fbf140b29f0 2023-10-06T02:55:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf09ffb700 1 -- 172.21.15.84:0/3394421253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04011b20 con 0x7fbf140b29f0 2023-10-06T02:55:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf140c8500 con 0x7fbf140b29f0 2023-10-06T02:55:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.096+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf14153ab0 con 0x7fbf140b29f0 2023-10-06T02:55:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.097+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf140c91d0 con 0x7fbf140b29f0 2023-10-06T02:55:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.097+0000 7fbf09ffb700 1 -- 172.21.15.84:0/3394421253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf040193f0 con 0x7fbf140b29f0 2023-10-06T02:55:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.098+0000 7fbf09ffb700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbef8066f30 0x7fbef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.098+0000 7fbf19e38700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbef8066f30 0x7fbef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.098+0000 7fbf09ffb700 1 -- 172.21.15.84:0/3394421253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbf04084c40 con 0x7fbf140b29f0 2023-10-06T02:55:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.098+0000 7fbf19e38700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbef8066f30 0x7fbef80693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf10006fd0 tx=0x7fbf10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.102+0000 7fbf09ffb700 1 -- 172.21.15.84:0/3394421253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf140c91d0 con 0x7fbf140b29f0 2023-10-06T02:55:13.219 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-10-06T02:55:13.218+0000 7fe740c35700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:55:13.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.284+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf14064ad0 con 0x7fbf140b29f0 2023-10-06T02:55:13.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.285+0000 7fbf09ffb700 1 -- 172.21.15.84:0/3394421253 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fbf040554f0 con 0x7fbf140b29f0 2023-10-06T02:55:13.286 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:13.287 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbef8066f30 msgr2=0x7fbef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbef8066f30 0x7fbef80693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf10006fd0 tx=0x7fbf10008040 comp rx=0 tx=0).stop 2023-10-06T02:55:13.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf140b29f0 msgr2=0x7fbf140c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf140b29f0 0x7fbf140c7510 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c7d0 tx=0x7fbf04008040 comp rx=0 tx=0).stop 2023-10-06T02:55:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 shutdown_connections 2023-10-06T02:55:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbef8066f30 0x7fbef80693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbf141596a0 0x7fbf140cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbf140b2620 0x7fbf1415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 --2- 172.21.15.84:0/3394421253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf140b29f0 0x7fbf140c7510 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 >> 172.21.15.84:0/3394421253 conn(0x7fbf1406ed20 msgr2=0x7fbf14157780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.287+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 shutdown_connections 2023-10-06T02:55:13.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.288+0000 7fbf1c09c700 1 -- 172.21.15.84:0/3394421253 wait complete. 2023-10-06T02:55:13.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:13.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.430+0000 7f11772a6700 1 Processor -- start 2023-10-06T02:55:13.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.431+0000 7f11772a6700 1 -- start start 2023-10-06T02:55:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.431+0000 7f11772a6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f117015db50 0x7f11700cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.431+0000 7f11772a6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700ced30 con 0x7f11700ad250 2023-10-06T02:55:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.431+0000 7f11772a6700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700cf010 con 0x7f11700ad620 2023-10-06T02:55:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.431+0000 7f11772a6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700ccad0 con 0x7f117015db50 2023-10-06T02:55:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.431+0000 7f1175042700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f11700ad250 0x7f117015d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36572/0 (socket says 172.21.15.84:36572) 2023-10-06T02:55:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.431+0000 7f1175042700 1 -- 172.21.15.84:0/3356896053 learned_addr learned my addr 172.21.15.84:0/3356896053 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1174841700 1 --2- 172.21.15.84:0/3356896053 >> v2:172.21.15.131:3300/0 conn(0x7f117015db50 0x7f11700cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038063212 0 0) 0x7f11700ced30 con 0x7f11700ad250 2023-10-06T02:55:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f115c003570 con 0x7f11700ad250 2023-10-06T02:55:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 741236863 0 0) 0x7f115c003570 con 0x7f11700ad250 2023-10-06T02:55:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 >> v2:172.21.15.131:3300/0 conn(0x7f117015db50 msgr2=0x7f11700cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 --2- 172.21.15.84:0/3356896053 >> v2:172.21.15.131:3300/0 conn(0x7f117015db50 0x7f11700cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 >> v1:172.21.15.131:6789/0 conn(0x7f11700ad620 legacy=0x7f11700ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700ccdb0 con 0x7f11700ad250 2023-10-06T02:55:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f116c001970 con 0x7f11700ad250 2023-10-06T02:55:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 >> v1:172.21.15.84:6789/0 conn(0x7f11700ad250 legacy=0x7f117015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f115c003a60 0x7f115c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c004810 0x7f115c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f115c0051c0 0x7f115c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700ccad0 con 0x7f115c003a60 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c00c0d0 con 0x7f115c0051c0 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c00c290 con 0x7f115c004810 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1175042700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f115c003a60 0x7f115c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1175843700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f115c0051c0 0x7f115c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1174841700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c004810 0x7f115c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1175042700 1 -- 172.21.15.84:0/3356896053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c004810 msgr2=0x7f115c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1175042700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c004810 0x7f115c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1175042700 1 -- 172.21.15.84:0/3356896053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f115c0051c0 msgr2=0x7f115c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1175042700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f115c0051c0 0x7f115c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1175042700 1 -- 172.21.15.84:0/3356896053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c003570 con 0x7f115c003a60 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.432+0000 7f1175843700 1 -- 172.21.15.84:0/3356896053 reap_dead start 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f1175042700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f115c003a60 0x7f115c003e70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f116c00c670 tx=0x7f116c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4482913a9f97cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c005b70 con 0x7f115c003a60 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c005cf0 con 0x7f115c003a60 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f1167fff700 1 -- 172.21.15.84:0/3356896053 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c007360 con 0x7f115c003a60 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f11772a6700 1 -- 172.21.15.84:0/3356896053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f115c003a60 msgr2=0x7f115c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f11772a6700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f115c003a60 0x7f115c003e70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f116c00c670 tx=0x7f116c007ca0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f11772a6700 1 -- 172.21.15.84:0/3356896053 shutdown_connections 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f11772a6700 1 --2- 172.21.15.84:0/3356896053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f115c003a60 0x7f115c003e70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f11772a6700 1 -- 172.21.15.84:0/3356896053 >> 172.21.15.84:0/3356896053 conn(0x7f1170067dd0 msgr2=0x7f11700ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f11772a6700 1 -- 172.21.15.84:0/3356896053 shutdown_connections 2023-10-06T02:55:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.433+0000 7f11772a6700 1 -- 172.21.15.84:0/3356896053 wait complete. 2023-10-06T02:55:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.434+0000 7f11772a6700 1 Processor -- start 2023-10-06T02:55:13.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.434+0000 7f11772a6700 1 -- start start 2023-10-06T02:55:13.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f11772a6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c003a60 0x7f11700b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f11772a6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117016b4f0 0x7f11700b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f11772a6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f117016d130 0x7f11700afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f11772a6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700af580 con 0x7f117016b4f0 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f11772a6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700aec90 con 0x7f117016d130 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f11772a6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b4040 con 0x7f115c003a60 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f1174841700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117016b4f0 0x7f11700b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f1174841700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117016b4f0 0x7f11700b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50832/0 (socket says 172.21.15.84:50832) 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f1174841700 1 -- 172.21.15.84:0/1411879796 learned_addr learned my addr 172.21.15.84:0/1411879796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f1175843700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f117016d130 0x7f11700afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.435+0000 7f1175042700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c003a60 0x7f11700b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f1174841700 1 -- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c003a60 msgr2=0x7f11700b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f1174841700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c003a60 0x7f11700b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f1174841700 1 -- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f117016d130 msgr2=0x7f11700afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f1174841700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f117016d130 0x7f11700afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f1174841700 1 -- 172.21.15.84:0/1411879796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700aef30 con 0x7f117016b4f0 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f1175042700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c003a60 0x7f11700b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f1175843700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f117016d130 0x7f11700afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f1174841700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117016b4f0 0x7f11700b37f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1160011b40 tx=0x7f11600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f11657fa700 1 -- 172.21.15.84:0/1411879796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000fa70 con 0x7f117016b4f0 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f11657fa700 1 -- 172.21.15.84:0/1411879796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000fbd0 con 0x7f117016b4f0 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11700af210 con 0x7f117016b4f0 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f11657fa700 1 -- 172.21.15.84:0/1411879796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116001d480 con 0x7f117016b4f0 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.436+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11700b3d30 con 0x7f117016b4f0 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.437+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170064ad0 con 0x7f117016b4f0 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.437+0000 7f11657fa700 1 -- 172.21.15.84:0/1411879796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f116001d870 con 0x7f117016b4f0 2023-10-06T02:55:13.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.438+0000 7f11657fa700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1154066f30 0x7f11540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.438+0000 7f11657fa700 1 -- 172.21.15.84:0/1411879796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1160018070 con 0x7f117016b4f0 2023-10-06T02:55:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.438+0000 7f1175042700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1154066f30 0x7f11540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.438+0000 7f1175042700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1154066f30 0x7f11540693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f116c00c670 tx=0x7f116c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:13.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.442+0000 7f11657fa700 1 -- 172.21.15.84:0/1411879796 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1160052500 con 0x7f117016b4f0 2023-10-06T02:55:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.665+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11700cc7a0 con 0x7f117016b4f0 2023-10-06T02:55:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.665+0000 7f11657fa700 1 -- 172.21.15.84:0/1411879796 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4596 (secure 0 0 0) 0x7f1160055b20 con 0x7f117016b4f0 2023-10-06T02:55:13.666 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:13.666 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:12.263022+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T02:55:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1154066f30 msgr2=0x7f11540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1154066f30 0x7f11540693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f116c00c670 tx=0x7f116c015000 comp rx=0 tx=0).stop 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117016b4f0 msgr2=0x7f11700b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117016b4f0 0x7f11700b37f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1160011b40 tx=0x7f11600091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 shutdown_connections 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1154066f30 0x7f11540693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f117016d130 0x7f11700afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115c003a60 0x7f11700b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 --2- 172.21.15.84:0/1411879796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f117016b4f0 0x7f11700b37f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.667+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 >> 172.21.15.84:0/1411879796 conn(0x7f1170067dd0 msgr2=0x7f117006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.668+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 shutdown_connections 2023-10-06T02:55:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.668+0000 7f11772a6700 1 -- 172.21.15.84:0/1411879796 wait complete. 2023-10-06T02:55:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-10-06T02:55:13.680 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:13.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.793+0000 7f51b40e0700 1 Processor -- start 2023-10-06T02:55:13.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.793+0000 7f51b40e0700 1 -- start start 2023-10-06T02:55:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b40e0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51ac0cb630 0x7f51ac0691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b40e0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f51ac15a220 0x7f51ac0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b40e0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac068d50 con 0x7f51ac069720 2023-10-06T02:55:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b40e0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac154060 con 0x7f51ac0cb630 2023-10-06T02:55:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b40e0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac15a6b0 con 0x7f51ac15a220 2023-10-06T02:55:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b1e7c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51ac0cb630 0x7f51ac0691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b167b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f51ac069720 0x7f51ac159b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36576/0 (socket says 172.21.15.84:36576) 2023-10-06T02:55:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b167b700 1 -- 172.21.15.84:0/3018469272 learned_addr learned my addr 172.21.15.84:0/3018469272 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b267d700 1 --2- 172.21.15.84:0/3018469272 >> v2:172.21.15.131:3300/0 conn(0x7f51ac15a220 0x7f51ac0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b1e7c700 1 -- 172.21.15.84:0/3018469272 >> v2:172.21.15.131:3300/0 conn(0x7f51ac15a220 msgr2=0x7f51ac0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b1e7c700 1 --2- 172.21.15.84:0/3018469272 >> v2:172.21.15.131:3300/0 conn(0x7f51ac15a220 0x7f51ac0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b1e7c700 1 -- 172.21.15.84:0/3018469272 >> v1:172.21.15.84:6789/0 conn(0x7f51ac069720 legacy=0x7f51ac159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b0e7a700 1 -- 172.21.15.84:0/3018469272 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066381771 0 0) 0x7f51ac068d50 con 0x7f51ac069720 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b1e7c700 1 -- 172.21.15.84:0/3018469272 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac15a990 con 0x7f51ac0cb630 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b1e7c700 1 --2- 172.21.15.84:0/3018469272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac0cb630 0x7f51ac0691e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51ac068cc0 tx=0x7f51a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de317c9c0d158f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b0e7a700 1 -- 172.21.15.84:0/3018469272 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400b6b0 con 0x7f51ac0cb630 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b0e7a700 1 -- 172.21.15.84:0/3018469272 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400b810 con 0x7f51ac0cb630 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.794+0000 7f51b0e7a700 1 -- 172.21.15.84:0/3018469272 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400bbb0 con 0x7f51ac0cb630 2023-10-06T02:55:13.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.795+0000 7f51b40e0700 1 -- 172.21.15.84:0/3018469272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac0cb630 msgr2=0x7f51ac0691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.795+0000 7f51b40e0700 1 --2- 172.21.15.84:0/3018469272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac0cb630 0x7f51ac0691e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51ac068cc0 tx=0x7f51a40091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.795+0000 7f51b40e0700 1 -- 172.21.15.84:0/3018469272 shutdown_connections 2023-10-06T02:55:13.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.795+0000 7f51b40e0700 1 --2- 172.21.15.84:0/3018469272 >> v2:172.21.15.131:3300/0 conn(0x7f51ac15a220 0x7f51ac0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.795+0000 7f51b40e0700 1 --2- 172.21.15.84:0/3018469272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac0cb630 0x7f51ac0691e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.795+0000 7f51b40e0700 1 -- 172.21.15.84:0/3018469272 >> 172.21.15.84:0/3018469272 conn(0x7f51ac070810 msgr2=0x7f51ac070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:13.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.795+0000 7f51b40e0700 1 -- 172.21.15.84:0/3018469272 shutdown_connections 2023-10-06T02:55:13.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.795+0000 7f51b40e0700 1 -- 172.21.15.84:0/3018469272 wait complete. 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.796+0000 7f51b40e0700 1 Processor -- start 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.796+0000 7f51b40e0700 1 -- start start 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b40e0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac069720 0x7f51ac156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b40e0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ac15a220 0x7f51ac1509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b40e0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ac154ae0 0x7f51ac0b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b40e0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac150f20 con 0x7f51ac069720 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b40e0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0b2a90 con 0x7f51ac15a220 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b40e0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac154240 con 0x7f51ac154ae0 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b1e7c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac069720 0x7f51ac156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b1e7c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac069720 0x7f51ac156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50842/0 (socket says 172.21.15.84:50842) 2023-10-06T02:55:13.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b1e7c700 1 -- 172.21.15.84:0/1156530371 learned_addr learned my addr 172.21.15.84:0/1156530371 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b267d700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ac154ae0 0x7f51ac0b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b167b700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ac15a220 0x7f51ac1509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b1e7c700 1 -- 172.21.15.84:0/1156530371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ac154ae0 msgr2=0x7f51ac0b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b1e7c700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ac154ae0 0x7f51ac0b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b1e7c700 1 -- 172.21.15.84:0/1156530371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ac15a220 msgr2=0x7f51ac1509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b1e7c700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ac15a220 0x7f51ac1509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b1e7c700 1 -- 172.21.15.84:0/1156530371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4009420 con 0x7f51ac069720 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51b1e7c700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac069720 0x7f51ac156c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51a4013000 tx=0x7f51a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51a9ffb700 1 -- 172.21.15.84:0/1156530371 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400bb90 con 0x7f51ac069720 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.797+0000 7f51a9ffb700 1 -- 172.21.15.84:0/1156530371 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a4011420 con 0x7f51ac069720 2023-10-06T02:55:13.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.798+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac154520 con 0x7f51ac069720 2023-10-06T02:55:13.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.798+0000 7f51a9ffb700 1 -- 172.21.15.84:0/1156530371 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a40117c0 con 0x7f51ac069720 2023-10-06T02:55:13.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.798+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac0b34b0 con 0x7f51ac069720 2023-10-06T02:55:13.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.799+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac0b2dc0 con 0x7f51ac069720 2023-10-06T02:55:13.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.799+0000 7f51a9ffb700 1 -- 172.21.15.84:0/1156530371 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51a4011bb0 con 0x7f51ac069720 2023-10-06T02:55:13.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.799+0000 7f51a9ffb700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5198066f30 0x7f51980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:13.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.799+0000 7f51b167b700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5198066f30 0x7f51980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:13.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.799+0000 7f51a9ffb700 1 -- 172.21.15.84:0/1156530371 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f51a40860c0 con 0x7f51ac069720 2023-10-06T02:55:13.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.800+0000 7f51b167b700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5198066f30 0x7f51980693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0c8790 tx=0x7f51a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:13.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.804+0000 7f51a9ffb700 1 -- 172.21.15.84:0/1156530371 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51a4052f60 con 0x7f51ac069720 2023-10-06T02:55:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.991+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51ac064ad0 con 0x7f51ac069720 2023-10-06T02:55:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.992+0000 7f51a9ffb700 1 -- 172.21.15.84:0/1156530371 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f51a4011e60 con 0x7f51ac069720 2023-10-06T02:55:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:13.993 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5198066f30 msgr2=0x7f51980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5198066f30 0x7f51980693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0c8790 tx=0x7f51a0009040 comp rx=0 tx=0).stop 2023-10-06T02:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac069720 msgr2=0x7f51ac156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac069720 0x7f51ac156c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51a4013000 tx=0x7f51a4017000 comp rx=0 tx=0).stop 2023-10-06T02:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 shutdown_connections 2023-10-06T02:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5198066f30 0x7f51980693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51ac154ae0 0x7f51ac0b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac069720 0x7f51ac156c50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 --2- 172.21.15.84:0/1156530371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ac15a220 0x7f51ac1509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 >> 172.21.15.84:0/1156530371 conn(0x7f51ac070810 msgr2=0x7f51ac0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 shutdown_connections 2023-10-06T02:55:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:13.994+0000 7f51b40e0700 1 -- 172.21.15.84:0/1156530371 wait complete. 2023-10-06T02:55:14.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:55:06.613971+0000', 'modified': '2023-10-06T02:55:12.263022+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6835/4173990514', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 4173990514}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 4173990514}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T02:55:14.409 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:55:14.409 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T02:55:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.524+0000 7fca7b2d1700 1 Processor -- start 2023-10-06T02:55:14.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.524+0000 7fca7b2d1700 1 -- start start 2023-10-06T02:55:14.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca7b2d1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fca74157080 0x7fca740cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca7b2d1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca74157450 0x7fca7406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca7b2d1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7415b210 con 0x7fca7415b6a0 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca7b2d1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7406db20 con 0x7fca74157080 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca7b2d1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca740ce4f0 con 0x7fca74157450 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca7aad0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fca7415b6a0 0x7fca740c9fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36586/0 (socket says 172.21.15.84:36586) 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca7aad0700 1 -- 172.21.15.84:0/4210087504 learned_addr learned my addr 172.21.15.84:0/4210087504 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919184322 0 0) 0x7fca7415b210 con 0x7fca7415b6a0 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/4210087504 >> v2:172.21.15.131:3300/0 conn(0x7fca74157080 0x7fca740cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca79ace700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca74157450 0x7fca7406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca60003570 con 0x7fca7415b6a0 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2252034945 0 0) 0x7fca60003570 con 0x7fca7415b6a0 2023-10-06T02:55:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca74157450 msgr2=0x7fca7406d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca792cd700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca74157450 0x7fca7406d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 >> v2:172.21.15.131:3300/0 conn(0x7fca74157080 msgr2=0x7fca740cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca792cd700 1 --2- 172.21.15.84:0/4210087504 >> v2:172.21.15.131:3300/0 conn(0x7fca74157080 0x7fca740cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.525+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740ce7d0 con 0x7fca7415b6a0 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fca6c0017f0 con 0x7fca7415b6a0 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 >> v1:172.21.15.84:6789/0 conn(0x7fca7415b6a0 legacy=0x7fca740c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca74157450 0x7fca60003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60003fe0 0x7fca60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca60004d50 0x7fca600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7406db20 con 0x7fca60004d50 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740ce4f0 con 0x7fca60003fe0 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6000ba90 con 0x7fca74157450 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca7aad0700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca60004d50 0x7fca600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca74157450 0x7fca60003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca79ace700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60003fe0 0x7fca60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca7aad0700 1 -- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca74157450 msgr2=0x7fca60003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca7aad0700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca74157450 0x7fca60003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca7aad0700 1 -- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60003fe0 msgr2=0x7fca60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca7aad0700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60003fe0 0x7fca60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca7aad0700 1 -- 172.21.15.84:0/4210087504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60003570 con 0x7fca60004d50 2023-10-06T02:55:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca7aad0700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca60004d50 0x7fca600051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00a970 tx=0x7fca6c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bda7eb21ca95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c012440 con 0x7fca60004d50 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c0125c0 con 0x7fca60004d50 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.526+0000 7fca792cd700 1 -- 172.21.15.84:0/4210087504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c012980 con 0x7fca60004d50 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.527+0000 7fca7b2d1700 1 -- 172.21.15.84:0/4210087504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca60004d50 msgr2=0x7fca600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.527+0000 7fca7b2d1700 1 --2- 172.21.15.84:0/4210087504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca60004d50 0x7fca600051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00a970 tx=0x7fca6c002210 comp rx=0 tx=0).stop 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.527+0000 7fca7aad0700 1 -- 172.21.15.84:0/4210087504 reap_dead start 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.527+0000 7fca7b2d1700 1 -- 172.21.15.84:0/4210087504 shutdown_connections 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.527+0000 7fca7b2d1700 1 -- 172.21.15.84:0/4210087504 >> 172.21.15.84:0/4210087504 conn(0x7fca7406b540 msgr2=0x7fca7406b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.527+0000 7fca7b2d1700 1 -- 172.21.15.84:0/4210087504 shutdown_connections 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.527+0000 7fca7b2d1700 1 -- 172.21.15.84:0/4210087504 wait complete. 2023-10-06T02:55:14.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.528+0000 7fca7b2d1700 1 Processor -- start 2023-10-06T02:55:14.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.528+0000 7fca7b2d1700 1 -- start start 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7b2d1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca60004d50 0x7fca7414c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7b2d1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca7414a590 0x7fca74159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7b2d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca74167780 0x7fca74167bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7b2d1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca74158410 con 0x7fca74167780 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7b2d1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7414aa00 con 0x7fca7414a590 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7b2d1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca74157820 con 0x7fca60004d50 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7aad0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca74167780 0x7fca74167bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7aad0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca74167780 0x7fca74167bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50860/0 (socket says 172.21.15.84:50860) 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7aad0700 1 -- 172.21.15.84:0/1278017793 learned_addr learned my addr 172.21.15.84:0/1278017793 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca60004d50 0x7fca7414c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca79ace700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca7414a590 0x7fca74159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7aad0700 1 -- 172.21.15.84:0/1278017793 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca60004d50 msgr2=0x7fca7414c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7aad0700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca60004d50 0x7fca7414c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7aad0700 1 -- 172.21.15.84:0/1278017793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca7414a590 msgr2=0x7fca74159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7aad0700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca7414a590 0x7fca74159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7aad0700 1 -- 172.21.15.84:0/1278017793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca74157ae0 con 0x7fca74167780 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7aad0700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca74167780 0x7fca74167bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fca60004730 tx=0x7fca6c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca6a7fc700 1 -- 172.21.15.84:0/1278017793 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c012440 con 0x7fca74167780 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca6a7fc700 1 -- 172.21.15.84:0/1278017793 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c0017b0 con 0x7fca74167780 2023-10-06T02:55:14.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca6a7fc700 1 -- 172.21.15.84:0/1278017793 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c012960 con 0x7fca74167780 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7b2d1700 1 -- 172.21.15.84:0/1278017793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca74157dc0 con 0x7fca74167780 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.529+0000 7fca7b2d1700 1 -- 172.21.15.84:0/1278017793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7415a400 con 0x7fca74167780 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.531+0000 7fca6a7fc700 1 -- 172.21.15.84:0/1278017793 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca6c019070 con 0x7fca74167780 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.531+0000 7fca6a7fc700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fca58066f30 0x7fca580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.531+0000 7fca6a7fc700 1 -- 172.21.15.84:0/1278017793 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fca6c086920 con 0x7fca74167780 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.531+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fca58066f30 0x7fca580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.531+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fca58066f30 0x7fca580693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca70006ed0 tx=0x7fca70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.533+0000 7fca8582bb80 1 Processor -- start 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.533+0000 7fca8582bb80 1 -- start start 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24a5e50 0x5644b2480cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b2481200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b2487a10 0x5644b2481740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca8582bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644b23dba70 con 0x5644b24862c0 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca8582bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644b23d9270 con 0x5644b2487a10 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca8582bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644b23d5060 con 0x5644b24a5e50 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca79ace700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b2481200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca79ace700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b2481200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50872/0 (socket says 172.21.15.84:50872) 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca79ace700 1 -- 172.21.15.84:0/2883197825 learned_addr learned my addr 172.21.15.84:0/2883197825 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca7aad0700 1 --2- 172.21.15.84:0/2883197825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b2487a10 0x5644b2481740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/2883197825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24a5e50 0x5644b2480cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca79ace700 1 -- 172.21.15.84:0/2883197825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24a5e50 msgr2=0x5644b2480cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca79ace700 1 --2- 172.21.15.84:0/2883197825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24a5e50 0x5644b2480cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca79ace700 1 -- 172.21.15.84:0/2883197825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b2487a10 msgr2=0x5644b2481740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca79ace700 1 --2- 172.21.15.84:0/2883197825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b2487a10 0x5644b2481740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca79ace700 1 -- 172.21.15.84:0/2883197825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644b226f270 con 0x5644b24862c0 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca79ace700 1 --2- 172.21.15.84:0/2883197825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b2481200 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca64009b70 tx=0x7fca64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a9ca9e7bc66369 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca577fe700 1 -- 172.21.15.84:0/2883197825 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64013ab0 con 0x5644b24862c0 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca577fe700 1 -- 172.21.15.84:0/2883197825 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca64013c10 con 0x5644b24862c0 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.534+0000 7fca577fe700 1 -- 172.21.15.84:0/2883197825 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64016460 con 0x5644b24862c0 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.535+0000 7fca8582bb80 1 -- 172.21.15.84:0/2883197825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 msgr2=0x5644b2481200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.535+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2883197825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b2481200 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca64009b70 tx=0x7fca64008040 comp rx=0 tx=0).stop 2023-10-06T02:55:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.535+0000 7fca8582bb80 1 -- 172.21.15.84:0/2883197825 shutdown_connections 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.535+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2883197825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b2487a10 0x5644b2481740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.535+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2883197825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24a5e50 0x5644b2480cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.535+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2883197825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b2481200 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.535+0000 7fca8582bb80 1 -- 172.21.15.84:0/2883197825 >> 172.21.15.84:0/2883197825 conn(0x5644b2485e80 msgr2=0x5644b24866b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.535+0000 7fca8582bb80 1 -- 172.21.15.84:0/2883197825 shutdown_connections 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.535+0000 7fca8582bb80 1 -- 172.21.15.84:0/2883197825 wait complete. 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.536+0000 7fca8582bb80 1 -- start start 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.536+0000 7fca8582bb80 1 Processor -- start 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.536+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24862c0 0x5644b24a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b2487a10 0x5644b24a6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 0x5644b24a2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca8582bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644b2380890 con 0x5644b2487a10 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca8582bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644b239bea0 con 0x5644b24a5e50 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca8582bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644b2257e30 con 0x5644b24862c0 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca8582bb80 10 client.0 _ll_register_callbacks cb 0x5644b2448020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca79ace700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b2487a10 0x5644b24a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca79ace700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b2487a10 0x5644b24a6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50880/0 (socket says 172.21.15.84:50880) 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca79ace700 1 -- 172.21.15.84:0/2147340593 learned_addr learned my addr 172.21.15.84:0/2147340593 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24862c0 0x5644b24a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca7aad0700 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 0x5644b24a2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca79ace700 1 -- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24862c0 msgr2=0x5644b24a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca79ace700 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24862c0 0x5644b24a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca79ace700 1 -- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 msgr2=0x5644b24a2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca79ace700 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 0x5644b24a2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca79ace700 1 -- 172.21.15.84:0/2147340593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca640098a0 con 0x5644b2487a10 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca79ace700 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b2487a10 0x5644b24a6220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fca64006eb0 tx=0x7fca6401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2511a5aebee2d943 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca54ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca54ff9700 1 -- 172.21.15.84:0/2147340593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca64024070 con 0x5644b2487a10 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca54ff9700 1 -- 172.21.15.84:0/2147340593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fca64016810 con 0x5644b2487a10 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca8582bb80 1 -- 172.21.15.84:0/2147340593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644b2479940 con 0x5644b2487a10 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca54ff9700 1 -- 172.21.15.84:0/2147340593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca64016be0 con 0x5644b2487a10 2023-10-06T02:55:14.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca8582bb80 10 client.4461 fetch_fsmap learned FSMap version 7 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca8582bb80 1 -- 172.21.15.84:0/2147340593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5644b2211fe0 con 0x5644b2487a10 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.537+0000 7fca54ff9700 1 -- 172.21.15.84:0/2147340593 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5644b2479940 con 0x5644b2487a10 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca54ff9700 1 -- 172.21.15.84:0/2147340593 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fca6402e250 con 0x5644b2487a10 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca8582bb80 10 client.4461 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca8582bb80 10 client.4461 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca8582bb80 20 client.4461 populate_metadata read hostname 'smithi084' 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x5644b24b3290 0x5644b24b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca8582bb80 4 client.4461 mds_command: new command op to 4308 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca8582bb80 1 -- 172.21.15.84:0/2147340593 --> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644b2456870 con 0x5644b24b3290 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x5644b24b3290 0x5644b24b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca54ff9700 10 client.4461 ms_handle_connect on v2:172.21.15.131:6833/4173990514 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.538+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x5644b24b3290 0x5644b24b3660 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21437871a4238aba server_cookie=31c09b4771232f80 in_seq=0 out_seq=0 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca54ff9700 1 -- 172.21.15.84:0/2147340593 <== mds.0 v2:172.21.15.131:6833/4173990514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5644b2456870 con 0x5644b24b3290 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca54ff9700 10 client.4461 handle_command_reply: tid=0 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 client.4461 shutdown 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 -- 172.21.15.84:0/2147340593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b2487a10 msgr2=0x5644b24a6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b2487a10 0x5644b24a6220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fca64006eb0 tx=0x7fca6401d000 comp rx=0 tx=0).stop 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 -- 172.21.15.84:0/2147340593 shutdown_connections 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x5644b24b3290 0x5644b24b3660 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 0x5644b24a2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b24862c0 0x5644b24a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca54ff9700 0 client.4461 ms_handle_reset on v2:172.21.15.131:6833/4173990514 2023-10-06T02:55:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2147340593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b2487a10 0x5644b24a6220 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 -- 172.21.15.84:0/2147340593 >> 172.21.15.84:0/2147340593 conn(0x5644b2485e80 msgr2=0x5644b2484cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 -- 172.21.15.84:0/2147340593 shutdown_connections 2023-10-06T02:55:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 1 -- 172.21.15.84:0/2147340593 wait complete. 2023-10-06T02:55:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.539+0000 7fca8582bb80 20 client.4461 trim_cache size 0 max 16384 2023-10-06T02:55:14.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.556+0000 7fca8582bb80 1 Processor -- start 2023-10-06T02:55:14.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.556+0000 7fca8582bb80 1 -- start start 2023-10-06T02:55:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.556+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24862c0 0x5644b24823d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.556+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 0x5644b247b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24a5e50 0x5644b247bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca8582bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644b24a5b40 con 0x5644b24a5e50 2023-10-06T02:55:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca8582bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644b2487140 con 0x5644b24862c0 2023-10-06T02:55:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca8582bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644b24ae150 con 0x5644b2487a10 2023-10-06T02:55:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7aad0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24a5e50 0x5644b247bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7aad0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24a5e50 0x5644b247bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50884/0 (socket says 172.21.15.84:50884) 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7aad0700 1 -- 172.21.15.84:0/2892663610 learned_addr learned my addr 172.21.15.84:0/2892663610 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca79ace700 1 --2- 172.21.15.84:0/2892663610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 0x5644b247b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/2892663610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24862c0 0x5644b24823d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7aad0700 1 -- 172.21.15.84:0/2892663610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 msgr2=0x5644b247b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7aad0700 1 --2- 172.21.15.84:0/2892663610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 0x5644b247b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7aad0700 1 -- 172.21.15.84:0/2892663610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24862c0 msgr2=0x5644b24823d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7aad0700 1 --2- 172.21.15.84:0/2892663610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24862c0 0x5644b24823d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7aad0700 1 -- 172.21.15.84:0/2892663610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644b23a3780 con 0x5644b24a5e50 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca7aad0700 1 --2- 172.21.15.84:0/2892663610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24a5e50 0x5644b247bc70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca6c001920 tx=0x7fca6c021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972902e92e5aba98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca57fff700 1 -- 172.21.15.84:0/2892663610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c056d60 con 0x5644b24a5e50 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca57fff700 1 -- 172.21.15.84:0/2892663610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c01aea0 con 0x5644b24a5e50 2023-10-06T02:55:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.557+0000 7fca57fff700 1 -- 172.21.15.84:0/2892663610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c057b00 con 0x5644b24a5e50 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 -- 172.21.15.84:0/2892663610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24a5e50 msgr2=0x5644b247bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2892663610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24a5e50 0x5644b247bc70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca6c001920 tx=0x7fca6c021040 comp rx=0 tx=0).stop 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 -- 172.21.15.84:0/2892663610 shutdown_connections 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2892663610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24862c0 0x5644b24823d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2892663610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24a5e50 0x5644b247bc70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2892663610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 0x5644b247b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 -- 172.21.15.84:0/2892663610 >> 172.21.15.84:0/2892663610 conn(0x5644b2485e80 msgr2=0x5644b24a74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 -- 172.21.15.84:0/2892663610 shutdown_connections 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 -- 172.21.15.84:0/2892663610 wait complete. 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 -- start start 2023-10-06T02:55:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.558+0000 7fca8582bb80 1 Processor -- start 2023-10-06T02:55:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b24ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 0x5644b24f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca8582bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 0x5644b24cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca8582bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644b2536760 con 0x5644b24862c0 2023-10-06T02:55:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca8582bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644b252f350 con 0x5644b24a5e50 2023-10-06T02:55:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca8582bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644b24b1ce0 con 0x5644b2487a10 2023-10-06T02:55:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca8582bb80 10 client.0 _ll_register_callbacks cb 0x5644b2448020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:55:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca7a2cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b24ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca7a2cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b24ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50896/0 (socket says 172.21.15.84:50896) 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca7a2cf700 1 -- 172.21.15.84:0/2007339088 learned_addr learned my addr 172.21.15.84:0/2007339088 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca79ace700 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 0x5644b24f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca7aad0700 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 0x5644b24cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca7a2cf700 1 -- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 msgr2=0x5644b24f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 0x5644b24f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca7a2cf700 1 -- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 msgr2=0x5644b24cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 0x5644b24cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca7a2cf700 1 -- 172.21.15.84:0/2007339088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7415a400 con 0x5644b24862c0 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.559+0000 7fca79ace700 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 0x5644b24f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca7a2cf700 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b24ad4d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca700096e0 tx=0x7fca70031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2ee255435f9c30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca54ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca54ff9700 1 -- 172.21.15.84:0/2007339088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70029040 con 0x5644b24862c0 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca54ff9700 1 -- 172.21.15.84:0/2007339088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fca70024640 con 0x5644b24862c0 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca8582bb80 1 -- 172.21.15.84:0/2007339088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca64013c10 con 0x5644b24862c0 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca54ff9700 1 -- 172.21.15.84:0/2007339088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca70024a10 con 0x5644b24862c0 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca8582bb80 10 client.4467 fetch_fsmap learned FSMap version 7 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca8582bb80 1 -- 172.21.15.84:0/2007339088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5644b238a470 con 0x5644b24862c0 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca54ff9700 1 -- 172.21.15.84:0/2007339088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca64013c10 con 0x5644b24862c0 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca54ff9700 1 -- 172.21.15.84:0/2007339088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fca70024b70 con 0x5644b24862c0 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca8582bb80 10 client.4467 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca8582bb80 10 client.4467 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:55:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca8582bb80 20 client.4467 populate_metadata read hostname 'smithi084' 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x5644b24cbbf0 0x5644b2480ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca8582bb80 4 client.4467 mds_command: new command op to 4308 tid=0[{"prefix": "status"}] 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca8582bb80 1 -- 172.21.15.84:0/2007339088 --> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5644b2377e00 con 0x5644b24cbbf0 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.560+0000 7fca79ace700 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x5644b24cbbf0 0x5644b2480ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca79ace700 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x5644b24cbbf0 0x5644b2480ad0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3be494bb4858779 server_cookie=6b03af7551db4cd5 in_seq=0 out_seq=0 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca54ff9700 10 client.4467 ms_handle_connect on v2:172.21.15.131:6833/4173990514 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca54ff9700 1 -- 172.21.15.84:0/2007339088 <== mds.0 v2:172.21.15.131:6833/4173990514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5644b2377e00 con 0x5644b24cbbf0 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca54ff9700 10 client.4467 handle_command_reply: tid=0 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 client.4467 shutdown 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 -- 172.21.15.84:0/2007339088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 msgr2=0x5644b24ad4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b24ad4d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca700096e0 tx=0x7fca70031040 comp rx=0 tx=0).stop 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 -- 172.21.15.84:0/2007339088 shutdown_connections 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x5644b24cbbf0 0x5644b2480ad0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5644b24a5e50 0x5644b24cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644b24862c0 0x5644b24ad4d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca54ff9700 0 client.4467 ms_handle_reset on v2:172.21.15.131:6833/4173990514 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 --2- 172.21.15.84:0/2007339088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5644b2487a10 0x5644b24f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 -- 172.21.15.84:0/2007339088 >> 172.21.15.84:0/2007339088 conn(0x5644b2485e80 msgr2=0x5644b24ddd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 -- 172.21.15.84:0/2007339088 shutdown_connections 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 1 -- 172.21.15.84:0/2007339088 wait complete. 2023-10-06T02:55:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.561+0000 7fca8582bb80 20 client.4467 trim_cache size 0 max 16384 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4308, 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 7.3379210510000004, 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 7, 2023-10-06T02:55:14.571 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 27, 2023-10-06T02:55:14.572 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 27, 2023-10-06T02:55:14.572 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 12.339074350000001 2023-10-06T02:55:14.572 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 -- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fca58066f30 msgr2=0x7fca580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fca58066f30 0x7fca580693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca70006ed0 tx=0x7fca70008040 comp rx=0 tx=0).stop 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 -- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca74167780 msgr2=0x7fca74167bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca74167780 0x7fca74167bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fca60004730 tx=0x7fca6c015000 comp rx=0 tx=0).stop 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 -- 172.21.15.84:0/1278017793 shutdown_connections 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fca58066f30 0x7fca580693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca74167780 0x7fca74167bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca60004d50 0x7fca7414c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 --2- 172.21.15.84:0/1278017793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca7414a590 0x7fca74159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 -- 172.21.15.84:0/1278017793 >> 172.21.15.84:0/1278017793 conn(0x7fca7406b540 msgr2=0x7fca740cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:14.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 -- 172.21.15.84:0/1278017793 shutdown_connections 2023-10-06T02:55:14.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.562+0000 7fca7b2d1700 1 -- 172.21.15.84:0/1278017793 wait complete. 2023-10-06T02:55:14.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:55:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.687+0000 7f8cedd87700 1 Processor -- start 2023-10-06T02:55:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.688+0000 7f8cedd87700 1 -- start start 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.688+0000 7f8cedd87700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ca3b0 0x7f8ce81582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.688+0000 7f8cedd87700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ce80adba0 0x7f8ce80ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.688+0000 7f8cedd87700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8ce80ce710 0x7f8ce815af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.688+0000 7f8cedd87700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80cbbd0 con 0x7f8ce80adba0 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.688+0000 7f8cedd87700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce8157e20 con 0x7f8ce80ce710 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.688+0000 7f8cedd87700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80ceb30 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.688+0000 7f8ce6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ce80adba0 0x7f8ce80ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ce80adba0 0x7f8ce80ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50906/0 (socket says 172.21.15.84:50906) 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce6ffd700 1 -- 172.21.15.84:0/1045289069 learned_addr learned my addr 172.21.15.84:0/1045289069 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce77fe700 1 --2- 172.21.15.84:0/1045289069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ca3b0 0x7f8ce81582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce7fff700 1 --2- 172.21.15.84:0/1045289069 >> v2:172.21.15.131:3300/0 conn(0x7f8ce80ce710 0x7f8ce815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce6ffd700 1 -- 172.21.15.84:0/1045289069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ca3b0 msgr2=0x7f8ce81582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce6ffd700 1 --2- 172.21.15.84:0/1045289069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ca3b0 0x7f8ce81582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce6ffd700 1 -- 172.21.15.84:0/1045289069 >> v2:172.21.15.131:3300/0 conn(0x7f8ce80ce710 msgr2=0x7f8ce815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce6ffd700 1 --2- 172.21.15.84:0/1045289069 >> v2:172.21.15.131:3300/0 conn(0x7f8ce80ce710 0x7f8ce815af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce6ffd700 1 -- 172.21.15.84:0/1045289069 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce80cb610 con 0x7f8ce80adba0 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce6ffd700 1 --2- 172.21.15.84:0/1045289069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80adba0 0x7f8ce80ce1d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80cde50 tx=0x7f8cdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b2c35475a10acf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce67fc700 1 -- 172.21.15.84:0/1045289069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc00b860 con 0x7f8ce80adba0 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce67fc700 1 -- 172.21.15.84:0/1045289069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc00b9c0 con 0x7f8ce80adba0 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.689+0000 7f8ce67fc700 1 -- 172.21.15.84:0/1045289069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc00bd60 con 0x7f8ce80adba0 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.690+0000 7f8cedd87700 1 -- 172.21.15.84:0/1045289069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80adba0 msgr2=0x7f8ce80ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.690+0000 7f8cedd87700 1 --2- 172.21.15.84:0/1045289069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80adba0 0x7f8ce80ce1d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80cde50 tx=0x7f8cdc009250 comp rx=0 tx=0).stop 2023-10-06T02:55:14.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.690+0000 7f8cedd87700 1 -- 172.21.15.84:0/1045289069 shutdown_connections 2023-10-06T02:55:14.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.690+0000 7f8cedd87700 1 --2- 172.21.15.84:0/1045289069 >> v2:172.21.15.131:3300/0 conn(0x7f8ce80ce710 0x7f8ce815af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.690+0000 7f8cedd87700 1 --2- 172.21.15.84:0/1045289069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ca3b0 0x7f8ce81582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.690+0000 7f8cedd87700 1 --2- 172.21.15.84:0/1045289069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80adba0 0x7f8ce80ce1d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.690+0000 7f8cedd87700 1 -- 172.21.15.84:0/1045289069 >> 172.21.15.84:0/1045289069 conn(0x7f8ce8070810 msgr2=0x7f8ce8070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:14.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.690+0000 7f8cedd87700 1 -- 172.21.15.84:0/1045289069 shutdown_connections 2023-10-06T02:55:14.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.690+0000 7f8cedd87700 1 -- 172.21.15.84:0/1045289069 wait complete. 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.691+0000 7f8cedd87700 1 Processor -- start 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.691+0000 7f8cedd87700 1 -- start start 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8cedd87700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce80adba0 0x7f8ce80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8cedd87700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80ca3b0 0x7f8ce8158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8cedd87700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ce710 0x7f8ce8159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8cedd87700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c4bf0 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8cedd87700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce816b0a0 con 0x7f8ce80adba0 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8cedd87700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce81581b0 con 0x7f8ce80ce710 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80ca3b0 0x7f8ce8158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80ca3b0 0x7f8ce8158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50910/0 (socket says 172.21.15.84:50910) 2023-10-06T02:55:14.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce6ffd700 1 -- 172.21.15.84:0/3128954063 learned_addr learned my addr 172.21.15.84:0/3128954063 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce7fff700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ce710 0x7f8ce8159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce77fe700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce80adba0 0x7f8ce80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce6ffd700 1 -- 172.21.15.84:0/3128954063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ce710 msgr2=0x7f8ce8159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce6ffd700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ce710 0x7f8ce8159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce6ffd700 1 -- 172.21.15.84:0/3128954063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce80adba0 msgr2=0x7f8ce80b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce6ffd700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce80adba0 0x7f8ce80b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce6ffd700 1 -- 172.21.15.84:0/3128954063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0094f0 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce77fe700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce80adba0 0x7f8ce80b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ce6ffd700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80ca3b0 0x7f8ce8158c00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80cdfe0 tx=0x7f8cdc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ccf7fe700 1 -- 172.21.15.84:0/3128954063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc011e70 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ccf7fe700 1 -- 172.21.15.84:0/3128954063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc024440 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8ccf7fe700 1 -- 172.21.15.84:0/3128954063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc024800 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce8158770 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.692+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce80b3ea0 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.693+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce8064ad0 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.694+0000 7f8ccf7fe700 1 -- 172.21.15.84:0/3128954063 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cdc01a420 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.694+0000 7f8ccf7fe700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cd4066f30 0x7f8cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:14.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.694+0000 7f8ccf7fe700 1 -- 172.21.15.84:0/3128954063 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8cdc086740 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.694+0000 7f8ce77fe700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cd4066f30 0x7f8cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:14.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.694+0000 7f8ce77fe700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cd4066f30 0x7f8cd40693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80075e0 tx=0x7f8cd80097e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:14.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.698+0000 7f8ccf7fe700 1 -- 172.21.15.84:0/3128954063 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cdc053560 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.925+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8ce80cb8f0 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.925+0000 7f8ccf7fe700 1 -- 172.21.15.84:0/3128954063 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8cdc015070 con 0x7f8ce80ca3b0 2023-10-06T02:55:14.926 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:55:14.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cd4066f30 msgr2=0x7f8cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cd4066f30 0x7f8cd40693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80075e0 tx=0x7f8cd80097e0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80ca3b0 msgr2=0x7f8ce8158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80ca3b0 0x7f8ce8158c00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80cdfe0 tx=0x7f8cdc017000 comp rx=0 tx=0).stop 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 shutdown_connections 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cd4066f30 0x7f8cd40693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce80adba0 0x7f8ce80b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ce80ce710 0x7f8ce8159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 --2- 172.21.15.84:0/3128954063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce80ca3b0 0x7f8ce8158c00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 >> 172.21.15.84:0/3128954063 conn(0x7f8ce8070810 msgr2=0x7f8ce81535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 shutdown_connections 2023-10-06T02:55:14.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:14.928+0000 7f8cedd87700 1 -- 172.21.15.84:0/3128954063 wait complete. 2023-10-06T02:55:14.940 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:55:14.940 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:55:14.940 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T02:55:14.940 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T02:55:14.941 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:55:14.941 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:55:14.941 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:55:14.941 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:55:14.941 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T02:55:14.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:14.941 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T02:55:14.956 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:14.956 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:14.956 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:55:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42494sec preferred_lft 42494sec 2023-10-06T02:55:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-10-06T02:55:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:14.958 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:55:14.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:14.958 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:14.958 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:14.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:55:14.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-10-06T02:55:14.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-10-06T02:55:14.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:55:14.959 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:15.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:15.119 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:55:15.161 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T02:55:15.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:15.163 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T02:55:15.235 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T02:55:15.235 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:55:15.235 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:55:15.235 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:55:15.235 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:55:15.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:15.236 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:15.236 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:15.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:55:15.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:55:15.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:55:15.236 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:15.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:15.503 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T02:55:15.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:15.518 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-10-06T02:55:15.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:15.571 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:15.572 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:15.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T02:55:15.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T02:55:15.572 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:15.661 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T02:55:15.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:15.661 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:15.661 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:15.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T02:55:15.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:55:15.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T02:55:15.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T02:55:15.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T02:55:15.662 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:15.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:15.858 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:15.858 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:15.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T02:55:15.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:55:15.858 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:15.950 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T02:55:15.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:15.950 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:55:15.965 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T02:55:15.965 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:15.966 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:55:16.020 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-10-06T02:55:16.085 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:55:16.085 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:55:16.149 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:55:16.150 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:55:16.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:16.151 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-10-06T02:55:16.206 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T02:55:16.206 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T02:55:16.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-10-06T02:55:16.273 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T02:55:16.273 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T02:55:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T02:55:16.339 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T02:55:16.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:16.339 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-10-06T02:55:16.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:2023-10-06T02:55:16.342+0000 7fe0cd877540 -1 init, newargv = 0x56164377ea00 newargc=15 2023-10-06T02:55:16.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[98256]: starting ceph client 2023-10-06T02:55:16.349 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[98256]: starting fuse 2023-10-06T02:55:16.357 INFO:teuthology.orchestra.run.smithi084.stdout:46 2023-10-06T02:55:16.358 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T02:55:16.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:55:16.358 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-10-06T02:55:16.358 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-10-06T02:55:16.358 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:55:16.358 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-10-06T02:55:16.358 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:55:16.358 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-10-06T02:55:16.358 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T02:55:16.359 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-10-06T02:55:16.359 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T02:55:16.359 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:55:16.359 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-10-06T02:55:16.359 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-10-06T02:55:16.359 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-10-06T02:55:16.359 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-10-06T02:55:16.359 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:55:16.359 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.admin")) 2023-10-06T02:55:16.360 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:55:16.478 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.admin.98256.asok 2023-10-06T02:55:16.660 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.98256.asok 2023-10-06T02:55:16.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:16.661 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.98256.asok status 2023-10-06T02:55:16.811 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:55:16.812 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-10-06T02:55:16.812 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T02:55:16.812 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T02:55:16.812 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "admin", 2023-10-06T02:55:16.812 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-10-06T02:55:16.812 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T02:55:16.812 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "98256", 2023-10-06T02:55:16.812 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-10-06T02:55:16.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:16.813 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-10-06T02:55:16.813 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-10-06T02:55:16.813 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4479, 2023-10-06T02:55:16.813 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-10-06T02:55:16.813 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-10-06T02:55:16.813 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-10-06T02:55:16.813 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4479 2023-10-06T02:55:16.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:16.814 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-10-06T02:55:16.814 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-10-06T02:55:16.814 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:55:16.814 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1984548573 2023-10-06T02:55:16.814 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:16.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1984548573 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4479 192.168.0.1:0/1984548573", 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/1984548573", 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 7, 2023-10-06T02:55:16.815 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 27, 2023-10-06T02:55:16.816 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-10-06T02:55:16.816 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-10-06T02:55:16.816 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-10-06T02:55:16.816 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:55:16.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:16.821 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-10-06T02:55:16.821 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:55:16.837 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-10-06T02:55:16.837 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:55:16.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:16.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:55:16.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:16.902 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T02:55:17.007 INFO:teuthology.orchestra.run.smithi084.stdout:# file: . 2023-10-06T02:55:17.007 INFO:teuthology.orchestra.run.smithi084.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T02:55:17.007 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:17.007 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-10-06T02:55:17.008 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:55:17.008 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T02:55:17.038 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[98256]: fuse finished with error 0 and tester_r 0 2023-10-06T02:55:17.039 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T02:55:17.134 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:55:17.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:17.134 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T02:55:17.149 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.304+0000 7fc34e8d1700 1 Processor -- start 2023-10-06T02:55:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.304+0000 7fc34e8d1700 1 -- start start 2023-10-06T02:55:17.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc34e8d1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc3481595a0 0x7fc3480aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc34e8d1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3480b49e0 0x7fc3480aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc34e8d1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3480b0ca0 con 0x7fc3480b07a0 2023-10-06T02:55:17.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc34e8d1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3480b0f80 con 0x7fc3480b49e0 2023-10-06T02:55:17.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc34e8d1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3480b1260 con 0x7fc3481595a0 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc3477fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3480b49e0 0x7fc3480aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc34ce6e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc3480b07a0 0x7fc3480b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36602/0 (socket says 172.21.15.84:36602) 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc34ce6e700 1 -- 172.21.15.84:0/2204930448 learned_addr learned my addr 172.21.15.84:0/2204930448 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc347fff700 1 --2- 172.21.15.84:0/2204930448 >> v2:172.21.15.131:3300/0 conn(0x7fc3481595a0 0x7fc3480aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc3477fe700 1 -- 172.21.15.84:0/2204930448 >> v2:172.21.15.131:3300/0 conn(0x7fc3481595a0 msgr2=0x7fc3480aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc3477fe700 1 --2- 172.21.15.84:0/2204930448 >> v2:172.21.15.131:3300/0 conn(0x7fc3481595a0 0x7fc3480aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc3477fe700 1 -- 172.21.15.84:0/2204930448 >> v1:172.21.15.84:6789/0 conn(0x7fc3480b07a0 legacy=0x7fc3480b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc3477fe700 1 -- 172.21.15.84:0/2204930448 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480b1540 con 0x7fc3480b49e0 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc346ffd700 1 -- 172.21.15.84:0/2204930448 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578547929 0 0) 0x7fc3480b0ca0 con 0x7fc3480b07a0 2023-10-06T02:55:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc347fff700 1 --2- 172.21.15.84:0/2204930448 >> v2:172.21.15.131:3300/0 conn(0x7fc3481595a0 0x7fc3480aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc3477fe700 1 --2- 172.21.15.84:0/2204930448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 0x7fc3480aaab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3380098e0 tx=0x7fc3380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b2f34686391150 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc346ffd700 1 -- 172.21.15.84:0/2204930448 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338009e80 con 0x7fc3480b49e0 2023-10-06T02:55:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.305+0000 7fc346ffd700 1 -- 172.21.15.84:0/2204930448 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33800b820 con 0x7fc3480b49e0 2023-10-06T02:55:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.306+0000 7fc346ffd700 1 -- 172.21.15.84:0/2204930448 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800bba0 con 0x7fc3480b49e0 2023-10-06T02:55:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.306+0000 7fc34e8d1700 1 -- 172.21.15.84:0/2204930448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 msgr2=0x7fc3480aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.306+0000 7fc34e8d1700 1 --2- 172.21.15.84:0/2204930448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 0x7fc3480aaab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3380098e0 tx=0x7fc3380091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.306+0000 7fc34e8d1700 1 -- 172.21.15.84:0/2204930448 shutdown_connections 2023-10-06T02:55:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.306+0000 7fc34e8d1700 1 --2- 172.21.15.84:0/2204930448 >> v2:172.21.15.131:3300/0 conn(0x7fc3481595a0 0x7fc3480aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.306+0000 7fc34e8d1700 1 --2- 172.21.15.84:0/2204930448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 0x7fc3480aaab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.306+0000 7fc34e8d1700 1 -- 172.21.15.84:0/2204930448 >> 172.21.15.84:0/2204930448 conn(0x7fc348099830 msgr2=0x7fc34806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:17.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.306+0000 7fc34e8d1700 1 -- 172.21.15.84:0/2204930448 shutdown_connections 2023-10-06T02:55:17.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.306+0000 7fc34e8d1700 1 -- 172.21.15.84:0/2204930448 wait complete. 2023-10-06T02:55:17.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.307+0000 7fc34e8d1700 1 Processor -- start 2023-10-06T02:55:17.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.307+0000 7fc34e8d1700 1 -- start start 2023-10-06T02:55:17.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc34e8d1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3480b07a0 0x7fc3480aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc34e8d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 0x7fc348154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc34e8d1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3481595a0 0x7fc34815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc34e8d1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480ce1f0 con 0x7fc3480b49e0 2023-10-06T02:55:17.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc34e8d1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480ce4d0 con 0x7fc3480b07a0 2023-10-06T02:55:17.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc34e8d1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480ce7b0 con 0x7fc3481595a0 2023-10-06T02:55:17.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc3477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 0x7fc348154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc3477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 0x7fc348154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50930/0 (socket says 172.21.15.84:50930) 2023-10-06T02:55:17.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc3477fe700 1 -- 172.21.15.84:0/3461111700 learned_addr learned my addr 172.21.15.84:0/3461111700 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:17.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc34ce6e700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3481595a0 0x7fc34815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc347fff700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3480b07a0 0x7fc3480aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc3477fe700 1 -- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3481595a0 msgr2=0x7fc34815ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc3477fe700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3481595a0 0x7fc34815ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc3477fe700 1 -- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3480b07a0 msgr2=0x7fc3480aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc3477fe700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3480b07a0 0x7fc3480aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc3477fe700 1 -- 172.21.15.84:0/3461111700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009420 con 0x7fc3480b49e0 2023-10-06T02:55:17.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc347fff700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3480b07a0 0x7fc3480aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:17.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc34ce6e700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3481595a0 0x7fc34815ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:17.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.308+0000 7fc3477fe700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 0x7fc348154e50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc338013000 tx=0x7fc338017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:17.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.309+0000 7fc32ffff700 1 -- 172.21.15.84:0/3461111700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338011420 con 0x7fc3480b49e0 2023-10-06T02:55:17.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.309+0000 7fc32ffff700 1 -- 172.21.15.84:0/3461111700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3380115a0 con 0x7fc3480b49e0 2023-10-06T02:55:17.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.309+0000 7fc32ffff700 1 -- 172.21.15.84:0/3461111700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338011960 con 0x7fc3480b49e0 2023-10-06T02:55:17.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.309+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3480cea90 con 0x7fc3480b49e0 2023-10-06T02:55:17.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.309+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3480af4d0 con 0x7fc3480b49e0 2023-10-06T02:55:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.310+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3480cefb0 con 0x7fc3480b49e0 2023-10-06T02:55:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.310+0000 7fc32ffff700 1 -- 172.21.15.84:0/3461111700 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc338011cd0 con 0x7fc3480b49e0 2023-10-06T02:55:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.310+0000 7fc32ffff700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.310+0000 7fc32ffff700 1 -- 172.21.15.84:0/3461111700 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc338086450 con 0x7fc3480b49e0 2023-10-06T02:55:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.310+0000 7fc347fff700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.311+0000 7fc347fff700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00ab10 tx=0x7fc33c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:17.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.315+0000 7fc32ffff700 1 -- 172.21.15.84:0/3461111700 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3480cefb0 con 0x7fc3480b49e0 2023-10-06T02:55:17.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.499+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3480cefb0 con 0x7fc3480b49e0 2023-10-06T02:55:17.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.500+0000 7fc32ffff700 1 -- 172.21.15.84:0/3461111700 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fc3480cefb0 con 0x7fc3480b49e0 2023-10-06T02:55:17.501 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:17.501 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:17.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 msgr2=0x7fc3340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00ab10 tx=0x7fc33c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:17.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 msgr2=0x7fc348154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 0x7fc348154e50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc338013000 tx=0x7fc338017000 comp rx=0 tx=0).stop 2023-10-06T02:55:17.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 shutdown_connections 2023-10-06T02:55:17.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3480b07a0 0x7fc3480aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3481595a0 0x7fc34815ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 --2- 172.21.15.84:0/3461111700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b49e0 0x7fc348154e50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 >> 172.21.15.84:0/3461111700 conn(0x7fc348099830 msgr2=0x7fc3480b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:17.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 shutdown_connections 2023-10-06T02:55:17.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.502+0000 7fc34e8d1700 1 -- 172.21.15.84:0/3461111700 wait complete. 2023-10-06T02:55:17.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:17.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.629+0000 7f078dd74700 1 Processor -- start 2023-10-06T02:55:17.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.629+0000 7f078dd74700 1 -- start start 2023-10-06T02:55:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f078dd74700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 0x7f078806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f078dd74700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07880675f0 0x7f0788067a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f078dd74700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078806ed10 con 0x7f078815caf0 2023-10-06T02:55:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f078dd74700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0788067f50 con 0x7f07880675f0 2023-10-06T02:55:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f078dd74700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07880cb8b0 con 0x7f07880caad0 2023-10-06T02:55:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f0787fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07880675f0 0x7f0788067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f0787fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07880675f0 0x7f0788067a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50934/0 (socket says 172.21.15.84:50934) 2023-10-06T02:55:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f0787fff700 1 -- 172.21.15.84:0/269289891 learned_addr learned my addr 172.21.15.84:0/269289891 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:17.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f0786ffd700 1 --2- 172.21.15.84:0/269289891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 0x7f078806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f0787fff700 1 -- 172.21.15.84:0/269289891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 msgr2=0x7f078806f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f0787fff700 1 --2- 172.21.15.84:0/269289891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 0x7f078806f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f0787fff700 1 -- 172.21.15.84:0/269289891 >> v1:172.21.15.131:6789/0 conn(0x7f078815caf0 legacy=0x7f07880caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f0787fff700 1 -- 172.21.15.84:0/269289891 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880cbb90 con 0x7f07880675f0 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f0787fff700 1 --2- 172.21.15.84:0/269289891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 0x7f0788067a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f07780099b0 tx=0x7f0778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ede57d3b3384731 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f07867fc700 1 -- 172.21.15.84:0/269289891 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778009ea0 con 0x7f07880675f0 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f07867fc700 1 -- 172.21.15.84:0/269289891 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077800b860 con 0x7f07880675f0 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.630+0000 7f07867fc700 1 -- 172.21.15.84:0/269289891 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800bc20 con 0x7f07880675f0 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.631+0000 7f078dd74700 1 -- 172.21.15.84:0/269289891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 msgr2=0x7f0788067a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.631+0000 7f078dd74700 1 --2- 172.21.15.84:0/269289891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 0x7f0788067a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f07780099b0 tx=0x7f0778009250 comp rx=0 tx=0).stop 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.631+0000 7f078dd74700 1 -- 172.21.15.84:0/269289891 shutdown_connections 2023-10-06T02:55:17.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.631+0000 7f078dd74700 1 --2- 172.21.15.84:0/269289891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 0x7f0788067a10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.631+0000 7f078dd74700 1 --2- 172.21.15.84:0/269289891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 0x7f078806f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.631+0000 7f078dd74700 1 -- 172.21.15.84:0/269289891 >> 172.21.15.84:0/269289891 conn(0x7f07880cdef0 msgr2=0x7f07880c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:17.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.631+0000 7f078dd74700 1 -- 172.21.15.84:0/269289891 shutdown_connections 2023-10-06T02:55:17.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.631+0000 7f078dd74700 1 -- 172.21.15.84:0/269289891 wait complete. 2023-10-06T02:55:17.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.632+0000 7f078dd74700 1 Processor -- start 2023-10-06T02:55:17.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.632+0000 7f078dd74700 1 -- start start 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f078dd74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 0x7f0788157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f078dd74700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 0x7f07880aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f078dd74700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f078815caf0 0x7f07880af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f078dd74700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078815b5c0 con 0x7f07880675f0 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f078dd74700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078816da40 con 0x7f078815caf0 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f078dd74700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078816d110 con 0x7f07880caad0 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f07877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 0x7f0788157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f07877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 0x7f0788157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50948/0 (socket says 172.21.15.84:50948) 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f07877fe700 1 -- 172.21.15.84:0/2467747025 learned_addr learned my addr 172.21.15.84:0/2467747025 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f0786ffd700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 0x7f07880aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f0787fff700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f078815caf0 0x7f07880af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f07877fe700 1 -- 172.21.15.84:0/2467747025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 msgr2=0x7f07880aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f07877fe700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 0x7f07880aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f07877fe700 1 -- 172.21.15.84:0/2467747025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f078815caf0 msgr2=0x7f07880af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f07877fe700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f078815caf0 0x7f07880af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f07877fe700 1 -- 172.21.15.84:0/2467747025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780094f0 con 0x7f07880675f0 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.633+0000 7f07877fe700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 0x7f0788157310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f078000c8e0 tx=0x7f0780001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.634+0000 7f076f7fe700 1 -- 172.21.15.84:0/2467747025 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780006ba0 con 0x7f07880675f0 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.634+0000 7f076f7fe700 1 -- 172.21.15.84:0/2467747025 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0780006d00 con 0x7f07880675f0 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.634+0000 7f076f7fe700 1 -- 172.21.15.84:0/2467747025 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780012880 con 0x7f07880675f0 2023-10-06T02:55:17.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.634+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078816d3f0 con 0x7f07880675f0 2023-10-06T02:55:17.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.634+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0788157850 con 0x7f07880675f0 2023-10-06T02:55:17.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.635+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078816dd20 con 0x7f07880675f0 2023-10-06T02:55:17.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.635+0000 7f076f7fe700 1 -- 172.21.15.84:0/2467747025 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0780012c70 con 0x7f07880675f0 2023-10-06T02:55:17.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.635+0000 7f076f7fe700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0774066f30 0x7f07740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.635+0000 7f076f7fe700 1 -- 172.21.15.84:0/2467747025 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f07800846b0 con 0x7f07880675f0 2023-10-06T02:55:17.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.635+0000 7f0786ffd700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0774066f30 0x7f07740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.636+0000 7f0786ffd700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0774066f30 0x7f07740693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07880b1540 tx=0x7f077c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:17.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.639+0000 7f076f7fe700 1 -- 172.21.15.84:0/2467747025 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07800514d0 con 0x7f07880675f0 2023-10-06T02:55:17.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.825+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0788064ad0 con 0x7f07880675f0 2023-10-06T02:55:17.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.826+0000 7f076f7fe700 1 -- 172.21.15.84:0/2467747025 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f0780054af0 con 0x7f07880675f0 2023-10-06T02:55:17.826 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:17.827 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:17.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0774066f30 msgr2=0x7f07740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0774066f30 0x7f07740693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07880b1540 tx=0x7f077c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 msgr2=0x7f0788157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 0x7f0788157310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f078000c8e0 tx=0x7f0780001710 comp rx=0 tx=0).stop 2023-10-06T02:55:17.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 shutdown_connections 2023-10-06T02:55:17.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0774066f30 0x7f07740693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f078815caf0 0x7f07880af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07880675f0 0x7f0788157310 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 --2- 172.21.15.84:0/2467747025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07880caad0 0x7f07880aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 >> 172.21.15.84:0/2467747025 conn(0x7f07880cdef0 msgr2=0x7f07880c9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:17.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 shutdown_connections 2023-10-06T02:55:17.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.828+0000 7f078dd74700 1 -- 172.21.15.84:0/2467747025 wait complete. 2023-10-06T02:55:17.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:55:17.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.958+0000 7feaaa63f700 1 Processor -- start 2023-10-06T02:55:17.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.958+0000 7feaaa63f700 1 -- start start 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.958+0000 7feaaa63f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feaa4070880 0x7feaa406e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.958+0000 7feaaa63f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa406e290 con 0x7feaa40cbcd0 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaaa63f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa406ec60 con 0x7feaa4157360 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaaa63f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa406dc80 con 0x7feaa4070880 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa8bdc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feaa4070880 0x7feaa406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feaa40cbcd0 0x7feaa4157730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36618/0 (socket says 172.21.15.84:36618) 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa37fe700 1 -- 172.21.15.84:0/1081350562 learned_addr learned my addr 172.21.15.84:0/1081350562 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa8bdc700 1 -- 172.21.15.84:0/1081350562 >> v1:172.21.15.131:6789/0 conn(0x7feaa4157360 legacy=0x7feaa40cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa8bdc700 1 -- 172.21.15.84:0/1081350562 >> v1:172.21.15.84:6789/0 conn(0x7feaa40cbcd0 legacy=0x7feaa4157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa8bdc700 1 -- 172.21.15.84:0/1081350562 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40b23f0 con 0x7feaa4070880 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa2ffd700 1 -- 172.21.15.84:0/1081350562 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115064037 0 0) 0x7feaa406e290 con 0x7feaa40cbcd0 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa8bdc700 1 --2- 172.21.15.84:0/1081350562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4070880 0x7feaa406e720 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009e60 tx=0x7fea9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0d7061f2656233 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa2ffd700 1 -- 172.21.15.84:0/1081350562 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00e070 con 0x7feaa4070880 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa2ffd700 1 -- 172.21.15.84:0/1081350562 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00bc30 con 0x7feaa4070880 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.959+0000 7feaa2ffd700 1 -- 172.21.15.84:0/1081350562 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c012430 con 0x7feaa4070880 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.960+0000 7feaaa63f700 1 -- 172.21.15.84:0/1081350562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4070880 msgr2=0x7feaa406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.960+0000 7feaaa63f700 1 --2- 172.21.15.84:0/1081350562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4070880 0x7feaa406e720 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009e60 tx=0x7fea9c009780 comp rx=0 tx=0).stop 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.960+0000 7feaaa63f700 1 -- 172.21.15.84:0/1081350562 shutdown_connections 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.960+0000 7feaaa63f700 1 --2- 172.21.15.84:0/1081350562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4070880 0x7feaa406e720 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.960+0000 7feaaa63f700 1 -- 172.21.15.84:0/1081350562 >> 172.21.15.84:0/1081350562 conn(0x7feaa40cd410 msgr2=0x7feaa40b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.960+0000 7feaaa63f700 1 -- 172.21.15.84:0/1081350562 shutdown_connections 2023-10-06T02:55:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.960+0000 7feaaa63f700 1 -- 172.21.15.84:0/1081350562 wait complete. 2023-10-06T02:55:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.961+0000 7feaaa63f700 1 Processor -- start 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.961+0000 7feaaa63f700 1 -- start start 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaaa63f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feaa4070880 0x7feaa40c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaaa63f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaa40cbcd0 0x7feaa414b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaaa63f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4157360 0x7feaa4148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaaa63f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa414b7a0 con 0x7feaa4157360 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaaa63f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40ca650 con 0x7feaa40cbcd0 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaaa63f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40c9a40 con 0x7feaa4070880 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa8bdc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4157360 0x7feaa4148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa8bdc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4157360 0x7feaa4148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50962/0 (socket says 172.21.15.84:50962) 2023-10-06T02:55:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa8bdc700 1 -- 172.21.15.84:0/632604895 learned_addr learned my addr 172.21.15.84:0/632604895 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa3fff700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feaa4070880 0x7feaa40c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa8bdc700 1 -- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feaa4070880 msgr2=0x7feaa40c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa37fe700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaa40cbcd0 0x7feaa414b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa8bdc700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feaa4070880 0x7feaa40c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa8bdc700 1 -- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaa40cbcd0 msgr2=0x7feaa414b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa8bdc700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaa40cbcd0 0x7feaa414b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa8bdc700 1 -- 172.21.15.84:0/632604895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c009a20 con 0x7feaa4157360 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa3fff700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feaa4070880 0x7feaa40c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.962+0000 7feaa37fe700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaa40cbcd0 0x7feaa414b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.963+0000 7feaa8bdc700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4157360 0x7feaa4148b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feaa406d730 tx=0x7fea9c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.963+0000 7fea8bfff700 1 -- 172.21.15.84:0/632604895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c01b630 con 0x7feaa4157360 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.963+0000 7fea8bfff700 1 -- 172.21.15.84:0/632604895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c01b790 con 0x7feaa4157360 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.963+0000 7fea8bfff700 1 -- 172.21.15.84:0/632604895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c01bb50 con 0x7feaa4157360 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.963+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa40c9d20 con 0x7feaa4157360 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.963+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa40ca2e0 con 0x7feaa4157360 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.964+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa4064ad0 con 0x7feaa4157360 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.964+0000 7fea8bfff700 1 -- 172.21.15.84:0/632604895 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea9c01c400 con 0x7feaa4157360 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.964+0000 7fea8bfff700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea90066f30 0x7fea900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.964+0000 7fea8bfff700 1 -- 172.21.15.84:0/632604895 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fea9c086960 con 0x7feaa4157360 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.964+0000 7feaa3fff700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea90066f30 0x7fea900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.965+0000 7feaa3fff700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea90066f30 0x7fea900693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea940017a0 tx=0x7fea94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:17.969+0000 7fea8bfff700 1 -- 172.21.15.84:0/632604895 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea9c053780 con 0x7feaa4157360 2023-10-06T02:55:18.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.194+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feaa40b26d0 con 0x7feaa4157360 2023-10-06T02:55:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.276+0000 7fea8bfff700 1 -- 172.21.15.84:0/632604895 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fea9c056da0 con 0x7feaa4157360 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea90066f30 msgr2=0x7fea900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea90066f30 0x7fea900693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea940017a0 tx=0x7fea94009040 comp rx=0 tx=0).stop 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4157360 msgr2=0x7feaa4148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4157360 0x7feaa4148b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feaa406d730 tx=0x7fea9c019000 comp rx=0 tx=0).stop 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 shutdown_connections 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea90066f30 0x7fea900693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feaa4157360 0x7feaa4148b60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feaa4070880 0x7feaa40c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 --2- 172.21.15.84:0/632604895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaa40cbcd0 0x7feaa414b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 >> 172.21.15.84:0/632604895 conn(0x7feaa40cd410 msgr2=0x7feaa4147d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:18.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 shutdown_connections 2023-10-06T02:55:18.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.279+0000 7feaaa63f700 1 -- 172.21.15.84:0/632604895 wait complete. 2023-10-06T02:55:18.291 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:55:18.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.407+0000 7fdc2a10c700 1 Processor -- start 2023-10-06T02:55:18.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.407+0000 7fdc2a10c700 1 -- start start 2023-10-06T02:55:18.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.408+0000 7fdc2a10c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc240cc860 0x7fdc240ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:18.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.408+0000 7fdc2a10c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc2406eff0 0x7fdc240c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:18.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.408+0000 7fdc2a10c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240675f0 0x7fdc24067a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:18.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.408+0000 7fdc2a10c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc24159c00 con 0x7fdc2406eff0 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.408+0000 7fdc2a10c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2406f460 con 0x7fdc240cc860 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.408+0000 7fdc2a10c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2415abb0 con 0x7fdc240675f0 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.408+0000 7fdc22ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc2406eff0 0x7fdc240c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc22ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc2406eff0 0x7fdc240c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50972/0 (socket says 172.21.15.84:50972) 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc22ffd700 1 -- 172.21.15.84:0/3057977045 learned_addr learned my addr 172.21.15.84:0/3057977045 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc23fff700 1 --2- 172.21.15.84:0/3057977045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240675f0 0x7fdc24067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc237fe700 1 --2- 172.21.15.84:0/3057977045 >> v2:172.21.15.131:3300/0 conn(0x7fdc240cc860 0x7fdc240ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc22ffd700 1 -- 172.21.15.84:0/3057977045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240675f0 msgr2=0x7fdc24067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc22ffd700 1 --2- 172.21.15.84:0/3057977045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240675f0 0x7fdc24067a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc22ffd700 1 -- 172.21.15.84:0/3057977045 >> v2:172.21.15.131:3300/0 conn(0x7fdc240cc860 msgr2=0x7fdc240ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc22ffd700 1 --2- 172.21.15.84:0/3057977045 >> v2:172.21.15.131:3300/0 conn(0x7fdc240cc860 0x7fdc240ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc22ffd700 1 -- 172.21.15.84:0/3057977045 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240cbfb0 con 0x7fdc2406eff0 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc237fe700 1 --2- 172.21.15.84:0/3057977045 >> v2:172.21.15.131:3300/0 conn(0x7fdc240cc860 0x7fdc240ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc22ffd700 1 --2- 172.21.15.84:0/3057977045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 0x7fdc240c9260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc240cacd0 tx=0x7fdc18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1056f77939fb586 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc227fc700 1 -- 172.21.15.84:0/3057977045 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18009ea0 con 0x7fdc2406eff0 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc227fc700 1 -- 172.21.15.84:0/3057977045 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1800b820 con 0x7fdc2406eff0 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.409+0000 7fdc227fc700 1 -- 172.21.15.84:0/3057977045 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800bbc0 con 0x7fdc2406eff0 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.410+0000 7fdc2a10c700 1 -- 172.21.15.84:0/3057977045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 msgr2=0x7fdc240c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.410+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/3057977045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 0x7fdc240c9260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc240cacd0 tx=0x7fdc18009250 comp rx=0 tx=0).stop 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.410+0000 7fdc2a10c700 1 -- 172.21.15.84:0/3057977045 shutdown_connections 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.410+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/3057977045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240675f0 0x7fdc24067a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.410+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/3057977045 >> v2:172.21.15.131:3300/0 conn(0x7fdc240cc860 0x7fdc240ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.410+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/3057977045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 0x7fdc240c9260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.410+0000 7fdc2a10c700 1 -- 172.21.15.84:0/3057977045 >> 172.21.15.84:0/3057977045 conn(0x7fdc240691d0 msgr2=0x7fdc240cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:18.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.410+0000 7fdc2a10c700 1 -- 172.21.15.84:0/3057977045 shutdown_connections 2023-10-06T02:55:18.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.410+0000 7fdc2a10c700 1 -- 172.21.15.84:0/3057977045 wait complete. 2023-10-06T02:55:18.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.411+0000 7fdc2a10c700 1 Processor -- start 2023-10-06T02:55:18.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.411+0000 7fdc2a10c700 1 -- start start 2023-10-06T02:55:18.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc2a10c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240675f0 0x7fdc240b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc2a10c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 0x7fdc24155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc2a10c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240cc860 0x7fdc24152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc2a10c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24153720 con 0x7fdc2406eff0 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc2a10c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc241542a0 con 0x7fdc240675f0 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc2a10c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24153970 con 0x7fdc240cc860 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc22ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 0x7fdc24155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc22ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 0x7fdc24155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50986/0 (socket says 172.21.15.84:50986) 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc22ffd700 1 -- 172.21.15.84:0/2330931712 learned_addr learned my addr 172.21.15.84:0/2330931712 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc23fff700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240cc860 0x7fdc24152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:18.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc237fe700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240675f0 0x7fdc240b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc22ffd700 1 -- 172.21.15.84:0/2330931712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240cc860 msgr2=0x7fdc24152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc22ffd700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240cc860 0x7fdc24152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc22ffd700 1 -- 172.21.15.84:0/2330931712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240675f0 msgr2=0x7fdc240b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc22ffd700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240675f0 0x7fdc240b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc22ffd700 1 -- 172.21.15.84:0/2330931712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180094f0 con 0x7fdc2406eff0 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc23fff700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240cc860 0x7fdc24152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc22ffd700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 0x7fdc24155330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc180090b0 tx=0x7fdc18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc0b7fe700 1 -- 172.21.15.84:0/2330931712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800bba0 con 0x7fdc2406eff0 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc0b7fe700 1 -- 172.21.15.84:0/2330931712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1801a450 con 0x7fdc2406eff0 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc24153c50 con 0x7fdc2406eff0 2023-10-06T02:55:18.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc0b7fe700 1 -- 172.21.15.84:0/2330931712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1801a7d0 con 0x7fdc2406eff0 2023-10-06T02:55:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.412+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc24155870 con 0x7fdc2406eff0 2023-10-06T02:55:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.413+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2406c210 con 0x7fdc2406eff0 2023-10-06T02:55:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.414+0000 7fdc0b7fe700 1 -- 172.21.15.84:0/2330931712 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc1801ab80 con 0x7fdc2406eff0 2023-10-06T02:55:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.414+0000 7fdc0b7fe700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc10066f30 0x7fdc100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.414+0000 7fdc0b7fe700 1 -- 172.21.15.84:0/2330931712 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdc18085ef0 con 0x7fdc2406eff0 2023-10-06T02:55:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.414+0000 7fdc237fe700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc10066f30 0x7fdc100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.415+0000 7fdc237fe700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc10066f30 0x7fdc100693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc14006f00 tx=0x7fdc14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:18.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.418+0000 7fdc0b7fe700 1 -- 172.21.15.84:0/2330931712 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc18052d10 con 0x7fdc2406eff0 2023-10-06T02:55:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:18.644+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc24154630 con 0x7fdc2406eff0 2023-10-06T02:55:19.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.283+0000 7fdc0b7fe700 1 -- 172.21.15.84:0/2330931712 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc18056330 con 0x7fdc2406eff0 2023-10-06T02:55:19.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc10066f30 msgr2=0x7fdc100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc10066f30 0x7fdc100693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc14006f00 tx=0x7fdc14008040 comp rx=0 tx=0).stop 2023-10-06T02:55:19.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 msgr2=0x7fdc24155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 0x7fdc24155330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc180090b0 tx=0x7fdc18017000 comp rx=0 tx=0).stop 2023-10-06T02:55:19.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 shutdown_connections 2023-10-06T02:55:19.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc10066f30 0x7fdc100693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc240675f0 0x7fdc240b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc240cc860 0x7fdc24152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 --2- 172.21.15.84:0/2330931712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc2406eff0 0x7fdc24155330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 >> 172.21.15.84:0/2330931712 conn(0x7fdc240691d0 msgr2=0x7fdc240aa910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:19.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 shutdown_connections 2023-10-06T02:55:19.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.286+0000 7fdc2a10c700 1 -- 172.21.15.84:0/2330931712 wait complete. 2023-10-06T02:55:19.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:19.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.411+0000 7f5343e44700 1 Processor -- start 2023-10-06T02:55:19.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.411+0000 7f5343e44700 1 -- start start 2023-10-06T02:55:19.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5343e44700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f533c1595a0 0x7f533c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5343e44700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f533c0b07a0 0x7f533c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5343e44700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533c0b0ca0 con 0x7f533c0b49e0 2023-10-06T02:55:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5343e44700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c0b0f80 con 0x7f533c1595a0 2023-10-06T02:55:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5343e44700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c0b1260 con 0x7f533c0b07a0 2023-10-06T02:55:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5341be0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f533c1595a0 0x7f533c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5341be0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f533c1595a0 0x7f533c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50996/0 (socket says 172.21.15.84:50996) 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5341be0700 1 -- 172.21.15.84:0/1557383118 learned_addr learned my addr 172.21.15.84:0/1557383118 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f53423e1700 1 --2- 172.21.15.84:0/1557383118 >> v2:172.21.15.131:3300/0 conn(0x7f533c0b07a0 0x7f533c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5341be0700 1 -- 172.21.15.84:0/1557383118 >> v2:172.21.15.131:3300/0 conn(0x7f533c0b07a0 msgr2=0x7f533c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.412+0000 7f5341be0700 1 --2- 172.21.15.84:0/1557383118 >> v2:172.21.15.131:3300/0 conn(0x7f533c0b07a0 0x7f533c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5341be0700 1 -- 172.21.15.84:0/1557383118 >> v1:172.21.15.131:6789/0 conn(0x7f533c0b49e0 legacy=0x7f533c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5341be0700 1 -- 172.21.15.84:0/1557383118 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c0b1540 con 0x7f533c1595a0 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5340bde700 1 -- 172.21.15.84:0/1557383118 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804915525 0 0) 0x7f533c0b0ca0 con 0x7f533c0b49e0 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5341be0700 1 --2- 172.21.15.84:0/1557383118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c1595a0 0x7f533c0aa570 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5338009f70 tx=0x7f5338009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7eabd98491cd7a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5340bde700 1 -- 172.21.15.84:0/1557383118 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533800e070 con 0x7f533c1595a0 2023-10-06T02:55:19.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5340bde700 1 -- 172.21.15.84:0/1557383118 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533800ba90 con 0x7f533c1595a0 2023-10-06T02:55:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5340bde700 1 -- 172.21.15.84:0/1557383118 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380092e0 con 0x7f533c1595a0 2023-10-06T02:55:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5343e44700 1 -- 172.21.15.84:0/1557383118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c1595a0 msgr2=0x7f533c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5343e44700 1 --2- 172.21.15.84:0/1557383118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c1595a0 0x7f533c0aa570 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5338009f70 tx=0x7f5338009840 comp rx=0 tx=0).stop 2023-10-06T02:55:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5343e44700 1 -- 172.21.15.84:0/1557383118 shutdown_connections 2023-10-06T02:55:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.413+0000 7f5343e44700 1 --2- 172.21.15.84:0/1557383118 >> v2:172.21.15.131:3300/0 conn(0x7f533c0b07a0 0x7f533c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.414+0000 7f5343e44700 1 --2- 172.21.15.84:0/1557383118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c1595a0 0x7f533c0aa570 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.414+0000 7f5343e44700 1 -- 172.21.15.84:0/1557383118 >> 172.21.15.84:0/1557383118 conn(0x7f533c099830 msgr2=0x7f533c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.414+0000 7f5343e44700 1 -- 172.21.15.84:0/1557383118 shutdown_connections 2023-10-06T02:55:19.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.414+0000 7f5343e44700 1 -- 172.21.15.84:0/1557383118 wait complete. 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.415+0000 7f5343e44700 1 Processor -- start 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.415+0000 7f5343e44700 1 -- start start 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.415+0000 7f5343e44700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c0b07a0 0x7f533c0ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.415+0000 7f5343e44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c0b49e0 0x7f533c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.415+0000 7f5343e44700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c1595a0 0x7f533c0ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.415+0000 7f5343e44700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c157780 con 0x7f533c0b49e0 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.415+0000 7f5343e44700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c157c30 con 0x7f533c1595a0 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.415+0000 7f5343e44700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0abda0 con 0x7f533c0b07a0 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53413df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c0b49e0 0x7f533c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53413df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c0b49e0 0x7f533c157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51010/0 (socket says 172.21.15.84:51010) 2023-10-06T02:55:19.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53413df700 1 -- 172.21.15.84:0/838977815 learned_addr learned my addr 172.21.15.84:0/838977815 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f5341be0700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c0b07a0 0x7f533c0ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53423e1700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c1595a0 0x7f533c0ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53413df700 1 -- 172.21.15.84:0/838977815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c0b07a0 msgr2=0x7f533c0ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53413df700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c0b07a0 0x7f533c0ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53413df700 1 -- 172.21.15.84:0/838977815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c1595a0 msgr2=0x7f533c0ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53413df700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c1595a0 0x7f533c0ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53413df700 1 -- 172.21.15.84:0/838977815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338009ae0 con 0x7f533c0b49e0 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f53413df700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c0b49e0 0x7f533c157240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f532c00c7e0 tx=0x7f532c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f5331ffb700 1 -- 172.21.15.84:0/838977815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c011590 con 0x7f533c0b49e0 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f5331ffb700 1 -- 172.21.15.84:0/838977815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c011710 con 0x7f533c0b49e0 2023-10-06T02:55:19.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c0ac080 con 0x7f533c0b49e0 2023-10-06T02:55:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f5331ffb700 1 -- 172.21.15.84:0/838977815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c011ad0 con 0x7f533c0b49e0 2023-10-06T02:55:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.416+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c0ac360 con 0x7f533c0b49e0 2023-10-06T02:55:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.417+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533c064ad0 con 0x7f533c0b49e0 2023-10-06T02:55:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.418+0000 7f5331ffb700 1 -- 172.21.15.84:0/838977815 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f532c01b3b0 con 0x7f533c0b49e0 2023-10-06T02:55:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.418+0000 7f5331ffb700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5320066f30 0x7f53200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.418+0000 7f5331ffb700 1 -- 172.21.15.84:0/838977815 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f532c083e00 con 0x7f533c0b49e0 2023-10-06T02:55:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.418+0000 7f5341be0700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5320066f30 0x7f53200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.418+0000 7f5341be0700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5320066f30 0x7f53200693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5338009ab0 tx=0x7f5338018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:19.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.422+0000 7f5331ffb700 1 -- 172.21.15.84:0/838977815 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f532c050c20 con 0x7f533c0b49e0 2023-10-06T02:55:19.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.647+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f533c0b1820 con 0x7f533c0b49e0 2023-10-06T02:55:19.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.648+0000 7f5331ffb700 1 -- 172.21.15.84:0/838977815 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7f532c017070 con 0x7f533c0b49e0 2023-10-06T02:55:19.649 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:19.649 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:19.276318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:55:19.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5320066f30 msgr2=0x7f53200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5320066f30 0x7f53200693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5338009ab0 tx=0x7f5338018000 comp rx=0 tx=0).stop 2023-10-06T02:55:19.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c0b49e0 msgr2=0x7f533c157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c0b49e0 0x7f533c157240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f532c00c7e0 tx=0x7f532c007d90 comp rx=0 tx=0).stop 2023-10-06T02:55:19.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 shutdown_connections 2023-10-06T02:55:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5320066f30 0x7f53200693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c1595a0 0x7f533c0ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c0b07a0 0x7f533c0ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 --2- 172.21.15.84:0/838977815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f533c0b49e0 0x7f533c157240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 >> 172.21.15.84:0/838977815 conn(0x7f533c099830 msgr2=0x7f533c1588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 shutdown_connections 2023-10-06T02:55:19.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.650+0000 7f5343e44700 1 -- 172.21.15.84:0/838977815 wait complete. 2023-10-06T02:55:19.653 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-10-06T02:55:19.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.776+0000 7f8f8ee8d700 1 Processor -- start 2023-10-06T02:55:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.776+0000 7f8f8ee8d700 1 -- start start 2023-10-06T02:55:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8ee8d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8f880cdea0 0x7f8f880c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8ee8d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8815b210 con 0x7f8f88157080 2023-10-06T02:55:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8ee8d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f880ce4f0 con 0x7f8f88157450 2023-10-06T02:55:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8ee8d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8815bdb0 con 0x7f8f880cdea0 2023-10-06T02:55:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8de8b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8f88157080 0x7f8f8806d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36622/0 (socket says 172.21.15.84:36622) 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8de8b700 1 -- 172.21.15.84:0/2335322895 learned_addr learned my addr 172.21.15.84:0/2335322895 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8e68c700 1 --2- 172.21.15.84:0/2335322895 >> v2:172.21.15.84:3300/0 conn(0x7f8f880cdea0 0x7f8f880c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8ce89700 1 -- 172.21.15.84:0/2335322895 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763802468 0 0) 0x7f8f8815b210 con 0x7f8f88157080 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8ce89700 1 -- 172.21.15.84:0/2335322895 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f70003570 con 0x7f8f88157080 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8e68c700 1 -- 172.21.15.84:0/2335322895 >> v1:172.21.15.131:6789/0 conn(0x7f8f88157450 legacy=0x7f8f8815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.777+0000 7f8f8e68c700 1 -- 172.21.15.84:0/2335322895 >> v1:172.21.15.84:6789/0 conn(0x7f8f88157080 legacy=0x7f8f8806d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8e68c700 1 -- 172.21.15.84:0/2335322895 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880ce7d0 con 0x7f8f880cdea0 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8e68c700 1 --2- 172.21.15.84:0/2335322895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 0x7f8f880c9fd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8f800098e0 tx=0x7f8f800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbe295d3e2650db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ce89700 1 -- 172.21.15.84:0/2335322895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000b640 con 0x7f8f880cdea0 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ce89700 1 -- 172.21.15.84:0/2335322895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8000b7a0 con 0x7f8f880cdea0 2023-10-06T02:55:19.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ce89700 1 -- 172.21.15.84:0/2335322895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000bb20 con 0x7f8f880cdea0 2023-10-06T02:55:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2335322895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 msgr2=0x7f8f880c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ee8d700 1 --2- 172.21.15.84:0/2335322895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 0x7f8f880c9fd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8f800098e0 tx=0x7f8f800091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2335322895 shutdown_connections 2023-10-06T02:55:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ee8d700 1 --2- 172.21.15.84:0/2335322895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 0x7f8f880c9fd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2335322895 >> 172.21.15.84:0/2335322895 conn(0x7f8f8806b540 msgr2=0x7f8f8806b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2335322895 shutdown_connections 2023-10-06T02:55:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.778+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2335322895 wait complete. 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.779+0000 7f8f8ee8d700 1 Processor -- start 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.779+0000 7f8f8ee8d700 1 -- start start 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8ee8d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 0x7f8f8814ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8ee8d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157080 0x7f8f881551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8ee8d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f88157450 0x7f8f880cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8ee8d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8815a6c0 con 0x7f8f880cdea0 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8ee8d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881597d0 con 0x7f8f88157080 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8ee8d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88159ab0 con 0x7f8f88157450 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8de8b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 0x7f8f8814ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8de8b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 0x7f8f8814ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51026/0 (socket says 172.21.15.84:51026) 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8de8b700 1 -- 172.21.15.84:0/2087957167 learned_addr learned my addr 172.21.15.84:0/2087957167 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8e68c700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f88157450 0x7f8f880cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.780+0000 7f8f8d68a700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157080 0x7f8f881551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f8de8b700 1 -- 172.21.15.84:0/2087957167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f88157450 msgr2=0x7f8f880cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f8de8b700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f88157450 0x7f8f880cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f8de8b700 1 -- 172.21.15.84:0/2087957167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157080 msgr2=0x7f8f881551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f8de8b700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157080 0x7f8f881551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f8de8b700 1 -- 172.21.15.84:0/2087957167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f80009420 con 0x7f8f880cdea0 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f8de8b700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 0x7f8f8814ac30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800cd30 tx=0x7f8f78001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f85ffb700 1 -- 172.21.15.84:0/2087957167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800ab70 con 0x7f8f880cdea0 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f85ffb700 1 -- 172.21.15.84:0/2087957167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7800acf0 con 0x7f8f880cdea0 2023-10-06T02:55:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f88159d90 con 0x7f8f880cdea0 2023-10-06T02:55:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f85ffb700 1 -- 172.21.15.84:0/2087957167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78007340 con 0x7f8f880cdea0 2023-10-06T02:55:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.781+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8815a350 con 0x7f8f880cdea0 2023-10-06T02:55:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.782+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8814baf0 con 0x7f8f880cdea0 2023-10-06T02:55:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.782+0000 7f8f85ffb700 1 -- 172.21.15.84:0/2087957167 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f78007770 con 0x7f8f880cdea0 2023-10-06T02:55:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.783+0000 7f8f85ffb700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8f74066f30 0x7f8f740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.783+0000 7f8f85ffb700 1 -- 172.21.15.84:0/2087957167 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8f78084f00 con 0x7f8f880cdea0 2023-10-06T02:55:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.783+0000 7f8f8d68a700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8f74066f30 0x7f8f740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:19.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.783+0000 7f8f8d68a700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8f74066f30 0x7f8f740693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8f88158920 tx=0x7f8f7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:19.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.787+0000 7f8f85ffb700 1 -- 172.21.15.84:0/2087957167 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f8814baf0 con 0x7f8f880cdea0 2023-10-06T02:55:19.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.969+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f8814baf0 con 0x7f8f880cdea0 2023-10-06T02:55:19.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.970+0000 7f8f85ffb700 1 -- 172.21.15.84:0/2087957167 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f8f8814baf0 con 0x7f8f880cdea0 2023-10-06T02:55:19.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:19.971 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:19.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.971+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8f74066f30 msgr2=0x7f8f740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.971+0000 7f8f8ee8d700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8f74066f30 0x7f8f740693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8f88158920 tx=0x7f8f7c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 msgr2=0x7f8f8814ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 0x7f8f8814ac30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800cd30 tx=0x7f8f78001b10 comp rx=0 tx=0).stop 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 shutdown_connections 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8f74066f30 0x7f8f740693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f88157450 0x7f8f880cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f880cdea0 0x7f8f8814ac30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 --2- 172.21.15.84:0/2087957167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88157080 0x7f8f881551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 >> 172.21.15.84:0/2087957167 conn(0x7f8f8806b540 msgr2=0x7f8f8815b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:19.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 shutdown_connections 2023-10-06T02:55:19.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:19.972+0000 7f8f8ee8d700 1 -- 172.21.15.84:0/2087957167 wait complete. 2023-10-06T02:55:19.985 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:55:19.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:55:20.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.098+0000 7f4017fff700 1 Processor -- start 2023-10-06T02:55:20.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.098+0000 7f4017fff700 1 -- start start 2023-10-06T02:55:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.098+0000 7f4017fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f40180b2860 0x7f401806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.098+0000 7f4017fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40180af6b0 0x7f4018157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.098+0000 7f4017fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401806b4b0 con 0x7f40181573a0 2023-10-06T02:55:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.098+0000 7f4017fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401806abb0 con 0x7f40180af6b0 2023-10-06T02:55:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.098+0000 7f4017fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40180c9800 con 0x7f40180b2860 2023-10-06T02:55:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f4016ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f40181573a0 0x7f40180b2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36636/0 (socket says 172.21.15.84:36636) 2023-10-06T02:55:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f4016ffd700 1 -- 172.21.15.84:0/1202647159 learned_addr learned my addr 172.21.15.84:0/1202647159 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:20.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f40177fe700 1 --2- 172.21.15.84:0/1202647159 >> v2:172.21.15.84:3300/0 conn(0x7f40180af6b0 0x7f4018157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f40167fc700 1 --2- 172.21.15.84:0/1202647159 >> v2:172.21.15.131:3300/0 conn(0x7f40180b2860 0x7f401806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f4015ffb700 1 -- 172.21.15.84:0/1202647159 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836001051 0 0) 0x7f401806b4b0 con 0x7f40181573a0 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f4015ffb700 1 -- 172.21.15.84:0/1202647159 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4000003570 con 0x7f40181573a0 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f40177fe700 1 -- 172.21.15.84:0/1202647159 >> v2:172.21.15.131:3300/0 conn(0x7f40180b2860 msgr2=0x7f401806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f40177fe700 1 --2- 172.21.15.84:0/1202647159 >> v2:172.21.15.131:3300/0 conn(0x7f40180b2860 0x7f401806eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f40177fe700 1 -- 172.21.15.84:0/1202647159 >> v1:172.21.15.84:6789/0 conn(0x7f40181573a0 legacy=0x7f40180b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f40177fe700 1 -- 172.21.15.84:0/1202647159 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401806a610 con 0x7f40180af6b0 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f40177fe700 1 --2- 172.21.15.84:0/1202647159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40180af6b0 0x7f4018157770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40180ce170 tx=0x7f40080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc048e18ae0bb2df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f4015ffb700 1 -- 172.21.15.84:0/1202647159 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008011630 con 0x7f40180af6b0 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f4015ffb700 1 -- 172.21.15.84:0/1202647159 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4008011790 con 0x7f40180af6b0 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.099+0000 7f4015ffb700 1 -- 172.21.15.84:0/1202647159 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008011b30 con 0x7f40180af6b0 2023-10-06T02:55:20.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.100+0000 7f4017fff700 1 -- 172.21.15.84:0/1202647159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40180af6b0 msgr2=0x7f4018157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.100+0000 7f4017fff700 1 --2- 172.21.15.84:0/1202647159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40180af6b0 0x7f4018157770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40180ce170 tx=0x7f40080091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.100+0000 7f4017fff700 1 -- 172.21.15.84:0/1202647159 shutdown_connections 2023-10-06T02:55:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.100+0000 7f4017fff700 1 --2- 172.21.15.84:0/1202647159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40180af6b0 0x7f4018157770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.100+0000 7f4017fff700 1 --2- 172.21.15.84:0/1202647159 >> v2:172.21.15.131:3300/0 conn(0x7f40180b2860 0x7f401806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.100+0000 7f4017fff700 1 -- 172.21.15.84:0/1202647159 >> 172.21.15.84:0/1202647159 conn(0x7f40180691d0 msgr2=0x7f40180aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:20.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.100+0000 7f4017fff700 1 -- 172.21.15.84:0/1202647159 shutdown_connections 2023-10-06T02:55:20.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.100+0000 7f4017fff700 1 -- 172.21.15.84:0/1202647159 wait complete. 2023-10-06T02:55:20.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.101+0000 7f4017fff700 1 Processor -- start 2023-10-06T02:55:20.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.101+0000 7f4017fff700 1 -- start start 2023-10-06T02:55:20.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f4017fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180af6b0 0x7f40180a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f4017fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40180b2860 0x7f40180ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f4017fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40181573a0 0x7f40180ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f4017fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40180ac040 con 0x7f40181573a0 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f4017fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40180cc920 con 0x7f40180af6b0 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f4017fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40180cbff0 con 0x7f40180b2860 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40177fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40181573a0 0x7f40180ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40177fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40181573a0 0x7f40180ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51058/0 (socket says 172.21.15.84:51058) 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40177fe700 1 -- 172.21.15.84:0/3857568672 learned_addr learned my addr 172.21.15.84:0/3857568672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f4016ffd700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180af6b0 0x7f40180a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40167fc700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40180b2860 0x7f40180ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40177fe700 1 -- 172.21.15.84:0/3857568672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40180b2860 msgr2=0x7f40180ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40177fe700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40180b2860 0x7f40180ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40177fe700 1 -- 172.21.15.84:0/3857568672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180af6b0 msgr2=0x7f40180a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40177fe700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180af6b0 0x7f40180a60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40177fe700 1 -- 172.21.15.84:0/3857568672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008009420 con 0x7f40181573a0 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f40177fe700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40181573a0 0x7f40180ccdb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4008009f50 tx=0x7f4008017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.102+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3857568672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008011b10 con 0x7f40181573a0 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.103+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3857568672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40080233f0 con 0x7f40181573a0 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.103+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40180cc2d0 con 0x7f40181573a0 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.103+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3857568672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008023790 con 0x7f40181573a0 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.103+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40180aa890 con 0x7f40181573a0 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.104+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401805f270 con 0x7f40181573a0 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.104+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3857568672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40080193b0 con 0x7f40181573a0 2023-10-06T02:55:20.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.104+0000 7f3ffeffd700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4004066f30 0x7f40040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.104+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3857568672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4008085fa0 con 0x7f40181573a0 2023-10-06T02:55:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.104+0000 7f4016ffd700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4004066f30 0x7f40040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.105+0000 7f4016ffd700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4004066f30 0x7f40040693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4010005c50 tx=0x7f4010009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:20.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.108+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3857568672 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40080b75a0 con 0x7f40181573a0 2023-10-06T02:55:20.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.288+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40180c8ef0 con 0x7f4004066f30 2023-10-06T02:55:20.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.299+0000 7f3ffeffd700 1 -- 172.21.15.84:0/3857568672 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367397 (secure 0 0 0) 0x7f40180c8ef0 con 0x7f4004066f30 2023-10-06T02:55:20.306 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.302+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4004066f30 msgr2=0x7f40040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.302+0000 7f4017fff700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4004066f30 0x7f40040693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4010005c50 tx=0x7f4010009040 comp rx=0 tx=0).stop 2023-10-06T02:55:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.302+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40181573a0 msgr2=0x7f40180ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.302+0000 7f4017fff700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40181573a0 0x7f40180ccdb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4008009f50 tx=0x7f4008017000 comp rx=0 tx=0).stop 2023-10-06T02:55:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.302+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 shutdown_connections 2023-10-06T02:55:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.302+0000 7f4017fff700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4004066f30 0x7f40040693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.303+0000 7f4017fff700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180af6b0 0x7f40180a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.303+0000 7f4017fff700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40181573a0 0x7f40180ccdb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.303+0000 7f4017fff700 1 --2- 172.21.15.84:0/3857568672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f40180b2860 0x7f40180ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.303+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 >> 172.21.15.84:0/3857568672 conn(0x7f40180691d0 msgr2=0x7f40181562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:20.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.303+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 shutdown_connections 2023-10-06T02:55:20.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.303+0000 7f4017fff700 1 -- 172.21.15.84:0/3857568672 wait complete. 2023-10-06T02:55:20.310 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:55:20.316 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-10-06T02:55:19.801313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381788,"kb_used_data":3484,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592932,"statfs":{"total":773094113280,"available":770655162368,"internally_reserved":0,"allocated":3567616,"data_stored":2143255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.567573"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239422+0000","last_change":"2023-10-06T02:55:07.110201+0000","last_active":"2023-10-06T02:55:11.239422+0000","last_peered":"2023-10-06T02:55:11.239422+0000","last_clean":"2023-10-06T02:55:11.239422+0000","last_became_active":"2023-10-06T02:55:07.109835+0000","last_became_peered":"2023-10-06T02:55:07.109835+0000","last_unstale":"2023-10-06T02:55:11.239422+0000","last_undegraded":"2023-10-06T02:55:11.239422+0000","last_fullsized":"2023-10-06T02:55:11.239422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:37.914521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236087+0000","last_change":"2023-10-06T02:55:07.113784+0000","last_active":"2023-10-06T02:55:11.236087+0000","last_peered":"2023-10-06T02:55:11.236087+0000","last_clean":"2023-10-06T02:55:11.236087+0000","last_became_active":"2023-10-06T02:55:07.113542+0000","last_became_peered":"2023-10-06T02:55:07.113542+0000","last_unstale":"2023-10-06T02:55:11.236087+0000","last_undegraded":"2023-10-06T02:55:11.236087+0000","last_fullsized":"2023-10-06T02:55:11.236087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:45.135333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244003+0000","last_change":"2023-10-06T02:55:07.109629+0000","last_active":"2023-10-06T02:55:11.244003+0000","last_peered":"2023-10-06T02:55:11.244003+0000","last_clean":"2023-10-06T02:55:11.244003+0000","last_became_active":"2023-10-06T02:55:07.109299+0000","last_became_peered":"2023-10-06T02:55:07.109299+0000","last_unstale":"2023-10-06T02:55:11.244003+0000","last_undegraded":"2023-10-06T02:55:11.244003+0000","last_fullsized":"2023-10-06T02:55:11.244003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:18.661747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236454+0000","last_change":"2023-10-06T02:55:07.109778+0000","last_active":"2023-10-06T02:55:11.236454+0000","last_peered":"2023-10-06T02:55:11.236454+0000","last_clean":"2023-10-06T02:55:11.236454+0000","last_became_active":"2023-10-06T02:55:07.109509+0000","last_became_peered":"2023-10-06T02:55:07.109509+0000","last_unstale":"2023-10-06T02:55:11.236454+0000","last_undegraded":"2023-10-06T02:55:11.236454+0000","last_fullsized":"2023-10-06T02:55:11.236454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:06.894832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243263+0000","last_change":"2023-10-06T02:55:07.114751+0000","last_active":"2023-10-06T02:55:11.243263+0000","last_peered":"2023-10-06T02:55:11.243263+0000","last_clean":"2023-10-06T02:55:11.243263+0000","last_became_active":"2023-10-06T02:55:07.114487+0000","last_became_peered":"2023-10-06T02:55:07.114487+0000","last_unstale":"2023-10-06T02:55:11.243263+0000","last_undegraded":"2023-10-06T02:55:11.243263+0000","last_fullsized":"2023-10-06T02:55:11.243263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244303+0000","last_change":"2023-10-06T02:55:07.111190+0000","last_active":"2023-10-06T02:55:11.244303+0000","last_peered":"2023-10-06T02:55:11.244303+0000","last_clean":"2023-10-06T02:55:11.244303+0000","last_became_active":"2023-10-06T02:55:07.110893+0000","last_became_peered":"2023-10-06T02:55:07.110893+0000","last_unstale":"2023-10-06T02:55:11.244303+0000","last_undegraded":"2023-10-06T02:55:11.244303+0000","last_fullsized":"2023-10-06T02:55:11.244303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:41.387727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.247033+0000","last_change":"2023-10-06T02:55:07.114160+0000","last_active":"2023-10-06T02:55:11.247033+0000","last_peered":"2023-10-06T02:55:11.247033+0000","last_clean":"2023-10-06T02:55:11.247033+0000","last_became_active":"2023-10-06T02:55:07.113571+0000","last_became_peered":"2023-10-06T02:55:07.113571+0000","last_unstale":"2023-10-06T02:55:11.247033+0000","last_undegraded":"2023-10-06T02:55:11.247033+0000","last_fullsized":"2023-10-06T02:55:11.247033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235851+0000","last_change":"2023-10-06T02:55:07.106766+0000","last_active":"2023-10-06T02:55:11.235851+0000","last_peered":"2023-10-06T02:55:11.235851+0000","last_clean":"2023-10-06T02:55:11.235851+0000","last_became_active":"2023-10-06T02:55:07.106562+0000","last_became_peered":"2023-10-06T02:55:07.106562+0000","last_unstale":"2023-10-06T02:55:11.235851+0000","last_undegraded":"2023-10-06T02:55:11.235851+0000","last_fullsized":"2023-10-06T02:55:11.235851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243386+0000","last_change":"2023-10-06T02:55:07.112458+0000","last_active":"2023-10-06T02:55:11.243386+0000","last_peered":"2023-10-06T02:55:11.243386+0000","last_clean":"2023-10-06T02:55:11.243386+0000","last_became_active":"2023-10-06T02:55:07.112034+0000","last_became_peered":"2023-10-06T02:55:07.112034+0000","last_unstale":"2023-10-06T02:55:11.243386+0000","last_undegraded":"2023-10-06T02:55:11.243386+0000","last_fullsized":"2023-10-06T02:55:11.243386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236308+0000","last_change":"2023-10-06T02:55:07.110571+0000","last_active":"2023-10-06T02:55:11.236308+0000","last_peered":"2023-10-06T02:55:11.236308+0000","last_clean":"2023-10-06T02:55:11.236308+0000","last_became_active":"2023-10-06T02:55:07.110305+0000","last_became_peered":"2023-10-06T02:55:07.110305+0000","last_unstale":"2023-10-06T02:55:11.236308+0000","last_undegraded":"2023-10-06T02:55:11.236308+0000","last_fullsized":"2023-10-06T02:55:11.236308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:48.545728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243893+0000","last_change":"2023-10-06T02:55:07.111579+0000","last_active":"2023-10-06T02:55:11.243893+0000","last_peered":"2023-10-06T02:55:11.243893+0000","last_clean":"2023-10-06T02:55:11.243893+0000","last_became_active":"2023-10-06T02:55:07.111318+0000","last_became_peered":"2023-10-06T02:55:07.111318+0000","last_unstale":"2023-10-06T02:55:11.243893+0000","last_undegraded":"2023-10-06T02:55:11.243893+0000","last_fullsized":"2023-10-06T02:55:11.243893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:47.019187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240508+0000","last_change":"2023-10-06T02:55:07.104069+0000","last_active":"2023-10-06T02:55:11.240508+0000","last_peered":"2023-10-06T02:55:11.240508+0000","last_clean":"2023-10-06T02:55:11.240508+0000","last_became_active":"2023-10-06T02:55:07.103805+0000","last_became_peered":"2023-10-06T02:55:07.103805+0000","last_unstale":"2023-10-06T02:55:11.240508+0000","last_undegraded":"2023-10-06T02:55:11.240508+0000","last_fullsized":"2023-10-06T02:55:11.240508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:05.829702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239484+0000","last_change":"2023-10-06T02:55:07.109817+0000","last_active":"2023-10-06T02:55:11.239484+0000","last_peered":"2023-10-06T02:55:11.239484+0000","last_clean":"2023-10-06T02:55:11.239484+0000","last_became_active":"2023-10-06T02:55:07.109582+0000","last_became_peered":"2023-10-06T02:55:07.109582+0000","last_unstale":"2023-10-06T02:55:11.239484+0000","last_undegraded":"2023-10-06T02:55:11.239484+0000","last_fullsized":"2023-10-06T02:55:11.239484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:51.423073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236216+0000","last_change":"2023-10-06T02:55:07.108183+0000","last_active":"2023-10-06T02:55:11.236216+0000","last_peered":"2023-10-06T02:55:11.236216+0000","last_clean":"2023-10-06T02:55:11.236216+0000","last_became_active":"2023-10-06T02:55:07.107919+0000","last_became_peered":"2023-10-06T02:55:07.107919+0000","last_unstale":"2023-10-06T02:55:11.236216+0000","last_undegraded":"2023-10-06T02:55:11.236216+0000","last_fullsized":"2023-10-06T02:55:11.236216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:50.364030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246844+0000","last_change":"2023-10-06T02:55:07.114341+0000","last_active":"2023-10-06T02:55:11.246844+0000","last_peered":"2023-10-06T02:55:11.246844+0000","last_clean":"2023-10-06T02:55:11.246844+0000","last_became_active":"2023-10-06T02:55:07.113900+0000","last_became_peered":"2023-10-06T02:55:07.113900+0000","last_unstale":"2023-10-06T02:55:11.246844+0000","last_undegraded":"2023-10-06T02:55:11.246844+0000","last_fullsized":"2023-10-06T02:55:11.246844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245965+0000","last_change":"2023-10-06T02:55:07.111225+0000","last_active":"2023-10-06T02:55:11.245965+0000","last_peered":"2023-10-06T02:55:11.245965+0000","last_clean":"2023-10-06T02:55:11.245965+0000","last_became_active":"2023-10-06T02:55:07.110865+0000","last_became_peered":"2023-10-06T02:55:07.110865+0000","last_unstale":"2023-10-06T02:55:11.245965+0000","last_undegraded":"2023-10-06T02:55:11.245965+0000","last_fullsized":"2023-10-06T02:55:11.245965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243421+0000","last_change":"2023-10-06T02:55:07.112286+0000","last_active":"2023-10-06T02:55:11.243421+0000","last_peered":"2023-10-06T02:55:11.243421+0000","last_clean":"2023-10-06T02:55:11.243421+0000","last_became_active":"2023-10-06T02:55:07.111766+0000","last_became_peered":"2023-10-06T02:55:07.111766+0000","last_unstale":"2023-10-06T02:55:11.243421+0000","last_undegraded":"2023-10-06T02:55:11.243421+0000","last_fullsized":"2023-10-06T02:55:11.243421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245058+0000","last_change":"2023-10-06T02:55:07.104506+0000","last_active":"2023-10-06T02:55:11.245058+0000","last_peered":"2023-10-06T02:55:11.245058+0000","last_clean":"2023-10-06T02:55:11.245058+0000","last_became_active":"2023-10-06T02:55:07.103148+0000","last_became_peered":"2023-10-06T02:55:07.103148+0000","last_unstale":"2023-10-06T02:55:11.245058+0000","last_undegraded":"2023-10-06T02:55:11.245058+0000","last_fullsized":"2023-10-06T02:55:11.245058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:30.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239743+0000","last_change":"2023-10-06T02:55:07.102510+0000","last_active":"2023-10-06T02:55:11.239743+0000","last_peered":"2023-10-06T02:55:11.239743+0000","last_clean":"2023-10-06T02:55:11.239743+0000","last_became_active":"2023-10-06T02:55:07.102223+0000","last_became_peered":"2023-10-06T02:55:07.102223+0000","last_unstale":"2023-10-06T02:55:11.239743+0000","last_undegraded":"2023-10-06T02:55:11.239743+0000","last_fullsized":"2023-10-06T02:55:11.239743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:03.327947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.241862+0000","last_change":"2023-10-06T02:55:07.103814+0000","last_active":"2023-10-06T02:55:11.241862+0000","last_peered":"2023-10-06T02:55:11.241862+0000","last_clean":"2023-10-06T02:55:11.241862+0000","last_became_active":"2023-10-06T02:55:07.103540+0000","last_became_peered":"2023-10-06T02:55:07.103540+0000","last_unstale":"2023-10-06T02:55:11.241862+0000","last_undegraded":"2023-10-06T02:55:11.241862+0000","last_fullsized":"2023-10-06T02:55:11.241862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249731+0000","last_change":"2023-10-06T02:55:07.111270+0000","last_active":"2023-10-06T02:55:11.249731+0000","last_peered":"2023-10-06T02:55:11.249731+0000","last_clean":"2023-10-06T02:55:11.249731+0000","last_became_active":"2023-10-06T02:55:07.110988+0000","last_became_peered":"2023-10-06T02:55:07.110988+0000","last_unstale":"2023-10-06T02:55:11.249731+0000","last_undegraded":"2023-10-06T02:55:11.249731+0000","last_fullsized":"2023-10-06T02:55:11.249731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242949+0000","last_change":"2023-10-06T02:55:07.112801+0000","last_active":"2023-10-06T02:55:11.242949+0000","last_peered":"2023-10-06T02:55:11.242949+0000","last_clean":"2023-10-06T02:55:11.242949+0000","last_became_active":"2023-10-06T02:55:07.112541+0000","last_became_peered":"2023-10-06T02:55:07.112541+0000","last_unstale":"2023-10-06T02:55:11.242949+0000","last_undegraded":"2023-10-06T02:55:11.242949+0000","last_fullsized":"2023-10-06T02:55:11.242949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:50.364030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.234999+0000","last_change":"2023-10-06T02:55:07.112735+0000","last_active":"2023-10-06T02:55:11.234999+0000","last_peered":"2023-10-06T02:55:11.234999+0000","last_clean":"2023-10-06T02:55:11.234999+0000","last_became_active":"2023-10-06T02:55:07.112354+0000","last_became_peered":"2023-10-06T02:55:07.112354+0000","last_unstale":"2023-10-06T02:55:11.234999+0000","last_undegraded":"2023-10-06T02:55:11.234999+0000","last_fullsized":"2023-10-06T02:55:11.234999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:30.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246446+0000","last_change":"2023-10-06T02:55:07.111427+0000","last_active":"2023-10-06T02:55:11.246446+0000","last_peered":"2023-10-06T02:55:11.246446+0000","last_clean":"2023-10-06T02:55:11.246446+0000","last_became_active":"2023-10-06T02:55:07.111175+0000","last_became_peered":"2023-10-06T02:55:07.111175+0000","last_unstale":"2023-10-06T02:55:11.246446+0000","last_undegraded":"2023-10-06T02:55:11.246446+0000","last_fullsized":"2023-10-06T02:55:11.246446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251151+0000","last_change":"2023-10-06T02:55:07.111532+0000","last_active":"2023-10-06T02:55:11.251151+0000","last_peered":"2023-10-06T02:55:11.251151+0000","last_clean":"2023-10-06T02:55:11.251151+0000","last_became_active":"2023-10-06T02:55:07.111049+0000","last_became_peered":"2023-10-06T02:55:07.111049+0000","last_unstale":"2023-10-06T02:55:11.251151+0000","last_undegraded":"2023-10-06T02:55:11.251151+0000","last_fullsized":"2023-10-06T02:55:11.251151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251111+0000","last_change":"2023-10-06T02:55:07.107260+0000","last_active":"2023-10-06T02:55:11.251111+0000","last_peered":"2023-10-06T02:55:11.251111+0000","last_clean":"2023-10-06T02:55:11.251111+0000","last_became_active":"2023-10-06T02:55:07.107057+0000","last_became_peered":"2023-10-06T02:55:07.107057+0000","last_unstale":"2023-10-06T02:55:11.251111+0000","last_undegraded":"2023-10-06T02:55:11.251111+0000","last_fullsized":"2023-10-06T02:55:11.251111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:03.676682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236378+0000","last_change":"2023-10-06T02:55:07.109107+0000","last_active":"2023-10-06T02:55:11.236378+0000","last_peered":"2023-10-06T02:55:11.236378+0000","last_clean":"2023-10-06T02:55:11.236378+0000","last_became_active":"2023-10-06T02:55:07.108804+0000","last_became_peered":"2023-10-06T02:55:07.108804+0000","last_unstale":"2023-10-06T02:55:11.236378+0000","last_undegraded":"2023-10-06T02:55:11.236378+0000","last_fullsized":"2023-10-06T02:55:11.236378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261436+0000","last_change":"2023-10-06T02:55:11.256831+0000","last_active":"2023-10-06T02:55:11.261436+0000","last_peered":"2023-10-06T02:55:11.261436+0000","last_clean":"2023-10-06T02:55:11.261436+0000","last_became_active":"2023-10-06T02:55:11.255607+0000","last_became_peered":"2023-10-06T02:55:11.255607+0000","last_unstale":"2023-10-06T02:55:11.261436+0000","last_undegraded":"2023-10-06T02:55:11.261436+0000","last_fullsized":"2023-10-06T02:55:11.261436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:59.809138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244213+0000","last_change":"2023-10-06T02:55:06.241953+0000","last_active":"2023-10-06T02:55:11.244213+0000","last_peered":"2023-10-06T02:55:11.244213+0000","last_clean":"2023-10-06T02:55:11.244213+0000","last_became_active":"2023-10-06T02:55:06.241631+0000","last_became_peered":"2023-10-06T02:55:06.241631+0000","last_unstale":"2023-10-06T02:55:11.244213+0000","last_undegraded":"2023-10-06T02:55:11.244213+0000","last_fullsized":"2023-10-06T02:55:11.244213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:13.153122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235457+0000","last_change":"2023-10-06T02:55:07.116546+0000","last_active":"2023-10-06T02:55:11.235457+0000","last_peered":"2023-10-06T02:55:11.235457+0000","last_clean":"2023-10-06T02:55:11.235457+0000","last_became_active":"2023-10-06T02:55:07.116298+0000","last_became_peered":"2023-10-06T02:55:07.116298+0000","last_unstale":"2023-10-06T02:55:11.235457+0000","last_undegraded":"2023-10-06T02:55:11.235457+0000","last_fullsized":"2023-10-06T02:55:11.235457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:09.033880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261529+0000","last_change":"2023-10-06T02:55:11.255287+0000","last_active":"2023-10-06T02:55:11.261529+0000","last_peered":"2023-10-06T02:55:11.261529+0000","last_clean":"2023-10-06T02:55:11.261529+0000","last_became_active":"2023-10-06T02:55:11.254851+0000","last_became_peered":"2023-10-06T02:55:11.254851+0000","last_unstale":"2023-10-06T02:55:11.261529+0000","last_undegraded":"2023-10-06T02:55:11.261529+0000","last_fullsized":"2023-10-06T02:55:11.261529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:39.598115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250011+0000","last_change":"2023-10-06T02:55:06.241290+0000","last_active":"2023-10-06T02:55:11.250011+0000","last_peered":"2023-10-06T02:55:11.250011+0000","last_clean":"2023-10-06T02:55:11.250011+0000","last_became_active":"2023-10-06T02:55:06.240960+0000","last_became_peered":"2023-10-06T02:55:06.240960+0000","last_unstale":"2023-10-06T02:55:11.250011+0000","last_undegraded":"2023-10-06T02:55:11.250011+0000","last_fullsized":"2023-10-06T02:55:11.250011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246457+0000","last_change":"2023-10-06T02:55:07.109573+0000","last_active":"2023-10-06T02:55:11.246457+0000","last_peered":"2023-10-06T02:55:11.246457+0000","last_clean":"2023-10-06T02:55:11.246457+0000","last_became_active":"2023-10-06T02:55:07.109273+0000","last_became_peered":"2023-10-06T02:55:07.109273+0000","last_unstale":"2023-10-06T02:55:11.246457+0000","last_undegraded":"2023-10-06T02:55:11.246457+0000","last_fullsized":"2023-10-06T02:55:11.246457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.254596+0000","last_change":"2023-10-06T02:55:11.252497+0000","last_active":"2023-10-06T02:55:11.254596+0000","last_peered":"2023-10-06T02:55:11.254596+0000","last_clean":"2023-10-06T02:55:11.254596+0000","last_became_active":"2023-10-06T02:55:11.252152+0000","last_became_peered":"2023-10-06T02:55:11.252152+0000","last_unstale":"2023-10-06T02:55:11.254596+0000","last_undegraded":"2023-10-06T02:55:11.254596+0000","last_fullsized":"2023-10-06T02:55:11.254596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:05.228696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235239+0000","last_change":"2023-10-06T02:55:06.244855+0000","last_active":"2023-10-06T02:55:11.235239+0000","last_peered":"2023-10-06T02:55:11.235239+0000","last_clean":"2023-10-06T02:55:11.235239+0000","last_became_active":"2023-10-06T02:55:06.243833+0000","last_became_peered":"2023-10-06T02:55:06.243833+0000","last_unstale":"2023-10-06T02:55:11.235239+0000","last_undegraded":"2023-10-06T02:55:11.235239+0000","last_fullsized":"2023-10-06T02:55:11.235239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239474+0000","last_change":"2023-10-06T02:55:07.106155+0000","last_active":"2023-10-06T02:55:11.239474+0000","last_peered":"2023-10-06T02:55:11.239474+0000","last_clean":"2023-10-06T02:55:11.239474+0000","last_became_active":"2023-10-06T02:55:07.105422+0000","last_became_peered":"2023-10-06T02:55:07.105422+0000","last_unstale":"2023-10-06T02:55:11.239474+0000","last_undegraded":"2023-10-06T02:55:11.239474+0000","last_fullsized":"2023-10-06T02:55:11.239474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:26.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258752+0000","last_change":"2023-10-06T02:55:11.252464+0000","last_active":"2023-10-06T02:55:11.258752+0000","last_peered":"2023-10-06T02:55:11.258752+0000","last_clean":"2023-10-06T02:55:11.258752+0000","last_became_active":"2023-10-06T02:55:11.252055+0000","last_became_peered":"2023-10-06T02:55:11.252055+0000","last_unstale":"2023-10-06T02:55:11.258752+0000","last_undegraded":"2023-10-06T02:55:11.258752+0000","last_fullsized":"2023-10-06T02:55:11.258752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:30.678912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243469+0000","last_change":"2023-10-06T02:55:06.243634+0000","last_active":"2023-10-06T02:55:11.243469+0000","last_peered":"2023-10-06T02:55:11.243469+0000","last_clean":"2023-10-06T02:55:11.243469+0000","last_became_active":"2023-10-06T02:55:06.243383+0000","last_became_peered":"2023-10-06T02:55:06.243383+0000","last_unstale":"2023-10-06T02:55:11.243469+0000","last_undegraded":"2023-10-06T02:55:11.243469+0000","last_fullsized":"2023-10-06T02:55:11.243469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235163+0000","last_change":"2023-10-06T02:55:07.117239+0000","last_active":"2023-10-06T02:55:11.235163+0000","last_peered":"2023-10-06T02:55:11.235163+0000","last_clean":"2023-10-06T02:55:11.235163+0000","last_became_active":"2023-10-06T02:55:07.116968+0000","last_became_peered":"2023-10-06T02:55:07.116968+0000","last_unstale":"2023-10-06T02:55:11.235163+0000","last_undegraded":"2023-10-06T02:55:11.235163+0000","last_fullsized":"2023-10-06T02:55:11.235163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258755+0000","last_change":"2023-10-06T02:55:11.254938+0000","last_active":"2023-10-06T02:55:11.258755+0000","last_peered":"2023-10-06T02:55:11.258755+0000","last_clean":"2023-10-06T02:55:11.258755+0000","last_became_active":"2023-10-06T02:55:11.254650+0000","last_became_peered":"2023-10-06T02:55:11.254650+0000","last_unstale":"2023-10-06T02:55:11.258755+0000","last_undegraded":"2023-10-06T02:55:11.258755+0000","last_fullsized":"2023-10-06T02:55:11.258755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:07.497924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236203+0000","last_change":"2023-10-06T02:55:06.239366+0000","last_active":"2023-10-06T02:55:11.236203+0000","last_peered":"2023-10-06T02:55:11.236203+0000","last_clean":"2023-10-06T02:55:11.236203+0000","last_became_active":"2023-10-06T02:55:06.239143+0000","last_became_peered":"2023-10-06T02:55:06.239143+0000","last_unstale":"2023-10-06T02:55:11.236203+0000","last_undegraded":"2023-10-06T02:55:11.236203+0000","last_fullsized":"2023-10-06T02:55:11.236203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:13.153122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235067+0000","last_change":"2023-10-06T02:55:07.109897+0000","last_active":"2023-10-06T02:55:11.235067+0000","last_peered":"2023-10-06T02:55:11.235067+0000","last_clean":"2023-10-06T02:55:11.235067+0000","last_became_active":"2023-10-06T02:55:07.108992+0000","last_became_peered":"2023-10-06T02:55:07.108992+0000","last_unstale":"2023-10-06T02:55:11.235067+0000","last_undegraded":"2023-10-06T02:55:11.235067+0000","last_fullsized":"2023-10-06T02:55:11.235067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:03.653175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253878+0000","last_change":"2023-10-06T02:55:11.249347+0000","last_active":"2023-10-06T02:55:11.253878+0000","last_peered":"2023-10-06T02:55:11.253878+0000","last_clean":"2023-10-06T02:55:11.253878+0000","last_became_active":"2023-10-06T02:55:11.248973+0000","last_became_peered":"2023-10-06T02:55:11.248973+0000","last_unstale":"2023-10-06T02:55:11.253878+0000","last_undegraded":"2023-10-06T02:55:11.253878+0000","last_fullsized":"2023-10-06T02:55:11.253878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.869089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249346+0000","last_change":"2023-10-06T02:55:06.244730+0000","last_active":"2023-10-06T02:55:11.249346+0000","last_peered":"2023-10-06T02:55:11.249346+0000","last_clean":"2023-10-06T02:55:11.249346+0000","last_became_active":"2023-10-06T02:55:06.244530+0000","last_became_peered":"2023-10-06T02:55:06.244530+0000","last_unstale":"2023-10-06T02:55:11.249346+0000","last_undegraded":"2023-10-06T02:55:11.249346+0000","last_fullsized":"2023-10-06T02:55:11.249346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:57.942072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250185+0000","last_change":"2023-10-06T02:55:07.113744+0000","last_active":"2023-10-06T02:55:11.250185+0000","last_peered":"2023-10-06T02:55:11.250185+0000","last_clean":"2023-10-06T02:55:11.250185+0000","last_became_active":"2023-10-06T02:55:07.110700+0000","last_became_peered":"2023-10-06T02:55:07.110700+0000","last_unstale":"2023-10-06T02:55:11.250185+0000","last_undegraded":"2023-10-06T02:55:11.250185+0000","last_fullsized":"2023-10-06T02:55:11.250185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:45.135333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264143+0000","last_change":"2023-10-06T02:55:11.262345+0000","last_active":"2023-10-06T02:55:11.264143+0000","last_peered":"2023-10-06T02:55:11.264143+0000","last_clean":"2023-10-06T02:55:11.264143+0000","last_became_active":"2023-10-06T02:55:11.261934+0000","last_became_peered":"2023-10-06T02:55:11.261934+0000","last_unstale":"2023-10-06T02:55:11.264143+0000","last_undegraded":"2023-10-06T02:55:11.264143+0000","last_fullsized":"2023-10-06T02:55:11.264143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T02:55:17.004310+0000","last_change":"2023-10-06T02:55:06.238681+0000","last_active":"2023-10-06T02:55:17.004310+0000","last_peered":"2023-10-06T02:55:17.004310+0000","last_clean":"2023-10-06T02:55:17.004310+0000","last_became_active":"2023-10-06T02:55:06.238378+0000","last_became_peered":"2023-10-06T02:55:06.238378+0000","last_unstale":"2023-10-06T02:55:17.004310+0000","last_undegraded":"2023-10-06T02:55:17.004310+0000","last_fullsized":"2023-10-06T02:55:17.004310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:53.170462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242315+0000","last_change":"2023-10-06T02:55:07.103795+0000","last_active":"2023-10-06T02:55:11.242315+0000","last_peered":"2023-10-06T02:55:11.242315+0000","last_clean":"2023-10-06T02:55:11.242315+0000","last_became_active":"2023-10-06T02:55:07.103512+0000","last_became_peered":"2023-10-06T02:55:07.103512+0000","last_unstale":"2023-10-06T02:55:11.242315+0000","last_undegraded":"2023-10-06T02:55:11.242315+0000","last_fullsized":"2023-10-06T02:55:11.242315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256756+0000","last_change":"2023-10-06T02:55:11.251476+0000","last_active":"2023-10-06T02:55:11.256756+0000","last_peered":"2023-10-06T02:55:11.256756+0000","last_clean":"2023-10-06T02:55:11.256756+0000","last_became_active":"2023-10-06T02:55:11.250987+0000","last_became_peered":"2023-10-06T02:55:11.250987+0000","last_unstale":"2023-10-06T02:55:11.256756+0000","last_undegraded":"2023-10-06T02:55:11.256756+0000","last_fullsized":"2023-10-06T02:55:11.256756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:14.100962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249652+0000","last_change":"2023-10-06T02:55:06.246906+0000","last_active":"2023-10-06T02:55:11.249652+0000","last_peered":"2023-10-06T02:55:11.249652+0000","last_clean":"2023-10-06T02:55:11.249652+0000","last_became_active":"2023-10-06T02:55:06.246640+0000","last_became_peered":"2023-10-06T02:55:06.246640+0000","last_unstale":"2023-10-06T02:55:11.249652+0000","last_undegraded":"2023-10-06T02:55:11.249652+0000","last_fullsized":"2023-10-06T02:55:11.249652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.944198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235544+0000","last_change":"2023-10-06T02:55:07.116704+0000","last_active":"2023-10-06T02:55:11.235544+0000","last_peered":"2023-10-06T02:55:11.235544+0000","last_clean":"2023-10-06T02:55:11.235544+0000","last_became_active":"2023-10-06T02:55:07.116441+0000","last_became_peered":"2023-10-06T02:55:07.116441+0000","last_unstale":"2023-10-06T02:55:11.235544+0000","last_undegraded":"2023-10-06T02:55:11.235544+0000","last_fullsized":"2023-10-06T02:55:11.235544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263207+0000","last_change":"2023-10-06T02:55:11.258974+0000","last_active":"2023-10-06T02:55:11.263207+0000","last_peered":"2023-10-06T02:55:11.263207+0000","last_clean":"2023-10-06T02:55:11.263207+0000","last_became_active":"2023-10-06T02:55:11.258615+0000","last_became_peered":"2023-10-06T02:55:11.258615+0000","last_unstale":"2023-10-06T02:55:11.263207+0000","last_undegraded":"2023-10-06T02:55:11.263207+0000","last_fullsized":"2023-10-06T02:55:11.263207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:22.469427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242843+0000","last_change":"2023-10-06T02:55:06.240931+0000","last_active":"2023-10-06T02:55:11.242843+0000","last_peered":"2023-10-06T02:55:11.242843+0000","last_clean":"2023-10-06T02:55:11.242843+0000","last_became_active":"2023-10-06T02:55:06.240681+0000","last_became_peered":"2023-10-06T02:55:06.240681+0000","last_unstale":"2023-10-06T02:55:11.242843+0000","last_undegraded":"2023-10-06T02:55:11.242843+0000","last_fullsized":"2023-10-06T02:55:11.242843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236292+0000","last_change":"2023-10-06T02:55:07.108936+0000","last_active":"2023-10-06T02:55:11.236292+0000","last_peered":"2023-10-06T02:55:11.236292+0000","last_clean":"2023-10-06T02:55:11.236292+0000","last_became_active":"2023-10-06T02:55:07.108696+0000","last_became_peered":"2023-10-06T02:55:07.108696+0000","last_unstale":"2023-10-06T02:55:11.236292+0000","last_undegraded":"2023-10-06T02:55:11.236292+0000","last_fullsized":"2023-10-06T02:55:11.236292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263173+0000","last_change":"2023-10-06T02:55:11.258916+0000","last_active":"2023-10-06T02:55:11.263173+0000","last_peered":"2023-10-06T02:55:11.263173+0000","last_clean":"2023-10-06T02:55:11.263173+0000","last_became_active":"2023-10-06T02:55:11.258551+0000","last_became_peered":"2023-10-06T02:55:11.258551+0000","last_unstale":"2023-10-06T02:55:11.263173+0000","last_undegraded":"2023-10-06T02:55:11.263173+0000","last_fullsized":"2023-10-06T02:55:11.263173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:29.955535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246941+0000","last_change":"2023-10-06T02:55:06.246931+0000","last_active":"2023-10-06T02:55:11.246941+0000","last_peered":"2023-10-06T02:55:11.246941+0000","last_clean":"2023-10-06T02:55:11.246941+0000","last_became_active":"2023-10-06T02:55:06.246709+0000","last_became_peered":"2023-10-06T02:55:06.246709+0000","last_unstale":"2023-10-06T02:55:11.246941+0000","last_undegraded":"2023-10-06T02:55:11.246941+0000","last_fullsized":"2023-10-06T02:55:11.246941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246634+0000","last_change":"2023-10-06T02:55:07.114181+0000","last_active":"2023-10-06T02:55:11.246634+0000","last_peered":"2023-10-06T02:55:11.246634+0000","last_clean":"2023-10-06T02:55:11.246634+0000","last_became_active":"2023-10-06T02:55:07.113881+0000","last_became_peered":"2023-10-06T02:55:07.113881+0000","last_unstale":"2023-10-06T02:55:11.246634+0000","last_undegraded":"2023-10-06T02:55:11.246634+0000","last_fullsized":"2023-10-06T02:55:11.246634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256543+0000","last_change":"2023-10-06T02:55:11.253825+0000","last_active":"2023-10-06T02:55:11.256543+0000","last_peered":"2023-10-06T02:55:11.256543+0000","last_clean":"2023-10-06T02:55:11.256543+0000","last_became_active":"2023-10-06T02:55:11.253052+0000","last_became_peered":"2023-10-06T02:55:11.253052+0000","last_unstale":"2023-10-06T02:55:11.256543+0000","last_undegraded":"2023-10-06T02:55:11.256543+0000","last_fullsized":"2023-10-06T02:55:11.256543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:22.469427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236177+0000","last_change":"2023-10-06T02:55:06.235238+0000","last_active":"2023-10-06T02:55:11.236177+0000","last_peered":"2023-10-06T02:55:11.236177+0000","last_clean":"2023-10-06T02:55:11.236177+0000","last_became_active":"2023-10-06T02:55:06.234941+0000","last_became_peered":"2023-10-06T02:55:06.234941+0000","last_unstale":"2023-10-06T02:55:11.236177+0000","last_undegraded":"2023-10-06T02:55:11.236177+0000","last_fullsized":"2023-10-06T02:55:11.236177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:22.823456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235743+0000","last_change":"2023-10-06T02:55:07.110108+0000","last_active":"2023-10-06T02:55:11.235743+0000","last_peered":"2023-10-06T02:55:11.235743+0000","last_clean":"2023-10-06T02:55:11.235743+0000","last_became_active":"2023-10-06T02:55:07.108982+0000","last_became_peered":"2023-10-06T02:55:07.108982+0000","last_unstale":"2023-10-06T02:55:11.235743+0000","last_undegraded":"2023-10-06T02:55:11.235743+0000","last_fullsized":"2023-10-06T02:55:11.235743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:09.755341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264350+0000","last_change":"2023-10-06T02:55:11.261896+0000","last_active":"2023-10-06T02:55:11.264350+0000","last_peered":"2023-10-06T02:55:11.264350+0000","last_clean":"2023-10-06T02:55:11.264350+0000","last_became_active":"2023-10-06T02:55:11.258453+0000","last_became_peered":"2023-10-06T02:55:11.258453+0000","last_unstale":"2023-10-06T02:55:11.264350+0000","last_undegraded":"2023-10-06T02:55:11.264350+0000","last_fullsized":"2023-10-06T02:55:11.264350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.248625+0000","last_change":"2023-10-06T02:55:06.246468+0000","last_active":"2023-10-06T02:55:11.248625+0000","last_peered":"2023-10-06T02:55:11.248625+0000","last_clean":"2023-10-06T02:55:11.248625+0000","last_became_active":"2023-10-06T02:55:06.246181+0000","last_became_peered":"2023-10-06T02:55:06.246181+0000","last_unstale":"2023-10-06T02:55:11.248625+0000","last_undegraded":"2023-10-06T02:55:11.248625+0000","last_fullsized":"2023-10-06T02:55:11.248625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:05.892985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235746+0000","last_change":"2023-10-06T02:55:07.108301+0000","last_active":"2023-10-06T02:55:11.235746+0000","last_peered":"2023-10-06T02:55:11.235746+0000","last_clean":"2023-10-06T02:55:11.235746+0000","last_became_active":"2023-10-06T02:55:07.108018+0000","last_became_peered":"2023-10-06T02:55:07.108018+0000","last_unstale":"2023-10-06T02:55:11.235746+0000","last_undegraded":"2023-10-06T02:55:11.235746+0000","last_fullsized":"2023-10-06T02:55:11.235746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253713+0000","last_change":"2023-10-06T02:55:11.250732+0000","last_active":"2023-10-06T02:55:11.253713+0000","last_peered":"2023-10-06T02:55:11.253713+0000","last_clean":"2023-10-06T02:55:11.253713+0000","last_became_active":"2023-10-06T02:55:11.250256+0000","last_became_peered":"2023-10-06T02:55:11.250256+0000","last_unstale":"2023-10-06T02:55:11.253713+0000","last_undegraded":"2023-10-06T02:55:11.253713+0000","last_fullsized":"2023-10-06T02:55:11.253713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:48.288942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246540+0000","last_change":"2023-10-06T02:55:06.246429+0000","last_active":"2023-10-06T02:55:11.246540+0000","last_peered":"2023-10-06T02:55:11.246540+0000","last_clean":"2023-10-06T02:55:11.246540+0000","last_became_active":"2023-10-06T02:55:06.246133+0000","last_became_peered":"2023-10-06T02:55:06.246133+0000","last_unstale":"2023-10-06T02:55:11.246540+0000","last_undegraded":"2023-10-06T02:55:11.246540+0000","last_fullsized":"2023-10-06T02:55:11.246540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242766+0000","last_change":"2023-10-06T02:55:07.111918+0000","last_active":"2023-10-06T02:55:11.242766+0000","last_peered":"2023-10-06T02:55:11.242766+0000","last_clean":"2023-10-06T02:55:11.242766+0000","last_became_active":"2023-10-06T02:55:07.111192+0000","last_became_peered":"2023-10-06T02:55:07.111192+0000","last_unstale":"2023-10-06T02:55:11.242766+0000","last_undegraded":"2023-10-06T02:55:11.242766+0000","last_fullsized":"2023-10-06T02:55:11.242766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:03.869547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.255431+0000","last_change":"2023-10-06T02:55:11.254429+0000","last_active":"2023-10-06T02:55:11.255431+0000","last_peered":"2023-10-06T02:55:11.255431+0000","last_clean":"2023-10-06T02:55:11.255431+0000","last_became_active":"2023-10-06T02:55:11.253634+0000","last_became_peered":"2023-10-06T02:55:11.253634+0000","last_unstale":"2023-10-06T02:55:11.255431+0000","last_undegraded":"2023-10-06T02:55:11.255431+0000","last_fullsized":"2023-10-06T02:55:11.255431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:39.598115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249543+0000","last_change":"2023-10-06T02:55:06.244313+0000","last_active":"2023-10-06T02:55:11.249543+0000","last_peered":"2023-10-06T02:55:11.249543+0000","last_clean":"2023-10-06T02:55:11.249543+0000","last_became_active":"2023-10-06T02:55:06.244045+0000","last_became_peered":"2023-10-06T02:55:06.244045+0000","last_unstale":"2023-10-06T02:55:11.249543+0000","last_undegraded":"2023-10-06T02:55:11.249543+0000","last_fullsized":"2023-10-06T02:55:11.249543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:49.362183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240556+0000","last_change":"2023-10-06T02:55:07.112001+0000","last_active":"2023-10-06T02:55:11.240556+0000","last_peered":"2023-10-06T02:55:11.240556+0000","last_clean":"2023-10-06T02:55:11.240556+0000","last_became_active":"2023-10-06T02:55:07.111530+0000","last_became_peered":"2023-10-06T02:55:07.111530+0000","last_unstale":"2023-10-06T02:55:11.240556+0000","last_undegraded":"2023-10-06T02:55:11.240556+0000","last_fullsized":"2023-10-06T02:55:11.240556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:28.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261909+0000","last_change":"2023-10-06T02:55:11.254821+0000","last_active":"2023-10-06T02:55:11.261909+0000","last_peered":"2023-10-06T02:55:11.261909+0000","last_clean":"2023-10-06T02:55:11.261909+0000","last_became_active":"2023-10-06T02:55:11.254465+0000","last_became_peered":"2023-10-06T02:55:11.254465+0000","last_unstale":"2023-10-06T02:55:11.261909+0000","last_undegraded":"2023-10-06T02:55:11.261909+0000","last_fullsized":"2023-10-06T02:55:11.261909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:22.675675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236372+0000","last_change":"2023-10-06T02:55:06.240642+0000","last_active":"2023-10-06T02:55:11.236372+0000","last_peered":"2023-10-06T02:55:11.236372+0000","last_clean":"2023-10-06T02:55:11.236372+0000","last_became_active":"2023-10-06T02:55:06.240361+0000","last_became_peered":"2023-10-06T02:55:06.240361+0000","last_unstale":"2023-10-06T02:55:11.236372+0000","last_undegraded":"2023-10-06T02:55:11.236372+0000","last_fullsized":"2023-10-06T02:55:11.236372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:35.258998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243005+0000","last_change":"2023-10-06T02:55:07.111431+0000","last_active":"2023-10-06T02:55:11.243005+0000","last_peered":"2023-10-06T02:55:11.243005+0000","last_clean":"2023-10-06T02:55:11.243005+0000","last_became_active":"2023-10-06T02:55:07.111223+0000","last_became_peered":"2023-10-06T02:55:07.111223+0000","last_unstale":"2023-10-06T02:55:11.243005+0000","last_undegraded":"2023-10-06T02:55:11.243005+0000","last_fullsized":"2023-10-06T02:55:11.243005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.262798+0000","last_change":"2023-10-06T02:55:11.258918+0000","last_active":"2023-10-06T02:55:11.262798+0000","last_peered":"2023-10-06T02:55:11.262798+0000","last_clean":"2023-10-06T02:55:11.262798+0000","last_became_active":"2023-10-06T02:55:11.258550+0000","last_became_peered":"2023-10-06T02:55:11.258550+0000","last_unstale":"2023-10-06T02:55:11.262798+0000","last_undegraded":"2023-10-06T02:55:11.262798+0000","last_fullsized":"2023-10-06T02:55:11.262798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:34.718619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235093+0000","last_change":"2023-10-06T02:55:06.243599+0000","last_active":"2023-10-06T02:55:11.235093+0000","last_peered":"2023-10-06T02:55:11.235093+0000","last_clean":"2023-10-06T02:55:11.235093+0000","last_became_active":"2023-10-06T02:55:06.243327+0000","last_became_peered":"2023-10-06T02:55:06.243327+0000","last_unstale":"2023-10-06T02:55:11.235093+0000","last_undegraded":"2023-10-06T02:55:11.235093+0000","last_fullsized":"2023-10-06T02:55:11.235093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:35.258998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.241631+0000","last_change":"2023-10-06T02:55:07.113758+0000","last_active":"2023-10-06T02:55:11.241631+0000","last_peered":"2023-10-06T02:55:11.241631+0000","last_clean":"2023-10-06T02:55:11.241631+0000","last_became_active":"2023-10-06T02:55:07.113506+0000","last_became_peered":"2023-10-06T02:55:07.113506+0000","last_unstale":"2023-10-06T02:55:11.241631+0000","last_undegraded":"2023-10-06T02:55:11.241631+0000","last_fullsized":"2023-10-06T02:55:11.241631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:44.275013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264161+0000","last_change":"2023-10-06T02:55:11.262774+0000","last_active":"2023-10-06T02:55:11.264161+0000","last_peered":"2023-10-06T02:55:11.264161+0000","last_clean":"2023-10-06T02:55:11.264161+0000","last_became_active":"2023-10-06T02:55:11.262415+0000","last_became_peered":"2023-10-06T02:55:11.262415+0000","last_unstale":"2023-10-06T02:55:11.264161+0000","last_undegraded":"2023-10-06T02:55:11.264161+0000","last_fullsized":"2023-10-06T02:55:11.264161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240564+0000","last_change":"2023-10-06T02:55:06.242089+0000","last_active":"2023-10-06T02:55:11.240564+0000","last_peered":"2023-10-06T02:55:11.240564+0000","last_clean":"2023-10-06T02:55:11.240564+0000","last_became_active":"2023-10-06T02:55:06.241809+0000","last_became_peered":"2023-10-06T02:55:06.241809+0000","last_unstale":"2023-10-06T02:55:11.240564+0000","last_undegraded":"2023-10-06T02:55:11.240564+0000","last_fullsized":"2023-10-06T02:55:11.240564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:00.333890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243430+0000","last_change":"2023-10-06T02:55:07.103210+0000","last_active":"2023-10-06T02:55:11.243430+0000","last_peered":"2023-10-06T02:55:11.243430+0000","last_clean":"2023-10-06T02:55:11.243430+0000","last_became_active":"2023-10-06T02:55:07.102900+0000","last_became_peered":"2023-10-06T02:55:07.102900+0000","last_unstale":"2023-10-06T02:55:11.243430+0000","last_undegraded":"2023-10-06T02:55:11.243430+0000","last_fullsized":"2023-10-06T02:55:11.243430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263787+0000","last_change":"2023-10-06T02:55:11.256640+0000","last_active":"2023-10-06T02:55:11.263787+0000","last_peered":"2023-10-06T02:55:11.263787+0000","last_clean":"2023-10-06T02:55:11.263787+0000","last_became_active":"2023-10-06T02:55:11.254235+0000","last_became_peered":"2023-10-06T02:55:11.254235+0000","last_unstale":"2023-10-06T02:55:11.263787+0000","last_undegraded":"2023-10-06T02:55:11.263787+0000","last_fullsized":"2023-10-06T02:55:11.263787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:04.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242562+0000","last_change":"2023-10-06T02:55:06.237767+0000","last_active":"2023-10-06T02:55:11.242562+0000","last_peered":"2023-10-06T02:55:11.242562+0000","last_clean":"2023-10-06T02:55:11.242562+0000","last_became_active":"2023-10-06T02:55:06.237033+0000","last_became_peered":"2023-10-06T02:55:06.237033+0000","last_unstale":"2023-10-06T02:55:11.242562+0000","last_undegraded":"2023-10-06T02:55:11.242562+0000","last_fullsized":"2023-10-06T02:55:11.242562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:00.333890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245169+0000","last_change":"2023-10-06T02:55:07.100985+0000","last_active":"2023-10-06T02:55:11.245169+0000","last_peered":"2023-10-06T02:55:11.245169+0000","last_clean":"2023-10-06T02:55:11.245169+0000","last_became_active":"2023-10-06T02:55:07.100724+0000","last_became_peered":"2023-10-06T02:55:07.100724+0000","last_unstale":"2023-10-06T02:55:11.245169+0000","last_undegraded":"2023-10-06T02:55:11.245169+0000","last_fullsized":"2023-10-06T02:55:11.245169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261373+0000","last_change":"2023-10-06T02:55:11.254821+0000","last_active":"2023-10-06T02:55:11.261373+0000","last_peered":"2023-10-06T02:55:11.261373+0000","last_clean":"2023-10-06T02:55:11.261373+0000","last_became_active":"2023-10-06T02:55:11.254344+0000","last_became_peered":"2023-10-06T02:55:11.254344+0000","last_unstale":"2023-10-06T02:55:11.261373+0000","last_undegraded":"2023-10-06T02:55:11.261373+0000","last_fullsized":"2023-10-06T02:55:11.261373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:28.325601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235090+0000","last_change":"2023-10-06T02:55:06.240594+0000","last_active":"2023-10-06T02:55:11.235090+0000","last_peered":"2023-10-06T02:55:11.235090+0000","last_clean":"2023-10-06T02:55:11.235090+0000","last_became_active":"2023-10-06T02:55:06.240357+0000","last_became_peered":"2023-10-06T02:55:06.240357+0000","last_unstale":"2023-10-06T02:55:11.235090+0000","last_undegraded":"2023-10-06T02:55:11.235090+0000","last_fullsized":"2023-10-06T02:55:11.235090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251318+0000","last_change":"2023-10-06T02:55:07.116386+0000","last_active":"2023-10-06T02:55:11.251318+0000","last_peered":"2023-10-06T02:55:11.251318+0000","last_clean":"2023-10-06T02:55:11.251318+0000","last_became_active":"2023-10-06T02:55:07.116115+0000","last_became_peered":"2023-10-06T02:55:07.116115+0000","last_unstale":"2023-10-06T02:55:11.251318+0000","last_undegraded":"2023-10-06T02:55:11.251318+0000","last_fullsized":"2023-10-06T02:55:11.251318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.260498+0000","last_change":"2023-10-06T02:55:11.258056+0000","last_active":"2023-10-06T02:55:11.260498+0000","last_peered":"2023-10-06T02:55:11.260498+0000","last_clean":"2023-10-06T02:55:11.260498+0000","last_became_active":"2023-10-06T02:55:11.256479+0000","last_became_peered":"2023-10-06T02:55:11.256479+0000","last_unstale":"2023-10-06T02:55:11.260498+0000","last_undegraded":"2023-10-06T02:55:11.260498+0000","last_fullsized":"2023-10-06T02:55:11.260498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250543+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:55:11.250543+0000","last_peered":"2023-10-06T02:55:11.250543+0000","last_clean":"2023-10-06T02:55:11.250543+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:55:11.250543+0000","last_undegraded":"2023-10-06T02:55:11.250543+0000","last_fullsized":"2023-10-06T02:55:11.250543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236179+0000","last_change":"2023-10-06T02:55:06.240875+0000","last_active":"2023-10-06T02:55:11.236179+0000","last_peered":"2023-10-06T02:55:11.236179+0000","last_clean":"2023-10-06T02:55:11.236179+0000","last_became_active":"2023-10-06T02:55:06.240637+0000","last_became_peered":"2023-10-06T02:55:06.240637+0000","last_unstale":"2023-10-06T02:55:11.236179+0000","last_undegraded":"2023-10-06T02:55:11.236179+0000","last_fullsized":"2023-10-06T02:55:11.236179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250109+0000","last_change":"2023-10-06T02:55:07.111939+0000","last_active":"2023-10-06T02:55:11.250109+0000","last_peered":"2023-10-06T02:55:11.250109+0000","last_clean":"2023-10-06T02:55:11.250109+0000","last_became_active":"2023-10-06T02:55:07.111076+0000","last_became_peered":"2023-10-06T02:55:07.111076+0000","last_unstale":"2023-10-06T02:55:11.250109+0000","last_undegraded":"2023-10-06T02:55:11.250109+0000","last_fullsized":"2023-10-06T02:55:11.250109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258159+0000","last_change":"2023-10-06T02:55:11.257606+0000","last_active":"2023-10-06T02:55:11.258159+0000","last_peered":"2023-10-06T02:55:11.258159+0000","last_clean":"2023-10-06T02:55:11.258159+0000","last_became_active":"2023-10-06T02:55:11.257305+0000","last_became_peered":"2023-10-06T02:55:11.257305+0000","last_unstale":"2023-10-06T02:55:11.258159+0000","last_undegraded":"2023-10-06T02:55:11.258159+0000","last_fullsized":"2023-10-06T02:55:11.258159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236318+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:55:11.236318+0000","last_peered":"2023-10-06T02:55:11.236318+0000","last_clean":"2023-10-06T02:55:11.236318+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:55:11.236318+0000","last_undegraded":"2023-10-06T02:55:11.236318+0000","last_fullsized":"2023-10-06T02:55:11.236318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242421+0000","last_change":"2023-10-06T02:55:06.245888+0000","last_active":"2023-10-06T02:55:11.242421+0000","last_peered":"2023-10-06T02:55:11.242421+0000","last_clean":"2023-10-06T02:55:11.242421+0000","last_became_active":"2023-10-06T02:55:06.245610+0000","last_became_peered":"2023-10-06T02:55:06.245610+0000","last_unstale":"2023-10-06T02:55:11.242421+0000","last_undegraded":"2023-10-06T02:55:11.242421+0000","last_fullsized":"2023-10-06T02:55:11.242421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:22.823456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250468+0000","last_change":"2023-10-06T02:55:07.105844+0000","last_active":"2023-10-06T02:55:11.250468+0000","last_peered":"2023-10-06T02:55:11.250468+0000","last_clean":"2023-10-06T02:55:11.250468+0000","last_became_active":"2023-10-06T02:55:07.105587+0000","last_became_peered":"2023-10-06T02:55:07.105587+0000","last_unstale":"2023-10-06T02:55:11.250468+0000","last_undegraded":"2023-10-06T02:55:11.250468+0000","last_fullsized":"2023-10-06T02:55:11.250468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:39.307208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.254953+0000","last_change":"2023-10-06T02:55:11.252978+0000","last_active":"2023-10-06T02:55:11.254953+0000","last_peered":"2023-10-06T02:55:11.254953+0000","last_clean":"2023-10-06T02:55:11.254953+0000","last_became_active":"2023-10-06T02:55:11.252446+0000","last_became_peered":"2023-10-06T02:55:11.252446+0000","last_unstale":"2023-10-06T02:55:11.254953+0000","last_undegraded":"2023-10-06T02:55:11.254953+0000","last_fullsized":"2023-10-06T02:55:11.254953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:20.987504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.238567+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:55:11.238567+0000","last_peered":"2023-10-06T02:55:11.238567+0000","last_clean":"2023-10-06T02:55:11.238567+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:55:11.238567+0000","last_undegraded":"2023-10-06T02:55:11.238567+0000","last_fullsized":"2023-10-06T02:55:11.238567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250490+0000","last_change":"2023-10-06T02:55:06.234766+0000","last_active":"2023-10-06T02:55:11.250490+0000","last_peered":"2023-10-06T02:55:11.250490+0000","last_clean":"2023-10-06T02:55:11.250490+0000","last_became_active":"2023-10-06T02:55:06.234390+0000","last_became_peered":"2023-10-06T02:55:06.234390+0000","last_unstale":"2023-10-06T02:55:11.250490+0000","last_undegraded":"2023-10-06T02:55:11.250490+0000","last_fullsized":"2023-10-06T02:55:11.250490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251232+0000","last_change":"2023-10-06T02:55:07.112215+0000","last_active":"2023-10-06T02:55:11.251232+0000","last_peered":"2023-10-06T02:55:11.251232+0000","last_clean":"2023-10-06T02:55:11.251232+0000","last_became_active":"2023-10-06T02:55:07.110597+0000","last_became_peered":"2023-10-06T02:55:07.110597+0000","last_unstale":"2023-10-06T02:55:11.251232+0000","last_undegraded":"2023-10-06T02:55:11.251232+0000","last_fullsized":"2023-10-06T02:55:11.251232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.267018+0000","last_change":"2023-10-06T02:55:11.259468+0000","last_active":"2023-10-06T02:55:11.267018+0000","last_peered":"2023-10-06T02:55:11.267018+0000","last_clean":"2023-10-06T02:55:11.267018+0000","last_became_active":"2023-10-06T02:55:11.259056+0000","last_became_peered":"2023-10-06T02:55:11.259056+0000","last_unstale":"2023-10-06T02:55:11.267018+0000","last_undegraded":"2023-10-06T02:55:11.267018+0000","last_fullsized":"2023-10-06T02:55:11.267018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236914+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:55:11.236914+0000","last_peered":"2023-10-06T02:55:11.236914+0000","last_clean":"2023-10-06T02:55:11.236914+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:55:11.236914+0000","last_undegraded":"2023-10-06T02:55:11.236914+0000","last_fullsized":"2023-10-06T02:55:11.236914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246339+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:55:11.246339+0000","last_peered":"2023-10-06T02:55:11.246339+0000","last_clean":"2023-10-06T02:55:11.246339+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:55:11.246339+0000","last_undegraded":"2023-10-06T02:55:11.246339+0000","last_fullsized":"2023-10-06T02:55:11.246339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235039+0000","last_change":"2023-10-06T02:55:06.244584+0000","last_active":"2023-10-06T02:55:11.235039+0000","last_peered":"2023-10-06T02:55:11.235039+0000","last_clean":"2023-10-06T02:55:11.235039+0000","last_became_active":"2023-10-06T02:55:06.244277+0000","last_became_peered":"2023-10-06T02:55:06.244277+0000","last_unstale":"2023-10-06T02:55:11.235039+0000","last_undegraded":"2023-10-06T02:55:11.235039+0000","last_fullsized":"2023-10-06T02:55:11.235039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235736+0000","last_change":"2023-10-06T02:55:07.102220+0000","last_active":"2023-10-06T02:55:11.235736+0000","last_peered":"2023-10-06T02:55:11.235736+0000","last_clean":"2023-10-06T02:55:11.235736+0000","last_became_active":"2023-10-06T02:55:07.101946+0000","last_became_peered":"2023-10-06T02:55:07.101946+0000","last_unstale":"2023-10-06T02:55:11.235736+0000","last_undegraded":"2023-10-06T02:55:11.235736+0000","last_fullsized":"2023-10-06T02:55:11.235736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:03.946045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263766+0000","last_change":"2023-10-06T02:55:11.256345+0000","last_active":"2023-10-06T02:55:11.263766+0000","last_peered":"2023-10-06T02:55:11.263766+0000","last_clean":"2023-10-06T02:55:11.263766+0000","last_became_active":"2023-10-06T02:55:11.253584+0000","last_became_peered":"2023-10-06T02:55:11.253584+0000","last_unstale":"2023-10-06T02:55:11.263766+0000","last_undegraded":"2023-10-06T02:55:11.263766+0000","last_fullsized":"2023-10-06T02:55:11.263766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246558+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:55:11.246558+0000","last_peered":"2023-10-06T02:55:11.246558+0000","last_clean":"2023-10-06T02:55:11.246558+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:55:11.246558+0000","last_undegraded":"2023-10-06T02:55:11.246558+0000","last_fullsized":"2023-10-06T02:55:11.246558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242581+0000","last_change":"2023-10-06T02:55:06.243148+0000","last_active":"2023-10-06T02:55:11.242581+0000","last_peered":"2023-10-06T02:55:11.242581+0000","last_clean":"2023-10-06T02:55:11.242581+0000","last_became_active":"2023-10-06T02:55:06.242874+0000","last_became_peered":"2023-10-06T02:55:06.242874+0000","last_unstale":"2023-10-06T02:55:11.242581+0000","last_undegraded":"2023-10-06T02:55:11.242581+0000","last_fullsized":"2023-10-06T02:55:11.242581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246552+0000","last_change":"2023-10-06T02:55:07.112041+0000","last_active":"2023-10-06T02:55:11.246552+0000","last_peered":"2023-10-06T02:55:11.246552+0000","last_clean":"2023-10-06T02:55:11.246552+0000","last_became_active":"2023-10-06T02:55:07.111789+0000","last_became_peered":"2023-10-06T02:55:07.111789+0000","last_unstale":"2023-10-06T02:55:11.246552+0000","last_undegraded":"2023-10-06T02:55:11.246552+0000","last_fullsized":"2023-10-06T02:55:11.246552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:09.755341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256412+0000","last_change":"2023-10-06T02:55:11.251646+0000","last_active":"2023-10-06T02:55:11.256412+0000","last_peered":"2023-10-06T02:55:11.256412+0000","last_clean":"2023-10-06T02:55:11.256412+0000","last_became_active":"2023-10-06T02:55:11.251231+0000","last_became_peered":"2023-10-06T02:55:11.251231+0000","last_unstale":"2023-10-06T02:55:11.256412+0000","last_undegraded":"2023-10-06T02:55:11.256412+0000","last_fullsized":"2023-10-06T02:55:11.256412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:44.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249446+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:55:11.249446+0000","last_peered":"2023-10-06T02:55:11.249446+0000","last_clean":"2023-10-06T02:55:11.249446+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:55:11.249446+0000","last_undegraded":"2023-10-06T02:55:11.249446+0000","last_fullsized":"2023-10-06T02:55:11.249446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250704+0000","last_change":"2023-10-06T02:55:06.235823+0000","last_active":"2023-10-06T02:55:11.250704+0000","last_peered":"2023-10-06T02:55:11.250704+0000","last_clean":"2023-10-06T02:55:11.250704+0000","last_became_active":"2023-10-06T02:55:06.235199+0000","last_became_peered":"2023-10-06T02:55:06.235199+0000","last_unstale":"2023-10-06T02:55:11.250704+0000","last_undegraded":"2023-10-06T02:55:11.250704+0000","last_fullsized":"2023-10-06T02:55:11.250704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243179+0000","last_change":"2023-10-06T02:55:07.110542+0000","last_active":"2023-10-06T02:55:11.243179+0000","last_peered":"2023-10-06T02:55:11.243179+0000","last_clean":"2023-10-06T02:55:11.243179+0000","last_became_active":"2023-10-06T02:55:07.110114+0000","last_became_peered":"2023-10-06T02:55:07.110114+0000","last_unstale":"2023-10-06T02:55:11.243179+0000","last_undegraded":"2023-10-06T02:55:11.243179+0000","last_fullsized":"2023-10-06T02:55:11.243179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264312+0000","last_change":"2023-10-06T02:55:11.259777+0000","last_active":"2023-10-06T02:55:11.264312+0000","last_peered":"2023-10-06T02:55:11.264312+0000","last_clean":"2023-10-06T02:55:11.264312+0000","last_became_active":"2023-10-06T02:55:11.259304+0000","last_became_peered":"2023-10-06T02:55:11.259304+0000","last_unstale":"2023-10-06T02:55:11.264312+0000","last_undegraded":"2023-10-06T02:55:11.264312+0000","last_fullsized":"2023-10-06T02:55:11.264312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:00.296633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235554+0000","last_change":"2023-10-06T02:55:06.240511+0000","last_active":"2023-10-06T02:55:11.235554+0000","last_peered":"2023-10-06T02:55:11.235554+0000","last_clean":"2023-10-06T02:55:11.235554+0000","last_became_active":"2023-10-06T02:55:06.240232+0000","last_became_peered":"2023-10-06T02:55:06.240232+0000","last_unstale":"2023-10-06T02:55:11.235554+0000","last_undegraded":"2023-10-06T02:55:11.235554+0000","last_fullsized":"2023-10-06T02:55:11.235554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251025+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:55:11.251025+0000","last_peered":"2023-10-06T02:55:11.251025+0000","last_clean":"2023-10-06T02:55:11.251025+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:55:11.251025+0000","last_undegraded":"2023-10-06T02:55:11.251025+0000","last_fullsized":"2023-10-06T02:55:11.251025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.234999+0000","last_change":"2023-10-06T02:55:07.109361+0000","last_active":"2023-10-06T02:55:11.234999+0000","last_peered":"2023-10-06T02:55:11.234999+0000","last_clean":"2023-10-06T02:55:11.234999+0000","last_became_active":"2023-10-06T02:55:07.109009+0000","last_became_peered":"2023-10-06T02:55:07.109009+0000","last_unstale":"2023-10-06T02:55:11.234999+0000","last_undegraded":"2023-10-06T02:55:11.234999+0000","last_fullsized":"2023-10-06T02:55:11.234999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.943919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253185+0000","last_change":"2023-10-06T02:55:11.248862+0000","last_active":"2023-10-06T02:55:11.253185+0000","last_peered":"2023-10-06T02:55:11.253185+0000","last_clean":"2023-10-06T02:55:11.253185+0000","last_became_active":"2023-10-06T02:55:11.248509+0000","last_became_peered":"2023-10-06T02:55:11.248509+0000","last_unstale":"2023-10-06T02:55:11.253185+0000","last_undegraded":"2023-10-06T02:55:11.253185+0000","last_fullsized":"2023-10-06T02:55:11.253185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.238397+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:55:11.238397+0000","last_peered":"2023-10-06T02:55:11.238397+0000","last_clean":"2023-10-06T02:55:11.238397+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:55:11.238397+0000","last_undegraded":"2023-10-06T02:55:11.238397+0000","last_fullsized":"2023-10-06T02:55:11.238397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T02:55:12.228337+0000","last_change":"2023-10-06T02:55:06.238192+0000","last_active":"2023-10-06T02:55:12.228337+0000","last_peered":"2023-10-06T02:55:12.228337+0000","last_clean":"2023-10-06T02:55:12.228337+0000","last_became_active":"2023-10-06T02:55:06.237939+0000","last_became_peered":"2023-10-06T02:55:06.237939+0000","last_unstale":"2023-10-06T02:55:12.228337+0000","last_undegraded":"2023-10-06T02:55:12.228337+0000","last_fullsized":"2023-10-06T02:55:12.228337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:02.326100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242677+0000","last_change":"2023-10-06T02:55:07.106782+0000","last_active":"2023-10-06T02:55:11.242677+0000","last_peered":"2023-10-06T02:55:11.242677+0000","last_clean":"2023-10-06T02:55:11.242677+0000","last_became_active":"2023-10-06T02:55:07.106537+0000","last_became_peered":"2023-10-06T02:55:07.106537+0000","last_unstale":"2023-10-06T02:55:11.242677+0000","last_undegraded":"2023-10-06T02:55:11.242677+0000","last_fullsized":"2023-10-06T02:55:11.242677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264229+0000","last_change":"2023-10-06T02:55:11.262893+0000","last_active":"2023-10-06T02:55:11.264229+0000","last_peered":"2023-10-06T02:55:11.264229+0000","last_clean":"2023-10-06T02:55:11.264229+0000","last_became_active":"2023-10-06T02:55:11.262445+0000","last_became_peered":"2023-10-06T02:55:11.262445+0000","last_unstale":"2023-10-06T02:55:11.264229+0000","last_undegraded":"2023-10-06T02:55:11.264229+0000","last_fullsized":"2023-10-06T02:55:11.264229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243094+0000","last_change":"2023-10-06T02:55:06.244999+0000","last_active":"2023-10-06T02:55:11.243094+0000","last_peered":"2023-10-06T02:55:11.243094+0000","last_clean":"2023-10-06T02:55:11.243094+0000","last_became_active":"2023-10-06T02:55:06.244558+0000","last_became_peered":"2023-10-06T02:55:06.244558+0000","last_unstale":"2023-10-06T02:55:11.243094+0000","last_undegraded":"2023-10-06T02:55:11.243094+0000","last_fullsized":"2023-10-06T02:55:11.243094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240384+0000","last_change":"2023-10-06T02:55:07.115236+0000","last_active":"2023-10-06T02:55:11.240384+0000","last_peered":"2023-10-06T02:55:11.240384+0000","last_clean":"2023-10-06T02:55:11.240384+0000","last_became_active":"2023-10-06T02:55:07.115036+0000","last_became_peered":"2023-10-06T02:55:07.115036+0000","last_unstale":"2023-10-06T02:55:11.240384+0000","last_undegraded":"2023-10-06T02:55:11.240384+0000","last_fullsized":"2023-10-06T02:55:11.240384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:28.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.262746+0000","last_change":"2023-10-06T02:55:11.258225+0000","last_active":"2023-10-06T02:55:11.262746+0000","last_peered":"2023-10-06T02:55:11.262746+0000","last_clean":"2023-10-06T02:55:11.262746+0000","last_became_active":"2023-10-06T02:55:11.257846+0000","last_became_peered":"2023-10-06T02:55:11.257846+0000","last_unstale":"2023-10-06T02:55:11.262746+0000","last_undegraded":"2023-10-06T02:55:11.262746+0000","last_fullsized":"2023-10-06T02:55:11.262746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236306+0000","last_change":"2023-10-06T02:55:06.243711+0000","last_active":"2023-10-06T02:55:11.236306+0000","last_peered":"2023-10-06T02:55:11.236306+0000","last_clean":"2023-10-06T02:55:11.236306+0000","last_became_active":"2023-10-06T02:55:06.243344+0000","last_became_peered":"2023-10-06T02:55:06.243344+0000","last_unstale":"2023-10-06T02:55:11.236306+0000","last_undegraded":"2023-10-06T02:55:11.236306+0000","last_fullsized":"2023-10-06T02:55:11.236306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243012+0000","last_change":"2023-10-06T02:55:07.114426+0000","last_active":"2023-10-06T02:55:11.243012+0000","last_peered":"2023-10-06T02:55:11.243012+0000","last_clean":"2023-10-06T02:55:11.243012+0000","last_became_active":"2023-10-06T02:55:07.114145+0000","last_became_peered":"2023-10-06T02:55:07.114145+0000","last_unstale":"2023-10-06T02:55:11.243012+0000","last_undegraded":"2023-10-06T02:55:11.243012+0000","last_fullsized":"2023-10-06T02:55:11.243012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261060+0000","last_change":"2023-10-06T02:55:11.254928+0000","last_active":"2023-10-06T02:55:11.261060+0000","last_peered":"2023-10-06T02:55:11.261060+0000","last_clean":"2023-10-06T02:55:11.261060+0000","last_became_active":"2023-10-06T02:55:11.254507+0000","last_became_peered":"2023-10-06T02:55:11.254507+0000","last_unstale":"2023-10-06T02:55:11.261060+0000","last_undegraded":"2023-10-06T02:55:11.261060+0000","last_fullsized":"2023-10-06T02:55:11.261060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236065+0000","last_change":"2023-10-06T02:55:06.243499+0000","last_active":"2023-10-06T02:55:11.236065+0000","last_peered":"2023-10-06T02:55:11.236065+0000","last_clean":"2023-10-06T02:55:11.236065+0000","last_became_active":"2023-10-06T02:55:06.243225+0000","last_became_peered":"2023-10-06T02:55:06.243225+0000","last_unstale":"2023-10-06T02:55:11.236065+0000","last_undegraded":"2023-10-06T02:55:11.236065+0000","last_fullsized":"2023-10-06T02:55:11.236065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242673+0000","last_change":"2023-10-06T02:55:07.109529+0000","last_active":"2023-10-06T02:55:11.242673+0000","last_peered":"2023-10-06T02:55:11.242673+0000","last_clean":"2023-10-06T02:55:11.242673+0000","last_became_active":"2023-10-06T02:55:07.109235+0000","last_became_peered":"2023-10-06T02:55:07.109235+0000","last_unstale":"2023-10-06T02:55:11.242673+0000","last_undegraded":"2023-10-06T02:55:11.242673+0000","last_fullsized":"2023-10-06T02:55:11.242673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:16.973575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264275+0000","last_change":"2023-10-06T02:55:11.259478+0000","last_active":"2023-10-06T02:55:11.264275+0000","last_peered":"2023-10-06T02:55:11.264275+0000","last_clean":"2023-10-06T02:55:11.264275+0000","last_became_active":"2023-10-06T02:55:11.258396+0000","last_became_peered":"2023-10-06T02:55:11.258396+0000","last_unstale":"2023-10-06T02:55:11.264275+0000","last_undegraded":"2023-10-06T02:55:11.264275+0000","last_fullsized":"2023-10-06T02:55:11.264275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.869089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235575+0000","last_change":"2023-10-06T02:55:06.243717+0000","last_active":"2023-10-06T02:55:11.235575+0000","last_peered":"2023-10-06T02:55:11.235575+0000","last_clean":"2023-10-06T02:55:11.235575+0000","last_became_active":"2023-10-06T02:55:06.243477+0000","last_became_peered":"2023-10-06T02:55:06.243477+0000","last_unstale":"2023-10-06T02:55:11.235575+0000","last_undegraded":"2023-10-06T02:55:11.235575+0000","last_fullsized":"2023-10-06T02:55:11.235575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:02.326100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235163+0000","last_change":"2023-10-06T02:55:07.109710+0000","last_active":"2023-10-06T02:55:11.235163+0000","last_peered":"2023-10-06T02:55:11.235163+0000","last_clean":"2023-10-06T02:55:11.235163+0000","last_became_active":"2023-10-06T02:55:07.109311+0000","last_became_peered":"2023-10-06T02:55:07.109311+0000","last_unstale":"2023-10-06T02:55:11.235163+0000","last_undegraded":"2023-10-06T02:55:11.235163+0000","last_fullsized":"2023-10-06T02:55:11.235163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.255838+0000","last_change":"2023-10-06T02:55:11.251970+0000","last_active":"2023-10-06T02:55:11.255838+0000","last_peered":"2023-10-06T02:55:11.255838+0000","last_clean":"2023-10-06T02:55:11.255838+0000","last_became_active":"2023-10-06T02:55:11.251576+0000","last_became_peered":"2023-10-06T02:55:11.251576+0000","last_unstale":"2023-10-06T02:55:11.255838+0000","last_undegraded":"2023-10-06T02:55:11.255838+0000","last_fullsized":"2023-10-06T02:55:11.255838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243536+0000","last_change":"2023-10-06T02:55:06.243528+0000","last_active":"2023-10-06T02:55:11.243536+0000","last_peered":"2023-10-06T02:55:11.243536+0000","last_clean":"2023-10-06T02:55:11.243536+0000","last_became_active":"2023-10-06T02:55:06.243235+0000","last_became_peered":"2023-10-06T02:55:06.243235+0000","last_unstale":"2023-10-06T02:55:11.243536+0000","last_undegraded":"2023-10-06T02:55:11.243536+0000","last_fullsized":"2023-10-06T02:55:11.243536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245975+0000","last_change":"2023-10-06T02:55:07.103783+0000","last_active":"2023-10-06T02:55:11.245975+0000","last_peered":"2023-10-06T02:55:11.245975+0000","last_clean":"2023-10-06T02:55:11.245975+0000","last_became_active":"2023-10-06T02:55:07.103380+0000","last_became_peered":"2023-10-06T02:55:07.103380+0000","last_unstale":"2023-10-06T02:55:11.245975+0000","last_undegraded":"2023-10-06T02:55:11.245975+0000","last_fullsized":"2023-10-06T02:55:11.245975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.943919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236264+0000","last_change":"2023-10-06T02:55:07.102410+0000","last_active":"2023-10-06T02:55:11.236264+0000","last_peered":"2023-10-06T02:55:11.236264+0000","last_clean":"2023-10-06T02:55:11.236264+0000","last_became_active":"2023-10-06T02:55:07.102078+0000","last_became_peered":"2023-10-06T02:55:07.102078+0000","last_unstale":"2023-10-06T02:55:11.236264+0000","last_undegraded":"2023-10-06T02:55:11.236264+0000","last_fullsized":"2023-10-06T02:55:11.236264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:05.829702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235500+0000","last_change":"2023-10-06T02:55:07.116830+0000","last_active":"2023-10-06T02:55:11.235500+0000","last_peered":"2023-10-06T02:55:11.235500+0000","last_clean":"2023-10-06T02:55:11.235500+0000","last_became_active":"2023-10-06T02:55:07.116644+0000","last_became_peered":"2023-10-06T02:55:07.116644+0000","last_unstale":"2023-10-06T02:55:11.235500+0000","last_undegraded":"2023-10-06T02:55:11.235500+0000","last_fullsized":"2023-10-06T02:55:11.235500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244388+0000","last_change":"2023-10-06T02:55:07.104996+0000","last_active":"2023-10-06T02:55:11.244388+0000","last_peered":"2023-10-06T02:55:11.244388+0000","last_clean":"2023-10-06T02:55:11.244388+0000","last_became_active":"2023-10-06T02:55:07.104710+0000","last_became_peered":"2023-10-06T02:55:07.104710+0000","last_unstale":"2023-10-06T02:55:11.244388+0000","last_undegraded":"2023-10-06T02:55:11.244388+0000","last_fullsized":"2023-10-06T02:55:11.244388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:09.033880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235232+0000","last_change":"2023-10-06T02:55:07.109367+0000","last_active":"2023-10-06T02:55:11.235232+0000","last_peered":"2023-10-06T02:55:11.235232+0000","last_clean":"2023-10-06T02:55:11.235232+0000","last_became_active":"2023-10-06T02:55:07.109089+0000","last_became_peered":"2023-10-06T02:55:07.109089+0000","last_unstale":"2023-10-06T02:55:11.235232+0000","last_undegraded":"2023-10-06T02:55:11.235232+0000","last_fullsized":"2023-10-06T02:55:11.235232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250624+0000","last_change":"2023-10-06T02:55:07.108442+0000","last_active":"2023-10-06T02:55:11.250624+0000","last_peered":"2023-10-06T02:55:11.250624+0000","last_clean":"2023-10-06T02:55:11.250624+0000","last_became_active":"2023-10-06T02:55:07.108151+0000","last_became_peered":"2023-10-06T02:55:07.108151+0000","last_unstale":"2023-10-06T02:55:11.250624+0000","last_undegraded":"2023-10-06T02:55:11.250624+0000","last_fullsized":"2023-10-06T02:55:11.250624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":118562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":118652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:55:20.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:55:20.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.468+0000 7f779341b700 1 Processor -- start 2023-10-06T02:55:20.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.468+0000 7f779341b700 1 -- start start 2023-10-06T02:55:20.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f779341b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f778c1594b0 0x7f778c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f779341b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f778c0c6260 0x7f778c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f779341b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778c0cd610 con 0x7f778c0cd1a0 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f779341b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c0cc840 con 0x7f778c0c6260 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f779341b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0cbc70 con 0x7f778c1594b0 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f7791c18700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f778c0cd1a0 0x7f778c0ce9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36644/0 (socket says 172.21.15.84:36644) 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f7791c18700 1 -- 172.21.15.84:0/940198711 learned_addr learned my addr 172.21.15.84:0/940198711 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252430483 0 0) 0x7f778c0cd610 con 0x7f778c0cd1a0 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7778003570 con 0x7f778c0cd1a0 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f7792c1a700 1 --2- 172.21.15.84:0/940198711 >> v2:172.21.15.131:3300/0 conn(0x7f778c0c6260 0x7f778c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.469+0000 7f7792419700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f778c1594b0 0x7f778c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3675554667 0 0) 0x7f7778003570 con 0x7f778c0cd1a0 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f778c1594b0 msgr2=0x7f778c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f778c1594b0 0x7f778c0ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 >> v2:172.21.15.131:3300/0 conn(0x7f778c0c6260 msgr2=0x7f778c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 --2- 172.21.15.84:0/940198711 >> v2:172.21.15.131:3300/0 conn(0x7f778c0c6260 0x7f778c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c0cbf10 con 0x7f778c0cd1a0 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f777c0015f0 con 0x7f778c0cd1a0 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 >> v1:172.21.15.84:6789/0 conn(0x7f778c0cd1a0 legacy=0x7f778c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f778c1594b0 0x7f7778003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7778003fe0 0x7f7778004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7778004d50 0x7f77780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0cc840 con 0x7f7778004d50 2023-10-06T02:55:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0cbc70 con 0x7f7778003fe0 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777800bb40 con 0x7f778c1594b0 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7792c1a700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7778004d50 0x7f77780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791c18700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7778003fe0 0x7f7778004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7792419700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f778c1594b0 0x7f7778003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7792c1a700 1 -- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f778c1594b0 msgr2=0x7f7778003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7792c1a700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f778c1594b0 0x7f7778003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7792c1a700 1 -- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7778003fe0 msgr2=0x7f7778004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7792c1a700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7778003fe0 0x7f7778004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7792c1a700 1 -- 172.21.15.84:0/940198711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778003570 con 0x7f7778004d50 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7792419700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f778c1594b0 0x7f7778003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7792c1a700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7778004d50 0x7f77780051c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77840094d0 tx=0x7f778400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2b08a43ddd0da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400ea90 con 0x7f7778004d50 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778400f040 con 0x7f7778004d50 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.470+0000 7f7791417700 1 -- 172.21.15.84:0/940198711 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400ee20 con 0x7f7778004d50 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.471+0000 7f779341b700 1 -- 172.21.15.84:0/940198711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7778004d50 msgr2=0x7f77780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.471+0000 7f779341b700 1 --2- 172.21.15.84:0/940198711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7778004d50 0x7f77780051c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77840094d0 tx=0x7f778400b040 comp rx=0 tx=0).stop 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.471+0000 7f7792c1a700 1 -- 172.21.15.84:0/940198711 reap_dead start 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.471+0000 7f779341b700 1 -- 172.21.15.84:0/940198711 shutdown_connections 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.471+0000 7f779341b700 1 -- 172.21.15.84:0/940198711 >> 172.21.15.84:0/940198711 conn(0x7f778c099600 msgr2=0x7f778c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.471+0000 7f779341b700 1 -- 172.21.15.84:0/940198711 shutdown_connections 2023-10-06T02:55:20.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.471+0000 7f779341b700 1 -- 172.21.15.84:0/940198711 wait complete. 2023-10-06T02:55:20.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.472+0000 7f779341b700 1 Processor -- start 2023-10-06T02:55:20.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.472+0000 7f779341b700 1 -- start start 2023-10-06T02:55:20.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f779341b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7778004d50 0x7f778c15f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f779341b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f778c157e00 0x7f778c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f779341b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f778c15b2e0 0x7f778c15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f779341b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c15bcc0 con 0x7f778c15b2e0 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f779341b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c15e3b0 con 0x7f778c157e00 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f779341b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1585f0 con 0x7f7778004d50 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792c1a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f778c15b2e0 0x7f778c15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792c1a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f778c15b2e0 0x7f778c15b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51070/0 (socket says 172.21.15.84:51070) 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792c1a700 1 -- 172.21.15.84:0/803234950 learned_addr learned my addr 172.21.15.84:0/803234950 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7791c18700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f778c157e00 0x7f778c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792419700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7778004d50 0x7f778c15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792c1a700 1 -- 172.21.15.84:0/803234950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7778004d50 msgr2=0x7f778c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792c1a700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7778004d50 0x7f778c15f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792c1a700 1 -- 172.21.15.84:0/803234950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f778c157e00 msgr2=0x7f778c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792c1a700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f778c157e00 0x7f778c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792c1a700 1 -- 172.21.15.84:0/803234950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c15da80 con 0x7f778c15b2e0 2023-10-06T02:55:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792419700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7778004d50 0x7f778c15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f7792c1a700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f778c15b2e0 0x7f778c15b780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7784016000 tx=0x7f778401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.473+0000 7f77827fc700 1 -- 172.21.15.84:0/803234950 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400ee90 con 0x7f778c15b2e0 2023-10-06T02:55:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.474+0000 7f77827fc700 1 -- 172.21.15.84:0/803234950 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778401d630 con 0x7f778c15b2e0 2023-10-06T02:55:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.474+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c15dd60 con 0x7f778c15b2e0 2023-10-06T02:55:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.474+0000 7f77827fc700 1 -- 172.21.15.84:0/803234950 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778401d9f0 con 0x7f778c15b2e0 2023-10-06T02:55:20.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.474+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c15f960 con 0x7f778c15b2e0 2023-10-06T02:55:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.474+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c15e560 con 0x7f778c15b2e0 2023-10-06T02:55:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.475+0000 7f77827fc700 1 -- 172.21.15.84:0/803234950 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77840133e0 con 0x7f778c15b2e0 2023-10-06T02:55:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.475+0000 7f77827fc700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7770066f30 0x7f77700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.475+0000 7f77827fc700 1 -- 172.21.15.84:0/803234950 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7784086680 con 0x7f778c15b2e0 2023-10-06T02:55:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.475+0000 7f7792419700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7770066f30 0x7f77700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.476+0000 7f7792419700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7770066f30 0x7f77700693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7788006aa0 tx=0x7f7788008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.480+0000 7f77827fc700 1 -- 172.21.15.84:0/803234950 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f778c15e560 con 0x7f778c15b2e0 2023-10-06T02:55:20.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.656+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f778c15e200 con 0x7f7770066f30 2023-10-06T02:55:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.666+0000 7f77827fc700 1 -- 172.21.15.84:0/803234950 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367397 (secure 0 0 0) 0x7f778c15e200 con 0x7f7770066f30 2023-10-06T02:55:20.671 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7770066f30 msgr2=0x7f77700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7770066f30 0x7f77700693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7788006aa0 tx=0x7f7788008040 comp rx=0 tx=0).stop 2023-10-06T02:55:20.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f778c15b2e0 msgr2=0x7f778c15b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f778c15b2e0 0x7f778c15b780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7784016000 tx=0x7f778401a000 comp rx=0 tx=0).stop 2023-10-06T02:55:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 shutdown_connections 2023-10-06T02:55:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7770066f30 0x7f77700693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f778c15b2e0 0x7f778c15b780 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7778004d50 0x7f778c15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 --2- 172.21.15.84:0/803234950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f778c157e00 0x7f778c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 >> 172.21.15.84:0/803234950 conn(0x7f778c099600 msgr2=0x7f778c068270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 shutdown_connections 2023-10-06T02:55:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.669+0000 7f779341b700 1 -- 172.21.15.84:0/803234950 wait complete. 2023-10-06T02:55:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:55:20.683 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-10-06T02:55:19.801313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381788,"kb_used_data":3484,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592932,"statfs":{"total":773094113280,"available":770655162368,"internally_reserved":0,"allocated":3567616,"data_stored":2143255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.567573"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239422+0000","last_change":"2023-10-06T02:55:07.110201+0000","last_active":"2023-10-06T02:55:11.239422+0000","last_peered":"2023-10-06T02:55:11.239422+0000","last_clean":"2023-10-06T02:55:11.239422+0000","last_became_active":"2023-10-06T02:55:07.109835+0000","last_became_peered":"2023-10-06T02:55:07.109835+0000","last_unstale":"2023-10-06T02:55:11.239422+0000","last_undegraded":"2023-10-06T02:55:11.239422+0000","last_fullsized":"2023-10-06T02:55:11.239422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:37.914521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236087+0000","last_change":"2023-10-06T02:55:07.113784+0000","last_active":"2023-10-06T02:55:11.236087+0000","last_peered":"2023-10-06T02:55:11.236087+0000","last_clean":"2023-10-06T02:55:11.236087+0000","last_became_active":"2023-10-06T02:55:07.113542+0000","last_became_peered":"2023-10-06T02:55:07.113542+0000","last_unstale":"2023-10-06T02:55:11.236087+0000","last_undegraded":"2023-10-06T02:55:11.236087+0000","last_fullsized":"2023-10-06T02:55:11.236087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:45.135333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244003+0000","last_change":"2023-10-06T02:55:07.109629+0000","last_active":"2023-10-06T02:55:11.244003+0000","last_peered":"2023-10-06T02:55:11.244003+0000","last_clean":"2023-10-06T02:55:11.244003+0000","last_became_active":"2023-10-06T02:55:07.109299+0000","last_became_peered":"2023-10-06T02:55:07.109299+0000","last_unstale":"2023-10-06T02:55:11.244003+0000","last_undegraded":"2023-10-06T02:55:11.244003+0000","last_fullsized":"2023-10-06T02:55:11.244003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:18.661747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236454+0000","last_change":"2023-10-06T02:55:07.109778+0000","last_active":"2023-10-06T02:55:11.236454+0000","last_peered":"2023-10-06T02:55:11.236454+0000","last_clean":"2023-10-06T02:55:11.236454+0000","last_became_active":"2023-10-06T02:55:07.109509+0000","last_became_peered":"2023-10-06T02:55:07.109509+0000","last_unstale":"2023-10-06T02:55:11.236454+0000","last_undegraded":"2023-10-06T02:55:11.236454+0000","last_fullsized":"2023-10-06T02:55:11.236454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:06.894832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243263+0000","last_change":"2023-10-06T02:55:07.114751+0000","last_active":"2023-10-06T02:55:11.243263+0000","last_peered":"2023-10-06T02:55:11.243263+0000","last_clean":"2023-10-06T02:55:11.243263+0000","last_became_active":"2023-10-06T02:55:07.114487+0000","last_became_peered":"2023-10-06T02:55:07.114487+0000","last_unstale":"2023-10-06T02:55:11.243263+0000","last_undegraded":"2023-10-06T02:55:11.243263+0000","last_fullsized":"2023-10-06T02:55:11.243263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244303+0000","last_change":"2023-10-06T02:55:07.111190+0000","last_active":"2023-10-06T02:55:11.244303+0000","last_peered":"2023-10-06T02:55:11.244303+0000","last_clean":"2023-10-06T02:55:11.244303+0000","last_became_active":"2023-10-06T02:55:07.110893+0000","last_became_peered":"2023-10-06T02:55:07.110893+0000","last_unstale":"2023-10-06T02:55:11.244303+0000","last_undegraded":"2023-10-06T02:55:11.244303+0000","last_fullsized":"2023-10-06T02:55:11.244303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:41.387727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.247033+0000","last_change":"2023-10-06T02:55:07.114160+0000","last_active":"2023-10-06T02:55:11.247033+0000","last_peered":"2023-10-06T02:55:11.247033+0000","last_clean":"2023-10-06T02:55:11.247033+0000","last_became_active":"2023-10-06T02:55:07.113571+0000","last_became_peered":"2023-10-06T02:55:07.113571+0000","last_unstale":"2023-10-06T02:55:11.247033+0000","last_undegraded":"2023-10-06T02:55:11.247033+0000","last_fullsized":"2023-10-06T02:55:11.247033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235851+0000","last_change":"2023-10-06T02:55:07.106766+0000","last_active":"2023-10-06T02:55:11.235851+0000","last_peered":"2023-10-06T02:55:11.235851+0000","last_clean":"2023-10-06T02:55:11.235851+0000","last_became_active":"2023-10-06T02:55:07.106562+0000","last_became_peered":"2023-10-06T02:55:07.106562+0000","last_unstale":"2023-10-06T02:55:11.235851+0000","last_undegraded":"2023-10-06T02:55:11.235851+0000","last_fullsized":"2023-10-06T02:55:11.235851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243386+0000","last_change":"2023-10-06T02:55:07.112458+0000","last_active":"2023-10-06T02:55:11.243386+0000","last_peered":"2023-10-06T02:55:11.243386+0000","last_clean":"2023-10-06T02:55:11.243386+0000","last_became_active":"2023-10-06T02:55:07.112034+0000","last_became_peered":"2023-10-06T02:55:07.112034+0000","last_unstale":"2023-10-06T02:55:11.243386+0000","last_undegraded":"2023-10-06T02:55:11.243386+0000","last_fullsized":"2023-10-06T02:55:11.243386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236308+0000","last_change":"2023-10-06T02:55:07.110571+0000","last_active":"2023-10-06T02:55:11.236308+0000","last_peered":"2023-10-06T02:55:11.236308+0000","last_clean":"2023-10-06T02:55:11.236308+0000","last_became_active":"2023-10-06T02:55:07.110305+0000","last_became_peered":"2023-10-06T02:55:07.110305+0000","last_unstale":"2023-10-06T02:55:11.236308+0000","last_undegraded":"2023-10-06T02:55:11.236308+0000","last_fullsized":"2023-10-06T02:55:11.236308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:48.545728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243893+0000","last_change":"2023-10-06T02:55:07.111579+0000","last_active":"2023-10-06T02:55:11.243893+0000","last_peered":"2023-10-06T02:55:11.243893+0000","last_clean":"2023-10-06T02:55:11.243893+0000","last_became_active":"2023-10-06T02:55:07.111318+0000","last_became_peered":"2023-10-06T02:55:07.111318+0000","last_unstale":"2023-10-06T02:55:11.243893+0000","last_undegraded":"2023-10-06T02:55:11.243893+0000","last_fullsized":"2023-10-06T02:55:11.243893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:47.019187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240508+0000","last_change":"2023-10-06T02:55:07.104069+0000","last_active":"2023-10-06T02:55:11.240508+0000","last_peered":"2023-10-06T02:55:11.240508+0000","last_clean":"2023-10-06T02:55:11.240508+0000","last_became_active":"2023-10-06T02:55:07.103805+0000","last_became_peered":"2023-10-06T02:55:07.103805+0000","last_unstale":"2023-10-06T02:55:11.240508+0000","last_undegraded":"2023-10-06T02:55:11.240508+0000","last_fullsized":"2023-10-06T02:55:11.240508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:05.829702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239484+0000","last_change":"2023-10-06T02:55:07.109817+0000","last_active":"2023-10-06T02:55:11.239484+0000","last_peered":"2023-10-06T02:55:11.239484+0000","last_clean":"2023-10-06T02:55:11.239484+0000","last_became_active":"2023-10-06T02:55:07.109582+0000","last_became_peered":"2023-10-06T02:55:07.109582+0000","last_unstale":"2023-10-06T02:55:11.239484+0000","last_undegraded":"2023-10-06T02:55:11.239484+0000","last_fullsized":"2023-10-06T02:55:11.239484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:51.423073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236216+0000","last_change":"2023-10-06T02:55:07.108183+0000","last_active":"2023-10-06T02:55:11.236216+0000","last_peered":"2023-10-06T02:55:11.236216+0000","last_clean":"2023-10-06T02:55:11.236216+0000","last_became_active":"2023-10-06T02:55:07.107919+0000","last_became_peered":"2023-10-06T02:55:07.107919+0000","last_unstale":"2023-10-06T02:55:11.236216+0000","last_undegraded":"2023-10-06T02:55:11.236216+0000","last_fullsized":"2023-10-06T02:55:11.236216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:50.364030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246844+0000","last_change":"2023-10-06T02:55:07.114341+0000","last_active":"2023-10-06T02:55:11.246844+0000","last_peered":"2023-10-06T02:55:11.246844+0000","last_clean":"2023-10-06T02:55:11.246844+0000","last_became_active":"2023-10-06T02:55:07.113900+0000","last_became_peered":"2023-10-06T02:55:07.113900+0000","last_unstale":"2023-10-06T02:55:11.246844+0000","last_undegraded":"2023-10-06T02:55:11.246844+0000","last_fullsized":"2023-10-06T02:55:11.246844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245965+0000","last_change":"2023-10-06T02:55:07.111225+0000","last_active":"2023-10-06T02:55:11.245965+0000","last_peered":"2023-10-06T02:55:11.245965+0000","last_clean":"2023-10-06T02:55:11.245965+0000","last_became_active":"2023-10-06T02:55:07.110865+0000","last_became_peered":"2023-10-06T02:55:07.110865+0000","last_unstale":"2023-10-06T02:55:11.245965+0000","last_undegraded":"2023-10-06T02:55:11.245965+0000","last_fullsized":"2023-10-06T02:55:11.245965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243421+0000","last_change":"2023-10-06T02:55:07.112286+0000","last_active":"2023-10-06T02:55:11.243421+0000","last_peered":"2023-10-06T02:55:11.243421+0000","last_clean":"2023-10-06T02:55:11.243421+0000","last_became_active":"2023-10-06T02:55:07.111766+0000","last_became_peered":"2023-10-06T02:55:07.111766+0000","last_unstale":"2023-10-06T02:55:11.243421+0000","last_undegraded":"2023-10-06T02:55:11.243421+0000","last_fullsized":"2023-10-06T02:55:11.243421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245058+0000","last_change":"2023-10-06T02:55:07.104506+0000","last_active":"2023-10-06T02:55:11.245058+0000","last_peered":"2023-10-06T02:55:11.245058+0000","last_clean":"2023-10-06T02:55:11.245058+0000","last_became_active":"2023-10-06T02:55:07.103148+0000","last_became_peered":"2023-10-06T02:55:07.103148+0000","last_unstale":"2023-10-06T02:55:11.245058+0000","last_undegraded":"2023-10-06T02:55:11.245058+0000","last_fullsized":"2023-10-06T02:55:11.245058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:30.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239743+0000","last_change":"2023-10-06T02:55:07.102510+0000","last_active":"2023-10-06T02:55:11.239743+0000","last_peered":"2023-10-06T02:55:11.239743+0000","last_clean":"2023-10-06T02:55:11.239743+0000","last_became_active":"2023-10-06T02:55:07.102223+0000","last_became_peered":"2023-10-06T02:55:07.102223+0000","last_unstale":"2023-10-06T02:55:11.239743+0000","last_undegraded":"2023-10-06T02:55:11.239743+0000","last_fullsized":"2023-10-06T02:55:11.239743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:03.327947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.241862+0000","last_change":"2023-10-06T02:55:07.103814+0000","last_active":"2023-10-06T02:55:11.241862+0000","last_peered":"2023-10-06T02:55:11.241862+0000","last_clean":"2023-10-06T02:55:11.241862+0000","last_became_active":"2023-10-06T02:55:07.103540+0000","last_became_peered":"2023-10-06T02:55:07.103540+0000","last_unstale":"2023-10-06T02:55:11.241862+0000","last_undegraded":"2023-10-06T02:55:11.241862+0000","last_fullsized":"2023-10-06T02:55:11.241862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249731+0000","last_change":"2023-10-06T02:55:07.111270+0000","last_active":"2023-10-06T02:55:11.249731+0000","last_peered":"2023-10-06T02:55:11.249731+0000","last_clean":"2023-10-06T02:55:11.249731+0000","last_became_active":"2023-10-06T02:55:07.110988+0000","last_became_peered":"2023-10-06T02:55:07.110988+0000","last_unstale":"2023-10-06T02:55:11.249731+0000","last_undegraded":"2023-10-06T02:55:11.249731+0000","last_fullsized":"2023-10-06T02:55:11.249731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242949+0000","last_change":"2023-10-06T02:55:07.112801+0000","last_active":"2023-10-06T02:55:11.242949+0000","last_peered":"2023-10-06T02:55:11.242949+0000","last_clean":"2023-10-06T02:55:11.242949+0000","last_became_active":"2023-10-06T02:55:07.112541+0000","last_became_peered":"2023-10-06T02:55:07.112541+0000","last_unstale":"2023-10-06T02:55:11.242949+0000","last_undegraded":"2023-10-06T02:55:11.242949+0000","last_fullsized":"2023-10-06T02:55:11.242949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:50.364030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.234999+0000","last_change":"2023-10-06T02:55:07.112735+0000","last_active":"2023-10-06T02:55:11.234999+0000","last_peered":"2023-10-06T02:55:11.234999+0000","last_clean":"2023-10-06T02:55:11.234999+0000","last_became_active":"2023-10-06T02:55:07.112354+0000","last_became_peered":"2023-10-06T02:55:07.112354+0000","last_unstale":"2023-10-06T02:55:11.234999+0000","last_undegraded":"2023-10-06T02:55:11.234999+0000","last_fullsized":"2023-10-06T02:55:11.234999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:30.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246446+0000","last_change":"2023-10-06T02:55:07.111427+0000","last_active":"2023-10-06T02:55:11.246446+0000","last_peered":"2023-10-06T02:55:11.246446+0000","last_clean":"2023-10-06T02:55:11.246446+0000","last_became_active":"2023-10-06T02:55:07.111175+0000","last_became_peered":"2023-10-06T02:55:07.111175+0000","last_unstale":"2023-10-06T02:55:11.246446+0000","last_undegraded":"2023-10-06T02:55:11.246446+0000","last_fullsized":"2023-10-06T02:55:11.246446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251151+0000","last_change":"2023-10-06T02:55:07.111532+0000","last_active":"2023-10-06T02:55:11.251151+0000","last_peered":"2023-10-06T02:55:11.251151+0000","last_clean":"2023-10-06T02:55:11.251151+0000","last_became_active":"2023-10-06T02:55:07.111049+0000","last_became_peered":"2023-10-06T02:55:07.111049+0000","last_unstale":"2023-10-06T02:55:11.251151+0000","last_undegraded":"2023-10-06T02:55:11.251151+0000","last_fullsized":"2023-10-06T02:55:11.251151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251111+0000","last_change":"2023-10-06T02:55:07.107260+0000","last_active":"2023-10-06T02:55:11.251111+0000","last_peered":"2023-10-06T02:55:11.251111+0000","last_clean":"2023-10-06T02:55:11.251111+0000","last_became_active":"2023-10-06T02:55:07.107057+0000","last_became_peered":"2023-10-06T02:55:07.107057+0000","last_unstale":"2023-10-06T02:55:11.251111+0000","last_undegraded":"2023-10-06T02:55:11.251111+0000","last_fullsized":"2023-10-06T02:55:11.251111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:03.676682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236378+0000","last_change":"2023-10-06T02:55:07.109107+0000","last_active":"2023-10-06T02:55:11.236378+0000","last_peered":"2023-10-06T02:55:11.236378+0000","last_clean":"2023-10-06T02:55:11.236378+0000","last_became_active":"2023-10-06T02:55:07.108804+0000","last_became_peered":"2023-10-06T02:55:07.108804+0000","last_unstale":"2023-10-06T02:55:11.236378+0000","last_undegraded":"2023-10-06T02:55:11.236378+0000","last_fullsized":"2023-10-06T02:55:11.236378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261436+0000","last_change":"2023-10-06T02:55:11.256831+0000","last_active":"2023-10-06T02:55:11.261436+0000","last_peered":"2023-10-06T02:55:11.261436+0000","last_clean":"2023-10-06T02:55:11.261436+0000","last_became_active":"2023-10-06T02:55:11.255607+0000","last_became_peered":"2023-10-06T02:55:11.255607+0000","last_unstale":"2023-10-06T02:55:11.261436+0000","last_undegraded":"2023-10-06T02:55:11.261436+0000","last_fullsized":"2023-10-06T02:55:11.261436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:59.809138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244213+0000","last_change":"2023-10-06T02:55:06.241953+0000","last_active":"2023-10-06T02:55:11.244213+0000","last_peered":"2023-10-06T02:55:11.244213+0000","last_clean":"2023-10-06T02:55:11.244213+0000","last_became_active":"2023-10-06T02:55:06.241631+0000","last_became_peered":"2023-10-06T02:55:06.241631+0000","last_unstale":"2023-10-06T02:55:11.244213+0000","last_undegraded":"2023-10-06T02:55:11.244213+0000","last_fullsized":"2023-10-06T02:55:11.244213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:13.153122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235457+0000","last_change":"2023-10-06T02:55:07.116546+0000","last_active":"2023-10-06T02:55:11.235457+0000","last_peered":"2023-10-06T02:55:11.235457+0000","last_clean":"2023-10-06T02:55:11.235457+0000","last_became_active":"2023-10-06T02:55:07.116298+0000","last_became_peered":"2023-10-06T02:55:07.116298+0000","last_unstale":"2023-10-06T02:55:11.235457+0000","last_undegraded":"2023-10-06T02:55:11.235457+0000","last_fullsized":"2023-10-06T02:55:11.235457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:09.033880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261529+0000","last_change":"2023-10-06T02:55:11.255287+0000","last_active":"2023-10-06T02:55:11.261529+0000","last_peered":"2023-10-06T02:55:11.261529+0000","last_clean":"2023-10-06T02:55:11.261529+0000","last_became_active":"2023-10-06T02:55:11.254851+0000","last_became_peered":"2023-10-06T02:55:11.254851+0000","last_unstale":"2023-10-06T02:55:11.261529+0000","last_undegraded":"2023-10-06T02:55:11.261529+0000","last_fullsized":"2023-10-06T02:55:11.261529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:39.598115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250011+0000","last_change":"2023-10-06T02:55:06.241290+0000","last_active":"2023-10-06T02:55:11.250011+0000","last_peered":"2023-10-06T02:55:11.250011+0000","last_clean":"2023-10-06T02:55:11.250011+0000","last_became_active":"2023-10-06T02:55:06.240960+0000","last_became_peered":"2023-10-06T02:55:06.240960+0000","last_unstale":"2023-10-06T02:55:11.250011+0000","last_undegraded":"2023-10-06T02:55:11.250011+0000","last_fullsized":"2023-10-06T02:55:11.250011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246457+0000","last_change":"2023-10-06T02:55:07.109573+0000","last_active":"2023-10-06T02:55:11.246457+0000","last_peered":"2023-10-06T02:55:11.246457+0000","last_clean":"2023-10-06T02:55:11.246457+0000","last_became_active":"2023-10-06T02:55:07.109273+0000","last_became_peered":"2023-10-06T02:55:07.109273+0000","last_unstale":"2023-10-06T02:55:11.246457+0000","last_undegraded":"2023-10-06T02:55:11.246457+0000","last_fullsized":"2023-10-06T02:55:11.246457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.254596+0000","last_change":"2023-10-06T02:55:11.252497+0000","last_active":"2023-10-06T02:55:11.254596+0000","last_peered":"2023-10-06T02:55:11.254596+0000","last_clean":"2023-10-06T02:55:11.254596+0000","last_became_active":"2023-10-06T02:55:11.252152+0000","last_became_peered":"2023-10-06T02:55:11.252152+0000","last_unstale":"2023-10-06T02:55:11.254596+0000","last_undegraded":"2023-10-06T02:55:11.254596+0000","last_fullsized":"2023-10-06T02:55:11.254596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:05.228696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235239+0000","last_change":"2023-10-06T02:55:06.244855+0000","last_active":"2023-10-06T02:55:11.235239+0000","last_peered":"2023-10-06T02:55:11.235239+0000","last_clean":"2023-10-06T02:55:11.235239+0000","last_became_active":"2023-10-06T02:55:06.243833+0000","last_became_peered":"2023-10-06T02:55:06.243833+0000","last_unstale":"2023-10-06T02:55:11.235239+0000","last_undegraded":"2023-10-06T02:55:11.235239+0000","last_fullsized":"2023-10-06T02:55:11.235239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239474+0000","last_change":"2023-10-06T02:55:07.106155+0000","last_active":"2023-10-06T02:55:11.239474+0000","last_peered":"2023-10-06T02:55:11.239474+0000","last_clean":"2023-10-06T02:55:11.239474+0000","last_became_active":"2023-10-06T02:55:07.105422+0000","last_became_peered":"2023-10-06T02:55:07.105422+0000","last_unstale":"2023-10-06T02:55:11.239474+0000","last_undegraded":"2023-10-06T02:55:11.239474+0000","last_fullsized":"2023-10-06T02:55:11.239474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:26.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258752+0000","last_change":"2023-10-06T02:55:11.252464+0000","last_active":"2023-10-06T02:55:11.258752+0000","last_peered":"2023-10-06T02:55:11.258752+0000","last_clean":"2023-10-06T02:55:11.258752+0000","last_became_active":"2023-10-06T02:55:11.252055+0000","last_became_peered":"2023-10-06T02:55:11.252055+0000","last_unstale":"2023-10-06T02:55:11.258752+0000","last_undegraded":"2023-10-06T02:55:11.258752+0000","last_fullsized":"2023-10-06T02:55:11.258752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:30.678912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243469+0000","last_change":"2023-10-06T02:55:06.243634+0000","last_active":"2023-10-06T02:55:11.243469+0000","last_peered":"2023-10-06T02:55:11.243469+0000","last_clean":"2023-10-06T02:55:11.243469+0000","last_became_active":"2023-10-06T02:55:06.243383+0000","last_became_peered":"2023-10-06T02:55:06.243383+0000","last_unstale":"2023-10-06T02:55:11.243469+0000","last_undegraded":"2023-10-06T02:55:11.243469+0000","last_fullsized":"2023-10-06T02:55:11.243469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235163+0000","last_change":"2023-10-06T02:55:07.117239+0000","last_active":"2023-10-06T02:55:11.235163+0000","last_peered":"2023-10-06T02:55:11.235163+0000","last_clean":"2023-10-06T02:55:11.235163+0000","last_became_active":"2023-10-06T02:55:07.116968+0000","last_became_peered":"2023-10-06T02:55:07.116968+0000","last_unstale":"2023-10-06T02:55:11.235163+0000","last_undegraded":"2023-10-06T02:55:11.235163+0000","last_fullsized":"2023-10-06T02:55:11.235163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258755+0000","last_change":"2023-10-06T02:55:11.254938+0000","last_active":"2023-10-06T02:55:11.258755+0000","last_peered":"2023-10-06T02:55:11.258755+0000","last_clean":"2023-10-06T02:55:11.258755+0000","last_became_active":"2023-10-06T02:55:11.254650+0000","last_became_peered":"2023-10-06T02:55:11.254650+0000","last_unstale":"2023-10-06T02:55:11.258755+0000","last_undegraded":"2023-10-06T02:55:11.258755+0000","last_fullsized":"2023-10-06T02:55:11.258755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:07.497924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236203+0000","last_change":"2023-10-06T02:55:06.239366+0000","last_active":"2023-10-06T02:55:11.236203+0000","last_peered":"2023-10-06T02:55:11.236203+0000","last_clean":"2023-10-06T02:55:11.236203+0000","last_became_active":"2023-10-06T02:55:06.239143+0000","last_became_peered":"2023-10-06T02:55:06.239143+0000","last_unstale":"2023-10-06T02:55:11.236203+0000","last_undegraded":"2023-10-06T02:55:11.236203+0000","last_fullsized":"2023-10-06T02:55:11.236203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:13.153122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235067+0000","last_change":"2023-10-06T02:55:07.109897+0000","last_active":"2023-10-06T02:55:11.235067+0000","last_peered":"2023-10-06T02:55:11.235067+0000","last_clean":"2023-10-06T02:55:11.235067+0000","last_became_active":"2023-10-06T02:55:07.108992+0000","last_became_peered":"2023-10-06T02:55:07.108992+0000","last_unstale":"2023-10-06T02:55:11.235067+0000","last_undegraded":"2023-10-06T02:55:11.235067+0000","last_fullsized":"2023-10-06T02:55:11.235067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:03.653175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253878+0000","last_change":"2023-10-06T02:55:11.249347+0000","last_active":"2023-10-06T02:55:11.253878+0000","last_peered":"2023-10-06T02:55:11.253878+0000","last_clean":"2023-10-06T02:55:11.253878+0000","last_became_active":"2023-10-06T02:55:11.248973+0000","last_became_peered":"2023-10-06T02:55:11.248973+0000","last_unstale":"2023-10-06T02:55:11.253878+0000","last_undegraded":"2023-10-06T02:55:11.253878+0000","last_fullsized":"2023-10-06T02:55:11.253878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.869089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249346+0000","last_change":"2023-10-06T02:55:06.244730+0000","last_active":"2023-10-06T02:55:11.249346+0000","last_peered":"2023-10-06T02:55:11.249346+0000","last_clean":"2023-10-06T02:55:11.249346+0000","last_became_active":"2023-10-06T02:55:06.244530+0000","last_became_peered":"2023-10-06T02:55:06.244530+0000","last_unstale":"2023-10-06T02:55:11.249346+0000","last_undegraded":"2023-10-06T02:55:11.249346+0000","last_fullsized":"2023-10-06T02:55:11.249346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:57.942072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250185+0000","last_change":"2023-10-06T02:55:07.113744+0000","last_active":"2023-10-06T02:55:11.250185+0000","last_peered":"2023-10-06T02:55:11.250185+0000","last_clean":"2023-10-06T02:55:11.250185+0000","last_became_active":"2023-10-06T02:55:07.110700+0000","last_became_peered":"2023-10-06T02:55:07.110700+0000","last_unstale":"2023-10-06T02:55:11.250185+0000","last_undegraded":"2023-10-06T02:55:11.250185+0000","last_fullsized":"2023-10-06T02:55:11.250185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:45.135333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264143+0000","last_change":"2023-10-06T02:55:11.262345+0000","last_active":"2023-10-06T02:55:11.264143+0000","last_peered":"2023-10-06T02:55:11.264143+0000","last_clean":"2023-10-06T02:55:11.264143+0000","last_became_active":"2023-10-06T02:55:11.261934+0000","last_became_peered":"2023-10-06T02:55:11.261934+0000","last_unstale":"2023-10-06T02:55:11.264143+0000","last_undegraded":"2023-10-06T02:55:11.264143+0000","last_fullsized":"2023-10-06T02:55:11.264143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T02:55:17.004310+0000","last_change":"2023-10-06T02:55:06.238681+0000","last_active":"2023-10-06T02:55:17.004310+0000","last_peered":"2023-10-06T02:55:17.004310+0000","last_clean":"2023-10-06T02:55:17.004310+0000","last_became_active":"2023-10-06T02:55:06.238378+0000","last_became_peered":"2023-10-06T02:55:06.238378+0000","last_unstale":"2023-10-06T02:55:17.004310+0000","last_undegraded":"2023-10-06T02:55:17.004310+0000","last_fullsized":"2023-10-06T02:55:17.004310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:53.170462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242315+0000","last_change":"2023-10-06T02:55:07.103795+0000","last_active":"2023-10-06T02:55:11.242315+0000","last_peered":"2023-10-06T02:55:11.242315+0000","last_clean":"2023-10-06T02:55:11.242315+0000","last_became_active":"2023-10-06T02:55:07.103512+0000","last_became_peered":"2023-10-06T02:55:07.103512+0000","last_unstale":"2023-10-06T02:55:11.242315+0000","last_undegraded":"2023-10-06T02:55:11.242315+0000","last_fullsized":"2023-10-06T02:55:11.242315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256756+0000","last_change":"2023-10-06T02:55:11.251476+0000","last_active":"2023-10-06T02:55:11.256756+0000","last_peered":"2023-10-06T02:55:11.256756+0000","last_clean":"2023-10-06T02:55:11.256756+0000","last_became_active":"2023-10-06T02:55:11.250987+0000","last_became_peered":"2023-10-06T02:55:11.250987+0000","last_unstale":"2023-10-06T02:55:11.256756+0000","last_undegraded":"2023-10-06T02:55:11.256756+0000","last_fullsized":"2023-10-06T02:55:11.256756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:14.100962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249652+0000","last_change":"2023-10-06T02:55:06.246906+0000","last_active":"2023-10-06T02:55:11.249652+0000","last_peered":"2023-10-06T02:55:11.249652+0000","last_clean":"2023-10-06T02:55:11.249652+0000","last_became_active":"2023-10-06T02:55:06.246640+0000","last_became_peered":"2023-10-06T02:55:06.246640+0000","last_unstale":"2023-10-06T02:55:11.249652+0000","last_undegraded":"2023-10-06T02:55:11.249652+0000","last_fullsized":"2023-10-06T02:55:11.249652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.944198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235544+0000","last_change":"2023-10-06T02:55:07.116704+0000","last_active":"2023-10-06T02:55:11.235544+0000","last_peered":"2023-10-06T02:55:11.235544+0000","last_clean":"2023-10-06T02:55:11.235544+0000","last_became_active":"2023-10-06T02:55:07.116441+0000","last_became_peered":"2023-10-06T02:55:07.116441+0000","last_unstale":"2023-10-06T02:55:11.235544+0000","last_undegraded":"2023-10-06T02:55:11.235544+0000","last_fullsized":"2023-10-06T02:55:11.235544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263207+0000","last_change":"2023-10-06T02:55:11.258974+0000","last_active":"2023-10-06T02:55:11.263207+0000","last_peered":"2023-10-06T02:55:11.263207+0000","last_clean":"2023-10-06T02:55:11.263207+0000","last_became_active":"2023-10-06T02:55:11.258615+0000","last_became_peered":"2023-10-06T02:55:11.258615+0000","last_unstale":"2023-10-06T02:55:11.263207+0000","last_undegraded":"2023-10-06T02:55:11.263207+0000","last_fullsized":"2023-10-06T02:55:11.263207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:22.469427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242843+0000","last_change":"2023-10-06T02:55:06.240931+0000","last_active":"2023-10-06T02:55:11.242843+0000","last_peered":"2023-10-06T02:55:11.242843+0000","last_clean":"2023-10-06T02:55:11.242843+0000","last_became_active":"2023-10-06T02:55:06.240681+0000","last_became_peered":"2023-10-06T02:55:06.240681+0000","last_unstale":"2023-10-06T02:55:11.242843+0000","last_undegraded":"2023-10-06T02:55:11.242843+0000","last_fullsized":"2023-10-06T02:55:11.242843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236292+0000","last_change":"2023-10-06T02:55:07.108936+0000","last_active":"2023-10-06T02:55:11.236292+0000","last_peered":"2023-10-06T02:55:11.236292+0000","last_clean":"2023-10-06T02:55:11.236292+0000","last_became_active":"2023-10-06T02:55:07.108696+0000","last_became_peered":"2023-10-06T02:55:07.108696+0000","last_unstale":"2023-10-06T02:55:11.236292+0000","last_undegraded":"2023-10-06T02:55:11.236292+0000","last_fullsized":"2023-10-06T02:55:11.236292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263173+0000","last_change":"2023-10-06T02:55:11.258916+0000","last_active":"2023-10-06T02:55:11.263173+0000","last_peered":"2023-10-06T02:55:11.263173+0000","last_clean":"2023-10-06T02:55:11.263173+0000","last_became_active":"2023-10-06T02:55:11.258551+0000","last_became_peered":"2023-10-06T02:55:11.258551+0000","last_unstale":"2023-10-06T02:55:11.263173+0000","last_undegraded":"2023-10-06T02:55:11.263173+0000","last_fullsized":"2023-10-06T02:55:11.263173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:29.955535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246941+0000","last_change":"2023-10-06T02:55:06.246931+0000","last_active":"2023-10-06T02:55:11.246941+0000","last_peered":"2023-10-06T02:55:11.246941+0000","last_clean":"2023-10-06T02:55:11.246941+0000","last_became_active":"2023-10-06T02:55:06.246709+0000","last_became_peered":"2023-10-06T02:55:06.246709+0000","last_unstale":"2023-10-06T02:55:11.246941+0000","last_undegraded":"2023-10-06T02:55:11.246941+0000","last_fullsized":"2023-10-06T02:55:11.246941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246634+0000","last_change":"2023-10-06T02:55:07.114181+0000","last_active":"2023-10-06T02:55:11.246634+0000","last_peered":"2023-10-06T02:55:11.246634+0000","last_clean":"2023-10-06T02:55:11.246634+0000","last_became_active":"2023-10-06T02:55:07.113881+0000","last_became_peered":"2023-10-06T02:55:07.113881+0000","last_unstale":"2023-10-06T02:55:11.246634+0000","last_undegraded":"2023-10-06T02:55:11.246634+0000","last_fullsized":"2023-10-06T02:55:11.246634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256543+0000","last_change":"2023-10-06T02:55:11.253825+0000","last_active":"2023-10-06T02:55:11.256543+0000","last_peered":"2023-10-06T02:55:11.256543+0000","last_clean":"2023-10-06T02:55:11.256543+0000","last_became_active":"2023-10-06T02:55:11.253052+0000","last_became_peered":"2023-10-06T02:55:11.253052+0000","last_unstale":"2023-10-06T02:55:11.256543+0000","last_undegraded":"2023-10-06T02:55:11.256543+0000","last_fullsized":"2023-10-06T02:55:11.256543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:22.469427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236177+0000","last_change":"2023-10-06T02:55:06.235238+0000","last_active":"2023-10-06T02:55:11.236177+0000","last_peered":"2023-10-06T02:55:11.236177+0000","last_clean":"2023-10-06T02:55:11.236177+0000","last_became_active":"2023-10-06T02:55:06.234941+0000","last_became_peered":"2023-10-06T02:55:06.234941+0000","last_unstale":"2023-10-06T02:55:11.236177+0000","last_undegraded":"2023-10-06T02:55:11.236177+0000","last_fullsized":"2023-10-06T02:55:11.236177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:22.823456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235743+0000","last_change":"2023-10-06T02:55:07.110108+0000","last_active":"2023-10-06T02:55:11.235743+0000","last_peered":"2023-10-06T02:55:11.235743+0000","last_clean":"2023-10-06T02:55:11.235743+0000","last_became_active":"2023-10-06T02:55:07.108982+0000","last_became_peered":"2023-10-06T02:55:07.108982+0000","last_unstale":"2023-10-06T02:55:11.235743+0000","last_undegraded":"2023-10-06T02:55:11.235743+0000","last_fullsized":"2023-10-06T02:55:11.235743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:09.755341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264350+0000","last_change":"2023-10-06T02:55:11.261896+0000","last_active":"2023-10-06T02:55:11.264350+0000","last_peered":"2023-10-06T02:55:11.264350+0000","last_clean":"2023-10-06T02:55:11.264350+0000","last_became_active":"2023-10-06T02:55:11.258453+0000","last_became_peered":"2023-10-06T02:55:11.258453+0000","last_unstale":"2023-10-06T02:55:11.264350+0000","last_undegraded":"2023-10-06T02:55:11.264350+0000","last_fullsized":"2023-10-06T02:55:11.264350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.248625+0000","last_change":"2023-10-06T02:55:06.246468+0000","last_active":"2023-10-06T02:55:11.248625+0000","last_peered":"2023-10-06T02:55:11.248625+0000","last_clean":"2023-10-06T02:55:11.248625+0000","last_became_active":"2023-10-06T02:55:06.246181+0000","last_became_peered":"2023-10-06T02:55:06.246181+0000","last_unstale":"2023-10-06T02:55:11.248625+0000","last_undegraded":"2023-10-06T02:55:11.248625+0000","last_fullsized":"2023-10-06T02:55:11.248625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:05.892985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235746+0000","last_change":"2023-10-06T02:55:07.108301+0000","last_active":"2023-10-06T02:55:11.235746+0000","last_peered":"2023-10-06T02:55:11.235746+0000","last_clean":"2023-10-06T02:55:11.235746+0000","last_became_active":"2023-10-06T02:55:07.108018+0000","last_became_peered":"2023-10-06T02:55:07.108018+0000","last_unstale":"2023-10-06T02:55:11.235746+0000","last_undegraded":"2023-10-06T02:55:11.235746+0000","last_fullsized":"2023-10-06T02:55:11.235746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253713+0000","last_change":"2023-10-06T02:55:11.250732+0000","last_active":"2023-10-06T02:55:11.253713+0000","last_peered":"2023-10-06T02:55:11.253713+0000","last_clean":"2023-10-06T02:55:11.253713+0000","last_became_active":"2023-10-06T02:55:11.250256+0000","last_became_peered":"2023-10-06T02:55:11.250256+0000","last_unstale":"2023-10-06T02:55:11.253713+0000","last_undegraded":"2023-10-06T02:55:11.253713+0000","last_fullsized":"2023-10-06T02:55:11.253713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:48.288942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246540+0000","last_change":"2023-10-06T02:55:06.246429+0000","last_active":"2023-10-06T02:55:11.246540+0000","last_peered":"2023-10-06T02:55:11.246540+0000","last_clean":"2023-10-06T02:55:11.246540+0000","last_became_active":"2023-10-06T02:55:06.246133+0000","last_became_peered":"2023-10-06T02:55:06.246133+0000","last_unstale":"2023-10-06T02:55:11.246540+0000","last_undegraded":"2023-10-06T02:55:11.246540+0000","last_fullsized":"2023-10-06T02:55:11.246540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242766+0000","last_change":"2023-10-06T02:55:07.111918+0000","last_active":"2023-10-06T02:55:11.242766+0000","last_peered":"2023-10-06T02:55:11.242766+0000","last_clean":"2023-10-06T02:55:11.242766+0000","last_became_active":"2023-10-06T02:55:07.111192+0000","last_became_peered":"2023-10-06T02:55:07.111192+0000","last_unstale":"2023-10-06T02:55:11.242766+0000","last_undegraded":"2023-10-06T02:55:11.242766+0000","last_fullsized":"2023-10-06T02:55:11.242766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:03.869547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.255431+0000","last_change":"2023-10-06T02:55:11.254429+0000","last_active":"2023-10-06T02:55:11.255431+0000","last_peered":"2023-10-06T02:55:11.255431+0000","last_clean":"2023-10-06T02:55:11.255431+0000","last_became_active":"2023-10-06T02:55:11.253634+0000","last_became_peered":"2023-10-06T02:55:11.253634+0000","last_unstale":"2023-10-06T02:55:11.255431+0000","last_undegraded":"2023-10-06T02:55:11.255431+0000","last_fullsized":"2023-10-06T02:55:11.255431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:39.598115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249543+0000","last_change":"2023-10-06T02:55:06.244313+0000","last_active":"2023-10-06T02:55:11.249543+0000","last_peered":"2023-10-06T02:55:11.249543+0000","last_clean":"2023-10-06T02:55:11.249543+0000","last_became_active":"2023-10-06T02:55:06.244045+0000","last_became_peered":"2023-10-06T02:55:06.244045+0000","last_unstale":"2023-10-06T02:55:11.249543+0000","last_undegraded":"2023-10-06T02:55:11.249543+0000","last_fullsized":"2023-10-06T02:55:11.249543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:49.362183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240556+0000","last_change":"2023-10-06T02:55:07.112001+0000","last_active":"2023-10-06T02:55:11.240556+0000","last_peered":"2023-10-06T02:55:11.240556+0000","last_clean":"2023-10-06T02:55:11.240556+0000","last_became_active":"2023-10-06T02:55:07.111530+0000","last_became_peered":"2023-10-06T02:55:07.111530+0000","last_unstale":"2023-10-06T02:55:11.240556+0000","last_undegraded":"2023-10-06T02:55:11.240556+0000","last_fullsized":"2023-10-06T02:55:11.240556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:28.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261909+0000","last_change":"2023-10-06T02:55:11.254821+0000","last_active":"2023-10-06T02:55:11.261909+0000","last_peered":"2023-10-06T02:55:11.261909+0000","last_clean":"2023-10-06T02:55:11.261909+0000","last_became_active":"2023-10-06T02:55:11.254465+0000","last_became_peered":"2023-10-06T02:55:11.254465+0000","last_unstale":"2023-10-06T02:55:11.261909+0000","last_undegraded":"2023-10-06T02:55:11.261909+0000","last_fullsized":"2023-10-06T02:55:11.261909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:22.675675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236372+0000","last_change":"2023-10-06T02:55:06.240642+0000","last_active":"2023-10-06T02:55:11.236372+0000","last_peered":"2023-10-06T02:55:11.236372+0000","last_clean":"2023-10-06T02:55:11.236372+0000","last_became_active":"2023-10-06T02:55:06.240361+0000","last_became_peered":"2023-10-06T02:55:06.240361+0000","last_unstale":"2023-10-06T02:55:11.236372+0000","last_undegraded":"2023-10-06T02:55:11.236372+0000","last_fullsized":"2023-10-06T02:55:11.236372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:35.258998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243005+0000","last_change":"2023-10-06T02:55:07.111431+0000","last_active":"2023-10-06T02:55:11.243005+0000","last_peered":"2023-10-06T02:55:11.243005+0000","last_clean":"2023-10-06T02:55:11.243005+0000","last_became_active":"2023-10-06T02:55:07.111223+0000","last_became_peered":"2023-10-06T02:55:07.111223+0000","last_unstale":"2023-10-06T02:55:11.243005+0000","last_undegraded":"2023-10-06T02:55:11.243005+0000","last_fullsized":"2023-10-06T02:55:11.243005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.262798+0000","last_change":"2023-10-06T02:55:11.258918+0000","last_active":"2023-10-06T02:55:11.262798+0000","last_peered":"2023-10-06T02:55:11.262798+0000","last_clean":"2023-10-06T02:55:11.262798+0000","last_became_active":"2023-10-06T02:55:11.258550+0000","last_became_peered":"2023-10-06T02:55:11.258550+0000","last_unstale":"2023-10-06T02:55:11.262798+0000","last_undegraded":"2023-10-06T02:55:11.262798+0000","last_fullsized":"2023-10-06T02:55:11.262798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:34.718619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235093+0000","last_change":"2023-10-06T02:55:06.243599+0000","last_active":"2023-10-06T02:55:11.235093+0000","last_peered":"2023-10-06T02:55:11.235093+0000","last_clean":"2023-10-06T02:55:11.235093+0000","last_became_active":"2023-10-06T02:55:06.243327+0000","last_became_peered":"2023-10-06T02:55:06.243327+0000","last_unstale":"2023-10-06T02:55:11.235093+0000","last_undegraded":"2023-10-06T02:55:11.235093+0000","last_fullsized":"2023-10-06T02:55:11.235093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:35.258998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.241631+0000","last_change":"2023-10-06T02:55:07.113758+0000","last_active":"2023-10-06T02:55:11.241631+0000","last_peered":"2023-10-06T02:55:11.241631+0000","last_clean":"2023-10-06T02:55:11.241631+0000","last_became_active":"2023-10-06T02:55:07.113506+0000","last_became_peered":"2023-10-06T02:55:07.113506+0000","last_unstale":"2023-10-06T02:55:11.241631+0000","last_undegraded":"2023-10-06T02:55:11.241631+0000","last_fullsized":"2023-10-06T02:55:11.241631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:44.275013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264161+0000","last_change":"2023-10-06T02:55:11.262774+0000","last_active":"2023-10-06T02:55:11.264161+0000","last_peered":"2023-10-06T02:55:11.264161+0000","last_clean":"2023-10-06T02:55:11.264161+0000","last_became_active":"2023-10-06T02:55:11.262415+0000","last_became_peered":"2023-10-06T02:55:11.262415+0000","last_unstale":"2023-10-06T02:55:11.264161+0000","last_undegraded":"2023-10-06T02:55:11.264161+0000","last_fullsized":"2023-10-06T02:55:11.264161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240564+0000","last_change":"2023-10-06T02:55:06.242089+0000","last_active":"2023-10-06T02:55:11.240564+0000","last_peered":"2023-10-06T02:55:11.240564+0000","last_clean":"2023-10-06T02:55:11.240564+0000","last_became_active":"2023-10-06T02:55:06.241809+0000","last_became_peered":"2023-10-06T02:55:06.241809+0000","last_unstale":"2023-10-06T02:55:11.240564+0000","last_undegraded":"2023-10-06T02:55:11.240564+0000","last_fullsized":"2023-10-06T02:55:11.240564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:00.333890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243430+0000","last_change":"2023-10-06T02:55:07.103210+0000","last_active":"2023-10-06T02:55:11.243430+0000","last_peered":"2023-10-06T02:55:11.243430+0000","last_clean":"2023-10-06T02:55:11.243430+0000","last_became_active":"2023-10-06T02:55:07.102900+0000","last_became_peered":"2023-10-06T02:55:07.102900+0000","last_unstale":"2023-10-06T02:55:11.243430+0000","last_undegraded":"2023-10-06T02:55:11.243430+0000","last_fullsized":"2023-10-06T02:55:11.243430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263787+0000","last_change":"2023-10-06T02:55:11.256640+0000","last_active":"2023-10-06T02:55:11.263787+0000","last_peered":"2023-10-06T02:55:11.263787+0000","last_clean":"2023-10-06T02:55:11.263787+0000","last_became_active":"2023-10-06T02:55:11.254235+0000","last_became_peered":"2023-10-06T02:55:11.254235+0000","last_unstale":"2023-10-06T02:55:11.263787+0000","last_undegraded":"2023-10-06T02:55:11.263787+0000","last_fullsized":"2023-10-06T02:55:11.263787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:04.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242562+0000","last_change":"2023-10-06T02:55:06.237767+0000","last_active":"2023-10-06T02:55:11.242562+0000","last_peered":"2023-10-06T02:55:11.242562+0000","last_clean":"2023-10-06T02:55:11.242562+0000","last_became_active":"2023-10-06T02:55:06.237033+0000","last_became_peered":"2023-10-06T02:55:06.237033+0000","last_unstale":"2023-10-06T02:55:11.242562+0000","last_undegraded":"2023-10-06T02:55:11.242562+0000","last_fullsized":"2023-10-06T02:55:11.242562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:00.333890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245169+0000","last_change":"2023-10-06T02:55:07.100985+0000","last_active":"2023-10-06T02:55:11.245169+0000","last_peered":"2023-10-06T02:55:11.245169+0000","last_clean":"2023-10-06T02:55:11.245169+0000","last_became_active":"2023-10-06T02:55:07.100724+0000","last_became_peered":"2023-10-06T02:55:07.100724+0000","last_unstale":"2023-10-06T02:55:11.245169+0000","last_undegraded":"2023-10-06T02:55:11.245169+0000","last_fullsized":"2023-10-06T02:55:11.245169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261373+0000","last_change":"2023-10-06T02:55:11.254821+0000","last_active":"2023-10-06T02:55:11.261373+0000","last_peered":"2023-10-06T02:55:11.261373+0000","last_clean":"2023-10-06T02:55:11.261373+0000","last_became_active":"2023-10-06T02:55:11.254344+0000","last_became_peered":"2023-10-06T02:55:11.254344+0000","last_unstale":"2023-10-06T02:55:11.261373+0000","last_undegraded":"2023-10-06T02:55:11.261373+0000","last_fullsized":"2023-10-06T02:55:11.261373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:28.325601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235090+0000","last_change":"2023-10-06T02:55:06.240594+0000","last_active":"2023-10-06T02:55:11.235090+0000","last_peered":"2023-10-06T02:55:11.235090+0000","last_clean":"2023-10-06T02:55:11.235090+0000","last_became_active":"2023-10-06T02:55:06.240357+0000","last_became_peered":"2023-10-06T02:55:06.240357+0000","last_unstale":"2023-10-06T02:55:11.235090+0000","last_undegraded":"2023-10-06T02:55:11.235090+0000","last_fullsized":"2023-10-06T02:55:11.235090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251318+0000","last_change":"2023-10-06T02:55:07.116386+0000","last_active":"2023-10-06T02:55:11.251318+0000","last_peered":"2023-10-06T02:55:11.251318+0000","last_clean":"2023-10-06T02:55:11.251318+0000","last_became_active":"2023-10-06T02:55:07.116115+0000","last_became_peered":"2023-10-06T02:55:07.116115+0000","last_unstale":"2023-10-06T02:55:11.251318+0000","last_undegraded":"2023-10-06T02:55:11.251318+0000","last_fullsized":"2023-10-06T02:55:11.251318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.260498+0000","last_change":"2023-10-06T02:55:11.258056+0000","last_active":"2023-10-06T02:55:11.260498+0000","last_peered":"2023-10-06T02:55:11.260498+0000","last_clean":"2023-10-06T02:55:11.260498+0000","last_became_active":"2023-10-06T02:55:11.256479+0000","last_became_peered":"2023-10-06T02:55:11.256479+0000","last_unstale":"2023-10-06T02:55:11.260498+0000","last_undegraded":"2023-10-06T02:55:11.260498+0000","last_fullsized":"2023-10-06T02:55:11.260498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250543+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:55:11.250543+0000","last_peered":"2023-10-06T02:55:11.250543+0000","last_clean":"2023-10-06T02:55:11.250543+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:55:11.250543+0000","last_undegraded":"2023-10-06T02:55:11.250543+0000","last_fullsized":"2023-10-06T02:55:11.250543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236179+0000","last_change":"2023-10-06T02:55:06.240875+0000","last_active":"2023-10-06T02:55:11.236179+0000","last_peered":"2023-10-06T02:55:11.236179+0000","last_clean":"2023-10-06T02:55:11.236179+0000","last_became_active":"2023-10-06T02:55:06.240637+0000","last_became_peered":"2023-10-06T02:55:06.240637+0000","last_unstale":"2023-10-06T02:55:11.236179+0000","last_undegraded":"2023-10-06T02:55:11.236179+0000","last_fullsized":"2023-10-06T02:55:11.236179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250109+0000","last_change":"2023-10-06T02:55:07.111939+0000","last_active":"2023-10-06T02:55:11.250109+0000","last_peered":"2023-10-06T02:55:11.250109+0000","last_clean":"2023-10-06T02:55:11.250109+0000","last_became_active":"2023-10-06T02:55:07.111076+0000","last_became_peered":"2023-10-06T02:55:07.111076+0000","last_unstale":"2023-10-06T02:55:11.250109+0000","last_undegraded":"2023-10-06T02:55:11.250109+0000","last_fullsized":"2023-10-06T02:55:11.250109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258159+0000","last_change":"2023-10-06T02:55:11.257606+0000","last_active":"2023-10-06T02:55:11.258159+0000","last_peered":"2023-10-06T02:55:11.258159+0000","last_clean":"2023-10-06T02:55:11.258159+0000","last_became_active":"2023-10-06T02:55:11.257305+0000","last_became_peered":"2023-10-06T02:55:11.257305+0000","last_unstale":"2023-10-06T02:55:11.258159+0000","last_undegraded":"2023-10-06T02:55:11.258159+0000","last_fullsized":"2023-10-06T02:55:11.258159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236318+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:55:11.236318+0000","last_peered":"2023-10-06T02:55:11.236318+0000","last_clean":"2023-10-06T02:55:11.236318+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:55:11.236318+0000","last_undegraded":"2023-10-06T02:55:11.236318+0000","last_fullsized":"2023-10-06T02:55:11.236318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242421+0000","last_change":"2023-10-06T02:55:06.245888+0000","last_active":"2023-10-06T02:55:11.242421+0000","last_peered":"2023-10-06T02:55:11.242421+0000","last_clean":"2023-10-06T02:55:11.242421+0000","last_became_active":"2023-10-06T02:55:06.245610+0000","last_became_peered":"2023-10-06T02:55:06.245610+0000","last_unstale":"2023-10-06T02:55:11.242421+0000","last_undegraded":"2023-10-06T02:55:11.242421+0000","last_fullsized":"2023-10-06T02:55:11.242421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:22.823456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250468+0000","last_change":"2023-10-06T02:55:07.105844+0000","last_active":"2023-10-06T02:55:11.250468+0000","last_peered":"2023-10-06T02:55:11.250468+0000","last_clean":"2023-10-06T02:55:11.250468+0000","last_became_active":"2023-10-06T02:55:07.105587+0000","last_became_peered":"2023-10-06T02:55:07.105587+0000","last_unstale":"2023-10-06T02:55:11.250468+0000","last_undegraded":"2023-10-06T02:55:11.250468+0000","last_fullsized":"2023-10-06T02:55:11.250468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:39.307208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.254953+0000","last_change":"2023-10-06T02:55:11.252978+0000","last_active":"2023-10-06T02:55:11.254953+0000","last_peered":"2023-10-06T02:55:11.254953+0000","last_clean":"2023-10-06T02:55:11.254953+0000","last_became_active":"2023-10-06T02:55:11.252446+0000","last_became_peered":"2023-10-06T02:55:11.252446+0000","last_unstale":"2023-10-06T02:55:11.254953+0000","last_undegraded":"2023-10-06T02:55:11.254953+0000","last_fullsized":"2023-10-06T02:55:11.254953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:20.987504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.238567+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:55:11.238567+0000","last_peered":"2023-10-06T02:55:11.238567+0000","last_clean":"2023-10-06T02:55:11.238567+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:55:11.238567+0000","last_undegraded":"2023-10-06T02:55:11.238567+0000","last_fullsized":"2023-10-06T02:55:11.238567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250490+0000","last_change":"2023-10-06T02:55:06.234766+0000","last_active":"2023-10-06T02:55:11.250490+0000","last_peered":"2023-10-06T02:55:11.250490+0000","last_clean":"2023-10-06T02:55:11.250490+0000","last_became_active":"2023-10-06T02:55:06.234390+0000","last_became_peered":"2023-10-06T02:55:06.234390+0000","last_unstale":"2023-10-06T02:55:11.250490+0000","last_undegraded":"2023-10-06T02:55:11.250490+0000","last_fullsized":"2023-10-06T02:55:11.250490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251232+0000","last_change":"2023-10-06T02:55:07.112215+0000","last_active":"2023-10-06T02:55:11.251232+0000","last_peered":"2023-10-06T02:55:11.251232+0000","last_clean":"2023-10-06T02:55:11.251232+0000","last_became_active":"2023-10-06T02:55:07.110597+0000","last_became_peered":"2023-10-06T02:55:07.110597+0000","last_unstale":"2023-10-06T02:55:11.251232+0000","last_undegraded":"2023-10-06T02:55:11.251232+0000","last_fullsized":"2023-10-06T02:55:11.251232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.267018+0000","last_change":"2023-10-06T02:55:11.259468+0000","last_active":"2023-10-06T02:55:11.267018+0000","last_peered":"2023-10-06T02:55:11.267018+0000","last_clean":"2023-10-06T02:55:11.267018+0000","last_became_active":"2023-10-06T02:55:11.259056+0000","last_became_peered":"2023-10-06T02:55:11.259056+0000","last_unstale":"2023-10-06T02:55:11.267018+0000","last_undegraded":"2023-10-06T02:55:11.267018+0000","last_fullsized":"2023-10-06T02:55:11.267018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236914+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:55:11.236914+0000","last_peered":"2023-10-06T02:55:11.236914+0000","last_clean":"2023-10-06T02:55:11.236914+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:55:11.236914+0000","last_undegraded":"2023-10-06T02:55:11.236914+0000","last_fullsized":"2023-10-06T02:55:11.236914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246339+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:55:11.246339+0000","last_peered":"2023-10-06T02:55:11.246339+0000","last_clean":"2023-10-06T02:55:11.246339+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:55:11.246339+0000","last_undegraded":"2023-10-06T02:55:11.246339+0000","last_fullsized":"2023-10-06T02:55:11.246339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235039+0000","last_change":"2023-10-06T02:55:06.244584+0000","last_active":"2023-10-06T02:55:11.235039+0000","last_peered":"2023-10-06T02:55:11.235039+0000","last_clean":"2023-10-06T02:55:11.235039+0000","last_became_active":"2023-10-06T02:55:06.244277+0000","last_became_peered":"2023-10-06T02:55:06.244277+0000","last_unstale":"2023-10-06T02:55:11.235039+0000","last_undegraded":"2023-10-06T02:55:11.235039+0000","last_fullsized":"2023-10-06T02:55:11.235039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235736+0000","last_change":"2023-10-06T02:55:07.102220+0000","last_active":"2023-10-06T02:55:11.235736+0000","last_peered":"2023-10-06T02:55:11.235736+0000","last_clean":"2023-10-06T02:55:11.235736+0000","last_became_active":"2023-10-06T02:55:07.101946+0000","last_became_peered":"2023-10-06T02:55:07.101946+0000","last_unstale":"2023-10-06T02:55:11.235736+0000","last_undegraded":"2023-10-06T02:55:11.235736+0000","last_fullsized":"2023-10-06T02:55:11.235736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:03.946045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263766+0000","last_change":"2023-10-06T02:55:11.256345+0000","last_active":"2023-10-06T02:55:11.263766+0000","last_peered":"2023-10-06T02:55:11.263766+0000","last_clean":"2023-10-06T02:55:11.263766+0000","last_became_active":"2023-10-06T02:55:11.253584+0000","last_became_peered":"2023-10-06T02:55:11.253584+0000","last_unstale":"2023-10-06T02:55:11.263766+0000","last_undegraded":"2023-10-06T02:55:11.263766+0000","last_fullsized":"2023-10-06T02:55:11.263766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246558+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:55:11.246558+0000","last_peered":"2023-10-06T02:55:11.246558+0000","last_clean":"2023-10-06T02:55:11.246558+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:55:11.246558+0000","last_undegraded":"2023-10-06T02:55:11.246558+0000","last_fullsized":"2023-10-06T02:55:11.246558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242581+0000","last_change":"2023-10-06T02:55:06.243148+0000","last_active":"2023-10-06T02:55:11.242581+0000","last_peered":"2023-10-06T02:55:11.242581+0000","last_clean":"2023-10-06T02:55:11.242581+0000","last_became_active":"2023-10-06T02:55:06.242874+0000","last_became_peered":"2023-10-06T02:55:06.242874+0000","last_unstale":"2023-10-06T02:55:11.242581+0000","last_undegraded":"2023-10-06T02:55:11.242581+0000","last_fullsized":"2023-10-06T02:55:11.242581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246552+0000","last_change":"2023-10-06T02:55:07.112041+0000","last_active":"2023-10-06T02:55:11.246552+0000","last_peered":"2023-10-06T02:55:11.246552+0000","last_clean":"2023-10-06T02:55:11.246552+0000","last_became_active":"2023-10-06T02:55:07.111789+0000","last_became_peered":"2023-10-06T02:55:07.111789+0000","last_unstale":"2023-10-06T02:55:11.246552+0000","last_undegraded":"2023-10-06T02:55:11.246552+0000","last_fullsized":"2023-10-06T02:55:11.246552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:09.755341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256412+0000","last_change":"2023-10-06T02:55:11.251646+0000","last_active":"2023-10-06T02:55:11.256412+0000","last_peered":"2023-10-06T02:55:11.256412+0000","last_clean":"2023-10-06T02:55:11.256412+0000","last_became_active":"2023-10-06T02:55:11.251231+0000","last_became_peered":"2023-10-06T02:55:11.251231+0000","last_unstale":"2023-10-06T02:55:11.256412+0000","last_undegraded":"2023-10-06T02:55:11.256412+0000","last_fullsized":"2023-10-06T02:55:11.256412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:44.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249446+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:55:11.249446+0000","last_peered":"2023-10-06T02:55:11.249446+0000","last_clean":"2023-10-06T02:55:11.249446+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:55:11.249446+0000","last_undegraded":"2023-10-06T02:55:11.249446+0000","last_fullsized":"2023-10-06T02:55:11.249446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250704+0000","last_change":"2023-10-06T02:55:06.235823+0000","last_active":"2023-10-06T02:55:11.250704+0000","last_peered":"2023-10-06T02:55:11.250704+0000","last_clean":"2023-10-06T02:55:11.250704+0000","last_became_active":"2023-10-06T02:55:06.235199+0000","last_became_peered":"2023-10-06T02:55:06.235199+0000","last_unstale":"2023-10-06T02:55:11.250704+0000","last_undegraded":"2023-10-06T02:55:11.250704+0000","last_fullsized":"2023-10-06T02:55:11.250704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243179+0000","last_change":"2023-10-06T02:55:07.110542+0000","last_active":"2023-10-06T02:55:11.243179+0000","last_peered":"2023-10-06T02:55:11.243179+0000","last_clean":"2023-10-06T02:55:11.243179+0000","last_became_active":"2023-10-06T02:55:07.110114+0000","last_became_peered":"2023-10-06T02:55:07.110114+0000","last_unstale":"2023-10-06T02:55:11.243179+0000","last_undegraded":"2023-10-06T02:55:11.243179+0000","last_fullsized":"2023-10-06T02:55:11.243179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264312+0000","last_change":"2023-10-06T02:55:11.259777+0000","last_active":"2023-10-06T02:55:11.264312+0000","last_peered":"2023-10-06T02:55:11.264312+0000","last_clean":"2023-10-06T02:55:11.264312+0000","last_became_active":"2023-10-06T02:55:11.259304+0000","last_became_peered":"2023-10-06T02:55:11.259304+0000","last_unstale":"2023-10-06T02:55:11.264312+0000","last_undegraded":"2023-10-06T02:55:11.264312+0000","last_fullsized":"2023-10-06T02:55:11.264312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:00.296633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235554+0000","last_change":"2023-10-06T02:55:06.240511+0000","last_active":"2023-10-06T02:55:11.235554+0000","last_peered":"2023-10-06T02:55:11.235554+0000","last_clean":"2023-10-06T02:55:11.235554+0000","last_became_active":"2023-10-06T02:55:06.240232+0000","last_became_peered":"2023-10-06T02:55:06.240232+0000","last_unstale":"2023-10-06T02:55:11.235554+0000","last_undegraded":"2023-10-06T02:55:11.235554+0000","last_fullsized":"2023-10-06T02:55:11.235554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251025+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:55:11.251025+0000","last_peered":"2023-10-06T02:55:11.251025+0000","last_clean":"2023-10-06T02:55:11.251025+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:55:11.251025+0000","last_undegraded":"2023-10-06T02:55:11.251025+0000","last_fullsized":"2023-10-06T02:55:11.251025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.234999+0000","last_change":"2023-10-06T02:55:07.109361+0000","last_active":"2023-10-06T02:55:11.234999+0000","last_peered":"2023-10-06T02:55:11.234999+0000","last_clean":"2023-10-06T02:55:11.234999+0000","last_became_active":"2023-10-06T02:55:07.109009+0000","last_became_peered":"2023-10-06T02:55:07.109009+0000","last_unstale":"2023-10-06T02:55:11.234999+0000","last_undegraded":"2023-10-06T02:55:11.234999+0000","last_fullsized":"2023-10-06T02:55:11.234999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.943919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253185+0000","last_change":"2023-10-06T02:55:11.248862+0000","last_active":"2023-10-06T02:55:11.253185+0000","last_peered":"2023-10-06T02:55:11.253185+0000","last_clean":"2023-10-06T02:55:11.253185+0000","last_became_active":"2023-10-06T02:55:11.248509+0000","last_became_peered":"2023-10-06T02:55:11.248509+0000","last_unstale":"2023-10-06T02:55:11.253185+0000","last_undegraded":"2023-10-06T02:55:11.253185+0000","last_fullsized":"2023-10-06T02:55:11.253185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.238397+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:55:11.238397+0000","last_peered":"2023-10-06T02:55:11.238397+0000","last_clean":"2023-10-06T02:55:11.238397+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:55:11.238397+0000","last_undegraded":"2023-10-06T02:55:11.238397+0000","last_fullsized":"2023-10-06T02:55:11.238397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T02:55:12.228337+0000","last_change":"2023-10-06T02:55:06.238192+0000","last_active":"2023-10-06T02:55:12.228337+0000","last_peered":"2023-10-06T02:55:12.228337+0000","last_clean":"2023-10-06T02:55:12.228337+0000","last_became_active":"2023-10-06T02:55:06.237939+0000","last_became_peered":"2023-10-06T02:55:06.237939+0000","last_unstale":"2023-10-06T02:55:12.228337+0000","last_undegraded":"2023-10-06T02:55:12.228337+0000","last_fullsized":"2023-10-06T02:55:12.228337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:02.326100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242677+0000","last_change":"2023-10-06T02:55:07.106782+0000","last_active":"2023-10-06T02:55:11.242677+0000","last_peered":"2023-10-06T02:55:11.242677+0000","last_clean":"2023-10-06T02:55:11.242677+0000","last_became_active":"2023-10-06T02:55:07.106537+0000","last_became_peered":"2023-10-06T02:55:07.106537+0000","last_unstale":"2023-10-06T02:55:11.242677+0000","last_undegraded":"2023-10-06T02:55:11.242677+0000","last_fullsized":"2023-10-06T02:55:11.242677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264229+0000","last_change":"2023-10-06T02:55:11.262893+0000","last_active":"2023-10-06T02:55:11.264229+0000","last_peered":"2023-10-06T02:55:11.264229+0000","last_clean":"2023-10-06T02:55:11.264229+0000","last_became_active":"2023-10-06T02:55:11.262445+0000","last_became_peered":"2023-10-06T02:55:11.262445+0000","last_unstale":"2023-10-06T02:55:11.264229+0000","last_undegraded":"2023-10-06T02:55:11.264229+0000","last_fullsized":"2023-10-06T02:55:11.264229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243094+0000","last_change":"2023-10-06T02:55:06.244999+0000","last_active":"2023-10-06T02:55:11.243094+0000","last_peered":"2023-10-06T02:55:11.243094+0000","last_clean":"2023-10-06T02:55:11.243094+0000","last_became_active":"2023-10-06T02:55:06.244558+0000","last_became_peered":"2023-10-06T02:55:06.244558+0000","last_unstale":"2023-10-06T02:55:11.243094+0000","last_undegraded":"2023-10-06T02:55:11.243094+0000","last_fullsized":"2023-10-06T02:55:11.243094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240384+0000","last_change":"2023-10-06T02:55:07.115236+0000","last_active":"2023-10-06T02:55:11.240384+0000","last_peered":"2023-10-06T02:55:11.240384+0000","last_clean":"2023-10-06T02:55:11.240384+0000","last_became_active":"2023-10-06T02:55:07.115036+0000","last_became_peered":"2023-10-06T02:55:07.115036+0000","last_unstale":"2023-10-06T02:55:11.240384+0000","last_undegraded":"2023-10-06T02:55:11.240384+0000","last_fullsized":"2023-10-06T02:55:11.240384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:28.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.262746+0000","last_change":"2023-10-06T02:55:11.258225+0000","last_active":"2023-10-06T02:55:11.262746+0000","last_peered":"2023-10-06T02:55:11.262746+0000","last_clean":"2023-10-06T02:55:11.262746+0000","last_became_active":"2023-10-06T02:55:11.257846+0000","last_became_peered":"2023-10-06T02:55:11.257846+0000","last_unstale":"2023-10-06T02:55:11.262746+0000","last_undegraded":"2023-10-06T02:55:11.262746+0000","last_fullsized":"2023-10-06T02:55:11.262746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236306+0000","last_change":"2023-10-06T02:55:06.243711+0000","last_active":"2023-10-06T02:55:11.236306+0000","last_peered":"2023-10-06T02:55:11.236306+0000","last_clean":"2023-10-06T02:55:11.236306+0000","last_became_active":"2023-10-06T02:55:06.243344+0000","last_became_peered":"2023-10-06T02:55:06.243344+0000","last_unstale":"2023-10-06T02:55:11.236306+0000","last_undegraded":"2023-10-06T02:55:11.236306+0000","last_fullsized":"2023-10-06T02:55:11.236306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243012+0000","last_change":"2023-10-06T02:55:07.114426+0000","last_active":"2023-10-06T02:55:11.243012+0000","last_peered":"2023-10-06T02:55:11.243012+0000","last_clean":"2023-10-06T02:55:11.243012+0000","last_became_active":"2023-10-06T02:55:07.114145+0000","last_became_peered":"2023-10-06T02:55:07.114145+0000","last_unstale":"2023-10-06T02:55:11.243012+0000","last_undegraded":"2023-10-06T02:55:11.243012+0000","last_fullsized":"2023-10-06T02:55:11.243012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261060+0000","last_change":"2023-10-06T02:55:11.254928+0000","last_active":"2023-10-06T02:55:11.261060+0000","last_peered":"2023-10-06T02:55:11.261060+0000","last_clean":"2023-10-06T02:55:11.261060+0000","last_became_active":"2023-10-06T02:55:11.254507+0000","last_became_peered":"2023-10-06T02:55:11.254507+0000","last_unstale":"2023-10-06T02:55:11.261060+0000","last_undegraded":"2023-10-06T02:55:11.261060+0000","last_fullsized":"2023-10-06T02:55:11.261060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236065+0000","last_change":"2023-10-06T02:55:06.243499+0000","last_active":"2023-10-06T02:55:11.236065+0000","last_peered":"2023-10-06T02:55:11.236065+0000","last_clean":"2023-10-06T02:55:11.236065+0000","last_became_active":"2023-10-06T02:55:06.243225+0000","last_became_peered":"2023-10-06T02:55:06.243225+0000","last_unstale":"2023-10-06T02:55:11.236065+0000","last_undegraded":"2023-10-06T02:55:11.236065+0000","last_fullsized":"2023-10-06T02:55:11.236065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242673+0000","last_change":"2023-10-06T02:55:07.109529+0000","last_active":"2023-10-06T02:55:11.242673+0000","last_peered":"2023-10-06T02:55:11.242673+0000","last_clean":"2023-10-06T02:55:11.242673+0000","last_became_active":"2023-10-06T02:55:07.109235+0000","last_became_peered":"2023-10-06T02:55:07.109235+0000","last_unstale":"2023-10-06T02:55:11.242673+0000","last_undegraded":"2023-10-06T02:55:11.242673+0000","last_fullsized":"2023-10-06T02:55:11.242673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:16.973575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264275+0000","last_change":"2023-10-06T02:55:11.259478+0000","last_active":"2023-10-06T02:55:11.264275+0000","last_peered":"2023-10-06T02:55:11.264275+0000","last_clean":"2023-10-06T02:55:11.264275+0000","last_became_active":"2023-10-06T02:55:11.258396+0000","last_became_peered":"2023-10-06T02:55:11.258396+0000","last_unstale":"2023-10-06T02:55:11.264275+0000","last_undegraded":"2023-10-06T02:55:11.264275+0000","last_fullsized":"2023-10-06T02:55:11.264275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.869089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235575+0000","last_change":"2023-10-06T02:55:06.243717+0000","last_active":"2023-10-06T02:55:11.235575+0000","last_peered":"2023-10-06T02:55:11.235575+0000","last_clean":"2023-10-06T02:55:11.235575+0000","last_became_active":"2023-10-06T02:55:06.243477+0000","last_became_peered":"2023-10-06T02:55:06.243477+0000","last_unstale":"2023-10-06T02:55:11.235575+0000","last_undegraded":"2023-10-06T02:55:11.235575+0000","last_fullsized":"2023-10-06T02:55:11.235575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:02.326100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235163+0000","last_change":"2023-10-06T02:55:07.109710+0000","last_active":"2023-10-06T02:55:11.235163+0000","last_peered":"2023-10-06T02:55:11.235163+0000","last_clean":"2023-10-06T02:55:11.235163+0000","last_became_active":"2023-10-06T02:55:07.109311+0000","last_became_peered":"2023-10-06T02:55:07.109311+0000","last_unstale":"2023-10-06T02:55:11.235163+0000","last_undegraded":"2023-10-06T02:55:11.235163+0000","last_fullsized":"2023-10-06T02:55:11.235163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.255838+0000","last_change":"2023-10-06T02:55:11.251970+0000","last_active":"2023-10-06T02:55:11.255838+0000","last_peered":"2023-10-06T02:55:11.255838+0000","last_clean":"2023-10-06T02:55:11.255838+0000","last_became_active":"2023-10-06T02:55:11.251576+0000","last_became_peered":"2023-10-06T02:55:11.251576+0000","last_unstale":"2023-10-06T02:55:11.255838+0000","last_undegraded":"2023-10-06T02:55:11.255838+0000","last_fullsized":"2023-10-06T02:55:11.255838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243536+0000","last_change":"2023-10-06T02:55:06.243528+0000","last_active":"2023-10-06T02:55:11.243536+0000","last_peered":"2023-10-06T02:55:11.243536+0000","last_clean":"2023-10-06T02:55:11.243536+0000","last_became_active":"2023-10-06T02:55:06.243235+0000","last_became_peered":"2023-10-06T02:55:06.243235+0000","last_unstale":"2023-10-06T02:55:11.243536+0000","last_undegraded":"2023-10-06T02:55:11.243536+0000","last_fullsized":"2023-10-06T02:55:11.243536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245975+0000","last_change":"2023-10-06T02:55:07.103783+0000","last_active":"2023-10-06T02:55:11.245975+0000","last_peered":"2023-10-06T02:55:11.245975+0000","last_clean":"2023-10-06T02:55:11.245975+0000","last_became_active":"2023-10-06T02:55:07.103380+0000","last_became_peered":"2023-10-06T02:55:07.103380+0000","last_unstale":"2023-10-06T02:55:11.245975+0000","last_undegraded":"2023-10-06T02:55:11.245975+0000","last_fullsized":"2023-10-06T02:55:11.245975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.943919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236264+0000","last_change":"2023-10-06T02:55:07.102410+0000","last_active":"2023-10-06T02:55:11.236264+0000","last_peered":"2023-10-06T02:55:11.236264+0000","last_clean":"2023-10-06T02:55:11.236264+0000","last_became_active":"2023-10-06T02:55:07.102078+0000","last_became_peered":"2023-10-06T02:55:07.102078+0000","last_unstale":"2023-10-06T02:55:11.236264+0000","last_undegraded":"2023-10-06T02:55:11.236264+0000","last_fullsized":"2023-10-06T02:55:11.236264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:05.829702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235500+0000","last_change":"2023-10-06T02:55:07.116830+0000","last_active":"2023-10-06T02:55:11.235500+0000","last_peered":"2023-10-06T02:55:11.235500+0000","last_clean":"2023-10-06T02:55:11.235500+0000","last_became_active":"2023-10-06T02:55:07.116644+0000","last_became_peered":"2023-10-06T02:55:07.116644+0000","last_unstale":"2023-10-06T02:55:11.235500+0000","last_undegraded":"2023-10-06T02:55:11.235500+0000","last_fullsized":"2023-10-06T02:55:11.235500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244388+0000","last_change":"2023-10-06T02:55:07.104996+0000","last_active":"2023-10-06T02:55:11.244388+0000","last_peered":"2023-10-06T02:55:11.244388+0000","last_clean":"2023-10-06T02:55:11.244388+0000","last_became_active":"2023-10-06T02:55:07.104710+0000","last_became_peered":"2023-10-06T02:55:07.104710+0000","last_unstale":"2023-10-06T02:55:11.244388+0000","last_undegraded":"2023-10-06T02:55:11.244388+0000","last_fullsized":"2023-10-06T02:55:11.244388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:09.033880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235232+0000","last_change":"2023-10-06T02:55:07.109367+0000","last_active":"2023-10-06T02:55:11.235232+0000","last_peered":"2023-10-06T02:55:11.235232+0000","last_clean":"2023-10-06T02:55:11.235232+0000","last_became_active":"2023-10-06T02:55:07.109089+0000","last_became_peered":"2023-10-06T02:55:07.109089+0000","last_unstale":"2023-10-06T02:55:11.235232+0000","last_undegraded":"2023-10-06T02:55:11.235232+0000","last_fullsized":"2023-10-06T02:55:11.235232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250624+0000","last_change":"2023-10-06T02:55:07.108442+0000","last_active":"2023-10-06T02:55:11.250624+0000","last_peered":"2023-10-06T02:55:11.250624+0000","last_clean":"2023-10-06T02:55:11.250624+0000","last_became_active":"2023-10-06T02:55:07.108151+0000","last_became_peered":"2023-10-06T02:55:07.108151+0000","last_unstale":"2023-10-06T02:55:11.250624+0000","last_undegraded":"2023-10-06T02:55:11.250624+0000","last_fullsized":"2023-10-06T02:55:11.250624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":118562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":118652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:55:20.695 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:55:20.696 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T02:55:20.696 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T02:55:20.696 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T02:55:20.696 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T02:55:20.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.836+0000 7fe00759e700 1 Processor -- start 2023-10-06T02:55:20.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.836+0000 7fe00759e700 1 -- start start 2023-10-06T02:55:20.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0080cbc70 0x7fe0080cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080cb7e0 con 0x7fe008159480 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00759e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080b08a0 con 0x7fe0080b2140 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080cb190 con 0x7fe0080cbc70 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe008159480 0x7fe0080b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36646/0 (socket says 172.21.15.84:36646) 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00659c700 1 -- 172.21.15.84:0/117910839 learned_addr learned my addr 172.21.15.84:0/117910839 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe005d9b700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0080cbc70 0x7fe0080cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138481923 0 0) 0x7fe0080cb7e0 con 0x7fe008159480 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff0003570 con 0x7fe008159480 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198155992 0 0) 0x7fdff0003570 con 0x7fe008159480 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0080cbc70 msgr2=0x7fe0080cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:20.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0080cbc70 0x7fe0080cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 >> v1:172.21.15.131:6789/0 conn(0x7fe0080b2140 legacy=0x7fe0080b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080cb470 con 0x7fe008159480 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fdff8001470 con 0x7fe008159480 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 >> v1:172.21.15.84:6789/0 conn(0x7fe008159480 legacy=0x7fe0080b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdff0003a90 0x7fdff0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.837+0000 7fe00559a700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fdff0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe00559a700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0080cbc70 0x7fdff00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080cb190 con 0x7fdff0004810 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff000bb60 con 0x7fdff0003a90 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff000bd20 con 0x7fe0080cbc70 2023-10-06T02:55:20.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe005d9b700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fdff0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe00659c700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdff0003a90 0x7fdff0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe006d9d700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0080cbc70 0x7fdff00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe005d9b700 1 -- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0080cbc70 msgr2=0x7fdff00051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe005d9b700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0080cbc70 0x7fdff00051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe005d9b700 1 -- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdff0003a90 msgr2=0x7fdff0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe005d9b700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdff0003a90 0x7fdff0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe005d9b700 1 -- 172.21.15.84:0/117910839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0003570 con 0x7fdff0004810 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe00659c700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdff0003a90 0x7fdff0003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe005d9b700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fdff0004c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009c00 tx=0x7fdffc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3c944067613405 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:20.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00e710 con 0x7fdff0004810 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc00e870 con 0x7fdff0004810 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.838+0000 7fe00559a700 1 -- 172.21.15.84:0/117910839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00ec30 con 0x7fdff0004810 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.839+0000 7fe00759e700 1 -- 172.21.15.84:0/117910839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 msgr2=0x7fdff0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.839+0000 7fe00759e700 1 --2- 172.21.15.84:0/117910839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fdff0004c80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009c00 tx=0x7fdffc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.839+0000 7fe006d9d700 1 -- 172.21.15.84:0/117910839 reap_dead start 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.839+0000 7fe00759e700 1 -- 172.21.15.84:0/117910839 shutdown_connections 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.839+0000 7fe00759e700 1 -- 172.21.15.84:0/117910839 >> 172.21.15.84:0/117910839 conn(0x7fe00806ed20 msgr2=0x7fe00806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.839+0000 7fe00759e700 1 -- 172.21.15.84:0/117910839 shutdown_connections 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.839+0000 7fe00759e700 1 -- 172.21.15.84:0/117910839 wait complete. 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.840+0000 7fe00759e700 1 Processor -- start 2023-10-06T02:55:20.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.840+0000 7fe00759e700 1 -- start start 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.840+0000 7fe00759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fe008169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.840+0000 7fe00759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0080c6410 0x7fe008156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.840+0000 7fe00759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008157000 0x7fe0080c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.840+0000 7fe00759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe008157480 con 0x7fdff0004810 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.840+0000 7fe00759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080c3b90 con 0x7fe0080c6410 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.840+0000 7fe00759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe008169d40 con 0x7fe008157000 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fe008169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fe008169700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51084/0 (socket says 172.21.15.84:51084) 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00659c700 1 -- 172.21.15.84:0/1583288956 learned_addr learned my addr 172.21.15.84:0/1583288956 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:20.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe005d9b700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0080c6410 0x7fe008156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe006d9d700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008157000 0x7fe0080c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00659c700 1 -- 172.21.15.84:0/1583288956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008157000 msgr2=0x7fe0080c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00659c700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008157000 0x7fe0080c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00659c700 1 -- 172.21.15.84:0/1583288956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0080c6410 msgr2=0x7fe008156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00659c700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0080c6410 0x7fe008156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00659c700 1 -- 172.21.15.84:0/1583288956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00816a020 con 0x7fdff0004810 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00659c700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fe008169700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdff800eb90 tx=0x7fdff8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fdff67fc700 1 -- 172.21.15.84:0/1583288956 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8005e70 con 0x7fdff0004810 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fdff67fc700 1 -- 172.21.15.84:0/1583288956 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff800c780 con 0x7fdff0004810 2023-10-06T02:55:20.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00816a300 con 0x7fdff0004810 2023-10-06T02:55:20.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fdff67fc700 1 -- 172.21.15.84:0/1583288956 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800cb20 con 0x7fdff0004810 2023-10-06T02:55:20.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.841+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe008154a80 con 0x7fdff0004810 2023-10-06T02:55:20.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.842+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00805f270 con 0x7fdff0004810 2023-10-06T02:55:20.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.843+0000 7fdff67fc700 1 -- 172.21.15.84:0/1583288956 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdff801d460 con 0x7fdff0004810 2023-10-06T02:55:20.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.843+0000 7fdff67fc700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdfe8066f30 0x7fdfe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:20.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.843+0000 7fe005d9b700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdfe8066f30 0x7fdfe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:20.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.843+0000 7fdff67fc700 1 -- 172.21.15.84:0/1583288956 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdff8084840 con 0x7fdff0004810 2023-10-06T02:55:20.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.843+0000 7fe005d9b700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdfe8066f30 0x7fdfe80693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0091e0 tx=0x7fdffc01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:20.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:20.847+0000 7fdff67fc700 1 -- 172.21.15.84:0/1583288956 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdff8051660 con 0x7fdff0004810 2023-10-06T02:55:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.080+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe008159850 con 0x7fdff0004810 2023-10-06T02:55:21.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.082+0000 7fdff67fc700 1 -- 172.21.15.84:0/1583288956 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163699 (secure 0 0 0) 0x7fdff8054c80 con 0x7fdff0004810 2023-10-06T02:55:21.086 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:21.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdfe8066f30 msgr2=0x7fdfe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdfe8066f30 0x7fdfe80693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0091e0 tx=0x7fdffc01a000 comp rx=0 tx=0).stop 2023-10-06T02:55:21.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 msgr2=0x7fe008169700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fe008169700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdff800eb90 tx=0x7fdff8001e90 comp rx=0 tx=0).stop 2023-10-06T02:55:21.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 shutdown_connections 2023-10-06T02:55:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdfe8066f30 0x7fdfe80693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008157000 0x7fe0080c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdff0004810 0x7fe008169700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 --2- 172.21.15.84:0/1583288956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0080c6410 0x7fe008156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 >> 172.21.15.84:0/1583288956 conn(0x7fe00806ed20 msgr2=0x7fe0080b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 shutdown_connections 2023-10-06T02:55:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.085+0000 7fe00759e700 1 -- 172.21.15.84:0/1583288956 wait complete. 2023-10-06T02:55:21.099 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":90399},{"type":"v1","addr":"172.21.15.84:6833","nonce":90399}]},"active_addr":"172.21.15.84:6833/90399","active_change":"2023-10-06T02:54:47.790287+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2779873729}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1615127751}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1849248419}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3724158517}]}]} 2023-10-06T02:55:21.108 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T02:55:21.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T02:55:21.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:21.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.221+0000 7f6e15089700 1 Processor -- start 2023-10-06T02:55:21.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.221+0000 7f6e15089700 1 -- start start 2023-10-06T02:55:21.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e15089700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e101594b0 0x7f6e100ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e15089700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e100cd1a0 0x7f6e100ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e15089700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 0x7f6e100c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e15089700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e100cd610 con 0x7f6e101594b0 2023-10-06T02:55:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e15089700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e100cc840 con 0x7f6e100cd1a0 2023-10-06T02:55:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e15089700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100cbc70 con 0x7f6e100cef00 2023-10-06T02:55:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e0ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e101594b0 0x7f6e100ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e0ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e101594b0 0x7f6e100ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51096/0 (socket says 172.21.15.84:51096) 2023-10-06T02:55:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e0ffff700 1 -- 172.21.15.84:0/3263238821 learned_addr learned my addr 172.21.15.84:0/3263238821 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e14888700 1 --2- 172.21.15.84:0/3263238821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 0x7f6e100c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e0f7fe700 1 --2- 172.21.15.84:0/3263238821 >> v2:172.21.15.131:3300/0 conn(0x7f6e100cd1a0 0x7f6e100ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e0ffff700 1 -- 172.21.15.84:0/3263238821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 msgr2=0x7f6e100c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/3263238821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 0x7f6e100c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e0ffff700 1 -- 172.21.15.84:0/3263238821 >> v2:172.21.15.131:3300/0 conn(0x7f6e100cd1a0 msgr2=0x7f6e100ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.222+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/3263238821 >> v2:172.21.15.131:3300/0 conn(0x7f6e100cd1a0 0x7f6e100ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e0ffff700 1 -- 172.21.15.84:0/3263238821 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100cbf10 con 0x7f6e101594b0 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e14888700 1 --2- 172.21.15.84:0/3263238821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 0x7f6e100c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/3263238821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e101594b0 0x7f6e100ccc60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e1006a730 tx=0x7f6e00009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b1b9be776ef421 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e0effd700 1 -- 172.21.15.84:0/3263238821 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00005c10 con 0x7f6e101594b0 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e0effd700 1 -- 172.21.15.84:0/3263238821 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00005d70 con 0x7f6e101594b0 2023-10-06T02:55:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e0effd700 1 -- 172.21.15.84:0/3263238821 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000b8a0 con 0x7f6e101594b0 2023-10-06T02:55:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e15089700 1 -- 172.21.15.84:0/3263238821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e101594b0 msgr2=0x7f6e100ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e15089700 1 --2- 172.21.15.84:0/3263238821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e101594b0 0x7f6e100ccc60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e1006a730 tx=0x7f6e00009220 comp rx=0 tx=0).stop 2023-10-06T02:55:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e15089700 1 -- 172.21.15.84:0/3263238821 shutdown_connections 2023-10-06T02:55:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e15089700 1 --2- 172.21.15.84:0/3263238821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 0x7f6e100c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e15089700 1 --2- 172.21.15.84:0/3263238821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e101594b0 0x7f6e100ccc60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e15089700 1 --2- 172.21.15.84:0/3263238821 >> v2:172.21.15.131:3300/0 conn(0x7f6e100cd1a0 0x7f6e100ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e15089700 1 -- 172.21.15.84:0/3263238821 >> 172.21.15.84:0/3263238821 conn(0x7f6e10099600 msgr2=0x7f6e1006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e15089700 1 -- 172.21.15.84:0/3263238821 shutdown_connections 2023-10-06T02:55:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.223+0000 7f6e15089700 1 -- 172.21.15.84:0/3263238821 wait complete. 2023-10-06T02:55:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.224+0000 7f6e15089700 1 Processor -- start 2023-10-06T02:55:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e15089700 1 -- start start 2023-10-06T02:55:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e15089700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e100cd1a0 0x7f6e10154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e15089700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 0x7f6e1015c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e15089700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e101594b0 0x7f6e100c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e15089700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1015c970 con 0x7f6e100cd1a0 2023-10-06T02:55:21.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e15089700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1015cb90 con 0x7f6e101594b0 2023-10-06T02:55:21.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e15089700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1015ce70 con 0x7f6e100cef00 2023-10-06T02:55:21.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e100cd1a0 0x7f6e10154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e0ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e100cd1a0 0x7f6e10154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51108/0 (socket says 172.21.15.84:51108) 2023-10-06T02:55:21.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.225+0000 7f6e0ffff700 1 -- 172.21.15.84:0/3021435466 learned_addr learned my addr 172.21.15.84:0/3021435466 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e0f7fe700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 0x7f6e1015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e14888700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e101594b0 0x7f6e100c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e0ffff700 1 -- 172.21.15.84:0/3021435466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 msgr2=0x7f6e1015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 0x7f6e1015c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e0ffff700 1 -- 172.21.15.84:0/3021435466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e101594b0 msgr2=0x7f6e100c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e101594b0 0x7f6e100c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e0ffff700 1 -- 172.21.15.84:0/3021435466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00009480 con 0x7f6e100cd1a0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e100cd1a0 0x7f6e10154040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e1006fc60 tx=0x7f6e00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6df7fff700 1 -- 172.21.15.84:0/3021435466 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0001a420 con 0x7f6e100cd1a0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6df7fff700 1 -- 172.21.15.84:0/3021435466 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0001a5e0 con 0x7f6e100cd1a0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1015d150 con 0x7f6e100cd1a0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6df7fff700 1 -- 172.21.15.84:0/3021435466 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0001a9a0 con 0x7f6e100cd1a0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.226+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e10156180 con 0x7f6e100cd1a0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.227+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1015d5f0 con 0x7f6e100cd1a0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.227+0000 7f6df7fff700 1 -- 172.21.15.84:0/3021435466 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e0001ad10 con 0x7f6e100cd1a0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.228+0000 7f6df7fff700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.228+0000 7f6df7fff700 1 -- 172.21.15.84:0/3021435466 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6e00085ac0 con 0x7f6e100cd1a0 2023-10-06T02:55:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.228+0000 7f6e0f7fe700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.228+0000 7f6e0f7fe700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e1009e140 tx=0x7f6e04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.232+0000 7f6df7fff700 1 -- 172.21.15.84:0/3021435466 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e1015d5f0 con 0x7f6e100cd1a0 2023-10-06T02:55:21.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.420+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e1015d5f0 con 0x7f6e100cd1a0 2023-10-06T02:55:21.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.421+0000 7f6df7fff700 1 -- 172.21.15.84:0/3021435466 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f6e1015d5f0 con 0x7f6e100cd1a0 2023-10-06T02:55:21.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:21.423 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:21.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 msgr2=0x7f6dfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e1009e140 tx=0x7f6e04008040 comp rx=0 tx=0).stop 2023-10-06T02:55:21.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e100cd1a0 msgr2=0x7f6e10154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e100cd1a0 0x7f6e10154040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e1006fc60 tx=0x7f6e00016000 comp rx=0 tx=0).stop 2023-10-06T02:55:21.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 shutdown_connections 2023-10-06T02:55:21.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e101594b0 0x7f6e100c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e100cd1a0 0x7f6e10154040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 --2- 172.21.15.84:0/3021435466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e100cef00 0x7f6e1015c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 >> 172.21.15.84:0/3021435466 conn(0x7f6e10099600 msgr2=0x7f6e10159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:21.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 shutdown_connections 2023-10-06T02:55:21.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.423+0000 7f6e15089700 1 -- 172.21.15.84:0/3021435466 wait complete. 2023-10-06T02:55:21.436 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T02:55:21.437 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.548+0000 7fdf2a07b700 1 Processor -- start 2023-10-06T02:55:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.548+0000 7fdf2a07b700 1 -- start start 2023-10-06T02:55:21.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf2a07b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf240cd370 0x7fdf240ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf2a07b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf240c6260 0x7fdf240cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf2a07b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf240cc840 con 0x7fdf241594b0 2023-10-06T02:55:21.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf2a07b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf240cbc70 con 0x7fdf240cd370 2023-10-06T02:55:21.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf2a07b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240cf440 con 0x7fdf240c6260 2023-10-06T02:55:21.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf29079700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdf241594b0 0x7fdf240ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36654/0 (socket says 172.21.15.84:36654) 2023-10-06T02:55:21.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf29079700 1 -- 172.21.15.84:0/3316446506 learned_addr learned my addr 172.21.15.84:0/3316446506 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:21.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf2987a700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf240c6260 0x7fdf240cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf28878700 1 --2- 172.21.15.84:0/3316446506 >> v2:172.21.15.131:3300/0 conn(0x7fdf240cd370 0x7fdf240ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643797281 0 0) 0x7fdf240cc840 con 0x7fdf241594b0 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.549+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf10003570 con 0x7fdf241594b0 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4179953738 0 0) 0x7fdf10003570 con 0x7fdf241594b0 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf240c6260 msgr2=0x7fdf240cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf240c6260 0x7fdf240cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 >> v2:172.21.15.131:3300/0 conn(0x7fdf240cd370 msgr2=0x7fdf240ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 --2- 172.21.15.84:0/3316446506 >> v2:172.21.15.131:3300/0 conn(0x7fdf240cd370 0x7fdf240ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240cbf10 con 0x7fdf241594b0 2023-10-06T02:55:21.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fdf20001970 con 0x7fdf241594b0 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 >> v1:172.21.15.84:6789/0 conn(0x7fdf241594b0 legacy=0x7fdf240ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf240c6260 0x7fdf10003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf10003fe0 0x7fdf10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf10004d50 0x7fdf100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240cbc70 con 0x7fdf10004d50 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240cf440 con 0x7fdf10003fe0 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1000bb40 con 0x7fdf240c6260 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf28878700 1 --2- 172.21.15.84:0/3316446506 >> v2:172.21.15.131:3300/0 conn(0x7fdf240cd370 0x7fdf240ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf2987a700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf10004d50 0x7fdf100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf29079700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf240c6260 0x7fdf10003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf28878700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf10003fe0 0x7fdf10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf2987a700 1 -- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf240c6260 msgr2=0x7fdf10003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf2987a700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf240c6260 0x7fdf10003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf2987a700 1 -- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf10003fe0 msgr2=0x7fdf10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf2987a700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf10003fe0 0x7fdf10004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf2987a700 1 -- 172.21.15.84:0/3316446506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10003570 con 0x7fdf10004d50 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf28878700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf10003fe0 0x7fdf10004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf2987a700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf10004d50 0x7fdf100051c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c006f00 tx=0x7fdf1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd3e59cd9c317f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00e710 con 0x7fdf10004d50 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c00e870 con 0x7fdf10004d50 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.550+0000 7fdf1bfff700 1 -- 172.21.15.84:0/3316446506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00ec30 con 0x7fdf10004d50 2023-10-06T02:55:21.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.551+0000 7fdf2a07b700 1 -- 172.21.15.84:0/3316446506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf10004d50 msgr2=0x7fdf100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.551+0000 7fdf2a07b700 1 --2- 172.21.15.84:0/3316446506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf10004d50 0x7fdf100051c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c006f00 tx=0x7fdf1c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.551+0000 7fdf2987a700 1 -- 172.21.15.84:0/3316446506 reap_dead start 2023-10-06T02:55:21.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.551+0000 7fdf2a07b700 1 -- 172.21.15.84:0/3316446506 shutdown_connections 2023-10-06T02:55:21.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.551+0000 7fdf2a07b700 1 -- 172.21.15.84:0/3316446506 >> 172.21.15.84:0/3316446506 conn(0x7fdf24099600 msgr2=0x7fdf2406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:21.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.551+0000 7fdf2a07b700 1 -- 172.21.15.84:0/3316446506 shutdown_connections 2023-10-06T02:55:21.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.551+0000 7fdf2a07b700 1 -- 172.21.15.84:0/3316446506 wait complete. 2023-10-06T02:55:21.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.552+0000 7fdf2a07b700 1 Processor -- start 2023-10-06T02:55:21.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.552+0000 7fdf2a07b700 1 -- start start 2023-10-06T02:55:21.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2a07b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf10004d50 0x7fdf24154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2a07b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf24155750 0x7fdf240c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2a07b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf24068fd0 0x7fdf24069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2a07b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240699b0 con 0x7fdf24068fd0 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2a07b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf240c8600 con 0x7fdf24155750 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2a07b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf24155230 con 0x7fdf10004d50 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2987a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf24068fd0 0x7fdf24069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2987a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf24068fd0 0x7fdf24069470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51118/0 (socket says 172.21.15.84:51118) 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2987a700 1 -- 172.21.15.84:0/1329371930 learned_addr learned my addr 172.21.15.84:0/1329371930 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf29079700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf10004d50 0x7fdf24154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf28878700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf24155750 0x7fdf240c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2987a700 1 -- 172.21.15.84:0/1329371930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf10004d50 msgr2=0x7fdf24154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2987a700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf10004d50 0x7fdf24154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2987a700 1 -- 172.21.15.84:0/1329371930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf24155750 msgr2=0x7fdf240c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2987a700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf24155750 0x7fdf240c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2987a700 1 -- 172.21.15.84:0/1329371930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240c7d60 con 0x7fdf24068fd0 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf28878700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf24155750 0x7fdf240c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.553+0000 7fdf2987a700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf24068fd0 0x7fdf24069470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000ba90 tx=0x7fdf1c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.554+0000 7fdf197fa700 1 -- 172.21.15.84:0/1329371930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c022070 con 0x7fdf24068fd0 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.554+0000 7fdf197fa700 1 -- 172.21.15.84:0/1329371930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c013d30 con 0x7fdf24068fd0 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.554+0000 7fdf197fa700 1 -- 172.21.15.84:0/1329371930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00e710 con 0x7fdf24068fd0 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.554+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf240c8040 con 0x7fdf24068fd0 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.554+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf240c8950 con 0x7fdf24068fd0 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.554+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf240c8b40 con 0x7fdf24068fd0 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.555+0000 7fdf197fa700 1 -- 172.21.15.84:0/1329371930 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf1c01c970 con 0x7fdf24068fd0 2023-10-06T02:55:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.555+0000 7fdf197fa700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf08066f30 0x7fdf080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.555+0000 7fdf29079700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf08066f30 0x7fdf080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.555+0000 7fdf197fa700 1 -- 172.21.15.84:0/1329371930 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdf1c000e40 con 0x7fdf24068fd0 2023-10-06T02:55:21.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.556+0000 7fdf29079700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf08066f30 0x7fdf080693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf200015e0 tx=0x7fdf20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.560+0000 7fdf197fa700 1 -- 172.21.15.84:0/1329371930 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf1c0530e0 con 0x7fdf24068fd0 2023-10-06T02:55:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.743+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf2405f270 con 0x7fdf24068fd0 2023-10-06T02:55:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.744+0000 7fdf197fa700 1 -- 172.21.15.84:0/1329371930 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fdf1c056700 con 0x7fdf24068fd0 2023-10-06T02:55:21.746 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:21.746 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf08066f30 msgr2=0x7fdf080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf08066f30 0x7fdf080693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf200015e0 tx=0x7fdf20009040 comp rx=0 tx=0).stop 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf24068fd0 msgr2=0x7fdf24069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf24068fd0 0x7fdf24069470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000ba90 tx=0x7fdf1c01a000 comp rx=0 tx=0).stop 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 shutdown_connections 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf08066f30 0x7fdf080693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf24068fd0 0x7fdf24069470 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf10004d50 0x7fdf24154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 --2- 172.21.15.84:0/1329371930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf24155750 0x7fdf240c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 >> 172.21.15.84:0/1329371930 conn(0x7fdf24099600 msgr2=0x7fdf240ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 shutdown_connections 2023-10-06T02:55:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.746+0000 7fdf2a07b700 1 -- 172.21.15.84:0/1329371930 wait complete. 2023-10-06T02:55:21.760 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T02:55:21.760 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T02:55:21.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T02:55:21.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T02:55:21.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T02:55:21.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T02:55:21.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T02:55:21.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T02:55:21.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.946+0000 7fae2dba1700 1 Processor -- start 2023-10-06T02:55:21.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.947+0000 7fae2dba1700 1 -- start start 2023-10-06T02:55:21.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.948+0000 7fae2dba1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fae28160e30 0x7fae28161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.948+0000 7fae2dba1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 0x7fae28069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.948+0000 7fae2dba1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae280c7e80 con 0x7fae280c8790 2023-10-06T02:55:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.948+0000 7fae2dba1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae280c7270 con 0x7fae28160e30 2023-10-06T02:55:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.948+0000 7fae2dba1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae280c7550 con 0x7fae280c8310 2023-10-06T02:55:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.949+0000 7fae27fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fae280c8790 0x7fae280aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36656/0 (socket says 172.21.15.84:36656) 2023-10-06T02:55:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.949+0000 7fae27fff700 1 -- 172.21.15.84:0/897097285 learned_addr learned my addr 172.21.15.84:0/897097285 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.949+0000 7fae277fe700 1 --2- 172.21.15.84:0/897097285 >> v2:172.21.15.131:3300/0 conn(0x7fae28160e30 0x7fae28161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.949+0000 7fae277fe700 1 -- 172.21.15.84:0/897097285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 msgr2=0x7fae28069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:21.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.949+0000 7fae26ffd700 1 --2- 172.21.15.84:0/897097285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 0x7fae28069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.949+0000 7fae277fe700 1 --2- 172.21.15.84:0/897097285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 0x7fae28069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.949+0000 7fae277fe700 1 -- 172.21.15.84:0/897097285 >> v1:172.21.15.84:6789/0 conn(0x7fae280c8790 legacy=0x7fae280aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.949+0000 7fae277fe700 1 -- 172.21.15.84:0/897097285 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae280c7830 con 0x7fae28160e30 2023-10-06T02:55:21.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.950+0000 7fae26ffd700 1 --2- 172.21.15.84:0/897097285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 0x7fae28069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:21.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.950+0000 7fae277fe700 1 --2- 172.21.15.84:0/897097285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae28160e30 0x7fae28161200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae100098e0 tx=0x7fae100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa735336e8ef05ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.955+0000 7fae267fc700 1 -- 172.21.15.84:0/897097285 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10009e80 con 0x7fae28160e30 2023-10-06T02:55:21.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.955+0000 7fae267fc700 1 -- 172.21.15.84:0/897097285 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1000b760 con 0x7fae28160e30 2023-10-06T02:55:21.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.955+0000 7fae267fc700 1 -- 172.21.15.84:0/897097285 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000bae0 con 0x7fae28160e30 2023-10-06T02:55:21.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.959+0000 7fae2dba1700 1 -- 172.21.15.84:0/897097285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae28160e30 msgr2=0x7fae28161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.959+0000 7fae2dba1700 1 --2- 172.21.15.84:0/897097285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae28160e30 0x7fae28161200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae100098e0 tx=0x7fae100091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.959+0000 7fe386fcb700 1 Processor -- start 2023-10-06T02:55:21.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.959+0000 7fae2dba1700 1 -- 172.21.15.84:0/897097285 shutdown_connections 2023-10-06T02:55:21.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.959+0000 7fae2dba1700 1 --2- 172.21.15.84:0/897097285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae28160e30 0x7fae28161200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.959+0000 7fae2dba1700 1 --2- 172.21.15.84:0/897097285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 0x7fae28069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.959+0000 7fae2dba1700 1 -- 172.21.15.84:0/897097285 >> 172.21.15.84:0/897097285 conn(0x7fae280680c0 msgr2=0x7fae280cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:21.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.959+0000 7fe386fcb700 1 -- start start 2023-10-06T02:55:21.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.960+0000 7fae2dba1700 1 -- 172.21.15.84:0/897097285 shutdown_connections 2023-10-06T02:55:21.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fbb1b079700 1 Processor -- start 2023-10-06T02:55:21.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fe386fcb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe3800cc920 0x7fe38006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fe386fcb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe38006c1a0 0x7fe3800675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fe386fcb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38006c9e0 con 0x7fe380156390 2023-10-06T02:55:21.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fe386fcb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe380156b60 con 0x7fe38006c1a0 2023-10-06T02:55:21.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fe386fcb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe380156e40 con 0x7fe3800cc920 2023-10-06T02:55:21.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fe385568700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe38006c1a0 0x7fe3800675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fe385568700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe38006c1a0 0x7fe3800675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51120/0 (socket says 172.21.15.84:51120) 2023-10-06T02:55:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fe385568700 1 -- 172.21.15.84:0/1167590418 learned_addr learned my addr 172.21.15.84:0/1167590418 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.961+0000 7fbb1b079700 1 -- start start 2023-10-06T02:55:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.960+0000 7fae2dba1700 1 -- 172.21.15.84:0/897097285 wait complete. 2023-10-06T02:55:21.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7f1a5945b700 1 Processor -- start 2023-10-06T02:55:21.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fe385568700 1 -- 172.21.15.84:0/1167590418 >> v2:172.21.15.131:3300/0 conn(0x7fe3800cc920 msgr2=0x7fe38006bc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:55:21.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fe385568700 1 --2- 172.21.15.84:0/1167590418 >> v2:172.21.15.131:3300/0 conn(0x7fe3800cc920 0x7fe38006bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fe385568700 1 -- 172.21.15.84:0/1167590418 >> v1:172.21.15.84:6789/0 conn(0x7fe380156390 legacy=0x7fe3800cc210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:55:21.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fe385568700 1 -- 172.21.15.84:0/1167590418 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe380157120 con 0x7fe38006c1a0 2023-10-06T02:55:21.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fae2dba1700 1 Processor -- start 2023-10-06T02:55:21.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fe385568700 1 --2- 172.21.15.84:0/1167590418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe38006c1a0 0x7fe3800675f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe3800c4480 tx=0x7fe378009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df508e944642a9fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fbb1b079700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb14067840 0x7fbb140c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fbb1b079700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbb140c7fa0 0x7fbb14160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fbb1b079700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1406bfe0 con 0x7fbb140caa30 2023-10-06T02:55:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fbb1b079700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb14162080 con 0x7fbb14067840 2023-10-06T02:55:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fbb1b079700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb14162360 con 0x7fbb140c7fa0 2023-10-06T02:55:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fbb18e15700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb14067840 0x7fbb140c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fbb18e15700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb14067840 0x7fbb140c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51134/0 (socket says 172.21.15.84:51134) 2023-10-06T02:55:21.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fbb18e15700 1 -- 172.21.15.84:0/3935684019 learned_addr learned my addr 172.21.15.84:0/3935684019 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fe3777fe700 1 -- 172.21.15.84:0/1167590418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800e070 con 0x7fe38006c1a0 2023-10-06T02:55:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fe3777fe700 1 -- 172.21.15.84:0/1167590418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800ba10 con 0x7fe38006c1a0 2023-10-06T02:55:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fe3777fe700 1 -- 172.21.15.84:0/1167590418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780092e0 con 0x7fe38006c1a0 2023-10-06T02:55:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fbb18e15700 1 -- 172.21.15.84:0/3935684019 >> v2:172.21.15.131:3300/0 conn(0x7fbb140c7fa0 msgr2=0x7fbb14160ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:55:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fbb18e15700 1 --2- 172.21.15.84:0/3935684019 >> v2:172.21.15.131:3300/0 conn(0x7fbb140c7fa0 0x7fbb14160ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fbb18e15700 1 -- 172.21.15.84:0/3935684019 >> v1:172.21.15.131:6789/0 conn(0x7fbb140caa30 legacy=0x7fbb1406c470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:55:21.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fbb18e15700 1 -- 172.21.15.84:0/3935684019 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14162640 con 0x7fbb14067840 2023-10-06T02:55:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fbb18e15700 1 --2- 172.21.15.84:0/3935684019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb14067840 0x7fbb140c7a60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbb1406bf50 tx=0x7fbb0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e81fb865548e953 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fe386fcb700 1 -- 172.21.15.84:0/1167590418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe38006c1a0 msgr2=0x7fe3800675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fe386fcb700 1 --2- 172.21.15.84:0/1167590418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe38006c1a0 0x7fe3800675f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe3800c4480 tx=0x7fe378009840 comp rx=0 tx=0).stop 2023-10-06T02:55:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7fae2dba1700 1 -- start start 2023-10-06T02:55:21.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fae2dba1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 0x7fae281594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fae2dba1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae280c8790 0x7fae280c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fae2dba1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae28160e30 0x7fae280c0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fae2dba1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae280c2cf0 con 0x7fae28160e30 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fae2dba1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2815e6d0 con 0x7fae280c8790 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7fae2dba1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae280c0cb0 con 0x7fae280c8310 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae26ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae280c8790 0x7fae280c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae26ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae280c8790 0x7fae280c27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:46700/0 (socket says 172.21.15.84:46700) 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae26ffd700 1 -- 172.21.15.84:0/121291899 learned_addr learned my addr 172.21.15.84:0/121291899 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae27fff700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae28160e30 0x7fae280c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae277fe700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 0x7fae281594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.962+0000 7f1a5945b700 1 -- start start 2023-10-06T02:55:21.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7f1a5945b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a54155860 0x7f1a540ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7f1a5945b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a54069c70 0x7f1a540abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7f1a5945b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540c7e10 con 0x7f1a540c82a0 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7f1a5945b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540aea00 con 0x7f1a54155860 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7f1a5945b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540c7200 con 0x7f1a54069c70 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7f1a52ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a54155860 0x7f1a540ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7f1a527fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1a540c82a0 0x7f1a54069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36658/0 (socket says 172.21.15.84:36658) 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.963+0000 7f1a527fc700 1 -- 172.21.15.84:0/3116489610 learned_addr learned my addr 172.21.15.84:0/3116489610 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7f1a52ffd700 1 -- 172.21.15.84:0/3116489610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a54069c70 msgr2=0x7f1a540abcd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7f1a52ffd700 1 --2- 172.21.15.84:0/3116489610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a54069c70 0x7f1a540abcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7f1a52ffd700 1 -- 172.21.15.84:0/3116489610 >> v1:172.21.15.84:6789/0 conn(0x7f1a540c82a0 legacy=0x7f1a54069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7f1a52ffd700 1 -- 172.21.15.84:0/3116489610 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540c74e0 con 0x7f1a54155860 2023-10-06T02:55:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7f1a52ffd700 1 --2- 172.21.15.84:0/3116489610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a54155860 0x7f1a540ae4c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400bb90 tx=0x7f1a4400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cded33d9e828ba9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7f1a51ffb700 1 -- 172.21.15.84:0/3116489610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400dba0 con 0x7f1a54155860 2023-10-06T02:55:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7f1a51ffb700 1 -- 172.21.15.84:0/3116489610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4400dd00 con 0x7f1a54155860 2023-10-06T02:55:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7f1a51ffb700 1 -- 172.21.15.84:0/3116489610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a440196b0 con 0x7f1a54155860 2023-10-06T02:55:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae26ffd700 1 -- 172.21.15.84:0/121291899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 msgr2=0x7fae281594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae26ffd700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae280c8310 0x7fae281594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae26ffd700 1 -- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae28160e30 msgr2=0x7fae280c0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae26ffd700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae28160e30 0x7fae280c0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fae26ffd700 1 -- 172.21.15.84:0/121291899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae10009420 con 0x7fae280c8790 2023-10-06T02:55:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.964+0000 7fbb137fe700 1 -- 172.21.15.84:0/3935684019 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00e070 con 0x7fbb14067840 2023-10-06T02:55:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fbb137fe700 1 -- 172.21.15.84:0/3935684019 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c00ba10 con 0x7fbb14067840 2023-10-06T02:55:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fbb137fe700 1 -- 172.21.15.84:0/3935684019 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0092e0 con 0x7fbb14067840 2023-10-06T02:55:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fae26ffd700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae280c8790 0x7fae280c27b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae1800a430 tx=0x7fae18007910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fe386fcb700 1 -- 172.21.15.84:0/1167590418 shutdown_connections 2023-10-06T02:55:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fe386fcb700 1 --2- 172.21.15.84:0/1167590418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe38006c1a0 0x7fe3800675f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fe386fcb700 1 --2- 172.21.15.84:0/1167590418 >> v2:172.21.15.131:3300/0 conn(0x7fe3800cc920 0x7fe38006bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fe386fcb700 1 -- 172.21.15.84:0/1167590418 >> 172.21.15.84:0/1167590418 conn(0x7fe3800cdef0 msgr2=0x7fe3800c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fae1f7fe700 1 -- 172.21.15.84:0/121291899 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18015440 con 0x7fae280c8790 2023-10-06T02:55:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fae1f7fe700 1 -- 172.21.15.84:0/121291899 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae180155a0 con 0x7fae280c8790 2023-10-06T02:55:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fae1f7fe700 1 -- 172.21.15.84:0/121291899 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18015940 con 0x7fae280c8790 2023-10-06T02:55:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fe386fcb700 1 -- 172.21.15.84:0/1167590418 shutdown_connections 2023-10-06T02:55:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fe386fcb700 1 -- 172.21.15.84:0/1167590418 wait complete. 2023-10-06T02:55:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae280c0f10 con 0x7fae280c8790 2023-10-06T02:55:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2815e080 con 0x7fae280c8790 2023-10-06T02:55:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7f1a5945b700 1 -- 172.21.15.84:0/3116489610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a54155860 msgr2=0x7f1a540ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7f1a5945b700 1 --2- 172.21.15.84:0/3116489610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a54155860 0x7f1a540ae4c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400bb90 tx=0x7f1a4400b430 comp rx=0 tx=0).stop 2023-10-06T02:55:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fbb1b079700 1 -- 172.21.15.84:0/3935684019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb14067840 msgr2=0x7fbb140c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.965+0000 7fbb1b079700 1 --2- 172.21.15.84:0/3935684019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb14067840 0x7fbb140c7a60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbb1406bf50 tx=0x7fbb0c009840 comp rx=0 tx=0).stop 2023-10-06T02:55:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.966+0000 7fbb1b079700 1 -- 172.21.15.84:0/3935684019 shutdown_connections 2023-10-06T02:55:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.966+0000 7fbb1b079700 1 --2- 172.21.15.84:0/3935684019 >> v2:172.21.15.131:3300/0 conn(0x7fbb140c7fa0 0x7fbb14160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.966+0000 7fbb1b079700 1 --2- 172.21.15.84:0/3935684019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb14067840 0x7fbb140c7a60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.966+0000 7fbb1b079700 1 -- 172.21.15.84:0/3935684019 >> 172.21.15.84:0/3935684019 conn(0x7fbb140cdef0 msgr2=0x7fbb140c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.966+0000 7fbb1b079700 1 -- 172.21.15.84:0/3935684019 shutdown_connections 2023-10-06T02:55:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.966+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae0c000fd0 con 0x7fae280c8790 2023-10-06T02:55:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.966+0000 7fe386fcb700 1 Processor -- start 2023-10-06T02:55:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7fbb1b079700 1 -- 172.21.15.84:0/3935684019 wait complete. 2023-10-06T02:55:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7f5e00ed0700 1 Processor -- start 2023-10-06T02:55:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7f1a5945b700 1 -- 172.21.15.84:0/3116489610 shutdown_connections 2023-10-06T02:55:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7f1a5945b700 1 --2- 172.21.15.84:0/3116489610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a54069c70 0x7f1a540abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7f1a5945b700 1 --2- 172.21.15.84:0/3116489610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a54155860 0x7f1a540ae4c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7f1a5945b700 1 -- 172.21.15.84:0/3116489610 >> 172.21.15.84:0/3116489610 conn(0x7f1a540680c0 msgr2=0x7f1a540cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7f5e00ed0700 1 -- start start 2023-10-06T02:55:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7f1a5945b700 1 -- 172.21.15.84:0/3116489610 shutdown_connections 2023-10-06T02:55:21.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7fe386fcb700 1 -- start start 2023-10-06T02:55:21.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe386fcb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe38006c1a0 0x7fe3800c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe386fcb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3800cc920 0x7fe3800c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe386fcb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe380156390 0x7fe3800b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe386fcb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800b01c0 con 0x7fe3800cc920 2023-10-06T02:55:21.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe386fcb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800b0780 con 0x7fe38006c1a0 2023-10-06T02:55:21.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe386fcb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c56e0 con 0x7fe380156390 2023-10-06T02:55:21.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe384d67700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe38006c1a0 0x7fe3800c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.967+0000 7f1a5945b700 1 -- 172.21.15.84:0/3116489610 wait complete. 2023-10-06T02:55:21.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fbb1b079700 1 Processor -- start 2023-10-06T02:55:21.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe384d67700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe38006c1a0 0x7fe3800c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:46712/0 (socket says 172.21.15.84:46712) 2023-10-06T02:55:21.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe384d67700 1 -- 172.21.15.84:0/443878246 learned_addr learned my addr 172.21.15.84:0/443878246 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe385568700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe380156390 0x7fe3800b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7f5e00ed0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dfc0b2390 0x7f5dfc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7f5e00ed0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5dfc162370 0x7f5dfc0cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7f5e00ed0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc15e170 con 0x7f5dfc1617c0 2023-10-06T02:55:21.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7f5e00ed0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc15e340 con 0x7f5dfc162370 2023-10-06T02:55:21.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7f5e00ed0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0cbd00 con 0x7f5dfc0b2390 2023-10-06T02:55:21.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.968+0000 7fe377fff700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3800cc920 0x7fe3800c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7f21c38b8700 1 Processor -- start 2023-10-06T02:55:21.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7f5df9d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5dfc162370 0x7f5dfc0cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7f5df9d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5dfc162370 0x7f5dfc0cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:46726/0 (socket says 172.21.15.84:46726) 2023-10-06T02:55:21.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7f5df9d9b700 1 -- 172.21.15.84:0/1889891666 learned_addr learned my addr 172.21.15.84:0/1889891666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7f21c38b8700 1 -- start start 2023-10-06T02:55:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7f1a5945b700 1 Processor -- start 2023-10-06T02:55:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7f1a5945b700 1 -- start start 2023-10-06T02:55:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7fbb1b079700 1 -- start start 2023-10-06T02:55:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f5df9d9b700 1 -- 172.21.15.84:0/1889891666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dfc0b2390 msgr2=0x7f5dfc0b2760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:55:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f5df9d9b700 1 --2- 172.21.15.84:0/1889891666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dfc0b2390 0x7f5dfc0b2760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f5df9d9b700 1 -- 172.21.15.84:0/1889891666 >> v1:172.21.15.131:6789/0 conn(0x7f5dfc1617c0 legacy=0x7f5dfc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f5df9d9b700 1 -- 172.21.15.84:0/1889891666 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc0cbfe0 con 0x7f5dfc162370 2023-10-06T02:55:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb1b079700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb14067840 0x7fbb14159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb1b079700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb140c7fa0 0x7fbb1415c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb1b079700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb140caa30 0x7fbb1415d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb1b079700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140c4bc0 con 0x7fbb140c7fa0 2023-10-06T02:55:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb1b079700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14160320 con 0x7fbb14067840 2023-10-06T02:55:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb1b079700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14160600 con 0x7fbb140caa30 2023-10-06T02:55:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb140c7fa0 0x7fbb1415c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb140c7fa0 0x7fbb1415c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51166/0 (socket says 172.21.15.84:51166) 2023-10-06T02:55:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb13fff700 1 -- 172.21.15.84:0/4177072640 learned_addr learned my addr 172.21.15.84:0/4177072640 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7fe384d67700 1 -- 172.21.15.84:0/443878246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe380156390 msgr2=0x7fe3800b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7fe384d67700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe380156390 0x7fe3800b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7fe384d67700 1 -- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3800cc920 msgr2=0x7fe3800c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7fe384d67700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3800cc920 0x7fe3800c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7fe384d67700 1 -- 172.21.15.84:0/443878246 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009ae0 con 0x7fe38006c1a0 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.969+0000 7fe384d67700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe38006c1a0 0x7fe3800c6300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe37000b5e0 tx=0x7fe3700090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fe374ff9700 1 -- 172.21.15.84:0/443878246 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000f510 con 0x7fe38006c1a0 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fe374ff9700 1 -- 172.21.15.84:0/443878246 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37000f690 con 0x7fe38006c1a0 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fe374ff9700 1 -- 172.21.15.84:0/443878246 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000fa50 con 0x7fe38006c1a0 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3800c6990 con 0x7fe38006c1a0 2023-10-06T02:55:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3800b0410 con 0x7fe38006c1a0 2023-10-06T02:55:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f21c38b8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21bc1562c0 0x7f21bc15a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f21c38b8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21bc068d10 0x7f21bc0abb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f21c38b8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc0c9740 con 0x7f21bc156690 2023-10-06T02:55:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f21c38b8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc15b040 con 0x7f21bc1562c0 2023-10-06T02:55:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f21c38b8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc0ad850 con 0x7f21bc068d10 2023-10-06T02:55:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f1a5945b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a54069c70 0x7f1a54154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f1a5945b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a540c82a0 0x7f1a540ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f1a5945b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a54155860 0x7f1a5415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f1a5945b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54154ec0 con 0x7f1a540c82a0 2023-10-06T02:55:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f1a5945b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540accd0 con 0x7f1a54155860 2023-10-06T02:55:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f1a5945b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540b15f0 con 0x7f1a54069c70 2023-10-06T02:55:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f21c1654700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21bc1562c0 0x7f21bc15a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f21c0e53700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f21bc156690 0x7f21bc068600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36662/0 (socket says 172.21.15.84:36662) 2023-10-06T02:55:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f21c0e53700 1 -- 172.21.15.84:0/3857202697 learned_addr learned my addr 172.21.15.84:0/3857202697 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f1a527fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a540c82a0 0x7f1a540ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f1a527fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a540c82a0 0x7f1a540ac790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51184/0 (socket says 172.21.15.84:51184) 2023-10-06T02:55:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f1a527fc700 1 -- 172.21.15.84:0/2798276295 learned_addr learned my addr 172.21.15.84:0/2798276295 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f21c1654700 1 -- 172.21.15.84:0/3857202697 >> v2:172.21.15.131:3300/0 conn(0x7f21bc068d10 msgr2=0x7f21bc0abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f21c1654700 1 --2- 172.21.15.84:0/3857202697 >> v2:172.21.15.131:3300/0 conn(0x7f21bc068d10 0x7f21bc0abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f21c1654700 1 -- 172.21.15.84:0/3857202697 >> v1:172.21.15.84:6789/0 conn(0x7f21bc156690 legacy=0x7f21bc068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f21c1654700 1 -- 172.21.15.84:0/3857202697 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc15a7a0 con 0x7f21bc1562c0 2023-10-06T02:55:21.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe380064ad0 con 0x7fe38006c1a0 2023-10-06T02:55:21.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7f5df9d9b700 1 --2- 172.21.15.84:0/1889891666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dfc162370 0x7f5dfc0cb450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0099b0 tx=0x7f5dec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9742876ac48a11a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb19616700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb140caa30 0x7fbb1415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb13fff700 1 -- 172.21.15.84:0/4177072640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb140caa30 msgr2=0x7fbb1415d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb13fff700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb140caa30 0x7fbb1415d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb13fff700 1 -- 172.21.15.84:0/4177072640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb14067840 msgr2=0x7fbb14159c80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:21.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb13fff700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb14067840 0x7fbb14159c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.970+0000 7fbb13fff700 1 -- 172.21.15.84:0/4177072640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c009ae0 con 0x7fbb140c7fa0 2023-10-06T02:55:21.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7fae1f7fe700 1 -- 172.21.15.84:0/121291899 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae18015cf0 con 0x7fae280c8790 2023-10-06T02:55:21.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7fae1f7fe700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fae08066fb0 0x7fae08069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7fae1f7fe700 1 -- 172.21.15.84:0/121291899 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fae18085130 con 0x7fae280c8790 2023-10-06T02:55:21.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7fae1f7fe700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7fae08070c00 0x7fae08073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7fae1f7fe700 1 -- 172.21.15.84:0/121291899 --> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae08073700 con 0x7fae08070c00 2023-10-06T02:55:21.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f21c1654700 1 --2- 172.21.15.84:0/3857202697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc1562c0 0x7f21bc15a0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0c94d0 tx=0x7f21b400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59aa9f363b0267b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7fae277fe700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fae08066fb0 0x7fae08069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7fae27fff700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7fae08070c00 0x7fae08073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f1a52ffd700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a54069c70 0x7f1a54154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.971+0000 7f1a537fe700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a54155860 0x7f1a5415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:21.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f1a52ffd700 1 -- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a54155860 msgr2=0x7f1a5415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f1a52ffd700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a54155860 0x7f1a5415e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f1a52ffd700 1 -- 172.21.15.84:0/2798276295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a540c82a0 msgr2=0x7f1a540ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:21.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f1a52ffd700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a540c82a0 0x7f1a540ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:21.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f1a52ffd700 1 -- 172.21.15.84:0/2798276295 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4400b6d0 con 0x7f1a54069c70 2023-10-06T02:55:21.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f1a52ffd700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a54069c70 0x7f1a54154980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a44018000 tx=0x7f1a4401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7fae277fe700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fae08066fb0 0x7fae08069460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae100093f0 tx=0x7fae10016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fae27fff700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7fae08070c00 0x7fae08073030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fbb13fff700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb140c7fa0 0x7fbb1415c700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b5e0 tx=0x7fbb080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:21.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7fe374ff9700 1 -- 172.21.15.84:0/443878246 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe37001a400 con 0x7fe38006c1a0 2023-10-06T02:55:21.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fe374ff9700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe36c067080 0x7fe36c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fe374ff9700 1 -- 172.21.15.84:0/443878246 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe370084450 con 0x7fe38006c1a0 2023-10-06T02:55:21.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fe374ff9700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7fe36c070d50 0x7fe36c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:21.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fe374ff9700 1 -- 172.21.15.84:0/443878246 --> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe36c073850 con 0x7fe36c070d50 2023-10-06T02:55:21.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fe374ff9700 1 -- 172.21.15.84:0/443878246 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3700869f0 con 0x7fe38006c1a0 2023-10-06T02:55:21.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f1a42ffd700 1 -- 172.21.15.84:0/2798276295 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44010850 con 0x7f1a54069c70 2023-10-06T02:55:21.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f1a42ffd700 1 -- 172.21.15.84:0/2798276295 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4401e040 con 0x7f1a54069c70 2023-10-06T02:55:21.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.972+0000 7f1a42ffd700 1 -- 172.21.15.84:0/2798276295 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44010c20 con 0x7f1a54069c70 2023-10-06T02:55:21.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a540ad840 con 0x7f1a54069c70 2023-10-06T02:55:21.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a540b0cc0 con 0x7f1a54069c70 2023-10-06T02:55:22.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fe377fff700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe36c067080 0x7fe36c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fe385568700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7fe36c070d50 0x7fe36c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fbb10ff9700 1 -- 172.21.15.84:0/4177072640 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800f510 con 0x7fbb140c7fa0 2023-10-06T02:55:22.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fbb10ff9700 1 -- 172.21.15.84:0/4177072640 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0800f670 con 0x7fbb140c7fa0 2023-10-06T02:55:22.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.973+0000 7fbb10ff9700 1 -- 172.21.15.84:0/4177072640 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800fa30 con 0x7fbb140c7fa0 2023-10-06T02:55:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7fae1f7fe700 1 -- 172.21.15.84:0/121291899 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae18051f60 con 0x7fae280c8790 2023-10-06T02:55:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7f5df959a700 1 -- 172.21.15.84:0/1889891666 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00b760 con 0x7f5dfc162370 2023-10-06T02:55:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7f5df959a700 1 -- 172.21.15.84:0/1889891666 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00b8c0 con 0x7f5dfc162370 2023-10-06T02:55:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7fae1f7fe700 1 -- 172.21.15.84:0/121291899 <== osd.2 v2:172.21.15.84:6800/90631 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fae08073700 con 0x7fae08070c00 2023-10-06T02:55:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb140c4570 con 0x7fbb140c7fa0 2023-10-06T02:55:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1415a1c0 con 0x7fbb140c7fa0 2023-10-06T02:55:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7fe385568700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7fe36c070d50 0x7fe36c073180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7f5df959a700 1 -- 172.21.15.84:0/1889891666 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00bc60 con 0x7f5dfc162370 2023-10-06T02:55:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1889891666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dfc162370 msgr2=0x7f5dfc0cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.974+0000 7f5e00ed0700 1 --2- 172.21.15.84:0/1889891666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dfc162370 0x7f5dfc0cb450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0099b0 tx=0x7f5dec009250 comp rx=0 tx=0).stop 2023-10-06T02:55:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.975+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1889891666 shutdown_connections 2023-10-06T02:55:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.975+0000 7f5e00ed0700 1 --2- 172.21.15.84:0/1889891666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dfc0b2390 0x7f5dfc0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.975+0000 7f5e00ed0700 1 --2- 172.21.15.84:0/1889891666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dfc162370 0x7f5dfc0cb450 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.975+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1889891666 >> 172.21.15.84:0/1889891666 conn(0x7f5dfc0ccf70 msgr2=0x7f5dfc0cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.975+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb14064ad0 con 0x7fbb140c7fa0 2023-10-06T02:55:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.975+0000 7fe374ff9700 1 -- 172.21.15.84:0/443878246 <== osd.1 v2:172.21.15.84:6816/90643 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe36c073850 con 0x7fe36c070d50 2023-10-06T02:55:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.975+0000 7fe377fff700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe36c067080 0x7fe36c069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe380146e20 tx=0x7fe37c000f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.976+0000 7f21b3fff700 1 -- 172.21.15.84:0/3857202697 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4010070 con 0x7f21bc1562c0 2023-10-06T02:55:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.976+0000 7fbb10ff9700 1 -- 172.21.15.84:0/4177072640 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb08024430 con 0x7fbb140c7fa0 2023-10-06T02:55:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.976+0000 7fbb10ff9700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb00067000 0x7fbb000694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7fbb10ff9700 1 -- 172.21.15.84:0/4177072640 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbb08084dc0 con 0x7fbb140c7fa0 2023-10-06T02:55:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7fbb10ff9700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7fbb00070cd0 0x7fbb00073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7fbb10ff9700 1 -- 172.21.15.84:0/4177072640 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb000737d0 con 0x7fbb00070cd0 2023-10-06T02:55:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7fbb10ff9700 1 -- 172.21.15.84:0/4177072640 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb080851e0 con 0x7fbb140c7fa0 2023-10-06T02:55:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.976+0000 7f21b3fff700 1 -- 172.21.15.84:0/3857202697 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b400de00 con 0x7f21bc1562c0 2023-10-06T02:55:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.976+0000 7f21b3fff700 1 -- 172.21.15.84:0/3857202697 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b400b320 con 0x7f21bc1562c0 2023-10-06T02:55:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.976+0000 7f21c38b8700 1 -- 172.21.15.84:0/3857202697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc1562c0 msgr2=0x7f21bc15a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7f21c38b8700 1 --2- 172.21.15.84:0/3857202697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc1562c0 0x7f21bc15a0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0c94d0 tx=0x7f21b400b990 comp rx=0 tx=0).stop 2023-10-06T02:55:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7f21c38b8700 1 -- 172.21.15.84:0/3857202697 shutdown_connections 2023-10-06T02:55:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7f21c38b8700 1 --2- 172.21.15.84:0/3857202697 >> v2:172.21.15.131:3300/0 conn(0x7f21bc068d10 0x7f21bc0abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7f21c38b8700 1 --2- 172.21.15.84:0/3857202697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc1562c0 0x7f21bc15a0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7f21c38b8700 1 -- 172.21.15.84:0/3857202697 >> 172.21.15.84:0/3857202697 conn(0x7f21bc06de80 msgr2=0x7f21bc06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7fbb19616700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7fbb00070cd0 0x7fbb00073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7f21c38b8700 1 -- 172.21.15.84:0/3857202697 shutdown_connections 2023-10-06T02:55:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7f21c38b8700 1 -- 172.21.15.84:0/3857202697 wait complete. 2023-10-06T02:55:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.977+0000 7fbb19616700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7fbb00070cd0 0x7fbb00073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.979+0000 7fbb10ff9700 1 -- 172.21.15.84:0/4177072640 <== osd.0 v2:172.21.15.84:6808/90632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbb000737d0 con 0x7fbb00070cd0 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.979+0000 7f21c38b8700 1 Processor -- start 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.979+0000 7f21c38b8700 1 -- start start 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.980+0000 7f21c38b8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21bc068d10 0x7f21bc0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.980+0000 7f21c38b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21bc1562c0 0x7f21bc147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.980+0000 7f21c38b8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc156690 0x7f21bc16e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.980+0000 7f21c38b8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0ca430 con 0x7f21bc156690 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.980+0000 7f21c38b8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc1474b0 con 0x7f21bc068d10 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.980+0000 7f21c38b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc14c4e0 con 0x7f21bc1562c0 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1e55700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc156690 0x7f21bc16e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1654700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21bc068d10 0x7f21bc0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c0e53700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21bc1562c0 0x7f21bc147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1e55700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc156690 0x7f21bc16e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51198/0 (socket says 172.21.15.84:51198) 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1654700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21bc068d10 0x7f21bc0c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:46758/0 (socket says 172.21.15.84:46758) 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1e55700 1 -- 172.21.15.84:0/2896953018 learned_addr learned my addr 172.21.15.84:0/2896953018 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1e55700 1 -- 172.21.15.84:0/2896953018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21bc1562c0 msgr2=0x7f21bc147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1e55700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21bc1562c0 0x7f21bc147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1e55700 1 -- 172.21.15.84:0/2896953018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21bc068d10 msgr2=0x7f21bc0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1e55700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21bc068d10 0x7f21bc0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1e55700 1 -- 172.21.15.84:0/2896953018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b400bc30 con 0x7f21bc156690 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1654700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21bc068d10 0x7f21bc0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.981+0000 7f21c1e55700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc156690 0x7f21bc16e1f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00b600 tx=0x7f21ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.982+0000 7f1a42ffd700 1 -- 172.21.15.84:0/2798276295 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a4402c440 con 0x7f1a54069c70 2023-10-06T02:55:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.982+0000 7f21c0e53700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21bc1562c0 0x7f21bc147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.982+0000 7f1a42ffd700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a3c0670d0 0x7f1a3c069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.983+0000 7f1a42ffd700 1 -- 172.21.15.84:0/2798276295 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1a44014070 con 0x7f1a54069c70 2023-10-06T02:55:22.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.984+0000 7f21b17fa700 1 -- 172.21.15.84:0/2896953018 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00f510 con 0x7f21bc156690 2023-10-06T02:55:22.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.984+0000 7f21b17fa700 1 -- 172.21.15.84:0/2896953018 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac00f670 con 0x7f21bc156690 2023-10-06T02:55:22.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.984+0000 7f21b17fa700 1 -- 172.21.15.84:0/2896953018 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00fa30 con 0x7f21bc156690 2023-10-06T02:55:22.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.984+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc16edd0 con 0x7f21bc156690 2023-10-06T02:55:22.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.984+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc146e60 con 0x7f21bc156690 2023-10-06T02:55:22.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.985+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21bc064ad0 con 0x7f21bc156690 2023-10-06T02:55:22.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.986+0000 7f1a527fc700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a3c0670d0 0x7f1a3c069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.986+0000 7f1a527fc700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a3c0670d0 0x7f1a3c069580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0053f0 tx=0x7f1a4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.988+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1889891666 shutdown_connections 2023-10-06T02:55:22.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.988+0000 7f1a5945b700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f1a300015f0 0x7f1a30003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.988+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 --> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a30006b90 con 0x7f1a300015f0 2023-10-06T02:55:22.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.988+0000 7fbb18e15700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb00067000 0x7fbb000694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.989+0000 7fbb18e15700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb00067000 0x7fbb000694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbb1406bf50 tx=0x7fbb0c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.989+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1889891666 wait complete. 2023-10-06T02:55:22.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f5e00ed0700 1 Processor -- start 2023-10-06T02:55:22.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f1a537fe700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f1a300015f0 0x7f1a30003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.989+0000 7f62c1d2d700 1 Processor -- start 2023-10-06T02:55:22.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.989+0000 7f62c1d2d700 1 -- start start 2023-10-06T02:55:22.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f62c1d2d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62bc155860 0x7f62bc0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f62c1d2d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f62bc069c70 0x7f62bc0abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f62c1d2d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc0c7e10 con 0x7f62bc0c82a0 2023-10-06T02:55:22.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f62c1d2d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc0aea00 con 0x7f62bc155860 2023-10-06T02:55:22.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f62c1d2d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc0c7200 con 0x7f62bc069c70 2023-10-06T02:55:22.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f62baffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f62bc0c82a0 0x7f62bc069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36668/0 (socket says 172.21.15.84:36668) 2023-10-06T02:55:22.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f62baffd700 1 -- 172.21.15.84:0/839236616 learned_addr learned my addr 172.21.15.84:0/839236616 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.990+0000 7f5e00ed0700 1 -- start start 2023-10-06T02:55:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.991+0000 7f5e00ed0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dfc0b2390 0x7f5dfc0c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.991+0000 7f5e00ed0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dfc1617c0 0x7f5dfc0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.991+0000 7f5e00ed0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc162370 0x7f5dfc0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.991+0000 7f5e00ed0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0c8dc0 con 0x7f5dfc162370 2023-10-06T02:55:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.991+0000 7f5e00ed0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0c81b0 con 0x7f5dfc0b2390 2023-10-06T02:55:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.991+0000 7f5e00ed0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0c8490 con 0x7f5dfc1617c0 2023-10-06T02:55:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5dfad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc162370 0x7f5dfc0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5df9d9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dfc1617c0 0x7f5dfc0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5dfad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc162370 0x7f5dfc0cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51216/0 (socket says 172.21.15.84:51216) 2023-10-06T02:55:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5dfad9d700 1 -- 172.21.15.84:0/1338233676 learned_addr learned my addr 172.21.15.84:0/1338233676 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5dfad9d700 1 -- 172.21.15.84:0/1338233676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dfc1617c0 msgr2=0x7f5dfc0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5dfad9d700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5dfc1617c0 0x7f5dfc0c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5dfad9d700 1 -- 172.21.15.84:0/1338233676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dfc0b2390 msgr2=0x7f5dfc0c30e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5dfad9d700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dfc0b2390 0x7f5dfc0c30e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5dfad9d700 1 -- 172.21.15.84:0/1338233676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0094f0 con 0x7f5dfc162370 2023-10-06T02:55:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f5dfad9d700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc162370 0x7f5dfc0cefb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c810 tx=0x7f5df0007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356540537 0 0) 0x7f62bc0c7e10 con 0x7f62bc0c82a0 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.992+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a4003570 con 0x7f62bc0c82a0 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3870324517 0 0) 0x7f62a4003570 con 0x7f62bc0c82a0 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 >> v2:172.21.15.131:3300/0 conn(0x7f62bc069c70 msgr2=0x7f62bc0abcd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 --2- 172.21.15.84:0/839236616 >> v2:172.21.15.131:3300/0 conn(0x7f62bc069c70 0x7f62bc0abcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 >> v2:172.21.15.84:3300/0 conn(0x7f62bc155860 msgr2=0x7f62bc0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 --2- 172.21.15.84:0/839236616 >> v2:172.21.15.84:3300/0 conn(0x7f62bc155860 0x7f62bc0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0c74e0 con 0x7f62bc0c82a0 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f62ac001470 con 0x7f62bc0c82a0 2023-10-06T02:55:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 >> v1:172.21.15.84:6789/0 conn(0x7f62bc0c82a0 legacy=0x7f62bc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62a4003ae0 0x7f62a4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a4004810 0x7f62a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62a40053c0 0x7f62a4007a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0aea00 con 0x7f62a4004810 2023-10-06T02:55:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0c7200 con 0x7f62a40053c0 2023-10-06T02:55:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4008340 con 0x7f62a4003ae0 2023-10-06T02:55:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62baffd700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a4004810 0x7f62a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f62bbfff700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62a40053c0 0x7f62a4007a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f1a537fe700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f1a300015f0 0x7f1a30003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f21b17fa700 1 -- 172.21.15.84:0/2896953018 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21ac024430 con 0x7f21bc156690 2023-10-06T02:55:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f21b17fa700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21a0067080 0x7f21a0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f21b17fa700 1 -- 172.21.15.84:0/2896953018 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f21ac084f90 con 0x7f21bc156690 2023-10-06T02:55:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f21b17fa700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f21a0070d50 0x7f21a0073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f21b17fa700 1 -- 172.21.15.84:0/2896953018 --> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21a0073850 con 0x7f21a0070d50 2023-10-06T02:55:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f21b17fa700 1 -- 172.21.15.84:0/2896953018 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21ac0852c0 con 0x7f21bc156690 2023-10-06T02:55:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f21c1654700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21a0067080 0x7f21a0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.995+0000 7f21c0e53700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f21a0070d50 0x7f21a0073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f5dea7fc700 1 -- 172.21.15.84:0/1338233676 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0012630 con 0x7f5dfc162370 2023-10-06T02:55:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f5dea7fc700 1 -- 172.21.15.84:0/1338233676 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df00127d0 con 0x7f5dfc162370 2023-10-06T02:55:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.993+0000 7f5dea7fc700 1 -- 172.21.15.84:0/1338233676 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0012b90 con 0x7f5dfc162370 2023-10-06T02:55:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f62baffd700 1 -- 172.21.15.84:0/839236616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62a4003ae0 msgr2=0x7f62a4003ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f62baffd700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62a4003ae0 0x7f62a4003ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f62baffd700 1 -- 172.21.15.84:0/839236616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62a40053c0 msgr2=0x7f62a4007a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f62baffd700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62a40053c0 0x7f62a4007a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f62baffd700 1 -- 172.21.15.84:0/839236616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0c74e0 con 0x7f62a4004810 2023-10-06T02:55:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.994+0000 7f62baffd700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a4004810 0x7f62a4004c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00d4f0 tx=0x7f62ac004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5943408bb779aea1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.995+0000 7f62bbfff700 1 -- 172.21.15.84:0/839236616 reap_dead start 2023-10-06T02:55:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.995+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00dd40 con 0x7f62a4004810 2023-10-06T02:55:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.995+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac010460 con 0x7f62a4004810 2023-10-06T02:55:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.995+0000 7f62ba7fc700 1 -- 172.21.15.84:0/839236616 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00dea0 con 0x7f62a4004810 2023-10-06T02:55:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.995+0000 7f21c0e53700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f21a0070d50 0x7f21a0073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.995+0000 7f21c1654700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21a0067080 0x7f21a0069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21b400bc00 tx=0x7f21b401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.996+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 --> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae0c002d30 con 0x7fae08070c00 2023-10-06T02:55:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.995+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0c8770 con 0x7f5dfc162370 2023-10-06T02:55:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.995+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc0c3620 con 0x7f5dfc162370 2023-10-06T02:55:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.996+0000 7f1a42ffd700 1 -- 172.21.15.84:0/2798276295 <== osd.5 v2:172.21.15.131:6808/90923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1a30006b90 con 0x7f1a300015f0 2023-10-06T02:55:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.996+0000 7f62c1d2d700 1 -- 172.21.15.84:0/839236616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a4004810 msgr2=0x7f62a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.996+0000 7f62c1d2d700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a4004810 0x7f62a4004c80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00d4f0 tx=0x7f62ac004950 comp rx=0 tx=0).stop 2023-10-06T02:55:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.996+0000 7f62c1d2d700 1 -- 172.21.15.84:0/839236616 shutdown_connections 2023-10-06T02:55:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.996+0000 7f62c1d2d700 1 --2- 172.21.15.84:0/839236616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a4004810 0x7f62a4004c80 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00d4f0 tx=0x7f62ac004950 comp rx=0 tx=0).stop 2023-10-06T02:55:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.996+0000 7f62c1d2d700 1 -- 172.21.15.84:0/839236616 >> 172.21.15.84:0/839236616 conn(0x7f62bc0680c0 msgr2=0x7f62bc0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.997+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5dfc064ad0 con 0x7f5dfc162370 2023-10-06T02:55:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.997+0000 7fae1f7fe700 1 -- 172.21.15.84:0/121291899 <== osd.2 v2:172.21.15.84:6800/90631 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae0c002d30 con 0x7fae08070c00 2023-10-06T02:55:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.997+0000 7f401ef87700 1 Processor -- start 2023-10-06T02:55:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.997+0000 7f401ef87700 1 -- start start 2023-10-06T02:55:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7fae08070c00 msgr2=0x7fae08073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7fae2dba1700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7fae08070c00 0x7fae08073030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fae08066fb0 msgr2=0x7fae08069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7fae2dba1700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fae08066fb0 0x7fae08069460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae100093f0 tx=0x7fae10016000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae280c8790 msgr2=0x7fae280c27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7fae2dba1700 1 --2- 172.21.15.84:0/121291899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae280c8790 0x7fae280c27b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae1800a430 tx=0x7fae18007910 comp rx=0 tx=0).stop 2023-10-06T02:55:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7fae27fff700 1 -- 172.21.15.84:0/121291899 reap_dead start 2023-10-06T02:55:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 shutdown_connections 2023-10-06T02:55:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 >> 172.21.15.84:0/121291899 conn(0x7fae280680c0 msgr2=0x7fae280b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7f62c1d2d700 1 -- 172.21.15.84:0/839236616 shutdown_connections 2023-10-06T02:55:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7f21b17fa700 1 -- 172.21.15.84:0/2896953018 <== osd.3 v2:172.21.15.84:6824/90648 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f21a0073850 con 0x7f21a0070d50 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7f401ef87700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4018156390 0x7f40180cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7f401ef87700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f401806c370 0x7f40180c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7f401ef87700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401806c780 con 0x7f40180cc750 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7f401ef87700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40180ccbd0 con 0x7f4018156390 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7f401ef87700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401806c9e0 con 0x7f401806c370 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.999+0000 7f401cd23700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4018156390 0x7f40180cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.999+0000 7f401cd23700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4018156390 0x7f40180cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51232/0 (socket says 172.21.15.84:51232) 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.999+0000 7f401cd23700 1 -- 172.21.15.84:0/2317543683 learned_addr learned my addr 172.21.15.84:0/2317543683 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.999+0000 7f401d524700 1 --2- 172.21.15.84:0/2317543683 >> v2:172.21.15.131:3300/0 conn(0x7f401806c370 0x7f40180c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.999+0000 7f401cd23700 1 -- 172.21.15.84:0/2317543683 >> v2:172.21.15.131:3300/0 conn(0x7f401806c370 msgr2=0x7f40180c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.999+0000 7f401cd23700 1 --2- 172.21.15.84:0/2317543683 >> v2:172.21.15.131:3300/0 conn(0x7f401806c370 0x7f40180c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.999+0000 7f401cd23700 1 -- 172.21.15.84:0/2317543683 >> v1:172.21.15.84:6789/0 conn(0x7f40180cc750 legacy=0x7f401806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.999+0000 7f401cd23700 1 -- 172.21.15.84:0/2317543683 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4018156b60 con 0x7f4018156390 2023-10-06T02:55:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.999+0000 7f401cd23700 1 --2- 172.21.15.84:0/2317543683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4018156390 0x7f40180cc210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f401806d010 tx=0x7f4008009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6339700716acef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:21.998+0000 7f62c1d2d700 1 -- 172.21.15.84:0/839236616 wait complete. 2023-10-06T02:55:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.000+0000 7f400f7fe700 1 -- 172.21.15.84:0/2317543683 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800f380 con 0x7f4018156390 2023-10-06T02:55:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.000+0000 7f400f7fe700 1 -- 172.21.15.84:0/2317543683 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4008009a10 con 0x7f4018156390 2023-10-06T02:55:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.000+0000 7f400f7fe700 1 -- 172.21.15.84:0/2317543683 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008009db0 con 0x7f4018156390 2023-10-06T02:55:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.000+0000 7f401ef87700 1 -- 172.21.15.84:0/2317543683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4018156390 msgr2=0x7f40180cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.000+0000 7f401ef87700 1 --2- 172.21.15.84:0/2317543683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4018156390 0x7f40180cc210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f401806d010 tx=0x7f4008009250 comp rx=0 tx=0).stop 2023-10-06T02:55:22.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.000+0000 7f62c1d2d700 1 Processor -- start 2023-10-06T02:55:22.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.000+0000 7f62c1d2d700 1 -- start start 2023-10-06T02:55:22.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62c1d2d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62bc171360 0x7f62bc171730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62c1d2d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62bc0bfc10 0x7f62bc0c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62c1d2d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62bc148cb0 0x7f62bc149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62c1d2d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc171c70 con 0x7f62bc171360 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62c1d2d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0c0990 con 0x7f62bc148cb0 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62c1d2d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0c0c70 con 0x7f62bc0bfc10 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62bc171360 0x7f62bc171730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62bc171360 0x7f62bc171730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51244/0 (socket says 172.21.15.84:51244) 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bb7fe700 1 -- 172.21.15.84:0/208128641 learned_addr learned my addr 172.21.15.84:0/208128641 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62baffd700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62bc0bfc10 0x7f62bc0c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bbfff700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62bc148cb0 0x7f62bc149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bb7fe700 1 -- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62bc0bfc10 msgr2=0x7f62bc0c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bb7fe700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62bc0bfc10 0x7f62bc0c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bb7fe700 1 -- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62bc148cb0 msgr2=0x7f62bc149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bb7fe700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62bc148cb0 0x7f62bc149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bb7fe700 1 -- 172.21.15.84:0/208128641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0c0f50 con 0x7f62bc171360 2023-10-06T02:55:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.002+0000 7f62bbfff700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62bc148cb0 0x7f62bc149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f62bb7fe700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62bc171360 0x7f62bc171730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b810 tx=0x7f62b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f401ef87700 1 -- 172.21.15.84:0/2317543683 shutdown_connections 2023-10-06T02:55:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f401ef87700 1 --2- 172.21.15.84:0/2317543683 >> v2:172.21.15.131:3300/0 conn(0x7f401806c370 0x7f40180c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f401ef87700 1 --2- 172.21.15.84:0/2317543683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4018156390 0x7f40180cc210 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f401ef87700 1 -- 172.21.15.84:0/2317543683 >> 172.21.15.84:0/2317543683 conn(0x7f40180cdef0 msgr2=0x7f40180c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f401ef87700 1 -- 172.21.15.84:0/2317543683 shutdown_connections 2023-10-06T02:55:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f62a37fe700 1 -- 172.21.15.84:0/208128641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b000f570 con 0x7f62bc171360 2023-10-06T02:55:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f62a37fe700 1 -- 172.21.15.84:0/208128641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b000f6f0 con 0x7f62bc171360 2023-10-06T02:55:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f62a37fe700 1 -- 172.21.15.84:0/208128641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b000fab0 con 0x7f62bc171360 2023-10-06T02:55:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 --> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe380157400 con 0x7fe36c070d50 2023-10-06T02:55:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.004+0000 7fe374ff9700 1 -- 172.21.15.84:0/443878246 <== osd.1 v2:172.21.15.84:6816/90643 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe380157400 con 0x7fe36c070d50 2023-10-06T02:55:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.003+0000 7f401ef87700 1 -- 172.21.15.84:0/2317543683 wait complete. 2023-10-06T02:55:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.004+0000 7f401ef87700 1 Processor -- start 2023-10-06T02:55:22.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.004+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc0c1230 con 0x7f62bc171360 2023-10-06T02:55:22.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.004+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc14ea00 con 0x7f62bc171360 2023-10-06T02:55:22.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7fe36c070d50 msgr2=0x7fe36c073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fe386fcb700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7fe36c070d50 0x7fe36c073180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe36c067080 msgr2=0x7fe36c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fe386fcb700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe36c067080 0x7fe36c069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe380146e20 tx=0x7fe37c000f90 comp rx=0 tx=0).stop 2023-10-06T02:55:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe38006c1a0 msgr2=0x7fe3800c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fe386fcb700 1 --2- 172.21.15.84:0/443878246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe38006c1a0 0x7fe3800c6300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe37000b5e0 tx=0x7fe3700090f0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fe385568700 1 -- 172.21.15.84:0/443878246 reap_dead start 2023-10-06T02:55:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 shutdown_connections 2023-10-06T02:55:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 >> 172.21.15.84:0/443878246 conn(0x7fe3800cdef0 msgr2=0x7fe3800caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.006+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 shutdown_connections 2023-10-06T02:55:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.006+0000 7f401ef87700 1 -- start start 2023-10-06T02:55:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.006+0000 7fe386fcb700 1 -- 172.21.15.84:0/443878246 wait complete. 2023-10-06T02:55:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.006+0000 7f401ef87700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f401806c370 0x7f40180b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.006+0000 7f401ef87700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180cc750 0x7f40180c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.006+0000 7f401ef87700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4018156390 0x7f40180c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.006+0000 7f401ef87700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40180c5970 con 0x7f4018156390 2023-10-06T02:55:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.006+0000 7f401ef87700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40180b0f70 con 0x7f40180cc750 2023-10-06T02:55:22.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.006+0000 7f401ef87700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40180b0360 con 0x7f401806c370 2023-10-06T02:55:22.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.004+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb1406bc70 con 0x7fbb00070cd0 2023-10-06T02:55:22.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.005+0000 7fbb10ff9700 1 -- 172.21.15.84:0/4177072640 <== osd.0 v2:172.21.15.84:6808/90632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbb1406bc70 con 0x7fbb00070cd0 2023-10-06T02:55:22.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7fbb00070cd0 msgr2=0x7fbb00073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7fbb1b079700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7fbb00070cd0 0x7fbb00073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb00067000 msgr2=0x7fbb000694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7fbb1b079700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb00067000 0x7fbb000694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbb1406bf50 tx=0x7fbb0c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb140c7fa0 msgr2=0x7fbb1415c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7fbb1b079700 1 --2- 172.21.15.84:0/4177072640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb140c7fa0 0x7fbb1415c700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b5e0 tx=0x7fbb080090f0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7fbb19616700 1 -- 172.21.15.84:0/4177072640 reap_dead start 2023-10-06T02:55:22.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 shutdown_connections 2023-10-06T02:55:22.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f5dea7fc700 1 -- 172.21.15.84:0/1338233676 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5df001b400 con 0x7f5dfc162370 2023-10-06T02:55:22.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f5dea7fc700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ddc067080 0x7f5ddc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f5dea7fc700 1 -- 172.21.15.84:0/1338233676 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5df00845c0 con 0x7f5dfc162370 2023-10-06T02:55:22.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f5dea7fc700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7f5ddc070d50 0x7f5ddc073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f5dea7fc700 1 -- 172.21.15.84:0/1338233676 --> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ddc073850 con 0x7f5ddc070d50 2023-10-06T02:55:22.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f5dea7fc700 1 -- 172.21.15.84:0/1338233676 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5df0086b60 con 0x7f5dfc162370 2023-10-06T02:55:22.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f401d524700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4018156390 0x7f40180c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f401d524700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4018156390 0x7f40180c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51250/0 (socket says 172.21.15.84:51250) 2023-10-06T02:55:22.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f401d524700 1 -- 172.21.15.84:0/1585327681 learned_addr learned my addr 172.21.15.84:0/1585327681 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f400ffff700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180cc750 0x7f40180c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f401cd23700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f401806c370 0x7f40180b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f400ffff700 1 -- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f401806c370 msgr2=0x7f40180b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f400ffff700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f401806c370 0x7f40180b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f400ffff700 1 -- 172.21.15.84:0/1585327681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4018156390 msgr2=0x7f40180c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f400ffff700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4018156390 0x7f40180c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f400ffff700 1 -- 172.21.15.84:0/1585327681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400800f610 con 0x7f40180cc750 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f400ffff700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180cc750 0x7f40180c4ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401400c5c0 tx=0x7f4014007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f400cff9700 1 -- 172.21.15.84:0/1585327681 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014011590 con 0x7f40180cc750 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f400cff9700 1 -- 172.21.15.84:0/1585327681 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4014011710 con 0x7f40180cc750 2023-10-06T02:55:22.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f62a37fe700 1 -- 172.21.15.84:0/208128641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62b001a460 con 0x7f62bc171360 2023-10-06T02:55:22.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f62a37fe700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62a4068c10 0x7f62a406b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f62a37fe700 1 -- 172.21.15.84:0/208128641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f62b0084640 con 0x7f62bc171360 2023-10-06T02:55:22.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.007+0000 7f62baffd700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62a4068c10 0x7f62a406b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7fae2dba1700 1 -- 172.21.15.84:0/121291899 wait complete. 2023-10-06T02:55:22.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f400cff9700 1 -- 172.21.15.84:0/1585327681 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014011ad0 con 0x7f40180cc750 2023-10-06T02:55:22.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40180b0640 con 0x7f40180cc750 2023-10-06T02:55:22.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40180b0c00 con 0x7f40180cc750 2023-10-06T02:55:22.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 shutdown_connections 2023-10-06T02:55:22.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 >> 172.21.15.84:0/4177072640 conn(0x7fbb140cdef0 msgr2=0x7fbb140c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f62baffd700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62a4068c10 0x7f62a406b0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0631e0 tx=0x7f62ac016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.009+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 shutdown_connections 2023-10-06T02:55:22.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.009+0000 7fbb1b079700 1 -- 172.21.15.84:0/4177072640 wait complete. 2023-10-06T02:55:22.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.010+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ff4000fd0 con 0x7f40180cc750 2023-10-06T02:55:22.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.010+0000 7f62c1d2d700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7f629c0015f0 0x7f629c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.010+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 --> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f629c006b90 con 0x7f629c0015f0 2023-10-06T02:55:22.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.008+0000 7f5dfa59c700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ddc067080 0x7f5ddc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.009+0000 7f5dfa59c700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ddc067080 0x7f5ddc069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5df400acf0 tx=0x7f5df4009350 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.010+0000 7f5df9d9b700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7f5ddc070d50 0x7f5ddc073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.010+0000 7f400cff9700 1 -- 172.21.15.84:0/1585327681 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f401401c440 con 0x7f40180cc750 2023-10-06T02:55:22.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.010+0000 7f400cff9700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ffc067050 0x7f3ffc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.010+0000 7f400cff9700 1 -- 172.21.15.84:0/1585327681 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4014083d70 con 0x7f40180cc750 2023-10-06T02:55:22.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.010+0000 7f400cff9700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f3ffc070ca0 0x7f3ffc0730d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.010+0000 7f400cff9700 1 -- 172.21.15.84:0/1585327681 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ffc0737a0 con 0x7f3ffc070ca0 2023-10-06T02:55:22.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.011+0000 7f400cff9700 1 -- 172.21.15.84:0/1585327681 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4014001120 con 0x7f40180cc750 2023-10-06T02:55:22.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.011+0000 7f401d524700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f3ffc070ca0 0x7f3ffc0730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.011+0000 7f401cd23700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ffc067050 0x7f3ffc069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.011+0000 7f5df9d9b700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7f5ddc070d50 0x7f5ddc073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.011+0000 7f62bbfff700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7f629c0015f0 0x7f629c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.011+0000 7f401d524700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f3ffc070ca0 0x7f3ffc0730d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.011+0000 7f401cd23700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ffc067050 0x7f3ffc069500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f401806d010 tx=0x7f4008017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.011+0000 7f62bbfff700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7f629c0015f0 0x7f629c003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.012+0000 7f5dea7fc700 1 -- 172.21.15.84:0/1338233676 <== osd.4 v2:172.21.15.131:6800/90922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5ddc073850 con 0x7f5ddc070d50 2023-10-06T02:55:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.012+0000 7f400cff9700 1 -- 172.21.15.84:0/1585327681 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3ffc0737a0 con 0x7f3ffc070ca0 2023-10-06T02:55:22.051 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-10-06T02:55:22.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T02:55:22.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.013+0000 7f62a37fe700 1 -- 172.21.15.84:0/208128641 <== osd.7 v2:172.21.15.131:6816/90924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f629c006b90 con 0x7f629c0015f0 2023-10-06T02:55:22.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.027+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 --> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a30005c80 con 0x7f1a300015f0 2023-10-06T02:55:22.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.028+0000 7f1a42ffd700 1 -- 172.21.15.84:0/2798276295 <== osd.5 v2:172.21.15.131:6808/90923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a30005c80 con 0x7f1a300015f0 2023-10-06T02:55:22.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.028+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f1a300015f0 msgr2=0x7f1a30003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.028+0000 7f1a5945b700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f1a300015f0 0x7f1a30003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.029+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 --> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5dfc0cc2c0 con 0x7f5ddc070d50 2023-10-06T02:55:22.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.029+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 --> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f21bc16ef60 con 0x7f21a0070d50 2023-10-06T02:55:22.054 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T02:55:22.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T02:55:22.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.029+0000 7f21b17fa700 1 -- 172.21.15.84:0/2896953018 <== osd.3 v2:172.21.15.84:6824/90648 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f21bc16ef60 con 0x7f21a0070d50 2023-10-06T02:55:22.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.029+0000 7f5dea7fc700 1 -- 172.21.15.84:0/1338233676 <== osd.4 v2:172.21.15.131:6800/90922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5dfc0cc2c0 con 0x7f5ddc070d50 2023-10-06T02:55:22.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a3c0670d0 msgr2=0x7f1a3c069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f1a5945b700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a3c0670d0 0x7f1a3c069580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0053f0 tx=0x7f1a4c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:22.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a54069c70 msgr2=0x7f1a54154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f1a5945b700 1 --2- 172.21.15.84:0/2798276295 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a54069c70 0x7f1a54154980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a44018000 tx=0x7f1a4401b000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f1a537fe700 1 -- 172.21.15.84:0/2798276295 reap_dead start 2023-10-06T02:55:22.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f21a0070d50 msgr2=0x7f21a0073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f21a0070d50 0x7f21a0073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 shutdown_connections 2023-10-06T02:55:22.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 >> 172.21.15.84:0/2798276295 conn(0x7f1a540680c0 msgr2=0x7f1a5415bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 shutdown_connections 2023-10-06T02:55:22.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21a0067080 msgr2=0x7f21a0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21a0067080 0x7f21a0069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21b400bc00 tx=0x7f21b401a000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f1a5945b700 1 -- 172.21.15.84:0/2798276295 wait complete. 2023-10-06T02:55:22.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc156690 msgr2=0x7f21bc16e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 --2- 172.21.15.84:0/2896953018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc156690 0x7f21bc16e1f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00b600 tx=0x7f21ac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.061 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:22.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T02:55:22.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c1e55700 1 -- 172.21.15.84:0/2896953018 reap_dead start 2023-10-06T02:55:22.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 shutdown_connections 2023-10-06T02:55:22.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 >> 172.21.15.84:0/2896953018 conn(0x7f21bc06de80 msgr2=0x7f21bc1492b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 shutdown_connections 2023-10-06T02:55:22.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.030+0000 7f21c38b8700 1 -- 172.21.15.84:0/2896953018 wait complete. 2023-10-06T02:55:22.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7f5ddc070d50 msgr2=0x7f5ddc073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7f5ddc070d50 0x7f5ddc073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ddc067080 msgr2=0x7f5ddc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ddc067080 0x7f5ddc069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5df400acf0 tx=0x7f5df4009350 comp rx=0 tx=0).stop 2023-10-06T02:55:22.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc162370 msgr2=0x7f5dfc0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 --2- 172.21.15.84:0/1338233676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5dfc162370 0x7f5dfc0cefb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c810 tx=0x7f5df0007e60 comp rx=0 tx=0).stop 2023-10-06T02:55:22.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5dfad9d700 1 -- 172.21.15.84:0/1338233676 reap_dead start 2023-10-06T02:55:22.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 shutdown_connections 2023-10-06T02:55:22.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 >> 172.21.15.84:0/1338233676 conn(0x7f5dfc0ccf70 msgr2=0x7f5dfc15cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 shutdown_connections 2023-10-06T02:55:22.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.032+0000 7f5e00ed0700 1 -- 172.21.15.84:0/1338233676 wait complete. 2023-10-06T02:55:22.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.037+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ff4002d30 con 0x7f3ffc070ca0 2023-10-06T02:55:22.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.038+0000 7f400cff9700 1 -- 172.21.15.84:0/1585327681 <== osd.6 v2:172.21.15.131:6824/90967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3ff4002d30 con 0x7f3ffc070ca0 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.038+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f3ffc070ca0 msgr2=0x7f3ffc0730d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.038+0000 7f401ef87700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f3ffc070ca0 0x7f3ffc0730d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.038+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ffc067050 msgr2=0x7f3ffc069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.038+0000 7f401ef87700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ffc067050 0x7f3ffc069500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f401806d010 tx=0x7f4008017000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.038+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180cc750 msgr2=0x7f40180c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.038+0000 7f401ef87700 1 --2- 172.21.15.84:0/1585327681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40180cc750 0x7f40180c4ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f401400c5c0 tx=0x7f4014007ec0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.038+0000 7f401d524700 1 -- 172.21.15.84:0/1585327681 reap_dead start 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.039+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 shutdown_connections 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.039+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 >> 172.21.15.84:0/1585327681 conn(0x7f40180cdef0 msgr2=0x7f40180c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.040+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 shutdown_connections 2023-10-06T02:55:22.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.040+0000 7f401ef87700 1 -- 172.21.15.84:0/1585327681 wait complete. 2023-10-06T02:55:22.067 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:22.068 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T02:55:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.046+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 --> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f629c005c20 con 0x7f629c0015f0 2023-10-06T02:55:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62a37fe700 1 -- 172.21.15.84:0/208128641 <== osd.7 v2:172.21.15.131:6816/90924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f629c005c20 con 0x7f629c0015f0 2023-10-06T02:55:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7f629c0015f0 msgr2=0x7f629c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7f629c0015f0 0x7f629c003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62a4068c10 msgr2=0x7f62a406b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62a4068c10 0x7f62a406b0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0631e0 tx=0x7f62ac016000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62bc171360 msgr2=0x7f62bc171730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 --2- 172.21.15.84:0/208128641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62bc171360 0x7f62bc171730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b810 tx=0x7f62b00091d0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62bbfff700 1 -- 172.21.15.84:0/208128641 reap_dead start 2023-10-06T02:55:22.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 shutdown_connections 2023-10-06T02:55:22.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 >> 172.21.15.84:0/208128641 conn(0x7f62bc0680c0 msgr2=0x7f62bc0ad780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 shutdown_connections 2023-10-06T02:55:22.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.047+0000 7f62c1d2d700 1 -- 172.21.15.84:0/208128641 wait complete. 2023-10-06T02:55:22.071 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:22.071 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T02:55:22.072 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:22.072 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T02:55:22.073 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:22.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T02:55:22.074 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:22.074 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T02:55:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.286+0000 7f30789a5700 1 Processor -- start 2023-10-06T02:55:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.286+0000 7f30789a5700 1 -- start start 2023-10-06T02:55:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.287+0000 7f30789a5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3074155860 0x7f30740ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.287+0000 7f30789a5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3074069c70 0x7f30740abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.287+0000 7f30789a5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30740c7e10 con 0x7f30740c82a0 2023-10-06T02:55:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.287+0000 7f30789a5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30740aea00 con 0x7f3074155860 2023-10-06T02:55:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.287+0000 7f30789a5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30740c7200 con 0x7f3074069c70 2023-10-06T02:55:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.288+0000 7f307259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3074155860 0x7f30740ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.288+0000 7f307259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3074155860 0x7f30740ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51256/0 (socket says 172.21.15.84:51256) 2023-10-06T02:55:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.288+0000 7f307259c700 1 -- 172.21.15.84:0/2146414412 learned_addr learned my addr 172.21.15.84:0/2146414412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.288+0000 7f307259c700 1 -- 172.21.15.84:0/2146414412 >> v2:172.21.15.131:3300/0 conn(0x7f3074069c70 msgr2=0x7f30740abcd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:55:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.288+0000 7f307259c700 1 --2- 172.21.15.84:0/2146414412 >> v2:172.21.15.131:3300/0 conn(0x7f3074069c70 0x7f30740abcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.288+0000 7f307259c700 1 -- 172.21.15.84:0/2146414412 >> v1:172.21.15.131:6789/0 conn(0x7f30740c82a0 legacy=0x7f3074069560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:55:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.288+0000 7f307259c700 1 -- 172.21.15.84:0/2146414412 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30740c74e0 con 0x7f3074155860 2023-10-06T02:55:22.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.288+0000 7f307259c700 1 --2- 172.21.15.84:0/2146414412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074155860 0x7f30740ae4c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f30740c6670 tx=0x7f306c007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b308536a831a611e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.296+0000 7f307159a700 1 -- 172.21.15.84:0/2146414412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c010070 con 0x7f3074155860 2023-10-06T02:55:22.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.296+0000 7f307159a700 1 -- 172.21.15.84:0/2146414412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c00dc40 con 0x7f3074155860 2023-10-06T02:55:22.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.296+0000 7f307159a700 1 -- 172.21.15.84:0/2146414412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c007b40 con 0x7f3074155860 2023-10-06T02:55:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.297+0000 7f30789a5700 1 -- 172.21.15.84:0/2146414412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074155860 msgr2=0x7f30740ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.297+0000 7f30789a5700 1 --2- 172.21.15.84:0/2146414412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074155860 0x7f30740ae4c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f30740c6670 tx=0x7f306c007690 comp rx=0 tx=0).stop 2023-10-06T02:55:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.297+0000 7f30789a5700 1 -- 172.21.15.84:0/2146414412 shutdown_connections 2023-10-06T02:55:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.297+0000 7f30789a5700 1 --2- 172.21.15.84:0/2146414412 >> v2:172.21.15.131:3300/0 conn(0x7f3074069c70 0x7f30740abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.297+0000 7f30789a5700 1 --2- 172.21.15.84:0/2146414412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074155860 0x7f30740ae4c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.297+0000 7f30789a5700 1 -- 172.21.15.84:0/2146414412 >> 172.21.15.84:0/2146414412 conn(0x7f30740680c0 msgr2=0x7f30740cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.302+0000 7ff28aa55700 1 Processor -- start 2023-10-06T02:55:22.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.303+0000 7ff28aa55700 1 -- start start 2023-10-06T02:55:22.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.302+0000 7f30789a5700 1 -- 172.21.15.84:0/2146414412 shutdown_connections 2023-10-06T02:55:22.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.304+0000 7ff28aa55700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff2840b29f0 0x7ff284159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.304+0000 7ff28aa55700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2841596a0 0x7ff2840cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.304+0000 7ff28aa55700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2840b0de0 con 0x7ff2840b2620 2023-10-06T02:55:22.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.304+0000 7ff28aa55700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2840cbfe0 con 0x7ff2840b29f0 2023-10-06T02:55:22.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.304+0000 7ff28aa55700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840cb3d0 con 0x7ff2841596a0 2023-10-06T02:55:22.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.304+0000 7ff283fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff2840b2620 0x7ff2840b06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36686/0 (socket says 172.21.15.84:36686) 2023-10-06T02:55:22.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.304+0000 7ff283fff700 1 -- 172.21.15.84:0/3007609171 learned_addr learned my addr 172.21.15.84:0/3007609171 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.304+0000 7ff288ff2700 1 --2- 172.21.15.84:0/3007609171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2841596a0 0x7ff2840cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.303+0000 7f30789a5700 1 -- 172.21.15.84:0/2146414412 wait complete. 2023-10-06T02:55:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.303+0000 7fe5b4409700 1 Processor -- start 2023-10-06T02:55:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7ff288ff2700 1 -- 172.21.15.84:0/3007609171 >> v2:172.21.15.131:3300/0 conn(0x7ff2840b29f0 msgr2=0x7ff284159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7ff288ff2700 1 --2- 172.21.15.84:0/3007609171 >> v2:172.21.15.131:3300/0 conn(0x7ff2840b29f0 0x7ff284159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7ff288ff2700 1 -- 172.21.15.84:0/3007609171 >> v1:172.21.15.84:6789/0 conn(0x7ff2840b2620 legacy=0x7ff2840b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7ff288ff2700 1 -- 172.21.15.84:0/3007609171 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2840cb6b0 con 0x7ff2841596a0 2023-10-06T02:55:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7ff288ff2700 1 --2- 172.21.15.84:0/3007609171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2841596a0 0x7ff2840cc470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009e60 tx=0x7ff27c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99eb7ebffff39bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7f30789a5700 1 Processor -- start 2023-10-06T02:55:22.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7f30789a5700 1 -- start start 2023-10-06T02:55:22.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.304+0000 7fe5b4409700 1 -- start start 2023-10-06T02:55:22.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7fe5b4409700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe5ac068850 0x7fe5ac0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7fe5b4409700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ac0af150 con 0x7fe5ac0ac480 2023-10-06T02:55:22.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7fe5b4409700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ac0ac910 con 0x7fe5ac068c20 2023-10-06T02:55:22.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7fe5b4409700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ac156460 con 0x7fe5ac068850 2023-10-06T02:55:22.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7fe5b19a4700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe5ac0ac480 0x7fe5ac155640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36694/0 (socket says 172.21.15.84:36694) 2023-10-06T02:55:22.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7fe5b19a4700 1 -- 172.21.15.84:0/3797871930 learned_addr learned my addr 172.21.15.84:0/3797871930 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:22.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.305+0000 7fe5b21a5700 1 --2- 172.21.15.84:0/3797871930 >> v2:172.21.15.131:3300/0 conn(0x7fe5ac068850 0x7fe5ac0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7fcf60693700 1 Processor -- start 2023-10-06T02:55:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7fcf60693700 1 -- start start 2023-10-06T02:55:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7fe5b21a5700 1 -- 172.21.15.84:0/3797871930 >> v1:172.21.15.131:6789/0 conn(0x7fe5ac068c20 legacy=0x7fe5ac155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7fe5b21a5700 1 -- 172.21.15.84:0/3797871930 >> v1:172.21.15.84:6789/0 conn(0x7fe5ac0ac480 legacy=0x7fe5ac155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7fe5b21a5700 1 -- 172.21.15.84:0/3797871930 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac0acbf0 con 0x7fe5ac068850 2023-10-06T02:55:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7fe5b21a5700 1 --2- 172.21.15.84:0/3797871930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5ac068850 0x7fe5ac0afb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0098d0 tx=0x7fe59c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2ce74d3557905f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7ff282ffd700 1 -- 172.21.15.84:0/3007609171 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00e070 con 0x7ff2841596a0 2023-10-06T02:55:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7ff282ffd700 1 -- 172.21.15.84:0/3007609171 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c00bc30 con 0x7ff2841596a0 2023-10-06T02:55:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7ff282ffd700 1 -- 172.21.15.84:0/3007609171 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c012430 con 0x7ff2841596a0 2023-10-06T02:55:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7fe5b11a3700 1 -- 172.21.15.84:0/3797871930 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c009e70 con 0x7fe5ac068850 2023-10-06T02:55:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7fe5b11a3700 1 -- 172.21.15.84:0/3797871930 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c005c10 con 0x7fe5ac068850 2023-10-06T02:55:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7fe5b11a3700 1 -- 172.21.15.84:0/3797871930 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00b650 con 0x7fe5ac068850 2023-10-06T02:55:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7f30789a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074069c70 0x7f3074166380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7f30789a5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30740c82a0 0x7f30740b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7f30789a5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3074155860 0x7f30740b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7f30789a5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30740b0a80 con 0x7f3074069c70 2023-10-06T02:55:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7f30789a5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30740af9e0 con 0x7f3074155860 2023-10-06T02:55:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.306+0000 7f30789a5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30740afcc0 con 0x7f30740c82a0 2023-10-06T02:55:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7f3071d9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30740c82a0 0x7f30740b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7f3071d9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30740c82a0 0x7f30740b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:40046/0 (socket says 172.21.15.84:40046) 2023-10-06T02:55:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7f3071d9b700 1 -- 172.21.15.84:0/1534465624 learned_addr learned my addr 172.21.15.84:0/1534465624 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7ff28aa55700 1 -- 172.21.15.84:0/3007609171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2841596a0 msgr2=0x7ff2840cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7ff28aa55700 1 --2- 172.21.15.84:0/3007609171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2841596a0 0x7ff2840cc470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009e60 tx=0x7ff27c009780 comp rx=0 tx=0).stop 2023-10-06T02:55:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7ff28aa55700 1 -- 172.21.15.84:0/3007609171 shutdown_connections 2023-10-06T02:55:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7ff28aa55700 1 --2- 172.21.15.84:0/3007609171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2841596a0 0x7ff2840cc470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7ff28aa55700 1 --2- 172.21.15.84:0/3007609171 >> v2:172.21.15.131:3300/0 conn(0x7ff2840b29f0 0x7ff284159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7ff28aa55700 1 -- 172.21.15.84:0/3007609171 >> 172.21.15.84:0/3007609171 conn(0x7ff28406ed20 msgr2=0x7ff28406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7f3071d9b700 1 -- 172.21.15.84:0/1534465624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3074155860 msgr2=0x7f30740b19a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:55:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7f3071d9b700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3074155860 0x7f30740b19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7f3071d9b700 1 -- 172.21.15.84:0/1534465624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074069c70 msgr2=0x7f3074166380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:55:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7f3071d9b700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074069c70 0x7f3074166380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7f3071d9b700 1 -- 172.21.15.84:0/1534465624 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c00be70 con 0x7f30740c82a0 2023-10-06T02:55:22.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7f3071d9b700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30740c82a0 0x7f30740b1460 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f306800b810 tx=0x7f30680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7fe5b4409700 1 -- 172.21.15.84:0/3797871930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5ac068850 msgr2=0x7fe5ac0afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7fe5b4409700 1 --2- 172.21.15.84:0/3797871930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5ac068850 0x7fe5ac0afb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0098d0 tx=0x7fe59c009120 comp rx=0 tx=0).stop 2023-10-06T02:55:22.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf60693700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf580cb630 0x7fcf580691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf60693700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf58069720 0x7fcf58159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf60693700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf58068d50 con 0x7fcf5815a050 2023-10-06T02:55:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf60693700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf58154060 con 0x7fcf58069720 2023-10-06T02:55:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf60693700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5815a490 con 0x7fcf580cb630 2023-10-06T02:55:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf5e42f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf580cb630 0x7fcf580691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf5dc2e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf58069720 0x7fcf58159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf5e42f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf580cb630 0x7fcf580691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:40058/0 (socket says 172.21.15.84:40058) 2023-10-06T02:55:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf5dc2e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf58069720 0x7fcf58159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:46846/0 (socket says 172.21.15.84:46846) 2023-10-06T02:55:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf5e42f700 1 -- 172.21.15.84:0/3429472215 learned_addr learned my addr 172.21.15.84:0/3429472215 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf5e42f700 1 -- 172.21.15.84:0/3429472215 >> v2:172.21.15.131:3300/0 conn(0x7fcf58069720 msgr2=0x7fcf58159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:22.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7f9700ca9700 1 Processor -- start 2023-10-06T02:55:22.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf5e42f700 1 --2- 172.21.15.84:0/3429472215 >> v2:172.21.15.131:3300/0 conn(0x7fcf58069720 0x7fcf58159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf5e42f700 1 -- 172.21.15.84:0/3429472215 >> v1:172.21.15.84:6789/0 conn(0x7fcf5815a050 legacy=0x7fcf580ca6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:55:22.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.307+0000 7fcf5e42f700 1 -- 172.21.15.84:0/3429472215 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5815a6b0 con 0x7fcf580cb630 2023-10-06T02:55:22.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7f30627fc700 1 -- 172.21.15.84:0/1534465624 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800f510 con 0x7f30740c82a0 2023-10-06T02:55:22.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7ff28aa55700 1 -- 172.21.15.84:0/3007609171 shutdown_connections 2023-10-06T02:55:22.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7fcf5e42f700 1 --2- 172.21.15.84:0/3429472215 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf580cb630 0x7fcf580691e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf480099b0 tx=0x7fcf48009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7326bd1a1bf8b5e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30740affa0 con 0x7f30740c82a0 2023-10-06T02:55:22.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7ff28aa55700 1 -- 172.21.15.84:0/3007609171 wait complete. 2023-10-06T02:55:22.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7f30627fc700 1 -- 172.21.15.84:0/1534465624 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800f670 con 0x7f30740c82a0 2023-10-06T02:55:22.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30740b0560 con 0x7f30740c82a0 2023-10-06T02:55:22.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7f30627fc700 1 -- 172.21.15.84:0/1534465624 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800fa10 con 0x7f30740c82a0 2023-10-06T02:55:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7fcf5d42d700 1 -- 172.21.15.84:0/3429472215 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800b820 con 0x7fcf580cb630 2023-10-06T02:55:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7fcf5d42d700 1 -- 172.21.15.84:0/3429472215 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4800b980 con 0x7fcf580cb630 2023-10-06T02:55:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7fcf5d42d700 1 -- 172.21.15.84:0/3429472215 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800bd00 con 0x7fcf580cb630 2023-10-06T02:55:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7fcf60693700 1 -- 172.21.15.84:0/3429472215 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf580cb630 msgr2=0x7fcf580691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7fcf60693700 1 --2- 172.21.15.84:0/3429472215 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf580cb630 0x7fcf580691e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf480099b0 tx=0x7fcf48009250 comp rx=0 tx=0).stop 2023-10-06T02:55:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7fbafe232700 1 Processor -- start 2023-10-06T02:55:22.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7fbafe232700 1 -- start start 2023-10-06T02:55:22.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7ff28aa55700 1 Processor -- start 2023-10-06T02:55:22.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7fe5b4409700 1 -- 172.21.15.84:0/3797871930 shutdown_connections 2023-10-06T02:55:22.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7fe5b4409700 1 --2- 172.21.15.84:0/3797871930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5ac068850 0x7fe5ac0afb80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7fe5b4409700 1 -- 172.21.15.84:0/3797871930 >> 172.21.15.84:0/3797871930 conn(0x7fe5ac06de80 msgr2=0x7fe5ac06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7f3708d22700 1 Processor -- start 2023-10-06T02:55:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7f3708d22700 1 -- start start 2023-10-06T02:55:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7ff28aa55700 1 -- start start 2023-10-06T02:55:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7f3708d22700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f370406b580 0x7f37041567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7f3708d22700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3704069c70 0x7f37040addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7f3708d22700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370406e360 con 0x7f37041531e0 2023-10-06T02:55:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7f3708d22700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3704156ce0 con 0x7f370406b580 2023-10-06T02:55:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7f3708d22700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370406e7f0 con 0x7f3704069c70 2023-10-06T02:55:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.308+0000 7f9700ca9700 1 -- start start 2023-10-06T02:55:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7f9700ca9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96fc0b49e0 0x7f96fc0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7f9700ca9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f96fc0b07a0 0x7f96fc0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7f9700ca9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc0b0ca0 con 0x7f96fc1595a0 2023-10-06T02:55:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7f9700ca9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc0b0f80 con 0x7f96fc0b49e0 2023-10-06T02:55:22.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.309+0000 7f9700ca9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc0b1260 con 0x7f96fc0b07a0 2023-10-06T02:55:22.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fe5b4409700 1 -- 172.21.15.84:0/3797871930 shutdown_connections 2023-10-06T02:55:22.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fe5b4409700 1 -- 172.21.15.84:0/3797871930 wait complete. 2023-10-06T02:55:22.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fcf60693700 1 -- 172.21.15.84:0/3429472215 shutdown_connections 2023-10-06T02:55:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fcf60693700 1 --2- 172.21.15.84:0/3429472215 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf580cb630 0x7fcf580691e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fcf60693700 1 --2- 172.21.15.84:0/3429472215 >> v2:172.21.15.131:3300/0 conn(0x7fcf58069720 0x7fcf58159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fcf60693700 1 -- 172.21.15.84:0/3429472215 >> 172.21.15.84:0/3429472215 conn(0x7fcf58070810 msgr2=0x7fcf58070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7ff28aa55700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2840b2620 0x7ff284158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff28aa55700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2840b29f0 0x7ff28415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff28aa55700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2841596a0 0x7ff2840c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff28aa55700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840c52e0 con 0x7ff2841596a0 2023-10-06T02:55:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff28aa55700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284169f00 con 0x7ff2840b29f0 2023-10-06T02:55:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff28aa55700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff284158950 con 0x7ff2840b2620 2023-10-06T02:55:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7fcf60693700 1 -- 172.21.15.84:0/3429472215 shutdown_connections 2023-10-06T02:55:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff2837fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2840b29f0 0x7ff28415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff2837fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2840b29f0 0x7ff28415c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:46862/0 (socket says 172.21.15.84:46862) 2023-10-06T02:55:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fbafe232700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbaf8070810 0x7fbaf80687c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fbafe232700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf80af150 con 0x7fbaf8070c90 2023-10-06T02:55:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fbafe232700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf80ac910 con 0x7fbaf80ac480 2023-10-06T02:55:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fbafe232700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf815cbb0 con 0x7fbaf8070810 2023-10-06T02:55:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fbaf6ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbaf8070810 0x7fbaf80687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff2837fe700 1 -- 172.21.15.84:0/2483693383 learned_addr learned my addr 172.21.15.84:0/2483693383 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fbaf6ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbaf8070810 0x7fbaf80687c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:46850/0 (socket says 172.21.15.84:46850) 2023-10-06T02:55:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7fbaf6ffd700 1 -- 172.21.15.84:0/501992215 learned_addr learned my addr 172.21.15.84:0/501992215 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7fbaf6ffd700 1 -- 172.21.15.84:0/501992215 >> v1:172.21.15.131:6789/0 conn(0x7fbaf80ac480 legacy=0x7fbaf80afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7fbaf6ffd700 1 -- 172.21.15.84:0/501992215 >> v1:172.21.15.84:6789/0 conn(0x7fbaf8070c90 legacy=0x7fbaf8155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7fbaf6ffd700 1 -- 172.21.15.84:0/501992215 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80acbf0 con 0x7fbaf8070810 2023-10-06T02:55:22.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7fcf60693700 1 -- 172.21.15.84:0/3429472215 wait complete. 2023-10-06T02:55:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f96fa59c700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f96fc1595a0 0x7f96fc0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:47342/0 (socket says 172.21.15.84:47342) 2023-10-06T02:55:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f96fa59c700 1 -- 172.21.15.84:0/2191560968 learned_addr learned my addr 172.21.15.84:0/2191560968 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f3702d9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3704069c70 0x7f37040addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f3702d9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3704069c70 0x7f37040addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:40062/0 (socket says 172.21.15.84:40062) 2023-10-06T02:55:22.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f3702d9d700 1 -- 172.21.15.84:0/1048366414 learned_addr learned my addr 172.21.15.84:0/1048366414 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff2837fe700 1 -- 172.21.15.84:0/2483693383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2840b2620 msgr2=0x7ff284158410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:55:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff2837fe700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2840b2620 0x7ff284158410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff2837fe700 1 -- 172.21.15.84:0/2483693383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2841596a0 msgr2=0x7ff2840c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff2837fe700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2841596a0 0x7ff2840c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7ff2837fe700 1 -- 172.21.15.84:0/2483693383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c009a20 con 0x7ff2840b29f0 2023-10-06T02:55:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f3702d9d700 1 -- 172.21.15.84:0/1048366414 >> v2:172.21.15.84:3300/0 conn(0x7f370406b580 msgr2=0x7f37041567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:22.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f3702d9d700 1 --2- 172.21.15.84:0/1048366414 >> v2:172.21.15.84:3300/0 conn(0x7f370406b580 0x7f37041567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f3702d9d700 1 -- 172.21.15.84:0/1048366414 >> v1:172.21.15.84:6789/0 conn(0x7f37041531e0 legacy=0x7f3704069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f3702d9d700 1 -- 172.21.15.84:0/1048366414 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370406d750 con 0x7f3704069c70 2023-10-06T02:55:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7ff2837fe700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2840b29f0 0x7ff28415c210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff27400b810 tx=0x7ff274009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7f96fad9d700 1 --2- 172.21.15.84:0/2191560968 >> v2:172.21.15.131:3300/0 conn(0x7f96fc0b07a0 0x7f96fc0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7f3702d9d700 1 --2- 172.21.15.84:0/1048366414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3704069c70 0x7f37040addd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009f20 tx=0x7f36fc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e16c21d9fe981061 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7ff26bfff700 1 -- 172.21.15.84:0/2483693383 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27400f590 con 0x7ff2840b29f0 2023-10-06T02:55:22.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7ff26bfff700 1 -- 172.21.15.84:0/2483693383 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27400f6f0 con 0x7ff2840b29f0 2023-10-06T02:55:22.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28416a480 con 0x7ff2840b29f0 2023-10-06T02:55:22.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2840c5000 con 0x7ff2840b29f0 2023-10-06T02:55:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.310+0000 7f30627fc700 1 -- 172.21.15.84:0/1534465624 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3068011400 con 0x7f30740c82a0 2023-10-06T02:55:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f30627fc700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3054066f30 0x7f30540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f307259c700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3054066f30 0x7f30540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f30627fc700 1 -- 172.21.15.84:0/1534465624 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3068083dd0 con 0x7f30740c82a0 2023-10-06T02:55:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.311+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580052b0 con 0x7f30740c82a0 2023-10-06T02:55:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7f307259c700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3054066f30 0x7f30540693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30740c6670 tx=0x7f306c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7fbaf6ffd700 1 --2- 172.21.15.84:0/501992215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbaf8070810 0x7fbaf80687c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbaec013260 tx=0x7fbaec011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85a612dd9dab2129 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7f96fad9d700 1 -- 172.21.15.84:0/2191560968 >> v2:172.21.15.84:3300/0 conn(0x7f96fc0b49e0 msgr2=0x7f96fc0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7f96fad9d700 1 --2- 172.21.15.84:0/2191560968 >> v2:172.21.15.84:3300/0 conn(0x7f96fc0b49e0 0x7f96fc0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7f96fad9d700 1 -- 172.21.15.84:0/2191560968 >> v1:172.21.15.131:6789/0 conn(0x7f96fc1595a0 legacy=0x7f96fc0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7f96fad9d700 1 -- 172.21.15.84:0/2191560968 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc0b1540 con 0x7f96fc0b07a0 2023-10-06T02:55:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7fe5b4409700 1 Processor -- start 2023-10-06T02:55:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7fe5b4409700 1 -- start start 2023-10-06T02:55:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7f96fad9d700 1 --2- 172.21.15.84:0/2191560968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96fc0b07a0 0x7f96fc0b1c00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009e60 tx=0x7f96f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365fa4f529100a8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7fbaf67fc700 1 -- 172.21.15.84:0/501992215 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec016070 con 0x7fbaf8070810 2023-10-06T02:55:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fbaf67fc700 1 -- 172.21.15.84:0/501992215 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec0110d0 con 0x7fbaf8070810 2023-10-06T02:55:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fbaf67fc700 1 -- 172.21.15.84:0/501992215 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec011470 con 0x7fbaf8070810 2023-10-06T02:55:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7ff26bfff700 1 -- 172.21.15.84:0/2483693383 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27400fab0 con 0x7ff2840b29f0 2023-10-06T02:55:22.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.312+0000 7fcf60693700 1 Processor -- start 2023-10-06T02:55:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fe5b4409700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5ac068850 0x7fe5ac16b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fe5b4409700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5ac068c20 0x7fe5ac0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fe5b4409700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5ac0ac480 0x7fe5ac0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fe5b4409700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac16e540 con 0x7fe5ac068850 2023-10-06T02:55:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fe5b4409700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac16e820 con 0x7fe5ac068c20 2023-10-06T02:55:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fe5b4409700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac16eb00 con 0x7fe5ac0ac480 2023-10-06T02:55:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b21a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5ac068850 0x7fe5ac16b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b21a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5ac068850 0x7fe5ac16b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51290/0 (socket says 172.21.15.84:51290) 2023-10-06T02:55:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b21a5700 1 -- 172.21.15.84:0/120917757 learned_addr learned my addr 172.21.15.84:0/120917757 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b19a4700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5ac068c20 0x7fe5ac0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b29a6700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5ac0ac480 0x7fe5ac0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b21a5700 1 -- 172.21.15.84:0/120917757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5ac0ac480 msgr2=0x7fe5ac0cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b21a5700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5ac0ac480 0x7fe5ac0cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b21a5700 1 -- 172.21.15.84:0/120917757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5ac068c20 msgr2=0x7fe5ac0caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b21a5700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5ac068c20 0x7fe5ac0caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b21a5700 1 -- 172.21.15.84:0/120917757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0093c0 con 0x7fe5ac068850 2023-10-06T02:55:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fbafe232700 1 -- 172.21.15.84:0/501992215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbaf8070810 msgr2=0x7fbaf80687c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fbafe232700 1 --2- 172.21.15.84:0/501992215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbaf8070810 0x7fbaf80687c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbaec013260 tx=0x7fbaec011af0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fbafe232700 1 -- 172.21.15.84:0/501992215 shutdown_connections 2023-10-06T02:55:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fbafe232700 1 --2- 172.21.15.84:0/501992215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbaf8070810 0x7fbaf80687c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fbafe232700 1 -- 172.21.15.84:0/501992215 >> 172.21.15.84:0/501992215 conn(0x7fbaf806de80 msgr2=0x7fbaf806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fbafe232700 1 -- 172.21.15.84:0/501992215 shutdown_connections 2023-10-06T02:55:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fbafe232700 1 -- 172.21.15.84:0/501992215 wait complete. 2023-10-06T02:55:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b21a5700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5ac068850 0x7fe5ac16b6e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009160 tx=0x7fe59c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5a27fc700 1 -- 172.21.15.84:0/120917757 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c006390 con 0x7fe5ac068850 2023-10-06T02:55:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5a27fc700 1 -- 172.21.15.84:0/120917757 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c0064f0 con 0x7fe5ac068850 2023-10-06T02:55:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac16ede0 con 0x7fe5ac068850 2023-10-06T02:55:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac16bc20 con 0x7fe5ac068850 2023-10-06T02:55:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.313+0000 7fcf60693700 1 -- start start 2023-10-06T02:55:22.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fcf60693700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf58069720 0x7fcf58156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fcf60693700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf580cb630 0x7fcf580c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7fcf60693700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5815a050 0x7fcf58152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf60693700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580c46d0 con 0x7fcf580cb630 2023-10-06T02:55:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf60693700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580c4af0 con 0x7fcf58069720 2023-10-06T02:55:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf60693700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580c3a50 con 0x7fcf5815a050 2023-10-06T02:55:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5e42f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf58069720 0x7fcf58156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5dc2e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf580cb630 0x7fcf580c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5e42f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf58069720 0x7fcf58156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:46884/0 (socket says 172.21.15.84:46884) 2023-10-06T02:55:22.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5e42f700 1 -- 172.21.15.84:0/1947177977 learned_addr learned my addr 172.21.15.84:0/1947177977 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7f96f959a700 1 -- 172.21.15.84:0/2191560968 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f400e070 con 0x7f96fc0b07a0 2023-10-06T02:55:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5ec30700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5815a050 0x7fcf58152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5dc2e700 1 -- 172.21.15.84:0/1947177977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5815a050 msgr2=0x7fcf58152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5dc2e700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5815a050 0x7fcf58152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5dc2e700 1 -- 172.21.15.84:0/1947177977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf58069720 msgr2=0x7fcf58156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5dc2e700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf58069720 0x7fcf58156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5dc2e700 1 -- 172.21.15.84:0/1947177977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf480094f0 con 0x7fcf580cb630 2023-10-06T02:55:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5ec30700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5815a050 0x7fcf58152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7fcf5dc2e700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf580cb630 0x7fcf580c30e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf50007f60 tx=0x7fcf50009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2640052b0 con 0x7ff2840b29f0 2023-10-06T02:55:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7ff26bfff700 1 -- 172.21.15.84:0/2483693383 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff27401a460 con 0x7ff2840b29f0 2023-10-06T02:55:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.314+0000 7ff26bfff700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff270066f30 0x7ff2700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7ff26bfff700 1 -- 172.21.15.84:0/2483693383 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff2740846e0 con 0x7ff2840b29f0 2023-10-06T02:55:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7ff283fff700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff270066f30 0x7ff2700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7fbafe232700 1 Processor -- start 2023-10-06T02:55:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7f96f959a700 1 -- 172.21.15.84:0/2191560968 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f400bbf0 con 0x7f96fc0b07a0 2023-10-06T02:55:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.315+0000 7f96f959a700 1 -- 172.21.15.84:0/2191560968 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4012430 con 0x7f96fc0b07a0 2023-10-06T02:55:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7f9700ca9700 1 -- 172.21.15.84:0/2191560968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96fc0b07a0 msgr2=0x7f96fc0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7f9700ca9700 1 --2- 172.21.15.84:0/2191560968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96fc0b07a0 0x7f96fc0b1c00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009e60 tx=0x7f96f4009780 comp rx=0 tx=0).stop 2023-10-06T02:55:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7fbafe232700 1 -- start start 2023-10-06T02:55:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7f9700ca9700 1 -- 172.21.15.84:0/2191560968 shutdown_connections 2023-10-06T02:55:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7f9700ca9700 1 --2- 172.21.15.84:0/2191560968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96fc0b07a0 0x7f96fc0b1c00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7f9700ca9700 1 --2- 172.21.15.84:0/2191560968 >> v2:172.21.15.84:3300/0 conn(0x7f96fc0b49e0 0x7f96fc0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7f9700ca9700 1 -- 172.21.15.84:0/2191560968 >> 172.21.15.84:0/2191560968 conn(0x7f96fc099830 msgr2=0x7f96fc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac16f300 con 0x7fe5ac068850 2023-10-06T02:55:22.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7ff283fff700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff270066f30 0x7ff2700693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2780010e0 tx=0x7ff278007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7f9700ca9700 1 -- 172.21.15.84:0/2191560968 shutdown_connections 2023-10-06T02:55:22.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.316+0000 7f9700ca9700 1 -- 172.21.15.84:0/2191560968 wait complete. 2023-10-06T02:55:22.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fe5a27fc700 1 -- 172.21.15.84:0/120917757 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c006890 con 0x7fe5ac068850 2023-10-06T02:55:22.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fcf4e7fc700 1 -- 172.21.15.84:0/1947177977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000ec40 con 0x7fcf580cb630 2023-10-06T02:55:22.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fcf4e7fc700 1 -- 172.21.15.84:0/1947177977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000eda0 con 0x7fcf580cb630 2023-10-06T02:55:22.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf580c3d30 con 0x7fcf580cb630 2023-10-06T02:55:22.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf580c42f0 con 0x7fcf580cb630 2023-10-06T02:55:22.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fcf4e7fc700 1 -- 172.21.15.84:0/1947177977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50014670 con 0x7fcf580cb630 2023-10-06T02:55:22.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7f30627fc700 1 -- 172.21.15.84:0/1534465624 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f306804a5a0 con 0x7f30740c82a0 2023-10-06T02:55:22.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fbafe232700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbaf8070810 0x7fbaf814ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fbafe232700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaf8070c90 0x7fbaf806b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fbafe232700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbaf80ac480 0x7fbaf806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fbafe232700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80c9f60 con 0x7fbaf8070c90 2023-10-06T02:55:22.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fbafe232700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80c9350 con 0x7fbaf8070810 2023-10-06T02:55:22.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fbafe232700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80c9630 con 0x7fbaf80ac480 2023-10-06T02:55:22.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.317+0000 7fbaf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaf8070c90 0x7fbaf806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7fbaf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaf8070c90 0x7fbaf806b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51300/0 (socket says 172.21.15.84:51300) 2023-10-06T02:55:22.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7fbaf6ffd700 1 -- 172.21.15.84:0/43794847 learned_addr learned my addr 172.21.15.84:0/43794847 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7f9700ca9700 1 Processor -- start 2023-10-06T02:55:22.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7fbaf6ffd700 1 -- 172.21.15.84:0/43794847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbaf80ac480 msgr2=0x7fbaf806b5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7fbaf6ffd700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbaf80ac480 0x7fbaf806b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7fbaf6ffd700 1 -- 172.21.15.84:0/43794847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbaf8070810 msgr2=0x7fbaf814ead0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7fbaf6ffd700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbaf8070810 0x7fbaf814ead0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7fbaf6ffd700 1 -- 172.21.15.84:0/43794847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec011d90 con 0x7fbaf8070c90 2023-10-06T02:55:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7fbaf6ffd700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaf8070c90 0x7fbaf806b070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbaec011840 tx=0x7fbaec01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf400052b0 con 0x7fcf580cb630 2023-10-06T02:55:22.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.320+0000 7ff26bfff700 1 -- 172.21.15.84:0/2483693383 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff274051580 con 0x7ff2840b29f0 2023-10-06T02:55:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.318+0000 7f9700ca9700 1 -- start start 2023-10-06T02:55:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f9700ca9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96fc0b07a0 0x7f96fc09a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f9700ca9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96fc0b49e0 0x7f96fc1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f9700ca9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96fc1595a0 0x7f96fc09c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f9700ca9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc09b410 con 0x7f96fc0b49e0 2023-10-06T02:55:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f9700ca9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0af590 con 0x7f96fc0b07a0 2023-10-06T02:55:22.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f9700ca9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc09a790 con 0x7f96fc1595a0 2023-10-06T02:55:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f96f9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96fc0b49e0 0x7f96fc1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f96f9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96fc0b49e0 0x7f96fc1588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51308/0 (socket says 172.21.15.84:51308) 2023-10-06T02:55:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f96f9d9b700 1 -- 172.21.15.84:0/2150960583 learned_addr learned my addr 172.21.15.84:0/2150960583 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f96f9d9b700 1 -- 172.21.15.84:0/2150960583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96fc1595a0 msgr2=0x7f96fc09c050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f96f9d9b700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96fc1595a0 0x7f96fc09c050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f96f9d9b700 1 -- 172.21.15.84:0/2150960583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96fc0b07a0 msgr2=0x7f96fc09a090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f96f9d9b700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96fc0b07a0 0x7f96fc09a090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f96f9d9b700 1 -- 172.21.15.84:0/2150960583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4009a20 con 0x7f96fc0b49e0 2023-10-06T02:55:22.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7f96f9d9b700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96fc0b49e0 0x7f96fc1588f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96f000b7e0 tx=0x7f96f0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7fcf4e7fc700 1 -- 172.21.15.84:0/1947177977 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf50014aa0 con 0x7fcf580cb630 2023-10-06T02:55:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.320+0000 7fcf4e7fc700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.320+0000 7fcf4e7fc700 1 -- 172.21.15.84:0/1947177977 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcf50085020 con 0x7fcf580cb630 2023-10-06T02:55:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7fe5a27fc700 1 -- 172.21.15.84:0/120917757 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe59c01a420 con 0x7fe5ac068850 2023-10-06T02:55:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7fe5a27fc700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe590066f30 0x7fe5900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.319+0000 7fe5b19a4700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe590066f30 0x7fe5900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.320+0000 7fe5b19a4700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe590066f30 0x7fe5900693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8007130 tx=0x7fe5a8007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.321+0000 7fe5a27fc700 1 -- 172.21.15.84:0/120917757 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe59c0567b0 con 0x7fe5ac068850 2023-10-06T02:55:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.322+0000 7fcf5e42f700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.322+0000 7fcf5e42f700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf48003080 tx=0x7fcf48016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.323+0000 7f96ea7fc700 1 -- 172.21.15.84:0/2150960583 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f000f570 con 0x7f96fc0b49e0 2023-10-06T02:55:22.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.323+0000 7fbadf7fe700 1 -- 172.21.15.84:0/43794847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec010e60 con 0x7fbaf8070c90 2023-10-06T02:55:22.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.323+0000 7fe5a27fc700 1 -- 172.21.15.84:0/120917757 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe59c08a060 con 0x7fe5ac068850 2023-10-06T02:55:22.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.323+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf80c9910 con 0x7fbaf8070c90 2023-10-06T02:55:22.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.323+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf814f010 con 0x7fbaf8070c90 2023-10-06T02:55:22.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.324+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf8064ad0 con 0x7fbaf8070c90 2023-10-06T02:55:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.325+0000 7f370159a700 1 -- 172.21.15.84:0/1048366414 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00e070 con 0x7f3704069c70 2023-10-06T02:55:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.325+0000 7f370159a700 1 -- 172.21.15.84:0/1048366414 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc00ba40 con 0x7f3704069c70 2023-10-06T02:55:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.325+0000 7f370159a700 1 -- 172.21.15.84:0/1048366414 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0092e0 con 0x7f3704069c70 2023-10-06T02:55:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.326+0000 7f3708d22700 1 -- 172.21.15.84:0/1048366414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3704069c70 msgr2=0x7f37040addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.326+0000 7f3708d22700 1 --2- 172.21.15.84:0/1048366414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3704069c70 0x7f37040addd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009f20 tx=0x7f36fc009840 comp rx=0 tx=0).stop 2023-10-06T02:55:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.326+0000 7f3708d22700 1 -- 172.21.15.84:0/1048366414 shutdown_connections 2023-10-06T02:55:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.326+0000 7f3708d22700 1 --2- 172.21.15.84:0/1048366414 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3704069c70 0x7f37040addd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.326+0000 7f3708d22700 1 --2- 172.21.15.84:0/1048366414 >> v2:172.21.15.84:3300/0 conn(0x7f370406b580 0x7f37041567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.326+0000 7f3708d22700 1 -- 172.21.15.84:0/1048366414 >> 172.21.15.84:0/1048366414 conn(0x7f37040680c0 msgr2=0x7f37040cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.327+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96fc09aa70 con 0x7f96fc0b49e0 2023-10-06T02:55:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.327+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96fc09b030 con 0x7f96fc0b49e0 2023-10-06T02:55:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.328+0000 7fbadf7fe700 1 -- 172.21.15.84:0/43794847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec01a640 con 0x7fbaf8070c90 2023-10-06T02:55:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.328+0000 7fbadf7fe700 1 -- 172.21.15.84:0/43794847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec01a7b0 con 0x7fbaf8070c90 2023-10-06T02:55:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.329+0000 7f96ea7fc700 1 -- 172.21.15.84:0/2150960583 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f000f8e0 con 0x7f96fc0b49e0 2023-10-06T02:55:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.329+0000 7f96ea7fc700 1 -- 172.21.15.84:0/2150960583 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f000fa50 con 0x7f96fc0b49e0 2023-10-06T02:55:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.331+0000 7f96ea7fc700 1 -- 172.21.15.84:0/2150960583 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96f000fbb0 con 0x7f96fc0b49e0 2023-10-06T02:55:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.331+0000 7f96ea7fc700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96dc066f30 0x7f96dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.331+0000 7f96ea7fc700 1 -- 172.21.15.84:0/2150960583 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f96f0084550 con 0x7f96fc0b49e0 2023-10-06T02:55:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.331+0000 7f96fa59c700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96dc066f30 0x7f96dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.332+0000 7fcf4e7fc700 1 -- 172.21.15.84:0/1947177977 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf50051e40 con 0x7fcf580cb630 2023-10-06T02:55:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.332+0000 7f3708d22700 1 -- 172.21.15.84:0/1048366414 shutdown_connections 2023-10-06T02:55:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.332+0000 7f3708d22700 1 -- 172.21.15.84:0/1048366414 wait complete. 2023-10-06T02:55:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.332+0000 7f96fa59c700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96dc066f30 0x7f96dc0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96ec005920 tx=0x7f96ec007ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.333+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e00052b0 con 0x7f96fc0b49e0 2023-10-06T02:55:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.333+0000 7fbadf7fe700 1 -- 172.21.15.84:0/43794847 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaec021070 con 0x7fbaf8070c90 2023-10-06T02:55:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.334+0000 7f3708d22700 1 Processor -- start 2023-10-06T02:55:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.334+0000 7fbadf7fe700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbae4066f30 0x7fbae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.334+0000 7fbadf7fe700 1 -- 172.21.15.84:0/43794847 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbaec08e1b0 con 0x7fbaf8070c90 2023-10-06T02:55:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.334+0000 7f3708d22700 1 -- start start 2023-10-06T02:55:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.335+0000 7f3708d22700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704069c70 0x7f37040c1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.335+0000 7f3708d22700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f370406b580 0x7f3704167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.335+0000 7f3708d22700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37041531e0 0x7f37040c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.335+0000 7f3708d22700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370416e0e0 con 0x7f370406b580 2023-10-06T02:55:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.335+0000 7f3708d22700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370416e3c0 con 0x7f3704069c70 2023-10-06T02:55:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.335+0000 7f3708d22700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370416e6a0 con 0x7f37041531e0 2023-10-06T02:55:22.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.335+0000 7fbadf7fe700 1 -- 172.21.15.84:0/43794847 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbaec05af30 con 0x7fbaf8070c90 2023-10-06T02:55:22.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f370259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704069c70 0x7f37040c1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f370259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704069c70 0x7f37040c1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:51374/0 (socket says 172.21.15.84:51374) 2023-10-06T02:55:22.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f370259c700 1 -- 172.21.15.84:0/1588460029 learned_addr learned my addr 172.21.15.84:0/1588460029 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f3702d9d700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37041531e0 0x7f37040c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f3702d9d700 1 -- 172.21.15.84:0/1588460029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704069c70 msgr2=0x7f37040c1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f3702d9d700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704069c70 0x7f37040c1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f3702d9d700 1 -- 172.21.15.84:0/1588460029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f370406b580 msgr2=0x7f3704167a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f3702d9d700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f370406b580 0x7f3704167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f3702d9d700 1 -- 172.21.15.84:0/1588460029 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009ae0 con 0x7f37041531e0 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.338+0000 7f3702d9d700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37041531e0 0x7f37040c3620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f36fc014000 tx=0x7f36fc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.339+0000 7f36f27fc700 1 -- 172.21.15.84:0/1588460029 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0092e0 con 0x7f37041531e0 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.339+0000 7f36f27fc700 1 -- 172.21.15.84:0/1588460029 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc012df0 con 0x7f37041531e0 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.339+0000 7f36f27fc700 1 -- 172.21.15.84:0/1588460029 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc01d670 con 0x7f37041531e0 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.339+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370416e980 con 0x7f37041531e0 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.339+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37040c3b60 con 0x7f37041531e0 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.341+0000 7f36f27fc700 1 -- 172.21.15.84:0/1588460029 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36fc01daa0 con 0x7f37041531e0 2023-10-06T02:55:22.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.341+0000 7f36f27fc700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36e4078090 0x7f36e407a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.341+0000 7f36f27fc700 1 -- 172.21.15.84:0/1588460029 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f36fc086420 con 0x7f37041531e0 2023-10-06T02:55:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.344+0000 7f96ea7fc700 1 -- 172.21.15.84:0/2150960583 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96f0054e00 con 0x7f96fc0b49e0 2023-10-06T02:55:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.340+0000 7fbaf77fe700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbae4066f30 0x7fbae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.340+0000 7fbaf77fe700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbae4066f30 0x7fbae40693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbae80096c0 tx=0x7fbae8006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.349+0000 7f370259c700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36e4078090 0x7f36e407a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.350+0000 7f370259c700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36e4078090 0x7f36e407a540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009c80 tx=0x7f36f4009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.354+0000 7f1dbc10f700 1 Processor -- start 2023-10-06T02:55:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.354+0000 7f1dbc10f700 1 -- start start 2023-10-06T02:55:22.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.355+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e80052b0 con 0x7f37041531e0 2023-10-06T02:55:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1dbc10f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1db4159390 0x7f1db40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1dbc10f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db406aeb0 con 0x7f1db4159760 2023-10-06T02:55:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1dbc10f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db40b0950 con 0x7f1db40675f0 2023-10-06T02:55:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1dbc10f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db40b0c20 con 0x7f1db4159390 2023-10-06T02:55:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1db9eab700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1db4159390 0x7f1db40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1db9eab700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1db4159390 0x7f1db40a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:51378/0 (socket says 172.21.15.84:51378) 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1db9eab700 1 -- 172.21.15.84:0/590274364 learned_addr learned my addr 172.21.15.84:0/590274364 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1db9eab700 1 -- 172.21.15.84:0/590274364 >> v1:172.21.15.131:6789/0 conn(0x7f1db40675f0 legacy=0x7f1db406b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1db9eab700 1 -- 172.21.15.84:0/590274364 >> v1:172.21.15.84:6789/0 conn(0x7f1db4159760 legacy=0x7f1db40b0240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.356+0000 7f1db9eab700 1 -- 172.21.15.84:0/590274364 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db406a860 con 0x7f1db4159390 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.357+0000 7f1db9eab700 1 --2- 172.21.15.84:0/590274364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1db4159390 0x7f1db40a98e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1da80099b0 tx=0x7f1da8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5a66d304bfe7b1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.357+0000 7f1db8ea9700 1 -- 172.21.15.84:0/590274364 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da800b820 con 0x7f1db4159390 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.357+0000 7f1db8ea9700 1 -- 172.21.15.84:0/590274364 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da800b980 con 0x7f1db4159390 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.357+0000 7f1db8ea9700 1 -- 172.21.15.84:0/590274364 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da800bd20 con 0x7f1db4159390 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.358+0000 7f1dbc10f700 1 -- 172.21.15.84:0/590274364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1db4159390 msgr2=0x7f1db40a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.358+0000 7f1dbc10f700 1 --2- 172.21.15.84:0/590274364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1db4159390 0x7f1db40a98e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1da80099b0 tx=0x7f1da8009250 comp rx=0 tx=0).stop 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.358+0000 7f1dbc10f700 1 -- 172.21.15.84:0/590274364 shutdown_connections 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.358+0000 7f1dbc10f700 1 --2- 172.21.15.84:0/590274364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1db4159390 0x7f1db40a98e0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1da80099b0 tx=0x7f1da8009250 comp rx=0 tx=0).stop 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.358+0000 7f1dbc10f700 1 -- 172.21.15.84:0/590274364 >> 172.21.15.84:0/590274364 conn(0x7f1db40691d0 msgr2=0x7f1db40aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.359+0000 7f1dbc10f700 1 -- 172.21.15.84:0/590274364 shutdown_connections 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.359+0000 7f1dbc10f700 1 -- 172.21.15.84:0/590274364 wait complete. 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.361+0000 7f1dbc10f700 1 Processor -- start 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.361+0000 7f1dbc10f700 1 -- start start 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.362+0000 7f1dbc10f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1db40675f0 0x7f1db4151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.362+0000 7f1dbc10f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1db4159760 0x7f1db4156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.362+0000 7f1dbc10f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db414bb00 0x7f1db414bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.362+0000 7f1dbc10f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db414c4c0 con 0x7f1db414bb00 2023-10-06T02:55:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.362+0000 7f1dbc10f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db414b470 con 0x7f1db4159760 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.362+0000 7f1dbc10f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4150d10 con 0x7f1db40675f0 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1dba6ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db414bb00 0x7f1db414bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1dba6ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db414bb00 0x7f1db414bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39820/0 (socket says 172.21.15.84:39820) 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1dba6ac700 1 -- 172.21.15.84:0/2658763006 learned_addr learned my addr 172.21.15.84:0/2658763006 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1db96aa700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1db4159760 0x7f1db4156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1dba6ac700 1 -- 172.21.15.84:0/2658763006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1db40675f0 msgr2=0x7f1db4151d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1dba6ac700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1db40675f0 0x7f1db4151d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1dba6ac700 1 -- 172.21.15.84:0/2658763006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1db4159760 msgr2=0x7f1db4156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1dba6ac700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1db4159760 0x7f1db4156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1dba6ac700 1 -- 172.21.15.84:0/2658763006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80094f0 con 0x7f1db414bb00 2023-10-06T02:55:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.363+0000 7f1dba6ac700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db414bb00 0x7f1db414bf80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00c910 tx=0x7f1dac001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.364+0000 7f36f27fc700 1 -- 172.21.15.84:0/1588460029 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36fc053220 con 0x7f37041531e0 2023-10-06T02:55:22.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.367+0000 7f1da5ffb700 1 -- 172.21.15.84:0/2658763006 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac012630 con 0x7f1db414bb00 2023-10-06T02:55:22.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.367+0000 7f1da5ffb700 1 -- 172.21.15.84:0/2658763006 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac012790 con 0x7f1db414bb00 2023-10-06T02:55:22.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.367+0000 7f1da5ffb700 1 -- 172.21.15.84:0/2658763006 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac012b30 con 0x7f1db414bb00 2023-10-06T02:55:22.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.370+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db4150f90 con 0x7f1db414bb00 2023-10-06T02:55:22.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.370+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db4151550 con 0x7f1db414bb00 2023-10-06T02:55:22.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.371+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db4064ad0 con 0x7f1db414bb00 2023-10-06T02:55:22.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.386+0000 7f1da5ffb700 1 -- 172.21.15.84:0/2658763006 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1dac024420 con 0x7f1db414bb00 2023-10-06T02:55:22.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.386+0000 7f1da5ffb700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d98067080 0x7f1d98069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:22.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.386+0000 7f1da5ffb700 1 -- 172.21.15.84:0/2658763006 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1dac0852e0 con 0x7f1db414bb00 2023-10-06T02:55:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.386+0000 7f1da5ffb700 1 -- 172.21.15.84:0/2658763006 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dac085770 con 0x7f1db414bb00 2023-10-06T02:55:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.400+0000 7f1db9eab700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d98067080 0x7f1d98069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:22.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.436+0000 7f1db9eab700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d98067080 0x7f1d98069530 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1da80099b0 tx=0x7f1da8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:22.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.691+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3058005560 con 0x7f30740c82a0 2023-10-06T02:55:22.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.700+0000 7f30627fc700 1 -- 172.21.15.84:0/1534465624 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3068016080 con 0x7f30740c82a0 2023-10-06T02:55:22.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.700+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff264005830 con 0x7ff2840b29f0 2023-10-06T02:55:22.702 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T02:55:22.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.701+0000 7ff26bfff700 1 -- 172.21.15.84:0/2483693383 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff274054ba0 con 0x7ff2840b29f0 2023-10-06T02:55:22.705 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2023-10-06T02:55:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.705+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3054066f30 msgr2=0x7f30540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.705+0000 7f30789a5700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3054066f30 0x7f30540693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30740c6670 tx=0x7f306c01a000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.705+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30740c82a0 msgr2=0x7f30740b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.705+0000 7f30789a5700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30740c82a0 0x7f30740b1460 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f306800b810 tx=0x7f30680091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.705+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff270066f30 msgr2=0x7ff2700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.705+0000 7ff28aa55700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff270066f30 0x7ff2700693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2780010e0 tx=0x7ff278007900 comp rx=0 tx=0).stop 2023-10-06T02:55:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.705+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2840b29f0 msgr2=0x7ff28415c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.705+0000 7ff28aa55700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2840b29f0 0x7ff28415c210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff27400b810 tx=0x7ff274009250 comp rx=0 tx=0).stop 2023-10-06T02:55:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.706+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 shutdown_connections 2023-10-06T02:55:22.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.706+0000 7f30789a5700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3054066f30 0x7f30540693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.706+0000 7f30789a5700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3074155860 0x7f30740b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.706+0000 7f30789a5700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074069c70 0x7f3074166380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.706+0000 7f30789a5700 1 --2- 172.21.15.84:0/1534465624 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30740c82a0 0x7f30740b1460 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.706+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 >> 172.21.15.84:0/1534465624 conn(0x7f30740680c0 msgr2=0x7f30740cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.709+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 shutdown_connections 2023-10-06T02:55:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.709+0000 7ff28aa55700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff270066f30 0x7ff2700693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.709+0000 7ff28aa55700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2841596a0 0x7ff2840c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.709+0000 7ff28aa55700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2840b2620 0x7ff284158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.709+0000 7ff28aa55700 1 --2- 172.21.15.84:0/2483693383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2840b29f0 0x7ff28415c210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.709+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 >> 172.21.15.84:0/2483693383 conn(0x7ff28406ed20 msgr2=0x7ff2840b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.712+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbaf804bb80 con 0x7fbaf8070c90 2023-10-06T02:55:22.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.713+0000 7fbadf7fe700 1 -- 172.21.15.84:0/43794847 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbaec05e550 con 0x7fbaf8070c90 2023-10-06T02:55:22.714 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T02:55:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.716+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 shutdown_connections 2023-10-06T02:55:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.716+0000 7f30789a5700 1 -- 172.21.15.84:0/1534465624 wait complete. 2023-10-06T02:55:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.717+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 shutdown_connections 2023-10-06T02:55:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.717+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbae4066f30 msgr2=0x7fbae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.717+0000 7fbafe232700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbae4066f30 0x7fbae40693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbae80096c0 tx=0x7fbae8006bd0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.717+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaf8070c90 msgr2=0x7fbaf806b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.717+0000 7fbafe232700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaf8070c90 0x7fbaf806b070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbaec011840 tx=0x7fbaec01f000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.717+0000 7ff28aa55700 1 -- 172.21.15.84:0/2483693383 wait complete. 2023-10-06T02:55:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.717+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe5ac064ad0 con 0x7fe5ac068850 2023-10-06T02:55:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.718+0000 7fe5a27fc700 1 -- 172.21.15.84:0/120917757 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe59c0523f0 con 0x7fe5ac068850 2023-10-06T02:55:22.720 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T02:55:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.718+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 shutdown_connections 2023-10-06T02:55:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.718+0000 7fbafe232700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbae4066f30 0x7fbae40693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.718+0000 7fbafe232700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbaf8070810 0x7fbaf814ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.718+0000 7fbafe232700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbaf80ac480 0x7fbaf806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.718+0000 7fbafe232700 1 --2- 172.21.15.84:0/43794847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbaf8070c90 0x7fbaf806b070 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.718+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 >> 172.21.15.84:0/43794847 conn(0x7fbaf806de80 msgr2=0x7fbaf80ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.719+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f96e0005830 con 0x7f96fc0b49e0 2023-10-06T02:55:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.719+0000 7f96ea7fc700 1 -- 172.21.15.84:0/2150960583 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96f0054990 con 0x7f96fc0b49e0 2023-10-06T02:55:22.721 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T02:55:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.721+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 shutdown_connections 2023-10-06T02:55:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.721+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe590066f30 msgr2=0x7fe5900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.721+0000 7fe5b4409700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe590066f30 0x7fe5900693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8007130 tx=0x7fe5a8007eb0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.721+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5ac068850 msgr2=0x7fe5ac16b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.721+0000 7fe5b4409700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5ac068850 0x7fe5ac16b6e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009160 tx=0x7fe59c016000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.721+0000 7fbafe232700 1 -- 172.21.15.84:0/43794847 wait complete. 2023-10-06T02:55:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.723+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 shutdown_connections 2023-10-06T02:55:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.723+0000 7fe5b4409700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe590066f30 0x7fe5900693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.723+0000 7fe5b4409700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5ac0ac480 0x7fe5ac0cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.723+0000 7fe5b4409700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5ac068850 0x7fe5ac16b6e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.723+0000 7fe5b4409700 1 --2- 172.21.15.84:0/120917757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5ac068c20 0x7fe5ac0caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.723+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 >> 172.21.15.84:0/120917757 conn(0x7fe5ac06de80 msgr2=0x7fe5ac15a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.723+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 shutdown_connections 2023-10-06T02:55:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.723+0000 7fe5b4409700 1 -- 172.21.15.84:0/120917757 wait complete. 2023-10-06T02:55:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.724+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcf40005830 con 0x7fcf580cb630 2023-10-06T02:55:22.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.725+0000 7fcf4e7fc700 1 -- 172.21.15.84:0/1947177977 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf500099a0 con 0x7fcf580cb630 2023-10-06T02:55:22.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.730+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96dc066f30 msgr2=0x7f96dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.730+0000 7f9700ca9700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96dc066f30 0x7f96dc0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96ec005920 tx=0x7f96ec007ad0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.730+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96fc0b49e0 msgr2=0x7f96fc1588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.730+0000 7f9700ca9700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96fc0b49e0 0x7f96fc1588f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f96f000b7e0 tx=0x7f96f0009220 comp rx=0 tx=0).stop 2023-10-06T02:55:22.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.732+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 shutdown_connections 2023-10-06T02:55:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.732+0000 7f9700ca9700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96dc066f30 0x7f96dc0693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.732+0000 7f9700ca9700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96fc0b07a0 0x7f96fc09a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.732+0000 7f9700ca9700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96fc1595a0 0x7f96fc09c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.732+0000 7f9700ca9700 1 --2- 172.21.15.84:0/2150960583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96fc0b49e0 0x7f96fc1588f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.732+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 >> 172.21.15.84:0/2150960583 conn(0x7f96fc099830 msgr2=0x7f96fc0ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-10-06T02:55:22.736 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T02:55:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.737+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 msgr2=0x7fcf3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.737+0000 7fcf60693700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf48003080 tx=0x7fcf48016000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.737+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf580cb630 msgr2=0x7fcf580c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.737+0000 7fcf60693700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf580cb630 0x7fcf580c30e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf50007f60 tx=0x7fcf50009880 comp rx=0 tx=0).stop 2023-10-06T02:55:22.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.738+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 shutdown_connections 2023-10-06T02:55:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.738+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 shutdown_connections 2023-10-06T02:55:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.738+0000 7fcf60693700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.738+0000 7fcf60693700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf58069720 0x7fcf58156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.738+0000 7fcf60693700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5815a050 0x7fcf58152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.738+0000 7fcf60693700 1 --2- 172.21.15.84:0/1947177977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf580cb630 0x7fcf580c30e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.738+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 >> 172.21.15.84:0/1947177977 conn(0x7fcf58070810 msgr2=0x7fcf580cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.738+0000 7f9700ca9700 1 -- 172.21.15.84:0/2150960583 wait complete. 2023-10-06T02:55:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.742+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 shutdown_connections 2023-10-06T02:55:22.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-10-06T02:55:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.744+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36e8005560 con 0x7f37041531e0 2023-10-06T02:55:22.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.745+0000 7fcf60693700 1 -- 172.21.15.84:0/1947177977 wait complete. 2023-10-06T02:55:22.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-10-06T02:55:22.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.746+0000 7f36f27fc700 1 -- 172.21.15.84:0/1588460029 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36fc02a020 con 0x7f37041531e0 2023-10-06T02:55:22.749 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:22.749 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T02:55:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.746+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1db404bb80 con 0x7f1db414bb00 2023-10-06T02:55:22.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.746+0000 7f1da5ffb700 1 -- 172.21.15.84:0/2658763006 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dac052160 con 0x7f1db414bb00 2023-10-06T02:55:22.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-10-06T02:55:22.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d98067080 msgr2=0x7f1d98069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d98067080 0x7f1d98069530 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1da80099b0 tx=0x7f1da8016000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db414bb00 msgr2=0x7f1db414bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db414bb00 0x7f1db414bf80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00c910 tx=0x7f1dac001710 comp rx=0 tx=0).stop 2023-10-06T02:55:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 shutdown_connections 2023-10-06T02:55:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d98067080 0x7f1d98069530 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db414bb00 0x7f1db414bf80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1db40675f0 0x7f1db4151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 --2- 172.21.15.84:0/2658763006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1db4159760 0x7f1db4156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 >> 172.21.15.84:0/2658763006 conn(0x7f1db40691d0 msgr2=0x7f1db40a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 shutdown_connections 2023-10-06T02:55:22.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36e4078090 msgr2=0x7f36e407a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f1dbc10f700 1 -- 172.21.15.84:0/2658763006 wait complete. 2023-10-06T02:55:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36e4078090 0x7f36e407a540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009c80 tx=0x7f36f4009250 comp rx=0 tx=0).stop 2023-10-06T02:55:22.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37041531e0 msgr2=0x7f37040c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37041531e0 0x7f37040c3620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f36fc014000 tx=0x7f36fc017000 comp rx=0 tx=0).stop 2023-10-06T02:55:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 shutdown_connections 2023-10-06T02:55:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36e4078090 0x7f36e407a540 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3704069c70 0x7f37040c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37041531e0 0x7f37040c3620 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 --2- 172.21.15.84:0/1588460029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f370406b580 0x7f3704167a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:22.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 >> 172.21.15.84:0/1588460029 conn(0x7f37040680c0 msgr2=0x7f3704158470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:22.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 shutdown_connections 2023-10-06T02:55:22.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:22.749+0000 7f3708d22700 1 -- 172.21.15.84:0/1588460029 wait complete. 2023-10-06T02:55:22.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-10-06T02:55:22.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-10-06T02:55:22.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-10-06T02:55:22.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-10-06T02:55:23.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T02:55:23.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T02:55:23.748 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T02:55:23.752 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T02:55:23.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T02:55:23.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T02:55:23.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T02:55:23.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T02:55:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.921+0000 7f56ef338700 1 Processor -- start 2023-10-06T02:55:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.921+0000 7f56ef338700 1 -- start start 2023-10-06T02:55:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.923+0000 7f56ef338700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f56e8161200 0x7f56e8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.923+0000 7f56ef338700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8069aa0 0x7f56e80aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.923+0000 7f56ef338700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e8069f00 con 0x7f56e8160e30 2023-10-06T02:55:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.923+0000 7f56ef338700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e80c8a20 con 0x7f56e8161200 2023-10-06T02:55:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.923+0000 7f56ef338700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80c7e80 con 0x7f56e8069aa0 2023-10-06T02:55:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.923+0000 7f56ed0d4700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f56e8160e30 0x7f56e80c8310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49124/0 (socket says 172.21.15.84:49124) 2023-10-06T02:55:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.923+0000 7f56ed0d4700 1 -- 172.21.15.84:0/4251327031 learned_addr learned my addr 172.21.15.84:0/4251327031 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.923+0000 7f56ed8d5700 1 --2- 172.21.15.84:0/4251327031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8069aa0 0x7f56e80aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.923+0000 7f56ec8d3700 1 --2- 172.21.15.84:0/4251327031 >> v2:172.21.15.131:3300/0 conn(0x7f56e8161200 0x7f56e8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.924+0000 7f56ed8d5700 1 -- 172.21.15.84:0/4251327031 >> v2:172.21.15.131:3300/0 conn(0x7f56e8161200 msgr2=0x7f56e8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.924+0000 7f56ed8d5700 1 --2- 172.21.15.84:0/4251327031 >> v2:172.21.15.131:3300/0 conn(0x7f56e8161200 0x7f56e8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.924+0000 7f56ed8d5700 1 -- 172.21.15.84:0/4251327031 >> v1:172.21.15.84:6789/0 conn(0x7f56e8160e30 legacy=0x7f56e80c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.924+0000 7f56ed8d5700 1 -- 172.21.15.84:0/4251327031 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e8161680 con 0x7f56e8069aa0 2023-10-06T02:55:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.924+0000 7f56ed8d5700 1 --2- 172.21.15.84:0/4251327031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8069aa0 0x7f56e80aeef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f56e4006fd0 tx=0x7f56e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afc2e86f8b4b0035 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.925+0000 7f56dffff700 1 -- 172.21.15.84:0/4251327031 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4005c60 con 0x7f56e8069aa0 2023-10-06T02:55:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.925+0000 7f56dffff700 1 -- 172.21.15.84:0/4251327031 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4005dc0 con 0x7f56e8069aa0 2023-10-06T02:55:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.925+0000 7f56dffff700 1 -- 172.21.15.84:0/4251327031 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4006280 con 0x7f56e8069aa0 2023-10-06T02:55:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.926+0000 7f56ef338700 1 -- 172.21.15.84:0/4251327031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8069aa0 msgr2=0x7f56e80aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.926+0000 7f56ef338700 1 --2- 172.21.15.84:0/4251327031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8069aa0 0x7f56e80aeef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f56e4006fd0 tx=0x7f56e40091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.926+0000 7f56ef338700 1 -- 172.21.15.84:0/4251327031 shutdown_connections 2023-10-06T02:55:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.926+0000 7f56ef338700 1 --2- 172.21.15.84:0/4251327031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8069aa0 0x7f56e80aeef0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.926+0000 7f56ef338700 1 --2- 172.21.15.84:0/4251327031 >> v2:172.21.15.131:3300/0 conn(0x7f56e8161200 0x7f56e8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.926+0000 7f56ef338700 1 -- 172.21.15.84:0/4251327031 >> 172.21.15.84:0/4251327031 conn(0x7f56e80680c0 msgr2=0x7f56e80cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.926+0000 7f56ef338700 1 -- 172.21.15.84:0/4251327031 shutdown_connections 2023-10-06T02:55:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.926+0000 7f56ef338700 1 -- 172.21.15.84:0/4251327031 wait complete. 2023-10-06T02:55:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.928+0000 7f56ef338700 1 Processor -- start 2023-10-06T02:55:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.928+0000 7f56ef338700 1 -- start start 2023-10-06T02:55:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.930+0000 7f56ef338700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8069aa0 0x7f56e80c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.930+0000 7f56ef338700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e8160e30 0x7f56e80c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.930+0000 7f56ef338700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8161200 0x7f56e814a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.930+0000 7f56ef338700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80c6ec0 con 0x7f56e8069aa0 2023-10-06T02:55:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.930+0000 7f56ef338700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80c0300 con 0x7f56e8160e30 2023-10-06T02:55:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.930+0000 7f56ef338700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e80c6be0 con 0x7f56e8161200 2023-10-06T02:55:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.930+0000 7f56ed0d4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8069aa0 0x7f56e80c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.930+0000 7f56ed0d4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8069aa0 0x7f56e80c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39828/0 (socket says 172.21.15.84:39828) 2023-10-06T02:55:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.930+0000 7f56ed0d4700 1 -- 172.21.15.84:0/3824904357 learned_addr learned my addr 172.21.15.84:0/3824904357 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.931+0000 7f56ec8d3700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e8160e30 0x7f56e80c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.931+0000 7f56ed0d4700 1 -- 172.21.15.84:0/3824904357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8161200 msgr2=0x7f56e814a1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.931+0000 7f56ed0d4700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8161200 0x7f56e814a1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.931+0000 7f56ed0d4700 1 -- 172.21.15.84:0/3824904357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e8160e30 msgr2=0x7f56e80c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.931+0000 7f56ed0d4700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e8160e30 0x7f56e80c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.931+0000 7f56ed0d4700 1 -- 172.21.15.84:0/3824904357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4009420 con 0x7f56e8069aa0 2023-10-06T02:55:23.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.931+0000 7f56ed0d4700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8069aa0 0x7f56e80c4730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f56e000cd30 tx=0x7f56e0001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:23.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.932+0000 7f56dd7fa700 1 -- 172.21.15.84:0/3824904357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0004bb0 con 0x7f56e8069aa0 2023-10-06T02:55:23.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.932+0000 7f56dd7fa700 1 -- 172.21.15.84:0/3824904357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e0004d30 con 0x7f56e8069aa0 2023-10-06T02:55:23.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.932+0000 7f56dd7fa700 1 -- 172.21.15.84:0/3824904357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0004ea0 con 0x7f56e8069aa0 2023-10-06T02:55:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.932+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e80bfcb0 con 0x7f56e8069aa0 2023-10-06T02:55:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.932+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e80c41b0 con 0x7f56e8069aa0 2023-10-06T02:55:23.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.936+0000 7f56dd7fa700 1 -- 172.21.15.84:0/3824904357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56e0007300 con 0x7f56e8069aa0 2023-10-06T02:55:23.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.936+0000 7f56dd7fa700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f56d40671a0 0x7f56d4069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.936+0000 7f56dd7fa700 1 -- 172.21.15.84:0/3824904357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f56e0084640 con 0x7f56e8069aa0 2023-10-06T02:55:23.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.937+0000 7f56ec8d3700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f56d40671a0 0x7f56d4069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.938+0000 7f56ec8d3700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f56d40671a0 0x7f56d4069650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f56d80093f0 tx=0x7f56d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:23.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.939+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c80052b0 con 0x7f56e8069aa0 2023-10-06T02:55:23.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.947+0000 7f56dd7fa700 1 -- 172.21.15.84:0/3824904357 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56e00514c0 con 0x7f56e8069aa0 2023-10-06T02:55:23.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.975+0000 7f68416eb700 1 Processor -- start 2023-10-06T02:55:23.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.982+0000 7f68416eb700 1 -- start start 2023-10-06T02:55:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f68416eb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f683c069c70 0x7f683c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f68416eb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f683c15d920 0x7f683c15bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f68416eb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683c15b960 con 0x7f683c159a60 2023-10-06T02:55:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f68416eb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683c15a220 con 0x7f683c15d920 2023-10-06T02:55:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f68416eb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683c15e2f0 con 0x7f683c069c70 2023-10-06T02:55:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f683b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f683c15d920 0x7f683c15bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f683affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f683c159a60 0x7f683c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49134/0 (socket says 172.21.15.84:49134) 2023-10-06T02:55:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f683b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f683c15d920 0x7f683c15bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39844/0 (socket says 172.21.15.84:39844) 2023-10-06T02:55:23.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f683affd700 1 -- 172.21.15.84:0/3363831686 learned_addr learned my addr 172.21.15.84:0/3363831686 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:23.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f683a7fc700 1 --2- 172.21.15.84:0/3363831686 >> v2:172.21.15.131:3300/0 conn(0x7f683c069c70 0x7f683c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f683b7fe700 1 -- 172.21.15.84:0/3363831686 >> v2:172.21.15.131:3300/0 conn(0x7f683c069c70 msgr2=0x7f683c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f683b7fe700 1 --2- 172.21.15.84:0/3363831686 >> v2:172.21.15.131:3300/0 conn(0x7f683c069c70 0x7f683c15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f683b7fe700 1 -- 172.21.15.84:0/3363831686 >> v1:172.21.15.84:6789/0 conn(0x7f683c159a60 legacy=0x7f683c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f683b7fe700 1 -- 172.21.15.84:0/3363831686 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c15e010 con 0x7f683c15d920 2023-10-06T02:55:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.984+0000 7f683b7fe700 1 --2- 172.21.15.84:0/3363831686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 0x7f683c15bdf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f683c06cb90 tx=0x7f6834009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5651011069ad4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7efce35e8700 1 Processor -- start 2023-10-06T02:55:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.984+0000 7efce35e8700 1 -- start start 2023-10-06T02:55:23.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7efce35e8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efcdc157830 0x7efcdc0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7efce35e8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc0ac480 0x7efcdc068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7efce35e8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0cae60 con 0x7efcdc157460 2023-10-06T02:55:23.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7efce35e8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0aeed0 con 0x7efcdc157830 2023-10-06T02:55:23.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7efce35e8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0af1b0 con 0x7efcdc0ac480 2023-10-06T02:55:23.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.983+0000 7f185917f700 1 Processor -- start 2023-10-06T02:55:23.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.984+0000 7f185917f700 1 -- start start 2023-10-06T02:55:23.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.984+0000 7f185917f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1854156390 0x7f18540cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.984+0000 7f185917f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f185406c370 0x7f18540c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.984+0000 7f185917f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18540ccbc0 con 0x7f18540cc750 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f185917f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185406c7d0 con 0x7f185406c370 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f185917f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185406c9e0 con 0x7f1854156390 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f185259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f18540cc750 0x7f185406bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49138/0 (socket says 172.21.15.84:49138) 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f185259c700 1 -- 172.21.15.84:0/3924012211 learned_addr learned my addr 172.21.15.84:0/3924012211 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f1852d9d700 1 --2- 172.21.15.84:0/3924012211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1854156390 0x7f18540cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f185359e700 1 --2- 172.21.15.84:0/3924012211 >> v2:172.21.15.131:3300/0 conn(0x7f185406c370 0x7f18540c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f1852d9d700 1 -- 172.21.15.84:0/3924012211 >> v2:172.21.15.131:3300/0 conn(0x7f185406c370 msgr2=0x7f18540c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f1852d9d700 1 --2- 172.21.15.84:0/3924012211 >> v2:172.21.15.131:3300/0 conn(0x7f185406c370 0x7f18540c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f1852d9d700 1 -- 172.21.15.84:0/3924012211 >> v1:172.21.15.84:6789/0 conn(0x7f18540cc750 legacy=0x7f185406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:23.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f1852d9d700 1 -- 172.21.15.84:0/3924012211 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854156b60 con 0x7f1854156390 2023-10-06T02:55:23.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7efce1384700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7efcdc157460 0x7efcdc0cc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:36584/0 (socket says 172.21.15.84:36584) 2023-10-06T02:55:23.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7efce1384700 1 -- 172.21.15.84:0/1666608061 learned_addr learned my addr 172.21.15.84:0/1666608061 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:23.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f1852d9d700 1 --2- 172.21.15.84:0/3924012211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1854156390 0x7f18540cc210 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f18440098e0 tx=0x7f18440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71a5158f53c266cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f6839ffb700 1 -- 172.21.15.84:0/3363831686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683400e070 con 0x7f683c15d920 2023-10-06T02:55:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7efce1b85700 1 --2- 172.21.15.84:0/1666608061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc0ac480 0x7efcdc068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f6839ffb700 1 -- 172.21.15.84:0/3363831686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683400bc30 con 0x7f683c15d920 2023-10-06T02:55:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f6839ffb700 1 -- 172.21.15.84:0/3363831686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834012430 con 0x7f683c15d920 2023-10-06T02:55:23.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7efce0b83700 1 --2- 172.21.15.84:0/1666608061 >> v2:172.21.15.84:3300/0 conn(0x7efcdc157830 0x7efcdc0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.984+0000 7f7da4033700 1 Processor -- start 2023-10-06T02:55:23.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.985+0000 7f7da4033700 1 -- start start 2023-10-06T02:55:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7fef2d714700 1 Processor -- start 2023-10-06T02:55:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7efce0b83700 1 -- 172.21.15.84:0/1666608061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc0ac480 msgr2=0x7efcdc068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7efce0b83700 1 --2- 172.21.15.84:0/1666608061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc0ac480 0x7efcdc068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7efce0b83700 1 -- 172.21.15.84:0/1666608061 >> v1:172.21.15.131:6789/0 conn(0x7efcdc157460 legacy=0x7efcdc0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7efce0b83700 1 -- 172.21.15.84:0/1666608061 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0af490 con 0x7efcdc157830 2023-10-06T02:55:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f7da4033700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7d9c0878f0 0x7f7d9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f7da4033700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0c8320 0x7f7d9c06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f7da4033700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c0c7270 con 0x7f7d9c069560 2023-10-06T02:55:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f7da4033700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9c0c8a20 con 0x7f7d9c0878f0 2023-10-06T02:55:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f7da4033700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0c7080 con 0x7f7d9c0c8320 2023-10-06T02:55:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7fef2d714700 1 -- start start 2023-10-06T02:55:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f68416eb700 1 -- 172.21.15.84:0/3363831686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 msgr2=0x7f683c15bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:23.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f68416eb700 1 --2- 172.21.15.84:0/3363831686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 0x7f683c15bdf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f683c06cb90 tx=0x7f6834009780 comp rx=0 tx=0).stop 2023-10-06T02:55:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f7da1dcf700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7d9c0878f0 0x7f7d9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f7da1dcf700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7d9c0878f0 0x7f7d9c06d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:51438/0 (socket says 172.21.15.84:51438) 2023-10-06T02:55:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f7da1dcf700 1 -- 172.21.15.84:0/3253235511 learned_addr learned my addr 172.21.15.84:0/3253235511 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f7da15ce700 1 --2- 172.21.15.84:0/3253235511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0c8320 0x7f7d9c06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7efce0b83700 1 --2- 172.21.15.84:0/1666608061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc157830 0x7efcdc0ae8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098e0 tx=0x7efccc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddb94f15eb2ff5d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f68416eb700 1 -- 172.21.15.84:0/3363831686 shutdown_connections 2023-10-06T02:55:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f68416eb700 1 --2- 172.21.15.84:0/3363831686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 0x7f683c15bdf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f68416eb700 1 --2- 172.21.15.84:0/3363831686 >> v2:172.21.15.131:3300/0 conn(0x7f683c069c70 0x7f683c15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f68416eb700 1 -- 172.21.15.84:0/3363831686 >> 172.21.15.84:0/3363831686 conn(0x7f683c0680c0 msgr2=0x7f683c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f7da1dcf700 1 -- 172.21.15.84:0/3253235511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0c8320 msgr2=0x7f7d9c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f7da1dcf700 1 --2- 172.21.15.84:0/3253235511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0c8320 0x7f7d9c06d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f7da1dcf700 1 -- 172.21.15.84:0/3253235511 >> v1:172.21.15.84:6789/0 conn(0x7f7d9c069560 legacy=0x7f7d9c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f7da1dcf700 1 -- 172.21.15.84:0/3253235511 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0aff00 con 0x7f7d9c0878f0 2023-10-06T02:55:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7f7da1dcf700 1 --2- 172.21.15.84:0/3253235511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c0878f0 0x7f7d9c06d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d980099b0 tx=0x7f7d98009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eea1585b8b03949 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7efcd3fff700 1 -- 172.21.15.84:0/1666608061 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00b640 con 0x7efcdc157830 2023-10-06T02:55:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7fef2d714700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fef280ac480 0x7fef280afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7fef2d714700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef28070c90 0x7fef28155640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7fef2d714700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef280ac910 con 0x7fef28070810 2023-10-06T02:55:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7fef2d714700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef280af150 con 0x7fef280ac480 2023-10-06T02:55:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7fef2d714700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef280acbf0 con 0x7fef28070c90 2023-10-06T02:55:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef26ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fef280ac480 0x7fef280afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef26ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fef280ac480 0x7fef280afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39862/0 (socket says 172.21.15.84:39862) 2023-10-06T02:55:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef26ffd700 1 -- 172.21.15.84:0/2782528527 learned_addr learned my addr 172.21.15.84:0/2782528527 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f1851d9b700 1 -- 172.21.15.84:0/3924012211 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400b640 con 0x7f1854156390 2023-10-06T02:55:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f1851d9b700 1 -- 172.21.15.84:0/3924012211 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184400b7a0 con 0x7f1854156390 2023-10-06T02:55:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.986+0000 7f1851d9b700 1 -- 172.21.15.84:0/3924012211 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400bb40 con 0x7f1854156390 2023-10-06T02:55:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f185917f700 1 -- 172.21.15.84:0/3924012211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1854156390 msgr2=0x7f18540cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f185917f700 1 --2- 172.21.15.84:0/3924012211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1854156390 0x7f18540cc210 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f18440098e0 tx=0x7f18440091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f68416eb700 1 -- 172.21.15.84:0/3363831686 shutdown_connections 2023-10-06T02:55:24.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f7da0dcd700 1 -- 172.21.15.84:0/3253235511 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d98009ea0 con 0x7f7d9c0878f0 2023-10-06T02:55:24.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f7da0dcd700 1 -- 172.21.15.84:0/3253235511 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9800b860 con 0x7f7d9c0878f0 2023-10-06T02:55:24.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f7da0dcd700 1 -- 172.21.15.84:0/3253235511 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9800bc00 con 0x7f7d9c0878f0 2023-10-06T02:55:24.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f185917f700 1 -- 172.21.15.84:0/3924012211 shutdown_connections 2023-10-06T02:55:24.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f185917f700 1 --2- 172.21.15.84:0/3924012211 >> v2:172.21.15.131:3300/0 conn(0x7f185406c370 0x7f18540c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f185917f700 1 --2- 172.21.15.84:0/3924012211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1854156390 0x7f18540cc210 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f185917f700 1 -- 172.21.15.84:0/3924012211 >> 172.21.15.84:0/3924012211 conn(0x7f18540cdef0 msgr2=0x7f18540c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef26ffd700 1 -- 172.21.15.84:0/2782528527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef28070c90 msgr2=0x7fef28155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef26ffd700 1 --2- 172.21.15.84:0/2782528527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef28070c90 0x7fef28155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef26ffd700 1 -- 172.21.15.84:0/2782528527 >> v1:172.21.15.131:6789/0 conn(0x7fef28070810 legacy=0x7fef280687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef26ffd700 1 -- 172.21.15.84:0/2782528527 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280aced0 con 0x7fef280ac480 2023-10-06T02:55:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef26ffd700 1 --2- 172.21.15.84:0/2782528527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ac480 0x7fef280afb80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fef20009f70 tx=0x7fef20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0ddcf6b414a2d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef25ffb700 1 -- 172.21.15.84:0/2782528527 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2000e070 con 0x7fef280ac480 2023-10-06T02:55:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef25ffb700 1 -- 172.21.15.84:0/2782528527 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2000b9d0 con 0x7fef280ac480 2023-10-06T02:55:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7fef25ffb700 1 -- 172.21.15.84:0/2782528527 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200092e0 con 0x7fef280ac480 2023-10-06T02:55:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f7da4033700 1 -- 172.21.15.84:0/3253235511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c0878f0 msgr2=0x7f7d9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f7da4033700 1 --2- 172.21.15.84:0/3253235511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c0878f0 0x7f7d9c06d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d980099b0 tx=0x7f7d98009250 comp rx=0 tx=0).stop 2023-10-06T02:55:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7efcd3fff700 1 -- 172.21.15.84:0/1666608061 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc00b7c0 con 0x7efcdc157830 2023-10-06T02:55:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.987+0000 7efcd3fff700 1 -- 172.21.15.84:0/1666608061 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00bb80 con 0x7efcdc157830 2023-10-06T02:55:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7efce35e8700 1 -- 172.21.15.84:0/1666608061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc157830 msgr2=0x7efcdc0ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7efce35e8700 1 --2- 172.21.15.84:0/1666608061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc157830 0x7efcdc0ae8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098e0 tx=0x7efccc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.988+0000 7f68416eb700 1 -- 172.21.15.84:0/3363831686 wait complete. 2023-10-06T02:55:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f7da4033700 1 -- 172.21.15.84:0/3253235511 shutdown_connections 2023-10-06T02:55:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f7da4033700 1 --2- 172.21.15.84:0/3253235511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c0878f0 0x7f7d9c06d390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f7da4033700 1 --2- 172.21.15.84:0/3253235511 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0c8320 0x7f7d9c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f7da4033700 1 -- 172.21.15.84:0/3253235511 >> 172.21.15.84:0/3253235511 conn(0x7f7d9c0680c0 msgr2=0x7f7d9c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7efce35e8700 1 -- 172.21.15.84:0/1666608061 shutdown_connections 2023-10-06T02:55:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7efce35e8700 1 --2- 172.21.15.84:0/1666608061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc0ac480 0x7efcdc068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7efce35e8700 1 --2- 172.21.15.84:0/1666608061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc157830 0x7efcdc0ae8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7efce35e8700 1 -- 172.21.15.84:0/1666608061 >> 172.21.15.84:0/1666608061 conn(0x7efcdc06de80 msgr2=0x7efcdc06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f7da4033700 1 -- 172.21.15.84:0/3253235511 shutdown_connections 2023-10-06T02:55:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f7da4033700 1 -- 172.21.15.84:0/3253235511 wait complete. 2023-10-06T02:55:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f68416eb700 1 Processor -- start 2023-10-06T02:55:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7f185917f700 1 -- 172.21.15.84:0/3924012211 shutdown_connections 2023-10-06T02:55:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7efce35e8700 1 -- 172.21.15.84:0/1666608061 shutdown_connections 2023-10-06T02:55:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.989+0000 7efce35e8700 1 -- 172.21.15.84:0/1666608061 wait complete. 2023-10-06T02:55:24.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.990+0000 7fef2d714700 1 -- 172.21.15.84:0/2782528527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ac480 msgr2=0x7fef280afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.990+0000 7fef2d714700 1 --2- 172.21.15.84:0/2782528527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ac480 0x7fef280afb80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fef20009f70 tx=0x7fef20009840 comp rx=0 tx=0).stop 2023-10-06T02:55:24.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.990+0000 7fef2d714700 1 -- 172.21.15.84:0/2782528527 shutdown_connections 2023-10-06T02:55:24.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.990+0000 7fef2d714700 1 --2- 172.21.15.84:0/2782528527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef28070c90 0x7fef28155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.990+0000 7fef2d714700 1 --2- 172.21.15.84:0/2782528527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ac480 0x7fef280afb80 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fef20009f70 tx=0x7fef20009840 comp rx=0 tx=0).stop 2023-10-06T02:55:24.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.990+0000 7fef2d714700 1 -- 172.21.15.84:0/2782528527 >> 172.21.15.84:0/2782528527 conn(0x7fef2806de80 msgr2=0x7fef2806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f185917f700 1 -- 172.21.15.84:0/3924012211 wait complete. 2023-10-06T02:55:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.990+0000 7f68416eb700 1 -- start start 2023-10-06T02:55:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f68416eb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f683c069c70 0x7f683c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f68416eb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f683c159a60 0x7f683c150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f68416eb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 0x7f683c16dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f68416eb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c153950 con 0x7f683c15d920 2023-10-06T02:55:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f68416eb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c150750 con 0x7f683c159a60 2023-10-06T02:55:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f68416eb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683c171e10 con 0x7f683c069c70 2023-10-06T02:55:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f7da4033700 1 Processor -- start 2023-10-06T02:55:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f7da4033700 1 -- start start 2023-10-06T02:55:24.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f683b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 0x7f683c16dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f683b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 0x7f683c16dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39864/0 (socket says 172.21.15.84:39864) 2023-10-06T02:55:24.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f683b7fe700 1 -- 172.21.15.84:0/3384030533 learned_addr learned my addr 172.21.15.84:0/3384030533 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f683affd700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f683c069c70 0x7f683c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7efce35e8700 1 Processor -- start 2023-10-06T02:55:24.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f683b7fe700 1 -- 172.21.15.84:0/3384030533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f683c069c70 msgr2=0x7f683c1528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f683b7fe700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f683c069c70 0x7f683c1528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f683b7fe700 1 -- 172.21.15.84:0/3384030533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f683c159a60 msgr2=0x7f683c150210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:24.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f683b7fe700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f683c159a60 0x7f683c150210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7f683b7fe700 1 -- 172.21.15.84:0/3384030533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834009a20 con 0x7f683c15d920 2023-10-06T02:55:24.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f683b7fe700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 0x7f683c16dc10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f68340097c0 tx=0x7f6834019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f6822ffd700 1 -- 172.21.15.84:0/3384030533 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834027470 con 0x7f683c15d920 2023-10-06T02:55:24.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f6822ffd700 1 -- 172.21.15.84:0/3384030533 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6834027610 con 0x7f683c15d920 2023-10-06T02:55:24.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f6822ffd700 1 -- 172.21.15.84:0/3384030533 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68340279d0 con 0x7f683c15d920 2023-10-06T02:55:24.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683c1720f0 con 0x7f683c15d920 2023-10-06T02:55:24.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683c1726b0 con 0x7f683c15d920 2023-10-06T02:55:24.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.991+0000 7efce35e8700 1 -- start start 2023-10-06T02:55:24.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce35e8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc0ac480 0x7efcdc147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce35e8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcdc157460 0x7efcdc06a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce35e8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc157830 0x7efcdc142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce35e8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc13f7f0 con 0x7efcdc0ac480 2023-10-06T02:55:24.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce35e8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc147840 con 0x7efcdc157460 2023-10-06T02:55:24.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce35e8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc146c30 con 0x7efcdc157830 2023-10-06T02:55:24.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7f185917f700 1 Processor -- start 2023-10-06T02:55:24.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683c064ad0 con 0x7f683c15d920 2023-10-06T02:55:24.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f7da4033700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c069560 0x7f7d9c0c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f7da4033700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0878f0 0x7f7d9c0c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f7da4033700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0c8320 0x7f7d9c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f7da4033700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c15af10 con 0x7f7d9c0c8320 2023-10-06T02:55:24.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f7da4033700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0c06e0 con 0x7f7d9c069560 2023-10-06T02:55:24.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.992+0000 7f7da4033700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c15a290 con 0x7f7d9c0878f0 2023-10-06T02:55:24.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7f7da1dcf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c069560 0x7f7d9c0c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7f7da15ce700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0878f0 0x7f7d9c0c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7f7da1dcf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c069560 0x7f7d9c0c2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:51456/0 (socket says 172.21.15.84:51456) 2023-10-06T02:55:24.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7f7da1dcf700 1 -- 172.21.15.84:0/2525958987 learned_addr learned my addr 172.21.15.84:0/2525958987 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f7da1dcf700 1 -- 172.21.15.84:0/2525958987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0878f0 msgr2=0x7f7d9c0c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f7da1dcf700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0878f0 0x7f7d9c0c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f7da1dcf700 1 -- 172.21.15.84:0/2525958987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0c8320 msgr2=0x7f7d9c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f7da1dcf700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0c8320 0x7f7d9c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f7da1dcf700 1 -- 172.21.15.84:0/2525958987 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d980094f0 con 0x7f7d9c069560 2023-10-06T02:55:24.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f7da1dcf700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c069560 0x7f7d9c0c2630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d980094c0 tx=0x7f7d98017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f7d91ffb700 1 -- 172.21.15.84:0/2525958987 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d98000d10 con 0x7f7d9c069560 2023-10-06T02:55:24.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce0b83700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcdc157460 0x7efcdc06a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce0b83700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcdc157460 0x7efcdc06a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:51472/0 (socket says 172.21.15.84:51472) 2023-10-06T02:55:24.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce0b83700 1 -- 172.21.15.84:0/175826093 learned_addr learned my addr 172.21.15.84:0/175826093 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce1b85700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc157830 0x7efcdc142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7efce1384700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc0ac480 0x7efcdc147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7efce1384700 1 -- 172.21.15.84:0/175826093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc157830 msgr2=0x7efcdc142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7efce1384700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc157830 0x7efcdc142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7efce1384700 1 -- 172.21.15.84:0/175826093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcdc157460 msgr2=0x7efcdc06a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7efce1384700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcdc157460 0x7efcdc06a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7efce1384700 1 -- 172.21.15.84:0/175826093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc009420 con 0x7efcdc0ac480 2023-10-06T02:55:24.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7efce1384700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc0ac480 0x7efcdc147cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efcd800c4e0 tx=0x7efcd8007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7fef2d714700 1 -- 172.21.15.84:0/2782528527 shutdown_connections 2023-10-06T02:55:24.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7fef2d714700 1 -- 172.21.15.84:0/2782528527 wait complete. 2023-10-06T02:55:24.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.993+0000 7f185917f700 1 -- start start 2023-10-06T02:55:24.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f185917f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185406c370 0x7f18540c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f185917f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18540cc750 0x7f18540c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f185917f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1854156390 0x7f18540c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f185917f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540c6f00 con 0x7f1854156390 2023-10-06T02:55:24.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f185917f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540c6bd0 con 0x7f185406c370 2023-10-06T02:55:24.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f185917f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18540b0260 con 0x7f18540cc750 2023-10-06T02:55:24.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f1852d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185406c370 0x7f18540c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f185259c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18540cc750 0x7f18540c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f1852d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185406c370 0x7f18540c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:51482/0 (socket says 172.21.15.84:51482) 2023-10-06T02:55:24.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.994+0000 7f1852d9d700 1 -- 172.21.15.84:0/3652144819 learned_addr learned my addr 172.21.15.84:0/3652144819 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7f7d91ffb700 1 -- 172.21.15.84:0/2525958987 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9800bbe0 con 0x7f7d9c069560 2023-10-06T02:55:24.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7f7d91ffb700 1 -- 172.21.15.84:0/2525958987 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9801a680 con 0x7f7d9c069560 2023-10-06T02:55:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c15a570 con 0x7f7d9c069560 2023-10-06T02:55:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c15ab30 con 0x7f7d9c069560 2023-10-06T02:55:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7f1852d9d700 1 -- 172.21.15.84:0/3652144819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18540cc750 msgr2=0x7f18540c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7f1852d9d700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18540cc750 0x7f18540c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7f1852d9d700 1 -- 172.21.15.84:0/3652144819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1854156390 msgr2=0x7f18540c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7f1852d9d700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1854156390 0x7f18540c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7f1852d9d700 1 -- 172.21.15.84:0/3652144819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844009420 con 0x7f185406c370 2023-10-06T02:55:24.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7fef2d714700 1 Processor -- start 2023-10-06T02:55:24.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.995+0000 7fef2d714700 1 -- start start 2023-10-06T02:55:24.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7efcd17fa700 1 -- 172.21.15.84:0/175826093 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8005d20 con 0x7efcdc0ac480 2023-10-06T02:55:24.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7f1852d9d700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185406c370 0x7f18540c4b90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f185406c910 tx=0x7f1844017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7efcd17fa700 1 -- 172.21.15.84:0/175826093 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8005e80 con 0x7efcdc0ac480 2023-10-06T02:55:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc146f10 con 0x7efcdc0ac480 2023-10-06T02:55:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7fef2d714700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef28070810 0x7fef28143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7fef2d714700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef28070c90 0x7fef280aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7fef2d714700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ab2f0 0x7fef28069dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7fef2d714700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28142eb0 con 0x7fef280ab2f0 2023-10-06T02:55:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7fef2d714700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28143190 con 0x7fef28070810 2023-10-06T02:55:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7fef2d714700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef28143470 con 0x7fef28070c90 2023-10-06T02:55:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.997+0000 7fef277fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ab2f0 0x7fef28069dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.997+0000 7fef277fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ab2f0 0x7fef28069dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39914/0 (socket says 172.21.15.84:39914) 2023-10-06T02:55:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.997+0000 7fef277fe700 1 -- 172.21.15.84:0/4018948988 learned_addr learned my addr 172.21.15.84:0/4018948988 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.997+0000 7fef26ffd700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef28070810 0x7fef28143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.997+0000 7fef267fc700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef28070c90 0x7fef280aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.997+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9c087d70 con 0x7f7d9c069560 2023-10-06T02:55:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7efcd17fa700 1 -- 172.21.15.84:0/175826093 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80072e0 con 0x7efcdc0ac480 2023-10-06T02:55:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.996+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc1474d0 con 0x7efcdc0ac480 2023-10-06T02:55:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.997+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc147b20 con 0x7efcdc0ac480 2023-10-06T02:55:24.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f7d91ffb700 1 -- 172.21.15.84:0/2525958987 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d9801aa30 con 0x7f7d9c069560 2023-10-06T02:55:24.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f6822ffd700 1 -- 172.21.15.84:0/3384030533 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6834024070 con 0x7f683c15d920 2023-10-06T02:55:24.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f183affd700 1 -- 172.21.15.84:0/3652144819 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184401a430 con 0x7f185406c370 2023-10-06T02:55:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f6822ffd700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6828066f30 0x7f68280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f6822ffd700 1 -- 172.21.15.84:0/3384030533 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6834087450 con 0x7f683c15d920 2023-10-06T02:55:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f683affd700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6828066f30 0x7f68280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.999+0000 7f683affd700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6828066f30 0x7f68280693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6830001950 tx=0x7f6830009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f183affd700 1 -- 172.21.15.84:0/3652144819 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184401a590 con 0x7f185406c370 2023-10-06T02:55:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f183affd700 1 -- 172.21.15.84:0/3652144819 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184401a930 con 0x7f185406c370 2023-10-06T02:55:24.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18540b0540 con 0x7f185406c370 2023-10-06T02:55:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18540c5c10 con 0x7f185406c370 2023-10-06T02:55:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.999+0000 7fef277fe700 1 -- 172.21.15.84:0/4018948988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef28070c90 msgr2=0x7fef280aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.999+0000 7fef277fe700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef28070c90 0x7fef280aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.999+0000 7fef277fe700 1 -- 172.21.15.84:0/4018948988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef28070810 msgr2=0x7fef28143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.999+0000 7fef277fe700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef28070810 0x7fef28143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.999+0000 7fef277fe700 1 -- 172.21.15.84:0/4018948988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef20009ae0 con 0x7fef280ab2f0 2023-10-06T02:55:24.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f7d91ffb700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d80067000 0x7f7d800694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.998+0000 7f7d91ffb700 1 -- 172.21.15.84:0/2525958987 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7d98086570 con 0x7f7d9c069560 2023-10-06T02:55:24.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.999+0000 7f7da15ce700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d80067000 0x7f7d800694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.999+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18340052b0 con 0x7f185406c370 2023-10-06T02:55:24.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:23.999+0000 7fef277fe700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ab2f0 0x7fef28069dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef1800b590 tx=0x7fef18006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.000+0000 7f7da15ce700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d80067000 0x7f7d800694b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c15b840 tx=0x7f7d8c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.001+0000 7ff71511d700 1 Processor -- start 2023-10-06T02:55:24.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.001+0000 7ff71511d700 1 -- start start 2023-10-06T02:55:24.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.001+0000 7ff71511d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff710156540 0x7ff7100c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.001+0000 7ff71511d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7100c75b0 0x7ff71006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.001+0000 7ff71511d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7100acd60 con 0x7ff71006ebd0 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.001+0000 7ff71511d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71006f470 con 0x7ff710156540 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.001+0000 7ff71511d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71006f050 con 0x7ff7100c75b0 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70ed9d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff710156540 0x7ff7100c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70f59e700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff71006ebd0 0x7ff71006d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:36602/0 (socket says 172.21.15.84:36602) 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70f59e700 1 -- 172.21.15.84:0/2995280940 learned_addr learned my addr 172.21.15.84:0/2995280940 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70e59c700 1 --2- 172.21.15.84:0/2995280940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7100c75b0 0x7ff71006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70ed9d700 1 -- 172.21.15.84:0/2995280940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7100c75b0 msgr2=0x7ff71006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70ed9d700 1 --2- 172.21.15.84:0/2995280940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7100c75b0 0x7ff71006e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70ed9d700 1 -- 172.21.15.84:0/2995280940 >> v1:172.21.15.131:6789/0 conn(0x7ff71006ebd0 legacy=0x7ff71006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70ed9d700 1 -- 172.21.15.84:0/2995280940 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff710156910 con 0x7ff710156540 2023-10-06T02:55:24.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70e59c700 1 --2- 172.21.15.84:0/2995280940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7100c75b0 0x7ff71006e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7ff70ed9d700 1 --2- 172.21.15.84:0/2995280940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff710156540 0x7ff7100c7070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff704009910 tx=0x7ff7040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebe80fcbf13d5db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7f6822ffd700 1 -- 172.21.15.84:0/3384030533 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68340542f0 con 0x7f683c15d920 2023-10-06T02:55:24.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.002+0000 7fef0effd700 1 -- 172.21.15.84:0/4018948988 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800f5e0 con 0x7fef280ab2f0 2023-10-06T02:55:24.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.003+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef28143750 con 0x7fef280ab2f0 2023-10-06T02:55:24.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.003+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef28142b40 con 0x7fef280ab2f0 2023-10-06T02:55:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.003+0000 7ff70dd9b700 1 -- 172.21.15.84:0/2995280940 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400b640 con 0x7ff710156540 2023-10-06T02:55:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.003+0000 7ff70dd9b700 1 -- 172.21.15.84:0/2995280940 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70400b7a0 con 0x7ff710156540 2023-10-06T02:55:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.003+0000 7ff70dd9b700 1 -- 172.21.15.84:0/2995280940 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400bb60 con 0x7ff710156540 2023-10-06T02:55:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.004+0000 7ff71511d700 1 -- 172.21.15.84:0/2995280940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff710156540 msgr2=0x7ff7100c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.004+0000 7ff71511d700 1 --2- 172.21.15.84:0/2995280940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff710156540 0x7ff7100c7070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff704009910 tx=0x7ff7040091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.004+0000 7f183affd700 1 -- 172.21.15.84:0/3652144819 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1844011420 con 0x7f185406c370 2023-10-06T02:55:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.004+0000 7f4509c9d700 1 Processor -- start 2023-10-06T02:55:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.004+0000 7f4509c9d700 1 -- start start 2023-10-06T02:55:24.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.003+0000 7f7d91ffb700 1 -- 172.21.15.84:0/2525958987 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d98053410 con 0x7f7d9c069560 2023-10-06T02:55:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.005+0000 7efcd17fa700 1 -- 172.21.15.84:0/175826093 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcd80076d0 con 0x7efcdc0ac480 2023-10-06T02:55:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.005+0000 7f183affd700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1840067030 0x7f18400694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.005+0000 7f183affd700 1 -- 172.21.15.84:0/3652144819 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1844086d30 con 0x7f185406c370 2023-10-06T02:55:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.005+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef28064ad0 con 0x7fef280ab2f0 2023-10-06T02:55:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.005+0000 7fef0effd700 1 -- 172.21.15.84:0/4018948988 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800f740 con 0x7fef280ab2f0 2023-10-06T02:55:24.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.005+0000 7fef0effd700 1 -- 172.21.15.84:0/4018948988 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800fb00 con 0x7fef280ab2f0 2023-10-06T02:55:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.005+0000 7efcd17fa700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efcc0067000 0x7efcc00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.005+0000 7efcd17fa700 1 -- 172.21.15.84:0/175826093 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efcd80846a0 con 0x7efcdc0ac480 2023-10-06T02:55:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7ff71511d700 1 -- 172.21.15.84:0/2995280940 shutdown_connections 2023-10-06T02:55:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7ff71511d700 1 --2- 172.21.15.84:0/2995280940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff710156540 0x7ff7100c7070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7ff71511d700 1 --2- 172.21.15.84:0/2995280940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7100c75b0 0x7ff71006e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7ff71511d700 1 -- 172.21.15.84:0/2995280940 >> 172.21.15.84:0/2995280940 conn(0x7ff7100680c0 msgr2=0x7ff7100cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7ff71511d700 1 -- 172.21.15.84:0/2995280940 shutdown_connections 2023-10-06T02:55:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7ff71511d700 1 -- 172.21.15.84:0/2995280940 wait complete. 2023-10-06T02:55:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f4509c9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f4509c9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f45040c75b0 0x7f450406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f4509c9d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45040acd60 con 0x7f450406ebd0 2023-10-06T02:55:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f4509c9d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450406f470 con 0x7f45040c75b0 2023-10-06T02:55:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f4509c9d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450406f050 con 0x7f4504156540 2023-10-06T02:55:24.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f4502ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f45040c75b0 0x7f450406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f4503fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f450406ebd0 0x7f450406d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49162/0 (socket says 172.21.15.84:49162) 2023-10-06T02:55:24.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f4503fff700 1 -- 172.21.15.84:0/2372132989 learned_addr learned my addr 172.21.15.84:0/2372132989 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f45037fe700 1 --2- 172.21.15.84:0/2372132989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.006+0000 7f185259c700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1840067030 0x7f18400694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.007+0000 7f185259c700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1840067030 0x7f18400694e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18540c3120 tx=0x7f1848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.007+0000 7f45037fe700 1 -- 172.21.15.84:0/2372132989 >> v2:172.21.15.84:3300/0 conn(0x7f45040c75b0 msgr2=0x7f450406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.007+0000 7f45037fe700 1 --2- 172.21.15.84:0/2372132989 >> v2:172.21.15.84:3300/0 conn(0x7f45040c75b0 0x7f450406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.007+0000 7f45037fe700 1 -- 172.21.15.84:0/2372132989 >> v1:172.21.15.84:6789/0 conn(0x7f450406ebd0 legacy=0x7f450406d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.007+0000 7f45037fe700 1 -- 172.21.15.84:0/2372132989 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504156910 con 0x7f4504156540 2023-10-06T02:55:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.007+0000 7f45037fe700 1 --2- 172.21.15.84:0/2372132989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c7070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44f80098e0 tx=0x7f44f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e9e2c4a0a64b729 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.007+0000 7f45027fc700 1 -- 172.21.15.84:0/2372132989 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800b640 con 0x7f4504156540 2023-10-06T02:55:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.007+0000 7f45027fc700 1 -- 172.21.15.84:0/2372132989 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800b7a0 con 0x7f4504156540 2023-10-06T02:55:24.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.007+0000 7f45027fc700 1 -- 172.21.15.84:0/2372132989 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800bb40 con 0x7f4504156540 2023-10-06T02:55:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7ff71511d700 1 Processor -- start 2023-10-06T02:55:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7efce0b83700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efcc0067000 0x7efcc00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7f183affd700 1 -- 172.21.15.84:0/3652144819 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1844053cb0 con 0x7f185406c370 2023-10-06T02:55:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7ff71511d700 1 -- start start 2023-10-06T02:55:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7f4509c9d700 1 -- 172.21.15.84:0/2372132989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 msgr2=0x7f45040c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7f4509c9d700 1 --2- 172.21.15.84:0/2372132989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c7070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f44f80098e0 tx=0x7f44f80091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7f4509c9d700 1 -- 172.21.15.84:0/2372132989 shutdown_connections 2023-10-06T02:55:24.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7f4509c9d700 1 --2- 172.21.15.84:0/2372132989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c7070 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7f4509c9d700 1 --2- 172.21.15.84:0/2372132989 >> v2:172.21.15.84:3300/0 conn(0x7f45040c75b0 0x7f450406e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7f4509c9d700 1 -- 172.21.15.84:0/2372132989 >> 172.21.15.84:0/2372132989 conn(0x7f45040680c0 msgr2=0x7f45040cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7f4509c9d700 1 -- 172.21.15.84:0/2372132989 shutdown_connections 2023-10-06T02:55:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.008+0000 7f4509c9d700 1 -- 172.21.15.84:0/2372132989 wait complete. 2023-10-06T02:55:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.009+0000 7ff71511d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71006ebd0 0x7ff7100bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.009+0000 7ff71511d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7100c75b0 0x7ff710154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.009+0000 7ff71511d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff710156540 0x7ff7101658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.009+0000 7ff71511d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100c5eb0 con 0x7ff7100c75b0 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.009+0000 7ff71511d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710154690 con 0x7ff710156540 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.009+0000 7ff71511d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100c3600 con 0x7ff71006ebd0 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.009+0000 7ff70ed9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71006ebd0 0x7ff7100bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.009+0000 7ff70ed9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71006ebd0 0x7ff7100bfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:60526/0 (socket says 172.21.15.84:60526) 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.009+0000 7ff70ed9d700 1 -- 172.21.15.84:0/2035287795 learned_addr learned my addr 172.21.15.84:0/2035287795 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.010+0000 7ff70ed9d700 1 -- 172.21.15.84:0/2035287795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff710156540 msgr2=0x7ff7101658e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.010+0000 7ff70ed9d700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff710156540 0x7ff7101658e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.010+0000 7ff70ed9d700 1 -- 172.21.15.84:0/2035287795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7100c75b0 msgr2=0x7ff710154150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T02:55:24.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.010+0000 7ff70ed9d700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7100c75b0 0x7ff710154150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.010+0000 7ff70ed9d700 1 -- 172.21.15.84:0/2035287795 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff708009420 con 0x7ff71006ebd0 2023-10-06T02:55:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.010+0000 7efce0b83700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efcc0067000 0x7efcc00694b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efcdc06ab60 tx=0x7efccc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.010+0000 7f4509c9d700 1 Processor -- start 2023-10-06T02:55:24.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.010+0000 7ff70ed9d700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71006ebd0 0x7ff7100bfaf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff704009fb0 tx=0x7ff704017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.010+0000 7f4509c9d700 1 -- start start 2023-10-06T02:55:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.011+0000 7f4509c9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f450406ebd0 0x7f4504177650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4509c9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45040c75b0 0x7f450414e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4509c9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4509c9d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040c4d20 con 0x7f450406ebd0 2023-10-06T02:55:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4509c9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040c3df0 con 0x7f45040c75b0 2023-10-06T02:55:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4509c9d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45040c40d0 con 0x7f4504156540 2023-10-06T02:55:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4503fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4502ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45040c75b0 0x7f450414e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4503fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:60542/0 (socket says 172.21.15.84:60542) 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4503fff700 1 -- 172.21.15.84:0/3050266283 learned_addr learned my addr 172.21.15.84:0/3050266283 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4502ffd700 1 -- 172.21.15.84:0/3050266283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 msgr2=0x7f45040c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4502ffd700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4502ffd700 1 -- 172.21.15.84:0/3050266283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f450406ebd0 msgr2=0x7f4504177650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4502ffd700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f450406ebd0 0x7f4504177650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4502ffd700 1 -- 172.21.15.84:0/3050266283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8009420 con 0x7f45040c75b0 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4503fff700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.012+0000 7f4502ffd700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45040c75b0 0x7f450414e150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44f400ea50 tx=0x7f44f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.013+0000 7f44eb7fe700 1 -- 172.21.15.84:0/3050266283 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400c7f0 con 0x7f45040c75b0 2023-10-06T02:55:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.013+0000 7f44eb7fe700 1 -- 172.21.15.84:0/3050266283 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400c970 con 0x7f45040c75b0 2023-10-06T02:55:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.013+0000 7f44eb7fe700 1 -- 172.21.15.84:0/3050266283 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400cd30 con 0x7f45040c75b0 2023-10-06T02:55:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.013+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45040c43b0 con 0x7f45040c75b0 2023-10-06T02:55:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.013+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450414e690 con 0x7f45040c75b0 2023-10-06T02:55:24.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.015+0000 7efcd17fa700 1 -- 172.21.15.84:0/175826093 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcd80515d0 con 0x7efcdc0ac480 2023-10-06T02:55:24.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.017+0000 7fef0effd700 1 -- 172.21.15.84:0/4018948988 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef18024430 con 0x7fef280ab2f0 2023-10-06T02:55:24.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.018+0000 7fef0effd700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef14066f30 0x7fef140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.018+0000 7fef0effd700 1 -- 172.21.15.84:0/4018948988 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fef18084f80 con 0x7fef280ab2f0 2023-10-06T02:55:24.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.018+0000 7fef26ffd700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef14066f30 0x7fef140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.018+0000 7fef0effd700 1 -- 172.21.15.84:0/4018948988 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef18085500 con 0x7fef280ab2f0 2023-10-06T02:55:24.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.018+0000 7fef26ffd700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef14066f30 0x7fef140693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fef2806bcc0 tx=0x7fef20017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.021+0000 7ff6f6ffd700 1 -- 172.21.15.84:0/2035287795 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70401f070 con 0x7ff71006ebd0 2023-10-06T02:55:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.021+0000 7ff6f6ffd700 1 -- 172.21.15.84:0/2035287795 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff704000c90 con 0x7ff71006ebd0 2023-10-06T02:55:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.021+0000 7ff6f6ffd700 1 -- 172.21.15.84:0/2035287795 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400bb60 con 0x7ff71006ebd0 2023-10-06T02:55:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.021+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff704009420 con 0x7ff71006ebd0 2023-10-06T02:55:24.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.021+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff710166410 con 0x7ff71006ebd0 2023-10-06T02:55:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.022+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71006bee0 con 0x7ff71006ebd0 2023-10-06T02:55:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.015+0000 7f44eb7fe700 1 -- 172.21.15.84:0/3050266283 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44f4013680 con 0x7f45040c75b0 2023-10-06T02:55:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.015+0000 7f44eb7fe700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f44ec0670d0 0x7f44ec069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.015+0000 7f44eb7fe700 1 -- 172.21.15.84:0/3050266283 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f44f4084c00 con 0x7f45040c75b0 2023-10-06T02:55:24.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.015+0000 7f45037fe700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f44ec0670d0 0x7f44ec069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.016+0000 7f45037fe700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f44ec0670d0 0x7f44ec069580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44f80091e0 tx=0x7f44f8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.030+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45040c4540 con 0x7f45040c75b0 2023-10-06T02:55:24.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.030+0000 7ff6f6ffd700 1 -- 172.21.15.84:0/2035287795 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff704023070 con 0x7ff71006ebd0 2023-10-06T02:55:24.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.031+0000 7ff6f6ffd700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6fc067080 0x7ff6fc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.031+0000 7ff6f6ffd700 1 -- 172.21.15.84:0/2035287795 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff704085da0 con 0x7ff71006ebd0 2023-10-06T02:55:24.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.031+0000 7ff70e59c700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6fc067080 0x7ff6fc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.031+0000 7ff70e59c700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6fc067080 0x7ff6fc069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff710069f50 tx=0x7ff7080091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.035+0000 7f44eb7fe700 1 -- 172.21.15.84:0/3050266283 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44f4051980 con 0x7f45040c75b0 2023-10-06T02:55:24.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.041+0000 7ff6f6ffd700 1 -- 172.21.15.84:0/2035287795 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff704052ba0 con 0x7ff71006ebd0 2023-10-06T02:55:24.348 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:24.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.337+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56c8005560 con 0x7f56e8069aa0 2023-10-06T02:55:24.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.337+0000 7f56dd7fa700 1 -- 172.21.15.84:0/3824904357 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56e0054ae0 con 0x7f56e8069aa0 2023-10-06T02:55:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.349+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f56d40671a0 msgr2=0x7f56d4069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.349+0000 7f56ef338700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f56d40671a0 0x7f56d4069650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f56d80093f0 tx=0x7f56d8008040 comp rx=0 tx=0).stop 2023-10-06T02:55:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.349+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8069aa0 msgr2=0x7f56e80c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.349+0000 7f56ef338700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8069aa0 0x7f56e80c4730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f56e000cd30 tx=0x7f56e0001ad0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.355+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 shutdown_connections 2023-10-06T02:55:24.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.355+0000 7f56ef338700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f56d40671a0 0x7f56d4069650 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.355+0000 7f56ef338700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56e8161200 0x7f56e814a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.355+0000 7f56ef338700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8069aa0 0x7f56e80c4730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.355+0000 7f56ef338700 1 --2- 172.21.15.84:0/3824904357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56e8160e30 0x7f56e80c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.355+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 >> 172.21.15.84:0/3824904357 conn(0x7f56e80680c0 msgr2=0x7f56e80c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.355+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 shutdown_connections 2023-10-06T02:55:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.355+0000 7f56ef338700 1 -- 172.21.15.84:0/3824904357 wait complete. 2023-10-06T02:55:24.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-10-06T02:55:24.378 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:24.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.378+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1834005830 con 0x7f185406c370 2023-10-06T02:55:24.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.379+0000 7f183affd700 1 -- 172.21.15.84:0/3652144819 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18440572d0 con 0x7f185406c370 2023-10-06T02:55:24.390 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1840067030 msgr2=0x7f18400694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1840067030 0x7f18400694e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18540c3120 tx=0x7f1848009040 comp rx=0 tx=0).stop 2023-10-06T02:55:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185406c370 msgr2=0x7f18540c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185406c370 0x7f18540c4b90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f185406c910 tx=0x7f1844017000 comp rx=0 tx=0).stop 2023-10-06T02:55:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 shutdown_connections 2023-10-06T02:55:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1840067030 0x7f18400694e0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18540c3120 tx=0x7f1848009040 comp rx=0 tx=0).stop 2023-10-06T02:55:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185406c370 0x7f18540c4b90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1854156390 0x7f18540c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 --2- 172.21.15.84:0/3652144819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18540cc750 0x7f18540c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.391+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 >> 172.21.15.84:0/3652144819 conn(0x7f18540cdef0 msgr2=0x7f18540cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.392+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 shutdown_connections 2023-10-06T02:55:24.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.392+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7d9c064ad0 con 0x7f7d9c069560 2023-10-06T02:55:24.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.392+0000 7f7d91ffb700 1 -- 172.21.15.84:0/2525958987 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d98056a30 con 0x7f7d9c069560 2023-10-06T02:55:24.394 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:24.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.393+0000 7f185917f700 1 -- 172.21.15.84:0/3652144819 wait complete. 2023-10-06T02:55:24.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.394+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f683c15b310 con 0x7f683c15d920 2023-10-06T02:55:24.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7efcdc064ad0 con 0x7efcdc0ac480 2023-10-06T02:55:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d80067000 msgr2=0x7f7d800694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d80067000 0x7f7d800694b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c15b840 tx=0x7f7d8c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c069560 msgr2=0x7f7d9c0c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c069560 0x7f7d9c0c2630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d980094c0 tx=0x7f7d98017000 comp rx=0 tx=0).stop 2023-10-06T02:55:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 shutdown_connections 2023-10-06T02:55:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d80067000 0x7f7d800694b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d9c069560 0x7f7d9c0c2630 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d980094c0 tx=0x7f7d98017000 comp rx=0 tx=0).stop 2023-10-06T02:55:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d9c0c8320 0x7f7d9c0c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 --2- 172.21.15.84:0/2525958987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d9c0878f0 0x7f7d9c0c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 >> 172.21.15.84:0/2525958987 conn(0x7f7d9c0680c0 msgr2=0x7f7d9c0c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 shutdown_connections 2023-10-06T02:55:24.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7efcd17fa700 1 -- 172.21.15.84:0/175826093 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efcd8017020 con 0x7efcdc0ac480 2023-10-06T02:55:24.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.400+0000 7f7da4033700 1 -- 172.21.15.84:0/2525958987 wait complete. 2023-10-06T02:55:24.403 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:24.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efcc0067000 msgr2=0x7efcc00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efcc0067000 0x7efcc00694b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efcdc06ab60 tx=0x7efccc017000 comp rx=0 tx=0).stop 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc0ac480 msgr2=0x7efcdc147cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc0ac480 0x7efcdc147cd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efcd800c4e0 tx=0x7efcd8007e50 comp rx=0 tx=0).stop 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 shutdown_connections 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efcc0067000 0x7efcc00694b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efcdc157830 0x7efcdc142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcdc0ac480 0x7efcdc147cd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 --2- 172.21.15.84:0/175826093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcdc157460 0x7efcdc06a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 >> 172.21.15.84:0/175826093 conn(0x7efcdc06de80 msgr2=0x7efcdc0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.402+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 shutdown_connections 2023-10-06T02:55:24.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.403+0000 7efce35e8700 1 -- 172.21.15.84:0/175826093 wait complete. 2023-10-06T02:55:24.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.403+0000 7f6822ffd700 1 -- 172.21.15.84:0/3384030533 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f683402c020 con 0x7f683c15d920 2023-10-06T02:55:24.406 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2023-10-06T02:55:24.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.405+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6828066f30 msgr2=0x7f68280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.405+0000 7f68416eb700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6828066f30 0x7f68280693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6830001950 tx=0x7f6830009040 comp rx=0 tx=0).stop 2023-10-06T02:55:24.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.405+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 msgr2=0x7f683c16dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.405+0000 7f68416eb700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 0x7f683c16dc10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f68340097c0 tx=0x7f6834019000 comp rx=0 tx=0).stop 2023-10-06T02:55:24.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.409+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 shutdown_connections 2023-10-06T02:55:24.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.409+0000 7f68416eb700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6828066f30 0x7f68280693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.409+0000 7f68416eb700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f683c15d920 0x7f683c16dc10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.409+0000 7f68416eb700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f683c069c70 0x7f683c1528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.409+0000 7f68416eb700 1 --2- 172.21.15.84:0/3384030533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f683c159a60 0x7f683c150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.409+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 >> 172.21.15.84:0/3384030533 conn(0x7f683c0680c0 msgr2=0x7f683c0cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.410+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fef28145c20 con 0x7fef280ab2f0 2023-10-06T02:55:24.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-06T02:55:24.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.411+0000 7fef0effd700 1 -- 172.21.15.84:0/4018948988 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef18051fb0 con 0x7fef280ab2f0 2023-10-06T02:55:24.413 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:24.413 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:24.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.413+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef14066f30 msgr2=0x7fef140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.413+0000 7fef2d714700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef14066f30 0x7fef140693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fef2806bcc0 tx=0x7fef20017000 comp rx=0 tx=0).stop 2023-10-06T02:55:24.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.413+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ab2f0 msgr2=0x7fef28069dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.413+0000 7fef2d714700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ab2f0 0x7fef28069dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef1800b590 tx=0x7fef18006f90 comp rx=0 tx=0).stop 2023-10-06T02:55:24.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.414+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 shutdown_connections 2023-10-06T02:55:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.414+0000 7fef2d714700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef14066f30 0x7fef140693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.414+0000 7fef2d714700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef28070810 0x7fef28143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.414+0000 7fef2d714700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef280ab2f0 0x7fef28069dc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.414+0000 7fef2d714700 1 --2- 172.21.15.84:0/4018948988 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef28070c90 0x7fef280aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.414+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 >> 172.21.15.84:0/4018948988 conn(0x7fef2806de80 msgr2=0x7fef281669d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.414+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 shutdown_connections 2023-10-06T02:55:24.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.414+0000 7fef2d714700 1 -- 172.21.15.84:0/4018948988 wait complete. 2023-10-06T02:55:24.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.418+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 shutdown_connections 2023-10-06T02:55:24.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.421+0000 7f68416eb700 1 -- 172.21.15.84:0/3384030533 wait complete. 2023-10-06T02:55:24.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-10-06T02:55:24.423 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:24.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.424+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4504064ad0 con 0x7f45040c75b0 2023-10-06T02:55:24.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.425+0000 7f44eb7fe700 1 -- 172.21.15.84:0/3050266283 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44f4017090 con 0x7f45040c75b0 2023-10-06T02:55:24.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-10-06T02:55:24.429 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2023-10-06T02:55:24.429 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:24.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-10-06T02:55:24.431 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:24.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.429+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f44ec0670d0 msgr2=0x7f44ec069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.429+0000 7f4509c9d700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f44ec0670d0 0x7f44ec069580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44f80091e0 tx=0x7f44f8017000 comp rx=0 tx=0).stop 2023-10-06T02:55:24.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.429+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45040c75b0 msgr2=0x7f450414e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.429+0000 7f4509c9d700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45040c75b0 0x7f450414e150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44f400ea50 tx=0x7f44f40091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.430+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 shutdown_connections 2023-10-06T02:55:24.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.430+0000 7f4509c9d700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f44ec0670d0 0x7f44ec069580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.430+0000 7f4509c9d700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4504156540 0x7f45040c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.430+0000 7f4509c9d700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f450406ebd0 0x7f4504177650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.430+0000 7f4509c9d700 1 --2- 172.21.15.84:0/3050266283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45040c75b0 0x7f450414e150 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.430+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 >> 172.21.15.84:0/3050266283 conn(0x7f45040680c0 msgr2=0x7f45041556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.430+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 shutdown_connections 2023-10-06T02:55:24.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.430+0000 7f4509c9d700 1 -- 172.21.15.84:0/3050266283 wait complete. 2023-10-06T02:55:24.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.430+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff7100c33e0 con 0x7ff71006ebd0 2023-10-06T02:55:24.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.431+0000 7ff6f6ffd700 1 -- 172.21.15.84:0/2035287795 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7040561c0 con 0x7ff71006ebd0 2023-10-06T02:55:24.435 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-10-06T02:55:24.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6fc067080 msgr2=0x7ff6fc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6fc067080 0x7ff6fc069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff710069f50 tx=0x7ff7080091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71006ebd0 msgr2=0x7ff7100bfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71006ebd0 0x7ff7100bfaf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff704009fb0 tx=0x7ff704017000 comp rx=0 tx=0).stop 2023-10-06T02:55:24.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 shutdown_connections 2023-10-06T02:55:24.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6fc067080 0x7ff6fc069530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff710156540 0x7ff7101658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff71006ebd0 0x7ff7100bfaf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 --2- 172.21.15.84:0/2035287795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7100c75b0 0x7ff710154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 >> 172.21.15.84:0/2035287795 conn(0x7ff7100680c0 msgr2=0x7ff7100b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.434+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 shutdown_connections 2023-10-06T02:55:24.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.435+0000 7ff71511d700 1 -- 172.21.15.84:0/2035287795 wait complete. 2023-10-06T02:55:24.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-10-06T02:55:24.440 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:24.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-10-06T02:55:24.454 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:24.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-10-06T02:55:24.455 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:24.455 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T02:55:24.455 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:55:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.607+0000 7f53a9b05700 1 Processor -- start 2023-10-06T02:55:24.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.607+0000 7f53a9b05700 1 -- start start 2023-10-06T02:55:24.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.608+0000 7f53a9b05700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a40ca3b0 0x7f53a41582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.608+0000 7f53a9b05700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f53a40ce8e0 0x7f53a415af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.608+0000 7f53a9b05700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a4157e20 con 0x7f53a40adba0 2023-10-06T02:55:24.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.608+0000 7f53a9b05700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a40cbbd0 con 0x7f53a40ce8e0 2023-10-06T02:55:24.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.608+0000 7f53a9b05700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40cb610 con 0x7f53a40ca3b0 2023-10-06T02:55:24.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.608+0000 7f53a2ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f53a40adba0 0x7f53a40ce1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49166/0 (socket says 172.21.15.84:49166) 2023-10-06T02:55:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.608+0000 7f53a2ffd700 1 -- 172.21.15.84:0/497721976 learned_addr learned my addr 172.21.15.84:0/497721976 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a3fff700 1 --2- 172.21.15.84:0/497721976 >> v2:172.21.15.131:3300/0 conn(0x7f53a40ce8e0 0x7f53a415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a37fe700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a40ca3b0 0x7f53a41582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661155499 0 0) 0x7f53a4157e20 con 0x7f53a40adba0 2023-10-06T02:55:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f538c003570 con 0x7f53a40adba0 2023-10-06T02:55:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830479074 0 0) 0x7f538c003570 con 0x7f53a40adba0 2023-10-06T02:55:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a40ca3b0 msgr2=0x7f53a41582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a40ca3b0 0x7f53a41582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 >> v2:172.21.15.131:3300/0 conn(0x7f53a40ce8e0 msgr2=0x7f53a415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 --2- 172.21.15.84:0/497721976 >> v2:172.21.15.131:3300/0 conn(0x7f53a40ce8e0 0x7f53a415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40cb8f0 con 0x7f53a40adba0 2023-10-06T02:55:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f5398001470 con 0x7f53a40adba0 2023-10-06T02:55:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 >> v1:172.21.15.84:6789/0 conn(0x7f53a40adba0 legacy=0x7f53a40ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f538c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f538c004810 0x7f538c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a40ca3b0 0x7f538c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40cbbd0 con 0x7f538c003a60 2023-10-06T02:55:24.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40cb610 con 0x7f538c004810 2023-10-06T02:55:24.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c00ba60 con 0x7f53a40ca3b0 2023-10-06T02:55:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a37fe700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f538c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a2ffd700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f538c004810 0x7f538c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a3fff700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a40ca3b0 0x7f538c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a37fe700 1 -- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a40ca3b0 msgr2=0x7f538c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a37fe700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a40ca3b0 0x7f538c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a37fe700 1 -- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f538c004810 msgr2=0x7f538c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:24.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a37fe700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f538c004810 0x7f538c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a37fe700 1 -- 172.21.15.84:0/497721976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c003570 con 0x7f538c003a60 2023-10-06T02:55:24.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.609+0000 7f53a37fe700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f538c003e70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f539400e240 tx=0x7f539400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe280dcb76a6f629 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400eaf0 con 0x7f538c003a60 2023-10-06T02:55:24.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539400f040 con 0x7f538c003a60 2023-10-06T02:55:24.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a27fc700 1 -- 172.21.15.84:0/497721976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400eea0 con 0x7f538c003a60 2023-10-06T02:55:24.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a9b05700 1 -- 172.21.15.84:0/497721976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 msgr2=0x7f538c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a9b05700 1 --2- 172.21.15.84:0/497721976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f538c003e70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f539400e240 tx=0x7f539400b040 comp rx=0 tx=0).stop 2023-10-06T02:55:24.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a3fff700 1 -- 172.21.15.84:0/497721976 reap_dead start 2023-10-06T02:55:24.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a9b05700 1 -- 172.21.15.84:0/497721976 shutdown_connections 2023-10-06T02:55:24.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a9b05700 1 -- 172.21.15.84:0/497721976 >> 172.21.15.84:0/497721976 conn(0x7f53a4070810 msgr2=0x7f53a4070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a9b05700 1 -- 172.21.15.84:0/497721976 shutdown_connections 2023-10-06T02:55:24.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.610+0000 7f53a9b05700 1 -- 172.21.15.84:0/497721976 wait complete. 2023-10-06T02:55:24.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.611+0000 7f53a9b05700 1 Processor -- start 2023-10-06T02:55:24.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.611+0000 7f53a9b05700 1 -- start start 2023-10-06T02:55:24.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a9b05700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f53a41518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a9b05700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a4167c50 0x7f53a41680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a9b05700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a4158e10 0x7f53a4159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a9b05700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4152bd0 con 0x7f538c003a60 2023-10-06T02:55:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a9b05700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4168600 con 0x7f53a4158e10 2023-10-06T02:55:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a9b05700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4151fc0 con 0x7f53a4167c50 2023-10-06T02:55:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f53a41518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f53a41518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39942/0 (socket says 172.21.15.84:39942) 2023-10-06T02:55:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a37fe700 1 -- 172.21.15.84:0/2707981152 learned_addr learned my addr 172.21.15.84:0/2707981152 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a2ffd700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a4167c50 0x7f53a41680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.612+0000 7f53a3fff700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a4158e10 0x7f53a4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f53a37fe700 1 -- 172.21.15.84:0/2707981152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a4167c50 msgr2=0x7f53a41680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f53a37fe700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a4167c50 0x7f53a41680c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f53a37fe700 1 -- 172.21.15.84:0/2707981152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a4158e10 msgr2=0x7f53a4159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f53a37fe700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a4158e10 0x7f53a4159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f53a37fe700 1 -- 172.21.15.84:0/2707981152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a41522a0 con 0x7f538c003a60 2023-10-06T02:55:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f53a37fe700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f53a41518c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5394009c30 tx=0x7f539401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f538b7fe700 1 -- 172.21.15.84:0/2707981152 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394014ea0 con 0x7f538c003a60 2023-10-06T02:55:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f538b7fe700 1 -- 172.21.15.84:0/2707981152 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539401d420 con 0x7f538c003a60 2023-10-06T02:55:24.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a4152580 con 0x7f538c003a60 2023-10-06T02:55:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f538b7fe700 1 -- 172.21.15.84:0/2707981152 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539401d7c0 con 0x7f538c003a60 2023-10-06T02:55:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.613+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a4153060 con 0x7f538c003a60 2023-10-06T02:55:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.614+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a4152a20 con 0x7f538c003a60 2023-10-06T02:55:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.614+0000 7f538b7fe700 1 -- 172.21.15.84:0/2707981152 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5394003040 con 0x7f538c003a60 2023-10-06T02:55:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.614+0000 7f538b7fe700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5390066f30 0x7f53900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.615+0000 7f538b7fe700 1 -- 172.21.15.84:0/2707981152 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5394086920 con 0x7f538c003a60 2023-10-06T02:55:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.615+0000 7f53a2ffd700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5390066f30 0x7f53900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.615+0000 7f53a2ffd700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5390066f30 0x7f53900693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5398000e50 tx=0x7f5398001e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.619+0000 7f538b7fe700 1 -- 172.21.15.84:0/2707981152 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5394053740 con 0x7f538c003a60 2023-10-06T02:55:24.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.797+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53a4152d10 con 0x7f5390066f30 2023-10-06T02:55:24.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.807+0000 7f538b7fe700 1 -- 172.21.15.84:0/2707981152 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367388 (secure 0 0 0) 0x7f5398007120 con 0x7f5390066f30 2023-10-06T02:55:24.814 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.810+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5390066f30 msgr2=0x7f53900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.810+0000 7f53a9b05700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5390066f30 0x7f53900693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5398000e50 tx=0x7f5398001e90 comp rx=0 tx=0).stop 2023-10-06T02:55:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.810+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 msgr2=0x7f53a41518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.810+0000 7f53a9b05700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f53a41518c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5394009c30 tx=0x7f539401a000 comp rx=0 tx=0).stop 2023-10-06T02:55:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.811+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 shutdown_connections 2023-10-06T02:55:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.811+0000 7f53a9b05700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5390066f30 0x7f53900693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.811+0000 7f53a9b05700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a4158e10 0x7f53a4159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.811+0000 7f53a9b05700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f538c003a60 0x7f53a41518c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.811+0000 7f53a9b05700 1 --2- 172.21.15.84:0/2707981152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a4167c50 0x7f53a41680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.811+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 >> 172.21.15.84:0/2707981152 conn(0x7f53a4070810 msgr2=0x7f53a4153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.811+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 shutdown_connections 2023-10-06T02:55:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.811+0000 7f53a9b05700 1 -- 172.21.15.84:0/2707981152 wait complete. 2023-10-06T02:55:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:55:24.825 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-10-06T02:55:23.805937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381788,"kb_used_data":3484,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592932,"statfs":{"total":773094113280,"available":770655162368,"internally_reserved":0,"allocated":3567616,"data_stored":2143255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.713979"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239422+0000","last_change":"2023-10-06T02:55:07.110201+0000","last_active":"2023-10-06T02:55:11.239422+0000","last_peered":"2023-10-06T02:55:11.239422+0000","last_clean":"2023-10-06T02:55:11.239422+0000","last_became_active":"2023-10-06T02:55:07.109835+0000","last_became_peered":"2023-10-06T02:55:07.109835+0000","last_unstale":"2023-10-06T02:55:11.239422+0000","last_undegraded":"2023-10-06T02:55:11.239422+0000","last_fullsized":"2023-10-06T02:55:11.239422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:37.914521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236087+0000","last_change":"2023-10-06T02:55:07.113784+0000","last_active":"2023-10-06T02:55:11.236087+0000","last_peered":"2023-10-06T02:55:11.236087+0000","last_clean":"2023-10-06T02:55:11.236087+0000","last_became_active":"2023-10-06T02:55:07.113542+0000","last_became_peered":"2023-10-06T02:55:07.113542+0000","last_unstale":"2023-10-06T02:55:11.236087+0000","last_undegraded":"2023-10-06T02:55:11.236087+0000","last_fullsized":"2023-10-06T02:55:11.236087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:45.135333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244003+0000","last_change":"2023-10-06T02:55:07.109629+0000","last_active":"2023-10-06T02:55:11.244003+0000","last_peered":"2023-10-06T02:55:11.244003+0000","last_clean":"2023-10-06T02:55:11.244003+0000","last_became_active":"2023-10-06T02:55:07.109299+0000","last_became_peered":"2023-10-06T02:55:07.109299+0000","last_unstale":"2023-10-06T02:55:11.244003+0000","last_undegraded":"2023-10-06T02:55:11.244003+0000","last_fullsized":"2023-10-06T02:55:11.244003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:18.661747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236454+0000","last_change":"2023-10-06T02:55:07.109778+0000","last_active":"2023-10-06T02:55:11.236454+0000","last_peered":"2023-10-06T02:55:11.236454+0000","last_clean":"2023-10-06T02:55:11.236454+0000","last_became_active":"2023-10-06T02:55:07.109509+0000","last_became_peered":"2023-10-06T02:55:07.109509+0000","last_unstale":"2023-10-06T02:55:11.236454+0000","last_undegraded":"2023-10-06T02:55:11.236454+0000","last_fullsized":"2023-10-06T02:55:11.236454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:06.894832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243263+0000","last_change":"2023-10-06T02:55:07.114751+0000","last_active":"2023-10-06T02:55:11.243263+0000","last_peered":"2023-10-06T02:55:11.243263+0000","last_clean":"2023-10-06T02:55:11.243263+0000","last_became_active":"2023-10-06T02:55:07.114487+0000","last_became_peered":"2023-10-06T02:55:07.114487+0000","last_unstale":"2023-10-06T02:55:11.243263+0000","last_undegraded":"2023-10-06T02:55:11.243263+0000","last_fullsized":"2023-10-06T02:55:11.243263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244303+0000","last_change":"2023-10-06T02:55:07.111190+0000","last_active":"2023-10-06T02:55:11.244303+0000","last_peered":"2023-10-06T02:55:11.244303+0000","last_clean":"2023-10-06T02:55:11.244303+0000","last_became_active":"2023-10-06T02:55:07.110893+0000","last_became_peered":"2023-10-06T02:55:07.110893+0000","last_unstale":"2023-10-06T02:55:11.244303+0000","last_undegraded":"2023-10-06T02:55:11.244303+0000","last_fullsized":"2023-10-06T02:55:11.244303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:41.387727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.247033+0000","last_change":"2023-10-06T02:55:07.114160+0000","last_active":"2023-10-06T02:55:11.247033+0000","last_peered":"2023-10-06T02:55:11.247033+0000","last_clean":"2023-10-06T02:55:11.247033+0000","last_became_active":"2023-10-06T02:55:07.113571+0000","last_became_peered":"2023-10-06T02:55:07.113571+0000","last_unstale":"2023-10-06T02:55:11.247033+0000","last_undegraded":"2023-10-06T02:55:11.247033+0000","last_fullsized":"2023-10-06T02:55:11.247033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235851+0000","last_change":"2023-10-06T02:55:07.106766+0000","last_active":"2023-10-06T02:55:11.235851+0000","last_peered":"2023-10-06T02:55:11.235851+0000","last_clean":"2023-10-06T02:55:11.235851+0000","last_became_active":"2023-10-06T02:55:07.106562+0000","last_became_peered":"2023-10-06T02:55:07.106562+0000","last_unstale":"2023-10-06T02:55:11.235851+0000","last_undegraded":"2023-10-06T02:55:11.235851+0000","last_fullsized":"2023-10-06T02:55:11.235851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243386+0000","last_change":"2023-10-06T02:55:07.112458+0000","last_active":"2023-10-06T02:55:11.243386+0000","last_peered":"2023-10-06T02:55:11.243386+0000","last_clean":"2023-10-06T02:55:11.243386+0000","last_became_active":"2023-10-06T02:55:07.112034+0000","last_became_peered":"2023-10-06T02:55:07.112034+0000","last_unstale":"2023-10-06T02:55:11.243386+0000","last_undegraded":"2023-10-06T02:55:11.243386+0000","last_fullsized":"2023-10-06T02:55:11.243386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236308+0000","last_change":"2023-10-06T02:55:07.110571+0000","last_active":"2023-10-06T02:55:11.236308+0000","last_peered":"2023-10-06T02:55:11.236308+0000","last_clean":"2023-10-06T02:55:11.236308+0000","last_became_active":"2023-10-06T02:55:07.110305+0000","last_became_peered":"2023-10-06T02:55:07.110305+0000","last_unstale":"2023-10-06T02:55:11.236308+0000","last_undegraded":"2023-10-06T02:55:11.236308+0000","last_fullsized":"2023-10-06T02:55:11.236308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:48.545728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243893+0000","last_change":"2023-10-06T02:55:07.111579+0000","last_active":"2023-10-06T02:55:11.243893+0000","last_peered":"2023-10-06T02:55:11.243893+0000","last_clean":"2023-10-06T02:55:11.243893+0000","last_became_active":"2023-10-06T02:55:07.111318+0000","last_became_peered":"2023-10-06T02:55:07.111318+0000","last_unstale":"2023-10-06T02:55:11.243893+0000","last_undegraded":"2023-10-06T02:55:11.243893+0000","last_fullsized":"2023-10-06T02:55:11.243893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:47.019187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240508+0000","last_change":"2023-10-06T02:55:07.104069+0000","last_active":"2023-10-06T02:55:11.240508+0000","last_peered":"2023-10-06T02:55:11.240508+0000","last_clean":"2023-10-06T02:55:11.240508+0000","last_became_active":"2023-10-06T02:55:07.103805+0000","last_became_peered":"2023-10-06T02:55:07.103805+0000","last_unstale":"2023-10-06T02:55:11.240508+0000","last_undegraded":"2023-10-06T02:55:11.240508+0000","last_fullsized":"2023-10-06T02:55:11.240508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:05.829702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239484+0000","last_change":"2023-10-06T02:55:07.109817+0000","last_active":"2023-10-06T02:55:11.239484+0000","last_peered":"2023-10-06T02:55:11.239484+0000","last_clean":"2023-10-06T02:55:11.239484+0000","last_became_active":"2023-10-06T02:55:07.109582+0000","last_became_peered":"2023-10-06T02:55:07.109582+0000","last_unstale":"2023-10-06T02:55:11.239484+0000","last_undegraded":"2023-10-06T02:55:11.239484+0000","last_fullsized":"2023-10-06T02:55:11.239484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:51.423073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236216+0000","last_change":"2023-10-06T02:55:07.108183+0000","last_active":"2023-10-06T02:55:11.236216+0000","last_peered":"2023-10-06T02:55:11.236216+0000","last_clean":"2023-10-06T02:55:11.236216+0000","last_became_active":"2023-10-06T02:55:07.107919+0000","last_became_peered":"2023-10-06T02:55:07.107919+0000","last_unstale":"2023-10-06T02:55:11.236216+0000","last_undegraded":"2023-10-06T02:55:11.236216+0000","last_fullsized":"2023-10-06T02:55:11.236216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:50.364030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246844+0000","last_change":"2023-10-06T02:55:07.114341+0000","last_active":"2023-10-06T02:55:11.246844+0000","last_peered":"2023-10-06T02:55:11.246844+0000","last_clean":"2023-10-06T02:55:11.246844+0000","last_became_active":"2023-10-06T02:55:07.113900+0000","last_became_peered":"2023-10-06T02:55:07.113900+0000","last_unstale":"2023-10-06T02:55:11.246844+0000","last_undegraded":"2023-10-06T02:55:11.246844+0000","last_fullsized":"2023-10-06T02:55:11.246844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245965+0000","last_change":"2023-10-06T02:55:07.111225+0000","last_active":"2023-10-06T02:55:11.245965+0000","last_peered":"2023-10-06T02:55:11.245965+0000","last_clean":"2023-10-06T02:55:11.245965+0000","last_became_active":"2023-10-06T02:55:07.110865+0000","last_became_peered":"2023-10-06T02:55:07.110865+0000","last_unstale":"2023-10-06T02:55:11.245965+0000","last_undegraded":"2023-10-06T02:55:11.245965+0000","last_fullsized":"2023-10-06T02:55:11.245965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243421+0000","last_change":"2023-10-06T02:55:07.112286+0000","last_active":"2023-10-06T02:55:11.243421+0000","last_peered":"2023-10-06T02:55:11.243421+0000","last_clean":"2023-10-06T02:55:11.243421+0000","last_became_active":"2023-10-06T02:55:07.111766+0000","last_became_peered":"2023-10-06T02:55:07.111766+0000","last_unstale":"2023-10-06T02:55:11.243421+0000","last_undegraded":"2023-10-06T02:55:11.243421+0000","last_fullsized":"2023-10-06T02:55:11.243421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245058+0000","last_change":"2023-10-06T02:55:07.104506+0000","last_active":"2023-10-06T02:55:11.245058+0000","last_peered":"2023-10-06T02:55:11.245058+0000","last_clean":"2023-10-06T02:55:11.245058+0000","last_became_active":"2023-10-06T02:55:07.103148+0000","last_became_peered":"2023-10-06T02:55:07.103148+0000","last_unstale":"2023-10-06T02:55:11.245058+0000","last_undegraded":"2023-10-06T02:55:11.245058+0000","last_fullsized":"2023-10-06T02:55:11.245058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:30.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239743+0000","last_change":"2023-10-06T02:55:07.102510+0000","last_active":"2023-10-06T02:55:11.239743+0000","last_peered":"2023-10-06T02:55:11.239743+0000","last_clean":"2023-10-06T02:55:11.239743+0000","last_became_active":"2023-10-06T02:55:07.102223+0000","last_became_peered":"2023-10-06T02:55:07.102223+0000","last_unstale":"2023-10-06T02:55:11.239743+0000","last_undegraded":"2023-10-06T02:55:11.239743+0000","last_fullsized":"2023-10-06T02:55:11.239743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:03.327947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.241862+0000","last_change":"2023-10-06T02:55:07.103814+0000","last_active":"2023-10-06T02:55:11.241862+0000","last_peered":"2023-10-06T02:55:11.241862+0000","last_clean":"2023-10-06T02:55:11.241862+0000","last_became_active":"2023-10-06T02:55:07.103540+0000","last_became_peered":"2023-10-06T02:55:07.103540+0000","last_unstale":"2023-10-06T02:55:11.241862+0000","last_undegraded":"2023-10-06T02:55:11.241862+0000","last_fullsized":"2023-10-06T02:55:11.241862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249731+0000","last_change":"2023-10-06T02:55:07.111270+0000","last_active":"2023-10-06T02:55:11.249731+0000","last_peered":"2023-10-06T02:55:11.249731+0000","last_clean":"2023-10-06T02:55:11.249731+0000","last_became_active":"2023-10-06T02:55:07.110988+0000","last_became_peered":"2023-10-06T02:55:07.110988+0000","last_unstale":"2023-10-06T02:55:11.249731+0000","last_undegraded":"2023-10-06T02:55:11.249731+0000","last_fullsized":"2023-10-06T02:55:11.249731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242949+0000","last_change":"2023-10-06T02:55:07.112801+0000","last_active":"2023-10-06T02:55:11.242949+0000","last_peered":"2023-10-06T02:55:11.242949+0000","last_clean":"2023-10-06T02:55:11.242949+0000","last_became_active":"2023-10-06T02:55:07.112541+0000","last_became_peered":"2023-10-06T02:55:07.112541+0000","last_unstale":"2023-10-06T02:55:11.242949+0000","last_undegraded":"2023-10-06T02:55:11.242949+0000","last_fullsized":"2023-10-06T02:55:11.242949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:50.364030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.234999+0000","last_change":"2023-10-06T02:55:07.112735+0000","last_active":"2023-10-06T02:55:11.234999+0000","last_peered":"2023-10-06T02:55:11.234999+0000","last_clean":"2023-10-06T02:55:11.234999+0000","last_became_active":"2023-10-06T02:55:07.112354+0000","last_became_peered":"2023-10-06T02:55:07.112354+0000","last_unstale":"2023-10-06T02:55:11.234999+0000","last_undegraded":"2023-10-06T02:55:11.234999+0000","last_fullsized":"2023-10-06T02:55:11.234999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:30.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246446+0000","last_change":"2023-10-06T02:55:07.111427+0000","last_active":"2023-10-06T02:55:11.246446+0000","last_peered":"2023-10-06T02:55:11.246446+0000","last_clean":"2023-10-06T02:55:11.246446+0000","last_became_active":"2023-10-06T02:55:07.111175+0000","last_became_peered":"2023-10-06T02:55:07.111175+0000","last_unstale":"2023-10-06T02:55:11.246446+0000","last_undegraded":"2023-10-06T02:55:11.246446+0000","last_fullsized":"2023-10-06T02:55:11.246446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251151+0000","last_change":"2023-10-06T02:55:07.111532+0000","last_active":"2023-10-06T02:55:11.251151+0000","last_peered":"2023-10-06T02:55:11.251151+0000","last_clean":"2023-10-06T02:55:11.251151+0000","last_became_active":"2023-10-06T02:55:07.111049+0000","last_became_peered":"2023-10-06T02:55:07.111049+0000","last_unstale":"2023-10-06T02:55:11.251151+0000","last_undegraded":"2023-10-06T02:55:11.251151+0000","last_fullsized":"2023-10-06T02:55:11.251151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251111+0000","last_change":"2023-10-06T02:55:07.107260+0000","last_active":"2023-10-06T02:55:11.251111+0000","last_peered":"2023-10-06T02:55:11.251111+0000","last_clean":"2023-10-06T02:55:11.251111+0000","last_became_active":"2023-10-06T02:55:07.107057+0000","last_became_peered":"2023-10-06T02:55:07.107057+0000","last_unstale":"2023-10-06T02:55:11.251111+0000","last_undegraded":"2023-10-06T02:55:11.251111+0000","last_fullsized":"2023-10-06T02:55:11.251111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:03.676682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236378+0000","last_change":"2023-10-06T02:55:07.109107+0000","last_active":"2023-10-06T02:55:11.236378+0000","last_peered":"2023-10-06T02:55:11.236378+0000","last_clean":"2023-10-06T02:55:11.236378+0000","last_became_active":"2023-10-06T02:55:07.108804+0000","last_became_peered":"2023-10-06T02:55:07.108804+0000","last_unstale":"2023-10-06T02:55:11.236378+0000","last_undegraded":"2023-10-06T02:55:11.236378+0000","last_fullsized":"2023-10-06T02:55:11.236378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261436+0000","last_change":"2023-10-06T02:55:11.256831+0000","last_active":"2023-10-06T02:55:11.261436+0000","last_peered":"2023-10-06T02:55:11.261436+0000","last_clean":"2023-10-06T02:55:11.261436+0000","last_became_active":"2023-10-06T02:55:11.255607+0000","last_became_peered":"2023-10-06T02:55:11.255607+0000","last_unstale":"2023-10-06T02:55:11.261436+0000","last_undegraded":"2023-10-06T02:55:11.261436+0000","last_fullsized":"2023-10-06T02:55:11.261436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:59.809138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244213+0000","last_change":"2023-10-06T02:55:06.241953+0000","last_active":"2023-10-06T02:55:11.244213+0000","last_peered":"2023-10-06T02:55:11.244213+0000","last_clean":"2023-10-06T02:55:11.244213+0000","last_became_active":"2023-10-06T02:55:06.241631+0000","last_became_peered":"2023-10-06T02:55:06.241631+0000","last_unstale":"2023-10-06T02:55:11.244213+0000","last_undegraded":"2023-10-06T02:55:11.244213+0000","last_fullsized":"2023-10-06T02:55:11.244213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:13.153122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235457+0000","last_change":"2023-10-06T02:55:07.116546+0000","last_active":"2023-10-06T02:55:11.235457+0000","last_peered":"2023-10-06T02:55:11.235457+0000","last_clean":"2023-10-06T02:55:11.235457+0000","last_became_active":"2023-10-06T02:55:07.116298+0000","last_became_peered":"2023-10-06T02:55:07.116298+0000","last_unstale":"2023-10-06T02:55:11.235457+0000","last_undegraded":"2023-10-06T02:55:11.235457+0000","last_fullsized":"2023-10-06T02:55:11.235457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:09.033880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261529+0000","last_change":"2023-10-06T02:55:11.255287+0000","last_active":"2023-10-06T02:55:11.261529+0000","last_peered":"2023-10-06T02:55:11.261529+0000","last_clean":"2023-10-06T02:55:11.261529+0000","last_became_active":"2023-10-06T02:55:11.254851+0000","last_became_peered":"2023-10-06T02:55:11.254851+0000","last_unstale":"2023-10-06T02:55:11.261529+0000","last_undegraded":"2023-10-06T02:55:11.261529+0000","last_fullsized":"2023-10-06T02:55:11.261529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:39.598115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250011+0000","last_change":"2023-10-06T02:55:06.241290+0000","last_active":"2023-10-06T02:55:11.250011+0000","last_peered":"2023-10-06T02:55:11.250011+0000","last_clean":"2023-10-06T02:55:11.250011+0000","last_became_active":"2023-10-06T02:55:06.240960+0000","last_became_peered":"2023-10-06T02:55:06.240960+0000","last_unstale":"2023-10-06T02:55:11.250011+0000","last_undegraded":"2023-10-06T02:55:11.250011+0000","last_fullsized":"2023-10-06T02:55:11.250011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246457+0000","last_change":"2023-10-06T02:55:07.109573+0000","last_active":"2023-10-06T02:55:11.246457+0000","last_peered":"2023-10-06T02:55:11.246457+0000","last_clean":"2023-10-06T02:55:11.246457+0000","last_became_active":"2023-10-06T02:55:07.109273+0000","last_became_peered":"2023-10-06T02:55:07.109273+0000","last_unstale":"2023-10-06T02:55:11.246457+0000","last_undegraded":"2023-10-06T02:55:11.246457+0000","last_fullsized":"2023-10-06T02:55:11.246457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.254596+0000","last_change":"2023-10-06T02:55:11.252497+0000","last_active":"2023-10-06T02:55:11.254596+0000","last_peered":"2023-10-06T02:55:11.254596+0000","last_clean":"2023-10-06T02:55:11.254596+0000","last_became_active":"2023-10-06T02:55:11.252152+0000","last_became_peered":"2023-10-06T02:55:11.252152+0000","last_unstale":"2023-10-06T02:55:11.254596+0000","last_undegraded":"2023-10-06T02:55:11.254596+0000","last_fullsized":"2023-10-06T02:55:11.254596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:05.228696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235239+0000","last_change":"2023-10-06T02:55:06.244855+0000","last_active":"2023-10-06T02:55:11.235239+0000","last_peered":"2023-10-06T02:55:11.235239+0000","last_clean":"2023-10-06T02:55:11.235239+0000","last_became_active":"2023-10-06T02:55:06.243833+0000","last_became_peered":"2023-10-06T02:55:06.243833+0000","last_unstale":"2023-10-06T02:55:11.235239+0000","last_undegraded":"2023-10-06T02:55:11.235239+0000","last_fullsized":"2023-10-06T02:55:11.235239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239474+0000","last_change":"2023-10-06T02:55:07.106155+0000","last_active":"2023-10-06T02:55:11.239474+0000","last_peered":"2023-10-06T02:55:11.239474+0000","last_clean":"2023-10-06T02:55:11.239474+0000","last_became_active":"2023-10-06T02:55:07.105422+0000","last_became_peered":"2023-10-06T02:55:07.105422+0000","last_unstale":"2023-10-06T02:55:11.239474+0000","last_undegraded":"2023-10-06T02:55:11.239474+0000","last_fullsized":"2023-10-06T02:55:11.239474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:26.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258752+0000","last_change":"2023-10-06T02:55:11.252464+0000","last_active":"2023-10-06T02:55:11.258752+0000","last_peered":"2023-10-06T02:55:11.258752+0000","last_clean":"2023-10-06T02:55:11.258752+0000","last_became_active":"2023-10-06T02:55:11.252055+0000","last_became_peered":"2023-10-06T02:55:11.252055+0000","last_unstale":"2023-10-06T02:55:11.258752+0000","last_undegraded":"2023-10-06T02:55:11.258752+0000","last_fullsized":"2023-10-06T02:55:11.258752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:30.678912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243469+0000","last_change":"2023-10-06T02:55:06.243634+0000","last_active":"2023-10-06T02:55:11.243469+0000","last_peered":"2023-10-06T02:55:11.243469+0000","last_clean":"2023-10-06T02:55:11.243469+0000","last_became_active":"2023-10-06T02:55:06.243383+0000","last_became_peered":"2023-10-06T02:55:06.243383+0000","last_unstale":"2023-10-06T02:55:11.243469+0000","last_undegraded":"2023-10-06T02:55:11.243469+0000","last_fullsized":"2023-10-06T02:55:11.243469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235163+0000","last_change":"2023-10-06T02:55:07.117239+0000","last_active":"2023-10-06T02:55:11.235163+0000","last_peered":"2023-10-06T02:55:11.235163+0000","last_clean":"2023-10-06T02:55:11.235163+0000","last_became_active":"2023-10-06T02:55:07.116968+0000","last_became_peered":"2023-10-06T02:55:07.116968+0000","last_unstale":"2023-10-06T02:55:11.235163+0000","last_undegraded":"2023-10-06T02:55:11.235163+0000","last_fullsized":"2023-10-06T02:55:11.235163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258755+0000","last_change":"2023-10-06T02:55:11.254938+0000","last_active":"2023-10-06T02:55:11.258755+0000","last_peered":"2023-10-06T02:55:11.258755+0000","last_clean":"2023-10-06T02:55:11.258755+0000","last_became_active":"2023-10-06T02:55:11.254650+0000","last_became_peered":"2023-10-06T02:55:11.254650+0000","last_unstale":"2023-10-06T02:55:11.258755+0000","last_undegraded":"2023-10-06T02:55:11.258755+0000","last_fullsized":"2023-10-06T02:55:11.258755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:07.497924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236203+0000","last_change":"2023-10-06T02:55:06.239366+0000","last_active":"2023-10-06T02:55:11.236203+0000","last_peered":"2023-10-06T02:55:11.236203+0000","last_clean":"2023-10-06T02:55:11.236203+0000","last_became_active":"2023-10-06T02:55:06.239143+0000","last_became_peered":"2023-10-06T02:55:06.239143+0000","last_unstale":"2023-10-06T02:55:11.236203+0000","last_undegraded":"2023-10-06T02:55:11.236203+0000","last_fullsized":"2023-10-06T02:55:11.236203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:13.153122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235067+0000","last_change":"2023-10-06T02:55:07.109897+0000","last_active":"2023-10-06T02:55:11.235067+0000","last_peered":"2023-10-06T02:55:11.235067+0000","last_clean":"2023-10-06T02:55:11.235067+0000","last_became_active":"2023-10-06T02:55:07.108992+0000","last_became_peered":"2023-10-06T02:55:07.108992+0000","last_unstale":"2023-10-06T02:55:11.235067+0000","last_undegraded":"2023-10-06T02:55:11.235067+0000","last_fullsized":"2023-10-06T02:55:11.235067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:03.653175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253878+0000","last_change":"2023-10-06T02:55:11.249347+0000","last_active":"2023-10-06T02:55:11.253878+0000","last_peered":"2023-10-06T02:55:11.253878+0000","last_clean":"2023-10-06T02:55:11.253878+0000","last_became_active":"2023-10-06T02:55:11.248973+0000","last_became_peered":"2023-10-06T02:55:11.248973+0000","last_unstale":"2023-10-06T02:55:11.253878+0000","last_undegraded":"2023-10-06T02:55:11.253878+0000","last_fullsized":"2023-10-06T02:55:11.253878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.869089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249346+0000","last_change":"2023-10-06T02:55:06.244730+0000","last_active":"2023-10-06T02:55:11.249346+0000","last_peered":"2023-10-06T02:55:11.249346+0000","last_clean":"2023-10-06T02:55:11.249346+0000","last_became_active":"2023-10-06T02:55:06.244530+0000","last_became_peered":"2023-10-06T02:55:06.244530+0000","last_unstale":"2023-10-06T02:55:11.249346+0000","last_undegraded":"2023-10-06T02:55:11.249346+0000","last_fullsized":"2023-10-06T02:55:11.249346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:57.942072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250185+0000","last_change":"2023-10-06T02:55:07.113744+0000","last_active":"2023-10-06T02:55:11.250185+0000","last_peered":"2023-10-06T02:55:11.250185+0000","last_clean":"2023-10-06T02:55:11.250185+0000","last_became_active":"2023-10-06T02:55:07.110700+0000","last_became_peered":"2023-10-06T02:55:07.110700+0000","last_unstale":"2023-10-06T02:55:11.250185+0000","last_undegraded":"2023-10-06T02:55:11.250185+0000","last_fullsized":"2023-10-06T02:55:11.250185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:45.135333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264143+0000","last_change":"2023-10-06T02:55:11.262345+0000","last_active":"2023-10-06T02:55:11.264143+0000","last_peered":"2023-10-06T02:55:11.264143+0000","last_clean":"2023-10-06T02:55:11.264143+0000","last_became_active":"2023-10-06T02:55:11.261934+0000","last_became_peered":"2023-10-06T02:55:11.261934+0000","last_unstale":"2023-10-06T02:55:11.264143+0000","last_undegraded":"2023-10-06T02:55:11.264143+0000","last_fullsized":"2023-10-06T02:55:11.264143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T02:55:17.004310+0000","last_change":"2023-10-06T02:55:06.238681+0000","last_active":"2023-10-06T02:55:17.004310+0000","last_peered":"2023-10-06T02:55:17.004310+0000","last_clean":"2023-10-06T02:55:17.004310+0000","last_became_active":"2023-10-06T02:55:06.238378+0000","last_became_peered":"2023-10-06T02:55:06.238378+0000","last_unstale":"2023-10-06T02:55:17.004310+0000","last_undegraded":"2023-10-06T02:55:17.004310+0000","last_fullsized":"2023-10-06T02:55:17.004310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:53.170462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242315+0000","last_change":"2023-10-06T02:55:07.103795+0000","last_active":"2023-10-06T02:55:11.242315+0000","last_peered":"2023-10-06T02:55:11.242315+0000","last_clean":"2023-10-06T02:55:11.242315+0000","last_became_active":"2023-10-06T02:55:07.103512+0000","last_became_peered":"2023-10-06T02:55:07.103512+0000","last_unstale":"2023-10-06T02:55:11.242315+0000","last_undegraded":"2023-10-06T02:55:11.242315+0000","last_fullsized":"2023-10-06T02:55:11.242315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256756+0000","last_change":"2023-10-06T02:55:11.251476+0000","last_active":"2023-10-06T02:55:11.256756+0000","last_peered":"2023-10-06T02:55:11.256756+0000","last_clean":"2023-10-06T02:55:11.256756+0000","last_became_active":"2023-10-06T02:55:11.250987+0000","last_became_peered":"2023-10-06T02:55:11.250987+0000","last_unstale":"2023-10-06T02:55:11.256756+0000","last_undegraded":"2023-10-06T02:55:11.256756+0000","last_fullsized":"2023-10-06T02:55:11.256756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:14.100962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249652+0000","last_change":"2023-10-06T02:55:06.246906+0000","last_active":"2023-10-06T02:55:11.249652+0000","last_peered":"2023-10-06T02:55:11.249652+0000","last_clean":"2023-10-06T02:55:11.249652+0000","last_became_active":"2023-10-06T02:55:06.246640+0000","last_became_peered":"2023-10-06T02:55:06.246640+0000","last_unstale":"2023-10-06T02:55:11.249652+0000","last_undegraded":"2023-10-06T02:55:11.249652+0000","last_fullsized":"2023-10-06T02:55:11.249652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.944198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235544+0000","last_change":"2023-10-06T02:55:07.116704+0000","last_active":"2023-10-06T02:55:11.235544+0000","last_peered":"2023-10-06T02:55:11.235544+0000","last_clean":"2023-10-06T02:55:11.235544+0000","last_became_active":"2023-10-06T02:55:07.116441+0000","last_became_peered":"2023-10-06T02:55:07.116441+0000","last_unstale":"2023-10-06T02:55:11.235544+0000","last_undegraded":"2023-10-06T02:55:11.235544+0000","last_fullsized":"2023-10-06T02:55:11.235544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263207+0000","last_change":"2023-10-06T02:55:11.258974+0000","last_active":"2023-10-06T02:55:11.263207+0000","last_peered":"2023-10-06T02:55:11.263207+0000","last_clean":"2023-10-06T02:55:11.263207+0000","last_became_active":"2023-10-06T02:55:11.258615+0000","last_became_peered":"2023-10-06T02:55:11.258615+0000","last_unstale":"2023-10-06T02:55:11.263207+0000","last_undegraded":"2023-10-06T02:55:11.263207+0000","last_fullsized":"2023-10-06T02:55:11.263207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:22.469427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242843+0000","last_change":"2023-10-06T02:55:06.240931+0000","last_active":"2023-10-06T02:55:11.242843+0000","last_peered":"2023-10-06T02:55:11.242843+0000","last_clean":"2023-10-06T02:55:11.242843+0000","last_became_active":"2023-10-06T02:55:06.240681+0000","last_became_peered":"2023-10-06T02:55:06.240681+0000","last_unstale":"2023-10-06T02:55:11.242843+0000","last_undegraded":"2023-10-06T02:55:11.242843+0000","last_fullsized":"2023-10-06T02:55:11.242843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236292+0000","last_change":"2023-10-06T02:55:07.108936+0000","last_active":"2023-10-06T02:55:11.236292+0000","last_peered":"2023-10-06T02:55:11.236292+0000","last_clean":"2023-10-06T02:55:11.236292+0000","last_became_active":"2023-10-06T02:55:07.108696+0000","last_became_peered":"2023-10-06T02:55:07.108696+0000","last_unstale":"2023-10-06T02:55:11.236292+0000","last_undegraded":"2023-10-06T02:55:11.236292+0000","last_fullsized":"2023-10-06T02:55:11.236292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263173+0000","last_change":"2023-10-06T02:55:11.258916+0000","last_active":"2023-10-06T02:55:11.263173+0000","last_peered":"2023-10-06T02:55:11.263173+0000","last_clean":"2023-10-06T02:55:11.263173+0000","last_became_active":"2023-10-06T02:55:11.258551+0000","last_became_peered":"2023-10-06T02:55:11.258551+0000","last_unstale":"2023-10-06T02:55:11.263173+0000","last_undegraded":"2023-10-06T02:55:11.263173+0000","last_fullsized":"2023-10-06T02:55:11.263173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:29.955535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246941+0000","last_change":"2023-10-06T02:55:06.246931+0000","last_active":"2023-10-06T02:55:11.246941+0000","last_peered":"2023-10-06T02:55:11.246941+0000","last_clean":"2023-10-06T02:55:11.246941+0000","last_became_active":"2023-10-06T02:55:06.246709+0000","last_became_peered":"2023-10-06T02:55:06.246709+0000","last_unstale":"2023-10-06T02:55:11.246941+0000","last_undegraded":"2023-10-06T02:55:11.246941+0000","last_fullsized":"2023-10-06T02:55:11.246941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246634+0000","last_change":"2023-10-06T02:55:07.114181+0000","last_active":"2023-10-06T02:55:11.246634+0000","last_peered":"2023-10-06T02:55:11.246634+0000","last_clean":"2023-10-06T02:55:11.246634+0000","last_became_active":"2023-10-06T02:55:07.113881+0000","last_became_peered":"2023-10-06T02:55:07.113881+0000","last_unstale":"2023-10-06T02:55:11.246634+0000","last_undegraded":"2023-10-06T02:55:11.246634+0000","last_fullsized":"2023-10-06T02:55:11.246634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256543+0000","last_change":"2023-10-06T02:55:11.253825+0000","last_active":"2023-10-06T02:55:11.256543+0000","last_peered":"2023-10-06T02:55:11.256543+0000","last_clean":"2023-10-06T02:55:11.256543+0000","last_became_active":"2023-10-06T02:55:11.253052+0000","last_became_peered":"2023-10-06T02:55:11.253052+0000","last_unstale":"2023-10-06T02:55:11.256543+0000","last_undegraded":"2023-10-06T02:55:11.256543+0000","last_fullsized":"2023-10-06T02:55:11.256543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:22.469427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236177+0000","last_change":"2023-10-06T02:55:06.235238+0000","last_active":"2023-10-06T02:55:11.236177+0000","last_peered":"2023-10-06T02:55:11.236177+0000","last_clean":"2023-10-06T02:55:11.236177+0000","last_became_active":"2023-10-06T02:55:06.234941+0000","last_became_peered":"2023-10-06T02:55:06.234941+0000","last_unstale":"2023-10-06T02:55:11.236177+0000","last_undegraded":"2023-10-06T02:55:11.236177+0000","last_fullsized":"2023-10-06T02:55:11.236177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:22.823456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235743+0000","last_change":"2023-10-06T02:55:07.110108+0000","last_active":"2023-10-06T02:55:11.235743+0000","last_peered":"2023-10-06T02:55:11.235743+0000","last_clean":"2023-10-06T02:55:11.235743+0000","last_became_active":"2023-10-06T02:55:07.108982+0000","last_became_peered":"2023-10-06T02:55:07.108982+0000","last_unstale":"2023-10-06T02:55:11.235743+0000","last_undegraded":"2023-10-06T02:55:11.235743+0000","last_fullsized":"2023-10-06T02:55:11.235743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:09.755341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264350+0000","last_change":"2023-10-06T02:55:11.261896+0000","last_active":"2023-10-06T02:55:11.264350+0000","last_peered":"2023-10-06T02:55:11.264350+0000","last_clean":"2023-10-06T02:55:11.264350+0000","last_became_active":"2023-10-06T02:55:11.258453+0000","last_became_peered":"2023-10-06T02:55:11.258453+0000","last_unstale":"2023-10-06T02:55:11.264350+0000","last_undegraded":"2023-10-06T02:55:11.264350+0000","last_fullsized":"2023-10-06T02:55:11.264350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.248625+0000","last_change":"2023-10-06T02:55:06.246468+0000","last_active":"2023-10-06T02:55:11.248625+0000","last_peered":"2023-10-06T02:55:11.248625+0000","last_clean":"2023-10-06T02:55:11.248625+0000","last_became_active":"2023-10-06T02:55:06.246181+0000","last_became_peered":"2023-10-06T02:55:06.246181+0000","last_unstale":"2023-10-06T02:55:11.248625+0000","last_undegraded":"2023-10-06T02:55:11.248625+0000","last_fullsized":"2023-10-06T02:55:11.248625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:05.892985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235746+0000","last_change":"2023-10-06T02:55:07.108301+0000","last_active":"2023-10-06T02:55:11.235746+0000","last_peered":"2023-10-06T02:55:11.235746+0000","last_clean":"2023-10-06T02:55:11.235746+0000","last_became_active":"2023-10-06T02:55:07.108018+0000","last_became_peered":"2023-10-06T02:55:07.108018+0000","last_unstale":"2023-10-06T02:55:11.235746+0000","last_undegraded":"2023-10-06T02:55:11.235746+0000","last_fullsized":"2023-10-06T02:55:11.235746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253713+0000","last_change":"2023-10-06T02:55:11.250732+0000","last_active":"2023-10-06T02:55:11.253713+0000","last_peered":"2023-10-06T02:55:11.253713+0000","last_clean":"2023-10-06T02:55:11.253713+0000","last_became_active":"2023-10-06T02:55:11.250256+0000","last_became_peered":"2023-10-06T02:55:11.250256+0000","last_unstale":"2023-10-06T02:55:11.253713+0000","last_undegraded":"2023-10-06T02:55:11.253713+0000","last_fullsized":"2023-10-06T02:55:11.253713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:48.288942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246540+0000","last_change":"2023-10-06T02:55:06.246429+0000","last_active":"2023-10-06T02:55:11.246540+0000","last_peered":"2023-10-06T02:55:11.246540+0000","last_clean":"2023-10-06T02:55:11.246540+0000","last_became_active":"2023-10-06T02:55:06.246133+0000","last_became_peered":"2023-10-06T02:55:06.246133+0000","last_unstale":"2023-10-06T02:55:11.246540+0000","last_undegraded":"2023-10-06T02:55:11.246540+0000","last_fullsized":"2023-10-06T02:55:11.246540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242766+0000","last_change":"2023-10-06T02:55:07.111918+0000","last_active":"2023-10-06T02:55:11.242766+0000","last_peered":"2023-10-06T02:55:11.242766+0000","last_clean":"2023-10-06T02:55:11.242766+0000","last_became_active":"2023-10-06T02:55:07.111192+0000","last_became_peered":"2023-10-06T02:55:07.111192+0000","last_unstale":"2023-10-06T02:55:11.242766+0000","last_undegraded":"2023-10-06T02:55:11.242766+0000","last_fullsized":"2023-10-06T02:55:11.242766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:03.869547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.255431+0000","last_change":"2023-10-06T02:55:11.254429+0000","last_active":"2023-10-06T02:55:11.255431+0000","last_peered":"2023-10-06T02:55:11.255431+0000","last_clean":"2023-10-06T02:55:11.255431+0000","last_became_active":"2023-10-06T02:55:11.253634+0000","last_became_peered":"2023-10-06T02:55:11.253634+0000","last_unstale":"2023-10-06T02:55:11.255431+0000","last_undegraded":"2023-10-06T02:55:11.255431+0000","last_fullsized":"2023-10-06T02:55:11.255431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:39.598115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249543+0000","last_change":"2023-10-06T02:55:06.244313+0000","last_active":"2023-10-06T02:55:11.249543+0000","last_peered":"2023-10-06T02:55:11.249543+0000","last_clean":"2023-10-06T02:55:11.249543+0000","last_became_active":"2023-10-06T02:55:06.244045+0000","last_became_peered":"2023-10-06T02:55:06.244045+0000","last_unstale":"2023-10-06T02:55:11.249543+0000","last_undegraded":"2023-10-06T02:55:11.249543+0000","last_fullsized":"2023-10-06T02:55:11.249543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:49.362183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240556+0000","last_change":"2023-10-06T02:55:07.112001+0000","last_active":"2023-10-06T02:55:11.240556+0000","last_peered":"2023-10-06T02:55:11.240556+0000","last_clean":"2023-10-06T02:55:11.240556+0000","last_became_active":"2023-10-06T02:55:07.111530+0000","last_became_peered":"2023-10-06T02:55:07.111530+0000","last_unstale":"2023-10-06T02:55:11.240556+0000","last_undegraded":"2023-10-06T02:55:11.240556+0000","last_fullsized":"2023-10-06T02:55:11.240556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:28.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261909+0000","last_change":"2023-10-06T02:55:11.254821+0000","last_active":"2023-10-06T02:55:11.261909+0000","last_peered":"2023-10-06T02:55:11.261909+0000","last_clean":"2023-10-06T02:55:11.261909+0000","last_became_active":"2023-10-06T02:55:11.254465+0000","last_became_peered":"2023-10-06T02:55:11.254465+0000","last_unstale":"2023-10-06T02:55:11.261909+0000","last_undegraded":"2023-10-06T02:55:11.261909+0000","last_fullsized":"2023-10-06T02:55:11.261909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:22.675675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236372+0000","last_change":"2023-10-06T02:55:06.240642+0000","last_active":"2023-10-06T02:55:11.236372+0000","last_peered":"2023-10-06T02:55:11.236372+0000","last_clean":"2023-10-06T02:55:11.236372+0000","last_became_active":"2023-10-06T02:55:06.240361+0000","last_became_peered":"2023-10-06T02:55:06.240361+0000","last_unstale":"2023-10-06T02:55:11.236372+0000","last_undegraded":"2023-10-06T02:55:11.236372+0000","last_fullsized":"2023-10-06T02:55:11.236372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:35.258998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243005+0000","last_change":"2023-10-06T02:55:07.111431+0000","last_active":"2023-10-06T02:55:11.243005+0000","last_peered":"2023-10-06T02:55:11.243005+0000","last_clean":"2023-10-06T02:55:11.243005+0000","last_became_active":"2023-10-06T02:55:07.111223+0000","last_became_peered":"2023-10-06T02:55:07.111223+0000","last_unstale":"2023-10-06T02:55:11.243005+0000","last_undegraded":"2023-10-06T02:55:11.243005+0000","last_fullsized":"2023-10-06T02:55:11.243005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.262798+0000","last_change":"2023-10-06T02:55:11.258918+0000","last_active":"2023-10-06T02:55:11.262798+0000","last_peered":"2023-10-06T02:55:11.262798+0000","last_clean":"2023-10-06T02:55:11.262798+0000","last_became_active":"2023-10-06T02:55:11.258550+0000","last_became_peered":"2023-10-06T02:55:11.258550+0000","last_unstale":"2023-10-06T02:55:11.262798+0000","last_undegraded":"2023-10-06T02:55:11.262798+0000","last_fullsized":"2023-10-06T02:55:11.262798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:34.718619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235093+0000","last_change":"2023-10-06T02:55:06.243599+0000","last_active":"2023-10-06T02:55:11.235093+0000","last_peered":"2023-10-06T02:55:11.235093+0000","last_clean":"2023-10-06T02:55:11.235093+0000","last_became_active":"2023-10-06T02:55:06.243327+0000","last_became_peered":"2023-10-06T02:55:06.243327+0000","last_unstale":"2023-10-06T02:55:11.235093+0000","last_undegraded":"2023-10-06T02:55:11.235093+0000","last_fullsized":"2023-10-06T02:55:11.235093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:35.258998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.241631+0000","last_change":"2023-10-06T02:55:07.113758+0000","last_active":"2023-10-06T02:55:11.241631+0000","last_peered":"2023-10-06T02:55:11.241631+0000","last_clean":"2023-10-06T02:55:11.241631+0000","last_became_active":"2023-10-06T02:55:07.113506+0000","last_became_peered":"2023-10-06T02:55:07.113506+0000","last_unstale":"2023-10-06T02:55:11.241631+0000","last_undegraded":"2023-10-06T02:55:11.241631+0000","last_fullsized":"2023-10-06T02:55:11.241631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:44.275013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264161+0000","last_change":"2023-10-06T02:55:11.262774+0000","last_active":"2023-10-06T02:55:11.264161+0000","last_peered":"2023-10-06T02:55:11.264161+0000","last_clean":"2023-10-06T02:55:11.264161+0000","last_became_active":"2023-10-06T02:55:11.262415+0000","last_became_peered":"2023-10-06T02:55:11.262415+0000","last_unstale":"2023-10-06T02:55:11.264161+0000","last_undegraded":"2023-10-06T02:55:11.264161+0000","last_fullsized":"2023-10-06T02:55:11.264161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240564+0000","last_change":"2023-10-06T02:55:06.242089+0000","last_active":"2023-10-06T02:55:11.240564+0000","last_peered":"2023-10-06T02:55:11.240564+0000","last_clean":"2023-10-06T02:55:11.240564+0000","last_became_active":"2023-10-06T02:55:06.241809+0000","last_became_peered":"2023-10-06T02:55:06.241809+0000","last_unstale":"2023-10-06T02:55:11.240564+0000","last_undegraded":"2023-10-06T02:55:11.240564+0000","last_fullsized":"2023-10-06T02:55:11.240564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:00.333890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243430+0000","last_change":"2023-10-06T02:55:07.103210+0000","last_active":"2023-10-06T02:55:11.243430+0000","last_peered":"2023-10-06T02:55:11.243430+0000","last_clean":"2023-10-06T02:55:11.243430+0000","last_became_active":"2023-10-06T02:55:07.102900+0000","last_became_peered":"2023-10-06T02:55:07.102900+0000","last_unstale":"2023-10-06T02:55:11.243430+0000","last_undegraded":"2023-10-06T02:55:11.243430+0000","last_fullsized":"2023-10-06T02:55:11.243430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263787+0000","last_change":"2023-10-06T02:55:11.256640+0000","last_active":"2023-10-06T02:55:11.263787+0000","last_peered":"2023-10-06T02:55:11.263787+0000","last_clean":"2023-10-06T02:55:11.263787+0000","last_became_active":"2023-10-06T02:55:11.254235+0000","last_became_peered":"2023-10-06T02:55:11.254235+0000","last_unstale":"2023-10-06T02:55:11.263787+0000","last_undegraded":"2023-10-06T02:55:11.263787+0000","last_fullsized":"2023-10-06T02:55:11.263787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:04.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242562+0000","last_change":"2023-10-06T02:55:06.237767+0000","last_active":"2023-10-06T02:55:11.242562+0000","last_peered":"2023-10-06T02:55:11.242562+0000","last_clean":"2023-10-06T02:55:11.242562+0000","last_became_active":"2023-10-06T02:55:06.237033+0000","last_became_peered":"2023-10-06T02:55:06.237033+0000","last_unstale":"2023-10-06T02:55:11.242562+0000","last_undegraded":"2023-10-06T02:55:11.242562+0000","last_fullsized":"2023-10-06T02:55:11.242562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:00.333890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245169+0000","last_change":"2023-10-06T02:55:07.100985+0000","last_active":"2023-10-06T02:55:11.245169+0000","last_peered":"2023-10-06T02:55:11.245169+0000","last_clean":"2023-10-06T02:55:11.245169+0000","last_became_active":"2023-10-06T02:55:07.100724+0000","last_became_peered":"2023-10-06T02:55:07.100724+0000","last_unstale":"2023-10-06T02:55:11.245169+0000","last_undegraded":"2023-10-06T02:55:11.245169+0000","last_fullsized":"2023-10-06T02:55:11.245169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261373+0000","last_change":"2023-10-06T02:55:11.254821+0000","last_active":"2023-10-06T02:55:11.261373+0000","last_peered":"2023-10-06T02:55:11.261373+0000","last_clean":"2023-10-06T02:55:11.261373+0000","last_became_active":"2023-10-06T02:55:11.254344+0000","last_became_peered":"2023-10-06T02:55:11.254344+0000","last_unstale":"2023-10-06T02:55:11.261373+0000","last_undegraded":"2023-10-06T02:55:11.261373+0000","last_fullsized":"2023-10-06T02:55:11.261373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:28.325601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235090+0000","last_change":"2023-10-06T02:55:06.240594+0000","last_active":"2023-10-06T02:55:11.235090+0000","last_peered":"2023-10-06T02:55:11.235090+0000","last_clean":"2023-10-06T02:55:11.235090+0000","last_became_active":"2023-10-06T02:55:06.240357+0000","last_became_peered":"2023-10-06T02:55:06.240357+0000","last_unstale":"2023-10-06T02:55:11.235090+0000","last_undegraded":"2023-10-06T02:55:11.235090+0000","last_fullsized":"2023-10-06T02:55:11.235090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251318+0000","last_change":"2023-10-06T02:55:07.116386+0000","last_active":"2023-10-06T02:55:11.251318+0000","last_peered":"2023-10-06T02:55:11.251318+0000","last_clean":"2023-10-06T02:55:11.251318+0000","last_became_active":"2023-10-06T02:55:07.116115+0000","last_became_peered":"2023-10-06T02:55:07.116115+0000","last_unstale":"2023-10-06T02:55:11.251318+0000","last_undegraded":"2023-10-06T02:55:11.251318+0000","last_fullsized":"2023-10-06T02:55:11.251318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.260498+0000","last_change":"2023-10-06T02:55:11.258056+0000","last_active":"2023-10-06T02:55:11.260498+0000","last_peered":"2023-10-06T02:55:11.260498+0000","last_clean":"2023-10-06T02:55:11.260498+0000","last_became_active":"2023-10-06T02:55:11.256479+0000","last_became_peered":"2023-10-06T02:55:11.256479+0000","last_unstale":"2023-10-06T02:55:11.260498+0000","last_undegraded":"2023-10-06T02:55:11.260498+0000","last_fullsized":"2023-10-06T02:55:11.260498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250543+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:55:11.250543+0000","last_peered":"2023-10-06T02:55:11.250543+0000","last_clean":"2023-10-06T02:55:11.250543+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:55:11.250543+0000","last_undegraded":"2023-10-06T02:55:11.250543+0000","last_fullsized":"2023-10-06T02:55:11.250543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236179+0000","last_change":"2023-10-06T02:55:06.240875+0000","last_active":"2023-10-06T02:55:11.236179+0000","last_peered":"2023-10-06T02:55:11.236179+0000","last_clean":"2023-10-06T02:55:11.236179+0000","last_became_active":"2023-10-06T02:55:06.240637+0000","last_became_peered":"2023-10-06T02:55:06.240637+0000","last_unstale":"2023-10-06T02:55:11.236179+0000","last_undegraded":"2023-10-06T02:55:11.236179+0000","last_fullsized":"2023-10-06T02:55:11.236179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250109+0000","last_change":"2023-10-06T02:55:07.111939+0000","last_active":"2023-10-06T02:55:11.250109+0000","last_peered":"2023-10-06T02:55:11.250109+0000","last_clean":"2023-10-06T02:55:11.250109+0000","last_became_active":"2023-10-06T02:55:07.111076+0000","last_became_peered":"2023-10-06T02:55:07.111076+0000","last_unstale":"2023-10-06T02:55:11.250109+0000","last_undegraded":"2023-10-06T02:55:11.250109+0000","last_fullsized":"2023-10-06T02:55:11.250109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258159+0000","last_change":"2023-10-06T02:55:11.257606+0000","last_active":"2023-10-06T02:55:11.258159+0000","last_peered":"2023-10-06T02:55:11.258159+0000","last_clean":"2023-10-06T02:55:11.258159+0000","last_became_active":"2023-10-06T02:55:11.257305+0000","last_became_peered":"2023-10-06T02:55:11.257305+0000","last_unstale":"2023-10-06T02:55:11.258159+0000","last_undegraded":"2023-10-06T02:55:11.258159+0000","last_fullsized":"2023-10-06T02:55:11.258159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236318+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:55:11.236318+0000","last_peered":"2023-10-06T02:55:11.236318+0000","last_clean":"2023-10-06T02:55:11.236318+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:55:11.236318+0000","last_undegraded":"2023-10-06T02:55:11.236318+0000","last_fullsized":"2023-10-06T02:55:11.236318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242421+0000","last_change":"2023-10-06T02:55:06.245888+0000","last_active":"2023-10-06T02:55:11.242421+0000","last_peered":"2023-10-06T02:55:11.242421+0000","last_clean":"2023-10-06T02:55:11.242421+0000","last_became_active":"2023-10-06T02:55:06.245610+0000","last_became_peered":"2023-10-06T02:55:06.245610+0000","last_unstale":"2023-10-06T02:55:11.242421+0000","last_undegraded":"2023-10-06T02:55:11.242421+0000","last_fullsized":"2023-10-06T02:55:11.242421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:22.823456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250468+0000","last_change":"2023-10-06T02:55:07.105844+0000","last_active":"2023-10-06T02:55:11.250468+0000","last_peered":"2023-10-06T02:55:11.250468+0000","last_clean":"2023-10-06T02:55:11.250468+0000","last_became_active":"2023-10-06T02:55:07.105587+0000","last_became_peered":"2023-10-06T02:55:07.105587+0000","last_unstale":"2023-10-06T02:55:11.250468+0000","last_undegraded":"2023-10-06T02:55:11.250468+0000","last_fullsized":"2023-10-06T02:55:11.250468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:39.307208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.254953+0000","last_change":"2023-10-06T02:55:11.252978+0000","last_active":"2023-10-06T02:55:11.254953+0000","last_peered":"2023-10-06T02:55:11.254953+0000","last_clean":"2023-10-06T02:55:11.254953+0000","last_became_active":"2023-10-06T02:55:11.252446+0000","last_became_peered":"2023-10-06T02:55:11.252446+0000","last_unstale":"2023-10-06T02:55:11.254953+0000","last_undegraded":"2023-10-06T02:55:11.254953+0000","last_fullsized":"2023-10-06T02:55:11.254953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:20.987504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.238567+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:55:11.238567+0000","last_peered":"2023-10-06T02:55:11.238567+0000","last_clean":"2023-10-06T02:55:11.238567+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:55:11.238567+0000","last_undegraded":"2023-10-06T02:55:11.238567+0000","last_fullsized":"2023-10-06T02:55:11.238567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250490+0000","last_change":"2023-10-06T02:55:06.234766+0000","last_active":"2023-10-06T02:55:11.250490+0000","last_peered":"2023-10-06T02:55:11.250490+0000","last_clean":"2023-10-06T02:55:11.250490+0000","last_became_active":"2023-10-06T02:55:06.234390+0000","last_became_peered":"2023-10-06T02:55:06.234390+0000","last_unstale":"2023-10-06T02:55:11.250490+0000","last_undegraded":"2023-10-06T02:55:11.250490+0000","last_fullsized":"2023-10-06T02:55:11.250490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251232+0000","last_change":"2023-10-06T02:55:07.112215+0000","last_active":"2023-10-06T02:55:11.251232+0000","last_peered":"2023-10-06T02:55:11.251232+0000","last_clean":"2023-10-06T02:55:11.251232+0000","last_became_active":"2023-10-06T02:55:07.110597+0000","last_became_peered":"2023-10-06T02:55:07.110597+0000","last_unstale":"2023-10-06T02:55:11.251232+0000","last_undegraded":"2023-10-06T02:55:11.251232+0000","last_fullsized":"2023-10-06T02:55:11.251232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.267018+0000","last_change":"2023-10-06T02:55:11.259468+0000","last_active":"2023-10-06T02:55:11.267018+0000","last_peered":"2023-10-06T02:55:11.267018+0000","last_clean":"2023-10-06T02:55:11.267018+0000","last_became_active":"2023-10-06T02:55:11.259056+0000","last_became_peered":"2023-10-06T02:55:11.259056+0000","last_unstale":"2023-10-06T02:55:11.267018+0000","last_undegraded":"2023-10-06T02:55:11.267018+0000","last_fullsized":"2023-10-06T02:55:11.267018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236914+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:55:11.236914+0000","last_peered":"2023-10-06T02:55:11.236914+0000","last_clean":"2023-10-06T02:55:11.236914+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:55:11.236914+0000","last_undegraded":"2023-10-06T02:55:11.236914+0000","last_fullsized":"2023-10-06T02:55:11.236914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246339+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:55:11.246339+0000","last_peered":"2023-10-06T02:55:11.246339+0000","last_clean":"2023-10-06T02:55:11.246339+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:55:11.246339+0000","last_undegraded":"2023-10-06T02:55:11.246339+0000","last_fullsized":"2023-10-06T02:55:11.246339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235039+0000","last_change":"2023-10-06T02:55:06.244584+0000","last_active":"2023-10-06T02:55:11.235039+0000","last_peered":"2023-10-06T02:55:11.235039+0000","last_clean":"2023-10-06T02:55:11.235039+0000","last_became_active":"2023-10-06T02:55:06.244277+0000","last_became_peered":"2023-10-06T02:55:06.244277+0000","last_unstale":"2023-10-06T02:55:11.235039+0000","last_undegraded":"2023-10-06T02:55:11.235039+0000","last_fullsized":"2023-10-06T02:55:11.235039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235736+0000","last_change":"2023-10-06T02:55:07.102220+0000","last_active":"2023-10-06T02:55:11.235736+0000","last_peered":"2023-10-06T02:55:11.235736+0000","last_clean":"2023-10-06T02:55:11.235736+0000","last_became_active":"2023-10-06T02:55:07.101946+0000","last_became_peered":"2023-10-06T02:55:07.101946+0000","last_unstale":"2023-10-06T02:55:11.235736+0000","last_undegraded":"2023-10-06T02:55:11.235736+0000","last_fullsized":"2023-10-06T02:55:11.235736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:03.946045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263766+0000","last_change":"2023-10-06T02:55:11.256345+0000","last_active":"2023-10-06T02:55:11.263766+0000","last_peered":"2023-10-06T02:55:11.263766+0000","last_clean":"2023-10-06T02:55:11.263766+0000","last_became_active":"2023-10-06T02:55:11.253584+0000","last_became_peered":"2023-10-06T02:55:11.253584+0000","last_unstale":"2023-10-06T02:55:11.263766+0000","last_undegraded":"2023-10-06T02:55:11.263766+0000","last_fullsized":"2023-10-06T02:55:11.263766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246558+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:55:11.246558+0000","last_peered":"2023-10-06T02:55:11.246558+0000","last_clean":"2023-10-06T02:55:11.246558+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:55:11.246558+0000","last_undegraded":"2023-10-06T02:55:11.246558+0000","last_fullsized":"2023-10-06T02:55:11.246558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242581+0000","last_change":"2023-10-06T02:55:06.243148+0000","last_active":"2023-10-06T02:55:11.242581+0000","last_peered":"2023-10-06T02:55:11.242581+0000","last_clean":"2023-10-06T02:55:11.242581+0000","last_became_active":"2023-10-06T02:55:06.242874+0000","last_became_peered":"2023-10-06T02:55:06.242874+0000","last_unstale":"2023-10-06T02:55:11.242581+0000","last_undegraded":"2023-10-06T02:55:11.242581+0000","last_fullsized":"2023-10-06T02:55:11.242581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246552+0000","last_change":"2023-10-06T02:55:07.112041+0000","last_active":"2023-10-06T02:55:11.246552+0000","last_peered":"2023-10-06T02:55:11.246552+0000","last_clean":"2023-10-06T02:55:11.246552+0000","last_became_active":"2023-10-06T02:55:07.111789+0000","last_became_peered":"2023-10-06T02:55:07.111789+0000","last_unstale":"2023-10-06T02:55:11.246552+0000","last_undegraded":"2023-10-06T02:55:11.246552+0000","last_fullsized":"2023-10-06T02:55:11.246552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:09.755341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256412+0000","last_change":"2023-10-06T02:55:11.251646+0000","last_active":"2023-10-06T02:55:11.256412+0000","last_peered":"2023-10-06T02:55:11.256412+0000","last_clean":"2023-10-06T02:55:11.256412+0000","last_became_active":"2023-10-06T02:55:11.251231+0000","last_became_peered":"2023-10-06T02:55:11.251231+0000","last_unstale":"2023-10-06T02:55:11.256412+0000","last_undegraded":"2023-10-06T02:55:11.256412+0000","last_fullsized":"2023-10-06T02:55:11.256412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:44.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249446+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:55:11.249446+0000","last_peered":"2023-10-06T02:55:11.249446+0000","last_clean":"2023-10-06T02:55:11.249446+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:55:11.249446+0000","last_undegraded":"2023-10-06T02:55:11.249446+0000","last_fullsized":"2023-10-06T02:55:11.249446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250704+0000","last_change":"2023-10-06T02:55:06.235823+0000","last_active":"2023-10-06T02:55:11.250704+0000","last_peered":"2023-10-06T02:55:11.250704+0000","last_clean":"2023-10-06T02:55:11.250704+0000","last_became_active":"2023-10-06T02:55:06.235199+0000","last_became_peered":"2023-10-06T02:55:06.235199+0000","last_unstale":"2023-10-06T02:55:11.250704+0000","last_undegraded":"2023-10-06T02:55:11.250704+0000","last_fullsized":"2023-10-06T02:55:11.250704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243179+0000","last_change":"2023-10-06T02:55:07.110542+0000","last_active":"2023-10-06T02:55:11.243179+0000","last_peered":"2023-10-06T02:55:11.243179+0000","last_clean":"2023-10-06T02:55:11.243179+0000","last_became_active":"2023-10-06T02:55:07.110114+0000","last_became_peered":"2023-10-06T02:55:07.110114+0000","last_unstale":"2023-10-06T02:55:11.243179+0000","last_undegraded":"2023-10-06T02:55:11.243179+0000","last_fullsized":"2023-10-06T02:55:11.243179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264312+0000","last_change":"2023-10-06T02:55:11.259777+0000","last_active":"2023-10-06T02:55:11.264312+0000","last_peered":"2023-10-06T02:55:11.264312+0000","last_clean":"2023-10-06T02:55:11.264312+0000","last_became_active":"2023-10-06T02:55:11.259304+0000","last_became_peered":"2023-10-06T02:55:11.259304+0000","last_unstale":"2023-10-06T02:55:11.264312+0000","last_undegraded":"2023-10-06T02:55:11.264312+0000","last_fullsized":"2023-10-06T02:55:11.264312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:00.296633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235554+0000","last_change":"2023-10-06T02:55:06.240511+0000","last_active":"2023-10-06T02:55:11.235554+0000","last_peered":"2023-10-06T02:55:11.235554+0000","last_clean":"2023-10-06T02:55:11.235554+0000","last_became_active":"2023-10-06T02:55:06.240232+0000","last_became_peered":"2023-10-06T02:55:06.240232+0000","last_unstale":"2023-10-06T02:55:11.235554+0000","last_undegraded":"2023-10-06T02:55:11.235554+0000","last_fullsized":"2023-10-06T02:55:11.235554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251025+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:55:11.251025+0000","last_peered":"2023-10-06T02:55:11.251025+0000","last_clean":"2023-10-06T02:55:11.251025+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:55:11.251025+0000","last_undegraded":"2023-10-06T02:55:11.251025+0000","last_fullsized":"2023-10-06T02:55:11.251025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.234999+0000","last_change":"2023-10-06T02:55:07.109361+0000","last_active":"2023-10-06T02:55:11.234999+0000","last_peered":"2023-10-06T02:55:11.234999+0000","last_clean":"2023-10-06T02:55:11.234999+0000","last_became_active":"2023-10-06T02:55:07.109009+0000","last_became_peered":"2023-10-06T02:55:07.109009+0000","last_unstale":"2023-10-06T02:55:11.234999+0000","last_undegraded":"2023-10-06T02:55:11.234999+0000","last_fullsized":"2023-10-06T02:55:11.234999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.943919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253185+0000","last_change":"2023-10-06T02:55:11.248862+0000","last_active":"2023-10-06T02:55:11.253185+0000","last_peered":"2023-10-06T02:55:11.253185+0000","last_clean":"2023-10-06T02:55:11.253185+0000","last_became_active":"2023-10-06T02:55:11.248509+0000","last_became_peered":"2023-10-06T02:55:11.248509+0000","last_unstale":"2023-10-06T02:55:11.253185+0000","last_undegraded":"2023-10-06T02:55:11.253185+0000","last_fullsized":"2023-10-06T02:55:11.253185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.238397+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:55:11.238397+0000","last_peered":"2023-10-06T02:55:11.238397+0000","last_clean":"2023-10-06T02:55:11.238397+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:55:11.238397+0000","last_undegraded":"2023-10-06T02:55:11.238397+0000","last_fullsized":"2023-10-06T02:55:11.238397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T02:55:12.228337+0000","last_change":"2023-10-06T02:55:06.238192+0000","last_active":"2023-10-06T02:55:12.228337+0000","last_peered":"2023-10-06T02:55:12.228337+0000","last_clean":"2023-10-06T02:55:12.228337+0000","last_became_active":"2023-10-06T02:55:06.237939+0000","last_became_peered":"2023-10-06T02:55:06.237939+0000","last_unstale":"2023-10-06T02:55:12.228337+0000","last_undegraded":"2023-10-06T02:55:12.228337+0000","last_fullsized":"2023-10-06T02:55:12.228337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:02.326100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242677+0000","last_change":"2023-10-06T02:55:07.106782+0000","last_active":"2023-10-06T02:55:11.242677+0000","last_peered":"2023-10-06T02:55:11.242677+0000","last_clean":"2023-10-06T02:55:11.242677+0000","last_became_active":"2023-10-06T02:55:07.106537+0000","last_became_peered":"2023-10-06T02:55:07.106537+0000","last_unstale":"2023-10-06T02:55:11.242677+0000","last_undegraded":"2023-10-06T02:55:11.242677+0000","last_fullsized":"2023-10-06T02:55:11.242677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264229+0000","last_change":"2023-10-06T02:55:11.262893+0000","last_active":"2023-10-06T02:55:11.264229+0000","last_peered":"2023-10-06T02:55:11.264229+0000","last_clean":"2023-10-06T02:55:11.264229+0000","last_became_active":"2023-10-06T02:55:11.262445+0000","last_became_peered":"2023-10-06T02:55:11.262445+0000","last_unstale":"2023-10-06T02:55:11.264229+0000","last_undegraded":"2023-10-06T02:55:11.264229+0000","last_fullsized":"2023-10-06T02:55:11.264229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243094+0000","last_change":"2023-10-06T02:55:06.244999+0000","last_active":"2023-10-06T02:55:11.243094+0000","last_peered":"2023-10-06T02:55:11.243094+0000","last_clean":"2023-10-06T02:55:11.243094+0000","last_became_active":"2023-10-06T02:55:06.244558+0000","last_became_peered":"2023-10-06T02:55:06.244558+0000","last_unstale":"2023-10-06T02:55:11.243094+0000","last_undegraded":"2023-10-06T02:55:11.243094+0000","last_fullsized":"2023-10-06T02:55:11.243094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240384+0000","last_change":"2023-10-06T02:55:07.115236+0000","last_active":"2023-10-06T02:55:11.240384+0000","last_peered":"2023-10-06T02:55:11.240384+0000","last_clean":"2023-10-06T02:55:11.240384+0000","last_became_active":"2023-10-06T02:55:07.115036+0000","last_became_peered":"2023-10-06T02:55:07.115036+0000","last_unstale":"2023-10-06T02:55:11.240384+0000","last_undegraded":"2023-10-06T02:55:11.240384+0000","last_fullsized":"2023-10-06T02:55:11.240384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:28.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.262746+0000","last_change":"2023-10-06T02:55:11.258225+0000","last_active":"2023-10-06T02:55:11.262746+0000","last_peered":"2023-10-06T02:55:11.262746+0000","last_clean":"2023-10-06T02:55:11.262746+0000","last_became_active":"2023-10-06T02:55:11.257846+0000","last_became_peered":"2023-10-06T02:55:11.257846+0000","last_unstale":"2023-10-06T02:55:11.262746+0000","last_undegraded":"2023-10-06T02:55:11.262746+0000","last_fullsized":"2023-10-06T02:55:11.262746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236306+0000","last_change":"2023-10-06T02:55:06.243711+0000","last_active":"2023-10-06T02:55:11.236306+0000","last_peered":"2023-10-06T02:55:11.236306+0000","last_clean":"2023-10-06T02:55:11.236306+0000","last_became_active":"2023-10-06T02:55:06.243344+0000","last_became_peered":"2023-10-06T02:55:06.243344+0000","last_unstale":"2023-10-06T02:55:11.236306+0000","last_undegraded":"2023-10-06T02:55:11.236306+0000","last_fullsized":"2023-10-06T02:55:11.236306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243012+0000","last_change":"2023-10-06T02:55:07.114426+0000","last_active":"2023-10-06T02:55:11.243012+0000","last_peered":"2023-10-06T02:55:11.243012+0000","last_clean":"2023-10-06T02:55:11.243012+0000","last_became_active":"2023-10-06T02:55:07.114145+0000","last_became_peered":"2023-10-06T02:55:07.114145+0000","last_unstale":"2023-10-06T02:55:11.243012+0000","last_undegraded":"2023-10-06T02:55:11.243012+0000","last_fullsized":"2023-10-06T02:55:11.243012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261060+0000","last_change":"2023-10-06T02:55:11.254928+0000","last_active":"2023-10-06T02:55:11.261060+0000","last_peered":"2023-10-06T02:55:11.261060+0000","last_clean":"2023-10-06T02:55:11.261060+0000","last_became_active":"2023-10-06T02:55:11.254507+0000","last_became_peered":"2023-10-06T02:55:11.254507+0000","last_unstale":"2023-10-06T02:55:11.261060+0000","last_undegraded":"2023-10-06T02:55:11.261060+0000","last_fullsized":"2023-10-06T02:55:11.261060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236065+0000","last_change":"2023-10-06T02:55:06.243499+0000","last_active":"2023-10-06T02:55:11.236065+0000","last_peered":"2023-10-06T02:55:11.236065+0000","last_clean":"2023-10-06T02:55:11.236065+0000","last_became_active":"2023-10-06T02:55:06.243225+0000","last_became_peered":"2023-10-06T02:55:06.243225+0000","last_unstale":"2023-10-06T02:55:11.236065+0000","last_undegraded":"2023-10-06T02:55:11.236065+0000","last_fullsized":"2023-10-06T02:55:11.236065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242673+0000","last_change":"2023-10-06T02:55:07.109529+0000","last_active":"2023-10-06T02:55:11.242673+0000","last_peered":"2023-10-06T02:55:11.242673+0000","last_clean":"2023-10-06T02:55:11.242673+0000","last_became_active":"2023-10-06T02:55:07.109235+0000","last_became_peered":"2023-10-06T02:55:07.109235+0000","last_unstale":"2023-10-06T02:55:11.242673+0000","last_undegraded":"2023-10-06T02:55:11.242673+0000","last_fullsized":"2023-10-06T02:55:11.242673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:16.973575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264275+0000","last_change":"2023-10-06T02:55:11.259478+0000","last_active":"2023-10-06T02:55:11.264275+0000","last_peered":"2023-10-06T02:55:11.264275+0000","last_clean":"2023-10-06T02:55:11.264275+0000","last_became_active":"2023-10-06T02:55:11.258396+0000","last_became_peered":"2023-10-06T02:55:11.258396+0000","last_unstale":"2023-10-06T02:55:11.264275+0000","last_undegraded":"2023-10-06T02:55:11.264275+0000","last_fullsized":"2023-10-06T02:55:11.264275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.869089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235575+0000","last_change":"2023-10-06T02:55:06.243717+0000","last_active":"2023-10-06T02:55:11.235575+0000","last_peered":"2023-10-06T02:55:11.235575+0000","last_clean":"2023-10-06T02:55:11.235575+0000","last_became_active":"2023-10-06T02:55:06.243477+0000","last_became_peered":"2023-10-06T02:55:06.243477+0000","last_unstale":"2023-10-06T02:55:11.235575+0000","last_undegraded":"2023-10-06T02:55:11.235575+0000","last_fullsized":"2023-10-06T02:55:11.235575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:02.326100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235163+0000","last_change":"2023-10-06T02:55:07.109710+0000","last_active":"2023-10-06T02:55:11.235163+0000","last_peered":"2023-10-06T02:55:11.235163+0000","last_clean":"2023-10-06T02:55:11.235163+0000","last_became_active":"2023-10-06T02:55:07.109311+0000","last_became_peered":"2023-10-06T02:55:07.109311+0000","last_unstale":"2023-10-06T02:55:11.235163+0000","last_undegraded":"2023-10-06T02:55:11.235163+0000","last_fullsized":"2023-10-06T02:55:11.235163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.255838+0000","last_change":"2023-10-06T02:55:11.251970+0000","last_active":"2023-10-06T02:55:11.255838+0000","last_peered":"2023-10-06T02:55:11.255838+0000","last_clean":"2023-10-06T02:55:11.255838+0000","last_became_active":"2023-10-06T02:55:11.251576+0000","last_became_peered":"2023-10-06T02:55:11.251576+0000","last_unstale":"2023-10-06T02:55:11.255838+0000","last_undegraded":"2023-10-06T02:55:11.255838+0000","last_fullsized":"2023-10-06T02:55:11.255838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243536+0000","last_change":"2023-10-06T02:55:06.243528+0000","last_active":"2023-10-06T02:55:11.243536+0000","last_peered":"2023-10-06T02:55:11.243536+0000","last_clean":"2023-10-06T02:55:11.243536+0000","last_became_active":"2023-10-06T02:55:06.243235+0000","last_became_peered":"2023-10-06T02:55:06.243235+0000","last_unstale":"2023-10-06T02:55:11.243536+0000","last_undegraded":"2023-10-06T02:55:11.243536+0000","last_fullsized":"2023-10-06T02:55:11.243536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245975+0000","last_change":"2023-10-06T02:55:07.103783+0000","last_active":"2023-10-06T02:55:11.245975+0000","last_peered":"2023-10-06T02:55:11.245975+0000","last_clean":"2023-10-06T02:55:11.245975+0000","last_became_active":"2023-10-06T02:55:07.103380+0000","last_became_peered":"2023-10-06T02:55:07.103380+0000","last_unstale":"2023-10-06T02:55:11.245975+0000","last_undegraded":"2023-10-06T02:55:11.245975+0000","last_fullsized":"2023-10-06T02:55:11.245975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.943919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236264+0000","last_change":"2023-10-06T02:55:07.102410+0000","last_active":"2023-10-06T02:55:11.236264+0000","last_peered":"2023-10-06T02:55:11.236264+0000","last_clean":"2023-10-06T02:55:11.236264+0000","last_became_active":"2023-10-06T02:55:07.102078+0000","last_became_peered":"2023-10-06T02:55:07.102078+0000","last_unstale":"2023-10-06T02:55:11.236264+0000","last_undegraded":"2023-10-06T02:55:11.236264+0000","last_fullsized":"2023-10-06T02:55:11.236264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:05.829702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235500+0000","last_change":"2023-10-06T02:55:07.116830+0000","last_active":"2023-10-06T02:55:11.235500+0000","last_peered":"2023-10-06T02:55:11.235500+0000","last_clean":"2023-10-06T02:55:11.235500+0000","last_became_active":"2023-10-06T02:55:07.116644+0000","last_became_peered":"2023-10-06T02:55:07.116644+0000","last_unstale":"2023-10-06T02:55:11.235500+0000","last_undegraded":"2023-10-06T02:55:11.235500+0000","last_fullsized":"2023-10-06T02:55:11.235500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244388+0000","last_change":"2023-10-06T02:55:07.104996+0000","last_active":"2023-10-06T02:55:11.244388+0000","last_peered":"2023-10-06T02:55:11.244388+0000","last_clean":"2023-10-06T02:55:11.244388+0000","last_became_active":"2023-10-06T02:55:07.104710+0000","last_became_peered":"2023-10-06T02:55:07.104710+0000","last_unstale":"2023-10-06T02:55:11.244388+0000","last_undegraded":"2023-10-06T02:55:11.244388+0000","last_fullsized":"2023-10-06T02:55:11.244388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:09.033880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235232+0000","last_change":"2023-10-06T02:55:07.109367+0000","last_active":"2023-10-06T02:55:11.235232+0000","last_peered":"2023-10-06T02:55:11.235232+0000","last_clean":"2023-10-06T02:55:11.235232+0000","last_became_active":"2023-10-06T02:55:07.109089+0000","last_became_peered":"2023-10-06T02:55:07.109089+0000","last_unstale":"2023-10-06T02:55:11.235232+0000","last_undegraded":"2023-10-06T02:55:11.235232+0000","last_fullsized":"2023-10-06T02:55:11.235232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250624+0000","last_change":"2023-10-06T02:55:07.108442+0000","last_active":"2023-10-06T02:55:11.250624+0000","last_peered":"2023-10-06T02:55:11.250624+0000","last_clean":"2023-10-06T02:55:11.250624+0000","last_became_active":"2023-10-06T02:55:07.108151+0000","last_became_peered":"2023-10-06T02:55:07.108151+0000","last_unstale":"2023-10-06T02:55:11.250624+0000","last_undegraded":"2023-10-06T02:55:11.250624+0000","last_fullsized":"2023-10-06T02:55:11.250624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":118562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":118652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:55:24.833 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:55:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.977+0000 7f082dd11700 1 Processor -- start 2023-10-06T02:55:24.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.977+0000 7f082dd11700 1 -- start start 2023-10-06T02:55:24.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f082dd11700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08281595a0 0x7f08280aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f082dd11700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b49e0 0x7f08280aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f082dd11700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f08280b07a0 0x7f08280b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f082dd11700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08280b0ca0 con 0x7f08281595a0 2023-10-06T02:55:24.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f082dd11700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08280b0f80 con 0x7f08280b07a0 2023-10-06T02:55:24.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f082dd11700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280b1260 con 0x7f08280b49e0 2023-10-06T02:55:24.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f08277fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08281595a0 0x7f08280aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f08277fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08281595a0 0x7f08280aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39944/0 (socket says 172.21.15.84:39944) 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f08277fe700 1 -- 172.21.15.84:0/3790027653 learned_addr learned my addr 172.21.15.84:0/3790027653 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f0827fff700 1 --2- 172.21.15.84:0/3790027653 >> v2:172.21.15.131:3300/0 conn(0x7f08280b07a0 0x7f08280b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f0826ffd700 1 --2- 172.21.15.84:0/3790027653 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b49e0 0x7f08280aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f08277fe700 1 -- 172.21.15.84:0/3790027653 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b49e0 msgr2=0x7f08280aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f08277fe700 1 --2- 172.21.15.84:0/3790027653 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b49e0 0x7f08280aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f08277fe700 1 -- 172.21.15.84:0/3790027653 >> v2:172.21.15.131:3300/0 conn(0x7f08280b07a0 msgr2=0x7f08280b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f08277fe700 1 --2- 172.21.15.84:0/3790027653 >> v2:172.21.15.131:3300/0 conn(0x7f08280b07a0 0x7f08280b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f08277fe700 1 -- 172.21.15.84:0/3790027653 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280b1540 con 0x7f08281595a0 2023-10-06T02:55:24.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f0827fff700 1 --2- 172.21.15.84:0/3790027653 >> v2:172.21.15.131:3300/0 conn(0x7f08280b07a0 0x7f08280b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.978+0000 7f08277fe700 1 --2- 172.21.15.84:0/3790027653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08281595a0 0x7f08280aa570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f08280d04a0 tx=0x7f0818009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0c022540943af3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f08267fc700 1 -- 172.21.15.84:0/3790027653 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800e070 con 0x7f08281595a0 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f08267fc700 1 -- 172.21.15.84:0/3790027653 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800bad0 con 0x7f08281595a0 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f08267fc700 1 -- 172.21.15.84:0/3790027653 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08180092e0 con 0x7f08281595a0 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f082dd11700 1 -- 172.21.15.84:0/3790027653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08281595a0 msgr2=0x7f08280aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f082dd11700 1 --2- 172.21.15.84:0/3790027653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08281595a0 0x7f08280aa570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f08280d04a0 tx=0x7f0818009840 comp rx=0 tx=0).stop 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f082dd11700 1 -- 172.21.15.84:0/3790027653 shutdown_connections 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f082dd11700 1 --2- 172.21.15.84:0/3790027653 >> v2:172.21.15.131:3300/0 conn(0x7f08280b07a0 0x7f08280b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f082dd11700 1 --2- 172.21.15.84:0/3790027653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08281595a0 0x7f08280aa570 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f082dd11700 1 --2- 172.21.15.84:0/3790027653 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b49e0 0x7f08280aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f082dd11700 1 -- 172.21.15.84:0/3790027653 >> 172.21.15.84:0/3790027653 conn(0x7f0828099830 msgr2=0x7f082806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:24.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f082dd11700 1 -- 172.21.15.84:0/3790027653 shutdown_connections 2023-10-06T02:55:24.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.979+0000 7f082dd11700 1 -- 172.21.15.84:0/3790027653 wait complete. 2023-10-06T02:55:24.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.980+0000 7f082dd11700 1 Processor -- start 2023-10-06T02:55:24.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.980+0000 7f082dd11700 1 -- start start 2023-10-06T02:55:24.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f082dd11700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b07a0 0x7f08280af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f082dd11700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08280b49e0 0x7f082816ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f082dd11700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08281595a0 0x7f0828099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f082dd11700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082815bcd0 con 0x7f08280b49e0 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f082dd11700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280af830 con 0x7f08281595a0 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f082dd11700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082815b980 con 0x7f08280b07a0 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f0826ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08280b49e0 0x7f082816ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f0826ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08280b49e0 0x7f082816ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39954/0 (socket says 172.21.15.84:39954) 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f0826ffd700 1 -- 172.21.15.84:0/3829962860 learned_addr learned my addr 172.21.15.84:0/3829962860 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f08277fe700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b07a0 0x7f08280af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.981+0000 7f0827fff700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08281595a0 0x7f0828099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f0826ffd700 1 -- 172.21.15.84:0/3829962860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b07a0 msgr2=0x7f08280af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f0826ffd700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b07a0 0x7f08280af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f0826ffd700 1 -- 172.21.15.84:0/3829962860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08281595a0 msgr2=0x7f0828099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f0826ffd700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08281595a0 0x7f0828099f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f0826ffd700 1 -- 172.21.15.84:0/3829962860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818009ae0 con 0x7f08280b49e0 2023-10-06T02:55:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f08277fe700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b07a0 0x7f08280af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f0826ffd700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08280b49e0 0x7f082816ca80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f081c00d8c0 tx=0x7f081c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f080f7fe700 1 -- 172.21.15.84:0/3829962860 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c00de60 con 0x7f08280b49e0 2023-10-06T02:55:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f080f7fe700 1 -- 172.21.15.84:0/3829962860 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c00b780 con 0x7f08280b49e0 2023-10-06T02:55:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082816d460 con 0x7f08280b49e0 2023-10-06T02:55:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f080f7fe700 1 -- 172.21.15.84:0/3829962860 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c00bb20 con 0x7f08280b49e0 2023-10-06T02:55:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.982+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082809d880 con 0x7f08280b49e0 2023-10-06T02:55:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.983+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082815be80 con 0x7f08280b49e0 2023-10-06T02:55:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.983+0000 7f080f7fe700 1 -- 172.21.15.84:0/3829962860 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f081c01e460 con 0x7f08280b49e0 2023-10-06T02:55:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.984+0000 7f080f7fe700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0814066f30 0x7f08140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.984+0000 7f080f7fe700 1 -- 172.21.15.84:0/3829962860 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f081c085010 con 0x7f08280b49e0 2023-10-06T02:55:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.984+0000 7f08277fe700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0814066f30 0x7f08140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.984+0000 7f08277fe700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0814066f30 0x7f08140693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0818009fd0 tx=0x7f0818018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:24.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:24.988+0000 7f080f7fe700 1 -- 172.21.15.84:0/3829962860 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f082815be80 con 0x7f08280b49e0 2023-10-06T02:55:25.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.165+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f082809daa0 con 0x7f0814066f30 2023-10-06T02:55:25.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.174+0000 7f080f7fe700 1 -- 172.21.15.84:0/3829962860 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367388 (secure 0 0 0) 0x7f082809daa0 con 0x7f0814066f30 2023-10-06T02:55:25.180 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0814066f30 msgr2=0x7f08140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0814066f30 0x7f08140693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0818009fd0 tx=0x7f0818018000 comp rx=0 tx=0).stop 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08280b49e0 msgr2=0x7f082816ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08280b49e0 0x7f082816ca80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f081c00d8c0 tx=0x7f081c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 shutdown_connections 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0814066f30 0x7f08140693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08281595a0 0x7f0828099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08280b07a0 0x7f08280af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 --2- 172.21.15.84:0/3829962860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08280b49e0 0x7f082816ca80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 >> 172.21.15.84:0/3829962860 conn(0x7f0828099830 msgr2=0x7f08281589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:25.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 shutdown_connections 2023-10-06T02:55:25.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.178+0000 7f082dd11700 1 -- 172.21.15.84:0/3829962860 wait complete. 2023-10-06T02:55:25.184 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:55:25.191 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-10-06T02:55:23.805937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381788,"kb_used_data":3484,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592932,"statfs":{"total":773094113280,"available":770655162368,"internally_reserved":0,"allocated":3567616,"data_stored":2143255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.713979"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239422+0000","last_change":"2023-10-06T02:55:07.110201+0000","last_active":"2023-10-06T02:55:11.239422+0000","last_peered":"2023-10-06T02:55:11.239422+0000","last_clean":"2023-10-06T02:55:11.239422+0000","last_became_active":"2023-10-06T02:55:07.109835+0000","last_became_peered":"2023-10-06T02:55:07.109835+0000","last_unstale":"2023-10-06T02:55:11.239422+0000","last_undegraded":"2023-10-06T02:55:11.239422+0000","last_fullsized":"2023-10-06T02:55:11.239422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:37.914521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236087+0000","last_change":"2023-10-06T02:55:07.113784+0000","last_active":"2023-10-06T02:55:11.236087+0000","last_peered":"2023-10-06T02:55:11.236087+0000","last_clean":"2023-10-06T02:55:11.236087+0000","last_became_active":"2023-10-06T02:55:07.113542+0000","last_became_peered":"2023-10-06T02:55:07.113542+0000","last_unstale":"2023-10-06T02:55:11.236087+0000","last_undegraded":"2023-10-06T02:55:11.236087+0000","last_fullsized":"2023-10-06T02:55:11.236087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:45.135333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244003+0000","last_change":"2023-10-06T02:55:07.109629+0000","last_active":"2023-10-06T02:55:11.244003+0000","last_peered":"2023-10-06T02:55:11.244003+0000","last_clean":"2023-10-06T02:55:11.244003+0000","last_became_active":"2023-10-06T02:55:07.109299+0000","last_became_peered":"2023-10-06T02:55:07.109299+0000","last_unstale":"2023-10-06T02:55:11.244003+0000","last_undegraded":"2023-10-06T02:55:11.244003+0000","last_fullsized":"2023-10-06T02:55:11.244003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:18.661747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236454+0000","last_change":"2023-10-06T02:55:07.109778+0000","last_active":"2023-10-06T02:55:11.236454+0000","last_peered":"2023-10-06T02:55:11.236454+0000","last_clean":"2023-10-06T02:55:11.236454+0000","last_became_active":"2023-10-06T02:55:07.109509+0000","last_became_peered":"2023-10-06T02:55:07.109509+0000","last_unstale":"2023-10-06T02:55:11.236454+0000","last_undegraded":"2023-10-06T02:55:11.236454+0000","last_fullsized":"2023-10-06T02:55:11.236454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:06.894832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243263+0000","last_change":"2023-10-06T02:55:07.114751+0000","last_active":"2023-10-06T02:55:11.243263+0000","last_peered":"2023-10-06T02:55:11.243263+0000","last_clean":"2023-10-06T02:55:11.243263+0000","last_became_active":"2023-10-06T02:55:07.114487+0000","last_became_peered":"2023-10-06T02:55:07.114487+0000","last_unstale":"2023-10-06T02:55:11.243263+0000","last_undegraded":"2023-10-06T02:55:11.243263+0000","last_fullsized":"2023-10-06T02:55:11.243263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244303+0000","last_change":"2023-10-06T02:55:07.111190+0000","last_active":"2023-10-06T02:55:11.244303+0000","last_peered":"2023-10-06T02:55:11.244303+0000","last_clean":"2023-10-06T02:55:11.244303+0000","last_became_active":"2023-10-06T02:55:07.110893+0000","last_became_peered":"2023-10-06T02:55:07.110893+0000","last_unstale":"2023-10-06T02:55:11.244303+0000","last_undegraded":"2023-10-06T02:55:11.244303+0000","last_fullsized":"2023-10-06T02:55:11.244303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:41.387727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.247033+0000","last_change":"2023-10-06T02:55:07.114160+0000","last_active":"2023-10-06T02:55:11.247033+0000","last_peered":"2023-10-06T02:55:11.247033+0000","last_clean":"2023-10-06T02:55:11.247033+0000","last_became_active":"2023-10-06T02:55:07.113571+0000","last_became_peered":"2023-10-06T02:55:07.113571+0000","last_unstale":"2023-10-06T02:55:11.247033+0000","last_undegraded":"2023-10-06T02:55:11.247033+0000","last_fullsized":"2023-10-06T02:55:11.247033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235851+0000","last_change":"2023-10-06T02:55:07.106766+0000","last_active":"2023-10-06T02:55:11.235851+0000","last_peered":"2023-10-06T02:55:11.235851+0000","last_clean":"2023-10-06T02:55:11.235851+0000","last_became_active":"2023-10-06T02:55:07.106562+0000","last_became_peered":"2023-10-06T02:55:07.106562+0000","last_unstale":"2023-10-06T02:55:11.235851+0000","last_undegraded":"2023-10-06T02:55:11.235851+0000","last_fullsized":"2023-10-06T02:55:11.235851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243386+0000","last_change":"2023-10-06T02:55:07.112458+0000","last_active":"2023-10-06T02:55:11.243386+0000","last_peered":"2023-10-06T02:55:11.243386+0000","last_clean":"2023-10-06T02:55:11.243386+0000","last_became_active":"2023-10-06T02:55:07.112034+0000","last_became_peered":"2023-10-06T02:55:07.112034+0000","last_unstale":"2023-10-06T02:55:11.243386+0000","last_undegraded":"2023-10-06T02:55:11.243386+0000","last_fullsized":"2023-10-06T02:55:11.243386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236308+0000","last_change":"2023-10-06T02:55:07.110571+0000","last_active":"2023-10-06T02:55:11.236308+0000","last_peered":"2023-10-06T02:55:11.236308+0000","last_clean":"2023-10-06T02:55:11.236308+0000","last_became_active":"2023-10-06T02:55:07.110305+0000","last_became_peered":"2023-10-06T02:55:07.110305+0000","last_unstale":"2023-10-06T02:55:11.236308+0000","last_undegraded":"2023-10-06T02:55:11.236308+0000","last_fullsized":"2023-10-06T02:55:11.236308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:48.545728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243893+0000","last_change":"2023-10-06T02:55:07.111579+0000","last_active":"2023-10-06T02:55:11.243893+0000","last_peered":"2023-10-06T02:55:11.243893+0000","last_clean":"2023-10-06T02:55:11.243893+0000","last_became_active":"2023-10-06T02:55:07.111318+0000","last_became_peered":"2023-10-06T02:55:07.111318+0000","last_unstale":"2023-10-06T02:55:11.243893+0000","last_undegraded":"2023-10-06T02:55:11.243893+0000","last_fullsized":"2023-10-06T02:55:11.243893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:47.019187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240508+0000","last_change":"2023-10-06T02:55:07.104069+0000","last_active":"2023-10-06T02:55:11.240508+0000","last_peered":"2023-10-06T02:55:11.240508+0000","last_clean":"2023-10-06T02:55:11.240508+0000","last_became_active":"2023-10-06T02:55:07.103805+0000","last_became_peered":"2023-10-06T02:55:07.103805+0000","last_unstale":"2023-10-06T02:55:11.240508+0000","last_undegraded":"2023-10-06T02:55:11.240508+0000","last_fullsized":"2023-10-06T02:55:11.240508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:05.829702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239484+0000","last_change":"2023-10-06T02:55:07.109817+0000","last_active":"2023-10-06T02:55:11.239484+0000","last_peered":"2023-10-06T02:55:11.239484+0000","last_clean":"2023-10-06T02:55:11.239484+0000","last_became_active":"2023-10-06T02:55:07.109582+0000","last_became_peered":"2023-10-06T02:55:07.109582+0000","last_unstale":"2023-10-06T02:55:11.239484+0000","last_undegraded":"2023-10-06T02:55:11.239484+0000","last_fullsized":"2023-10-06T02:55:11.239484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:51.423073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236216+0000","last_change":"2023-10-06T02:55:07.108183+0000","last_active":"2023-10-06T02:55:11.236216+0000","last_peered":"2023-10-06T02:55:11.236216+0000","last_clean":"2023-10-06T02:55:11.236216+0000","last_became_active":"2023-10-06T02:55:07.107919+0000","last_became_peered":"2023-10-06T02:55:07.107919+0000","last_unstale":"2023-10-06T02:55:11.236216+0000","last_undegraded":"2023-10-06T02:55:11.236216+0000","last_fullsized":"2023-10-06T02:55:11.236216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:50.364030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246844+0000","last_change":"2023-10-06T02:55:07.114341+0000","last_active":"2023-10-06T02:55:11.246844+0000","last_peered":"2023-10-06T02:55:11.246844+0000","last_clean":"2023-10-06T02:55:11.246844+0000","last_became_active":"2023-10-06T02:55:07.113900+0000","last_became_peered":"2023-10-06T02:55:07.113900+0000","last_unstale":"2023-10-06T02:55:11.246844+0000","last_undegraded":"2023-10-06T02:55:11.246844+0000","last_fullsized":"2023-10-06T02:55:11.246844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245965+0000","last_change":"2023-10-06T02:55:07.111225+0000","last_active":"2023-10-06T02:55:11.245965+0000","last_peered":"2023-10-06T02:55:11.245965+0000","last_clean":"2023-10-06T02:55:11.245965+0000","last_became_active":"2023-10-06T02:55:07.110865+0000","last_became_peered":"2023-10-06T02:55:07.110865+0000","last_unstale":"2023-10-06T02:55:11.245965+0000","last_undegraded":"2023-10-06T02:55:11.245965+0000","last_fullsized":"2023-10-06T02:55:11.245965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243421+0000","last_change":"2023-10-06T02:55:07.112286+0000","last_active":"2023-10-06T02:55:11.243421+0000","last_peered":"2023-10-06T02:55:11.243421+0000","last_clean":"2023-10-06T02:55:11.243421+0000","last_became_active":"2023-10-06T02:55:07.111766+0000","last_became_peered":"2023-10-06T02:55:07.111766+0000","last_unstale":"2023-10-06T02:55:11.243421+0000","last_undegraded":"2023-10-06T02:55:11.243421+0000","last_fullsized":"2023-10-06T02:55:11.243421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245058+0000","last_change":"2023-10-06T02:55:07.104506+0000","last_active":"2023-10-06T02:55:11.245058+0000","last_peered":"2023-10-06T02:55:11.245058+0000","last_clean":"2023-10-06T02:55:11.245058+0000","last_became_active":"2023-10-06T02:55:07.103148+0000","last_became_peered":"2023-10-06T02:55:07.103148+0000","last_unstale":"2023-10-06T02:55:11.245058+0000","last_undegraded":"2023-10-06T02:55:11.245058+0000","last_fullsized":"2023-10-06T02:55:11.245058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:30.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239743+0000","last_change":"2023-10-06T02:55:07.102510+0000","last_active":"2023-10-06T02:55:11.239743+0000","last_peered":"2023-10-06T02:55:11.239743+0000","last_clean":"2023-10-06T02:55:11.239743+0000","last_became_active":"2023-10-06T02:55:07.102223+0000","last_became_peered":"2023-10-06T02:55:07.102223+0000","last_unstale":"2023-10-06T02:55:11.239743+0000","last_undegraded":"2023-10-06T02:55:11.239743+0000","last_fullsized":"2023-10-06T02:55:11.239743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:03.327947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.241862+0000","last_change":"2023-10-06T02:55:07.103814+0000","last_active":"2023-10-06T02:55:11.241862+0000","last_peered":"2023-10-06T02:55:11.241862+0000","last_clean":"2023-10-06T02:55:11.241862+0000","last_became_active":"2023-10-06T02:55:07.103540+0000","last_became_peered":"2023-10-06T02:55:07.103540+0000","last_unstale":"2023-10-06T02:55:11.241862+0000","last_undegraded":"2023-10-06T02:55:11.241862+0000","last_fullsized":"2023-10-06T02:55:11.241862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249731+0000","last_change":"2023-10-06T02:55:07.111270+0000","last_active":"2023-10-06T02:55:11.249731+0000","last_peered":"2023-10-06T02:55:11.249731+0000","last_clean":"2023-10-06T02:55:11.249731+0000","last_became_active":"2023-10-06T02:55:07.110988+0000","last_became_peered":"2023-10-06T02:55:07.110988+0000","last_unstale":"2023-10-06T02:55:11.249731+0000","last_undegraded":"2023-10-06T02:55:11.249731+0000","last_fullsized":"2023-10-06T02:55:11.249731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242949+0000","last_change":"2023-10-06T02:55:07.112801+0000","last_active":"2023-10-06T02:55:11.242949+0000","last_peered":"2023-10-06T02:55:11.242949+0000","last_clean":"2023-10-06T02:55:11.242949+0000","last_became_active":"2023-10-06T02:55:07.112541+0000","last_became_peered":"2023-10-06T02:55:07.112541+0000","last_unstale":"2023-10-06T02:55:11.242949+0000","last_undegraded":"2023-10-06T02:55:11.242949+0000","last_fullsized":"2023-10-06T02:55:11.242949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:50.364030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.234999+0000","last_change":"2023-10-06T02:55:07.112735+0000","last_active":"2023-10-06T02:55:11.234999+0000","last_peered":"2023-10-06T02:55:11.234999+0000","last_clean":"2023-10-06T02:55:11.234999+0000","last_became_active":"2023-10-06T02:55:07.112354+0000","last_became_peered":"2023-10-06T02:55:07.112354+0000","last_unstale":"2023-10-06T02:55:11.234999+0000","last_undegraded":"2023-10-06T02:55:11.234999+0000","last_fullsized":"2023-10-06T02:55:11.234999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:30.704691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246446+0000","last_change":"2023-10-06T02:55:07.111427+0000","last_active":"2023-10-06T02:55:11.246446+0000","last_peered":"2023-10-06T02:55:11.246446+0000","last_clean":"2023-10-06T02:55:11.246446+0000","last_became_active":"2023-10-06T02:55:07.111175+0000","last_became_peered":"2023-10-06T02:55:07.111175+0000","last_unstale":"2023-10-06T02:55:11.246446+0000","last_undegraded":"2023-10-06T02:55:11.246446+0000","last_fullsized":"2023-10-06T02:55:11.246446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251151+0000","last_change":"2023-10-06T02:55:07.111532+0000","last_active":"2023-10-06T02:55:11.251151+0000","last_peered":"2023-10-06T02:55:11.251151+0000","last_clean":"2023-10-06T02:55:11.251151+0000","last_became_active":"2023-10-06T02:55:07.111049+0000","last_became_peered":"2023-10-06T02:55:07.111049+0000","last_unstale":"2023-10-06T02:55:11.251151+0000","last_undegraded":"2023-10-06T02:55:11.251151+0000","last_fullsized":"2023-10-06T02:55:11.251151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251111+0000","last_change":"2023-10-06T02:55:07.107260+0000","last_active":"2023-10-06T02:55:11.251111+0000","last_peered":"2023-10-06T02:55:11.251111+0000","last_clean":"2023-10-06T02:55:11.251111+0000","last_became_active":"2023-10-06T02:55:07.107057+0000","last_became_peered":"2023-10-06T02:55:07.107057+0000","last_unstale":"2023-10-06T02:55:11.251111+0000","last_undegraded":"2023-10-06T02:55:11.251111+0000","last_fullsized":"2023-10-06T02:55:11.251111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:03.676682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236378+0000","last_change":"2023-10-06T02:55:07.109107+0000","last_active":"2023-10-06T02:55:11.236378+0000","last_peered":"2023-10-06T02:55:11.236378+0000","last_clean":"2023-10-06T02:55:11.236378+0000","last_became_active":"2023-10-06T02:55:07.108804+0000","last_became_peered":"2023-10-06T02:55:07.108804+0000","last_unstale":"2023-10-06T02:55:11.236378+0000","last_undegraded":"2023-10-06T02:55:11.236378+0000","last_fullsized":"2023-10-06T02:55:11.236378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261436+0000","last_change":"2023-10-06T02:55:11.256831+0000","last_active":"2023-10-06T02:55:11.261436+0000","last_peered":"2023-10-06T02:55:11.261436+0000","last_clean":"2023-10-06T02:55:11.261436+0000","last_became_active":"2023-10-06T02:55:11.255607+0000","last_became_peered":"2023-10-06T02:55:11.255607+0000","last_unstale":"2023-10-06T02:55:11.261436+0000","last_undegraded":"2023-10-06T02:55:11.261436+0000","last_fullsized":"2023-10-06T02:55:11.261436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:59.809138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244213+0000","last_change":"2023-10-06T02:55:06.241953+0000","last_active":"2023-10-06T02:55:11.244213+0000","last_peered":"2023-10-06T02:55:11.244213+0000","last_clean":"2023-10-06T02:55:11.244213+0000","last_became_active":"2023-10-06T02:55:06.241631+0000","last_became_peered":"2023-10-06T02:55:06.241631+0000","last_unstale":"2023-10-06T02:55:11.244213+0000","last_undegraded":"2023-10-06T02:55:11.244213+0000","last_fullsized":"2023-10-06T02:55:11.244213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:13.153122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235457+0000","last_change":"2023-10-06T02:55:07.116546+0000","last_active":"2023-10-06T02:55:11.235457+0000","last_peered":"2023-10-06T02:55:11.235457+0000","last_clean":"2023-10-06T02:55:11.235457+0000","last_became_active":"2023-10-06T02:55:07.116298+0000","last_became_peered":"2023-10-06T02:55:07.116298+0000","last_unstale":"2023-10-06T02:55:11.235457+0000","last_undegraded":"2023-10-06T02:55:11.235457+0000","last_fullsized":"2023-10-06T02:55:11.235457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:09.033880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261529+0000","last_change":"2023-10-06T02:55:11.255287+0000","last_active":"2023-10-06T02:55:11.261529+0000","last_peered":"2023-10-06T02:55:11.261529+0000","last_clean":"2023-10-06T02:55:11.261529+0000","last_became_active":"2023-10-06T02:55:11.254851+0000","last_became_peered":"2023-10-06T02:55:11.254851+0000","last_unstale":"2023-10-06T02:55:11.261529+0000","last_undegraded":"2023-10-06T02:55:11.261529+0000","last_fullsized":"2023-10-06T02:55:11.261529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:39.598115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250011+0000","last_change":"2023-10-06T02:55:06.241290+0000","last_active":"2023-10-06T02:55:11.250011+0000","last_peered":"2023-10-06T02:55:11.250011+0000","last_clean":"2023-10-06T02:55:11.250011+0000","last_became_active":"2023-10-06T02:55:06.240960+0000","last_became_peered":"2023-10-06T02:55:06.240960+0000","last_unstale":"2023-10-06T02:55:11.250011+0000","last_undegraded":"2023-10-06T02:55:11.250011+0000","last_fullsized":"2023-10-06T02:55:11.250011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246457+0000","last_change":"2023-10-06T02:55:07.109573+0000","last_active":"2023-10-06T02:55:11.246457+0000","last_peered":"2023-10-06T02:55:11.246457+0000","last_clean":"2023-10-06T02:55:11.246457+0000","last_became_active":"2023-10-06T02:55:07.109273+0000","last_became_peered":"2023-10-06T02:55:07.109273+0000","last_unstale":"2023-10-06T02:55:11.246457+0000","last_undegraded":"2023-10-06T02:55:11.246457+0000","last_fullsized":"2023-10-06T02:55:11.246457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.254596+0000","last_change":"2023-10-06T02:55:11.252497+0000","last_active":"2023-10-06T02:55:11.254596+0000","last_peered":"2023-10-06T02:55:11.254596+0000","last_clean":"2023-10-06T02:55:11.254596+0000","last_became_active":"2023-10-06T02:55:11.252152+0000","last_became_peered":"2023-10-06T02:55:11.252152+0000","last_unstale":"2023-10-06T02:55:11.254596+0000","last_undegraded":"2023-10-06T02:55:11.254596+0000","last_fullsized":"2023-10-06T02:55:11.254596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:05.228696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235239+0000","last_change":"2023-10-06T02:55:06.244855+0000","last_active":"2023-10-06T02:55:11.235239+0000","last_peered":"2023-10-06T02:55:11.235239+0000","last_clean":"2023-10-06T02:55:11.235239+0000","last_became_active":"2023-10-06T02:55:06.243833+0000","last_became_peered":"2023-10-06T02:55:06.243833+0000","last_unstale":"2023-10-06T02:55:11.235239+0000","last_undegraded":"2023-10-06T02:55:11.235239+0000","last_fullsized":"2023-10-06T02:55:11.235239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.239474+0000","last_change":"2023-10-06T02:55:07.106155+0000","last_active":"2023-10-06T02:55:11.239474+0000","last_peered":"2023-10-06T02:55:11.239474+0000","last_clean":"2023-10-06T02:55:11.239474+0000","last_became_active":"2023-10-06T02:55:07.105422+0000","last_became_peered":"2023-10-06T02:55:07.105422+0000","last_unstale":"2023-10-06T02:55:11.239474+0000","last_undegraded":"2023-10-06T02:55:11.239474+0000","last_fullsized":"2023-10-06T02:55:11.239474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:26.954598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258752+0000","last_change":"2023-10-06T02:55:11.252464+0000","last_active":"2023-10-06T02:55:11.258752+0000","last_peered":"2023-10-06T02:55:11.258752+0000","last_clean":"2023-10-06T02:55:11.258752+0000","last_became_active":"2023-10-06T02:55:11.252055+0000","last_became_peered":"2023-10-06T02:55:11.252055+0000","last_unstale":"2023-10-06T02:55:11.258752+0000","last_undegraded":"2023-10-06T02:55:11.258752+0000","last_fullsized":"2023-10-06T02:55:11.258752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:30.678912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243469+0000","last_change":"2023-10-06T02:55:06.243634+0000","last_active":"2023-10-06T02:55:11.243469+0000","last_peered":"2023-10-06T02:55:11.243469+0000","last_clean":"2023-10-06T02:55:11.243469+0000","last_became_active":"2023-10-06T02:55:06.243383+0000","last_became_peered":"2023-10-06T02:55:06.243383+0000","last_unstale":"2023-10-06T02:55:11.243469+0000","last_undegraded":"2023-10-06T02:55:11.243469+0000","last_fullsized":"2023-10-06T02:55:11.243469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235163+0000","last_change":"2023-10-06T02:55:07.117239+0000","last_active":"2023-10-06T02:55:11.235163+0000","last_peered":"2023-10-06T02:55:11.235163+0000","last_clean":"2023-10-06T02:55:11.235163+0000","last_became_active":"2023-10-06T02:55:07.116968+0000","last_became_peered":"2023-10-06T02:55:07.116968+0000","last_unstale":"2023-10-06T02:55:11.235163+0000","last_undegraded":"2023-10-06T02:55:11.235163+0000","last_fullsized":"2023-10-06T02:55:11.235163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258755+0000","last_change":"2023-10-06T02:55:11.254938+0000","last_active":"2023-10-06T02:55:11.258755+0000","last_peered":"2023-10-06T02:55:11.258755+0000","last_clean":"2023-10-06T02:55:11.258755+0000","last_became_active":"2023-10-06T02:55:11.254650+0000","last_became_peered":"2023-10-06T02:55:11.254650+0000","last_unstale":"2023-10-06T02:55:11.258755+0000","last_undegraded":"2023-10-06T02:55:11.258755+0000","last_fullsized":"2023-10-06T02:55:11.258755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:07.497924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236203+0000","last_change":"2023-10-06T02:55:06.239366+0000","last_active":"2023-10-06T02:55:11.236203+0000","last_peered":"2023-10-06T02:55:11.236203+0000","last_clean":"2023-10-06T02:55:11.236203+0000","last_became_active":"2023-10-06T02:55:06.239143+0000","last_became_peered":"2023-10-06T02:55:06.239143+0000","last_unstale":"2023-10-06T02:55:11.236203+0000","last_undegraded":"2023-10-06T02:55:11.236203+0000","last_fullsized":"2023-10-06T02:55:11.236203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:13.153122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235067+0000","last_change":"2023-10-06T02:55:07.109897+0000","last_active":"2023-10-06T02:55:11.235067+0000","last_peered":"2023-10-06T02:55:11.235067+0000","last_clean":"2023-10-06T02:55:11.235067+0000","last_became_active":"2023-10-06T02:55:07.108992+0000","last_became_peered":"2023-10-06T02:55:07.108992+0000","last_unstale":"2023-10-06T02:55:11.235067+0000","last_undegraded":"2023-10-06T02:55:11.235067+0000","last_fullsized":"2023-10-06T02:55:11.235067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:30:03.653175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253878+0000","last_change":"2023-10-06T02:55:11.249347+0000","last_active":"2023-10-06T02:55:11.253878+0000","last_peered":"2023-10-06T02:55:11.253878+0000","last_clean":"2023-10-06T02:55:11.253878+0000","last_became_active":"2023-10-06T02:55:11.248973+0000","last_became_peered":"2023-10-06T02:55:11.248973+0000","last_unstale":"2023-10-06T02:55:11.253878+0000","last_undegraded":"2023-10-06T02:55:11.253878+0000","last_fullsized":"2023-10-06T02:55:11.253878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.869089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249346+0000","last_change":"2023-10-06T02:55:06.244730+0000","last_active":"2023-10-06T02:55:11.249346+0000","last_peered":"2023-10-06T02:55:11.249346+0000","last_clean":"2023-10-06T02:55:11.249346+0000","last_became_active":"2023-10-06T02:55:06.244530+0000","last_became_peered":"2023-10-06T02:55:06.244530+0000","last_unstale":"2023-10-06T02:55:11.249346+0000","last_undegraded":"2023-10-06T02:55:11.249346+0000","last_fullsized":"2023-10-06T02:55:11.249346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:57.942072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250185+0000","last_change":"2023-10-06T02:55:07.113744+0000","last_active":"2023-10-06T02:55:11.250185+0000","last_peered":"2023-10-06T02:55:11.250185+0000","last_clean":"2023-10-06T02:55:11.250185+0000","last_became_active":"2023-10-06T02:55:07.110700+0000","last_became_peered":"2023-10-06T02:55:07.110700+0000","last_unstale":"2023-10-06T02:55:11.250185+0000","last_undegraded":"2023-10-06T02:55:11.250185+0000","last_fullsized":"2023-10-06T02:55:11.250185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:31:45.135333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264143+0000","last_change":"2023-10-06T02:55:11.262345+0000","last_active":"2023-10-06T02:55:11.264143+0000","last_peered":"2023-10-06T02:55:11.264143+0000","last_clean":"2023-10-06T02:55:11.264143+0000","last_became_active":"2023-10-06T02:55:11.261934+0000","last_became_peered":"2023-10-06T02:55:11.261934+0000","last_unstale":"2023-10-06T02:55:11.264143+0000","last_undegraded":"2023-10-06T02:55:11.264143+0000","last_fullsized":"2023-10-06T02:55:11.264143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T02:55:17.004310+0000","last_change":"2023-10-06T02:55:06.238681+0000","last_active":"2023-10-06T02:55:17.004310+0000","last_peered":"2023-10-06T02:55:17.004310+0000","last_clean":"2023-10-06T02:55:17.004310+0000","last_became_active":"2023-10-06T02:55:06.238378+0000","last_became_peered":"2023-10-06T02:55:06.238378+0000","last_unstale":"2023-10-06T02:55:17.004310+0000","last_undegraded":"2023-10-06T02:55:17.004310+0000","last_fullsized":"2023-10-06T02:55:17.004310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:53.170462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242315+0000","last_change":"2023-10-06T02:55:07.103795+0000","last_active":"2023-10-06T02:55:11.242315+0000","last_peered":"2023-10-06T02:55:11.242315+0000","last_clean":"2023-10-06T02:55:11.242315+0000","last_became_active":"2023-10-06T02:55:07.103512+0000","last_became_peered":"2023-10-06T02:55:07.103512+0000","last_unstale":"2023-10-06T02:55:11.242315+0000","last_undegraded":"2023-10-06T02:55:11.242315+0000","last_fullsized":"2023-10-06T02:55:11.242315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256756+0000","last_change":"2023-10-06T02:55:11.251476+0000","last_active":"2023-10-06T02:55:11.256756+0000","last_peered":"2023-10-06T02:55:11.256756+0000","last_clean":"2023-10-06T02:55:11.256756+0000","last_became_active":"2023-10-06T02:55:11.250987+0000","last_became_peered":"2023-10-06T02:55:11.250987+0000","last_unstale":"2023-10-06T02:55:11.256756+0000","last_undegraded":"2023-10-06T02:55:11.256756+0000","last_fullsized":"2023-10-06T02:55:11.256756+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:14.100962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249652+0000","last_change":"2023-10-06T02:55:06.246906+0000","last_active":"2023-10-06T02:55:11.249652+0000","last_peered":"2023-10-06T02:55:11.249652+0000","last_clean":"2023-10-06T02:55:11.249652+0000","last_became_active":"2023-10-06T02:55:06.246640+0000","last_became_peered":"2023-10-06T02:55:06.246640+0000","last_unstale":"2023-10-06T02:55:11.249652+0000","last_undegraded":"2023-10-06T02:55:11.249652+0000","last_fullsized":"2023-10-06T02:55:11.249652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:02.944198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235544+0000","last_change":"2023-10-06T02:55:07.116704+0000","last_active":"2023-10-06T02:55:11.235544+0000","last_peered":"2023-10-06T02:55:11.235544+0000","last_clean":"2023-10-06T02:55:11.235544+0000","last_became_active":"2023-10-06T02:55:07.116441+0000","last_became_peered":"2023-10-06T02:55:07.116441+0000","last_unstale":"2023-10-06T02:55:11.235544+0000","last_undegraded":"2023-10-06T02:55:11.235544+0000","last_fullsized":"2023-10-06T02:55:11.235544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263207+0000","last_change":"2023-10-06T02:55:11.258974+0000","last_active":"2023-10-06T02:55:11.263207+0000","last_peered":"2023-10-06T02:55:11.263207+0000","last_clean":"2023-10-06T02:55:11.263207+0000","last_became_active":"2023-10-06T02:55:11.258615+0000","last_became_peered":"2023-10-06T02:55:11.258615+0000","last_unstale":"2023-10-06T02:55:11.263207+0000","last_undegraded":"2023-10-06T02:55:11.263207+0000","last_fullsized":"2023-10-06T02:55:11.263207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:22.469427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242843+0000","last_change":"2023-10-06T02:55:06.240931+0000","last_active":"2023-10-06T02:55:11.242843+0000","last_peered":"2023-10-06T02:55:11.242843+0000","last_clean":"2023-10-06T02:55:11.242843+0000","last_became_active":"2023-10-06T02:55:06.240681+0000","last_became_peered":"2023-10-06T02:55:06.240681+0000","last_unstale":"2023-10-06T02:55:11.242843+0000","last_undegraded":"2023-10-06T02:55:11.242843+0000","last_fullsized":"2023-10-06T02:55:11.242843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236292+0000","last_change":"2023-10-06T02:55:07.108936+0000","last_active":"2023-10-06T02:55:11.236292+0000","last_peered":"2023-10-06T02:55:11.236292+0000","last_clean":"2023-10-06T02:55:11.236292+0000","last_became_active":"2023-10-06T02:55:07.108696+0000","last_became_peered":"2023-10-06T02:55:07.108696+0000","last_unstale":"2023-10-06T02:55:11.236292+0000","last_undegraded":"2023-10-06T02:55:11.236292+0000","last_fullsized":"2023-10-06T02:55:11.236292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263173+0000","last_change":"2023-10-06T02:55:11.258916+0000","last_active":"2023-10-06T02:55:11.263173+0000","last_peered":"2023-10-06T02:55:11.263173+0000","last_clean":"2023-10-06T02:55:11.263173+0000","last_became_active":"2023-10-06T02:55:11.258551+0000","last_became_peered":"2023-10-06T02:55:11.258551+0000","last_unstale":"2023-10-06T02:55:11.263173+0000","last_undegraded":"2023-10-06T02:55:11.263173+0000","last_fullsized":"2023-10-06T02:55:11.263173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:29.955535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246941+0000","last_change":"2023-10-06T02:55:06.246931+0000","last_active":"2023-10-06T02:55:11.246941+0000","last_peered":"2023-10-06T02:55:11.246941+0000","last_clean":"2023-10-06T02:55:11.246941+0000","last_became_active":"2023-10-06T02:55:06.246709+0000","last_became_peered":"2023-10-06T02:55:06.246709+0000","last_unstale":"2023-10-06T02:55:11.246941+0000","last_undegraded":"2023-10-06T02:55:11.246941+0000","last_fullsized":"2023-10-06T02:55:11.246941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:04.827855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246634+0000","last_change":"2023-10-06T02:55:07.114181+0000","last_active":"2023-10-06T02:55:11.246634+0000","last_peered":"2023-10-06T02:55:11.246634+0000","last_clean":"2023-10-06T02:55:11.246634+0000","last_became_active":"2023-10-06T02:55:07.113881+0000","last_became_peered":"2023-10-06T02:55:07.113881+0000","last_unstale":"2023-10-06T02:55:11.246634+0000","last_undegraded":"2023-10-06T02:55:11.246634+0000","last_fullsized":"2023-10-06T02:55:11.246634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:00:26.664984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256543+0000","last_change":"2023-10-06T02:55:11.253825+0000","last_active":"2023-10-06T02:55:11.256543+0000","last_peered":"2023-10-06T02:55:11.256543+0000","last_clean":"2023-10-06T02:55:11.256543+0000","last_became_active":"2023-10-06T02:55:11.253052+0000","last_became_peered":"2023-10-06T02:55:11.253052+0000","last_unstale":"2023-10-06T02:55:11.256543+0000","last_undegraded":"2023-10-06T02:55:11.256543+0000","last_fullsized":"2023-10-06T02:55:11.256543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:22.469427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236177+0000","last_change":"2023-10-06T02:55:06.235238+0000","last_active":"2023-10-06T02:55:11.236177+0000","last_peered":"2023-10-06T02:55:11.236177+0000","last_clean":"2023-10-06T02:55:11.236177+0000","last_became_active":"2023-10-06T02:55:06.234941+0000","last_became_peered":"2023-10-06T02:55:06.234941+0000","last_unstale":"2023-10-06T02:55:11.236177+0000","last_undegraded":"2023-10-06T02:55:11.236177+0000","last_fullsized":"2023-10-06T02:55:11.236177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:22.823456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235743+0000","last_change":"2023-10-06T02:55:07.110108+0000","last_active":"2023-10-06T02:55:11.235743+0000","last_peered":"2023-10-06T02:55:11.235743+0000","last_clean":"2023-10-06T02:55:11.235743+0000","last_became_active":"2023-10-06T02:55:07.108982+0000","last_became_peered":"2023-10-06T02:55:07.108982+0000","last_unstale":"2023-10-06T02:55:11.235743+0000","last_undegraded":"2023-10-06T02:55:11.235743+0000","last_fullsized":"2023-10-06T02:55:11.235743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:09.755341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264350+0000","last_change":"2023-10-06T02:55:11.261896+0000","last_active":"2023-10-06T02:55:11.264350+0000","last_peered":"2023-10-06T02:55:11.264350+0000","last_clean":"2023-10-06T02:55:11.264350+0000","last_became_active":"2023-10-06T02:55:11.258453+0000","last_became_peered":"2023-10-06T02:55:11.258453+0000","last_unstale":"2023-10-06T02:55:11.264350+0000","last_undegraded":"2023-10-06T02:55:11.264350+0000","last_fullsized":"2023-10-06T02:55:11.264350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.248625+0000","last_change":"2023-10-06T02:55:06.246468+0000","last_active":"2023-10-06T02:55:11.248625+0000","last_peered":"2023-10-06T02:55:11.248625+0000","last_clean":"2023-10-06T02:55:11.248625+0000","last_became_active":"2023-10-06T02:55:06.246181+0000","last_became_peered":"2023-10-06T02:55:06.246181+0000","last_unstale":"2023-10-06T02:55:11.248625+0000","last_undegraded":"2023-10-06T02:55:11.248625+0000","last_fullsized":"2023-10-06T02:55:11.248625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:05.892985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235746+0000","last_change":"2023-10-06T02:55:07.108301+0000","last_active":"2023-10-06T02:55:11.235746+0000","last_peered":"2023-10-06T02:55:11.235746+0000","last_clean":"2023-10-06T02:55:11.235746+0000","last_became_active":"2023-10-06T02:55:07.108018+0000","last_became_peered":"2023-10-06T02:55:07.108018+0000","last_unstale":"2023-10-06T02:55:11.235746+0000","last_undegraded":"2023-10-06T02:55:11.235746+0000","last_fullsized":"2023-10-06T02:55:11.235746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:31.879772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253713+0000","last_change":"2023-10-06T02:55:11.250732+0000","last_active":"2023-10-06T02:55:11.253713+0000","last_peered":"2023-10-06T02:55:11.253713+0000","last_clean":"2023-10-06T02:55:11.253713+0000","last_became_active":"2023-10-06T02:55:11.250256+0000","last_became_peered":"2023-10-06T02:55:11.250256+0000","last_unstale":"2023-10-06T02:55:11.253713+0000","last_undegraded":"2023-10-06T02:55:11.253713+0000","last_fullsized":"2023-10-06T02:55:11.253713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:48.288942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246540+0000","last_change":"2023-10-06T02:55:06.246429+0000","last_active":"2023-10-06T02:55:11.246540+0000","last_peered":"2023-10-06T02:55:11.246540+0000","last_clean":"2023-10-06T02:55:11.246540+0000","last_became_active":"2023-10-06T02:55:06.246133+0000","last_became_peered":"2023-10-06T02:55:06.246133+0000","last_unstale":"2023-10-06T02:55:11.246540+0000","last_undegraded":"2023-10-06T02:55:11.246540+0000","last_fullsized":"2023-10-06T02:55:11.246540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242766+0000","last_change":"2023-10-06T02:55:07.111918+0000","last_active":"2023-10-06T02:55:11.242766+0000","last_peered":"2023-10-06T02:55:11.242766+0000","last_clean":"2023-10-06T02:55:11.242766+0000","last_became_active":"2023-10-06T02:55:07.111192+0000","last_became_peered":"2023-10-06T02:55:07.111192+0000","last_unstale":"2023-10-06T02:55:11.242766+0000","last_undegraded":"2023-10-06T02:55:11.242766+0000","last_fullsized":"2023-10-06T02:55:11.242766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:03.869547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.255431+0000","last_change":"2023-10-06T02:55:11.254429+0000","last_active":"2023-10-06T02:55:11.255431+0000","last_peered":"2023-10-06T02:55:11.255431+0000","last_clean":"2023-10-06T02:55:11.255431+0000","last_became_active":"2023-10-06T02:55:11.253634+0000","last_became_peered":"2023-10-06T02:55:11.253634+0000","last_unstale":"2023-10-06T02:55:11.255431+0000","last_undegraded":"2023-10-06T02:55:11.255431+0000","last_fullsized":"2023-10-06T02:55:11.255431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:39.598115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249543+0000","last_change":"2023-10-06T02:55:06.244313+0000","last_active":"2023-10-06T02:55:11.249543+0000","last_peered":"2023-10-06T02:55:11.249543+0000","last_clean":"2023-10-06T02:55:11.249543+0000","last_became_active":"2023-10-06T02:55:06.244045+0000","last_became_peered":"2023-10-06T02:55:06.244045+0000","last_unstale":"2023-10-06T02:55:11.249543+0000","last_undegraded":"2023-10-06T02:55:11.249543+0000","last_fullsized":"2023-10-06T02:55:11.249543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:49.362183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240556+0000","last_change":"2023-10-06T02:55:07.112001+0000","last_active":"2023-10-06T02:55:11.240556+0000","last_peered":"2023-10-06T02:55:11.240556+0000","last_clean":"2023-10-06T02:55:11.240556+0000","last_became_active":"2023-10-06T02:55:07.111530+0000","last_became_peered":"2023-10-06T02:55:07.111530+0000","last_unstale":"2023-10-06T02:55:11.240556+0000","last_undegraded":"2023-10-06T02:55:11.240556+0000","last_fullsized":"2023-10-06T02:55:11.240556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:28.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261909+0000","last_change":"2023-10-06T02:55:11.254821+0000","last_active":"2023-10-06T02:55:11.261909+0000","last_peered":"2023-10-06T02:55:11.261909+0000","last_clean":"2023-10-06T02:55:11.261909+0000","last_became_active":"2023-10-06T02:55:11.254465+0000","last_became_peered":"2023-10-06T02:55:11.254465+0000","last_unstale":"2023-10-06T02:55:11.261909+0000","last_undegraded":"2023-10-06T02:55:11.261909+0000","last_fullsized":"2023-10-06T02:55:11.261909+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:22.675675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236372+0000","last_change":"2023-10-06T02:55:06.240642+0000","last_active":"2023-10-06T02:55:11.236372+0000","last_peered":"2023-10-06T02:55:11.236372+0000","last_clean":"2023-10-06T02:55:11.236372+0000","last_became_active":"2023-10-06T02:55:06.240361+0000","last_became_peered":"2023-10-06T02:55:06.240361+0000","last_unstale":"2023-10-06T02:55:11.236372+0000","last_undegraded":"2023-10-06T02:55:11.236372+0000","last_fullsized":"2023-10-06T02:55:11.236372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:35.258998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243005+0000","last_change":"2023-10-06T02:55:07.111431+0000","last_active":"2023-10-06T02:55:11.243005+0000","last_peered":"2023-10-06T02:55:11.243005+0000","last_clean":"2023-10-06T02:55:11.243005+0000","last_became_active":"2023-10-06T02:55:07.111223+0000","last_became_peered":"2023-10-06T02:55:07.111223+0000","last_unstale":"2023-10-06T02:55:11.243005+0000","last_undegraded":"2023-10-06T02:55:11.243005+0000","last_fullsized":"2023-10-06T02:55:11.243005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.262798+0000","last_change":"2023-10-06T02:55:11.258918+0000","last_active":"2023-10-06T02:55:11.262798+0000","last_peered":"2023-10-06T02:55:11.262798+0000","last_clean":"2023-10-06T02:55:11.262798+0000","last_became_active":"2023-10-06T02:55:11.258550+0000","last_became_peered":"2023-10-06T02:55:11.258550+0000","last_unstale":"2023-10-06T02:55:11.262798+0000","last_undegraded":"2023-10-06T02:55:11.262798+0000","last_fullsized":"2023-10-06T02:55:11.262798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:34.718619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235093+0000","last_change":"2023-10-06T02:55:06.243599+0000","last_active":"2023-10-06T02:55:11.235093+0000","last_peered":"2023-10-06T02:55:11.235093+0000","last_clean":"2023-10-06T02:55:11.235093+0000","last_became_active":"2023-10-06T02:55:06.243327+0000","last_became_peered":"2023-10-06T02:55:06.243327+0000","last_unstale":"2023-10-06T02:55:11.235093+0000","last_undegraded":"2023-10-06T02:55:11.235093+0000","last_fullsized":"2023-10-06T02:55:11.235093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:35.258998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.241631+0000","last_change":"2023-10-06T02:55:07.113758+0000","last_active":"2023-10-06T02:55:11.241631+0000","last_peered":"2023-10-06T02:55:11.241631+0000","last_clean":"2023-10-06T02:55:11.241631+0000","last_became_active":"2023-10-06T02:55:07.113506+0000","last_became_peered":"2023-10-06T02:55:07.113506+0000","last_unstale":"2023-10-06T02:55:11.241631+0000","last_undegraded":"2023-10-06T02:55:11.241631+0000","last_fullsized":"2023-10-06T02:55:11.241631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:44.275013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264161+0000","last_change":"2023-10-06T02:55:11.262774+0000","last_active":"2023-10-06T02:55:11.264161+0000","last_peered":"2023-10-06T02:55:11.264161+0000","last_clean":"2023-10-06T02:55:11.264161+0000","last_became_active":"2023-10-06T02:55:11.262415+0000","last_became_peered":"2023-10-06T02:55:11.262415+0000","last_unstale":"2023-10-06T02:55:11.264161+0000","last_undegraded":"2023-10-06T02:55:11.264161+0000","last_fullsized":"2023-10-06T02:55:11.264161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240564+0000","last_change":"2023-10-06T02:55:06.242089+0000","last_active":"2023-10-06T02:55:11.240564+0000","last_peered":"2023-10-06T02:55:11.240564+0000","last_clean":"2023-10-06T02:55:11.240564+0000","last_became_active":"2023-10-06T02:55:06.241809+0000","last_became_peered":"2023-10-06T02:55:06.241809+0000","last_unstale":"2023-10-06T02:55:11.240564+0000","last_undegraded":"2023-10-06T02:55:11.240564+0000","last_fullsized":"2023-10-06T02:55:11.240564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:00.333890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243430+0000","last_change":"2023-10-06T02:55:07.103210+0000","last_active":"2023-10-06T02:55:11.243430+0000","last_peered":"2023-10-06T02:55:11.243430+0000","last_clean":"2023-10-06T02:55:11.243430+0000","last_became_active":"2023-10-06T02:55:07.102900+0000","last_became_peered":"2023-10-06T02:55:07.102900+0000","last_unstale":"2023-10-06T02:55:11.243430+0000","last_undegraded":"2023-10-06T02:55:11.243430+0000","last_fullsized":"2023-10-06T02:55:11.243430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263787+0000","last_change":"2023-10-06T02:55:11.256640+0000","last_active":"2023-10-06T02:55:11.263787+0000","last_peered":"2023-10-06T02:55:11.263787+0000","last_clean":"2023-10-06T02:55:11.263787+0000","last_became_active":"2023-10-06T02:55:11.254235+0000","last_became_peered":"2023-10-06T02:55:11.254235+0000","last_unstale":"2023-10-06T02:55:11.263787+0000","last_undegraded":"2023-10-06T02:55:11.263787+0000","last_fullsized":"2023-10-06T02:55:11.263787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:04.291016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242562+0000","last_change":"2023-10-06T02:55:06.237767+0000","last_active":"2023-10-06T02:55:11.242562+0000","last_peered":"2023-10-06T02:55:11.242562+0000","last_clean":"2023-10-06T02:55:11.242562+0000","last_became_active":"2023-10-06T02:55:06.237033+0000","last_became_peered":"2023-10-06T02:55:06.237033+0000","last_unstale":"2023-10-06T02:55:11.242562+0000","last_undegraded":"2023-10-06T02:55:11.242562+0000","last_fullsized":"2023-10-06T02:55:11.242562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:00.333890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245169+0000","last_change":"2023-10-06T02:55:07.100985+0000","last_active":"2023-10-06T02:55:11.245169+0000","last_peered":"2023-10-06T02:55:11.245169+0000","last_clean":"2023-10-06T02:55:11.245169+0000","last_became_active":"2023-10-06T02:55:07.100724+0000","last_became_peered":"2023-10-06T02:55:07.100724+0000","last_unstale":"2023-10-06T02:55:11.245169+0000","last_undegraded":"2023-10-06T02:55:11.245169+0000","last_fullsized":"2023-10-06T02:55:11.245169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261373+0000","last_change":"2023-10-06T02:55:11.254821+0000","last_active":"2023-10-06T02:55:11.261373+0000","last_peered":"2023-10-06T02:55:11.261373+0000","last_clean":"2023-10-06T02:55:11.261373+0000","last_became_active":"2023-10-06T02:55:11.254344+0000","last_became_peered":"2023-10-06T02:55:11.254344+0000","last_unstale":"2023-10-06T02:55:11.261373+0000","last_undegraded":"2023-10-06T02:55:11.261373+0000","last_fullsized":"2023-10-06T02:55:11.261373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:28.325601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235090+0000","last_change":"2023-10-06T02:55:06.240594+0000","last_active":"2023-10-06T02:55:11.235090+0000","last_peered":"2023-10-06T02:55:11.235090+0000","last_clean":"2023-10-06T02:55:11.235090+0000","last_became_active":"2023-10-06T02:55:06.240357+0000","last_became_peered":"2023-10-06T02:55:06.240357+0000","last_unstale":"2023-10-06T02:55:11.235090+0000","last_undegraded":"2023-10-06T02:55:11.235090+0000","last_fullsized":"2023-10-06T02:55:11.235090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251318+0000","last_change":"2023-10-06T02:55:07.116386+0000","last_active":"2023-10-06T02:55:11.251318+0000","last_peered":"2023-10-06T02:55:11.251318+0000","last_clean":"2023-10-06T02:55:11.251318+0000","last_became_active":"2023-10-06T02:55:07.116115+0000","last_became_peered":"2023-10-06T02:55:07.116115+0000","last_unstale":"2023-10-06T02:55:11.251318+0000","last_undegraded":"2023-10-06T02:55:11.251318+0000","last_fullsized":"2023-10-06T02:55:11.251318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:58.022736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.260498+0000","last_change":"2023-10-06T02:55:11.258056+0000","last_active":"2023-10-06T02:55:11.260498+0000","last_peered":"2023-10-06T02:55:11.260498+0000","last_clean":"2023-10-06T02:55:11.260498+0000","last_became_active":"2023-10-06T02:55:11.256479+0000","last_became_peered":"2023-10-06T02:55:11.256479+0000","last_unstale":"2023-10-06T02:55:11.260498+0000","last_undegraded":"2023-10-06T02:55:11.260498+0000","last_fullsized":"2023-10-06T02:55:11.260498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250543+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:55:11.250543+0000","last_peered":"2023-10-06T02:55:11.250543+0000","last_clean":"2023-10-06T02:55:11.250543+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:55:11.250543+0000","last_undegraded":"2023-10-06T02:55:11.250543+0000","last_fullsized":"2023-10-06T02:55:11.250543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236179+0000","last_change":"2023-10-06T02:55:06.240875+0000","last_active":"2023-10-06T02:55:11.236179+0000","last_peered":"2023-10-06T02:55:11.236179+0000","last_clean":"2023-10-06T02:55:11.236179+0000","last_became_active":"2023-10-06T02:55:06.240637+0000","last_became_peered":"2023-10-06T02:55:06.240637+0000","last_unstale":"2023-10-06T02:55:11.236179+0000","last_undegraded":"2023-10-06T02:55:11.236179+0000","last_fullsized":"2023-10-06T02:55:11.236179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250109+0000","last_change":"2023-10-06T02:55:07.111939+0000","last_active":"2023-10-06T02:55:11.250109+0000","last_peered":"2023-10-06T02:55:11.250109+0000","last_clean":"2023-10-06T02:55:11.250109+0000","last_became_active":"2023-10-06T02:55:07.111076+0000","last_became_peered":"2023-10-06T02:55:07.111076+0000","last_unstale":"2023-10-06T02:55:11.250109+0000","last_undegraded":"2023-10-06T02:55:11.250109+0000","last_fullsized":"2023-10-06T02:55:11.250109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.258159+0000","last_change":"2023-10-06T02:55:11.257606+0000","last_active":"2023-10-06T02:55:11.258159+0000","last_peered":"2023-10-06T02:55:11.258159+0000","last_clean":"2023-10-06T02:55:11.258159+0000","last_became_active":"2023-10-06T02:55:11.257305+0000","last_became_peered":"2023-10-06T02:55:11.257305+0000","last_unstale":"2023-10-06T02:55:11.258159+0000","last_undegraded":"2023-10-06T02:55:11.258159+0000","last_fullsized":"2023-10-06T02:55:11.258159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236318+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:55:11.236318+0000","last_peered":"2023-10-06T02:55:11.236318+0000","last_clean":"2023-10-06T02:55:11.236318+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:55:11.236318+0000","last_undegraded":"2023-10-06T02:55:11.236318+0000","last_fullsized":"2023-10-06T02:55:11.236318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242421+0000","last_change":"2023-10-06T02:55:06.245888+0000","last_active":"2023-10-06T02:55:11.242421+0000","last_peered":"2023-10-06T02:55:11.242421+0000","last_clean":"2023-10-06T02:55:11.242421+0000","last_became_active":"2023-10-06T02:55:06.245610+0000","last_became_peered":"2023-10-06T02:55:06.245610+0000","last_unstale":"2023-10-06T02:55:11.242421+0000","last_undegraded":"2023-10-06T02:55:11.242421+0000","last_fullsized":"2023-10-06T02:55:11.242421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:22.823456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250468+0000","last_change":"2023-10-06T02:55:07.105844+0000","last_active":"2023-10-06T02:55:11.250468+0000","last_peered":"2023-10-06T02:55:11.250468+0000","last_clean":"2023-10-06T02:55:11.250468+0000","last_became_active":"2023-10-06T02:55:07.105587+0000","last_became_peered":"2023-10-06T02:55:07.105587+0000","last_unstale":"2023-10-06T02:55:11.250468+0000","last_undegraded":"2023-10-06T02:55:11.250468+0000","last_fullsized":"2023-10-06T02:55:11.250468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:39.307208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.254953+0000","last_change":"2023-10-06T02:55:11.252978+0000","last_active":"2023-10-06T02:55:11.254953+0000","last_peered":"2023-10-06T02:55:11.254953+0000","last_clean":"2023-10-06T02:55:11.254953+0000","last_became_active":"2023-10-06T02:55:11.252446+0000","last_became_peered":"2023-10-06T02:55:11.252446+0000","last_unstale":"2023-10-06T02:55:11.254953+0000","last_undegraded":"2023-10-06T02:55:11.254953+0000","last_fullsized":"2023-10-06T02:55:11.254953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:20.987504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.238567+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:55:11.238567+0000","last_peered":"2023-10-06T02:55:11.238567+0000","last_clean":"2023-10-06T02:55:11.238567+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:55:11.238567+0000","last_undegraded":"2023-10-06T02:55:11.238567+0000","last_fullsized":"2023-10-06T02:55:11.238567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250490+0000","last_change":"2023-10-06T02:55:06.234766+0000","last_active":"2023-10-06T02:55:11.250490+0000","last_peered":"2023-10-06T02:55:11.250490+0000","last_clean":"2023-10-06T02:55:11.250490+0000","last_became_active":"2023-10-06T02:55:06.234390+0000","last_became_peered":"2023-10-06T02:55:06.234390+0000","last_unstale":"2023-10-06T02:55:11.250490+0000","last_undegraded":"2023-10-06T02:55:11.250490+0000","last_fullsized":"2023-10-06T02:55:11.250490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251232+0000","last_change":"2023-10-06T02:55:07.112215+0000","last_active":"2023-10-06T02:55:11.251232+0000","last_peered":"2023-10-06T02:55:11.251232+0000","last_clean":"2023-10-06T02:55:11.251232+0000","last_became_active":"2023-10-06T02:55:07.110597+0000","last_became_peered":"2023-10-06T02:55:07.110597+0000","last_unstale":"2023-10-06T02:55:11.251232+0000","last_undegraded":"2023-10-06T02:55:11.251232+0000","last_fullsized":"2023-10-06T02:55:11.251232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:19.614914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.267018+0000","last_change":"2023-10-06T02:55:11.259468+0000","last_active":"2023-10-06T02:55:11.267018+0000","last_peered":"2023-10-06T02:55:11.267018+0000","last_clean":"2023-10-06T02:55:11.267018+0000","last_became_active":"2023-10-06T02:55:11.259056+0000","last_became_peered":"2023-10-06T02:55:11.259056+0000","last_unstale":"2023-10-06T02:55:11.267018+0000","last_undegraded":"2023-10-06T02:55:11.267018+0000","last_fullsized":"2023-10-06T02:55:11.267018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:49.377473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236914+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:55:11.236914+0000","last_peered":"2023-10-06T02:55:11.236914+0000","last_clean":"2023-10-06T02:55:11.236914+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:55:11.236914+0000","last_undegraded":"2023-10-06T02:55:11.236914+0000","last_fullsized":"2023-10-06T02:55:11.236914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246339+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:55:11.246339+0000","last_peered":"2023-10-06T02:55:11.246339+0000","last_clean":"2023-10-06T02:55:11.246339+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:55:11.246339+0000","last_undegraded":"2023-10-06T02:55:11.246339+0000","last_fullsized":"2023-10-06T02:55:11.246339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235039+0000","last_change":"2023-10-06T02:55:06.244584+0000","last_active":"2023-10-06T02:55:11.235039+0000","last_peered":"2023-10-06T02:55:11.235039+0000","last_clean":"2023-10-06T02:55:11.235039+0000","last_became_active":"2023-10-06T02:55:06.244277+0000","last_became_peered":"2023-10-06T02:55:06.244277+0000","last_unstale":"2023-10-06T02:55:11.235039+0000","last_undegraded":"2023-10-06T02:55:11.235039+0000","last_fullsized":"2023-10-06T02:55:11.235039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235736+0000","last_change":"2023-10-06T02:55:07.102220+0000","last_active":"2023-10-06T02:55:11.235736+0000","last_peered":"2023-10-06T02:55:11.235736+0000","last_clean":"2023-10-06T02:55:11.235736+0000","last_became_active":"2023-10-06T02:55:07.101946+0000","last_became_peered":"2023-10-06T02:55:07.101946+0000","last_unstale":"2023-10-06T02:55:11.235736+0000","last_undegraded":"2023-10-06T02:55:11.235736+0000","last_fullsized":"2023-10-06T02:55:11.235736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:03.946045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.263766+0000","last_change":"2023-10-06T02:55:11.256345+0000","last_active":"2023-10-06T02:55:11.263766+0000","last_peered":"2023-10-06T02:55:11.263766+0000","last_clean":"2023-10-06T02:55:11.263766+0000","last_became_active":"2023-10-06T02:55:11.253584+0000","last_became_peered":"2023-10-06T02:55:11.253584+0000","last_unstale":"2023-10-06T02:55:11.263766+0000","last_undegraded":"2023-10-06T02:55:11.263766+0000","last_fullsized":"2023-10-06T02:55:11.263766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246558+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:55:11.246558+0000","last_peered":"2023-10-06T02:55:11.246558+0000","last_clean":"2023-10-06T02:55:11.246558+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:55:11.246558+0000","last_undegraded":"2023-10-06T02:55:11.246558+0000","last_fullsized":"2023-10-06T02:55:11.246558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242581+0000","last_change":"2023-10-06T02:55:06.243148+0000","last_active":"2023-10-06T02:55:11.242581+0000","last_peered":"2023-10-06T02:55:11.242581+0000","last_clean":"2023-10-06T02:55:11.242581+0000","last_became_active":"2023-10-06T02:55:06.242874+0000","last_became_peered":"2023-10-06T02:55:06.242874+0000","last_unstale":"2023-10-06T02:55:11.242581+0000","last_undegraded":"2023-10-06T02:55:11.242581+0000","last_fullsized":"2023-10-06T02:55:11.242581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.246552+0000","last_change":"2023-10-06T02:55:07.112041+0000","last_active":"2023-10-06T02:55:11.246552+0000","last_peered":"2023-10-06T02:55:11.246552+0000","last_clean":"2023-10-06T02:55:11.246552+0000","last_became_active":"2023-10-06T02:55:07.111789+0000","last_became_peered":"2023-10-06T02:55:07.111789+0000","last_unstale":"2023-10-06T02:55:11.246552+0000","last_undegraded":"2023-10-06T02:55:11.246552+0000","last_fullsized":"2023-10-06T02:55:11.246552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:09.755341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.256412+0000","last_change":"2023-10-06T02:55:11.251646+0000","last_active":"2023-10-06T02:55:11.256412+0000","last_peered":"2023-10-06T02:55:11.256412+0000","last_clean":"2023-10-06T02:55:11.256412+0000","last_became_active":"2023-10-06T02:55:11.251231+0000","last_became_peered":"2023-10-06T02:55:11.251231+0000","last_unstale":"2023-10-06T02:55:11.256412+0000","last_undegraded":"2023-10-06T02:55:11.256412+0000","last_fullsized":"2023-10-06T02:55:11.256412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:44.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.249446+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:55:11.249446+0000","last_peered":"2023-10-06T02:55:11.249446+0000","last_clean":"2023-10-06T02:55:11.249446+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:55:11.249446+0000","last_undegraded":"2023-10-06T02:55:11.249446+0000","last_fullsized":"2023-10-06T02:55:11.249446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250704+0000","last_change":"2023-10-06T02:55:06.235823+0000","last_active":"2023-10-06T02:55:11.250704+0000","last_peered":"2023-10-06T02:55:11.250704+0000","last_clean":"2023-10-06T02:55:11.250704+0000","last_became_active":"2023-10-06T02:55:06.235199+0000","last_became_peered":"2023-10-06T02:55:06.235199+0000","last_unstale":"2023-10-06T02:55:11.250704+0000","last_undegraded":"2023-10-06T02:55:11.250704+0000","last_fullsized":"2023-10-06T02:55:11.250704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:36.912674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243179+0000","last_change":"2023-10-06T02:55:07.110542+0000","last_active":"2023-10-06T02:55:11.243179+0000","last_peered":"2023-10-06T02:55:11.243179+0000","last_clean":"2023-10-06T02:55:11.243179+0000","last_became_active":"2023-10-06T02:55:07.110114+0000","last_became_peered":"2023-10-06T02:55:07.110114+0000","last_unstale":"2023-10-06T02:55:11.243179+0000","last_undegraded":"2023-10-06T02:55:11.243179+0000","last_fullsized":"2023-10-06T02:55:11.243179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264312+0000","last_change":"2023-10-06T02:55:11.259777+0000","last_active":"2023-10-06T02:55:11.264312+0000","last_peered":"2023-10-06T02:55:11.264312+0000","last_clean":"2023-10-06T02:55:11.264312+0000","last_became_active":"2023-10-06T02:55:11.259304+0000","last_became_peered":"2023-10-06T02:55:11.259304+0000","last_unstale":"2023-10-06T02:55:11.264312+0000","last_undegraded":"2023-10-06T02:55:11.264312+0000","last_fullsized":"2023-10-06T02:55:11.264312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:00.296633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235554+0000","last_change":"2023-10-06T02:55:06.240511+0000","last_active":"2023-10-06T02:55:11.235554+0000","last_peered":"2023-10-06T02:55:11.235554+0000","last_clean":"2023-10-06T02:55:11.235554+0000","last_became_active":"2023-10-06T02:55:06.240232+0000","last_became_peered":"2023-10-06T02:55:06.240232+0000","last_unstale":"2023-10-06T02:55:11.235554+0000","last_undegraded":"2023-10-06T02:55:11.235554+0000","last_fullsized":"2023-10-06T02:55:11.235554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.251025+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:55:11.251025+0000","last_peered":"2023-10-06T02:55:11.251025+0000","last_clean":"2023-10-06T02:55:11.251025+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:55:11.251025+0000","last_undegraded":"2023-10-06T02:55:11.251025+0000","last_fullsized":"2023-10-06T02:55:11.251025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.234999+0000","last_change":"2023-10-06T02:55:07.109361+0000","last_active":"2023-10-06T02:55:11.234999+0000","last_peered":"2023-10-06T02:55:11.234999+0000","last_clean":"2023-10-06T02:55:11.234999+0000","last_became_active":"2023-10-06T02:55:07.109009+0000","last_became_peered":"2023-10-06T02:55:07.109009+0000","last_unstale":"2023-10-06T02:55:11.234999+0000","last_undegraded":"2023-10-06T02:55:11.234999+0000","last_fullsized":"2023-10-06T02:55:11.234999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.943919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.253185+0000","last_change":"2023-10-06T02:55:11.248862+0000","last_active":"2023-10-06T02:55:11.253185+0000","last_peered":"2023-10-06T02:55:11.253185+0000","last_clean":"2023-10-06T02:55:11.253185+0000","last_became_active":"2023-10-06T02:55:11.248509+0000","last_became_peered":"2023-10-06T02:55:11.248509+0000","last_unstale":"2023-10-06T02:55:11.253185+0000","last_undegraded":"2023-10-06T02:55:11.253185+0000","last_fullsized":"2023-10-06T02:55:11.253185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:17.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.238397+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:55:11.238397+0000","last_peered":"2023-10-06T02:55:11.238397+0000","last_clean":"2023-10-06T02:55:11.238397+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:55:11.238397+0000","last_undegraded":"2023-10-06T02:55:11.238397+0000","last_fullsized":"2023-10-06T02:55:11.238397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T02:55:12.228337+0000","last_change":"2023-10-06T02:55:06.238192+0000","last_active":"2023-10-06T02:55:12.228337+0000","last_peered":"2023-10-06T02:55:12.228337+0000","last_clean":"2023-10-06T02:55:12.228337+0000","last_became_active":"2023-10-06T02:55:06.237939+0000","last_became_peered":"2023-10-06T02:55:06.237939+0000","last_unstale":"2023-10-06T02:55:12.228337+0000","last_undegraded":"2023-10-06T02:55:12.228337+0000","last_fullsized":"2023-10-06T02:55:12.228337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:02.326100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242677+0000","last_change":"2023-10-06T02:55:07.106782+0000","last_active":"2023-10-06T02:55:11.242677+0000","last_peered":"2023-10-06T02:55:11.242677+0000","last_clean":"2023-10-06T02:55:11.242677+0000","last_became_active":"2023-10-06T02:55:07.106537+0000","last_became_peered":"2023-10-06T02:55:07.106537+0000","last_unstale":"2023-10-06T02:55:11.242677+0000","last_undegraded":"2023-10-06T02:55:11.242677+0000","last_fullsized":"2023-10-06T02:55:11.242677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:56:01.045231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264229+0000","last_change":"2023-10-06T02:55:11.262893+0000","last_active":"2023-10-06T02:55:11.264229+0000","last_peered":"2023-10-06T02:55:11.264229+0000","last_clean":"2023-10-06T02:55:11.264229+0000","last_became_active":"2023-10-06T02:55:11.262445+0000","last_became_peered":"2023-10-06T02:55:11.262445+0000","last_unstale":"2023-10-06T02:55:11.264229+0000","last_undegraded":"2023-10-06T02:55:11.264229+0000","last_fullsized":"2023-10-06T02:55:11.264229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243094+0000","last_change":"2023-10-06T02:55:06.244999+0000","last_active":"2023-10-06T02:55:11.243094+0000","last_peered":"2023-10-06T02:55:11.243094+0000","last_clean":"2023-10-06T02:55:11.243094+0000","last_became_active":"2023-10-06T02:55:06.244558+0000","last_became_peered":"2023-10-06T02:55:06.244558+0000","last_unstale":"2023-10-06T02:55:11.243094+0000","last_undegraded":"2023-10-06T02:55:11.243094+0000","last_fullsized":"2023-10-06T02:55:11.243094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.240384+0000","last_change":"2023-10-06T02:55:07.115236+0000","last_active":"2023-10-06T02:55:11.240384+0000","last_peered":"2023-10-06T02:55:11.240384+0000","last_clean":"2023-10-06T02:55:11.240384+0000","last_became_active":"2023-10-06T02:55:07.115036+0000","last_became_peered":"2023-10-06T02:55:07.115036+0000","last_unstale":"2023-10-06T02:55:11.240384+0000","last_undegraded":"2023-10-06T02:55:11.240384+0000","last_fullsized":"2023-10-06T02:55:11.240384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:28.603540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.262746+0000","last_change":"2023-10-06T02:55:11.258225+0000","last_active":"2023-10-06T02:55:11.262746+0000","last_peered":"2023-10-06T02:55:11.262746+0000","last_clean":"2023-10-06T02:55:11.262746+0000","last_became_active":"2023-10-06T02:55:11.257846+0000","last_became_peered":"2023-10-06T02:55:11.257846+0000","last_unstale":"2023-10-06T02:55:11.262746+0000","last_undegraded":"2023-10-06T02:55:11.262746+0000","last_fullsized":"2023-10-06T02:55:11.262746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236306+0000","last_change":"2023-10-06T02:55:06.243711+0000","last_active":"2023-10-06T02:55:11.236306+0000","last_peered":"2023-10-06T02:55:11.236306+0000","last_clean":"2023-10-06T02:55:11.236306+0000","last_became_active":"2023-10-06T02:55:06.243344+0000","last_became_peered":"2023-10-06T02:55:06.243344+0000","last_unstale":"2023-10-06T02:55:11.236306+0000","last_undegraded":"2023-10-06T02:55:11.236306+0000","last_fullsized":"2023-10-06T02:55:11.236306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:27.601693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243012+0000","last_change":"2023-10-06T02:55:07.114426+0000","last_active":"2023-10-06T02:55:11.243012+0000","last_peered":"2023-10-06T02:55:11.243012+0000","last_clean":"2023-10-06T02:55:11.243012+0000","last_became_active":"2023-10-06T02:55:07.114145+0000","last_became_peered":"2023-10-06T02:55:07.114145+0000","last_unstale":"2023-10-06T02:55:11.243012+0000","last_undegraded":"2023-10-06T02:55:11.243012+0000","last_fullsized":"2023-10-06T02:55:11.243012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:35.584186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.261060+0000","last_change":"2023-10-06T02:55:11.254928+0000","last_active":"2023-10-06T02:55:11.261060+0000","last_peered":"2023-10-06T02:55:11.261060+0000","last_clean":"2023-10-06T02:55:11.261060+0000","last_became_active":"2023-10-06T02:55:11.254507+0000","last_became_peered":"2023-10-06T02:55:11.254507+0000","last_unstale":"2023-10-06T02:55:11.261060+0000","last_undegraded":"2023-10-06T02:55:11.261060+0000","last_fullsized":"2023-10-06T02:55:11.261060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:20.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236065+0000","last_change":"2023-10-06T02:55:06.243499+0000","last_active":"2023-10-06T02:55:11.236065+0000","last_peered":"2023-10-06T02:55:11.236065+0000","last_clean":"2023-10-06T02:55:11.236065+0000","last_became_active":"2023-10-06T02:55:06.243225+0000","last_became_peered":"2023-10-06T02:55:06.243225+0000","last_unstale":"2023-10-06T02:55:11.236065+0000","last_undegraded":"2023-10-06T02:55:11.236065+0000","last_fullsized":"2023-10-06T02:55:11.236065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:50.421226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.242673+0000","last_change":"2023-10-06T02:55:07.109529+0000","last_active":"2023-10-06T02:55:11.242673+0000","last_peered":"2023-10-06T02:55:11.242673+0000","last_clean":"2023-10-06T02:55:11.242673+0000","last_became_active":"2023-10-06T02:55:07.109235+0000","last_became_peered":"2023-10-06T02:55:07.109235+0000","last_unstale":"2023-10-06T02:55:11.242673+0000","last_undegraded":"2023-10-06T02:55:11.242673+0000","last_fullsized":"2023-10-06T02:55:11.242673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:28:16.973575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.264275+0000","last_change":"2023-10-06T02:55:11.259478+0000","last_active":"2023-10-06T02:55:11.264275+0000","last_peered":"2023-10-06T02:55:11.264275+0000","last_clean":"2023-10-06T02:55:11.264275+0000","last_became_active":"2023-10-06T02:55:11.258396+0000","last_became_peered":"2023-10-06T02:55:11.258396+0000","last_unstale":"2023-10-06T02:55:11.264275+0000","last_undegraded":"2023-10-06T02:55:11.264275+0000","last_fullsized":"2023-10-06T02:55:11.264275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:35.869089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235575+0000","last_change":"2023-10-06T02:55:06.243717+0000","last_active":"2023-10-06T02:55:11.235575+0000","last_peered":"2023-10-06T02:55:11.235575+0000","last_clean":"2023-10-06T02:55:11.235575+0000","last_became_active":"2023-10-06T02:55:06.243477+0000","last_became_peered":"2023-10-06T02:55:06.243477+0000","last_unstale":"2023-10-06T02:55:11.235575+0000","last_undegraded":"2023-10-06T02:55:11.235575+0000","last_fullsized":"2023-10-06T02:55:11.235575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:02.326100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235163+0000","last_change":"2023-10-06T02:55:07.109710+0000","last_active":"2023-10-06T02:55:11.235163+0000","last_peered":"2023-10-06T02:55:11.235163+0000","last_clean":"2023-10-06T02:55:11.235163+0000","last_became_active":"2023-10-06T02:55:07.109311+0000","last_became_peered":"2023-10-06T02:55:07.109311+0000","last_unstale":"2023-10-06T02:55:11.235163+0000","last_undegraded":"2023-10-06T02:55:11.235163+0000","last_fullsized":"2023-10-06T02:55:11.235163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:56.198939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.255838+0000","last_change":"2023-10-06T02:55:11.251970+0000","last_active":"2023-10-06T02:55:11.255838+0000","last_peered":"2023-10-06T02:55:11.255838+0000","last_clean":"2023-10-06T02:55:11.255838+0000","last_became_active":"2023-10-06T02:55:11.251576+0000","last_became_peered":"2023-10-06T02:55:11.251576+0000","last_unstale":"2023-10-06T02:55:11.255838+0000","last_undegraded":"2023-10-06T02:55:11.255838+0000","last_fullsized":"2023-10-06T02:55:11.255838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:10.229182+0000","last_clean_scrub_stamp":"2023-10-06T02:55:10.229182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:06.829607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.243536+0000","last_change":"2023-10-06T02:55:06.243528+0000","last_active":"2023-10-06T02:55:11.243536+0000","last_peered":"2023-10-06T02:55:11.243536+0000","last_clean":"2023-10-06T02:55:11.243536+0000","last_became_active":"2023-10-06T02:55:06.243235+0000","last_became_peered":"2023-10-06T02:55:06.243235+0000","last_unstale":"2023-10-06T02:55:11.243536+0000","last_undegraded":"2023-10-06T02:55:11.243536+0000","last_fullsized":"2023-10-06T02:55:11.243536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:05.213406+0000","last_clean_scrub_stamp":"2023-10-06T02:55:05.213406+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:25.952751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.245975+0000","last_change":"2023-10-06T02:55:07.103783+0000","last_active":"2023-10-06T02:55:11.245975+0000","last_peered":"2023-10-06T02:55:11.245975+0000","last_clean":"2023-10-06T02:55:11.245975+0000","last_became_active":"2023-10-06T02:55:07.103380+0000","last_became_peered":"2023-10-06T02:55:07.103380+0000","last_unstale":"2023-10-06T02:55:11.245975+0000","last_undegraded":"2023-10-06T02:55:11.245975+0000","last_fullsized":"2023-10-06T02:55:11.245975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.943919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.236264+0000","last_change":"2023-10-06T02:55:07.102410+0000","last_active":"2023-10-06T02:55:11.236264+0000","last_peered":"2023-10-06T02:55:11.236264+0000","last_clean":"2023-10-06T02:55:11.236264+0000","last_became_active":"2023-10-06T02:55:07.102078+0000","last_became_peered":"2023-10-06T02:55:07.102078+0000","last_unstale":"2023-10-06T02:55:11.236264+0000","last_undegraded":"2023-10-06T02:55:11.236264+0000","last_fullsized":"2023-10-06T02:55:11.236264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:05.829702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235500+0000","last_change":"2023-10-06T02:55:07.116830+0000","last_active":"2023-10-06T02:55:11.235500+0000","last_peered":"2023-10-06T02:55:11.235500+0000","last_clean":"2023-10-06T02:55:11.235500+0000","last_became_active":"2023-10-06T02:55:07.116644+0000","last_became_peered":"2023-10-06T02:55:07.116644+0000","last_unstale":"2023-10-06T02:55:11.235500+0000","last_undegraded":"2023-10-06T02:55:11.235500+0000","last_fullsized":"2023-10-06T02:55:11.235500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:40.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.244388+0000","last_change":"2023-10-06T02:55:07.104996+0000","last_active":"2023-10-06T02:55:11.244388+0000","last_peered":"2023-10-06T02:55:11.244388+0000","last_clean":"2023-10-06T02:55:11.244388+0000","last_became_active":"2023-10-06T02:55:07.104710+0000","last_became_peered":"2023-10-06T02:55:07.104710+0000","last_unstale":"2023-10-06T02:55:11.244388+0000","last_undegraded":"2023-10-06T02:55:11.244388+0000","last_fullsized":"2023-10-06T02:55:11.244388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:09.033880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.235232+0000","last_change":"2023-10-06T02:55:07.109367+0000","last_active":"2023-10-06T02:55:11.235232+0000","last_peered":"2023-10-06T02:55:11.235232+0000","last_clean":"2023-10-06T02:55:11.235232+0000","last_became_active":"2023-10-06T02:55:07.109089+0000","last_became_peered":"2023-10-06T02:55:07.109089+0000","last_unstale":"2023-10-06T02:55:11.235232+0000","last_undegraded":"2023-10-06T02:55:11.235232+0000","last_fullsized":"2023-10-06T02:55:11.235232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T02:55:11.250624+0000","last_change":"2023-10-06T02:55:07.108442+0000","last_active":"2023-10-06T02:55:11.250624+0000","last_peered":"2023-10-06T02:55:11.250624+0000","last_clean":"2023-10-06T02:55:11.250624+0000","last_became_active":"2023-10-06T02:55:07.108151+0000","last_became_peered":"2023-10-06T02:55:07.108151+0000","last_unstale":"2023-10-06T02:55:11.250624+0000","last_undegraded":"2023-10-06T02:55:11.250624+0000","last_fullsized":"2023-10-06T02:55:11.250624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:06.215253+0000","last_clean_scrub_stamp":"2023-10-06T02:55:06.215253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:11:48.319270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":118562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":118652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:55:25.198 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T02:55:25.198 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T02:55:25.199 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T02:55:25.199 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T02:55:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.343+0000 7fa33759e700 1 Processor -- start 2023-10-06T02:55:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.343+0000 7fa33759e700 1 -- start start 2023-10-06T02:55:25.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.344+0000 7fa33759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3380af600 0x7fa33806af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.344+0000 7fa33759e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa33806b4b0 0x7fa3380675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.344+0000 7fa33759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33806aae0 con 0x7fa3381594d0 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.344+0000 7fa33759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380aa2d0 con 0x7fa3380af600 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.344+0000 7fa33759e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380aa5b0 con 0x7fa33806b4b0 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.344+0000 7fa32dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3380af600 0x7fa33806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.344+0000 7fa33659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa3381594d0 0x7fa3380a9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49172/0 (socket says 172.21.15.84:49172) 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.344+0000 7fa33659c700 1 -- 172.21.15.84:0/3686902543 learned_addr learned my addr 172.21.15.84:0/3686902543 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa336d9d700 1 --2- 172.21.15.84:0/3686902543 >> v2:172.21.15.131:3300/0 conn(0x7fa33806b4b0 0x7fa3380675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa32dd9b700 1 -- 172.21.15.84:0/3686902543 >> v2:172.21.15.131:3300/0 conn(0x7fa33806b4b0 msgr2=0x7fa3380675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa32dd9b700 1 --2- 172.21.15.84:0/3686902543 >> v2:172.21.15.131:3300/0 conn(0x7fa33806b4b0 0x7fa3380675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa32dd9b700 1 -- 172.21.15.84:0/3686902543 >> v1:172.21.15.84:6789/0 conn(0x7fa3381594d0 legacy=0x7fa3380a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa32dd9b700 1 -- 172.21.15.84:0/3686902543 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33806a490 con 0x7fa3380af600 2023-10-06T02:55:25.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa335d9b700 1 -- 172.21.15.84:0/3686902543 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694343732 0 0) 0x7fa33806aae0 con 0x7fa3381594d0 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa32dd9b700 1 --2- 172.21.15.84:0/3686902543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3380af600 0x7fa33806af70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa33806e350 tx=0x7fa3200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e533a780afa8e9e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa335d9b700 1 -- 172.21.15.84:0/3686902543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000b6b0 con 0x7fa3380af600 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa335d9b700 1 -- 172.21.15.84:0/3686902543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000b810 con 0x7fa3380af600 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa335d9b700 1 -- 172.21.15.84:0/3686902543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000bbb0 con 0x7fa3380af600 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa33759e700 1 -- 172.21.15.84:0/3686902543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3380af600 msgr2=0x7fa33806af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa33759e700 1 --2- 172.21.15.84:0/3686902543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3380af600 0x7fa33806af70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa33806e350 tx=0x7fa3200091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa33759e700 1 -- 172.21.15.84:0/3686902543 shutdown_connections 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa33759e700 1 --2- 172.21.15.84:0/3686902543 >> v2:172.21.15.131:3300/0 conn(0x7fa33806b4b0 0x7fa3380675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa33759e700 1 --2- 172.21.15.84:0/3686902543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3380af600 0x7fa33806af70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa33759e700 1 -- 172.21.15.84:0/3686902543 >> 172.21.15.84:0/3686902543 conn(0x7fa3380691d0 msgr2=0x7fa3380aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa33759e700 1 -- 172.21.15.84:0/3686902543 shutdown_connections 2023-10-06T02:55:25.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.345+0000 7fa33759e700 1 -- 172.21.15.84:0/3686902543 wait complete. 2023-10-06T02:55:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.347+0000 7fa33759e700 1 Processor -- start 2023-10-06T02:55:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.347+0000 7fa33759e700 1 -- start start 2023-10-06T02:55:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.347+0000 7fa33759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa33806b4b0 0x7fa338140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.347+0000 7fa33759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3380af600 0x7fa33815d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.347+0000 7fa33759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381594d0 0x7fa33815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.347+0000 7fa33759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3381412a0 con 0x7fa3381594d0 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.347+0000 7fa33759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815b110 con 0x7fa3380af600 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.347+0000 7fa33759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815ded0 con 0x7fa33806b4b0 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.347+0000 7fa336d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381594d0 0x7fa33815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa336d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381594d0 0x7fa33815b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39984/0 (socket says 172.21.15.84:39984) 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa336d9d700 1 -- 172.21.15.84:0/1751309845 learned_addr learned my addr 172.21.15.84:0/1751309845 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa32dd9b700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3380af600 0x7fa33815d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa33659c700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa33806b4b0 0x7fa338140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa336d9d700 1 -- 172.21.15.84:0/1751309845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa33806b4b0 msgr2=0x7fa338140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa336d9d700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa33806b4b0 0x7fa338140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa336d9d700 1 -- 172.21.15.84:0/1751309845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3380af600 msgr2=0x7fa33815d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa336d9d700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3380af600 0x7fa33815d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa336d9d700 1 -- 172.21.15.84:0/1751309845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320009420 con 0x7fa3381594d0 2023-10-06T02:55:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa336d9d700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381594d0 0x7fa33815b5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa330007f30 tx=0x7fa3300098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa32effd700 1 -- 172.21.15.84:0/1751309845 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000eb90 con 0x7fa3381594d0 2023-10-06T02:55:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa32effd700 1 -- 172.21.15.84:0/1751309845 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000ecf0 con 0x7fa3381594d0 2023-10-06T02:55:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33815a500 con 0x7fa3381594d0 2023-10-06T02:55:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa32effd700 1 -- 172.21.15.84:0/1751309845 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330014670 con 0x7fa3381594d0 2023-10-06T02:55:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.348+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33815aac0 con 0x7fa3381594d0 2023-10-06T02:55:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.349+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33805f270 con 0x7fa3381594d0 2023-10-06T02:55:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.349+0000 7fa32effd700 1 -- 172.21.15.84:0/1751309845 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa330014a20 con 0x7fa3381594d0 2023-10-06T02:55:25.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.350+0000 7fa32effd700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa318066f30 0x7fa3180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.350+0000 7fa32effd700 1 -- 172.21.15.84:0/1751309845 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa330085010 con 0x7fa3381594d0 2023-10-06T02:55:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.350+0000 7fa33659c700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa318066f30 0x7fa3180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.350+0000 7fa33659c700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa318066f30 0x7fa3180693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa328007160 tx=0x7fa328007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:25.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.354+0000 7fa32effd700 1 -- 172.21.15.84:0/1751309845 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa330051e30 con 0x7fa3381594d0 2023-10-06T02:55:25.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.577+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa33806a770 con 0x7fa3381594d0 2023-10-06T02:55:25.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.577+0000 7fa32effd700 1 -- 172.21.15.84:0/1751309845 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa33000ee60 con 0x7fa3381594d0 2023-10-06T02:55:25.579 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:25.579 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T02:55:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa318066f30 msgr2=0x7fa3180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa318066f30 0x7fa3180693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa328007160 tx=0x7fa328007f50 comp rx=0 tx=0).stop 2023-10-06T02:55:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381594d0 msgr2=0x7fa33815b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381594d0 0x7fa33815b5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa330007f30 tx=0x7fa3300098e0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 shutdown_connections 2023-10-06T02:55:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa318066f30 0x7fa3180693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3381594d0 0x7fa33815b5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa33806b4b0 0x7fa338140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 --2- 172.21.15.84:0/1751309845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3380af600 0x7fa33815d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 >> 172.21.15.84:0/1751309845 conn(0x7fa3380691d0 msgr2=0x7fa3380abc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:25.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 shutdown_connections 2023-10-06T02:55:25.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.579+0000 7fa33759e700 1 -- 172.21.15.84:0/1751309845 wait complete. 2023-10-06T02:55:25.592 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T02:55:25.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:25.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.706+0000 7fb84864f700 1 Processor -- start 2023-10-06T02:55:25.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.706+0000 7fb84864f700 1 -- start start 2023-10-06T02:55:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.707+0000 7fb84864f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8400ca3b0 0x7fb8401582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.707+0000 7fb84864f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400adba0 0x7fb8400ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.707+0000 7fb84864f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400ceb70 con 0x7fb8400ce710 2023-10-06T02:55:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.707+0000 7fb84864f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400cbbd0 con 0x7fb8400ca3b0 2023-10-06T02:55:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.707+0000 7fb84864f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb840157e20 con 0x7fb8400adba0 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.707+0000 7fb8463eb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8400ca3b0 0x7fb8401582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.707+0000 7fb846bec700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb8400ce710 0x7fb84015af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49184/0 (socket says 172.21.15.84:49184) 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.707+0000 7fb846bec700 1 -- 172.21.15.84:0/3871525093 learned_addr learned my addr 172.21.15.84:0/3871525093 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.707+0000 7fb845bea700 1 --2- 172.21.15.84:0/3871525093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400adba0 0x7fb8400ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8453e9700 1 -- 172.21.15.84:0/3871525093 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097865475 0 0) 0x7fb838001490 con 0x7fb8400ce710 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8453e9700 1 -- 172.21.15.84:0/3871525093 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c003570 con 0x7fb8400ce710 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8463eb700 1 -- 172.21.15.84:0/3871525093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400adba0 msgr2=0x7fb8400ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8463eb700 1 --2- 172.21.15.84:0/3871525093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400adba0 0x7fb8400ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8463eb700 1 -- 172.21.15.84:0/3871525093 >> v1:172.21.15.84:6789/0 conn(0x7fb8400ce710 legacy=0x7fb84015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8463eb700 1 -- 172.21.15.84:0/3871525093 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400cb610 con 0x7fb8400ca3b0 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8463eb700 1 --2- 172.21.15.84:0/3871525093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ca3b0 0x7fb8401582b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0098e0 tx=0x7fb83c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897a73dfe6b37750 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8453e9700 1 -- 172.21.15.84:0/3871525093 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011630 con 0x7fb8400ca3b0 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8453e9700 1 -- 172.21.15.84:0/3871525093 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c011790 con 0x7fb8400ca3b0 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb8453e9700 1 -- 172.21.15.84:0/3871525093 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011b30 con 0x7fb8400ca3b0 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb84864f700 1 -- 172.21.15.84:0/3871525093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ca3b0 msgr2=0x7fb8401582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.708+0000 7fb84864f700 1 --2- 172.21.15.84:0/3871525093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ca3b0 0x7fb8401582b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0098e0 tx=0x7fb83c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.709+0000 7fb84864f700 1 -- 172.21.15.84:0/3871525093 shutdown_connections 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.709+0000 7fb84864f700 1 --2- 172.21.15.84:0/3871525093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ca3b0 0x7fb8401582b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.709+0000 7fb84864f700 1 --2- 172.21.15.84:0/3871525093 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400adba0 0x7fb8400ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.709+0000 7fb84864f700 1 -- 172.21.15.84:0/3871525093 >> 172.21.15.84:0/3871525093 conn(0x7fb840070810 msgr2=0x7fb840070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.709+0000 7fb84864f700 1 -- 172.21.15.84:0/3871525093 shutdown_connections 2023-10-06T02:55:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.709+0000 7fb84864f700 1 -- 172.21.15.84:0/3871525093 wait complete. 2023-10-06T02:55:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb84864f700 1 Processor -- start 2023-10-06T02:55:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb84864f700 1 -- start start 2023-10-06T02:55:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb84864f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8400adba0 0x7fb840158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb84864f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400ca3b0 0x7fb8401518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb84864f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ce710 0x7fb8400c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb84864f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c5a80 con 0x7fb8400ce710 2023-10-06T02:55:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb84864f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c54c0 con 0x7fb8400adba0 2023-10-06T02:55:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb84864f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c57a0 con 0x7fb8400ca3b0 2023-10-06T02:55:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb846bec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ce710 0x7fb8400c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb846bec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ce710 0x7fb8400c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40002/0 (socket says 172.21.15.84:40002) 2023-10-06T02:55:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.710+0000 7fb846bec700 1 -- 172.21.15.84:0/4184030762 learned_addr learned my addr 172.21.15.84:0/4184030762 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb845bea700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400ca3b0 0x7fb8401518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb8463eb700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8400adba0 0x7fb840158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb846bec700 1 -- 172.21.15.84:0/4184030762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400ca3b0 msgr2=0x7fb8401518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb846bec700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400ca3b0 0x7fb8401518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb846bec700 1 -- 172.21.15.84:0/4184030762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8400adba0 msgr2=0x7fb840158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb846bec700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8400adba0 0x7fb840158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb846bec700 1 -- 172.21.15.84:0/4184030762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009420 con 0x7fb8400ce710 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb846bec700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ce710 0x7fb8400c6ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb83800cd00 tx=0x7fb838001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb8367fc700 1 -- 172.21.15.84:0/4184030762 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800ab70 con 0x7fb8400ce710 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb8367fc700 1 -- 172.21.15.84:0/4184030762 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800acd0 con 0x7fb8400ce710 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8400c2900 con 0x7fb8400ce710 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb8367fc700 1 -- 172.21.15.84:0/4184030762 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838007300 con 0x7fb8400ce710 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.711+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb840159470 con 0x7fb8400ce710 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.712+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb840064ad0 con 0x7fb8400ce710 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.712+0000 7fb8367fc700 1 -- 172.21.15.84:0/4184030762 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8380076f0 con 0x7fb8400ce710 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.713+0000 7fb8367fc700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb824066f30 0x7fb8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.713+0000 7fb8463eb700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb824066f30 0x7fb8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.713+0000 7fb8367fc700 1 -- 172.21.15.84:0/4184030762 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb838084ce0 con 0x7fb8400ce710 2023-10-06T02:55:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.713+0000 7fb8463eb700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb824066f30 0x7fb8240693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0091e0 tx=0x7fb83c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.717+0000 7fb8367fc700 1 -- 172.21.15.84:0/4184030762 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb838051b80 con 0x7fb8400ce710 2023-10-06T02:55:25.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.902+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8400ceb70 con 0x7fb8400ce710 2023-10-06T02:55:25.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.903+0000 7fb8367fc700 1 -- 172.21.15.84:0/4184030762 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fb8400ceb70 con 0x7fb8400ce710 2023-10-06T02:55:25.905 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:25.905 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:25.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb824066f30 msgr2=0x7fb8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb824066f30 0x7fb8240693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0091e0 tx=0x7fb83c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:25.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ce710 msgr2=0x7fb8400c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:25.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ce710 0x7fb8400c6ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb83800cd00 tx=0x7fb838001ad0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 shutdown_connections 2023-10-06T02:55:25.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb824066f30 0x7fb8240693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8400adba0 0x7fb840158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8400ce710 0x7fb8400c6ee0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 --2- 172.21.15.84:0/4184030762 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb8400ca3b0 0x7fb8401518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:25.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 >> 172.21.15.84:0/4184030762 conn(0x7fb840070810 msgr2=0x7fb8400ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:25.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 shutdown_connections 2023-10-06T02:55:25.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:25.905+0000 7fb84864f700 1 -- 172.21.15.84:0/4184030762 wait complete. 2023-10-06T02:55:25.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:55:05.120029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:55:05.566741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:55:09.247969+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:55:25.920 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.035+0000 7f1155b4e700 1 Processor -- start 2023-10-06T02:55:26.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.035+0000 7f1155b4e700 1 -- start start 2023-10-06T02:55:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.036+0000 7f1155b4e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115006d3e0 0x7f115006d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.036+0000 7f1155b4e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11501410d0 con 0x7f1150140d00 2023-10-06T02:55:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.036+0000 7f1155b4e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11500c7ea0 con 0x7f11500695f0 2023-10-06T02:55:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.036+0000 7f1155b4e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115006dd70 con 0x7f115006d3e0 2023-10-06T02:55:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.036+0000 7f114f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1150140d00 0x7f11500c6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49198/0 (socket says 172.21.15.84:49198) 2023-10-06T02:55:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.036+0000 7f114f7fe700 1 -- 172.21.15.84:0/3626702017 learned_addr learned my addr 172.21.15.84:0/3626702017 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114effd700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115006d3e0 0x7f115006d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084629887 0 0) 0x7f11501410d0 con 0x7f1150140d00 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1138003570 con 0x7f1150140d00 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3800750356 0 0) 0x7f1138003570 con 0x7f1150140d00 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115006d3e0 msgr2=0x7f115006d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115006d3e0 0x7f115006d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 >> v1:172.21.15.131:6789/0 conn(0x7f11500695f0 legacy=0x7f1150069a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115006f720 con 0x7f1150140d00 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f11400017f0 con 0x7f1150140d00 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 >> v1:172.21.15.84:6789/0 conn(0x7f1150140d00 legacy=0x7f11500c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1138003a90 0x7f1138003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1138004810 0x7f1138004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115006d3e0 0x7f11380051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115006dd70 con 0x7f1138004810 2023-10-06T02:55:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113800bb60 con 0x7f1138003a90 2023-10-06T02:55:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113800bd20 con 0x7f115006d3e0 2023-10-06T02:55:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114effd700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1138004810 0x7f1138004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114f7fe700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1138003a90 0x7f1138003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114ffff700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115006d3e0 0x7f11380051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114effd700 1 -- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115006d3e0 msgr2=0x7f11380051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114effd700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115006d3e0 0x7f11380051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114effd700 1 -- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1138003a90 msgr2=0x7f1138003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114effd700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1138003a90 0x7f1138003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114effd700 1 -- 172.21.15.84:0/3626702017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138003570 con 0x7f1138004810 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114f7fe700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1138003a90 0x7f1138003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.037+0000 7f114effd700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1138004810 0x7f1138004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1144009c00 tx=0x7f11440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50a5c49223bd596 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400e710 con 0x7f1138004810 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114400e870 con 0x7f1138004810 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f114e7fc700 1 -- 172.21.15.84:0/3626702017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400ec30 con 0x7f1138004810 2023-10-06T02:55:26.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f1155b4e700 1 -- 172.21.15.84:0/3626702017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1138004810 msgr2=0x7f1138004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f1155b4e700 1 --2- 172.21.15.84:0/3626702017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1138004810 0x7f1138004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1144009c00 tx=0x7f11440091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f114ffff700 1 -- 172.21.15.84:0/3626702017 reap_dead start 2023-10-06T02:55:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f1155b4e700 1 -- 172.21.15.84:0/3626702017 shutdown_connections 2023-10-06T02:55:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f1155b4e700 1 -- 172.21.15.84:0/3626702017 >> 172.21.15.84:0/3626702017 conn(0x7f11500cc0e0 msgr2=0x7f11500cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f1155b4e700 1 -- 172.21.15.84:0/3626702017 shutdown_connections 2023-10-06T02:55:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.038+0000 7f1155b4e700 1 -- 172.21.15.84:0/3626702017 wait complete. 2023-10-06T02:55:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.039+0000 7f1155b4e700 1 Processor -- start 2023-10-06T02:55:26.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.039+0000 7f1155b4e700 1 -- start start 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f1155b4e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1138004810 0x7f115016aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f1155b4e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11501360a0 0x7f11500b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f1155b4e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115013a470 0x7f115013a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f1155b4e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150169120 con 0x7f11501360a0 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f1155b4e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115013ae10 con 0x7f1138004810 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f1155b4e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11500b1950 con 0x7f115013a470 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f114effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11501360a0 0x7f11500b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f114effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11501360a0 0x7f11500b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40020/0 (socket says 172.21.15.84:40020) 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f114effd700 1 -- 172.21.15.84:0/3182973135 learned_addr learned my addr 172.21.15.84:0/3182973135 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:26.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.040+0000 7f114ffff700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115013a470 0x7f115013a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f114effd700 1 -- 172.21.15.84:0/3182973135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115013a470 msgr2=0x7f115013a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f114effd700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115013a470 0x7f115013a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f114effd700 1 -- 172.21.15.84:0/3182973135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1138004810 msgr2=0x7f115016aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f114effd700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1138004810 0x7f115016aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f114effd700 1 -- 172.21.15.84:0/3182973135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500b0d80 con 0x7f11501360a0 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f114effd700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11501360a0 0x7f11500b0350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f113800bb30 tx=0x7f114401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f11377fe700 1 -- 172.21.15.84:0/3182973135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1144022070 con 0x7f11501360a0 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f11377fe700 1 -- 172.21.15.84:0/3182973135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114400e9e0 con 0x7f11501360a0 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11500b1020 con 0x7f11501360a0 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f11377fe700 1 -- 172.21.15.84:0/3182973135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114401c450 con 0x7f11501360a0 2023-10-06T02:55:26.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.041+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11500b15e0 con 0x7f11501360a0 2023-10-06T02:55:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.042+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1150064ad0 con 0x7f11501360a0 2023-10-06T02:55:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.042+0000 7f11377fe700 1 -- 172.21.15.84:0/3182973135 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f114401c860 con 0x7f11501360a0 2023-10-06T02:55:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.043+0000 7f11377fe700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.043+0000 7f11377fe700 1 -- 172.21.15.84:0/3182973135 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1144086130 con 0x7f11501360a0 2023-10-06T02:55:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.043+0000 7f114f7fe700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.043+0000 7f114f7fe700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1140002250 tx=0x7f11500c7e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:26.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.047+0000 7f11377fe700 1 -- 172.21.15.84:0/3182973135 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1144052f90 con 0x7f11501360a0 2023-10-06T02:55:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.229+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11500b1a90 con 0x7f11501360a0 2023-10-06T02:55:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.230+0000 7f11377fe700 1 -- 172.21.15.84:0/3182973135 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1144017020 con 0x7f11501360a0 2023-10-06T02:55:26.231 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:55:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 msgr2=0x7f113c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1140002250 tx=0x7f11500c7e10 comp rx=0 tx=0).stop 2023-10-06T02:55:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11501360a0 msgr2=0x7f11500b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11501360a0 0x7f11500b0350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f113800bb30 tx=0x7f114401a000 comp rx=0 tx=0).stop 2023-10-06T02:55:26.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 shutdown_connections 2023-10-06T02:55:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1138004810 0x7f115016aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f115013a470 0x7f115013a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 --2- 172.21.15.84:0/3182973135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11501360a0 0x7f11500b0350 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 >> 172.21.15.84:0/3182973135 conn(0x7f11500cc0e0 msgr2=0x7f115013ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 shutdown_connections 2023-10-06T02:55:26.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.232+0000 7f1155b4e700 1 -- 172.21.15.84:0/3182973135 wait complete. 2023-10-06T02:55:26.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:26.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.362+0000 7f6bccaf0700 1 Processor -- start 2023-10-06T02:55:26.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.362+0000 7f6bccaf0700 1 -- start start 2023-10-06T02:55:26.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bccaf0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bc80b2660 0x7f6bc80cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bccaf0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80cc9b0 con 0x7f6bc80b2a30 2023-10-06T02:55:26.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bccaf0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80cbda0 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bccaf0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80cc080 con 0x7f6bc80b2660 2023-10-06T02:55:26.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bc80b2660 0x7f6bc80cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6bc80b2a30 0x7f6bc80ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49210/0 (socket says 172.21.15.84:49210) 2023-10-06T02:55:26.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc6ffd700 1 -- 172.21.15.84:0/914048062 learned_addr learned my addr 172.21.15.84:0/914048062 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:26.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc77fe700 1 -- 172.21.15.84:0/914048062 >> v1:172.21.15.131:6789/0 conn(0x7f6bc80cf1f0 legacy=0x7f6bc80c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc77fe700 1 -- 172.21.15.84:0/914048062 >> v1:172.21.15.84:6789/0 conn(0x7f6bc80b2a30 legacy=0x7f6bc80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc77fe700 1 -- 172.21.15.84:0/914048062 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80cc360 con 0x7f6bc80b2660 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc67fc700 1 -- 172.21.15.84:0/914048062 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862486749 0 0) 0x7f6bc80cc9b0 con 0x7f6bc80b2a30 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc77fe700 1 --2- 172.21.15.84:0/914048062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80b2660 0x7f6bc80cccf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80098d0 tx=0x7f6bb8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ac335aee10dcbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc67fc700 1 -- 172.21.15.84:0/914048062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8009e70 con 0x7f6bc80b2660 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc67fc700 1 -- 172.21.15.84:0/914048062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8005c10 con 0x7f6bc80b2660 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.363+0000 7f6bc67fc700 1 -- 172.21.15.84:0/914048062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800b610 con 0x7f6bc80b2660 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.364+0000 7f6bccaf0700 1 -- 172.21.15.84:0/914048062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80b2660 msgr2=0x7f6bc80cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.364+0000 7f6bccaf0700 1 --2- 172.21.15.84:0/914048062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80b2660 0x7f6bc80cccf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80098d0 tx=0x7f6bb8009120 comp rx=0 tx=0).stop 2023-10-06T02:55:26.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.364+0000 7f6bccaf0700 1 -- 172.21.15.84:0/914048062 shutdown_connections 2023-10-06T02:55:26.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.364+0000 7f6bccaf0700 1 --2- 172.21.15.84:0/914048062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80b2660 0x7f6bc80cccf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.364+0000 7f6bccaf0700 1 -- 172.21.15.84:0/914048062 >> 172.21.15.84:0/914048062 conn(0x7f6bc8099560 msgr2=0x7f6bc806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:26.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.364+0000 7f6bccaf0700 1 -- 172.21.15.84:0/914048062 shutdown_connections 2023-10-06T02:55:26.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.364+0000 7f6bccaf0700 1 -- 172.21.15.84:0/914048062 wait complete. 2023-10-06T02:55:26.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.365+0000 7f6bccaf0700 1 Processor -- start 2023-10-06T02:55:26.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.365+0000 7f6bccaf0700 1 -- start start 2023-10-06T02:55:26.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bccaf0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bc80b2660 0x7f6bc809c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bccaf0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bc80b2a30 0x7f6bc80c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bccaf0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80cf1f0 0x7f6bc80c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bccaf0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc815da90 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bccaf0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc809da80 con 0x7f6bc80b2a30 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bccaf0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc809ce70 con 0x7f6bc80b2660 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80cf1f0 0x7f6bc80c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80cf1f0 0x7f6bc80c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40028/0 (socket says 172.21.15.84:40028) 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc7fff700 1 -- 172.21.15.84:0/166638652 learned_addr learned my addr 172.21.15.84:0/166638652 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc6ffd700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bc80b2a30 0x7f6bc80c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc77fe700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bc80b2660 0x7f6bc809c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc7fff700 1 -- 172.21.15.84:0/166638652 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bc80b2660 msgr2=0x7f6bc809c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc7fff700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bc80b2660 0x7f6bc809c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc7fff700 1 -- 172.21.15.84:0/166638652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bc80b2a30 msgr2=0x7f6bc80c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc7fff700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bc80b2a30 0x7f6bc80c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc7fff700 1 -- 172.21.15.84:0/166638652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb80093c0 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.366+0000 7f6bc6ffd700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bc80b2a30 0x7f6bc80c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.367+0000 7f6bc7fff700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80cf1f0 0x7f6bc80c9a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c930 tx=0x7f6bc00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.367+0000 7f6baf7fe700 1 -- 172.21.15.84:0/166638652 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000ce70 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.367+0000 7f6baf7fe700 1 -- 172.21.15.84:0/166638652 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc000a7e0 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.367+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc809d150 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.367+0000 7f6baf7fe700 1 -- 172.21.15.84:0/166638652 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000aba0 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.367+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc809d710 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.368+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc805f270 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.368+0000 7f6baf7fe700 1 -- 172.21.15.84:0/166638652 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bc0012420 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.368+0000 7f6baf7fe700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bb4066f30 0x7f6bb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.368+0000 7f6baf7fe700 1 -- 172.21.15.84:0/166638652 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6bc0084dc0 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.368+0000 7f6bc77fe700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bb4066f30 0x7f6bb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.369+0000 7f6bc77fe700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bb4066f30 0x7f6bb40693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009390 tx=0x7f6bb8015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:26.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.373+0000 7f6baf7fe700 1 -- 172.21.15.84:0/166638652 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bc0051c90 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.554+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6bc809d8a0 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.555+0000 7f6baf7fe700 1 -- 172.21.15.84:0/166638652 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6bc00552b0 con 0x7f6bc80cf1f0 2023-10-06T02:55:26.556 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:55:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.556+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bb4066f30 msgr2=0x7f6bb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.556+0000 7f6bccaf0700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bb4066f30 0x7f6bb40693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009390 tx=0x7f6bb8015000 comp rx=0 tx=0).stop 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.556+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80cf1f0 msgr2=0x7f6bc80c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.556+0000 7f6bccaf0700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80cf1f0 0x7f6bc80c9a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c930 tx=0x7f6bc00026e0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.557+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 shutdown_connections 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.557+0000 7f6bccaf0700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bb4066f30 0x7f6bb40693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.557+0000 7f6bccaf0700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc80cf1f0 0x7f6bc80c9a50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.557+0000 7f6bccaf0700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bc80b2660 0x7f6bc809c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.557+0000 7f6bccaf0700 1 --2- 172.21.15.84:0/166638652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bc80b2a30 0x7f6bc80c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.557+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 >> 172.21.15.84:0/166638652 conn(0x7f6bc8099560 msgr2=0x7f6bc8158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.557+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 shutdown_connections 2023-10-06T02:55:26.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.557+0000 7f6bccaf0700 1 -- 172.21.15.84:0/166638652 wait complete. 2023-10-06T02:55:26.570 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:55:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.686+0000 7f4ddb96f700 1 Processor -- start 2023-10-06T02:55:26.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.686+0000 7f4ddb96f700 1 -- start start 2023-10-06T02:55:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.687+0000 7f4ddb96f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4dd4159650 0x7f4dd40c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.687+0000 7f4ddb96f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd4069af0 con 0x7f4dd4159a20 2023-10-06T02:55:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.687+0000 7f4ddb96f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd40c3260 con 0x7f4dd40681a0 2023-10-06T02:55:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.687+0000 7f4ddb96f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd40c3540 con 0x7f4dd4159650 2023-10-06T02:55:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.687+0000 7f4dd9f0c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4dd4159a20 0x7f4dd40c3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49226/0 (socket says 172.21.15.84:49226) 2023-10-06T02:55:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.687+0000 7f4dd9f0c700 1 -- 172.21.15.84:0/3422495136 learned_addr learned my addr 172.21.15.84:0/3422495136 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.687+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569511457 0 0) 0x7f4dd4069af0 con 0x7f4dd4159a20 2023-10-06T02:55:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.687+0000 7f4dd970b700 1 --2- 172.21.15.84:0/3422495136 >> v2:172.21.15.131:3300/0 conn(0x7f4dd4159650 0x7f4dd40c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.687+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc0003570 con 0x7f4dd4159a20 2023-10-06T02:55:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3285791800 0 0) 0x7f4dc0003570 con 0x7f4dd4159a20 2023-10-06T02:55:26.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 >> v2:172.21.15.131:3300/0 conn(0x7f4dd4159650 msgr2=0x7f4dd40c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 --2- 172.21.15.84:0/3422495136 >> v2:172.21.15.131:3300/0 conn(0x7f4dd4159650 0x7f4dd40c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 >> v1:172.21.15.131:6789/0 conn(0x7f4dd40681a0 legacy=0x7f4dd40cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40c3820 con 0x7f4dd4159a20 2023-10-06T02:55:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f4dcc001470 con 0x7f4dd4159a20 2023-10-06T02:55:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd970b700 1 --2- 172.21.15.84:0/3422495136 >> v2:172.21.15.131:3300/0 conn(0x7f4dd4159650 0x7f4dd40c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 >> v1:172.21.15.84:6789/0 conn(0x7f4dd4159a20 legacy=0x7f4dd40c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dc0003a60 0x7f4dc0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4dc00052e0 0x7f4dc000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd40c3540 con 0x7f4dc0004810 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc000c230 con 0x7f4dc0003a60 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc000c3f0 con 0x7f4dc00052e0 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd8f0a700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd970b700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dc0003a60 0x7f4dc0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd9f0c700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4dc00052e0 0x7f4dc000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd8f0a700 1 -- 172.21.15.84:0/3422495136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4dc00052e0 msgr2=0x7f4dc000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd8f0a700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4dc00052e0 0x7f4dc000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd8f0a700 1 -- 172.21.15.84:0/3422495136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dc0003a60 msgr2=0x7f4dc0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd8f0a700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dc0003a60 0x7f4dc0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd8f0a700 1 -- 172.21.15.84:0/3422495136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0003570 con 0x7f4dc0004810 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd9f0c700 1 -- 172.21.15.84:0/3422495136 reap_dead start 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.688+0000 7f4dd8f0a700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dc0004c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40018b0 tx=0x7f4dc4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2797ed8eb07b429a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4012420 con 0x7f4dc0004810 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc40125a0 con 0x7f4dc0004810 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4dcbfff700 1 -- 172.21.15.84:0/3422495136 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4012960 con 0x7f4dc0004810 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3422495136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 msgr2=0x7f4dc0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4ddb96f700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dc0004c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40018b0 tx=0x7f4dc4007d30 comp rx=0 tx=0).stop 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3422495136 shutdown_connections 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4ddb96f700 1 --2- 172.21.15.84:0/3422495136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dc0004c80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3422495136 >> 172.21.15.84:0/3422495136 conn(0x7f4dd4067dd0 msgr2=0x7f4dd40ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3422495136 shutdown_connections 2023-10-06T02:55:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.689+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3422495136 wait complete. 2023-10-06T02:55:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.690+0000 7f4ddb96f700 1 Processor -- start 2023-10-06T02:55:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.690+0000 7f4ddb96f700 1 -- start start 2023-10-06T02:55:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4ddb96f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dd4153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4ddb96f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd4169830 0x7f4dd4169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4ddb96f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4dd4099f20 0x7f4dd409a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4ddb96f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd409a8d0 con 0x7f4dc0004810 2023-10-06T02:55:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4ddb96f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd4099a90 con 0x7f4dd4169830 2023-10-06T02:55:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4ddb96f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd4098e80 con 0x7f4dd4099f20 2023-10-06T02:55:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4dd970b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dd4153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4dd970b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dd4153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40038/0 (socket says 172.21.15.84:40038) 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4dd970b700 1 -- 172.21.15.84:0/3037791995 learned_addr learned my addr 172.21.15.84:0/3037791995 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4dd8f0a700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd4169830 0x7f4dd4169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4dd9f0c700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4dd4099f20 0x7f4dd409a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4dd970b700 1 -- 172.21.15.84:0/3037791995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4dd4099f20 msgr2=0x7f4dd409a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4dd970b700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4dd4099f20 0x7f4dd409a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4dd970b700 1 -- 172.21.15.84:0/3037791995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd4169830 msgr2=0x7f4dd4169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.691+0000 7f4dd970b700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd4169830 0x7f4dd4169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.692+0000 7f4dd970b700 1 -- 172.21.15.84:0/3037791995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4099160 con 0x7f4dc0004810 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.692+0000 7f4dd970b700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dd4153e70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00104e0 tx=0x7f4dd0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.692+0000 7f4dc97fa700 1 -- 172.21.15.84:0/3037791995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd001b070 con 0x7f4dc0004810 2023-10-06T02:55:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.692+0000 7f4dc97fa700 1 -- 172.21.15.84:0/3037791995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0017430 con 0x7f4dc0004810 2023-10-06T02:55:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.692+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd4099440 con 0x7f4dc0004810 2023-10-06T02:55:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.692+0000 7f4dc97fa700 1 -- 172.21.15.84:0/3037791995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00177d0 con 0x7f4dc0004810 2023-10-06T02:55:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.692+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd41543b0 con 0x7f4dc0004810 2023-10-06T02:55:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.693+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd4064ad0 con 0x7f4dc0004810 2023-10-06T02:55:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.693+0000 7f4dc97fa700 1 -- 172.21.15.84:0/3037791995 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4dd0003020 con 0x7f4dc0004810 2023-10-06T02:55:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.693+0000 7f4dc97fa700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4db8066f30 0x7f4db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.694+0000 7f4dc97fa700 1 -- 172.21.15.84:0/3037791995 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4dd0085250 con 0x7f4dc0004810 2023-10-06T02:55:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.694+0000 7f4dd8f0a700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4db8066f30 0x7f4db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.694+0000 7f4dd8f0a700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4db8066f30 0x7f4db80693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4158e50 tx=0x7f4dc4015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:26.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.698+0000 7f4dc97fa700 1 -- 172.21.15.84:0/3037791995 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dd00505a0 con 0x7f4dc0004810 2023-10-06T02:55:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.879+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4dd4069dd0 con 0x7f4dc0004810 2023-10-06T02:55:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.880+0000 7f4dc97fa700 1 -- 172.21.15.84:0/3037791995 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4dd0052130 con 0x7f4dc0004810 2023-10-06T02:55:26.882 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4db8066f30 msgr2=0x7f4db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4db8066f30 0x7f4db80693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4158e50 tx=0x7f4dc4015000 comp rx=0 tx=0).stop 2023-10-06T02:55:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 msgr2=0x7f4dd4153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dd4153e70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00104e0 tx=0x7f4dd0009820 comp rx=0 tx=0).stop 2023-10-06T02:55:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 shutdown_connections 2023-10-06T02:55:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4db8066f30 0x7f4db80693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4dd4099f20 0x7f4dd409a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dc0004810 0x7f4dd4153e70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 --2- 172.21.15.84:0/3037791995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd4169830 0x7f4dd4169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 >> 172.21.15.84:0/3037791995 conn(0x7f4dd4067dd0 msgr2=0x7f4dd406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 shutdown_connections 2023-10-06T02:55:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:26.882+0000 7f4ddb96f700 1 -- 172.21.15.84:0/3037791995 wait complete. 2023-10-06T02:55:26.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:55:27.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.010+0000 7ff526d75700 1 Processor -- start 2023-10-06T02:55:27.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.010+0000 7ff526d75700 1 -- start start 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff526d75700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5200cbcb0 0x7ff5200cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff526d75700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5200cf610 con 0x7ff520159510 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff526d75700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5200cf8f0 con 0x7ff5201598e0 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff526d75700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200cfbd0 con 0x7ff5200cbcb0 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff524b11700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff520159510 0x7ff5200cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49236/0 (socket says 172.21.15.84:49236) 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff524b11700 1 -- 172.21.15.84:0/785203708 learned_addr learned my addr 172.21.15.84:0/785203708 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff525312700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5200cbcb0 0x7ff5200cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176332200 0 0) 0x7ff5200cf610 con 0x7ff520159510 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff510003570 con 0x7ff520159510 2023-10-06T02:55:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914555104 0 0) 0x7ff5200cf8f0 con 0x7ff5201598e0 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5200cf610 con 0x7ff5201598e0 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 379402762 0 0) 0x7ff510003570 con 0x7ff520159510 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5200cbcb0 msgr2=0x7ff5200cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5200cbcb0 0x7ff5200cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 >> v1:172.21.15.131:6789/0 conn(0x7ff5201598e0 legacy=0x7ff5200ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5200cfeb0 con 0x7ff520159510 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7ff514001470 con 0x7ff520159510 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff525312700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5200cbcb0 0x7ff5200cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.011+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 >> v1:172.21.15.84:6789/0 conn(0x7ff520159510 legacy=0x7ff5200cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51f7fe700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff510003c20 0x7ff510004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51f7fe700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5200cbcb0 0x7ff510004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51f7fe700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff510004d50 0x7ff5100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200cfbd0 con 0x7ff510004d50 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51000bb10 con 0x7ff510003c20 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51000bcd0 con 0x7ff5200cbcb0 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff525312700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff510004d50 0x7ff5100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51ffff700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5200cbcb0 0x7ff510004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff525312700 1 -- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5200cbcb0 msgr2=0x7ff510004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff525312700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5200cbcb0 0x7ff510004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff525312700 1 -- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff510003c20 msgr2=0x7ff510004010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff525312700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff510003c20 0x7ff510004010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff525312700 1 -- 172.21.15.84:0/785203708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518009a20 con 0x7ff510004d50 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff525312700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff510004d50 0x7ff5100051c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff51800e3c0 tx=0x7ff51800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bb502a162e0781 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518009c50 con 0x7ff510004d50 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51800f040 con 0x7ff510004d50 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.012+0000 7ff51f7fe700 1 -- 172.21.15.84:0/785203708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51800eea0 con 0x7ff510004d50 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.013+0000 7ff526d75700 1 -- 172.21.15.84:0/785203708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff510004d50 msgr2=0x7ff5100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.013+0000 7ff526d75700 1 --2- 172.21.15.84:0/785203708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff510004d50 0x7ff5100051c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff51800e3c0 tx=0x7ff51800b040 comp rx=0 tx=0).stop 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.013+0000 7ff525312700 1 -- 172.21.15.84:0/785203708 reap_dead start 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.013+0000 7ff526d75700 1 -- 172.21.15.84:0/785203708 shutdown_connections 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.013+0000 7ff526d75700 1 -- 172.21.15.84:0/785203708 >> 172.21.15.84:0/785203708 conn(0x7ff520089e90 msgr2=0x7ff5200997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.013+0000 7ff526d75700 1 -- 172.21.15.84:0/785203708 shutdown_connections 2023-10-06T02:55:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.013+0000 7ff526d75700 1 -- 172.21.15.84:0/785203708 wait complete. 2023-10-06T02:55:27.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.014+0000 7ff526d75700 1 Processor -- start 2023-10-06T02:55:27.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.014+0000 7ff526d75700 1 -- start start 2023-10-06T02:55:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff526d75700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff510004d50 0x7ff520069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff526d75700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff520159ce0 0x7ff52014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff526d75700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff52016b740 0x7ff52016bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff526d75700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff520069820 con 0x7ff52016b740 2023-10-06T02:55:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff526d75700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52015a150 con 0x7ff510004d50 2023-10-06T02:55:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff526d75700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52015ac10 con 0x7ff520159ce0 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff525312700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff52016b740 0x7ff52016bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff525312700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff52016b740 0x7ff52016bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40050/0 (socket says 172.21.15.84:40050) 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff525312700 1 -- 172.21.15.84:0/560201490 learned_addr learned my addr 172.21.15.84:0/560201490 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff524b11700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff510004d50 0x7ff520069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff525312700 1 -- 172.21.15.84:0/560201490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff520159ce0 msgr2=0x7ff52014bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff525312700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff520159ce0 0x7ff52014bf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff525312700 1 -- 172.21.15.84:0/560201490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff510004d50 msgr2=0x7ff520069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff525312700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff510004d50 0x7ff520069d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff525312700 1 -- 172.21.15.84:0/560201490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52016a7c0 con 0x7ff52016b740 2023-10-06T02:55:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff524b11700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff510004d50 0x7ff520069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff525312700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff52016b740 0x7ff52016bbb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff51800e9b0 tx=0x7ff51801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff51cff9700 1 -- 172.21.15.84:0/560201490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51801d630 con 0x7ff52016b740 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff51cff9700 1 -- 172.21.15.84:0/560201490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51801d790 con 0x7ff52016b740 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52015a370 con 0x7ff52016b740 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff51cff9700 1 -- 172.21.15.84:0/560201490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51801db30 con 0x7ff52016b740 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.015+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52015a930 con 0x7ff52016b740 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.017+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52016a590 con 0x7ff52016b740 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.017+0000 7ff51cff9700 1 -- 172.21.15.84:0/560201490 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff518003040 con 0x7ff52016b740 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.017+0000 7ff51cff9700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff504066f30 0x7ff5040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.017+0000 7ff51cff9700 1 -- 172.21.15.84:0/560201490 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff518085c70 con 0x7ff52016b740 2023-10-06T02:55:27.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.017+0000 7ff524b11700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff504066f30 0x7ff5040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.018+0000 7ff524b11700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff504066f30 0x7ff5040693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff514001010 tx=0x7ff514009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:27.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.021+0000 7ff51cff9700 1 -- 172.21.15.84:0/560201490 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff52016a590 con 0x7ff52016b740 2023-10-06T02:55:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.202+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff52016a590 con 0x7ff52016b740 2023-10-06T02:55:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.203+0000 7ff51cff9700 1 -- 172.21.15.84:0/560201490 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff52016a590 con 0x7ff52016b740 2023-10-06T02:55:27.205 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff504066f30 msgr2=0x7ff5040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff504066f30 0x7ff5040693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff514001010 tx=0x7ff514009040 comp rx=0 tx=0).stop 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff52016b740 msgr2=0x7ff52016bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff52016b740 0x7ff52016bbb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff51800e9b0 tx=0x7ff51801a000 comp rx=0 tx=0).stop 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 shutdown_connections 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff504066f30 0x7ff5040693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff510004d50 0x7ff520069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff52016b740 0x7ff52016bbb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 --2- 172.21.15.84:0/560201490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff520159ce0 0x7ff52014bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 >> 172.21.15.84:0/560201490 conn(0x7ff520089e90 msgr2=0x7ff5200ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 shutdown_connections 2023-10-06T02:55:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.205+0000 7ff526d75700 1 -- 172.21.15.84:0/560201490 wait complete. 2023-10-06T02:55:27.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:55:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.336+0000 7f3830909700 1 Processor -- start 2023-10-06T02:55:27.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.336+0000 7f3830909700 1 -- start start 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.337+0000 7f3830909700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f382c159340 0x7f382c0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.337+0000 7f3830909700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f382c159710 0x7f382c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.337+0000 7f3830909700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c0cbed0 con 0x7f382c0cba70 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.337+0000 7f3830909700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c0cf820 con 0x7f382c159710 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.337+0000 7f3830909700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c0cfb00 con 0x7f382c159340 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.338+0000 7f3829d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f382c159710 0x7f382c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.338+0000 7f3829d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f382c159710 0x7f382c0cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40052/0 (socket says 172.21.15.84:40052) 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.338+0000 7f3829d9b700 1 -- 172.21.15.84:0/4033501497 learned_addr learned my addr 172.21.15.84:0/4033501497 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.338+0000 7f382a59c700 1 --2- 172.21.15.84:0/4033501497 >> v2:172.21.15.131:3300/0 conn(0x7f382c159340 0x7f382c0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.338+0000 7f3829d9b700 1 -- 172.21.15.84:0/4033501497 >> v2:172.21.15.131:3300/0 conn(0x7f382c159340 msgr2=0x7f382c0af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:27.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.338+0000 7f3829d9b700 1 --2- 172.21.15.84:0/4033501497 >> v2:172.21.15.131:3300/0 conn(0x7f382c159340 0x7f382c0af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.338+0000 7f3829d9b700 1 -- 172.21.15.84:0/4033501497 >> v1:172.21.15.131:6789/0 conn(0x7f382c0cba70 legacy=0x7f382c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.338+0000 7f3829d9b700 1 -- 172.21.15.84:0/4033501497 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c0cfde0 con 0x7f382c159710 2023-10-06T02:55:27.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.338+0000 7f3829d9b700 1 --2- 172.21.15.84:0/4033501497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 0x7f382c0cb530 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f382c071290 tx=0x7f3820009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca27cadaccaf6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.339+0000 7f382959a700 1 -- 172.21.15.84:0/4033501497 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820009e70 con 0x7f382c159710 2023-10-06T02:55:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f382959a700 1 -- 172.21.15.84:0/4033501497 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382000b860 con 0x7f382c159710 2023-10-06T02:55:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f382959a700 1 -- 172.21.15.84:0/4033501497 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382000bc00 con 0x7f382c159710 2023-10-06T02:55:27.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f3830909700 1 -- 172.21.15.84:0/4033501497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 msgr2=0x7f382c0cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f3830909700 1 --2- 172.21.15.84:0/4033501497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 0x7f382c0cb530 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f382c071290 tx=0x7f3820009250 comp rx=0 tx=0).stop 2023-10-06T02:55:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f3830909700 1 -- 172.21.15.84:0/4033501497 shutdown_connections 2023-10-06T02:55:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f3830909700 1 --2- 172.21.15.84:0/4033501497 >> v2:172.21.15.131:3300/0 conn(0x7f382c159340 0x7f382c0af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f3830909700 1 --2- 172.21.15.84:0/4033501497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 0x7f382c0cb530 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f3830909700 1 -- 172.21.15.84:0/4033501497 >> 172.21.15.84:0/4033501497 conn(0x7f382c099720 msgr2=0x7f382c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f3830909700 1 -- 172.21.15.84:0/4033501497 shutdown_connections 2023-10-06T02:55:27.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.340+0000 7f3830909700 1 -- 172.21.15.84:0/4033501497 wait complete. 2023-10-06T02:55:27.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.341+0000 7f3830909700 1 Processor -- start 2023-10-06T02:55:27.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.341+0000 7f3830909700 1 -- start start 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f3830909700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f382c0cba70 0x7f382c0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f3830909700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f382c159340 0x7f382c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f3830909700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 0x7f382c15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f3830909700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0b60a0 con 0x7f382c159710 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f3830909700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c15d600 con 0x7f382c159340 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f3830909700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c15d8e0 con 0x7f382c0cba70 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f382ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 0x7f382c15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f382ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 0x7f382c15b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40060/0 (socket says 172.21.15.84:40060) 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f382ad9d700 1 -- 172.21.15.84:0/2035852907 learned_addr learned my addr 172.21.15.84:0/2035852907 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:27.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f382a59c700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f382c0cba70 0x7f382c0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.342+0000 7f3829d9b700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f382c159340 0x7f382c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f382ad9d700 1 -- 172.21.15.84:0/2035852907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f382c0cba70 msgr2=0x7f382c0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f382ad9d700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f382c0cba70 0x7f382c0b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f382ad9d700 1 -- 172.21.15.84:0/2035852907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f382c159340 msgr2=0x7f382c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f382ad9d700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f382c159340 0x7f382c15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f382ad9d700 1 -- 172.21.15.84:0/2035852907 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200094f0 con 0x7f382c159710 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f382ad9d700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 0x7f382c15b0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f382400c8e0 tx=0x7f3824001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f381a7fc700 1 -- 172.21.15.84:0/2035852907 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824012630 con 0x7f382c159710 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f381a7fc700 1 -- 172.21.15.84:0/2035852907 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3824012790 con 0x7f382c159710 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f381a7fc700 1 -- 172.21.15.84:0/2035852907 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824012b50 con 0x7f382c159710 2023-10-06T02:55:27.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c15dbc0 con 0x7f382c159710 2023-10-06T02:55:27.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.343+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c15e180 con 0x7f382c159710 2023-10-06T02:55:27.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.344+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c0b3b00 con 0x7f382c159710 2023-10-06T02:55:27.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.344+0000 7f381a7fc700 1 -- 172.21.15.84:0/2035852907 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f382401a3a0 con 0x7f382c159710 2023-10-06T02:55:27.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.344+0000 7f381a7fc700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f380c066f30 0x7f380c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.344+0000 7f381a7fc700 1 -- 172.21.15.84:0/2035852907 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3824084960 con 0x7f382c159710 2023-10-06T02:55:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.344+0000 7f382a59c700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f380c066f30 0x7f380c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.345+0000 7f382a59c700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f380c066f30 0x7f380c0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f381c009da0 tx=0x7f381c009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:27.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.349+0000 7f381a7fc700 1 -- 172.21.15.84:0/2035852907 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3824055210 con 0x7f382c159710 2023-10-06T02:55:27.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.529+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f382c0cbed0 con 0x7f382c159710 2023-10-06T02:55:27.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.530+0000 7f381a7fc700 1 -- 172.21.15.84:0/2035852907 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f382c0cbed0 con 0x7f382c159710 2023-10-06T02:55:27.532 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f380c066f30 msgr2=0x7f380c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f380c066f30 0x7f380c0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f381c009da0 tx=0x7f381c009120 comp rx=0 tx=0).stop 2023-10-06T02:55:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 msgr2=0x7f382c15b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 0x7f382c15b0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f382400c8e0 tx=0x7f3824001710 comp rx=0 tx=0).stop 2023-10-06T02:55:27.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 shutdown_connections 2023-10-06T02:55:27.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f380c066f30 0x7f380c0693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f382c159710 0x7f382c15b0c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f382c0cba70 0x7f382c0b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 --2- 172.21.15.84:0/2035852907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f382c159340 0x7f382c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 >> 172.21.15.84:0/2035852907 conn(0x7f382c099720 msgr2=0x7f382c0c5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 shutdown_connections 2023-10-06T02:55:27.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.532+0000 7f3830909700 1 -- 172.21.15.84:0/2035852907 wait complete. 2023-10-06T02:55:27.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:27.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.658+0000 7f0695294700 1 Processor -- start 2023-10-06T02:55:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.658+0000 7f0695294700 1 -- start start 2023-10-06T02:55:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f0695294700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f06900b2620 0x7f06900b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f0695294700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0690159870 0x7f06900cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f0695294700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06900cbfe0 con 0x7f06900b29f0 2023-10-06T02:55:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f0695294700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900cb3d0 con 0x7f0690159870 2023-10-06T02:55:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f0695294700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900cb6b0 con 0x7f06900b2620 2023-10-06T02:55:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0690159870 0x7f06900cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0690159870 0x7f06900cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40076/0 (socket says 172.21.15.84:40076) 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068f7fe700 1 -- 172.21.15.84:0/1646318647 learned_addr learned my addr 172.21.15.84:0/1646318647 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068f7fe700 1 -- 172.21.15.84:0/1646318647 >> v2:172.21.15.131:3300/0 conn(0x7f06900b2620 msgr2=0x7f06900b06d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068f7fe700 1 --2- 172.21.15.84:0/1646318647 >> v2:172.21.15.131:3300/0 conn(0x7f06900b2620 0x7f06900b06d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068f7fe700 1 -- 172.21.15.84:0/1646318647 >> v1:172.21.15.131:6789/0 conn(0x7f06900b29f0 legacy=0x7f0690159160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068f7fe700 1 -- 172.21.15.84:0/1646318647 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900cb990 con 0x7f0690159870 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068f7fe700 1 --2- 172.21.15.84:0/1646318647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0690159870 0x7f06900cc470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06900d0460 tx=0x7f0688009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e542f8e58f18b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068dffb700 1 -- 172.21.15.84:0/1646318647 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068800e070 con 0x7f0690159870 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068dffb700 1 -- 172.21.15.84:0/1646318647 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068800ba10 con 0x7f0690159870 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.659+0000 7f068dffb700 1 -- 172.21.15.84:0/1646318647 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880092e0 con 0x7f0690159870 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.660+0000 7f0695294700 1 -- 172.21.15.84:0/1646318647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0690159870 msgr2=0x7f06900cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.660+0000 7f0695294700 1 --2- 172.21.15.84:0/1646318647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0690159870 0x7f06900cc470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06900d0460 tx=0x7f0688009840 comp rx=0 tx=0).stop 2023-10-06T02:55:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.660+0000 7f0695294700 1 -- 172.21.15.84:0/1646318647 shutdown_connections 2023-10-06T02:55:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.660+0000 7f0695294700 1 --2- 172.21.15.84:0/1646318647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0690159870 0x7f06900cc470 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.660+0000 7f0695294700 1 --2- 172.21.15.84:0/1646318647 >> v2:172.21.15.131:3300/0 conn(0x7f06900b2620 0x7f06900b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.660+0000 7f0695294700 1 -- 172.21.15.84:0/1646318647 >> 172.21.15.84:0/1646318647 conn(0x7f069006ed20 msgr2=0x7f069006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.660+0000 7f0695294700 1 -- 172.21.15.84:0/1646318647 shutdown_connections 2023-10-06T02:55:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.660+0000 7f0695294700 1 -- 172.21.15.84:0/1646318647 wait complete. 2023-10-06T02:55:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.661+0000 7f0695294700 1 Processor -- start 2023-10-06T02:55:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.661+0000 7f0695294700 1 -- start start 2023-10-06T02:55:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f0695294700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06900b2620 0x7f069014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f0695294700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06900b29f0 0x7f0690157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f0695294700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0690159870 0x7f06900b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f0695294700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0690158620 con 0x7f06900b2620 2023-10-06T02:55:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f0695294700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069014b020 con 0x7f0690159870 2023-10-06T02:55:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f0695294700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06900c7d00 con 0x7f06900b29f0 2023-10-06T02:55:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f068effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06900b2620 0x7f069014aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f068effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06900b2620 0x7f069014aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40092/0 (socket says 172.21.15.84:40092) 2023-10-06T02:55:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f068effd700 1 -- 172.21.15.84:0/934821563 learned_addr learned my addr 172.21.15.84:0/934821563 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f068effd700 1 -- 172.21.15.84:0/934821563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06900b29f0 msgr2=0x7f0690157880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f068effd700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06900b29f0 0x7f0690157880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f068effd700 1 -- 172.21.15.84:0/934821563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0690159870 msgr2=0x7f06900b51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:27.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f068effd700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0690159870 0x7f06900b51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f068effd700 1 -- 172.21.15.84:0/934821563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0688009ae0 con 0x7f06900b2620 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f068effd700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06900b2620 0x7f069014aae0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f068000b7e0 tx=0x7f06800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.662+0000 7f0676ffd700 1 -- 172.21.15.84:0/934821563 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068000f510 con 0x7f06900b2620 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.663+0000 7f0676ffd700 1 -- 172.21.15.84:0/934821563 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068000f670 con 0x7f06900b2620 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.663+0000 7f0676ffd700 1 -- 172.21.15.84:0/934821563 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068000fa30 con 0x7f06900b2620 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.663+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0690158340 con 0x7f06900b2620 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.663+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06900c7990 con 0x7f06900b2620 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.663+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06900c7510 con 0x7f06900b2620 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.664+0000 7f0676ffd700 1 -- 172.21.15.84:0/934821563 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f068001a400 con 0x7f06900b2620 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.664+0000 7f0676ffd700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f067c066f30 0x7f067c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:27.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.664+0000 7f0676ffd700 1 -- 172.21.15.84:0/934821563 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f06800843c0 con 0x7f06900b2620 2023-10-06T02:55:27.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.664+0000 7f068e7fc700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f067c066f30 0x7f067c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:27.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.665+0000 7f068e7fc700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f067c066f30 0x7f067c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0690153f70 tx=0x7f0684006c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:27.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.668+0000 7f0676ffd700 1 -- 172.21.15.84:0/934821563 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06900c7510 con 0x7f06900b2620 2023-10-06T02:55:27.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.898+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06900c7510 con 0x7f06900b2620 2023-10-06T02:55:27.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.898+0000 7f0676ffd700 1 -- 172.21.15.84:0/934821563 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7f06900c7510 con 0x7f06900b2620 2023-10-06T02:55:27.901 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:27.901 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:19.276318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:55:27.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f067c066f30 msgr2=0x7f067c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f067c066f30 0x7f067c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0690153f70 tx=0x7f0684006c60 comp rx=0 tx=0).stop 2023-10-06T02:55:27.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06900b2620 msgr2=0x7f069014aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:27.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06900b2620 0x7f069014aae0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f068000b7e0 tx=0x7f06800091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 shutdown_connections 2023-10-06T02:55:27.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f067c066f30 0x7f067c0693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0690159870 0x7f06900b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06900b2620 0x7f069014aae0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 --2- 172.21.15.84:0/934821563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06900b29f0 0x7f0690157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:27.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 >> 172.21.15.84:0/934821563 conn(0x7f069006ed20 msgr2=0x7f06900b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:27.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 shutdown_connections 2023-10-06T02:55:27.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:27.900+0000 7f0695294700 1 -- 172.21.15.84:0/934821563 wait complete. 2023-10-06T02:55:27.904 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-10-06T02:55:27.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:28.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.026+0000 7fa5b8836700 1 Processor -- start 2023-10-06T02:55:28.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.026+0000 7fa5b8836700 1 -- start start 2023-10-06T02:55:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.026+0000 7fa5b8836700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa5b40b49e0 0x7fa5b40aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.026+0000 7fa5b8836700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b40b07a0 0x7fa5b40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.026+0000 7fa5b8836700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b40b0ca0 con 0x7fa5b41595a0 2023-10-06T02:55:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.026+0000 7fa5b8836700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b40b0f80 con 0x7fa5b40b49e0 2023-10-06T02:55:28.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.026+0000 7fa5b8836700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40b1260 con 0x7fa5b40b07a0 2023-10-06T02:55:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.026+0000 7fa5b259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa5b41595a0 0x7fa5b40aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49250/0 (socket says 172.21.15.84:49250) 2023-10-06T02:55:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b259c700 1 -- 172.21.15.84:0/2582096030 learned_addr learned my addr 172.21.15.84:0/2582096030 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b2d9d700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b40b07a0 0x7fa5b40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5a9d9b700 1 --2- 172.21.15.84:0/2582096030 >> v2:172.21.15.131:3300/0 conn(0x7fa5b40b49e0 0x7fa5b40aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915918842 0 0) 0x7fa5b40b0ca0 con 0x7fa5b41595a0 2023-10-06T02:55:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a0003570 con 0x7fa5b41595a0 2023-10-06T02:55:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3503709790 0 0) 0x7fa5a0003570 con 0x7fa5b41595a0 2023-10-06T02:55:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b40b07a0 msgr2=0x7fa5b40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b40b07a0 0x7fa5b40b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 >> v2:172.21.15.131:3300/0 conn(0x7fa5b40b49e0 msgr2=0x7fa5b40aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 --2- 172.21.15.84:0/2582096030 >> v2:172.21.15.131:3300/0 conn(0x7fa5b40b49e0 0x7fa5b40aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40b1540 con 0x7fa5b41595a0 2023-10-06T02:55:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fa5a40015f0 con 0x7fa5b41595a0 2023-10-06T02:55:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5a9d9b700 1 --2- 172.21.15.84:0/2582096030 >> v2:172.21.15.131:3300/0 conn(0x7fa5b40b49e0 0x7fa5b40aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 >> v1:172.21.15.84:6789/0 conn(0x7fa5b41595a0 legacy=0x7fa5b40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b40b07a0 0x7fa5a0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5a0003fe0 0x7fa5a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0004d50 0x7fa5a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40b0f80 con 0x7fa5a0003fe0 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40b1260 con 0x7fa5a0004d50 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a000ba90 con 0x7fa5b40b07a0 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5a9d9b700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5a0003fe0 0x7fa5a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b259c700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b40b07a0 0x7fa5a0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.027+0000 7fa5b2d9d700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0004d50 0x7fa5a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5a9d9b700 1 -- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b40b07a0 msgr2=0x7fa5a0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5a9d9b700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b40b07a0 0x7fa5a0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5a9d9b700 1 -- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0004d50 msgr2=0x7fa5a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5a9d9b700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0004d50 0x7fa5a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5a9d9b700 1 -- 172.21.15.84:0/2582096030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0003570 con 0x7fa5a0003fe0 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5a9d9b700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5a0003fe0 0x7fa5a0004810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4099f60 tx=0x7fa59c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8517d635abaa175 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c009740 con 0x7fa5a0003fe0 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c00e890 con 0x7fa5a0003fe0 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b1d9b700 1 -- 172.21.15.84:0/2582096030 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00ec30 con 0x7fa5a0003fe0 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b8836700 1 -- 172.21.15.84:0/2582096030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5a0003fe0 msgr2=0x7fa5a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b8836700 1 --2- 172.21.15.84:0/2582096030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5a0003fe0 0x7fa5a0004810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4099f60 tx=0x7fa59c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b2d9d700 1 -- 172.21.15.84:0/2582096030 reap_dead start 2023-10-06T02:55:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b8836700 1 -- 172.21.15.84:0/2582096030 shutdown_connections 2023-10-06T02:55:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b8836700 1 -- 172.21.15.84:0/2582096030 >> 172.21.15.84:0/2582096030 conn(0x7fa5b4099830 msgr2=0x7fa5b406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b8836700 1 -- 172.21.15.84:0/2582096030 shutdown_connections 2023-10-06T02:55:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.028+0000 7fa5b8836700 1 -- 172.21.15.84:0/2582096030 wait complete. 2023-10-06T02:55:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b8836700 1 Processor -- start 2023-10-06T02:55:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b8836700 1 -- start start 2023-10-06T02:55:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b8836700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0003fe0 0x7fa5b40aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b8836700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5b409a560 0x7fa5b416d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b8836700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b416ddb0 0x7fa5b409d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b8836700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b416e7f0 con 0x7fa5b409a560 2023-10-06T02:55:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b8836700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b409cda0 con 0x7fa5a0003fe0 2023-10-06T02:55:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b8836700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b409d340 con 0x7fa5b416ddb0 2023-10-06T02:55:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5a9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5b409a560 0x7fa5b416d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5a9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5b409a560 0x7fa5b416d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40108/0 (socket says 172.21.15.84:40108) 2023-10-06T02:55:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5a9d9b700 1 -- 172.21.15.84:0/757173424 learned_addr learned my addr 172.21.15.84:0/757173424 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b259c700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0003fe0 0x7fa5b40aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.030+0000 7fa5b2d9d700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b416ddb0 0x7fa5b409d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5a9d9b700 1 -- 172.21.15.84:0/757173424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b416ddb0 msgr2=0x7fa5b409d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5a9d9b700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b416ddb0 0x7fa5b409d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5a9d9b700 1 -- 172.21.15.84:0/757173424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0003fe0 msgr2=0x7fa5b40aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5a9d9b700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0003fe0 0x7fa5b40aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5a9d9b700 1 -- 172.21.15.84:0/757173424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b416e230 con 0x7fa5b409a560 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5a9d9b700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5b409a560 0x7fa5b416d870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0091e0 tx=0x7fa59c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5aaffd700 1 -- 172.21.15.84:0/757173424 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c023070 con 0x7fa5b409a560 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5aaffd700 1 -- 172.21.15.84:0/757173424 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c01e970 con 0x7fa5b409a560 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b416e510 con 0x7fa5b409a560 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5aaffd700 1 -- 172.21.15.84:0/757173424 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c01ed30 con 0x7fa5b409a560 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.031+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b40af440 con 0x7fa5b409a560 2023-10-06T02:55:28.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.032+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b40b05b0 con 0x7fa5b409a560 2023-10-06T02:55:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.032+0000 7fa5aaffd700 1 -- 172.21.15.84:0/757173424 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa59c013680 con 0x7fa5b409a560 2023-10-06T02:55:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.033+0000 7fa5aaffd700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa594066f30 0x7fa5940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.033+0000 7fa5b259c700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa594066f30 0x7fa5940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.033+0000 7fa5aaffd700 1 -- 172.21.15.84:0/757173424 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa59c086130 con 0x7fa5b409a560 2023-10-06T02:55:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.033+0000 7fa5b259c700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa594066f30 0x7fa5940693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4000ef0 tx=0x7fa5a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.037+0000 7fa5aaffd700 1 -- 172.21.15.84:0/757173424 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa59c052f50 con 0x7fa5b409a560 2023-10-06T02:55:28.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.220+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5b40675f0 con 0x7fa5b409a560 2023-10-06T02:55:28.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.221+0000 7fa5aaffd700 1 -- 172.21.15.84:0/757173424 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fa59c056570 con 0x7fa5b409a560 2023-10-06T02:55:28.222 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:28.223 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:28.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.222+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa594066f30 msgr2=0x7fa5940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.222+0000 7fa5b8836700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa594066f30 0x7fa5940693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4000ef0 tx=0x7fa5a4009040 comp rx=0 tx=0).stop 2023-10-06T02:55:28.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.222+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5b409a560 msgr2=0x7fa5b416d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.222+0000 7fa5b8836700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5b409a560 0x7fa5b416d870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0091e0 tx=0x7fa59c01a000 comp rx=0 tx=0).stop 2023-10-06T02:55:28.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.223+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 shutdown_connections 2023-10-06T02:55:28.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.223+0000 7fa5b8836700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa594066f30 0x7fa5940693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.223+0000 7fa5b8836700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0003fe0 0x7fa5b40aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.223+0000 7fa5b8836700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5b416ddb0 0x7fa5b409d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.223+0000 7fa5b8836700 1 --2- 172.21.15.84:0/757173424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5b409a560 0x7fa5b416d870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.223+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 >> 172.21.15.84:0/757173424 conn(0x7fa5b4099830 msgr2=0x7fa5b4157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:28.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.223+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 shutdown_connections 2023-10-06T02:55:28.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.223+0000 7fa5b8836700 1 -- 172.21.15.84:0/757173424 wait complete. 2023-10-06T02:55:28.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:55:05.120029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:55:05.566741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:55:09.247969+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:55:28.238 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.353+0000 7f732e36a700 1 Processor -- start 2023-10-06T02:55:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.353+0000 7f732e36a700 1 -- start start 2023-10-06T02:55:28.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.354+0000 7f732e36a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7328159c10 0x7f73280d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.354+0000 7f732e36a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73280d0850 0x7f7328163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.354+0000 7f732e36a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280b5f30 con 0x7f73280cd980 2023-10-06T02:55:28.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.354+0000 7f732e36a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73280b3640 con 0x7f73280d0850 2023-10-06T02:55:28.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.354+0000 7f732e36a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280d0c90 con 0x7f7328159c10 2023-10-06T02:55:28.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.354+0000 7f732c907700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73280d0850 0x7f7328163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.354+0000 7f732c907700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73280d0850 0x7f7328163240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40124/0 (socket says 172.21.15.84:40124) 2023-10-06T02:55:28.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.354+0000 7f732c907700 1 -- 172.21.15.84:0/1414298325 learned_addr learned my addr 172.21.15.84:0/1414298325 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:28.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f73277fe700 1 --2- 172.21.15.84:0/1414298325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7328159c10 0x7f73280d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f732c907700 1 -- 172.21.15.84:0/1414298325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7328159c10 msgr2=0x7f73280d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:28.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f732c907700 1 --2- 172.21.15.84:0/1414298325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7328159c10 0x7f73280d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f732c907700 1 -- 172.21.15.84:0/1414298325 >> v1:172.21.15.131:6789/0 conn(0x7f73280cd980 legacy=0x7f73280b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:28.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f732c907700 1 -- 172.21.15.84:0/1414298325 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280b63c0 con 0x7f73280d0850 2023-10-06T02:55:28.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f73277fe700 1 --2- 172.21.15.84:0/1414298325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7328159c10 0x7f73280d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:28.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f732c907700 1 --2- 172.21.15.84:0/1414298325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280d0850 0x7f7328163240 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7320009f20 tx=0x7f7320009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c42479615dc008 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:28.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f7326ffd700 1 -- 172.21.15.84:0/1414298325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000e070 con 0x7f73280d0850 2023-10-06T02:55:28.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f7326ffd700 1 -- 172.21.15.84:0/1414298325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000ba40 con 0x7f73280d0850 2023-10-06T02:55:28.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f7326ffd700 1 -- 172.21.15.84:0/1414298325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200092e0 con 0x7f73280d0850 2023-10-06T02:55:28.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.355+0000 7f732e36a700 1 -- 172.21.15.84:0/1414298325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280d0850 msgr2=0x7f7328163240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.356+0000 7f732e36a700 1 --2- 172.21.15.84:0/1414298325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280d0850 0x7f7328163240 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7320009f20 tx=0x7f7320009840 comp rx=0 tx=0).stop 2023-10-06T02:55:28.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.356+0000 7f732e36a700 1 -- 172.21.15.84:0/1414298325 shutdown_connections 2023-10-06T02:55:28.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.356+0000 7f732e36a700 1 --2- 172.21.15.84:0/1414298325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280d0850 0x7f7328163240 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.356+0000 7f732e36a700 1 --2- 172.21.15.84:0/1414298325 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7328159c10 0x7f73280d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.356+0000 7f732e36a700 1 -- 172.21.15.84:0/1414298325 >> 172.21.15.84:0/1414298325 conn(0x7f732806ed20 msgr2=0x7f732806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:28.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.356+0000 7f732e36a700 1 -- 172.21.15.84:0/1414298325 shutdown_connections 2023-10-06T02:55:28.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.356+0000 7f732e36a700 1 -- 172.21.15.84:0/1414298325 wait complete. 2023-10-06T02:55:28.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.357+0000 7f732e36a700 1 Processor -- start 2023-10-06T02:55:28.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.357+0000 7f732e36a700 1 -- start start 2023-10-06T02:55:28.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.357+0000 7f732e36a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280cd980 0x7f7328154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f732e36a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73280d0850 0x7f73280ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f732e36a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7328159c10 0x7f732813ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f732e36a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280cf730 con 0x7f73280cd980 2023-10-06T02:55:28.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f732e36a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280cec50 con 0x7f7328159c10 2023-10-06T02:55:28.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f732e36a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7328151380 con 0x7f73280d0850 2023-10-06T02:55:28.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f7327fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280cd980 0x7f7328154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f7327fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280cd980 0x7f7328154310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40140/0 (socket says 172.21.15.84:40140) 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f7327fff700 1 -- 172.21.15.84:0/2164424901 learned_addr learned my addr 172.21.15.84:0/2164424901 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f73277fe700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73280d0850 0x7f73280ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f732c907700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7328159c10 0x7f732813ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f7327fff700 1 -- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73280d0850 msgr2=0x7f73280ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f7327fff700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73280d0850 0x7f73280ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f7327fff700 1 -- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7328159c10 msgr2=0x7f732813ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f7327fff700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7328159c10 0x7f732813ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f7327fff700 1 -- 172.21.15.84:0/2164424901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320009ae0 con 0x7f73280cd980 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f73277fe700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73280d0850 0x7f73280ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f732c907700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7328159c10 0x7f732813ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:28.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f7327fff700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280cd980 0x7f7328154310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f731800b5e0 tx=0x7f7318009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f730ffff700 1 -- 172.21.15.84:0/2164424901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731800f510 con 0x7f73280cd980 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f730ffff700 1 -- 172.21.15.84:0/2164424901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731800f670 con 0x7f73280cd980 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73280cee90 con 0x7f73280cd980 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f730ffff700 1 -- 172.21.15.84:0/2164424901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731800fa30 con 0x7f73280cd980 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.358+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73280cf450 con 0x7f73280cd980 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.359+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7328151150 con 0x7f73280cd980 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.359+0000 7f730ffff700 1 -- 172.21.15.84:0/2164424901 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f731801a400 con 0x7f73280cd980 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.360+0000 7f730ffff700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7314066f30 0x7f73140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.360+0000 7f730ffff700 1 -- 172.21.15.84:0/2164424901 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7318084450 con 0x7f73280cd980 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.360+0000 7f73277fe700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7314066f30 0x7f73140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.360+0000 7f73277fe700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7314066f30 0x7f73140693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73280d0010 tx=0x7f731c006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:28.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.364+0000 7f730ffff700 1 -- 172.21.15.84:0/2164424901 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7328151150 con 0x7f73280cd980 2023-10-06T02:55:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.548+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7328151150 con 0x7f73280cd980 2023-10-06T02:55:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.549+0000 7f730ffff700 1 -- 172.21.15.84:0/2164424901 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7328151150 con 0x7f73280cd980 2023-10-06T02:55:28.551 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:55:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7314066f30 msgr2=0x7f73140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7314066f30 0x7f73140693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73280d0010 tx=0x7f731c006f90 comp rx=0 tx=0).stop 2023-10-06T02:55:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280cd980 msgr2=0x7f7328154310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280cd980 0x7f7328154310 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f731800b5e0 tx=0x7f7318009120 comp rx=0 tx=0).stop 2023-10-06T02:55:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 shutdown_connections 2023-10-06T02:55:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7314066f30 0x7f73140693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7328159c10 0x7f732813ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73280cd980 0x7f7328154310 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 --2- 172.21.15.84:0/2164424901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73280d0850 0x7f73280ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 >> 172.21.15.84:0/2164424901 conn(0x7f732806ed20 msgr2=0x7f73280b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 shutdown_connections 2023-10-06T02:55:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.551+0000 7f732e36a700 1 -- 172.21.15.84:0/2164424901 wait complete. 2023-10-06T02:55:28.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:28.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.679+0000 7f025d031700 1 Processor -- start 2023-10-06T02:55:28.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.679+0000 7f025d031700 1 -- start start 2023-10-06T02:55:28.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f025d031700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0258159510 0x7f02580cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f025d031700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02580cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f025d031700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02580cf350 con 0x7f02580ce820 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f025d031700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02580cf610 con 0x7f0258159510 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f025d031700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02580cf8f0 con 0x7f02581598e0 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f0256d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0258159510 0x7f02580cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f025759e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f02580ce820 0x7f02580cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49252/0 (socket says 172.21.15.84:49252) 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f025759e700 1 -- 172.21.15.84:0/520728284 learned_addr learned my addr 172.21.15.84:0/520728284 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f025659c700 1 --2- 172.21.15.84:0/520728284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02580cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f0256d9d700 1 -- 172.21.15.84:0/520728284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 msgr2=0x7f02580cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f0256d9d700 1 --2- 172.21.15.84:0/520728284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02580cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f0256d9d700 1 -- 172.21.15.84:0/520728284 >> v1:172.21.15.84:6789/0 conn(0x7f02580ce820 legacy=0x7f02580cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f0255d9b700 1 -- 172.21.15.84:0/520728284 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581133832 0 0) 0x7f02580cf350 con 0x7f02580ce820 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f0256d9d700 1 -- 172.21.15.84:0/520728284 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02580cfbd0 con 0x7f0258159510 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f025659c700 1 --2- 172.21.15.84:0/520728284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02580cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.680+0000 7f0256d9d700 1 --2- 172.21.15.84:0/520728284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 0x7f02580cb5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f02480098e0 tx=0x7f02480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42433b378ebdcf1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f0255d9b700 1 -- 172.21.15.84:0/520728284 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248009e80 con 0x7f0258159510 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f0255d9b700 1 -- 172.21.15.84:0/520728284 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024800b860 con 0x7f0258159510 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f0255d9b700 1 -- 172.21.15.84:0/520728284 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024800bbe0 con 0x7f0258159510 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f025d031700 1 -- 172.21.15.84:0/520728284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 msgr2=0x7f02580cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f025d031700 1 --2- 172.21.15.84:0/520728284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 0x7f02580cb5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f02480098e0 tx=0x7f02480091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f025d031700 1 -- 172.21.15.84:0/520728284 shutdown_connections 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f025d031700 1 --2- 172.21.15.84:0/520728284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 0x7f02580cb5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f025d031700 1 --2- 172.21.15.84:0/520728284 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02580cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f025d031700 1 -- 172.21.15.84:0/520728284 >> 172.21.15.84:0/520728284 conn(0x7f0258089e90 msgr2=0x7f02580997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:28.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f025d031700 1 -- 172.21.15.84:0/520728284 shutdown_connections 2023-10-06T02:55:28.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.681+0000 7f025d031700 1 -- 172.21.15.84:0/520728284 wait complete. 2023-10-06T02:55:28.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.682+0000 7f025d031700 1 Processor -- start 2023-10-06T02:55:28.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.682+0000 7f025d031700 1 -- start start 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.683+0000 7f025d031700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 0x7f0258142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.683+0000 7f025d031700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 0x7f025816ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.683+0000 7f025d031700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02581582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.683+0000 7f025d031700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02580c9080 con 0x7f0258159510 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.683+0000 7f025d031700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025814e550 con 0x7f02580ce820 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.683+0000 7f025d031700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025816d8d0 con 0x7f02581598e0 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.683+0000 7f025659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 0x7f025816ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.683+0000 7f025659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 0x7f025816ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40152/0 (socket says 172.21.15.84:40152) 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.683+0000 7f025659c700 1 -- 172.21.15.84:0/2688292074 learned_addr learned my addr 172.21.15.84:0/2688292074 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:28.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025659c700 1 -- 172.21.15.84:0/2688292074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 msgr2=0x7f02581582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025759e700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02581582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f0256d9d700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 0x7f0258142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025659c700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02581582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025659c700 1 -- 172.21.15.84:0/2688292074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 msgr2=0x7f0258142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025659c700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 0x7f0258142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025659c700 1 -- 172.21.15.84:0/2688292074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0248009420 con 0x7f0258159510 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025759e700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02581582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025659c700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 0x7f025816ce10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c800 tx=0x7f024c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f023effd700 1 -- 172.21.15.84:0/2688292074 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c011600 con 0x7f0258159510 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f023effd700 1 -- 172.21.15.84:0/2688292074 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c011760 con 0x7f0258159510 2023-10-06T02:55:28.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025816dbb0 con 0x7f0258159510 2023-10-06T02:55:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f023effd700 1 -- 172.21.15.84:0/2688292074 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c011ae0 con 0x7f0258159510 2023-10-06T02:55:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.684+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02580c8990 con 0x7f0258159510 2023-10-06T02:55:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.685+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02580c9230 con 0x7f0258159510 2023-10-06T02:55:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.685+0000 7f023effd700 1 -- 172.21.15.84:0/2688292074 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f024c010350 con 0x7f0258159510 2023-10-06T02:55:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.685+0000 7f023effd700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0244066f30 0x7f02440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.686+0000 7f023effd700 1 -- 172.21.15.84:0/2688292074 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f024c0848b0 con 0x7f0258159510 2023-10-06T02:55:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.686+0000 7f0256d9d700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0244066f30 0x7f02440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.686+0000 7f0256d9d700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0244066f30 0x7f02440693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0248003080 tx=0x7f0248017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:28.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.690+0000 7f023effd700 1 -- 172.21.15.84:0/2688292074 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02580c9230 con 0x7f0258159510 2023-10-06T02:55:28.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.871+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0258064ad0 con 0x7f0258159510 2023-10-06T02:55:28.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.872+0000 7f023effd700 1 -- 172.21.15.84:0/2688292074 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f024c055160 con 0x7f0258159510 2023-10-06T02:55:28.874 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:55:28.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0244066f30 msgr2=0x7f02440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0244066f30 0x7f02440693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0248003080 tx=0x7f0248017000 comp rx=0 tx=0).stop 2023-10-06T02:55:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 msgr2=0x7f025816ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 0x7f025816ce10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c800 tx=0x7f024c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 shutdown_connections 2023-10-06T02:55:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0244066f30 0x7f02440693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02580ce820 0x7f0258142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f02581598e0 0x7f02581582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 --2- 172.21.15.84:0/2688292074 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0258159510 0x7f025816ce10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 >> 172.21.15.84:0/2688292074 conn(0x7f0258089e90 msgr2=0x7f025815bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 shutdown_connections 2023-10-06T02:55:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:28.874+0000 7f025d031700 1 -- 172.21.15.84:0/2688292074 wait complete. 2023-10-06T02:55:28.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:55:29.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.003+0000 7fb6a71df700 1 Processor -- start 2023-10-06T02:55:29.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.003+0000 7fb6a71df700 1 -- start start 2023-10-06T02:55:29.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a71df700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6a00cb0a0 0x7fb6a0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a71df700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a080 0x7fb6a00c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a71df700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a006d470 con 0x7fb6a013c470 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a71df700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a006cb80 con 0x7fb6a00cb0a0 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a71df700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a013c840 con 0x7fb6a015a080 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a61dd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb6a013c470 0x7fb6a00ca990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49258/0 (socket says 172.21.15.84:49258) 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a61dd700 1 -- 172.21.15.84:0/1396542932 learned_addr learned my addr 172.21.15.84:0/1396542932 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709479790 0 0) 0x7fb6a006d470 con 0x7fb6a013c470 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb68c003570 con 0x7fb6a013c470 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 34290253 0 0) 0x7fb68c003570 con 0x7fb6a013c470 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a080 msgr2=0x7fb6a00c8730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 --2- 172.21.15.84:0/1396542932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a080 0x7fb6a00c8730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 >> v2:172.21.15.131:3300/0 conn(0x7fb6a00cb0a0 msgr2=0x7fb6a0159b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 --2- 172.21.15.84:0/1396542932 >> v2:172.21.15.131:3300/0 conn(0x7fb6a00cb0a0 0x7fb6a0159b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a006ce20 con 0x7fb6a013c470 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fb69c001470 con 0x7fb6a013c470 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 >> v1:172.21.15.84:6789/0 conn(0x7fb6a013c470 legacy=0x7fb6a00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 --2- 172.21.15.84:0/1396542932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb68c003a60 0x7fb68c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 --2- 172.21.15.84:0/1396542932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb68c004810 0x7fb68c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 --2- 172.21.15.84:0/1396542932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a080 0x7fb68c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a006cb80 con 0x7fb68c003a60 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a013c840 con 0x7fb68c004810 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.004+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0055e0 con 0x7fb6a015a080 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a61dd700 1 --2- 172.21.15.84:0/1396542932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb68c003a60 0x7fb68c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a61dd700 1 -- 172.21.15.84:0/1396542932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a080 msgr2=0x7fb68c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a61dd700 1 --2- 172.21.15.84:0/1396542932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a015a080 0x7fb68c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a61dd700 1 -- 172.21.15.84:0/1396542932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb68c004810 msgr2=0x7fb68c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a61dd700 1 --2- 172.21.15.84:0/1396542932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb68c004810 0x7fb68c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a61dd700 1 -- 172.21.15.84:0/1396542932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c003570 con 0x7fb68c003a60 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a61dd700 1 --2- 172.21.15.84:0/1396542932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb68c003a60 0x7fb68c003e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c390 tx=0x7fb69c007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574a5054c29817b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00cc80 con 0x7fb68c003a60 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c00cde0 con 0x7fb68c003a60 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.005+0000 7fb6a51db700 1 -- 172.21.15.84:0/1396542932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c005b70 con 0x7fb68c003a60 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.006+0000 7fb6a71df700 1 -- 172.21.15.84:0/1396542932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb68c003a60 msgr2=0x7fb68c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.006+0000 7fb6a71df700 1 --2- 172.21.15.84:0/1396542932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb68c003a60 0x7fb68c003e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c390 tx=0x7fb69c007940 comp rx=0 tx=0).stop 2023-10-06T02:55:29.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.006+0000 7fb6a69de700 1 -- 172.21.15.84:0/1396542932 reap_dead start 2023-10-06T02:55:29.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.006+0000 7fb6a71df700 1 -- 172.21.15.84:0/1396542932 shutdown_connections 2023-10-06T02:55:29.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.006+0000 7fb6a71df700 1 -- 172.21.15.84:0/1396542932 >> 172.21.15.84:0/1396542932 conn(0x7fb6a006b370 msgr2=0x7fb6a006b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:29.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.006+0000 7fb6a71df700 1 -- 172.21.15.84:0/1396542932 shutdown_connections 2023-10-06T02:55:29.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.006+0000 7fb6a71df700 1 -- 172.21.15.84:0/1396542932 wait complete. 2023-10-06T02:55:29.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.007+0000 7fb6a71df700 1 Processor -- start 2023-10-06T02:55:29.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.007+0000 7fb6a71df700 1 -- start start 2023-10-06T02:55:29.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.007+0000 7fb6a71df700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb68c003a60 0x7fb6a00b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.007+0000 7fb6a71df700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a0141f10 0x7fb6a0133840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.007+0000 7fb6a71df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a0133d80 0x7fb6a013e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.007+0000 7fb6a71df700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a00b2d00 con 0x7fb6a0133d80 2023-10-06T02:55:29.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.007+0000 7fb6a71df700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a00b20f0 con 0x7fb6a0141f10 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.007+0000 7fb6a71df700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a00b23d0 con 0x7fb68c003a60 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a69de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a0133d80 0x7fb6a013e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a69de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a0133d80 0x7fb6a013e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40156/0 (socket says 172.21.15.84:40156) 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a69de700 1 -- 172.21.15.84:0/1249504206 learned_addr learned my addr 172.21.15.84:0/1249504206 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a61dd700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb68c003a60 0x7fb6a00b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a59dc700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a0141f10 0x7fb6a0133840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a69de700 1 -- 172.21.15.84:0/1249504206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb68c003a60 msgr2=0x7fb6a00b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a69de700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb68c003a60 0x7fb6a00b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a69de700 1 -- 172.21.15.84:0/1249504206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a0141f10 msgr2=0x7fb6a0133840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a69de700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a0141f10 0x7fb6a0133840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a69de700 1 -- 172.21.15.84:0/1249504206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a00b26b0 con 0x7fb6a0133d80 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a69de700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a0133d80 0x7fb6a013e800 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00711f0 tx=0x7fb6980030f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6967fc700 1 -- 172.21.15.84:0/1249504206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698007430 con 0x7fb6a0133d80 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6967fc700 1 -- 172.21.15.84:0/1249504206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6980044f0 con 0x7fb6a0133d80 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a00b2990 con 0x7fb6a0133d80 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6967fc700 1 -- 172.21.15.84:0/1249504206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980048b0 con 0x7fb6a0133d80 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.008+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a013ed40 con 0x7fb6a0133d80 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.009+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a00b2eb0 con 0x7fb6a0133d80 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.010+0000 7fb6967fc700 1 -- 172.21.15.84:0/1249504206 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb698004ca0 con 0x7fb6a0133d80 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.010+0000 7fb6967fc700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb684066f30 0x7fb6840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.010+0000 7fb6a61dd700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb684066f30 0x7fb6840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.010+0000 7fb6967fc700 1 -- 172.21.15.84:0/1249504206 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb6980841e0 con 0x7fb6a0133d80 2023-10-06T02:55:29.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.010+0000 7fb6a61dd700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb684066f30 0x7fb6840693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb69c008fd0 tx=0x7fb69c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.014+0000 7fb6967fc700 1 -- 172.21.15.84:0/1249504206 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6a00b2eb0 con 0x7fb6a0133d80 2023-10-06T02:55:29.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.193+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6a00b3090 con 0x7fb6a0133d80 2023-10-06T02:55:29.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.194+0000 7fb6967fc700 1 -- 172.21.15.84:0/1249504206 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb698051080 con 0x7fb6a0133d80 2023-10-06T02:55:29.196 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.195+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb684066f30 msgr2=0x7fb6840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.195+0000 7fb6a71df700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb684066f30 0x7fb6840693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb69c008fd0 tx=0x7fb69c015000 comp rx=0 tx=0).stop 2023-10-06T02:55:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.195+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a0133d80 msgr2=0x7fb6a013e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.195+0000 7fb6a71df700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a0133d80 0x7fb6a013e800 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00711f0 tx=0x7fb6980030f0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.196+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 shutdown_connections 2023-10-06T02:55:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.196+0000 7fb6a71df700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb684066f30 0x7fb6840693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.196+0000 7fb6a71df700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6a0133d80 0x7fb6a013e800 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.196+0000 7fb6a71df700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb68c003a60 0x7fb6a00b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.196+0000 7fb6a71df700 1 --2- 172.21.15.84:0/1249504206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a0141f10 0x7fb6a0133840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.196+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 >> 172.21.15.84:0/1249504206 conn(0x7fb6a006b370 msgr2=0x7fb6a013ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.196+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 shutdown_connections 2023-10-06T02:55:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.196+0000 7fb6a71df700 1 -- 172.21.15.84:0/1249504206 wait complete. 2023-10-06T02:55:29.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:55:29.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.324+0000 7f48c2ffa700 1 Processor -- start 2023-10-06T02:55:29.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.324+0000 7f48c2ffa700 1 -- start start 2023-10-06T02:55:29.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c2ffa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f48bc0d0a00 0x7f48bc164330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c2ffa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0cdc30 con 0x7f48bc0ccab0 2023-10-06T02:55:29.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c2ffa700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0cb500 con 0x7f48bc1539d0 2023-10-06T02:55:29.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c2ffa700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc0cd020 con 0x7f48bc0d0a00 2023-10-06T02:55:29.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c17f7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f48bc0ccab0 0x7f48bc0d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49262/0 (socket says 172.21.15.84:49262) 2023-10-06T02:55:29.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c17f7700 1 -- 172.21.15.84:0/132614315 learned_addr learned my addr 172.21.15.84:0/132614315 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:29.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327723878 0 0) 0x7f48bc0cdc30 con 0x7f48bc0ccab0 2023-10-06T02:55:29.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a8003570 con 0x7f48bc0ccab0 2023-10-06T02:55:29.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c27f9700 1 --2- 172.21.15.84:0/132614315 >> v2:172.21.15.131:3300/0 conn(0x7f48bc0d0a00 0x7f48bc164330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1579346730 0 0) 0x7f48a8003570 con 0x7f48bc0ccab0 2023-10-06T02:55:29.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 >> v2:172.21.15.131:3300/0 conn(0x7f48bc0d0a00 msgr2=0x7f48bc164330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:29.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 --2- 172.21.15.84:0/132614315 >> v2:172.21.15.131:3300/0 conn(0x7f48bc0d0a00 0x7f48bc164330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 >> v1:172.21.15.131:6789/0 conn(0x7f48bc1539d0 legacy=0x7f48bc15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0cd300 con 0x7f48bc0ccab0 2023-10-06T02:55:29.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f48ac001470 con 0x7f48bc0ccab0 2023-10-06T02:55:29.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 >> v1:172.21.15.84:6789/0 conn(0x7f48bc0ccab0 legacy=0x7f48bc0d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 --2- 172.21.15.84:0/132614315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48a8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 --2- 172.21.15.84:0/132614315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48a8004810 0x7f48a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 --2- 172.21.15.84:0/132614315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48a80051c0 0x7f48a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0cd020 con 0x7f48a8003a60 2023-10-06T02:55:29.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a800c0e0 con 0x7f48a8004810 2023-10-06T02:55:29.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a800c2a0 con 0x7f48a80051c0 2023-10-06T02:55:29.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.325+0000 7f48c1ff8700 1 --2- 172.21.15.84:0/132614315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48a8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c1ff8700 1 -- 172.21.15.84:0/132614315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48a80051c0 msgr2=0x7f48a800ba60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:29.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c1ff8700 1 --2- 172.21.15.84:0/132614315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48a80051c0 0x7f48a800ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c1ff8700 1 -- 172.21.15.84:0/132614315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48a8004810 msgr2=0x7f48a8004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T02:55:29.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c1ff8700 1 --2- 172.21.15.84:0/132614315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48a8004810 0x7f48a8004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c1ff8700 1 -- 172.21.15.84:0/132614315 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8003570 con 0x7f48a8003a60 2023-10-06T02:55:29.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c27f9700 1 -- 172.21.15.84:0/132614315 reap_dead start 2023-10-06T02:55:29.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c1ff8700 1 --2- 172.21.15.84:0/132614315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48a8003e30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f48b80019a0 tx=0x7f48b8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bbde0b28f12e92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800c5d0 con 0x7f48a8003a60 2023-10-06T02:55:29.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b800c730 con 0x7f48a8003a60 2023-10-06T02:55:29.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c0ff6700 1 -- 172.21.15.84:0/132614315 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800cad0 con 0x7f48a8003a60 2023-10-06T02:55:29.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c2ffa700 1 -- 172.21.15.84:0/132614315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 msgr2=0x7f48a8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c2ffa700 1 --2- 172.21.15.84:0/132614315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48a8003e30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f48b80019a0 tx=0x7f48b8007d10 comp rx=0 tx=0).stop 2023-10-06T02:55:29.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.326+0000 7f48c2ffa700 1 -- 172.21.15.84:0/132614315 shutdown_connections 2023-10-06T02:55:29.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.327+0000 7f48c2ffa700 1 --2- 172.21.15.84:0/132614315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48a8003e30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.327+0000 7f48c2ffa700 1 -- 172.21.15.84:0/132614315 >> 172.21.15.84:0/132614315 conn(0x7f48bc068100 msgr2=0x7f48bc0684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:29.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.327+0000 7f48c2ffa700 1 -- 172.21.15.84:0/132614315 shutdown_connections 2023-10-06T02:55:29.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.327+0000 7f48c2ffa700 1 -- 172.21.15.84:0/132614315 wait complete. 2023-10-06T02:55:29.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.328+0000 7f48c2ffa700 1 Processor -- start 2023-10-06T02:55:29.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.328+0000 7f48c2ffa700 1 -- start start 2023-10-06T02:55:29.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.328+0000 7f48c2ffa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48bc0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.328+0000 7f48c2ffa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48bc16d6c0 0x7f48bc150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.328+0000 7f48c2ffa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48bc0c78d0 0x7f48bc0c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.328+0000 7f48c2ffa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0b17e0 con 0x7f48a8003a60 2023-10-06T02:55:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.328+0000 7f48c2ffa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0b3190 con 0x7f48bc0c78d0 2023-10-06T02:55:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.328+0000 7f48c2ffa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0b05e0 con 0x7f48bc16d6c0 2023-10-06T02:55:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.328+0000 7f48c1ff8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48bc0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c1ff8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48bc0b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40182/0 (socket says 172.21.15.84:40182) 2023-10-06T02:55:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c1ff8700 1 -- 172.21.15.84:0/838333475 learned_addr learned my addr 172.21.15.84:0/838333475 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c17f7700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48bc16d6c0 0x7f48bc150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c1ff8700 1 -- 172.21.15.84:0/838333475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48bc16d6c0 msgr2=0x7f48bc150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c1ff8700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48bc16d6c0 0x7f48bc150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c1ff8700 1 -- 172.21.15.84:0/838333475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48bc0c78d0 msgr2=0x7f48bc0c5c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:55:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c1ff8700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48bc0c78d0 0x7f48bc0c5c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c1ff8700 1 -- 172.21.15.84:0/838333475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0b08c0 con 0x7f48a8003a60 2023-10-06T02:55:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c1ff8700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48bc0b0000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f48b8012f40 tx=0x7f48b8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48b1ffb700 1 -- 172.21.15.84:0/838333475 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800ce40 con 0x7f48a8003a60 2023-10-06T02:55:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48b1ffb700 1 -- 172.21.15.84:0/838333475 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b800c8a0 con 0x7f48a8003a60 2023-10-06T02:55:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc0b0ba0 con 0x7f48a8003a60 2023-10-06T02:55:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48b1ffb700 1 -- 172.21.15.84:0/838333475 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b801e400 con 0x7f48a8003a60 2023-10-06T02:55:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.329+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc150560 con 0x7f48a8003a60 2023-10-06T02:55:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.330+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc05f270 con 0x7f48a8003a60 2023-10-06T02:55:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.330+0000 7f48b1ffb700 1 -- 172.21.15.84:0/838333475 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48b8019030 con 0x7f48a8003a60 2023-10-06T02:55:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.331+0000 7f48b1ffb700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f48a0066f30 0x7f48a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.331+0000 7f48b1ffb700 1 -- 172.21.15.84:0/838333475 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f48b8085ef0 con 0x7f48a8003a60 2023-10-06T02:55:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.331+0000 7f48c17f7700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f48a0066f30 0x7f48a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.331+0000 7f48c17f7700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f48a0066f30 0x7f48a00693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48ac001620 tx=0x7f48ac000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.335+0000 7f48b1ffb700 1 -- 172.21.15.84:0/838333475 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48b8052e50 con 0x7f48a8003a60 2023-10-06T02:55:29.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.515+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48bc0ce170 con 0x7f48a8003a60 2023-10-06T02:55:29.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.516+0000 7f48b1ffb700 1 -- 172.21.15.84:0/838333475 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48b802c0a0 con 0x7f48a8003a60 2023-10-06T02:55:29.518 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:55:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f48a0066f30 msgr2=0x7f48a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f48a0066f30 0x7f48a00693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48ac001620 tx=0x7f48ac000bc0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 msgr2=0x7f48bc0b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48bc0b0000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f48b8012f40 tx=0x7f48b8015000 comp rx=0 tx=0).stop 2023-10-06T02:55:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 shutdown_connections 2023-10-06T02:55:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f48a0066f30 0x7f48a00693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48bc0c78d0 0x7f48bc0c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8003a60 0x7f48bc0b0000 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 --2- 172.21.15.84:0/838333475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48bc16d6c0 0x7f48bc150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 >> 172.21.15.84:0/838333475 conn(0x7f48bc068100 msgr2=0x7f48bc0c5100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 shutdown_connections 2023-10-06T02:55:29.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.518+0000 7f48c2ffa700 1 -- 172.21.15.84:0/838333475 wait complete. 2023-10-06T02:55:29.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:55:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.645+0000 7fec42b03700 1 Processor -- start 2023-10-06T02:55:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.645+0000 7fec42b03700 1 -- start start 2023-10-06T02:55:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.646+0000 7fec42b03700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fec3c1598e0 0x7fec3c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.646+0000 7fec42b03700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec3c0cbcb0 0x7fec3c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.646+0000 7fec42b03700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3c0cf610 con 0x7fec3c159510 2023-10-06T02:55:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.646+0000 7fec42b03700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3c0cf8f0 con 0x7fec3c0cbcb0 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.646+0000 7fec42b03700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3c0cfbd0 con 0x7fec3c1598e0 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.646+0000 7fec410a0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec3c0cbcb0 0x7fec3c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.646+0000 7fec410a0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec3c0cbcb0 0x7fec3c0ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40196/0 (socket says 172.21.15.84:40196) 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.646+0000 7fec410a0700 1 -- 172.21.15.84:0/886734135 learned_addr learned my addr 172.21.15.84:0/886734135 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.646+0000 7fec3bfff700 1 --2- 172.21.15.84:0/886734135 >> v2:172.21.15.131:3300/0 conn(0x7fec3c1598e0 0x7fec3c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec410a0700 1 -- 172.21.15.84:0/886734135 >> v2:172.21.15.131:3300/0 conn(0x7fec3c1598e0 msgr2=0x7fec3c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec410a0700 1 --2- 172.21.15.84:0/886734135 >> v2:172.21.15.131:3300/0 conn(0x7fec3c1598e0 0x7fec3c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec410a0700 1 -- 172.21.15.84:0/886734135 >> v1:172.21.15.131:6789/0 conn(0x7fec3c159510 legacy=0x7fec3c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec410a0700 1 -- 172.21.15.84:0/886734135 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c0cfeb0 con 0x7fec3c0cbcb0 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec3bfff700 1 --2- 172.21.15.84:0/886734135 >> v2:172.21.15.131:3300/0 conn(0x7fec3c1598e0 0x7fec3c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:29.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec410a0700 1 --2- 172.21.15.84:0/886734135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c0cbcb0 0x7fec3c0ced60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0c73b0 tx=0x7fec34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0de1cb348e7ef98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec3b7fe700 1 -- 172.21.15.84:0/886734135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400b860 con 0x7fec3c0cbcb0 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec3b7fe700 1 -- 172.21.15.84:0/886734135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3400b9c0 con 0x7fec3c0cbcb0 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec3b7fe700 1 -- 172.21.15.84:0/886734135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3400bd60 con 0x7fec3c0cbcb0 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec42b03700 1 -- 172.21.15.84:0/886734135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c0cbcb0 msgr2=0x7fec3c0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec42b03700 1 --2- 172.21.15.84:0/886734135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c0cbcb0 0x7fec3c0ced60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0c73b0 tx=0x7fec34009250 comp rx=0 tx=0).stop 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec42b03700 1 -- 172.21.15.84:0/886734135 shutdown_connections 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec42b03700 1 --2- 172.21.15.84:0/886734135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c0cbcb0 0x7fec3c0ced60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec42b03700 1 --2- 172.21.15.84:0/886734135 >> v2:172.21.15.131:3300/0 conn(0x7fec3c1598e0 0x7fec3c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec42b03700 1 -- 172.21.15.84:0/886734135 >> 172.21.15.84:0/886734135 conn(0x7fec3c089e90 msgr2=0x7fec3c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec42b03700 1 -- 172.21.15.84:0/886734135 shutdown_connections 2023-10-06T02:55:29.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.647+0000 7fec42b03700 1 -- 172.21.15.84:0/886734135 wait complete. 2023-10-06T02:55:29.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.648+0000 7fec42b03700 1 Processor -- start 2023-10-06T02:55:29.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec42b03700 1 -- start start 2023-10-06T02:55:29.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec42b03700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec3c0cbcb0 0x7fec3c1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec42b03700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c159510 0x7fec3c149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec42b03700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec3c1598e0 0x7fec3c14bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec42b03700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c16d960 con 0x7fec3c159510 2023-10-06T02:55:29.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec42b03700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c16d070 con 0x7fec3c1598e0 2023-10-06T02:55:29.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec42b03700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c151d90 con 0x7fec3c0cbcb0 2023-10-06T02:55:29.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec3bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c159510 0x7fec3c149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec3bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c159510 0x7fec3c149950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40200/0 (socket says 172.21.15.84:40200) 2023-10-06T02:55:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.649+0000 7fec3bfff700 1 -- 172.21.15.84:0/428497252 learned_addr learned my addr 172.21.15.84:0/428497252 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec4089f700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec3c0cbcb0 0x7fec3c1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec410a0700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec3c1598e0 0x7fec3c14bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec3bfff700 1 -- 172.21.15.84:0/428497252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec3c0cbcb0 msgr2=0x7fec3c1529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec3bfff700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec3c0cbcb0 0x7fec3c1529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec3bfff700 1 -- 172.21.15.84:0/428497252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec3c1598e0 msgr2=0x7fec3c14bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec3bfff700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec3c1598e0 0x7fec3c14bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec3bfff700 1 -- 172.21.15.84:0/428497252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec340094f0 con 0x7fec3c159510 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec3bfff700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c159510 0x7fec3c149950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fec3000d860 tx=0x7fec30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec38ff9700 1 -- 172.21.15.84:0/428497252 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec300125f0 con 0x7fec3c159510 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec38ff9700 1 -- 172.21.15.84:0/428497252 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec30012750 con 0x7fec3c159510 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec38ff9700 1 -- 172.21.15.84:0/428497252 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec30012b10 con 0x7fec3c159510 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c16d310 con 0x7fec3c159510 2023-10-06T02:55:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.650+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c149e90 con 0x7fec3c159510 2023-10-06T02:55:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.651+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c16dad0 con 0x7fec3c159510 2023-10-06T02:55:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.652+0000 7fec38ff9700 1 -- 172.21.15.84:0/428497252 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec30013480 con 0x7fec3c159510 2023-10-06T02:55:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.652+0000 7fec38ff9700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec28066f30 0x7fec280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.652+0000 7fec38ff9700 1 -- 172.21.15.84:0/428497252 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fec30084c00 con 0x7fec3c159510 2023-10-06T02:55:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.652+0000 7fec4089f700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec28066f30 0x7fec280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.652+0000 7fec4089f700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec28066f30 0x7fec280693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fec2c007fd0 tx=0x7fec2c0016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.656+0000 7fec38ff9700 1 -- 172.21.15.84:0/428497252 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec3008b080 con 0x7fec3c159510 2023-10-06T02:55:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.838+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec3c064ad0 con 0x7fec3c159510 2023-10-06T02:55:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.838+0000 7fec38ff9700 1 -- 172.21.15.84:0/428497252 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec30051a20 con 0x7fec3c159510 2023-10-06T02:55:29.840 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:29.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec28066f30 msgr2=0x7fec280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec28066f30 0x7fec280693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fec2c007fd0 tx=0x7fec2c0016f0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c159510 msgr2=0x7fec3c149950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c159510 0x7fec3c149950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fec3000d860 tx=0x7fec30008040 comp rx=0 tx=0).stop 2023-10-06T02:55:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 shutdown_connections 2023-10-06T02:55:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec28066f30 0x7fec280693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec3c1598e0 0x7fec3c14bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec3c0cbcb0 0x7fec3c1529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 --2- 172.21.15.84:0/428497252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec3c159510 0x7fec3c149950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 >> 172.21.15.84:0/428497252 conn(0x7fec3c089e90 msgr2=0x7fec3c0d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 shutdown_connections 2023-10-06T02:55:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.840+0000 7fec42b03700 1 -- 172.21.15.84:0/428497252 wait complete. 2023-10-06T02:55:29.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:29.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.966+0000 7fd529ae8700 1 Processor -- start 2023-10-06T02:55:29.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.966+0000 7fd529ae8700 1 -- start start 2023-10-06T02:55:29.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.966+0000 7fd529ae8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd5240b07a0 0x7fd5240ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.966+0000 7fd529ae8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240b0ca0 con 0x7fd5241595a0 2023-10-06T02:55:29.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.966+0000 7fd529ae8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240b0f80 con 0x7fd5240b49e0 2023-10-06T02:55:29.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.966+0000 7fd529ae8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5240ab390 con 0x7fd5240b07a0 2023-10-06T02:55:29.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5237fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd5241595a0 0x7fd5240aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49268/0 (socket says 172.21.15.84:49268) 2023-10-06T02:55:29.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5237fe700 1 -- 172.21.15.84:0/2178112943 learned_addr learned my addr 172.21.15.84:0/2178112943 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:29.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd523fff700 1 --2- 172.21.15.84:0/2178112943 >> v2:172.21.15.131:3300/0 conn(0x7fd5240b07a0 0x7fd5240ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729081204 0 0) 0x7fd5240b0ca0 con 0x7fd5241595a0 2023-10-06T02:55:29.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd510003570 con 0x7fd5241595a0 2023-10-06T02:55:29.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687257730 0 0) 0x7fd5240b0f80 con 0x7fd5240b49e0 2023-10-06T02:55:29.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5240b0ca0 con 0x7fd5240b49e0 2023-10-06T02:55:29.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201054673 0 0) 0x7fd510003570 con 0x7fd5241595a0 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 >> v2:172.21.15.131:3300/0 conn(0x7fd5240b07a0 msgr2=0x7fd5240ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 --2- 172.21.15.84:0/2178112943 >> v2:172.21.15.131:3300/0 conn(0x7fd5240b07a0 0x7fd5240ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 >> v1:172.21.15.131:6789/0 conn(0x7fd5240b49e0 legacy=0x7fd5240aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240b1260 con 0x7fd5241595a0 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fd5140015f0 con 0x7fd5241595a0 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 >> v1:172.21.15.84:6789/0 conn(0x7fd5241595a0 legacy=0x7fd5240aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd510003c40 0x7fd510004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510004810 0x7fd510004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd510005210 0x7fd51000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240ab390 con 0x7fd510004810 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51000c130 con 0x7fd510003c40 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51000c2c0 con 0x7fd510005210 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd522ffd700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510004810 0x7fd510004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd5237fe700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd510003c40 0x7fd510004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.967+0000 7fd523fff700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd510005210 0x7fd51000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd522ffd700 1 -- 172.21.15.84:0/2178112943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd510005210 msgr2=0x7fd51000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd522ffd700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd510005210 0x7fd51000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd522ffd700 1 -- 172.21.15.84:0/2178112943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd510003c40 msgr2=0x7fd510004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd522ffd700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd510003c40 0x7fd510004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd523fff700 1 -- 172.21.15.84:0/2178112943 reap_dead start 2023-10-06T02:55:29.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd522ffd700 1 -- 172.21.15.84:0/2178112943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510003570 con 0x7fd510004810 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd522ffd700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510004810 0x7fd510004c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0019e0 tx=0x7fd50c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a11a3840fc62c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00c550 con 0x7fd510004810 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00c6b0 con 0x7fd510004810 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd5227fc700 1 -- 172.21.15.84:0/2178112943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00ca50 con 0x7fd510004810 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd529ae8700 1 -- 172.21.15.84:0/2178112943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510004810 msgr2=0x7fd510004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd529ae8700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510004810 0x7fd510004c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0019e0 tx=0x7fd50c007d30 comp rx=0 tx=0).stop 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd529ae8700 1 -- 172.21.15.84:0/2178112943 shutdown_connections 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd529ae8700 1 --2- 172.21.15.84:0/2178112943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd510004810 0x7fd510004c80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd529ae8700 1 -- 172.21.15.84:0/2178112943 >> 172.21.15.84:0/2178112943 conn(0x7fd524099830 msgr2=0x7fd52406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:29.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd529ae8700 1 -- 172.21.15.84:0/2178112943 shutdown_connections 2023-10-06T02:55:29.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.968+0000 7fd529ae8700 1 -- 172.21.15.84:0/2178112943 wait complete. 2023-10-06T02:55:29.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.970+0000 7fd529ae8700 1 Processor -- start 2023-10-06T02:55:29.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.970+0000 7fd529ae8700 1 -- start start 2023-10-06T02:55:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.970+0000 7fd529ae8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd510004810 0x7fd5240aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.970+0000 7fd529ae8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5240abe00 0x7fd52416a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.970+0000 7fd529ae8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5240aac30 0x7fd5240693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.970+0000 7fd529ae8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52416a5c0 con 0x7fd5240abe00 2023-10-06T02:55:29.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.970+0000 7fd529ae8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240ac270 con 0x7fd510004810 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.970+0000 7fd529ae8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240ac500 con 0x7fd5240aac30 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.970+0000 7fd522ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5240abe00 0x7fd52416a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd522ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5240abe00 0x7fd52416a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40208/0 (socket says 172.21.15.84:40208) 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd522ffd700 1 -- 172.21.15.84:0/1586146915 learned_addr learned my addr 172.21.15.84:0/1586146915 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd5237fe700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd510004810 0x7fd5240aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd523fff700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5240aac30 0x7fd5240693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd522ffd700 1 -- 172.21.15.84:0/1586146915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5240aac30 msgr2=0x7fd5240693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd522ffd700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5240aac30 0x7fd5240693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd522ffd700 1 -- 172.21.15.84:0/1586146915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd510004810 msgr2=0x7fd5240aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd522ffd700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd510004810 0x7fd5240aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd522ffd700 1 -- 172.21.15.84:0/1586146915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240adc80 con 0x7fd5240abe00 2023-10-06T02:55:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd522ffd700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5240abe00 0x7fd52416a080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00c3c0 tx=0x7fd50c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd51b7fe700 1 -- 172.21.15.84:0/1586146915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00c550 con 0x7fd5240abe00 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd51b7fe700 1 -- 172.21.15.84:0/1586146915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c012ab0 con 0x7fd5240abe00 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5240adf60 con 0x7fd5240abe00 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd51b7fe700 1 -- 172.21.15.84:0/1586146915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c007b10 con 0x7fd5240abe00 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.971+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5240ae520 con 0x7fd5240abe00 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.972+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd524064ad0 con 0x7fd5240abe00 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.973+0000 7fd51b7fe700 1 -- 172.21.15.84:0/1586146915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd50c019070 con 0x7fd5240abe00 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.973+0000 7fd51b7fe700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd504066f30 0x7fd5040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.973+0000 7fd51b7fe700 1 -- 172.21.15.84:0/1586146915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd50c085ed0 con 0x7fd5240abe00 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.973+0000 7fd5237fe700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd504066f30 0x7fd5040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:29.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.973+0000 7fd5237fe700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd504066f30 0x7fd5040693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd5240b64d0 tx=0x7fd514009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:29.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:29.977+0000 7fd51b7fe700 1 -- 172.21.15.84:0/1586146915 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd50c052cf0 con 0x7fd5240abe00 2023-10-06T02:55:30.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.202+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd52416a5c0 con 0x7fd5240abe00 2023-10-06T02:55:30.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.202+0000 7fd51b7fe700 1 -- 172.21.15.84:0/1586146915 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7fd50c022090 con 0x7fd5240abe00 2023-10-06T02:55:30.204 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:30.204 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:19.276318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:55:30.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd504066f30 msgr2=0x7fd5040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd504066f30 0x7fd5040693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd5240b64d0 tx=0x7fd514009040 comp rx=0 tx=0).stop 2023-10-06T02:55:30.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5240abe00 msgr2=0x7fd52416a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5240abe00 0x7fd52416a080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00c3c0 tx=0x7fd50c015000 comp rx=0 tx=0).stop 2023-10-06T02:55:30.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 shutdown_connections 2023-10-06T02:55:30.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd504066f30 0x7fd5040693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd510004810 0x7fd5240aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5240aac30 0x7fd5240693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 --2- 172.21.15.84:0/1586146915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5240abe00 0x7fd52416a080 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 >> 172.21.15.84:0/1586146915 conn(0x7fd524099830 msgr2=0x7fd524158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:30.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 shutdown_connections 2023-10-06T02:55:30.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.204+0000 7fd529ae8700 1 -- 172.21.15.84:0/1586146915 wait complete. 2023-10-06T02:55:30.208 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-10-06T02:55:30.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:30.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.331+0000 7f5b329b8700 1 Processor -- start 2023-10-06T02:55:30.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.331+0000 7f5b329b8700 1 -- start start 2023-10-06T02:55:30.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.332+0000 7f5b329b8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b2c0cbc70 0x7f5b2c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.332+0000 7f5b329b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c0b2140 0x7f5b2c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.332+0000 7f5b329b8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c0cb7e0 con 0x7f5b2c159480 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.332+0000 7f5b329b8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c0b08a0 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.332+0000 7f5b329b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0cb190 con 0x7f5b2c0b2140 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.332+0000 7f5b311b5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b2c0cbc70 0x7f5b2c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.332+0000 7f5b311b5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b2c0cbc70 0x7f5b2c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40218/0 (socket says 172.21.15.84:40218) 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.332+0000 7f5b311b5700 1 -- 172.21.15.84:0/1410674399 learned_addr learned my addr 172.21.15.84:0/1410674399 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.332+0000 7f5b321b7700 1 --2- 172.21.15.84:0/1410674399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c0b2140 0x7f5b2c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b311b5700 1 -- 172.21.15.84:0/1410674399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c0b2140 msgr2=0x7f5b2c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b311b5700 1 --2- 172.21.15.84:0/1410674399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c0b2140 0x7f5b2c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b311b5700 1 -- 172.21.15.84:0/1410674399 >> v1:172.21.15.131:6789/0 conn(0x7f5b2c159480 legacy=0x7f5b2c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b311b5700 1 -- 172.21.15.84:0/1410674399 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0cb470 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b311b5700 1 --2- 172.21.15.84:0/1410674399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 0x7f5b2c0cc0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0099b0 tx=0x7f5b1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb4d0d0932010fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b309b4700 1 -- 172.21.15.84:0/1410674399 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c009ea0 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b309b4700 1 -- 172.21.15.84:0/1410674399 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00b860 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b309b4700 1 -- 172.21.15.84:0/1410674399 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00bc00 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b329b8700 1 -- 172.21.15.84:0/1410674399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 msgr2=0x7f5b2c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b329b8700 1 --2- 172.21.15.84:0/1410674399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 0x7f5b2c0cc0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0099b0 tx=0x7f5b1c009250 comp rx=0 tx=0).stop 2023-10-06T02:55:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b329b8700 1 -- 172.21.15.84:0/1410674399 shutdown_connections 2023-10-06T02:55:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b329b8700 1 --2- 172.21.15.84:0/1410674399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c0b2140 0x7f5b2c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b329b8700 1 --2- 172.21.15.84:0/1410674399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 0x7f5b2c0cc0c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.333+0000 7f5b329b8700 1 -- 172.21.15.84:0/1410674399 >> 172.21.15.84:0/1410674399 conn(0x7f5b2c06ed20 msgr2=0x7f5b2c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.334+0000 7f5b329b8700 1 -- 172.21.15.84:0/1410674399 shutdown_connections 2023-10-06T02:55:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.334+0000 7f5b329b8700 1 -- 172.21.15.84:0/1410674399 wait complete. 2023-10-06T02:55:30.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b329b8700 1 Processor -- start 2023-10-06T02:55:30.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b329b8700 1 -- start start 2023-10-06T02:55:30.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b329b8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b2c0b2140 0x7f5b2c0c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b329b8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 0x7f5b2c15dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b329b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c159480 0x7f5b2c169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b329b8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0c94a0 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b329b8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c15e890 con 0x7f5b2c0b2140 2023-10-06T02:55:30.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b329b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c15eb70 con 0x7f5b2c159480 2023-10-06T02:55:30.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b311b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 0x7f5b2c15dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b311b5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 0x7f5b2c15dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40220/0 (socket says 172.21.15.84:40220) 2023-10-06T02:55:30.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b311b5700 1 -- 172.21.15.84:0/1029595160 learned_addr learned my addr 172.21.15.84:0/1029595160 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:30.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b319b6700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b2c0b2140 0x7f5b2c0c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.335+0000 7f5b321b7700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c159480 0x7f5b2c169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b311b5700 1 -- 172.21.15.84:0/1029595160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c159480 msgr2=0x7f5b2c169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b311b5700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c159480 0x7f5b2c169bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b311b5700 1 -- 172.21.15.84:0/1029595160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b2c0b2140 msgr2=0x7f5b2c0c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b311b5700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b2c0b2140 0x7f5b2c0c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b311b5700 1 -- 172.21.15.84:0/1029595160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c0094f0 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b311b5700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 0x7f5b2c15dff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c069190 tx=0x7f5b1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:30.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b21ffb700 1 -- 172.21.15.84:0/1029595160 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c000d10 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b21ffb700 1 -- 172.21.15.84:0/1029595160 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00bbe0 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b21ffb700 1 -- 172.21.15.84:0/1029595160 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c011670 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c0c9130 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.336+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c15e530 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.337+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c0c9610 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.338+0000 7f5b21ffb700 1 -- 172.21.15.84:0/1029595160 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b1c011aa0 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.338+0000 7f5b21ffb700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b10066f30 0x7f5b100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.338+0000 7f5b21ffb700 1 -- 172.21.15.84:0/1029595160 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5b1c085e10 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.338+0000 7f5b319b6700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b10066f30 0x7f5b100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.339+0000 7f5b319b6700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b10066f30 0x7f5b100693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5b28007fd0 tx=0x7f5b28001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:30.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.342+0000 7f5b21ffb700 1 -- 172.21.15.84:0/1029595160 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b1c052cb0 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.526+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b2c05f270 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.526+0000 7f5b21ffb700 1 -- 172.21.15.84:0/1029595160 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f5b1c0562d0 con 0x7f5b2c0cbc70 2023-10-06T02:55:30.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:30.529 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:30.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b10066f30 msgr2=0x7f5b100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b10066f30 0x7f5b100693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5b28007fd0 tx=0x7f5b28001650 comp rx=0 tx=0).stop 2023-10-06T02:55:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 msgr2=0x7f5b2c15dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 0x7f5b2c15dff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c069190 tx=0x7f5b1c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 shutdown_connections 2023-10-06T02:55:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b10066f30 0x7f5b100693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b2c0b2140 0x7f5b2c0c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b2c159480 0x7f5b2c169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 --2- 172.21.15.84:0/1029595160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b2c0cbc70 0x7f5b2c15dff0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.528+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 >> 172.21.15.84:0/1029595160 conn(0x7f5b2c06ed20 msgr2=0x7f5b2c0cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:30.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.529+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 shutdown_connections 2023-10-06T02:55:30.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.529+0000 7f5b329b8700 1 -- 172.21.15.84:0/1029595160 wait complete. 2023-10-06T02:55:30.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:30.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.655+0000 7fb6d70de700 1 Processor -- start 2023-10-06T02:55:30.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.655+0000 7fb6d70de700 1 -- start start 2023-10-06T02:55:30.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d70de700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6d00cdea0 0x7fb6d00c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d70de700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d015b210 con 0x7fb6d0157080 2023-10-06T02:55:30.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d70de700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d00ce4f0 con 0x7fb6d0157450 2023-10-06T02:55:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d70de700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d015bdb0 con 0x7fb6d00cdea0 2023-10-06T02:55:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d68dd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6d00cdea0 0x7fb6d00c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d60dc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb6d0157080 0x7fb6d006d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49270/0 (socket says 172.21.15.84:49270) 2023-10-06T02:55:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d60dc700 1 -- 172.21.15.84:0/3721202437 learned_addr learned my addr 172.21.15.84:0/3721202437 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d68dd700 1 -- 172.21.15.84:0/3721202437 >> v1:172.21.15.131:6789/0 conn(0x7fb6d0157450 legacy=0x7fb6d015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:30.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d68dd700 1 -- 172.21.15.84:0/3721202437 >> v1:172.21.15.84:6789/0 conn(0x7fb6d0157080 legacy=0x7fb6d006d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d68dd700 1 -- 172.21.15.84:0/3721202437 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00ce7d0 con 0x7fb6d00cdea0 2023-10-06T02:55:30.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.656+0000 7fb6d50da700 1 -- 172.21.15.84:0/3721202437 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654848995 0 0) 0x7fb6d015b210 con 0x7fb6d0157080 2023-10-06T02:55:30.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d68dd700 1 --2- 172.21.15.84:0/3721202437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d00cdea0 0x7fb6d00c9fd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80098e0 tx=0x7fb6c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5424845d824b786f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:30.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d50da700 1 -- 172.21.15.84:0/3721202437 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8009e80 con 0x7fb6d00cdea0 2023-10-06T02:55:30.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d50da700 1 -- 172.21.15.84:0/3721202437 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c800b820 con 0x7fb6d00cdea0 2023-10-06T02:55:30.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d50da700 1 -- 172.21.15.84:0/3721202437 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c800bba0 con 0x7fb6d00cdea0 2023-10-06T02:55:30.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d70de700 1 -- 172.21.15.84:0/3721202437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d00cdea0 msgr2=0x7fb6d00c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d70de700 1 --2- 172.21.15.84:0/3721202437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d00cdea0 0x7fb6d00c9fd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80098e0 tx=0x7fb6c80091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d70de700 1 -- 172.21.15.84:0/3721202437 shutdown_connections 2023-10-06T02:55:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d70de700 1 --2- 172.21.15.84:0/3721202437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d00cdea0 0x7fb6d00c9fd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d70de700 1 -- 172.21.15.84:0/3721202437 >> 172.21.15.84:0/3721202437 conn(0x7fb6d006b540 msgr2=0x7fb6d006b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d70de700 1 -- 172.21.15.84:0/3721202437 shutdown_connections 2023-10-06T02:55:30.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.657+0000 7fb6d70de700 1 -- 172.21.15.84:0/3721202437 wait complete. 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.658+0000 7fb6d70de700 1 Processor -- start 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.658+0000 7fb6d70de700 1 -- start start 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d70de700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6d00cdea0 0x7fb6d014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d70de700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d0157080 0x7fb6d00b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d70de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d0157450 0x7fb6d0167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d70de700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d0168a20 con 0x7fb6d0157450 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d70de700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d00b1560 con 0x7fb6d00cdea0 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d70de700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d014d2a0 con 0x7fb6d0157080 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d68dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d0157450 0x7fb6d0167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d68dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d0157450 0x7fb6d0167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40236/0 (socket says 172.21.15.84:40236) 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d68dd700 1 -- 172.21.15.84:0/156960825 learned_addr learned my addr 172.21.15.84:0/156960825 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d58db700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d0157080 0x7fb6d00b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.659+0000 7fb6d60dc700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6d00cdea0 0x7fb6d014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6d68dd700 1 -- 172.21.15.84:0/156960825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d0157080 msgr2=0x7fb6d00b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6d68dd700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d0157080 0x7fb6d00b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6d68dd700 1 -- 172.21.15.84:0/156960825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6d00cdea0 msgr2=0x7fb6d014cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6d68dd700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6d00cdea0 0x7fb6d014cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6d68dd700 1 -- 172.21.15.84:0/156960825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c8009420 con 0x7fb6d0157450 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6d68dd700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d0157450 0x7fb6d0167a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80030c0 tx=0x7fb6c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6c67fc700 1 -- 172.21.15.84:0/156960825 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c801b450 con 0x7fb6d0157450 2023-10-06T02:55:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6c67fc700 1 -- 172.21.15.84:0/156960825 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8020070 con 0x7fb6d0157450 2023-10-06T02:55:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d0168460 con 0x7fb6d0157450 2023-10-06T02:55:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6c67fc700 1 -- 172.21.15.84:0/156960825 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c801b7e0 con 0x7fb6d0157450 2023-10-06T02:55:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.660+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d00b11f0 con 0x7fb6d0157450 2023-10-06T02:55:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.661+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d00b1030 con 0x7fb6d0157450 2023-10-06T02:55:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.661+0000 7fb6c67fc700 1 -- 172.21.15.84:0/156960825 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6c8022030 con 0x7fb6d0157450 2023-10-06T02:55:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.662+0000 7fb6c67fc700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb6b4066f30 0x7fb6b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.662+0000 7fb6c67fc700 1 -- 172.21.15.84:0/156960825 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb6c8086c00 con 0x7fb6d0157450 2023-10-06T02:55:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.662+0000 7fb6d60dc700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb6b4066f30 0x7fb6b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.662+0000 7fb6d60dc700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb6b4066f30 0x7fb6b40693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0153520 tx=0x7fb6cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:30.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.666+0000 7fb6c67fc700 1 -- 172.21.15.84:0/156960825 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6c808d080 con 0x7fb6d0157450 2023-10-06T02:55:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.892+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6d00b1030 con 0x7fb6d0157450 2023-10-06T02:55:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.892+0000 7fb6c67fc700 1 -- 172.21.15.84:0/156960825 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7fb6c8053a20 con 0x7fb6d0157450 2023-10-06T02:55:30.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:30.894 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:19.276318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:55:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb6b4066f30 msgr2=0x7fb6b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb6b4066f30 0x7fb6b40693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0153520 tx=0x7fb6cc009040 comp rx=0 tx=0).stop 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d0157450 msgr2=0x7fb6d0167a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d0157450 0x7fb6d0167a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80030c0 tx=0x7fb6c8016000 comp rx=0 tx=0).stop 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 shutdown_connections 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb6b4066f30 0x7fb6b40693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6d00cdea0 0x7fb6d014cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6d0157450 0x7fb6d0167a10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 --2- 172.21.15.84:0/156960825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6d0157080 0x7fb6d00b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 >> 172.21.15.84:0/156960825 conn(0x7fb6d006b540 msgr2=0x7fb6d0150e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 shutdown_connections 2023-10-06T02:55:30.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:30.895+0000 7fb6d70de700 1 -- 172.21.15.84:0/156960825 wait complete. 2023-10-06T02:55:30.898 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-10-06T02:55:31.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:55:06.613971+0000', 'modified': '2023-10-06T02:55:19.276318+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6835/4173990514', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 4173990514}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 4173990514}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:55:31.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:55:31.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T02:55:31.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.426+0000 7f952f16b700 1 Processor -- start 2023-10-06T02:55:31.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.426+0000 7f952f16b700 1 -- start start 2023-10-06T02:55:31.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.426+0000 7f952f16b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f95281595a0 0x7f95280aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.426+0000 7f952f16b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b49e0 0x7f95280aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.426+0000 7f952f16b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95280b07a0 0x7f95280b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.426+0000 7f952f16b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95280b0ca0 con 0x7f95280b07a0 2023-10-06T02:55:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.426+0000 7f952f16b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95280b0f80 con 0x7f95281595a0 2023-10-06T02:55:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.426+0000 7f952f16b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95280b1260 con 0x7f95280b49e0 2023-10-06T02:55:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952d708700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95280b07a0 0x7f95280b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952d708700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95280b07a0 0x7f95280b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40244/0 (socket says 172.21.15.84:40244) 2023-10-06T02:55:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952d708700 1 -- 172.21.15.84:0/1287547974 learned_addr learned my addr 172.21.15.84:0/1287547974 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f9527fff700 1 --2- 172.21.15.84:0/1287547974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b49e0 0x7f95280aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952cf07700 1 --2- 172.21.15.84:0/1287547974 >> v2:172.21.15.131:3300/0 conn(0x7f95281595a0 0x7f95280aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952d708700 1 -- 172.21.15.84:0/1287547974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b49e0 msgr2=0x7f95280aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952d708700 1 --2- 172.21.15.84:0/1287547974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b49e0 0x7f95280aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952d708700 1 -- 172.21.15.84:0/1287547974 >> v2:172.21.15.131:3300/0 conn(0x7f95281595a0 msgr2=0x7f95280aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952d708700 1 --2- 172.21.15.84:0/1287547974 >> v2:172.21.15.131:3300/0 conn(0x7f95281595a0 0x7f95280aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952d708700 1 -- 172.21.15.84:0/1287547974 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280b1540 con 0x7f95280b07a0 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f9527fff700 1 --2- 172.21.15.84:0/1287547974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b49e0 0x7f95280aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952cf07700 1 --2- 172.21.15.84:0/1287547974 >> v2:172.21.15.131:3300/0 conn(0x7f95281595a0 0x7f95280aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f952d708700 1 --2- 172.21.15.84:0/1287547974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b07a0 0x7f95280b38d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9528088cc0 tx=0x7f9510009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd628850aa5d277 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f95277fe700 1 -- 172.21.15.84:0/1287547974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000b860 con 0x7f95280b07a0 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f95277fe700 1 -- 172.21.15.84:0/1287547974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000b9c0 con 0x7f95280b07a0 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.427+0000 7f95277fe700 1 -- 172.21.15.84:0/1287547974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000bd60 con 0x7f95280b07a0 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.428+0000 7f952f16b700 1 -- 172.21.15.84:0/1287547974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b07a0 msgr2=0x7f95280b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.428+0000 7f952f16b700 1 --2- 172.21.15.84:0/1287547974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b07a0 0x7f95280b38d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9528088cc0 tx=0x7f9510009250 comp rx=0 tx=0).stop 2023-10-06T02:55:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.428+0000 7f952f16b700 1 -- 172.21.15.84:0/1287547974 shutdown_connections 2023-10-06T02:55:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.428+0000 7f952f16b700 1 --2- 172.21.15.84:0/1287547974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b07a0 0x7f95280b38d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.428+0000 7f952f16b700 1 --2- 172.21.15.84:0/1287547974 >> v2:172.21.15.131:3300/0 conn(0x7f95281595a0 0x7f95280aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.428+0000 7f952f16b700 1 --2- 172.21.15.84:0/1287547974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b49e0 0x7f95280aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.428+0000 7f952f16b700 1 -- 172.21.15.84:0/1287547974 >> 172.21.15.84:0/1287547974 conn(0x7f9528099830 msgr2=0x7f952806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.428+0000 7f952f16b700 1 -- 172.21.15.84:0/1287547974 shutdown_connections 2023-10-06T02:55:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.428+0000 7f952f16b700 1 -- 172.21.15.84:0/1287547974 wait complete. 2023-10-06T02:55:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.429+0000 7f952f16b700 1 Processor -- start 2023-10-06T02:55:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.429+0000 7f952f16b700 1 -- start start 2023-10-06T02:55:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f952f16b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b07a0 0x7f9528154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f952f16b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b49e0 0x7f952814fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f952f16b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95281595a0 0x7f9528157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f952f16b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952815a730 con 0x7f95280b49e0 2023-10-06T02:55:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f952f16b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9528158160 con 0x7f95281595a0 2023-10-06T02:55:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f952f16b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9528158440 con 0x7f95280b07a0 2023-10-06T02:55:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9527fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b49e0 0x7f952814fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9527fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b49e0 0x7f952814fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40256/0 (socket says 172.21.15.84:40256) 2023-10-06T02:55:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9527fff700 1 -- 172.21.15.84:0/2533556208 learned_addr learned my addr 172.21.15.84:0/2533556208 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f952cf07700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b07a0 0x7f9528154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f952d708700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95281595a0 0x7f9528157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9527fff700 1 -- 172.21.15.84:0/2533556208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b07a0 msgr2=0x7f9528154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9527fff700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b07a0 0x7f9528154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9527fff700 1 -- 172.21.15.84:0/2533556208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95281595a0 msgr2=0x7f9528157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9527fff700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95281595a0 0x7f9528157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9527fff700 1 -- 172.21.15.84:0/2533556208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95100094f0 con 0x7f95280b49e0 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9527fff700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b49e0 0x7f952814fa60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f951800d1d0 tx=0x7f9518009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9524ff9700 1 -- 172.21.15.84:0/2533556208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800de70 con 0x7f95280b49e0 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f9524ff9700 1 -- 172.21.15.84:0/2533556208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951800f040 con 0x7f95280b49e0 2023-10-06T02:55:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.430+0000 7f952f16b700 1 -- 172.21.15.84:0/2533556208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9528158720 con 0x7f95280b49e0 2023-10-06T02:55:31.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.431+0000 7f9524ff9700 1 -- 172.21.15.84:0/2533556208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518015670 con 0x7f95280b49e0 2023-10-06T02:55:31.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.431+0000 7f952f16b700 1 -- 172.21.15.84:0/2533556208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9528155aa0 con 0x7f95280b49e0 2023-10-06T02:55:31.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.432+0000 7f9524ff9700 1 -- 172.21.15.84:0/2533556208 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9518015a60 con 0x7f95280b49e0 2023-10-06T02:55:31.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.432+0000 7f9524ff9700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9508066f30 0x7f95080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.432+0000 7f9524ff9700 1 -- 172.21.15.84:0/2533556208 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9518084ef0 con 0x7f95280b49e0 2023-10-06T02:55:31.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.432+0000 7f952cf07700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9508066f30 0x7f95080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.433+0000 7f952cf07700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9508066f30 0x7f95080693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f952000bbe0 tx=0x7f9520008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.434+0000 7f9538463b80 1 Processor -- start 2023-10-06T02:55:31.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.434+0000 7f9538463b80 1 -- start start 2023-10-06T02:55:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9538463b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1be840 0x55e40c1bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9538463b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c20e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9538463b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c20f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9538463b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40c115a70 con 0x55e40c1bfcc0 2023-10-06T02:55:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9538463b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40c113270 con 0x55e40c20ec00 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9538463b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40c10f060 con 0x55e40c1be840 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9527fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c20e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9527fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c20e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40272/0 (socket says 172.21.15.84:40272) 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9527fff700 1 -- 172.21.15.84:0/675282612 learned_addr learned my addr 172.21.15.84:0/675282612 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f952d708700 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c20f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f952cf07700 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1be840 0x55e40c1bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9527fff700 1 -- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1be840 msgr2=0x55e40c1bec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9527fff700 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1be840 0x55e40c1bec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9527fff700 1 -- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 msgr2=0x55e40c20f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9527fff700 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c20f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9527fff700 1 -- 172.21.15.84:0/675282612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e40bfa9270 con 0x55e40c1bfcc0 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f952cf07700 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1be840 0x55e40c1bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f952d708700 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c20f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f9527fff700 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c20e6c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9518051f80 tx=0x7f9518082f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704a29196879a94c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f951dffb700 1 -- 172.21.15.84:0/675282612 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518053e20 con 0x55e40c1bfcc0 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f951dffb700 1 -- 172.21.15.84:0/675282612 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518070020 con 0x55e40c1bfcc0 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.435+0000 7f951dffb700 1 -- 172.21.15.84:0/675282612 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518055ce0 con 0x55e40c1bfcc0 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.436+0000 7f9538463b80 1 -- 172.21.15.84:0/675282612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 msgr2=0x55e40c20e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.436+0000 7f9538463b80 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c20e6c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9518051f80 tx=0x7f9518082f20 comp rx=0 tx=0).stop 2023-10-06T02:55:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.436+0000 7f9538463b80 1 -- 172.21.15.84:0/675282612 shutdown_connections 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.436+0000 7f9538463b80 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c20f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.436+0000 7f9538463b80 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1be840 0x55e40c1bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.436+0000 7f9538463b80 1 --2- 172.21.15.84:0/675282612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c20e6c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.436+0000 7f9538463b80 1 -- 172.21.15.84:0/675282612 >> 172.21.15.84:0/675282612 conn(0x55e40c1c0160 msgr2=0x55e40c1c0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.436+0000 7f9538463b80 1 -- 172.21.15.84:0/675282612 shutdown_connections 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.436+0000 7f9538463b80 1 -- 172.21.15.84:0/675282612 wait complete. 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.437+0000 7f9538463b80 1 -- start start 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.437+0000 7f9538463b80 1 Processor -- start 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c1e7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1bfcc0 0x55e40c1eace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c1fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40c0ba890 con 0x55e40c1be840 2023-10-06T02:55:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40c0d5ea0 con 0x55e40c20ec00 2023-10-06T02:55:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40bf91e30 con 0x55e40c1bfcc0 2023-10-06T02:55:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 10 client.0 _ll_register_callbacks cb 0x55e40c181e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:55:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952cf07700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c1e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952cf07700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c1e7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40278/0 (socket says 172.21.15.84:40278) 2023-10-06T02:55:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952cf07700 1 -- 172.21.15.84:0/4021825882 learned_addr learned my addr 172.21.15.84:0/4021825882 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9527fff700 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1bfcc0 0x55e40c1eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952d708700 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c1fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952cf07700 1 -- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1bfcc0 msgr2=0x55e40c1eace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952cf07700 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1bfcc0 0x55e40c1eace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952cf07700 1 -- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 msgr2=0x55e40c1fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952cf07700 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c1fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952cf07700 1 -- 172.21.15.84:0/4021825882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9528155aa0 con 0x55e40c1be840 2023-10-06T02:55:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952d708700 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c1fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f952cf07700 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c1e7810 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9520014810 tx=0x7f9520018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cfe84ec9fa4a3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:55:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9506ffd700 1 -- 172.21.15.84:0/4021825882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200157a0 con 0x55e40c1be840 2023-10-06T02:55:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9506ffd700 1 -- 172.21.15.84:0/4021825882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9520015900 con 0x55e40c1be840 2023-10-06T02:55:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 1 -- 172.21.15.84:0/4021825882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e40c1b3940 con 0x55e40c1be840 2023-10-06T02:55:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9506ffd700 1 -- 172.21.15.84:0/4021825882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9520015d60 con 0x55e40c1be840 2023-10-06T02:55:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 10 client.4797 fetch_fsmap learned FSMap version 9 2023-10-06T02:55:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.438+0000 7f9538463b80 1 -- 172.21.15.84:0/4021825882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e40bf4bfe0 con 0x55e40c1be840 2023-10-06T02:55:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9506ffd700 1 -- 172.21.15.84:0/4021825882 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e40c1b3940 con 0x55e40c1be840 2023-10-06T02:55:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9506ffd700 1 -- 172.21.15.84:0/4021825882 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f9520029350 con 0x55e40c1be840 2023-10-06T02:55:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9538463b80 10 client.4797 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T02:55:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9538463b80 10 client.4797 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:55:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9538463b80 20 client.4797 populate_metadata read hostname 'smithi084' 2023-10-06T02:55:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9538463b80 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x55e40c206e70 0x55e40c207240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9538463b80 4 client.4797 mds_command: new command op to 4308 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:55:31.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9538463b80 1 -- 172.21.15.84:0/4021825882 --> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e40c190870 con 0x55e40c206e70 2023-10-06T02:55:31.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9527fff700 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x55e40c206e70 0x55e40c207240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9506ffd700 10 client.4797 ms_handle_connect on v2:172.21.15.131:6833/4173990514 2023-10-06T02:55:31.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.439+0000 7f9527fff700 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x55e40c206e70 0x55e40c207240 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa5869329b6754ac server_cookie=48861d3997bc7f0 in_seq=0 out_seq=0 2023-10-06T02:55:31.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9506ffd700 1 -- 172.21.15.84:0/4021825882 <== mds.0 v2:172.21.15.131:6833/4173990514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e40c190870 con 0x55e40c206e70 2023-10-06T02:55:31.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9506ffd700 10 client.4797 handle_command_reply: tid=0 2023-10-06T02:55:31.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 client.4797 shutdown 2023-10-06T02:55:31.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 -- 172.21.15.84:0/4021825882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 msgr2=0x55e40c1e7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c1e7810 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9520014810 tx=0x7f9520018040 comp rx=0 tx=0).stop 2023-10-06T02:55:31.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 -- 172.21.15.84:0/4021825882 shutdown_connections 2023-10-06T02:55:31.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x55e40c206e70 0x55e40c207240 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c20ec00 0x55e40c1fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c1e7810 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 --2- 172.21.15.84:0/4021825882 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c1bfcc0 0x55e40c1eace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9506ffd700 0 client.4797 ms_handle_reset on v2:172.21.15.131:6833/4173990514 2023-10-06T02:55:31.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 -- 172.21.15.84:0/4021825882 >> 172.21.15.84:0/4021825882 conn(0x55e40c1c0160 msgr2=0x55e40c202570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:31.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 -- 172.21.15.84:0/4021825882 shutdown_connections 2023-10-06T02:55:31.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.440+0000 7f9538463b80 1 -- 172.21.15.84:0/4021825882 wait complete. 2023-10-06T02:55:31.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.441+0000 7f9538463b80 20 client.4797 trim_cache size 0 max 16384 2023-10-06T02:55:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.457+0000 7f9538463b80 1 Processor -- start 2023-10-06T02:55:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.457+0000 7f9538463b80 1 -- start start 2023-10-06T02:55:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f9538463b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c203010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f9538463b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c1bfcc0 0x55e40c1b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f9538463b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c20ec00 0x55e40c1b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f9538463b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40c197280 con 0x55e40c1be840 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f9538463b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40c1b9370 con 0x55e40c1bfcc0 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f9538463b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40c204160 con 0x55e40c20ec00 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f952cf07700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c203010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f952cf07700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c203010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40286/0 (socket says 172.21.15.84:40286) 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f952cf07700 1 -- 172.21.15.84:0/2344400241 learned_addr learned my addr 172.21.15.84:0/2344400241 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f952cf07700 1 -- 172.21.15.84:0/2344400241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c20ec00 msgr2=0x55e40c1b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f952cf07700 1 --2- 172.21.15.84:0/2344400241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c20ec00 0x55e40c1b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f952cf07700 1 -- 172.21.15.84:0/2344400241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c1bfcc0 msgr2=0x55e40c1b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f952cf07700 1 --2- 172.21.15.84:0/2344400241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c1bfcc0 0x55e40c1b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f952cf07700 1 -- 172.21.15.84:0/2344400241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e40c0dd780 con 0x55e40c1be840 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.458+0000 7f952cf07700 1 --2- 172.21.15.84:0/2344400241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c203010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9520007fd0 tx=0x7f9520021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4214ec25d1b00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f951e7fc700 1 -- 172.21.15.84:0/2344400241 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520015410 con 0x55e40c1be840 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f951e7fc700 1 -- 172.21.15.84:0/2344400241 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520038030 con 0x55e40c1be840 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f951e7fc700 1 -- 172.21.15.84:0/2344400241 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520029b40 con 0x55e40c1be840 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f9538463b80 1 -- 172.21.15.84:0/2344400241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 msgr2=0x55e40c203010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f9538463b80 1 --2- 172.21.15.84:0/2344400241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c203010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9520007fd0 tx=0x7f9520021000 comp rx=0 tx=0).stop 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f9538463b80 1 -- 172.21.15.84:0/2344400241 shutdown_connections 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f9538463b80 1 --2- 172.21.15.84:0/2344400241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c20ec00 0x55e40c1b9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f9538463b80 1 --2- 172.21.15.84:0/2344400241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1be840 0x55e40c203010 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f9538463b80 1 --2- 172.21.15.84:0/2344400241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c1bfcc0 0x55e40c1b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f9538463b80 1 -- 172.21.15.84:0/2344400241 >> 172.21.15.84:0/2344400241 conn(0x55e40c1c0160 msgr2=0x55e40c1b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f9538463b80 1 -- 172.21.15.84:0/2344400241 shutdown_connections 2023-10-06T02:55:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.459+0000 7f9538463b80 1 -- 172.21.15.84:0/2344400241 wait complete. 2023-10-06T02:55:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.460+0000 7f9538463b80 1 -- start start 2023-10-06T02:55:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.460+0000 7f9538463b80 1 Processor -- start 2023-10-06T02:55:31.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c1be840 0x55e40c208f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c1bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c20ec00 0x55e40c1e6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40c1e8960 con 0x55e40c1bfcc0 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e40c1e8c40 con 0x55e40c1be840 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e40c1e8f20 con 0x55e40c20ec00 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 10 client.0 _ll_register_callbacks cb 0x55e40c181e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9527fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c1bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9527fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c1bbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40292/0 (socket says 172.21.15.84:40292) 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9527fff700 1 -- 172.21.15.84:0/2455132174 learned_addr learned my addr 172.21.15.84:0/2455132174 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f952cf07700 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c1be840 0x55e40c208f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f952d708700 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c20ec00 0x55e40c1e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9527fff700 1 -- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c20ec00 msgr2=0x55e40c1e6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9527fff700 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c20ec00 0x55e40c1e6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9527fff700 1 -- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c1be840 msgr2=0x55e40c208f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9527fff700 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c1be840 0x55e40c208f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9527fff700 1 -- 172.21.15.84:0/2455132174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e40bf4bfe0 con 0x55e40c1bfcc0 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9527fff700 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c1bbd90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9518051f80 tx=0x7f9518062250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e93ef2fca5e4b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9506ffd700 1 -- 172.21.15.84:0/2455132174 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518082040 con 0x55e40c1bfcc0 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9506ffd700 1 -- 172.21.15.84:0/2455132174 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9518071070 con 0x55e40c1bfcc0 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 1 -- 172.21.15.84:0/2455132174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9518070020 con 0x55e40c1bfcc0 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9506ffd700 1 -- 172.21.15.84:0/2455132174 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95180157d0 con 0x55e40c1bfcc0 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 10 client.4803 fetch_fsmap learned FSMap version 9 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9538463b80 1 -- 172.21.15.84:0/2455132174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e40c0c4470 con 0x55e40c1bfcc0 2023-10-06T02:55:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.461+0000 7f9506ffd700 1 -- 172.21.15.84:0/2455132174 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518070020 con 0x55e40c1bfcc0 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9506ffd700 1 -- 172.21.15.84:0/2455132174 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f9518054f70 con 0x55e40c1bfcc0 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9538463b80 10 client.4803 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9538463b80 10 client.4803 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9538463b80 20 client.4803 populate_metadata read hostname 'smithi084' 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9538463b80 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x55e40c1babc0 0x55e40c1baf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9538463b80 4 client.4803 mds_command: new command op to 4308 tid=0[{"prefix": "status"}] 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9538463b80 1 -- 172.21.15.84:0/2455132174 --> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e40c0b1e00 con 0x55e40c1babc0 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f952cf07700 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x55e40c1babc0 0x55e40c1baf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9506ffd700 10 client.4803 ms_handle_connect on v2:172.21.15.131:6833/4173990514 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f952cf07700 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x55e40c1babc0 0x55e40c1baf90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18c062df9a354e25 server_cookie=eb4e272682a3c821 in_seq=0 out_seq=0 2023-10-06T02:55:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9506ffd700 1 -- 172.21.15.84:0/2455132174 <== mds.0 v2:172.21.15.131:6833/4173990514 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e40c0b1e00 con 0x55e40c1babc0 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9506ffd700 10 client.4803 handle_command_reply: tid=0 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.462+0000 7f9538463b80 1 client.4803 shutdown 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 -- 172.21.15.84:0/2455132174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 msgr2=0x55e40c1bbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c1bbd90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9518051f80 tx=0x7f9518062250 comp rx=0 tx=0).stop 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 -- 172.21.15.84:0/2455132174 shutdown_connections 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:6833/4173990514,v1:172.21.15.131:6835/4173990514] conn(0x55e40c1babc0 0x55e40c1baf90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e40c1be840 0x55e40c208f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e40c20ec00 0x55e40c1e6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9506ffd700 0 client.4803 ms_handle_reset on v2:172.21.15.131:6833/4173990514 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 --2- 172.21.15.84:0/2455132174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e40c1bfcc0 0x55e40c1bbd90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 -- 172.21.15.84:0/2455132174 >> 172.21.15.84:0/2455132174 conn(0x55e40c1c0160 msgr2=0x55e40c202e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 -- 172.21.15.84:0/2455132174 shutdown_connections 2023-10-06T02:55:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 1 -- 172.21.15.84:0/2455132174 wait complete. 2023-10-06T02:55:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f9538463b80 20 client.4803 trim_cache size 0 max 16384 2023-10-06T02:55:31.472 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:55:31.472 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:55:31.472 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T02:55:31.472 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4308, 2023-10-06T02:55:31.472 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:55:31.472 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:55:31.472 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:55:31.473 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 24.240470314, 2023-10-06T02:55:31.473 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 9, 2023-10-06T02:55:31.473 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 27, 2023-10-06T02:55:31.473 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 27, 2023-10-06T02:55:31.473 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 29.241623703999998 2023-10-06T02:55:31.473 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:55:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 -- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9508066f30 msgr2=0x7f95080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9508066f30 0x7f95080693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f952000bbe0 tx=0x7f9520008040 comp rx=0 tx=0).stop 2023-10-06T02:55:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 -- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b49e0 msgr2=0x7f952814fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b49e0 0x7f952814fa60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f951800d1d0 tx=0x7f9518009a90 comp rx=0 tx=0).stop 2023-10-06T02:55:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 -- 172.21.15.84:0/2533556208 shutdown_connections 2023-10-06T02:55:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9508066f30 0x7f95080693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95281595a0 0x7f9528157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95280b07a0 0x7f9528154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 --2- 172.21.15.84:0/2533556208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95280b49e0 0x7f952814fa60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 -- 172.21.15.84:0/2533556208 >> 172.21.15.84:0/2533556208 conn(0x7f9528099830 msgr2=0x7f95280b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 -- 172.21.15.84:0/2533556208 shutdown_connections 2023-10-06T02:55:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:31.463+0000 7f952f16b700 1 -- 172.21.15.84:0/2533556208 wait complete. 2023-10-06T02:55:31.477 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T02:55:31.489 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T02:55:31.489 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T02:55:31.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.489 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T02:55:31.504 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T02:55:31.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T02:55:31.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-10-06T02:55:31.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.671 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T02:55:31.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.686 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-10-06T02:55:31.754 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2023-10-06T02:55:31.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:55:31.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.756 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T02:55:31.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2023-10-06T02:55:31.845 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2023-10-06T02:55:31.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:55:31.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.847 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T02:55:31.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:31.905 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2023-10-06T02:55:31.973 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2023-10-06T02:55:31.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:55:31.974 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-06T02:55:31.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:55:32.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.088+0000 7f2909171700 1 Processor -- start 2023-10-06T02:55:32.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.088+0000 7f2909171700 1 -- start start 2023-10-06T02:55:32.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.088+0000 7f2909171700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29040adf60 0x7f29040ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.088+0000 7f2909171700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 0x7f290406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.088+0000 7f2909171700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29040c7370 con 0x7f290406e280 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.088+0000 7f2909171700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2904156150 con 0x7f29040adf60 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.088+0000 7f2909171700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29040ac580 con 0x7f2904069c70 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2902d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29040adf60 0x7f29040ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2902d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29040adf60 0x7f29040ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40296/0 (socket says 172.21.15.84:40296) 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2902d9d700 1 -- 172.21.15.84:0/3778927179 learned_addr learned my addr 172.21.15.84:0/3778927179 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f290359e700 1 --2- 172.21.15.84:0/3778927179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 0x7f290406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2902d9d700 1 -- 172.21.15.84:0/3778927179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 msgr2=0x7f290406e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2902d9d700 1 --2- 172.21.15.84:0/3778927179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 0x7f290406e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2902d9d700 1 -- 172.21.15.84:0/3778927179 >> v1:172.21.15.131:6789/0 conn(0x7f290406e280 legacy=0x7f2904069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2902d9d700 1 -- 172.21.15.84:0/3778927179 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29040c6760 con 0x7f29040adf60 2023-10-06T02:55:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2902d9d700 1 --2- 172.21.15.84:0/3778927179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29040adf60 0x7f29040ac040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d1a0 tx=0x7f28fc00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a6064ca13ab656 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2901d9b700 1 -- 172.21.15.84:0/3778927179 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc010070 con 0x7f29040adf60 2023-10-06T02:55:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2901d9b700 1 -- 172.21.15.84:0/3778927179 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc00dc70 con 0x7f29040adf60 2023-10-06T02:55:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.089+0000 7f2901d9b700 1 -- 172.21.15.84:0/3778927179 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc016440 con 0x7f29040adf60 2023-10-06T02:55:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.090+0000 7f2909171700 1 -- 172.21.15.84:0/3778927179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29040adf60 msgr2=0x7f29040ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.090+0000 7f2909171700 1 --2- 172.21.15.84:0/3778927179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29040adf60 0x7f29040ac040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d1a0 tx=0x7f28fc00ba50 comp rx=0 tx=0).stop 2023-10-06T02:55:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.090+0000 7f2909171700 1 -- 172.21.15.84:0/3778927179 shutdown_connections 2023-10-06T02:55:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.090+0000 7f2909171700 1 --2- 172.21.15.84:0/3778927179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 0x7f290406e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.090+0000 7f2909171700 1 --2- 172.21.15.84:0/3778927179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29040adf60 0x7f29040ac040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.090+0000 7f2909171700 1 -- 172.21.15.84:0/3778927179 >> 172.21.15.84:0/3778927179 conn(0x7f29040680c0 msgr2=0x7f29040cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.090+0000 7f2909171700 1 -- 172.21.15.84:0/3778927179 shutdown_connections 2023-10-06T02:55:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.090+0000 7f2909171700 1 -- 172.21.15.84:0/3778927179 wait complete. 2023-10-06T02:55:32.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.091+0000 7f2909171700 1 Processor -- start 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.091+0000 7f2909171700 1 -- start start 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f2909171700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 0x7f2904169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f2909171700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f290406e280 0x7f29040c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f2909171700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29040adf60 0x7f29040c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f2909171700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29040c2e20 con 0x7f290406e280 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f2909171700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29040c43d0 con 0x7f29040adf60 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f2909171700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29040c4860 con 0x7f2904069c70 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f290259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f290406e280 0x7f29040c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f2902d9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 0x7f2904169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f290259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f290406e280 0x7f29040c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40312/0 (socket says 172.21.15.84:40312) 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f290359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29040adf60 0x7f29040c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f290259c700 1 -- 172.21.15.84:0/656664358 learned_addr learned my addr 172.21.15.84:0/656664358 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f290259c700 1 -- 172.21.15.84:0/656664358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 msgr2=0x7f2904169cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f290259c700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 0x7f2904169cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f290259c700 1 -- 172.21.15.84:0/656664358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29040adf60 msgr2=0x7f29040c28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f290259c700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29040adf60 0x7f29040c28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.092+0000 7f290259c700 1 -- 172.21.15.84:0/656664358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc00bcf0 con 0x7f290406e280 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.093+0000 7f290259c700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f290406e280 0x7f29040c3130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c5d0 tx=0x7f28f8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.093+0000 7f28eaffd700 1 -- 172.21.15.84:0/656664358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8011590 con 0x7f290406e280 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.093+0000 7f28eaffd700 1 -- 172.21.15.84:0/656664358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8011710 con 0x7f290406e280 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.093+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29040c37c0 con 0x7f290406e280 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.093+0000 7f28eaffd700 1 -- 172.21.15.84:0/656664358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8011ad0 con 0x7f290406e280 2023-10-06T02:55:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.093+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29040c3d80 con 0x7f290406e280 2023-10-06T02:55:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.094+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290406bee0 con 0x7f290406e280 2023-10-06T02:55:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.094+0000 7f28eaffd700 1 -- 172.21.15.84:0/656664358 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28f801c460 con 0x7f290406e280 2023-10-06T02:55:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.094+0000 7f28eaffd700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f28f0066f30 0x7f28f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.095+0000 7f28eaffd700 1 -- 172.21.15.84:0/656664358 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f28f80845d0 con 0x7f290406e280 2023-10-06T02:55:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.095+0000 7f2902d9d700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f28f0066f30 0x7f28f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.095+0000 7f2902d9d700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f28f0066f30 0x7f28f00693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d1a0 tx=0x7f28fc01b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:32.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.099+0000 7f28eaffd700 1 -- 172.21.15.84:0/656664358 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28f80513f0 con 0x7f290406e280 2023-10-06T02:55:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.326+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2904064ad0 con 0x7f290406e280 2023-10-06T02:55:32.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.326+0000 7f28eaffd700 1 -- 172.21.15.84:0/656664358 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f28f8054a10 con 0x7f290406e280 2023-10-06T02:55:32.328 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:55:32.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.328+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f28f0066f30 msgr2=0x7f28f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.328+0000 7f2909171700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f28f0066f30 0x7f28f00693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d1a0 tx=0x7f28fc01b000 comp rx=0 tx=0).stop 2023-10-06T02:55:32.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.328+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f290406e280 msgr2=0x7f29040c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:32.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.328+0000 7f2909171700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f290406e280 0x7f29040c3130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c5d0 tx=0x7f28f8007f60 comp rx=0 tx=0).stop 2023-10-06T02:55:32.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.328+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 shutdown_connections 2023-10-06T02:55:32.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.328+0000 7f2909171700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f28f0066f30 0x7f28f00693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.329+0000 7f2909171700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29040adf60 0x7f29040c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.329+0000 7f2909171700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2904069c70 0x7f2904169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.329+0000 7f2909171700 1 --2- 172.21.15.84:0/656664358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f290406e280 0x7f29040c3130 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:32.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.329+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 >> 172.21.15.84:0/656664358 conn(0x7f29040680c0 msgr2=0x7f29040ac6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:32.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.329+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 shutdown_connections 2023-10-06T02:55:32.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:32.329+0000 7f2909171700 1 -- 172.21.15.84:0/656664358 wait complete. 2023-10-06T02:55:32.342 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:55:32.342 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:55:32.342 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T02:55:32.342 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:55:32.342 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:55:32.342 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:55:32.342 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:55:32.343 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:55:32.343 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:55:32.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.343 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T02:55:32.358 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:32.358 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:32.358 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:32.359 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:32.359 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:32.359 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:32.359 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:32.359 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:32.359 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T02:55:32.359 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:32.359 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:32.359 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T02:55:32.360 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:32.360 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:32.360 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:55:32.360 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:32.360 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:55:32.360 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42477sec preferred_lft 42477sec 2023-10-06T02:55:32.360 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-10-06T02:55:32.360 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:32.360 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:55:32.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.361 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:32.361 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:32.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:55:32.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-10-06T02:55:32.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-10-06T02:55:32.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:55:32.361 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:32.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.469 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:55:32.493 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T02:55:32.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.494 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T02:55:32.550 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T02:55:32.551 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:55:32.551 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:55:32.551 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:55:32.551 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:55:32.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.551 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:32.551 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:32.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:55:32.552 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:55:32.552 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:55:32.552 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:32.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.650 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T02:55:32.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.665 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-10-06T02:55:32.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.720 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:32.720 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:32.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:55:32.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T02:55:32.720 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:32.808 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T02:55:32.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.809 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:32.809 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:32.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T02:55:32.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:55:32.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T02:55:32.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T02:55:32.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T02:55:32.809 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:32.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:32.989 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:32.989 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:32.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T02:55:32.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:55:32.989 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:33.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:33.081 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:55:33.095 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:55:33.096 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:33.096 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:55:33.150 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T02:55:33.150 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:55:33.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:55:33.230 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:55:33.230 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:55:33.230 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:55:33.320 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:55:33.321 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:55:33.321 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:55:33.321 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:55:33.321 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:33.343 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:55:33.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:55:33.343 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:55:33.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:55:33.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:33.343 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T02:55:33.344 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T02:55:33.344 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T02:55:33.345 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:55:33.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:33.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:55:33.410 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-06T02:55:33.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:55:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.561+0000 7f0a6b288700 1 Processor -- start 2023-10-06T02:55:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.561+0000 7f0a6b288700 1 -- start start 2023-10-06T02:55:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a6b288700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 0x7f0a640c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a6b288700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a64156420 0x7f0a640b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a6b288700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a640b1160 0x7f0a640b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a6b288700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a640b1b20 con 0x7f0a64156420 2023-10-06T02:55:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a6b288700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6415ad90 con 0x7f0a640b1160 2023-10-06T02:55:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a6b288700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640b0d30 con 0x7f0a64156050 2023-10-06T02:55:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a69a85700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a64156420 0x7f0a640b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a69a85700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a64156420 0x7f0a640b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54336/0 (socket says 172.21.15.84:54336) 2023-10-06T02:55:33.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a69a85700 1 -- 172.21.15.84:0/872092560 learned_addr learned my addr 172.21.15.84:0/872092560 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:33.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a6a286700 1 --2- 172.21.15.84:0/872092560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 0x7f0a640c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.562+0000 7f0a6aa87700 1 --2- 172.21.15.84:0/872092560 >> v2:172.21.15.131:3300/0 conn(0x7f0a640b1160 0x7f0a640b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a69a85700 1 -- 172.21.15.84:0/872092560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 msgr2=0x7f0a640c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:33.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a69a85700 1 --2- 172.21.15.84:0/872092560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 0x7f0a640c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a69a85700 1 -- 172.21.15.84:0/872092560 >> v2:172.21.15.131:3300/0 conn(0x7f0a640b1160 msgr2=0x7f0a640b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:33.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a69a85700 1 --2- 172.21.15.84:0/872092560 >> v2:172.21.15.131:3300/0 conn(0x7f0a640b1160 0x7f0a640b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a69a85700 1 -- 172.21.15.84:0/872092560 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64159ea0 con 0x7f0a64156420 2023-10-06T02:55:33.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a69a85700 1 --2- 172.21.15.84:0/872092560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 0x7f0a640b07f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0a640af8f0 tx=0x7f0a5400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95910f3bf6bc804e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a69284700 1 -- 172.21.15.84:0/872092560 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400dc50 con 0x7f0a64156420 2023-10-06T02:55:33.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a69284700 1 -- 172.21.15.84:0/872092560 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5400ddb0 con 0x7f0a64156420 2023-10-06T02:55:33.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a69284700 1 -- 172.21.15.84:0/872092560 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a540196d0 con 0x7f0a64156420 2023-10-06T02:55:33.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a6b288700 1 -- 172.21.15.84:0/872092560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 msgr2=0x7f0a640b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a6b288700 1 --2- 172.21.15.84:0/872092560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 0x7f0a640b07f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0a640af8f0 tx=0x7f0a5400b4f0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a6b288700 1 -- 172.21.15.84:0/872092560 shutdown_connections 2023-10-06T02:55:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a6b288700 1 --2- 172.21.15.84:0/872092560 >> v2:172.21.15.131:3300/0 conn(0x7f0a640b1160 0x7f0a640b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a6b288700 1 --2- 172.21.15.84:0/872092560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 0x7f0a640c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a6b288700 1 --2- 172.21.15.84:0/872092560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 0x7f0a640b07f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a6b288700 1 -- 172.21.15.84:0/872092560 >> 172.21.15.84:0/872092560 conn(0x7f0a640691d0 msgr2=0x7f0a640aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a6b288700 1 -- 172.21.15.84:0/872092560 shutdown_connections 2023-10-06T02:55:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.563+0000 7f0a6b288700 1 -- 172.21.15.84:0/872092560 wait complete. 2023-10-06T02:55:33.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.564+0000 7f0a6b288700 1 Processor -- start 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.564+0000 7f0a6b288700 1 -- start start 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6b288700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a640b1160 0x7f0a64147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6b288700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 0x7f0a641660c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6b288700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 0x7f0a6413bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6b288700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6414d410 con 0x7f0a64156420 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6b288700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6414d900 con 0x7f0a640b1160 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6b288700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a641509e0 con 0x7f0a64156050 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6aa87700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 0x7f0a6413bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6aa87700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 0x7f0a6413bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54344/0 (socket says 172.21.15.84:54344) 2023-10-06T02:55:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6aa87700 1 -- 172.21.15.84:0/3207168249 learned_addr learned my addr 172.21.15.84:0/3207168249 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:33.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a6a286700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a640b1160 0x7f0a64147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.565+0000 7f0a69a85700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 0x7f0a641660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a6aa87700 1 -- 172.21.15.84:0/3207168249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 msgr2=0x7f0a641660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a6aa87700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 0x7f0a641660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a6aa87700 1 -- 172.21.15.84:0/3207168249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a640b1160 msgr2=0x7f0a64147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a6aa87700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a640b1160 0x7f0a64147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a6aa87700 1 -- 172.21.15.84:0/3207168249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5400b790 con 0x7f0a64156420 2023-10-06T02:55:33.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a6aa87700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 0x7f0a6413bbf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00d890 tx=0x7f0a5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a5a7fc700 1 -- 172.21.15.84:0/3207168249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0125f0 con 0x7f0a64156420 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a5a7fc700 1 -- 172.21.15.84:0/3207168249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c012770 con 0x7f0a64156420 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6414fcd0 con 0x7f0a64156420 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a5a7fc700 1 -- 172.21.15.84:0/3207168249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c012b30 con 0x7f0a64156420 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.566+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6414d6d0 con 0x7f0a64156420 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.567+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a64150b70 con 0x7f0a64156420 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.567+0000 7f0a5a7fc700 1 -- 172.21.15.84:0/3207168249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a5c013480 con 0x7f0a64156420 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.568+0000 7f0a5a7fc700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a48066f30 0x7f0a480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.568+0000 7f0a5a7fc700 1 -- 172.21.15.84:0/3207168249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0a5c084c80 con 0x7f0a64156420 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.568+0000 7f0a6a286700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a48066f30 0x7f0a480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:33.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.568+0000 7f0a6a286700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a48066f30 0x7f0a480693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a60007640 tx=0x7f0a60009850 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:33.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.572+0000 7f0a5a7fc700 1 -- 172.21.15.84:0/3207168249 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a5c051aa0 con 0x7f0a64156420 2023-10-06T02:55:33.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.795+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0a6405f270 con 0x7f0a64156420 2023-10-06T02:55:33.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.795+0000 7f0a5a7fc700 1 -- 172.21.15.84:0/3207168249 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0a5c084070 con 0x7f0a64156420 2023-10-06T02:55:33.797 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.797+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a48066f30 msgr2=0x7f0a480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.797+0000 7f0a6b288700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a48066f30 0x7f0a480693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a60007640 tx=0x7f0a60009850 comp rx=0 tx=0).stop 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.797+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 msgr2=0x7f0a6413bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.797+0000 7f0a6b288700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 0x7f0a6413bbf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00d890 tx=0x7f0a5c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.798+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 shutdown_connections 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.798+0000 7f0a6b288700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a48066f30 0x7f0a480693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.798+0000 7f0a6b288700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a640b1160 0x7f0a64147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.798+0000 7f0a6b288700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a64156420 0x7f0a6413bbf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.798+0000 7f0a6b288700 1 --2- 172.21.15.84:0/3207168249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a64156050 0x7f0a641660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.798+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 >> 172.21.15.84:0/3207168249 conn(0x7f0a640691d0 msgr2=0x7f0a640cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:33.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.798+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 shutdown_connections 2023-10-06T02:55:33.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:33.798+0000 7f0a6b288700 1 -- 172.21.15.84:0/3207168249 wait complete. 2023-10-06T02:55:33.811 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:55:33.811 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:55:33.811 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T02:55:33.812 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T02:55:33.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T02:55:33.812 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:55:33.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:55:33.812 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:55:33.812 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T02:55:33.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:33.813 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T02:55:33.833 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:33.834 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T02:55:33.834 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42475sec preferred_lft 42475sec 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:55:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c4d3:64ff:fe4d:ee22/64 scope link tentative 2023-10-06T02:55:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:33.836 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:55:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:55:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::41f:f5ff:fe77:615a/64 scope link tentative 2023-10-06T02:55:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:33.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:33.837 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:55:33.896 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T02:55:33.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:33.898 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T02:55:33.954 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T02:55:33.954 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:55:33.954 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:55:33.954 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:55:33.954 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:55:33.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:33.955 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:33.955 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:33.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:55:33.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:55:33.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:55:33.955 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:34.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:34.055 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T02:55:34.069 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:55:34.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:34.070 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-10-06T02:55:34.124 INFO:teuthology.orchestra.run.smithi084.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T02:55:34.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:34.125 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:34.125 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:34.125 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:55:34.125 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T02:55:34.125 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:34.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:34.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T02:55:34.248 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:34.248 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:34.248 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:34.248 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:34.248 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:34.249 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:34.249 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:55:34.249 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:83:ec:f0:8e:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:55:34.249 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:55:34.249 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:34.249 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3c83:ecff:fef0:8e07/64 scope link 2023-10-06T02:55:34.249 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:34.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:34.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T02:55:34.330 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:34.330 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:83:ec:f0:8e:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3c83:ecff:fef0:8e07/64 scope link 2023-10-06T02:55:34.331 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:34.346 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T02:55:34.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:34.347 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:34.347 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:34.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T02:55:34.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T02:55:34.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T02:55:34.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T02:55:34.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T02:55:34.347 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:34.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:34.551 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:55:34.551 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:55:34.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.1 up 2023-10-06T02:55:34.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T02:55:34.551 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:55:34.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:34.631 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T02:55:34.645 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T02:55:34.645 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:34.646 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T02:55:34.699 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T02:55:34.699 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:55:34.700 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T02:55:34.778 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T02:55:34.779 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T02:55:34.779 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:55:34.787 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T02:55:34.787 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T02:55:34.787 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:55:34.787 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:55:34.787 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:34.808 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T02:55:34.808 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T02:55:34.809 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:55:34.809 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:55:34.809 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:34.809 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T02:55:34.809 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T02:55:34.809 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T02:55:34.811 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:55:34.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:34.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T02:55:34.875 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-06T02:55:34.875 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:55:35.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.028+0000 7f3cec918700 1 Processor -- start 2023-10-06T02:55:35.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.028+0000 7f3cec918700 1 -- start start 2023-10-06T02:55:35.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.028+0000 7f3cec918700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3ce81595a0 0x7f3ce80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.028+0000 7f3cec918700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ce80b07a0 0x7f3ce80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3cec918700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce80b0ca0 con 0x7f3ce80b49e0 2023-10-06T02:55:35.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3cec918700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce80b0f80 con 0x7f3ce80b07a0 2023-10-06T02:55:35.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3cec918700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce80b1260 con 0x7f3ce81595a0 2023-10-06T02:55:35.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ce80b07a0 0x7f3ce80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce5d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3ce80b49e0 0x7f3ce80aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47272/0 (socket says 172.21.15.84:47272) 2023-10-06T02:55:35.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce5d9b700 1 -- 172.21.15.84:0/2172704481 learned_addr learned my addr 172.21.15.84:0/2172704481 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:35.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce659c700 1 --2- 172.21.15.84:0/2172704481 >> v2:172.21.15.131:3300/0 conn(0x7f3ce81595a0 0x7f3ce80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce6d9d700 1 -- 172.21.15.84:0/2172704481 >> v2:172.21.15.131:3300/0 conn(0x7f3ce81595a0 msgr2=0x7f3ce80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:35.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce6d9d700 1 --2- 172.21.15.84:0/2172704481 >> v2:172.21.15.131:3300/0 conn(0x7f3ce81595a0 0x7f3ce80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce6d9d700 1 -- 172.21.15.84:0/2172704481 >> v1:172.21.15.84:6789/0 conn(0x7f3ce80b49e0 legacy=0x7f3ce80aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce559a700 1 -- 172.21.15.84:0/2172704481 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230972247 0 0) 0x7f3ce80b0ca0 con 0x7f3ce80b49e0 2023-10-06T02:55:35.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce6d9d700 1 -- 172.21.15.84:0/2172704481 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80b1540 con 0x7f3ce80b07a0 2023-10-06T02:55:35.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce6d9d700 1 --2- 172.21.15.84:0/2172704481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b07a0 0x7f3ce80b1c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00098e0 tx=0x7f3ce00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1853bb4be10c6293 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:35.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce559a700 1 -- 172.21.15.84:0/2172704481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0009e80 con 0x7f3ce80b07a0 2023-10-06T02:55:35.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce559a700 1 -- 172.21.15.84:0/2172704481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce000b820 con 0x7f3ce80b07a0 2023-10-06T02:55:35.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.029+0000 7f3ce559a700 1 -- 172.21.15.84:0/2172704481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000bba0 con 0x7f3ce80b07a0 2023-10-06T02:55:35.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.030+0000 7f3cec918700 1 -- 172.21.15.84:0/2172704481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b07a0 msgr2=0x7f3ce80b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.030+0000 7f3cec918700 1 --2- 172.21.15.84:0/2172704481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b07a0 0x7f3ce80b1c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00098e0 tx=0x7f3ce00091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.030+0000 7f3cec918700 1 -- 172.21.15.84:0/2172704481 shutdown_connections 2023-10-06T02:55:35.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.030+0000 7f3cec918700 1 --2- 172.21.15.84:0/2172704481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b07a0 0x7f3ce80b1c00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.030+0000 7f3cec918700 1 --2- 172.21.15.84:0/2172704481 >> v2:172.21.15.131:3300/0 conn(0x7f3ce81595a0 0x7f3ce80aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.030+0000 7f3cec918700 1 -- 172.21.15.84:0/2172704481 >> 172.21.15.84:0/2172704481 conn(0x7f3ce8099830 msgr2=0x7f3ce806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:35.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.030+0000 7f3cec918700 1 -- 172.21.15.84:0/2172704481 shutdown_connections 2023-10-06T02:55:35.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.030+0000 7f3cec918700 1 -- 172.21.15.84:0/2172704481 wait complete. 2023-10-06T02:55:35.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.031+0000 7f3cec918700 1 Processor -- start 2023-10-06T02:55:35.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.031+0000 7f3cec918700 1 -- start start 2023-10-06T02:55:35.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cec918700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ce80b07a0 0x7f3ce809a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cec918700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b49e0 0x7f3ce815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cec918700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce81595a0 0x7f3ce809c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cec918700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce809a5d0 con 0x7f3ce80b49e0 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cec918700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce815d180 con 0x7f3ce81595a0 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cec918700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce815a7c0 con 0x7f3ce80b07a0 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b49e0 0x7f3ce815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b49e0 0x7f3ce815cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54368/0 (socket says 172.21.15.84:54368) 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce5d9b700 1 -- 172.21.15.84:0/239144199 learned_addr learned my addr 172.21.15.84:0/239144199 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce6d9d700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce81595a0 0x7f3ce809c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce659c700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ce80b07a0 0x7f3ce809a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce5d9b700 1 -- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ce80b07a0 msgr2=0x7f3ce809a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce5d9b700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ce80b07a0 0x7f3ce809a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce5d9b700 1 -- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce81595a0 msgr2=0x7f3ce809c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce5d9b700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce81595a0 0x7f3ce809c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce5d9b700 1 -- 172.21.15.84:0/239144199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0009420 con 0x7f3ce80b49e0 2023-10-06T02:55:35.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce6d9d700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce81595a0 0x7f3ce809c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:35.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce659c700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ce80b07a0 0x7f3ce809a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:35.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3ce5d9b700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b49e0 0x7f3ce815cc40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c7e0 tx=0x7f3cd0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:35.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cde7fc700 1 -- 172.21.15.84:0/239144199 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0005c00 con 0x7f3ce80b49e0 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cde7fc700 1 -- 172.21.15.84:0/239144199 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd0005d60 con 0x7f3ce80b49e0 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce816a9a0 con 0x7f3ce80b49e0 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cde7fc700 1 -- 172.21.15.84:0/239144199 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00072e0 con 0x7f3ce80b49e0 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.032+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce815a170 con 0x7f3ce80b49e0 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.033+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce8064ad0 con 0x7f3ce80b49e0 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.034+0000 7f3cde7fc700 1 -- 172.21.15.84:0/239144199 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cd001b3b0 con 0x7f3ce80b49e0 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.034+0000 7f3cde7fc700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3cc8066f30 0x7f3cc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.034+0000 7f3cde7fc700 1 -- 172.21.15.84:0/239144199 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3cd0083df0 con 0x7f3ce80b49e0 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.034+0000 7f3ce659c700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3cc8066f30 0x7f3cc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:35.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.035+0000 7f3ce659c700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3cc8066f30 0x7f3cc80693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ce809e190 tx=0x7f3cd80097b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:35.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.038+0000 7f3cde7fc700 1 -- 172.21.15.84:0/239144199 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cd004b5a0 con 0x7f3ce80b49e0 2023-10-06T02:55:35.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.272+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3ce815a900 con 0x7f3ce80b49e0 2023-10-06T02:55:35.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.273+0000 7f3cde7fc700 1 -- 172.21.15.84:0/239144199 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3cd0017070 con 0x7f3ce80b49e0 2023-10-06T02:55:35.275 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:55:35.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3cc8066f30 msgr2=0x7f3cc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3cc8066f30 0x7f3cc80693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ce809e190 tx=0x7f3cd80097b0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b49e0 msgr2=0x7f3ce815cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:35.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b49e0 0x7f3ce815cc40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c7e0 tx=0x7f3cd0007d90 comp rx=0 tx=0).stop 2023-10-06T02:55:35.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 shutdown_connections 2023-10-06T02:55:35.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3cc8066f30 0x7f3cc80693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce81595a0 0x7f3ce809c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ce80b07a0 0x7f3ce809a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 --2- 172.21.15.84:0/239144199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce80b49e0 0x7f3ce815cc40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:35.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 >> 172.21.15.84:0/239144199 conn(0x7f3ce8099830 msgr2=0x7f3ce8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:35.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 shutdown_connections 2023-10-06T02:55:35.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:35.275+0000 7f3cec918700 1 -- 172.21.15.84:0/239144199 wait complete. 2023-10-06T02:55:35.288 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:55:35.288 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:55:35.289 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T02:55:35.289 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T02:55:35.289 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T02:55:35.289 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:55:35.289 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:55:35.289 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:55:35.289 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:55:35.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:35.290 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T02:55:35.308 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:35.308 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:35.308 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:35.308 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:35.308 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:35.308 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:35.308 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:35.308 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:35.308 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42470sec preferred_lft 42470sec 2023-10-06T02:55:35.309 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T02:55:35.310 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:35.310 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T02:55:35.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:35.310 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T02:55:35.310 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T02:55:35.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2023-10-06T02:55:35.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2023-10-06T02:55:35.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2023-10-06T02:55:35.311 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T02:55:35.311 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T02:55:35.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:35.475 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:55:35.514 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T02:55:35.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:35.516 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T02:55:35.585 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T02:55:35.585 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:55:35.585 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:55:35.586 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:55:35.586 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:55:35.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:35.586 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T02:55:35.586 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T02:55:35.586 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:55:35.586 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:55:35.586 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:55:35.587 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T02:55:35.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:35.815 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T02:55:35.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:35.830 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2023-10-06T02:55:35.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:35.884 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T02:55:35.884 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T02:55:35.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:55:35.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T02:55:35.884 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T02:55:35.974 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T02:55:35.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:35.974 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T02:55:35.974 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T02:55:35.974 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T02:55:35.974 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T02:55:35.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T02:55:35.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T02:55:35.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T02:55:35.975 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T02:55:36.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:55:36.180 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:55:36.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:36.202 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T02:55:36.202 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T02:55:36.202 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2023-10-06T02:55:36.202 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T02:55:36.202 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T02:55:36.357 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:36.357 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T02:55:36.372 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T02:55:36.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:36.372 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:55:36.426 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T02:55:36.427 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:55:36.427 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T02:55:36.511 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T02:55:36.511 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T02:55:36.512 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-10-06T02:55:36.584 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T02:55:36.585 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T02:55:36.585 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-10-06T02:55:36.585 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:55:36.585 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T02:55:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T02:55:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-10-06T02:55:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:55:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T02:55:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T02:55:36.606 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T02:55:36.608 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:55:36.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:36.608 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T02:55:36.632 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-06T02:55:36.632 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:55:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.756+0000 7f94630f0700 1 Processor -- start 2023-10-06T02:55:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.756+0000 7f94630f0700 1 -- start start 2023-10-06T02:55:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.756+0000 7f94630f0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c0ad620 0x7f945c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.756+0000 7f94630f0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c0ced30 con 0x7f945c0ad250 2023-10-06T02:55:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.756+0000 7f94630f0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c0cf010 con 0x7f945c15db50 2023-10-06T02:55:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.756+0000 7f94630f0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0ccad0 con 0x7f945c0ad620 2023-10-06T02:55:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f9460e8c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f945c0ad250 0x7f945c15d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47276/0 (socket says 172.21.15.84:47276) 2023-10-06T02:55:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f9460e8c700 1 -- 172.21.15.84:0/1078215632 learned_addr learned my addr 172.21.15.84:0/1078215632 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f946168d700 1 --2- 172.21.15.84:0/1078215632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c0ad620 0x7f945c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f945b7fe700 1 -- 172.21.15.84:0/1078215632 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741576504 0 0) 0x7f945c0ced30 con 0x7f945c0ad250 2023-10-06T02:55:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f945b7fe700 1 -- 172.21.15.84:0/1078215632 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9444003570 con 0x7f945c0ad250 2023-10-06T02:55:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f945b7fe700 1 -- 172.21.15.84:0/1078215632 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29421741 0 0) 0x7f945c0cf010 con 0x7f945c15db50 2023-10-06T02:55:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f945b7fe700 1 -- 172.21.15.84:0/1078215632 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f945c0ced30 con 0x7f945c15db50 2023-10-06T02:55:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f945b7fe700 1 -- 172.21.15.84:0/1078215632 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310859938 0 0) 0x7f9444003570 con 0x7f945c0ad250 2023-10-06T02:55:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f946168d700 1 -- 172.21.15.84:0/1078215632 >> v1:172.21.15.131:6789/0 conn(0x7f945c15db50 legacy=0x7f945c0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f946168d700 1 -- 172.21.15.84:0/1078215632 >> v1:172.21.15.84:6789/0 conn(0x7f945c0ad250 legacy=0x7f945c15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f946168d700 1 -- 172.21.15.84:0/1078215632 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0ccdb0 con 0x7f945c0ad620 2023-10-06T02:55:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f946168d700 1 --2- 172.21.15.84:0/1078215632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c0ad620 0x7f945c0cd2d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9454009910 tx=0x7f94540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23a4316752bea4a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.757+0000 7f945b7fe700 1 -- 172.21.15.84:0/1078215632 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c001970 con 0x7f945c0ad620 2023-10-06T02:55:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.758+0000 7f945b7fe700 1 -- 172.21.15.84:0/1078215632 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9454011420 con 0x7f945c0ad620 2023-10-06T02:55:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.758+0000 7f945b7fe700 1 -- 172.21.15.84:0/1078215632 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540117c0 con 0x7f945c0ad620 2023-10-06T02:55:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.758+0000 7f94630f0700 1 -- 172.21.15.84:0/1078215632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c0ad620 msgr2=0x7f945c0cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.758+0000 7f94630f0700 1 --2- 172.21.15.84:0/1078215632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c0ad620 0x7f945c0cd2d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9454009910 tx=0x7f94540091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.758+0000 7f94630f0700 1 -- 172.21.15.84:0/1078215632 shutdown_connections 2023-10-06T02:55:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.758+0000 7f94630f0700 1 --2- 172.21.15.84:0/1078215632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c0ad620 0x7f945c0cd2d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.758+0000 7f94630f0700 1 -- 172.21.15.84:0/1078215632 >> 172.21.15.84:0/1078215632 conn(0x7f945c067dd0 msgr2=0x7f945c0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.758+0000 7f94630f0700 1 -- 172.21.15.84:0/1078215632 shutdown_connections 2023-10-06T02:55:36.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.758+0000 7f94630f0700 1 -- 172.21.15.84:0/1078215632 wait complete. 2023-10-06T02:55:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.759+0000 7f94630f0700 1 Processor -- start 2023-10-06T02:55:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.759+0000 7f94630f0700 1 -- start start 2023-10-06T02:55:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f94630f0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f945c0ad250 0x7f945c0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f94630f0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f945c0ad620 0x7f945c0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f94630f0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c15db50 0x7f945c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f94630f0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0b15a0 con 0x7f945c0ad250 2023-10-06T02:55:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f94630f0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0b2120 con 0x7f945c0ad620 2023-10-06T02:55:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f94630f0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0b1b60 con 0x7f945c15db50 2023-10-06T02:55:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f9460e8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f945c0ad250 0x7f945c0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f9460e8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f945c0ad250 0x7f945c0b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54376/0 (socket says 172.21.15.84:54376) 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f9460e8c700 1 -- 172.21.15.84:0/933311144 learned_addr learned my addr 172.21.15.84:0/933311144 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f9460e8c700 1 -- 172.21.15.84:0/933311144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c15db50 msgr2=0x7f945c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f9460e8c700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c15db50 0x7f945c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f9460e8c700 1 -- 172.21.15.84:0/933311144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f945c0ad620 msgr2=0x7f945c0691b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f9460e8c700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f945c0ad620 0x7f945c0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.760+0000 7f9460e8c700 1 -- 172.21.15.84:0/933311144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454009420 con 0x7f945c0ad250 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.761+0000 7f9460e8c700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f945c0ad250 0x7f945c0b1060 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f944c00cc90 tx=0x7f944c002f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.761+0000 7f9458ff9700 1 -- 172.21.15.84:0/933311144 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00cea0 con 0x7f945c0ad250 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.761+0000 7f9458ff9700 1 -- 172.21.15.84:0/933311144 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c005d80 con 0x7f945c0ad250 2023-10-06T02:55:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.761+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945c0b1e40 con 0x7f945c0ad250 2023-10-06T02:55:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.761+0000 7f9458ff9700 1 -- 172.21.15.84:0/933311144 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00aaf0 con 0x7f945c0ad250 2023-10-06T02:55:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.761+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c0c6af0 con 0x7f945c0ad250 2023-10-06T02:55:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.762+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c0c6d10 con 0x7f945c0ad250 2023-10-06T02:55:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.762+0000 7f9458ff9700 1 -- 172.21.15.84:0/933311144 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f944c0070f0 con 0x7f945c0ad250 2023-10-06T02:55:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.763+0000 7f9458ff9700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9448066f30 0x7f94480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.763+0000 7f9458ff9700 1 -- 172.21.15.84:0/933311144 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f944c084af0 con 0x7f945c0ad250 2023-10-06T02:55:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.763+0000 7f945bfff700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9448066f30 0x7f94480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.763+0000 7f945bfff700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9448066f30 0x7f94480693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9450002650 tx=0x7f9450007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:36.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.767+0000 7f9458ff9700 1 -- 172.21.15.84:0/933311144 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f944c051990 con 0x7f945c0ad250 2023-10-06T02:55:36.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.991+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f945c064ad0 con 0x7f945c0ad250 2023-10-06T02:55:36.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.991+0000 7f9458ff9700 1 -- 172.21.15.84:0/933311144 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f944c054fb0 con 0x7f945c0ad250 2023-10-06T02:55:36.993 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T02:55:36.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9448066f30 msgr2=0x7f94480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9448066f30 0x7f94480693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9450002650 tx=0x7f9450007990 comp rx=0 tx=0).stop 2023-10-06T02:55:36.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f945c0ad250 msgr2=0x7f945c0b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:36.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f945c0ad250 0x7f945c0b1060 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f944c00cc90 tx=0x7f944c002f30 comp rx=0 tx=0).stop 2023-10-06T02:55:36.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 shutdown_connections 2023-10-06T02:55:36.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9448066f30 0x7f94480693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f945c15db50 0x7f945c15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f945c0ad250 0x7f945c0b1060 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 --2- 172.21.15.84:0/933311144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f945c0ad620 0x7f945c0691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:36.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.993+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 >> 172.21.15.84:0/933311144 conn(0x7f945c067dd0 msgr2=0x7f945c15bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:36.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.994+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 shutdown_connections 2023-10-06T02:55:36.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:36.994+0000 7f94630f0700 1 -- 172.21.15.84:0/933311144 wait complete. 2023-10-06T02:55:37.007 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T02:55:37.007 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:55:37.007 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2023-10-06T02:55:37.007 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T02:55:37.007 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T02:55:37.007 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T02:55:37.007 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T02:55:37.008 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:55:37.008 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T02:55:37.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.008 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2023-10-06T02:55:37.023 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:37.023 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:37.023 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:37.024 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42469sec preferred_lft 42469sec 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 1a:c6:b7:e3:cc:2a brd ff:ff:ff:ff:ff:ff 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::5007:d9ff:fe71:3649/64 scope link 2023-10-06T02:55:37.025 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.026 INFO:teuthology.orchestra.run.smithi131.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:55:37.026 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 1a:c6:b7:e3:cc:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T02:55:37.026 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::18c6:b7ff:fee3:cc2a/64 scope link tentative 2023-10-06T02:55:37.026 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.026 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:55:37.086 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-10-06T02:55:37.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.088 DEBUG:teuthology.orchestra.run.smithi131:> route 2023-10-06T02:55:37.144 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2023-10-06T02:55:37.144 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:55:37.145 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:55:37.145 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:55:37.145 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:55:37.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.145 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T02:55:37.145 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T02:55:37.145 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:55:37.145 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:55:37.146 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:55:37.146 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T02:55:37.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.244 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T02:55:37.258 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T02:55:37.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.258 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2023-10-06T02:55:37.312 INFO:teuthology.orchestra.run.smithi131.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T02:55:37.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.313 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T02:55:37.313 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T02:55:37.313 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T02:55:37.313 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T02:55:37.313 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T02:55:37.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T02:55:37.429 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:37.429 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:37.429 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:37.429 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.429 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:37.429 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.430 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:55:37.430 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether de:87:42:43:57:26 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:55:37.430 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:55:37.430 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.430 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::dc87:42ff:fe43:5726/64 scope link tentative 2023-10-06T02:55:37.430 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T02:55:37.512 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:55:37.512 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:55:37.512 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:55:37.513 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.513 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2023-10-06T02:55:37.513 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.513 INFO:teuthology.orchestra.run.smithi131.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:55:37.513 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether de:87:42:43:57:26 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T02:55:37.513 INFO:teuthology.orchestra.run.smithi131.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T02:55:37.513 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.513 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::dc87:42ff:fe43:5726/64 scope link tentative 2023-10-06T02:55:37.513 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:55:37.523 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T02:55:37.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.524 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T02:55:37.524 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T02:55:37.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T02:55:37.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T02:55:37.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T02:55:37.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T02:55:37.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T02:55:37.524 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T02:55:37.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.730 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2023-10-06T02:55:37.730 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2023-10-06T02:55:37.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.1 up 2023-10-06T02:55:37.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T02:55:37.730 DEBUG:teuthology.orchestra.run.smithi131:> ') 2023-10-06T02:55:37.809 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:37.810 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T02:55:37.824 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T02:55:37.824 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:55:37.825 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T02:55:37.879 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T02:55:37.879 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:55:37.879 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T02:55:37.958 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T02:55:37.959 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T02:55:37.959 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-10-06T02:55:37.966 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T02:55:37.966 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T02:55:37.967 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-10-06T02:55:37.967 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:55:37.967 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:37.988 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T02:55:37.988 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T02:55:37.988 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2023-10-06T02:55:37.988 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:55:37.988 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:55:37.988 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T02:55:37.988 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T02:55:37.988 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T02:55:37.990 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:55:37.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:37.990 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T02:55:38.054 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T02:55:38.072 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:38.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.196+0000 7f5d1db3e700 1 Processor -- start 2023-10-06T02:55:38.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.196+0000 7f5d1db3e700 1 -- start start 2023-10-06T02:55:38.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d1db3e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5d181595a0 0x7f5d180aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d1db3e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b49e0 0x7f5d180aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d1db3e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5d180b07a0 0x7f5d180b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d1db3e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d180b0ca0 con 0x7f5d180b07a0 2023-10-06T02:55:38.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d1db3e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d180b0f80 con 0x7f5d181595a0 2023-10-06T02:55:38.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d1db3e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180b1260 con 0x7f5d180b49e0 2023-10-06T02:55:38.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d17fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5d180b07a0 0x7f5d180b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d17fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5d180b07a0 0x7f5d180b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54382/0 (socket says 172.21.15.84:54382) 2023-10-06T02:55:38.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d17fff700 1 -- 172.21.15.84:0/4227954286 learned_addr learned my addr 172.21.15.84:0/4227954286 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:38.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d177fe700 1 --2- 172.21.15.84:0/4227954286 >> v2:172.21.15.131:3300/0 conn(0x7f5d181595a0 0x7f5d180aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d16ffd700 1 --2- 172.21.15.84:0/4227954286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b49e0 0x7f5d180aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d17fff700 1 -- 172.21.15.84:0/4227954286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b49e0 msgr2=0x7f5d180aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d17fff700 1 --2- 172.21.15.84:0/4227954286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b49e0 0x7f5d180aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d17fff700 1 -- 172.21.15.84:0/4227954286 >> v2:172.21.15.131:3300/0 conn(0x7f5d181595a0 msgr2=0x7f5d180aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d17fff700 1 --2- 172.21.15.84:0/4227954286 >> v2:172.21.15.131:3300/0 conn(0x7f5d181595a0 0x7f5d180aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d17fff700 1 -- 172.21.15.84:0/4227954286 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d180b1540 con 0x7f5d180b07a0 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d177fe700 1 --2- 172.21.15.84:0/4227954286 >> v2:172.21.15.131:3300/0 conn(0x7f5d181595a0 0x7f5d180aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.197+0000 7f5d17fff700 1 --2- 172.21.15.84:0/4227954286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d180b07a0 0x7f5d180b38d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d18088cc0 tx=0x7f5d10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35ea2964690c82f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d167fc700 1 -- 172.21.15.84:0/4227954286 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1000b860 con 0x7f5d180b07a0 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d167fc700 1 -- 172.21.15.84:0/4227954286 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1000b9c0 con 0x7f5d180b07a0 2023-10-06T02:55:38.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d167fc700 1 -- 172.21.15.84:0/4227954286 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1000bd60 con 0x7f5d180b07a0 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d1db3e700 1 -- 172.21.15.84:0/4227954286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d180b07a0 msgr2=0x7f5d180b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/4227954286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d180b07a0 0x7f5d180b38d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d18088cc0 tx=0x7f5d10009250 comp rx=0 tx=0).stop 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d1db3e700 1 -- 172.21.15.84:0/4227954286 shutdown_connections 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/4227954286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d180b07a0 0x7f5d180b38d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/4227954286 >> v2:172.21.15.131:3300/0 conn(0x7f5d181595a0 0x7f5d180aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/4227954286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b49e0 0x7f5d180aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d1db3e700 1 -- 172.21.15.84:0/4227954286 >> 172.21.15.84:0/4227954286 conn(0x7f5d18099830 msgr2=0x7f5d1806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d1db3e700 1 -- 172.21.15.84:0/4227954286 shutdown_connections 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.198+0000 7f5d1db3e700 1 -- 172.21.15.84:0/4227954286 wait complete. 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.199+0000 7f5d1db3e700 1 Processor -- start 2023-10-06T02:55:38.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d1db3e700 1 -- start start 2023-10-06T02:55:38.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d1db3e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b07a0 0x7f5d1815e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d1db3e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d180b49e0 0x7f5d180aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d1db3e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d181595a0 0x7f5d180af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d1db3e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1815c900 con 0x7f5d181595a0 2023-10-06T02:55:38.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d1db3e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1815c620 con 0x7f5d180b49e0 2023-10-06T02:55:38.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d1db3e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1809a1c0 con 0x7f5d180b07a0 2023-10-06T02:55:38.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d17fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d181595a0 0x7f5d180af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d17fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d181595a0 0x7f5d180af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54384/0 (socket says 172.21.15.84:54384) 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d17fff700 1 -- 172.21.15.84:0/3170717468 learned_addr learned my addr 172.21.15.84:0/3170717468 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d16ffd700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d180b49e0 0x7f5d180aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.200+0000 7f5d177fe700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b07a0 0x7f5d1815e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5d17fff700 1 -- 172.21.15.84:0/3170717468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b07a0 msgr2=0x7f5d1815e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5d17fff700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b07a0 0x7f5d1815e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5d17fff700 1 -- 172.21.15.84:0/3170717468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d180b49e0 msgr2=0x7f5d180aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5d17fff700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d180b49e0 0x7f5d180aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5d17fff700 1 -- 172.21.15.84:0/3170717468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d100094f0 con 0x7f5d181595a0 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5d17fff700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d181595a0 0x7f5d180af180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5d18067c60 tx=0x7f5d10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5cff7fe700 1 -- 172.21.15.84:0/3170717468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10011ea0 con 0x7f5d181595a0 2023-10-06T02:55:38.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5cff7fe700 1 -- 172.21.15.84:0/3170717468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1001a630 con 0x7f5d181595a0 2023-10-06T02:55:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5cff7fe700 1 -- 172.21.15.84:0/3170717468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1001a9d0 con 0x7f5d181595a0 2023-10-06T02:55:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1809a4a0 con 0x7f5d181595a0 2023-10-06T02:55:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.201+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1815ec10 con 0x7f5d181595a0 2023-10-06T02:55:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.202+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d18064ad0 con 0x7f5d181595a0 2023-10-06T02:55:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.202+0000 7f5cff7fe700 1 -- 172.21.15.84:0/3170717468 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d1002d440 con 0x7f5d181595a0 2023-10-06T02:55:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.203+0000 7f5cff7fe700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d04066f30 0x7f5d040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.203+0000 7f5cff7fe700 1 -- 172.21.15.84:0/3170717468 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5d10086440 con 0x7f5d181595a0 2023-10-06T02:55:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.203+0000 7f5d177fe700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d04066f30 0x7f5d040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.203+0000 7f5d177fe700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d04066f30 0x7f5d040693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800d650 tx=0x7f5d08007800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.207+0000 7f5cff7fe700 1 -- 172.21.15.84:0/3170717468 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d100532e0 con 0x7f5d181595a0 2023-10-06T02:55:38.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.396+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d180695c0 con 0x7f5d181595a0 2023-10-06T02:55:38.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.397+0000 7f5cff7fe700 1 -- 172.21.15.84:0/3170717468 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f5d10056900 con 0x7f5d181595a0 2023-10-06T02:55:38.399 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:38.399 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:38.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d04066f30 msgr2=0x7f5d040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d04066f30 0x7f5d040693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800d650 tx=0x7f5d08007800 comp rx=0 tx=0).stop 2023-10-06T02:55:38.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d181595a0 msgr2=0x7f5d180af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d181595a0 0x7f5d180af180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5d18067c60 tx=0x7f5d10017000 comp rx=0 tx=0).stop 2023-10-06T02:55:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 shutdown_connections 2023-10-06T02:55:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d04066f30 0x7f5d040693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d181595a0 0x7f5d180af180 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d180b07a0 0x7f5d1815e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 --2- 172.21.15.84:0/3170717468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d180b49e0 0x7f5d180aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 >> 172.21.15.84:0/3170717468 conn(0x7f5d18099830 msgr2=0x7f5d180b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 shutdown_connections 2023-10-06T02:55:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.399+0000 7f5d1db3e700 1 -- 172.21.15.84:0/3170717468 wait complete. 2023-10-06T02:55:38.413 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:55:05.120029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:55:05.566741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:55:09.247969+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:55:38.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:38.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.528+0000 7fc34e641700 1 Processor -- start 2023-10-06T02:55:38.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.528+0000 7fc34e641700 1 -- start start 2023-10-06T02:55:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc34e641700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc348159510 0x7fc3480cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc34e641700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc3480cbae0 0x7fc3480cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc34e641700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3480cbf20 con 0x7fc3481598e0 2023-10-06T02:55:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc34e641700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3480cf610 con 0x7fc348159510 2023-10-06T02:55:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc34e641700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3480cf8f0 con 0x7fc3480cbae0 2023-10-06T02:55:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc347fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc348159510 0x7fc3480cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc347fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc348159510 0x7fc3480cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54400/0 (socket says 172.21.15.84:54400) 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc347fff700 1 -- 172.21.15.84:0/292683015 learned_addr learned my addr 172.21.15.84:0/292683015 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc34cbde700 1 --2- 172.21.15.84:0/292683015 >> v2:172.21.15.131:3300/0 conn(0x7fc3480cbae0 0x7fc3480cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc347fff700 1 -- 172.21.15.84:0/292683015 >> v2:172.21.15.131:3300/0 conn(0x7fc3480cbae0 msgr2=0x7fc3480cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc347fff700 1 --2- 172.21.15.84:0/292683015 >> v2:172.21.15.131:3300/0 conn(0x7fc3480cbae0 0x7fc3480cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc347fff700 1 -- 172.21.15.84:0/292683015 >> v1:172.21.15.131:6789/0 conn(0x7fc3481598e0 legacy=0x7fc3480ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.529+0000 7fc347fff700 1 -- 172.21.15.84:0/292683015 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480cfbd0 con 0x7fc348159510 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc347fff700 1 --2- 172.21.15.84:0/292683015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 0x7fc3480cb5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc34806f990 tx=0x7fc338009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd35d651de56611 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc346ffd700 1 -- 172.21.15.84:0/292683015 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338009e70 con 0x7fc348159510 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc346ffd700 1 -- 172.21.15.84:0/292683015 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33800b860 con 0x7fc348159510 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc346ffd700 1 -- 172.21.15.84:0/292683015 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800bc00 con 0x7fc348159510 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc34e641700 1 -- 172.21.15.84:0/292683015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 msgr2=0x7fc3480cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc34e641700 1 --2- 172.21.15.84:0/292683015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 0x7fc3480cb5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc34806f990 tx=0x7fc338009250 comp rx=0 tx=0).stop 2023-10-06T02:55:38.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc34e641700 1 -- 172.21.15.84:0/292683015 shutdown_connections 2023-10-06T02:55:38.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc34e641700 1 --2- 172.21.15.84:0/292683015 >> v2:172.21.15.131:3300/0 conn(0x7fc3480cbae0 0x7fc3480cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc34e641700 1 --2- 172.21.15.84:0/292683015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 0x7fc3480cb5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc34e641700 1 -- 172.21.15.84:0/292683015 >> 172.21.15.84:0/292683015 conn(0x7fc348089e90 msgr2=0x7fc3480997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:38.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc34e641700 1 -- 172.21.15.84:0/292683015 shutdown_connections 2023-10-06T02:55:38.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.530+0000 7fc34e641700 1 -- 172.21.15.84:0/292683015 wait complete. 2023-10-06T02:55:38.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.531+0000 7fc34e641700 1 Processor -- start 2023-10-06T02:55:38.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc34e641700 1 -- start start 2023-10-06T02:55:38.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc34e641700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3480cbae0 0x7fc34816d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc34e641700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 0x7fc3480b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc34e641700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3481598e0 0x7fc3481696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc34e641700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34815aa40 con 0x7fc348159510 2023-10-06T02:55:38.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc34e641700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34816da50 con 0x7fc3481598e0 2023-10-06T02:55:38.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc34e641700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34816dd30 con 0x7fc3480cbae0 2023-10-06T02:55:38.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc3477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 0x7fc3480b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc3477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 0x7fc3480b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54402/0 (socket says 172.21.15.84:54402) 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc3477fe700 1 -- 172.21.15.84:0/583287132 learned_addr learned my addr 172.21.15.84:0/583287132 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc34cbde700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3481598e0 0x7fc3481696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.532+0000 7fc347fff700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3480cbae0 0x7fc34816d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc3477fe700 1 -- 172.21.15.84:0/583287132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3480cbae0 msgr2=0x7fc34816d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc3477fe700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3480cbae0 0x7fc34816d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc3477fe700 1 -- 172.21.15.84:0/583287132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3481598e0 msgr2=0x7fc3481696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc3477fe700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3481598e0 0x7fc3481696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc3477fe700 1 -- 172.21.15.84:0/583287132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3380094f0 con 0x7fc348159510 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc3477fe700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 0x7fc3480b3440 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00c4c0 tx=0x7fc33c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc32ffff700 1 -- 172.21.15.84:0/583287132 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00ce70 con 0x7fc348159510 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc32ffff700 1 -- 172.21.15.84:0/583287132 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c011590 con 0x7fc348159510 2023-10-06T02:55:38.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc32ffff700 1 -- 172.21.15.84:0/583287132 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c011970 con 0x7fc348159510 2023-10-06T02:55:38.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34816e010 con 0x7fc348159510 2023-10-06T02:55:38.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.533+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3480b3980 con 0x7fc348159510 2023-10-06T02:55:38.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.534+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34815abf0 con 0x7fc348159510 2023-10-06T02:55:38.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.534+0000 7fc32ffff700 1 -- 172.21.15.84:0/583287132 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc33c011d20 con 0x7fc348159510 2023-10-06T02:55:38.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.535+0000 7fc32ffff700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.535+0000 7fc32ffff700 1 -- 172.21.15.84:0/583287132 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc33c083c60 con 0x7fc348159510 2023-10-06T02:55:38.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.535+0000 7fc347fff700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.535+0000 7fc347fff700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc34806f990 tx=0x7fc338017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.539+0000 7fc32ffff700 1 -- 172.21.15.84:0/583287132 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc34815abf0 con 0x7fc348159510 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.721+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc34815a800 con 0x7fc348159510 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.721+0000 7fc32ffff700 1 -- 172.21.15.84:0/583287132 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc33c017070 con 0x7fc348159510 2023-10-06T02:55:38.723 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:55:38.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 msgr2=0x7fc3340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc34806f990 tx=0x7fc338017000 comp rx=0 tx=0).stop 2023-10-06T02:55:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 msgr2=0x7fc3480b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 0x7fc3480b3440 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00c4c0 tx=0x7fc33c007ef0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 shutdown_connections 2023-10-06T02:55:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc334066f30 0x7fc3340693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3481598e0 0x7fc3481696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3480cbae0 0x7fc34816d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 --2- 172.21.15.84:0/583287132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc348159510 0x7fc3480b3440 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 >> 172.21.15.84:0/583287132 conn(0x7fc348089e90 msgr2=0x7fc348068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 shutdown_connections 2023-10-06T02:55:38.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.723+0000 7fc34e641700 1 -- 172.21.15.84:0/583287132 wait complete. 2023-10-06T02:55:38.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:38.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.854+0000 7ffad0e81700 1 Processor -- start 2023-10-06T02:55:38.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.854+0000 7ffad0e81700 1 -- start start 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffad0e81700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffacc159510 0x7ffacc0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffad0e81700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffacc1598e0 0x7ffacc0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffad0e81700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc0ce820 0x7ffacc0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffad0e81700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0cf610 con 0x7ffacc1598e0 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffad0e81700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0cf8f0 con 0x7ffacc159510 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffad0e81700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0cfbd0 con 0x7ffacc0ce820 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac9d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffacc1598e0 0x7ffacc0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac9d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffacc1598e0 0x7ffacc0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54414/0 (socket says 172.21.15.84:54414) 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac9d9b700 1 -- 172.21.15.84:0/4242588135 learned_addr learned my addr 172.21.15.84:0/4242588135 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffaca59c700 1 --2- 172.21.15.84:0/4242588135 >> v2:172.21.15.131:3300/0 conn(0x7ffacc159510 0x7ffacc0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffacad9d700 1 --2- 172.21.15.84:0/4242588135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc0ce820 0x7ffacc0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac9d9b700 1 -- 172.21.15.84:0/4242588135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc0ce820 msgr2=0x7ffacc0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac9d9b700 1 --2- 172.21.15.84:0/4242588135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc0ce820 0x7ffacc0cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac9d9b700 1 -- 172.21.15.84:0/4242588135 >> v2:172.21.15.131:3300/0 conn(0x7ffacc159510 msgr2=0x7ffacc0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac9d9b700 1 --2- 172.21.15.84:0/4242588135 >> v2:172.21.15.131:3300/0 conn(0x7ffacc159510 0x7ffacc0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac9d9b700 1 -- 172.21.15.84:0/4242588135 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0cfeb0 con 0x7ffacc1598e0 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac9d9b700 1 --2- 172.21.15.84:0/4242588135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc1598e0 0x7ffacc0cbae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffacc088fb0 tx=0x7ffac0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b681f49f4381b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac959a700 1 -- 172.21.15.84:0/4242588135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000b640 con 0x7ffacc1598e0 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac959a700 1 -- 172.21.15.84:0/4242588135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac000b7a0 con 0x7ffacc1598e0 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.855+0000 7ffac959a700 1 -- 172.21.15.84:0/4242588135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000bb60 con 0x7ffacc1598e0 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.856+0000 7ffad0e81700 1 -- 172.21.15.84:0/4242588135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc1598e0 msgr2=0x7ffacc0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.856+0000 7ffad0e81700 1 --2- 172.21.15.84:0/4242588135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc1598e0 0x7ffacc0cbae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffacc088fb0 tx=0x7ffac0009250 comp rx=0 tx=0).stop 2023-10-06T02:55:38.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.856+0000 7ffad0e81700 1 -- 172.21.15.84:0/4242588135 shutdown_connections 2023-10-06T02:55:38.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.856+0000 7ffad0e81700 1 --2- 172.21.15.84:0/4242588135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc0ce820 0x7ffacc0cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.856+0000 7ffad0e81700 1 --2- 172.21.15.84:0/4242588135 >> v2:172.21.15.131:3300/0 conn(0x7ffacc159510 0x7ffacc0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.856+0000 7ffad0e81700 1 --2- 172.21.15.84:0/4242588135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc1598e0 0x7ffacc0cbae0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.856+0000 7ffad0e81700 1 -- 172.21.15.84:0/4242588135 >> 172.21.15.84:0/4242588135 conn(0x7ffacc089e90 msgr2=0x7ffacc0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:38.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.856+0000 7ffad0e81700 1 -- 172.21.15.84:0/4242588135 shutdown_connections 2023-10-06T02:55:38.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.856+0000 7ffad0e81700 1 -- 172.21.15.84:0/4242588135 wait complete. 2023-10-06T02:55:38.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.857+0000 7ffad0e81700 1 Processor -- start 2023-10-06T02:55:38.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.857+0000 7ffad0e81700 1 -- start start 2023-10-06T02:55:38.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffad0e81700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ce820 0x7ffacc153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffad0e81700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc159510 0x7ffacc169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffad0e81700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc1598e0 0x7ffacc169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffad0e81700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc154be0 con 0x7ffacc159510 2023-10-06T02:55:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffad0e81700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc15b760 con 0x7ffacc0ce820 2023-10-06T02:55:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffad0e81700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc153fd0 con 0x7ffacc1598e0 2023-10-06T02:55:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffac9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc159510 0x7ffacc169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffac9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc159510 0x7ffacc169610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54422/0 (socket says 172.21.15.84:54422) 2023-10-06T02:55:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffac9d9b700 1 -- 172.21.15.84:0/807113656 learned_addr learned my addr 172.21.15.84:0/807113656 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffaca59c700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ce820 0x7ffacc153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffacad9d700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc1598e0 0x7ffacc169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffac9d9b700 1 -- 172.21.15.84:0/807113656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc1598e0 msgr2=0x7ffacc169b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffac9d9b700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc1598e0 0x7ffacc169b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffac9d9b700 1 -- 172.21.15.84:0/807113656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ce820 msgr2=0x7ffacc153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:38.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffac9d9b700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ce820 0x7ffacc153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:38.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffac9d9b700 1 -- 172.21.15.84:0/807113656 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00094f0 con 0x7ffacc159510 2023-10-06T02:55:38.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffaca59c700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ce820 0x7ffacc153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:38.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.858+0000 7ffac9d9b700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc159510 0x7ffacc169610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffacc067c60 tx=0x7ffac0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.859+0000 7ffaba7fc700 1 -- 172.21.15.84:0/807113656 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0000d10 con 0x7ffacc159510 2023-10-06T02:55:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.859+0000 7ffaba7fc700 1 -- 172.21.15.84:0/807113656 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac000bb20 con 0x7ffacc159510 2023-10-06T02:55:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.859+0000 7ffaba7fc700 1 -- 172.21.15.84:0/807113656 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011670 con 0x7ffacc159510 2023-10-06T02:55:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.859+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc1542b0 con 0x7ffacc159510 2023-10-06T02:55:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.859+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc154870 con 0x7ffacc159510 2023-10-06T02:55:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.859+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc064ad0 con 0x7ffacc159510 2023-10-06T02:55:38.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.860+0000 7ffaba7fc700 1 -- 172.21.15.84:0/807113656 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffac00119e0 con 0x7ffacc159510 2023-10-06T02:55:38.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.860+0000 7ffaba7fc700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffaac066f30 0x7ffaac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:38.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.860+0000 7ffaba7fc700 1 -- 172.21.15.84:0/807113656 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ffac0086140 con 0x7ffacc159510 2023-10-06T02:55:38.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.860+0000 7ffaca59c700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffaac066f30 0x7ffaac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:38.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.861+0000 7ffaca59c700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffaac066f30 0x7ffaac0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009d80 tx=0x7ffabc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:38.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:38.864+0000 7ffaba7fc700 1 -- 172.21.15.84:0/807113656 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffac0052f60 con 0x7ffacc159510 2023-10-06T02:55:39.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.046+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffacc154d20 con 0x7ffacc159510 2023-10-06T02:55:39.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.047+0000 7ffaba7fc700 1 -- 172.21.15.84:0/807113656 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffac0056580 con 0x7ffacc159510 2023-10-06T02:55:39.049 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffaac066f30 msgr2=0x7ffaac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffaac066f30 0x7ffaac0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009d80 tx=0x7ffabc008040 comp rx=0 tx=0).stop 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc159510 msgr2=0x7ffacc169610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc159510 0x7ffacc169610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffacc067c60 tx=0x7ffac0017000 comp rx=0 tx=0).stop 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 shutdown_connections 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffaac066f30 0x7ffaac0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ce820 0x7ffacc153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffacc1598e0 0x7ffacc169b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 --2- 172.21.15.84:0/807113656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffacc159510 0x7ffacc169610 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 >> 172.21.15.84:0/807113656 conn(0x7ffacc089e90 msgr2=0x7ffacc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 shutdown_connections 2023-10-06T02:55:39.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.049+0000 7ffad0e81700 1 -- 172.21.15.84:0/807113656 wait complete. 2023-10-06T02:55:39.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:55:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.180+0000 7fbe96756700 1 Processor -- start 2023-10-06T02:55:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.180+0000 7fbe96756700 1 -- start start 2023-10-06T02:55:39.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe96756700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe90150820 0x7fbe90157530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe96756700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe9006b4b0 0x7fbe9006e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe96756700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe900c7d10 con 0x7fbe9006b900 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe96756700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe900c91b0 con 0x7fbe9006b4b0 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe96756700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9006bda0 con 0x7fbe90150820 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe8ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe90150820 0x7fbe90157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe8f7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe9006b4b0 0x7fbe9006e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe94cf3700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fbe9006b900 0x7fbe900ab160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:45516/0 (socket says 172.21.15.84:45516) 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe8ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe90150820 0x7fbe90157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:44426/0 (socket says 172.21.15.84:44426) 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe8f7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbe9006b4b0 0x7fbe9006e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:44862/0 (socket says 172.21.15.84:44862) 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.181+0000 7fbe94cf3700 1 -- 172.21.15.84:0/909883011 learned_addr learned my addr 172.21.15.84:0/909883011 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.182+0000 7fbe8f7fe700 1 -- 172.21.15.84:0/909883011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe90150820 msgr2=0x7fbe90157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:39.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.182+0000 7fbe8f7fe700 1 --2- 172.21.15.84:0/909883011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe90150820 0x7fbe90157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.182+0000 7fbe8f7fe700 1 -- 172.21.15.84:0/909883011 >> v1:172.21.15.131:6789/0 conn(0x7fbe9006b900 legacy=0x7fbe900ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.182+0000 7fbe8f7fe700 1 -- 172.21.15.84:0/909883011 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9006c080 con 0x7fbe9006b4b0 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.182+0000 7fbe8ffff700 1 --2- 172.21.15.84:0/909883011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe90150820 0x7fbe90157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.182+0000 7fbe8f7fe700 1 --2- 172.21.15.84:0/909883011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b4b0 0x7fbe9006e4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe840098e0 tx=0x7fbe840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad00299a9758d4ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.182+0000 7fbe8effd700 1 -- 172.21.15.84:0/909883011 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400b640 con 0x7fbe9006b4b0 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.182+0000 7fbe8effd700 1 -- 172.21.15.84:0/909883011 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8400b7a0 con 0x7fbe9006b4b0 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.182+0000 7fbe8effd700 1 -- 172.21.15.84:0/909883011 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400bb40 con 0x7fbe9006b4b0 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.183+0000 7fbe96756700 1 -- 172.21.15.84:0/909883011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b4b0 msgr2=0x7fbe9006e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.183+0000 7fbe96756700 1 --2- 172.21.15.84:0/909883011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b4b0 0x7fbe9006e4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe840098e0 tx=0x7fbe840091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.183+0000 7fbe96756700 1 -- 172.21.15.84:0/909883011 shutdown_connections 2023-10-06T02:55:39.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.183+0000 7fbe96756700 1 --2- 172.21.15.84:0/909883011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe90150820 0x7fbe90157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.183+0000 7fbe96756700 1 --2- 172.21.15.84:0/909883011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b4b0 0x7fbe9006e4c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.183+0000 7fbe96756700 1 -- 172.21.15.84:0/909883011 >> 172.21.15.84:0/909883011 conn(0x7fbe900691d0 msgr2=0x7fbe900cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.183+0000 7fbe96756700 1 -- 172.21.15.84:0/909883011 shutdown_connections 2023-10-06T02:55:39.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.183+0000 7fbe96756700 1 -- 172.21.15.84:0/909883011 wait complete. 2023-10-06T02:55:39.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.184+0000 7fbe96756700 1 Processor -- start 2023-10-06T02:55:39.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.184+0000 7fbe96756700 1 -- start start 2023-10-06T02:55:39.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe96756700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9006b4b0 0x7fbe90150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe96756700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b900 0x7fbe900c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe96756700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe90150820 0x7fbe9014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe96756700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900b0930 con 0x7fbe90150820 2023-10-06T02:55:39.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe96756700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90151130 con 0x7fbe9006b900 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe96756700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900c6790 con 0x7fbe9006b4b0 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe94cf3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe90150820 0x7fbe9014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b900 0x7fbe900c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe8ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9006b4b0 0x7fbe90150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b900 0x7fbe900c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:44868/0 (socket says 172.21.15.84:44868) 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe8f7fe700 1 -- 172.21.15.84:0/2904175568 learned_addr learned my addr 172.21.15.84:0/2904175568 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe94cf3700 1 -- 172.21.15.84:0/2904175568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9006b4b0 msgr2=0x7fbe90150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe94cf3700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9006b4b0 0x7fbe90150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe94cf3700 1 -- 172.21.15.84:0/2904175568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b900 msgr2=0x7fbe900c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe94cf3700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b900 0x7fbe900c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe94cf3700 1 -- 172.21.15.84:0/2904175568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe80009420 con 0x7fbe90150820 2023-10-06T02:55:39.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe8ffff700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9006b4b0 0x7fbe90150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:39.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe94cf3700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe90150820 0x7fbe9014fbd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbe9006f5a0 tx=0x7fbe880019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe77fff700 1 -- 172.21.15.84:0/2904175568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800a7e0 con 0x7fbe90150820 2023-10-06T02:55:39.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe77fff700 1 -- 172.21.15.84:0/2904175568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800a940 con 0x7fbe90150820 2023-10-06T02:55:39.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe84009420 con 0x7fbe90150820 2023-10-06T02:55:39.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe77fff700 1 -- 172.21.15.84:0/2904175568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800ad00 con 0x7fbe90150820 2023-10-06T02:55:39.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.185+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe900c6d50 con 0x7fbe90150820 2023-10-06T02:55:39.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.186+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe900b0aa0 con 0x7fbe90150820 2023-10-06T02:55:39.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.187+0000 7fbe77fff700 1 -- 172.21.15.84:0/2904175568 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe88007300 con 0x7fbe90150820 2023-10-06T02:55:39.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.187+0000 7fbe77fff700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe7c066f30 0x7fbe7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.187+0000 7fbe77fff700 1 -- 172.21.15.84:0/2904175568 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbe88084be0 con 0x7fbe90150820 2023-10-06T02:55:39.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.187+0000 7fbe8ffff700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe7c066f30 0x7fbe7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.187+0000 7fbe8ffff700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe7c066f30 0x7fbe7c0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbe80011560 tx=0x7fbe800091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.191+0000 7fbe77fff700 1 -- 172.21.15.84:0/2904175568 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe88051a00 con 0x7fbe90150820 2023-10-06T02:55:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.371+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe90064ad0 con 0x7fbe90150820 2023-10-06T02:55:39.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.371+0000 7fbe77fff700 1 -- 172.21.15.84:0/2904175568 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe8800ae60 con 0x7fbe90150820 2023-10-06T02:55:39.373 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe7c066f30 msgr2=0x7fbe7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe7c066f30 0x7fbe7c0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbe80011560 tx=0x7fbe800091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe90150820 msgr2=0x7fbe9014fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe90150820 0x7fbe9014fbd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbe9006f5a0 tx=0x7fbe880019a0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 shutdown_connections 2023-10-06T02:55:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe7c066f30 0x7fbe7c0693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe90150820 0x7fbe9014fbd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbe9006b4b0 0x7fbe90150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 --2- 172.21.15.84:0/2904175568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe9006b900 0x7fbe900c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 >> 172.21.15.84:0/2904175568 conn(0x7fbe900691d0 msgr2=0x7fbe900c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 shutdown_connections 2023-10-06T02:55:39.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.373+0000 7fbe96756700 1 -- 172.21.15.84:0/2904175568 wait complete. 2023-10-06T02:55:39.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:55:39.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.501+0000 7f5f8ec7c700 1 Processor -- start 2023-10-06T02:55:39.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.502+0000 7f5f8ec7c700 1 -- start start 2023-10-06T02:55:39.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.502+0000 7f5f8ec7c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f8806eae0 0x7f5f88161100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.502+0000 7f5f8ec7c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f880c84e0 con 0x7f5f881563b0 2023-10-06T02:55:39.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.502+0000 7f5f8ec7c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8806f910 con 0x7f5f88156780 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.502+0000 7f5f8ec7c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f880c78d0 con 0x7f5f8806eae0 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.502+0000 7f5f8d219700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f8806eae0 0x7f5f88161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f8d219700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5f8806eae0 0x7f5f88161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54446/0 (socket says 172.21.15.84:54446) 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f8ca18700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5f881563b0 0x7f5f8806f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47278/0 (socket says 172.21.15.84:47278) 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f8d219700 1 -- 172.21.15.84:0/3607360112 learned_addr learned my addr 172.21.15.84:0/3607360112 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f8d219700 1 -- 172.21.15.84:0/3607360112 >> v1:172.21.15.131:6789/0 conn(0x7f5f88156780 legacy=0x7f5f8806e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f8d219700 1 -- 172.21.15.84:0/3607360112 >> v1:172.21.15.84:6789/0 conn(0x7f5f881563b0 legacy=0x7f5f8806f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f877fe700 1 -- 172.21.15.84:0/3607360112 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393415050 0 0) 0x7f5f880c84e0 con 0x7f5f881563b0 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f8d219700 1 -- 172.21.15.84:0/3607360112 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880c7bb0 con 0x7f5f8806eae0 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f8d219700 1 --2- 172.21.15.84:0/3607360112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f8806eae0 0x7f5f88161100 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000bc50 tx=0x7f5f8000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce999ac4529be9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f877fe700 1 -- 172.21.15.84:0/3607360112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000be60 con 0x7f5f8806eae0 2023-10-06T02:55:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f877fe700 1 -- 172.21.15.84:0/3607360112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8000de00 con 0x7f5f8806eae0 2023-10-06T02:55:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.503+0000 7f5f877fe700 1 -- 172.21.15.84:0/3607360112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800196b0 con 0x7f5f8806eae0 2023-10-06T02:55:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.504+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/3607360112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f8806eae0 msgr2=0x7f5f88161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.504+0000 7f5f8ec7c700 1 --2- 172.21.15.84:0/3607360112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f8806eae0 0x7f5f88161100 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000bc50 tx=0x7f5f8000b4f0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.504+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/3607360112 shutdown_connections 2023-10-06T02:55:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.504+0000 7f5f8ec7c700 1 --2- 172.21.15.84:0/3607360112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f8806eae0 0x7f5f88161100 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.504+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/3607360112 >> 172.21.15.84:0/3607360112 conn(0x7f5f88069190 msgr2=0x7f5f880cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.504+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/3607360112 shutdown_connections 2023-10-06T02:55:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.504+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/3607360112 wait complete. 2023-10-06T02:55:39.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.505+0000 7f5f8ec7c700 1 Processor -- start 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.505+0000 7f5f8ec7c700 1 -- start start 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8ec7c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f8806eae0 0x7f5f880c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8ec7c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f881563b0 0x7f5f88158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8ec7c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f88156780 0x7f5f881556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8ec7c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f881598f0 con 0x7f5f881563b0 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8ec7c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f88158a40 con 0x7f5f8806eae0 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8ec7c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f88158ce0 con 0x7f5f88156780 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f87fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f881563b0 0x7f5f88158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f87fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f881563b0 0x7f5f88158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54458/0 (socket says 172.21.15.84:54458) 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f87fff700 1 -- 172.21.15.84:0/2936021002 learned_addr learned my addr 172.21.15.84:0/2936021002 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8ca18700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f8806eae0 0x7f5f880c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8d219700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f88156780 0x7f5f881556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f87fff700 1 -- 172.21.15.84:0/2936021002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f88156780 msgr2=0x7f5f881556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f87fff700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f88156780 0x7f5f881556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f87fff700 1 -- 172.21.15.84:0/2936021002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f8806eae0 msgr2=0x7f5f880c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f87fff700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f8806eae0 0x7f5f880c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f87fff700 1 -- 172.21.15.84:0/2936021002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8000b790 con 0x7f5f881563b0 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f87fff700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f881563b0 0x7f5f88158500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c560 tx=0x7f5f70007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f84ff9700 1 -- 172.21.15.84:0/2936021002 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70011590 con 0x7f5f881563b0 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f84ff9700 1 -- 172.21.15.84:0/2936021002 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70011710 con 0x7f5f881563b0 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f84ff9700 1 -- 172.21.15.84:0/2936021002 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70011ad0 con 0x7f5f881563b0 2023-10-06T02:55:39.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f88158fc0 con 0x7f5f881563b0 2023-10-06T02:55:39.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.506+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f88159580 con 0x7f5f881563b0 2023-10-06T02:55:39.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.507+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f88159a60 con 0x7f5f881563b0 2023-10-06T02:55:39.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.508+0000 7f5f84ff9700 1 -- 172.21.15.84:0/2936021002 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f7001a360 con 0x7f5f881563b0 2023-10-06T02:55:39.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.508+0000 7f5f84ff9700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5f68066f30 0x7f5f680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.508+0000 7f5f84ff9700 1 -- 172.21.15.84:0/2936021002 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5f70083830 con 0x7f5f881563b0 2023-10-06T02:55:39.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.508+0000 7f5f8ca18700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5f68066f30 0x7f5f680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.508+0000 7f5f8ca18700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5f68066f30 0x7f5f680693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5f78001620 tx=0x7f5f78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.512+0000 7f5f84ff9700 1 -- 172.21.15.84:0/2936021002 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f70050650 con 0x7f5f881563b0 2023-10-06T02:55:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.692+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f88064ad0 con 0x7f5f881563b0 2023-10-06T02:55:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.693+0000 7f5f84ff9700 1 -- 172.21.15.84:0/2936021002 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f70053c70 con 0x7f5f881563b0 2023-10-06T02:55:39.694 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:55:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5f68066f30 msgr2=0x7f5f680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5f68066f30 0x7f5f680693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5f78001620 tx=0x7f5f78009040 comp rx=0 tx=0).stop 2023-10-06T02:55:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f881563b0 msgr2=0x7f5f88158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f881563b0 0x7f5f88158500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000c560 tx=0x7f5f70007f20 comp rx=0 tx=0).stop 2023-10-06T02:55:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 shutdown_connections 2023-10-06T02:55:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5f68066f30 0x7f5f680693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f8806eae0 0x7f5f880c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5f88156780 0x7f5f881556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 --2- 172.21.15.84:0/2936021002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f881563b0 0x7f5f88158500 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.694+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 >> 172.21.15.84:0/2936021002 conn(0x7f5f88069190 msgr2=0x7f5f880cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.695+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 shutdown_connections 2023-10-06T02:55:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.695+0000 7f5f8ec7c700 1 -- 172.21.15.84:0/2936021002 wait complete. 2023-10-06T02:55:39.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:55:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.822+0000 7fa69e874700 1 Processor -- start 2023-10-06T02:55:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.823+0000 7fa69e874700 1 -- start start 2023-10-06T02:55:39.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.823+0000 7fa69e874700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6981563b0 0x7fa69806f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.823+0000 7fa69e874700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa69806eae0 0x7fa6980adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.823+0000 7fa69e874700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6980c84e0 con 0x7fa698156780 2023-10-06T02:55:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.823+0000 7fa69e874700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6980c78d0 con 0x7fa69806eae0 2023-10-06T02:55:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.823+0000 7fa69e874700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c7bb0 con 0x7fa6981563b0 2023-10-06T02:55:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa697fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6981563b0 0x7fa69806f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa69ce11700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa69806eae0 0x7fa6980adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa697fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6981563b0 0x7fa69806f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:44450/0 (socket says 172.21.15.84:44450) 2023-10-06T02:55:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa697fff700 1 -- 172.21.15.84:0/3315913822 learned_addr learned my addr 172.21.15.84:0/3315913822 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa6977fe700 1 --1- 172.21.15.84:0/3315913822 >> v1:172.21.15.131:6789/0 conn(0x7fa698156780 0x7fa69806e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:45532/0 (socket says 172.21.15.84:45532) 2023-10-06T02:55:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa696ffd700 1 -- 172.21.15.84:0/3315913822 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269416841 0 0) 0x7fa6980c84e0 con 0x7fa698156780 2023-10-06T02:55:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa696ffd700 1 -- 172.21.15.84:0/3315913822 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa680003570 con 0x7fa698156780 2023-10-06T02:55:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa697fff700 1 -- 172.21.15.84:0/3315913822 >> v2:172.21.15.131:3300/0 conn(0x7fa69806eae0 msgr2=0x7fa6980adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa697fff700 1 --2- 172.21.15.84:0/3315913822 >> v2:172.21.15.131:3300/0 conn(0x7fa69806eae0 0x7fa6980adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa697fff700 1 -- 172.21.15.84:0/3315913822 >> v1:172.21.15.131:6789/0 conn(0x7fa698156780 legacy=0x7fa69806e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa697fff700 1 -- 172.21.15.84:0/3315913822 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980c7e90 con 0x7fa6981563b0 2023-10-06T02:55:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa69ce11700 1 --2- 172.21.15.84:0/3315913822 >> v2:172.21.15.131:3300/0 conn(0x7fa69806eae0 0x7fa6980adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa697fff700 1 --2- 172.21.15.84:0/3315913822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6981563b0 0x7fa69806f200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa68800bc30 tx=0x7fa68800b4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59491cd0b8e2a999 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa696ffd700 1 -- 172.21.15.84:0/3315913822 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688005c10 con 0x7fa6981563b0 2023-10-06T02:55:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa696ffd700 1 -- 172.21.15.84:0/3315913822 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688005d70 con 0x7fa6981563b0 2023-10-06T02:55:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.824+0000 7fa696ffd700 1 -- 172.21.15.84:0/3315913822 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800db60 con 0x7fa6981563b0 2023-10-06T02:55:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.825+0000 7fa69e874700 1 -- 172.21.15.84:0/3315913822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6981563b0 msgr2=0x7fa69806f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.825+0000 7fa69e874700 1 --2- 172.21.15.84:0/3315913822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6981563b0 0x7fa69806f200 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa68800bc30 tx=0x7fa68800b4c0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.825+0000 7fa69e874700 1 -- 172.21.15.84:0/3315913822 shutdown_connections 2023-10-06T02:55:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.825+0000 7fa69e874700 1 --2- 172.21.15.84:0/3315913822 >> v2:172.21.15.131:3300/0 conn(0x7fa69806eae0 0x7fa6980adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.825+0000 7fa69e874700 1 --2- 172.21.15.84:0/3315913822 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6981563b0 0x7fa69806f200 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.825+0000 7fa69e874700 1 -- 172.21.15.84:0/3315913822 >> 172.21.15.84:0/3315913822 conn(0x7fa698069190 msgr2=0x7fa6980cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.825+0000 7fa69e874700 1 -- 172.21.15.84:0/3315913822 shutdown_connections 2023-10-06T02:55:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.825+0000 7fa69e874700 1 -- 172.21.15.84:0/3315913822 wait complete. 2023-10-06T02:55:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.826+0000 7fa69e874700 1 Processor -- start 2023-10-06T02:55:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.826+0000 7fa69e874700 1 -- start start 2023-10-06T02:55:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa69e874700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa69806eae0 0x7fa6980c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa69e874700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6981563b0 0x7fa698165740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa69e874700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa698156780 0x7fa6980cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa69e874700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c2b10 con 0x7fa69806eae0 2023-10-06T02:55:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa69e874700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa698166ec0 con 0x7fa6981563b0 2023-10-06T02:55:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa69e874700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6981695f0 con 0x7fa698156780 2023-10-06T02:55:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa697fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa69806eae0 0x7fa6980c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa697fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa69806eae0 0x7fa6980c25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54466/0 (socket says 172.21.15.84:54466) 2023-10-06T02:55:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa697fff700 1 -- 172.21.15.84:0/1237934326 learned_addr learned my addr 172.21.15.84:0/1237934326 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa69ce11700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa698156780 0x7fa6980cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa6977fe700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6981563b0 0x7fa698165740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa697fff700 1 -- 172.21.15.84:0/1237934326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa698156780 msgr2=0x7fa6980cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa697fff700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa698156780 0x7fa6980cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa697fff700 1 -- 172.21.15.84:0/1237934326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6981563b0 msgr2=0x7fa698165740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa697fff700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6981563b0 0x7fa698165740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa697fff700 1 -- 172.21.15.84:0/1237934326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa690009a20 con 0x7fa69806eae0 2023-10-06T02:55:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa6977fe700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6981563b0 0x7fa698165740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.827+0000 7fa697fff700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa69806eae0 0x7fa6980c25d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6980c7cf0 tx=0x7fa68801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.828+0000 7fa67ffff700 1 -- 172.21.15.84:0/1237934326 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800db40 con 0x7fa69806eae0 2023-10-06T02:55:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.828+0000 7fa67ffff700 1 -- 172.21.15.84:0/1237934326 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68801d070 con 0x7fa69806eae0 2023-10-06T02:55:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.828+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68800b720 con 0x7fa69806eae0 2023-10-06T02:55:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.828+0000 7fa67ffff700 1 -- 172.21.15.84:0/1237934326 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688024690 con 0x7fa69806eae0 2023-10-06T02:55:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.828+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa698169bb0 con 0x7fa69806eae0 2023-10-06T02:55:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.828+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69806b810 con 0x7fa69806eae0 2023-10-06T02:55:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.829+0000 7fa67ffff700 1 -- 172.21.15.84:0/1237934326 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa688024a40 con 0x7fa69806eae0 2023-10-06T02:55:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.829+0000 7fa67ffff700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa684066f60 0x7fa684069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.829+0000 7fa67ffff700 1 -- 172.21.15.84:0/1237934326 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa688014030 con 0x7fa69806eae0 2023-10-06T02:55:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.829+0000 7fa6977fe700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa684066f60 0x7fa684069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.830+0000 7fa6977fe700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa684066f60 0x7fa684069410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa6980c0710 tx=0x7fa68c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:39.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:39.833+0000 7fa67ffff700 1 -- 172.21.15.84:0/1237934326 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa688055f40 con 0x7fa69806eae0 2023-10-06T02:55:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.015+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa698064ad0 con 0x7fa69806eae0 2023-10-06T02:55:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.015+0000 7fa67ffff700 1 -- 172.21.15.84:0/1237934326 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa68801f0a0 con 0x7fa69806eae0 2023-10-06T02:55:40.017 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:40.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa684066f60 msgr2=0x7fa684069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa684066f60 0x7fa684069410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa6980c0710 tx=0x7fa68c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:40.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa69806eae0 msgr2=0x7fa6980c25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa69806eae0 0x7fa6980c25d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6980c7cf0 tx=0x7fa68801a000 comp rx=0 tx=0).stop 2023-10-06T02:55:40.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 shutdown_connections 2023-10-06T02:55:40.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa684066f60 0x7fa684069410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa698156780 0x7fa6980cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa69806eae0 0x7fa6980c25d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 --2- 172.21.15.84:0/1237934326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6981563b0 0x7fa698165740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 >> 172.21.15.84:0/1237934326 conn(0x7fa698069190 msgr2=0x7fa6980cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 shutdown_connections 2023-10-06T02:55:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.017+0000 7fa69e874700 1 -- 172.21.15.84:0/1237934326 wait complete. 2023-10-06T02:55:40.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:40.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.145+0000 7fee6ac65700 1 Processor -- start 2023-10-06T02:55:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.145+0000 7fee6ac65700 1 -- start start 2023-10-06T02:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee6ac65700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fee64159480 0x7fee640b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee6ac65700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee640b3610 0x7fee640cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee6ac65700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee640cb7e0 con 0x7fee640cc1b0 2023-10-06T02:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee6ac65700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee640b08a0 con 0x7fee640b3610 2023-10-06T02:55:40.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee6ac65700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee640cb190 con 0x7fee64159480 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee69462700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee640b3610 0x7fee640cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee6a464700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fee640cc1b0 0x7fee640b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47284/0 (socket says 172.21.15.84:47284) 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee6a464700 1 -- 172.21.15.84:0/126991611 learned_addr learned my addr 172.21.15.84:0/126991611 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee69462700 1 --2- 172.21.15.84:0/126991611 >> v2:172.21.15.84:3300/0 conn(0x7fee640b3610 0x7fee640cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54472/0 (socket says 172.21.15.84:54472) 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee69c63700 1 --2- 172.21.15.84:0/126991611 >> v2:172.21.15.131:3300/0 conn(0x7fee64159480 0x7fee640b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee69462700 1 -- 172.21.15.84:0/126991611 >> v2:172.21.15.131:3300/0 conn(0x7fee64159480 msgr2=0x7fee640b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee69462700 1 --2- 172.21.15.84:0/126991611 >> v2:172.21.15.131:3300/0 conn(0x7fee64159480 0x7fee640b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee69462700 1 -- 172.21.15.84:0/126991611 >> v1:172.21.15.84:6789/0 conn(0x7fee640cc1b0 legacy=0x7fee640b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee69462700 1 -- 172.21.15.84:0/126991611 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee640cb470 con 0x7fee640b3610 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee68c61700 1 -- 172.21.15.84:0/126991611 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955625539 0 0) 0x7fee640cb7e0 con 0x7fee640cc1b0 2023-10-06T02:55:40.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.146+0000 7fee69462700 1 --2- 172.21.15.84:0/126991611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640b3610 0x7fee640cbc70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fee6406fa30 tx=0x7fee540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4050f5f6057ba13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee68c61700 1 -- 172.21.15.84:0/126991611 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54011630 con 0x7fee640b3610 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee68c61700 1 -- 172.21.15.84:0/126991611 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54011790 con 0x7fee640b3610 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee68c61700 1 -- 172.21.15.84:0/126991611 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54011b30 con 0x7fee640b3610 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee6ac65700 1 -- 172.21.15.84:0/126991611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640b3610 msgr2=0x7fee640cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee6ac65700 1 --2- 172.21.15.84:0/126991611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640b3610 0x7fee640cbc70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fee6406fa30 tx=0x7fee540091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee6ac65700 1 -- 172.21.15.84:0/126991611 shutdown_connections 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee6ac65700 1 --2- 172.21.15.84:0/126991611 >> v2:172.21.15.131:3300/0 conn(0x7fee64159480 0x7fee640b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee6ac65700 1 --2- 172.21.15.84:0/126991611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640b3610 0x7fee640cbc70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee6ac65700 1 -- 172.21.15.84:0/126991611 >> 172.21.15.84:0/126991611 conn(0x7fee6406ed20 msgr2=0x7fee6406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee6ac65700 1 -- 172.21.15.84:0/126991611 shutdown_connections 2023-10-06T02:55:40.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.147+0000 7fee6ac65700 1 -- 172.21.15.84:0/126991611 wait complete. 2023-10-06T02:55:40.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.148+0000 7fee6ac65700 1 Processor -- start 2023-10-06T02:55:40.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.148+0000 7fee6ac65700 1 -- start start 2023-10-06T02:55:40.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee6ac65700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee640b3610 0x7fee64154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee6ac65700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640cc1b0 0x7fee640cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee6ac65700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fee64159480 0x7fee640c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee6ac65700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640c69f0 con 0x7fee640cc1b0 2023-10-06T02:55:40.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee6ac65700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640c8e00 con 0x7fee640b3610 2023-10-06T02:55:40.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee6ac65700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee640c6710 con 0x7fee64159480 2023-10-06T02:55:40.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee69462700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640cc1b0 0x7fee640cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee69462700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640cc1b0 0x7fee640cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54480/0 (socket says 172.21.15.84:54480) 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee69462700 1 -- 172.21.15.84:0/2228272367 learned_addr learned my addr 172.21.15.84:0/2228272367 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee69462700 1 -- 172.21.15.84:0/2228272367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fee64159480 msgr2=0x7fee640c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee69462700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fee64159480 0x7fee640c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee69462700 1 -- 172.21.15.84:0/2228272367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee640b3610 msgr2=0x7fee64154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee69462700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee640b3610 0x7fee64154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.149+0000 7fee69462700 1 -- 172.21.15.84:0/2228272367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee54009420 con 0x7fee640cc1b0 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.150+0000 7fee69462700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640cc1b0 0x7fee640cde30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fee64069190 tx=0x7fee54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.150+0000 7fee59ffb700 1 -- 172.21.15.84:0/2228272367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54011b10 con 0x7fee640cc1b0 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.150+0000 7fee59ffb700 1 -- 172.21.15.84:0/2228272367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540233f0 con 0x7fee640cc1b0 2023-10-06T02:55:40.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.150+0000 7fee59ffb700 1 -- 172.21.15.84:0/2228272367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540237b0 con 0x7fee640cc1b0 2023-10-06T02:55:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.150+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee640c90a0 con 0x7fee640cc1b0 2023-10-06T02:55:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.150+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee640c9660 con 0x7fee640cc1b0 2023-10-06T02:55:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.151+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee640c9850 con 0x7fee640cc1b0 2023-10-06T02:55:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.151+0000 7fee59ffb700 1 -- 172.21.15.84:0/2228272367 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee540193b0 con 0x7fee640cc1b0 2023-10-06T02:55:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.152+0000 7fee59ffb700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fee48066f30 0x7fee480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.152+0000 7fee69c63700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fee48066f30 0x7fee480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.152+0000 7fee59ffb700 1 -- 172.21.15.84:0/2228272367 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fee54085f80 con 0x7fee640cc1b0 2023-10-06T02:55:40.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.152+0000 7fee69c63700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fee48066f30 0x7fee480693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fee60009a80 tx=0x7fee600091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.156+0000 7fee59ffb700 1 -- 172.21.15.84:0/2228272367 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee54052d80 con 0x7fee640cc1b0 2023-10-06T02:55:40.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.340+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee6405f2a0 con 0x7fee640cc1b0 2023-10-06T02:55:40.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.341+0000 7fee59ffb700 1 -- 172.21.15.84:0/2228272367 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fee54028090 con 0x7fee640cc1b0 2023-10-06T02:55:40.343 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:40.343 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:40.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fee48066f30 msgr2=0x7fee480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fee48066f30 0x7fee480693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fee60009a80 tx=0x7fee600091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640cc1b0 msgr2=0x7fee640cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640cc1b0 0x7fee640cde30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fee64069190 tx=0x7fee54017000 comp rx=0 tx=0).stop 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 shutdown_connections 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fee48066f30 0x7fee480693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee640b3610 0x7fee64154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fee64159480 0x7fee640c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 --2- 172.21.15.84:0/2228272367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee640cc1b0 0x7fee640cde30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 >> 172.21.15.84:0/2228272367 conn(0x7fee6406ed20 msgr2=0x7fee64158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:40.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 shutdown_connections 2023-10-06T02:55:40.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.343+0000 7fee6ac65700 1 -- 172.21.15.84:0/2228272367 wait complete. 2023-10-06T02:55:40.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:55:05.120029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:55:05.566741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:55:09.247969+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:55:40.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:40.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.472+0000 7f5ac2914700 1 Processor -- start 2023-10-06T02:55:40.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.472+0000 7f5ac2914700 1 -- start start 2023-10-06T02:55:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.472+0000 7f5ac2914700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc159510 0x7f5abc0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.472+0000 7f5ac2914700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5abc0cbae0 0x7f5abc0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.472+0000 7f5ac2914700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5abc0cbf00 con 0x7f5abc1598e0 2023-10-06T02:55:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5ac2914700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5abc0cf610 con 0x7f5abc0cbae0 2023-10-06T02:55:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5ac2914700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0cf8f0 con 0x7f5abc159510 2023-10-06T02:55:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5abbfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc159510 0x7f5abc0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5ac0eb1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5abc0cbae0 0x7f5abc0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5abb7fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f5abc1598e0 0x7f5abc0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:45540/0 (socket says 172.21.15.84:45540) 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5ac0eb1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5abc0cbae0 0x7f5abc0cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:44912/0 (socket says 172.21.15.84:44912) 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5abb7fe700 1 -- 172.21.15.84:0/4162565934 learned_addr learned my addr 172.21.15.84:0/4162565934 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5abbfff700 1 -- 172.21.15.84:0/4162565934 >> v2:172.21.15.131:3300/0 conn(0x7f5abc0cbae0 msgr2=0x7f5abc0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5abbfff700 1 --2- 172.21.15.84:0/4162565934 >> v2:172.21.15.131:3300/0 conn(0x7f5abc0cbae0 0x7f5abc0cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5abbfff700 1 -- 172.21.15.84:0/4162565934 >> v1:172.21.15.131:6789/0 conn(0x7f5abc1598e0 legacy=0x7f5abc0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5abbfff700 1 -- 172.21.15.84:0/4162565934 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc0cfbd0 con 0x7f5abc159510 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5ac0eb1700 1 --2- 172.21.15.84:0/4162565934 >> v2:172.21.15.131:3300/0 conn(0x7f5abc0cbae0 0x7f5abc0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.473+0000 7f5abbfff700 1 --2- 172.21.15.84:0/4162565934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc159510 0x7f5abc0cb5a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0098e0 tx=0x7f5aac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8695766d62d05819 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5abaffd700 1 -- 172.21.15.84:0/4162565934 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00b640 con 0x7f5abc159510 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5abaffd700 1 -- 172.21.15.84:0/4162565934 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac00b7a0 con 0x7f5abc159510 2023-10-06T02:55:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5abaffd700 1 -- 172.21.15.84:0/4162565934 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00bb40 con 0x7f5abc159510 2023-10-06T02:55:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5ac2914700 1 -- 172.21.15.84:0/4162565934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc159510 msgr2=0x7f5abc0cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5ac2914700 1 --2- 172.21.15.84:0/4162565934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc159510 0x7f5abc0cb5a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0098e0 tx=0x7f5aac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5ac2914700 1 -- 172.21.15.84:0/4162565934 shutdown_connections 2023-10-06T02:55:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5ac2914700 1 --2- 172.21.15.84:0/4162565934 >> v2:172.21.15.131:3300/0 conn(0x7f5abc0cbae0 0x7f5abc0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5ac2914700 1 --2- 172.21.15.84:0/4162565934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc159510 0x7f5abc0cb5a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5ac2914700 1 -- 172.21.15.84:0/4162565934 >> 172.21.15.84:0/4162565934 conn(0x7f5abc089e90 msgr2=0x7f5abc0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5ac2914700 1 -- 172.21.15.84:0/4162565934 shutdown_connections 2023-10-06T02:55:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.474+0000 7f5ac2914700 1 -- 172.21.15.84:0/4162565934 wait complete. 2023-10-06T02:55:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.475+0000 7f5ac2914700 1 Processor -- start 2023-10-06T02:55:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.475+0000 7f5ac2914700 1 -- start start 2023-10-06T02:55:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5ac2914700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc0cbae0 0x7f5abc0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5ac2914700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5abc159510 0x7f5abc0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5ac2914700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5abc1598e0 0x7f5abc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5ac2914700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0c96e0 con 0x7f5abc1598e0 2023-10-06T02:55:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5ac2914700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc169ec0 con 0x7f5abc159510 2023-10-06T02:55:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5ac2914700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0b6130 con 0x7f5abc0cbae0 2023-10-06T02:55:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5ac0eb1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5abc1598e0 0x7f5abc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5ac0eb1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5abc1598e0 0x7f5abc0b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54492/0 (socket says 172.21.15.84:54492) 2023-10-06T02:55:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5ac0eb1700 1 -- 172.21.15.84:0/1349595253 learned_addr learned my addr 172.21.15.84:0/1349595253 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5abbfff700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc0cbae0 0x7f5abc0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.476+0000 7f5abb7fe700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5abc159510 0x7f5abc0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5ac0eb1700 1 -- 172.21.15.84:0/1349595253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc0cbae0 msgr2=0x7f5abc0c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5ac0eb1700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc0cbae0 0x7f5abc0c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5ac0eb1700 1 -- 172.21.15.84:0/1349595253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5abc159510 msgr2=0x7f5abc0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5ac0eb1700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5abc159510 0x7f5abc0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5ac0eb1700 1 -- 172.21.15.84:0/1349595253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab4009a20 con 0x7f5abc1598e0 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5abb7fe700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5abc159510 0x7f5abc0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5ac0eb1700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5abc1598e0 0x7f5abc0b5bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009f20 tx=0x7f5ab400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5aa3fff700 1 -- 172.21.15.84:0/1349595253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab400cbd0 con 0x7f5abc1598e0 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5aa3fff700 1 -- 172.21.15.84:0/1349595253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab400f040 con 0x7f5abc1598e0 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aac009420 con 0x7f5abc1598e0 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5aa3fff700 1 -- 172.21.15.84:0/1349595253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4014480 con 0x7f5abc1598e0 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.477+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc0c7ec0 con 0x7f5abc1598e0 2023-10-06T02:55:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.478+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc16a080 con 0x7f5abc1598e0 2023-10-06T02:55:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.478+0000 7f5aa3fff700 1 -- 172.21.15.84:0/1349595253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ab4003020 con 0x7f5abc1598e0 2023-10-06T02:55:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.479+0000 7f5aa3fff700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aa8066f30 0x7f5aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.479+0000 7f5aa3fff700 1 -- 172.21.15.84:0/1349595253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5ab40852b0 con 0x7f5abc1598e0 2023-10-06T02:55:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.479+0000 7f5abbfff700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aa8066f30 0x7f5aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.479+0000 7f5abbfff700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aa8066f30 0x7f5aa80693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0093f0 tx=0x7f5aac017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.483+0000 7f5aa3fff700 1 -- 172.21.15.84:0/1349595253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5abc16a080 con 0x7f5abc1598e0 2023-10-06T02:55:40.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.665+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5abc16a080 con 0x7f5abc1598e0 2023-10-06T02:55:40.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.666+0000 7f5aa3fff700 1 -- 172.21.15.84:0/1349595253 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5abc16a080 con 0x7f5abc1598e0 2023-10-06T02:55:40.668 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:55:40.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aa8066f30 msgr2=0x7f5aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aa8066f30 0x7f5aa80693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0093f0 tx=0x7f5aac017000 comp rx=0 tx=0).stop 2023-10-06T02:55:40.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5abc1598e0 msgr2=0x7f5abc0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5abc1598e0 0x7f5abc0b5bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009f20 tx=0x7f5ab400b040 comp rx=0 tx=0).stop 2023-10-06T02:55:40.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 shutdown_connections 2023-10-06T02:55:40.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aa8066f30 0x7f5aa80693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5abc1598e0 0x7f5abc0b5bf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5abc0cbae0 0x7f5abc0c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 --2- 172.21.15.84:0/1349595253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5abc159510 0x7f5abc0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 >> 172.21.15.84:0/1349595253 conn(0x7f5abc089e90 msgr2=0x7f5abc15bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:40.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 shutdown_connections 2023-10-06T02:55:40.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.668+0000 7f5ac2914700 1 -- 172.21.15.84:0/1349595253 wait complete. 2023-10-06T02:55:40.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:40.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.796+0000 7f1b31fae700 1 Processor -- start 2023-10-06T02:55:40.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.796+0000 7f1b31fae700 1 -- start start 2023-10-06T02:55:40.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b31fae700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1b2c159510 0x7f1b2c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b31fae700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b2c1598e0 0x7f1b2c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b31fae700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c0ce820 0x7f1b2c0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b31fae700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c0cf610 con 0x7f1b2c1598e0 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b31fae700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c0cf8f0 con 0x7f1b2c159510 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b31fae700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0cfbd0 con 0x7f1b2c0ce820 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b2affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b2c1598e0 0x7f1b2c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b2affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b2c1598e0 0x7f1b2c0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54508/0 (socket says 172.21.15.84:54508) 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b2affd700 1 -- 172.21.15.84:0/3016122627 learned_addr learned my addr 172.21.15.84:0/3016122627 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b2bfff700 1 --2- 172.21.15.84:0/3016122627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c0ce820 0x7f1b2c0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.797+0000 7f1b2b7fe700 1 --2- 172.21.15.84:0/3016122627 >> v2:172.21.15.131:3300/0 conn(0x7f1b2c159510 0x7f1b2c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2affd700 1 -- 172.21.15.84:0/3016122627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c0ce820 msgr2=0x7f1b2c0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2affd700 1 --2- 172.21.15.84:0/3016122627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c0ce820 0x7f1b2c0cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2affd700 1 -- 172.21.15.84:0/3016122627 >> v2:172.21.15.131:3300/0 conn(0x7f1b2c159510 msgr2=0x7f1b2c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2affd700 1 --2- 172.21.15.84:0/3016122627 >> v2:172.21.15.131:3300/0 conn(0x7f1b2c159510 0x7f1b2c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2affd700 1 -- 172.21.15.84:0/3016122627 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0cfeb0 con 0x7f1b2c1598e0 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2b7fe700 1 --2- 172.21.15.84:0/3016122627 >> v2:172.21.15.131:3300/0 conn(0x7f1b2c159510 0x7f1b2c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2affd700 1 --2- 172.21.15.84:0/3016122627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c1598e0 0x7f1b2c0cbae0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c088fb0 tx=0x7f1b20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f62f2ced4dad0be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2a7fc700 1 -- 172.21.15.84:0/3016122627 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20009e70 con 0x7f1b2c1598e0 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2a7fc700 1 -- 172.21.15.84:0/3016122627 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2000b860 con 0x7f1b2c1598e0 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b2a7fc700 1 -- 172.21.15.84:0/3016122627 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2000bc00 con 0x7f1b2c1598e0 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b31fae700 1 -- 172.21.15.84:0/3016122627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c1598e0 msgr2=0x7f1b2c0cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b31fae700 1 --2- 172.21.15.84:0/3016122627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c1598e0 0x7f1b2c0cbae0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c088fb0 tx=0x7f1b20009250 comp rx=0 tx=0).stop 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b31fae700 1 -- 172.21.15.84:0/3016122627 shutdown_connections 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.798+0000 7f1b31fae700 1 --2- 172.21.15.84:0/3016122627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c0ce820 0x7f1b2c0cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.799+0000 7f1b31fae700 1 --2- 172.21.15.84:0/3016122627 >> v2:172.21.15.131:3300/0 conn(0x7f1b2c159510 0x7f1b2c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.799+0000 7f1b31fae700 1 --2- 172.21.15.84:0/3016122627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c1598e0 0x7f1b2c0cbae0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.799+0000 7f1b31fae700 1 -- 172.21.15.84:0/3016122627 >> 172.21.15.84:0/3016122627 conn(0x7f1b2c089e90 msgr2=0x7f1b2c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:40.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.799+0000 7f1b31fae700 1 -- 172.21.15.84:0/3016122627 shutdown_connections 2023-10-06T02:55:40.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.799+0000 7f1b31fae700 1 -- 172.21.15.84:0/3016122627 wait complete. 2023-10-06T02:55:40.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.800+0000 7f1b31fae700 1 Processor -- start 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.800+0000 7f1b31fae700 1 -- start start 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.800+0000 7f1b31fae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c0ce820 0x7f1b2c16d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.800+0000 7f1b31fae700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c159510 0x7f1b2c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.800+0000 7f1b31fae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b2c1598e0 0x7f1b2c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b31fae700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c16a180 con 0x7f1b2c0ce820 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b31fae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c16a460 con 0x7f1b2c1598e0 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b31fae700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c16a740 con 0x7f1b2c159510 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c0ce820 0x7f1b2c16d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c0ce820 0x7f1b2c16d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54518/0 (socket says 172.21.15.84:54518) 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2b7fe700 1 -- 172.21.15.84:0/2238550874 learned_addr learned my addr 172.21.15.84:0/2238550874 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2affd700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c159510 0x7f1b2c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2bfff700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b2c1598e0 0x7f1b2c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2b7fe700 1 -- 172.21.15.84:0/2238550874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c159510 msgr2=0x7f1b2c154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2b7fe700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c159510 0x7f1b2c154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2b7fe700 1 -- 172.21.15.84:0/2238550874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b2c1598e0 msgr2=0x7f1b2c14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2b7fe700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b2c1598e0 0x7f1b2c14e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2b7fe700 1 -- 172.21.15.84:0/2238550874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200094f0 con 0x7f1b2c0ce820 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b2b7fe700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c0ce820 0x7f1b2c16d380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00d1d0 tx=0x7f1b1c009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b137fe700 1 -- 172.21.15.84:0/2238550874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00dd10 con 0x7f1b2c0ce820 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b137fe700 1 -- 172.21.15.84:0/2238550874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c00f040 con 0x7f1b2c0ce820 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c16aa20 con 0x7f1b2c0ce820 2023-10-06T02:55:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b137fe700 1 -- 172.21.15.84:0/2238550874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c015670 con 0x7f1b2c0ce820 2023-10-06T02:55:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.801+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c14eb10 con 0x7f1b2c0ce820 2023-10-06T02:55:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.802+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c16ad90 con 0x7f1b2c0ce820 2023-10-06T02:55:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.803+0000 7f1b137fe700 1 -- 172.21.15.84:0/2238550874 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b1c015a60 con 0x7f1b2c0ce820 2023-10-06T02:55:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.803+0000 7f1b137fe700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b18066f30 0x7f1b180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.803+0000 7f1b137fe700 1 -- 172.21.15.84:0/2238550874 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1b1c084cd0 con 0x7f1b2c0ce820 2023-10-06T02:55:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.803+0000 7f1b2affd700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b18066f30 0x7f1b180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.803+0000 7f1b2affd700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b18066f30 0x7f1b180693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c08a870 tx=0x7f1b20017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.807+0000 7f1b137fe700 1 -- 172.21.15.84:0/2238550874 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b1c04e5a0 con 0x7f1b2c0ce820 2023-10-06T02:55:40.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.992+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b2c14ed60 con 0x7f1b2c0ce820 2023-10-06T02:55:40.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.992+0000 7f1b137fe700 1 -- 172.21.15.84:0/2238550874 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b1c01a0a0 con 0x7f1b2c0ce820 2023-10-06T02:55:40.994 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:55:40.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.994+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b18066f30 msgr2=0x7f1b180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.994+0000 7f1b31fae700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b18066f30 0x7f1b180693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c08a870 tx=0x7f1b20017000 comp rx=0 tx=0).stop 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.994+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c0ce820 msgr2=0x7f1b2c16d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.994+0000 7f1b31fae700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c0ce820 0x7f1b2c16d380 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00d1d0 tx=0x7f1b1c009a90 comp rx=0 tx=0).stop 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.995+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 shutdown_connections 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.995+0000 7f1b31fae700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b18066f30 0x7f1b180693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.995+0000 7f1b31fae700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b2c1598e0 0x7f1b2c14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.995+0000 7f1b31fae700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b2c0ce820 0x7f1b2c16d380 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.995+0000 7f1b31fae700 1 --2- 172.21.15.84:0/2238550874 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b2c159510 0x7f1b2c154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.995+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 >> 172.21.15.84:0/2238550874 conn(0x7f1b2c089e90 msgr2=0x7f1b2c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.995+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 shutdown_connections 2023-10-06T02:55:40.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:40.995+0000 7f1b31fae700 1 -- 172.21.15.84:0/2238550874 wait complete. 2023-10-06T02:55:41.008 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:55:41.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.123+0000 7f81416d7700 1 Processor -- start 2023-10-06T02:55:41.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.124+0000 7f81416d7700 1 -- start start 2023-10-06T02:55:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.124+0000 7f81416d7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f813c158f70 0x7f813c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.124+0000 7f81416d7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c06b380 con 0x7f813c158ba0 2023-10-06T02:55:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.124+0000 7f81416d7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c06a770 con 0x7f813c068d10 2023-10-06T02:55:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.124+0000 7f81416d7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c06aa50 con 0x7f813c158f70 2023-10-06T02:55:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.124+0000 7f813affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f813c158ba0 0x7f813c068600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47296/0 (socket says 172.21.15.84:47296) 2023-10-06T02:55:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.124+0000 7f813affd700 1 -- 172.21.15.84:0/956541321 learned_addr learned my addr 172.21.15.84:0/956541321 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.124+0000 7f813b7fe700 1 --2- 172.21.15.84:0/956541321 >> v2:172.21.15.84:3300/0 conn(0x7f813c158f70 0x7f813c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.125+0000 7f8139ffb700 1 -- 172.21.15.84:0/956541321 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913575059 0 0) 0x7f813c06b380 con 0x7f813c158ba0 2023-10-06T02:55:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.125+0000 7f8139ffb700 1 -- 172.21.15.84:0/956541321 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8128004680 con 0x7f813c158ba0 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.125+0000 7f813b7fe700 1 -- 172.21.15.84:0/956541321 >> v1:172.21.15.131:6789/0 conn(0x7f813c068d10 legacy=0x7f813c069a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.125+0000 7f813b7fe700 1 -- 172.21.15.84:0/956541321 >> v1:172.21.15.84:6789/0 conn(0x7f813c158ba0 legacy=0x7f813c068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.125+0000 7f813b7fe700 1 -- 172.21.15.84:0/956541321 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c06ad30 con 0x7f813c158f70 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.125+0000 7f813b7fe700 1 --2- 172.21.15.84:0/956541321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 0x7f813c06a170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8134009e60 tx=0x7f8134009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892dfe19b054d820 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.125+0000 7f8139ffb700 1 -- 172.21.15.84:0/956541321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813400e070 con 0x7f813c158f70 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.125+0000 7f8139ffb700 1 -- 172.21.15.84:0/956541321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813400bb20 con 0x7f813c158f70 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.125+0000 7f8139ffb700 1 -- 172.21.15.84:0/956541321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134012430 con 0x7f813c158f70 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.126+0000 7f81416d7700 1 -- 172.21.15.84:0/956541321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 msgr2=0x7f813c06a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.126+0000 7f81416d7700 1 --2- 172.21.15.84:0/956541321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 0x7f813c06a170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8134009e60 tx=0x7f8134009780 comp rx=0 tx=0).stop 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.126+0000 7f81416d7700 1 -- 172.21.15.84:0/956541321 shutdown_connections 2023-10-06T02:55:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.126+0000 7f81416d7700 1 --2- 172.21.15.84:0/956541321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 0x7f813c06a170 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.126+0000 7f81416d7700 1 -- 172.21.15.84:0/956541321 >> 172.21.15.84:0/956541321 conn(0x7f813c0c9cd0 msgr2=0x7f813c06da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.126+0000 7f81416d7700 1 -- 172.21.15.84:0/956541321 shutdown_connections 2023-10-06T02:55:41.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.126+0000 7f81416d7700 1 -- 172.21.15.84:0/956541321 wait complete. 2023-10-06T02:55:41.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.127+0000 7f81416d7700 1 Processor -- start 2023-10-06T02:55:41.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.127+0000 7f81416d7700 1 -- start start 2023-10-06T02:55:41.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f81416d7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c068d10 0x7f813c067e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f81416d7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c158ba0 0x7f813c0a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f81416d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 0x7f813c0a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f81416d7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0a5bc0 con 0x7f813c158f70 2023-10-06T02:55:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f81416d7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0a8240 con 0x7f813c158ba0 2023-10-06T02:55:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f81416d7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0a5570 con 0x7f813c068d10 2023-10-06T02:55:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 0x7f813c0a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 0x7f813c0a6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54532/0 (socket says 172.21.15.84:54532) 2023-10-06T02:55:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813b7fe700 1 -- 172.21.15.84:0/2628946305 learned_addr learned my addr 172.21.15.84:0/2628946305 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:41.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813affd700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c068d10 0x7f813c067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813a7fc700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c158ba0 0x7f813c0a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813b7fe700 1 -- 172.21.15.84:0/2628946305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c068d10 msgr2=0x7f813c067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813b7fe700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c068d10 0x7f813c067e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813b7fe700 1 -- 172.21.15.84:0/2628946305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c158ba0 msgr2=0x7f813c0a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813b7fe700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c158ba0 0x7f813c0a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813b7fe700 1 -- 172.21.15.84:0/2628946305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8134009a20 con 0x7f813c158f70 2023-10-06T02:55:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f813b7fe700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 0x7f813c0a6050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f81340097c0 tx=0x7f8134018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f8132ffd700 1 -- 172.21.15.84:0/2628946305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134012e00 con 0x7f813c158f70 2023-10-06T02:55:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f8132ffd700 1 -- 172.21.15.84:0/2628946305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813401e640 con 0x7f813c158f70 2023-10-06T02:55:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c0a5850 con 0x7f813c158f70 2023-10-06T02:55:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f8132ffd700 1 -- 172.21.15.84:0/2628946305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813401ea00 con 0x7f813c158f70 2023-10-06T02:55:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.128+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c068390 con 0x7f813c158f70 2023-10-06T02:55:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.129+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c068580 con 0x7f813c158f70 2023-10-06T02:55:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.130+0000 7f8132ffd700 1 -- 172.21.15.84:0/2628946305 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8134024070 con 0x7f813c158f70 2023-10-06T02:55:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.130+0000 7f8132ffd700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f811c066f30 0x7f811c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.130+0000 7f8132ffd700 1 -- 172.21.15.84:0/2628946305 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8134087420 con 0x7f813c158f70 2023-10-06T02:55:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.130+0000 7f813affd700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f811c066f30 0x7f811c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.130+0000 7f813affd700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f811c066f30 0x7f811c0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f812c0058d0 tx=0x7f812c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.134+0000 7f8132ffd700 1 -- 172.21.15.84:0/2628946305 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81340542f0 con 0x7f813c158f70 2023-10-06T02:55:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.319+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f813c0ac250 con 0x7f813c158f70 2023-10-06T02:55:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.319+0000 7f8132ffd700 1 -- 172.21.15.84:0/2628946305 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8134057910 con 0x7f813c158f70 2023-10-06T02:55:41.322 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f811c066f30 msgr2=0x7f811c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f811c066f30 0x7f811c0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f812c0058d0 tx=0x7f812c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 msgr2=0x7f813c0a6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 0x7f813c0a6050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f81340097c0 tx=0x7f8134018000 comp rx=0 tx=0).stop 2023-10-06T02:55:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 shutdown_connections 2023-10-06T02:55:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f811c066f30 0x7f811c0693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813c158f70 0x7f813c0a6050 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c068d10 0x7f813c067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 --2- 172.21.15.84:0/2628946305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c158ba0 0x7f813c0a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 >> 172.21.15.84:0/2628946305 conn(0x7f813c0c9cd0 msgr2=0x7f813c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 shutdown_connections 2023-10-06T02:55:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.321+0000 7f81416d7700 1 -- 172.21.15.84:0/2628946305 wait complete. 2023-10-06T02:55:41.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:55:41.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.449+0000 7f6ceb59e700 1 Processor -- start 2023-10-06T02:55:41.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.449+0000 7f6ceb59e700 1 -- start start 2023-10-06T02:55:41.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ceb59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6cec0b0460 0x7f6cec0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ceb59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cec0cdd00 con 0x7f6cec0b0830 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ceb59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cec0cd0f0 con 0x7f6cec0c4180 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ceb59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec0cd3d0 con 0x7f6cec0b0460 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ce9d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6cec0b0830 0x7f6cec0c3a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47310/0 (socket says 172.21.15.84:47310) 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ce9d9b700 1 -- 172.21.15.84:0/1426987688 learned_addr learned my addr 172.21.15.84:0/1426987688 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068590974 0 0) 0x7f6cec0cdd00 con 0x7f6cec0b0830 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd4003570 con 0x7f6cec0b0830 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6cea59c700 1 --2- 172.21.15.84:0/1426987688 >> v2:172.21.15.131:3300/0 conn(0x7f6cec0b0460 0x7f6cec0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2929222378 0 0) 0x7f6cd4003570 con 0x7f6cec0b0830 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 >> v2:172.21.15.131:3300/0 conn(0x7f6cec0b0460 msgr2=0x7f6cec0cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:41.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ce959a700 1 --2- 172.21.15.84:0/1426987688 >> v2:172.21.15.131:3300/0 conn(0x7f6cec0b0460 0x7f6cec0cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 >> v1:172.21.15.131:6789/0 conn(0x7f6cec0c4180 legacy=0x7f6cec0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.450+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec0cd6b0 con 0x7f6cec0b0830 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f6ce00014c0 con 0x7f6cec0b0830 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 >> v1:172.21.15.84:6789/0 conn(0x7f6cec0b0830 legacy=0x7f6cec0c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4003a60 0x7f6cd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004810 0x7f6cd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cd40051c0 0x7f6cd400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0cd3d0 con 0x7f6cd4004810 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd400c0d0 con 0x7f6cd40051c0 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd400c290 con 0x7f6cd4003a60 2023-10-06T02:55:41.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce9d9b700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004810 0x7f6cd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6cea59c700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4003a60 0x7f6cd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6cead9d700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cd40051c0 0x7f6cd400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce9d9b700 1 -- 172.21.15.84:0/1426987688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4003a60 msgr2=0x7f6cd4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce9d9b700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4003a60 0x7f6cd4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce9d9b700 1 -- 172.21.15.84:0/1426987688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cd40051c0 msgr2=0x7f6cd400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce9d9b700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cd40051c0 0x7f6cd400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce9d9b700 1 -- 172.21.15.84:0/1426987688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4003570 con 0x7f6cd4004810 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6cead9d700 1 -- 172.21.15.84:0/1426987688 reap_dead start 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6cea59c700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4003a60 0x7f6cd4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:41.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce9d9b700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004810 0x7f6cd4004c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c3c0 tx=0x7f6ce0007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2f7453c43f0a3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce000cc90 con 0x7f6cd4004810 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce000ce10 con 0x7f6cd4004810 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.451+0000 7f6ce959a700 1 -- 172.21.15.84:0/1426987688 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0005b70 con 0x7f6cd4004810 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.452+0000 7f6ceb59e700 1 -- 172.21.15.84:0/1426987688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004810 msgr2=0x7f6cd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.452+0000 7f6ceb59e700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004810 0x7f6cd4004c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c3c0 tx=0x7f6ce0007940 comp rx=0 tx=0).stop 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.452+0000 7f6ceb59e700 1 -- 172.21.15.84:0/1426987688 shutdown_connections 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.452+0000 7f6ceb59e700 1 --2- 172.21.15.84:0/1426987688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004810 0x7f6cd4004c80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.452+0000 7f6ceb59e700 1 -- 172.21.15.84:0/1426987688 >> 172.21.15.84:0/1426987688 conn(0x7f6cec096a70 msgr2=0x7f6cec096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.452+0000 7f6ceb59e700 1 -- 172.21.15.84:0/1426987688 shutdown_connections 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.452+0000 7f6ceb59e700 1 -- 172.21.15.84:0/1426987688 wait complete. 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.453+0000 7f6ceb59e700 1 Processor -- start 2023-10-06T02:55:41.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.453+0000 7f6ceb59e700 1 -- start start 2023-10-06T02:55:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ceb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4004810 0x7f6cec0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ceb59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cec1579b0 0x7f6cec157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ceb59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cec0c6360 0x7f6cec0c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ceb59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0b22b0 con 0x7f6cec1579b0 2023-10-06T02:55:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ceb59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec158360 con 0x7f6cec0c6360 2023-10-06T02:55:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ceb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0c70e0 con 0x7f6cd4004810 2023-10-06T02:55:41.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ce9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cec1579b0 0x7f6cec157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ce9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cec1579b0 0x7f6cec157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54538/0 (socket says 172.21.15.84:54538) 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ce9d9b700 1 -- 172.21.15.84:0/3157548933 learned_addr learned my addr 172.21.15.84:0/3157548933 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6cea59c700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4004810 0x7f6cec0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6cead9d700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cec0c6360 0x7f6cec0c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ce9d9b700 1 -- 172.21.15.84:0/3157548933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4004810 msgr2=0x7f6cec0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ce9d9b700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4004810 0x7f6cec0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ce9d9b700 1 -- 172.21.15.84:0/3157548933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cec0c6360 msgr2=0x7f6cec0c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ce9d9b700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cec0c6360 0x7f6cec0c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ce9d9b700 1 -- 172.21.15.84:0/3157548933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec0c73c0 con 0x7f6cec1579b0 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6cea59c700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4004810 0x7f6cec0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:41.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ce9d9b700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cec1579b0 0x7f6cec157e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0000c00 tx=0x7f6ce0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3157548933 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0001590 con 0x7f6cec1579b0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3157548933 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce00072e0 con 0x7f6cec1579b0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3157548933 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00076c0 con 0x7f6cec1579b0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec0c76a0 con 0x7f6cec1579b0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.454+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec0b2fe0 con 0x7f6cec1579b0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.455+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec0c7bc0 con 0x7f6cec1579b0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.456+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3157548933 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ce0028460 con 0x7f6cec1579b0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.456+0000 7f6cda7fc700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ccc066f30 0x7f6ccc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.456+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3157548933 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6ce0085ce0 con 0x7f6cec1579b0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.456+0000 7f6cea59c700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ccc066f30 0x7f6ccc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.457+0000 7f6cea59c700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ccc066f30 0x7f6ccc0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009fd0 tx=0x7f6ce400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.460+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3157548933 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cec0c7bc0 con 0x7f6cec1579b0 2023-10-06T02:55:41.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.642+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cec0c7bc0 con 0x7f6cec1579b0 2023-10-06T02:55:41.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.643+0000 7f6cda7fc700 1 -- 172.21.15.84:0/3157548933 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cec0c7bc0 con 0x7f6cec1579b0 2023-10-06T02:55:41.644 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:55:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ccc066f30 msgr2=0x7f6ccc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ccc066f30 0x7f6ccc0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009fd0 tx=0x7f6ce400b040 comp rx=0 tx=0).stop 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cec1579b0 msgr2=0x7f6cec157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cec1579b0 0x7f6cec157e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0000c00 tx=0x7f6ce0015000 comp rx=0 tx=0).stop 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 shutdown_connections 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ccc066f30 0x7f6ccc0693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cec0c6360 0x7f6cec0c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cd4004810 0x7f6cec0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 --2- 172.21.15.84:0/3157548933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cec1579b0 0x7f6cec157e20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 >> 172.21.15.84:0/3157548933 conn(0x7f6cec096a70 msgr2=0x7f6cec0c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 shutdown_connections 2023-10-06T02:55:41.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.645+0000 7f6ceb59e700 1 -- 172.21.15.84:0/3157548933 wait complete. 2023-10-06T02:55:41.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:55:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.773+0000 7fb1f4b76700 1 Processor -- start 2023-10-06T02:55:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.773+0000 7fb1f4b76700 1 -- start start 2023-10-06T02:55:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1f4b76700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1f00cb7b0 0x7fb1f0156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1f4b76700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f00ad830 con 0x7fb1f0156500 2023-10-06T02:55:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1f4b76700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f0157500 con 0x7fb1f006ea30 2023-10-06T02:55:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1f4b76700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f0150360 con 0x7fb1f00cb7b0 2023-10-06T02:55:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1ef7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb1f00cb7b0 0x7fb1f0156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1effff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb1f0156500 0x7fb1f00adcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47314/0 (socket says 172.21.15.84:47314) 2023-10-06T02:55:41.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1effff700 1 -- 172.21.15.84:0/1337612772 learned_addr learned my addr 172.21.15.84:0/1337612772 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:41.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1ef7fe700 1 -- 172.21.15.84:0/1337612772 >> v1:172.21.15.131:6789/0 conn(0x7fb1f006ea30 legacy=0x7fb1f0155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1ef7fe700 1 -- 172.21.15.84:0/1337612772 >> v1:172.21.15.84:6789/0 conn(0x7fb1f0156500 legacy=0x7fb1f00adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1ee7fc700 1 -- 172.21.15.84:0/1337612772 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413913269 0 0) 0x7fb1f00ad830 con 0x7fb1f0156500 2023-10-06T02:55:41.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.774+0000 7fb1ef7fe700 1 -- 172.21.15.84:0/1337612772 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0156920 con 0x7fb1f00cb7b0 2023-10-06T02:55:41.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1ef7fe700 1 --2- 172.21.15.84:0/1337612772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f00cb7b0 0x7fb1f0156fc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000afa0 tx=0x7fb1e000a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8463da775daa5ebd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1ee7fc700 1 -- 172.21.15.84:0/1337612772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000f070 con 0x7fb1f00cb7b0 2023-10-06T02:55:41.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1ee7fc700 1 -- 172.21.15.84:0/1337612772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e000a2e0 con 0x7fb1f00cb7b0 2023-10-06T02:55:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1ee7fc700 1 -- 172.21.15.84:0/1337612772 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000cd10 con 0x7fb1f00cb7b0 2023-10-06T02:55:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1f4b76700 1 -- 172.21.15.84:0/1337612772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f00cb7b0 msgr2=0x7fb1f0156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1f4b76700 1 --2- 172.21.15.84:0/1337612772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f00cb7b0 0x7fb1f0156fc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000afa0 tx=0x7fb1e000a890 comp rx=0 tx=0).stop 2023-10-06T02:55:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1f4b76700 1 -- 172.21.15.84:0/1337612772 shutdown_connections 2023-10-06T02:55:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1f4b76700 1 --2- 172.21.15.84:0/1337612772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f00cb7b0 0x7fb1f0156fc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1f4b76700 1 -- 172.21.15.84:0/1337612772 >> 172.21.15.84:0/1337612772 conn(0x7fb1f00cbf10 msgr2=0x7fb1f00cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1f4b76700 1 -- 172.21.15.84:0/1337612772 shutdown_connections 2023-10-06T02:55:41.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.775+0000 7fb1f4b76700 1 -- 172.21.15.84:0/1337612772 wait complete. 2023-10-06T02:55:41.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1f4b76700 1 Processor -- start 2023-10-06T02:55:41.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1f4b76700 1 -- start start 2023-10-06T02:55:41.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1f4b76700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f006ea30 0x7fb1f0167430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1f4b76700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1f00cb7b0 0x7fb1f00a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1f4b76700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1f0156500 0x7fb1f0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1f4b76700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f015c8f0 con 0x7fb1f006ea30 2023-10-06T02:55:41.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1f4b76700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f0168490 con 0x7fb1f00cb7b0 2023-10-06T02:55:41.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1f4b76700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f0167970 con 0x7fb1f0156500 2023-10-06T02:55:41.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1ef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f006ea30 0x7fb1f0167430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.777+0000 7fb1ef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f006ea30 0x7fb1f0167430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54564/0 (socket says 172.21.15.84:54564) 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1ef7fe700 1 -- 172.21.15.84:0/2250650644 learned_addr learned my addr 172.21.15.84:0/2250650644 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1effff700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1f0156500 0x7fb1f0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1eeffd700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1f00cb7b0 0x7fb1f00a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1ef7fe700 1 -- 172.21.15.84:0/2250650644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1f0156500 msgr2=0x7fb1f0154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1ef7fe700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1f0156500 0x7fb1f0154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1ef7fe700 1 -- 172.21.15.84:0/2250650644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1f00cb7b0 msgr2=0x7fb1f00a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1ef7fe700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1f00cb7b0 0x7fb1f00a5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1ef7fe700 1 -- 172.21.15.84:0/2250650644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e000ab30 con 0x7fb1f006ea30 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1ef7fe700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f006ea30 0x7fb1f0167430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000d010 tx=0x7fb1e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1d77fe700 1 -- 172.21.15.84:0/2250650644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0009ad0 con 0x7fb1f006ea30 2023-10-06T02:55:41.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1d77fe700 1 -- 172.21.15.84:0/2250650644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0009c30 con 0x7fb1f006ea30 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f01689f0 con 0x7fb1f006ea30 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1d77fe700 1 -- 172.21.15.84:0/2250650644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0027410 con 0x7fb1f006ea30 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.778+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f015c610 con 0x7fb1f006ea30 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.779+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f005f270 con 0x7fb1f006ea30 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.780+0000 7fb1d77fe700 1 -- 172.21.15.84:0/2250650644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1e00277a0 con 0x7fb1f006ea30 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.780+0000 7fb1d77fe700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1dc066f30 0x7fb1dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.780+0000 7fb1d77fe700 1 -- 172.21.15.84:0/2250650644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb1e0086650 con 0x7fb1f006ea30 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.780+0000 7fb1eeffd700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1dc066f30 0x7fb1dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.780+0000 7fb1eeffd700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1dc066f30 0x7fb1dc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0155a30 tx=0x7fb1e4007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:41.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.784+0000 7fb1d77fe700 1 -- 172.21.15.84:0/2250650644 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1e0053470 con 0x7fb1f006ea30 2023-10-06T02:55:41.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.968+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb1f0156b90 con 0x7fb1f006ea30 2023-10-06T02:55:41.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.968+0000 7fb1d77fe700 1 -- 172.21.15.84:0/2250650644 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb1e0056a90 con 0x7fb1f006ea30 2023-10-06T02:55:41.970 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:41.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.970+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1dc066f30 msgr2=0x7fb1dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.970+0000 7fb1f4b76700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1dc066f30 0x7fb1dc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0155a30 tx=0x7fb1e4007ec0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.970+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f006ea30 msgr2=0x7fb1f0167430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.970+0000 7fb1f4b76700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f006ea30 0x7fb1f0167430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000d010 tx=0x7fb1e0019000 comp rx=0 tx=0).stop 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.970+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 shutdown_connections 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.970+0000 7fb1f4b76700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1dc066f30 0x7fb1dc0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.970+0000 7fb1f4b76700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1f0156500 0x7fb1f0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.970+0000 7fb1f4b76700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1f006ea30 0x7fb1f0167430 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.970+0000 7fb1f4b76700 1 --2- 172.21.15.84:0/2250650644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1f00cb7b0 0x7fb1f00a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.971+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 >> 172.21.15.84:0/2250650644 conn(0x7fb1f00cbf10 msgr2=0x7fb1f00adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:41.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.971+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 shutdown_connections 2023-10-06T02:55:41.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:41.971+0000 7fb1f4b76700 1 -- 172.21.15.84:0/2250650644 wait complete. 2023-10-06T02:55:41.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:42.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.098+0000 7f18b62e1700 1 Processor -- start 2023-10-06T02:55:42.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.098+0000 7f18b62e1700 1 -- start start 2023-10-06T02:55:42.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b62e1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f18b0159480 0x7f18b00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b62e1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00b3610 0x7f18b00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b62e1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f18b00cc1b0 0x7f18b00b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b62e1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00cb7e0 con 0x7f18b00cc1b0 2023-10-06T02:55:42.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b62e1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00b08a0 con 0x7f18b0159480 2023-10-06T02:55:42.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b62e1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00cb190 con 0x7f18b00b3610 2023-10-06T02:55:42.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b5ae0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f18b00cc1b0 0x7f18b00b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b5ae0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f18b00cc1b0 0x7f18b00b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54576/0 (socket says 172.21.15.84:54576) 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b5ae0700 1 -- 172.21.15.84:0/893920507 learned_addr learned my addr 172.21.15.84:0/893920507 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b52df700 1 --2- 172.21.15.84:0/893920507 >> v2:172.21.15.131:3300/0 conn(0x7f18b0159480 0x7f18b00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b4ade700 1 --2- 172.21.15.84:0/893920507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00b3610 0x7f18b00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b5ae0700 1 -- 172.21.15.84:0/893920507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00b3610 msgr2=0x7f18b00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b5ae0700 1 --2- 172.21.15.84:0/893920507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00b3610 0x7f18b00cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b5ae0700 1 -- 172.21.15.84:0/893920507 >> v2:172.21.15.131:3300/0 conn(0x7f18b0159480 msgr2=0x7f18b00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b5ae0700 1 --2- 172.21.15.84:0/893920507 >> v2:172.21.15.131:3300/0 conn(0x7f18b0159480 0x7f18b00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b5ae0700 1 -- 172.21.15.84:0/893920507 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b00cb470 con 0x7f18b00cc1b0 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b4ade700 1 --2- 172.21.15.84:0/893920507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00b3610 0x7f18b00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18b5ae0700 1 --2- 172.21.15.84:0/893920507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00cc1b0 0x7f18b00b2140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f18b006fa30 tx=0x7f18a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9766e5a56b7119 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.099+0000 7f18a7fff700 1 -- 172.21.15.84:0/893920507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800e070 con 0x7f18b00cc1b0 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18a7fff700 1 -- 172.21.15.84:0/893920507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a800ba20 con 0x7f18b00cc1b0 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18a7fff700 1 -- 172.21.15.84:0/893920507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80092e0 con 0x7f18b00cc1b0 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18b62e1700 1 -- 172.21.15.84:0/893920507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00cc1b0 msgr2=0x7f18b00b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18b62e1700 1 --2- 172.21.15.84:0/893920507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00cc1b0 0x7f18b00b2140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f18b006fa30 tx=0x7f18a8009840 comp rx=0 tx=0).stop 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18b62e1700 1 -- 172.21.15.84:0/893920507 shutdown_connections 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18b62e1700 1 --2- 172.21.15.84:0/893920507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b00cc1b0 0x7f18b00b2140 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18b62e1700 1 --2- 172.21.15.84:0/893920507 >> v2:172.21.15.131:3300/0 conn(0x7f18b0159480 0x7f18b00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18b62e1700 1 --2- 172.21.15.84:0/893920507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00b3610 0x7f18b00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18b62e1700 1 -- 172.21.15.84:0/893920507 >> 172.21.15.84:0/893920507 conn(0x7f18b006ed20 msgr2=0x7f18b006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18b62e1700 1 -- 172.21.15.84:0/893920507 shutdown_connections 2023-10-06T02:55:42.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.100+0000 7f18b62e1700 1 -- 172.21.15.84:0/893920507 wait complete. 2023-10-06T02:55:42.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.101+0000 7f18b62e1700 1 Processor -- start 2023-10-06T02:55:42.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.101+0000 7f18b62e1700 1 -- start start 2023-10-06T02:55:42.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b62e1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18b00b3610 0x7f18b0154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b62e1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00cc1b0 0x7f18b00cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b62e1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b0159480 0x7f18b00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b62e1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b015fb30 con 0x7f18b0159480 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b62e1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00c4c90 con 0x7f18b00b3610 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b62e1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b0155500 con 0x7f18b00cc1b0 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b5ae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b0159480 0x7f18b00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b5ae0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b0159480 0x7f18b00ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54578/0 (socket says 172.21.15.84:54578) 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b5ae0700 1 -- 172.21.15.84:0/327339296 learned_addr learned my addr 172.21.15.84:0/327339296 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b52df700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18b00b3610 0x7f18b0154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.102+0000 7f18b4ade700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00cc1b0 0x7f18b00cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18b5ae0700 1 -- 172.21.15.84:0/327339296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00cc1b0 msgr2=0x7f18b00cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18b5ae0700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00cc1b0 0x7f18b00cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18b5ae0700 1 -- 172.21.15.84:0/327339296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18b00b3610 msgr2=0x7f18b0154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18b5ae0700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18b00b3610 0x7f18b0154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18b5ae0700 1 -- 172.21.15.84:0/327339296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8009ae0 con 0x7f18b0159480 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18b5ae0700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b0159480 0x7f18b00ce370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f18b0069190 tx=0x7f18a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18a57fa700 1 -- 172.21.15.84:0/327339296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80032f0 con 0x7f18b0159480 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18a57fa700 1 -- 172.21.15.84:0/327339296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8026460 con 0x7f18b0159480 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b00c4680 con 0x7f18b0159480 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18a57fa700 1 -- 172.21.15.84:0/327339296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8026800 con 0x7f18b0159480 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.103+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b00c4920 con 0x7f18b0159480 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.104+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b00c44e0 con 0x7f18b0159480 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.104+0000 7f18a57fa700 1 -- 172.21.15.84:0/327339296 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18a8003040 con 0x7f18b0159480 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.104+0000 7f18a57fa700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1894066f30 0x7f18940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.105+0000 7f18a57fa700 1 -- 172.21.15.84:0/327339296 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f18a8086ad0 con 0x7f18b0159480 2023-10-06T02:55:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.105+0000 7f18b52df700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1894066f30 0x7f18940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.105+0000 7f18b52df700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1894066f30 0x7f18940693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18b00b0670 tx=0x7f18ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.109+0000 7f18a57fa700 1 -- 172.21.15.84:0/327339296 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18b00c44e0 con 0x7f18b0159480 2023-10-06T02:55:42.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.293+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b00c44e0 con 0x7f18b0159480 2023-10-06T02:55:42.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.294+0000 7f18a57fa700 1 -- 172.21.15.84:0/327339296 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f18b00c44e0 con 0x7f18b0159480 2023-10-06T02:55:42.296 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:42.296 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1894066f30 msgr2=0x7f18940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1894066f30 0x7f18940693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18b00b0670 tx=0x7f18ac008040 comp rx=0 tx=0).stop 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b0159480 msgr2=0x7f18b00ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b0159480 0x7f18b00ce370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f18b0069190 tx=0x7f18a8018000 comp rx=0 tx=0).stop 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 shutdown_connections 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1894066f30 0x7f18940693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18b00b3610 0x7f18b0154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b0159480 0x7f18b00ce370 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 --2- 172.21.15.84:0/327339296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18b00cc1b0 0x7f18b00cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 >> 172.21.15.84:0/327339296 conn(0x7f18b006ed20 msgr2=0x7f18b00b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 shutdown_connections 2023-10-06T02:55:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.297+0000 7f18b62e1700 1 -- 172.21.15.84:0/327339296 wait complete. 2023-10-06T02:55:42.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:55:05.120029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:55:05.566741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:55:09.247969+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:55:42.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:42.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.427+0000 7fb9eceef700 1 Processor -- start 2023-10-06T02:55:42.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.427+0000 7fb9eceef700 1 -- start start 2023-10-06T02:55:42.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9eceef700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9e80cd400 0x7fb9e80ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9eceef700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80cc9b0 con 0x7fb9e80b2660 2023-10-06T02:55:42.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9eceef700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80cbda0 con 0x7fb9e80b2a30 2023-10-06T02:55:42.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9eceef700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e80cc080 con 0x7fb9e80cd400 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb9e80b2660 0x7fb9e80cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51592/0 (socket says 172.21.15.84:51592) 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e77fe700 1 -- 172.21.15.84:0/1589441700 learned_addr learned my addr 172.21.15.84:0/1589441700 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e6ffd700 1 --2- 172.21.15.84:0/1589441700 >> v2:172.21.15.131:3300/0 conn(0x7fb9e80cd400 0x7fb9e80ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029882173 0 0) 0x7fb9e80cc9b0 con 0x7fb9e80b2660 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d0003570 con 0x7fb9e80b2660 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829195076 0 0) 0x7fb9e80cbda0 con 0x7fb9e80b2a30 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e80cc9b0 con 0x7fb9e80b2a30 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2374359914 0 0) 0x7fb9d0003570 con 0x7fb9e80b2660 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 >> v2:172.21.15.131:3300/0 conn(0x7fb9e80cd400 msgr2=0x7fb9e80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 --2- 172.21.15.84:0/1589441700 >> v2:172.21.15.131:3300/0 conn(0x7fb9e80cd400 0x7fb9e80ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 >> v1:172.21.15.131:6789/0 conn(0x7fb9e80b2a30 legacy=0x7fb9e80c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80cc360 con 0x7fb9e80b2660 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fb9d8001970 con 0x7fb9e80b2660 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 >> v1:172.21.15.84:6789/0 conn(0x7fb9e80b2660 legacy=0x7fb9e80cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9d0003c40 0x7fb9d0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9d0004810 0x7fb9d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80cc080 con 0x7fb9d0005210 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d000c130 con 0x7fb9d0004810 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.428+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d000c2c0 con 0x7fb9d0003c40 2023-10-06T02:55:42.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e7fff700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e6ffd700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9d0004810 0x7fb9d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e77fe700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9d0003c40 0x7fb9d0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e7fff700 1 -- 172.21.15.84:0/1589441700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9d0003c40 msgr2=0x7fb9d0004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e7fff700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9d0003c40 0x7fb9d0004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e7fff700 1 -- 172.21.15.84:0/1589441700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9d0004810 msgr2=0x7fb9d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e7fff700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9d0004810 0x7fb9d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e7fff700 1 -- 172.21.15.84:0/1589441700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d0003570 con 0x7fb9d0005210 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e7fff700 1 -- 172.21.15.84:0/1589441700 reap_dead start 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e7fff700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9d000ba60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0001a10 tx=0x7fb9e0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e548af927c9035 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000c590 con 0x7fb9d0005210 2023-10-06T02:55:42.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e000c6f0 con 0x7fb9d0005210 2023-10-06T02:55:42.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.429+0000 7fb9e67fc700 1 -- 172.21.15.84:0/1589441700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000ca90 con 0x7fb9d0005210 2023-10-06T02:55:42.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.430+0000 7fb9eceef700 1 -- 172.21.15.84:0/1589441700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 msgr2=0x7fb9d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.430+0000 7fb9eceef700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9d000ba60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0001a10 tx=0x7fb9e0007d30 comp rx=0 tx=0).stop 2023-10-06T02:55:42.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.430+0000 7fb9eceef700 1 -- 172.21.15.84:0/1589441700 shutdown_connections 2023-10-06T02:55:42.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.430+0000 7fb9eceef700 1 --2- 172.21.15.84:0/1589441700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9d000ba60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.430+0000 7fb9eceef700 1 -- 172.21.15.84:0/1589441700 >> 172.21.15.84:0/1589441700 conn(0x7fb9e8099560 msgr2=0x7fb9e806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:42.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.430+0000 7fb9eceef700 1 -- 172.21.15.84:0/1589441700 shutdown_connections 2023-10-06T02:55:42.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.430+0000 7fb9eceef700 1 -- 172.21.15.84:0/1589441700 wait complete. 2023-10-06T02:55:42.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.431+0000 7fb9eceef700 1 Processor -- start 2023-10-06T02:55:42.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.431+0000 7fb9eceef700 1 -- start start 2023-10-06T02:55:42.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9eceef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9e80b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9eceef700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e80c7dd0 0x7fb9e8150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9eceef700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e8155b60 0x7fb9e8155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9eceef700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8156510 con 0x7fb9d0005210 2023-10-06T02:55:42.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9eceef700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c8520 con 0x7fb9e8155b60 2023-10-06T02:55:42.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9eceef700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c8800 con 0x7fb9e80c7dd0 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9e77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9e80b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9e77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9e80b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40262/0 (socket says 172.21.15.84:40262) 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9e77fe700 1 -- 172.21.15.84:0/1452262106 learned_addr learned my addr 172.21.15.84:0/1452262106 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9e77fe700 1 -- 172.21.15.84:0/1452262106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e80c7dd0 msgr2=0x7fb9e8150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9e77fe700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e80c7dd0 0x7fb9e8150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9e77fe700 1 -- 172.21.15.84:0/1452262106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e8155b60 msgr2=0x7fb9e8155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9e77fe700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e8155b60 0x7fb9e8155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9e77fe700 1 -- 172.21.15.84:0/1452262106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80c8ae0 con 0x7fb9d0005210 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9e77fe700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9e80b4d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8001190 tx=0x7fb9d8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9cf7fe700 1 -- 172.21.15.84:0/1452262106 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8005e50 con 0x7fb9d0005210 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9cf7fe700 1 -- 172.21.15.84:0/1452262106 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800d760 con 0x7fb9d0005210 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e80c8dc0 con 0x7fb9d0005210 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9cf7fe700 1 -- 172.21.15.84:0/1452262106 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800db20 con 0x7fb9d0005210 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.432+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e80c9130 con 0x7fb9d0005210 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.433+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e8169860 con 0x7fb9d0005210 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.434+0000 7fb9cf7fe700 1 -- 172.21.15.84:0/1452262106 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9d8007070 con 0x7fb9d0005210 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.434+0000 7fb9cf7fe700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb9d4066f30 0x7fb9d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.434+0000 7fb9cf7fe700 1 -- 172.21.15.84:0/1452262106 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb9d8084d60 con 0x7fb9d0005210 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.434+0000 7fb9e6ffd700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb9d4066f30 0x7fb9d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.435+0000 7fb9e6ffd700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb9d4066f30 0x7fb9d40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009170 tx=0x7fb9dc0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.438+0000 7fb9cf7fe700 1 -- 172.21.15.84:0/1452262106 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9d8051b80 con 0x7fb9d0005210 2023-10-06T02:55:42.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.618+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9e805f270 con 0x7fb9d0005210 2023-10-06T02:55:42.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.618+0000 7fb9cf7fe700 1 -- 172.21.15.84:0/1452262106 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9d80551a0 con 0x7fb9d0005210 2023-10-06T02:55:42.620 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:55:42.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb9d4066f30 msgr2=0x7fb9d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb9d4066f30 0x7fb9d40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009170 tx=0x7fb9dc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 msgr2=0x7fb9e80b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9e80b4d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8001190 tx=0x7fb9d8009040 comp rx=0 tx=0).stop 2023-10-06T02:55:42.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 shutdown_connections 2023-10-06T02:55:42.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb9d4066f30 0x7fb9d40693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9e8155b60 0x7fb9e8155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9d0005210 0x7fb9e80b4d80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 --2- 172.21.15.84:0/1452262106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9e80c7dd0 0x7fb9e8150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.620+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 >> 172.21.15.84:0/1452262106 conn(0x7fb9e8099560 msgr2=0x7fb9e8157870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:42.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.621+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 shutdown_connections 2023-10-06T02:55:42.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.621+0000 7fb9eceef700 1 -- 172.21.15.84:0/1452262106 wait complete. 2023-10-06T02:55:42.634 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:42.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.750+0000 7f9a3cb71700 1 Processor -- start 2023-10-06T02:55:42.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.750+0000 7f9a3cb71700 1 -- start start 2023-10-06T02:55:42.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.751+0000 7f9a3cb71700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a380cbc40 0x7f9a38164180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.751+0000 7f9a3cb71700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a380afbe0 con 0x7f9a38159710 2023-10-06T02:55:42.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.751+0000 7f9a3cb71700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a380cf820 con 0x7f9a38159340 2023-10-06T02:55:42.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.751+0000 7f9a3cb71700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380cfb00 con 0x7f9a380cbc40 2023-10-06T02:55:42.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.751+0000 7f9a2dd9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9a38159710 0x7f9a380cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51604/0 (socket says 172.21.15.84:51604) 2023-10-06T02:55:42.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.751+0000 7f9a2dd9b700 1 -- 172.21.15.84:0/1810915912 learned_addr learned my addr 172.21.15.84:0/1810915912 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a36d9d700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a380cbc40 0x7f9a38164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603789835 0 0) 0x7f9a20001110 con 0x7f9a38159710 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a24003570 con 0x7f9a38159710 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1121951057 0 0) 0x7f9a24003570 con 0x7f9a38159710 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a380cbc40 msgr2=0x7f9a38164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a380cbc40 0x7f9a38164180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 >> v1:172.21.15.131:6789/0 conn(0x7f9a38159340 legacy=0x7f9a380af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380cfde0 con 0x7f9a38159710 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f9a20001600 con 0x7f9a38159710 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 >> v1:172.21.15.84:6789/0 conn(0x7f9a38159710 legacy=0x7f9a380cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a380cbc40 0x7f9a24003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a24004010 0x7f9a24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a24004d50 0x7f9a240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380cfb00 con 0x7f9a24004010 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2400bbf0 con 0x7f9a24004d50 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2400bdb0 con 0x7f9a380cbc40 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a2dd9b700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a24004010 0x7f9a24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a3659c700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a380cbc40 0x7f9a24003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a36d9d700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a24004d50 0x7f9a240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a2dd9b700 1 -- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a380cbc40 msgr2=0x7f9a24003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a2dd9b700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a380cbc40 0x7f9a24003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a2dd9b700 1 -- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a24004d50 msgr2=0x7f9a240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:42.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a2dd9b700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a24004d50 0x7f9a240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a2dd9b700 1 -- 172.21.15.84:0/1810915912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a24003570 con 0x7f9a24004010 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.752+0000 7f9a2dd9b700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a24004010 0x7f9a24004810 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a20001ed0 tx=0x7f9a20007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5863a9060c4e4eff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000cd90 con 0x7f9a24004010 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a20005920 con 0x7f9a24004010 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a35d9b700 1 -- 172.21.15.84:0/1810915912 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20005ce0 con 0x7f9a24004010 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1810915912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a24004010 msgr2=0x7f9a24004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a3cb71700 1 --2- 172.21.15.84:0/1810915912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a24004010 0x7f9a24004810 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a20001ed0 tx=0x7f9a20007a50 comp rx=0 tx=0).stop 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a36d9d700 1 -- 172.21.15.84:0/1810915912 reap_dead start 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1810915912 shutdown_connections 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1810915912 >> 172.21.15.84:0/1810915912 conn(0x7f9a38099720 msgr2=0x7f9a3806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1810915912 shutdown_connections 2023-10-06T02:55:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.753+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1810915912 wait complete. 2023-10-06T02:55:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.754+0000 7f9a3cb71700 1 Processor -- start 2023-10-06T02:55:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a3cb71700 1 -- start start 2023-10-06T02:55:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a3cb71700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a24004010 0x7f9a3814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a3cb71700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a380b44c0 0x7f9a380c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a3cb71700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a380b4bc0 0x7f9a380b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a3cb71700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380b5580 con 0x7f9a380b4bc0 2023-10-06T02:55:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a3cb71700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380b4030 con 0x7f9a380b44c0 2023-10-06T02:55:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a3cb71700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380b3420 con 0x7f9a24004010 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a36d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a380b4bc0 0x7f9a380b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a36d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a380b4bc0 0x7f9a380b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40280/0 (socket says 172.21.15.84:40280) 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a36d9d700 1 -- 172.21.15.84:0/1334103827 learned_addr learned my addr 172.21.15.84:0/1334103827 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a3659c700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a24004010 0x7f9a3814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.755+0000 7f9a2dd9b700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a380b44c0 0x7f9a380c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a36d9d700 1 -- 172.21.15.84:0/1334103827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a24004010 msgr2=0x7f9a3814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a36d9d700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a24004010 0x7f9a3814af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a36d9d700 1 -- 172.21.15.84:0/1334103827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a380b44c0 msgr2=0x7f9a380c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a36d9d700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a380b44c0 0x7f9a380c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a36d9d700 1 -- 172.21.15.84:0/1334103827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380b3700 con 0x7f9a380b4bc0 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a36d9d700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a380b4bc0 0x7f9a380b5040 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a380cc040 tx=0x7f9a3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a2effd700 1 -- 172.21.15.84:0/1334103827 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3000e040 con 0x7f9a380b4bc0 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a2effd700 1 -- 172.21.15.84:0/1334103827 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3000f040 con 0x7f9a380b4bc0 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a380b39e0 con 0x7f9a380b4bc0 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a2effd700 1 -- 172.21.15.84:0/1334103827 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3000fd90 con 0x7f9a380b4bc0 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.756+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3814b450 con 0x7f9a380b4bc0 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.757+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a38064ad0 con 0x7f9a380b4bc0 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.757+0000 7f9a2effd700 1 -- 172.21.15.84:0/1334103827 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a30015640 con 0x7f9a380b4bc0 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.758+0000 7f9a2effd700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a18066f30 0x7f9a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.758+0000 7f9a2effd700 1 -- 172.21.15.84:0/1334103827 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9a30085320 con 0x7f9a380b4bc0 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.758+0000 7f9a3659c700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a18066f30 0x7f9a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.758+0000 7f9a3659c700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a18066f30 0x7f9a180693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a28007fd0 tx=0x7f9a28007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.762+0000 7f9a2effd700 1 -- 172.21.15.84:0/1334103827 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a30052140 con 0x7f9a380b4bc0 2023-10-06T02:55:42.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.943+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a380b4170 con 0x7f9a380b4bc0 2023-10-06T02:55:42.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.943+0000 7f9a2effd700 1 -- 172.21.15.84:0/1334103827 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a30055760 con 0x7f9a380b4bc0 2023-10-06T02:55:42.945 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:55:42.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a18066f30 msgr2=0x7f9a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a18066f30 0x7f9a180693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a28007fd0 tx=0x7f9a28007d80 comp rx=0 tx=0).stop 2023-10-06T02:55:42.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a380b4bc0 msgr2=0x7f9a380b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:42.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a380b4bc0 0x7f9a380b5040 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a380cc040 tx=0x7f9a3000b040 comp rx=0 tx=0).stop 2023-10-06T02:55:42.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 shutdown_connections 2023-10-06T02:55:42.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a18066f30 0x7f9a180693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a380b4bc0 0x7f9a380b5040 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a24004010 0x7f9a3814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 --2- 172.21.15.84:0/1334103827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a380b44c0 0x7f9a380c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:42.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.945+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 >> 172.21.15.84:0/1334103827 conn(0x7f9a38099720 msgr2=0x7f9a380d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:42.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.946+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 shutdown_connections 2023-10-06T02:55:42.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:42.946+0000 7f9a3cb71700 1 -- 172.21.15.84:0/1334103827 wait complete. 2023-10-06T02:55:42.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:55:43.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.074+0000 7f89709b7700 1 Processor -- start 2023-10-06T02:55:43.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.074+0000 7f89709b7700 1 -- start start 2023-10-06T02:55:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f89709b7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c159510 0x7f896c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f89709b7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f896c0cbae0 0x7f896c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f89709b7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c0cbf00 con 0x7f896c1598e0 2023-10-06T02:55:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f89709b7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c0cf610 con 0x7f896c0cbae0 2023-10-06T02:55:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f89709b7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0cf8f0 con 0x7f896c159510 2023-10-06T02:55:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f896c0cbae0 0x7f896c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f896c0cbae0 0x7f896c0cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40288/0 (socket says 172.21.15.84:40288) 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896ad9d700 1 -- 172.21.15.84:0/3256952059 learned_addr learned my addr 172.21.15.84:0/3256952059 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896a59c700 1 --2- 172.21.15.84:0/3256952059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c159510 0x7f896c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896ad9d700 1 -- 172.21.15.84:0/3256952059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c159510 msgr2=0x7f896c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896ad9d700 1 --2- 172.21.15.84:0/3256952059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c159510 0x7f896c0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896ad9d700 1 -- 172.21.15.84:0/3256952059 >> v1:172.21.15.131:6789/0 conn(0x7f896c1598e0 legacy=0x7f896c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896ad9d700 1 -- 172.21.15.84:0/3256952059 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0cfbd0 con 0x7f896c0cbae0 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896ad9d700 1 --2- 172.21.15.84:0/3256952059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c0cbae0 0x7f896c0cef30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89640099b0 tx=0x7f8964009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff28c2c21d75ab97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896959a700 1 -- 172.21.15.84:0/3256952059 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400b820 con 0x7f896c0cbae0 2023-10-06T02:55:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896959a700 1 -- 172.21.15.84:0/3256952059 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896400b980 con 0x7f896c0cbae0 2023-10-06T02:55:43.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.075+0000 7f896959a700 1 -- 172.21.15.84:0/3256952059 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400bd20 con 0x7f896c0cbae0 2023-10-06T02:55:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.076+0000 7f89709b7700 1 -- 172.21.15.84:0/3256952059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c0cbae0 msgr2=0x7f896c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.076+0000 7f89709b7700 1 --2- 172.21.15.84:0/3256952059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c0cbae0 0x7f896c0cef30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89640099b0 tx=0x7f8964009250 comp rx=0 tx=0).stop 2023-10-06T02:55:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.076+0000 7f89709b7700 1 -- 172.21.15.84:0/3256952059 shutdown_connections 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.076+0000 7f89709b7700 1 --2- 172.21.15.84:0/3256952059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c0cbae0 0x7f896c0cef30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.076+0000 7f89709b7700 1 --2- 172.21.15.84:0/3256952059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c159510 0x7f896c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.076+0000 7f89709b7700 1 -- 172.21.15.84:0/3256952059 >> 172.21.15.84:0/3256952059 conn(0x7f896c089e90 msgr2=0x7f896c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.076+0000 7f89709b7700 1 -- 172.21.15.84:0/3256952059 shutdown_connections 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.076+0000 7f89709b7700 1 -- 172.21.15.84:0/3256952059 wait complete. 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.077+0000 7f89709b7700 1 Processor -- start 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.077+0000 7f89709b7700 1 -- start start 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f89709b7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c0cbae0 0x7f896c14a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f89709b7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c159510 0x7f896c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f89709b7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f896c1598e0 0x7f896c0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f89709b7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c15a0f0 con 0x7f896c159510 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f89709b7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c15b690 con 0x7f896c1598e0 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f89709b7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c14aba0 con 0x7f896c0cbae0 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f8969d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c159510 0x7f896c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f8969d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c159510 0x7f896c15abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40290/0 (socket says 172.21.15.84:40290) 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f8969d9b700 1 -- 172.21.15.84:0/1390830466 learned_addr learned my addr 172.21.15.84:0/1390830466 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f896ad9d700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f896c1598e0 0x7f896c0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f896a59c700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c0cbae0 0x7f896c14a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f8969d9b700 1 -- 172.21.15.84:0/1390830466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c0cbae0 msgr2=0x7f896c14a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f8969d9b700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c0cbae0 0x7f896c14a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f8969d9b700 1 -- 172.21.15.84:0/1390830466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f896c1598e0 msgr2=0x7f896c0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f8969d9b700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f896c1598e0 0x7f896c0b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f8969d9b700 1 -- 172.21.15.84:0/1390830466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640094f0 con 0x7f896c159510 2023-10-06T02:55:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.078+0000 7f8969d9b700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c159510 0x7f896c15abf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f895400c5c0 tx=0x7f8954007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.079+0000 7f89627fc700 1 -- 172.21.15.84:0/1390830466 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954011590 con 0x7f896c159510 2023-10-06T02:55:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.079+0000 7f89627fc700 1 -- 172.21.15.84:0/1390830466 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89540116f0 con 0x7f896c159510 2023-10-06T02:55:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.079+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896c0b56d0 con 0x7f896c159510 2023-10-06T02:55:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.079+0000 7f89627fc700 1 -- 172.21.15.84:0/1390830466 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954011ab0 con 0x7f896c159510 2023-10-06T02:55:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.079+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c15b3b0 con 0x7f896c159510 2023-10-06T02:55:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.079+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c0b5860 con 0x7f896c159510 2023-10-06T02:55:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.080+0000 7f89627fc700 1 -- 172.21.15.84:0/1390830466 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f895401c460 con 0x7f896c159510 2023-10-06T02:55:43.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.080+0000 7f89627fc700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f894c066f30 0x7f894c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.080+0000 7f89627fc700 1 -- 172.21.15.84:0/1390830466 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f89540845b0 con 0x7f896c159510 2023-10-06T02:55:43.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.080+0000 7f896a59c700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f894c066f30 0x7f894c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.081+0000 7f896a59c700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f894c066f30 0x7f894c0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f896c154f80 tx=0x7f895c0077f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.084+0000 7f89627fc700 1 -- 172.21.15.84:0/1390830466 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89540513d0 con 0x7f896c159510 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.273+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f896c064ad0 con 0x7f896c159510 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.274+0000 7f89627fc700 1 -- 172.21.15.84:0/1390830466 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89540549f0 con 0x7f896c159510 2023-10-06T02:55:43.275 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f894c066f30 msgr2=0x7f894c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f894c066f30 0x7f894c0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f896c154f80 tx=0x7f895c0077f0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c159510 msgr2=0x7f896c15abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c159510 0x7f896c15abf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f895400c5c0 tx=0x7f8954007f30 comp rx=0 tx=0).stop 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 shutdown_connections 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f894c066f30 0x7f894c0693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f896c1598e0 0x7f896c0b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f896c0cbae0 0x7f896c14a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 --2- 172.21.15.84:0/1390830466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f896c159510 0x7f896c15abf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 >> 172.21.15.84:0/1390830466 conn(0x7f896c089e90 msgr2=0x7f896c14bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 shutdown_connections 2023-10-06T02:55:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.276+0000 7f89709b7700 1 -- 172.21.15.84:0/1390830466 wait complete. 2023-10-06T02:55:43.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:55:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.406+0000 7fa6c0193700 1 Processor -- start 2023-10-06T02:55:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.406+0000 7fa6c0193700 1 -- start start 2023-10-06T02:55:43.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6c0193700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6b81598e0 0x7fa6b80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6c0193700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6b80cbcb0 0x7fa6b80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6c0193700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b80cf610 con 0x7fa6b8159510 2023-10-06T02:55:43.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6c0193700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b80cf8f0 con 0x7fa6b80cbcb0 2023-10-06T02:55:43.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6c0193700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b80cfbd0 con 0x7fa6b81598e0 2023-10-06T02:55:43.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6be730700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6b80cbcb0 0x7fa6b80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6be730700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6b80cbcb0 0x7fa6b80ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40294/0 (socket says 172.21.15.84:40294) 2023-10-06T02:55:43.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6be730700 1 -- 172.21.15.84:0/3069829292 learned_addr learned my addr 172.21.15.84:0/3069829292 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:43.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6bd72e700 1 --2- 172.21.15.84:0/3069829292 >> v2:172.21.15.131:3300/0 conn(0x7fa6b81598e0 0x7fa6b80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6be730700 1 -- 172.21.15.84:0/3069829292 >> v2:172.21.15.131:3300/0 conn(0x7fa6b81598e0 msgr2=0x7fa6b80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6be730700 1 --2- 172.21.15.84:0/3069829292 >> v2:172.21.15.131:3300/0 conn(0x7fa6b81598e0 0x7fa6b80ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6be730700 1 -- 172.21.15.84:0/3069829292 >> v1:172.21.15.131:6789/0 conn(0x7fa6b8159510 legacy=0x7fa6b80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6be730700 1 -- 172.21.15.84:0/3069829292 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b80cfeb0 con 0x7fa6b80cbcb0 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6be730700 1 --2- 172.21.15.84:0/3069829292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b80cbcb0 0x7fa6b80ced60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80c73b0 tx=0x7fa6b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0e2b1ff22b2ad6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.407+0000 7fa6bcf2d700 1 -- 172.21.15.84:0/3069829292 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b000e070 con 0x7fa6b80cbcb0 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6bcf2d700 1 -- 172.21.15.84:0/3069829292 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b000ba10 con 0x7fa6b80cbcb0 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6bcf2d700 1 -- 172.21.15.84:0/3069829292 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b00092e0 con 0x7fa6b80cbcb0 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6c0193700 1 -- 172.21.15.84:0/3069829292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b80cbcb0 msgr2=0x7fa6b80ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6c0193700 1 --2- 172.21.15.84:0/3069829292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b80cbcb0 0x7fa6b80ced60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80c73b0 tx=0x7fa6b0009840 comp rx=0 tx=0).stop 2023-10-06T02:55:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6c0193700 1 -- 172.21.15.84:0/3069829292 shutdown_connections 2023-10-06T02:55:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6c0193700 1 --2- 172.21.15.84:0/3069829292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b80cbcb0 0x7fa6b80ced60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6c0193700 1 --2- 172.21.15.84:0/3069829292 >> v2:172.21.15.131:3300/0 conn(0x7fa6b81598e0 0x7fa6b80ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6c0193700 1 -- 172.21.15.84:0/3069829292 >> 172.21.15.84:0/3069829292 conn(0x7fa6b8089e90 msgr2=0x7fa6b80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6c0193700 1 -- 172.21.15.84:0/3069829292 shutdown_connections 2023-10-06T02:55:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.408+0000 7fa6c0193700 1 -- 172.21.15.84:0/3069829292 wait complete. 2023-10-06T02:55:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.409+0000 7fa6c0193700 1 Processor -- start 2023-10-06T02:55:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.409+0000 7fa6c0193700 1 -- start start 2023-10-06T02:55:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6c0193700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b80cbcb0 0x7fa6b8149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6c0193700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b8159510 0x7fa6b81572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6c0193700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b81598e0 0x7fa6b815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6c0193700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8157cd0 con 0x7fa6b81598e0 2023-10-06T02:55:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6c0193700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8157fb0 con 0x7fa6b80cbcb0 2023-10-06T02:55:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6c0193700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8158290 con 0x7fa6b8159510 2023-10-06T02:55:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6be730700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b81598e0 0x7fa6b815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6be730700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b81598e0 0x7fa6b815d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40304/0 (socket says 172.21.15.84:40304) 2023-10-06T02:55:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6be730700 1 -- 172.21.15.84:0/3767116021 learned_addr learned my addr 172.21.15.84:0/3767116021 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6bd72e700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b8159510 0x7fa6b81572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6bdf2f700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b80cbcb0 0x7fa6b8149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6be730700 1 -- 172.21.15.84:0/3767116021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b8159510 msgr2=0x7fa6b81572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6be730700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b8159510 0x7fa6b81572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6be730700 1 -- 172.21.15.84:0/3767116021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b80cbcb0 msgr2=0x7fa6b8149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6be730700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b80cbcb0 0x7fa6b8149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6be730700 1 -- 172.21.15.84:0/3767116021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b0009ae0 con 0x7fa6b81598e0 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.410+0000 7fa6bdf2f700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b80cbcb0 0x7fa6b8149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.411+0000 7fa6be730700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b81598e0 0x7fa6b815d3c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0003000 tx=0x7fa6b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.411+0000 7fa6adffb700 1 -- 172.21.15.84:0/3767116021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b00092e0 con 0x7fa6b81598e0 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.411+0000 7fa6adffb700 1 -- 172.21.15.84:0/3767116021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b0012db0 con 0x7fa6b81598e0 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.411+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b8158570 con 0x7fa6b81598e0 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.411+0000 7fa6adffb700 1 -- 172.21.15.84:0/3767116021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b001e660 con 0x7fa6b81598e0 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.411+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b80c8200 con 0x7fa6b81598e0 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.412+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b81588c0 con 0x7fa6b81598e0 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.412+0000 7fa6adffb700 1 -- 172.21.15.84:0/3767116021 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6b001ea10 con 0x7fa6b81598e0 2023-10-06T02:55:43.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.413+0000 7fa6adffb700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa69c066f30 0x7fa69c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.413+0000 7fa6adffb700 1 -- 172.21.15.84:0/3767116021 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa6b00863d0 con 0x7fa6b81598e0 2023-10-06T02:55:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.413+0000 7fa6bdf2f700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa69c066f30 0x7fa69c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.413+0000 7fa6bdf2f700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa69c066f30 0x7fa69c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80682f0 tx=0x7fa6b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.417+0000 7fa6adffb700 1 -- 172.21.15.84:0/3767116021 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6b00531f0 con 0x7fa6b81598e0 2023-10-06T02:55:43.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.598+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6b80c8200 con 0x7fa6b81598e0 2023-10-06T02:55:43.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.599+0000 7fa6adffb700 1 -- 172.21.15.84:0/3767116021 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6b80c8200 con 0x7fa6b81598e0 2023-10-06T02:55:43.600 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa69c066f30 msgr2=0x7fa69c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa69c066f30 0x7fa69c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80682f0 tx=0x7fa6b4008040 comp rx=0 tx=0).stop 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b81598e0 msgr2=0x7fa6b815d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b81598e0 0x7fa6b815d3c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0003000 tx=0x7fa6b0017000 comp rx=0 tx=0).stop 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 shutdown_connections 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa69c066f30 0x7fa69c0693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b80cbcb0 0x7fa6b8149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b81598e0 0x7fa6b815d3c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 --2- 172.21.15.84:0/3767116021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6b8159510 0x7fa6b81572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 >> 172.21.15.84:0/3767116021 conn(0x7fa6b8089e90 msgr2=0x7fa6b80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 shutdown_connections 2023-10-06T02:55:43.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.601+0000 7fa6c0193700 1 -- 172.21.15.84:0/3767116021 wait complete. 2023-10-06T02:55:43.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:55:43.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.729+0000 7f8bfde0e700 1 Processor -- start 2023-10-06T02:55:43.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.729+0000 7f8bfde0e700 1 -- start start 2023-10-06T02:55:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.730+0000 7f8bfde0e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8bf8159510 0x7f8bf80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.730+0000 7f8bfde0e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80cbf20 con 0x7f8bf80cbae0 2023-10-06T02:55:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.730+0000 7f8bfde0e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80cf610 con 0x7f8bf81598e0 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.730+0000 7f8bfde0e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80cf8f0 con 0x7f8bf8159510 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.730+0000 7f8bf77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8bf8159510 0x7f8bf80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.730+0000 7f8bf7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8bf80cbae0 0x7f8bf80c56d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51610/0 (socket says 172.21.15.84:51610) 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.730+0000 7f8bf7fff700 1 -- 172.21.15.84:0/3993362900 learned_addr learned my addr 172.21.15.84:0/3993362900 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bf77fe700 1 -- 172.21.15.84:0/3993362900 >> v1:172.21.15.131:6789/0 conn(0x7f8bf81598e0 legacy=0x7f8bf80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bf77fe700 1 -- 172.21.15.84:0/3993362900 >> v1:172.21.15.84:6789/0 conn(0x7f8bf80cbae0 legacy=0x7f8bf80c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bf77fe700 1 -- 172.21.15.84:0/3993362900 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80cfbd0 con 0x7f8bf8159510 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bf67fc700 1 -- 172.21.15.84:0/3993362900 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140978722 0 0) 0x7f8bf80cbf20 con 0x7f8bf80cbae0 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bf77fe700 1 --2- 172.21.15.84:0/3993362900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf8159510 0x7f8bf80cb5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009e60 tx=0x7f8be8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b39b0bba4468ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bf67fc700 1 -- 172.21.15.84:0/3993362900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800e070 con 0x7f8bf8159510 2023-10-06T02:55:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bf67fc700 1 -- 172.21.15.84:0/3993362900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800bc30 con 0x7f8bf8159510 2023-10-06T02:55:43.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bf67fc700 1 -- 172.21.15.84:0/3993362900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8012430 con 0x7f8bf8159510 2023-10-06T02:55:43.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3993362900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf8159510 msgr2=0x7f8bf80cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bfde0e700 1 --2- 172.21.15.84:0/3993362900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf8159510 0x7f8bf80cb5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009e60 tx=0x7f8be8009780 comp rx=0 tx=0).stop 2023-10-06T02:55:43.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3993362900 shutdown_connections 2023-10-06T02:55:43.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bfde0e700 1 --2- 172.21.15.84:0/3993362900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf8159510 0x7f8bf80cb5a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3993362900 >> 172.21.15.84:0/3993362900 conn(0x7f8bf8089e90 msgr2=0x7f8bf80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3993362900 shutdown_connections 2023-10-06T02:55:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.731+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3993362900 wait complete. 2023-10-06T02:55:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.733+0000 7f8bfde0e700 1 Processor -- start 2023-10-06T02:55:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.733+0000 7f8bfde0e700 1 -- start start 2023-10-06T02:55:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.733+0000 7f8bfde0e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf80cbae0 0x7f8bf80b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.733+0000 7f8bfde0e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bf8159510 0x7f8bf814d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.733+0000 7f8bfde0e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bf81598e0 0x7f8bf815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.733+0000 7f8bfde0e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80b4a00 con 0x7f8bf80cbae0 2023-10-06T02:55:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.733+0000 7f8bfde0e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80b5260 con 0x7f8bf81598e0 2023-10-06T02:55:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.733+0000 7f8bfde0e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf814d5e0 con 0x7f8bf8159510 2023-10-06T02:55:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf80cbae0 0x7f8bf80b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf80cbae0 0x7f8bf80b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40328/0 (socket says 172.21.15.84:40328) 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf77fe700 1 -- 172.21.15.84:0/3546246440 learned_addr learned my addr 172.21.15.84:0/3546246440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf7fff700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bf81598e0 0x7f8bf815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf6ffd700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bf8159510 0x7f8bf814d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf77fe700 1 -- 172.21.15.84:0/3546246440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bf8159510 msgr2=0x7f8bf814d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf77fe700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bf8159510 0x7f8bf814d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf77fe700 1 -- 172.21.15.84:0/3546246440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bf81598e0 msgr2=0x7f8bf815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf77fe700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bf81598e0 0x7f8bf815c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf77fe700 1 -- 172.21.15.84:0/3546246440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8009a20 con 0x7f8bf80cbae0 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bf77fe700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf80cbae0 0x7f8bf80b56f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8be80099f0 tx=0x7f8be8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bdf7fe700 1 -- 172.21.15.84:0/3546246440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be801b420 con 0x7f8bf80cbae0 2023-10-06T02:55:43.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bdf7fe700 1 -- 172.21.15.84:0/3546246440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be801b580 con 0x7f8bf80cbae0 2023-10-06T02:55:43.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf816e3d0 con 0x7f8bf80cbae0 2023-10-06T02:55:43.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bdf7fe700 1 -- 172.21.15.84:0/3546246440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be801b940 con 0x7f8bf80cbae0 2023-10-06T02:55:43.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.734+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf80b4ef0 con 0x7f8bf80cbae0 2023-10-06T02:55:43.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.735+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf80b5540 con 0x7f8bf80cbae0 2023-10-06T02:55:43.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.736+0000 7f8bdf7fe700 1 -- 172.21.15.84:0/3546246440 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8be801bcf0 con 0x7f8bf80cbae0 2023-10-06T02:55:43.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.736+0000 7f8bdf7fe700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8be4066f30 0x7f8be40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:43.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.736+0000 7f8bdf7fe700 1 -- 172.21.15.84:0/3546246440 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8be8086740 con 0x7f8bf80cbae0 2023-10-06T02:55:43.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.736+0000 7f8bf6ffd700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8be4066f30 0x7f8be40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:43.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.736+0000 7f8bf6ffd700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8be4066f30 0x7f8be40693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80c6e00 tx=0x7f8bec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:43.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.740+0000 7f8bdf7fe700 1 -- 172.21.15.84:0/3546246440 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8be8053560 con 0x7f8bf80cbae0 2023-10-06T02:55:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.925+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8bf8064ad0 con 0x7f8bf80cbae0 2023-10-06T02:55:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.925+0000 7f8bdf7fe700 1 -- 172.21.15.84:0/3546246440 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8be8056b80 con 0x7f8bf80cbae0 2023-10-06T02:55:43.927 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8be4066f30 msgr2=0x7f8be40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8be4066f30 0x7f8be40693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80c6e00 tx=0x7f8bec009040 comp rx=0 tx=0).stop 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf80cbae0 msgr2=0x7f8bf80b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf80cbae0 0x7f8bf80b56f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8be80099f0 tx=0x7f8be8019000 comp rx=0 tx=0).stop 2023-10-06T02:55:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 shutdown_connections 2023-10-06T02:55:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8be4066f30 0x7f8be40693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bf81598e0 0x7f8bf815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bf80cbae0 0x7f8bf80b56f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 --2- 172.21.15.84:0/3546246440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bf8159510 0x7f8bf814d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 >> 172.21.15.84:0/3546246440 conn(0x7f8bf8089e90 msgr2=0x7f8bf814eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 shutdown_connections 2023-10-06T02:55:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:43.927+0000 7f8bfde0e700 1 -- 172.21.15.84:0/3546246440 wait complete. 2023-10-06T02:55:43.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:44.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.054+0000 7f10c0f09700 1 Processor -- start 2023-10-06T02:55:44.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.054+0000 7f10c0f09700 1 -- start start 2023-10-06T02:55:44.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10c0f09700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10bc159480 0x7f10bc0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10c0f09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f10bc0b2140 0x7f10bc0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10c0f09700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0cb7e0 con 0x7f10bc0b3610 2023-10-06T02:55:44.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10c0f09700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0b08a0 con 0x7f10bc0b2140 2023-10-06T02:55:44.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10c0f09700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0cb190 con 0x7f10bc159480 2023-10-06T02:55:44.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f10bc0b2140 0x7f10bc0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bbfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f10bc0b2140 0x7f10bc0b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40344/0 (socket says 172.21.15.84:40344) 2023-10-06T02:55:44.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bbfff700 1 -- 172.21.15.84:0/717986332 learned_addr learned my addr 172.21.15.84:0/717986332 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bb7fe700 1 --2- 172.21.15.84:0/717986332 >> v2:172.21.15.131:3300/0 conn(0x7f10bc159480 0x7f10bc0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bbfff700 1 -- 172.21.15.84:0/717986332 >> v2:172.21.15.131:3300/0 conn(0x7f10bc159480 msgr2=0x7f10bc0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bbfff700 1 --2- 172.21.15.84:0/717986332 >> v2:172.21.15.131:3300/0 conn(0x7f10bc159480 0x7f10bc0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bbfff700 1 -- 172.21.15.84:0/717986332 >> v1:172.21.15.131:6789/0 conn(0x7f10bc0b3610 legacy=0x7f10bc0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bbfff700 1 -- 172.21.15.84:0/717986332 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0cb470 con 0x7f10bc0b2140 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bb7fe700 1 --2- 172.21.15.84:0/717986332 >> v2:172.21.15.131:3300/0 conn(0x7f10bc159480 0x7f10bc0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10bbfff700 1 --2- 172.21.15.84:0/717986332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc0b2140 0x7f10bc0b2560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f10bc06fa30 tx=0x7f10b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2d882a67d7dbc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.055+0000 7f10ba7fc700 1 -- 172.21.15.84:0/717986332 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b400e070 con 0x7f10bc0b2140 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10ba7fc700 1 -- 172.21.15.84:0/717986332 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b400ba10 con 0x7f10bc0b2140 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10ba7fc700 1 -- 172.21.15.84:0/717986332 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b40092e0 con 0x7f10bc0b2140 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10c0f09700 1 -- 172.21.15.84:0/717986332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc0b2140 msgr2=0x7f10bc0b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10c0f09700 1 --2- 172.21.15.84:0/717986332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc0b2140 0x7f10bc0b2560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f10bc06fa30 tx=0x7f10b4009840 comp rx=0 tx=0).stop 2023-10-06T02:55:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10c0f09700 1 -- 172.21.15.84:0/717986332 shutdown_connections 2023-10-06T02:55:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10c0f09700 1 --2- 172.21.15.84:0/717986332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc0b2140 0x7f10bc0b2560 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10c0f09700 1 --2- 172.21.15.84:0/717986332 >> v2:172.21.15.131:3300/0 conn(0x7f10bc159480 0x7f10bc0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10c0f09700 1 -- 172.21.15.84:0/717986332 >> 172.21.15.84:0/717986332 conn(0x7f10bc06ed20 msgr2=0x7f10bc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10c0f09700 1 -- 172.21.15.84:0/717986332 shutdown_connections 2023-10-06T02:55:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.056+0000 7f10c0f09700 1 -- 172.21.15.84:0/717986332 wait complete. 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.057+0000 7f10c0f09700 1 Processor -- start 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.057+0000 7f10c0f09700 1 -- start start 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10c0f09700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0b2140 0x7f10bc0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10c0f09700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0b3610 0x7f10bc0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10c0f09700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc159480 0x7f10bc153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10c0f09700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0ca000 con 0x7f10bc159480 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10c0f09700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0c7310 con 0x7f10bc0b3610 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10c0f09700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0c4a80 con 0x7f10bc0b2140 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc159480 0x7f10bc153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc159480 0x7f10bc153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40352/0 (socket says 172.21.15.84:40352) 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bbfff700 1 -- 172.21.15.84:0/4175703543 learned_addr learned my addr 172.21.15.84:0/4175703543 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10baffd700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0b3610 0x7f10bc0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bb7fe700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0b2140 0x7f10bc0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bbfff700 1 -- 172.21.15.84:0/4175703543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0b2140 msgr2=0x7f10bc0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bbfff700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0b2140 0x7f10bc0c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bbfff700 1 -- 172.21.15.84:0/4175703543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0b3610 msgr2=0x7f10bc0b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bbfff700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0b3610 0x7f10bc0b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bbfff700 1 -- 172.21.15.84:0/4175703543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4009ae0 con 0x7f10bc159480 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.058+0000 7f10bb7fe700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0b2140 0x7f10bc0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.059+0000 7f10bbfff700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc159480 0x7f10bc153450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f10bc069190 tx=0x7f10b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.059+0000 7f10a37fe700 1 -- 172.21.15.84:0/4175703543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b40094e0 con 0x7f10bc159480 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.059+0000 7f10a37fe700 1 -- 172.21.15.84:0/4175703543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b40032f0 con 0x7f10bc159480 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.059+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc0c56f0 con 0x7f10bc159480 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.059+0000 7f10a37fe700 1 -- 172.21.15.84:0/4175703543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b401d420 con 0x7f10bc159480 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.059+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc0c5d30 con 0x7f10bc159480 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.060+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc154930 con 0x7f10bc159480 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.060+0000 7f10a37fe700 1 -- 172.21.15.84:0/4175703543 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10b401d810 con 0x7f10bc159480 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.060+0000 7f10a37fe700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10a8066f30 0x7f10a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.061+0000 7f10a37fe700 1 -- 172.21.15.84:0/4175703543 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f10b40861e0 con 0x7f10bc159480 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.061+0000 7f10bb7fe700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10a8066f30 0x7f10a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.061+0000 7f10bb7fe700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10a8066f30 0x7f10a80693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10ac006fd0 tx=0x7f10ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.065+0000 7f10a37fe700 1 -- 172.21.15.84:0/4175703543 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10b4052f60 con 0x7f10bc159480 2023-10-06T02:55:44.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.254+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10bc0c74a0 con 0x7f10bc159480 2023-10-06T02:55:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.255+0000 7f10a37fe700 1 -- 172.21.15.84:0/4175703543 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f10b4056580 con 0x7f10bc159480 2023-10-06T02:55:44.257 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:44.257 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:11.623432+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10a8066f30 msgr2=0x7f10a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10a8066f30 0x7f10a80693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10ac006fd0 tx=0x7f10ac008040 comp rx=0 tx=0).stop 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc159480 msgr2=0x7f10bc153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc159480 0x7f10bc153450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f10bc069190 tx=0x7f10b4017000 comp rx=0 tx=0).stop 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 shutdown_connections 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10a8066f30 0x7f10a80693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10bc159480 0x7f10bc153450 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0b2140 0x7f10bc0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 --2- 172.21.15.84:0/4175703543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0b3610 0x7f10bc0b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 >> 172.21.15.84:0/4175703543 conn(0x7f10bc06ed20 msgr2=0x7f10bc158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 shutdown_connections 2023-10-06T02:55:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.257+0000 7f10c0f09700 1 -- 172.21.15.84:0/4175703543 wait complete. 2023-10-06T02:55:44.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:55:05.120029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:55:05.566741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:55:09.247969+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:55:44.271 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:44.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.387+0000 7fb2dbfee700 1 Processor -- start 2023-10-06T02:55:44.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.387+0000 7fb2dbfee700 1 -- start start 2023-10-06T02:55:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2dbfee700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2d4157430 0x7fb2d40af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2dbfee700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb2d406e3d0 0x7fb2d40affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2dbfee700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d40afb40 con 0x7fb2d4157800 2023-10-06T02:55:44.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2dbfee700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40cdde0 con 0x7fb2d4157430 2023-10-06T02:55:44.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2dbfee700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d415b230 con 0x7fb2d406e3d0 2023-10-06T02:55:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2d9d8a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2d4157430 0x7fb2d40af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2d9d8a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2d4157430 0x7fb2d40af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40362/0 (socket says 172.21.15.84:40362) 2023-10-06T02:55:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2da58b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb2d4157800 0x7fb2d40675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51616/0 (socket says 172.21.15.84:51616) 2023-10-06T02:55:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2d9d8a700 1 -- 172.21.15.84:0/914287353 learned_addr learned my addr 172.21.15.84:0/914287353 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.388+0000 7fb2d9589700 1 --2- 172.21.15.84:0/914287353 >> v2:172.21.15.131:3300/0 conn(0x7fb2d406e3d0 0x7fb2d40affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2d9d8a700 1 -- 172.21.15.84:0/914287353 >> v2:172.21.15.131:3300/0 conn(0x7fb2d406e3d0 msgr2=0x7fb2d40affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2d9d8a700 1 --2- 172.21.15.84:0/914287353 >> v2:172.21.15.131:3300/0 conn(0x7fb2d406e3d0 0x7fb2d40affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2d9d8a700 1 -- 172.21.15.84:0/914287353 >> v1:172.21.15.84:6789/0 conn(0x7fb2d4157800 legacy=0x7fb2d40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2d9d8a700 1 -- 172.21.15.84:0/914287353 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d406e920 con 0x7fb2d4157430 2023-10-06T02:55:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2d8d88700 1 -- 172.21.15.84:0/914287353 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779102538 0 0) 0x7fb2cc001110 con 0x7fb2d4157800 2023-10-06T02:55:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2d9d8a700 1 --2- 172.21.15.84:0/914287353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157430 0x7fb2d40af600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb2d415b190 tx=0x7fb2d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64cce1a9fae7f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2d8d88700 1 -- 172.21.15.84:0/914287353 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000e070 con 0x7fb2d4157430 2023-10-06T02:55:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2d8d88700 1 -- 172.21.15.84:0/914287353 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d000ba20 con 0x7fb2d4157430 2023-10-06T02:55:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2d8d88700 1 -- 172.21.15.84:0/914287353 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00092e0 con 0x7fb2d4157430 2023-10-06T02:55:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2dbfee700 1 -- 172.21.15.84:0/914287353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157430 msgr2=0x7fb2d40af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2dbfee700 1 --2- 172.21.15.84:0/914287353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157430 0x7fb2d40af600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb2d415b190 tx=0x7fb2d0009840 comp rx=0 tx=0).stop 2023-10-06T02:55:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2dbfee700 1 -- 172.21.15.84:0/914287353 shutdown_connections 2023-10-06T02:55:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2dbfee700 1 --2- 172.21.15.84:0/914287353 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157430 0x7fb2d40af600 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2dbfee700 1 --2- 172.21.15.84:0/914287353 >> v2:172.21.15.131:3300/0 conn(0x7fb2d406e3d0 0x7fb2d40affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.389+0000 7fb2dbfee700 1 -- 172.21.15.84:0/914287353 >> 172.21.15.84:0/914287353 conn(0x7fb2d4069190 msgr2=0x7fb2d40cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.390+0000 7fb2dbfee700 1 -- 172.21.15.84:0/914287353 shutdown_connections 2023-10-06T02:55:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.390+0000 7fb2dbfee700 1 -- 172.21.15.84:0/914287353 wait complete. 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.391+0000 7fb2dbfee700 1 Processor -- start 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.391+0000 7fb2dbfee700 1 -- start start 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.391+0000 7fb2dbfee700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2d406e3d0 0x7fb2d415d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.391+0000 7fb2dbfee700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2d4157430 0x7fb2d40acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.391+0000 7fb2dbfee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157800 0x7fb2d40c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.391+0000 7fb2dbfee700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40ad510 con 0x7fb2d4157800 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.391+0000 7fb2dbfee700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d414bf00 con 0x7fb2d406e3d0 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.391+0000 7fb2dbfee700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40c9770 con 0x7fb2d4157430 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2da58b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157800 0x7fb2d40c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2da58b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157800 0x7fb2d40c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40370/0 (socket says 172.21.15.84:40370) 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2da58b700 1 -- 172.21.15.84:0/401158022 learned_addr learned my addr 172.21.15.84:0/401158022 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2d9d8a700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2d406e3d0 0x7fb2d415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2d9589700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2d4157430 0x7fb2d40acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2da58b700 1 -- 172.21.15.84:0/401158022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2d4157430 msgr2=0x7fb2d40acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2da58b700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2d4157430 0x7fb2d40acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2da58b700 1 -- 172.21.15.84:0/401158022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2d406e3d0 msgr2=0x7fb2d415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2da58b700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2d406e3d0 0x7fb2d415d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2da58b700 1 -- 172.21.15.84:0/401158022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0009ae0 con 0x7fb2d4157800 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2da58b700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157800 0x7fb2d40c9230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c530 tx=0x7fb2cc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2c9ffb700 1 -- 172.21.15.84:0/401158022 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00ce80 con 0x7fb2d4157800 2023-10-06T02:55:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2c9ffb700 1 -- 172.21.15.84:0/401158022 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc005a70 con 0x7fb2d4157800 2023-10-06T02:55:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d40c18d0 con 0x7fb2d4157800 2023-10-06T02:55:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2c9ffb700 1 -- 172.21.15.84:0/401158022 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc005e10 con 0x7fb2d4157800 2023-10-06T02:55:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.392+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d40c1280 con 0x7fb2d4157800 2023-10-06T02:55:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.393+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d40c10e0 con 0x7fb2d4157800 2023-10-06T02:55:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.394+0000 7fb2c9ffb700 1 -- 172.21.15.84:0/401158022 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2cc0072e0 con 0x7fb2d4157800 2023-10-06T02:55:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.394+0000 7fb2c9ffb700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb2b8066f30 0x7fb2b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.394+0000 7fb2c9ffb700 1 -- 172.21.15.84:0/401158022 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb2cc083b00 con 0x7fb2d4157800 2023-10-06T02:55:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.394+0000 7fb2d9d8a700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb2b8066f30 0x7fb2b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.395+0000 7fb2d9d8a700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb2b8066f30 0x7fb2b80693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009fd0 tx=0x7fb2d0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.398+0000 7fb2c9ffb700 1 -- 172.21.15.84:0/401158022 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2d40c10e0 con 0x7fb2d4157800 2023-10-06T02:55:44.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.579+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2d40afb40 con 0x7fb2d4157800 2023-10-06T02:55:44.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.579+0000 7fb2c9ffb700 1 -- 172.21.15.84:0/401158022 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2d40afb40 con 0x7fb2d4157800 2023-10-06T02:55:44.581 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:55:44.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.581+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb2b8066f30 msgr2=0x7fb2b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.581+0000 7fb2dbfee700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb2b8066f30 0x7fb2b80693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009fd0 tx=0x7fb2d0018000 comp rx=0 tx=0).stop 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.581+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157800 msgr2=0x7fb2d40c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.581+0000 7fb2dbfee700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157800 0x7fb2d40c9230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00c530 tx=0x7fb2cc007f90 comp rx=0 tx=0).stop 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.582+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 shutdown_connections 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.582+0000 7fb2dbfee700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb2b8066f30 0x7fb2b80693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.582+0000 7fb2dbfee700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2d406e3d0 0x7fb2d415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.582+0000 7fb2dbfee700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2d4157800 0x7fb2d40c9230 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.582+0000 7fb2dbfee700 1 --2- 172.21.15.84:0/401158022 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2d4157430 0x7fb2d40acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.582+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 >> 172.21.15.84:0/401158022 conn(0x7fb2d4069190 msgr2=0x7fb2d40675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.582+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 shutdown_connections 2023-10-06T02:55:44.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.582+0000 7fb2dbfee700 1 -- 172.21.15.84:0/401158022 wait complete. 2023-10-06T02:55:44.595 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:44.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.710+0000 7f5762e45700 1 Processor -- start 2023-10-06T02:55:44.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.710+0000 7f5762e45700 1 -- start start 2023-10-06T02:55:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f5762e45700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 0x7f575c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f5762e45700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f575c1598e0 0x7f575c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f5762e45700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f575c0ce820 0x7f575c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f5762e45700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575c0cf610 con 0x7f575c0ce820 2023-10-06T02:55:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f5762e45700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575c0cf8f0 con 0x7f575c1598e0 2023-10-06T02:55:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f5762e45700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0cfbd0 con 0x7f575c159510 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f57613e2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f575c0ce820 0x7f575c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f57613e2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f575c0ce820 0x7f575c0cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40372/0 (socket says 172.21.15.84:40372) 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f57613e2700 1 -- 172.21.15.84:0/1215534133 learned_addr learned my addr 172.21.15.84:0/1215534133 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f5753fff700 1 --2- 172.21.15.84:0/1215534133 >> v2:172.21.15.131:3300/0 conn(0x7f575c1598e0 0x7f575c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.711+0000 7f5760be1700 1 --2- 172.21.15.84:0/1215534133 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 0x7f575c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f57613e2700 1 -- 172.21.15.84:0/1215534133 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 msgr2=0x7f575c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f57613e2700 1 --2- 172.21.15.84:0/1215534133 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 0x7f575c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f57613e2700 1 -- 172.21.15.84:0/1215534133 >> v2:172.21.15.131:3300/0 conn(0x7f575c1598e0 msgr2=0x7f575c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f57613e2700 1 --2- 172.21.15.84:0/1215534133 >> v2:172.21.15.131:3300/0 conn(0x7f575c1598e0 0x7f575c0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f57613e2700 1 -- 172.21.15.84:0/1215534133 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c0cfeb0 con 0x7f575c0ce820 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f57613e2700 1 --2- 172.21.15.84:0/1215534133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 0x7f575c0cec40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f575c089360 tx=0x7f5754009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a63e85600c6f0a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f57537fe700 1 -- 172.21.15.84:0/1215534133 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754014ca0 con 0x7f575c0ce820 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f57537fe700 1 -- 172.21.15.84:0/1215534133 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5754014e00 con 0x7f575c0ce820 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f57537fe700 1 -- 172.21.15.84:0/1215534133 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575401c680 con 0x7f575c0ce820 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f5762e45700 1 -- 172.21.15.84:0/1215534133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 msgr2=0x7f575c0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f5762e45700 1 --2- 172.21.15.84:0/1215534133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 0x7f575c0cec40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f575c089360 tx=0x7f5754009250 comp rx=0 tx=0).stop 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f5762e45700 1 -- 172.21.15.84:0/1215534133 shutdown_connections 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f5762e45700 1 --2- 172.21.15.84:0/1215534133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 0x7f575c0cec40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f5762e45700 1 --2- 172.21.15.84:0/1215534133 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 0x7f575c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f5762e45700 1 --2- 172.21.15.84:0/1215534133 >> v2:172.21.15.131:3300/0 conn(0x7f575c1598e0 0x7f575c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f5762e45700 1 -- 172.21.15.84:0/1215534133 >> 172.21.15.84:0/1215534133 conn(0x7f575c089e90 msgr2=0x7f575c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f5762e45700 1 -- 172.21.15.84:0/1215534133 shutdown_connections 2023-10-06T02:55:44.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.712+0000 7f5762e45700 1 -- 172.21.15.84:0/1215534133 wait complete. 2023-10-06T02:55:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.713+0000 7f5762e45700 1 Processor -- start 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.714+0000 7f5762e45700 1 -- start start 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.714+0000 7f5762e45700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 0x7f575c0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.714+0000 7f5762e45700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 0x7f575c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.714+0000 7f5762e45700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f575c1598e0 0x7f575c14be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.714+0000 7f5762e45700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0b51c0 con 0x7f575c0ce820 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.714+0000 7f5762e45700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0c7b40 con 0x7f575c1598e0 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.714+0000 7f5762e45700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c147a70 con 0x7f575c159510 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.714+0000 7f5760be1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 0x7f575c0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.714+0000 7f5760be1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 0x7f575c0c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40378/0 (socket says 172.21.15.84:40378) 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5760be1700 1 -- 172.21.15.84:0/761862969 learned_addr learned my addr 172.21.15.84:0/761862969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5753fff700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 0x7f575c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f57613e2700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f575c1598e0 0x7f575c14be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5760be1700 1 -- 172.21.15.84:0/761862969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 msgr2=0x7f575c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5760be1700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 0x7f575c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5760be1700 1 -- 172.21.15.84:0/761862969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f575c1598e0 msgr2=0x7f575c14be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5760be1700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f575c1598e0 0x7f575c14be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5760be1700 1 -- 172.21.15.84:0/761862969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540094f0 con 0x7f575c0ce820 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5760be1700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 0x7f575c0c7600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5758009ef0 tx=0x7f575800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5750ff9700 1 -- 172.21.15.84:0/761862969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800cb70 con 0x7f575c0ce820 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5750ff9700 1 -- 172.21.15.84:0/761862969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575800f040 con 0x7f575c0ce820 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c147d50 con 0x7f575c0ce820 2023-10-06T02:55:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5750ff9700 1 -- 172.21.15.84:0/761862969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758014480 con 0x7f575c0ce820 2023-10-06T02:55:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.715+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c148310 con 0x7f575c0ce820 2023-10-06T02:55:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.716+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c064ad0 con 0x7f575c0ce820 2023-10-06T02:55:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.716+0000 7f5750ff9700 1 -- 172.21.15.84:0/761862969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57580147f0 con 0x7f575c0ce820 2023-10-06T02:55:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.717+0000 7f5750ff9700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5748066f30 0x7f57480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.717+0000 7f5750ff9700 1 -- 172.21.15.84:0/761862969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5758085210 con 0x7f575c0ce820 2023-10-06T02:55:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.717+0000 7f5753fff700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5748066f30 0x7f57480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.717+0000 7f5753fff700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5748066f30 0x7f57480693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f575c15c080 tx=0x7f574c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.721+0000 7f5750ff9700 1 -- 172.21.15.84:0/761862969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5758052030 con 0x7f575c0ce820 2023-10-06T02:55:44.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.903+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f575c0b5300 con 0x7f575c0ce820 2023-10-06T02:55:44.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.904+0000 7f5750ff9700 1 -- 172.21.15.84:0/761862969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5758055650 con 0x7f575c0ce820 2023-10-06T02:55:44.905 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:55:44.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5748066f30 msgr2=0x7f57480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5748066f30 0x7f57480693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f575c15c080 tx=0x7f574c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 msgr2=0x7f575c0c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:44.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 0x7f575c0c7600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5758009ef0 tx=0x7f575800b040 comp rx=0 tx=0).stop 2023-10-06T02:55:44.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 shutdown_connections 2023-10-06T02:55:44.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5748066f30 0x7f57480693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f575c1598e0 0x7f575c14be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c0ce820 0x7f575c0c7600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 --2- 172.21.15.84:0/761862969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f575c159510 0x7f575c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:44.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 >> 172.21.15.84:0/761862969 conn(0x7f575c089e90 msgr2=0x7f575c15cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:44.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 shutdown_connections 2023-10-06T02:55:44.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:44.906+0000 7f5762e45700 1 -- 172.21.15.84:0/761862969 wait complete. 2023-10-06T02:55:44.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:55:45.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.034+0000 7fe6683c8700 1 Processor -- start 2023-10-06T02:55:45.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.034+0000 7fe6683c8700 1 -- start start 2023-10-06T02:55:45.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe6683c8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe66006d000 0x7fe66006d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe6683c8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe66015afc0 0x7fe66015b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe6683c8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600cc920 con 0x7fe660151b50 2023-10-06T02:55:45.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe6683c8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66006d990 con 0x7fe66015afc0 2023-10-06T02:55:45.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe6683c8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66015bcf0 con 0x7fe66006d000 2023-10-06T02:55:45.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe666965700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe66015afc0 0x7fe66015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe666965700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe66015afc0 0x7fe66015b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40390/0 (socket says 172.21.15.84:40390) 2023-10-06T02:55:45.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe666965700 1 -- 172.21.15.84:0/1094592703 learned_addr learned my addr 172.21.15.84:0/1094592703 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:45.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe665963700 1 --2- 172.21.15.84:0/1094592703 >> v2:172.21.15.131:3300/0 conn(0x7fe66006d000 0x7fe66006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe666965700 1 -- 172.21.15.84:0/1094592703 >> v2:172.21.15.131:3300/0 conn(0x7fe66006d000 msgr2=0x7fe66006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe666965700 1 --2- 172.21.15.84:0/1094592703 >> v2:172.21.15.131:3300/0 conn(0x7fe66006d000 0x7fe66006d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe666965700 1 -- 172.21.15.84:0/1094592703 >> v1:172.21.15.131:6789/0 conn(0x7fe660151b50 legacy=0x7fe6600ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe666965700 1 -- 172.21.15.84:0/1094592703 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600cc2d0 con 0x7fe66015afc0 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe666965700 1 --2- 172.21.15.84:0/1094592703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66015afc0 0x7fe66015b420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe66006f000 tx=0x7fe65c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ac6497dd4f9337 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe665162700 1 -- 172.21.15.84:0/1094592703 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00b820 con 0x7fe66015afc0 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe665162700 1 -- 172.21.15.84:0/1094592703 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00b980 con 0x7fe66015afc0 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.035+0000 7fe665162700 1 -- 172.21.15.84:0/1094592703 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00bd20 con 0x7fe66015afc0 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.036+0000 7fe6683c8700 1 -- 172.21.15.84:0/1094592703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66015afc0 msgr2=0x7fe66015b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.036+0000 7fe6683c8700 1 --2- 172.21.15.84:0/1094592703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66015afc0 0x7fe66015b420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe66006f000 tx=0x7fe65c009250 comp rx=0 tx=0).stop 2023-10-06T02:55:45.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.036+0000 7fe6683c8700 1 -- 172.21.15.84:0/1094592703 shutdown_connections 2023-10-06T02:55:45.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.036+0000 7fe6683c8700 1 --2- 172.21.15.84:0/1094592703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66015afc0 0x7fe66015b420 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.036+0000 7fe6683c8700 1 --2- 172.21.15.84:0/1094592703 >> v2:172.21.15.131:3300/0 conn(0x7fe66006d000 0x7fe66006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.036+0000 7fe6683c8700 1 -- 172.21.15.84:0/1094592703 >> 172.21.15.84:0/1094592703 conn(0x7fe6600675f0 msgr2=0x7fe6600679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:45.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.036+0000 7fe6683c8700 1 -- 172.21.15.84:0/1094592703 shutdown_connections 2023-10-06T02:55:45.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.036+0000 7fe6683c8700 1 -- 172.21.15.84:0/1094592703 wait complete. 2023-10-06T02:55:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.037+0000 7fe6683c8700 1 Processor -- start 2023-10-06T02:55:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.037+0000 7fe6683c8700 1 -- start start 2023-10-06T02:55:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe6683c8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006d000 0x7fe66016e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe6683c8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe660151b50 0x7fe660069c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe6683c8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe66015afc0 0x7fe66014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe6683c8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600697a0 con 0x7fe66006d000 2023-10-06T02:55:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe6683c8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe660152b50 con 0x7fe660151b50 2023-10-06T02:55:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe6683c8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66016eec0 con 0x7fe66015afc0 2023-10-06T02:55:45.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666164700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006d000 0x7fe66016e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666164700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006d000 0x7fe66016e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40392/0 (socket says 172.21.15.84:40392) 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666164700 1 -- 172.21.15.84:0/632433259 learned_addr learned my addr 172.21.15.84:0/632433259 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666965700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe66015afc0 0x7fe66014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe665963700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe660151b50 0x7fe660069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666164700 1 -- 172.21.15.84:0/632433259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe66015afc0 msgr2=0x7fe66014f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666164700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe66015afc0 0x7fe66014f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666164700 1 -- 172.21.15.84:0/632433259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe660151b50 msgr2=0x7fe660069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666164700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe660151b50 0x7fe660069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666164700 1 -- 172.21.15.84:0/632433259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0094f0 con 0x7fe66006d000 2023-10-06T02:55:45.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe666164700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006d000 0x7fe66016e980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c950 tx=0x7fe658002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.038+0000 7fe6567fc700 1 -- 172.21.15.84:0/632433259 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800a7e0 con 0x7fe66006d000 2023-10-06T02:55:45.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.039+0000 7fe6567fc700 1 -- 172.21.15.84:0/632433259 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65800a940 con 0x7fe66006d000 2023-10-06T02:55:45.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.039+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66006a170 con 0x7fe66006d000 2023-10-06T02:55:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.039+0000 7fe6567fc700 1 -- 172.21.15.84:0/632433259 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800ad00 con 0x7fe66006d000 2023-10-06T02:55:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.039+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe660068e70 con 0x7fe66006d000 2023-10-06T02:55:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.040+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66005f270 con 0x7fe66006d000 2023-10-06T02:55:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.040+0000 7fe6567fc700 1 -- 172.21.15.84:0/632433259 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe658012630 con 0x7fe66006d000 2023-10-06T02:55:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.040+0000 7fe6567fc700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe644066f30 0x7fe6440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.040+0000 7fe6567fc700 1 -- 172.21.15.84:0/632433259 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe658084e40 con 0x7fe66006d000 2023-10-06T02:55:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.040+0000 7fe665963700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe644066f30 0x7fe6440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.041+0000 7fe665963700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe644066f30 0x7fe6440693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe66016f0d0 tx=0x7fe650008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.044+0000 7fe6567fc700 1 -- 172.21.15.84:0/632433259 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe658051c60 con 0x7fe66006d000 2023-10-06T02:55:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.227+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6600cc5b0 con 0x7fe66006d000 2023-10-06T02:55:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.227+0000 7fe6567fc700 1 -- 172.21.15.84:0/632433259 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe65800ae60 con 0x7fe66006d000 2023-10-06T02:55:45.229 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe644066f30 msgr2=0x7fe6440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe644066f30 0x7fe6440693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe66016f0d0 tx=0x7fe650008040 comp rx=0 tx=0).stop 2023-10-06T02:55:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006d000 msgr2=0x7fe66016e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006d000 0x7fe66016e980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c950 tx=0x7fe658002760 comp rx=0 tx=0).stop 2023-10-06T02:55:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 shutdown_connections 2023-10-06T02:55:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe644066f30 0x7fe6440693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe66015afc0 0x7fe66014f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006d000 0x7fe66016e980 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 --2- 172.21.15.84:0/632433259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe660151b50 0x7fe660069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 >> 172.21.15.84:0/632433259 conn(0x7fe6600675f0 msgr2=0x7fe660063450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 shutdown_connections 2023-10-06T02:55:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.229+0000 7fe6683c8700 1 -- 172.21.15.84:0/632433259 wait complete. 2023-10-06T02:55:45.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:55:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.358+0000 7fec21fc6700 1 Processor -- start 2023-10-06T02:55:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.358+0000 7fec21fc6700 1 -- start start 2023-10-06T02:55:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec21fc6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 0x7fec1c0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec21fc6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec1c159e60 0x7fec1c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec21fc6700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c0ccb70 con 0x7fec1c0d0350 2023-10-06T02:55:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec21fc6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c0cbe20 con 0x7fec1c159e60 2023-10-06T02:55:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec21fc6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c15aed0 con 0x7fec1c157490 2023-10-06T02:55:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec1affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec1c159e60 0x7fec1c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec1affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fec1c159e60 0x7fec1c0ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40408/0 (socket says 172.21.15.84:40408) 2023-10-06T02:55:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec1affd700 1 -- 172.21.15.84:0/3194932390 learned_addr learned my addr 172.21.15.84:0/3194932390 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec1b7fe700 1 --2- 172.21.15.84:0/3194932390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 0x7fec1c0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec1affd700 1 -- 172.21.15.84:0/3194932390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 msgr2=0x7fec1c0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec1affd700 1 --2- 172.21.15.84:0/3194932390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 0x7fec1c0cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec1affd700 1 -- 172.21.15.84:0/3194932390 >> v1:172.21.15.131:6789/0 conn(0x7fec1c0d0350 legacy=0x7fec1c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec1affd700 1 -- 172.21.15.84:0/3194932390 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c0cce40 con 0x7fec1c159e60 2023-10-06T02:55:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.359+0000 7fec1affd700 1 --2- 172.21.15.84:0/3194932390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c159e60 0x7fec1c0ce970 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fec100099b0 tx=0x7fec10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bca8ac28dc827b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec1a7fc700 1 -- 172.21.15.84:0/3194932390 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1000b820 con 0x7fec1c159e60 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec1a7fc700 1 -- 172.21.15.84:0/3194932390 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1000b980 con 0x7fec1c159e60 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec1a7fc700 1 -- 172.21.15.84:0/3194932390 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1000bd20 con 0x7fec1c159e60 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec21fc6700 1 -- 172.21.15.84:0/3194932390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c159e60 msgr2=0x7fec1c0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec21fc6700 1 --2- 172.21.15.84:0/3194932390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c159e60 0x7fec1c0ce970 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fec100099b0 tx=0x7fec10009250 comp rx=0 tx=0).stop 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec21fc6700 1 -- 172.21.15.84:0/3194932390 shutdown_connections 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec21fc6700 1 --2- 172.21.15.84:0/3194932390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 0x7fec1c0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec21fc6700 1 --2- 172.21.15.84:0/3194932390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c159e60 0x7fec1c0ce970 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec21fc6700 1 -- 172.21.15.84:0/3194932390 >> 172.21.15.84:0/3194932390 conn(0x7fec1c06ed20 msgr2=0x7fec1c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec21fc6700 1 -- 172.21.15.84:0/3194932390 shutdown_connections 2023-10-06T02:55:45.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.360+0000 7fec21fc6700 1 -- 172.21.15.84:0/3194932390 wait complete. 2023-10-06T02:55:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.361+0000 7fec21fc6700 1 Processor -- start 2023-10-06T02:55:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.361+0000 7fec21fc6700 1 -- start start 2023-10-06T02:55:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec21fc6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c0d0350 0x7fec1c14a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec21fc6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 0x7fec1c0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec21fc6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec1c159e60 0x7fec1c16d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec21fc6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c147cf0 con 0x7fec1c0d0350 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec21fc6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0c8e50 con 0x7fec1c159e60 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec21fc6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c147f80 con 0x7fec1c157490 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec1b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c0d0350 0x7fec1c14a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec1b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c0d0350 0x7fec1c14a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40424/0 (socket says 172.21.15.84:40424) 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec1b7fe700 1 -- 172.21.15.84:0/1916532480 learned_addr learned my addr 172.21.15.84:0/1916532480 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec1affd700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 0x7fec1c0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.362+0000 7fec1bfff700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec1c159e60 0x7fec1c16d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec1b7fe700 1 -- 172.21.15.84:0/1916532480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 msgr2=0x7fec1c0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec1b7fe700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 0x7fec1c0c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec1b7fe700 1 -- 172.21.15.84:0/1916532480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec1c159e60 msgr2=0x7fec1c16d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec1b7fe700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec1c159e60 0x7fec1c16d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec1b7fe700 1 -- 172.21.15.84:0/1916532480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100094f0 con 0x7fec1c0d0350 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec1b7fe700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c0d0350 0x7fec1c14a870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e190 tx=0x7fec0c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec037fe700 1 -- 172.21.15.84:0/1916532480 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00ecd0 con 0x7fec1c0d0350 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec037fe700 1 -- 172.21.15.84:0/1916532480 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c00ee30 con 0x7fec1c0d0350 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c0c8240 con 0x7fec1c0d0350 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec037fe700 1 -- 172.21.15.84:0/1916532480 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c014670 con 0x7fec1c0d0350 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.363+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c0c8800 con 0x7fec1c0d0350 2023-10-06T02:55:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.364+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c0644d0 con 0x7fec1c0d0350 2023-10-06T02:55:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.364+0000 7fec037fe700 1 -- 172.21.15.84:0/1916532480 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec0c014a20 con 0x7fec1c0d0350 2023-10-06T02:55:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.365+0000 7fec037fe700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec08066f30 0x7fec080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.365+0000 7fec037fe700 1 -- 172.21.15.84:0/1916532480 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fec0c085090 con 0x7fec1c0d0350 2023-10-06T02:55:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.365+0000 7fec1affd700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec08066f30 0x7fec080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.365+0000 7fec1affd700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec08066f30 0x7fec080693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fec100099b0 tx=0x7fec10016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.369+0000 7fec037fe700 1 -- 172.21.15.84:0/1916532480 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec0c051eb0 con 0x7fec1c0d0350 2023-10-06T02:55:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.551+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec1c05f270 con 0x7fec1c0d0350 2023-10-06T02:55:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.551+0000 7fec037fe700 1 -- 172.21.15.84:0/1916532480 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec0c009a60 con 0x7fec1c0d0350 2023-10-06T02:55:45.553 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:55:45.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec08066f30 msgr2=0x7fec080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec08066f30 0x7fec080693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fec100099b0 tx=0x7fec10016000 comp rx=0 tx=0).stop 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c0d0350 msgr2=0x7fec1c14a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c0d0350 0x7fec1c14a870 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00e190 tx=0x7fec0c009920 comp rx=0 tx=0).stop 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 shutdown_connections 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fec08066f30 0x7fec080693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec1c159e60 0x7fec1c16d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c0d0350 0x7fec1c14a870 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 --2- 172.21.15.84:0/1916532480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fec1c157490 0x7fec1c0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 >> 172.21.15.84:0/1916532480 conn(0x7fec1c06ed20 msgr2=0x7fec1c0ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 shutdown_connections 2023-10-06T02:55:45.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.553+0000 7fec21fc6700 1 -- 172.21.15.84:0/1916532480 wait complete. 2023-10-06T02:55:45.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:55:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.682+0000 7fddbeb40700 1 Processor -- start 2023-10-06T02:55:45.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.682+0000 7fddbeb40700 1 -- start start 2023-10-06T02:55:45.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.682+0000 7fddbeb40700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fddb80b0860 0x7fddb8068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.682+0000 7fddbeb40700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c4490 0x7fddb80cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.682+0000 7fddbeb40700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb80c96b0 con 0x7fddb80cc780 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.682+0000 7fddbeb40700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb8159c40 con 0x7fddb80b0860 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.682+0000 7fddbeb40700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c8aa0 con 0x7fddb80c4490 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddbd0dd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fddb80cc780 0x7fddb80ccbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51624/0 (socket says 172.21.15.84:51624) 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddbd0dd700 1 -- 172.21.15.84:0/3320290620 learned_addr learned my addr 172.21.15.84:0/3320290620 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddbc8dc700 1 --2- 172.21.15.84:0/3320290620 >> v2:172.21.15.131:3300/0 conn(0x7fddb80b0860 0x7fddb8068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaffff700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c4490 0x7fddb80cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923612265 0 0) 0x7fddb80c96b0 con 0x7fddb80cc780 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdda0003570 con 0x7fddb80cc780 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3438255308 0 0) 0x7fdda0003570 con 0x7fddb80cc780 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c4490 msgr2=0x7fddb80cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:45.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c4490 0x7fddb80cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 >> v2:172.21.15.131:3300/0 conn(0x7fddb80b0860 msgr2=0x7fddb8068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 --2- 172.21.15.84:0/3320290620 >> v2:172.21.15.131:3300/0 conn(0x7fddb80b0860 0x7fddb8068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80c8d80 con 0x7fddb80cc780 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fddb0001470 con 0x7fddb80cc780 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 >> v1:172.21.15.84:6789/0 conn(0x7fddb80cc780 legacy=0x7fddb80ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda0003a60 0x7fdda0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda0004810 0x7fdda0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c4490 0x7fdda00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8159c40 con 0x7fdda0004810 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c8aa0 con 0x7fdda0003a60 2023-10-06T02:55:45.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda000ba60 con 0x7fddb80c4490 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddaffff700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda0004810 0x7fdda0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddbc8dc700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda0003a60 0x7fdda0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.683+0000 7fddbd0dd700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c4490 0x7fdda00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddaffff700 1 -- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c4490 msgr2=0x7fdda00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddaffff700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c4490 0x7fdda00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddaffff700 1 -- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda0003a60 msgr2=0x7fdda0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddaffff700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda0003a60 0x7fdda0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddaffff700 1 -- 172.21.15.84:0/3320290620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0003570 con 0x7fdda0004810 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddaffff700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda0004810 0x7fdda0004c80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009c30 tx=0x7fdda80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638eb867cf9ff2c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda800e710 con 0x7fdda0004810 2023-10-06T02:55:45.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda800e870 con 0x7fdda0004810 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddaf7fe700 1 -- 172.21.15.84:0/3320290620 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda800ec30 con 0x7fdda0004810 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddbeb40700 1 -- 172.21.15.84:0/3320290620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda0004810 msgr2=0x7fdda0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddbeb40700 1 --2- 172.21.15.84:0/3320290620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdda0004810 0x7fdda0004c80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009c30 tx=0x7fdda80091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddbd0dd700 1 -- 172.21.15.84:0/3320290620 reap_dead start 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddbeb40700 1 -- 172.21.15.84:0/3320290620 shutdown_connections 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddbeb40700 1 -- 172.21.15.84:0/3320290620 >> 172.21.15.84:0/3320290620 conn(0x7fddb8088000 msgr2=0x7fddb80ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddbeb40700 1 -- 172.21.15.84:0/3320290620 shutdown_connections 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.684+0000 7fddbeb40700 1 -- 172.21.15.84:0/3320290620 wait complete. 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.685+0000 7fddbeb40700 1 Processor -- start 2023-10-06T02:55:45.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddbeb40700 1 -- start start 2023-10-06T02:55:45.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddbeb40700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda0004810 0x7fddb80b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddbeb40700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb81553f0 0x7fddb8154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddbeb40700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c7900 0x7fddb80c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddbeb40700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c82e0 con 0x7fddb81553f0 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddbeb40700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8169c90 con 0x7fdda0004810 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddbeb40700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8169f30 con 0x7fddb80c7900 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddaffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb81553f0 0x7fddb8154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddaffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb81553f0 0x7fddb8154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40450/0 (socket says 172.21.15.84:40450) 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddbc8dc700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda0004810 0x7fddb80b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.686+0000 7fddaffff700 1 -- 172.21.15.84:0/2518170899 learned_addr learned my addr 172.21.15.84:0/2518170899 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:45.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddbd0dd700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c7900 0x7fddb80c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddaffff700 1 -- 172.21.15.84:0/2518170899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c7900 msgr2=0x7fddb80c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddaffff700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c7900 0x7fddb80c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddaffff700 1 -- 172.21.15.84:0/2518170899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda0004810 msgr2=0x7fddb80b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddaffff700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda0004810 0x7fddb80b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddaffff700 1 -- 172.21.15.84:0/2518170899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb816a210 con 0x7fddb81553f0 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddaffff700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb81553f0 0x7fddb8154bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdda00046d0 tx=0x7fdda801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddacff9700 1 -- 172.21.15.84:0/2518170899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8022070 con 0x7fddb81553f0 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddacff9700 1 -- 172.21.15.84:0/2518170899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda800e9e0 con 0x7fddb81553f0 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb816a4f0 con 0x7fddb81553f0 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddacff9700 1 -- 172.21.15.84:0/2518170899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8006e50 con 0x7fddb81553f0 2023-10-06T02:55:45.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.687+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb80b3b80 con 0x7fddb81553f0 2023-10-06T02:55:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.688+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb8064ad0 con 0x7fddb81553f0 2023-10-06T02:55:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.688+0000 7fddacff9700 1 -- 172.21.15.84:0/2518170899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdda801c660 con 0x7fddb81553f0 2023-10-06T02:55:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.689+0000 7fddacff9700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdda4066f30 0x7fdda40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.689+0000 7fddacff9700 1 -- 172.21.15.84:0/2518170899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdda8085ff0 con 0x7fddb81553f0 2023-10-06T02:55:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.689+0000 7fddbc8dc700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdda4066f30 0x7fdda40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.689+0000 7fddbc8dc700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdda4066f30 0x7fdda40693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fddb40094d0 tx=0x7fddb400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:45.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.693+0000 7fddacff9700 1 -- 172.21.15.84:0/2518170899 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdda8052ec0 con 0x7fddb81553f0 2023-10-06T02:55:45.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.876+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fddb80b4120 con 0x7fddb81553f0 2023-10-06T02:55:45.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.876+0000 7fddacff9700 1 -- 172.21.15.84:0/2518170899 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdda80564e0 con 0x7fddb81553f0 2023-10-06T02:55:45.879 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:45.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdda4066f30 msgr2=0x7fdda40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdda4066f30 0x7fdda40693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fddb40094d0 tx=0x7fddb400b040 comp rx=0 tx=0).stop 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb81553f0 msgr2=0x7fddb8154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb81553f0 0x7fddb8154bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdda00046d0 tx=0x7fdda801a000 comp rx=0 tx=0).stop 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 shutdown_connections 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdda4066f30 0x7fdda40693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda0004810 0x7fddb80b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fddb80c7900 0x7fddb80c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 --2- 172.21.15.84:0/2518170899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb81553f0 0x7fddb8154bf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.878+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 >> 172.21.15.84:0/2518170899 conn(0x7fddb8088000 msgr2=0x7fddb8069330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.879+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 shutdown_connections 2023-10-06T02:55:45.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:45.879+0000 7fddbeb40700 1 -- 172.21.15.84:0/2518170899 wait complete. 2023-10-06T02:55:45.914 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-10-06T02:55:45.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2023-10-06T02:55:46.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.026+0000 7f328c638700 1 Processor -- start 2023-10-06T02:55:46.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.026+0000 7f328c638700 1 -- start start 2023-10-06T02:55:46.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.027+0000 7f328c638700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32840adf60 0x7f32840ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.027+0000 7f328c638700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f328406e280 0x7f328406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.027+0000 7f328c638700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840c7370 con 0x7f32840cc830 2023-10-06T02:55:46.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.027+0000 7f328c638700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3284156150 con 0x7f32840adf60 2023-10-06T02:55:46.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.027+0000 7f328c638700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840ac580 con 0x7f328406e280 2023-10-06T02:55:46.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.027+0000 7f328abd5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f32840cc830 0x7f3284069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51636/0 (socket says 172.21.15.84:51636) 2023-10-06T02:55:46.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.027+0000 7f328abd5700 1 -- 172.21.15.84:0/3420045675 learned_addr learned my addr 172.21.15.84:0/3420045675 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:46.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f3289bd3700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f328406e280 0x7f328406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f328a3d4700 1 --2- 172.21.15.84:0/3420045675 >> v2:172.21.15.131:3300/0 conn(0x7f32840adf60 0x7f32840ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113493144 0 0) 0x7f32840c7370 con 0x7f32840cc830 2023-10-06T02:55:46.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3270003570 con 0x7f32840cc830 2023-10-06T02:55:46.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 202728063 0 0) 0x7f3270003570 con 0x7f32840cc830 2023-10-06T02:55:46.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f328406e280 msgr2=0x7f328406e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:46.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f328406e280 0x7f328406e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 >> v2:172.21.15.131:3300/0 conn(0x7f32840adf60 msgr2=0x7f32840ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:46.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 --2- 172.21.15.84:0/3420045675 >> v2:172.21.15.131:3300/0 conn(0x7f32840adf60 0x7f32840ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840c6760 con 0x7f32840cc830 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f327c001470 con 0x7f32840cc830 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 >> v1:172.21.15.84:6789/0 conn(0x7f32840cc830 legacy=0x7f3284069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f328406e280 0x7f3270003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3270003fe0 0x7f3270004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3270004d50 0x7f32700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284156150 con 0x7f3270003fe0 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840ac580 con 0x7f3270004d50 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327000ba90 con 0x7f328406e280 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f3289bd3700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3270003fe0 0x7f3270004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f328a3d4700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f328406e280 0x7f3270003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f328abd5700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3270004d50 0x7f32700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f3289bd3700 1 -- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f328406e280 msgr2=0x7f3270003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f3289bd3700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f328406e280 0x7f3270003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f3289bd3700 1 -- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3270004d50 msgr2=0x7f32700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f3289bd3700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3270004d50 0x7f32700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f3289bd3700 1 -- 172.21.15.84:0/3420045675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270003570 con 0x7f3270003fe0 2023-10-06T02:55:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.028+0000 7f3289bd3700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3270003fe0 0x7f3270004810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3274009c00 tx=0x7f32740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcd1ff628a6c307 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400e6b0 con 0x7f3270003fe0 2023-10-06T02:55:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400e810 con 0x7f3270003fe0 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f32893d2700 1 -- 172.21.15.84:0/3420045675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400ebd0 con 0x7f3270003fe0 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f328c638700 1 -- 172.21.15.84:0/3420045675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3270003fe0 msgr2=0x7f3270004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f328c638700 1 --2- 172.21.15.84:0/3420045675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3270003fe0 0x7f3270004810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3274009c00 tx=0x7f32740091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f328abd5700 1 -- 172.21.15.84:0/3420045675 reap_dead start 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f328c638700 1 -- 172.21.15.84:0/3420045675 shutdown_connections 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f328c638700 1 -- 172.21.15.84:0/3420045675 >> 172.21.15.84:0/3420045675 conn(0x7f32840680c0 msgr2=0x7f32840cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f328c638700 1 -- 172.21.15.84:0/3420045675 shutdown_connections 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.029+0000 7f328c638700 1 -- 172.21.15.84:0/3420045675 wait complete. 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.030+0000 7f328c638700 1 Processor -- start 2023-10-06T02:55:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.030+0000 7f328c638700 1 -- start start 2023-10-06T02:55:46.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328c638700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3270003fe0 0x7f3284169a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328c638700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32840c5dc0 0x7f32840c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328c638700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32841652c0 0x7f32840caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328c638700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284152ef0 con 0x7f32841652c0 2023-10-06T02:55:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328c638700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c5930 con 0x7f3270003fe0 2023-10-06T02:55:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328c638700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c3670 con 0x7f32840c5dc0 2023-10-06T02:55:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328abd5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32841652c0 0x7f32840caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328abd5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32841652c0 0x7f32840caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40474/0 (socket says 172.21.15.84:40474) 2023-10-06T02:55:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328abd5700 1 -- 172.21.15.84:0/2341658575 learned_addr learned my addr 172.21.15.84:0/2341658575 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328a3d4700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3270003fe0 0x7f3284169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f3289bd3700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32840c5dc0 0x7f32840c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328abd5700 1 -- 172.21.15.84:0/2341658575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32840c5dc0 msgr2=0x7f32840c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328abd5700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32840c5dc0 0x7f32840c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328abd5700 1 -- 172.21.15.84:0/2341658575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3270003fe0 msgr2=0x7f3284169a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328abd5700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3270003fe0 0x7f3284169a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.031+0000 7f328abd5700 1 -- 172.21.15.84:0/2341658575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840c5000 con 0x7f32841652c0 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.032+0000 7f328abd5700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32841652c0 0x7f32840caed0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f32840ccc00 tx=0x7f327c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.032+0000 7f327a7fc700 1 -- 172.21.15.84:0/2341658575 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0114f0 con 0x7f32841652c0 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.032+0000 7f327a7fc700 1 -- 172.21.15.84:0/2341658575 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c011650 con 0x7f32841652c0 2023-10-06T02:55:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.032+0000 7f327a7fc700 1 -- 172.21.15.84:0/2341658575 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c011a10 con 0x7f32841652c0 2023-10-06T02:55:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.032+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32840c52e0 con 0x7f32841652c0 2023-10-06T02:55:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.032+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3284165730 con 0x7f32841652c0 2023-10-06T02:55:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.033+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328406d430 con 0x7f32841652c0 2023-10-06T02:55:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.033+0000 7f327a7fc700 1 -- 172.21.15.84:0/2341658575 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f327c0133e0 con 0x7f32841652c0 2023-10-06T02:55:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.033+0000 7f327a7fc700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3268066f30 0x7f32680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.033+0000 7f327a7fc700 1 -- 172.21.15.84:0/2341658575 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f327c0840b0 con 0x7f32841652c0 2023-10-06T02:55:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.033+0000 7f328a3d4700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3268066f30 0x7f32680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.034+0000 7f328a3d4700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3268066f30 0x7f32680693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32800094d0 tx=0x7f328000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.038+0000 7f327a7fc700 1 -- 172.21.15.84:0/2341658575 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f327c050ed0 con 0x7f32841652c0 2023-10-06T02:55:46.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:46.299+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) v1 -- 0x7f32840ad840 con 0x7f32841652c0 2023-10-06T02:55:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.137+0000 7f327a7fc700 1 -- 172.21.15.84:0/2341658575 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v59) v1 ==== 139+0+0 (secure 0 0 0) 0x7f327c0190d0 con 0x7f32841652c0 2023-10-06T02:55:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3268066f30 msgr2=0x7f32680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3268066f30 0x7f32680693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32800094d0 tx=0x7f328000b040 comp rx=0 tx=0).stop 2023-10-06T02:55:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32841652c0 msgr2=0x7f32840caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32841652c0 0x7f32840caed0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f32840ccc00 tx=0x7f327c001e90 comp rx=0 tx=0).stop 2023-10-06T02:55:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 shutdown_connections 2023-10-06T02:55:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3268066f30 0x7f32680693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3270003fe0 0x7f3284169a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32841652c0 0x7f32840caed0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 --2- 172.21.15.84:0/2341658575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f32840c5dc0 0x7f32840c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 >> 172.21.15.84:0/2341658575 conn(0x7f32840680c0 msgr2=0x7f32840c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:47.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 shutdown_connections 2023-10-06T02:55:47.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.139+0000 7f328c638700 1 -- 172.21.15.84:0/2341658575 wait complete. 2023-10-06T02:55:47.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:55:47.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.271+0000 7efe797a1700 1 Processor -- start 2023-10-06T02:55:47.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.271+0000 7efe797a1700 1 -- start start 2023-10-06T02:55:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe797a1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe797a1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efe740cf1f0 0x7efe740cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe797a1700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe740cc9b0 con 0x7efe740b2a30 2023-10-06T02:55:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe797a1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe740cbda0 con 0x7efe740cf1f0 2023-10-06T02:55:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe797a1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe740cc080 con 0x7efe740b2660 2023-10-06T02:55:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe73fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe78fa0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efe740cf1f0 0x7efe740cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe73fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:43720/0 (socket says 172.21.15.84:43720) 2023-10-06T02:55:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe737fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7efe740b2a30 0x7efe740ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:45328/0 (socket says 172.21.15.84:45328) 2023-10-06T02:55:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.272+0000 7efe73fff700 1 -- 172.21.15.84:0/3322625227 learned_addr learned my addr 172.21.15.84:0/3322625227 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe72ffd700 1 -- 172.21.15.84:0/3322625227 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470288861 0 0) 0x7efe740cc9b0 con 0x7efe740b2a30 2023-10-06T02:55:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe72ffd700 1 -- 172.21.15.84:0/3322625227 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe5c003570 con 0x7efe740b2a30 2023-10-06T02:55:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe73fff700 1 -- 172.21.15.84:0/3322625227 >> v2:172.21.15.131:3300/0 conn(0x7efe740cf1f0 msgr2=0x7efe740cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe73fff700 1 --2- 172.21.15.84:0/3322625227 >> v2:172.21.15.131:3300/0 conn(0x7efe740cf1f0 0x7efe740cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe73fff700 1 -- 172.21.15.84:0/3322625227 >> v1:172.21.15.131:6789/0 conn(0x7efe740b2a30 legacy=0x7efe740ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe73fff700 1 -- 172.21.15.84:0/3322625227 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740cc360 con 0x7efe740b2660 2023-10-06T02:55:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe78fa0700 1 --2- 172.21.15.84:0/3322625227 >> v2:172.21.15.131:3300/0 conn(0x7efe740cf1f0 0x7efe740cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe73fff700 1 --2- 172.21.15.84:0/3322625227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740cccf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe64009990 tx=0x7efe64009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775e5903c8d489d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe72ffd700 1 -- 172.21.15.84:0/3322625227 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64005c10 con 0x7efe740b2660 2023-10-06T02:55:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe72ffd700 1 -- 172.21.15.84:0/3322625227 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64005d70 con 0x7efe740b2660 2023-10-06T02:55:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.273+0000 7efe72ffd700 1 -- 172.21.15.84:0/3322625227 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64006260 con 0x7efe740b2660 2023-10-06T02:55:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.274+0000 7efe797a1700 1 -- 172.21.15.84:0/3322625227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 msgr2=0x7efe740cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.274+0000 7efe797a1700 1 --2- 172.21.15.84:0/3322625227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740cccf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe64009990 tx=0x7efe64009220 comp rx=0 tx=0).stop 2023-10-06T02:55:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.274+0000 7efe797a1700 1 -- 172.21.15.84:0/3322625227 shutdown_connections 2023-10-06T02:55:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.274+0000 7efe797a1700 1 --2- 172.21.15.84:0/3322625227 >> v2:172.21.15.131:3300/0 conn(0x7efe740cf1f0 0x7efe740cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.274+0000 7efe797a1700 1 --2- 172.21.15.84:0/3322625227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740cccf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.274+0000 7efe797a1700 1 -- 172.21.15.84:0/3322625227 >> 172.21.15.84:0/3322625227 conn(0x7efe74099560 msgr2=0x7efe7406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.274+0000 7efe797a1700 1 -- 172.21.15.84:0/3322625227 shutdown_connections 2023-10-06T02:55:47.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.274+0000 7efe797a1700 1 -- 172.21.15.84:0/3322625227 wait complete. 2023-10-06T02:55:47.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.275+0000 7efe797a1700 1 Processor -- start 2023-10-06T02:55:47.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.275+0000 7efe797a1700 1 -- start start 2023-10-06T02:55:47.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe797a1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe797a1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe740b2a30 0x7efe740b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe797a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe740cf1f0 0x7efe741548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe797a1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe740ca760 con 0x7efe740cf1f0 2023-10-06T02:55:47.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe797a1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe740b39f0 con 0x7efe740b2a30 2023-10-06T02:55:47.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe797a1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe740ca1a0 con 0x7efe740b2660 2023-10-06T02:55:47.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe78fa0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe740cf1f0 0x7efe741548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe78fa0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe740cf1f0 0x7efe741548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40480/0 (socket says 172.21.15.84:40480) 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe78fa0700 1 -- 172.21.15.84:0/1866210259 learned_addr learned my addr 172.21.15.84:0/1866210259 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe73fff700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe737fe700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe740b2a30 0x7efe740b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe78fa0700 1 -- 172.21.15.84:0/1866210259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 msgr2=0x7efe740c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe78fa0700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe78fa0700 1 -- 172.21.15.84:0/1866210259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe740b2a30 msgr2=0x7efe740b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe78fa0700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe740b2a30 0x7efe740b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe78fa0700 1 -- 172.21.15.84:0/1866210259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c009a20 con 0x7efe740cf1f0 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe78fa0700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe740cf1f0 0x7efe741548c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009fc0 tx=0x7efe6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe5bfff700 1 -- 172.21.15.84:0/1866210259 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00cd30 con 0x7efe740cf1f0 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe5bfff700 1 -- 172.21.15.84:0/1866210259 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c00f040 con 0x7efe740cf1f0 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe64009480 con 0x7efe740cf1f0 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.276+0000 7efe5bfff700 1 -- 172.21.15.84:0/1866210259 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0146d0 con 0x7efe740cf1f0 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.277+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe740b3680 con 0x7efe740cf1f0 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.277+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe740b3ba0 con 0x7efe740cf1f0 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.278+0000 7efe5bfff700 1 -- 172.21.15.84:0/1866210259 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe6c003020 con 0x7efe740cf1f0 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.278+0000 7efe5bfff700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe60066f30 0x7efe600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.278+0000 7efe73fff700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe60066f30 0x7efe600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.278+0000 7efe5bfff700 1 -- 172.21.15.84:0/1866210259 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efe6c0853d0 con 0x7efe740cf1f0 2023-10-06T02:55:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.279+0000 7efe73fff700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe60066f30 0x7efe600693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe64007fd0 tx=0x7efe64016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:47.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.283+0000 7efe5bfff700 1 -- 172.21.15.84:0/1866210259 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe740b3ba0 con 0x7efe740cf1f0 2023-10-06T02:55:47.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.463+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efe740b3b60 con 0x7efe740cf1f0 2023-10-06T02:55:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.469+0000 7efe5bfff700 1 -- 172.21.15.84:0/1866210259 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe6c0521f0 con 0x7efe740cf1f0 2023-10-06T02:55:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe60066f30 msgr2=0x7efe600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe60066f30 0x7efe600693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe64007fd0 tx=0x7efe64016000 comp rx=0 tx=0).stop 2023-10-06T02:55:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe740cf1f0 msgr2=0x7efe741548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe740cf1f0 0x7efe741548c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009fc0 tx=0x7efe6c00b040 comp rx=0 tx=0).stop 2023-10-06T02:55:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 shutdown_connections 2023-10-06T02:55:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe60066f30 0x7efe600693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe740cf1f0 0x7efe741548c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe740b2660 0x7efe740c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 --2- 172.21.15.84:0/1866210259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe740b2a30 0x7efe740b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 >> 172.21.15.84:0/1866210259 conn(0x7efe74099560 msgr2=0x7efe74068b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 shutdown_connections 2023-10-06T02:55:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:47.471+0000 7efe797a1700 1 -- 172.21.15.84:0/1866210259 wait complete. 2023-10-06T02:55:47.485 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:55:47.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:55:47.528 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:55:47.571 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:55:47.571 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:55:47.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:47.571 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T02:55:47.611 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:55:47.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:47.611 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:55:47.666 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T02:55:47.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:47.666 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T02:55:47.706 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T02:55:47.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:47.707 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T02:55:47.763 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T02:55:47.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:47.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T02:55:47.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:55:47.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:47.804 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T02:55:47.859 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T02:55:47.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:55:47.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T02:55:47.896 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T02:55:47.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:55:47.896 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T02:55:47.953 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:55:47.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:48.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.065+0000 7faa04fd0700 1 Processor -- start 2023-10-06T02:55:48.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.065+0000 7faa04fd0700 1 -- start start 2023-10-06T02:55:48.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.066+0000 7faa04fd0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa001595a0 0x7faa000aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.066+0000 7faa04fd0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa000b0ca0 con 0x7faa000b07a0 2023-10-06T02:55:48.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.066+0000 7faa04fd0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa000b0f80 con 0x7faa000b49e0 2023-10-06T02:55:48.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.066+0000 7faa04fd0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa000b1260 con 0x7faa001595a0 2023-10-06T02:55:48.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.066+0000 7fa9fe59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa001595a0 0x7faa000aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.066+0000 7fa9fed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faa000b07a0 0x7faa000b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51648/0 (socket says 172.21.15.84:51648) 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.066+0000 7fa9fed9d700 1 -- 172.21.15.84:0/1238462692 learned_addr learned my addr 172.21.15.84:0/1238462692 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7fa9fe59c700 1 -- 172.21.15.84:0/1238462692 >> v1:172.21.15.131:6789/0 conn(0x7faa000b49e0 legacy=0x7faa000aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7fa9fe59c700 1 -- 172.21.15.84:0/1238462692 >> v1:172.21.15.84:6789/0 conn(0x7faa000b07a0 legacy=0x7faa000b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7fa9fe59c700 1 -- 172.21.15.84:0/1238462692 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa000b1540 con 0x7faa001595a0 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7fa9fe59c700 1 --2- 172.21.15.84:0/1238462692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa001595a0 0x7faa000aa570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009900 tx=0x7fa9f0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3509c877572c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7fa9fdd9b700 1 -- 172.21.15.84:0/1238462692 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0009ea0 con 0x7faa001595a0 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7fa9fdd9b700 1 -- 172.21.15.84:0/1238462692 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f0005c10 con 0x7faa001595a0 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7fa9fdd9b700 1 -- 172.21.15.84:0/1238462692 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000b610 con 0x7faa001595a0 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7faa04fd0700 1 -- 172.21.15.84:0/1238462692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa001595a0 msgr2=0x7faa000aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7faa04fd0700 1 --2- 172.21.15.84:0/1238462692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa001595a0 0x7faa000aa570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009900 tx=0x7fa9f0009120 comp rx=0 tx=0).stop 2023-10-06T02:55:48.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7faa04fd0700 1 -- 172.21.15.84:0/1238462692 shutdown_connections 2023-10-06T02:55:48.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7faa04fd0700 1 --2- 172.21.15.84:0/1238462692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa001595a0 0x7faa000aa570 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7faa04fd0700 1 -- 172.21.15.84:0/1238462692 >> 172.21.15.84:0/1238462692 conn(0x7faa00099830 msgr2=0x7faa0006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7faa04fd0700 1 -- 172.21.15.84:0/1238462692 shutdown_connections 2023-10-06T02:55:48.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.067+0000 7faa04fd0700 1 -- 172.21.15.84:0/1238462692 wait complete. 2023-10-06T02:55:48.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.069+0000 7faa04fd0700 1 Processor -- start 2023-10-06T02:55:48.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.069+0000 7faa04fd0700 1 -- start start 2023-10-06T02:55:48.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.069+0000 7faa04fd0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa000b07a0 0x7faa0014a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.069+0000 7faa04fd0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa000b49e0 0x7faa000b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.069+0000 7faa04fd0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa001595a0 0x7faa000b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.069+0000 7faa04fd0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0009af80 con 0x7faa000b07a0 2023-10-06T02:55:48.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.069+0000 7faa04fd0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0009bbf0 con 0x7faa000b49e0 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.069+0000 7faa04fd0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0009bed0 con 0x7faa001595a0 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.069+0000 7fa9fe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa000b07a0 0x7faa0014a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9fe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa000b07a0 0x7faa0014a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40502/0 (socket says 172.21.15.84:40502) 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9fe59c700 1 -- 172.21.15.84:0/2705771574 learned_addr learned my addr 172.21.15.84:0/2705771574 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9fed9d700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa001595a0 0x7faa000b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9f5d9b700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa000b49e0 0x7faa000b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9fe59c700 1 -- 172.21.15.84:0/2705771574 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa001595a0 msgr2=0x7faa000b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9fe59c700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa001595a0 0x7faa000b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9fe59c700 1 -- 172.21.15.84:0/2705771574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa000b49e0 msgr2=0x7faa000b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9fe59c700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa000b49e0 0x7faa000b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9fe59c700 1 -- 172.21.15.84:0/2705771574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00093c0 con 0x7faa000b07a0 2023-10-06T02:55:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9f5d9b700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa000b49e0 0x7faa000b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9fe59c700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa000b07a0 0x7faa0014a7e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009160 tx=0x7fa9f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9f6ffd700 1 -- 172.21.15.84:0/2705771574 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00063e0 con 0x7faa000b07a0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9f6ffd700 1 -- 172.21.15.84:0/2705771574 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f0006560 con 0x7faa000b07a0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0009c1b0 con 0x7faa000b07a0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7fa9f6ffd700 1 -- 172.21.15.84:0/2705771574 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0006920 con 0x7faa000b07a0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.070+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0014ad20 con 0x7faa000b07a0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.071+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0009c6d0 con 0x7faa000b07a0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.071+0000 7fa9f6ffd700 1 -- 172.21.15.84:0/2705771574 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9f001b690 con 0x7faa000b07a0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.072+0000 7fa9f6ffd700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa9e0066f30 0x7fa9e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.072+0000 7fa9f6ffd700 1 -- 172.21.15.84:0/2705771574 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa9f0086b00 con 0x7faa000b07a0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.072+0000 7fa9f5d9b700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa9e0066f30 0x7fa9e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.072+0000 7fa9f5d9b700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa9e0066f30 0x7fa9e00693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8007fd0 tx=0x7fa9e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.076+0000 7fa9f6ffd700 1 -- 172.21.15.84:0/2705771574 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa0009c6d0 con 0x7faa000b07a0 2023-10-06T02:55:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.302+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa0009c6d0 con 0x7faa000b07a0 2023-10-06T02:55:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.303+0000 7fa9f6ffd700 1 -- 172.21.15.84:0/2705771574 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7faa0009c6d0 con 0x7faa000b07a0 2023-10-06T02:55:48.304 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:48.305 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:19.276318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:55:48.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa9e0066f30 msgr2=0x7fa9e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa9e0066f30 0x7fa9e00693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8007fd0 tx=0x7fa9e8009040 comp rx=0 tx=0).stop 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa000b07a0 msgr2=0x7faa0014a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa000b07a0 0x7faa0014a7e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009160 tx=0x7fa9f0016000 comp rx=0 tx=0).stop 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 shutdown_connections 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa9e0066f30 0x7fa9e00693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa001595a0 0x7faa000b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa000b07a0 0x7faa0014a7e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 --2- 172.21.15.84:0/2705771574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa000b49e0 0x7faa000b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 >> 172.21.15.84:0/2705771574 conn(0x7faa00099830 msgr2=0x7faa000aa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 shutdown_connections 2023-10-06T02:55:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.305+0000 7faa04fd0700 1 -- 172.21.15.84:0/2705771574 wait complete. 2023-10-06T02:55:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-10-06T02:55:48.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:48.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.432+0000 7f6fee016700 1 Processor -- start 2023-10-06T02:55:48.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.432+0000 7f6fee016700 1 -- start start 2023-10-06T02:55:48.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fee016700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6fe81595a0 0x7f6fe80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fee016700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe80b07a0 0x7f6fe80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fee016700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe80b0ca0 con 0x7f6fe80b49e0 2023-10-06T02:55:48.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fee016700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe80b0f80 con 0x7f6fe81595a0 2023-10-06T02:55:48.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fee016700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b1260 con 0x7f6fe80b07a0 2023-10-06T02:55:48.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6fe80b49e0 0x7f6fe80aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51658/0 (socket says 172.21.15.84:51658) 2023-10-06T02:55:48.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe6ffd700 1 -- 172.21.15.84:0/1600723034 learned_addr learned my addr 172.21.15.84:0/1600723034 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:48.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe7fff700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe80b07a0 0x7f6fe80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe77fe700 1 --2- 172.21.15.84:0/1600723034 >> v2:172.21.15.131:3300/0 conn(0x7f6fe81595a0 0x7f6fe80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536788568 0 0) 0x7f6fe80b0ca0 con 0x7f6fe80b49e0 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd0003570 con 0x7f6fe80b49e0 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3596189048 0 0) 0x7f6fd0003570 con 0x7f6fe80b49e0 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe80b07a0 msgr2=0x7f6fe80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe67fc700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe80b07a0 0x7f6fe80b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 >> v2:172.21.15.131:3300/0 conn(0x7f6fe81595a0 msgr2=0x7f6fe80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe67fc700 1 --2- 172.21.15.84:0/1600723034 >> v2:172.21.15.131:3300/0 conn(0x7f6fe81595a0 0x7f6fe80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe80b1540 con 0x7f6fe80b49e0 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.433+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f6fdc001470 con 0x7f6fe80b49e0 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 >> v1:172.21.15.84:6789/0 conn(0x7f6fe80b49e0 legacy=0x7f6fe80aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd0003a60 0x7f6fd0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe80b07a0 0x7f6fd0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd0004d50 0x7f6fd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b0f80 con 0x7f6fd0004d50 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b1260 con 0x7f6fd0003a60 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd000ba60 con 0x7f6fe80b07a0 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe7fff700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd0004d50 0x7f6fd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe6ffd700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe80b07a0 0x7f6fd0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe77fe700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd0003a60 0x7f6fd0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe7fff700 1 -- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe80b07a0 msgr2=0x7f6fd0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe7fff700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe80b07a0 0x7f6fd0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe7fff700 1 -- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd0003a60 msgr2=0x7f6fd0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe7fff700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd0003a60 0x7f6fd0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe7fff700 1 -- 172.21.15.84:0/1600723034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0003570 con 0x7f6fd0004d50 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe7fff700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd0004d50 0x7f6fd00051c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80b64f0 tx=0x7f6fe00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3484c74b205db5d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe000e6b0 con 0x7f6fd0004d50 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe000e810 con 0x7f6fd0004d50 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.434+0000 7f6fe67fc700 1 -- 172.21.15.84:0/1600723034 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe000ebd0 con 0x7f6fd0004d50 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.435+0000 7f6fee016700 1 -- 172.21.15.84:0/1600723034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd0004d50 msgr2=0x7f6fd00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.435+0000 7f6fee016700 1 --2- 172.21.15.84:0/1600723034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fd0004d50 0x7f6fd00051c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80b64f0 tx=0x7f6fe00091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.435+0000 7f6fe7fff700 1 -- 172.21.15.84:0/1600723034 reap_dead start 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.435+0000 7f6fee016700 1 -- 172.21.15.84:0/1600723034 shutdown_connections 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.435+0000 7f6fee016700 1 -- 172.21.15.84:0/1600723034 >> 172.21.15.84:0/1600723034 conn(0x7f6fe8099830 msgr2=0x7f6fe806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.435+0000 7f6fee016700 1 -- 172.21.15.84:0/1600723034 shutdown_connections 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.435+0000 7f6fee016700 1 -- 172.21.15.84:0/1600723034 wait complete. 2023-10-06T02:55:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.436+0000 7f6fee016700 1 Processor -- start 2023-10-06T02:55:48.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.436+0000 7f6fee016700 1 -- start start 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fee016700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe816c470 0x7f6fe80ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fee016700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe80adda0 0x7f6fe8157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fee016700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe8157fb0 0x7f6fe809d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fee016700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80ae210 con 0x7f6fe816c470 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fee016700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe8158420 con 0x7f6fe80adda0 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fee016700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80ac430 con 0x7f6fe8157fb0 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe816c470 0x7f6fe80ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe816c470 0x7f6fe80ab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40522/0 (socket says 172.21.15.84:40522) 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe77fe700 1 -- 172.21.15.84:0/107660300 learned_addr learned my addr 172.21.15.84:0/107660300 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe6ffd700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe80adda0 0x7f6fe8157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe7fff700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe8157fb0 0x7f6fe809d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe77fe700 1 -- 172.21.15.84:0/107660300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe8157fb0 msgr2=0x7f6fe809d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe77fe700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe8157fb0 0x7f6fe809d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe77fe700 1 -- 172.21.15.84:0/107660300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe80adda0 msgr2=0x7f6fe8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe77fe700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe80adda0 0x7f6fe8157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe77fe700 1 -- 172.21.15.84:0/107660300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe80ad190 con 0x7f6fe816c470 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe7fff700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe8157fb0 0x7f6fe809d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fe77fe700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe816c470 0x7f6fe80ab240 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8011f30 tx=0x7f6fd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fcf7fe700 1 -- 172.21.15.84:0/107660300 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd800e040 con 0x7f6fe816c470 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fcf7fe700 1 -- 172.21.15.84:0/107660300 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd800f040 con 0x7f6fe816c470 2023-10-06T02:55:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe80ab820 con 0x7f6fe816c470 2023-10-06T02:55:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fcf7fe700 1 -- 172.21.15.84:0/107660300 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8015430 con 0x7f6fe816c470 2023-10-06T02:55:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.437+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe80abde0 con 0x7f6fe816c470 2023-10-06T02:55:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.438+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe8064ad0 con 0x7f6fe816c470 2023-10-06T02:55:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.439+0000 7f6fcf7fe700 1 -- 172.21.15.84:0/107660300 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fd8015860 con 0x7f6fe816c470 2023-10-06T02:55:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.439+0000 7f6fcf7fe700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fd4066f30 0x7f6fd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.439+0000 7f6fe6ffd700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fd4066f30 0x7f6fd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.439+0000 7f6fcf7fe700 1 -- 172.21.15.84:0/107660300 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6fd8085690 con 0x7f6fe816c470 2023-10-06T02:55:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.439+0000 7f6fe6ffd700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fd4066f30 0x7f6fd40693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0015a0 tx=0x7f6fdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.443+0000 7f6fcf7fe700 1 -- 172.21.15.84:0/107660300 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fd80524b0 con 0x7f6fe816c470 2023-10-06T02:55:48.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.632+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fe80b1820 con 0x7f6fe816c470 2023-10-06T02:55:48.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.633+0000 7f6fcf7fe700 1 -- 172.21.15.84:0/107660300 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f6fd8055ad0 con 0x7f6fe816c470 2023-10-06T02:55:48.634 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:48.635 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:48.468481+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:48.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fd4066f30 msgr2=0x7f6fd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fd4066f30 0x7f6fd40693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0015a0 tx=0x7f6fdc009040 comp rx=0 tx=0).stop 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe816c470 msgr2=0x7f6fe80ab240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe816c470 0x7f6fe80ab240 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8011f30 tx=0x7f6fd800b040 comp rx=0 tx=0).stop 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 shutdown_connections 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6fd4066f30 0x7f6fd40693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fe8157fb0 0x7f6fe809d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe816c470 0x7f6fe80ab240 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 --2- 172.21.15.84:0/107660300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fe80adda0 0x7f6fe8157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 >> 172.21.15.84:0/107660300 conn(0x7f6fe8099830 msgr2=0x7f6fe80b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 shutdown_connections 2023-10-06T02:55:48.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.635+0000 7f6fee016700 1 -- 172.21.15.84:0/107660300 wait complete. 2023-10-06T02:55:48.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:55:05.120029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:55:05.566741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T02:55:09.247969+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:55:48.649 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:55:48.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.764+0000 7f811a6c2700 1 Processor -- start 2023-10-06T02:55:48.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.764+0000 7f811a6c2700 1 -- start start 2023-10-06T02:55:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f811a6c2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f81140b2660 0x7f81140cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f811a6c2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f81140b2a30 0x7f81140cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f811a6c2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140ceae0 0x7f81140cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f811a6c2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81140cc9b0 con 0x7f81140b2660 2023-10-06T02:55:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f811a6c2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81140cf4c0 con 0x7f81140b2a30 2023-10-06T02:55:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f811a6c2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81140cbda0 con 0x7f81140ceae0 2023-10-06T02:55:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f81196c0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f81140b2660 0x7f81140cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f81196c0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f81140b2660 0x7f81140cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40530/0 (socket says 172.21.15.84:40530) 2023-10-06T02:55:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f81196c0700 1 -- 172.21.15.84:0/1192771814 learned_addr learned my addr 172.21.15.84:0/1192771814 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f8119ec1700 1 --2- 172.21.15.84:0/1192771814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140ceae0 0x7f81140cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f8118ebf700 1 --2- 172.21.15.84:0/1192771814 >> v2:172.21.15.131:3300/0 conn(0x7f81140b2a30 0x7f81140cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f81196c0700 1 -- 172.21.15.84:0/1192771814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140ceae0 msgr2=0x7f81140cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f81196c0700 1 --2- 172.21.15.84:0/1192771814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140ceae0 0x7f81140cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f81196c0700 1 -- 172.21.15.84:0/1192771814 >> v2:172.21.15.131:3300/0 conn(0x7f81140b2a30 msgr2=0x7f81140cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f81196c0700 1 --2- 172.21.15.84:0/1192771814 >> v2:172.21.15.131:3300/0 conn(0x7f81140b2a30 0x7f81140cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.765+0000 7f81196c0700 1 -- 172.21.15.84:0/1192771814 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140cc080 con 0x7f81140b2660 2023-10-06T02:55:48.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f81196c0700 1 --2- 172.21.15.84:0/1192771814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2660 0x7f81140cccf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81140b6310 tx=0x7f8110009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40856ed8eeae55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f810bfff700 1 -- 172.21.15.84:0/1192771814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110005c10 con 0x7f81140b2660 2023-10-06T02:55:48.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f810bfff700 1 -- 172.21.15.84:0/1192771814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8110005d70 con 0x7f81140b2660 2023-10-06T02:55:48.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f810bfff700 1 -- 172.21.15.84:0/1192771814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000b880 con 0x7f81140b2660 2023-10-06T02:55:48.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f811a6c2700 1 -- 172.21.15.84:0/1192771814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2660 msgr2=0x7f81140cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f811a6c2700 1 --2- 172.21.15.84:0/1192771814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2660 0x7f81140cccf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81140b6310 tx=0x7f8110009220 comp rx=0 tx=0).stop 2023-10-06T02:55:48.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f811a6c2700 1 -- 172.21.15.84:0/1192771814 shutdown_connections 2023-10-06T02:55:48.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f811a6c2700 1 --2- 172.21.15.84:0/1192771814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140ceae0 0x7f81140cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f811a6c2700 1 --2- 172.21.15.84:0/1192771814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2660 0x7f81140cccf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f811a6c2700 1 --2- 172.21.15.84:0/1192771814 >> v2:172.21.15.131:3300/0 conn(0x7f81140b2a30 0x7f81140cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f811a6c2700 1 -- 172.21.15.84:0/1192771814 >> 172.21.15.84:0/1192771814 conn(0x7f8114099560 msgr2=0x7f811406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f811a6c2700 1 -- 172.21.15.84:0/1192771814 shutdown_connections 2023-10-06T02:55:48.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.766+0000 7f811a6c2700 1 -- 172.21.15.84:0/1192771814 wait complete. 2023-10-06T02:55:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.767+0000 7f811a6c2700 1 Processor -- start 2023-10-06T02:55:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.768+0000 7f811a6c2700 1 -- start start 2023-10-06T02:55:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.768+0000 7f811a6c2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140b2660 0x7f8114157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.768+0000 7f811a6c2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2a30 0x7f811416cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.768+0000 7f811a6c2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81140ceae0 0x7f8114144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.768+0000 7f811a6c2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811416d4e0 con 0x7f81140b2a30 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.768+0000 7f811a6c2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140c73c0 con 0x7f81140ceae0 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.768+0000 7f811a6c2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81140c76a0 con 0x7f81140b2660 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.768+0000 7f8118ebf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2a30 0x7f811416cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f8118ebf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2a30 0x7f811416cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40536/0 (socket says 172.21.15.84:40536) 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f8118ebf700 1 -- 172.21.15.84:0/2671791218 learned_addr learned my addr 172.21.15.84:0/2671791218 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f81196c0700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140b2660 0x7f8114157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f8119ec1700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81140ceae0 0x7f8114144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f8118ebf700 1 -- 172.21.15.84:0/2671791218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140b2660 msgr2=0x7f8114157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f8118ebf700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140b2660 0x7f8114157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f8118ebf700 1 -- 172.21.15.84:0/2671791218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81140ceae0 msgr2=0x7f8114144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f8118ebf700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81140ceae0 0x7f8114144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f8118ebf700 1 -- 172.21.15.84:0/2671791218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8110009480 con 0x7f81140b2a30 2023-10-06T02:55:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f8118ebf700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2a30 0x7f811416cfa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f810400d890 tx=0x7f8104008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f81097fa700 1 -- 172.21.15.84:0/2671791218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040125f0 con 0x7f81140b2a30 2023-10-06T02:55:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f81097fa700 1 -- 172.21.15.84:0/2671791218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104012750 con 0x7f81140b2a30 2023-10-06T02:55:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811416d710 con 0x7f81140b2a30 2023-10-06T02:55:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f81097fa700 1 -- 172.21.15.84:0/2671791218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104012af0 con 0x7f81140b2a30 2023-10-06T02:55:48.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.769+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811416dcd0 con 0x7f81140b2a30 2023-10-06T02:55:48.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.770+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811405f270 con 0x7f81140b2a30 2023-10-06T02:55:48.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.770+0000 7f81097fa700 1 -- 172.21.15.84:0/2671791218 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f810401e460 con 0x7f81140b2a30 2023-10-06T02:55:48.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.771+0000 7f81097fa700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f80f8066f30 0x7f80f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:48.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.771+0000 7f81097fa700 1 -- 172.21.15.84:0/2671791218 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f8104084ec0 con 0x7f81140b2a30 2023-10-06T02:55:48.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.771+0000 7f81196c0700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f80f8066f30 0x7f80f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:48.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.771+0000 7f81196c0700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f80f8066f30 0x7f80f80693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8114099a80 tx=0x7f8110016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:48.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.775+0000 7f81097fa700 1 -- 172.21.15.84:0/2671791218 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8104055730 con 0x7f81140b2a30 2023-10-06T02:55:48.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.959+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81140c77e0 con 0x7f81140b2a30 2023-10-06T02:55:48.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.960+0000 7f81097fa700 1 -- 172.21.15.84:0/2671791218 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81040552c0 con 0x7f81140b2a30 2023-10-06T02:55:48.961 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:55:48.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f80f8066f30 msgr2=0x7f80f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f80f8066f30 0x7f80f80693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8114099a80 tx=0x7f8110016000 comp rx=0 tx=0).stop 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2a30 msgr2=0x7f811416cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2a30 0x7f811416cfa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f810400d890 tx=0x7f8104008040 comp rx=0 tx=0).stop 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 shutdown_connections 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f80f8066f30 0x7f80f80693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81140ceae0 0x7f8114144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81140b2660 0x7f8114157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 --2- 172.21.15.84:0/2671791218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81140b2a30 0x7f811416cfa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 >> 172.21.15.84:0/2671791218 conn(0x7f8114099560 msgr2=0x7f81140689e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 shutdown_connections 2023-10-06T02:55:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:48.962+0000 7f811a6c2700 1 -- 172.21.15.84:0/2671791218 wait complete. 2023-10-06T02:55:48.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:55:49.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.091+0000 7ffaf64b9700 1 Processor -- start 2023-10-06T02:55:49.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.091+0000 7ffaf64b9700 1 -- start start 2023-10-06T02:55:49.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaf64b9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf0159510 0x7ffaf00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaf64b9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffaf00cbae0 0x7ffaf00cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaf64b9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00cbf00 con 0x7ffaf01598e0 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaf64b9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf00cf610 con 0x7ffaf00cbae0 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaf64b9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00cf8f0 con 0x7ffaf0159510 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaf4a56700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffaf00cbae0 0x7ffaf00cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaf4a56700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffaf00cbae0 0x7ffaf00cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40540/0 (socket says 172.21.15.84:40540) 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaf4a56700 1 -- 172.21.15.84:0/655650510 learned_addr learned my addr 172.21.15.84:0/655650510 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaeffff700 1 --2- 172.21.15.84:0/655650510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf0159510 0x7ffaf00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.092+0000 7ffaf4a56700 1 -- 172.21.15.84:0/655650510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf0159510 msgr2=0x7ffaf00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf4a56700 1 --2- 172.21.15.84:0/655650510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf0159510 0x7ffaf00cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf4a56700 1 -- 172.21.15.84:0/655650510 >> v1:172.21.15.131:6789/0 conn(0x7ffaf01598e0 legacy=0x7ffaf00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf4a56700 1 -- 172.21.15.84:0/655650510 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00cfbd0 con 0x7ffaf00cbae0 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf4a56700 1 --2- 172.21.15.84:0/655650510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf00cbae0 0x7ffaf00cef30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009f20 tx=0x7ffae8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdb3ebf3e7d86ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaeeffd700 1 -- 172.21.15.84:0/655650510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae800e070 con 0x7ffaf00cbae0 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaeeffd700 1 -- 172.21.15.84:0/655650510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae800ba80 con 0x7ffaf00cbae0 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaeeffd700 1 -- 172.21.15.84:0/655650510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80092e0 con 0x7ffaf00cbae0 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf64b9700 1 -- 172.21.15.84:0/655650510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf00cbae0 msgr2=0x7ffaf00cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf64b9700 1 --2- 172.21.15.84:0/655650510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf00cbae0 0x7ffaf00cef30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009f20 tx=0x7ffae8009840 comp rx=0 tx=0).stop 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf64b9700 1 -- 172.21.15.84:0/655650510 shutdown_connections 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf64b9700 1 --2- 172.21.15.84:0/655650510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf00cbae0 0x7ffaf00cef30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf64b9700 1 --2- 172.21.15.84:0/655650510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf0159510 0x7ffaf00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf64b9700 1 -- 172.21.15.84:0/655650510 >> 172.21.15.84:0/655650510 conn(0x7ffaf0089e90 msgr2=0x7ffaf00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:49.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf64b9700 1 -- 172.21.15.84:0/655650510 shutdown_connections 2023-10-06T02:55:49.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.093+0000 7ffaf64b9700 1 -- 172.21.15.84:0/655650510 wait complete. 2023-10-06T02:55:49.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.094+0000 7ffaf64b9700 1 Processor -- start 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.095+0000 7ffaf64b9700 1 -- start start 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.095+0000 7ffaf64b9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf00cbae0 0x7ffaf0149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.095+0000 7ffaf64b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf0159510 0x7ffaf01558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.095+0000 7ffaf64b9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf01598e0 0x7ffaf015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.095+0000 7ffaf64b9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00c9180 con 0x7ffaf0159510 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.095+0000 7ffaf64b9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00c9430 con 0x7ffaf00cbae0 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.095+0000 7ffaf64b9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00c9710 con 0x7ffaf01598e0 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf0159510 0x7ffaf01558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf0159510 0x7ffaf01558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40546/0 (socket says 172.21.15.84:40546) 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaef7fe700 1 -- 172.21.15.84:0/740188676 learned_addr learned my addr 172.21.15.84:0/740188676 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:49.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaeffff700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf00cbae0 0x7ffaf0149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaf4a56700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf01598e0 0x7ffaf015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaef7fe700 1 -- 172.21.15.84:0/740188676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf01598e0 msgr2=0x7ffaf015a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaef7fe700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf01598e0 0x7ffaf015a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaef7fe700 1 -- 172.21.15.84:0/740188676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf00cbae0 msgr2=0x7ffaf0149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaef7fe700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf00cbae0 0x7ffaf0149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaef7fe700 1 -- 172.21.15.84:0/740188676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae8009ae0 con 0x7ffaf0159510 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaef7fe700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf0159510 0x7ffaf01558a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c7c0 tx=0x7ffae4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffad7fff700 1 -- 172.21.15.84:0/740188676 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4011590 con 0x7ffaf0159510 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffad7fff700 1 -- 172.21.15.84:0/740188676 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae40116f0 con 0x7ffaf0159510 2023-10-06T02:55:49.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf00c99f0 con 0x7ffaf0159510 2023-10-06T02:55:49.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffad7fff700 1 -- 172.21.15.84:0/740188676 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4011ab0 con 0x7ffaf0159510 2023-10-06T02:55:49.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.096+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf015c5c0 con 0x7ffaf0159510 2023-10-06T02:55:49.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.097+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf0153610 con 0x7ffaf0159510 2023-10-06T02:55:49.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.098+0000 7ffad7fff700 1 -- 172.21.15.84:0/740188676 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffae401b3b0 con 0x7ffaf0159510 2023-10-06T02:55:49.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.098+0000 7ffad7fff700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffadc066f60 0x7ffadc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.098+0000 7ffad7fff700 1 -- 172.21.15.84:0/740188676 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ffae4083da0 con 0x7ffaf0159510 2023-10-06T02:55:49.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.098+0000 7ffaeffff700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffadc066f60 0x7ffadc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.098+0000 7ffaeffff700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffadc066f60 0x7ffadc069410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffae0006fd0 tx=0x7ffae0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.102+0000 7ffad7fff700 1 -- 172.21.15.84:0/740188676 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffaf0153610 con 0x7ffaf0159510 2023-10-06T02:55:49.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.285+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffaf0153610 con 0x7ffaf0159510 2023-10-06T02:55:49.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.285+0000 7ffad7fff700 1 -- 172.21.15.84:0/740188676 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffaf0153610 con 0x7ffaf0159510 2023-10-06T02:55:49.287 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:55:49.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffadc066f60 msgr2=0x7ffadc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffadc066f60 0x7ffadc069410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffae0006fd0 tx=0x7ffae0008040 comp rx=0 tx=0).stop 2023-10-06T02:55:49.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf0159510 msgr2=0x7ffaf01558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf0159510 0x7ffaf01558a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c7c0 tx=0x7ffae4007f50 comp rx=0 tx=0).stop 2023-10-06T02:55:49.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 shutdown_connections 2023-10-06T02:55:49.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffadc066f60 0x7ffadc069410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf00cbae0 0x7ffaf0149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffaf01598e0 0x7ffaf015a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 --2- 172.21.15.84:0/740188676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffaf0159510 0x7ffaf01558a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 >> 172.21.15.84:0/740188676 conn(0x7ffaf0089e90 msgr2=0x7ffaf014aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:49.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 shutdown_connections 2023-10-06T02:55:49.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.287+0000 7ffaf64b9700 1 -- 172.21.15.84:0/740188676 wait complete. 2023-10-06T02:55:49.300 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:55:49.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.416+0000 7fc2e1ed4700 1 Processor -- start 2023-10-06T02:55:49.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.416+0000 7fc2e1ed4700 1 -- start start 2023-10-06T02:55:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2e1ed4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0b0680 0x7fc2dc0ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2e1ed4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2dc0b0a50 0x7fc2dc0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2e1ed4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2dc0c5400 con 0x7fc2dc0cc460 2023-10-06T02:55:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2e1ed4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2dc0ca7d0 con 0x7fc2dc0b0a50 2023-10-06T02:55:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2e1ed4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc0ccd40 con 0x7fc2dc0b0680 2023-10-06T02:55:49.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2daffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2dc0b0a50 0x7fc2dc0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2daffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2dc0b0a50 0x7fc2dc0cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40556/0 (socket says 172.21.15.84:40556) 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2daffd700 1 -- 172.21.15.84:0/884554557 learned_addr learned my addr 172.21.15.84:0/884554557 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2db7fe700 1 --2- 172.21.15.84:0/884554557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0b0680 0x7fc2dc0ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2daffd700 1 -- 172.21.15.84:0/884554557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0b0680 msgr2=0x7fc2dc0ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2daffd700 1 --2- 172.21.15.84:0/884554557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0b0680 0x7fc2dc0ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2daffd700 1 -- 172.21.15.84:0/884554557 >> v1:172.21.15.131:6789/0 conn(0x7fc2dc0cc460 legacy=0x7fc2dc0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2daffd700 1 -- 172.21.15.84:0/884554557 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc0cd020 con 0x7fc2dc0b0a50 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2db7fe700 1 --2- 172.21.15.84:0/884554557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0b0680 0x7fc2dc0ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.417+0000 7fc2daffd700 1 --2- 172.21.15.84:0/884554557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0a50 0x7fc2dc0cbf20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00099b0 tx=0x7fc2d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae1a35fbbd5c42a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2da7fc700 1 -- 172.21.15.84:0/884554557 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000b820 con 0x7fc2dc0b0a50 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2da7fc700 1 -- 172.21.15.84:0/884554557 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d000b980 con 0x7fc2dc0b0a50 2023-10-06T02:55:49.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2da7fc700 1 -- 172.21.15.84:0/884554557 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000bd20 con 0x7fc2dc0b0a50 2023-10-06T02:55:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/884554557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0a50 msgr2=0x7fc2dc0cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2e1ed4700 1 --2- 172.21.15.84:0/884554557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0a50 0x7fc2dc0cbf20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00099b0 tx=0x7fc2d0009250 comp rx=0 tx=0).stop 2023-10-06T02:55:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/884554557 shutdown_connections 2023-10-06T02:55:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2e1ed4700 1 --2- 172.21.15.84:0/884554557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0b0680 0x7fc2dc0ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2e1ed4700 1 --2- 172.21.15.84:0/884554557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0a50 0x7fc2dc0cbf20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/884554557 >> 172.21.15.84:0/884554557 conn(0x7fc2dc088000 msgr2=0x7fc2dc0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/884554557 shutdown_connections 2023-10-06T02:55:49.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.418+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/884554557 wait complete. 2023-10-06T02:55:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.419+0000 7fc2e1ed4700 1 Processor -- start 2023-10-06T02:55:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.419+0000 7fc2e1ed4700 1 -- start start 2023-10-06T02:55:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2e1ed4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0680 0x7fc2dc168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2e1ed4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2dc0b0a50 0x7fc2dc0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2e1ed4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0cc460 0x7fc2dc15c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2e1ed4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc150cd0 con 0x7fc2dc0b0680 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2e1ed4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc16b770 con 0x7fc2dc0b0a50 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2e1ed4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc0b18f0 con 0x7fc2dc0cc460 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0680 0x7fc2dc168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0680 0x7fc2dc168060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40558/0 (socket says 172.21.15.84:40558) 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2db7fe700 1 -- 172.21.15.84:0/1137864054 learned_addr learned my addr 172.21.15.84:0/1137864054 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2dbfff700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0cc460 0x7fc2dc15c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.420+0000 7fc2daffd700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2dc0b0a50 0x7fc2dc0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2db7fe700 1 -- 172.21.15.84:0/1137864054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0cc460 msgr2=0x7fc2dc15c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2db7fe700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0cc460 0x7fc2dc15c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2db7fe700 1 -- 172.21.15.84:0/1137864054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2dc0b0a50 msgr2=0x7fc2dc0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2db7fe700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2dc0b0a50 0x7fc2dc0b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2db7fe700 1 -- 172.21.15.84:0/1137864054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00094f0 con 0x7fc2dc0b0680 2023-10-06T02:55:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2db7fe700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0680 0x7fc2dc168060 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00c880 tx=0x7fc2cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2c37fe700 1 -- 172.21.15.84:0/1137864054 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc005a00 con 0x7fc2dc0b0680 2023-10-06T02:55:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2c37fe700 1 -- 172.21.15.84:0/1137864054 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc005b60 con 0x7fc2dc0b0680 2023-10-06T02:55:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2dc0b1630 con 0x7fc2dc0b0680 2023-10-06T02:55:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2c37fe700 1 -- 172.21.15.84:0/1137864054 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc011600 con 0x7fc2dc0b0680 2023-10-06T02:55:49.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.421+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2dc1689d0 con 0x7fc2dc0b0680 2023-10-06T02:55:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.422+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2dc064ad0 con 0x7fc2dc0b0680 2023-10-06T02:55:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.422+0000 7fc2c37fe700 1 -- 172.21.15.84:0/1137864054 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2cc0119f0 con 0x7fc2dc0b0680 2023-10-06T02:55:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.422+0000 7fc2c37fe700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2c8066f30 0x7fc2c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.423+0000 7fc2c37fe700 1 -- 172.21.15.84:0/1137864054 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fc2cc0846a0 con 0x7fc2dc0b0680 2023-10-06T02:55:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.423+0000 7fc2daffd700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2c8066f30 0x7fc2c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.423+0000 7fc2daffd700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2c8066f30 0x7fc2c80693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00099b0 tx=0x7fc2d0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.427+0000 7fc2c37fe700 1 -- 172.21.15.84:0/1137864054 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2cc051480 con 0x7fc2dc0b0680 2023-10-06T02:55:49.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.611+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2dc0ca3f0 con 0x7fc2dc0b0680 2023-10-06T02:55:49.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.612+0000 7fc2c37fe700 1 -- 172.21.15.84:0/1137864054 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2cc054aa0 con 0x7fc2dc0b0680 2023-10-06T02:55:49.613 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2c8066f30 msgr2=0x7fc2c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2c8066f30 0x7fc2c80693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00099b0 tx=0x7fc2d0016000 comp rx=0 tx=0).stop 2023-10-06T02:55:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0680 msgr2=0x7fc2dc168060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0680 0x7fc2dc168060 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00c880 tx=0x7fc2cc008040 comp rx=0 tx=0).stop 2023-10-06T02:55:49.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 shutdown_connections 2023-10-06T02:55:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2c8066f30 0x7fc2c80693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2dc0cc460 0x7fc2dc15c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2dc0b0680 0x7fc2dc168060 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 --2- 172.21.15.84:0/1137864054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2dc0b0a50 0x7fc2dc0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.613+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 >> 172.21.15.84:0/1137864054 conn(0x7fc2dc088000 msgr2=0x7fc2dc0c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.614+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 shutdown_connections 2023-10-06T02:55:49.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.614+0000 7fc2e1ed4700 1 -- 172.21.15.84:0/1137864054 wait complete. 2023-10-06T02:55:49.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:55:49.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.744+0000 7fe27359e700 1 Processor -- start 2023-10-06T02:55:49.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.745+0000 7fe27359e700 1 -- start start 2023-10-06T02:55:49.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.745+0000 7fe27359e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe2740b0800 0x7fe274156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.745+0000 7fe27359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27415a640 con 0x7fe2740b1870 2023-10-06T02:55:49.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.745+0000 7fe27359e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2740b0d10 con 0x7fe2741539b0 2023-10-06T02:55:49.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.745+0000 7fe27359e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe274159d10 con 0x7fe2740b0800 2023-10-06T02:55:49.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.745+0000 7fe269d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe2740b1870 0x7fe274156630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51668/0 (socket says 172.21.15.84:51668) 2023-10-06T02:55:49.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.745+0000 7fe269d9b700 1 -- 172.21.15.84:0/2602085262 learned_addr learned my addr 172.21.15.84:0/2602085262 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe272d9d700 1 --2- 172.21.15.84:0/2602085262 >> v2:172.21.15.131:3300/0 conn(0x7fe2740b0800 0x7fe274156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391650081 0 0) 0x7fe27415a640 con 0x7fe2740b1870 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe260003570 con 0x7fe2740b1870 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541089850 0 0) 0x7fe2740b0d10 con 0x7fe2741539b0 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe27415a640 con 0x7fe2741539b0 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3489713143 0 0) 0x7fe260003570 con 0x7fe2740b1870 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 >> v2:172.21.15.131:3300/0 conn(0x7fe2740b0800 msgr2=0x7fe274156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 --2- 172.21.15.84:0/2602085262 >> v2:172.21.15.131:3300/0 conn(0x7fe2740b0800 0x7fe274156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 >> v1:172.21.15.131:6789/0 conn(0x7fe2741539b0 legacy=0x7fe2740b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe274159ff0 con 0x7fe2740b1870 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fe25c001470 con 0x7fe2740b1870 2023-10-06T02:55:49.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 >> v1:172.21.15.84:6789/0 conn(0x7fe2740b1870 legacy=0x7fe274156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe260003c40 0x7fe260004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260004810 0x7fe260004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe260005210 0x7fe26000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe274159d10 con 0x7fe260003c40 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26000c130 con 0x7fe260005210 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26000c2c0 con 0x7fe260004810 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe27259c700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe260003c40 0x7fe260004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe269d9b700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260004810 0x7fe260004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe272d9d700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe260005210 0x7fe26000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe27259c700 1 -- 172.21.15.84:0/2602085262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260004810 msgr2=0x7fe260004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:49.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe27259c700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260004810 0x7fe260004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe27259c700 1 -- 172.21.15.84:0/2602085262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe260005210 msgr2=0x7fe26000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.746+0000 7fe27259c700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe260005210 0x7fe26000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe272d9d700 1 -- 172.21.15.84:0/2602085262 reap_dead start 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe27259c700 1 -- 172.21.15.84:0/2602085262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260003570 con 0x7fe260003c40 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe269d9b700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260004810 0x7fe260004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe27259c700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe260003c40 0x7fe260004030 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2640019e0 tx=0x7fe264007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1159cadbf73733 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26400c550 con 0x7fe260003c40 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26400c6b0 con 0x7fe260003c40 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe271d9b700 1 -- 172.21.15.84:0/2602085262 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26400ca50 con 0x7fe260003c40 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe27359e700 1 -- 172.21.15.84:0/2602085262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe260003c40 msgr2=0x7fe260004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe27359e700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe260003c40 0x7fe260004030 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2640019e0 tx=0x7fe264007d30 comp rx=0 tx=0).stop 2023-10-06T02:55:49.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe27359e700 1 -- 172.21.15.84:0/2602085262 shutdown_connections 2023-10-06T02:55:49.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe27359e700 1 --2- 172.21.15.84:0/2602085262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe260003c40 0x7fe260004030 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe27359e700 1 -- 172.21.15.84:0/2602085262 >> 172.21.15.84:0/2602085262 conn(0x7fe274069180 msgr2=0x7fe2740aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:49.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe27359e700 1 -- 172.21.15.84:0/2602085262 shutdown_connections 2023-10-06T02:55:49.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.747+0000 7fe27359e700 1 -- 172.21.15.84:0/2602085262 wait complete. 2023-10-06T02:55:49.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.748+0000 7fe27359e700 1 Processor -- start 2023-10-06T02:55:49.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe27359e700 1 -- start start 2023-10-06T02:55:49.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe27359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260003c40 0x7fe27416ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe27359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27416a540 0x7fe274141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe27359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27416c410 0x7fe27416c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe27359e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27416b370 con 0x7fe27416c410 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe27359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27416b650 con 0x7fe27416a540 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe27359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27416b930 con 0x7fe260003c40 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe272d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27416c410 0x7fe27416c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe272d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27416c410 0x7fe27416c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40590/0 (socket says 172.21.15.84:40590) 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe272d9d700 1 -- 172.21.15.84:0/384073735 learned_addr learned my addr 172.21.15.84:0/384073735 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe269d9b700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27416a540 0x7fe274141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.749+0000 7fe27259c700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260003c40 0x7fe27416ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe272d9d700 1 -- 172.21.15.84:0/384073735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260003c40 msgr2=0x7fe27416ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe272d9d700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260003c40 0x7fe27416ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe272d9d700 1 -- 172.21.15.84:0/384073735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27416a540 msgr2=0x7fe274141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe272d9d700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27416a540 0x7fe274141a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe272d9d700 1 -- 172.21.15.84:0/384073735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27416bc10 con 0x7fe27416c410 2023-10-06T02:55:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe269d9b700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27416a540 0x7fe274141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe272d9d700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27416c410 0x7fe27416c860 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe27406dd40 tx=0x7fe26c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe26affd700 1 -- 172.21.15.84:0/384073735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c00e070 con 0x7fe27416c410 2023-10-06T02:55:49.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe26affd700 1 -- 172.21.15.84:0/384073735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c011d00 con 0x7fe27416c410 2023-10-06T02:55:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27416bef0 con 0x7fe27416c410 2023-10-06T02:55:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe26affd700 1 -- 172.21.15.84:0/384073735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0166a0 con 0x7fe27416c410 2023-10-06T02:55:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.750+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe274141f80 con 0x7fe27416c410 2023-10-06T02:55:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.751+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27416c130 con 0x7fe27416c410 2023-10-06T02:55:49.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.751+0000 7fe26affd700 1 -- 172.21.15.84:0/384073735 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe26c016ad0 con 0x7fe27416c410 2023-10-06T02:55:49.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.751+0000 7fe26affd700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe254066f30 0x7fe2540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:49.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.752+0000 7fe26affd700 1 -- 172.21.15.84:0/384073735 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fe26c085720 con 0x7fe27416c410 2023-10-06T02:55:49.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.752+0000 7fe27259c700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe254066f30 0x7fe2540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:49.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.752+0000 7fe27259c700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe254066f30 0x7fe2540693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe2640017f0 tx=0x7fe264015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:49.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.756+0000 7fe26affd700 1 -- 172.21.15.84:0/384073735 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe27416c130 con 0x7fe27416c410 2023-10-06T02:55:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.941+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe27416c130 con 0x7fe27416c410 2023-10-06T02:55:49.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.941+0000 7fe26affd700 1 -- 172.21.15.84:0/384073735 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe27416c130 con 0x7fe27416c410 2023-10-06T02:55:49.943 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:55:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe254066f30 msgr2=0x7fe2540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe254066f30 0x7fe2540693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe2640017f0 tx=0x7fe264015000 comp rx=0 tx=0).stop 2023-10-06T02:55:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27416c410 msgr2=0x7fe27416c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27416c410 0x7fe27416c860 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe27406dd40 tx=0x7fe26c00b040 comp rx=0 tx=0).stop 2023-10-06T02:55:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 shutdown_connections 2023-10-06T02:55:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe254066f30 0x7fe2540693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe27416c410 0x7fe27416c860 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe260003c40 0x7fe27416ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 --2- 172.21.15.84:0/384073735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe27416a540 0x7fe274141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:49.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 >> 172.21.15.84:0/384073735 conn(0x7fe274069180 msgr2=0x7fe2740cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:49.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 shutdown_connections 2023-10-06T02:55:49.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:49.943+0000 7fe27359e700 1 -- 172.21.15.84:0/384073735 wait complete. 2023-10-06T02:55:49.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T02:55:50.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.071+0000 7f382427e700 1 Processor -- start 2023-10-06T02:55:50.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.072+0000 7f382427e700 1 -- start start 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.072+0000 7f382427e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f381c1598e0 0x7f381c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.072+0000 7f382427e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c0cf610 con 0x7f381c0cbcb0 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.072+0000 7f382427e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c0cf8f0 con 0x7f381c159510 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.072+0000 7f382427e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c0cfbd0 con 0x7f381c1598e0 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f382281b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f381c0cbcb0 0x7f381c0ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51678/0 (socket says 172.21.15.84:51678) 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f382281b700 1 -- 172.21.15.84:0/3251056082 learned_addr learned my addr 172.21.15.84:0/3251056082 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821819700 1 --2- 172.21.15.84:0/3251056082 >> v2:172.21.15.131:3300/0 conn(0x7f381c1598e0 0x7f381c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675996268 0 0) 0x7f381c0cf610 con 0x7f381c0cbcb0 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3804003570 con 0x7f381c0cbcb0 2023-10-06T02:55:50.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2781323812 0 0) 0x7f3804003570 con 0x7f381c0cbcb0 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 >> v2:172.21.15.131:3300/0 conn(0x7f381c1598e0 msgr2=0x7f381c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 --2- 172.21.15.84:0/3251056082 >> v2:172.21.15.131:3300/0 conn(0x7f381c1598e0 0x7f381c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 >> v1:172.21.15.131:6789/0 conn(0x7f381c159510 legacy=0x7f381c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0cfeb0 con 0x7f381c0cbcb0 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f3814001470 con 0x7f381c0cbcb0 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 >> v1:172.21.15.84:6789/0 conn(0x7f381c0cbcb0 legacy=0x7f381c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3804003a60 0x7f3804003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3804004810 0x7f3804004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38040051c0 0x7f380400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0cfbd0 con 0x7f3804003a60 2023-10-06T02:55:50.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380400c0d0 con 0x7f38040051c0 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380400c290 con 0x7f3804004810 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f382201a700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3804003a60 0x7f3804003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f382281b700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38040051c0 0x7f380400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.073+0000 7f3821819700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3804004810 0x7f3804004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f382201a700 1 -- 172.21.15.84:0/3251056082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3804004810 msgr2=0x7f3804004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f382201a700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3804004810 0x7f3804004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f382201a700 1 -- 172.21.15.84:0/3251056082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38040051c0 msgr2=0x7f380400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f382201a700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38040051c0 0x7f380400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f382201a700 1 -- 172.21.15.84:0/3251056082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804003570 con 0x7f3804003a60 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f382281b700 1 -- 172.21.15.84:0/3251056082 reap_dead start 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f382201a700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3804003a60 0x7f3804003e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f380c001fc0 tx=0x7f380c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d337834076395b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c001950 con 0x7f3804003a60 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c00c8b0 con 0x7f3804003a60 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f3821018700 1 -- 172.21.15.84:0/3251056082 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c00cc50 con 0x7f3804003a60 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f382427e700 1 -- 172.21.15.84:0/3251056082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3804003a60 msgr2=0x7f3804003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.074+0000 7f382427e700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3804003a60 0x7f3804003e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f380c001fc0 tx=0x7f380c001640 comp rx=0 tx=0).stop 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.075+0000 7f382427e700 1 -- 172.21.15.84:0/3251056082 shutdown_connections 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.075+0000 7f382427e700 1 --2- 172.21.15.84:0/3251056082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3804003a60 0x7f3804003e70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.075+0000 7f382427e700 1 -- 172.21.15.84:0/3251056082 >> 172.21.15.84:0/3251056082 conn(0x7f381c089e90 msgr2=0x7f381c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.075+0000 7f382427e700 1 -- 172.21.15.84:0/3251056082 shutdown_connections 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.075+0000 7f382427e700 1 -- 172.21.15.84:0/3251056082 wait complete. 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382427e700 1 Processor -- start 2023-10-06T02:55:50.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382427e700 1 -- start start 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382427e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3804003a60 0x7f381c16de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382427e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f381c1696a0 0x7f381c14a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382427e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f381c169b10 0x7f381c14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382427e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0b5e30 con 0x7f381c169b10 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382427e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c16e340 con 0x7f381c1696a0 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382427e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0b62c0 con 0x7f3804003a60 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382281b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f381c169b10 0x7f381c14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.076+0000 7f382281b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f381c169b10 0x7f381c14adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40608/0 (socket says 172.21.15.84:40608) 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382281b700 1 -- 172.21.15.84:0/4251271452 learned_addr learned my addr 172.21.15.84:0/4251271452 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382201a700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3804003a60 0x7f381c16de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f3821819700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f381c1696a0 0x7f381c14a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382281b700 1 -- 172.21.15.84:0/4251271452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3804003a60 msgr2=0x7f381c16de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382281b700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3804003a60 0x7f381c16de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382281b700 1 -- 172.21.15.84:0/4251271452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f381c1696a0 msgr2=0x7f381c14a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382281b700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f381c1696a0 0x7f381c14a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382281b700 1 -- 172.21.15.84:0/4251271452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0b5220 con 0x7f381c169b10 2023-10-06T02:55:50.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382281b700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f381c169b10 0x7f381c14adf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f381c0cc0b0 tx=0x7f3814001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f381a7fc700 1 -- 172.21.15.84:0/4251271452 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814012560 con 0x7f381c169b10 2023-10-06T02:55:50.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f381a7fc700 1 -- 172.21.15.84:0/4251271452 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140126c0 con 0x7f381c169b10 2023-10-06T02:55:50.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c0b5500 con 0x7f381c169b10 2023-10-06T02:55:50.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f381a7fc700 1 -- 172.21.15.84:0/4251271452 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814012a80 con 0x7f381c169b10 2023-10-06T02:55:50.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.077+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c0b5ac0 con 0x7f381c169b10 2023-10-06T02:55:50.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.078+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c064ad0 con 0x7f381c169b10 2023-10-06T02:55:50.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.078+0000 7f381a7fc700 1 -- 172.21.15.84:0/4251271452 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f381401d460 con 0x7f381c169b10 2023-10-06T02:55:50.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.079+0000 7f381a7fc700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3808066f30 0x7f38080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.079+0000 7f381a7fc700 1 -- 172.21.15.84:0/4251271452 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f38140846c0 con 0x7f381c169b10 2023-10-06T02:55:50.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.079+0000 7f382201a700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3808066f30 0x7f38080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.079+0000 7f382201a700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3808066f30 0x7f38080693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f380c001da0 tx=0x7f380c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.083+0000 7f381a7fc700 1 -- 172.21.15.84:0/4251271452 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38140514a0 con 0x7f381c169b10 2023-10-06T02:55:50.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.265+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f381c0b5f70 con 0x7f381c169b10 2023-10-06T02:55:50.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.266+0000 7f381a7fc700 1 -- 172.21.15.84:0/4251271452 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3814054ac0 con 0x7f381c169b10 2023-10-06T02:55:50.267 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:55:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3808066f30 msgr2=0x7f38080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3808066f30 0x7f38080693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f380c001da0 tx=0x7f380c015000 comp rx=0 tx=0).stop 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f381c169b10 msgr2=0x7f381c14adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f381c169b10 0x7f381c14adf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f381c0cc0b0 tx=0x7f3814001e50 comp rx=0 tx=0).stop 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 shutdown_connections 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3808066f30 0x7f38080693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f381c169b10 0x7f381c14adf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3804003a60 0x7f381c16de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 --2- 172.21.15.84:0/4251271452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f381c1696a0 0x7f381c14a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 >> 172.21.15.84:0/4251271452 conn(0x7f381c089e90 msgr2=0x7f381c15c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 shutdown_connections 2023-10-06T02:55:50.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.268+0000 7f382427e700 1 -- 172.21.15.84:0/4251271452 wait complete. 2023-10-06T02:55:50.281 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:50.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.394+0000 7f5ba2874700 1 Processor -- start 2023-10-06T02:55:50.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.395+0000 7f5ba2874700 1 -- start start 2023-10-06T02:55:50.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.395+0000 7f5ba2874700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c069c70 0x7f5b9c0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.395+0000 7f5ba2874700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9c0c7370 con 0x7f5b9c0ac040 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.395+0000 7f5ba2874700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9c0c6760 con 0x7f5b9c0adf60 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.395+0000 7f5ba2874700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c156150 con 0x7f5b9c069c70 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.395+0000 7f5b9b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5b9c0ac040 0x7f5b9c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51692/0 (socket says 172.21.15.84:51692) 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.395+0000 7f5b9b7fe700 1 -- 172.21.15.84:0/2143754723 learned_addr learned my addr 172.21.15.84:0/2143754723 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5ba0e11700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c069c70 0x7f5b9c0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609778166 0 0) 0x7f5b9c0c7370 con 0x7f5b9c0ac040 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b84003570 con 0x7f5b9c0ac040 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554218176 0 0) 0x7f5b84003570 con 0x7f5b9c0ac040 2023-10-06T02:55:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c069c70 msgr2=0x7f5b9c0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c069c70 0x7f5b9c0c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 >> v1:172.21.15.131:6789/0 conn(0x7f5b9c0adf60 legacy=0x7f5b9c06e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c0c6a40 con 0x7f5b9c0ac040 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f5b90001470 con 0x7f5b9c0ac040 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 >> v1:172.21.15.84:6789/0 conn(0x7f5b9c0ac040 legacy=0x7f5b9c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b84003a90 0x7f5b84003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c069c70 0x7f5b840051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c156150 con 0x7f5b84004810 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8400bb60 con 0x7f5b84003a90 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8400df30 con 0x7f5b9c069c70 2023-10-06T02:55:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9b7fe700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9bfff700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b84003a90 0x7f5b84003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5ba0e11700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c069c70 0x7f5b840051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9b7fe700 1 -- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c069c70 msgr2=0x7f5b840051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9b7fe700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c069c70 0x7f5b840051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9b7fe700 1 -- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b84003a90 msgr2=0x7f5b84003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9b7fe700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b84003a90 0x7f5b84003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9b7fe700 1 -- 172.21.15.84:0/2143754723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84003570 con 0x7f5b84004810 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.396+0000 7f5b9bfff700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b84003a90 0x7f5b84003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5b9b7fe700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b84004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c3c0 tx=0x7f5b90001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c2c36b3c4df2a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000cc90 con 0x7f5b84004810 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9000cdf0 con 0x7f5b84004810 2023-10-06T02:55:50.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5b9affd700 1 -- 172.21.15.84:0/2143754723 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90005b70 con 0x7f5b84004810 2023-10-06T02:55:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5ba2874700 1 -- 172.21.15.84:0/2143754723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 msgr2=0x7f5b84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5ba2874700 1 --2- 172.21.15.84:0/2143754723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b84004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c3c0 tx=0x7f5b90001e50 comp rx=0 tx=0).stop 2023-10-06T02:55:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5ba0e11700 1 -- 172.21.15.84:0/2143754723 reap_dead start 2023-10-06T02:55:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5ba2874700 1 -- 172.21.15.84:0/2143754723 shutdown_connections 2023-10-06T02:55:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5ba2874700 1 -- 172.21.15.84:0/2143754723 >> 172.21.15.84:0/2143754723 conn(0x7f5b9c0680c0 msgr2=0x7f5b9c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5ba2874700 1 -- 172.21.15.84:0/2143754723 shutdown_connections 2023-10-06T02:55:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.397+0000 7f5ba2874700 1 -- 172.21.15.84:0/2143754723 wait complete. 2023-10-06T02:55:50.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.398+0000 7f5ba2874700 1 Processor -- start 2023-10-06T02:55:50.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5ba2874700 1 -- start start 2023-10-06T02:55:50.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5ba2874700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b9c0c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5ba2874700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0bfec0 0x7f5b9c0c0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5ba2874700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c166760 0x7f5b9c166bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5ba2874700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0c4580 con 0x7f5b84004810 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5ba2874700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0c0910 con 0x7f5b9c0bfec0 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5ba2874700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c0c0bf0 con 0x7f5b9c166760 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5b9bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b9c0c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5b9bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b9c0c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40620/0 (socket says 172.21.15.84:40620) 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5b9bfff700 1 -- 172.21.15.84:0/1863759547 learned_addr learned my addr 172.21.15.84:0/1863759547 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5ba0e11700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c166760 0x7f5b9c166bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.399+0000 7f5b9b7fe700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0bfec0 0x7f5b9c0c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5b9bfff700 1 -- 172.21.15.84:0/1863759547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c166760 msgr2=0x7f5b9c166bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5b9bfff700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c166760 0x7f5b9c166bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5b9bfff700 1 -- 172.21.15.84:0/1863759547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0bfec0 msgr2=0x7f5b9c0c0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5b9bfff700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0bfec0 0x7f5b9c0c0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5b9bfff700 1 -- 172.21.15.84:0/1863759547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c0c0ed0 con 0x7f5b84004810 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5b9bfff700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b9c0c20a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00e840 tx=0x7f5b8c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5b83fff700 1 -- 172.21.15.84:0/1863759547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c010520 con 0x7f5b84004810 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5b83fff700 1 -- 172.21.15.84:0/1863759547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c010680 con 0x7f5b84004810 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b9c0c41a0 con 0x7f5b84004810 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5b83fff700 1 -- 172.21.15.84:0/1863759547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c010a40 con 0x7f5b84004810 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.400+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9c0c5fd0 con 0x7f5b84004810 2023-10-06T02:55:50.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.401+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9c0c47f0 con 0x7f5b84004810 2023-10-06T02:55:50.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.401+0000 7f5b83fff700 1 -- 172.21.15.84:0/1863759547 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b8c014480 con 0x7f5b84004810 2023-10-06T02:55:50.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.402+0000 7f5b83fff700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b88066f30 0x7f5b880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.402+0000 7f5b83fff700 1 -- 172.21.15.84:0/1863759547 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f5b8c0843d0 con 0x7f5b84004810 2023-10-06T02:55:50.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.402+0000 7f5b9b7fe700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b88066f30 0x7f5b880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.402+0000 7f5b9b7fe700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b88066f30 0x7f5b880693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5b90001e90 tx=0x7f5b90015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.406+0000 7f5b83fff700 1 -- 172.21.15.84:0/1863759547 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b8c051260 con 0x7f5b84004810 2023-10-06T02:55:50.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.630+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b9c064ad0 con 0x7f5b84004810 2023-10-06T02:55:50.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.631+0000 7f5b83fff700 1 -- 172.21.15.84:0/1863759547 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7f5b8c054880 con 0x7f5b84004810 2023-10-06T02:55:50.633 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:50.633 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:19.276318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:55:50.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b88066f30 msgr2=0x7f5b880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b88066f30 0x7f5b880693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5b90001e90 tx=0x7f5b90015000 comp rx=0 tx=0).stop 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 msgr2=0x7f5b9c0c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b9c0c20a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00e840 tx=0x7f5b8c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 shutdown_connections 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5b88066f30 0x7f5b880693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c166760 0x7f5b9c166bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b84004810 0x7f5b9c0c20a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 --2- 172.21.15.84:0/1863759547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0bfec0 0x7f5b9c0c0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 >> 172.21.15.84:0/1863759547 conn(0x7f5b9c0680c0 msgr2=0x7f5b9c0c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:50.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 shutdown_connections 2023-10-06T02:55:50.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.633+0000 7f5ba2874700 1 -- 172.21.15.84:0/1863759547 wait complete. 2023-10-06T02:55:50.636 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-10-06T02:55:50.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.759+0000 7f277f386700 1 Processor -- start 2023-10-06T02:55:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.759+0000 7f277f386700 1 -- start start 2023-10-06T02:55:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277f386700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27780b49e0 0x7f27780aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277f386700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f27780b07a0 0x7f27780b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277f386700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780b0ca0 con 0x7f27781595a0 2023-10-06T02:55:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277f386700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27780b0f80 con 0x7f27780b07a0 2023-10-06T02:55:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277f386700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780b1260 con 0x7f27780b49e0 2023-10-06T02:55:50.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277c921700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27780b49e0 0x7f27780aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277d923700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f27780b07a0 0x7f27780b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277c921700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27780b49e0 0x7f27780aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:43902/0 (socket says 172.21.15.84:43902) 2023-10-06T02:55:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277d923700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f27780b07a0 0x7f27780b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:55580/0 (socket says 172.21.15.84:55580) 2023-10-06T02:55:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.760+0000 7f277c921700 1 -- 172.21.15.84:0/623791935 learned_addr learned my addr 172.21.15.84:0/623791935 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.761+0000 7f277c921700 1 -- 172.21.15.84:0/623791935 >> v2:172.21.15.131:3300/0 conn(0x7f27780b07a0 msgr2=0x7f27780b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.761+0000 7f277c921700 1 --2- 172.21.15.84:0/623791935 >> v2:172.21.15.131:3300/0 conn(0x7f27780b07a0 0x7f27780b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.761+0000 7f277c921700 1 -- 172.21.15.84:0/623791935 >> v1:172.21.15.131:6789/0 conn(0x7f27781595a0 legacy=0x7f27780aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.761+0000 7f277c921700 1 -- 172.21.15.84:0/623791935 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780b1540 con 0x7f27780b49e0 2023-10-06T02:55:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.761+0000 7f277d923700 1 --2- 172.21.15.84:0/623791935 >> v2:172.21.15.131:3300/0 conn(0x7f27780b07a0 0x7f27780b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.761+0000 7f277c921700 1 --2- 172.21.15.84:0/623791935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27780b49e0 0x7f27780aac80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27680099b0 tx=0x7f2768009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d33f8bd097ce45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.761+0000 7f276ffff700 1 -- 172.21.15.84:0/623791935 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768009ea0 con 0x7f27780b49e0 2023-10-06T02:55:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.761+0000 7f276ffff700 1 -- 172.21.15.84:0/623791935 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276800b860 con 0x7f27780b49e0 2023-10-06T02:55:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.761+0000 7f276ffff700 1 -- 172.21.15.84:0/623791935 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800bc00 con 0x7f27780b49e0 2023-10-06T02:55:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.762+0000 7f277f386700 1 -- 172.21.15.84:0/623791935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27780b49e0 msgr2=0x7f27780aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.762+0000 7f277f386700 1 --2- 172.21.15.84:0/623791935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27780b49e0 0x7f27780aac80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27680099b0 tx=0x7f2768009250 comp rx=0 tx=0).stop 2023-10-06T02:55:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.762+0000 7f277f386700 1 -- 172.21.15.84:0/623791935 shutdown_connections 2023-10-06T02:55:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.762+0000 7f277f386700 1 --2- 172.21.15.84:0/623791935 >> v2:172.21.15.131:3300/0 conn(0x7f27780b07a0 0x7f27780b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.762+0000 7f277f386700 1 --2- 172.21.15.84:0/623791935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27780b49e0 0x7f27780aac80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.762+0000 7f277f386700 1 -- 172.21.15.84:0/623791935 >> 172.21.15.84:0/623791935 conn(0x7f2778099830 msgr2=0x7f277806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.762+0000 7f277f386700 1 -- 172.21.15.84:0/623791935 shutdown_connections 2023-10-06T02:55:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.762+0000 7f277f386700 1 -- 172.21.15.84:0/623791935 wait complete. 2023-10-06T02:55:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.763+0000 7f277f386700 1 Processor -- start 2023-10-06T02:55:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.763+0000 7f277f386700 1 -- start start 2023-10-06T02:55:50.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277f386700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780b07a0 0x7f277809a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277f386700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27780b49e0 0x7f27780aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277f386700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27781595a0 0x7f2778157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277f386700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277809da00 con 0x7f27780b49e0 2023-10-06T02:55:50.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277f386700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277809d0d0 con 0x7f27780b07a0 2023-10-06T02:55:50.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277f386700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277809d3b0 con 0x7f27781595a0 2023-10-06T02:55:50.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277c921700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27780b49e0 0x7f27780aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277c921700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27780b49e0 0x7f27780aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40622/0 (socket says 172.21.15.84:40622) 2023-10-06T02:55:50.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277c921700 1 -- 172.21.15.84:0/3638392192 learned_addr learned my addr 172.21.15.84:0/3638392192 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:50.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277d122700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780b07a0 0x7f277809a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277d923700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27781595a0 0x7f2778157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277c921700 1 -- 172.21.15.84:0/3638392192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27781595a0 msgr2=0x7f2778157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277c921700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27781595a0 0x7f2778157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277c921700 1 -- 172.21.15.84:0/3638392192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780b07a0 msgr2=0x7f277809a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277c921700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780b07a0 0x7f277809a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277c921700 1 -- 172.21.15.84:0/3638392192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009a20 con 0x7f27780b49e0 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.764+0000 7f277c921700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27780b49e0 0x7f27780aa910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27780b13a0 tx=0x7f2768017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.765+0000 7f276d7fa700 1 -- 172.21.15.84:0/3638392192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800bbe0 con 0x7f27780b49e0 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.765+0000 7f276d7fa700 1 -- 172.21.15.84:0/3638392192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2768011420 con 0x7f27780b49e0 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.765+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27680094f0 con 0x7f27780b49e0 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.765+0000 7f276d7fa700 1 -- 172.21.15.84:0/3638392192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27680117c0 con 0x7f27780b49e0 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.765+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27781581e0 con 0x7f27780b49e0 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.765+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277809db70 con 0x7f27780b49e0 2023-10-06T02:55:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.766+0000 7f276d7fa700 1 -- 172.21.15.84:0/3638392192 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2768011bf0 con 0x7f27780b49e0 2023-10-06T02:55:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.766+0000 7f276d7fa700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f275c066f30 0x7f275c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.766+0000 7f276d7fa700 1 -- 172.21.15.84:0/3638392192 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f27680861b0 con 0x7f27780b49e0 2023-10-06T02:55:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.766+0000 7f277d122700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f275c066f30 0x7f275c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.767+0000 7f277d122700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f275c066f30 0x7f275c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f277806a070 tx=0x7f2774009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:50.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.770+0000 7f276d7fa700 1 -- 172.21.15.84:0/3638392192 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2768053050 con 0x7f27780b49e0 2023-10-06T02:55:50.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.956+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2778064ad0 con 0x7f27780b49e0 2023-10-06T02:55:50.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.957+0000 7f276d7fa700 1 -- 172.21.15.84:0/3638392192 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f2768056670 con 0x7f27780b49e0 2023-10-06T02:55:50.959 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:50.960 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:49.478096+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:50.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f275c066f30 msgr2=0x7f275c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f275c066f30 0x7f275c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f277806a070 tx=0x7f2774009040 comp rx=0 tx=0).stop 2023-10-06T02:55:50.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27780b49e0 msgr2=0x7f27780aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:50.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27780b49e0 0x7f27780aa910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27780b13a0 tx=0x7f2768017000 comp rx=0 tx=0).stop 2023-10-06T02:55:50.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 shutdown_connections 2023-10-06T02:55:50.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f275c066f30 0x7f275c0693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27780b07a0 0x7f277809a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27781595a0 0x7f2778157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 --2- 172.21.15.84:0/3638392192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27780b49e0 0x7f27780aa910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:50.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 >> 172.21.15.84:0/3638392192 conn(0x7f2778099830 msgr2=0x7f2778158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:50.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 shutdown_connections 2023-10-06T02:55:50.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:50.959+0000 7f277f386700 1 -- 172.21.15.84:0/3638392192 wait complete. 2023-10-06T02:55:50.973 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:55:50.973 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:51.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.085+0000 7f0e37012700 1 Processor -- start 2023-10-06T02:55:51.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.085+0000 7f0e37012700 1 -- start start 2023-10-06T02:55:51.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e37012700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0e30159480 0x7f0e300b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e37012700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 0x7f0e300b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e37012700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300cb7e0 con 0x7f0e300b3610 2023-10-06T02:55:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e37012700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e300b08a0 con 0x7f0e30159480 2023-10-06T02:55:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e37012700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300cb190 con 0x7f0e300b2140 2023-10-06T02:55:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e3580f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0e300b3610 0x7f0e300cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51696/0 (socket says 172.21.15.84:51696) 2023-10-06T02:55:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e3580f700 1 -- 172.21.15.84:0/3049653420 learned_addr learned my addr 172.21.15.84:0/3049653420 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e36010700 1 --2- 172.21.15.84:0/3049653420 >> v2:172.21.15.131:3300/0 conn(0x7f0e30159480 0x7f0e300b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e36811700 1 --2- 172.21.15.84:0/3049653420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 0x7f0e300b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e3500e700 1 -- 172.21.15.84:0/3049653420 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041797357 0 0) 0x7f0e300cb7e0 con 0x7f0e300b3610 2023-10-06T02:55:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.086+0000 7f0e3500e700 1 -- 172.21.15.84:0/3049653420 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e1c003570 con 0x7f0e300b3610 2023-10-06T02:55:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e36010700 1 -- 172.21.15.84:0/3049653420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 msgr2=0x7f0e300b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e36010700 1 --2- 172.21.15.84:0/3049653420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 0x7f0e300b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e36010700 1 -- 172.21.15.84:0/3049653420 >> v1:172.21.15.84:6789/0 conn(0x7f0e300b3610 legacy=0x7f0e300cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e36010700 1 -- 172.21.15.84:0/3049653420 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e300cb470 con 0x7f0e30159480 2023-10-06T02:55:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e36010700 1 --2- 172.21.15.84:0/3049653420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e30159480 0x7f0e300b30d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0098e0 tx=0x7f0e2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1f16b12d9961e26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e3500e700 1 -- 172.21.15.84:0/3049653420 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c011630 con 0x7f0e30159480 2023-10-06T02:55:51.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e3500e700 1 -- 172.21.15.84:0/3049653420 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c011790 con 0x7f0e30159480 2023-10-06T02:55:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e3500e700 1 -- 172.21.15.84:0/3049653420 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c011b30 con 0x7f0e30159480 2023-10-06T02:55:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e37012700 1 -- 172.21.15.84:0/3049653420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e30159480 msgr2=0x7f0e300b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.087+0000 7f0e37012700 1 --2- 172.21.15.84:0/3049653420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e30159480 0x7f0e300b30d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0098e0 tx=0x7f0e2c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.088+0000 7f0e37012700 1 -- 172.21.15.84:0/3049653420 shutdown_connections 2023-10-06T02:55:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.088+0000 7f0e37012700 1 --2- 172.21.15.84:0/3049653420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 0x7f0e300b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.088+0000 7f0e37012700 1 --2- 172.21.15.84:0/3049653420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e30159480 0x7f0e300b30d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.088+0000 7f0e37012700 1 -- 172.21.15.84:0/3049653420 >> 172.21.15.84:0/3049653420 conn(0x7f0e3006ed20 msgr2=0x7f0e3006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.088+0000 7f0e37012700 1 -- 172.21.15.84:0/3049653420 shutdown_connections 2023-10-06T02:55:51.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.088+0000 7f0e37012700 1 -- 172.21.15.84:0/3049653420 wait complete. 2023-10-06T02:55:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e37012700 1 Processor -- start 2023-10-06T02:55:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e37012700 1 -- start start 2023-10-06T02:55:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e37012700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 0x7f0e301556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e37012700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e300b3610 0x7f0e3015cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e37012700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e30159480 0x7f0e3015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e37012700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300c9c00 con 0x7f0e300b3610 2023-10-06T02:55:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e37012700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300c8d90 con 0x7f0e30159480 2023-10-06T02:55:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e37012700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300c8ff0 con 0x7f0e300b2140 2023-10-06T02:55:51.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e3580f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e300b3610 0x7f0e3015cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e3580f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e300b3610 0x7f0e3015cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40624/0 (socket says 172.21.15.84:40624) 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.089+0000 7f0e3580f700 1 -- 172.21.15.84:0/1483109009 learned_addr learned my addr 172.21.15.84:0/1483109009 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e36010700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 0x7f0e301556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e36811700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e30159480 0x7f0e3015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e3580f700 1 -- 172.21.15.84:0/1483109009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 msgr2=0x7f0e301556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e3580f700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 0x7f0e301556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e3580f700 1 -- 172.21.15.84:0/1483109009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e30159480 msgr2=0x7f0e3015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e3580f700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e30159480 0x7f0e3015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e3580f700 1 -- 172.21.15.84:0/1483109009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c009420 con 0x7f0e300b3610 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e3580f700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e300b3610 0x7f0e3015cf90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000c7c0 tx=0x7f0e20007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e267fc700 1 -- 172.21.15.84:0/1483109009 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20005b30 con 0x7f0e300b3610 2023-10-06T02:55:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e267fc700 1 -- 172.21.15.84:0/1483109009 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e20005c90 con 0x7f0e300b3610 2023-10-06T02:55:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e300c92d0 con 0x7f0e300b3610 2023-10-06T02:55:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e267fc700 1 -- 172.21.15.84:0/1483109009 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20007340 con 0x7f0e300b3610 2023-10-06T02:55:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.090+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e300c9890 con 0x7f0e300b3610 2023-10-06T02:55:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.091+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3005f270 con 0x7f0e300b3610 2023-10-06T02:55:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.091+0000 7f0e267fc700 1 -- 172.21.15.84:0/1483109009 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e2001b400 con 0x7f0e300b3610 2023-10-06T02:55:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.092+0000 7f0e267fc700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e14066f30 0x7f0e140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.092+0000 7f0e267fc700 1 -- 172.21.15.84:0/1483109009 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0e20084460 con 0x7f0e300b3610 2023-10-06T02:55:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.092+0000 7f0e36010700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e14066f30 0x7f0e140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.092+0000 7f0e36010700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e14066f30 0x7f0e140693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0091e0 tx=0x7f0e2c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.096+0000 7f0e267fc700 1 -- 172.21.15.84:0/1483109009 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e200512c0 con 0x7f0e300b3610 2023-10-06T02:55:51.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.324+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e300b2ae0 con 0x7f0e300b3610 2023-10-06T02:55:51.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.324+0000 7f0e267fc700 1 -- 172.21.15.84:0/1483109009 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7f0e200548e0 con 0x7f0e300b3610 2023-10-06T02:55:51.326 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:51.326 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:19.276318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:55:51.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.326+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e14066f30 msgr2=0x7f0e140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.326+0000 7f0e37012700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e14066f30 0x7f0e140693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0091e0 tx=0x7f0e2c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:51.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.326+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e300b3610 msgr2=0x7f0e3015cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.326+0000 7f0e37012700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e300b3610 0x7f0e3015cf90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000c7c0 tx=0x7f0e20007e00 comp rx=0 tx=0).stop 2023-10-06T02:55:51.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.327+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 shutdown_connections 2023-10-06T02:55:51.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.327+0000 7f0e37012700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e14066f30 0x7f0e140693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.327+0000 7f0e37012700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e30159480 0x7f0e3015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.327+0000 7f0e37012700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e300b2140 0x7f0e301556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.327+0000 7f0e37012700 1 --2- 172.21.15.84:0/1483109009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e300b3610 0x7f0e3015cf90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.327+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 >> 172.21.15.84:0/1483109009 conn(0x7f0e3006ed20 msgr2=0x7f0e300cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.327+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 shutdown_connections 2023-10-06T02:55:51.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.327+0000 7f0e37012700 1 -- 172.21.15.84:0/1483109009 wait complete. 2023-10-06T02:55:51.330 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-10-06T02:55:51.340 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:55:51.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.454+0000 7f3d9c2de700 1 Processor -- start 2023-10-06T02:55:51.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.454+0000 7f3d9c2de700 1 -- start start 2023-10-06T02:55:51.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d9c2de700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d940b07a0 0x7f3d940ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d9c2de700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d940b0ca0 con 0x7f3d940b49e0 2023-10-06T02:55:51.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d9c2de700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d940b0f80 con 0x7f3d941595a0 2023-10-06T02:55:51.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d9c2de700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940ab390 con 0x7f3d940b07a0 2023-10-06T02:55:51.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99879700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3d940b49e0 0x7f3d940aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51704/0 (socket says 172.21.15.84:51704) 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99879700 1 -- 172.21.15.84:0/2194263180 learned_addr learned my addr 172.21.15.84:0/2194263180 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d9a87b700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d940b07a0 0x7f3d940ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190290712 0 0) 0x7f3d940b0ca0 con 0x7f3d940b49e0 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d80003570 con 0x7f3d940b49e0 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808130597 0 0) 0x7f3d940b0f80 con 0x7f3d941595a0 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d940b0ca0 con 0x7f3d941595a0 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2720997912 0 0) 0x7f3d80003570 con 0x7f3d940b49e0 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d940b07a0 msgr2=0x7f3d940ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d940b07a0 0x7f3d940ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 >> v1:172.21.15.131:6789/0 conn(0x7f3d941595a0 legacy=0x7f3d940aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940b1260 con 0x7f3d940b49e0 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f3d84001470 con 0x7f3d940b49e0 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 >> v1:172.21.15.84:6789/0 conn(0x7f3d940b49e0 legacy=0x7f3d940aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d940b07a0 0x7f3d80003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d800041d0 0x7f3d80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940ab390 con 0x7f3d80004d50 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8000bbf0 con 0x7f3d800041d0 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.455+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8000bdb0 con 0x7f3d940b07a0 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d9a87b700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d99879700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d800041d0 0x7f3d80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d9a07a700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d940b07a0 0x7f3d80003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d9a87b700 1 -- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d940b07a0 msgr2=0x7f3d80003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d9a87b700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d940b07a0 0x7f3d80003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d9a87b700 1 -- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d800041d0 msgr2=0x7f3d80004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d9a87b700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d800041d0 0x7f3d80004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d9a87b700 1 -- 172.21.15.84:0/2194263180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80003570 con 0x7f3d80004d50 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d9a07a700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d940b07a0 0x7f3d80003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d99879700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d800041d0 0x7f3d80004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d9a87b700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d800051c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3d940b64f0 tx=0x7f3d8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbec6c20ede7f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00ea90 con 0x7f3d80004d50 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c00f040 con 0x7f3d80004d50 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.456+0000 7f3d99078700 1 -- 172.21.15.84:0/2194263180 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00ee40 con 0x7f3d80004d50 2023-10-06T02:55:51.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.457+0000 7f3d9c2de700 1 -- 172.21.15.84:0/2194263180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 msgr2=0x7f3d800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.457+0000 7f3d9c2de700 1 --2- 172.21.15.84:0/2194263180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d800051c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3d940b64f0 tx=0x7f3d8c00b040 comp rx=0 tx=0).stop 2023-10-06T02:55:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.457+0000 7f3d9a87b700 1 -- 172.21.15.84:0/2194263180 reap_dead start 2023-10-06T02:55:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.457+0000 7f3d9c2de700 1 -- 172.21.15.84:0/2194263180 shutdown_connections 2023-10-06T02:55:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.457+0000 7f3d9c2de700 1 -- 172.21.15.84:0/2194263180 >> 172.21.15.84:0/2194263180 conn(0x7f3d94099830 msgr2=0x7f3d9406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.457+0000 7f3d9c2de700 1 -- 172.21.15.84:0/2194263180 shutdown_connections 2023-10-06T02:55:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.457+0000 7f3d9c2de700 1 -- 172.21.15.84:0/2194263180 wait complete. 2023-10-06T02:55:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.458+0000 7f3d9c2de700 1 Processor -- start 2023-10-06T02:55:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.458+0000 7f3d9c2de700 1 -- start start 2023-10-06T02:55:51.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.458+0000 7f3d9c2de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d941477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.458+0000 7f3d9c2de700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d940adab0 0x7f3d940adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.458+0000 7f3d9c2de700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d94169eb0 0x7f3d9416a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.458+0000 7f3d9c2de700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940ae460 con 0x7f3d80004d50 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.458+0000 7f3d9c2de700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9416af90 con 0x7f3d940adab0 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.458+0000 7f3d9c2de700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9416b200 con 0x7f3d94169eb0 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a07a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d941477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a07a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d941477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40652/0 (socket says 172.21.15.84:40652) 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a07a700 1 -- 172.21.15.84:0/3850308572 learned_addr learned my addr 172.21.15.84:0/3850308572 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d99879700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d940adab0 0x7f3d940adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a87b700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d94169eb0 0x7f3d9416a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a07a700 1 -- 172.21.15.84:0/3850308572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d94169eb0 msgr2=0x7f3d9416a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a07a700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d94169eb0 0x7f3d9416a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a07a700 1 -- 172.21.15.84:0/3850308572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d940adab0 msgr2=0x7f3d940adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a07a700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d940adab0 0x7f3d940adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a07a700 1 -- 172.21.15.84:0/3850308572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9416b4e0 con 0x7f3d80004d50 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d99879700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d940adab0 0x7f3d940adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9a07a700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d941477d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000e730 tx=0x7f3d90009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d8a7fc700 1 -- 172.21.15.84:0/3850308572 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90006870 con 0x7f3d80004d50 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d8a7fc700 1 -- 172.21.15.84:0/3850308572 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d90010040 con 0x7f3d80004d50 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9416b7c0 con 0x7f3d80004d50 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d8a7fc700 1 -- 172.21.15.84:0/3850308572 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90006c20 con 0x7f3d80004d50 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.459+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9416a870 con 0x7f3d80004d50 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.460+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9416ba00 con 0x7f3d80004d50 2023-10-06T02:55:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.460+0000 7f3d8a7fc700 1 -- 172.21.15.84:0/3850308572 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d90007240 con 0x7f3d80004d50 2023-10-06T02:55:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.461+0000 7f3d8a7fc700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3d78066f30 0x7f3d780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.461+0000 7f3d8a7fc700 1 -- 172.21.15.84:0/3850308572 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f3d90084000 con 0x7f3d80004d50 2023-10-06T02:55:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.461+0000 7f3d99879700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3d78066f30 0x7f3d780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.461+0000 7f3d99879700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3d78066f30 0x7f3d780693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d840015a0 tx=0x7f3d84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.465+0000 7f3d8a7fc700 1 -- 172.21.15.84:0/3850308572 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d9004e5a0 con 0x7f3d80004d50 2023-10-06T02:55:51.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.686+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d94064ad0 con 0x7f3d80004d50 2023-10-06T02:55:51.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.687+0000 7f3d8a7fc700 1 -- 172.21.15.84:0/3850308572 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4596 (secure 0 0 0) 0x7f3d9001a020 con 0x7f3d80004d50 2023-10-06T02:55:51.689 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:51.689 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2549099465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2549099465},{"type":"v1","addr":"172.21.15.84:6836","nonce":2549099465}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4046598952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4046598952},{"type":"v1","addr":"172.21.15.84:6837","nonce":4046598952}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/290972776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":290972776},{"type":"v1","addr":"172.21.15.131:6834","nonce":290972776}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:55:06.613971+0000","modified":"2023-10-06T02:55:19.276318+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6835/4173990514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4173990514},{"type":"v1","addr":"172.21.15.131:6835","nonce":4173990514}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T02:55:51.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3d78066f30 msgr2=0x7f3d780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3d78066f30 0x7f3d780693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d840015a0 tx=0x7f3d84009040 comp rx=0 tx=0).stop 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 msgr2=0x7f3d941477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d941477d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000e730 tx=0x7f3d90009040 comp rx=0 tx=0).stop 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 shutdown_connections 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3d78066f30 0x7f3d780693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d94169eb0 0x7f3d9416a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d80004d50 0x7f3d941477d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 --2- 172.21.15.84:0/3850308572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d940adab0 0x7f3d940adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 >> 172.21.15.84:0/3850308572 conn(0x7f3d94099830 msgr2=0x7f3d94068f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 shutdown_connections 2023-10-06T02:55:51.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.689+0000 7f3d9c2de700 1 -- 172.21.15.84:0/3850308572 wait complete. 2023-10-06T02:55:51.692 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-10-06T02:55:51.702 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:55:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.816+0000 7f3b43550700 1 Processor -- start 2023-10-06T02:55:51.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.816+0000 7f3b43550700 1 -- start start 2023-10-06T02:55:51.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b43550700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ca3b0 0x7f3b3c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b43550700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3b3c0ce8e0 0x7f3b3c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b43550700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c157e20 con 0x7f3b3c0adba0 2023-10-06T02:55:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b43550700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c0cbbd0 con 0x7f3b3c0ce8e0 2023-10-06T02:55:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b43550700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0cb610 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b412ec700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ca3b0 0x7f3b3c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b41aed700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3b3c0ce8e0 0x7f3b3c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b412ec700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ca3b0 0x7f3b3c1582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:43950/0 (socket says 172.21.15.84:43950) 2023-10-06T02:55:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b412ec700 1 -- 172.21.15.84:0/1460819039 learned_addr learned my addr 172.21.15.84:0/1460819039 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.817+0000 7f3b40aeb700 1 --1- 172.21.15.84:0/1460819039 >> v1:172.21.15.131:6789/0 conn(0x7f3b3c0adba0 0x7f3b3c0ce1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:45418/0 (socket says 172.21.15.84:45418) 2023-10-06T02:55:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b41aed700 1 -- 172.21.15.84:0/1460819039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ca3b0 msgr2=0x7f3b3c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b41aed700 1 --2- 172.21.15.84:0/1460819039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ca3b0 0x7f3b3c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b41aed700 1 -- 172.21.15.84:0/1460819039 >> v1:172.21.15.131:6789/0 conn(0x7f3b3c0adba0 legacy=0x7f3b3c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b41aed700 1 -- 172.21.15.84:0/1460819039 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0cb8f0 con 0x7f3b3c0ce8e0 2023-10-06T02:55:51.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b41aed700 1 --2- 172.21.15.84:0/1460819039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b3c0ce8e0 0x7f3b3c15af10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009e60 tx=0x7f3b34009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=273932f59b9d06ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b33fff700 1 -- 172.21.15.84:0/1460819039 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400e070 con 0x7f3b3c0ce8e0 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b33fff700 1 -- 172.21.15.84:0/1460819039 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3400bb60 con 0x7f3b3c0ce8e0 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b33fff700 1 -- 172.21.15.84:0/1460819039 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34012430 con 0x7f3b3c0ce8e0 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b43550700 1 -- 172.21.15.84:0/1460819039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b3c0ce8e0 msgr2=0x7f3b3c15af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.818+0000 7f3b43550700 1 --2- 172.21.15.84:0/1460819039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b3c0ce8e0 0x7f3b3c15af10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009e60 tx=0x7f3b34009780 comp rx=0 tx=0).stop 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.819+0000 7f3b43550700 1 -- 172.21.15.84:0/1460819039 shutdown_connections 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.819+0000 7f3b43550700 1 --2- 172.21.15.84:0/1460819039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b3c0ce8e0 0x7f3b3c15af10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.819+0000 7f3b43550700 1 --2- 172.21.15.84:0/1460819039 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ca3b0 0x7f3b3c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.819+0000 7f3b43550700 1 -- 172.21.15.84:0/1460819039 >> 172.21.15.84:0/1460819039 conn(0x7f3b3c070810 msgr2=0x7f3b3c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:51.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.819+0000 7f3b43550700 1 -- 172.21.15.84:0/1460819039 shutdown_connections 2023-10-06T02:55:51.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.819+0000 7f3b43550700 1 -- 172.21.15.84:0/1460819039 wait complete. 2023-10-06T02:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.820+0000 7f3b43550700 1 Processor -- start 2023-10-06T02:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.820+0000 7f3b43550700 1 -- start start 2023-10-06T02:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.820+0000 7f3b43550700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b3c0adba0 0x7f3b3c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b43550700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3c0ca3b0 0x7f3b3c150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b43550700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ce8e0 0x7f3b3c0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b43550700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c156bd0 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b43550700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c155a30 con 0x7f3b3c0adba0 2023-10-06T02:55:51.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b43550700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c155fc0 con 0x7f3b3c0ce8e0 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b40aeb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3c0ca3b0 0x7f3b3c150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b40aeb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3c0ca3b0 0x7f3b3c150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40658/0 (socket says 172.21.15.84:40658) 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b40aeb700 1 -- 172.21.15.84:0/784728843 learned_addr learned my addr 172.21.15.84:0/784728843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b412ec700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b3c0adba0 0x7f3b3c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b41aed700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ce8e0 0x7f3b3c0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b40aeb700 1 -- 172.21.15.84:0/784728843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ce8e0 msgr2=0x7f3b3c0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b40aeb700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ce8e0 0x7f3b3c0b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b40aeb700 1 -- 172.21.15.84:0/784728843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b3c0adba0 msgr2=0x7f3b3c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b40aeb700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b3c0adba0 0x7f3b3c1554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b40aeb700 1 -- 172.21.15.84:0/784728843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34009a20 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b40aeb700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3c0ca3b0 0x7f3b3c150eb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00c560 tx=0x7f3b2c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b317fa700 1 -- 172.21.15.84:0/784728843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c005a70 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b317fa700 1 -- 172.21.15.84:0/784728843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c005bd0 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c1562a0 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b317fa700 1 -- 172.21.15.84:0/784728843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0070d0 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.821+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c156860 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.822+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c156d40 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.823+0000 7f3b317fa700 1 -- 172.21.15.84:0/784728843 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b2c007480 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.823+0000 7f3b317fa700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b20066f30 0x7f3b200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.823+0000 7f3b317fa700 1 -- 172.21.15.84:0/784728843 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f3b2c083d30 con 0x7f3b3c0ca3b0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.823+0000 7f3b412ec700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b20066f30 0x7f3b200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:51.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.823+0000 7f3b412ec700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b20066f30 0x7f3b200693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0c48f0 tx=0x7f3b38009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:51.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:51.827+0000 7f3b317fa700 1 -- 172.21.15.84:0/784728843 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b2c050b10 con 0x7f3b3c0ca3b0 2023-10-06T02:55:52.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.013+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b3c064ad0 con 0x7f3b3c0ca3b0 2023-10-06T02:55:52.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.014+0000 7f3b317fa700 1 -- 172.21.15.84:0/784728843 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f3b2c017020 con 0x7f3b3c0ca3b0 2023-10-06T02:55:52.018 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:52.018 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:49.478096+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:55:05.120029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T02:55:05.566741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T02:55:09.247969+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:55:52.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b20066f30 msgr2=0x7f3b200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b20066f30 0x7f3b200693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0c48f0 tx=0x7f3b38009250 comp rx=0 tx=0).stop 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3c0ca3b0 msgr2=0x7f3b3c150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3c0ca3b0 0x7f3b3c150eb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00c560 tx=0x7f3b2c007f70 comp rx=0 tx=0).stop 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 shutdown_connections 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b20066f30 0x7f3b200693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b3c0adba0 0x7f3b3c1554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b3c0ce8e0 0x7f3b3c0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 --2- 172.21.15.84:0/784728843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3c0ca3b0 0x7f3b3c150eb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 >> 172.21.15.84:0/784728843 conn(0x7f3b3c070810 msgr2=0x7f3b3c0cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 shutdown_connections 2023-10-06T02:55:52.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.016+0000 7f3b43550700 1 -- 172.21.15.84:0/784728843 wait complete. 2023-10-06T02:55:52.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:55:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.145+0000 7fb3c33e9700 1 Processor -- start 2023-10-06T02:55:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.145+0000 7fb3c33e9700 1 -- start start 2023-10-06T02:55:52.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c33e9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb3bc068600 0x7fb3bc068a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c33e9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3bc0aa460 0x7fb3bc0aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c33e9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3bc068fb0 con 0x7fb3bc159690 2023-10-06T02:55:52.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c33e9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc0a9fd0 con 0x7fb3bc0aa460 2023-10-06T02:55:52.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c33e9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc0abfe0 con 0x7fb3bc068600 2023-10-06T02:55:52.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c1986700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3bc0aa460 0x7fb3bc0aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c1986700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb3bc0aa460 0x7fb3bc0aa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40672/0 (socket says 172.21.15.84:40672) 2023-10-06T02:55:52.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c1986700 1 -- 172.21.15.84:0/535827944 learned_addr learned my addr 172.21.15.84:0/535827944 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:52.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c0984700 1 --2- 172.21.15.84:0/535827944 >> v2:172.21.15.131:3300/0 conn(0x7fb3bc068600 0x7fb3bc068a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c1986700 1 -- 172.21.15.84:0/535827944 >> v2:172.21.15.131:3300/0 conn(0x7fb3bc068600 msgr2=0x7fb3bc068a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:52.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c1986700 1 --2- 172.21.15.84:0/535827944 >> v2:172.21.15.131:3300/0 conn(0x7fb3bc068600 0x7fb3bc068a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c1986700 1 -- 172.21.15.84:0/535827944 >> v1:172.21.15.131:6789/0 conn(0x7fb3bc159690 legacy=0x7fb3bc0ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:52.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c1986700 1 -- 172.21.15.84:0/535827944 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc0abd00 con 0x7fb3bc0aa460 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3c1986700 1 --2- 172.21.15.84:0/535827944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc0aa460 0x7fb3bc0aa8a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc06ef40 tx=0x7fb3b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a10fcb03a6d932 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3b3fff700 1 -- 172.21.15.84:0/535827944 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400e070 con 0x7fb3bc0aa460 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3b3fff700 1 -- 172.21.15.84:0/535827944 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b400ba10 con 0x7fb3bc0aa460 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.146+0000 7fb3b3fff700 1 -- 172.21.15.84:0/535827944 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40092e0 con 0x7fb3bc0aa460 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.147+0000 7fb3c33e9700 1 -- 172.21.15.84:0/535827944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc0aa460 msgr2=0x7fb3bc0aa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.147+0000 7fb3c33e9700 1 --2- 172.21.15.84:0/535827944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc0aa460 0x7fb3bc0aa8a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc06ef40 tx=0x7fb3b4009840 comp rx=0 tx=0).stop 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.147+0000 7fb3c33e9700 1 -- 172.21.15.84:0/535827944 shutdown_connections 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.147+0000 7fb3c33e9700 1 --2- 172.21.15.84:0/535827944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc0aa460 0x7fb3bc0aa8a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.147+0000 7fb3c33e9700 1 --2- 172.21.15.84:0/535827944 >> v2:172.21.15.131:3300/0 conn(0x7fb3bc068600 0x7fb3bc068a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.147+0000 7fb3c33e9700 1 -- 172.21.15.84:0/535827944 >> 172.21.15.84:0/535827944 conn(0x7fb3bc06de80 msgr2=0x7fb3bc06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:52.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.147+0000 7fb3c33e9700 1 -- 172.21.15.84:0/535827944 shutdown_connections 2023-10-06T02:55:52.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.147+0000 7fb3c33e9700 1 -- 172.21.15.84:0/535827944 wait complete. 2023-10-06T02:55:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.148+0000 7fb3c33e9700 1 Processor -- start 2023-10-06T02:55:52.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.148+0000 7fb3c33e9700 1 -- start start 2023-10-06T02:55:52.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c33e9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3bc068600 0x7fb3bc0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c33e9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3bc0aa460 0x7fb3bc0aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c33e9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc159690 0x7fb3bc0aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c33e9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc16dd40 con 0x7fb3bc159690 2023-10-06T02:55:52.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c33e9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc15a4c0 con 0x7fb3bc068600 2023-10-06T02:55:52.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c33e9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc159b90 con 0x7fb3bc0aa460 2023-10-06T02:55:52.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1986700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc159690 0x7fb3bc0aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1986700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc159690 0x7fb3bc0aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40680/0 (socket says 172.21.15.84:40680) 2023-10-06T02:55:52.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1986700 1 -- 172.21.15.84:0/1575373149 learned_addr learned my addr 172.21.15.84:0/1575373149 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1185700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3bc068600 0x7fb3bc0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c0984700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3bc0aa460 0x7fb3bc0aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1986700 1 -- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3bc0aa460 msgr2=0x7fb3bc0aa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1986700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3bc0aa460 0x7fb3bc0aa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1986700 1 -- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3bc068600 msgr2=0x7fb3bc0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1986700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3bc068600 0x7fb3bc0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1986700 1 -- 172.21.15.84:0/1575373149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b4009ae0 con 0x7fb3bc159690 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c0984700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3bc0aa460 0x7fb3bc0aa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.149+0000 7fb3c1185700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3bc068600 0x7fb3bc0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.150+0000 7fb3c1986700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc159690 0x7fb3bc0aad70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc06d2a0 tx=0x7fb3b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.150+0000 7fb3b17fa700 1 -- 172.21.15.84:0/1575373149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40094e0 con 0x7fb3bc159690 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.150+0000 7fb3b17fa700 1 -- 172.21.15.84:0/1575373149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4012e60 con 0x7fb3bc159690 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.150+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc159e70 con 0x7fb3bc159690 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.150+0000 7fb3b17fa700 1 -- 172.21.15.84:0/1575373149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b401d670 con 0x7fb3bc159690 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.150+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc15a950 con 0x7fb3bc159690 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.151+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc0cc0f0 con 0x7fb3bc159690 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.151+0000 7fb3b17fa700 1 -- 172.21.15.84:0/1575373149 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3b401da20 con 0x7fb3bc159690 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.151+0000 7fb3b17fa700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a0066f30 0x7fb3a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.151+0000 7fb3b17fa700 1 -- 172.21.15.84:0/1575373149 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb3b4086110 con 0x7fb3bc159690 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.151+0000 7fb3c1185700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a0066f30 0x7fb3a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.152+0000 7fb3c1185700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a0066f30 0x7fb3a00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0af660 tx=0x7fb3b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.156+0000 7fb3b17fa700 1 -- 172.21.15.84:0/1575373149 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3b4052ef0 con 0x7fb3bc159690 2023-10-06T02:55:52.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.383+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb3bc15a630 con 0x7fb3bc159690 2023-10-06T02:55:52.385 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T02:55:52.383+0000 7fedbe922700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:55:52.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.387+0000 7fb3b17fa700 1 -- 172.21.15.84:0/1575373149 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb3b4056510 con 0x7fb3bc159690 2023-10-06T02:55:52.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a0066f30 msgr2=0x7fb3a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a0066f30 0x7fb3a00693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0af660 tx=0x7fb3b8008040 comp rx=0 tx=0).stop 2023-10-06T02:55:52.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc159690 msgr2=0x7fb3bc0aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc159690 0x7fb3bc0aad70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc06d2a0 tx=0x7fb3b4017000 comp rx=0 tx=0).stop 2023-10-06T02:55:52.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 shutdown_connections 2023-10-06T02:55:52.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a0066f30 0x7fb3a00693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3bc068600 0x7fb3bc0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3bc159690 0x7fb3bc0aad70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 --2- 172.21.15.84:0/1575373149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3bc0aa460 0x7fb3bc0aa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.389+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 >> 172.21.15.84:0/1575373149 conn(0x7fb3bc06de80 msgr2=0x7fb3bc0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:52.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.390+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 shutdown_connections 2023-10-06T02:55:52.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.390+0000 7fb3c33e9700 1 -- 172.21.15.84:0/1575373149 wait complete. 2023-10-06T02:55:52.393 INFO:tasks.ceph.mds.b.smithi131.stderr: -3640> 2023-10-06T02:55:13.218+0000 7fe740c35700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:55:52.393 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:55:52.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:55:52.420 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T02:55:52.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.519+0000 7f03796e5700 1 Processor -- start 2023-10-06T02:55:52.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.519+0000 7f03796e5700 1 -- start start 2023-10-06T02:55:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f03796e5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03740b2a90 0x7f03740cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f03796e5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 0x7f03740cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f03796e5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03740cbdf0 con 0x7f03740cb980 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f03796e5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03740b2e60 con 0x7f03740b2a90 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f03796e5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03740cf5d0 con 0x7f03740c6610 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f0372ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03740b2a90 0x7f03740cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f0372ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03740b2a90 0x7f03740cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43346/0 (socket says 172.21.15.84:43346) 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f0372ffd700 1 -- 172.21.15.84:0/3819899633 learned_addr learned my addr 172.21.15.84:0/3819899633 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f0372ffd700 1 -- 172.21.15.84:0/3819899633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 msgr2=0x7f03740cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f03737fe700 1 --2- 172.21.15.84:0/3819899633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 0x7f03740cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f0372ffd700 1 --2- 172.21.15.84:0/3819899633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 0x7f03740cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f0372ffd700 1 -- 172.21.15.84:0/3819899633 >> v1:172.21.15.131:6789/0 conn(0x7f03740cb980 legacy=0x7f03740ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f0372ffd700 1 -- 172.21.15.84:0/3819899633 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740cf8b0 con 0x7f03740b2a90 2023-10-06T02:55:52.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f0372ffd700 1 --2- 172.21.15.84:0/3819899633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740b2a90 0x7f03740cb440 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0364009990 tx=0x7f0364009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2601e045f24fd3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f03727fc700 1 -- 172.21.15.84:0/3819899633 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364005c10 con 0x7f03740b2a90 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f03727fc700 1 -- 172.21.15.84:0/3819899633 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0364005d70 con 0x7f03740b2a90 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.520+0000 7f03727fc700 1 -- 172.21.15.84:0/3819899633 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036400b860 con 0x7f03740b2a90 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.521+0000 7f03796e5700 1 -- 172.21.15.84:0/3819899633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740b2a90 msgr2=0x7f03740cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.521+0000 7f03796e5700 1 --2- 172.21.15.84:0/3819899633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740b2a90 0x7f03740cb440 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0364009990 tx=0x7f0364009220 comp rx=0 tx=0).stop 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.521+0000 7f03796e5700 1 -- 172.21.15.84:0/3819899633 shutdown_connections 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.521+0000 7f03796e5700 1 --2- 172.21.15.84:0/3819899633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 0x7f03740cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.521+0000 7f03796e5700 1 --2- 172.21.15.84:0/3819899633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740b2a90 0x7f03740cb440 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.521+0000 7f03796e5700 1 -- 172.21.15.84:0/3819899633 >> 172.21.15.84:0/3819899633 conn(0x7f0374099740 msgr2=0x7f037406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.521+0000 7f03796e5700 1 -- 172.21.15.84:0/3819899633 shutdown_connections 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.521+0000 7f03796e5700 1 -- 172.21.15.84:0/3819899633 wait complete. 2023-10-06T02:55:52.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.522+0000 7f03796e5700 1 Processor -- start 2023-10-06T02:55:52.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.522+0000 7f03796e5700 1 -- start start 2023-10-06T02:55:52.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03796e5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03740b2a90 0x7f037416a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03796e5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 0x7f0374157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03796e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740cb980 0x7f03740ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03796e5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740c84d0 con 0x7f03740cb980 2023-10-06T02:55:52.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03796e5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037416aba0 con 0x7f03740b2a90 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03796e5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037416d530 con 0x7f03740c6610 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740cb980 0x7f03740ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740cb980 0x7f03740ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43350/0 (socket says 172.21.15.84:43350) 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03737fe700 1 -- 172.21.15.84:0/3605277618 learned_addr learned my addr 172.21.15.84:0/3605277618 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f0372ffd700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03740b2a90 0x7f037416a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f036bfff700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 0x7f0374157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03737fe700 1 -- 172.21.15.84:0/3605277618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 msgr2=0x7f0374157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03737fe700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 0x7f0374157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03737fe700 1 -- 172.21.15.84:0/3605277618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03740b2a90 msgr2=0x7f037416a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03737fe700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03740b2a90 0x7f037416a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:52.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03737fe700 1 -- 172.21.15.84:0/3605277618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0364009480 con 0x7f03740cb980 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03737fe700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740cb980 0x7f03740ce810 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f036c00ceb0 tx=0x7f036c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f036affd700 1 -- 172.21.15.84:0/3605277618 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c00ad90 con 0x7f03740cb980 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f036affd700 1 -- 172.21.15.84:0/3605277618 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c016420 con 0x7f03740cb980 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037416d810 con 0x7f03740cb980 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.523+0000 7f036affd700 1 -- 172.21.15.84:0/3605277618 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c0167e0 con 0x7f03740cb980 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.524+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037416ddd0 con 0x7f03740cb980 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.524+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037409a240 con 0x7f03740cb980 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.525+0000 7f036affd700 1 -- 172.21.15.84:0/3605277618 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f036c009030 con 0x7f03740cb980 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.525+0000 7f036affd700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0354066f30 0x7f03540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:52.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.525+0000 7f036affd700 1 -- 172.21.15.84:0/3605277618 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f036c012070 con 0x7f03740cb980 2023-10-06T02:55:52.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.525+0000 7f0372ffd700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0354066f30 0x7f03540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:52.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.526+0000 7f0372ffd700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0354066f30 0x7f03540693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0364007fd0 tx=0x7f0364015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:52.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.529+0000 7f036affd700 1 -- 172.21.15.84:0/3605277618 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f036c04e5a0 con 0x7f03740cb980 2023-10-06T02:55:52.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:52.752+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0374064ad0 con 0x7f03740cb980 2023-10-06T02:55:53.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.387+0000 7f036affd700 1 -- 172.21.15.84:0/3605277618 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f037409a240 con 0x7f03740cb980 2023-10-06T02:55:53.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0354066f30 msgr2=0x7f03540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0354066f30 0x7f03540693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0364007fd0 tx=0x7f0364015000 comp rx=0 tx=0).stop 2023-10-06T02:55:53.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740cb980 msgr2=0x7f03740ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740cb980 0x7f03740ce810 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f036c00ceb0 tx=0x7f036c007870 comp rx=0 tx=0).stop 2023-10-06T02:55:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 shutdown_connections 2023-10-06T02:55:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0354066f30 0x7f03540693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03740b2a90 0x7f037416a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03740cb980 0x7f03740ce810 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 --2- 172.21.15.84:0/3605277618 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03740c6610 0x7f0374157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 >> 172.21.15.84:0/3605277618 conn(0x7f0374099740 msgr2=0x7f0374063450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 shutdown_connections 2023-10-06T02:55:53.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.389+0000 7f03796e5700 1 -- 172.21.15.84:0/3605277618 wait complete. 2023-10-06T02:55:53.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:55:53.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.520+0000 7fd57ad5a700 1 Processor -- start 2023-10-06T02:55:53.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.520+0000 7fd57ad5a700 1 -- start start 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd57ad5a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd57ad5a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd5740c6d00 0x7fd57406e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd57ad5a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57406a970 con 0x7fd574068600 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd57ad5a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd574069ac0 con 0x7fd5740c6d00 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd57ad5a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd574069d60 con 0x7fd5741590b0 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd579d58700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd579557700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd5740c6d00 0x7fd57406e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd57a559700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd574068600 0x7fd57406ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:37394/0 (socket says 172.21.15.84:37394) 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd579d58700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:51104/0 (socket says 172.21.15.84:51104) 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd579557700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd5740c6d00 0x7fd57406e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:47456/0 (socket says 172.21.15.84:47456) 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.521+0000 7fd57a559700 1 -- 172.21.15.84:0/3336575137 learned_addr learned my addr 172.21.15.84:0/3336575137 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd579557700 1 -- 172.21.15.84:0/3336575137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5741590b0 msgr2=0x7fd574159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:53.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd579557700 1 --2- 172.21.15.84:0/3336575137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd579557700 1 -- 172.21.15.84:0/3336575137 >> v1:172.21.15.131:6789/0 conn(0x7fd574068600 legacy=0x7fd57406ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd579557700 1 -- 172.21.15.84:0/3336575137 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57406a040 con 0x7fd5740c6d00 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd579d58700 1 --2- 172.21.15.84:0/3336575137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd579557700 1 --2- 172.21.15.84:0/3336575137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 0x7fd57406e760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd5640098e0 tx=0x7fd5640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122e8658103231bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd578d56700 1 -- 172.21.15.84:0/3336575137 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400b640 con 0x7fd5740c6d00 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd578d56700 1 -- 172.21.15.84:0/3336575137 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400b7a0 con 0x7fd5740c6d00 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd578d56700 1 -- 172.21.15.84:0/3336575137 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400bb40 con 0x7fd5740c6d00 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3336575137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 msgr2=0x7fd57406e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.522+0000 7fd57ad5a700 1 --2- 172.21.15.84:0/3336575137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 0x7fd57406e760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd5640098e0 tx=0x7fd5640091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.523+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3336575137 shutdown_connections 2023-10-06T02:55:53.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.523+0000 7fd57ad5a700 1 --2- 172.21.15.84:0/3336575137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.523+0000 7fd57ad5a700 1 --2- 172.21.15.84:0/3336575137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 0x7fd57406e760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.523+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3336575137 >> 172.21.15.84:0/3336575137 conn(0x7fd5740c9ca0 msgr2=0x7fd57406da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:53.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.523+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3336575137 shutdown_connections 2023-10-06T02:55:53.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.523+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3336575137 wait complete. 2023-10-06T02:55:53.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.524+0000 7fd57ad5a700 1 Processor -- start 2023-10-06T02:55:53.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.524+0000 7fd57ad5a700 1 -- start start 2023-10-06T02:55:53.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.524+0000 7fd57ad5a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd574068600 0x7fd5740c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.524+0000 7fd57ad5a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 0x7fd5740c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.524+0000 7fd57ad5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.524+0000 7fd57ad5a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740c4070 con 0x7fd5741590b0 2023-10-06T02:55:53.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.524+0000 7fd57ad5a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740c4350 con 0x7fd5740c6d00 2023-10-06T02:55:53.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.524+0000 7fd57ad5a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740c4630 con 0x7fd574068600 2023-10-06T02:55:53.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57a559700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57a559700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43358/0 (socket says 172.21.15.84:43358) 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57a559700 1 -- 172.21.15.84:0/3003042942 learned_addr learned my addr 172.21.15.84:0/3003042942 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd579d58700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd574068600 0x7fd5740c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd579557700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 0x7fd5740c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57a559700 1 -- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd574068600 msgr2=0x7fd5740c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57a559700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd574068600 0x7fd5740c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57a559700 1 -- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 msgr2=0x7fd5740c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57a559700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 0x7fd5740c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:53.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57a559700 1 -- 172.21.15.84:0/3003042942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c009a20 con 0x7fd5741590b0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd579557700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 0x7fd5740c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd579d58700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd574068600 0x7fd5740c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57a559700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5741590b0 0x7fd574159480 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd57000c590 tx=0x7fd570007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd569ffb700 1 -- 172.21.15.84:0/3003042942 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570005b30 con 0x7fd5741590b0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd569ffb700 1 -- 172.21.15.84:0/3003042942 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570005cb0 con 0x7fd5741590b0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd569ffb700 1 -- 172.21.15.84:0/3003042942 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570007320 con 0x7fd5741590b0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.525+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd564009420 con 0x7fd5741590b0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.526+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5740c55d0 con 0x7fd5741590b0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.526+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5740c57c0 con 0x7fd5741590b0 2023-10-06T02:55:53.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.527+0000 7fd569ffb700 1 -- 172.21.15.84:0/3003042942 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd57001b3b0 con 0x7fd5741590b0 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.527+0000 7fd569ffb700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd558066f30 0x7fd5580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.527+0000 7fd569ffb700 1 -- 172.21.15.84:0/3003042942 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fd570083df0 con 0x7fd5741590b0 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.527+0000 7fd579d58700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd558066f30 0x7fd5580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.527+0000 7fd579d58700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd558066f30 0x7fd5580693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009fd0 tx=0x7fd56c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:53.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.531+0000 7fd569ffb700 1 -- 172.21.15.84:0/3003042942 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd570050b80 con 0x7fd5741590b0 2023-10-06T02:55:53.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:53.712+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd57405f270 con 0x7fd5741590b0 2023-10-06T02:55:54.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.390+0000 7fd569ffb700 1 -- 172.21.15.84:0/3003042942 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd570017020 con 0x7fd5741590b0 2023-10-06T02:55:54.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd558066f30 msgr2=0x7fd5580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd558066f30 0x7fd5580693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009fd0 tx=0x7fd56c00b040 comp rx=0 tx=0).stop 2023-10-06T02:55:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5741590b0 msgr2=0x7fd574159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5741590b0 0x7fd574159480 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd57000c590 tx=0x7fd570007ef0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 shutdown_connections 2023-10-06T02:55:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd558066f30 0x7fd5580693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5741590b0 0x7fd574159480 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd574068600 0x7fd5740c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 --2- 172.21.15.84:0/3003042942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5740c6d00 0x7fd5740c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.394+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 >> 172.21.15.84:0/3003042942 conn(0x7fd5740c9ca0 msgr2=0x7fd5741580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:54.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.395+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 shutdown_connections 2023-10-06T02:55:54.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.395+0000 7fd57ad5a700 1 -- 172.21.15.84:0/3003042942 wait complete. 2023-10-06T02:55:54.398 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:55:54.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:55:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.533+0000 7fde8b1dc700 1 Processor -- start 2023-10-06T02:55:54.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.533+0000 7fde8b1dc700 1 -- start start 2023-10-06T02:55:54.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.534+0000 7fde8b1dc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140c20 0x7fde840c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.534+0000 7fde8b1dc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde840675f0 0x7fde84067a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.534+0000 7fde8b1dc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8406b680 con 0x7fde84140ff0 2023-10-06T02:55:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.534+0000 7fde8b1dc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde84067f70 con 0x7fde840675f0 2023-10-06T02:55:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.534+0000 7fde8b1dc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840c2220 con 0x7fde84140c20 2023-10-06T02:55:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.534+0000 7fde8a9db700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde840675f0 0x7fde84067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.534+0000 7fde899d9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fde84140ff0 0x7fde8415bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59880/0 (socket says 172.21.15.84:59880) 2023-10-06T02:55:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.534+0000 7fde899d9700 1 -- 172.21.15.84:0/1486266875 learned_addr learned my addr 172.21.15.84:0/1486266875 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:54.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.534+0000 7fde8a1da700 1 --2- 172.21.15.84:0/1486266875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140c20 0x7fde840c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.535+0000 7fde8a9db700 1 -- 172.21.15.84:0/1486266875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140c20 msgr2=0x7fde840c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.535+0000 7fde8a9db700 1 --2- 172.21.15.84:0/1486266875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140c20 0x7fde840c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.535+0000 7fde8a9db700 1 -- 172.21.15.84:0/1486266875 >> v1:172.21.15.84:6789/0 conn(0x7fde84140ff0 legacy=0x7fde8415bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.535+0000 7fde891d8700 1 -- 172.21.15.84:0/1486266875 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299380774 0 0) 0x7fde8406b680 con 0x7fde84140ff0 2023-10-06T02:55:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.535+0000 7fde8a9db700 1 -- 172.21.15.84:0/1486266875 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840c2500 con 0x7fde840675f0 2023-10-06T02:55:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.535+0000 7fde8a9db700 1 --2- 172.21.15.84:0/1486266875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 0x7fde84067a30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0098e0 tx=0x7fde7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ccd9648a77fcd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.535+0000 7fde891d8700 1 -- 172.21.15.84:0/1486266875 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c009e80 con 0x7fde840675f0 2023-10-06T02:55:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.535+0000 7fde891d8700 1 -- 172.21.15.84:0/1486266875 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c00b860 con 0x7fde840675f0 2023-10-06T02:55:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.535+0000 7fde891d8700 1 -- 172.21.15.84:0/1486266875 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00bbe0 con 0x7fde840675f0 2023-10-06T02:55:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.536+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1486266875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 msgr2=0x7fde84067a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.536+0000 7fde8b1dc700 1 --2- 172.21.15.84:0/1486266875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 0x7fde84067a30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0098e0 tx=0x7fde7c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.536+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1486266875 shutdown_connections 2023-10-06T02:55:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.536+0000 7fde8b1dc700 1 --2- 172.21.15.84:0/1486266875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 0x7fde84067a30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.536+0000 7fde8b1dc700 1 --2- 172.21.15.84:0/1486266875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140c20 0x7fde840c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.536+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1486266875 >> 172.21.15.84:0/1486266875 conn(0x7fde8406a3d0 msgr2=0x7fde8406a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.536+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1486266875 shutdown_connections 2023-10-06T02:55:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.536+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1486266875 wait complete. 2023-10-06T02:55:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.537+0000 7fde8b1dc700 1 Processor -- start 2023-10-06T02:55:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.537+0000 7fde8b1dc700 1 -- start start 2023-10-06T02:55:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8b1dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 0x7fde84156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8b1dc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84140c20 0x7fde840c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8b1dc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140ff0 0x7fde84158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8b1dc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840cbef0 con 0x7fde840675f0 2023-10-06T02:55:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8b1dc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840cc4b0 con 0x7fde84140c20 2023-10-06T02:55:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8b1dc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840c9220 con 0x7fde84140ff0 2023-10-06T02:55:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a1da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 0x7fde84156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a1da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 0x7fde84156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43370/0 (socket says 172.21.15.84:43370) 2023-10-06T02:55:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a1da700 1 -- 172.21.15.84:0/1471808444 learned_addr learned my addr 172.21.15.84:0/1471808444 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a9db700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140ff0 0x7fde84158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a1da700 1 -- 172.21.15.84:0/1471808444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140ff0 msgr2=0x7fde84158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a1da700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140ff0 0x7fde84158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde899d9700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84140c20 0x7fde840c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a1da700 1 -- 172.21.15.84:0/1471808444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84140c20 msgr2=0x7fde840c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:54.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a1da700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84140c20 0x7fde840c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:54.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a1da700 1 -- 172.21.15.84:0/1471808444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c009420 con 0x7fde840675f0 2023-10-06T02:55:54.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a9db700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140ff0 0x7fde84158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:55:54.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8a1da700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 0x7fde84156f10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fde74009fd0 tx=0x7fde74009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:54.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde827fc700 1 -- 172.21.15.84:0/1471808444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7400edd0 con 0x7fde840675f0 2023-10-06T02:55:54.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde827fc700 1 -- 172.21.15.84:0/1471808444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74014420 con 0x7fde840675f0 2023-10-06T02:55:54.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde840c9500 con 0x7fde840675f0 2023-10-06T02:55:54.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde827fc700 1 -- 172.21.15.84:0/1471808444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740147c0 con 0x7fde840675f0 2023-10-06T02:55:54.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.538+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8415abd0 con 0x7fde840675f0 2023-10-06T02:55:54.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.539+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8405f270 con 0x7fde840675f0 2023-10-06T02:55:54.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.540+0000 7fde827fc700 1 -- 172.21.15.84:0/1471808444 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde74014bb0 con 0x7fde840675f0 2023-10-06T02:55:54.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.540+0000 7fde827fc700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde70066f30 0x7fde700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:54.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.540+0000 7fde827fc700 1 -- 172.21.15.84:0/1471808444 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6515+0+0 (secure 0 0 0) 0x7fde74085030 con 0x7fde840675f0 2023-10-06T02:55:54.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.540+0000 7fde899d9700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde70066f30 0x7fde700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:54.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.540+0000 7fde899d9700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde70066f30 0x7fde700693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde841402a0 tx=0x7fde78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:54.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.544+0000 7fde827fc700 1 -- 172.21.15.84:0/1471808444 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde74051f70 con 0x7fde840675f0 2023-10-06T02:55:54.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:54.727+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fde840cc300 con 0x7fde840675f0 2023-10-06T02:55:55.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.399+0000 7fde827fc700 1 -- 172.21.15.84:0/1471808444 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fde74009a00 con 0x7fde840675f0 2023-10-06T02:55:55.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde70066f30 msgr2=0x7fde700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde70066f30 0x7fde700693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde841402a0 tx=0x7fde78009040 comp rx=0 tx=0).stop 2023-10-06T02:55:55.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 msgr2=0x7fde84156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 0x7fde84156f10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fde74009fd0 tx=0x7fde74009970 comp rx=0 tx=0).stop 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 shutdown_connections 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde70066f30 0x7fde700693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde84140ff0 0x7fde84158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde840675f0 0x7fde84156f10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 --2- 172.21.15.84:0/1471808444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84140c20 0x7fde840c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 >> 172.21.15.84:0/1471808444 conn(0x7fde8406a3d0 msgr2=0x7fde840b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 shutdown_connections 2023-10-06T02:55:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.402+0000 7fde8b1dc700 1 -- 172.21.15.84:0/1471808444 wait complete. 2023-10-06T02:55:55.410 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T02:55:55.417 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T02:55:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.535+0000 7fe6643c3700 1 Processor -- start 2023-10-06T02:55:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.535+0000 7fe6643c3700 1 -- start start 2023-10-06T02:55:55.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe6643c3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c06ed20 0x7fe65c0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe6643c3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0b2d20 con 0x7fe65c0aee20 2023-10-06T02:55:55.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe6643c3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0b0450 con 0x7fe65c06f0f0 2023-10-06T02:55:55.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe6643c3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c06fb80 con 0x7fe65c06ed20 2023-10-06T02:55:55.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe662960700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe65c0aee20 0x7fe65c0af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59894/0 (socket says 172.21.15.84:59894) 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe662960700 1 -- 172.21.15.84:0/964667752 learned_addr learned my addr 172.21.15.84:0/964667752 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66215f700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c06ed20 0x7fe65c0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479408804 0 0) 0x7fe65c0b2d20 con 0x7fe65c0aee20 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe644003570 con 0x7fe65c0aee20 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2107600783 0 0) 0x7fe644003570 con 0x7fe65c0aee20 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c06ed20 msgr2=0x7fe65c0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c06ed20 0x7fe65c0b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 >> v1:172.21.15.131:6789/0 conn(0x7fe65c06f0f0 legacy=0x7fe65c0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0b2a40 con 0x7fe65c0aee20 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fe64c001470 con 0x7fe65c0aee20 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 >> v1:172.21.15.84:6789/0 conn(0x7fe65c0aee20 legacy=0x7fe65c0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c06ed20 0x7fe644003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644003fd0 0x7fe644004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe644004d50 0x7fe6440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.536+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64400bb10 con 0x7fe644004d50 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64400bc80 con 0x7fe644003fd0 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64400be40 con 0x7fe65c06ed20 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe662960700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe644004d50 0x7fe6440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe66215f700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c06ed20 0x7fe644003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe66195e700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644003fd0 0x7fe644004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe662960700 1 -- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c06ed20 msgr2=0x7fe644003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:55.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe662960700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c06ed20 0x7fe644003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe662960700 1 -- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644003fd0 msgr2=0x7fe644004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe662960700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644003fd0 0x7fe644004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe662960700 1 -- 172.21.15.84:0/964667752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644003570 con 0x7fe644004d50 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe662960700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe644004d50 0x7fe6440051c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00c2d0 tx=0x7fe64c001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fa8514648656b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00cbc0 con 0x7fe644004d50 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c00cd20 con 0x7fe644004d50 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe66115d700 1 -- 172.21.15.84:0/964667752 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c005b70 con 0x7fe644004d50 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe6643c3700 1 -- 172.21.15.84:0/964667752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe644004d50 msgr2=0x7fe6440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe6643c3700 1 --2- 172.21.15.84:0/964667752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe644004d50 0x7fe6440051c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00c2d0 tx=0x7fe64c001df0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.537+0000 7fe662960700 1 -- 172.21.15.84:0/964667752 reap_dead start 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.538+0000 7fe6643c3700 1 -- 172.21.15.84:0/964667752 shutdown_connections 2023-10-06T02:55:55.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.538+0000 7fe6643c3700 1 -- 172.21.15.84:0/964667752 >> 172.21.15.84:0/964667752 conn(0x7fe65c068330 msgr2=0x7fe65c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:55.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.538+0000 7fe6643c3700 1 -- 172.21.15.84:0/964667752 shutdown_connections 2023-10-06T02:55:55.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.538+0000 7fe6643c3700 1 -- 172.21.15.84:0/964667752 wait complete. 2023-10-06T02:55:55.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe6643c3700 1 Processor -- start 2023-10-06T02:55:55.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe6643c3700 1 -- start start 2023-10-06T02:55:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe6643c3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644004d50 0x7fe65c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe6643c3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65c15e620 0x7fe65c15bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe6643c3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c0b4110 0x7fe65c0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe6643c3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c157b20 con 0x7fe65c15e620 2023-10-06T02:55:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe6643c3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0b4ac0 con 0x7fe644004d50 2023-10-06T02:55:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe6643c3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c15d190 con 0x7fe65c0b4110 2023-10-06T02:55:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe66195e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65c15e620 0x7fe65c15bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe66195e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65c15e620 0x7fe65c15bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43380/0 (socket says 172.21.15.84:43380) 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.539+0000 7fe66195e700 1 -- 172.21.15.84:0/403969821 learned_addr learned my addr 172.21.15.84:0/403969821 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe662960700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c0b4110 0x7fe65c0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe66215f700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644004d50 0x7fe65c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe66195e700 1 -- 172.21.15.84:0/403969821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c0b4110 msgr2=0x7fe65c0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe66195e700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c0b4110 0x7fe65c0b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe66195e700 1 -- 172.21.15.84:0/403969821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644004d50 msgr2=0x7fe65c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe66195e700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644004d50 0x7fe65c154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe66195e700 1 -- 172.21.15.84:0/403969821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c15d470 con 0x7fe65c15e620 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe66195e700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65c15e620 0x7fe65c15bc70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe65000eb50 tx=0x7fe650009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe65a7fc700 1 -- 172.21.15.84:0/403969821 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500032e0 con 0x7fe65c15e620 2023-10-06T02:55:55.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe65a7fc700 1 -- 172.21.15.84:0/403969821 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650010040 con 0x7fe65c15e620 2023-10-06T02:55:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c15d750 con 0x7fe65c15e620 2023-10-06T02:55:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe65a7fc700 1 -- 172.21.15.84:0/403969821 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650001710 con 0x7fe65c15e620 2023-10-06T02:55:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.540+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c158f10 con 0x7fe65c15e620 2023-10-06T02:55:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.541+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c064ad0 con 0x7fe65c15e620 2023-10-06T02:55:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.541+0000 7fe65a7fc700 1 -- 172.21.15.84:0/403969821 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe650001a80 con 0x7fe65c15e620 2023-10-06T02:55:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.542+0000 7fe65a7fc700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe648066f30 0x7fe6480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.542+0000 7fe65a7fc700 1 -- 172.21.15.84:0/403969821 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6043+0+0 (secure 0 0 0) 0x7fe650084300 con 0x7fe65c15e620 2023-10-06T02:55:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.542+0000 7fe66215f700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe648066f30 0x7fe6480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:55.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.542+0000 7fe66215f700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe648066f30 0x7fe6480693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe654009db0 tx=0x7fe654008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:55.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.546+0000 7fe65a7fc700 1 -- 172.21.15.84:0/403969821 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe650051380 con 0x7fe65c15e620 2023-10-06T02:55:55.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:55.733+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe65c04bb80 con 0x7fe65c15e620 2023-10-06T02:55:56.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.403+0000 7fe65a7fc700 1 -- 172.21.15.84:0/403969821 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7fe6500549a0 con 0x7fe65c15e620 2023-10-06T02:55:56.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.405+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe648066f30 msgr2=0x7fe6480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe648066f30 0x7fe6480693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe654009db0 tx=0x7fe654008040 comp rx=0 tx=0).stop 2023-10-06T02:55:56.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65c15e620 msgr2=0x7fe65c15bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65c15e620 0x7fe65c15bc70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe65000eb50 tx=0x7fe650009040 comp rx=0 tx=0).stop 2023-10-06T02:55:56.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 shutdown_connections 2023-10-06T02:55:56.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe648066f30 0x7fe6480693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644004d50 0x7fe65c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe65c0b4110 0x7fe65c0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 --2- 172.21.15.84:0/403969821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe65c15e620 0x7fe65c15bc70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 >> 172.21.15.84:0/403969821 conn(0x7fe65c068330 msgr2=0x7fe65c0cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:56.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 shutdown_connections 2023-10-06T02:55:56.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.406+0000 7fe6643c3700 1 -- 172.21.15.84:0/403969821 wait complete. 2023-10-06T02:55:56.409 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' removed 2023-10-06T02:55:56.422 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:55:56.422 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:55:56.422 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:55:56.422 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:55:56.422 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:55:56.423 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:55:56.423 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:55:56.423 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:55:56.423 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:55:56.423 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:55:56.423 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:55:56.423 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:55:56.424 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:55:56.424 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:55:56.424 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:55:56.424 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:55:56.432 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:55:56.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:55:56.433 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:55:56.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:55:56.434 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:55:56.434 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:55:56.435 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:55:56.435 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:55:56.474 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:55:56.474 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:56.474 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:55:56.475 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:56.476 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:55:56.477 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:56.477 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:55:56.477 DEBUG:teuthology.parallel:result is None 2023-10-06T02:55:56.477 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:55:56.549 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T02:55:56.549 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T02:55:56.557 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T02:55:56.557 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T02:55:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.597+0000 7fb53619f700 1 Processor -- start 2023-10-06T02:55:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.597+0000 7fb53619f700 1 -- start start 2023-10-06T02:55:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.598+0000 7fb53619f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5300cc920 0x7fb53006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.598+0000 7fb53619f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb53006c1a0 0x7fb5300c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.598+0000 7fb53619f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53006c9e0 con 0x7fb530156390 2023-10-06T02:55:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.598+0000 7fb53619f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb530156b60 con 0x7fb53006c1a0 2023-10-06T02:55:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.598+0000 7fb53619f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb530156e40 con 0x7fb5300cc920 2023-10-06T02:55:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.598+0000 7fb52ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb53006c1a0 0x7fb5300c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.598+0000 7fb52f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb530156390 0x7fb5300cc210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59928/0 (socket says 172.21.15.84:59928) 2023-10-06T02:55:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.598+0000 7fb52f7fe700 1 -- 172.21.15.84:0/2355394490 learned_addr learned my addr 172.21.15.84:0/2355394490 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52effd700 1 --2- 172.21.15.84:0/2355394490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5300cc920 0x7fb53006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52ffff700 1 -- 172.21.15.84:0/2355394490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5300cc920 msgr2=0x7fb53006bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52ffff700 1 --2- 172.21.15.84:0/2355394490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5300cc920 0x7fb53006bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52ffff700 1 -- 172.21.15.84:0/2355394490 >> v1:172.21.15.84:6789/0 conn(0x7fb530156390 legacy=0x7fb5300cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52ffff700 1 -- 172.21.15.84:0/2355394490 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb530157120 con 0x7fb53006c1a0 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52e7fc700 1 -- 172.21.15.84:0/2355394490 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031170704 0 0) 0x7fb53006c9e0 con 0x7fb530156390 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52ffff700 1 --2- 172.21.15.84:0/2355394490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 0x7fb5300c88c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb52800bb90 tx=0x7fb52800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8797002f76fbae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52e7fc700 1 -- 172.21.15.84:0/2355394490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800dba0 con 0x7fb53006c1a0 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52e7fc700 1 -- 172.21.15.84:0/2355394490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52800dd00 con 0x7fb53006c1a0 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb52e7fc700 1 -- 172.21.15.84:0/2355394490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280196b0 con 0x7fb53006c1a0 2023-10-06T02:55:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb53619f700 1 -- 172.21.15.84:0/2355394490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 msgr2=0x7fb5300c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb53619f700 1 --2- 172.21.15.84:0/2355394490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 0x7fb5300c88c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb52800bb90 tx=0x7fb52800b430 comp rx=0 tx=0).stop 2023-10-06T02:55:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb53619f700 1 -- 172.21.15.84:0/2355394490 shutdown_connections 2023-10-06T02:55:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb53619f700 1 --2- 172.21.15.84:0/2355394490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 0x7fb5300c88c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb53619f700 1 --2- 172.21.15.84:0/2355394490 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5300cc920 0x7fb53006bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.599+0000 7fb53619f700 1 -- 172.21.15.84:0/2355394490 >> 172.21.15.84:0/2355394490 conn(0x7fb5300cdef0 msgr2=0x7fb5300c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.600+0000 7fb53619f700 1 -- 172.21.15.84:0/2355394490 shutdown_connections 2023-10-06T02:55:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.600+0000 7fb53619f700 1 -- 172.21.15.84:0/2355394490 wait complete. 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.601+0000 7fb53619f700 1 Processor -- start 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.601+0000 7fb53619f700 1 -- start start 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.601+0000 7fb53619f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 0x7fb530166220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.601+0000 7fb53619f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300cc920 0x7fb5300af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.601+0000 7fb53619f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb530156390 0x7fb5301669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.601+0000 7fb53619f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300c6970 con 0x7fb53006c1a0 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.601+0000 7fb53619f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb530166760 con 0x7fb5300cc920 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.601+0000 7fb53619f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300afb50 con 0x7fb530156390 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 0x7fb530166220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 0x7fb530166220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43406/0 (socket says 172.21.15.84:43406) 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52f7fe700 1 -- 172.21.15.84:0/2531402483 learned_addr learned my addr 172.21.15.84:0/2531402483 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52ffff700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb530156390 0x7fb5301669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52effd700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300cc920 0x7fb5300af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52f7fe700 1 -- 172.21.15.84:0/2531402483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb530156390 msgr2=0x7fb5301669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52f7fe700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb530156390 0x7fb5301669c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52f7fe700 1 -- 172.21.15.84:0/2531402483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300cc920 msgr2=0x7fb5300af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52f7fe700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300cc920 0x7fb5300af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52f7fe700 1 -- 172.21.15.84:0/2531402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52800b6d0 con 0x7fb53006c1a0 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52effd700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300cc920 0x7fb5300af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:56.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb52f7fe700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 0x7fb530166220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb52000cc70 tx=0x7fb520001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb5177fe700 1 -- 172.21.15.84:0/2531402483 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52000ce80 con 0x7fb53006c1a0 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb5177fe700 1 -- 172.21.15.84:0/2531402483 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52000ab70 con 0x7fb53006c1a0 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb5177fe700 1 -- 172.21.15.84:0/2531402483 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5200070f0 con 0x7fb53006c1a0 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5300c5d60 con 0x7fb53006c1a0 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.602+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5300c6320 con 0x7fb53006c1a0 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.603+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb530071060 con 0x7fb53006c1a0 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.603+0000 7fb5177fe700 1 -- 172.21.15.84:0/2531402483 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5200074e0 con 0x7fb53006c1a0 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.604+0000 7fb5177fe700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb51c066f30 0x7fb51c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.604+0000 7fb5177fe700 1 -- 172.21.15.84:0/2531402483 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fb520084950 con 0x7fb53006c1a0 2023-10-06T02:55:56.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.604+0000 7fb52effd700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb51c066f30 0x7fb51c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.604+0000 7fb52effd700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb51c066f30 0x7fb51c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb5301633e0 tx=0x7fb524008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:56.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.608+0000 7fb5177fe700 1 -- 172.21.15.84:0/2531402483 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb520051ca0 con 0x7fb53006c1a0 2023-10-06T02:55:56.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:56.807+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb530064ad0 con 0x7fb53006c1a0 2023-10-06T02:55:58.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.124+0000 7fb5177fe700 1 -- 172.21.15.84:0/2531402483 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb5200552c0 con 0x7fb53006c1a0 2023-10-06T02:55:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb51c066f30 msgr2=0x7fb51c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb51c066f30 0x7fb51c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb5301633e0 tx=0x7fb524008040 comp rx=0 tx=0).stop 2023-10-06T02:55:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 msgr2=0x7fb530166220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 0x7fb530166220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb52000cc70 tx=0x7fb520001a30 comp rx=0 tx=0).stop 2023-10-06T02:55:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 shutdown_connections 2023-10-06T02:55:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb51c066f30 0x7fb51c0693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb530156390 0x7fb5301669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb53006c1a0 0x7fb530166220 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 --2- 172.21.15.84:0/2531402483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300cc920 0x7fb5300af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 >> 172.21.15.84:0/2531402483 conn(0x7fb5300cdef0 msgr2=0x7fb5301549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 shutdown_connections 2023-10-06T02:55:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.127+0000 7fb53619f700 1 -- 172.21.15.84:0/2531402483 wait complete. 2023-10-06T02:55:58.131 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T02:55:58.143 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:55:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.262+0000 7f9523dcb700 1 Processor -- start 2023-10-06T02:55:58.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.262+0000 7f9523dcb700 1 -- start start 2023-10-06T02:55:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.263+0000 7f9523dcb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f951c0b49e0 0x7f951c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.263+0000 7f9523dcb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f951c0b07a0 0x7f951c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.263+0000 7f9523dcb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c0b0ca0 con 0x7f951c1595a0 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.263+0000 7f9523dcb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0b0f80 con 0x7f951c0b07a0 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.263+0000 7f9523dcb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0b1260 con 0x7f951c0b49e0 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.263+0000 7f9522368700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f951c0b07a0 0x7f951c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.263+0000 7f9521b67700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f951c1595a0 0x7f951c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59934/0 (socket says 172.21.15.84:59934) 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.263+0000 7f9521b67700 1 -- 172.21.15.84:0/201356943 learned_addr learned my addr 172.21.15.84:0/201356943 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9522368700 1 -- 172.21.15.84:0/201356943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f951c0b49e0 msgr2=0x7f951c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9522368700 1 --2- 172.21.15.84:0/201356943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f951c0b49e0 0x7f951c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9522368700 1 -- 172.21.15.84:0/201356943 >> v1:172.21.15.84:6789/0 conn(0x7f951c1595a0 legacy=0x7f951c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9522368700 1 -- 172.21.15.84:0/201356943 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0b1540 con 0x7f951c0b07a0 2023-10-06T02:55:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9520b65700 1 -- 172.21.15.84:0/201356943 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368721689 0 0) 0x7f951c0b0ca0 con 0x7f951c1595a0 2023-10-06T02:55:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9522368700 1 --2- 172.21.15.84:0/201356943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 0x7f951c0b1c00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f95140098e0 tx=0x7f95140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e46b70c50234a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9520b65700 1 -- 172.21.15.84:0/201356943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514009e80 con 0x7f951c0b07a0 2023-10-06T02:55:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9520b65700 1 -- 172.21.15.84:0/201356943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400b860 con 0x7f951c0b07a0 2023-10-06T02:55:58.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9520b65700 1 -- 172.21.15.84:0/201356943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400bbe0 con 0x7f951c0b07a0 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9523dcb700 1 -- 172.21.15.84:0/201356943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 msgr2=0x7f951c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9523dcb700 1 --2- 172.21.15.84:0/201356943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 0x7f951c0b1c00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f95140098e0 tx=0x7f95140091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9523dcb700 1 -- 172.21.15.84:0/201356943 shutdown_connections 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9523dcb700 1 --2- 172.21.15.84:0/201356943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 0x7f951c0b1c00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9523dcb700 1 --2- 172.21.15.84:0/201356943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f951c0b49e0 0x7f951c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.264+0000 7f9523dcb700 1 -- 172.21.15.84:0/201356943 >> 172.21.15.84:0/201356943 conn(0x7f951c099830 msgr2=0x7f951c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:58.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.265+0000 7f9523dcb700 1 -- 172.21.15.84:0/201356943 shutdown_connections 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.265+0000 7f9523dcb700 1 -- 172.21.15.84:0/201356943 wait complete. 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9523dcb700 1 Processor -- start 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9523dcb700 1 -- start start 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9523dcb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 0x7f951c09c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9523dcb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f951c0b49e0 0x7f951c15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9523dcb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c1595a0 0x7f951c159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9523dcb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c15b6c0 con 0x7f951c0b07a0 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9523dcb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c159eb0 con 0x7f951c1595a0 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9523dcb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c15a0e0 con 0x7f951c0b49e0 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9521b67700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 0x7f951c09c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9521b67700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 0x7f951c09c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43434/0 (socket says 172.21.15.84:43434) 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.266+0000 7f9521b67700 1 -- 172.21.15.84:0/29410505 learned_addr learned my addr 172.21.15.84:0/29410505 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9521366700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f951c0b49e0 0x7f951c15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9522368700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c1595a0 0x7f951c159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9521b67700 1 -- 172.21.15.84:0/29410505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f951c0b49e0 msgr2=0x7f951c15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9521b67700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f951c0b49e0 0x7f951c15b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9521b67700 1 -- 172.21.15.84:0/29410505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c1595a0 msgr2=0x7f951c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9521b67700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c1595a0 0x7f951c159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9521b67700 1 -- 172.21.15.84:0/29410505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514009420 con 0x7f951c0b07a0 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9521b67700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 0x7f951c09c040 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f951800c960 tx=0x7f95180016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:58.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9511ffb700 1 -- 172.21.15.84:0/29410505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518005d80 con 0x7f951c0b07a0 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9511ffb700 1 -- 172.21.15.84:0/29410505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951800a590 con 0x7f951c0b07a0 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c15a3c0 con 0x7f951c0b07a0 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9511ffb700 1 -- 172.21.15.84:0/29410505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800a950 con 0x7f951c0b07a0 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.267+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c15a750 con 0x7f951c0b07a0 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.268+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c15a550 con 0x7f951c0b07a0 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.268+0000 7f9511ffb700 1 -- 172.21.15.84:0/29410505 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f951800ad40 con 0x7f951c0b07a0 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.269+0000 7f9511ffb700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9500066f30 0x7f95000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.269+0000 7f9511ffb700 1 -- 172.21.15.84:0/29410505 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f95180842d0 con 0x7f951c0b07a0 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.269+0000 7f9521366700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9500066f30 0x7f95000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.269+0000 7f9521366700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9500066f30 0x7f95000693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f950c006fd0 tx=0x7f950c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:58.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.273+0000 7f9511ffb700 1 -- 172.21.15.84:0/29410505 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9518051670 con 0x7f951c0b07a0 2023-10-06T02:55:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.532+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f951c064ad0 con 0x7f951c0b07a0 2023-10-06T02:55:58.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.533+0000 7f9511ffb700 1 -- 172.21.15.84:0/29410505 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f9518054c90 con 0x7f951c0b07a0 2023-10-06T02:55:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:55:58.535 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:55:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T02:55:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T02:55:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lFrNmJBAAeVhw9betN9snqLPgSK9efw==", 2023-10-06T02:55:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:55:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:55:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:55:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lbi6hLxAAICzxeAsbJ5rhbyMBkPcrAQ==", 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.537 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lSCo1KxAAuETY4PeWDJS3bGzqTpHLpQ==", 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lvPxyNhAAKlqBTG/Fr8/2Rf+lcGQxIg==", 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T02:55:58.539 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDUdh9lV3sRIRAAoUtG7F6EMyew6CX3NaNufw==", 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDXdh9ls5OxHhAAanGTRmjW75UAwrqzL0CIdw==", 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.540 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDadh9lQeJTHhAAFeayQY1F10UDCck78/ja4w==", 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:58.541 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDddh9l+cx8HhAAeAcoLzCUiCC+9O+WZYYTsA==", 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.542 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDjdh9lA4upJxAAdFHhR2/rMyG2NbQEu7JpLw==", 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.543 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDmdh9lOGETJRAA7nLtgcumxqfum8cirnbaRA==", 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDpdh9lSbDhJBAAnMWhjKSKYcLaZeRk9drdgA==", 2023-10-06T02:55:58.544 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDsdh9lImOeIhAAPUO3jy2/cPZW+eKukBywcw==", 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:55:58.545 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lRRw/OhAAwavsq3e0HeVF3/G4SX0v+A==", 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:55:58.546 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lftv/BhAAo8sb1EG96nHv77bn3af/dg==", 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:55:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lxOX6AxAAWDpHCodRcEc2/YF5yqnkQg==", 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:55:58.548 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lheJnDBAAqAQeFxMQ9Qv108TLz65mVw==", 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:55:58.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9l8qZuCBAArPoeoGgydlQPFp7XYwI9KQ==", 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:55:58.550 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mds", 2023-10-06T02:55:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDydh9lAEoxEhAACdCaUlabEQviQqFNbWMqTw==", 2023-10-06T02:55:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T02:55:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T02:55:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDydh9loFMxEhAA5O88BFz7NMfNb0RQMhBhnA==", 2023-10-06T02:55:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-osd", 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDydh9lXFwxEhAAoaYoG4HgWSbhOP4ILbobMQ==", 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T02:55:58.554 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDydh9lZGMxEhAAS3AAY8uByAtpSf4N8ppzlQ==", 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.555 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDydh9lp2oxEhAA+41EESsWbSSKplT13mf5YQ==", 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDydh9lBHIxEhAA3soS6YEfvxIVXffntLZyhg==", 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.556 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T02:55:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T02:55:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9ly2pdIRAAX7YmT9B/MzoD8xJH347ruQ==", 2023-10-06T02:55:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:55:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T02:55:58.557 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lW/KSHBAAEvgj/BAe20tCp8uwBEIVbA==", 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:55:58.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:55:58.559 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T02:55:58.559 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:55:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9500066f30 msgr2=0x7f95000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9500066f30 0x7f95000693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f950c006fd0 tx=0x7f950c008040 comp rx=0 tx=0).stop 2023-10-06T02:55:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 msgr2=0x7f951c09c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 0x7f951c09c040 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f951800c960 tx=0x7f95180016f0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 shutdown_connections 2023-10-06T02:55:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9500066f30 0x7f95000693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c1595a0 0x7f951c159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f951c0b07a0 0x7f951c09c040 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 --2- 172.21.15.84:0/29410505 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f951c0b49e0 0x7f951c15b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 >> 172.21.15.84:0/29410505 conn(0x7f951c099830 msgr2=0x7f951c0694e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 shutdown_connections 2023-10-06T02:55:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.535+0000 7f9523dcb700 1 -- 172.21.15.84:0/29410505 wait complete. 2023-10-06T02:55:58.562 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T02:55:58.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.678+0000 7fb56d870700 1 Processor -- start 2023-10-06T02:55:58.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.678+0000 7fb56d870700 1 -- start start 2023-10-06T02:55:58.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.679+0000 7fb56d870700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5681595a0 0x7fb5680aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.679+0000 7fb56d870700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680b0ca0 con 0x7fb5680b49e0 2023-10-06T02:55:58.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.679+0000 7fb56d870700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680b0f80 con 0x7fb5680b07a0 2023-10-06T02:55:58.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.679+0000 7fb56d870700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680b1260 con 0x7fb5681595a0 2023-10-06T02:55:58.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.679+0000 7fb5667fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb5680b49e0 0x7fb5680aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59940/0 (socket says 172.21.15.84:59940) 2023-10-06T02:55:58.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.679+0000 7fb5667fc700 1 -- 172.21.15.84:0/1512566570 learned_addr learned my addr 172.21.15.84:0/1512566570 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:58.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.679+0000 7fb566ffd700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5681595a0 0x7fb5680aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.679+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611965041 0 0) 0x7fb5680b0ca0 con 0x7fb5680b49e0 2023-10-06T02:55:58.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.679+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb550003570 con 0x7fb5680b49e0 2023-10-06T02:55:58.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1425256738 0 0) 0x7fb550003570 con 0x7fb5680b49e0 2023-10-06T02:55:58.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5681595a0 msgr2=0x7fb5680aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:58.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5681595a0 0x7fb5680aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 >> v1:172.21.15.131:6789/0 conn(0x7fb5680b07a0 legacy=0x7fb5680b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680b1540 con 0x7fb5680b49e0 2023-10-06T02:55:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fb55c001470 con 0x7fb5680b49e0 2023-10-06T02:55:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 >> v1:172.21.15.84:6789/0 conn(0x7fb5680b49e0 legacy=0x7fb5680aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5681595a0 0x7fb550003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb550004010 0x7fb550004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb550004d50 0x7fb5500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680b1260 con 0x7fb550004d50 2023-10-06T02:55:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55000bbf0 con 0x7fb550004010 2023-10-06T02:55:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55000bdb0 con 0x7fb5681595a0 2023-10-06T02:55:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb5677fe700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb550004d50 0x7fb5500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb566ffd700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5681595a0 0x7fb550003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb5667fc700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb550004010 0x7fb550004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb5677fe700 1 -- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5681595a0 msgr2=0x7fb550003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb5677fe700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5681595a0 0x7fb550003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb5677fe700 1 -- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb550004010 msgr2=0x7fb550004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb5677fe700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb550004010 0x7fb550004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb5677fe700 1 -- 172.21.15.84:0/1512566570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550003570 con 0x7fb550004d50 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb5667fc700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb550004010 0x7fb550004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb5677fe700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb550004d50 0x7fb5500051c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb560001880 tx=0x7fb560007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8582907a67e62b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560012420 con 0x7fb550004d50 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560012580 con 0x7fb550004d50 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.680+0000 7fb565ffb700 1 -- 172.21.15.84:0/1512566570 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560012920 con 0x7fb550004d50 2023-10-06T02:55:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.681+0000 7fb56d870700 1 -- 172.21.15.84:0/1512566570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb550004d50 msgr2=0x7fb5500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.681+0000 7fb56d870700 1 --2- 172.21.15.84:0/1512566570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb550004d50 0x7fb5500051c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb560001880 tx=0x7fb560007d30 comp rx=0 tx=0).stop 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.681+0000 7fb5677fe700 1 -- 172.21.15.84:0/1512566570 reap_dead start 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.681+0000 7fb56d870700 1 -- 172.21.15.84:0/1512566570 shutdown_connections 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.681+0000 7fb56d870700 1 -- 172.21.15.84:0/1512566570 >> 172.21.15.84:0/1512566570 conn(0x7fb568099830 msgr2=0x7fb56806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.681+0000 7fb56d870700 1 -- 172.21.15.84:0/1512566570 shutdown_connections 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.681+0000 7fb56d870700 1 -- 172.21.15.84:0/1512566570 wait complete. 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.682+0000 7fb56d870700 1 Processor -- start 2023-10-06T02:55:58.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.682+0000 7fb56d870700 1 -- start start 2023-10-06T02:55:58.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb56d870700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568156a60 0x7fb56815e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb56d870700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb56809a090 0x7fb5680cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb56d870700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5680cbc70 0x7fb568169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb56d870700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56809b260 con 0x7fb568156a60 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb56d870700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680cc0e0 con 0x7fb5680cbc70 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb56d870700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56809a650 con 0x7fb56809a090 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb566ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568156a60 0x7fb56815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb566ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568156a60 0x7fb56815e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43452/0 (socket says 172.21.15.84:43452) 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb566ffd700 1 -- 172.21.15.84:0/4150343608 learned_addr learned my addr 172.21.15.84:0/4150343608 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb5667fc700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb56809a090 0x7fb5680cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb5677fe700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5680cbc70 0x7fb568169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb566ffd700 1 -- 172.21.15.84:0/4150343608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb56809a090 msgr2=0x7fb5680cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb566ffd700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb56809a090 0x7fb5680cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb566ffd700 1 -- 172.21.15.84:0/4150343608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5680cbc70 msgr2=0x7fb568169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb566ffd700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5680cbc70 0x7fb568169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb566ffd700 1 -- 172.21.15.84:0/4150343608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56809a930 con 0x7fb568156a60 2023-10-06T02:55:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb5667fc700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb56809a090 0x7fb5680cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb566ffd700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568156a60 0x7fb56815e880 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb558011f80 tx=0x7fb55800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.683+0000 7fb54effd700 1 -- 172.21.15.84:0/4150343608 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800e040 con 0x7fb568156a60 2023-10-06T02:55:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.684+0000 7fb54effd700 1 -- 172.21.15.84:0/4150343608 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55800f040 con 0x7fb568156a60 2023-10-06T02:55:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.684+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56809ac10 con 0x7fb568156a60 2023-10-06T02:55:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.684+0000 7fb54effd700 1 -- 172.21.15.84:0/4150343608 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558015430 con 0x7fb568156a60 2023-10-06T02:55:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.684+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56815edc0 con 0x7fb568156a60 2023-10-06T02:55:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.684+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb568064ad0 con 0x7fb568156a60 2023-10-06T02:55:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.685+0000 7fb54effd700 1 -- 172.21.15.84:0/4150343608 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb558015860 con 0x7fb568156a60 2023-10-06T02:55:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.685+0000 7fb54effd700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb554066f30 0x7fb5540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.685+0000 7fb54effd700 1 -- 172.21.15.84:0/4150343608 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fb5580851b0 con 0x7fb568156a60 2023-10-06T02:55:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.685+0000 7fb5667fc700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb554066f30 0x7fb5540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.686+0000 7fb5667fc700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb554066f30 0x7fb5540693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0015a0 tx=0x7fb55c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.690+0000 7fb54effd700 1 -- 172.21.15.84:0/4150343608 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5580524d0 con 0x7fb568156a60 2023-10-06T02:55:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.946+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb56815bc80 con 0x7fb568156a60 2023-10-06T02:55:58.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.950+0000 7fb54effd700 1 -- 172.21.15.84:0/4150343608 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb558055af0 con 0x7fb568156a60 2023-10-06T02:55:58.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb554066f30 msgr2=0x7fb5540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb554066f30 0x7fb5540693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0015a0 tx=0x7fb55c009040 comp rx=0 tx=0).stop 2023-10-06T02:55:58.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568156a60 msgr2=0x7fb56815e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:58.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568156a60 0x7fb56815e880 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb558011f80 tx=0x7fb55800b040 comp rx=0 tx=0).stop 2023-10-06T02:55:58.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 shutdown_connections 2023-10-06T02:55:58.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb554066f30 0x7fb5540693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5680cbc70 0x7fb568169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568156a60 0x7fb56815e880 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 --2- 172.21.15.84:0/4150343608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb56809a090 0x7fb5680cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:58.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 >> 172.21.15.84:0/4150343608 conn(0x7fb568099830 msgr2=0x7fb5680cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:58.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 shutdown_connections 2023-10-06T02:55:58.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:58.952+0000 7fb56d870700 1 -- 172.21.15.84:0/4150343608 wait complete. 2023-10-06T02:55:58.965 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T02:55:59.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.078+0000 7fe91885c700 1 Processor -- start 2023-10-06T02:55:59.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.078+0000 7fe91885c700 1 -- start start 2023-10-06T02:55:59.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.079+0000 7fe91885c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe914159b10 0x7fe914159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.079+0000 7fe91885c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe9140caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.079+0000 7fe91885c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe914068d50 con 0x7fe9140cb630 2023-10-06T02:55:59.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.079+0000 7fe91885c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91415a4d0 con 0x7fe914159b10 2023-10-06T02:55:59.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.079+0000 7fe91885c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe914154060 con 0x7fe9140ca6b0 2023-10-06T02:55:59.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe911d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe914159b10 0x7fe914159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe912d9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe9140caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe912d9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe9140caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:51244/0 (socket says 172.21.15.84:51244) 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe91259c700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe9140cb630 0x7fe9140691e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:37438/0 (socket says 172.21.15.84:37438) 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe911d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe914159b10 0x7fe914159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:47582/0 (socket says 172.21.15.84:47582) 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe91259c700 1 -- 172.21.15.84:0/2057373950 learned_addr learned my addr 172.21.15.84:0/2057373950 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe912d9d700 1 -- 172.21.15.84:0/2057373950 >> v2:172.21.15.131:3300/0 conn(0x7fe914159b10 msgr2=0x7fe914159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe912d9d700 1 --2- 172.21.15.84:0/2057373950 >> v2:172.21.15.131:3300/0 conn(0x7fe914159b10 0x7fe914159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe912d9d700 1 -- 172.21.15.84:0/2057373950 >> v1:172.21.15.131:6789/0 conn(0x7fe9140cb630 legacy=0x7fe9140691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe912d9d700 1 -- 172.21.15.84:0/2057373950 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91415a6b0 con 0x7fe9140ca6b0 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe912d9d700 1 --2- 172.21.15.84:0/2057373950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe9140caaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0098e0 tx=0x7fe90c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc197820e7d86aac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe91159a700 1 -- 172.21.15.84:0/2057373950 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c00b640 con 0x7fe9140ca6b0 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe91159a700 1 -- 172.21.15.84:0/2057373950 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c00b7a0 con 0x7fe9140ca6b0 2023-10-06T02:55:59.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.080+0000 7fe91159a700 1 -- 172.21.15.84:0/2057373950 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c00bb40 con 0x7fe9140ca6b0 2023-10-06T02:55:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.081+0000 7fe91885c700 1 -- 172.21.15.84:0/2057373950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 msgr2=0x7fe9140caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.081+0000 7fe91885c700 1 --2- 172.21.15.84:0/2057373950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe9140caaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0098e0 tx=0x7fe90c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.081+0000 7fe91885c700 1 -- 172.21.15.84:0/2057373950 shutdown_connections 2023-10-06T02:55:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.081+0000 7fe91885c700 1 --2- 172.21.15.84:0/2057373950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe9140caaf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.081+0000 7fe91885c700 1 --2- 172.21.15.84:0/2057373950 >> v2:172.21.15.131:3300/0 conn(0x7fe914159b10 0x7fe914159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.081+0000 7fe91885c700 1 -- 172.21.15.84:0/2057373950 >> 172.21.15.84:0/2057373950 conn(0x7fe914070810 msgr2=0x7fe914070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:59.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.081+0000 7fe91885c700 1 -- 172.21.15.84:0/2057373950 shutdown_connections 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.081+0000 7fe91885c700 1 -- 172.21.15.84:0/2057373950 wait complete. 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.082+0000 7fe91885c700 1 Processor -- start 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.082+0000 7fe91885c700 1 -- start start 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe91885c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe91414f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe91885c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9140cb630 0x7fe914151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe91885c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe914159b10 0x7fe9141518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe91885c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140b10c0 con 0x7fe914159b10 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe91885c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140b1360 con 0x7fe9140cb630 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe91885c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140b1640 con 0x7fe9140ca6b0 2023-10-06T02:55:59.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe912d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe914159b10 0x7fe9141518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe912d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe914159b10 0x7fe9141518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43454/0 (socket says 172.21.15.84:43454) 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe912d9d700 1 -- 172.21.15.84:0/115447943 learned_addr learned my addr 172.21.15.84:0/115447943 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe911d9b700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9140cb630 0x7fe914151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe91259c700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe91414f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe912d9d700 1 -- 172.21.15.84:0/115447943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 msgr2=0x7fe91414f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe912d9d700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe91414f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe912d9d700 1 -- 172.21.15.84:0/115447943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9140cb630 msgr2=0x7fe914151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe912d9d700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9140cb630 0x7fe914151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.083+0000 7fe912d9d700 1 -- 172.21.15.84:0/115447943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c009420 con 0x7fe914159b10 2023-10-06T02:55:59.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.084+0000 7fe912d9d700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe914159b10 0x7fe9141518a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009f80 tx=0x7fe90c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.084+0000 7fe9027fc700 1 -- 172.21.15.84:0/115447943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c011420 con 0x7fe914159b10 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.084+0000 7fe9027fc700 1 -- 172.21.15.84:0/115447943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0115c0 con 0x7fe914159b10 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.084+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9140b1920 con 0x7fe914159b10 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.084+0000 7fe9027fc700 1 -- 172.21.15.84:0/115447943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c011980 con 0x7fe914159b10 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.084+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9140b1ee0 con 0x7fe914159b10 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.085+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe914064ad0 con 0x7fe914159b10 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.085+0000 7fe9027fc700 1 -- 172.21.15.84:0/115447943 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe90c011cf0 con 0x7fe914159b10 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.085+0000 7fe9027fc700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe8f4066fb0 0x7fe8f4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.086+0000 7fe9027fc700 1 -- 172.21.15.84:0/115447943 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fe90c085fb0 con 0x7fe914159b10 2023-10-06T02:55:59.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.086+0000 7fe91259c700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe8f4066fb0 0x7fe8f4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.086+0000 7fe91259c700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe8f4066fb0 0x7fe8f4069460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe904002040 tx=0x7fe904000f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:59.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.090+0000 7fe9027fc700 1 -- 172.21.15.84:0/115447943 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe90c053230 con 0x7fe914159b10 2023-10-06T02:55:59.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.347+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe91404bb80 con 0x7fe914159b10 2023-10-06T02:55:59.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.351+0000 7fe9027fc700 1 -- 172.21.15.84:0/115447943 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe90c056850 con 0x7fe914159b10 2023-10-06T02:55:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe8f4066fb0 msgr2=0x7fe8f4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe8f4066fb0 0x7fe8f4069460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe904002040 tx=0x7fe904000f40 comp rx=0 tx=0).stop 2023-10-06T02:55:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe914159b10 msgr2=0x7fe9141518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe914159b10 0x7fe9141518a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009f80 tx=0x7fe90c017000 comp rx=0 tx=0).stop 2023-10-06T02:55:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 shutdown_connections 2023-10-06T02:55:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe8f4066fb0 0x7fe8f4069460 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe914159b10 0x7fe9141518a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9140ca6b0 0x7fe91414f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 --2- 172.21.15.84:0/115447943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9140cb630 0x7fe914151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 >> 172.21.15.84:0/115447943 conn(0x7fe914070810 msgr2=0x7fe9140cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 shutdown_connections 2023-10-06T02:55:59.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.353+0000 7fe91885c700 1 -- 172.21.15.84:0/115447943 wait complete. 2023-10-06T02:55:59.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T02:55:59.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.480+0000 7fb257fff700 1 Processor -- start 2023-10-06T02:55:59.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.480+0000 7fb257fff700 1 -- start start 2023-10-06T02:55:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb257fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb258159480 0x7fb2580b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb257fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2580b2140 0x7fb2580b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb257fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2580cb7e0 con 0x7fb2580b3610 2023-10-06T02:55:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb257fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2580b08a0 con 0x7fb2580b2140 2023-10-06T02:55:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb257fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580cb190 con 0x7fb258159480 2023-10-06T02:55:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb2577fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2580b2140 0x7fb2580b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb2567fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb2580b3610 0x7fb2580cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59942/0 (socket says 172.21.15.84:59942) 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb2567fc700 1 -- 172.21.15.84:0/2264856684 learned_addr learned my addr 172.21.15.84:0/2264856684 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb256ffd700 1 --2- 172.21.15.84:0/2264856684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb258159480 0x7fb2580b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb2577fe700 1 -- 172.21.15.84:0/2264856684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb258159480 msgr2=0x7fb2580b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb2577fe700 1 --2- 172.21.15.84:0/2264856684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb258159480 0x7fb2580b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb2577fe700 1 -- 172.21.15.84:0/2264856684 >> v1:172.21.15.84:6789/0 conn(0x7fb2580b3610 legacy=0x7fb2580cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb255ffb700 1 -- 172.21.15.84:0/2264856684 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153435611 0 0) 0x7fb2580cb7e0 con 0x7fb2580b3610 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.481+0000 7fb2577fe700 1 -- 172.21.15.84:0/2264856684 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580cb470 con 0x7fb2580b2140 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb2577fe700 1 --2- 172.21.15.84:0/2264856684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b2140 0x7fb2580b25c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb2500098e0 tx=0x7fb2500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a78390f2bf9f16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb255ffb700 1 -- 172.21.15.84:0/2264856684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb250009e80 con 0x7fb2580b2140 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb255ffb700 1 -- 172.21.15.84:0/2264856684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25000b860 con 0x7fb2580b2140 2023-10-06T02:55:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb255ffb700 1 -- 172.21.15.84:0/2264856684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000bbe0 con 0x7fb2580b2140 2023-10-06T02:55:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb257fff700 1 -- 172.21.15.84:0/2264856684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b2140 msgr2=0x7fb2580b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb257fff700 1 --2- 172.21.15.84:0/2264856684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b2140 0x7fb2580b25c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb2500098e0 tx=0x7fb2500091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb257fff700 1 -- 172.21.15.84:0/2264856684 shutdown_connections 2023-10-06T02:55:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb257fff700 1 --2- 172.21.15.84:0/2264856684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b2140 0x7fb2580b25c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb257fff700 1 --2- 172.21.15.84:0/2264856684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb258159480 0x7fb2580b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb257fff700 1 -- 172.21.15.84:0/2264856684 >> 172.21.15.84:0/2264856684 conn(0x7fb25806ed20 msgr2=0x7fb25806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:59.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb257fff700 1 -- 172.21.15.84:0/2264856684 shutdown_connections 2023-10-06T02:55:59.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.482+0000 7fb257fff700 1 -- 172.21.15.84:0/2264856684 wait complete. 2023-10-06T02:55:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb257fff700 1 Processor -- start 2023-10-06T02:55:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb257fff700 1 -- start start 2023-10-06T02:55:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb257fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2580b2140 0x7fb25815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb257fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b3610 0x7fb258148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb257fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb258159480 0x7fb258148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb257fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb258169400 con 0x7fb2580b3610 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb257fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25815bac0 con 0x7fb258159480 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb257fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580c8210 con 0x7fb2580b2140 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb2567fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b3610 0x7fb258148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb2567fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b3610 0x7fb258148310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43476/0 (socket says 172.21.15.84:43476) 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.484+0000 7fb2567fc700 1 -- 172.21.15.84:0/3996295370 learned_addr learned my addr 172.21.15.84:0/3996295370 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb2577fe700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb258159480 0x7fb258148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb256ffd700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2580b2140 0x7fb25815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb2567fc700 1 -- 172.21.15.84:0/3996295370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2580b2140 msgr2=0x7fb25815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb2567fc700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2580b2140 0x7fb25815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb2567fc700 1 -- 172.21.15.84:0/3996295370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb258159480 msgr2=0x7fb258148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb2567fc700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb258159480 0x7fb258148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb2567fc700 1 -- 172.21.15.84:0/3996295370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250009420 con 0x7fb2580b3610 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb256ffd700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2580b2140 0x7fb25815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb2567fc700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b3610 0x7fb258148310 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00c810 tx=0x7fb24c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb23effd700 1 -- 172.21.15.84:0/3996295370 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c005c00 con 0x7fb2580b3610 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb23effd700 1 -- 172.21.15.84:0/3996295370 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c005d60 con 0x7fb2580b3610 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2580c84f0 con 0x7fb2580b3610 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb23effd700 1 -- 172.21.15.84:0/3996295370 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c007320 con 0x7fb2580b3610 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.485+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2580c8ab0 con 0x7fb2580b3610 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.486+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25805f270 con 0x7fb2580b3610 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.486+0000 7fb23effd700 1 -- 172.21.15.84:0/3996295370 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb24c01b3b0 con 0x7fb2580b3610 2023-10-06T02:55:59.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.487+0000 7fb23effd700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb244066f30 0x7fb2440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.487+0000 7fb256ffd700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb244066f30 0x7fb2440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.487+0000 7fb23effd700 1 -- 172.21.15.84:0/3996295370 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fb24c0839b0 con 0x7fb2580b3610 2023-10-06T02:55:59.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.487+0000 7fb256ffd700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb244066f30 0x7fb2440693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb248009fd0 tx=0x7fb248009740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:59.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.491+0000 7fb23effd700 1 -- 172.21.15.84:0/3996295370 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb24c050cd0 con 0x7fb2580b3610 2023-10-06T02:55:59.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.750+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb2580b2b00 con 0x7fb2580b3610 2023-10-06T02:55:59.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.753+0000 7fb23effd700 1 -- 172.21.15.84:0/3996295370 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb24c017020 con 0x7fb2580b3610 2023-10-06T02:55:59.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb244066f30 msgr2=0x7fb2440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb244066f30 0x7fb2440693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb248009fd0 tx=0x7fb248009740 comp rx=0 tx=0).stop 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b3610 msgr2=0x7fb258148310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b3610 0x7fb258148310 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00c810 tx=0x7fb24c007d90 comp rx=0 tx=0).stop 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 shutdown_connections 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb244066f30 0x7fb2440693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb258159480 0x7fb258148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb2580b2140 0x7fb25815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 --2- 172.21.15.84:0/3996295370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2580b3610 0x7fb258148310 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.755+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 >> 172.21.15.84:0/3996295370 conn(0x7fb25806ed20 msgr2=0x7fb258157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.756+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 shutdown_connections 2023-10-06T02:55:59.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.756+0000 7fb257fff700 1 -- 172.21.15.84:0/3996295370 wait complete. 2023-10-06T02:55:59.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T02:55:59.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.885+0000 7f3213fff700 1 Processor -- start 2023-10-06T02:55:59.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.885+0000 7f3213fff700 1 -- start start 2023-10-06T02:55:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f3213fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 0x7f32140b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f3213fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32140b3610 0x7f32140cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f3213fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32140cb7e0 con 0x7f32140cc1b0 2023-10-06T02:55:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f3213fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32140b08a0 con 0x7f32140b3610 2023-10-06T02:55:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f3213fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32140cb190 con 0x7f3214159480 2023-10-06T02:55:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f320a7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32140b3610 0x7f32140cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f32137fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f32140cc1b0 0x7f32140b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59950/0 (socket says 172.21.15.84:59950) 2023-10-06T02:55:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f32137fe700 1 -- 172.21.15.84:0/3533942983 learned_addr learned my addr 172.21.15.84:0/3533942983 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:55:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f3212ffd700 1 --2- 172.21.15.84:0/3533942983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 0x7f32140b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f320a7fc700 1 -- 172.21.15.84:0/3533942983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 msgr2=0x7f32140b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:55:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f320a7fc700 1 --2- 172.21.15.84:0/3533942983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 0x7f32140b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f320a7fc700 1 -- 172.21.15.84:0/3533942983 >> v1:172.21.15.84:6789/0 conn(0x7f32140cc1b0 legacy=0x7f32140b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f320a7fc700 1 -- 172.21.15.84:0/3533942983 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140cb470 con 0x7f32140b3610 2023-10-06T02:55:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.886+0000 7f32127fc700 1 -- 172.21.15.84:0/3533942983 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600381546 0 0) 0x7f32140cb7e0 con 0x7f32140cc1b0 2023-10-06T02:55:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f320a7fc700 1 --2- 172.21.15.84:0/3533942983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 0x7f32140cbc70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0098e0 tx=0x7f31fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f202b0b455373c0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f32127fc700 1 -- 172.21.15.84:0/3533942983 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc009e80 con 0x7f32140b3610 2023-10-06T02:55:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f32127fc700 1 -- 172.21.15.84:0/3533942983 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc00b860 con 0x7f32140b3610 2023-10-06T02:55:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f32127fc700 1 -- 172.21.15.84:0/3533942983 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00bbe0 con 0x7f32140b3610 2023-10-06T02:55:59.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f3213fff700 1 -- 172.21.15.84:0/3533942983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 msgr2=0x7f32140cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f3213fff700 1 --2- 172.21.15.84:0/3533942983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 0x7f32140cbc70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0098e0 tx=0x7f31fc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f3213fff700 1 -- 172.21.15.84:0/3533942983 shutdown_connections 2023-10-06T02:55:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f3213fff700 1 --2- 172.21.15.84:0/3533942983 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 0x7f32140b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f3213fff700 1 --2- 172.21.15.84:0/3533942983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 0x7f32140cbc70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f3213fff700 1 -- 172.21.15.84:0/3533942983 >> 172.21.15.84:0/3533942983 conn(0x7f321406ed20 msgr2=0x7f321406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:55:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f3213fff700 1 -- 172.21.15.84:0/3533942983 shutdown_connections 2023-10-06T02:55:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.887+0000 7f3213fff700 1 -- 172.21.15.84:0/3533942983 wait complete. 2023-10-06T02:55:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3213fff700 1 Processor -- start 2023-10-06T02:55:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3213fff700 1 -- start start 2023-10-06T02:55:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3213fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 0x7f321416c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3213fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32140cc1b0 0x7f3214169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3213fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 0x7f321415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3213fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321416a130 con 0x7f32140b3610 2023-10-06T02:55:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3213fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3214157650 con 0x7f32140cc1b0 2023-10-06T02:55:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3213fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321416cec0 con 0x7f3214159480 2023-10-06T02:55:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3212ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 0x7f321416c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3212ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 0x7f321416c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43496/0 (socket says 172.21.15.84:43496) 2023-10-06T02:55:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.889+0000 7f3212ffd700 1 -- 172.21.15.84:0/523447545 learned_addr learned my addr 172.21.15.84:0/523447545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:55:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f32137fe700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 0x7f321415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f3212ffd700 1 -- 172.21.15.84:0/523447545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 msgr2=0x7f321415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f3212ffd700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 0x7f321415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f320a7fc700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32140cc1b0 0x7f3214169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f3212ffd700 1 -- 172.21.15.84:0/523447545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32140cc1b0 msgr2=0x7f3214169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:55:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f3212ffd700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32140cc1b0 0x7f3214169bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:55:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f3212ffd700 1 -- 172.21.15.84:0/523447545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc009420 con 0x7f32140b3610 2023-10-06T02:55:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f3212ffd700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 0x7f321416c7c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f320400d860 tx=0x7f3204008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f320b7fe700 1 -- 172.21.15.84:0/523447545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204009610 con 0x7f32140b3610 2023-10-06T02:55:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f320b7fe700 1 -- 172.21.15.84:0/523447545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3204009770 con 0x7f32140b3610 2023-10-06T02:55:59.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f320b7fe700 1 -- 172.21.15.84:0/523447545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204009b30 con 0x7f32140b3610 2023-10-06T02:55:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321416d1a0 con 0x7f32140b3610 2023-10-06T02:55:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.890+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321415c8c0 con 0x7f32140b3610 2023-10-06T02:55:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.891+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321416d6c0 con 0x7f32140b3610 2023-10-06T02:55:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.891+0000 7f320b7fe700 1 -- 172.21.15.84:0/523447545 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f320401e460 con 0x7f32140b3610 2023-10-06T02:55:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.892+0000 7f320b7fe700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31f4066f30 0x7f31f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:55:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.892+0000 7f320b7fe700 1 -- 172.21.15.84:0/523447545 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f3204084af0 con 0x7f32140b3610 2023-10-06T02:55:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.892+0000 7f320a7fc700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31f4066f30 0x7f31f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:55:59.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.892+0000 7f320a7fc700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31f4066f30 0x7f31f40693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3214155210 tx=0x7f31fc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:55:59.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:55:59.896+0000 7f320b7fe700 1 -- 172.21.15.84:0/523447545 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3204051e10 con 0x7f32140b3610 2023-10-06T02:56:00.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.154+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f321405f270 con 0x7f32140b3610 2023-10-06T02:56:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.158+0000 7f320b7fe700 1 -- 172.21.15.84:0/523447545 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3204055430 con 0x7f32140b3610 2023-10-06T02:56:00.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31f4066f30 msgr2=0x7f31f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31f4066f30 0x7f31f40693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3214155210 tx=0x7f31fc017000 comp rx=0 tx=0).stop 2023-10-06T02:56:00.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 msgr2=0x7f321416c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 0x7f321416c7c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f320400d860 tx=0x7f3204008040 comp rx=0 tx=0).stop 2023-10-06T02:56:00.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 shutdown_connections 2023-10-06T02:56:00.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31f4066f30 0x7f31f40693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3214159480 0x7f321415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32140b3610 0x7f321416c7c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 --2- 172.21.15.84:0/523447545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32140cc1b0 0x7f3214169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 >> 172.21.15.84:0/523447545 conn(0x7f321406ed20 msgr2=0x7f32140b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:00.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 shutdown_connections 2023-10-06T02:56:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.160+0000 7f3213fff700 1 -- 172.21.15.84:0/523447545 wait complete. 2023-10-06T02:56:00.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T02:56:00.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.287+0000 7f4487391700 1 Processor -- start 2023-10-06T02:56:00.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.288+0000 7f4487391700 1 -- start start 2023-10-06T02:56:00.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.288+0000 7f4487391700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44801595a0 0x7f44800aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.288+0000 7f4487391700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44800b07a0 0x7f44800b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.288+0000 7f4487391700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44800b0ca0 con 0x7f44800b49e0 2023-10-06T02:56:00.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.288+0000 7f4487391700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44800b0f80 con 0x7f44800b07a0 2023-10-06T02:56:00.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.288+0000 7f4487391700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44800b1260 con 0x7f44801595a0 2023-10-06T02:56:00.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.288+0000 7f448592e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44800b07a0 0x7f44800b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f448492c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f44800b49e0 0x7f44800aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59960/0 (socket says 172.21.15.84:59960) 2023-10-06T02:56:00.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f448492c700 1 -- 172.21.15.84:0/917178085 learned_addr learned my addr 172.21.15.84:0/917178085 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:00.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f448592e700 1 -- 172.21.15.84:0/917178085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44801595a0 msgr2=0x7f44800aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:00.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f448512d700 1 --2- 172.21.15.84:0/917178085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44801595a0 0x7f44800aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f447ffff700 1 -- 172.21.15.84:0/917178085 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232015723 0 0) 0x7f44800b0ca0 con 0x7f44800b49e0 2023-10-06T02:56:00.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f448592e700 1 --2- 172.21.15.84:0/917178085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44801595a0 0x7f44800aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f448592e700 1 -- 172.21.15.84:0/917178085 >> v1:172.21.15.84:6789/0 conn(0x7f44800b49e0 legacy=0x7f44800aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f448592e700 1 -- 172.21.15.84:0/917178085 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44800b1540 con 0x7f44800b07a0 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f448512d700 1 --2- 172.21.15.84:0/917178085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44801595a0 0x7f44800aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f448592e700 1 --2- 172.21.15.84:0/917178085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 0x7f44800b1c00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4478009e60 tx=0x7f4478009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448639657e2cd4ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f447ffff700 1 -- 172.21.15.84:0/917178085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447800e070 con 0x7f44800b07a0 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f447ffff700 1 -- 172.21.15.84:0/917178085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447800bc30 con 0x7f44800b07a0 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.289+0000 7f447ffff700 1 -- 172.21.15.84:0/917178085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478012430 con 0x7f44800b07a0 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.290+0000 7f4487391700 1 -- 172.21.15.84:0/917178085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 msgr2=0x7f44800b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.290+0000 7f4487391700 1 --2- 172.21.15.84:0/917178085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 0x7f44800b1c00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4478009e60 tx=0x7f4478009780 comp rx=0 tx=0).stop 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.290+0000 7f4487391700 1 -- 172.21.15.84:0/917178085 shutdown_connections 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.290+0000 7f4487391700 1 --2- 172.21.15.84:0/917178085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 0x7f44800b1c00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.290+0000 7f4487391700 1 --2- 172.21.15.84:0/917178085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44801595a0 0x7f44800aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.290+0000 7f4487391700 1 -- 172.21.15.84:0/917178085 >> 172.21.15.84:0/917178085 conn(0x7f4480099830 msgr2=0x7f448006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:00.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.290+0000 7f4487391700 1 -- 172.21.15.84:0/917178085 shutdown_connections 2023-10-06T02:56:00.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.290+0000 7f4487391700 1 -- 172.21.15.84:0/917178085 wait complete. 2023-10-06T02:56:00.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.291+0000 7f4487391700 1 Processor -- start 2023-10-06T02:56:00.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.291+0000 7f4487391700 1 -- start start 2023-10-06T02:56:00.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f4487391700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 0x7f44801569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f4487391700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44800b49e0 0x7f448015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f4487391700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801595a0 0x7f448015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f4487391700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448009def0 con 0x7f44800b07a0 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f4487391700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44801696d0 con 0x7f44801595a0 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f4487391700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448015e2e0 con 0x7f44800b49e0 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448512d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 0x7f44801569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448512d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 0x7f44801569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43512/0 (socket says 172.21.15.84:43512) 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448512d700 1 -- 172.21.15.84:0/4017072932 learned_addr learned my addr 172.21.15.84:0/4017072932 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448592e700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801595a0 0x7f448015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448492c700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44800b49e0 0x7f448015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448512d700 1 -- 172.21.15.84:0/4017072932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44800b49e0 msgr2=0x7f448015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448512d700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44800b49e0 0x7f448015a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448512d700 1 -- 172.21.15.84:0/4017072932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801595a0 msgr2=0x7f448015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448512d700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801595a0 0x7f448015aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448512d700 1 -- 172.21.15.84:0/4017072932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478009a20 con 0x7f44800b07a0 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f448512d700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 0x7f44801569d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f447000c880 tx=0x7f4470008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.292+0000 7f447d7fa700 1 -- 172.21.15.84:0/4017072932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470005a00 con 0x7f44800b07a0 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.293+0000 7f447d7fa700 1 -- 172.21.15.84:0/4017072932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470005b60 con 0x7f44800b07a0 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.293+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448015e5c0 con 0x7f44800b07a0 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.293+0000 7f447d7fa700 1 -- 172.21.15.84:0/4017072932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470011600 con 0x7f44800b07a0 2023-10-06T02:56:00.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.293+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448015eb80 con 0x7f44800b07a0 2023-10-06T02:56:00.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.293+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4480064ad0 con 0x7f44800b07a0 2023-10-06T02:56:00.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.294+0000 7f447d7fa700 1 -- 172.21.15.84:0/4017072932 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44700119f0 con 0x7f44800b07a0 2023-10-06T02:56:00.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.294+0000 7f447d7fa700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f446c066f30 0x7f446c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.294+0000 7f447d7fa700 1 -- 172.21.15.84:0/4017072932 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f44700842c0 con 0x7f44800b07a0 2023-10-06T02:56:00.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.294+0000 7f448492c700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f446c066f30 0x7f446c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.295+0000 7f448492c700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f446c066f30 0x7f446c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44800ccd30 tx=0x7f4474009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:00.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.298+0000 7f447d7fa700 1 -- 172.21.15.84:0/4017072932 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44700515e0 con 0x7f44800b07a0 2023-10-06T02:56:00.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.560+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f44800b1820 con 0x7f44800b07a0 2023-10-06T02:56:00.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.563+0000 7f447d7fa700 1 -- 172.21.15.84:0/4017072932 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4470054c00 con 0x7f44800b07a0 2023-10-06T02:56:00.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f446c066f30 msgr2=0x7f446c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f446c066f30 0x7f446c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44800ccd30 tx=0x7f4474009040 comp rx=0 tx=0).stop 2023-10-06T02:56:00.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 msgr2=0x7f44801569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 0x7f44801569d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f447000c880 tx=0x7f4470008040 comp rx=0 tx=0).stop 2023-10-06T02:56:00.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 shutdown_connections 2023-10-06T02:56:00.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f446c066f30 0x7f446c0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f44801595a0 0x7f448015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44800b07a0 0x7f44801569d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 --2- 172.21.15.84:0/4017072932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44800b49e0 0x7f448015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 >> 172.21.15.84:0/4017072932 conn(0x7f4480099830 msgr2=0x7f4480069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:00.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 shutdown_connections 2023-10-06T02:56:00.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.566+0000 7f4487391700 1 -- 172.21.15.84:0/4017072932 wait complete. 2023-10-06T02:56:00.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T02:56:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.692+0000 7f73941f4700 1 Processor -- start 2023-10-06T02:56:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.693+0000 7f73941f4700 1 -- start start 2023-10-06T02:56:00.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.693+0000 7f73941f4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f738c0ad360 0x7f738c0ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.693+0000 7f73941f4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f738c0ad730 0x7f738c068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.693+0000 7f73941f4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c068f80 con 0x7f738c068b40 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.693+0000 7f73941f4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c159f80 con 0x7f738c0ad360 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.693+0000 7f73941f4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c15a260 con 0x7f738c0ad730 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7391f90700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f738c0ad360 0x7f738c0ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7391f90700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f738c0ad360 0x7f738c0ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43516/0 (socket says 172.21.15.84:43516) 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7391f90700 1 -- 172.21.15.84:0/3055981716 learned_addr learned my addr 172.21.15.84:0/3055981716 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f739178f700 1 --2- 172.21.15.84:0/3055981716 >> v2:172.21.15.131:3300/0 conn(0x7f738c0ad730 0x7f738c068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7391f90700 1 -- 172.21.15.84:0/3055981716 >> v2:172.21.15.131:3300/0 conn(0x7f738c0ad730 msgr2=0x7f738c068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7391f90700 1 --2- 172.21.15.84:0/3055981716 >> v2:172.21.15.131:3300/0 conn(0x7f738c0ad730 0x7f738c068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7391f90700 1 -- 172.21.15.84:0/3055981716 >> v1:172.21.15.131:6789/0 conn(0x7f738c068b40 legacy=0x7f738c15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7391f90700 1 -- 172.21.15.84:0/3055981716 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c15a540 con 0x7f738c0ad360 2023-10-06T02:56:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7391f90700 1 --2- 172.21.15.84:0/3055981716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c0ad360 0x7f738c0ac270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f738c06e980 tx=0x7f7388009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74da1ce563d78af2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7390f8e700 1 -- 172.21.15.84:0/3055981716 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800e070 con 0x7f738c0ad360 2023-10-06T02:56:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7390f8e700 1 -- 172.21.15.84:0/3055981716 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738800ba50 con 0x7f738c0ad360 2023-10-06T02:56:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.694+0000 7f7390f8e700 1 -- 172.21.15.84:0/3055981716 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73880092e0 con 0x7f738c0ad360 2023-10-06T02:56:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.695+0000 7f73941f4700 1 -- 172.21.15.84:0/3055981716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c0ad360 msgr2=0x7f738c0ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.695+0000 7f73941f4700 1 --2- 172.21.15.84:0/3055981716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c0ad360 0x7f738c0ac270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f738c06e980 tx=0x7f7388009840 comp rx=0 tx=0).stop 2023-10-06T02:56:00.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.695+0000 7f73941f4700 1 -- 172.21.15.84:0/3055981716 shutdown_connections 2023-10-06T02:56:00.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.695+0000 7f73941f4700 1 --2- 172.21.15.84:0/3055981716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c0ad360 0x7f738c0ac270 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.695+0000 7f73941f4700 1 --2- 172.21.15.84:0/3055981716 >> v2:172.21.15.131:3300/0 conn(0x7f738c0ad730 0x7f738c068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.695+0000 7f73941f4700 1 -- 172.21.15.84:0/3055981716 >> 172.21.15.84:0/3055981716 conn(0x7f738c06dd10 msgr2=0x7f738c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:00.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.695+0000 7f73941f4700 1 -- 172.21.15.84:0/3055981716 shutdown_connections 2023-10-06T02:56:00.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.695+0000 7f73941f4700 1 -- 172.21.15.84:0/3055981716 wait complete. 2023-10-06T02:56:00.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.696+0000 7f73941f4700 1 Processor -- start 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.696+0000 7f73941f4700 1 -- start start 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f73941f4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c068b40 0x7f738c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f73941f4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f738c0ad360 0x7f738c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f73941f4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f738c0ad730 0x7f738c0a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f73941f4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0ca530 con 0x7f738c068b40 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f73941f4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c169ac0 con 0x7f738c0ad730 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f73941f4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c169da0 con 0x7f738c0ad360 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7391f90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c068b40 0x7f738c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7391f90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c068b40 0x7f738c0cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43520/0 (socket says 172.21.15.84:43520) 2023-10-06T02:56:00.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7391f90700 1 -- 172.21.15.84:0/3927000235 learned_addr learned my addr 172.21.15.84:0/3927000235 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7392791700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f738c0ad730 0x7f738c0a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f739178f700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f738c0ad360 0x7f738c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7391f90700 1 -- 172.21.15.84:0/3927000235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f738c0ad360 msgr2=0x7f738c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7391f90700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f738c0ad360 0x7f738c150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7391f90700 1 -- 172.21.15.84:0/3927000235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f738c0ad730 msgr2=0x7f738c0a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7391f90700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f738c0ad730 0x7f738c0a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7391f90700 1 -- 172.21.15.84:0/3927000235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388009ae0 con 0x7f738c068b40 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7391f90700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c068b40 0x7f738c0cb920 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7388009880 tx=0x7f7388018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7381ffb700 1 -- 172.21.15.84:0/3927000235 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73880094e0 con 0x7f738c068b40 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7381ffb700 1 -- 172.21.15.84:0/3927000235 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73880089b0 con 0x7f738c068b40 2023-10-06T02:56:00.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f7381ffb700 1 -- 172.21.15.84:0/3927000235 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388008d70 con 0x7f738c068b40 2023-10-06T02:56:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.697+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c16a080 con 0x7f738c068b40 2023-10-06T02:56:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.698+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c1696b0 con 0x7f738c068b40 2023-10-06T02:56:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.698+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c064ad0 con 0x7f738c068b40 2023-10-06T02:56:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.699+0000 7f7381ffb700 1 -- 172.21.15.84:0/3927000235 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7388003040 con 0x7f738c068b40 2023-10-06T02:56:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.699+0000 7f7381ffb700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7370066f30 0x7f73700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.699+0000 7f7381ffb700 1 -- 172.21.15.84:0/3927000235 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7388086160 con 0x7f738c068b40 2023-10-06T02:56:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.699+0000 7f739178f700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7370066f30 0x7f73700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:00.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.700+0000 7f739178f700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7370066f30 0x7f73700693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f737c006fd0 tx=0x7f737c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:00.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.703+0000 7f7381ffb700 1 -- 172.21.15.84:0/3927000235 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7388053480 con 0x7f738c068b40 2023-10-06T02:56:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.960+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f738c04bb80 con 0x7f738c068b40 2023-10-06T02:56:00.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.964+0000 7f7381ffb700 1 -- 172.21.15.84:0/3927000235 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7388056aa0 con 0x7f738c068b40 2023-10-06T02:56:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7370066f30 msgr2=0x7f73700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7370066f30 0x7f73700693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f737c006fd0 tx=0x7f737c008040 comp rx=0 tx=0).stop 2023-10-06T02:56:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c068b40 msgr2=0x7f738c0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c068b40 0x7f738c0cb920 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7388009880 tx=0x7f7388018000 comp rx=0 tx=0).stop 2023-10-06T02:56:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 shutdown_connections 2023-10-06T02:56:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7370066f30 0x7f73700693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f738c0ad730 0x7f738c0a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f738c068b40 0x7f738c0cb920 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 --2- 172.21.15.84:0/3927000235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f738c0ad360 0x7f738c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 >> 172.21.15.84:0/3927000235 conn(0x7f738c06dd10 msgr2=0x7f738c152680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 shutdown_connections 2023-10-06T02:56:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:00.966+0000 7f73941f4700 1 -- 172.21.15.84:0/3927000235 wait complete. 2023-10-06T02:56:00.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:56:01.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.091+0000 7f569ad42700 1 Processor -- start 2023-10-06T02:56:01.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.091+0000 7f569ad42700 1 -- start start 2023-10-06T02:56:01.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f569ad42700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56940b07a0 0x7f56940ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f569ad42700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56940b0ca0 con 0x7f56940b49e0 2023-10-06T02:56:01.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f569ad42700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56940b0f80 con 0x7f56941595a0 2023-10-06T02:56:01.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f569ad42700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56940ab390 con 0x7f56940b07a0 2023-10-06T02:56:01.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f5693fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f56940b49e0 0x7f56940aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59970/0 (socket says 172.21.15.84:59970) 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f5693fff700 1 -- 172.21.15.84:0/4218020384 learned_addr learned my addr 172.21.15.84:0/4218020384 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f56992df700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56940b07a0 0x7f56940ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788895896 0 0) 0x7f56940b0ca0 con 0x7f56940b49e0 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5684003570 con 0x7f56940b49e0 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2680776783 0 0) 0x7f5684003570 con 0x7f56940b49e0 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56940b07a0 msgr2=0x7f56940ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f56937fe700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56940b07a0 0x7f56940ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 >> v1:172.21.15.131:6789/0 conn(0x7f56941595a0 legacy=0x7f56940aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940b1260 con 0x7f56940b49e0 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.092+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f5680001470 con 0x7f56940b49e0 2023-10-06T02:56:01.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 >> v1:172.21.15.84:6789/0 conn(0x7f56940b49e0 legacy=0x7f56940aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5684003a90 0x7f5684003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56940b07a0 0x7f5684004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5684004d50 0x7f56840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56940ab390 con 0x7f5684004d50 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568400bb70 con 0x7f5684003a90 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568400bd30 con 0x7f56940b07a0 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56992df700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5684004d50 0x7f56840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f5698ade700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5684003a90 0x7f5684003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f5693fff700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56940b07a0 0x7f5684004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56992df700 1 -- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56940b07a0 msgr2=0x7f5684004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:01.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56992df700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56940b07a0 0x7f5684004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56992df700 1 -- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5684003a90 msgr2=0x7f5684003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56992df700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5684003a90 0x7f5684003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56992df700 1 -- 172.21.15.84:0/4218020384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5684003570 con 0x7f5684004d50 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56992df700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5684004d50 0x7f56840051c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f56940b64f0 tx=0x7f568c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f6ee168b3805d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00ea90 con 0x7f5684004d50 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c00f040 con 0x7f5684004d50 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.093+0000 7f56937fe700 1 -- 172.21.15.84:0/4218020384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00ee40 con 0x7f5684004d50 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.094+0000 7f569ad42700 1 -- 172.21.15.84:0/4218020384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5684004d50 msgr2=0x7f56840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.094+0000 7f569ad42700 1 --2- 172.21.15.84:0/4218020384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5684004d50 0x7f56840051c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f56940b64f0 tx=0x7f568c00b040 comp rx=0 tx=0).stop 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.094+0000 7f56992df700 1 -- 172.21.15.84:0/4218020384 reap_dead start 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.094+0000 7f569ad42700 1 -- 172.21.15.84:0/4218020384 shutdown_connections 2023-10-06T02:56:01.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.094+0000 7f569ad42700 1 -- 172.21.15.84:0/4218020384 >> 172.21.15.84:0/4218020384 conn(0x7f5694099830 msgr2=0x7f569406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:01.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.094+0000 7f569ad42700 1 -- 172.21.15.84:0/4218020384 shutdown_connections 2023-10-06T02:56:01.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.094+0000 7f569ad42700 1 -- 172.21.15.84:0/4218020384 wait complete. 2023-10-06T02:56:01.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.095+0000 7f569ad42700 1 Processor -- start 2023-10-06T02:56:01.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.095+0000 7f569ad42700 1 -- start start 2023-10-06T02:56:01.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f569ad42700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5694158750 0x7f56940ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f569ad42700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56940acd90 0x7f569416adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f569ad42700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f569416b2f0 0x7f569416a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f569ad42700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5694169d80 con 0x7f5694158750 2023-10-06T02:56:01.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f569ad42700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5694158b20 con 0x7f56940acd90 2023-10-06T02:56:01.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f569ad42700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56940abab0 con 0x7f569416b2f0 2023-10-06T02:56:01.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5698ade700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5694158750 0x7f56940ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5698ade700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5694158750 0x7f56940ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43540/0 (socket says 172.21.15.84:43540) 2023-10-06T02:56:01.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5698ade700 1 -- 172.21.15.84:0/2026060518 learned_addr learned my addr 172.21.15.84:0/2026060518 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:01.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f56992df700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f569416b2f0 0x7f569416a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5693fff700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56940acd90 0x7f569416adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5698ade700 1 -- 172.21.15.84:0/2026060518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f569416b2f0 msgr2=0x7f569416a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5698ade700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f569416b2f0 0x7f569416a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5698ade700 1 -- 172.21.15.84:0/2026060518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56940acd90 msgr2=0x7f569416adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5698ade700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56940acd90 0x7f569416adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5698ade700 1 -- 172.21.15.84:0/2026060518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56940abd90 con 0x7f5694158750 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5693fff700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56940acd90 0x7f569416adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5698ade700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5694158750 0x7f56940ab4d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f56880028c0 tx=0x7f5688007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5690ff9700 1 -- 172.21.15.84:0/2026060518 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688002e60 con 0x7f5694158750 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5690ff9700 1 -- 172.21.15.84:0/2026060518 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800f8d0 con 0x7f5694158750 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56940ac070 con 0x7f5694158750 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f5690ff9700 1 -- 172.21.15.84:0/2026060518 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800fc50 con 0x7f5694158750 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.096+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56940ad200 con 0x7f5694158750 2023-10-06T02:56:01.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.097+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569416a060 con 0x7f5694158750 2023-10-06T02:56:01.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.098+0000 7f5690ff9700 1 -- 172.21.15.84:0/2026060518 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56880133f0 con 0x7f5694158750 2023-10-06T02:56:01.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.098+0000 7f5690ff9700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5678066f30 0x7f56780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.098+0000 7f5693fff700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5678066f30 0x7f56780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.098+0000 7f5690ff9700 1 -- 172.21.15.84:0/2026060518 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5688084300 con 0x7f5694158750 2023-10-06T02:56:01.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.098+0000 7f5693fff700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5678066f30 0x7f56780693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5680000e10 tx=0x7f5680009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:01.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.102+0000 7f5690ff9700 1 -- 172.21.15.84:0/2026060518 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5688051620 con 0x7f5694158750 2023-10-06T02:56:01.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.286+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5694064ad0 con 0x7f5694158750 2023-10-06T02:56:01.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.287+0000 7f5690ff9700 1 -- 172.21.15.84:0/2026060518 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13855 (secure 0 0 0) 0x7f5688054c40 con 0x7f5694158750 2023-10-06T02:56:01.289 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:01.289 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:55:58.119613+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:56:01.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5678066f30 msgr2=0x7f56780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5678066f30 0x7f56780693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5680000e10 tx=0x7f5680009040 comp rx=0 tx=0).stop 2023-10-06T02:56:01.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5694158750 msgr2=0x7f56940ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5694158750 0x7f56940ab4d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f56880028c0 tx=0x7f5688007d80 comp rx=0 tx=0).stop 2023-10-06T02:56:01.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 shutdown_connections 2023-10-06T02:56:01.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5678066f30 0x7f56780693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f569416b2f0 0x7f569416a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5694158750 0x7f56940ab4d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 --2- 172.21.15.84:0/2026060518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56940acd90 0x7f569416adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 >> 172.21.15.84:0/2026060518 conn(0x7f5694099830 msgr2=0x7f56940cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:01.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 shutdown_connections 2023-10-06T02:56:01.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.289+0000 7f569ad42700 1 -- 172.21.15.84:0/2026060518 wait complete. 2023-10-06T02:56:01.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:56:01.303 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:56:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.419+0000 7f01ed9a1700 1 Processor -- start 2023-10-06T02:56:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.419+0000 7f01ed9a1700 1 -- start start 2023-10-06T02:56:01.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01ed9a1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f01e80ac0c0 0x7f01e80a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01ed9a1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01e80ac490 0x7f01e80af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01ed9a1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e80af900 con 0x7f01e815d870 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01ed9a1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e80aa580 con 0x7f01e80ac490 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01ed9a1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e815d3e0 con 0x7f01e80ac0c0 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01e80ac490 0x7f01e80af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01ed1a0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f01e815d870 0x7f01e80675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59974/0 (socket says 172.21.15.84:59974) 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01ed1a0700 1 -- 172.21.15.84:0/3493300728 learned_addr learned my addr 172.21.15.84:0/3493300728 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01ec99f700 1 --2- 172.21.15.84:0/3493300728 >> v2:172.21.15.131:3300/0 conn(0x7f01e80ac0c0 0x7f01e80a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e7fff700 1 -- 172.21.15.84:0/3493300728 >> v2:172.21.15.131:3300/0 conn(0x7f01e80ac0c0 msgr2=0x7f01e80a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e7fff700 1 --2- 172.21.15.84:0/3493300728 >> v2:172.21.15.131:3300/0 conn(0x7f01e80ac0c0 0x7f01e80a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e7fff700 1 -- 172.21.15.84:0/3493300728 >> v1:172.21.15.84:6789/0 conn(0x7f01e815d870 legacy=0x7f01e80675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e7fff700 1 -- 172.21.15.84:0/3493300728 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e80a9fc0 con 0x7f01e80ac490 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e77fe700 1 -- 172.21.15.84:0/3493300728 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865538112 0 0) 0x7f01e80af900 con 0x7f01e815d870 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e7fff700 1 --2- 172.21.15.84:0/3493300728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e80ac490 0x7f01e80af3c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f01e80686d0 tx=0x7f01d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2175126b1444b98c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e77fe700 1 -- 172.21.15.84:0/3493300728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d400b6b0 con 0x7f01e80ac490 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e77fe700 1 -- 172.21.15.84:0/3493300728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d400b810 con 0x7f01e80ac490 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.420+0000 7f01e77fe700 1 -- 172.21.15.84:0/3493300728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d400bbb0 con 0x7f01e80ac490 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.421+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3493300728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e80ac490 msgr2=0x7f01e80af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.421+0000 7f01ed9a1700 1 --2- 172.21.15.84:0/3493300728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e80ac490 0x7f01e80af3c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f01e80686d0 tx=0x7f01d40091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.421+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3493300728 shutdown_connections 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.421+0000 7f01ed9a1700 1 --2- 172.21.15.84:0/3493300728 >> v2:172.21.15.131:3300/0 conn(0x7f01e80ac0c0 0x7f01e80a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.421+0000 7f01ed9a1700 1 --2- 172.21.15.84:0/3493300728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e80ac490 0x7f01e80af3c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.421+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3493300728 >> 172.21.15.84:0/3493300728 conn(0x7f01e8069180 msgr2=0x7f01e80aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.421+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3493300728 shutdown_connections 2023-10-06T02:56:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.421+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3493300728 wait complete. 2023-10-06T02:56:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.422+0000 7f01ed9a1700 1 Processor -- start 2023-10-06T02:56:01.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.422+0000 7f01ed9a1700 1 -- start start 2023-10-06T02:56:01.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed9a1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e80ac0c0 0x7f01e814de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed9a1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e80ac490 0x7f01e80acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed9a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e815d870 0x7f01e8159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed9a1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e80ad810 con 0x7f01e815d870 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed9a1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e80adaf0 con 0x7f01e80ac0c0 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed9a1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e80addd0 con 0x7f01e80ac490 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed1a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e815d870 0x7f01e8159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed1a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e815d870 0x7f01e8159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43550/0 (socket says 172.21.15.84:43550) 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed1a0700 1 -- 172.21.15.84:0/3850278381 learned_addr learned my addr 172.21.15.84:0/3850278381 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01e7fff700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e80ac490 0x7f01e80acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ec99f700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e80ac0c0 0x7f01e814de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed1a0700 1 -- 172.21.15.84:0/3850278381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e80ac490 msgr2=0x7f01e80acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed1a0700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e80ac490 0x7f01e80acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed1a0700 1 -- 172.21.15.84:0/3850278381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e80ac0c0 msgr2=0x7f01e814de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed1a0700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e80ac0c0 0x7f01e814de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.423+0000 7f01ed1a0700 1 -- 172.21.15.84:0/3850278381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4009420 con 0x7f01e815d870 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.424+0000 7f01ed1a0700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e815d870 0x7f01e8159bd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f01e000cbf0 tx=0x7f01e00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.424+0000 7f01e4ff9700 1 -- 172.21.15.84:0/3850278381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000a9c0 con 0x7f01e815d870 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.424+0000 7f01e4ff9700 1 -- 172.21.15.84:0/3850278381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e000ab20 con 0x7f01e815d870 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.424+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e80ae0b0 con 0x7f01e815d870 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.424+0000 7f01e4ff9700 1 -- 172.21.15.84:0/3850278381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00070f0 con 0x7f01e815d870 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.424+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e814e350 con 0x7f01e815d870 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.425+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e805f270 con 0x7f01e815d870 2023-10-06T02:56:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.425+0000 7f01e4ff9700 1 -- 172.21.15.84:0/3850278381 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01e0007520 con 0x7f01e815d870 2023-10-06T02:56:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.425+0000 7f01e4ff9700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f01cc066f30 0x7f01cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.426+0000 7f01e4ff9700 1 -- 172.21.15.84:0/3850278381 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f01e0084870 con 0x7f01e815d870 2023-10-06T02:56:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.426+0000 7f01ec99f700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f01cc066f30 0x7f01cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.426+0000 7f01ec99f700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f01cc066f30 0x7f01cc0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01dc006fd0 tx=0x7f01dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.430+0000 7f01e4ff9700 1 -- 172.21.15.84:0/3850278381 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01e0051c10 con 0x7f01e815d870 2023-10-06T02:56:01.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.613+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01e80aa2a0 con 0x7f01e815d870 2023-10-06T02:56:01.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.613+0000 7f01e4ff9700 1 -- 172.21.15.84:0/3850278381 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01e0055230 con 0x7f01e815d870 2023-10-06T02:56:01.615 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:56:01.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.615+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f01cc066f30 msgr2=0x7f01cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.615+0000 7f01ed9a1700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f01cc066f30 0x7f01cc0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01dc006fd0 tx=0x7f01dc008040 comp rx=0 tx=0).stop 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.615+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e815d870 msgr2=0x7f01e8159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.615+0000 7f01ed9a1700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e815d870 0x7f01e8159bd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f01e000cbf0 tx=0x7f01e00019b0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.616+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 shutdown_connections 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.616+0000 7f01ed9a1700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f01cc066f30 0x7f01cc0693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.616+0000 7f01ed9a1700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01e80ac0c0 0x7f01e814de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.616+0000 7f01ed9a1700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e815d870 0x7f01e8159bd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.616+0000 7f01ed9a1700 1 --2- 172.21.15.84:0/3850278381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f01e80ac490 0x7f01e80acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.616+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 >> 172.21.15.84:0/3850278381 conn(0x7f01e8069180 msgr2=0x7f01e80b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.616+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 shutdown_connections 2023-10-06T02:56:01.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.616+0000 7f01ed9a1700 1 -- 172.21.15.84:0/3850278381 wait complete. 2023-10-06T02:56:01.629 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:56:01.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.744+0000 7f8cce963700 1 Processor -- start 2023-10-06T02:56:01.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.744+0000 7f8cce963700 1 -- start start 2023-10-06T02:56:01.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.745+0000 7f8cce963700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc81598e0 0x7f8cc80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.745+0000 7f8cce963700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc80cf610 con 0x7f8cc80cbcb0 2023-10-06T02:56:01.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.745+0000 7f8cce963700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc80cf8f0 con 0x7f8cc8159510 2023-10-06T02:56:01.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.745+0000 7f8cce963700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80cfbd0 con 0x7f8cc81598e0 2023-10-06T02:56:01.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.745+0000 7f8cccf00700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8cc80cbcb0 0x7f8cc80ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59976/0 (socket says 172.21.15.84:59976) 2023-10-06T02:56:01.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.745+0000 7f8cccf00700 1 -- 172.21.15.84:0/1242185651 learned_addr learned my addr 172.21.15.84:0/1242185651 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:01.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.745+0000 7f8cc77fe700 1 --2- 172.21.15.84:0/1242185651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc81598e0 0x7f8cc80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc6ffd700 1 -- 172.21.15.84:0/1242185651 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498237819 0 0) 0x7f8cc80cf610 con 0x7f8cc80cbcb0 2023-10-06T02:56:01.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc6ffd700 1 -- 172.21.15.84:0/1242185651 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb0003570 con 0x7f8cc80cbcb0 2023-10-06T02:56:01.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc77fe700 1 -- 172.21.15.84:0/1242185651 >> v1:172.21.15.131:6789/0 conn(0x7f8cc8159510 legacy=0x7f8cc80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc6ffd700 1 -- 172.21.15.84:0/1242185651 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590464821 0 0) 0x7f8cc80cf8f0 con 0x7f8cc8159510 2023-10-06T02:56:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc77fe700 1 -- 172.21.15.84:0/1242185651 >> v1:172.21.15.84:6789/0 conn(0x7f8cc80cbcb0 legacy=0x7f8cc80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc77fe700 1 -- 172.21.15.84:0/1242185651 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc80cfeb0 con 0x7f8cc81598e0 2023-10-06T02:56:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc77fe700 1 --2- 172.21.15.84:0/1242185651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc81598e0 0x7f8cc80ce820 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009910 tx=0x7f8cbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=628a72d854cb67c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc6ffd700 1 -- 172.21.15.84:0/1242185651 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00b680 con 0x7f8cc81598e0 2023-10-06T02:56:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc6ffd700 1 -- 172.21.15.84:0/1242185651 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc00b7e0 con 0x7f8cc81598e0 2023-10-06T02:56:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.746+0000 7f8cc6ffd700 1 -- 172.21.15.84:0/1242185651 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00bba0 con 0x7f8cc81598e0 2023-10-06T02:56:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.747+0000 7f8cce963700 1 -- 172.21.15.84:0/1242185651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc81598e0 msgr2=0x7f8cc80ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.747+0000 7f8cce963700 1 --2- 172.21.15.84:0/1242185651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc81598e0 0x7f8cc80ce820 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009910 tx=0x7f8cbc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.747+0000 7f8cce963700 1 -- 172.21.15.84:0/1242185651 shutdown_connections 2023-10-06T02:56:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.747+0000 7f8cce963700 1 --2- 172.21.15.84:0/1242185651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc81598e0 0x7f8cc80ce820 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.747+0000 7f8cce963700 1 -- 172.21.15.84:0/1242185651 >> 172.21.15.84:0/1242185651 conn(0x7f8cc8089e90 msgr2=0x7f8cc80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.747+0000 7f8cce963700 1 -- 172.21.15.84:0/1242185651 shutdown_connections 2023-10-06T02:56:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.747+0000 7f8cce963700 1 -- 172.21.15.84:0/1242185651 wait complete. 2023-10-06T02:56:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.748+0000 7f8cce963700 1 Processor -- start 2023-10-06T02:56:01.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.748+0000 7f8cce963700 1 -- start start 2023-10-06T02:56:01.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cce963700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc80cbcb0 0x7f8cc80b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cce963700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8159510 0x7f8cc81451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cce963700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cc81598e0 0x7f8cc8156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cce963700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80c9570 con 0x7f8cc81598e0 2023-10-06T02:56:01.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cce963700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80c9810 con 0x7f8cc8159510 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cce963700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80c9af0 con 0x7f8cc80cbcb0 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cccf00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cc81598e0 0x7f8cc8156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cccf00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cc81598e0 0x7f8cc8156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43556/0 (socket says 172.21.15.84:43556) 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cccf00700 1 -- 172.21.15.84:0/1108681751 learned_addr learned my addr 172.21.15.84:0/1108681751 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cc7fff700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc80cbcb0 0x7f8cc80b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cc77fe700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8159510 0x7f8cc81451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cccf00700 1 -- 172.21.15.84:0/1108681751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc80cbcb0 msgr2=0x7f8cc80b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cccf00700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc80cbcb0 0x7f8cc80b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cccf00700 1 -- 172.21.15.84:0/1108681751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8159510 msgr2=0x7f8cc81451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cccf00700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8159510 0x7f8cc81451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cccf00700 1 -- 172.21.15.84:0/1108681751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc009420 con 0x7f8cc81598e0 2023-10-06T02:56:01.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cccf00700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cc81598e0 0x7f8cc8156260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000cbc0 tx=0x7f8cc0001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:01.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8caffff700 1 -- 172.21.15.84:0/1108681751 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000a8e0 con 0x7f8cc81598e0 2023-10-06T02:56:01.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8caffff700 1 -- 172.21.15.84:0/1108681751 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000aa60 con 0x7f8cc81598e0 2023-10-06T02:56:01.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc80c9dd0 con 0x7f8cc81598e0 2023-10-06T02:56:01.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8caffff700 1 -- 172.21.15.84:0/1108681751 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000ae20 con 0x7f8cc81598e0 2023-10-06T02:56:01.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.749+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc8145700 con 0x7f8cc81598e0 2023-10-06T02:56:01.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.750+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc80ca2f0 con 0x7f8cc81598e0 2023-10-06T02:56:01.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.751+0000 7f8caffff700 1 -- 172.21.15.84:0/1108681751 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cc0007300 con 0x7f8cc81598e0 2023-10-06T02:56:01.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.751+0000 7f8caffff700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cb4066f30 0x7f8cb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:01.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.751+0000 7f8cc7fff700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cb4066f30 0x7f8cb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:01.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.751+0000 7f8caffff700 1 -- 172.21.15.84:0/1108681751 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8cc0084140 con 0x7f8cc81598e0 2023-10-06T02:56:01.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.752+0000 7f8cc7fff700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cb4066f30 0x7f8cb40693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80011e0 tx=0x7f8cb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:01.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.755+0000 7f8caffff700 1 -- 172.21.15.84:0/1108681751 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cc80ca2f0 con 0x7f8cc81598e0 2023-10-06T02:56:01.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.936+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8cc80ca2f0 con 0x7f8cc81598e0 2023-10-06T02:56:01.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.937+0000 7f8caffff700 1 -- 172.21.15.84:0/1108681751 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8cc80ca2f0 con 0x7f8cc81598e0 2023-10-06T02:56:01.939 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:56:01.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cb4066f30 msgr2=0x7f8cb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cb4066f30 0x7f8cb40693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80011e0 tx=0x7f8cb8009040 comp rx=0 tx=0).stop 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cc81598e0 msgr2=0x7f8cc8156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cc81598e0 0x7f8cc8156260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000cbc0 tx=0x7f8cc0001980 comp rx=0 tx=0).stop 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 shutdown_connections 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8cb4066f30 0x7f8cb40693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cc81598e0 0x7f8cc8156260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cc80cbcb0 0x7f8cc80b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 --2- 172.21.15.84:0/1108681751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8159510 0x7f8cc81451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 >> 172.21.15.84:0/1108681751 conn(0x7f8cc8089e90 msgr2=0x7f8cc80c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:01.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 shutdown_connections 2023-10-06T02:56:01.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:01.939+0000 7f8cce963700 1 -- 172.21.15.84:0/1108681751 wait complete. 2023-10-06T02:56:01.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:56:02.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.064+0000 7f8b5350e700 1 Processor -- start 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.065+0000 7f8b5350e700 1 -- start start 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.065+0000 7f8b5350e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b4c0b49e0 0x7f8b4c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.065+0000 7f8b5350e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c0b0ca0 con 0x7f8b4c0b07a0 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.065+0000 7f8b5350e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c0b0f80 con 0x7f8b4c1595a0 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.065+0000 7f8b5350e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0b1260 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.065+0000 7f8b50aa9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b4c0b49e0 0x7f8b4c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.065+0000 7f8b51aab700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8b4c0b07a0 0x7f8b4c0b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59988/0 (socket says 172.21.15.84:59988) 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.065+0000 7f8b51aab700 1 -- 172.21.15.84:0/3082695344 learned_addr learned my addr 172.21.15.84:0/3082695344 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.066+0000 7f8b50aa9700 1 -- 172.21.15.84:0/3082695344 >> v1:172.21.15.131:6789/0 conn(0x7f8b4c1595a0 legacy=0x7f8b4c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.066+0000 7f8b50aa9700 1 -- 172.21.15.84:0/3082695344 >> v1:172.21.15.84:6789/0 conn(0x7f8b4c0b07a0 legacy=0x7f8b4c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.066+0000 7f8b50aa9700 1 -- 172.21.15.84:0/3082695344 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c0b1540 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.066+0000 7f8b50aa9700 1 --2- 172.21.15.84:0/3082695344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 0x7f8b4c0aac80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009910 tx=0x7f8b400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8362413943b366 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:02.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.066+0000 7f8b4bfff700 1 -- 172.21.15.84:0/3082695344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000b820 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.066+0000 7f8b4bfff700 1 -- 172.21.15.84:0/3082695344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000b980 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.066+0000 7f8b4bfff700 1 -- 172.21.15.84:0/3082695344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000bd20 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.066+0000 7f8b5350e700 1 -- 172.21.15.84:0/3082695344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 msgr2=0x7f8b4c0aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.066+0000 7f8b5350e700 1 --2- 172.21.15.84:0/3082695344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 0x7f8b4c0aac80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009910 tx=0x7f8b400091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.067+0000 7f8b5350e700 1 -- 172.21.15.84:0/3082695344 shutdown_connections 2023-10-06T02:56:02.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.067+0000 7f8b5350e700 1 --2- 172.21.15.84:0/3082695344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 0x7f8b4c0aac80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.067+0000 7f8b5350e700 1 -- 172.21.15.84:0/3082695344 >> 172.21.15.84:0/3082695344 conn(0x7f8b4c099830 msgr2=0x7f8b4c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:02.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.067+0000 7f8b5350e700 1 -- 172.21.15.84:0/3082695344 shutdown_connections 2023-10-06T02:56:02.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.067+0000 7f8b5350e700 1 -- 172.21.15.84:0/3082695344 wait complete. 2023-10-06T02:56:02.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.068+0000 7f8b5350e700 1 Processor -- start 2023-10-06T02:56:02.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.068+0000 7f8b5350e700 1 -- start start 2023-10-06T02:56:02.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.068+0000 7f8b5350e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b4c0b07a0 0x7f8b4c0ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.068+0000 7f8b5350e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 0x7f8b4c0adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.068+0000 7f8b5350e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b4c1595a0 0x7f8b4c16c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.068+0000 7f8b5350e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0af5a0 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b5350e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0ae500 con 0x7f8b4c0b07a0 2023-10-06T02:56:02.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b5350e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0ae7e0 con 0x7f8b4c1595a0 2023-10-06T02:56:02.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b50aa9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 0x7f8b4c0adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:02.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b50aa9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 0x7f8b4c0adcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43582/0 (socket says 172.21.15.84:43582) 2023-10-06T02:56:02.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b50aa9700 1 -- 172.21.15.84:0/302155654 learned_addr learned my addr 172.21.15.84:0/302155654 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:02.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b512aa700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b4c0b07a0 0x7f8b4c0ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:02.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b51aab700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b4c1595a0 0x7f8b4c16c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:02.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b50aa9700 1 -- 172.21.15.84:0/302155654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b4c1595a0 msgr2=0x7f8b4c16c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b50aa9700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b4c1595a0 0x7f8b4c16c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b50aa9700 1 -- 172.21.15.84:0/302155654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b4c0b07a0 msgr2=0x7f8b4c0ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b50aa9700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b4c0b07a0 0x7f8b4c0ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b50aa9700 1 -- 172.21.15.84:0/302155654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40009420 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b50aa9700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 0x7f8b4c0adcb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8b40013000 tx=0x7f8b40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:02.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b497fa700 1 -- 172.21.15.84:0/302155654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000bd00 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b497fa700 1 -- 172.21.15.84:0/302155654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b40024440 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c0aeac0 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b497fa700 1 -- 172.21.15.84:0/302155654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400247c0 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.069+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c0af080 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.070+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c0af270 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.071+0000 7f8b497fa700 1 -- 172.21.15.84:0/302155654 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b4002d440 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.071+0000 7f8b497fa700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b38066f30 0x7f8b380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.071+0000 7f8b497fa700 1 -- 172.21.15.84:0/302155654 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8b40085e80 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.071+0000 7f8b512aa700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b38066f30 0x7f8b380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:02.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.072+0000 7f8b512aa700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b38066f30 0x7f8b380693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c158a10 tx=0x7f8b3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:02.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.075+0000 7f8b497fa700 1 -- 172.21.15.84:0/302155654 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b400531a0 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.262+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8b4c064ad0 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.263+0000 7f8b497fa700 1 -- 172.21.15.84:0/302155654 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8b400567c0 con 0x7f8b4c0b49e0 2023-10-06T02:56:02.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:56:02.265 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T02:56:02.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b38066f30 msgr2=0x7f8b380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b38066f30 0x7f8b380693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c158a10 tx=0x7f8b3c009040 comp rx=0 tx=0).stop 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 msgr2=0x7f8b4c0adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 0x7f8b4c0adcb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8b40013000 tx=0x7f8b40017000 comp rx=0 tx=0).stop 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 shutdown_connections 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b38066f30 0x7f8b380693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b4c0b07a0 0x7f8b4c0ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b4c1595a0 0x7f8b4c16c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 --2- 172.21.15.84:0/302155654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b4c0b49e0 0x7f8b4c0adcb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 >> 172.21.15.84:0/302155654 conn(0x7f8b4c099830 msgr2=0x7f8b4c0b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 shutdown_connections 2023-10-06T02:56:02.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.265+0000 7f8b5350e700 1 -- 172.21.15.84:0/302155654 wait complete. 2023-10-06T02:56:02.278 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:56:02.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:56:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.396+0000 7f36af703700 1 Processor -- start 2023-10-06T02:56:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.396+0000 7f36af703700 1 -- start start 2023-10-06T02:56:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36af703700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36a815cf50 0x7f36a80ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36af703700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80c8970 con 0x7f36a815cb80 2023-10-06T02:56:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36af703700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80c8f30 con 0x7f36a80cceb0 2023-10-06T02:56:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36af703700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80cf290 con 0x7f36a815cf50 2023-10-06T02:56:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36acc9e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36a815cf50 0x7f36a80ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36ad49f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f36a815cb80 0x7f36a80cc7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56946/0 (socket says 172.21.15.84:56946) 2023-10-06T02:56:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36ad49f700 1 -- 172.21.15.84:0/2334780949 learned_addr learned my addr 172.21.15.84:0/2334780949 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36acc9e700 1 -- 172.21.15.84:0/2334780949 >> v1:172.21.15.131:6789/0 conn(0x7f36a80cceb0 legacy=0x7f36a80c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36acc9e700 1 -- 172.21.15.84:0/2334780949 >> v1:172.21.15.84:6789/0 conn(0x7f36a815cb80 legacy=0x7f36a80cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36acc9e700 1 -- 172.21.15.84:0/2334780949 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80c42a0 con 0x7f36a815cf50 2023-10-06T02:56:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f36acc9e700 1 --2- 172.21.15.84:0/2334780949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815cf50 0x7f36a80ced50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f36980098e0 tx=0x7f36980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663c0449438c4936 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f369ffff700 1 -- 172.21.15.84:0/2334780949 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698009e80 con 0x7f36a815cf50 2023-10-06T02:56:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f369ffff700 1 -- 172.21.15.84:0/2334780949 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800b860 con 0x7f36a815cf50 2023-10-06T02:56:02.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.397+0000 7f369ffff700 1 -- 172.21.15.84:0/2334780949 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800bbe0 con 0x7f36a815cf50 2023-10-06T02:56:02.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.398+0000 7f36af703700 1 -- 172.21.15.84:0/2334780949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815cf50 msgr2=0x7f36a80ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.398+0000 7f36af703700 1 --2- 172.21.15.84:0/2334780949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815cf50 0x7f36a80ced50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f36980098e0 tx=0x7f36980091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.398+0000 7f36af703700 1 -- 172.21.15.84:0/2334780949 shutdown_connections 2023-10-06T02:56:02.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.398+0000 7f36af703700 1 --2- 172.21.15.84:0/2334780949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815cf50 0x7f36a80ced50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.398+0000 7f36af703700 1 -- 172.21.15.84:0/2334780949 >> 172.21.15.84:0/2334780949 conn(0x7f36a8088000 msgr2=0x7f36a80ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.398+0000 7f36af703700 1 -- 172.21.15.84:0/2334780949 shutdown_connections 2023-10-06T02:56:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.398+0000 7f36af703700 1 -- 172.21.15.84:0/2334780949 wait complete. 2023-10-06T02:56:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.399+0000 7f36af703700 1 Processor -- start 2023-10-06T02:56:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.399+0000 7f36af703700 1 -- start start 2023-10-06T02:56:02.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36af703700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a80cceb0 0x7f36a814b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36af703700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f36a815cb80 0x7f36a80b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36af703700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a815cf50 0x7f36a8158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36af703700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80c6e80 con 0x7f36a80cceb0 2023-10-06T02:56:02.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36af703700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a814b790 con 0x7f36a815cf50 2023-10-06T02:56:02.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36af703700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80c6550 con 0x7f36a815cb80 2023-10-06T02:56:02.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36ad49f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a80cceb0 0x7f36a814b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:02.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36ad49f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a80cceb0 0x7f36a814b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56474/0 (socket says 172.21.15.84:56474) 2023-10-06T02:56:02.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36ad49f700 1 -- 172.21.15.84:0/3678123666 learned_addr learned my addr 172.21.15.84:0/3678123666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:02.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36ad49f700 1 -- 172.21.15.84:0/3678123666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f36a815cb80 msgr2=0x7f36a80b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36ad49f700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f36a815cb80 0x7f36a80b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36ad49f700 1 -- 172.21.15.84:0/3678123666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a815cf50 msgr2=0x7f36a8158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:02.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36ad49f700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a815cf50 0x7f36a8158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:02.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36ad49f700 1 -- 172.21.15.84:0/3678123666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698009420 con 0x7f36a80cceb0 2023-10-06T02:56:02.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f36ad49f700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a80cceb0 0x7f36a814b250 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c7c0 tx=0x7f36a4007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:02.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.400+0000 7f369d7fa700 1 -- 172.21.15.84:0/3678123666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40073d0 con 0x7f36a80cceb0 2023-10-06T02:56:02.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.401+0000 7f369d7fa700 1 -- 172.21.15.84:0/3678123666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a4007530 con 0x7f36a80cceb0 2023-10-06T02:56:02.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.401+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a80c6830 con 0x7f36a80cceb0 2023-10-06T02:56:02.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.401+0000 7f369d7fa700 1 -- 172.21.15.84:0/3678123666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4005a40 con 0x7f36a80cceb0 2023-10-06T02:56:02.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.401+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a80b1ce0 con 0x7f36a80cceb0 2023-10-06T02:56:02.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.401+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8064ad0 con 0x7f36a80cceb0 2023-10-06T02:56:02.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.402+0000 7f369d7fa700 1 -- 172.21.15.84:0/3678123666 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36a401b400 con 0x7f36a80cceb0 2023-10-06T02:56:02.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.402+0000 7f369d7fa700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f368c066f30 0x7f368c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:02.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.402+0000 7f36acc9e700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f368c066f30 0x7f368c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:02.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.402+0000 7f369d7fa700 1 -- 172.21.15.84:0/3678123666 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f36a4083f30 con 0x7f36a80cceb0 2023-10-06T02:56:02.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.403+0000 7f36acc9e700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f368c066f30 0x7f368c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f36a80b0d00 tx=0x7f3698017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:02.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.407+0000 7f369d7fa700 1 -- 172.21.15.84:0/3678123666 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36a40512d0 con 0x7f36a80cceb0 2023-10-06T02:56:02.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:02.591+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f36a804bb80 con 0x7f36a80cceb0 2023-10-06T02:56:03.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.427+0000 7f369d7fa700 1 -- 172.21.15.84:0/3678123666 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f36a40548f0 con 0x7f36a80cceb0 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f368c066f30 msgr2=0x7f368c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f368c066f30 0x7f368c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f36a80b0d00 tx=0x7f3698017000 comp rx=0 tx=0).stop 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a80cceb0 msgr2=0x7f36a814b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a80cceb0 0x7f36a814b250 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c7c0 tx=0x7f36a4007de0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 shutdown_connections 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f368c066f30 0x7f368c0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a815cf50 0x7f36a8158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a80cceb0 0x7f36a814b250 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 --2- 172.21.15.84:0/3678123666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f36a815cb80 0x7f36a80b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 >> 172.21.15.84:0/3678123666 conn(0x7f36a8088000 msgr2=0x7f36a815d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:03.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 shutdown_connections 2023-10-06T02:56:03.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.431+0000 7f36af703700 1 -- 172.21.15.84:0/3678123666 wait complete. 2023-10-06T02:56:03.434 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T02:56:03.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:56:03.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.570+0000 7f31dd159700 1 Processor -- start 2023-10-06T02:56:03.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.570+0000 7f31dd159700 1 -- start start 2023-10-06T02:56:03.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.571+0000 7f31dd159700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31d80b0680 0x7f31d80ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.571+0000 7f31dd159700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f31d80b0a50 0x7f31d80cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.571+0000 7f31dd159700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d80c5400 con 0x7f31d80cc460 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.571+0000 7f31dd159700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d80ca7d0 con 0x7f31d80b0680 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.571+0000 7f31dd159700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d80ccd40 con 0x7f31d80b0a50 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.571+0000 7f31d6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31d80b0680 0x7f31d80ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.571+0000 7f31d759e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f31d80cc460 0x7f31d80c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56948/0 (socket says 172.21.15.84:56948) 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.571+0000 7f31d759e700 1 -- 172.21.15.84:0/805316724 learned_addr learned my addr 172.21.15.84:0/805316724 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31d6d9d700 1 -- 172.21.15.84:0/805316724 >> v2:172.21.15.131:3300/0 conn(0x7f31d80b0a50 msgr2=0x7f31d80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31ce59c700 1 --2- 172.21.15.84:0/805316724 >> v2:172.21.15.131:3300/0 conn(0x7f31d80b0a50 0x7f31d80cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31d6d9d700 1 --2- 172.21.15.84:0/805316724 >> v2:172.21.15.131:3300/0 conn(0x7f31d80b0a50 0x7f31d80cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31d659c700 1 -- 172.21.15.84:0/805316724 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228243655 0 0) 0x7f31d80c5400 con 0x7f31d80cc460 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31d6d9d700 1 -- 172.21.15.84:0/805316724 >> v1:172.21.15.84:6789/0 conn(0x7f31d80cc460 legacy=0x7f31d80c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31d6d9d700 1 -- 172.21.15.84:0/805316724 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d80cd020 con 0x7f31d80b0680 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31ce59c700 1 --2- 172.21.15.84:0/805316724 >> v2:172.21.15.131:3300/0 conn(0x7f31d80b0a50 0x7f31d80cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31d6d9d700 1 --2- 172.21.15.84:0/805316724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0680 0x7f31d80ced10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f31d806f480 tx=0x7f31c8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f704eb56ebef90c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31d659c700 1 -- 172.21.15.84:0/805316724 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8005c10 con 0x7f31d80b0680 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31d659c700 1 -- 172.21.15.84:0/805316724 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c8005d70 con 0x7f31d80b0680 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31d659c700 1 -- 172.21.15.84:0/805316724 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8006260 con 0x7f31d80b0680 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31dd159700 1 -- 172.21.15.84:0/805316724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0680 msgr2=0x7f31d80ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.572+0000 7f31dd159700 1 --2- 172.21.15.84:0/805316724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0680 0x7f31d80ced10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f31d806f480 tx=0x7f31c8009120 comp rx=0 tx=0).stop 2023-10-06T02:56:03.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.573+0000 7f31dd159700 1 -- 172.21.15.84:0/805316724 shutdown_connections 2023-10-06T02:56:03.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.573+0000 7f31dd159700 1 --2- 172.21.15.84:0/805316724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0680 0x7f31d80ced10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.573+0000 7f31dd159700 1 --2- 172.21.15.84:0/805316724 >> v2:172.21.15.131:3300/0 conn(0x7f31d80b0a50 0x7f31d80cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.573+0000 7f31dd159700 1 -- 172.21.15.84:0/805316724 >> 172.21.15.84:0/805316724 conn(0x7f31d8088000 msgr2=0x7f31d80ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:03.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.573+0000 7f31dd159700 1 -- 172.21.15.84:0/805316724 shutdown_connections 2023-10-06T02:56:03.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.573+0000 7f31dd159700 1 -- 172.21.15.84:0/805316724 wait complete. 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.574+0000 7f31dd159700 1 Processor -- start 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.574+0000 7f31dd159700 1 -- start start 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.574+0000 7f31dd159700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80b0680 0x7f31d8148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.574+0000 7f31dd159700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0a50 0x7f31d80b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.574+0000 7f31dd159700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d80cc460 0x7f31d80c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.574+0000 7f31dd159700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d81493c0 con 0x7f31d80b0a50 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.574+0000 7f31dd159700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80c66c0 con 0x7f31d80cc460 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.574+0000 7f31dd159700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80b2740 con 0x7f31d80b0680 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31ce59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0a50 0x7f31d80b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31ce59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0a50 0x7f31d80b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56490/0 (socket says 172.21.15.84:56490) 2023-10-06T02:56:03.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31ce59c700 1 -- 172.21.15.84:0/2043251942 learned_addr learned my addr 172.21.15.84:0/2043251942 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31d6d9d700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80b0680 0x7f31d8148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31d759e700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d80cc460 0x7f31d80c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31ce59c700 1 -- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80b0680 msgr2=0x7f31d8148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31ce59c700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80b0680 0x7f31d8148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31ce59c700 1 -- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d80cc460 msgr2=0x7f31d80c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31ce59c700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d80cc460 0x7f31d80c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31ce59c700 1 -- 172.21.15.84:0/2043251942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80093c0 con 0x7f31d80b0a50 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31d6d9d700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80b0680 0x7f31d8148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31d759e700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d80cc460 0x7f31d80c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31ce59c700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0a50 0x7f31d80b1c30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c850 tx=0x7f31c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:03.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31cf7fe700 1 -- 172.21.15.84:0/2043251942 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0011600 con 0x7f31d80b0a50 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31cf7fe700 1 -- 172.21.15.84:0/2043251942 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0011760 con 0x7f31d80b0a50 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d80b2460 con 0x7f31d80b0a50 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31cf7fe700 1 -- 172.21.15.84:0/2043251942 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0011b00 con 0x7f31d80b0a50 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.575+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d80c6350 con 0x7f31d80b0a50 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.576+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d8064ad0 con 0x7f31d80b0a50 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.577+0000 7f31cf7fe700 1 -- 172.21.15.84:0/2043251942 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31c00073b0 con 0x7f31d80b0a50 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.577+0000 7f31cf7fe700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31b8066f30 0x7f31b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.577+0000 7f31d6d9d700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31b8066f30 0x7f31b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.577+0000 7f31cf7fe700 1 -- 172.21.15.84:0/2043251942 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f31c00844f0 con 0x7f31d80b0a50 2023-10-06T02:56:03.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.578+0000 7f31d6d9d700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31b8066f30 0x7f31b80693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009160 tx=0x7f31c8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:03.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.582+0000 7f31cf7fe700 1 -- 172.21.15.84:0/2043251942 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31c0055130 con 0x7f31d80b0a50 2023-10-06T02:56:03.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:03.764+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f31d80ca3f0 con 0x7f31d80b0a50 2023-10-06T02:56:04.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.431+0000 7f31cf7fe700 1 -- 172.21.15.84:0/2043251942 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v40) v1 ==== 170+0+0 (secure 0 0 0) 0x7f31c0054cc0 con 0x7f31d80b0a50 2023-10-06T02:56:04.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31b8066f30 msgr2=0x7f31b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:04.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31b8066f30 0x7f31b80693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009160 tx=0x7f31c8016000 comp rx=0 tx=0).stop 2023-10-06T02:56:04.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0a50 msgr2=0x7f31d80b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:04.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0a50 0x7f31d80b1c30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c850 tx=0x7f31c0008040 comp rx=0 tx=0).stop 2023-10-06T02:56:04.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 shutdown_connections 2023-10-06T02:56:04.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f31b8066f30 0x7f31b80693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:04.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31d80cc460 0x7f31d80c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:04.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31d80b0680 0x7f31d8148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:04.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 --2- 172.21.15.84:0/2043251942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d80b0a50 0x7f31d80b1c30 secure :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c850 tx=0x7f31c0008040 comp rx=0 tx=0).stop 2023-10-06T02:56:04.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.436+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 >> 172.21.15.84:0/2043251942 conn(0x7f31d8088000 msgr2=0x7f31d80c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:04.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.437+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 shutdown_connections 2023-10-06T02:56:04.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.440+0000 7f31dd159700 1 -- 172.21.15.84:0/2043251942 wait complete. 2023-10-06T02:56:04.448 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T02:56:04.458 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:56:04.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.574+0000 7f8db63a8700 1 Processor -- start 2023-10-06T02:56:04.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.574+0000 7f8db63a8700 1 -- start start 2023-10-06T02:56:04.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8db63a8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8db0159510 0x7f8db00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:04.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8db63a8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8db01598e0 0x7f8db00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:04.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8db63a8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db00cf350 con 0x7f8db00ce820 2023-10-06T02:56:04.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8db63a8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db00cf610 con 0x7f8db01598e0 2023-10-06T02:56:04.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8db63a8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00cf8f0 con 0x7f8db0159510 2023-10-06T02:56:04.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8daf7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8db01598e0 0x7f8db00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:04.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8db4945700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8db00ce820 0x7f8db00cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56956/0 (socket says 172.21.15.84:56956) 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8db4945700 1 -- 172.21.15.84:0/953954474 learned_addr learned my addr 172.21.15.84:0/953954474 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8daf7fe700 1 -- 172.21.15.84:0/953954474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8db0159510 msgr2=0x7f8db00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8daf7fe700 1 --2- 172.21.15.84:0/953954474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8db0159510 0x7f8db00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8daf7fe700 1 -- 172.21.15.84:0/953954474 >> v1:172.21.15.84:6789/0 conn(0x7f8db00ce820 legacy=0x7f8db00cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8daf7fe700 1 -- 172.21.15.84:0/953954474 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00cfbd0 con 0x7f8db01598e0 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.575+0000 7f8daeffd700 1 -- 172.21.15.84:0/953954474 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359701119 0 0) 0x7f8db00cf350 con 0x7f8db00ce820 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8daf7fe700 1 --2- 172.21.15.84:0/953954474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db01598e0 0x7f8db00cbae0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8da40098e0 tx=0x7f8da40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16da40ce4a40c049 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8daeffd700 1 -- 172.21.15.84:0/953954474 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4009e80 con 0x7f8db01598e0 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8daeffd700 1 -- 172.21.15.84:0/953954474 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da400b860 con 0x7f8db01598e0 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8daeffd700 1 -- 172.21.15.84:0/953954474 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da400bbe0 con 0x7f8db01598e0 2023-10-06T02:56:04.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8db63a8700 1 -- 172.21.15.84:0/953954474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db01598e0 msgr2=0x7f8db00cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:04.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8db63a8700 1 --2- 172.21.15.84:0/953954474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db01598e0 0x7f8db00cbae0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8da40098e0 tx=0x7f8da40091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:04.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8db63a8700 1 -- 172.21.15.84:0/953954474 shutdown_connections 2023-10-06T02:56:04.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8db63a8700 1 --2- 172.21.15.84:0/953954474 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8db0159510 0x7f8db00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:04.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8db63a8700 1 --2- 172.21.15.84:0/953954474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db01598e0 0x7f8db00cbae0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:04.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8db63a8700 1 -- 172.21.15.84:0/953954474 >> 172.21.15.84:0/953954474 conn(0x7f8db0089e90 msgr2=0x7f8db00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:04.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8db63a8700 1 -- 172.21.15.84:0/953954474 shutdown_connections 2023-10-06T02:56:04.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.576+0000 7f8db63a8700 1 -- 172.21.15.84:0/953954474 wait complete. 2023-10-06T02:56:04.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.577+0000 7f8db63a8700 1 Processor -- start 2023-10-06T02:56:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8db63a8700 1 -- start start 2023-10-06T02:56:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8db63a8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db00ce820 0x7f8db014b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8db63a8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8db0159510 0x7f8db0154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8db63a8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db01598e0 0x7f8db0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8db63a8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db016b110 con 0x7f8db00ce820 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8db63a8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db016e260 con 0x7f8db01598e0 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8db63a8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db014bb40 con 0x7f8db0159510 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8daffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db00ce820 0x7f8db014b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8daffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db00ce820 0x7f8db014b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56512/0 (socket says 172.21.15.84:56512) 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.578+0000 7f8daffff700 1 -- 172.21.15.84:0/231260234 learned_addr learned my addr 172.21.15.84:0/231260234 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8db4945700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db01598e0 0x7f8db0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8daf7fe700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8db0159510 0x7f8db0154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8daffff700 1 -- 172.21.15.84:0/231260234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8db0159510 msgr2=0x7f8db0154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8daffff700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8db0159510 0x7f8db0154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8daffff700 1 -- 172.21.15.84:0/231260234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db01598e0 msgr2=0x7f8db0154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8daffff700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db01598e0 0x7f8db0154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8daffff700 1 -- 172.21.15.84:0/231260234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da4009420 con 0x7f8db00ce820 2023-10-06T02:56:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8db4945700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db01598e0 0x7f8db0154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8daffff700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db00ce820 0x7f8db014b600 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8da000b840 tx=0x7f8da0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8d97fff700 1 -- 172.21.15.84:0/231260234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da000f590 con 0x7f8db00ce820 2023-10-06T02:56:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8d97fff700 1 -- 172.21.15.84:0/231260234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da000f6f0 con 0x7f8db00ce820 2023-10-06T02:56:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db016d930 con 0x7f8db00ce820 2023-10-06T02:56:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8d97fff700 1 -- 172.21.15.84:0/231260234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da000fab0 con 0x7f8db00ce820 2023-10-06T02:56:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.579+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db016def0 con 0x7f8db00ce820 2023-10-06T02:56:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.580+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db0064ad0 con 0x7f8db00ce820 2023-10-06T02:56:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.581+0000 7f8d97fff700 1 -- 172.21.15.84:0/231260234 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8da001a460 con 0x7f8db00ce820 2023-10-06T02:56:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.581+0000 7f8d97fff700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d9c066f30 0x7f8d9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.581+0000 7f8d97fff700 1 -- 172.21.15.84:0/231260234 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f8da0084540 con 0x7f8db00ce820 2023-10-06T02:56:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.581+0000 7f8daf7fe700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d9c066f30 0x7f8d9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.581+0000 7f8daf7fe700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d9c066f30 0x7f8d9c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8db0159cd0 tx=0x7f8da4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:04.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.586+0000 7f8d97fff700 1 -- 172.21.15.84:0/231260234 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8da00515f0 con 0x7f8db00ce820 2023-10-06T02:56:04.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:04.811+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8db00cfeb0 con 0x7f8db00ce820 2023-10-06T02:56:05.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.433+0000 7f8d97fff700 1 -- 172.21.15.84:0/231260234 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8da0054c10 con 0x7f8db00ce820 2023-10-06T02:56:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d9c066f30 msgr2=0x7f8d9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d9c066f30 0x7f8d9c0693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8db0159cd0 tx=0x7f8da4017000 comp rx=0 tx=0).stop 2023-10-06T02:56:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db00ce820 msgr2=0x7f8db014b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db00ce820 0x7f8db014b600 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8da000b840 tx=0x7f8da0009250 comp rx=0 tx=0).stop 2023-10-06T02:56:05.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 shutdown_connections 2023-10-06T02:56:05.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d9c066f30 0x7f8d9c0693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db01598e0 0x7f8db0154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8db00ce820 0x7f8db014b600 secure :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8da000b840 tx=0x7f8da0009250 comp rx=0 tx=0).stop 2023-10-06T02:56:05.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 --2- 172.21.15.84:0/231260234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8db0159510 0x7f8db0154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.441+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 >> 172.21.15.84:0/231260234 conn(0x7f8db0089e90 msgr2=0x7f8db00c5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:05.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.443+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 shutdown_connections 2023-10-06T02:56:05.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.446+0000 7f8db63a8700 1 -- 172.21.15.84:0/231260234 wait complete. 2023-10-06T02:56:05.459 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T02:56:05.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:56:05.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.584+0000 7f9bb759e700 1 Processor -- start 2023-10-06T02:56:05.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.584+0000 7f9bb759e700 1 -- start start 2023-10-06T02:56:05.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9bb80cbc70 0x7f9bb80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 0x7f9bb80b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb759e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80cb7e0 con 0x7f9bb8159480 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb80b08a0 con 0x7f9bb80cbc70 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80cb190 con 0x7f9bb80b2140 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb5d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9bb80cbc70 0x7f9bb80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb5d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9bb80cbc70 0x7f9bb80cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56514/0 (socket says 172.21.15.84:56514) 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb5d9b700 1 -- 172.21.15.84:0/1091579586 learned_addr learned my addr 172.21.15.84:0/1091579586 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb6d9d700 1 --2- 172.21.15.84:0/1091579586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 0x7f9bb80b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb5d9b700 1 -- 172.21.15.84:0/1091579586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 msgr2=0x7f9bb80b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb5d9b700 1 --2- 172.21.15.84:0/1091579586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 0x7f9bb80b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb5d9b700 1 -- 172.21.15.84:0/1091579586 >> v1:172.21.15.131:6789/0 conn(0x7f9bb8159480 legacy=0x7f9bb80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.585+0000 7f9bb5d9b700 1 -- 172.21.15.84:0/1091579586 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80cb470 con 0x7f9bb80cbc70 2023-10-06T02:56:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb5d9b700 1 --2- 172.21.15.84:0/1091579586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb80cbc70 0x7f9bb80cc0c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0099b0 tx=0x7f9bac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fa29ed25c7210d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb559a700 1 -- 172.21.15.84:0/1091579586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac009ea0 con 0x7f9bb80cbc70 2023-10-06T02:56:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb559a700 1 -- 172.21.15.84:0/1091579586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00b860 con 0x7f9bb80cbc70 2023-10-06T02:56:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb559a700 1 -- 172.21.15.84:0/1091579586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00bc00 con 0x7f9bb80cbc70 2023-10-06T02:56:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb759e700 1 -- 172.21.15.84:0/1091579586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb80cbc70 msgr2=0x7f9bb80cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb759e700 1 --2- 172.21.15.84:0/1091579586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb80cbc70 0x7f9bb80cc0c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0099b0 tx=0x7f9bac009250 comp rx=0 tx=0).stop 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb759e700 1 -- 172.21.15.84:0/1091579586 shutdown_connections 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb759e700 1 --2- 172.21.15.84:0/1091579586 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 0x7f9bb80b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb759e700 1 --2- 172.21.15.84:0/1091579586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb80cbc70 0x7f9bb80cc0c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb759e700 1 -- 172.21.15.84:0/1091579586 >> 172.21.15.84:0/1091579586 conn(0x7f9bb806ed20 msgr2=0x7f9bb806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb759e700 1 -- 172.21.15.84:0/1091579586 shutdown_connections 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.586+0000 7f9bb759e700 1 -- 172.21.15.84:0/1091579586 wait complete. 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.587+0000 7f9bb759e700 1 Processor -- start 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.587+0000 7f9bb759e700 1 -- start start 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 0x7f9bb80c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb80cbc70 0x7f9bb815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb8159480 0x7f9bb8169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80c94a0 con 0x7f9bb8159480 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb815e890 con 0x7f9bb80cbc70 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb815eb70 con 0x7f9bb80b2140 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb8159480 0x7f9bb8169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb8159480 0x7f9bb8169bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56516/0 (socket says 172.21.15.84:56516) 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb6d9d700 1 -- 172.21.15.84:0/822926293 learned_addr learned my addr 172.21.15.84:0/822926293 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb659c700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 0x7f9bb80c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb5d9b700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb80cbc70 0x7f9bb815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb6d9d700 1 -- 172.21.15.84:0/822926293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 msgr2=0x7f9bb80c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb6d9d700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 0x7f9bb80c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb6d9d700 1 -- 172.21.15.84:0/822926293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb80cbc70 msgr2=0x7f9bb815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb6d9d700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb80cbc70 0x7f9bb815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.588+0000 7f9bb6d9d700 1 -- 172.21.15.84:0/822926293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0094f0 con 0x7f9bb8159480 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.589+0000 7f9bb6d9d700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb8159480 0x7f9bb8169bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800ea50 tx=0x7f9ba80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.589+0000 7f9ba67fc700 1 -- 172.21.15.84:0/822926293 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80096b0 con 0x7f9bb8159480 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.589+0000 7f9ba67fc700 1 -- 172.21.15.84:0/822926293 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba800c850 con 0x7f9bb8159480 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.589+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb80c9130 con 0x7f9bb8159480 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.589+0000 7f9ba67fc700 1 -- 172.21.15.84:0/822926293 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba800cc10 con 0x7f9bb8159480 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.589+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb815e530 con 0x7f9bb8159480 2023-10-06T02:56:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.590+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb80c9610 con 0x7f9bb8159480 2023-10-06T02:56:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.590+0000 7f9ba67fc700 1 -- 172.21.15.84:0/822926293 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ba8013470 con 0x7f9bb8159480 2023-10-06T02:56:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.590+0000 7f9ba67fc700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b98066f30 0x7f9b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.591+0000 7f9ba67fc700 1 -- 172.21.15.84:0/822926293 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9ba8084940 con 0x7f9bb8159480 2023-10-06T02:56:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.591+0000 7f9bb659c700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b98066f30 0x7f9b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.591+0000 7f9bb659c700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b98066f30 0x7f9b980693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0007fd0 tx=0x7f9bb0001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:05.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.596+0000 7f9ba67fc700 1 -- 172.21.15.84:0/822926293 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ba8051910 con 0x7f9bb8159480 2023-10-06T02:56:05.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.779+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bb805f270 con 0x7f9bb8159480 2023-10-06T02:56:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.779+0000 7f9ba67fc700 1 -- 172.21.15.84:0/822926293 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f9ba8054f30 con 0x7f9bb8159480 2023-10-06T02:56:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:05.780 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":41,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:56:04.812688+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:56:02.609660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:56:03.782698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:56:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b98066f30 msgr2=0x7f9b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b98066f30 0x7f9b980693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0007fd0 tx=0x7f9bb0001650 comp rx=0 tx=0).stop 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb8159480 msgr2=0x7f9bb8169bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb8159480 0x7f9bb8169bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800ea50 tx=0x7f9ba80091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 shutdown_connections 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b98066f30 0x7f9b980693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb8159480 0x7f9bb8169bf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9bb80b2140 0x7f9bb80c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 --2- 172.21.15.84:0/822926293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bb80cbc70 0x7f9bb815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 >> 172.21.15.84:0/822926293 conn(0x7f9bb806ed20 msgr2=0x7f9bb80cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 shutdown_connections 2023-10-06T02:56:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.782+0000 7f9bb759e700 1 -- 172.21.15.84:0/822926293 wait complete. 2023-10-06T02:56:05.794 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:56:05.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.907+0000 7fbbbd154700 1 Processor -- start 2023-10-06T02:56:05.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.907+0000 7fbbbd154700 1 -- start start 2023-10-06T02:56:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbd154700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbbb80cbc70 0x7fbbb80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbd154700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbbb80b2140 0x7fbbb80b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbd154700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb80cb7e0 con 0x7fbbb8159480 2023-10-06T02:56:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbd154700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb80b08a0 con 0x7fbbb80b2140 2023-10-06T02:56:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbd154700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb80cb190 con 0x7fbbb80cbc70 2023-10-06T02:56:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbc953700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbbb80b2140 0x7fbbb80b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbc953700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbbb80b2140 0x7fbbb80b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56522/0 (socket says 172.21.15.84:56522) 2023-10-06T02:56:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbc953700 1 -- 172.21.15.84:0/412638309 learned_addr learned my addr 172.21.15.84:0/412638309 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbb77fe700 1 --2- 172.21.15.84:0/412638309 >> v2:172.21.15.131:3300/0 conn(0x7fbbb80cbc70 0x7fbbb80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbc953700 1 -- 172.21.15.84:0/412638309 >> v2:172.21.15.131:3300/0 conn(0x7fbbb80cbc70 msgr2=0x7fbbb80cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbc953700 1 --2- 172.21.15.84:0/412638309 >> v2:172.21.15.131:3300/0 conn(0x7fbbb80cbc70 0x7fbbb80cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbc953700 1 -- 172.21.15.84:0/412638309 >> v1:172.21.15.131:6789/0 conn(0x7fbbb8159480 legacy=0x7fbbb80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.908+0000 7fbbbc953700 1 -- 172.21.15.84:0/412638309 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb80cb470 con 0x7fbbb80b2140 2023-10-06T02:56:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbbc953700 1 --2- 172.21.15.84:0/412638309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb80b2140 0x7fbbb80b2560 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80d0260 tx=0x7fbbb0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9828020ef4a0acf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbb6ffd700 1 -- 172.21.15.84:0/412638309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb000e070 con 0x7fbbb80b2140 2023-10-06T02:56:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbb6ffd700 1 -- 172.21.15.84:0/412638309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb000ba10 con 0x7fbbb80b2140 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbb6ffd700 1 -- 172.21.15.84:0/412638309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00092e0 con 0x7fbbb80b2140 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbbd154700 1 -- 172.21.15.84:0/412638309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb80b2140 msgr2=0x7fbbb80b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbbd154700 1 --2- 172.21.15.84:0/412638309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb80b2140 0x7fbbb80b2560 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80d0260 tx=0x7fbbb0009840 comp rx=0 tx=0).stop 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbbd154700 1 -- 172.21.15.84:0/412638309 shutdown_connections 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbbd154700 1 --2- 172.21.15.84:0/412638309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb80b2140 0x7fbbb80b2560 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbbd154700 1 --2- 172.21.15.84:0/412638309 >> v2:172.21.15.131:3300/0 conn(0x7fbbb80cbc70 0x7fbbb80cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbbd154700 1 -- 172.21.15.84:0/412638309 >> 172.21.15.84:0/412638309 conn(0x7fbbb806ed20 msgr2=0x7fbbb806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbbd154700 1 -- 172.21.15.84:0/412638309 shutdown_connections 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.909+0000 7fbbbd154700 1 -- 172.21.15.84:0/412638309 wait complete. 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.910+0000 7fbbbd154700 1 Processor -- start 2023-10-06T02:56:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbd154700 1 -- start start 2023-10-06T02:56:05.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbd154700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb80b2140 0x7fbbb80c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbd154700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbb80cbc70 0x7fbbb8156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbd154700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb8159480 0x7fbbb81543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbd154700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80c93b0 con 0x7fbbb8159480 2023-10-06T02:56:05.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbd154700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80c87a0 con 0x7fbbb80b2140 2023-10-06T02:56:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbd154700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb80c8a80 con 0x7fbbb80cbc70 2023-10-06T02:56:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbc953700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb8159480 0x7fbbb81543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbc953700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb8159480 0x7fbbb81543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56532/0 (socket says 172.21.15.84:56532) 2023-10-06T02:56:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbbc953700 1 -- 172.21.15.84:0/3530317235 learned_addr learned my addr 172.21.15.84:0/3530317235 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.911+0000 7fbbb7fff700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb80b2140 0x7fbbb80c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbbb77fe700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbb80cbc70 0x7fbbb8156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbbbc953700 1 -- 172.21.15.84:0/3530317235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbb80cbc70 msgr2=0x7fbbb8156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbbbc953700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbb80cbc70 0x7fbbb8156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbbbc953700 1 -- 172.21.15.84:0/3530317235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb80b2140 msgr2=0x7fbbb80c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbbbc953700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb80b2140 0x7fbbb80c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbbbc953700 1 -- 172.21.15.84:0/3530317235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb0009ae0 con 0x7fbbb8159480 2023-10-06T02:56:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbbbc953700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb8159480 0x7fbbb81543d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8069190 tx=0x7fbbb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbb9ffff700 1 -- 172.21.15.84:0/3530317235 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb000bee0 con 0x7fbbb8159480 2023-10-06T02:56:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbb9ffff700 1 -- 172.21.15.84:0/3530317235 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb00032f0 con 0x7fbbb8159480 2023-10-06T02:56:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb80c8d60 con 0x7fbbb8159480 2023-10-06T02:56:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbb9ffff700 1 -- 172.21.15.84:0/3530317235 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb001d420 con 0x7fbbb8159480 2023-10-06T02:56:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.912+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb80c8450 con 0x7fbbb8159480 2023-10-06T02:56:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.913+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb805f270 con 0x7fbbb8159480 2023-10-06T02:56:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.913+0000 7fbb9ffff700 1 -- 172.21.15.84:0/3530317235 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbb001d850 con 0x7fbbb8159480 2023-10-06T02:56:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.914+0000 7fbb9ffff700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbba4066f30 0x7fbba40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.914+0000 7fbb9ffff700 1 -- 172.21.15.84:0/3530317235 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbbb0085f00 con 0x7fbbb8159480 2023-10-06T02:56:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.914+0000 7fbbb7fff700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbba4066f30 0x7fbba40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.914+0000 7fbbb7fff700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbba4066f30 0x7fbba40693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009af0 tx=0x7fbba8009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:05.918+0000 7fbb9ffff700 1 -- 172.21.15.84:0/3530317235 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbb0052ed0 con 0x7fbbb8159480 2023-10-06T02:56:06.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.101+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbb8159850 con 0x7fbbb8159480 2023-10-06T02:56:06.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.102+0000 7fbb9ffff700 1 -- 172.21.15.84:0/3530317235 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17084 (secure 0 0 0) 0x7fbbb00564f0 con 0x7fbbb8159480 2023-10-06T02:56:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:06.103 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":41,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:56:04.812688+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:56:02.609660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:56:03.782698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:56:06.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbba4066f30 msgr2=0x7fbba40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbba4066f30 0x7fbba40693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009af0 tx=0x7fbba8009060 comp rx=0 tx=0).stop 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb8159480 msgr2=0x7fbbb81543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb8159480 0x7fbbb81543d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8069190 tx=0x7fbbb0017000 comp rx=0 tx=0).stop 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 shutdown_connections 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbba4066f30 0x7fbba40693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbb80b2140 0x7fbbb80c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb8159480 0x7fbbb81543d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 --2- 172.21.15.84:0/3530317235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbb80cbc70 0x7fbbb8156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 >> 172.21.15.84:0/3530317235 conn(0x7fbbb806ed20 msgr2=0x7fbbb80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 shutdown_connections 2023-10-06T02:56:06.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.104+0000 7fbbbd154700 1 -- 172.21.15.84:0/3530317235 wait complete. 2023-10-06T02:56:06.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:56:06.234 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:56:06.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.233+0000 7f7a292f2700 1 Processor -- start 2023-10-06T02:56:06.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.233+0000 7f7a292f2700 1 -- start start 2023-10-06T02:56:06.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.234+0000 7f7a292f2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7a24159430 0x7f7a240cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:06.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.234+0000 7f7a292f2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a240c9ce0 0x7f7a2406dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.234+0000 7f7a292f2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a24067fc0 con 0x7f7a2406e1c0 2023-10-06T02:56:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.234+0000 7f7a292f2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2406eb00 con 0x7f7a240c9ce0 2023-10-06T02:56:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.234+0000 7f7a292f2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2406e640 con 0x7f7a24159430 2023-10-06T02:56:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.234+0000 7f7a227fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a240c9ce0 0x7f7a2406dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.234+0000 7f7a237fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a2406e1c0 0x7f7a24068450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56968/0 (socket says 172.21.15.84:56968) 2023-10-06T02:56:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.234+0000 7f7a237fe700 1 -- 172.21.15.84:0/3508677319 learned_addr learned my addr 172.21.15.84:0/3508677319 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.234+0000 7f7a22ffd700 1 --2- 172.21.15.84:0/3508677319 >> v2:172.21.15.131:3300/0 conn(0x7f7a24159430 0x7f7a240cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a227fc700 1 -- 172.21.15.84:0/3508677319 >> v2:172.21.15.131:3300/0 conn(0x7f7a24159430 msgr2=0x7f7a240cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a227fc700 1 --2- 172.21.15.84:0/3508677319 >> v2:172.21.15.131:3300/0 conn(0x7f7a24159430 0x7f7a240cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a227fc700 1 -- 172.21.15.84:0/3508677319 >> v1:172.21.15.84:6789/0 conn(0x7f7a2406e1c0 legacy=0x7f7a24068450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a227fc700 1 -- 172.21.15.84:0/3508677319 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240ca150 con 0x7f7a240c9ce0 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a227fc700 1 --2- 172.21.15.84:0/3508677319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a240c9ce0 0x7f7a2406dc80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7a24070080 tx=0x7f7a0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d855e07a7c747e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a21ffb700 1 -- 172.21.15.84:0/3508677319 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c009e80 con 0x7f7a240c9ce0 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a21ffb700 1 -- 172.21.15.84:0/3508677319 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c00b820 con 0x7f7a240c9ce0 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a21ffb700 1 -- 172.21.15.84:0/3508677319 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c00bba0 con 0x7f7a240c9ce0 2023-10-06T02:56:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a292f2700 1 -- 172.21.15.84:0/3508677319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a240c9ce0 msgr2=0x7f7a2406dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:06.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a292f2700 1 --2- 172.21.15.84:0/3508677319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a240c9ce0 0x7f7a2406dc80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7a24070080 tx=0x7f7a0c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a292f2700 1 -- 172.21.15.84:0/3508677319 shutdown_connections 2023-10-06T02:56:06.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a292f2700 1 --2- 172.21.15.84:0/3508677319 >> v2:172.21.15.131:3300/0 conn(0x7f7a24159430 0x7f7a240cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a292f2700 1 --2- 172.21.15.84:0/3508677319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a240c9ce0 0x7f7a2406dc80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.235+0000 7f7a292f2700 1 -- 172.21.15.84:0/3508677319 >> 172.21.15.84:0/3508677319 conn(0x7f7a240cd410 msgr2=0x7f7a240b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:06.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.236+0000 7f7a292f2700 1 -- 172.21.15.84:0/3508677319 shutdown_connections 2023-10-06T02:56:06.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.236+0000 7f7a292f2700 1 -- 172.21.15.84:0/3508677319 wait complete. 2023-10-06T02:56:06.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.237+0000 7f7a292f2700 1 Processor -- start 2023-10-06T02:56:06.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.237+0000 7f7a292f2700 1 -- start start 2023-10-06T02:56:06.243 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:56:06.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.237+0000 7f7a292f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a2406e1c0 0x7f7a24152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:06.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.237+0000 7f7a292f2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a240c9ce0 0x7f7a24159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:06.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.237+0000 7f7a292f2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a24159430 0x7f7a24159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:06.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.237+0000 7f7a292f2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2415af80 con 0x7f7a2406e1c0 2023-10-06T02:56:06.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.237+0000 7f7a292f2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24153500 con 0x7f7a24159430 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.237+0000 7f7a292f2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2415a370 con 0x7f7a240c9ce0 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a22ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a2406e1c0 0x7f7a24152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a22ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a2406e1c0 0x7f7a24152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56556/0 (socket says 172.21.15.84:56556) 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a22ffd700 1 -- 172.21.15.84:0/2268940602 learned_addr learned my addr 172.21.15.84:0/2268940602 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a227fc700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a240c9ce0 0x7f7a24159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a237fe700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a24159430 0x7f7a24159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a22ffd700 1 -- 172.21.15.84:0/2268940602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a240c9ce0 msgr2=0x7f7a24159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a22ffd700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a240c9ce0 0x7f7a24159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a22ffd700 1 -- 172.21.15.84:0/2268940602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a24159430 msgr2=0x7f7a24159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:06.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a22ffd700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a24159430 0x7f7a24159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a22ffd700 1 -- 172.21.15.84:0/2268940602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c009420 con 0x7f7a2406e1c0 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a237fe700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a24159430 0x7f7a24159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a22ffd700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a2406e1c0 0x7f7a24152990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009fa0 tx=0x7f7a14009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a1affd700 1 -- 172.21.15.84:0/2268940602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400ec70 con 0x7f7a2406e1c0 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a1affd700 1 -- 172.21.15.84:0/2268940602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1400edd0 con 0x7f7a2406e1c0 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2415a650 con 0x7f7a2406e1c0 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a1affd700 1 -- 172.21.15.84:0/2268940602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14014670 con 0x7f7a2406e1c0 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.238+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2415ac10 con 0x7f7a2406e1c0 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.239+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a24064ad0 con 0x7f7a2406e1c0 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.240+0000 7f7a1affd700 1 -- 172.21.15.84:0/2268940602 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a140149e0 con 0x7f7a2406e1c0 2023-10-06T02:56:06.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.240+0000 7f7a1affd700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a04066f30 0x7f7a040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.240+0000 7f7a1affd700 1 -- 172.21.15.84:0/2268940602 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7a14084ec0 con 0x7f7a2406e1c0 2023-10-06T02:56:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.240+0000 7f7a227fc700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a04066f30 0x7f7a040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.240+0000 7f7a227fc700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a04066f30 0x7f7a040693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0093f0 tx=0x7f7a0c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:06.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.244+0000 7f7a1affd700 1 -- 172.21.15.84:0/2268940602 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a14051e90 con 0x7f7a2406e1c0 2023-10-06T02:56:06.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:06.483+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7a24067690 con 0x7f7a2406e1c0 2023-10-06T02:56:07.413 INFO:tasks.ceph.mds.d.smithi131.stderr:2023-10-06T02:56:07.411+0000 7f468a638700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:56:07.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.460+0000 7f7a1affd700 1 -- 172.21.15.84:0/2268940602 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7a140554b0 con 0x7f7a2406e1c0 2023-10-06T02:56:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a04066f30 msgr2=0x7f7a040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a04066f30 0x7f7a040693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0093f0 tx=0x7f7a0c017000 comp rx=0 tx=0).stop 2023-10-06T02:56:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a2406e1c0 msgr2=0x7f7a24152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a2406e1c0 0x7f7a24152990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009fa0 tx=0x7f7a14009880 comp rx=0 tx=0).stop 2023-10-06T02:56:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 shutdown_connections 2023-10-06T02:56:07.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a04066f30 0x7f7a040693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a24159430 0x7f7a24159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a2406e1c0 0x7f7a24152990 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 --2- 172.21.15.84:0/2268940602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a240c9ce0 0x7f7a24159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 >> 172.21.15.84:0/2268940602 conn(0x7f7a240cd410 msgr2=0x7f7a24156b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:07.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 shutdown_connections 2023-10-06T02:56:07.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.463+0000 7f7a292f2700 1 -- 172.21.15.84:0/2268940602 wait complete. 2023-10-06T02:56:07.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:56:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.602+0000 7fd26559f700 1 Processor -- start 2023-10-06T02:56:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.602+0000 7fd26559f700 1 -- start start 2023-10-06T02:56:07.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd26559f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd2600b2660 0x7fd2600cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:07.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd26559f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2600b2a30 0x7fd2600cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd26559f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2600ceae0 0x7fd2600cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd26559f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2600cc9b0 con 0x7fd2600ceae0 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd26559f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2600cf4c0 con 0x7fd2600b2660 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd26559f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600cbda0 con 0x7fd2600b2a30 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd264d9e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2600ceae0 0x7fd2600cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd264d9e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2600ceae0 0x7fd2600cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56570/0 (socket says 172.21.15.84:56570) 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd264d9e700 1 -- 172.21.15.84:0/3430858935 learned_addr learned my addr 172.21.15.84:0/3430858935 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.603+0000 7fd264d9e700 1 -- 172.21.15.84:0/3430858935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2600b2a30 msgr2=0x7fd2600cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd264d9e700 1 --2- 172.21.15.84:0/3430858935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2600b2a30 0x7fd2600cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd25ffff700 1 --2- 172.21.15.84:0/3430858935 >> v2:172.21.15.131:3300/0 conn(0x7fd2600b2660 0x7fd2600cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd264d9e700 1 -- 172.21.15.84:0/3430858935 >> v2:172.21.15.131:3300/0 conn(0x7fd2600b2660 msgr2=0x7fd2600cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:07.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd264d9e700 1 --2- 172.21.15.84:0/3430858935 >> v2:172.21.15.131:3300/0 conn(0x7fd2600b2660 0x7fd2600cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd264d9e700 1 -- 172.21.15.84:0/3430858935 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600cc080 con 0x7fd2600ceae0 2023-10-06T02:56:07.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd264d9e700 1 --2- 172.21.15.84:0/3430858935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 0x7fd2600cef80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd260089500 tx=0x7fd258009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa3041eb03b807a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:07.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd25effd700 1 -- 172.21.15.84:0/3430858935 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800e070 con 0x7fd2600ceae0 2023-10-06T02:56:07.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd25effd700 1 -- 172.21.15.84:0/3430858935 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800ba50 con 0x7fd2600ceae0 2023-10-06T02:56:07.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd25effd700 1 -- 172.21.15.84:0/3430858935 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580092e0 con 0x7fd2600ceae0 2023-10-06T02:56:07.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd26559f700 1 -- 172.21.15.84:0/3430858935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 msgr2=0x7fd2600cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:07.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd26559f700 1 --2- 172.21.15.84:0/3430858935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 0x7fd2600cef80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd260089500 tx=0x7fd258009840 comp rx=0 tx=0).stop 2023-10-06T02:56:07.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd26559f700 1 -- 172.21.15.84:0/3430858935 shutdown_connections 2023-10-06T02:56:07.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd26559f700 1 --2- 172.21.15.84:0/3430858935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 0x7fd2600cef80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd26559f700 1 --2- 172.21.15.84:0/3430858935 >> v2:172.21.15.131:3300/0 conn(0x7fd2600b2660 0x7fd2600cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd26559f700 1 --2- 172.21.15.84:0/3430858935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2600b2a30 0x7fd2600cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.604+0000 7fd26559f700 1 -- 172.21.15.84:0/3430858935 >> 172.21.15.84:0/3430858935 conn(0x7fd260099560 msgr2=0x7fd26006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:07.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.605+0000 7fd26559f700 1 -- 172.21.15.84:0/3430858935 shutdown_connections 2023-10-06T02:56:07.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.605+0000 7fd26559f700 1 -- 172.21.15.84:0/3430858935 wait complete. 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.606+0000 7fd26559f700 1 Processor -- start 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.606+0000 7fd26559f700 1 -- start start 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.606+0000 7fd26559f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2600b2660 0x7fd2600b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.606+0000 7fd26559f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2600b2a30 0x7fd2600c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.606+0000 7fd26559f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 0x7fd2600b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.606+0000 7fd26559f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600ca760 con 0x7fd2600ceae0 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.606+0000 7fd26559f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd260154150 con 0x7fd2600b2660 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.606+0000 7fd26559f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd260153820 con 0x7fd2600b2a30 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd264d9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 0x7fd2600b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd264d9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 0x7fd2600b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56584/0 (socket says 172.21.15.84:56584) 2023-10-06T02:56:07.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd264d9e700 1 -- 172.21.15.84:0/1912049519 learned_addr learned my addr 172.21.15.84:0/1912049519 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd25ffff700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2600b2660 0x7fd2600b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd25f7fe700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2600b2a30 0x7fd2600c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd264d9e700 1 -- 172.21.15.84:0/1912049519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2600b2a30 msgr2=0x7fd2600c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd264d9e700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2600b2a30 0x7fd2600c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd264d9e700 1 -- 172.21.15.84:0/1912049519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2600b2660 msgr2=0x7fd2600b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd264d9e700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2600b2660 0x7fd2600b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd264d9e700 1 -- 172.21.15.84:0/1912049519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258009ae0 con 0x7fd2600ceae0 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd264d9e700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 0x7fd2600b3ae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd26006fd00 tx=0x7fd258018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd247fff700 1 -- 172.21.15.84:0/1912049519 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580032f0 con 0x7fd2600ceae0 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd247fff700 1 -- 172.21.15.84:0/1912049519 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd258008d20 con 0x7fd2600ceae0 2023-10-06T02:56:07.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd247fff700 1 -- 172.21.15.84:0/1912049519 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580266b0 con 0x7fd2600ceae0 2023-10-06T02:56:07.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd260153b00 con 0x7fd2600ceae0 2023-10-06T02:56:07.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.607+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2600b60c0 con 0x7fd2600ceae0 2023-10-06T02:56:07.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.608+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26005f270 con 0x7fd2600ceae0 2023-10-06T02:56:07.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.609+0000 7fd247fff700 1 -- 172.21.15.84:0/1912049519 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd258003040 con 0x7fd2600ceae0 2023-10-06T02:56:07.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.609+0000 7fd247fff700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd24c066f30 0x7fd24c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:07.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.609+0000 7fd247fff700 1 -- 172.21.15.84:0/1912049519 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd2580861d0 con 0x7fd2600ceae0 2023-10-06T02:56:07.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.609+0000 7fd25ffff700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd24c066f30 0x7fd24c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:07.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.609+0000 7fd25ffff700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd24c066f30 0x7fd24c0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd25000ac00 tx=0x7fd250008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:07.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.613+0000 7fd247fff700 1 -- 172.21.15.84:0/1912049519 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd258053250 con 0x7fd2600ceae0 2023-10-06T02:56:07.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:07.839+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd2600cc360 con 0x7fd2600ceae0 2023-10-06T02:56:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.466+0000 7fd247fff700 1 -- 172.21.15.84:0/1912049519 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd258056870 con 0x7fd2600ceae0 2023-10-06T02:56:08.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd24c066f30 msgr2=0x7fd24c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd24c066f30 0x7fd24c0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd25000ac00 tx=0x7fd250008040 comp rx=0 tx=0).stop 2023-10-06T02:56:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 msgr2=0x7fd2600b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 0x7fd2600b3ae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd26006fd00 tx=0x7fd258018000 comp rx=0 tx=0).stop 2023-10-06T02:56:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 shutdown_connections 2023-10-06T02:56:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd24c066f30 0x7fd24c0693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2600b2660 0x7fd2600b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2600ceae0 0x7fd2600b3ae0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 --2- 172.21.15.84:0/1912049519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2600b2a30 0x7fd2600c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 >> 172.21.15.84:0/1912049519 conn(0x7fd260099560 msgr2=0x7fd260068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 shutdown_connections 2023-10-06T02:56:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.469+0000 7fd26559f700 1 -- 172.21.15.84:0/1912049519 wait complete. 2023-10-06T02:56:08.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:56:08.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.596+0000 7fc9b086f700 1 Processor -- start 2023-10-06T02:56:08.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.596+0000 7fc9b086f700 1 -- start start 2023-10-06T02:56:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.597+0000 7fc9b086f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac1595a0 0x7fc9ac0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.597+0000 7fc9b086f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9ac0b49e0 0x7fc9ac0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.597+0000 7fc9b086f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ac0b0ca0 con 0x7fc9ac0b07a0 2023-10-06T02:56:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.597+0000 7fc9b086f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac0b0f80 con 0x7fc9ac0b49e0 2023-10-06T02:56:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.597+0000 7fc9b086f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac0b1260 con 0x7fc9ac1595a0 2023-10-06T02:56:08.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.597+0000 7fc9a1d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9ac0b49e0 0x7fc9ac0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.597+0000 7fc9a1d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9ac0b49e0 0x7fc9ac0aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:53530/0 (socket says 172.21.15.84:53530) 2023-10-06T02:56:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.597+0000 7fc9aa59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac1595a0 0x7fc9ac0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.597+0000 7fc9a1d9b700 1 -- 172.21.15.84:0/1229529124 learned_addr learned my addr 172.21.15.84:0/1229529124 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.598+0000 7fc9a1d9b700 1 -- 172.21.15.84:0/1229529124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac1595a0 msgr2=0x7fc9ac0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.598+0000 7fc9a1d9b700 1 --2- 172.21.15.84:0/1229529124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac1595a0 0x7fc9ac0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.598+0000 7fc9a1d9b700 1 -- 172.21.15.84:0/1229529124 >> v1:172.21.15.131:6789/0 conn(0x7fc9ac0b07a0 legacy=0x7fc9ac0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.598+0000 7fc9a1d9b700 1 -- 172.21.15.84:0/1229529124 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0b1540 con 0x7fc9ac0b49e0 2023-10-06T02:56:08.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.598+0000 7fc9a1d9b700 1 --2- 172.21.15.84:0/1229529124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b49e0 0x7fc9ac0aaab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc9940099b0 tx=0x7fc994009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9236987433cdcf0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.598+0000 7fc9a9d9b700 1 -- 172.21.15.84:0/1229529124 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994009ea0 con 0x7fc9ac0b49e0 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.598+0000 7fc9a9d9b700 1 -- 172.21.15.84:0/1229529124 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400b860 con 0x7fc9ac0b49e0 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.598+0000 7fc9a9d9b700 1 -- 172.21.15.84:0/1229529124 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400bc00 con 0x7fc9ac0b49e0 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.599+0000 7fc9b086f700 1 -- 172.21.15.84:0/1229529124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b49e0 msgr2=0x7fc9ac0aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.599+0000 7fc9b086f700 1 --2- 172.21.15.84:0/1229529124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b49e0 0x7fc9ac0aaab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc9940099b0 tx=0x7fc994009250 comp rx=0 tx=0).stop 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.599+0000 7fc9b086f700 1 -- 172.21.15.84:0/1229529124 shutdown_connections 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.599+0000 7fc9b086f700 1 --2- 172.21.15.84:0/1229529124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac1595a0 0x7fc9ac0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.599+0000 7fc9b086f700 1 --2- 172.21.15.84:0/1229529124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b49e0 0x7fc9ac0aaab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.599+0000 7fc9b086f700 1 -- 172.21.15.84:0/1229529124 >> 172.21.15.84:0/1229529124 conn(0x7fc9ac099830 msgr2=0x7fc9ac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:08.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.599+0000 7fc9b086f700 1 -- 172.21.15.84:0/1229529124 shutdown_connections 2023-10-06T02:56:08.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.599+0000 7fc9b086f700 1 -- 172.21.15.84:0/1229529124 wait complete. 2023-10-06T02:56:08.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.600+0000 7fc9b086f700 1 Processor -- start 2023-10-06T02:56:08.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.600+0000 7fc9b086f700 1 -- start start 2023-10-06T02:56:08.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9b086f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b07a0 0x7fc9ac16a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9b086f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac0b49e0 0x7fc9ac16c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9b086f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9ac1595a0 0x7fc9ac0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9b086f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac0cd810 con 0x7fc9ac1595a0 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9b086f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac0cd530 con 0x7fc9ac0b07a0 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9b086f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac0c5310 con 0x7fc9ac0b49e0 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9ac1595a0 0x7fc9ac0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9ac1595a0 0x7fc9ac0ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56588/0 (socket says 172.21.15.84:56588) 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aad9d700 1 -- 172.21.15.84:0/761422614 learned_addr learned my addr 172.21.15.84:0/761422614 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aa59c700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b07a0 0x7fc9ac16a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9a1d9b700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac0b49e0 0x7fc9ac16c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aad9d700 1 -- 172.21.15.84:0/761422614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac0b49e0 msgr2=0x7fc9ac16c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aad9d700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac0b49e0 0x7fc9ac16c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aad9d700 1 -- 172.21.15.84:0/761422614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b07a0 msgr2=0x7fc9ac16a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aad9d700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b07a0 0x7fc9ac16a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aad9d700 1 -- 172.21.15.84:0/761422614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9940094f0 con 0x7fc9ac1595a0 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aa59c700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b07a0 0x7fc9ac16a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.601+0000 7fc9aad9d700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9ac1595a0 0x7fc9ac0ca500 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400c8e0 tx=0x7fc9a4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.602+0000 7fc9a2ffd700 1 -- 172.21.15.84:0/761422614 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4012630 con 0x7fc9ac1595a0 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.602+0000 7fc9a2ffd700 1 -- 172.21.15.84:0/761422614 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4012790 con 0x7fc9ac1595a0 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.602+0000 7fc9a2ffd700 1 -- 172.21.15.84:0/761422614 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4012b50 con 0x7fc9ac1595a0 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.602+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac0c55f0 con 0x7fc9ac1595a0 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.602+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac16c710 con 0x7fc9ac1595a0 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.602+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac0c5b10 con 0x7fc9ac1595a0 2023-10-06T02:56:08.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.603+0000 7fc9a2ffd700 1 -- 172.21.15.84:0/761422614 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9a401a3a0 con 0x7fc9ac1595a0 2023-10-06T02:56:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.603+0000 7fc9a2ffd700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc98c066f30 0x7fc98c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.603+0000 7fc9a2ffd700 1 -- 172.21.15.84:0/761422614 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc9a4084940 con 0x7fc9ac1595a0 2023-10-06T02:56:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.603+0000 7fc9aa59c700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc98c066f30 0x7fc98c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.604+0000 7fc9aa59c700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc98c066f30 0x7fc98c0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0113e0 tx=0x7fc99c009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:08.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.607+0000 7fc9a2ffd700 1 -- 172.21.15.84:0/761422614 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9ac0c5b10 con 0x7fc9ac1595a0 2023-10-06T02:56:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.833+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9ac0c5b10 con 0x7fc9ac1595a0 2023-10-06T02:56:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.834+0000 7fc9a2ffd700 1 -- 172.21.15.84:0/761422614 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fc9ac0c5b10 con 0x7fc9ac1595a0 2023-10-06T02:56:08.835 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:08.835 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1815868063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1815868063},{"type":"v1","addr":"172.21.15.84:6836","nonce":1815868063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/197493808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":197493808},{"type":"v1","addr":"172.21.15.84:6837","nonce":197493808}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:56:04.813024+0000","modified":"2023-10-06T02:56:08.459978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6835/781245140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":781245140},{"type":"v1","addr":"172.21.15.131:6835","nonce":781245140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc98c066f30 msgr2=0x7fc98c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc98c066f30 0x7fc98c0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0113e0 tx=0x7fc99c009120 comp rx=0 tx=0).stop 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9ac1595a0 msgr2=0x7fc9ac0ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9ac1595a0 0x7fc9ac0ca500 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400c8e0 tx=0x7fc9a4001710 comp rx=0 tx=0).stop 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 shutdown_connections 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc98c066f30 0x7fc98c0693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ac0b07a0 0x7fc9ac16a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9ac1595a0 0x7fc9ac0ca500 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 --2- 172.21.15.84:0/761422614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9ac0b49e0 0x7fc9ac16c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 >> 172.21.15.84:0/761422614 conn(0x7fc9ac099830 msgr2=0x7fc9ac068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 shutdown_connections 2023-10-06T02:56:08.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.836+0000 7fc9b086f700 1 -- 172.21.15.84:0/761422614 wait complete. 2023-10-06T02:56:08.838 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-10-06T02:56:08.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:56:08.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.961+0000 7f2e4420c700 1 Processor -- start 2023-10-06T02:56:08.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.961+0000 7f2e4420c700 1 -- start start 2023-10-06T02:56:08.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.962+0000 7f2e4420c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c1595a0 0x7f2e3c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.962+0000 7f2e4420c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c0b0ca0 con 0x7f2e3c0b07a0 2023-10-06T02:56:08.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.962+0000 7f2e4420c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c0b0f80 con 0x7f2e3c0b49e0 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.962+0000 7f2e4420c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0b1260 con 0x7f2e3c1595a0 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.962+0000 7f2e427a9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2e3c0b07a0 0x7f2e3c0b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56982/0 (socket says 172.21.15.84:56982) 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.962+0000 7f2e427a9700 1 -- 172.21.15.84:0/553321198 learned_addr learned my addr 172.21.15.84:0/553321198 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e41fa8700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c1595a0 0x7f2e3c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993893544 0 0) 0x7f2e3c0b0ca0 con 0x7f2e3c0b07a0 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e28003570 con 0x7f2e3c0b07a0 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204742914 0 0) 0x7f2e3c0b0f80 con 0x7f2e3c0b49e0 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c0b0ca0 con 0x7f2e3c0b49e0 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4022535296 0 0) 0x7f2e28003570 con 0x7f2e3c0b07a0 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c1595a0 msgr2=0x7f2e3c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:08.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c1595a0 0x7f2e3c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 >> v1:172.21.15.131:6789/0 conn(0x7f2e3c0b49e0 legacy=0x7f2e3c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0b1540 con 0x7f2e3c0b07a0 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f2e340017f0 con 0x7f2e3c0b07a0 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 >> v1:172.21.15.84:6789/0 conn(0x7f2e3c0b07a0 legacy=0x7f2e3c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e28003c20 0x7f2e28004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28004810 0x7f2e28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c1595a0 0x7f2e28005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0b1260 con 0x7f2e28003c20 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2800bbf0 con 0x7f2e28004810 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2800bdb0 con 0x7f2e3c1595a0 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e41fa8700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e28003c20 0x7f2e28004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e417a7700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28004810 0x7f2e28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e427a9700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c1595a0 0x7f2e28005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e41fa8700 1 -- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c1595a0 msgr2=0x7f2e28005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e41fa8700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c1595a0 0x7f2e28005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e41fa8700 1 -- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28004810 msgr2=0x7f2e28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e41fa8700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28004810 0x7f2e28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e41fa8700 1 -- 172.21.15.84:0/553321198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e28003570 con 0x7f2e28003c20 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e417a7700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28004810 0x7f2e28004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.963+0000 7f2e41fa8700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e28003c20 0x7f2e28004010 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009bf0 tx=0x7f2e38009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7d7166c14f9c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38005a00 con 0x7f2e28003c20 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38005b60 con 0x7f2e28003c20 2023-10-06T02:56:08.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e40fa6700 1 -- 172.21.15.84:0/553321198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800e710 con 0x7f2e28003c20 2023-10-06T02:56:08.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e4420c700 1 -- 172.21.15.84:0/553321198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e28003c20 msgr2=0x7f2e28004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e4420c700 1 --2- 172.21.15.84:0/553321198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e28003c20 0x7f2e28004010 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009bf0 tx=0x7f2e38009120 comp rx=0 tx=0).stop 2023-10-06T02:56:08.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e427a9700 1 -- 172.21.15.84:0/553321198 reap_dead start 2023-10-06T02:56:08.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e4420c700 1 -- 172.21.15.84:0/553321198 shutdown_connections 2023-10-06T02:56:08.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e4420c700 1 -- 172.21.15.84:0/553321198 >> 172.21.15.84:0/553321198 conn(0x7f2e3c099830 msgr2=0x7f2e3c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:08.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e4420c700 1 -- 172.21.15.84:0/553321198 shutdown_connections 2023-10-06T02:56:08.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.964+0000 7f2e4420c700 1 -- 172.21.15.84:0/553321198 wait complete. 2023-10-06T02:56:08.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.965+0000 7f2e4420c700 1 Processor -- start 2023-10-06T02:56:08.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.965+0000 7f2e4420c700 1 -- start start 2023-10-06T02:56:08.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e4420c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28003c20 0x7f2e3c16cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e4420c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e3c16d0d0 0x7f2e3c15b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e4420c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c15b6d0 0x7f2e3c09d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e4420c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c16d540 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e4420c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c16adb0 con 0x7f2e28003c20 2023-10-06T02:56:08.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e4420c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c09ac40 con 0x7f2e3c15b6d0 2023-10-06T02:56:08.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e417a7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e3c16d0d0 0x7f2e3c15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e417a7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e3c16d0d0 0x7f2e3c15b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56608/0 (socket says 172.21.15.84:56608) 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e417a7700 1 -- 172.21.15.84:0/3871686512 learned_addr learned my addr 172.21.15.84:0/3871686512 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e41fa8700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28003c20 0x7f2e3c16cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e417a7700 1 -- 172.21.15.84:0/3871686512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c15b6d0 msgr2=0x7f2e3c09d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e427a9700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c15b6d0 0x7f2e3c09d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e417a7700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c15b6d0 0x7f2e3c09d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e417a7700 1 -- 172.21.15.84:0/3871686512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28003c20 msgr2=0x7f2e3c16cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e417a7700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28003c20 0x7f2e3c16cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e417a7700 1 -- 172.21.15.84:0/3871686512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c15bec0 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.966+0000 7f2e41fa8700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28003c20 0x7f2e3c16cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:08.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.967+0000 7f2e417a7700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e3c16d0d0 0x7f2e3c15b190 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c000f60 tx=0x7f2e2c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.967+0000 7f2e31ffb700 1 -- 172.21.15.84:0/3871686512 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c006820 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.967+0000 7f2e31ffb700 1 -- 172.21.15.84:0/3871686512 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c006980 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.967+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c15c1a0 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.967+0000 7f2e31ffb700 1 -- 172.21.15.84:0/3871686512 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c006d20 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.967+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c16aa40 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.968+0000 7f2e31ffb700 1 -- 172.21.15.84:0/3871686512 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e2c007230 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.968+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c064ad0 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.968+0000 7f2e31ffb700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e20066f30 0x7f2e200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.968+0000 7f2e31ffb700 1 -- 172.21.15.84:0/3871686512 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2e2c084a30 con 0x7f2e3c16d0d0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.968+0000 7f2e41fa8700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e20066f30 0x7f2e200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:08.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.969+0000 7f2e41fa8700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e20066f30 0x7f2e200693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009160 tx=0x7f2e38019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:08.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:08.972+0000 7f2e31ffb700 1 -- 172.21.15.84:0/3871686512 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e2c051960 con 0x7f2e3c16d0d0 2023-10-06T02:56:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.156+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e3c16aef0 con 0x7f2e3c16d0d0 2023-10-06T02:56:09.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.157+0000 7f2e31ffb700 1 -- 172.21.15.84:0/3871686512 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f2e2c017090 con 0x7f2e3c16d0d0 2023-10-06T02:56:09.158 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:09.158 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":42,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:56:06.429954+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:56:02.609660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:56:03.782698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:56:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e20066f30 msgr2=0x7f2e200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e20066f30 0x7f2e200693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009160 tx=0x7f2e38019000 comp rx=0 tx=0).stop 2023-10-06T02:56:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e3c16d0d0 msgr2=0x7f2e3c15b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e3c16d0d0 0x7f2e3c15b190 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c000f60 tx=0x7f2e2c009040 comp rx=0 tx=0).stop 2023-10-06T02:56:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 shutdown_connections 2023-10-06T02:56:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2e20066f30 0x7f2e200693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e28003c20 0x7f2e3c16cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2e3c15b6d0 0x7f2e3c09d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 --2- 172.21.15.84:0/3871686512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e3c16d0d0 0x7f2e3c15b190 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 >> 172.21.15.84:0/3871686512 conn(0x7f2e3c099830 msgr2=0x7f2e3c0b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 shutdown_connections 2023-10-06T02:56:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.159+0000 7f2e4420c700 1 -- 172.21.15.84:0/3871686512 wait complete. 2023-10-06T02:56:09.172 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:56:09.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:56:09.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.287+0000 7fb46090b700 1 Processor -- start 2023-10-06T02:56:09.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.287+0000 7fb46090b700 1 -- start start 2023-10-06T02:56:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb46090b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c159480 0x7fb45c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb46090b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb45c0b2140 0x7fb45c0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb46090b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0cb7e0 con 0x7fb45c0b3610 2023-10-06T02:56:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb46090b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c0b08a0 con 0x7fb45c0b2140 2023-10-06T02:56:09.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb46090b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0cb190 con 0x7fb45c159480 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb45bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb45c0b2140 0x7fb45c0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb45affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb45c0b3610 0x7fb45c0cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56988/0 (socket says 172.21.15.84:56988) 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb45affd700 1 -- 172.21.15.84:0/2649794997 learned_addr learned my addr 172.21.15.84:0/2649794997 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb45b7fe700 1 --2- 172.21.15.84:0/2649794997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c159480 0x7fb45c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb45bfff700 1 -- 172.21.15.84:0/2649794997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c159480 msgr2=0x7fb45c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb45bfff700 1 --2- 172.21.15.84:0/2649794997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c159480 0x7fb45c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb45bfff700 1 -- 172.21.15.84:0/2649794997 >> v1:172.21.15.84:6789/0 conn(0x7fb45c0b3610 legacy=0x7fb45c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb45a7fc700 1 -- 172.21.15.84:0/2649794997 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662219408 0 0) 0x7fb45c0cb7e0 con 0x7fb45c0b3610 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.288+0000 7fb45bfff700 1 -- 172.21.15.84:0/2649794997 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0cb470 con 0x7fb45c0b2140 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb45bfff700 1 --2- 172.21.15.84:0/2649794997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 0x7fb45c0b25c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb4540098e0 tx=0x7fb4540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2255da2a5b7534a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:09.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb45a7fc700 1 -- 172.21.15.84:0/2649794997 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454009e80 con 0x7fb45c0b2140 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb45a7fc700 1 -- 172.21.15.84:0/2649794997 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400b860 con 0x7fb45c0b2140 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb45a7fc700 1 -- 172.21.15.84:0/2649794997 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400bbe0 con 0x7fb45c0b2140 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb46090b700 1 -- 172.21.15.84:0/2649794997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 msgr2=0x7fb45c0b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb46090b700 1 --2- 172.21.15.84:0/2649794997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 0x7fb45c0b25c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb4540098e0 tx=0x7fb4540091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb46090b700 1 -- 172.21.15.84:0/2649794997 shutdown_connections 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb46090b700 1 --2- 172.21.15.84:0/2649794997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 0x7fb45c0b25c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb46090b700 1 --2- 172.21.15.84:0/2649794997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c159480 0x7fb45c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb46090b700 1 -- 172.21.15.84:0/2649794997 >> 172.21.15.84:0/2649794997 conn(0x7fb45c06ed20 msgr2=0x7fb45c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb46090b700 1 -- 172.21.15.84:0/2649794997 shutdown_connections 2023-10-06T02:56:09.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.289+0000 7fb46090b700 1 -- 172.21.15.84:0/2649794997 wait complete. 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb46090b700 1 Processor -- start 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb46090b700 1 -- start start 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb46090b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 0x7fb45c0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb46090b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c0b3610 0x7fb45c157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb46090b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb45c159480 0x7fb45c153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb46090b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0ca2e0 con 0x7fb45c0b2140 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb46090b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c169570 con 0x7fb45c159480 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb46090b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0c8030 con 0x7fb45c0b3610 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb45b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 0x7fb45c0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb45b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 0x7fb45c0c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56632/0 (socket says 172.21.15.84:56632) 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.291+0000 7fb45b7fe700 1 -- 172.21.15.84:0/2560135813 learned_addr learned my addr 172.21.15.84:0/2560135813 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45bfff700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb45c159480 0x7fb45c153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45affd700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c0b3610 0x7fb45c157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45b7fe700 1 -- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c0b3610 msgr2=0x7fb45c157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45b7fe700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c0b3610 0x7fb45c157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45b7fe700 1 -- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb45c159480 msgr2=0x7fb45c153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45b7fe700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb45c159480 0x7fb45c153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45b7fe700 1 -- 172.21.15.84:0/2560135813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454009420 con 0x7fb45c0b2140 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45affd700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c0b3610 0x7fb45c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45bfff700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb45c159480 0x7fb45c153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb45b7fe700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 0x7fb45c0c9da0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb44c007f60 tx=0x7fb44c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb4437fe700 1 -- 172.21.15.84:0/2560135813 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00ecf0 con 0x7fb45c0b2140 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb4437fe700 1 -- 172.21.15.84:0/2560135813 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c00ee70 con 0x7fb45c0b2140 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c0c3b40 con 0x7fb45c0b2140 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb4437fe700 1 -- 172.21.15.84:0/2560135813 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c014650 con 0x7fb45c0b2140 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.292+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c0c4100 con 0x7fb45c0b2140 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.293+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c0c4320 con 0x7fb45c0b2140 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.293+0000 7fb4437fe700 1 -- 172.21.15.84:0/2560135813 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb44c0149c0 con 0x7fb45c0b2140 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.294+0000 7fb4437fe700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb448066f30 0x7fb4480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.294+0000 7fb4437fe700 1 -- 172.21.15.84:0/2560135813 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb44c084f70 con 0x7fb45c0b2140 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.294+0000 7fb45affd700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb448066f30 0x7fb4480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.294+0000 7fb45affd700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb448066f30 0x7fb4480693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb45c158ea0 tx=0x7fb450009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:09.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.298+0000 7fb4437fe700 1 -- 172.21.15.84:0/2560135813 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb44c051f40 con 0x7fb45c0b2140 2023-10-06T02:56:09.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.477+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb45c05f270 con 0x7fb448066f30 2023-10-06T02:56:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.485+0000 7fb4437fe700 1 -- 172.21.15.84:0/2560135813 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300169 (secure 0 0 0) 0x7fb45c05f270 con 0x7fb448066f30 2023-10-06T02:56:09.490 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb448066f30 msgr2=0x7fb4480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb448066f30 0x7fb4480693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb45c158ea0 tx=0x7fb450009040 comp rx=0 tx=0).stop 2023-10-06T02:56:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 msgr2=0x7fb45c0c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 0x7fb45c0c9da0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb44c007f60 tx=0x7fb44c009860 comp rx=0 tx=0).stop 2023-10-06T02:56:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 shutdown_connections 2023-10-06T02:56:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb448066f30 0x7fb4480693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb45c159480 0x7fb45c153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45c0b2140 0x7fb45c0c9da0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 --2- 172.21.15.84:0/2560135813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb45c0b3610 0x7fb45c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.488+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 >> 172.21.15.84:0/2560135813 conn(0x7fb45c06ed20 msgr2=0x7fb45c155a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.489+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 shutdown_connections 2023-10-06T02:56:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.489+0000 7fb46090b700 1 -- 172.21.15.84:0/2560135813 wait complete. 2023-10-06T02:56:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:56:09.501 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-10-06T02:56:07.815472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382912,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591808,"statfs":{"total":773094113280,"available":770654011392,"internally_reserved":0,"allocated":4718592,"data_stored":2719465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.389336"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.430593+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:26:30.195903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.432618+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:26.196575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.426724+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:51.353015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.431359+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:16.691652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.430539+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:03.661551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.433236+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:44.605360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.428462+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:25.906594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.437100+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:33.447750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.432505+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:26:30.195903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.436178+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:15.668167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.431996+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:26:30.195903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.436549+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:07.244350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.430073+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:08.711921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.431260+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:05.296707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.429480+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:05.296707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.436633+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:08.959428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.436305+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:32.994968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.433138+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:50.329950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.428470+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:08.959428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.429448+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:41.003350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.429399+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:39.006302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.428440+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:29.801563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.436202+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:25.906594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.431212+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:41.003350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.436118+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:29.801563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:55:58.330560+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:55:58.330560+0000","last_peered":"2023-10-06T02:55:58.330560+0000","last_clean":"2023-10-06T02:55:58.330560+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:55:58.330560+0000","last_undegraded":"2023-10-06T02:55:58.330560+0000","last_fullsized":"2023-10-06T02:55:58.330560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.429354+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:33.447750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:55:58.331889+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:55:58.331889+0000","last_peered":"2023-10-06T02:55:58.331889+0000","last_clean":"2023-10-06T02:55:58.331889+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:55:58.331889+0000","last_undegraded":"2023-10-06T02:55:58.331889+0000","last_fullsized":"2023-10-06T02:55:58.331889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.431382+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:03.661551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:55:58.124899+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:55:58.124899+0000","last_peered":"2023-10-06T02:55:58.124899+0000","last_clean":"2023-10-06T02:55:58.124899+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:55:58.124899+0000","last_undegraded":"2023-10-06T02:55:58.124899+0000","last_fullsized":"2023-10-06T02:55:58.124899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.428440+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:15.668167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:55:58.331956+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:55:58.331956+0000","last_peered":"2023-10-06T02:55:58.331956+0000","last_clean":"2023-10-06T02:55:58.331956+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:55:58.331956+0000","last_undegraded":"2023-10-06T02:55:58.331956+0000","last_fullsized":"2023-10-06T02:55:58.331956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:55:58.331903+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:55:58.331903+0000","last_peered":"2023-10-06T02:55:58.331903+0000","last_clean":"2023-10-06T02:55:58.331903+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:55:58.331903+0000","last_undegraded":"2023-10-06T02:55:58.331903+0000","last_fullsized":"2023-10-06T02:55:58.331903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.426793+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:15.668167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:55:58.331858+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:55:58.331858+0000","last_peered":"2023-10-06T02:55:58.331858+0000","last_clean":"2023-10-06T02:55:58.331858+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:55:58.331858+0000","last_undegraded":"2023-10-06T02:55:58.331858+0000","last_fullsized":"2023-10-06T02:55:58.331858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.426783+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:29.801563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:55:58.331895+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:55:58.331895+0000","last_peered":"2023-10-06T02:55:58.331895+0000","last_clean":"2023-10-06T02:55:58.331895+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:55:58.331895+0000","last_undegraded":"2023-10-06T02:55:58.331895+0000","last_fullsized":"2023-10-06T02:55:58.331895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.432598+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:36.828249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:55:58.330598+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:55:58.330598+0000","last_peered":"2023-10-06T02:55:58.330598+0000","last_clean":"2023-10-06T02:55:58.330598+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:55:58.330598+0000","last_undegraded":"2023-10-06T02:55:58.330598+0000","last_fullsized":"2023-10-06T02:55:58.330598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T02:56:04.423849+0000","last_change":"2023-10-06T02:56:04.423849+0000","last_active":"2023-10-06T02:56:04.423849+0000","last_peered":"2023-10-06T02:56:04.423849+0000","last_clean":"2023-10-06T02:56:04.423849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:04.423849+0000","last_undegraded":"2023-10-06T02:56:04.423849+0000","last_fullsized":"2023-10-06T02:56:04.423849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:56:03.418385+0000","last_change":"2023-10-06T02:56:03.431283+0000","last_active":"2023-10-06T02:56:03.418385+0000","last_peered":"2023-10-06T02:56:03.418385+0000","last_clean":"2023-10-06T02:56:03.418385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:56:03.418385+0000","last_undegraded":"2023-10-06T02:56:03.418385+0000","last_fullsized":"2023-10-06T02:56:03.418385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:08.711921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T02:55:58.123000+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:55:58.123000+0000","last_peered":"2023-10-06T02:55:58.123000+0000","last_clean":"2023-10-06T02:55:58.123000+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:55:58.123000+0000","last_undegraded":"2023-10-06T02:55:58.123000+0000","last_fullsized":"2023-10-06T02:55:58.123000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":1032192,"data_stored":780659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.373},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.443},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.505},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":196769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.57099999999999995}]},{"osd":1,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.443}]},{"osd":2,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.577,"5min":3.577,"15min":3.577},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":434176,"data_stored":189280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.373},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":21.193999999999999,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":21.135000000000002,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":21.085000000000001,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":21.166,"5min":21.166,"15min":21.166},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":1040384,"data_stored":786126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.30599999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":190291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.29899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.442},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":446464,"data_stored":195758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":0.224},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.28699999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.311},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.48699999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.497}]},{"osd":7,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.45400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":190291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.628},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.89100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":190291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.621},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:56:09.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:56:09.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.655+0000 7f6576501700 1 Processor -- start 2023-10-06T02:56:09.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.655+0000 7f6576501700 1 -- start start 2023-10-06T02:56:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6576501700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f65700b49e0 0x7f65700aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6576501700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65700b07a0 0x7f65700b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6576501700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700b0ca0 con 0x7f65701595a0 2023-10-06T02:56:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6576501700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700b0f80 con 0x7f65700b07a0 2023-10-06T02:56:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6576501700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700b1260 con 0x7f65700b49e0 2023-10-06T02:56:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6574a9e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65700b07a0 0x7f65700b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6574a9e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65700b07a0 0x7f65700b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56634/0 (socket says 172.21.15.84:56634) 2023-10-06T02:56:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6574a9e700 1 -- 172.21.15.84:0/3869550855 learned_addr learned my addr 172.21.15.84:0/3869550855 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f656f7fe700 1 --2- 172.21.15.84:0/3869550855 >> v2:172.21.15.131:3300/0 conn(0x7f65700b49e0 0x7f65700aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6574a9e700 1 -- 172.21.15.84:0/3869550855 >> v2:172.21.15.131:3300/0 conn(0x7f65700b49e0 msgr2=0x7f65700aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6574a9e700 1 --2- 172.21.15.84:0/3869550855 >> v2:172.21.15.131:3300/0 conn(0x7f65700b49e0 0x7f65700aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6574a9e700 1 -- 172.21.15.84:0/3869550855 >> v1:172.21.15.131:6789/0 conn(0x7f65701595a0 legacy=0x7f65700aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6574a9e700 1 -- 172.21.15.84:0/3869550855 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700b1540 con 0x7f65700b07a0 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f656f7fe700 1 --2- 172.21.15.84:0/3869550855 >> v2:172.21.15.131:3300/0 conn(0x7f65700b49e0 0x7f65700aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f6574a9e700 1 --2- 172.21.15.84:0/3869550855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65700b07a0 0x7f65700b1c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6568009f20 tx=0x7f6568009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c1e2b7d7111f23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f656effd700 1 -- 172.21.15.84:0/3869550855 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800e070 con 0x7f65700b07a0 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f656effd700 1 -- 172.21.15.84:0/3869550855 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800ba00 con 0x7f65700b07a0 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.656+0000 7f656effd700 1 -- 172.21.15.84:0/3869550855 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680092e0 con 0x7f65700b07a0 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.657+0000 7f6576501700 1 -- 172.21.15.84:0/3869550855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65700b07a0 msgr2=0x7f65700b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.657+0000 7f6576501700 1 --2- 172.21.15.84:0/3869550855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65700b07a0 0x7f65700b1c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6568009f20 tx=0x7f6568009840 comp rx=0 tx=0).stop 2023-10-06T02:56:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.657+0000 7f6576501700 1 -- 172.21.15.84:0/3869550855 shutdown_connections 2023-10-06T02:56:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.657+0000 7f6576501700 1 --2- 172.21.15.84:0/3869550855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65700b07a0 0x7f65700b1c00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.657+0000 7f6576501700 1 --2- 172.21.15.84:0/3869550855 >> v2:172.21.15.131:3300/0 conn(0x7f65700b49e0 0x7f65700aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.657+0000 7f6576501700 1 -- 172.21.15.84:0/3869550855 >> 172.21.15.84:0/3869550855 conn(0x7f6570099830 msgr2=0x7f657006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.657+0000 7f6576501700 1 -- 172.21.15.84:0/3869550855 shutdown_connections 2023-10-06T02:56:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.657+0000 7f6576501700 1 -- 172.21.15.84:0/3869550855 wait complete. 2023-10-06T02:56:09.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.658+0000 7f6576501700 1 Processor -- start 2023-10-06T02:56:09.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.658+0000 7f6576501700 1 -- start start 2023-10-06T02:56:09.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6576501700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65700b07a0 0x7f65700aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6576501700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65700b49e0 0x7f657009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6576501700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65701595a0 0x7f657009a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6576501700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657009c560 con 0x7f65701595a0 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6576501700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700af090 con 0x7f65700b07a0 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6576501700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657015c6f0 con 0x7f65700b49e0 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6574a9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65701595a0 0x7f657009a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6574a9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65701595a0 0x7f657009a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56636/0 (socket says 172.21.15.84:56636) 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6574a9e700 1 -- 172.21.15.84:0/2691020452 learned_addr learned my addr 172.21.15.84:0/2691020452 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6574a9e700 1 -- 172.21.15.84:0/2691020452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65700b49e0 msgr2=0x7f657009d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6574a9e700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65700b49e0 0x7f657009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6574a9e700 1 -- 172.21.15.84:0/2691020452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65700b07a0 msgr2=0x7f65700aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6574a9e700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65700b07a0 0x7f65700aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6574a9e700 1 -- 172.21.15.84:0/2691020452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568009ae0 con 0x7f65701595a0 2023-10-06T02:56:09.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6574a9e700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65701595a0 0x7f657009a090 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6570067c60 tx=0x7f6568017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.659+0000 7f6557fff700 1 -- 172.21.15.84:0/2691020452 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568012ea0 con 0x7f65701595a0 2023-10-06T02:56:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.660+0000 7f6557fff700 1 -- 172.21.15.84:0/2691020452 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680092e0 con 0x7f65701595a0 2023-10-06T02:56:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.660+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657009bfa0 con 0x7f65701595a0 2023-10-06T02:56:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.660+0000 7f6557fff700 1 -- 172.21.15.84:0/2691020452 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656801d650 con 0x7f65701595a0 2023-10-06T02:56:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.660+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657009bc70 con 0x7f65701595a0 2023-10-06T02:56:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.660+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6570064ad0 con 0x7f65701595a0 2023-10-06T02:56:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.661+0000 7f6557fff700 1 -- 172.21.15.84:0/2691020452 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f656801da40 con 0x7f65701595a0 2023-10-06T02:56:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.661+0000 7f6557fff700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f655c066f30 0x7f655c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:09.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.661+0000 7f6557fff700 1 -- 172.21.15.84:0/2691020452 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6568086190 con 0x7f65701595a0 2023-10-06T02:56:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.661+0000 7f656ffff700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f655c066f30 0x7f655c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.662+0000 7f656ffff700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f655c066f30 0x7f655c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6560009740 tx=0x7f6560006c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.666+0000 7f6557fff700 1 -- 172.21.15.84:0/2691020452 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6568053160 con 0x7f65701595a0 2023-10-06T02:56:09.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.846+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65700b1820 con 0x7f655c066f30 2023-10-06T02:56:09.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.854+0000 7f6557fff700 1 -- 172.21.15.84:0/2691020452 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311066 (secure 0 0 0) 0x7f65700b1820 con 0x7f655c066f30 2023-10-06T02:56:09.862 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f655c066f30 msgr2=0x7f655c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f655c066f30 0x7f655c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6560009740 tx=0x7f6560006c50 comp rx=0 tx=0).stop 2023-10-06T02:56:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65701595a0 msgr2=0x7f657009a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65701595a0 0x7f657009a090 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6570067c60 tx=0x7f6568017000 comp rx=0 tx=0).stop 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 shutdown_connections 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f655c066f30 0x7f655c0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65700b07a0 0x7f65700aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65701595a0 0x7f657009a090 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 --2- 172.21.15.84:0/2691020452 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65700b49e0 0x7f657009d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 >> 172.21.15.84:0/2691020452 conn(0x7f6570099830 msgr2=0x7f65700b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 shutdown_connections 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:09.857+0000 7f6576501700 1 -- 172.21.15.84:0/2691020452 wait complete. 2023-10-06T02:56:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:56:09.871 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-10-06T02:56:09.815777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383324,"kb_used_data":5020,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591396,"statfs":{"total":773094113280,"available":770653589504,"internally_reserved":0,"allocated":5140480,"data_stored":2927067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000922"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.458585+0000","last_change":"2023-10-06T02:56:05.451501+0000","last_active":"2023-10-06T02:56:05.458585+0000","last_peered":"2023-10-06T02:56:05.458585+0000","last_clean":"2023-10-06T02:56:05.458585+0000","last_became_active":"2023-10-06T02:56:05.451218+0000","last_became_peered":"2023-10-06T02:56:05.451218+0000","last_unstale":"2023-10-06T02:56:05.458585+0000","last_undegraded":"2023-10-06T02:56:05.458585+0000","last_fullsized":"2023-10-06T02:56:05.458585+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.620098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.459662+0000","last_change":"2023-10-06T02:56:05.457539+0000","last_active":"2023-10-06T02:56:05.459662+0000","last_peered":"2023-10-06T02:56:05.459662+0000","last_clean":"2023-10-06T02:56:05.459662+0000","last_became_active":"2023-10-06T02:56:05.457242+0000","last_became_peered":"2023-10-06T02:56:05.457242+0000","last_unstale":"2023-10-06T02:56:05.459662+0000","last_undegraded":"2023-10-06T02:56:05.459662+0000","last_fullsized":"2023-10-06T02:56:05.459662+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:44.900191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.455390+0000","last_change":"2023-10-06T02:56:05.450533+0000","last_active":"2023-10-06T02:56:05.455390+0000","last_peered":"2023-10-06T02:56:05.455390+0000","last_clean":"2023-10-06T02:56:05.455390+0000","last_became_active":"2023-10-06T02:56:05.450286+0000","last_became_peered":"2023-10-06T02:56:05.450286+0000","last_unstale":"2023-10-06T02:56:05.455390+0000","last_undegraded":"2023-10-06T02:56:05.455390+0000","last_fullsized":"2023-10-06T02:56:05.455390+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:15.089189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.465352+0000","last_change":"2023-10-06T02:56:05.456479+0000","last_active":"2023-10-06T02:56:05.465352+0000","last_peered":"2023-10-06T02:56:05.465352+0000","last_clean":"2023-10-06T02:56:05.465352+0000","last_became_active":"2023-10-06T02:56:05.456225+0000","last_became_peered":"2023-10-06T02:56:05.456225+0000","last_unstale":"2023-10-06T02:56:05.465352+0000","last_undegraded":"2023-10-06T02:56:05.465352+0000","last_fullsized":"2023-10-06T02:56:05.465352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:43.779090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.450700+0000","last_change":"2023-10-06T02:56:05.449000+0000","last_active":"2023-10-06T02:56:05.450700+0000","last_peered":"2023-10-06T02:56:05.450700+0000","last_clean":"2023-10-06T02:56:05.450700+0000","last_became_active":"2023-10-06T02:56:05.448317+0000","last_became_peered":"2023-10-06T02:56:05.448317+0000","last_unstale":"2023-10-06T02:56:05.450700+0000","last_undegraded":"2023-10-06T02:56:05.450700+0000","last_fullsized":"2023-10-06T02:56:05.450700+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:37.730594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456200+0000","last_change":"2023-10-06T02:56:05.447293+0000","last_active":"2023-10-06T02:56:05.456200+0000","last_peered":"2023-10-06T02:56:05.456200+0000","last_clean":"2023-10-06T02:56:05.456200+0000","last_became_active":"2023-10-06T02:56:05.447045+0000","last_became_peered":"2023-10-06T02:56:05.447045+0000","last_unstale":"2023-10-06T02:56:05.456200+0000","last_undegraded":"2023-10-06T02:56:05.456200+0000","last_fullsized":"2023-10-06T02:56:05.456200+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:19.367007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.453061+0000","last_change":"2023-10-06T02:56:05.444461+0000","last_active":"2023-10-06T02:56:05.453061+0000","last_peered":"2023-10-06T02:56:05.453061+0000","last_clean":"2023-10-06T02:56:05.453061+0000","last_became_active":"2023-10-06T02:56:05.444193+0000","last_became_peered":"2023-10-06T02:56:05.444193+0000","last_unstale":"2023-10-06T02:56:05.453061+0000","last_undegraded":"2023-10-06T02:56:05.453061+0000","last_fullsized":"2023-10-06T02:56:05.453061+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:15.089189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.465416+0000","last_change":"2023-10-06T02:56:05.457172+0000","last_active":"2023-10-06T02:56:05.465416+0000","last_peered":"2023-10-06T02:56:05.465416+0000","last_clean":"2023-10-06T02:56:05.465416+0000","last_became_active":"2023-10-06T02:56:05.456770+0000","last_became_peered":"2023-10-06T02:56:05.456770+0000","last_unstale":"2023-10-06T02:56:05.465416+0000","last_undegraded":"2023-10-06T02:56:05.465416+0000","last_fullsized":"2023-10-06T02:56:05.465416+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:19:10.777547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.464112+0000","last_change":"2023-10-06T02:56:05.456045+0000","last_active":"2023-10-06T02:56:05.464112+0000","last_peered":"2023-10-06T02:56:05.464112+0000","last_clean":"2023-10-06T02:56:05.464112+0000","last_became_active":"2023-10-06T02:56:05.455771+0000","last_became_peered":"2023-10-06T02:56:05.455771+0000","last_unstale":"2023-10-06T02:56:05.464112+0000","last_undegraded":"2023-10-06T02:56:05.464112+0000","last_fullsized":"2023-10-06T02:56:05.464112+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:48.706011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.465387+0000","last_change":"2023-10-06T02:56:05.456918+0000","last_active":"2023-10-06T02:56:05.465387+0000","last_peered":"2023-10-06T02:56:05.465387+0000","last_clean":"2023-10-06T02:56:05.465387+0000","last_became_active":"2023-10-06T02:56:05.456689+0000","last_became_peered":"2023-10-06T02:56:05.456689+0000","last_unstale":"2023-10-06T02:56:05.465387+0000","last_undegraded":"2023-10-06T02:56:05.465387+0000","last_fullsized":"2023-10-06T02:56:05.465387+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.620098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.463937+0000","last_change":"2023-10-06T02:56:05.455460+0000","last_active":"2023-10-06T02:56:05.463937+0000","last_peered":"2023-10-06T02:56:05.463937+0000","last_clean":"2023-10-06T02:56:05.463937+0000","last_became_active":"2023-10-06T02:56:05.455179+0000","last_became_peered":"2023-10-06T02:56:05.455179+0000","last_unstale":"2023-10-06T02:56:05.463937+0000","last_undegraded":"2023-10-06T02:56:05.463937+0000","last_fullsized":"2023-10-06T02:56:05.463937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:07.587261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.453261+0000","last_change":"2023-10-06T02:56:05.451509+0000","last_active":"2023-10-06T02:56:05.453261+0000","last_peered":"2023-10-06T02:56:05.453261+0000","last_clean":"2023-10-06T02:56:05.453261+0000","last_became_active":"2023-10-06T02:56:05.450922+0000","last_became_peered":"2023-10-06T02:56:05.450922+0000","last_unstale":"2023-10-06T02:56:05.453261+0000","last_undegraded":"2023-10-06T02:56:05.453261+0000","last_fullsized":"2023-10-06T02:56:05.453261+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:11.588250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.461085+0000","last_change":"2023-10-06T02:56:05.454955+0000","last_active":"2023-10-06T02:56:05.461085+0000","last_peered":"2023-10-06T02:56:05.461085+0000","last_clean":"2023-10-06T02:56:05.461085+0000","last_became_active":"2023-10-06T02:56:05.454728+0000","last_became_peered":"2023-10-06T02:56:05.454728+0000","last_unstale":"2023-10-06T02:56:05.461085+0000","last_undegraded":"2023-10-06T02:56:05.461085+0000","last_fullsized":"2023-10-06T02:56:05.461085+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:26.912058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.464020+0000","last_change":"2023-10-06T02:56:05.455694+0000","last_active":"2023-10-06T02:56:05.464020+0000","last_peered":"2023-10-06T02:56:05.464020+0000","last_clean":"2023-10-06T02:56:05.464020+0000","last_became_active":"2023-10-06T02:56:05.455372+0000","last_became_peered":"2023-10-06T02:56:05.455372+0000","last_unstale":"2023-10-06T02:56:05.464020+0000","last_undegraded":"2023-10-06T02:56:05.464020+0000","last_fullsized":"2023-10-06T02:56:05.464020+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:19.367007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456859+0000","last_change":"2023-10-06T02:56:05.451341+0000","last_active":"2023-10-06T02:56:05.456859+0000","last_peered":"2023-10-06T02:56:05.456859+0000","last_clean":"2023-10-06T02:56:05.456859+0000","last_became_active":"2023-10-06T02:56:05.451122+0000","last_became_peered":"2023-10-06T02:56:05.451122+0000","last_unstale":"2023-10-06T02:56:05.456859+0000","last_undegraded":"2023-10-06T02:56:05.456859+0000","last_fullsized":"2023-10-06T02:56:05.456859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:21.290881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460001+0000","last_change":"2023-10-06T02:56:05.450815+0000","last_active":"2023-10-06T02:56:05.460001+0000","last_peered":"2023-10-06T02:56:05.460001+0000","last_clean":"2023-10-06T02:56:05.460001+0000","last_became_active":"2023-10-06T02:56:05.450519+0000","last_became_peered":"2023-10-06T02:56:05.450519+0000","last_unstale":"2023-10-06T02:56:05.460001+0000","last_undegraded":"2023-10-06T02:56:05.460001+0000","last_fullsized":"2023-10-06T02:56:05.460001+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:30.807027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.455340+0000","last_change":"2023-10-06T02:56:05.449835+0000","last_active":"2023-10-06T02:56:05.455340+0000","last_peered":"2023-10-06T02:56:05.455340+0000","last_clean":"2023-10-06T02:56:05.455340+0000","last_became_active":"2023-10-06T02:56:05.449570+0000","last_became_peered":"2023-10-06T02:56:05.449570+0000","last_unstale":"2023-10-06T02:56:05.455340+0000","last_undegraded":"2023-10-06T02:56:05.455340+0000","last_fullsized":"2023-10-06T02:56:05.455340+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:38.869880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460227+0000","last_change":"2023-10-06T02:56:05.455746+0000","last_active":"2023-10-06T02:56:05.460227+0000","last_peered":"2023-10-06T02:56:05.460227+0000","last_clean":"2023-10-06T02:56:05.460227+0000","last_became_active":"2023-10-06T02:56:05.455476+0000","last_became_peered":"2023-10-06T02:56:05.455476+0000","last_unstale":"2023-10-06T02:56:05.460227+0000","last_undegraded":"2023-10-06T02:56:05.460227+0000","last_fullsized":"2023-10-06T02:56:05.460227+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:08.899225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.459199+0000","last_change":"2023-10-06T02:56:05.450525+0000","last_active":"2023-10-06T02:56:05.459199+0000","last_peered":"2023-10-06T02:56:05.459199+0000","last_clean":"2023-10-06T02:56:05.459199+0000","last_became_active":"2023-10-06T02:56:05.449904+0000","last_became_peered":"2023-10-06T02:56:05.449904+0000","last_unstale":"2023-10-06T02:56:05.459199+0000","last_undegraded":"2023-10-06T02:56:05.459199+0000","last_fullsized":"2023-10-06T02:56:05.459199+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:27:16.673631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.461105+0000","last_change":"2023-10-06T02:56:05.454433+0000","last_active":"2023-10-06T02:56:05.461105+0000","last_peered":"2023-10-06T02:56:05.461105+0000","last_clean":"2023-10-06T02:56:05.461105+0000","last_became_active":"2023-10-06T02:56:05.453742+0000","last_became_peered":"2023-10-06T02:56:05.453742+0000","last_unstale":"2023-10-06T02:56:05.461105+0000","last_undegraded":"2023-10-06T02:56:05.461105+0000","last_fullsized":"2023-10-06T02:56:05.461105+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:40.011766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.457043+0000","last_change":"2023-10-06T02:56:05.447846+0000","last_active":"2023-10-06T02:56:05.457043+0000","last_peered":"2023-10-06T02:56:05.457043+0000","last_clean":"2023-10-06T02:56:05.457043+0000","last_became_active":"2023-10-06T02:56:05.447602+0000","last_became_peered":"2023-10-06T02:56:05.447602+0000","last_unstale":"2023-10-06T02:56:05.457043+0000","last_undegraded":"2023-10-06T02:56:05.457043+0000","last_fullsized":"2023-10-06T02:56:05.457043+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:48.706011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.465357+0000","last_change":"2023-10-06T02:56:05.456495+0000","last_active":"2023-10-06T02:56:05.465357+0000","last_peered":"2023-10-06T02:56:05.465357+0000","last_clean":"2023-10-06T02:56:05.465357+0000","last_became_active":"2023-10-06T02:56:05.456267+0000","last_became_peered":"2023-10-06T02:56:05.456267+0000","last_unstale":"2023-10-06T02:56:05.465357+0000","last_undegraded":"2023-10-06T02:56:05.465357+0000","last_fullsized":"2023-10-06T02:56:05.465357+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:15.089189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460277+0000","last_change":"2023-10-06T02:56:05.454514+0000","last_active":"2023-10-06T02:56:05.460277+0000","last_peered":"2023-10-06T02:56:05.460277+0000","last_clean":"2023-10-06T02:56:05.460277+0000","last_became_active":"2023-10-06T02:56:05.454261+0000","last_became_peered":"2023-10-06T02:56:05.454261+0000","last_unstale":"2023-10-06T02:56:05.460277+0000","last_undegraded":"2023-10-06T02:56:05.460277+0000","last_fullsized":"2023-10-06T02:56:05.460277+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:06.302171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460569+0000","last_change":"2023-10-06T02:56:05.454220+0000","last_active":"2023-10-06T02:56:05.460569+0000","last_peered":"2023-10-06T02:56:05.460569+0000","last_clean":"2023-10-06T02:56:05.460569+0000","last_became_active":"2023-10-06T02:56:05.453956+0000","last_became_peered":"2023-10-06T02:56:05.453956+0000","last_unstale":"2023-10-06T02:56:05.460569+0000","last_undegraded":"2023-10-06T02:56:05.460569+0000","last_fullsized":"2023-10-06T02:56:05.460569+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:09.964892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.459264+0000","last_change":"2023-10-06T02:56:05.451564+0000","last_active":"2023-10-06T02:56:05.459264+0000","last_peered":"2023-10-06T02:56:05.459264+0000","last_clean":"2023-10-06T02:56:05.459264+0000","last_became_active":"2023-10-06T02:56:05.451316+0000","last_became_peered":"2023-10-06T02:56:05.451316+0000","last_unstale":"2023-10-06T02:56:05.459264+0000","last_undegraded":"2023-10-06T02:56:05.459264+0000","last_fullsized":"2023-10-06T02:56:05.459264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:48.474003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.461064+0000","last_change":"2023-10-06T02:56:05.454598+0000","last_active":"2023-10-06T02:56:05.461064+0000","last_peered":"2023-10-06T02:56:05.461064+0000","last_clean":"2023-10-06T02:56:05.461064+0000","last_became_active":"2023-10-06T02:56:05.454388+0000","last_became_peered":"2023-10-06T02:56:05.454388+0000","last_unstale":"2023-10-06T02:56:05.461064+0000","last_undegraded":"2023-10-06T02:56:05.461064+0000","last_fullsized":"2023-10-06T02:56:05.461064+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:09.717385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.455371+0000","last_change":"2023-10-06T02:56:05.449945+0000","last_active":"2023-10-06T02:56:05.455371+0000","last_peered":"2023-10-06T02:56:05.455371+0000","last_clean":"2023-10-06T02:56:05.455371+0000","last_became_active":"2023-10-06T02:56:05.449653+0000","last_became_peered":"2023-10-06T02:56:05.449653+0000","last_unstale":"2023-10-06T02:56:05.455371+0000","last_undegraded":"2023-10-06T02:56:05.455371+0000","last_fullsized":"2023-10-06T02:56:05.455371+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.620098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.453243+0000","last_change":"2023-10-06T02:56:05.451331+0000","last_active":"2023-10-06T02:56:05.453243+0000","last_peered":"2023-10-06T02:56:05.453243+0000","last_clean":"2023-10-06T02:56:05.453243+0000","last_became_active":"2023-10-06T02:56:05.450935+0000","last_became_peered":"2023-10-06T02:56:05.450935+0000","last_unstale":"2023-10-06T02:56:05.453243+0000","last_undegraded":"2023-10-06T02:56:05.453243+0000","last_fullsized":"2023-10-06T02:56:05.453243+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:00.328446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.459171+0000","last_change":"2023-10-06T02:56:05.450273+0000","last_active":"2023-10-06T02:56:05.459171+0000","last_peered":"2023-10-06T02:56:05.459171+0000","last_clean":"2023-10-06T02:56:05.459171+0000","last_became_active":"2023-10-06T02:56:05.450023+0000","last_became_peered":"2023-10-06T02:56:05.450023+0000","last_unstale":"2023-10-06T02:56:05.459171+0000","last_undegraded":"2023-10-06T02:56:05.459171+0000","last_fullsized":"2023-10-06T02:56:05.459171+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:52.358479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460137+0000","last_change":"2023-10-06T02:56:05.456737+0000","last_active":"2023-10-06T02:56:05.460137+0000","last_peered":"2023-10-06T02:56:05.460137+0000","last_clean":"2023-10-06T02:56:05.460137+0000","last_became_active":"2023-10-06T02:56:05.456412+0000","last_became_peered":"2023-10-06T02:56:05.456412+0000","last_unstale":"2023-10-06T02:56:05.460137+0000","last_undegraded":"2023-10-06T02:56:05.460137+0000","last_fullsized":"2023-10-06T02:56:05.460137+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:58.215157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456840+0000","last_change":"2023-10-06T02:56:05.447806+0000","last_active":"2023-10-06T02:56:05.456840+0000","last_peered":"2023-10-06T02:56:05.456840+0000","last_clean":"2023-10-06T02:56:05.456840+0000","last_became_active":"2023-10-06T02:56:05.447208+0000","last_became_peered":"2023-10-06T02:56:05.447208+0000","last_unstale":"2023-10-06T02:56:05.456840+0000","last_undegraded":"2023-10-06T02:56:05.456840+0000","last_fullsized":"2023-10-06T02:56:05.456840+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.620098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.458389+0000","last_change":"2023-10-06T02:56:05.453471+0000","last_active":"2023-10-06T02:56:05.458389+0000","last_peered":"2023-10-06T02:56:05.458389+0000","last_clean":"2023-10-06T02:56:05.458389+0000","last_became_active":"2023-10-06T02:56:05.453206+0000","last_became_peered":"2023-10-06T02:56:05.453206+0000","last_unstale":"2023-10-06T02:56:05.458389+0000","last_undegraded":"2023-10-06T02:56:05.458389+0000","last_fullsized":"2023-10-06T02:56:05.458389+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:42.008814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.453926+0000","last_change":"2023-10-06T02:56:05.450221+0000","last_active":"2023-10-06T02:56:05.453926+0000","last_peered":"2023-10-06T02:56:05.453926+0000","last_clean":"2023-10-06T02:56:05.453926+0000","last_became_active":"2023-10-06T02:56:05.449701+0000","last_became_peered":"2023-10-06T02:56:05.449701+0000","last_unstale":"2023-10-06T02:56:05.453926+0000","last_undegraded":"2023-10-06T02:56:05.453926+0000","last_fullsized":"2023-10-06T02:56:05.453926+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:17.697117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460607+0000","last_change":"2023-10-06T02:56:04.445739+0000","last_active":"2023-10-06T02:56:05.460607+0000","last_peered":"2023-10-06T02:56:05.460607+0000","last_clean":"2023-10-06T02:56:05.460607+0000","last_became_active":"2023-10-06T02:56:04.445468+0000","last_became_peered":"2023-10-06T02:56:04.445468+0000","last_unstale":"2023-10-06T02:56:05.460607+0000","last_undegraded":"2023-10-06T02:56:05.460607+0000","last_fullsized":"2023-10-06T02:56:05.460607+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:36.828249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460184+0000","last_change":"2023-10-06T02:56:05.452712+0000","last_active":"2023-10-06T02:56:05.460184+0000","last_peered":"2023-10-06T02:56:05.460184+0000","last_clean":"2023-10-06T02:56:05.460184+0000","last_became_active":"2023-10-06T02:56:05.452226+0000","last_became_peered":"2023-10-06T02:56:05.452226+0000","last_unstale":"2023-10-06T02:56:05.460184+0000","last_undegraded":"2023-10-06T02:56:05.460184+0000","last_fullsized":"2023-10-06T02:56:05.460184+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:34.453214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460415+0000","last_change":"2023-10-06T02:56:04.444642+0000","last_active":"2023-10-06T02:56:05.460415+0000","last_peered":"2023-10-06T02:56:05.460415+0000","last_clean":"2023-10-06T02:56:05.460415+0000","last_became_active":"2023-10-06T02:56:04.444382+0000","last_became_peered":"2023-10-06T02:56:04.444382+0000","last_unstale":"2023-10-06T02:56:05.460415+0000","last_undegraded":"2023-10-06T02:56:05.460415+0000","last_fullsized":"2023-10-06T02:56:05.460415+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:10.170482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.459619+0000","last_change":"2023-10-06T02:56:05.456411+0000","last_active":"2023-10-06T02:56:05.459619+0000","last_peered":"2023-10-06T02:56:05.459619+0000","last_clean":"2023-10-06T02:56:05.459619+0000","last_became_active":"2023-10-06T02:56:05.456223+0000","last_became_peered":"2023-10-06T02:56:05.456223+0000","last_unstale":"2023-10-06T02:56:05.459619+0000","last_undegraded":"2023-10-06T02:56:05.459619+0000","last_fullsized":"2023-10-06T02:56:05.459619+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:45.610824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.458870+0000","last_change":"2023-10-06T02:56:04.443441+0000","last_active":"2023-10-06T02:56:05.458870+0000","last_peered":"2023-10-06T02:56:05.458870+0000","last_clean":"2023-10-06T02:56:05.458870+0000","last_became_active":"2023-10-06T02:56:04.443226+0000","last_became_peered":"2023-10-06T02:56:04.443226+0000","last_unstale":"2023-10-06T02:56:05.458870+0000","last_undegraded":"2023-10-06T02:56:05.458870+0000","last_fullsized":"2023-10-06T02:56:05.458870+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:33.447750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.451043+0000","last_change":"2023-10-06T02:56:05.446068+0000","last_active":"2023-10-06T02:56:05.451043+0000","last_peered":"2023-10-06T02:56:05.451043+0000","last_clean":"2023-10-06T02:56:05.451043+0000","last_became_active":"2023-10-06T02:56:05.445820+0000","last_became_peered":"2023-10-06T02:56:05.445820+0000","last_unstale":"2023-10-06T02:56:05.451043+0000","last_undegraded":"2023-10-06T02:56:05.451043+0000","last_fullsized":"2023-10-06T02:56:05.451043+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:04.667015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460310+0000","last_change":"2023-10-06T02:56:04.453825+0000","last_active":"2023-10-06T02:56:05.460310+0000","last_peered":"2023-10-06T02:56:05.460310+0000","last_clean":"2023-10-06T02:56:05.460310+0000","last_became_active":"2023-10-06T02:56:04.452516+0000","last_became_peered":"2023-10-06T02:56:04.452516+0000","last_unstale":"2023-10-06T02:56:05.460310+0000","last_undegraded":"2023-10-06T02:56:05.460310+0000","last_fullsized":"2023-10-06T02:56:05.460310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:36.828249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.457916+0000","last_change":"2023-10-06T02:56:05.451833+0000","last_active":"2023-10-06T02:56:05.457916+0000","last_peered":"2023-10-06T02:56:05.457916+0000","last_clean":"2023-10-06T02:56:05.457916+0000","last_became_active":"2023-10-06T02:56:05.451570+0000","last_became_peered":"2023-10-06T02:56:05.451570+0000","last_unstale":"2023-10-06T02:56:05.457916+0000","last_undegraded":"2023-10-06T02:56:05.457916+0000","last_fullsized":"2023-10-06T02:56:05.457916+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:19.367007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456724+0000","last_change":"2023-10-06T02:56:04.450111+0000","last_active":"2023-10-06T02:56:05.456724+0000","last_peered":"2023-10-06T02:56:05.456724+0000","last_clean":"2023-10-06T02:56:05.456724+0000","last_became_active":"2023-10-06T02:56:04.449858+0000","last_became_peered":"2023-10-06T02:56:04.449858+0000","last_unstale":"2023-10-06T02:56:05.456724+0000","last_undegraded":"2023-10-06T02:56:05.456724+0000","last_fullsized":"2023-10-06T02:56:05.456724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:50.329950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.455815+0000","last_change":"2023-10-06T02:56:05.448758+0000","last_active":"2023-10-06T02:56:05.455815+0000","last_peered":"2023-10-06T02:56:05.455815+0000","last_clean":"2023-10-06T02:56:05.455815+0000","last_became_active":"2023-10-06T02:56:05.448502+0000","last_became_peered":"2023-10-06T02:56:05.448502+0000","last_unstale":"2023-10-06T02:56:05.455815+0000","last_undegraded":"2023-10-06T02:56:05.455815+0000","last_fullsized":"2023-10-06T02:56:05.455815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:33.356271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.452926+0000","last_change":"2023-10-06T02:56:04.443566+0000","last_active":"2023-10-06T02:56:05.452926+0000","last_peered":"2023-10-06T02:56:05.452926+0000","last_clean":"2023-10-06T02:56:05.452926+0000","last_became_active":"2023-10-06T02:56:04.443291+0000","last_became_peered":"2023-10-06T02:56:04.443291+0000","last_unstale":"2023-10-06T02:56:05.452926+0000","last_undegraded":"2023-10-06T02:56:05.452926+0000","last_fullsized":"2023-10-06T02:56:05.452926+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:10.582786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.465395+0000","last_change":"2023-10-06T02:56:05.457019+0000","last_active":"2023-10-06T02:56:05.465395+0000","last_peered":"2023-10-06T02:56:05.465395+0000","last_clean":"2023-10-06T02:56:05.465395+0000","last_became_active":"2023-10-06T02:56:05.456320+0000","last_became_peered":"2023-10-06T02:56:05.456320+0000","last_unstale":"2023-10-06T02:56:05.465395+0000","last_undegraded":"2023-10-06T02:56:05.465395+0000","last_fullsized":"2023-10-06T02:56:05.465395+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:38.869880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.440023+0000","last_change":"2023-10-06T02:56:04.444560+0000","last_active":"2023-10-06T02:56:05.440023+0000","last_peered":"2023-10-06T02:56:05.440023+0000","last_clean":"2023-10-06T02:56:05.440023+0000","last_became_active":"2023-10-06T02:56:04.444178+0000","last_became_peered":"2023-10-06T02:56:04.444178+0000","last_unstale":"2023-10-06T02:56:05.440023+0000","last_undegraded":"2023-10-06T02:56:05.440023+0000","last_fullsized":"2023-10-06T02:56:05.440023+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:39.006302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460263+0000","last_change":"2023-10-06T02:56:05.454507+0000","last_active":"2023-10-06T02:56:05.460263+0000","last_peered":"2023-10-06T02:56:05.460263+0000","last_clean":"2023-10-06T02:56:05.460263+0000","last_became_active":"2023-10-06T02:56:05.453933+0000","last_became_peered":"2023-10-06T02:56:05.453933+0000","last_unstale":"2023-10-06T02:56:05.460263+0000","last_undegraded":"2023-10-06T02:56:05.460263+0000","last_fullsized":"2023-10-06T02:56:05.460263+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:42.008814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.443713+0000","last_change":"2023-10-06T02:56:04.444367+0000","last_active":"2023-10-06T02:56:05.443713+0000","last_peered":"2023-10-06T02:56:05.443713+0000","last_clean":"2023-10-06T02:56:05.443713+0000","last_became_active":"2023-10-06T02:56:04.444117+0000","last_became_peered":"2023-10-06T02:56:04.444117+0000","last_unstale":"2023-10-06T02:56:05.443713+0000","last_undegraded":"2023-10-06T02:56:05.443713+0000","last_fullsized":"2023-10-06T02:56:05.443713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:16.691652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.458057+0000","last_change":"2023-10-06T02:56:05.454299+0000","last_active":"2023-10-06T02:56:05.458057+0000","last_peered":"2023-10-06T02:56:05.458057+0000","last_clean":"2023-10-06T02:56:05.458057+0000","last_became_active":"2023-10-06T02:56:05.454038+0000","last_became_peered":"2023-10-06T02:56:05.454038+0000","last_unstale":"2023-10-06T02:56:05.458057+0000","last_undegraded":"2023-10-06T02:56:05.458057+0000","last_fullsized":"2023-10-06T02:56:05.458057+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:20.630212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.445270+0000","last_change":"2023-10-06T02:56:04.446872+0000","last_active":"2023-10-06T02:56:05.445270+0000","last_peered":"2023-10-06T02:56:05.445270+0000","last_clean":"2023-10-06T02:56:05.445270+0000","last_became_active":"2023-10-06T02:56:04.446464+0000","last_became_peered":"2023-10-06T02:56:04.446464+0000","last_unstale":"2023-10-06T02:56:05.445270+0000","last_undegraded":"2023-10-06T02:56:05.445270+0000","last_fullsized":"2023-10-06T02:56:05.445270+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:59.322982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.448342+0000","last_change":"2023-10-06T02:56:05.442200+0000","last_active":"2023-10-06T02:56:05.448342+0000","last_peered":"2023-10-06T02:56:05.448342+0000","last_clean":"2023-10-06T02:56:05.448342+0000","last_became_active":"2023-10-06T02:56:05.441919+0000","last_became_peered":"2023-10-06T02:56:05.441919+0000","last_unstale":"2023-10-06T02:56:05.448342+0000","last_undegraded":"2023-10-06T02:56:05.448342+0000","last_fullsized":"2023-10-06T02:56:05.448342+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:48.706011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.444228+0000","last_change":"2023-10-06T02:56:04.452911+0000","last_active":"2023-10-06T02:56:05.444228+0000","last_peered":"2023-10-06T02:56:05.444228+0000","last_clean":"2023-10-06T02:56:05.444228+0000","last_became_active":"2023-10-06T02:56:04.452729+0000","last_became_peered":"2023-10-06T02:56:04.452729+0000","last_unstale":"2023-10-06T02:56:05.444228+0000","last_undegraded":"2023-10-06T02:56:05.444228+0000","last_fullsized":"2023-10-06T02:56:05.444228+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:41.003350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.457015+0000","last_change":"2023-10-06T02:56:05.450887+0000","last_active":"2023-10-06T02:56:05.457015+0000","last_peered":"2023-10-06T02:56:05.457015+0000","last_clean":"2023-10-06T02:56:05.457015+0000","last_became_active":"2023-10-06T02:56:05.450622+0000","last_became_peered":"2023-10-06T02:56:05.450622+0000","last_unstale":"2023-10-06T02:56:05.457015+0000","last_undegraded":"2023-10-06T02:56:05.457015+0000","last_fullsized":"2023-10-06T02:56:05.457015+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:38.869880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.463305+0000","last_change":"2023-10-06T02:56:04.453713+0000","last_active":"2023-10-06T02:56:05.463305+0000","last_peered":"2023-10-06T02:56:05.463305+0000","last_clean":"2023-10-06T02:56:05.463305+0000","last_became_active":"2023-10-06T02:56:04.453478+0000","last_became_peered":"2023-10-06T02:56:04.453478+0000","last_unstale":"2023-10-06T02:56:05.463305+0000","last_undegraded":"2023-10-06T02:56:05.463305+0000","last_fullsized":"2023-10-06T02:56:05.463305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:44.605360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.448472+0000","last_change":"2023-10-06T02:56:05.443268+0000","last_active":"2023-10-06T02:56:05.448472+0000","last_peered":"2023-10-06T02:56:05.448472+0000","last_clean":"2023-10-06T02:56:05.448472+0000","last_became_active":"2023-10-06T02:56:05.442985+0000","last_became_peered":"2023-10-06T02:56:05.442985+0000","last_unstale":"2023-10-06T02:56:05.448472+0000","last_undegraded":"2023-10-06T02:56:05.448472+0000","last_fullsized":"2023-10-06T02:56:05.448472+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:01.878841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.464114+0000","last_change":"2023-10-06T02:56:04.447017+0000","last_active":"2023-10-06T02:56:05.464114+0000","last_peered":"2023-10-06T02:56:05.464114+0000","last_clean":"2023-10-06T02:56:05.464114+0000","last_became_active":"2023-10-06T02:56:04.446747+0000","last_became_peered":"2023-10-06T02:56:04.446747+0000","last_unstale":"2023-10-06T02:56:05.464114+0000","last_undegraded":"2023-10-06T02:56:05.464114+0000","last_fullsized":"2023-10-06T02:56:05.464114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:39.479934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460480+0000","last_change":"2023-10-06T02:56:05.452093+0000","last_active":"2023-10-06T02:56:05.460480+0000","last_peered":"2023-10-06T02:56:05.460480+0000","last_clean":"2023-10-06T02:56:05.460480+0000","last_became_active":"2023-10-06T02:56:05.451031+0000","last_became_peered":"2023-10-06T02:56:05.451031+0000","last_unstale":"2023-10-06T02:56:05.460480+0000","last_undegraded":"2023-10-06T02:56:05.460480+0000","last_fullsized":"2023-10-06T02:56:05.460480+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:26.912058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.457095+0000","last_change":"2023-10-06T02:56:04.448793+0000","last_active":"2023-10-06T02:56:05.457095+0000","last_peered":"2023-10-06T02:56:05.457095+0000","last_clean":"2023-10-06T02:56:05.457095+0000","last_became_active":"2023-10-06T02:56:04.448528+0000","last_became_peered":"2023-10-06T02:56:04.448528+0000","last_unstale":"2023-10-06T02:56:05.457095+0000","last_undegraded":"2023-10-06T02:56:05.457095+0000","last_fullsized":"2023-10-06T02:56:05.457095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:10.170482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456136+0000","last_change":"2023-10-06T02:56:05.450006+0000","last_active":"2023-10-06T02:56:05.456136+0000","last_peered":"2023-10-06T02:56:05.456136+0000","last_clean":"2023-10-06T02:56:05.456136+0000","last_became_active":"2023-10-06T02:56:05.449665+0000","last_became_peered":"2023-10-06T02:56:05.449665+0000","last_unstale":"2023-10-06T02:56:05.456136+0000","last_undegraded":"2023-10-06T02:56:05.456136+0000","last_fullsized":"2023-10-06T02:56:05.456136+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:58.215157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.434062+0000","last_change":"2023-10-06T02:56:04.453272+0000","last_active":"2023-10-06T02:56:05.434062+0000","last_peered":"2023-10-06T02:56:05.434062+0000","last_clean":"2023-10-06T02:56:05.434062+0000","last_became_active":"2023-10-06T02:56:04.452977+0000","last_became_peered":"2023-10-06T02:56:04.452977+0000","last_unstale":"2023-10-06T02:56:05.434062+0000","last_undegraded":"2023-10-06T02:56:05.434062+0000","last_fullsized":"2023-10-06T02:56:05.434062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:36.725130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.457882+0000","last_change":"2023-10-06T02:56:05.449039+0000","last_active":"2023-10-06T02:56:05.457882+0000","last_peered":"2023-10-06T02:56:05.457882+0000","last_clean":"2023-10-06T02:56:05.457882+0000","last_became_active":"2023-10-06T02:56:05.448785+0000","last_became_peered":"2023-10-06T02:56:05.448785+0000","last_unstale":"2023-10-06T02:56:05.457882+0000","last_undegraded":"2023-10-06T02:56:05.457882+0000","last_fullsized":"2023-10-06T02:56:05.457882+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:08.899225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.436768+0000","last_change":"2023-10-06T02:56:04.448740+0000","last_active":"2023-10-06T02:56:05.436768+0000","last_peered":"2023-10-06T02:56:05.436768+0000","last_clean":"2023-10-06T02:56:05.436768+0000","last_became_active":"2023-10-06T02:56:04.448492+0000","last_became_peered":"2023-10-06T02:56:04.448492+0000","last_unstale":"2023-10-06T02:56:05.436768+0000","last_undegraded":"2023-10-06T02:56:05.436768+0000","last_fullsized":"2023-10-06T02:56:05.436768+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:36.725130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.453193+0000","last_change":"2023-10-06T02:56:05.447316+0000","last_active":"2023-10-06T02:56:05.453193+0000","last_peered":"2023-10-06T02:56:05.453193+0000","last_clean":"2023-10-06T02:56:05.453193+0000","last_became_active":"2023-10-06T02:56:05.447056+0000","last_became_peered":"2023-10-06T02:56:05.447056+0000","last_unstale":"2023-10-06T02:56:05.453193+0000","last_undegraded":"2023-10-06T02:56:05.453193+0000","last_fullsized":"2023-10-06T02:56:05.453193+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:21.290881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.461534+0000","last_change":"2023-10-06T02:56:04.446930+0000","last_active":"2023-10-06T02:56:05.461534+0000","last_peered":"2023-10-06T02:56:05.461534+0000","last_clean":"2023-10-06T02:56:05.461534+0000","last_became_active":"2023-10-06T02:56:04.446564+0000","last_became_peered":"2023-10-06T02:56:04.446564+0000","last_unstale":"2023-10-06T02:56:05.461534+0000","last_undegraded":"2023-10-06T02:56:05.461534+0000","last_fullsized":"2023-10-06T02:56:05.461534+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:08.711921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.458447+0000","last_change":"2023-10-06T02:56:05.448358+0000","last_active":"2023-10-06T02:56:05.458447+0000","last_peered":"2023-10-06T02:56:05.458447+0000","last_clean":"2023-10-06T02:56:05.458447+0000","last_became_active":"2023-10-06T02:56:05.447917+0000","last_became_peered":"2023-10-06T02:56:05.447917+0000","last_unstale":"2023-10-06T02:56:05.458447+0000","last_undegraded":"2023-10-06T02:56:05.458447+0000","last_fullsized":"2023-10-06T02:56:05.458447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:06.302171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.457659+0000","last_change":"2023-10-06T02:56:04.442385+0000","last_active":"2023-10-06T02:56:05.457659+0000","last_peered":"2023-10-06T02:56:05.457659+0000","last_clean":"2023-10-06T02:56:05.457659+0000","last_became_active":"2023-10-06T02:56:04.442142+0000","last_became_peered":"2023-10-06T02:56:04.442142+0000","last_unstale":"2023-10-06T02:56:05.457659+0000","last_undegraded":"2023-10-06T02:56:05.457659+0000","last_fullsized":"2023-10-06T02:56:05.457659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:34.895836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.458762+0000","last_change":"2023-10-06T02:56:05.454376+0000","last_active":"2023-10-06T02:56:05.458762+0000","last_peered":"2023-10-06T02:56:05.458762+0000","last_clean":"2023-10-06T02:56:05.458762+0000","last_became_active":"2023-10-06T02:56:05.454151+0000","last_became_peered":"2023-10-06T02:56:05.454151+0000","last_unstale":"2023-10-06T02:56:05.458762+0000","last_undegraded":"2023-10-06T02:56:05.458762+0000","last_fullsized":"2023-10-06T02:56:05.458762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:21.290881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.454819+0000","last_change":"2023-10-06T02:56:04.444103+0000","last_active":"2023-10-06T02:56:05.454819+0000","last_peered":"2023-10-06T02:56:05.454819+0000","last_clean":"2023-10-06T02:56:05.454819+0000","last_became_active":"2023-10-06T02:56:04.443838+0000","last_became_peered":"2023-10-06T02:56:04.443838+0000","last_unstale":"2023-10-06T02:56:05.454819+0000","last_undegraded":"2023-10-06T02:56:05.454819+0000","last_fullsized":"2023-10-06T02:56:05.454819+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:36.725130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460332+0000","last_change":"2023-10-06T02:56:05.456532+0000","last_active":"2023-10-06T02:56:05.460332+0000","last_peered":"2023-10-06T02:56:05.460332+0000","last_clean":"2023-10-06T02:56:05.460332+0000","last_became_active":"2023-10-06T02:56:05.456275+0000","last_became_peered":"2023-10-06T02:56:05.456275+0000","last_unstale":"2023-10-06T02:56:05.460332+0000","last_undegraded":"2023-10-06T02:56:05.460332+0000","last_fullsized":"2023-10-06T02:56:05.460332+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:08:40.485398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456999+0000","last_change":"2023-10-06T02:56:04.443585+0000","last_active":"2023-10-06T02:56:05.456999+0000","last_peered":"2023-10-06T02:56:05.456999+0000","last_clean":"2023-10-06T02:56:05.456999+0000","last_became_active":"2023-10-06T02:56:04.443310+0000","last_became_peered":"2023-10-06T02:56:04.443310+0000","last_unstale":"2023-10-06T02:56:05.456999+0000","last_undegraded":"2023-10-06T02:56:05.456999+0000","last_fullsized":"2023-10-06T02:56:05.456999+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:41.003350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.459220+0000","last_change":"2023-10-06T02:56:05.450719+0000","last_active":"2023-10-06T02:56:05.459220+0000","last_peered":"2023-10-06T02:56:05.459220+0000","last_clean":"2023-10-06T02:56:05.459220+0000","last_became_active":"2023-10-06T02:56:05.450218+0000","last_became_peered":"2023-10-06T02:56:05.450218+0000","last_unstale":"2023-10-06T02:56:05.459220+0000","last_undegraded":"2023-10-06T02:56:05.459220+0000","last_fullsized":"2023-10-06T02:56:05.459220+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:41.716634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.436731+0000","last_change":"2023-10-06T02:56:04.435737+0000","last_active":"2023-10-06T02:56:05.436731+0000","last_peered":"2023-10-06T02:56:05.436731+0000","last_clean":"2023-10-06T02:56:05.436731+0000","last_became_active":"2023-10-06T02:56:04.435484+0000","last_became_peered":"2023-10-06T02:56:04.435484+0000","last_unstale":"2023-10-06T02:56:05.436731+0000","last_undegraded":"2023-10-06T02:56:05.436731+0000","last_fullsized":"2023-10-06T02:56:05.436731+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:16.691652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456796+0000","last_change":"2023-10-06T02:56:05.448187+0000","last_active":"2023-10-06T02:56:05.456796+0000","last_peered":"2023-10-06T02:56:05.456796+0000","last_clean":"2023-10-06T02:56:05.456796+0000","last_became_active":"2023-10-06T02:56:05.447953+0000","last_became_peered":"2023-10-06T02:56:05.447953+0000","last_unstale":"2023-10-06T02:56:05.456796+0000","last_undegraded":"2023-10-06T02:56:05.456796+0000","last_fullsized":"2023-10-06T02:56:05.456796+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:20.630212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456820+0000","last_change":"2023-10-06T02:56:04.449958+0000","last_active":"2023-10-06T02:56:05.456820+0000","last_peered":"2023-10-06T02:56:05.456820+0000","last_clean":"2023-10-06T02:56:05.456820+0000","last_became_active":"2023-10-06T02:56:04.449771+0000","last_became_peered":"2023-10-06T02:56:04.449771+0000","last_unstale":"2023-10-06T02:56:05.456820+0000","last_undegraded":"2023-10-06T02:56:05.456820+0000","last_fullsized":"2023-10-06T02:56:05.456820+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:26.196575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.451184+0000","last_change":"2023-10-06T02:56:05.444653+0000","last_active":"2023-10-06T02:56:05.451184+0000","last_peered":"2023-10-06T02:56:05.451184+0000","last_clean":"2023-10-06T02:56:05.451184+0000","last_became_active":"2023-10-06T02:56:05.444408+0000","last_became_peered":"2023-10-06T02:56:05.444408+0000","last_unstale":"2023-10-06T02:56:05.451184+0000","last_undegraded":"2023-10-06T02:56:05.451184+0000","last_fullsized":"2023-10-06T02:56:05.451184+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:26:31.201367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.440065+0000","last_change":"2023-10-06T02:56:04.442816+0000","last_active":"2023-10-06T02:56:05.440065+0000","last_peered":"2023-10-06T02:56:05.440065+0000","last_clean":"2023-10-06T02:56:05.440065+0000","last_became_active":"2023-10-06T02:56:04.442524+0000","last_became_peered":"2023-10-06T02:56:04.442524+0000","last_unstale":"2023-10-06T02:56:05.440065+0000","last_undegraded":"2023-10-06T02:56:05.440065+0000","last_fullsized":"2023-10-06T02:56:05.440065+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:33.447750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.458369+0000","last_change":"2023-10-06T02:56:05.452172+0000","last_active":"2023-10-06T02:56:05.458369+0000","last_peered":"2023-10-06T02:56:05.458369+0000","last_clean":"2023-10-06T02:56:05.458369+0000","last_became_active":"2023-10-06T02:56:05.451896+0000","last_became_peered":"2023-10-06T02:56:05.451896+0000","last_unstale":"2023-10-06T02:56:05.458369+0000","last_undegraded":"2023-10-06T02:56:05.458369+0000","last_fullsized":"2023-10-06T02:56:05.458369+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:17.697117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.441289+0000","last_change":"2023-10-06T02:56:04.450063+0000","last_active":"2023-10-06T02:56:05.441289+0000","last_peered":"2023-10-06T02:56:05.441289+0000","last_clean":"2023-10-06T02:56:05.441289+0000","last_became_active":"2023-10-06T02:56:04.449802+0000","last_became_peered":"2023-10-06T02:56:04.449802+0000","last_unstale":"2023-10-06T02:56:05.441289+0000","last_undegraded":"2023-10-06T02:56:05.441289+0000","last_fullsized":"2023-10-06T02:56:05.441289+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:39.006302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.458907+0000","last_change":"2023-10-06T02:56:05.455230+0000","last_active":"2023-10-06T02:56:05.458907+0000","last_peered":"2023-10-06T02:56:05.458907+0000","last_clean":"2023-10-06T02:56:05.458907+0000","last_became_active":"2023-10-06T02:56:05.454988+0000","last_became_peered":"2023-10-06T02:56:05.454988+0000","last_unstale":"2023-10-06T02:56:05.458907+0000","last_undegraded":"2023-10-06T02:56:05.458907+0000","last_fullsized":"2023-10-06T02:56:05.458907+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:20.630212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.434017+0000","last_change":"2023-10-06T02:56:04.454132+0000","last_active":"2023-10-06T02:56:05.434017+0000","last_peered":"2023-10-06T02:56:05.434017+0000","last_clean":"2023-10-06T02:56:05.434017+0000","last_became_active":"2023-10-06T02:56:04.453862+0000","last_became_peered":"2023-10-06T02:56:04.453862+0000","last_unstale":"2023-10-06T02:56:05.434017+0000","last_undegraded":"2023-10-06T02:56:05.434017+0000","last_fullsized":"2023-10-06T02:56:05.434017+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:10.170482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.457960+0000","last_change":"2023-10-06T02:56:05.454135+0000","last_active":"2023-10-06T02:56:05.457960+0000","last_peered":"2023-10-06T02:56:05.457960+0000","last_clean":"2023-10-06T02:56:05.457960+0000","last_became_active":"2023-10-06T02:56:05.453848+0000","last_became_peered":"2023-10-06T02:56:05.453848+0000","last_unstale":"2023-10-06T02:56:05.457960+0000","last_undegraded":"2023-10-06T02:56:05.457960+0000","last_fullsized":"2023-10-06T02:56:05.457960+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:33.356271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.443869+0000","last_change":"2023-10-06T02:56:04.446361+0000","last_active":"2023-10-06T02:56:05.443869+0000","last_peered":"2023-10-06T02:56:05.443869+0000","last_clean":"2023-10-06T02:56:05.443869+0000","last_became_active":"2023-10-06T02:56:04.446123+0000","last_became_peered":"2023-10-06T02:56:04.446123+0000","last_unstale":"2023-10-06T02:56:05.443869+0000","last_undegraded":"2023-10-06T02:56:05.443869+0000","last_fullsized":"2023-10-06T02:56:05.443869+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:05.296707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.433193+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:56:05.433193+0000","last_peered":"2023-10-06T02:56:05.433193+0000","last_clean":"2023-10-06T02:56:05.433193+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:56:05.433193+0000","last_undegraded":"2023-10-06T02:56:05.433193+0000","last_fullsized":"2023-10-06T02:56:05.433193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.460238+0000","last_change":"2023-10-06T02:56:05.456627+0000","last_active":"2023-10-06T02:56:05.460238+0000","last_peered":"2023-10-06T02:56:05.460238+0000","last_clean":"2023-10-06T02:56:05.460238+0000","last_became_active":"2023-10-06T02:56:05.456394+0000","last_became_peered":"2023-10-06T02:56:05.456394+0000","last_unstale":"2023-10-06T02:56:05.460238+0000","last_undegraded":"2023-10-06T02:56:05.460238+0000","last_fullsized":"2023-10-06T02:56:05.460238+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:40.011766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-06T02:56:06.563500+0000","last_change":"2023-10-06T02:56:04.445118+0000","last_active":"2023-10-06T02:56:06.563500+0000","last_peered":"2023-10-06T02:56:06.563500+0000","last_clean":"2023-10-06T02:56:06.563500+0000","last_became_active":"2023-10-06T02:56:04.444862+0000","last_became_peered":"2023-10-06T02:56:04.444862+0000","last_unstale":"2023-10-06T02:56:06.563500+0000","last_undegraded":"2023-10-06T02:56:06.563500+0000","last_fullsized":"2023-10-06T02:56:06.563500+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:34:44.605360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.440191+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:56:05.440191+0000","last_peered":"2023-10-06T02:56:05.440191+0000","last_clean":"2023-10-06T02:56:05.440191+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:56:05.440191+0000","last_undegraded":"2023-10-06T02:56:05.440191+0000","last_fullsized":"2023-10-06T02:56:05.440191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456197+0000","last_change":"2023-10-06T02:56:05.451817+0000","last_active":"2023-10-06T02:56:05.456197+0000","last_peered":"2023-10-06T02:56:05.456197+0000","last_clean":"2023-10-06T02:56:05.456197+0000","last_became_active":"2023-10-06T02:56:05.451555+0000","last_became_peered":"2023-10-06T02:56:05.451555+0000","last_unstale":"2023-10-06T02:56:05.456197+0000","last_undegraded":"2023-10-06T02:56:05.456197+0000","last_fullsized":"2023-10-06T02:56:05.456197+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:01.878841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.435080+0000","last_change":"2023-10-06T02:56:04.453244+0000","last_active":"2023-10-06T02:56:05.435080+0000","last_peered":"2023-10-06T02:56:05.435080+0000","last_clean":"2023-10-06T02:56:05.435080+0000","last_became_active":"2023-10-06T02:56:04.452906+0000","last_became_peered":"2023-10-06T02:56:04.452906+0000","last_unstale":"2023-10-06T02:56:05.435080+0000","last_undegraded":"2023-10-06T02:56:05.435080+0000","last_fullsized":"2023-10-06T02:56:05.435080+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:50.329950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.438635+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:56:05.438635+0000","last_peered":"2023-10-06T02:56:05.438635+0000","last_clean":"2023-10-06T02:56:05.438635+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:56:05.438635+0000","last_undegraded":"2023-10-06T02:56:05.438635+0000","last_fullsized":"2023-10-06T02:56:05.438635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.459491+0000","last_change":"2023-10-06T02:56:05.455103+0000","last_active":"2023-10-06T02:56:05.459491+0000","last_peered":"2023-10-06T02:56:05.459491+0000","last_clean":"2023-10-06T02:56:05.459491+0000","last_became_active":"2023-10-06T02:56:05.454802+0000","last_became_peered":"2023-10-06T02:56:05.454802+0000","last_unstale":"2023-10-06T02:56:05.459491+0000","last_undegraded":"2023-10-06T02:56:05.459491+0000","last_fullsized":"2023-10-06T02:56:05.459491+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:34:08.899225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456751+0000","last_change":"2023-10-06T02:56:04.445198+0000","last_active":"2023-10-06T02:56:05.456751+0000","last_peered":"2023-10-06T02:56:05.456751+0000","last_clean":"2023-10-06T02:56:05.456751+0000","last_became_active":"2023-10-06T02:56:04.444966+0000","last_became_peered":"2023-10-06T02:56:04.444966+0000","last_unstale":"2023-10-06T02:56:05.456751+0000","last_undegraded":"2023-10-06T02:56:05.456751+0000","last_fullsized":"2023-10-06T02:56:05.456751+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:05.296707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.440520+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:56:05.440520+0000","last_peered":"2023-10-06T02:56:05.440520+0000","last_clean":"2023-10-06T02:56:05.440520+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:56:05.440520+0000","last_undegraded":"2023-10-06T02:56:05.440520+0000","last_fullsized":"2023-10-06T02:56:05.440520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.434004+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:56:05.434004+0000","last_peered":"2023-10-06T02:56:05.434004+0000","last_clean":"2023-10-06T02:56:05.434004+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:56:05.434004+0000","last_undegraded":"2023-10-06T02:56:05.434004+0000","last_fullsized":"2023-10-06T02:56:05.434004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.453391+0000","last_change":"2023-10-06T02:56:05.445960+0000","last_active":"2023-10-06T02:56:05.453391+0000","last_peered":"2023-10-06T02:56:05.453391+0000","last_clean":"2023-10-06T02:56:05.453391+0000","last_became_active":"2023-10-06T02:56:05.445661+0000","last_became_peered":"2023-10-06T02:56:05.445661+0000","last_unstale":"2023-10-06T02:56:05.453391+0000","last_undegraded":"2023-10-06T02:56:05.453391+0000","last_fullsized":"2023-10-06T02:56:05.453391+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:33.356271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.433191+0000","last_change":"2023-10-06T02:56:04.444766+0000","last_active":"2023-10-06T02:56:05.433191+0000","last_peered":"2023-10-06T02:56:05.433191+0000","last_clean":"2023-10-06T02:56:05.433191+0000","last_became_active":"2023-10-06T02:56:04.444514+0000","last_became_peered":"2023-10-06T02:56:04.444514+0000","last_unstale":"2023-10-06T02:56:05.433191+0000","last_undegraded":"2023-10-06T02:56:05.433191+0000","last_fullsized":"2023-10-06T02:56:05.433191+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:08.959428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.434145+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:56:05.434145+0000","last_peered":"2023-10-06T02:56:05.434145+0000","last_clean":"2023-10-06T02:56:05.434145+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:56:05.434145+0000","last_undegraded":"2023-10-06T02:56:05.434145+0000","last_fullsized":"2023-10-06T02:56:05.434145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.458315+0000","last_change":"2023-10-06T02:56:05.452160+0000","last_active":"2023-10-06T02:56:05.458315+0000","last_peered":"2023-10-06T02:56:05.458315+0000","last_clean":"2023-10-06T02:56:05.458315+0000","last_became_active":"2023-10-06T02:56:05.451878+0000","last_became_peered":"2023-10-06T02:56:05.451878+0000","last_unstale":"2023-10-06T02:56:05.458315+0000","last_undegraded":"2023-10-06T02:56:05.458315+0000","last_fullsized":"2023-10-06T02:56:05.458315+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:11.175946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.433099+0000","last_change":"2023-10-06T02:56:04.442487+0000","last_active":"2023-10-06T02:56:05.433099+0000","last_peered":"2023-10-06T02:56:05.433099+0000","last_clean":"2023-10-06T02:56:05.433099+0000","last_became_active":"2023-10-06T02:56:04.442223+0000","last_became_peered":"2023-10-06T02:56:04.442223+0000","last_unstale":"2023-10-06T02:56:05.433099+0000","last_undegraded":"2023-10-06T02:56:05.433099+0000","last_fullsized":"2023-10-06T02:56:05.433099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:25.906594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.435144+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:56:05.435144+0000","last_peered":"2023-10-06T02:56:05.435144+0000","last_clean":"2023-10-06T02:56:05.435144+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:56:05.435144+0000","last_undegraded":"2023-10-06T02:56:05.435144+0000","last_fullsized":"2023-10-06T02:56:05.435144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.453500+0000","last_change":"2023-10-06T02:56:05.444648+0000","last_active":"2023-10-06T02:56:05.453500+0000","last_peered":"2023-10-06T02:56:05.453500+0000","last_clean":"2023-10-06T02:56:05.453500+0000","last_became_active":"2023-10-06T02:56:05.444382+0000","last_became_peered":"2023-10-06T02:56:05.444382+0000","last_unstale":"2023-10-06T02:56:05.453500+0000","last_undegraded":"2023-10-06T02:56:05.453500+0000","last_fullsized":"2023-10-06T02:56:05.453500+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:43.779090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.445275+0000","last_change":"2023-10-06T02:56:04.447069+0000","last_active":"2023-10-06T02:56:05.445275+0000","last_peered":"2023-10-06T02:56:05.445275+0000","last_clean":"2023-10-06T02:56:05.445275+0000","last_became_active":"2023-10-06T02:56:04.446794+0000","last_became_peered":"2023-10-06T02:56:04.446794+0000","last_unstale":"2023-10-06T02:56:05.445275+0000","last_undegraded":"2023-10-06T02:56:05.445275+0000","last_fullsized":"2023-10-06T02:56:05.445275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:43.894727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.433385+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:56:05.433385+0000","last_peered":"2023-10-06T02:56:05.433385+0000","last_clean":"2023-10-06T02:56:05.433385+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:56:05.433385+0000","last_undegraded":"2023-10-06T02:56:05.433385+0000","last_fullsized":"2023-10-06T02:56:05.433385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.456817+0000","last_change":"2023-10-06T02:56:05.450750+0000","last_active":"2023-10-06T02:56:05.456817+0000","last_peered":"2023-10-06T02:56:05.456817+0000","last_clean":"2023-10-06T02:56:05.456817+0000","last_became_active":"2023-10-06T02:56:05.450500+0000","last_became_peered":"2023-10-06T02:56:05.450500+0000","last_unstale":"2023-10-06T02:56:05.456817+0000","last_undegraded":"2023-10-06T02:56:05.456817+0000","last_fullsized":"2023-10-06T02:56:05.456817+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:04.423849+0000","last_clean_scrub_stamp":"2023-10-06T02:56:04.423849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:15.089189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.434206+0000","last_change":"2023-10-06T02:56:04.454279+0000","last_active":"2023-10-06T02:56:05.434206+0000","last_peered":"2023-10-06T02:56:05.434206+0000","last_clean":"2023-10-06T02:56:05.434206+0000","last_became_active":"2023-10-06T02:56:04.453912+0000","last_became_peered":"2023-10-06T02:56:04.453912+0000","last_unstale":"2023-10-06T02:56:05.434206+0000","last_undegraded":"2023-10-06T02:56:05.434206+0000","last_fullsized":"2023-10-06T02:56:05.434206+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:56:03.418385+0000","last_clean_scrub_stamp":"2023-10-06T02:56:03.418385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:26.196575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T02:56:05.438620+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:56:05.438620+0000","last_peered":"2023-10-06T02:56:05.438620+0000","last_clean":"2023-10-06T02:56:05.438620+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:56:05.438620+0000","last_undegraded":"2023-10-06T02:56:05.438620+0000","last_fullsized":"2023-10-06T02:56:05.438620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298348,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073492,"statfs":{"total":96636764160,"available":96331255808,"internally_reserved":0,"allocated":1085440,"data_stored":808552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.504},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.435},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.624}]},{"osd":4,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.68400000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":218738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.577,"5min":3.577,"15min":3.577},"last":0.622},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:55:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":217153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.27900000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":21.193999999999999,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.37},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.433},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":21.135000000000002,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":21.085000000000001,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.50800000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":21.166,"5min":21.166,"15min":21.166},"last":0.49399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298344,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073496,"statfs":{"total":96636764160,"available":96331259904,"internally_reserved":0,"allocated":1081344,"data_stored":807485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.247},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"last":0.31}]},{"osd":2,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.26800000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":219652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.40300000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297772,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074068,"statfs":{"total":96636764160,"available":96331845632,"internally_reserved":0,"allocated":495616,"data_stored":217693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.31}]},{"osd":1,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.505},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297776,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074064,"statfs":{"total":96636764160,"available":96331841536,"internally_reserved":0,"allocated":499712,"data_stored":219630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.626},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42899999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":218164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.62},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.57799999999999996}]},{"osd":4,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.73599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:56:09.879 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:56:09.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:56:10.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.032+0000 7ff54f285700 1 Processor -- start 2023-10-06T02:56:10.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.032+0000 7ff54f285700 1 -- start start 2023-10-06T02:56:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54f285700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480b2660 0x7ff5480cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54f285700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480cc9b0 con 0x7ff5480cf1f0 2023-10-06T02:56:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54f285700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480cbda0 con 0x7ff5480b2a30 2023-10-06T02:56:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54f285700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480cc080 con 0x7ff5480b2660 2023-10-06T02:56:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54ea84700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff5480cf1f0 0x7ff5480c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56994/0 (socket says 172.21.15.84:56994) 2023-10-06T02:56:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54ea84700 1 -- 172.21.15.84:0/4092520088 learned_addr learned my addr 172.21.15.84:0/4092520088 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54e283700 1 --2- 172.21.15.84:0/4092520088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480b2660 0x7ff5480cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54d281700 1 -- 172.21.15.84:0/4092520088 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4837078 0 0) 0x7ff5480cc9b0 con 0x7ff5480cf1f0 2023-10-06T02:56:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54d281700 1 -- 172.21.15.84:0/4092520088 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff534003570 con 0x7ff5480cf1f0 2023-10-06T02:56:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54d281700 1 -- 172.21.15.84:0/4092520088 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730626080 0 0) 0x7ff5480cbda0 con 0x7ff5480b2a30 2023-10-06T02:56:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54d281700 1 -- 172.21.15.84:0/4092520088 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5480cc9b0 con 0x7ff5480b2a30 2023-10-06T02:56:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54e283700 1 -- 172.21.15.84:0/4092520088 >> v1:172.21.15.131:6789/0 conn(0x7ff5480b2a30 legacy=0x7ff5480ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54e283700 1 -- 172.21.15.84:0/4092520088 >> v1:172.21.15.84:6789/0 conn(0x7ff5480cf1f0 legacy=0x7ff5480c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.033+0000 7ff54d281700 1 -- 172.21.15.84:0/4092520088 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895302229 0 0) 0x7ff534003570 con 0x7ff5480cf1f0 2023-10-06T02:56:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.034+0000 7ff54e283700 1 -- 172.21.15.84:0/4092520088 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480cc360 con 0x7ff5480b2660 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.034+0000 7ff54e283700 1 --2- 172.21.15.84:0/4092520088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480b2660 0x7ff5480cccf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff544009900 tx=0x7ff544009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d72b663967de6652 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.034+0000 7ff54d281700 1 -- 172.21.15.84:0/4092520088 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5400017f0 con 0x7ff5480b2660 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.034+0000 7ff54d281700 1 -- 172.21.15.84:0/4092520088 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff544011420 con 0x7ff5480b2660 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.034+0000 7ff54d281700 1 -- 172.21.15.84:0/4092520088 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440117c0 con 0x7ff5480b2660 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.034+0000 7ff54f285700 1 -- 172.21.15.84:0/4092520088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480b2660 msgr2=0x7ff5480cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.034+0000 7ff54f285700 1 --2- 172.21.15.84:0/4092520088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480b2660 0x7ff5480cccf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff544009900 tx=0x7ff544009120 comp rx=0 tx=0).stop 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.035+0000 7ff54f285700 1 -- 172.21.15.84:0/4092520088 shutdown_connections 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.035+0000 7ff54f285700 1 --2- 172.21.15.84:0/4092520088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480b2660 0x7ff5480cccf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.035+0000 7ff54f285700 1 -- 172.21.15.84:0/4092520088 >> 172.21.15.84:0/4092520088 conn(0x7ff548099560 msgr2=0x7ff54806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.035+0000 7ff54f285700 1 -- 172.21.15.84:0/4092520088 shutdown_connections 2023-10-06T02:56:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.035+0000 7ff54f285700 1 -- 172.21.15.84:0/4092520088 wait complete. 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54f285700 1 Processor -- start 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54f285700 1 -- start start 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54f285700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480b2660 0x7ff5481570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54f285700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5480b2a30 0x7ff54815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54f285700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480cf1f0 0x7ff5480c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54f285700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548159c00 con 0x7ff5480b2660 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54f285700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54815a4a0 con 0x7ff5480b2a30 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54f285700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54815c7a0 con 0x7ff5480cf1f0 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54e283700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480b2660 0x7ff5481570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54e283700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480b2660 0x7ff5481570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56652/0 (socket says 172.21.15.84:56652) 2023-10-06T02:56:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.036+0000 7ff54e283700 1 -- 172.21.15.84:0/2890639932 learned_addr learned my addr 172.21.15.84:0/2890639932 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54ea84700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480cf1f0 0x7ff5480c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54da82700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5480b2a30 0x7ff54815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54e283700 1 -- 172.21.15.84:0/2890639932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480cf1f0 msgr2=0x7ff5480c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54e283700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480cf1f0 0x7ff5480c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54e283700 1 -- 172.21.15.84:0/2890639932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5480b2a30 msgr2=0x7ff54815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54e283700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5480b2a30 0x7ff54815be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54e283700 1 -- 172.21.15.84:0/2890639932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440093c0 con 0x7ff5480b2660 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54da82700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5480b2a30 0x7ff54815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54e283700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480b2660 0x7ff5481570b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff54806fd00 tx=0x7ff544016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff53e7fc700 1 -- 172.21.15.84:0/2890639932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54401cbe0 con 0x7ff5480b2660 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff53e7fc700 1 -- 172.21.15.84:0/2890639932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54401cd80 con 0x7ff5480b2660 2023-10-06T02:56:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff548159e50 con 0x7ff5480b2660 2023-10-06T02:56:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff53e7fc700 1 -- 172.21.15.84:0/2890639932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54401a6a0 con 0x7ff5480b2660 2023-10-06T02:56:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.037+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54809adf0 con 0x7ff5480b2660 2023-10-06T02:56:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.038+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54805f270 con 0x7ff5480b2660 2023-10-06T02:56:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.038+0000 7ff53e7fc700 1 -- 172.21.15.84:0/2890639932 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff54401aad0 con 0x7ff5480b2660 2023-10-06T02:56:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.039+0000 7ff53e7fc700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.039+0000 7ff53e7fc700 1 -- 172.21.15.84:0/2890639932 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff544085ff0 con 0x7ff5480b2660 2023-10-06T02:56:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.039+0000 7ff54da82700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.039+0000 7ff54da82700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff54809abe0 tx=0x7ff538009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.043+0000 7ff53e7fc700 1 -- 172.21.15.84:0/2890639932 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff544053070 con 0x7ff5480b2660 2023-10-06T02:56:10.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.300+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff5480cc640 con 0x7ff5480b2660 2023-10-06T02:56:10.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.303+0000 7ff53e7fc700 1 -- 172.21.15.84:0/2890639932 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff544056690 con 0x7ff5480b2660 2023-10-06T02:56:10.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.305+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 msgr2=0x7ff52c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff54809abe0 tx=0x7ff538009040 comp rx=0 tx=0).stop 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480b2660 msgr2=0x7ff5481570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480b2660 0x7ff5481570b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff54806fd00 tx=0x7ff544016000 comp rx=0 tx=0).stop 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 shutdown_connections 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff52c066f30 0x7ff52c0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5480cf1f0 0x7ff5480c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5480b2660 0x7ff5481570b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 --2- 172.21.15.84:0/2890639932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5480b2a30 0x7ff54815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 >> 172.21.15.84:0/2890639932 conn(0x7ff548099560 msgr2=0x7ff548157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 shutdown_connections 2023-10-06T02:56:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.306+0000 7ff54f285700 1 -- 172.21.15.84:0/2890639932 wait complete. 2023-10-06T02:56:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T02:56:10.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:56:10.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.431+0000 7ff8c6e79700 1 Processor -- start 2023-10-06T02:56:10.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.431+0000 7ff8c6e79700 1 -- start start 2023-10-06T02:56:10.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.431+0000 7ff8c6e79700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff8c01595a0 0x7ff8c00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.431+0000 7ff8c6e79700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b49e0 0x7ff8c00aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.431+0000 7ff8c6e79700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8c00b07a0 0x7ff8c00b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.431+0000 7ff8c6e79700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c00b0ca0 con 0x7ff8c00b07a0 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.431+0000 7ff8c6e79700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c00b0f80 con 0x7ff8c01595a0 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.431+0000 7ff8c6e79700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c00b1260 con 0x7ff8c00b49e0 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c5416700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8c00b07a0 0x7ff8c00b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c5416700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff8c00b07a0 0x7ff8c00b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56668/0 (socket says 172.21.15.84:56668) 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c5416700 1 -- 172.21.15.84:0/3144419955 learned_addr learned my addr 172.21.15.84:0/3144419955 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c4c15700 1 --2- 172.21.15.84:0/3144419955 >> v2:172.21.15.131:3300/0 conn(0x7ff8c01595a0 0x7ff8c00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8bffff700 1 --2- 172.21.15.84:0/3144419955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b49e0 0x7ff8c00aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c5416700 1 -- 172.21.15.84:0/3144419955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b49e0 msgr2=0x7ff8c00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c5416700 1 --2- 172.21.15.84:0/3144419955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b49e0 0x7ff8c00aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c5416700 1 -- 172.21.15.84:0/3144419955 >> v2:172.21.15.131:3300/0 conn(0x7ff8c01595a0 msgr2=0x7ff8c00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c5416700 1 --2- 172.21.15.84:0/3144419955 >> v2:172.21.15.131:3300/0 conn(0x7ff8c01595a0 0x7ff8c00aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c5416700 1 -- 172.21.15.84:0/3144419955 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c00b1540 con 0x7ff8c00b07a0 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8c5416700 1 --2- 172.21.15.84:0/3144419955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c00b07a0 0x7ff8c00b38d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0088cc0 tx=0x7ff8b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4e83b4681924f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8bf7fe700 1 -- 172.21.15.84:0/3144419955 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b800b640 con 0x7ff8c00b07a0 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8bf7fe700 1 -- 172.21.15.84:0/3144419955 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b800b7a0 con 0x7ff8c00b07a0 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.432+0000 7ff8bf7fe700 1 -- 172.21.15.84:0/3144419955 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b800bb60 con 0x7ff8c00b07a0 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.433+0000 7ff8c6e79700 1 -- 172.21.15.84:0/3144419955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c00b07a0 msgr2=0x7ff8c00b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.433+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/3144419955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c00b07a0 0x7ff8c00b38d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0088cc0 tx=0x7ff8b8009250 comp rx=0 tx=0).stop 2023-10-06T02:56:10.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.433+0000 7ff8c6e79700 1 -- 172.21.15.84:0/3144419955 shutdown_connections 2023-10-06T02:56:10.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.433+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/3144419955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c00b07a0 0x7ff8c00b38d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.433+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/3144419955 >> v2:172.21.15.131:3300/0 conn(0x7ff8c01595a0 0x7ff8c00aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.433+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/3144419955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b49e0 0x7ff8c00aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.433+0000 7ff8c6e79700 1 -- 172.21.15.84:0/3144419955 >> 172.21.15.84:0/3144419955 conn(0x7ff8c0099830 msgr2=0x7ff8c006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:10.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.433+0000 7ff8c6e79700 1 -- 172.21.15.84:0/3144419955 shutdown_connections 2023-10-06T02:56:10.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.433+0000 7ff8c6e79700 1 -- 172.21.15.84:0/3144419955 wait complete. 2023-10-06T02:56:10.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.434+0000 7ff8c6e79700 1 Processor -- start 2023-10-06T02:56:10.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.434+0000 7ff8c6e79700 1 -- start start 2023-10-06T02:56:10.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c6e79700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b07a0 0x7ff8c01569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c6e79700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8c00b49e0 0x7ff8c009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c6e79700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c01595a0 0x7ff8c01579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c6e79700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c016d9f0 con 0x7ff8c01595a0 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c6e79700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c009a590 con 0x7ff8c00b49e0 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c6e79700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c009a870 con 0x7ff8c00b07a0 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c5416700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c01595a0 0x7ff8c01579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c5416700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c01595a0 0x7ff8c01579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56670/0 (socket says 172.21.15.84:56670) 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c5416700 1 -- 172.21.15.84:0/1890187299 learned_addr learned my addr 172.21.15.84:0/1890187299 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8bffff700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8c00b49e0 0x7ff8c009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c4c15700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b07a0 0x7ff8c01569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c5416700 1 -- 172.21.15.84:0/1890187299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b07a0 msgr2=0x7ff8c01569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c5416700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b07a0 0x7ff8c01569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c5416700 1 -- 172.21.15.84:0/1890187299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8c00b49e0 msgr2=0x7ff8c009d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c5416700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8c00b49e0 0x7ff8c009d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c5416700 1 -- 172.21.15.84:0/1890187299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b80094f0 con 0x7ff8c01595a0 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c5416700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c01595a0 0x7ff8c01579f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80094c0 tx=0x7ff8b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8bcff9700 1 -- 172.21.15.84:0/1890187299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b800bb20 con 0x7ff8c01595a0 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8bcff9700 1 -- 172.21.15.84:0/1890187299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b8011420 con 0x7ff8c01595a0 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c009ab50 con 0x7ff8c01595a0 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.435+0000 7ff8bcff9700 1 -- 172.21.15.84:0/1890187299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80117e0 con 0x7ff8c01595a0 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.436+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c009b110 con 0x7ff8c01595a0 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.436+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c015bb50 con 0x7ff8c01595a0 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.437+0000 7ff8bcff9700 1 -- 172.21.15.84:0/1890187299 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8b8011b50 con 0x7ff8c01595a0 2023-10-06T02:56:10.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.437+0000 7ff8bcff9700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff8ac066f30 0x7ff8ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:10.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.437+0000 7ff8bcff9700 1 -- 172.21.15.84:0/1890187299 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff8b8086100 con 0x7ff8c01595a0 2023-10-06T02:56:10.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.437+0000 7ff8c4c15700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff8ac066f30 0x7ff8ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:10.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.438+0000 7ff8c4c15700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff8ac066f30 0x7ff8ac0693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000f510 tx=0x7ff8b000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:10.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.441+0000 7ff8bcff9700 1 -- 172.21.15.84:0/1890187299 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8c015bb50 con 0x7ff8c01595a0 2023-10-06T02:56:10.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.665+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8c015bb50 con 0x7ff8c01595a0 2023-10-06T02:56:10.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.665+0000 7ff8bcff9700 1 -- 172.21.15.84:0/1890187299 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4594 (secure 0 0 0) 0x7ff8c015bb50 con 0x7ff8c01595a0 2023-10-06T02:56:10.666 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:10.666 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1815868063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1815868063},{"type":"v1","addr":"172.21.15.84:6836","nonce":1815868063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/197493808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":197493808},{"type":"v1","addr":"172.21.15.84:6837","nonce":197493808}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:56:04.813024+0000","modified":"2023-10-06T02:56:08.459978+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5124":{"gid":5124,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6835/781245140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":781245140},{"type":"v1","addr":"172.21.15.131:6835","nonce":781245140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:56:10.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff8ac066f30 msgr2=0x7ff8ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff8ac066f30 0x7ff8ac0693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000f510 tx=0x7ff8b000b040 comp rx=0 tx=0).stop 2023-10-06T02:56:10.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c01595a0 msgr2=0x7ff8c01579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c01595a0 0x7ff8c01579f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80094c0 tx=0x7ff8b8017000 comp rx=0 tx=0).stop 2023-10-06T02:56:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 shutdown_connections 2023-10-06T02:56:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff8ac066f30 0x7ff8ac0693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8c01595a0 0x7ff8c01579f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8c00b07a0 0x7ff8c01569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 --2- 172.21.15.84:0/1890187299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8c00b49e0 0x7ff8c009d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.667+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 >> 172.21.15.84:0/1890187299 conn(0x7ff8c0099830 msgr2=0x7ff8c00afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.668+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 shutdown_connections 2023-10-06T02:56:10.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:10.668+0000 7ff8c6e79700 1 -- 172.21.15.84:0/1890187299 wait complete. 2023-10-06T02:56:10.670 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-10-06T02:56:11.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:56:04.813024+0000', 'modified': '2023-10-06T02:56:08.459978+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5124}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5124': {'gid': 5124, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.131:6835/781245140', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 781245140}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 781245140}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:56:11.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:56:11.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T02:56:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.198+0000 7f26374d1700 1 Processor -- start 2023-10-06T02:56:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.198+0000 7f26374d1700 1 -- start start 2023-10-06T02:56:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.199+0000 7f26374d1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f26300b07a0 0x7f26300ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.199+0000 7f26374d1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300b0ca0 con 0x7f26300b49e0 2023-10-06T02:56:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.199+0000 7f26374d1700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300b0f80 con 0x7f26301595a0 2023-10-06T02:56:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.199+0000 7f26374d1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300ab390 con 0x7f26300b07a0 2023-10-06T02:56:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.199+0000 7f2634a6c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26300b49e0 0x7f26300aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57000/0 (socket says 172.21.15.84:57000) 2023-10-06T02:56:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.199+0000 7f2634a6c700 1 -- 172.21.15.84:0/503712877 learned_addr learned my addr 172.21.15.84:0/503712877 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.199+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643684698 0 0) 0x7f26300b0ca0 con 0x7f26300b49e0 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f261c003570 con 0x7f26300b49e0 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2635a6e700 1 --2- 172.21.15.84:0/503712877 >> v2:172.21.15.131:3300/0 conn(0x7f26300b07a0 0x7f26300ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1672742590 0 0) 0x7f261c003570 con 0x7f26300b49e0 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 >> v2:172.21.15.131:3300/0 conn(0x7f26300b07a0 msgr2=0x7f26300ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 --2- 172.21.15.84:0/503712877 >> v2:172.21.15.131:3300/0 conn(0x7f26300b07a0 0x7f26300ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 >> v1:172.21.15.131:6789/0 conn(0x7f26301595a0 legacy=0x7f26300aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300b1260 con 0x7f26300b49e0 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f2620001470 con 0x7f26300b49e0 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 >> v1:172.21.15.84:6789/0 conn(0x7f26300b49e0 legacy=0x7f26300aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f261c003a60 0x7f261c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261c004810 0x7f261c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f261c0051c0 0x7f261c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300ab390 con 0x7f261c004810 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c00c0d0 con 0x7f261c003a60 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c00c290 con 0x7f261c0051c0 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2634a6c700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261c004810 0x7f261c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f263526d700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f261c003a60 0x7f261c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2635a6e700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f261c0051c0 0x7f261c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2634a6c700 1 -- 172.21.15.84:0/503712877 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f261c0051c0 msgr2=0x7f261c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2634a6c700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f261c0051c0 0x7f261c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2634a6c700 1 -- 172.21.15.84:0/503712877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f261c003a60 msgr2=0x7f261c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2634a6c700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f261c003a60 0x7f261c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2635a6e700 1 -- 172.21.15.84:0/503712877 reap_dead start 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2634a6c700 1 -- 172.21.15.84:0/503712877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c003570 con 0x7f261c004810 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.200+0000 7f2634a6c700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261c004810 0x7f261c004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2630088e20 tx=0x7f2620001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed6bbabcc1cab99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000cbb0 con 0x7f261c004810 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000cd10 con 0x7f261c004810 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f2627fff700 1 -- 172.21.15.84:0/503712877 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620005b50 con 0x7f261c004810 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f26374d1700 1 -- 172.21.15.84:0/503712877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261c004810 msgr2=0x7f261c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f26374d1700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261c004810 0x7f261c004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2630088e20 tx=0x7f2620001e50 comp rx=0 tx=0).stop 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f26374d1700 1 -- 172.21.15.84:0/503712877 shutdown_connections 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f26374d1700 1 --2- 172.21.15.84:0/503712877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261c004810 0x7f261c004c80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f26374d1700 1 -- 172.21.15.84:0/503712877 >> 172.21.15.84:0/503712877 conn(0x7f2630099830 msgr2=0x7f263006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f26374d1700 1 -- 172.21.15.84:0/503712877 shutdown_connections 2023-10-06T02:56:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.201+0000 7f26374d1700 1 -- 172.21.15.84:0/503712877 wait complete. 2023-10-06T02:56:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.202+0000 7f26374d1700 1 Processor -- start 2023-10-06T02:56:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.202+0000 7f26374d1700 1 -- start start 2023-10-06T02:56:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f26374d1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f261c004810 0x7f263014dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f26374d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f263016e060 0x7f26300aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f26374d1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f263009be30 0x7f26300ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f26374d1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300ac5f0 con 0x7f263016e060 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f26374d1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300adaa0 con 0x7f261c004810 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f26374d1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26300ac310 con 0x7f263009be30 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f2634a6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f263016e060 0x7f26300aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f2634a6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f263016e060 0x7f26300aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56688/0 (socket says 172.21.15.84:56688) 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f2634a6c700 1 -- 172.21.15.84:0/2069673495 learned_addr learned my addr 172.21.15.84:0/2069673495 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f263526d700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f261c004810 0x7f263014dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f2635a6e700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f263009be30 0x7f26300ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f2634a6c700 1 -- 172.21.15.84:0/2069673495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f263009be30 msgr2=0x7f26300ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.203+0000 7f2634a6c700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f263009be30 0x7f26300ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.204+0000 7f2634a6c700 1 -- 172.21.15.84:0/2069673495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f261c004810 msgr2=0x7f263014dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.204+0000 7f2634a6c700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f261c004810 0x7f263014dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.204+0000 7f2634a6c700 1 -- 172.21.15.84:0/2069673495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300add20 con 0x7f263016e060 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.204+0000 7f2634a6c700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f263016e060 0x7f26300aba10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2620007cd0 tx=0x7f2620015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.204+0000 7f26257fa700 1 -- 172.21.15.84:0/2069673495 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000cbb0 con 0x7f263016e060 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.204+0000 7f26257fa700 1 -- 172.21.15.84:0/2069673495 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000ce80 con 0x7f263016e060 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.204+0000 7f26374d1700 1 -- 172.21.15.84:0/2069673495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26300ae000 con 0x7f263016e060 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.204+0000 7f26257fa700 1 -- 172.21.15.84:0/2069673495 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620007300 con 0x7f263016e060 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.204+0000 7f26374d1700 1 -- 172.21.15.84:0/2069673495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263014e020 con 0x7f263016e060 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.205+0000 7f26257fa700 1 -- 172.21.15.84:0/2069673495 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2620012400 con 0x7f263016e060 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.206+0000 7f26257fa700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2614066f30 0x7f26140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.206+0000 7f26257fa700 1 -- 172.21.15.84:0/2069673495 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2620084f40 con 0x7f263016e060 2023-10-06T02:56:11.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.206+0000 7f263526d700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2614066f30 0x7f26140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.206+0000 7f263526d700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2614066f30 0x7f26140693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26300af610 tx=0x7f262c001a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f26407c9b80 1 Processor -- start 2023-10-06T02:56:11.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f26407c9b80 1 -- start start 2023-10-06T02:56:11.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 0x5594df249c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df24acc0 0x5594df2996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df299c00 0x5594df29a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f26407c9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594df1a0a70 con 0x5594df24acc0 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f26407c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594df19e270 con 0x5594df299c00 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f26407c9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594df19a060 con 0x5594df249840 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f2634a6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df24acc0 0x5594df2996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.208+0000 7f2634a6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df24acc0 0x5594df2996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56692/0 (socket says 172.21.15.84:56692) 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f2634a6c700 1 -- 172.21.15.84:0/3519611974 learned_addr learned my addr 172.21.15.84:0/3519611974 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f263526d700 1 --2- 172.21.15.84:0/3519611974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 0x5594df249c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f2635a6e700 1 --2- 172.21.15.84:0/3519611974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df299c00 0x5594df29a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f2634a6c700 1 -- 172.21.15.84:0/3519611974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 msgr2=0x5594df249c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f2634a6c700 1 --2- 172.21.15.84:0/3519611974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 0x5594df249c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f2634a6c700 1 -- 172.21.15.84:0/3519611974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df299c00 msgr2=0x5594df29a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f2634a6c700 1 --2- 172.21.15.84:0/3519611974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df299c00 0x5594df29a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f2634a6c700 1 -- 172.21.15.84:0/3519611974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594df034270 con 0x5594df24acc0 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f2634a6c700 1 --2- 172.21.15.84:0/3519611974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df24acc0 0x5594df2996c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f26200831f0 tx=0x7f2620083120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6241b11d84a0f80f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f261a7fc700 1 -- 172.21.15.84:0/3519611974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620055bd0 con 0x5594df24acc0 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f261a7fc700 1 -- 172.21.15.84:0/3519611974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620058e20 con 0x5594df24acc0 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.209+0000 7f261a7fc700 1 -- 172.21.15.84:0/3519611974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262005cb70 con 0x5594df24acc0 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 -- 172.21.15.84:0/3519611974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df24acc0 msgr2=0x5594df2996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3519611974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df24acc0 0x5594df2996c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f26200831f0 tx=0x7f2620083120 comp rx=0 tx=0).stop 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 -- 172.21.15.84:0/3519611974 shutdown_connections 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3519611974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df299c00 0x5594df29a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3519611974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 0x5594df249c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3519611974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df24acc0 0x5594df2996c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 -- 172.21.15.84:0/3519611974 >> 172.21.15.84:0/3519611974 conn(0x5594df24b160 msgr2=0x5594df24b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 -- 172.21.15.84:0/3519611974 shutdown_connections 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 -- 172.21.15.84:0/3519611974 wait complete. 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 -- start start 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.210+0000 7f26407c9b80 1 Processor -- start 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df249840 0x5594df287e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 0x5594df290520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df299c00 0x5594df2a31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f26407c9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594df145890 con 0x5594df249840 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f26407c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594df160ea0 con 0x5594df24acc0 2023-10-06T02:56:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f26407c9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594df01ce30 con 0x5594df299c00 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f26407c9b80 10 client.0 _ll_register_callbacks cb 0x5594df20ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f263526d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df249840 0x5594df287e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f263526d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df249840 0x5594df287e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56702/0 (socket says 172.21.15.84:56702) 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f263526d700 1 -- 172.21.15.84:0/749366445 learned_addr learned my addr 172.21.15.84:0/749366445 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f2635a6e700 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df299c00 0x5594df2a31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.211+0000 7f2634a6c700 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 0x5594df290520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f263526d700 1 -- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df299c00 msgr2=0x5594df2a31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f263526d700 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df299c00 0x5594df2a31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f263526d700 1 -- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 msgr2=0x5594df290520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f263526d700 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 0x5594df290520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f263526d700 1 -- 172.21.15.84:0/749366445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263014e020 con 0x5594df249840 2023-10-06T02:56:11.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f2635a6e700 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df299c00 0x5594df2a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f263526d700 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df249840 0x5594df287e70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f262c0155e0 tx=0x7f262c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2218407bc4027c78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f260f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f260f7fe700 1 -- 172.21.15.84:0/749366445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c023630 con 0x5594df249840 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f260f7fe700 1 -- 172.21.15.84:0/749366445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f262c023790 con 0x5594df249840 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f26407c9b80 1 -- 172.21.15.84:0/749366445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594df23e940 con 0x5594df249840 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f260f7fe700 1 -- 172.21.15.84:0/749366445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f262c023b60 con 0x5594df249840 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f26407c9b80 10 client.5319 fetch_fsmap learned FSMap version 17 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f26407c9b80 1 -- 172.21.15.84:0/749366445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5594defd6fe0 con 0x5594df249840 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f260f7fe700 1 -- 172.21.15.84:0/749366445 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594df23e940 con 0x5594df249840 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f260f7fe700 1 -- 172.21.15.84:0/749366445 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f262c023cc0 con 0x5594df249840 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f26407c9b80 10 client.5319 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T02:56:11.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f26407c9b80 10 client.5319 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f26407c9b80 20 client.5319 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f26407c9b80 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5594df25ed20 0x5594df25f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f26407c9b80 4 client.5319 mds_command: new command op to 5124 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.212+0000 7f26407c9b80 1 -- 172.21.15.84:0/749366445 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594df21b870 con 0x5594df25ed20 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.213+0000 7f2634a6c700 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5594df25ed20 0x5594df25f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.213+0000 7f260f7fe700 10 client.5319 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.213+0000 7f2634a6c700 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5594df25ed20 0x5594df25f0f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b672e257870afc21 server_cookie=3b460b0cf9e798db in_seq=0 out_seq=0 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f260f7fe700 1 -- 172.21.15.84:0/749366445 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5594df21b870 con 0x5594df25ed20 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f260f7fe700 10 client.5319 handle_command_reply: tid=0 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 client.5319 shutdown 2023-10-06T02:56:11.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 -- 172.21.15.84:0/749366445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df249840 msgr2=0x5594df287e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df249840 0x5594df287e70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f262c0155e0 tx=0x7f262c01a040 comp rx=0 tx=0).stop 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 -- 172.21.15.84:0/749366445 shutdown_connections 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5594df25ed20 0x5594df25f0f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df299c00 0x5594df2a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df249840 0x5594df287e70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f260f7fe700 0 client.5319 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 --2- 172.21.15.84:0/749366445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 0x5594df290520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 -- 172.21.15.84:0/749366445 >> 172.21.15.84:0/749366445 conn(0x5594df24b160 msgr2=0x5594df272ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 -- 172.21.15.84:0/749366445 shutdown_connections 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 1 -- 172.21.15.84:0/749366445 wait complete. 2023-10-06T02:56:11.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.214+0000 7f26407c9b80 20 client.5319 trim_cache size 0 max 16384 2023-10-06T02:56:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.230+0000 7f26407c9b80 1 Processor -- start 2023-10-06T02:56:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f26407c9b80 1 -- start start 2023-10-06T02:56:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 0x5594df2930d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 0x5594df2a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f26407c9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594df29a450 con 0x5594df299c00 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f26407c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594df28e6b0 con 0x5594df24acc0 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f26407c9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594df24bbb0 con 0x5594df249840 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f2635a6e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f2635a6e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2aa1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56712/0 (socket says 172.21.15.84:56712) 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f2635a6e700 1 -- 172.21.15.84:0/2922223439 learned_addr learned my addr 172.21.15.84:0/2922223439 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f263526d700 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 0x5594df2930d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.231+0000 7f2634a6c700 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 0x5594df2a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f2635a6e700 1 -- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 msgr2=0x5594df2930d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f2635a6e700 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 0x5594df2930d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f2635a6e700 1 -- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 msgr2=0x5594df2a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f2635a6e700 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 0x5594df2a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f2635a6e700 1 -- 172.21.15.84:0/2922223439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594df168780 con 0x5594df299c00 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f263526d700 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 0x5594df2930d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f2634a6c700 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 0x5594df2a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f2635a6e700 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2aa1c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f26300b5650 tx=0x7f2628008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a209960fbeabe8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f261affd700 1 -- 172.21.15.84:0/2922223439 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262801c070 con 0x5594df299c00 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f261affd700 1 -- 172.21.15.84:0/2922223439 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2628017bf0 con 0x5594df299c00 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f261affd700 1 -- 172.21.15.84:0/2922223439 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628021460 con 0x5594df299c00 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f26407c9b80 1 -- 172.21.15.84:0/2922223439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 msgr2=0x5594df2aa1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f26407c9b80 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2aa1c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f26300b5650 tx=0x7f2628008040 comp rx=0 tx=0).stop 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f26407c9b80 1 -- 172.21.15.84:0/2922223439 shutdown_connections 2023-10-06T02:56:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f26407c9b80 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2aa1c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f26407c9b80 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df249840 0x5594df2930d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f26407c9b80 1 --2- 172.21.15.84:0/2922223439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df24acc0 0x5594df2a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f26407c9b80 1 -- 172.21.15.84:0/2922223439 >> 172.21.15.84:0/2922223439 conn(0x5594df24b160 msgr2=0x5594df26f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f26407c9b80 1 -- 172.21.15.84:0/2922223439 shutdown_connections 2023-10-06T02:56:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.232+0000 7f26407c9b80 1 -- 172.21.15.84:0/2922223439 wait complete. 2023-10-06T02:56:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.233+0000 7f26407c9b80 1 -- start start 2023-10-06T02:56:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.233+0000 7f26407c9b80 1 Processor -- start 2023-10-06T02:56:11.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df249840 0x5594df2ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df24acc0 0x5594df28d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f26407c9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2eead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f26407c9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594df2ec430 con 0x5594df299c00 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f26407c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594df28dbd0 con 0x5594df249840 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f26407c9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594df293620 con 0x5594df24acc0 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f26407c9b80 10 client.0 _ll_register_callbacks cb 0x5594df20ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f2635a6e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f2635a6e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2eead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56714/0 (socket says 172.21.15.84:56714) 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f2635a6e700 1 -- 172.21.15.84:0/3950971524 learned_addr learned my addr 172.21.15.84:0/3950971524 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f263526d700 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df249840 0x5594df2ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f2634a6c700 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df24acc0 0x5594df28d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f2635a6e700 1 -- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df24acc0 msgr2=0x5594df28d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f2635a6e700 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df24acc0 0x5594df28d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f2635a6e700 1 -- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df249840 msgr2=0x5594df2ebb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f2635a6e700 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df249840 0x5594df2ebb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.234+0000 7f2635a6e700 1 -- 172.21.15.84:0/3950971524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2628009cb0 con 0x5594df299c00 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f2635a6e700 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2eead0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x5594df290180 tx=0x7f2628021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81293c8b6fe8f135 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f260f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f260f7fe700 1 -- 172.21.15.84:0/3950971524 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628014410 con 0x5594df299c00 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f260f7fe700 1 -- 172.21.15.84:0/3950971524 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2628014570 con 0x5594df299c00 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f26407c9b80 1 -- 172.21.15.84:0/3950971524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2620058e20 con 0x5594df299c00 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f260f7fe700 1 -- 172.21.15.84:0/3950971524 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2628014940 con 0x5594df299c00 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f26407c9b80 10 client.5325 fetch_fsmap learned FSMap version 17 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f26407c9b80 1 -- 172.21.15.84:0/3950971524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5594df14f470 con 0x5594df299c00 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f260f7fe700 1 -- 172.21.15.84:0/3950971524 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620058e20 con 0x5594df299c00 2023-10-06T02:56:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f260f7fe700 1 -- 172.21.15.84:0/3950971524 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2628014aa0 con 0x5594df299c00 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f26407c9b80 10 client.5325 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f26407c9b80 10 client.5325 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f26407c9b80 20 client.5325 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5594df2aa660 0x5594df2aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f26407c9b80 4 client.5325 mds_command: new command op to 5124 tid=0[{"prefix": "status"}] 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f26407c9b80 1 -- 172.21.15.84:0/3950971524 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5594df13ce00 con 0x5594df2aa660 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.235+0000 7f263526d700 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5594df2aa660 0x5594df2aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f260f7fe700 10 client.5325 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f263526d700 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5594df2aa660 0x5594df2aaa30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b23e87c3858f0d09 server_cookie=61985d542dcea2a2 in_seq=0 out_seq=0 2023-10-06T02:56:11.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f260f7fe700 1 -- 172.21.15.84:0/3950971524 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5594df13ce00 con 0x5594df2aa660 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f260f7fe700 10 client.5325 handle_command_reply: tid=0 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 client.5325 shutdown 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 -- 172.21.15.84:0/3950971524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 msgr2=0x5594df2eead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2eead0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x5594df290180 tx=0x7f2628021000 comp rx=0 tx=0).stop 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 -- 172.21.15.84:0/3950971524 shutdown_connections 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5594df2aa660 0x5594df2aaa30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594df249840 0x5594df2ebb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5594df299c00 0x5594df2eead0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f260f7fe700 0 client.5325 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 --2- 172.21.15.84:0/3950971524 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5594df24acc0 0x5594df28d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 -- 172.21.15.84:0/3950971524 >> 172.21.15.84:0/3950971524 conn(0x5594df24b160 msgr2=0x5594df26f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 -- 172.21.15.84:0/3950971524 shutdown_connections 2023-10-06T02:56:11.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 1 -- 172.21.15.84:0/3950971524 wait complete. 2023-10-06T02:56:11.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.236+0000 7f26407c9b80 20 client.5325 trim_cache size 0 max 16384 2023-10-06T02:56:11.245 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:56:11.245 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:56:11.245 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T02:56:11.245 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5124, 2023-10-06T02:56:11.245 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:56:11.245 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:56:11.245 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:56:11.246 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 5.8061533770000002, 2023-10-06T02:56:11.246 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 17, 2023-10-06T02:56:11.246 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 42, 2023-10-06T02:56:11.246 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 42, 2023-10-06T02:56:11.246 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 14.677512442999999 2023-10-06T02:56:11.246 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:56:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 -- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2614066f30 msgr2=0x7f26140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2614066f30 0x7f26140693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26300af610 tx=0x7f262c001a70 comp rx=0 tx=0).stop 2023-10-06T02:56:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 -- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f263016e060 msgr2=0x7f26300aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f263016e060 0x7f26300aba10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2620007cd0 tx=0x7f2620015000 comp rx=0 tx=0).stop 2023-10-06T02:56:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 -- 172.21.15.84:0/2069673495 shutdown_connections 2023-10-06T02:56:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2614066f30 0x7f26140693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f261c004810 0x7f263014dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f263009be30 0x7f26300ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 --2- 172.21.15.84:0/2069673495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f263016e060 0x7f26300aba10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 -- 172.21.15.84:0/2069673495 >> 172.21.15.84:0/2069673495 conn(0x7f2630099830 msgr2=0x7f26300698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 -- 172.21.15.84:0/2069673495 shutdown_connections 2023-10-06T02:56:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.237+0000 7f26374d1700 1 -- 172.21.15.84:0/2069673495 wait complete. 2023-10-06T02:56:11.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:56:11.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.363+0000 7f61cc92b700 1 Processor -- start 2023-10-06T02:56:11.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.363+0000 7f61cc92b700 1 -- start start 2023-10-06T02:56:11.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.363+0000 7f61cc92b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 0x7f61c80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.363+0000 7f61cc92b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61c815b6a0 0x7f61c80c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.363+0000 7f61cc92b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c815b210 con 0x7f61c8157080 2023-10-06T02:56:11.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.363+0000 7f61cc92b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c80ce4f0 con 0x7f61c815b6a0 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.363+0000 7f61cc92b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80ce7d0 con 0x7f61c8157450 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.363+0000 7f61c6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f61c8157080 0x7f61c806d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:57014/0 (socket says 172.21.15.84:57014) 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c6d9d700 1 -- 172.21.15.84:0/452424279 learned_addr learned my addr 172.21.15.84:0/452424279 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c759e700 1 --2- 172.21.15.84:0/452424279 >> v2:172.21.15.84:3300/0 conn(0x7f61c815b6a0 0x7f61c80c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61be59c700 1 --2- 172.21.15.84:0/452424279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 0x7f61c80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c659c700 1 -- 172.21.15.84:0/452424279 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151473625 0 0) 0x7f61c815b210 con 0x7f61c8157080 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c659c700 1 -- 172.21.15.84:0/452424279 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b4003570 con 0x7f61c8157080 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c759e700 1 -- 172.21.15.84:0/452424279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 msgr2=0x7f61c80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c759e700 1 --2- 172.21.15.84:0/452424279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 0x7f61c80cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c759e700 1 -- 172.21.15.84:0/452424279 >> v1:172.21.15.84:6789/0 conn(0x7f61c8157080 legacy=0x7f61c806d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c759e700 1 -- 172.21.15.84:0/452424279 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c815aea0 con 0x7f61c815b6a0 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c759e700 1 --2- 172.21.15.84:0/452424279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c815b6a0 0x7f61c80c9fd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009e60 tx=0x7f61c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab72ecaf5e8d89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c659c700 1 -- 172.21.15.84:0/452424279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000e070 con 0x7f61c815b6a0 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c659c700 1 -- 172.21.15.84:0/452424279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000bab0 con 0x7f61c815b6a0 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.364+0000 7f61c659c700 1 -- 172.21.15.84:0/452424279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000be70 con 0x7f61c815b6a0 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.365+0000 7f61cc92b700 1 -- 172.21.15.84:0/452424279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c815b6a0 msgr2=0x7f61c80c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.365+0000 7f61cc92b700 1 --2- 172.21.15.84:0/452424279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c815b6a0 0x7f61c80c9fd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009e60 tx=0x7f61c0009780 comp rx=0 tx=0).stop 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.365+0000 7f61cc92b700 1 -- 172.21.15.84:0/452424279 shutdown_connections 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.365+0000 7f61cc92b700 1 --2- 172.21.15.84:0/452424279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c815b6a0 0x7f61c80c9fd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.365+0000 7f61cc92b700 1 --2- 172.21.15.84:0/452424279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 0x7f61c80cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.365+0000 7f61cc92b700 1 -- 172.21.15.84:0/452424279 >> 172.21.15.84:0/452424279 conn(0x7f61c806b540 msgr2=0x7f61c806b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:11.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.365+0000 7f61cc92b700 1 -- 172.21.15.84:0/452424279 shutdown_connections 2023-10-06T02:56:11.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.365+0000 7f61cc92b700 1 -- 172.21.15.84:0/452424279 wait complete. 2023-10-06T02:56:11.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.366+0000 7f61cc92b700 1 Processor -- start 2023-10-06T02:56:11.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.366+0000 7f61cc92b700 1 -- start start 2023-10-06T02:56:11.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61cc92b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c8157080 0x7f61c8150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61cc92b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 0x7f61c8154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61cc92b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61c815b6a0 0x7f61c8156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61cc92b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8155b70 con 0x7f61c8157080 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61cc92b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8150550 con 0x7f61c815b6a0 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61cc92b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8154f60 con 0x7f61c8157450 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c8157080 0x7f61c8150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c8157080 0x7f61c8150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56732/0 (socket says 172.21.15.84:56732) 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c6d9d700 1 -- 172.21.15.84:0/3273143253 learned_addr learned my addr 172.21.15.84:0/3273143253 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c759e700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61c815b6a0 0x7f61c8156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61be59c700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 0x7f61c8154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c6d9d700 1 -- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 msgr2=0x7f61c8154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c6d9d700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 0x7f61c8154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c6d9d700 1 -- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61c815b6a0 msgr2=0x7f61c8156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c6d9d700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61c815b6a0 0x7f61c8156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c6d9d700 1 -- 172.21.15.84:0/3273143253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0009a20 con 0x7f61c8157080 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61be59c700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 0x7f61c8154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c759e700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61c815b6a0 0x7f61c8156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61c6d9d700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c8157080 0x7f61c8150010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c7c0 tx=0x7f61b8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61bf7fe700 1 -- 172.21.15.84:0/3273143253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8005b30 con 0x7f61c8157080 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61bf7fe700 1 -- 172.21.15.84:0/3273143253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8005c90 con 0x7f61c8157080 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61bf7fe700 1 -- 172.21.15.84:0/3273143253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8007340 con 0x7f61c8157080 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c8155240 con 0x7f61c8157080 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.367+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c8155800 con 0x7f61c8157080 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.368+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c805f270 con 0x7f61c8157080 2023-10-06T02:56:11.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.369+0000 7f61bf7fe700 1 -- 172.21.15.84:0/3273143253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61b801b400 con 0x7f61c8157080 2023-10-06T02:56:11.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.369+0000 7f61bf7fe700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f61a8066f30 0x7f61a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:11.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.369+0000 7f61bf7fe700 1 -- 172.21.15.84:0/3273143253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f61b8084290 con 0x7f61c8157080 2023-10-06T02:56:11.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.369+0000 7f61be59c700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f61a8066f30 0x7f61a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:11.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.369+0000 7f61be59c700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f61a8066f30 0x7f61a80693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f61b0006f00 tx=0x7f61b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:11.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.373+0000 7f61bf7fe700 1 -- 172.21.15.84:0/3273143253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61b80512e0 con 0x7f61c8157080 2023-10-06T02:56:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.602+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f61c8155e50 con 0x7f61c8157080 2023-10-06T02:56:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.603+0000 7f61bf7fe700 1 -- 172.21.15.84:0/3273143253 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f61b8054900 con 0x7f61c8157080 2023-10-06T02:56:11.603 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:56:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.604+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f61a8066f30 msgr2=0x7f61a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.604+0000 7f61cc92b700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f61a8066f30 0x7f61a80693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f61b0006f00 tx=0x7f61b0008040 comp rx=0 tx=0).stop 2023-10-06T02:56:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.604+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c8157080 msgr2=0x7f61c8150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.604+0000 7f61cc92b700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c8157080 0x7f61c8150010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c7c0 tx=0x7f61b8007e00 comp rx=0 tx=0).stop 2023-10-06T02:56:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.605+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 shutdown_connections 2023-10-06T02:56:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.605+0000 7f61cc92b700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f61a8066f30 0x7f61a80693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.605+0000 7f61cc92b700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61c815b6a0 0x7f61c8156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.605+0000 7f61cc92b700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61c8157080 0x7f61c8150010 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.605+0000 7f61cc92b700 1 --2- 172.21.15.84:0/3273143253 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f61c8157450 0x7f61c8154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.605+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 >> 172.21.15.84:0/3273143253 conn(0x7f61c806b540 msgr2=0x7f61c8150870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.605+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 shutdown_connections 2023-10-06T02:56:11.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:11.605+0000 7f61cc92b700 1 -- 172.21.15.84:0/3273143253 wait complete. 2023-10-06T02:56:11.617 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:56:11.617 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:56:11.617 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T02:56:11.617 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:56:11.617 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:56:11.618 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:56:11.618 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:56:11.618 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:56:11.618 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:56:11.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:56:11.618 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T02:56:11.633 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:56:11.633 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:56:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:56:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:56:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T02:56:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:56:11.634 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:56:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:56:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T02:56:11.635 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:56:11.635 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:56:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T02:56:11.636 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:56:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:56:11.636 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:56:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:56:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:56:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42437sec preferred_lft 42437sec 2023-10-06T02:56:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-10-06T02:56:11.636 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:56:11.637 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:56:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T02:56:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:56:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:56:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c4d3:64ff:fe4d:ee22/64 scope link 2023-10-06T02:56:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:56:11.637 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:56:11.637 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:56:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::41f:f5ff:fe77:615a/64 scope link 2023-10-06T02:56:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:56:11.638 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:56:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 66:ce:03:f1:65:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:56:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::64ce:3ff:fef1:6538/64 scope link 2023-10-06T02:56:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:56:11.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:56:11.638 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:56:11.696 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T02:56:11.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:56:11.697 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T02:56:11.753 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T02:56:11.753 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:56:11.754 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:56:11.754 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:56:11.754 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:56:11.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:56:11.754 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:56:11.754 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:56:11.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:56:11.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:56:11.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:56:11.755 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:56:11.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:56:11.853 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T02:56:11.868 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:56:11.868 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:56:11.869 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:56:11.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:56:11.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T02:56:11.934 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:56:11.935 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:56:11.988 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:56:11.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:56:11.988 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:56:12.042 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T02:56:12.043 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:56:12.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:56:12.122 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:56:12.122 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:56:12.122 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:56:12.130 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:56:12.130 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:56:12.130 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:56:12.131 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:56:12.131 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:56:12.153 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:56:12.153 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:56:12.154 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:56:12.154 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:56:12.154 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:56:12.154 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T02:56:12.154 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T02:56:12.154 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T02:56:12.155 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:56:12.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:56:12.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:56:12.221 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-10-06T02:56:12.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.376+0000 7f793c28c700 1 Processor -- start 2023-10-06T02:56:12.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.376+0000 7f793c28c700 1 -- start start 2023-10-06T02:56:12.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.377+0000 7f793c28c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f79340cd980 0x7f7934159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:12.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.377+0000 7f793c28c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79340b4eb0 0x7f7934163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.377+0000 7f793c28c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79340b5f30 con 0x7f79340b4a60 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.377+0000 7f793c28c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79340b3640 con 0x7f79340b4eb0 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.377+0000 7f793c28c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79340b63c0 con 0x7f79340cd980 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.377+0000 7f793a829700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79340b4eb0 0x7f7934163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.377+0000 7f7939827700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f79340b4a60 0x7f79340d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38208/0 (socket says 172.21.15.84:38208) 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f793a829700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79340b4eb0 0x7f7934163240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41824/0 (socket says 172.21.15.84:41824) 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f7939827700 1 -- 172.21.15.84:0/1124866072 learned_addr learned my addr 172.21.15.84:0/1124866072 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f793a028700 1 --2- 172.21.15.84:0/1124866072 >> v2:172.21.15.131:3300/0 conn(0x7f79340cd980 0x7f7934159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f793a829700 1 -- 172.21.15.84:0/1124866072 >> v2:172.21.15.131:3300/0 conn(0x7f79340cd980 msgr2=0x7f7934159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f793a829700 1 --2- 172.21.15.84:0/1124866072 >> v2:172.21.15.131:3300/0 conn(0x7f79340cd980 0x7f7934159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f793a829700 1 -- 172.21.15.84:0/1124866072 >> v1:172.21.15.84:6789/0 conn(0x7f79340b4a60 legacy=0x7f79340d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:12.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f793a829700 1 -- 172.21.15.84:0/1124866072 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79340b5320 con 0x7f79340b4eb0 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f793a829700 1 --2- 172.21.15.84:0/1124866072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4eb0 0x7f7934163240 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7934088d10 tx=0x7f792c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c215c9db426b6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f7939026700 1 -- 172.21.15.84:0/1124866072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00e070 con 0x7f79340b4eb0 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f7939026700 1 -- 172.21.15.84:0/1124866072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c00bb60 con 0x7f79340b4eb0 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.378+0000 7f7939026700 1 -- 172.21.15.84:0/1124866072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c012430 con 0x7f79340b4eb0 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.379+0000 7f793c28c700 1 -- 172.21.15.84:0/1124866072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4eb0 msgr2=0x7f7934163240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.379+0000 7f793c28c700 1 --2- 172.21.15.84:0/1124866072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4eb0 0x7f7934163240 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7934088d10 tx=0x7f792c009780 comp rx=0 tx=0).stop 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.379+0000 7f793c28c700 1 -- 172.21.15.84:0/1124866072 shutdown_connections 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.379+0000 7f793c28c700 1 --2- 172.21.15.84:0/1124866072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4eb0 0x7f7934163240 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.379+0000 7f793c28c700 1 --2- 172.21.15.84:0/1124866072 >> v2:172.21.15.131:3300/0 conn(0x7f79340cd980 0x7f7934159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.379+0000 7f793c28c700 1 -- 172.21.15.84:0/1124866072 >> 172.21.15.84:0/1124866072 conn(0x7f793406ed20 msgr2=0x7f793406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.379+0000 7f793c28c700 1 -- 172.21.15.84:0/1124866072 shutdown_connections 2023-10-06T02:56:12.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.379+0000 7f793c28c700 1 -- 172.21.15.84:0/1124866072 wait complete. 2023-10-06T02:56:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.380+0000 7f793c28c700 1 Processor -- start 2023-10-06T02:56:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.380+0000 7f793c28c700 1 -- start start 2023-10-06T02:56:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.380+0000 7f793c28c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4a60 0x7f7934144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793c28c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79340b4eb0 0x7f793416d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793c28c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79340cd980 0x7f79340cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793c28c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7934155e00 con 0x7f79340b4a60 2023-10-06T02:56:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793c28c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793416d4e0 con 0x7f79340b4eb0 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793c28c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793416deb0 con 0x7f79340cd980 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a028700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4a60 0x7f7934144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a028700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4a60 0x7f7934144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41826/0 (socket says 172.21.15.84:41826) 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a028700 1 -- 172.21.15.84:0/4239738426 learned_addr learned my addr 172.21.15.84:0/4239738426 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a829700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79340cd980 0x7f79340cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f7939827700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79340b4eb0 0x7f793416d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a028700 1 -- 172.21.15.84:0/4239738426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79340cd980 msgr2=0x7f79340cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a028700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79340cd980 0x7f79340cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a028700 1 -- 172.21.15.84:0/4239738426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79340b4eb0 msgr2=0x7f793416d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a028700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79340b4eb0 0x7f793416d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a028700 1 -- 172.21.15.84:0/4239738426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c009a20 con 0x7f79340b4a60 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793a028700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4a60 0x7f7934144080 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f793000e930 tx=0x7f79300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f792a7fc700 1 -- 172.21.15.84:0/4239738426 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793000eed0 con 0x7f79340b4a60 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f792a7fc700 1 -- 172.21.15.84:0/4239738426 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793000c850 con 0x7f79340b4a60 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7934155840 con 0x7f79340b4a60 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f792a7fc700 1 -- 172.21.15.84:0/4239738426 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793000cbf0 con 0x7f79340b4a60 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.381+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793416d170 con 0x7f79340b4a60 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.382+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7934064ad0 con 0x7f79340b4a60 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.383+0000 7f792a7fc700 1 -- 172.21.15.84:0/4239738426 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7930013470 con 0x7f79340b4a60 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.383+0000 7f792a7fc700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7918066f30 0x7f79180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.383+0000 7f792a7fc700 1 -- 172.21.15.84:0/4239738426 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7930084a00 con 0x7f79340b4a60 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.383+0000 7f7939827700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7918066f30 0x7f79180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.383+0000 7f7939827700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7918066f30 0x7f79180693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7934152e80 tx=0x7f7924009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:12.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.387+0000 7f792a7fc700 1 -- 172.21.15.84:0/4239738426 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79300519d0 con 0x7f79340b4a60 2023-10-06T02:56:12.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:12.615+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f79340b5600 con 0x7f79340b4a60 2023-10-06T02:56:13.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.480+0000 7f792a7fc700 1 -- 172.21.15.84:0/4239738426 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f7930054ff0 con 0x7f79340b4a60 2023-10-06T02:56:13.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.482+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7918066f30 msgr2=0x7f79180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:13.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.482+0000 7f793c28c700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7918066f30 0x7f79180693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7934152e80 tx=0x7f7924009040 comp rx=0 tx=0).stop 2023-10-06T02:56:13.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.482+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4a60 msgr2=0x7f7934144080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:13.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.482+0000 7f793c28c700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4a60 0x7f7934144080 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f793000e930 tx=0x7f79300091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.483+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 shutdown_connections 2023-10-06T02:56:13.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.483+0000 7f793c28c700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7918066f30 0x7f79180693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.483+0000 7f793c28c700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79340cd980 0x7f79340cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.483+0000 7f793c28c700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79340b4a60 0x7f7934144080 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.483+0000 7f793c28c700 1 --2- 172.21.15.84:0/4239738426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79340b4eb0 0x7f793416d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.483+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 >> 172.21.15.84:0/4239738426 conn(0x7f793406ed20 msgr2=0x7f793415c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:13.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.483+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 shutdown_connections 2023-10-06T02:56:13.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.483+0000 7f793c28c700 1 -- 172.21.15.84:0/4239738426 wait complete. 2023-10-06T02:56:13.500 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:56:13.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.615+0000 7f136b55b700 1 Processor -- start 2023-10-06T02:56:13.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.615+0000 7f136b55b700 1 -- start start 2023-10-06T02:56:13.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f136b55b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13640b49e0 0x7f13640aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:13.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f136b55b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13640b0ca0 con 0x7f13640b07a0 2023-10-06T02:56:13.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f136b55b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13640b0f80 con 0x7f13641595a0 2023-10-06T02:56:13.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f136b55b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640b1260 con 0x7f13640b49e0 2023-10-06T02:56:13.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f1369af8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f13640b07a0 0x7f13640b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38220/0 (socket says 172.21.15.84:38220) 2023-10-06T02:56:13.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f1369af8700 1 -- 172.21.15.84:0/3454666141 learned_addr learned my addr 172.21.15.84:0/3454666141 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:13.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855083083 0 0) 0x7f13640b0ca0 con 0x7f13640b07a0 2023-10-06T02:56:13.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1350003570 con 0x7f13640b07a0 2023-10-06T02:56:13.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f1368af6700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13640b49e0 0x7f13640aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:13.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1201138887 0 0) 0x7f1350003570 con 0x7f13640b07a0 2023-10-06T02:56:13.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13640b49e0 msgr2=0x7f13640aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:13.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13640b49e0 0x7f13640aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 >> v1:172.21.15.131:6789/0 conn(0x7f13641595a0 legacy=0x7f13640aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640b1540 con 0x7f13640b07a0 2023-10-06T02:56:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f135c0017f0 con 0x7f13640b07a0 2023-10-06T02:56:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f1368af6700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13640b49e0 0x7f13640aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 >> v1:172.21.15.84:6789/0 conn(0x7f13640b07a0 legacy=0x7f13640b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:13.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350003a90 0x7f1350003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:13.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1350004810 0x7f1350004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:13.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13640b49e0 0x7f1350005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:13.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13640b1260 con 0x7f1350003a90 2023-10-06T02:56:13.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135000bbf0 con 0x7f1350004810 2023-10-06T02:56:13.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135000bdb0 con 0x7f13640b49e0 2023-10-06T02:56:13.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.616+0000 7f13692f7700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350003a90 0x7f1350003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:13.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f1368af6700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1350004810 0x7f1350004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f1369af8700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13640b49e0 0x7f1350005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f13692f7700 1 -- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13640b49e0 msgr2=0x7f1350005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f13692f7700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f13640b49e0 0x7f1350005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f13692f7700 1 -- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1350004810 msgr2=0x7f1350004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f13692f7700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1350004810 0x7f1350004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f13692f7700 1 -- 172.21.15.84:0/3454666141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350003570 con 0x7f1350003a90 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f13692f7700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350003a90 0x7f1350003ea0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f13600018d0 tx=0x7f1360007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ae37acfedc0623 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360001290 con 0x7f1350003a90 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360012420 con 0x7f1350003a90 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f135bfff700 1 -- 172.21.15.84:0/3454666141 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600127e0 con 0x7f1350003a90 2023-10-06T02:56:13.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f136b55b700 1 -- 172.21.15.84:0/3454666141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350003a90 msgr2=0x7f1350003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f136b55b700 1 --2- 172.21.15.84:0/3454666141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1350003a90 0x7f1350003ea0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f13600018d0 tx=0x7f1360007d80 comp rx=0 tx=0).stop 2023-10-06T02:56:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f1369af8700 1 -- 172.21.15.84:0/3454666141 reap_dead start 2023-10-06T02:56:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f136b55b700 1 -- 172.21.15.84:0/3454666141 shutdown_connections 2023-10-06T02:56:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.617+0000 7f136b55b700 1 -- 172.21.15.84:0/3454666141 >> 172.21.15.84:0/3454666141 conn(0x7f1364099830 msgr2=0x7f136406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.618+0000 7f136b55b700 1 -- 172.21.15.84:0/3454666141 shutdown_connections 2023-10-06T02:56:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.618+0000 7f136b55b700 1 -- 172.21.15.84:0/3454666141 wait complete. 2023-10-06T02:56:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.619+0000 7f136b55b700 1 Processor -- start 2023-10-06T02:56:13.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.619+0000 7f136b55b700 1 -- start start 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.619+0000 7f136b55b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1350003a90 0x7f13640af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.619+0000 7f136b55b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136414eb80 0x7f1364159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.619+0000 7f136b55b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1364159eb0 0x7f13640b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.619+0000 7f136b55b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13640af8c0 con 0x7f136414eb80 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.619+0000 7f136b55b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136416dc80 con 0x7f1350003a90 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.619+0000 7f136b55b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136416d070 con 0x7f1364159eb0 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1368af6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136414eb80 0x7f1364159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1368af6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136414eb80 0x7f1364159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41838/0 (socket says 172.21.15.84:41838) 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1368af6700 1 -- 172.21.15.84:0/3273099671 learned_addr learned my addr 172.21.15.84:0/3273099671 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f13692f7700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1350003a90 0x7f13640af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:13.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1369af8700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1364159eb0 0x7f13640b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1368af6700 1 -- 172.21.15.84:0/3273099671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1364159eb0 msgr2=0x7f13640b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1368af6700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1364159eb0 0x7f13640b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1368af6700 1 -- 172.21.15.84:0/3273099671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1350003a90 msgr2=0x7f13640af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1368af6700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1350003a90 0x7f13640af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1368af6700 1 -- 172.21.15.84:0/3273099671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136416d350 con 0x7f136414eb80 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f1368af6700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136414eb80 0x7f1364159970 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1354011990 tx=0x7f1354008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f13597fa700 1 -- 172.21.15.84:0/3273099671 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400c070 con 0x7f136414eb80 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f13597fa700 1 -- 172.21.15.84:0/3273099671 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1354015670 con 0x7f136414eb80 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f13597fa700 1 -- 172.21.15.84:0/3273099671 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354015a30 con 0x7f136414eb80 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136416d630 con 0x7f136414eb80 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.620+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13640b3840 con 0x7f136414eb80 2023-10-06T02:56:13.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.621+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1364064ad0 con 0x7f136414eb80 2023-10-06T02:56:13.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.622+0000 7f13597fa700 1 -- 172.21.15.84:0/3273099671 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1354013410 con 0x7f136414eb80 2023-10-06T02:56:13.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.622+0000 7f13597fa700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1348066f30 0x7f13480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:13.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.622+0000 7f13597fa700 1 -- 172.21.15.84:0/3273099671 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f13540847f0 con 0x7f136414eb80 2023-10-06T02:56:13.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.622+0000 7f13692f7700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1348066f30 0x7f13480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:13.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.622+0000 7f13692f7700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1348066f30 0x7f13480693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1364151660 tx=0x7f1360015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:13.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.626+0000 7f13597fa700 1 -- 172.21.15.84:0/3273099671 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13540517c0 con 0x7f136414eb80 2023-10-06T02:56:13.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.850+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13640b1820 con 0x7f136414eb80 2023-10-06T02:56:13.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.851+0000 7f13597fa700 1 -- 172.21.15.84:0/3273099671 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f1354054de0 con 0x7f136414eb80 2023-10-06T02:56:13.852 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:13.852 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1815868063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1815868063},{"type":"v1","addr":"172.21.15.84:6836","nonce":1815868063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:56:04.813024+0000","modified":"2023-10-06T02:56:13.480955+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":5124,"mds_1":5115},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5115":{"gid":5115,"name":"c","rank":1,"incarnation":19,"state":"up:creating","state_seq":1,"addr":"172.21.15.84:6837/197493808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":197493808},{"type":"v1","addr":"172.21.15.84:6837","nonce":197493808}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5124":{"gid":5124,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6835/781245140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":781245140},{"type":"v1","addr":"172.21.15.131:6835","nonce":781245140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1348066f30 msgr2=0x7f13480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1348066f30 0x7f13480693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1364151660 tx=0x7f1360015000 comp rx=0 tx=0).stop 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136414eb80 msgr2=0x7f1364159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136414eb80 0x7f1364159970 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1354011990 tx=0x7f1354008040 comp rx=0 tx=0).stop 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 shutdown_connections 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1348066f30 0x7f13480693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1350003a90 0x7f13640af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1364159eb0 0x7f13640b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 --2- 172.21.15.84:0/3273099671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136414eb80 0x7f1364159970 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:13.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 >> 172.21.15.84:0/3273099671 conn(0x7f1364099830 msgr2=0x7f13641518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 shutdown_connections 2023-10-06T02:56:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:13.853+0000 7f136b55b700 1 -- 172.21.15.84:0/3273099671 wait complete. 2023-10-06T02:56:13.855 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 19 2023-10-06T02:56:14.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:56:04.813024+0000', 'modified': '2023-10-06T02:56:13.480955+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 5124, 'mds_1': 5115}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5115': {'gid': 5115, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.84:6837/197493808', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 197493808}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 197493808}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5124': {'gid': 5124, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.131:6835/781245140', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 781245140}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 781245140}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:56:14.268 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5115:up:creating 2023-10-06T02:56:15.269 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:56:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.385+0000 7ff91ea10700 1 Processor -- start 2023-10-06T02:56:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.385+0000 7ff91ea10700 1 -- start start 2023-10-06T02:56:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.386+0000 7ff91ea10700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180adba0 0x7ff9180ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.386+0000 7ff91ea10700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9180ce710 0x7ff91815af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.386+0000 7ff91ea10700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180ceb70 con 0x7ff9180ca3b0 2023-10-06T02:56:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.386+0000 7ff91ea10700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9180cbbd0 con 0x7ff9180ce710 2023-10-06T02:56:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.386+0000 7ff91ea10700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff918157e20 con 0x7ff9180adba0 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.386+0000 7ff91cfad700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9180ce710 0x7ff91815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.386+0000 7ff91cfad700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9180ce710 0x7ff91815af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41852/0 (socket says 172.21.15.84:41852) 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.386+0000 7ff91cfad700 1 -- 172.21.15.84:0/3074286565 learned_addr learned my addr 172.21.15.84:0/3074286565 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff9177fe700 1 --2- 172.21.15.84:0/3074286565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180adba0 0x7ff9180ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91cfad700 1 -- 172.21.15.84:0/3074286565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180adba0 msgr2=0x7ff9180ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91cfad700 1 --2- 172.21.15.84:0/3074286565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180adba0 0x7ff9180ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91cfad700 1 -- 172.21.15.84:0/3074286565 >> v1:172.21.15.131:6789/0 conn(0x7ff9180ca3b0 legacy=0x7ff9181582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91cfad700 1 -- 172.21.15.84:0/3074286565 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180cb610 con 0x7ff9180ce710 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91cfad700 1 --2- 172.21.15.84:0/3074286565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180ce710 0x7ff91815af10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff910009f20 tx=0x7ff910009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdd04456f1694c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff916ffd700 1 -- 172.21.15.84:0/3074286565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000e070 con 0x7ff9180ce710 2023-10-06T02:56:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff916ffd700 1 -- 172.21.15.84:0/3074286565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91000ba40 con 0x7ff9180ce710 2023-10-06T02:56:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff916ffd700 1 -- 172.21.15.84:0/3074286565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9100092e0 con 0x7ff9180ce710 2023-10-06T02:56:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91ea10700 1 -- 172.21.15.84:0/3074286565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180ce710 msgr2=0x7ff91815af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91ea10700 1 --2- 172.21.15.84:0/3074286565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180ce710 0x7ff91815af10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff910009f20 tx=0x7ff910009840 comp rx=0 tx=0).stop 2023-10-06T02:56:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91ea10700 1 -- 172.21.15.84:0/3074286565 shutdown_connections 2023-10-06T02:56:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91ea10700 1 --2- 172.21.15.84:0/3074286565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180ce710 0x7ff91815af10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91ea10700 1 --2- 172.21.15.84:0/3074286565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180adba0 0x7ff9180ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.387+0000 7ff91ea10700 1 -- 172.21.15.84:0/3074286565 >> 172.21.15.84:0/3074286565 conn(0x7ff918070810 msgr2=0x7ff918070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.388+0000 7ff91ea10700 1 -- 172.21.15.84:0/3074286565 shutdown_connections 2023-10-06T02:56:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.388+0000 7ff91ea10700 1 -- 172.21.15.84:0/3074286565 wait complete. 2023-10-06T02:56:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.389+0000 7ff91ea10700 1 Processor -- start 2023-10-06T02:56:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.389+0000 7ff91ea10700 1 -- start start 2023-10-06T02:56:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.389+0000 7ff91ea10700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180adba0 0x7ff918155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.389+0000 7ff91ea10700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9180ca3b0 0x7ff9180b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.389+0000 7ff91ea10700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180ce710 0x7ff9180b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.389+0000 7ff91ea10700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c1f00 con 0x7ff9180adba0 2023-10-06T02:56:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.389+0000 7ff91ea10700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff918156500 con 0x7ff9180ca3b0 2023-10-06T02:56:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.389+0000 7ff91ea10700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9181567e0 con 0x7ff9180ce710 2023-10-06T02:56:15.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff917fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180adba0 0x7ff918155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff917fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180adba0 0x7ff918155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41854/0 (socket says 172.21.15.84:41854) 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff917fff700 1 -- 172.21.15.84:0/2576703348 learned_addr learned my addr 172.21.15.84:0/2576703348 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff9177fe700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9180ca3b0 0x7ff9180b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff91cfad700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180ce710 0x7ff9180b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff917fff700 1 -- 172.21.15.84:0/2576703348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180ce710 msgr2=0x7ff9180b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff917fff700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180ce710 0x7ff9180b2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff917fff700 1 -- 172.21.15.84:0/2576703348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9180ca3b0 msgr2=0x7ff9180b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff917fff700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9180ca3b0 0x7ff9180b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff917fff700 1 -- 172.21.15.84:0/2576703348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910009ae0 con 0x7ff9180adba0 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff917fff700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180adba0 0x7ff918155f10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c5d0 tx=0x7ff908007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff8fffff700 1 -- 172.21.15.84:0/2576703348 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011590 con 0x7ff9180adba0 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff8fffff700 1 -- 172.21.15.84:0/2576703348 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908011710 con 0x7ff9180adba0 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff918156ac0 con 0x7ff9180adba0 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff8fffff700 1 -- 172.21.15.84:0/2576703348 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011ad0 con 0x7ff9180adba0 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.390+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9180b1600 con 0x7ff9180adba0 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.391+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9180cf190 con 0x7ff9180adba0 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.392+0000 7ff8fffff700 1 -- 172.21.15.84:0/2576703348 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff90801c460 con 0x7ff9180adba0 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.392+0000 7ff8fffff700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff904066f30 0x7ff9040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.392+0000 7ff9177fe700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff904066f30 0x7ff9040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.392+0000 7ff8fffff700 1 -- 172.21.15.84:0/2576703348 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff9080844f0 con 0x7ff9180adba0 2023-10-06T02:56:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.392+0000 7ff9177fe700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff904066f30 0x7ff9040693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff918151d50 tx=0x7ff90c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:15.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.396+0000 7ff8fffff700 1 -- 172.21.15.84:0/2576703348 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff908051420 con 0x7ff9180adba0 2023-10-06T02:56:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.624+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff918064ad0 con 0x7ff9180adba0 2023-10-06T02:56:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.625+0000 7ff8fffff700 1 -- 172.21.15.84:0/2576703348 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4622 (secure 0 0 0) 0x7ff908054a40 con 0x7ff9180adba0 2023-10-06T02:56:15.626 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:15.626 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:56:04.813024+0000","modified":"2023-10-06T02:56:15.489597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5124,"mds_1":5115,"mds_2":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6836/1815868063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1815868063},{"type":"v1","addr":"172.21.15.84:6836","nonce":1815868063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5115":{"gid":5115,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6837/197493808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":197493808},{"type":"v1","addr":"172.21.15.84:6837","nonce":197493808}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5124":{"gid":5124,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6835/781245140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":781245140},{"type":"v1","addr":"172.21.15.131:6835","nonce":781245140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:56:15.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff904066f30 msgr2=0x7ff9040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:15.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff904066f30 0x7ff9040693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff918151d50 tx=0x7ff90c008040 comp rx=0 tx=0).stop 2023-10-06T02:56:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180adba0 msgr2=0x7ff918155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180adba0 0x7ff918155f10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c5d0 tx=0x7ff908007f60 comp rx=0 tx=0).stop 2023-10-06T02:56:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 shutdown_connections 2023-10-06T02:56:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff904066f30 0x7ff9040693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9180ce710 0x7ff9180b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180adba0 0x7ff918155f10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 --2- 172.21.15.84:0/2576703348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9180ca3b0 0x7ff9180b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 >> 172.21.15.84:0/2576703348 conn(0x7ff918070810 msgr2=0x7ff9181534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 shutdown_connections 2023-10-06T02:56:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:15.627+0000 7ff91ea10700 1 -- 172.21.15.84:0/2576703348 wait complete. 2023-10-06T02:56:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 22 2023-10-06T02:56:16.042 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:56:04.813024+0000', 'modified': '2023-10-06T02:56:15.489597+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 5124, 'mds_1': 5115, 'mds_2': 5112}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5112': {'gid': 5112, 'name': 'a', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.84:6836/1815868063', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1815868063}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 1815868063}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5115': {'gid': 5115, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.84:6837/197493808', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 197493808}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 197493808}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5124': {'gid': 5124, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.131:6835/781245140', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 781245140}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 781245140}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:56:16.043 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-06T02:56:16.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:56:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.158+0000 7f6d163dd700 1 Processor -- start 2023-10-06T02:56:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.158+0000 7f6d163dd700 1 -- start start 2023-10-06T02:56:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d163dd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6d100b49e0 0x7f6d100aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d163dd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6d100b07a0 0x7f6d100b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d163dd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d100b0ca0 con 0x7f6d101595a0 2023-10-06T02:56:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d163dd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d100b0f80 con 0x7f6d100b07a0 2023-10-06T02:56:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d163dd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d100b1260 con 0x7f6d100b49e0 2023-10-06T02:56:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d1497a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6d100b07a0 0x7f6d100b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d1497a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6d100b07a0 0x7f6d100b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41862/0 (socket says 172.21.15.84:41862) 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d0ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6d101595a0 0x7f6d100aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38232/0 (socket says 172.21.15.84:38232) 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d1497a700 1 -- 172.21.15.84:0/2811438828 learned_addr learned my addr 172.21.15.84:0/2811438828 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/2811438828 >> v2:172.21.15.131:3300/0 conn(0x7f6d100b49e0 0x7f6d100aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d1497a700 1 -- 172.21.15.84:0/2811438828 >> v2:172.21.15.131:3300/0 conn(0x7f6d100b49e0 msgr2=0x7f6d100aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d1497a700 1 --2- 172.21.15.84:0/2811438828 >> v2:172.21.15.131:3300/0 conn(0x7f6d100b49e0 0x7f6d100aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d1497a700 1 -- 172.21.15.84:0/2811438828 >> v1:172.21.15.84:6789/0 conn(0x7f6d101595a0 legacy=0x7f6d100aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d1497a700 1 -- 172.21.15.84:0/2811438828 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d100b1540 con 0x7f6d100b07a0 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.159+0000 7f6d1497a700 1 --2- 172.21.15.84:0/2811438828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b07a0 0x7f6d100b1c00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009f20 tx=0x7f6d08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb87065e2d8767d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d0effd700 1 -- 172.21.15.84:0/2811438828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800e070 con 0x7f6d100b07a0 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d0effd700 1 -- 172.21.15.84:0/2811438828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0800ba40 con 0x7f6d100b07a0 2023-10-06T02:56:16.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d0effd700 1 -- 172.21.15.84:0/2811438828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080092e0 con 0x7f6d100b07a0 2023-10-06T02:56:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d163dd700 1 -- 172.21.15.84:0/2811438828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b07a0 msgr2=0x7f6d100b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d163dd700 1 --2- 172.21.15.84:0/2811438828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b07a0 0x7f6d100b1c00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009f20 tx=0x7f6d08009840 comp rx=0 tx=0).stop 2023-10-06T02:56:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d163dd700 1 -- 172.21.15.84:0/2811438828 shutdown_connections 2023-10-06T02:56:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d163dd700 1 --2- 172.21.15.84:0/2811438828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b07a0 0x7f6d100b1c00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d163dd700 1 --2- 172.21.15.84:0/2811438828 >> v2:172.21.15.131:3300/0 conn(0x7f6d100b49e0 0x7f6d100aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d163dd700 1 -- 172.21.15.84:0/2811438828 >> 172.21.15.84:0/2811438828 conn(0x7f6d10099830 msgr2=0x7f6d1006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d163dd700 1 -- 172.21.15.84:0/2811438828 shutdown_connections 2023-10-06T02:56:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.160+0000 7f6d163dd700 1 -- 172.21.15.84:0/2811438828 wait complete. 2023-10-06T02:56:16.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.161+0000 7f6d163dd700 1 Processor -- start 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.161+0000 7f6d163dd700 1 -- start start 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d163dd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d100b07a0 0x7f6d100adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d163dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b49e0 0x7f6d10147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d163dd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d101595a0 0x7f6d1015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d163dd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1009e0a0 con 0x7f6d100b49e0 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d163dd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10147790 con 0x7f6d101595a0 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d163dd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100aee50 con 0x7f6d100b07a0 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d0f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b49e0 0x7f6d10147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d0f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b49e0 0x7f6d10147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41878/0 (socket says 172.21.15.84:41878) 2023-10-06T02:56:16.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d0f7fe700 1 -- 172.21.15.84:0/372221955 learned_addr learned my addr 172.21.15.84:0/372221955 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d100b07a0 0x7f6d100adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d1497a700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d101595a0 0x7f6d1015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d0f7fe700 1 -- 172.21.15.84:0/372221955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d100b07a0 msgr2=0x7f6d100adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d100b07a0 0x7f6d100adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d0f7fe700 1 -- 172.21.15.84:0/372221955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d101595a0 msgr2=0x7f6d1015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d101595a0 0x7f6d1015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.162+0000 7f6d0f7fe700 1 -- 172.21.15.84:0/372221955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d08009ae0 con 0x7f6d100b49e0 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.163+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b49e0 0x7f6d10147250 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d890 tx=0x7f6d04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.163+0000 7f6cf7fff700 1 -- 172.21.15.84:0/372221955 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04012630 con 0x7f6d100b49e0 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.163+0000 7f6cf7fff700 1 -- 172.21.15.84:0/372221955 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d04012790 con 0x7f6d100b49e0 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.163+0000 7f6d163dd700 1 -- 172.21.15.84:0/372221955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1015c420 con 0x7f6d100b49e0 2023-10-06T02:56:16.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.163+0000 7f6cf7fff700 1 -- 172.21.15.84:0/372221955 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04012b50 con 0x7f6d100b49e0 2023-10-06T02:56:16.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.163+0000 7f6d163dd700 1 -- 172.21.15.84:0/372221955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d100ae520 con 0x7f6d100b49e0 2023-10-06T02:56:16.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.164+0000 7f6cf7fff700 1 -- 172.21.15.84:0/372221955 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d0401d400 con 0x7f6d100b49e0 2023-10-06T02:56:16.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.165+0000 7f6cf7fff700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6cfc066f30 0x7f6cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.165+0000 7f6cf7fff700 1 -- 172.21.15.84:0/372221955 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6d04084c10 con 0x7f6d100b49e0 2023-10-06T02:56:16.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.165+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6cfc066f30 0x7f6cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.165+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6cfc066f30 0x7f6cfc0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d00002790 tx=0x7f6d00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.166+0000 7f6d1f6d5b80 1 Processor -- start 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.167+0000 7f6d1f6d5b80 1 -- start start 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.167+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x56104742ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.167+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104747a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.167+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 0x56104747b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.167+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561047381a70 con 0x56104742a840 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.167+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104737f270 con 0x56104742bcc0 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.167+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56104737b060 con 0x56104747ac00 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.167+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x56104742ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x56104742ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41882/0 (socket says 172.21.15.84:41882) 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d0ffff700 1 -- 172.21.15.84:0/3561378134 learned_addr learned my addr 172.21.15.84:0/3561378134 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d1497a700 1 --2- 172.21.15.84:0/3561378134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 0x56104747b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/3561378134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104747a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d0ffff700 1 -- 172.21.15.84:0/3561378134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 msgr2=0x56104747b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/3561378134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 0x56104747b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d0ffff700 1 -- 172.21.15.84:0/3561378134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 msgr2=0x56104747a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/3561378134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104747a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d0ffff700 1 -- 172.21.15.84:0/3561378134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561047215270 con 0x56104742a840 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/3561378134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x56104742ac10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6d00007550 tx=0x7f6d00013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afaf9d4ca6445f03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6cf57fa700 1 -- 172.21.15.84:0/3561378134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000076b0 con 0x56104742a840 2023-10-06T02:56:16.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6cf57fa700 1 -- 172.21.15.84:0/3561378134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00012590 con 0x56104742a840 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.168+0000 7f6cf57fa700 1 -- 172.21.15.84:0/3561378134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00012910 con 0x56104742a840 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/3561378134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 msgr2=0x56104742ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/3561378134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x56104742ac10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6d00007550 tx=0x7f6d00013000 comp rx=0 tx=0).stop 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/3561378134 shutdown_connections 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/3561378134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 0x56104747b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/3561378134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x56104742ac10 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/3561378134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104747a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/3561378134 >> 172.21.15.84:0/3561378134 conn(0x56104742c160 msgr2=0x56104742c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/3561378134 shutdown_connections 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/3561378134 wait complete. 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 -- start start 2023-10-06T02:56:16.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.169+0000 7f6d1f6d5b80 1 Processor -- start 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 0x561047473560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x561047453ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x561047477ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561047326890 con 0x56104747ac00 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561047341ea0 con 0x56104742bcc0 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610471fde30 con 0x56104742a840 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1f6d5b80 10 client.0 _ll_register_callbacks cb 0x5610473ede70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1497a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x561047477ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1497a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x561047477ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41894/0 (socket says 172.21.15.84:41894) 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d1497a700 1 -- 172.21.15.84:0/2908924749 learned_addr learned my addr 172.21.15.84:0/2908924749 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 0x561047473560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.170+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x561047453ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1497a700 1 -- 172.21.15.84:0/2908924749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 msgr2=0x561047473560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1497a700 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 0x561047473560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1497a700 1 -- 172.21.15.84:0/2908924749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 msgr2=0x561047453ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1497a700 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x561047453ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1497a700 1 -- 172.21.15.84:0/2908924749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0000f040 con 0x56104747ac00 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1497a700 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x561047477ea0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6d10067c60 tx=0x7f6d08018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89d803b5627fc33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6cee7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6cee7fc700 1 -- 172.21.15.84:0/2908924749 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080092e0 con 0x56104747ac00 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6cee7fc700 1 -- 172.21.15.84:0/2908924749 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6d0800be50 con 0x56104747ac00 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/2908924749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56104741f940 con 0x56104747ac00 2023-10-06T02:56:16.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6cee7fc700 1 -- 172.21.15.84:0/2908924749 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d08007200 con 0x56104747ac00 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1f6d5b80 10 client.5370 fetch_fsmap learned FSMap version 22 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/2908924749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5610471b7fe0 con 0x56104747ac00 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6cee7fc700 1 -- 172.21.15.84:0/2908924749 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56104741f940 con 0x56104747ac00 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6cee7fc700 1 -- 172.21.15.84:0/2908924749 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 22) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f6d0800b050 con 0x56104747ac00 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1f6d5b80 10 client.5370 fetch_fsmap finished waiting for FSMap version 22 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1f6d5b80 10 client.5370 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1f6d5b80 20 client.5370 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x561047478740 0x5610474698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1f6d5b80 4 client.5370 mds_command: new command op to 5112 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.171+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/2908924749 --> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610473fc870 con 0x561047478740 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.172+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x561047478740 0x5610474698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.172+0000 7f6cee7fc700 10 client.5370 ms_handle_connect on v2:172.21.15.84:6834/1815868063 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.172+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x561047478740 0x5610474698b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b18446cd807a632e server_cookie=b01ff67bc46175b2 in_seq=0 out_seq=0 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.172+0000 7f6cee7fc700 1 -- 172.21.15.84:0/2908924749 <== mds.2 v2:172.21.15.84:6834/1815868063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5610473fc870 con 0x561047478740 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.172+0000 7f6cee7fc700 10 client.5370 handle_command_reply: tid=0 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.172+0000 7f6d1f6d5b80 1 client.5370 shutdown 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.172+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/2908924749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 msgr2=0x561047477ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.172+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x561047477ea0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6d10067c60 tx=0x7f6d08018000 comp rx=0 tx=0).stop 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/2908924749 shutdown_connections 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x561047478740 0x5610474698b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x561047477ea0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 0x561047473560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/2908924749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x561047453ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6cee7fc700 0 client.5370 ms_handle_reset on v2:172.21.15.84:6834/1815868063 2023-10-06T02:56:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/2908924749 >> 172.21.15.84:0/2908924749 conn(0x56104742c160 msgr2=0x56104746ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/2908924749 shutdown_connections 2023-10-06T02:56:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/2908924749 wait complete. 2023-10-06T02:56:16.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.173+0000 7f6d1f6d5b80 20 client.5370 trim_cache size 0 max 16384 2023-10-06T02:56:16.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.189+0000 7f6d1f6d5b80 1 Processor -- start 2023-10-06T02:56:16.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.189+0000 7f6d1f6d5b80 1 -- start start 2023-10-06T02:56:16.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 0x56104746e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104746ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x5610474527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561047425620 con 0x56104747ac00 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610474721e0 con 0x56104742bcc0 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56104740a2e0 con 0x56104742a840 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1497a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x5610474527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1497a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x5610474527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41902/0 (socket says 172.21.15.84:41902) 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1497a700 1 -- 172.21.15.84:0/1450881246 learned_addr learned my addr 172.21.15.84:0/1450881246 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 0x56104746e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.190+0000 7f6d1497a700 1 -- 172.21.15.84:0/1450881246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 msgr2=0x56104746e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6d1497a700 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 0x56104746e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6d1497a700 1 -- 172.21.15.84:0/1450881246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 msgr2=0x56104746ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104746ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6d1497a700 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104746ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6d1497a700 1 -- 172.21.15.84:0/1450881246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561047349780 con 0x56104747ac00 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104746ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6d1497a700 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x5610474527b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d080070c0 tx=0x7f6d08021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a752d8b7c46b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6cf5ffb700 1 -- 172.21.15.84:0/1450881246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08037070 con 0x56104747ac00 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6cf5ffb700 1 -- 172.21.15.84:0/1450881246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0801f650 con 0x56104747ac00 2023-10-06T02:56:16.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6cf5ffb700 1 -- 172.21.15.84:0/1450881246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080092e0 con 0x56104747ac00 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1450881246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 msgr2=0x5610474527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.191+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x5610474527b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d080070c0 tx=0x7f6d08021070 comp rx=0 tx=0).stop 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.192+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1450881246 shutdown_connections 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.192+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104747ac00 0x5610474527b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.192+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104742a840 0x56104746e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.192+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1450881246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104746ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.192+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1450881246 >> 172.21.15.84:0/1450881246 conn(0x56104742c160 msgr2=0x561047473870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.192+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1450881246 shutdown_connections 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.192+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1450881246 wait complete. 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.192+0000 7f6d1f6d5b80 1 -- start start 2023-10-06T02:56:16.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.192+0000 7f6d1f6d5b80 1 Processor -- start 2023-10-06T02:56:16.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x561047483a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104746e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d1f6d5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 0x56104746ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561047483fa0 con 0x56104742a840 2023-10-06T02:56:16.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610474d7b80 con 0x56104742bcc0 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d1f6d5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610474532c0 con 0x56104747ac00 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d1f6d5b80 10 client.0 _ll_register_callbacks cb 0x5610473ede70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x561047483a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x561047483a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41904/0 (socket says 172.21.15.84:41904) 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0ffff700 1 -- 172.21.15.84:0/1754342385 learned_addr learned my addr 172.21.15.84:0/1754342385 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d1497a700 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 0x56104746ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104746e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0ffff700 1 -- 172.21.15.84:0/1754342385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 msgr2=0x56104746ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 0x56104746ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0ffff700 1 -- 172.21.15.84:0/1754342385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 msgr2=0x56104746e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104746e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0ffff700 1 -- 172.21.15.84:0/1754342385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610471b7fe0 con 0x56104742a840 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6d0ffff700 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x561047483a60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6d00007520 tx=0x7f6d00024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c87044a563ac28b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6cee7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.193+0000 7f6cee7fc700 1 -- 172.21.15.84:0/1754342385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00012700 con 0x56104742a840 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6cee7fc700 1 -- 172.21.15.84:0/1754342385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6d00012860 con 0x56104742a840 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1754342385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d00012590 con 0x56104742a840 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6cee7fc700 1 -- 172.21.15.84:0/1754342385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d0002f5b0 con 0x56104742a840 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 10 client.5376 fetch_fsmap learned FSMap version 22 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1754342385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561047330470 con 0x56104742a840 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6cee7fc700 1 -- 172.21.15.84:0/1754342385 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00012590 con 0x56104742a840 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6cee7fc700 1 -- 172.21.15.84:0/1754342385 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 22) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f6d0002f710 con 0x56104742a840 2023-10-06T02:56:16.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 10 client.5376 fetch_fsmap finished waiting for FSMap version 22 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 10 client.5376 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 20 client.5376 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x561047478f20 0x5610474792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 4 client.5376 mds_command: new command op to 5112 tid=0[{"prefix": "status"}] 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1754342385 --> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56104731de00 con 0x561047478f20 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x561047478f20 0x5610474792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6cee7fc700 10 client.5376 ms_handle_connect on v2:172.21.15.84:6834/1815868063 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d0f7fe700 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x561047478f20 0x5610474792f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ade87dee3db2325 server_cookie=ff4aa6e17efd79af in_seq=0 out_seq=0 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6cee7fc700 1 -- 172.21.15.84:0/1754342385 <== mds.2 v2:172.21.15.84:6834/1815868063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56104731de00 con 0x561047478f20 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6cee7fc700 10 client.5376 handle_command_reply: tid=0 2023-10-06T02:56:16.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.194+0000 7f6d1f6d5b80 1 client.5376 shutdown 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1754342385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 msgr2=0x561047483a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x561047483a60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6d00007520 tx=0x7f6d00024040 comp rx=0 tx=0).stop 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1754342385 shutdown_connections 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x561047478f20 0x5610474792f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56104747ac00 0x56104746ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6cee7fc700 0 client.5376 ms_handle_reset on v2:172.21.15.84:6834/1815868063 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56104742a840 0x561047483a60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 --2- 172.21.15.84:0/1754342385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56104742bcc0 0x56104746e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1754342385 >> 172.21.15.84:0/1754342385 conn(0x56104742c160 msgr2=0x561047469db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1754342385 shutdown_connections 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 1 -- 172.21.15.84:0/1754342385 wait complete. 2023-10-06T02:56:16.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d1f6d5b80 20 client.5376 trim_cache size 0 max 16384 2023-10-06T02:56:16.204 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:56:16.204 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:56:16.204 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2023-10-06T02:56:16.204 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5112, 2023-10-06T02:56:16.204 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:56:16.204 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:56:16.204 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:56:16.204 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 1.7071358130000001, 2023-10-06T02:56:16.205 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 22, 2023-10-06T02:56:16.205 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 42, 2023-10-06T02:56:16.205 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 42, 2023-10-06T02:56:16.205 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 19.644673102999999 2023-10-06T02:56:16.205 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:56:16.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 -- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6cfc066f30 msgr2=0x7f6cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6cfc066f30 0x7f6cfc0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d00002790 tx=0x7f6d00009040 comp rx=0 tx=0).stop 2023-10-06T02:56:16.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 -- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b49e0 msgr2=0x7f6d10147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b49e0 0x7f6d10147250 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400d890 tx=0x7f6d04008040 comp rx=0 tx=0).stop 2023-10-06T02:56:16.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 -- 172.21.15.84:0/372221955 shutdown_connections 2023-10-06T02:56:16.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6cfc066f30 0x7f6cfc0693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d101595a0 0x7f6d1015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d100b07a0 0x7f6d100adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 --2- 172.21.15.84:0/372221955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d100b49e0 0x7f6d10147250 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 -- 172.21.15.84:0/372221955 >> 172.21.15.84:0/372221955 conn(0x7f6d10099830 msgr2=0x7f6d10158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 -- 172.21.15.84:0/372221955 shutdown_connections 2023-10-06T02:56:16.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.195+0000 7f6d163dd700 1 -- 172.21.15.84:0/372221955 wait complete. 2023-10-06T02:56:16.208 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:56:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.322+0000 7f2c7ffff700 1 Processor -- start 2023-10-06T02:56:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.322+0000 7f2c7ffff700 1 -- start start 2023-10-06T02:56:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c7ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2c800cbc70 0x7f2c800cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c7ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 0x7f2c800b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c7ffff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c800cb7e0 con 0x7f2c80159480 2023-10-06T02:56:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c7ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c800b08a0 con 0x7f2c800cbc70 2023-10-06T02:56:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c7ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800cb190 con 0x7f2c800b2140 2023-10-06T02:56:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c767fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2c800cbc70 0x7f2c800cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c767fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2c800cbc70 0x7f2c800cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41906/0 (socket says 172.21.15.84:41906) 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c767fc700 1 -- 172.21.15.84:0/818160775 learned_addr learned my addr 172.21.15.84:0/818160775 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/818160775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 0x7f2c800b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c767fc700 1 -- 172.21.15.84:0/818160775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 msgr2=0x7f2c800b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c767fc700 1 --2- 172.21.15.84:0/818160775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 0x7f2c800b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c767fc700 1 -- 172.21.15.84:0/818160775 >> v1:172.21.15.131:6789/0 conn(0x7f2c80159480 legacy=0x7f2c800b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c767fc700 1 -- 172.21.15.84:0/818160775 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800cb470 con 0x7f2c800cbc70 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.323+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/818160775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 0x7f2c800b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c767fc700 1 --2- 172.21.15.84:0/818160775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 0x7f2c800cc0c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2c680099b0 tx=0x7f2c68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1328e7817aa39e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7e7fc700 1 -- 172.21.15.84:0/818160775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800b860 con 0x7f2c800cbc70 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7e7fc700 1 -- 172.21.15.84:0/818160775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6800b9c0 con 0x7f2c800cbc70 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7e7fc700 1 -- 172.21.15.84:0/818160775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800bd60 con 0x7f2c800cbc70 2023-10-06T02:56:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7ffff700 1 -- 172.21.15.84:0/818160775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 msgr2=0x7f2c800cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7ffff700 1 --2- 172.21.15.84:0/818160775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 0x7f2c800cc0c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2c680099b0 tx=0x7f2c68009250 comp rx=0 tx=0).stop 2023-10-06T02:56:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7ffff700 1 -- 172.21.15.84:0/818160775 shutdown_connections 2023-10-06T02:56:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7ffff700 1 --2- 172.21.15.84:0/818160775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 0x7f2c800b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7ffff700 1 --2- 172.21.15.84:0/818160775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 0x7f2c800cc0c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7ffff700 1 -- 172.21.15.84:0/818160775 >> 172.21.15.84:0/818160775 conn(0x7f2c8006ed20 msgr2=0x7f2c8006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7ffff700 1 -- 172.21.15.84:0/818160775 shutdown_connections 2023-10-06T02:56:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.324+0000 7f2c7ffff700 1 -- 172.21.15.84:0/818160775 wait complete. 2023-10-06T02:56:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.325+0000 7f2c7ffff700 1 Processor -- start 2023-10-06T02:56:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.325+0000 7f2c7ffff700 1 -- start start 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c7ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 0x7f2c800c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 0x7f2c8015e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c7ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c80159480 0x7f2c80169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c7ffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800ca190 con 0x7f2c800cbc70 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c7ffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8015f5b0 con 0x7f2c80159480 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c7ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800c77b0 con 0x7f2c800b2140 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c767fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 0x7f2c8015e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c767fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 0x7f2c8015e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41910/0 (socket says 172.21.15.84:41910) 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c767fc700 1 -- 172.21.15.84:0/3151606537 learned_addr learned my addr 172.21.15.84:0/3151606537 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c7effd700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 0x7f2c800c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.326+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c80159480 0x7f2c80169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c767fc700 1 -- 172.21.15.84:0/3151606537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 msgr2=0x7f2c800c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c767fc700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 0x7f2c800c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c767fc700 1 -- 172.21.15.84:0/3151606537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c80159480 msgr2=0x7f2c80169780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c767fc700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c80159480 0x7f2c80169780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c767fc700 1 -- 172.21.15.84:0/3151606537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c680094f0 con 0x7f2c800cbc70 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c80159480 0x7f2c80169780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c767fc700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 0x7f2c8015e860 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2c680090b0 tx=0x7f2c68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c777fe700 1 -- 172.21.15.84:0/3151606537 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011e70 con 0x7f2c800cbc70 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c777fe700 1 -- 172.21.15.84:0/3151606537 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6801f070 con 0x7f2c800cbc70 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c777fe700 1 -- 172.21.15.84:0/3151606537 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680266d0 con 0x7f2c800cbc70 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c7ffff700 1 -- 172.21.15.84:0/3151606537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8015eda0 con 0x7f2c800cbc70 2023-10-06T02:56:16.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.327+0000 7f2c7ffff700 1 -- 172.21.15.84:0/3151606537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8015f2d0 con 0x7f2c800cbc70 2023-10-06T02:56:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.328+0000 7f2c777fe700 1 -- 172.21.15.84:0/3151606537 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c68026a40 con 0x7f2c800cbc70 2023-10-06T02:56:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.328+0000 7f2c777fe700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2c60066f30 0x7f2c600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.329+0000 7f2c777fe700 1 -- 172.21.15.84:0/3151606537 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2c68021070 con 0x7f2c800cbc70 2023-10-06T02:56:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.329+0000 7f2c7effd700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2c60066f30 0x7f2c600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.329+0000 7f2c7effd700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2c60066f30 0x7f2c600693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2c800cc5d0 tx=0x7f2c70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.330+0000 7f2c8ecfbb80 1 Processor -- start 2023-10-06T02:56:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c8ecfbb80 1 -- start start 2023-10-06T02:56:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a335390cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a335391200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a335391740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3352eba70 con 0x55a3353962c0 2023-10-06T02:56:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3352e9270 con 0x55a335397a10 2023-10-06T02:56:16.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3352e5060 con 0x55a3353b5e50 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c767fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a335391200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c767fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a335391200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41916/0 (socket says 172.21.15.84:41916) 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.331+0000 7f2c767fc700 1 -- 172.21.15.84:0/2975656982 learned_addr learned my addr 172.21.15.84:0/2975656982 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c7effd700 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a335390cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a335391740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c767fc700 1 -- 172.21.15.84:0/2975656982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 msgr2=0x55a335390cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c767fc700 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a335390cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c767fc700 1 -- 172.21.15.84:0/2975656982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 msgr2=0x55a335391740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c767fc700 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a335391740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c767fc700 1 -- 172.21.15.84:0/2975656982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a33517f270 con 0x55a3353962c0 2023-10-06T02:56:16.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a335391740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c767fc700 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a335391200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800b400 tx=0x7f2c68084710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6833b646153a355d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c5ffff700 1 -- 172.21.15.84:0/2975656982 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680571c0 con 0x55a3353962c0 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c5ffff700 1 -- 172.21.15.84:0/2975656982 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6805a410 con 0x55a3353962c0 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.332+0000 7f2c5ffff700 1 -- 172.21.15.84:0/2975656982 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6805e160 con 0x55a3353962c0 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/2975656982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 msgr2=0x55a335391200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a335391200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800b400 tx=0x7f2c68084710 comp rx=0 tx=0).stop 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/2975656982 shutdown_connections 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a335391740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a335390cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/2975656982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a335391200 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/2975656982 >> 172.21.15.84:0/2975656982 conn(0x55a335395e80 msgr2=0x55a3353966b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/2975656982 shutdown_connections 2023-10-06T02:56:16.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/2975656982 wait complete. 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 -- start start 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.333+0000 7f2c8ecfbb80 1 Processor -- start 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353c1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a3353ae950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a335290890 con 0x55a3353962c0 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3352abea0 con 0x55a335397a10 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a335167e30 con 0x55a3353b5e50 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c7effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353c1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c8ecfbb80 10 client.0 _ll_register_callbacks cb 0x55a335358020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c7effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353c1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41920/0 (socket says 172.21.15.84:41920) 2023-10-06T02:56:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c7effd700 1 -- 172.21.15.84:0/723214376 learned_addr learned my addr 172.21.15.84:0/723214376 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a3353ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.334+0000 7f2c767fc700 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c7effd700 1 -- 172.21.15.84:0/723214376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 msgr2=0x55a3353ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c7effd700 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a3353ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c7effd700 1 -- 172.21.15.84:0/723214376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 msgr2=0x55a3353ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c7effd700 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c7effd700 1 -- 172.21.15.84:0/723214376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8015f2d0 con 0x55a3353962c0 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c767fc700 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c7effd700 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353c1210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c700145a0 tx=0x7f2c70015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0806255b771f60b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c5d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:16.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/723214376 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70014d20 con 0x55a3353962c0 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/723214376 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2c7001c040 con 0x55a3353962c0 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/723214376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a335389940 con 0x55a3353962c0 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/723214376 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c70014e80 con 0x55a3353962c0 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c8ecfbb80 10 client.5388 fetch_fsmap learned FSMap version 22 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/723214376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55a335121fe0 con 0x55a3353962c0 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/723214376 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a335389940 con 0x55a3353962c0 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/723214376 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 22) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f2c7002c3b0 con 0x55a3353962c0 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c8ecfbb80 10 client.5388 fetch_fsmap finished waiting for FSMap version 22 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c8ecfbb80 10 client.5388 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c8ecfbb80 20 client.5388 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55a3353eea80 0x55a3353f8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c8ecfbb80 4 client.5388 mds_command: new command op to 5115 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.335+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/723214376 --> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a335366870 con 0x55a3353eea80 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.336+0000 7f2c767fc700 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55a3353eea80 0x55a3353f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.336+0000 7f2c5d7fa700 10 client.5388 ms_handle_connect on v2:172.21.15.84:6835/197493808 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.336+0000 7f2c767fc700 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55a3353eea80 0x55a3353f8460 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ede08cf0ab11bcc server_cookie=f2ab56ad52e5a1b5 in_seq=0 out_seq=0 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.336+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/723214376 <== mds.1 v2:172.21.15.84:6835/197493808 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a335366870 con 0x55a3353eea80 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.336+0000 7f2c5d7fa700 10 client.5388 handle_command_reply: tid=0 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.336+0000 7f2c8ecfbb80 1 client.5388 shutdown 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.336+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/723214376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 msgr2=0x55a3353c1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.336+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353c1210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c700145a0 tx=0x7f2c70015000 comp rx=0 tx=0).stop 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/723214376 shutdown_connections 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55a3353eea80 0x55a3353f8460 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a3353ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353c1210 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/723214376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c5d7fa700 0 client.5388 ms_handle_reset on v2:172.21.15.84:6835/197493808 2023-10-06T02:56:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/723214376 >> 172.21.15.84:0/723214376 conn(0x55a335395e80 msgr2=0x55a3353b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/723214376 shutdown_connections 2023-10-06T02:56:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/723214376 wait complete. 2023-10-06T02:56:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.337+0000 7f2c8ecfbb80 20 client.5388 trim_cache size 0 max 16384 2023-10-06T02:56:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.353+0000 7f2c8ecfbb80 1 Processor -- start 2023-10-06T02:56:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c8ecfbb80 1 -- start start 2023-10-06T02:56:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353962c0 0x55a335394b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353b5e50 0x55a3353ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a335394020 con 0x55a3353b5e50 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3353ae1f0 con 0x55a335397a10 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3353aaf30 con 0x55a3353962c0 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c7f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353b5e50 0x55a3353ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c7f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353b5e50 0x55a3353ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41936/0 (socket says 172.21.15.84:41936) 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.354+0000 7f2c7f7fe700 1 -- 172.21.15.84:0/3931212441 learned_addr learned my addr 172.21.15.84:0/3931212441 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c7effd700 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353962c0 0x55a335394b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c767fc700 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c7f7fe700 1 -- 172.21.15.84:0/3931212441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353962c0 msgr2=0x55a335394b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353962c0 0x55a335394b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c7f7fe700 1 -- 172.21.15.84:0/3931212441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 msgr2=0x55a3353ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c7f7fe700 1 -- 172.21.15.84:0/3931212441 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3352b3780 con 0x55a3353b5e50 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c767fc700 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353b5e50 0x55a3353ae8d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2c78007480 tx=0x7f2c7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca401918c3622a87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c74ff9700 1 -- 172.21.15.84:0/3931212441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78017470 con 0x55a3353b5e50 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c74ff9700 1 -- 172.21.15.84:0/3931212441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c780175d0 con 0x55a3353b5e50 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c74ff9700 1 -- 172.21.15.84:0/3931212441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78017950 con 0x55a3353b5e50 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/3931212441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353b5e50 msgr2=0x55a3353ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353b5e50 0x55a3353ae8d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2c78007480 tx=0x7f2c7800b040 comp rx=0 tx=0).stop 2023-10-06T02:56:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/3931212441 shutdown_connections 2023-10-06T02:56:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353b5e50 0x55a3353ae8d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353962c0 0x55a335394b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/3931212441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a3353ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/3931212441 >> 172.21.15.84:0/3931212441 conn(0x55a335395e80 msgr2=0x55a3353fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.355+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/3931212441 shutdown_connections 2023-10-06T02:56:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.356+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/3931212441 wait complete. 2023-10-06T02:56:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.356+0000 7f2c8ecfbb80 1 -- start start 2023-10-06T02:56:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.356+0000 7f2c8ecfbb80 1 Processor -- start 2023-10-06T02:56:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353ed600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a33543b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c8ecfbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a335391170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3353dd600 con 0x55a3353962c0 2023-10-06T02:56:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3353ddf50 con 0x55a335397a10 2023-10-06T02:56:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c8ecfbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3353edd00 con 0x55a3353b5e50 2023-10-06T02:56:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c8ecfbb80 10 client.0 _ll_register_callbacks cb 0x55a335358020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:16.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c7effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c7effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353ed600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41938/0 (socket says 172.21.15.84:41938) 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c7effd700 1 -- 172.21.15.84:0/1738797748 learned_addr learned my addr 172.21.15.84:0/1738797748 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c767fc700 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a33543b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c7f7fe700 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a335391170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c7effd700 1 -- 172.21.15.84:0/1738797748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 msgr2=0x55a335391170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c7effd700 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a335391170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c7effd700 1 -- 172.21.15.84:0/1738797748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 msgr2=0x55a33543b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c7effd700 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a33543b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.357+0000 7f2c7effd700 1 -- 172.21.15.84:0/1738797748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c78011040 con 0x55a3353962c0 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c7effd700 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353ed600 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c700149e0 tx=0x7f2c7001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed94bac3c8caada server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c5d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:16.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/1738797748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7002c870 con 0x55a3353962c0 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/1738797748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2c70021430 con 0x55a3353962c0 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/1738797748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c6805a410 con 0x55a3353962c0 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/1738797748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c7002c9d0 con 0x55a3353962c0 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c8ecfbb80 10 client.5394 fetch_fsmap learned FSMap version 22 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/1738797748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55a33529a470 con 0x55a3353962c0 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/1738797748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6805a410 con 0x55a3353962c0 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/1738797748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 22) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f2c70012070 con 0x55a3353962c0 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c8ecfbb80 10 client.5394 fetch_fsmap finished waiting for FSMap version 22 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c8ecfbb80 10 client.5394 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c8ecfbb80 20 client.5394 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55a3353ae330 0x55a3353ae700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c8ecfbb80 4 client.5394 mds_command: new command op to 5115 tid=0[{"prefix": "status"}] 2023-10-06T02:56:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/1738797748 --> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a335287e00 con 0x55a3353ae330 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c767fc700 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55a3353ae330 0x55a3353ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c5d7fa700 10 client.5394 ms_handle_connect on v2:172.21.15.84:6835/197493808 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.358+0000 7f2c767fc700 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55a3353ae330 0x55a3353ae700 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a077f03dc2c2cc server_cookie=62ce7b6738d70e5e in_seq=0 out_seq=0 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c5d7fa700 1 -- 172.21.15.84:0/1738797748 <== mds.1 v2:172.21.15.84:6835/197493808 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a335287e00 con 0x55a3353ae330 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c5d7fa700 10 client.5394 handle_command_reply: tid=0 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 client.5394 shutdown 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/1738797748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 msgr2=0x55a3353ed600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353ed600 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c700149e0 tx=0x7f2c7001b000 comp rx=0 tx=0).stop 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/1738797748 shutdown_connections 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55a3353ae330 0x55a3353ae700 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a3353b5e50 0x55a335391170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3353962c0 0x55a3353ed600 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 --2- 172.21.15.84:0/1738797748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a335397a10 0x55a33543b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c5d7fa700 0 client.5394 ms_handle_reset on v2:172.21.15.84:6835/197493808 2023-10-06T02:56:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/1738797748 >> 172.21.15.84:0/1738797748 conn(0x55a335395e80 msgr2=0x55a335395700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/1738797748 shutdown_connections 2023-10-06T02:56:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 1 -- 172.21.15.84:0/1738797748 wait complete. 2023-10-06T02:56:16.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c8ecfbb80 20 client.5394 trim_cache size 0 max 16384 2023-10-06T02:56:16.367 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:56:16.367 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5115, 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 2.8770159300000002, 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 22, 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 42, 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 42, 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 19.808727395999998 2023-10-06T02:56:16.368 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:56:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c7ffff700 1 -- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2c60066f30 msgr2=0x7f2c600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c7ffff700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2c60066f30 0x7f2c600693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2c800cc5d0 tx=0x7f2c70009040 comp rx=0 tx=0).stop 2023-10-06T02:56:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c7ffff700 1 -- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 msgr2=0x7f2c8015e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.359+0000 7f2c7ffff700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 0x7f2c8015e860 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2c680090b0 tx=0x7f2c68017000 comp rx=0 tx=0).stop 2023-10-06T02:56:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.360+0000 7f2c7ffff700 1 -- 172.21.15.84:0/3151606537 shutdown_connections 2023-10-06T02:56:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.360+0000 7f2c7ffff700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2c60066f30 0x7f2c600693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.360+0000 7f2c7ffff700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c80159480 0x7f2c80169780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.360+0000 7f2c7ffff700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2c800b2140 0x7f2c800c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.360+0000 7f2c7ffff700 1 --2- 172.21.15.84:0/3151606537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c800cbc70 0x7f2c8015e860 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.360+0000 7f2c7ffff700 1 -- 172.21.15.84:0/3151606537 >> 172.21.15.84:0/3151606537 conn(0x7f2c8006ed20 msgr2=0x7f2c80155320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.360+0000 7f2c7ffff700 1 -- 172.21.15.84:0/3151606537 shutdown_connections 2023-10-06T02:56:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.360+0000 7f2c7ffff700 1 -- 172.21.15.84:0/3151606537 wait complete. 2023-10-06T02:56:16.372 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T02:56:16.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.487+0000 7f22fc9fd700 1 Processor -- start 2023-10-06T02:56:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.487+0000 7f22fc9fd700 1 -- start start 2023-10-06T02:56:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.487+0000 7f22fc9fd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f22f81595a0 0x7f22f80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.487+0000 7f22fc9fd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f80b0ca0 con 0x7f22f80b07a0 2023-10-06T02:56:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.487+0000 7f22fc9fd700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f80b0f80 con 0x7f22f80b49e0 2023-10-06T02:56:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.487+0000 7f22fc9fd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f80b1260 con 0x7f22f81595a0 2023-10-06T02:56:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f22f81595a0 0x7f22f80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f22f80b07a0 0x7f22f80b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38238/0 (socket says 172.21.15.84:38238) 2023-10-06T02:56:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f6d9d700 1 -- 172.21.15.84:0/1567365994 learned_addr learned my addr 172.21.15.84:0/1567365994 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f659c700 1 -- 172.21.15.84:0/1567365994 >> v1:172.21.15.131:6789/0 conn(0x7f22f80b49e0 legacy=0x7f22f80aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f659c700 1 -- 172.21.15.84:0/1567365994 >> v1:172.21.15.84:6789/0 conn(0x7f22f80b07a0 legacy=0x7f22f80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f5d9b700 1 -- 172.21.15.84:0/1567365994 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660205857 0 0) 0x7f22f80b0ca0 con 0x7f22f80b07a0 2023-10-06T02:56:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f659c700 1 -- 172.21.15.84:0/1567365994 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80b1540 con 0x7f22f81595a0 2023-10-06T02:56:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f659c700 1 --2- 172.21.15.84:0/1567365994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 0x7f22f80aa570 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009900 tx=0x7f22e8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9fdf34a16f11b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f5d9b700 1 -- 172.21.15.84:0/1567365994 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8009ea0 con 0x7f22f81595a0 2023-10-06T02:56:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f5d9b700 1 -- 172.21.15.84:0/1567365994 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e8005c10 con 0x7f22f81595a0 2023-10-06T02:56:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.488+0000 7f22f5d9b700 1 -- 172.21.15.84:0/1567365994 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e800b610 con 0x7f22f81595a0 2023-10-06T02:56:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.489+0000 7f22fc9fd700 1 -- 172.21.15.84:0/1567365994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 msgr2=0x7f22f80aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.489+0000 7f22fc9fd700 1 --2- 172.21.15.84:0/1567365994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 0x7f22f80aa570 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009900 tx=0x7f22e8009120 comp rx=0 tx=0).stop 2023-10-06T02:56:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.489+0000 7f22fc9fd700 1 -- 172.21.15.84:0/1567365994 shutdown_connections 2023-10-06T02:56:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.489+0000 7f22fc9fd700 1 --2- 172.21.15.84:0/1567365994 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 0x7f22f80aa570 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.489+0000 7f22fc9fd700 1 -- 172.21.15.84:0/1567365994 >> 172.21.15.84:0/1567365994 conn(0x7f22f8099830 msgr2=0x7f22f806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.489+0000 7f22fc9fd700 1 -- 172.21.15.84:0/1567365994 shutdown_connections 2023-10-06T02:56:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.489+0000 7f22fc9fd700 1 -- 172.21.15.84:0/1567365994 wait complete. 2023-10-06T02:56:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.490+0000 7f22fc9fd700 1 Processor -- start 2023-10-06T02:56:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.490+0000 7f22fc9fd700 1 -- start start 2023-10-06T02:56:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22fc9fd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f80b07a0 0x7f22f8157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22fc9fd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22f80b49e0 0x7f22f809b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22fc9fd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 0x7f22f809bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22fc9fd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f815cfb0 con 0x7f22f81595a0 2023-10-06T02:56:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22fc9fd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f809b500 con 0x7f22f80b07a0 2023-10-06T02:56:16.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22fc9fd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8158150 con 0x7f22f80b49e0 2023-10-06T02:56:16.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 0x7f22f809bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 0x7f22f809bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41958/0 (socket says 172.21.15.84:41958) 2023-10-06T02:56:16.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f6d9d700 1 -- 172.21.15.84:0/2921171720 learned_addr learned my addr 172.21.15.84:0/2921171720 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f659c700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f80b07a0 0x7f22f8157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22edd9b700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22f80b49e0 0x7f22f809b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f6d9d700 1 -- 172.21.15.84:0/2921171720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22f80b49e0 msgr2=0x7f22f809b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22f80b49e0 0x7f22f809b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f6d9d700 1 -- 172.21.15.84:0/2921171720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f80b07a0 msgr2=0x7f22f8157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f80b07a0 0x7f22f8157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f6d9d700 1 -- 172.21.15.84:0/2921171720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80093c0 con 0x7f22f81595a0 2023-10-06T02:56:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.491+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 0x7f22f809bed0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f22f000ccc0 tx=0x7f22f0001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.493+0000 7f22eeffd700 1 -- 172.21.15.84:0/2921171720 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000a8f0 con 0x7f22f81595a0 2023-10-06T02:56:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.493+0000 7f22eeffd700 1 -- 172.21.15.84:0/2921171720 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f000aa50 con 0x7f22f81595a0 2023-10-06T02:56:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.493+0000 7f22fc9fd700 1 -- 172.21.15.84:0/2921171720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f809abd0 con 0x7f22f81595a0 2023-10-06T02:56:16.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.493+0000 7f22eeffd700 1 -- 172.21.15.84:0/2921171720 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f000ae10 con 0x7f22f81595a0 2023-10-06T02:56:16.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.493+0000 7f22fc9fd700 1 -- 172.21.15.84:0/2921171720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f809b190 con 0x7f22f81595a0 2023-10-06T02:56:16.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.494+0000 7f22eeffd700 1 -- 172.21.15.84:0/2921171720 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22f0007300 con 0x7f22f81595a0 2023-10-06T02:56:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.495+0000 7f22eeffd700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f22d8066f30 0x7f22d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.495+0000 7f22eeffd700 1 -- 172.21.15.84:0/2921171720 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f22f0084ba0 con 0x7f22f81595a0 2023-10-06T02:56:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.495+0000 7f22f659c700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f22d8066f30 0x7f22d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.495+0000 7f22f659c700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f22d8066f30 0x7f22d80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009390 tx=0x7f22e8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.497+0000 7f2305cf5b80 1 Processor -- start 2023-10-06T02:56:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.497+0000 7f2305cf5b80 1 -- start start 2023-10-06T02:56:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375d840 0x5641d375dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 0x5641d37ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37adc00 0x5641d37ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d36b4a70 con 0x5641d375d840 2023-10-06T02:56:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d36b2270 con 0x5641d375ecc0 2023-10-06T02:56:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641d36ae060 con 0x5641d37adc00 2023-10-06T02:56:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375d840 0x5641d375dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375d840 0x5641d375dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41964/0 (socket says 172.21.15.84:41964) 2023-10-06T02:56:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f659c700 1 -- 172.21.15.84:0/1969593931 learned_addr learned my addr 172.21.15.84:0/1969593931 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37adc00 0x5641d37ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22edd9b700 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 0x5641d37ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f659c700 1 -- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37adc00 msgr2=0x5641d37ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f659c700 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37adc00 0x5641d37ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f659c700 1 -- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 msgr2=0x5641d37ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f659c700 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 0x5641d37ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f659c700 1 -- 172.21.15.84:0/1969593931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641d3548270 con 0x5641d375d840 2023-10-06T02:56:16.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37adc00 0x5641d37ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:16.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22edd9b700 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 0x5641d37ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:16.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22f659c700 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375d840 0x5641d375dc10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f22e800b3c0 tx=0x7f22e8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e6057ddd4ed3a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.498+0000 7f22d77fe700 1 -- 172.21.15.84:0/1969593931 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8023070 con 0x5641d375d840 2023-10-06T02:56:16.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f22d77fe700 1 -- 172.21.15.84:0/1969593931 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e800be90 con 0x5641d375d840 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f22d77fe700 1 -- 172.21.15.84:0/1969593931 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8006410 con 0x5641d375d840 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f2305cf5b80 1 -- 172.21.15.84:0/1969593931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375d840 msgr2=0x5641d375dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375d840 0x5641d375dc10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f22e800b3c0 tx=0x7f22e8023000 comp rx=0 tx=0).stop 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f2305cf5b80 1 -- 172.21.15.84:0/1969593931 shutdown_connections 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37adc00 0x5641d37ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375d840 0x5641d375dc10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/1969593931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 0x5641d37ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f2305cf5b80 1 -- 172.21.15.84:0/1969593931 >> 172.21.15.84:0/1969593931 conn(0x5641d375f160 msgr2=0x5641d375f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f2305cf5b80 1 -- 172.21.15.84:0/1969593931 shutdown_connections 2023-10-06T02:56:16.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.499+0000 7f2305cf5b80 1 -- 172.21.15.84:0/1969593931 wait complete. 2023-10-06T02:56:16.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.500+0000 7f2305cf5b80 1 -- start start 2023-10-06T02:56:16.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.500+0000 7f2305cf5b80 1 Processor -- start 2023-10-06T02:56:16.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 0x5641d3784400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 0x5641d379bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d37adc00 0x5641d37a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d3659890 con 0x5641d37adc00 2023-10-06T02:56:16.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d3674ea0 con 0x5641d375ecc0 2023-10-06T02:56:16.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641d3530e30 con 0x5641d375d840 2023-10-06T02:56:16.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f2305cf5b80 10 client.0 _ll_register_callbacks cb 0x5641d3720e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:16.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d37adc00 0x5641d37a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d37adc00 0x5641d37a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41968/0 (socket says 172.21.15.84:41968) 2023-10-06T02:56:16.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f6d9d700 1 -- 172.21.15.84:0/2776707338 learned_addr learned my addr 172.21.15.84:0/2776707338 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f659c700 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 0x5641d3784400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22edd9b700 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 0x5641d379bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f6d9d700 1 -- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 msgr2=0x5641d3784400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 0x5641d3784400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f6d9d700 1 -- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 msgr2=0x5641d379bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 0x5641d379bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f6d9d700 1 -- 172.21.15.84:0/2776707338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f80b1540 con 0x5641d37adc00 2023-10-06T02:56:16.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d37adc00 0x5641d37a6260 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f22f000cfd0 tx=0x7f22f0082cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d458f6afe7f6c92e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22d4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:16.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.501+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2776707338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f005c840 con 0x5641d37adc00 2023-10-06T02:56:16.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2776707338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f22f0055a80 con 0x5641d37adc00 2023-10-06T02:56:16.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2776707338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641d3752940 con 0x5641d37adc00 2023-10-06T02:56:16.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2776707338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22f0054d10 con 0x5641d37adc00 2023-10-06T02:56:16.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f2305cf5b80 10 client.5409 fetch_fsmap learned FSMap version 22 2023-10-06T02:56:16.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2776707338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5641d34eafe0 con 0x5641d37adc00 2023-10-06T02:56:16.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2776707338 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641d3752940 con 0x5641d37adc00 2023-10-06T02:56:16.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2776707338 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 22) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f22f005c330 con 0x5641d37adc00 2023-10-06T02:56:16.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f2305cf5b80 10 client.5409 fetch_fsmap finished waiting for FSMap version 22 2023-10-06T02:56:16.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f2305cf5b80 10 client.5409 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:56:16.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f2305cf5b80 20 client.5409 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:16.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5641d37a5780 0x5641d37b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f2305cf5b80 4 client.5409 mds_command: new command op to 5124 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:56:16.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2776707338 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641d372f870 con 0x5641d37a5780 2023-10-06T02:56:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.502+0000 7f22f659c700 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5641d37a5780 0x5641d37b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f22d4ff9700 10 client.5409 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f22f659c700 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5641d37a5780 0x5641d37b3c50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e72110cabb2a3940 server_cookie=17041817bf839833 in_seq=0 out_seq=0 2023-10-06T02:56:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2776707338 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5641d372f870 con 0x5641d37a5780 2023-10-06T02:56:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f22d4ff9700 10 client.5409 handle_command_reply: tid=0 2023-10-06T02:56:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f2305cf5b80 1 client.5409 shutdown 2023-10-06T02:56:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2776707338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d37adc00 msgr2=0x5641d37a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d37adc00 0x5641d37a6260 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f22f000cfd0 tx=0x7f22f0082cf0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2776707338 shutdown_connections 2023-10-06T02:56:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5641d37a5780 0x5641d37b3c50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d37adc00 0x5641d37a6260 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 0x5641d3784400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f22d4ff9700 0 client.5409 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2776707338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375ecc0 0x5641d379bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.503+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2776707338 >> 172.21.15.84:0/2776707338 conn(0x5641d375f160 msgr2=0x5641d3786a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.504+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2776707338 shutdown_connections 2023-10-06T02:56:16.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.504+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2776707338 wait complete. 2023-10-06T02:56:16.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.504+0000 7f2305cf5b80 20 client.5409 trim_cache size 0 max 16384 2023-10-06T02:56:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.520+0000 7f2305cf5b80 1 Processor -- start 2023-10-06T02:56:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.520+0000 7f2305cf5b80 1 -- start start 2023-10-06T02:56:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375d840 0x5641d37a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d379d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37a5780 0x5641d375f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d375df90 con 0x5641d375ecc0 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d379e6c0 con 0x5641d375d840 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641d3758620 con 0x5641d37a5780 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22edd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d379d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22edd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d379d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41984/0 (socket says 172.21.15.84:41984) 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22edd9b700 1 -- 172.21.15.84:0/461171701 learned_addr learned my addr 172.21.15.84:0/461171701 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22edd9b700 1 -- 172.21.15.84:0/461171701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37a5780 msgr2=0x5641d375f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22edd9b700 1 --2- 172.21.15.84:0/461171701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37a5780 0x5641d375f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22edd9b700 1 -- 172.21.15.84:0/461171701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375d840 msgr2=0x5641d37a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22edd9b700 1 --2- 172.21.15.84:0/461171701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375d840 0x5641d37a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22edd9b700 1 -- 172.21.15.84:0/461171701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641d367c780 con 0x5641d375ecc0 2023-10-06T02:56:16.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22edd9b700 1 --2- 172.21.15.84:0/461171701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d379d590 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f22f8099f60 tx=0x7f22e0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9837356d404ee1d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.521+0000 7f22d7fff700 1 -- 172.21.15.84:0/461171701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e001b030 con 0x5641d375ecc0 2023-10-06T02:56:16.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f22d7fff700 1 -- 172.21.15.84:0/461171701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0006a30 con 0x5641d375ecc0 2023-10-06T02:56:16.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f22d7fff700 1 -- 172.21.15.84:0/461171701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0006dd0 con 0x5641d375ecc0 2023-10-06T02:56:16.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f2305cf5b80 1 -- 172.21.15.84:0/461171701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 msgr2=0x5641d379d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/461171701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d379d590 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f22f8099f60 tx=0x7f22e0009040 comp rx=0 tx=0).stop 2023-10-06T02:56:16.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f2305cf5b80 1 -- 172.21.15.84:0/461171701 shutdown_connections 2023-10-06T02:56:16.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/461171701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d375d840 0x5641d37a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/461171701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d37a5780 0x5641d375f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/461171701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d379d590 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f2305cf5b80 1 -- 172.21.15.84:0/461171701 >> 172.21.15.84:0/461171701 conn(0x5641d375f160 msgr2=0x5641d3756280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f2305cf5b80 1 -- 172.21.15.84:0/461171701 shutdown_connections 2023-10-06T02:56:16.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.522+0000 7f2305cf5b80 1 -- 172.21.15.84:0/461171701 wait complete. 2023-10-06T02:56:16.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.523+0000 7f2305cf5b80 1 -- start start 2023-10-06T02:56:16.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.523+0000 7f2305cf5b80 1 Processor -- start 2023-10-06T02:56:16.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.523+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 0x5641d375f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.523+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d375fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.523+0000 7f2305cf5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d37a5780 0x5641d379ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.523+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d3783a70 con 0x5641d375ecc0 2023-10-06T02:56:16.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.523+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d380a720 con 0x5641d37a5780 2023-10-06T02:56:16.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.523+0000 7f2305cf5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641d380aad0 con 0x5641d375d840 2023-10-06T02:56:16.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f2305cf5b80 10 client.0 _ll_register_callbacks cb 0x5641d3720e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:16.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22edd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d375fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22edd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d375fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41998/0 (socket says 172.21.15.84:41998) 2023-10-06T02:56:16.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22edd9b700 1 -- 172.21.15.84:0/2598725552 learned_addr learned my addr 172.21.15.84:0/2598725552 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22f659c700 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 0x5641d375f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d37a5780 0x5641d379ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22edd9b700 1 -- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 msgr2=0x5641d375f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22edd9b700 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 0x5641d375f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22edd9b700 1 -- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d37a5780 msgr2=0x5641d379ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22edd9b700 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d37a5780 0x5641d379ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22edd9b700 1 -- 172.21.15.84:0/2598725552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f80b0f80 con 0x5641d375ecc0 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22f6d9d700 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d37a5780 0x5641d379ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22edd9b700 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d375fa70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f22e00072e0 tx=0x7f22e001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9e34b7dab71cd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22d4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2598725552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0015480 con 0x5641d375ecc0 2023-10-06T02:56:16.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2598725552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f22e001c070 con 0x5641d375ecc0 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2598725552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22e800be90 con 0x5641d375ecc0 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2598725552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22e00155e0 con 0x5641d375ecc0 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f2305cf5b80 10 client.5415 fetch_fsmap learned FSMap version 22 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2598725552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5641d3663470 con 0x5641d375ecc0 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2598725552 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0030070 con 0x5641d375ecc0 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2598725552 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 22) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f22e0015740 con 0x5641d375ecc0 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f2305cf5b80 10 client.5415 fetch_fsmap finished waiting for FSMap version 22 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f2305cf5b80 10 client.5415 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f2305cf5b80 20 client.5415 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:16.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5641d37adc00 0x5641d379f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.524+0000 7f2305cf5b80 4 client.5415 mds_command: new command op to 5124 tid=0[{"prefix": "status"}] 2023-10-06T02:56:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2598725552 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5641d3650e00 con 0x5641d37adc00 2023-10-06T02:56:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f22f659c700 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5641d37adc00 0x5641d379f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f22d4ff9700 10 client.5415 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f22f659c700 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5641d37adc00 0x5641d379f530 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=835dc8db76e6b43e server_cookie=3d907bc43b1a16c0 in_seq=0 out_seq=0 2023-10-06T02:56:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f22d4ff9700 1 -- 172.21.15.84:0/2598725552 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5641d3650e00 con 0x5641d37adc00 2023-10-06T02:56:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f22d4ff9700 10 client.5415 handle_command_reply: tid=0 2023-10-06T02:56:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 client.5415 shutdown 2023-10-06T02:56:16.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2598725552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 msgr2=0x5641d375fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d375fa70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f22e00072e0 tx=0x7f22e001c000 comp rx=0 tx=0).stop 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2598725552 shutdown_connections 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5641d37adc00 0x5641d379f530 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641d37a5780 0x5641d379ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f22d4ff9700 0 client.5415 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5641d375d840 0x5641d375f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 --2- 172.21.15.84:0/2598725552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641d375ecc0 0x5641d375fa70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.525+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2598725552 >> 172.21.15.84:0/2598725552 conn(0x5641d375f160 msgr2=0x5641d37a5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2598725552 shutdown_connections 2023-10-06T02:56:16.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f2305cf5b80 1 -- 172.21.15.84:0/2598725552 wait complete. 2023-10-06T02:56:16.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f2305cf5b80 20 client.5415 trim_cache size 0 max 16384 2023-10-06T02:56:16.536 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:56:16.536 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:56:16.536 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T02:56:16.536 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5124, 2023-10-06T02:56:16.536 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:56:16.536 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:56:16.537 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:56:16.537 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 11.09549002, 2023-10-06T02:56:16.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 22, 2023-10-06T02:56:16.537 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 42, 2023-10-06T02:56:16.537 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 42, 2023-10-06T02:56:16.537 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 19.966851799000001 2023-10-06T02:56:16.537 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:56:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 -- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f22d8066f30 msgr2=0x7f22d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f22d8066f30 0x7f22d80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009390 tx=0x7f22e8016000 comp rx=0 tx=0).stop 2023-10-06T02:56:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 -- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 msgr2=0x7f22f809bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 0x7f22f809bed0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f22f000ccc0 tx=0x7f22f0001a20 comp rx=0 tx=0).stop 2023-10-06T02:56:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 -- 172.21.15.84:0/2921171720 shutdown_connections 2023-10-06T02:56:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f22d8066f30 0x7f22d80693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22f80b07a0 0x7f22f8157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22f81595a0 0x7f22f809bed0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 --2- 172.21.15.84:0/2921171720 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22f80b49e0 0x7f22f809b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 -- 172.21.15.84:0/2921171720 >> 172.21.15.84:0/2921171720 conn(0x7f22f8099830 msgr2=0x7f22f80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 -- 172.21.15.84:0/2921171720 shutdown_connections 2023-10-06T02:56:16.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.526+0000 7f22fc9fd700 1 -- 172.21.15.84:0/2921171720 wait complete. 2023-10-06T02:56:16.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:56:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.654+0000 7f0a9eb9d700 1 Processor -- start 2023-10-06T02:56:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.654+0000 7f0a9eb9d700 1 -- start start 2023-10-06T02:56:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9eb9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a980cbc70 0x7f0a980cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9eb9d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a980b2140 0x7f0a980b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9eb9d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a980cb7e0 con 0x7f0a98159480 2023-10-06T02:56:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9eb9d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a980b08a0 con 0x7f0a980cbc70 2023-10-06T02:56:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9eb9d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a980cb190 con 0x7f0a980b2140 2023-10-06T02:56:16.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9d39a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a980cbc70 0x7f0a980cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9db9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0a98159480 0x7f0a980b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38246/0 (socket says 172.21.15.84:38246) 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9db9b700 1 -- 172.21.15.84:0/2913730526 learned_addr learned my addr 172.21.15.84:0/2913730526 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9e39c700 1 --2- 172.21.15.84:0/2913730526 >> v2:172.21.15.131:3300/0 conn(0x7f0a980b2140 0x7f0a980b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9d39a700 1 -- 172.21.15.84:0/2913730526 >> v2:172.21.15.131:3300/0 conn(0x7f0a980b2140 msgr2=0x7f0a980b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9d39a700 1 --2- 172.21.15.84:0/2913730526 >> v2:172.21.15.131:3300/0 conn(0x7f0a980b2140 0x7f0a980b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9d39a700 1 -- 172.21.15.84:0/2913730526 >> v1:172.21.15.84:6789/0 conn(0x7f0a98159480 legacy=0x7f0a980b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9d39a700 1 -- 172.21.15.84:0/2913730526 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a980cb470 con 0x7f0a980cbc70 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9cb99700 1 -- 172.21.15.84:0/2913730526 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839408644 0 0) 0x7f0a980cb7e0 con 0x7f0a98159480 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.655+0000 7f0a9d39a700 1 --2- 172.21.15.84:0/2913730526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980cbc70 0x7f0a980cc0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0a980ca830 tx=0x7f0a8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb309f55ddad8ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9cb99700 1 -- 172.21.15.84:0/2913730526 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00b6b0 con 0x7f0a980cbc70 2023-10-06T02:56:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9cb99700 1 -- 172.21.15.84:0/2913730526 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00b810 con 0x7f0a980cbc70 2023-10-06T02:56:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9cb99700 1 -- 172.21.15.84:0/2913730526 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00bbb0 con 0x7f0a980cbc70 2023-10-06T02:56:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/2913730526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980cbc70 msgr2=0x7f0a980cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9eb9d700 1 --2- 172.21.15.84:0/2913730526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980cbc70 0x7f0a980cc0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0a980ca830 tx=0x7f0a8c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/2913730526 shutdown_connections 2023-10-06T02:56:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9eb9d700 1 --2- 172.21.15.84:0/2913730526 >> v2:172.21.15.131:3300/0 conn(0x7f0a980b2140 0x7f0a980b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9eb9d700 1 --2- 172.21.15.84:0/2913730526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980cbc70 0x7f0a980cc0c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/2913730526 >> 172.21.15.84:0/2913730526 conn(0x7f0a9806ed20 msgr2=0x7f0a9806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/2913730526 shutdown_connections 2023-10-06T02:56:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.656+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/2913730526 wait complete. 2023-10-06T02:56:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.657+0000 7f0a9eb9d700 1 Processor -- start 2023-10-06T02:56:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.657+0000 7f0a9eb9d700 1 -- start start 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9eb9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980b2140 0x7f0a98153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9eb9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a980cbc70 0x7f0a980c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9eb9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a98159480 0x7f0a980c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9eb9d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a98154200 con 0x7f0a980b2140 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9eb9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980ce480 con 0x7f0a980cbc70 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9eb9d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980c9770 con 0x7f0a98159480 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9db9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980b2140 0x7f0a98153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9db9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980b2140 0x7f0a98153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42006/0 (socket says 172.21.15.84:42006) 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9db9b700 1 -- 172.21.15.84:0/808576984 learned_addr learned my addr 172.21.15.84:0/808576984 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9d39a700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a980cbc70 0x7f0a980c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9e39c700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a98159480 0x7f0a980c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.658+0000 7f0a9db9b700 1 -- 172.21.15.84:0/808576984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a98159480 msgr2=0x7f0a980c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a9db9b700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a98159480 0x7f0a980c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a9db9b700 1 -- 172.21.15.84:0/808576984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a980cbc70 msgr2=0x7f0a980c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a9db9b700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a980cbc70 0x7f0a980c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a9db9b700 1 -- 172.21.15.84:0/808576984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c009420 con 0x7f0a980b2140 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a9e39c700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a98159480 0x7f0a980c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a9db9b700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980b2140 0x7f0a98153cc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000cc70 tx=0x7f0a90001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a95ffb700 1 -- 172.21.15.84:0/808576984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000a940 con 0x7f0a980b2140 2023-10-06T02:56:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a95ffb700 1 -- 172.21.15.84:0/808576984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9000aaa0 con 0x7f0a980b2140 2023-10-06T02:56:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a95ffb700 1 -- 172.21.15.84:0/808576984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000ae20 con 0x7f0a980b2140 2023-10-06T02:56:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a980c9a50 con 0x7f0a980b2140 2023-10-06T02:56:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.659+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a980ce110 con 0x7f0a980b2140 2023-10-06T02:56:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.660+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9805f270 con 0x7f0a980b2140 2023-10-06T02:56:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.660+0000 7f0a95ffb700 1 -- 172.21.15.84:0/808576984 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a90007300 con 0x7f0a980b2140 2023-10-06T02:56:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.660+0000 7f0a95ffb700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a84066f30 0x7f0a840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.661+0000 7f0a95ffb700 1 -- 172.21.15.84:0/808576984 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a90084b70 con 0x7f0a980b2140 2023-10-06T02:56:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.661+0000 7f0a9d39a700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a84066f30 0x7f0a840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.661+0000 7f0a9d39a700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a84066f30 0x7f0a840693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0093f0 tx=0x7f0a8c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.665+0000 7f0a95ffb700 1 -- 172.21.15.84:0/808576984 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a90051bc0 con 0x7f0a980b2140 2023-10-06T02:56:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.889+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a98159850 con 0x7f0a980b2140 2023-10-06T02:56:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.889+0000 7f0a95ffb700 1 -- 172.21.15.84:0/808576984 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4622 (secure 0 0 0) 0x7f0a900551e0 con 0x7f0a980b2140 2023-10-06T02:56:16.890 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:56:16.890 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:56:04.813024+0000","modified":"2023-10-06T02:56:15.489597+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5124,"mds_1":5115,"mds_2":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6836/1815868063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1815868063},{"type":"v1","addr":"172.21.15.84:6836","nonce":1815868063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5115":{"gid":5115,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6837/197493808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":197493808},{"type":"v1","addr":"172.21.15.84:6837","nonce":197493808}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5124":{"gid":5124,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6835/781245140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":781245140},{"type":"v1","addr":"172.21.15.131:6835","nonce":781245140}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:56:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a84066f30 msgr2=0x7f0a840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a84066f30 0x7f0a840693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0093f0 tx=0x7f0a8c017000 comp rx=0 tx=0).stop 2023-10-06T02:56:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980b2140 msgr2=0x7f0a98153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980b2140 0x7f0a98153cc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000cc70 tx=0x7f0a90001a30 comp rx=0 tx=0).stop 2023-10-06T02:56:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 shutdown_connections 2023-10-06T02:56:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a84066f30 0x7f0a840693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a98159480 0x7f0a980c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a980b2140 0x7f0a98153cc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 --2- 172.21.15.84:0/808576984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a980cbc70 0x7f0a980c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:16.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 >> 172.21.15.84:0/808576984 conn(0x7f0a9806ed20 msgr2=0x7f0a981585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:16.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 shutdown_connections 2023-10-06T02:56:16.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:16.892+0000 7f0a9eb9d700 1 -- 172.21.15.84:0/808576984 wait complete. 2023-10-06T02:56:16.894 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 22 2023-10-06T02:56:16.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:56:16.904 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T02:56:16.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:56:16.931 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T02:56:16.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:56:16.993 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-10-06T02:56:17.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:56:17.050 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-10-06T02:56:17.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:56:17.105 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-10-06T02:56:17.162 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-10-06T02:56:17.304 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:56:17.305 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:56:17.305 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:56:19.306 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-10-06T02:56:19.451 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:56:19.451 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:56:19.452 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:56:21.453 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-10-06T02:56:21.595 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:56:21.596 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:56:21.596 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:56:23.597 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-10-06T02:56:23.743 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:56:23.744 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:56:23.744 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:56:25.745 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-10-06T02:56:25.888 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:56:25.888 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:56:25.889 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:56:27.890 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-10-06T02:56:28.033 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}}] 2023-10-06T02:56:28.033 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:56:28.034 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:56:28.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:56:28.178 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T02:56:28.179 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:56:28.179 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:56:30.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:56:30.315 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T02:56:30.315 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:56:30.316 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:56:32.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:56:32.462 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-10-06T02:56:32.462 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:56:32.463 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:56:32.463 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:56:32.593 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T02:56:32.594 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:56:32.594 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:56:32.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 flush journal 2023-10-06T02:56:32.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.707+0000 7f7ac0958700 1 Processor -- start 2023-10-06T02:56:32.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.707+0000 7f7ac0958700 1 -- start start 2023-10-06T02:56:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.708+0000 7f7ac0958700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7abc159e60 0x7f7abc06e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.708+0000 7f7ac0958700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0ca5f0 con 0x7f7abc155da0 2023-10-06T02:56:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.708+0000 7f7ac0958700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0cb450 con 0x7f7abc1559d0 2023-10-06T02:56:32.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.708+0000 7f7ac0958700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0ca840 con 0x7f7abc159e60 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.708+0000 7f7ab9d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7abc155da0 0x7f7abc159750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59354/0 (socket says 172.21.15.84:59354) 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.708+0000 7f7ab9d9b700 1 -- 172.21.15.84:0/3594172912 learned_addr learned my addr 172.21.15.84:0/3594172912 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7abad9d700 1 --2- 172.21.15.84:0/3594172912 >> v2:172.21.15.131:3300/0 conn(0x7f7abc159e60 0x7f7abc06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061310297 0 0) 0x7f7abc0ca5f0 con 0x7f7abc155da0 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa4004680 con 0x7f7abc155da0 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3777951997 0 0) 0x7f7aa4004680 con 0x7f7abc155da0 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 >> v2:172.21.15.131:3300/0 conn(0x7f7abc159e60 msgr2=0x7f7abc06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 --2- 172.21.15.84:0/3594172912 >> v2:172.21.15.131:3300/0 conn(0x7f7abc159e60 0x7f7abc06e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 >> v1:172.21.15.131:6789/0 conn(0x7f7abc1559d0 legacy=0x7f7abc0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc0cab20 con 0x7f7abc155da0 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f7ab0001470 con 0x7f7abc155da0 2023-10-06T02:56:32.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 >> v1:172.21.15.84:6789/0 conn(0x7f7abc155da0 legacy=0x7f7abc159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa4004b70 0x7f7aa4004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa4005920 0x7f7aa4005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7aa40062d0 0x7f7aa400cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0ca840 con 0x7f7aa4004b70 2023-10-06T02:56:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa400d270 con 0x7f7aa4005920 2023-10-06T02:56:32.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa400d430 con 0x7f7aa40062d0 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7aba59c700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa4004b70 0x7f7aa4004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7ab9d9b700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa4005920 0x7f7aa4005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7abad9d700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7aa40062d0 0x7f7aa400cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7aba59c700 1 -- 172.21.15.84:0/3594172912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7aa40062d0 msgr2=0x7f7aa400cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7aba59c700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7aa40062d0 0x7f7aa400cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7aba59c700 1 -- 172.21.15.84:0/3594172912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa4005920 msgr2=0x7f7aa4005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7aba59c700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa4005920 0x7f7aa4005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7aba59c700 1 -- 172.21.15.84:0/3594172912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4004680 con 0x7f7aa4004b70 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.709+0000 7f7abad9d700 1 -- 172.21.15.84:0/3594172912 reap_dead start 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7aba59c700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa4004b70 0x7f7aa4004f80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7aac001fc0 tx=0x7f7aac001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1e1ab9a663b8ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac001950 con 0x7f7aa4004b70 2023-10-06T02:56:32.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00c8b0 con 0x7f7aa4004b70 2023-10-06T02:56:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ab959a700 1 -- 172.21.15.84:0/3594172912 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00cc50 con 0x7f7aa4004b70 2023-10-06T02:56:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ac0958700 1 -- 172.21.15.84:0/3594172912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa4004b70 msgr2=0x7f7aa4004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ac0958700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa4004b70 0x7f7aa4004f80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7aac001fc0 tx=0x7f7aac001640 comp rx=0 tx=0).stop 2023-10-06T02:56:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ac0958700 1 -- 172.21.15.84:0/3594172912 shutdown_connections 2023-10-06T02:56:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ac0958700 1 --2- 172.21.15.84:0/3594172912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aa4004b70 0x7f7aa4004f80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ac0958700 1 -- 172.21.15.84:0/3594172912 >> 172.21.15.84:0/3594172912 conn(0x7f7abc0cc0d0 msgr2=0x7f7abc0cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ac0958700 1 -- 172.21.15.84:0/3594172912 shutdown_connections 2023-10-06T02:56:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.710+0000 7f7ac0958700 1 -- 172.21.15.84:0/3594172912 wait complete. 2023-10-06T02:56:32.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.711+0000 7f7ac0958700 1 Processor -- start 2023-10-06T02:56:32.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.711+0000 7f7ac0958700 1 -- start start 2023-10-06T02:56:32.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7ac0958700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa4004b70 0x7f7abc14ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7ac0958700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7abc0aee70 0x7f7abc0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7ac0958700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7abc153200 0x7f7abc153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7ac0958700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0af820 con 0x7f7abc153200 2023-10-06T02:56:32.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7ac0958700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0accf0 con 0x7f7aa4004b70 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7ac0958700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1541c0 con 0x7f7abc0aee70 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7abc153200 0x7f7abc153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7abc153200 0x7f7abc153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52282/0 (socket says 172.21.15.84:52282) 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7abad9d700 1 -- 172.21.15.84:0/1471477631 learned_addr learned my addr 172.21.15.84:0/1471477631 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7aba59c700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa4004b70 0x7f7abc14ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7ab9d9b700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7abc0aee70 0x7f7abc0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7abad9d700 1 -- 172.21.15.84:0/1471477631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7abc0aee70 msgr2=0x7f7abc0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7abad9d700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7abc0aee70 0x7f7abc0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7abad9d700 1 -- 172.21.15.84:0/1471477631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa4004b70 msgr2=0x7f7abc14ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7abad9d700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa4004b70 0x7f7abc14ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.712+0000 7f7abad9d700 1 -- 172.21.15.84:0/1471477631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc153ee0 con 0x7f7abc153200 2023-10-06T02:56:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.713+0000 7f7abad9d700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7abc153200 0x7f7abc153670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7abc06d3b0 tx=0x7f7ab4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.713+0000 7f7aaa7fc700 1 -- 172.21.15.84:0/1471477631 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4011ed0 con 0x7f7abc153200 2023-10-06T02:56:32.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.713+0000 7f7aaa7fc700 1 -- 172.21.15.84:0/1471477631 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab4015670 con 0x7f7abc153200 2023-10-06T02:56:32.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.713+0000 7f7ac0958700 1 -- 172.21.15.84:0/1471477631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc0ac6a0 con 0x7f7abc153200 2023-10-06T02:56:32.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.713+0000 7f7aaa7fc700 1 -- 172.21.15.84:0/1471477631 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4015a30 con 0x7f7abc153200 2023-10-06T02:56:32.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.713+0000 7f7ac0958700 1 -- 172.21.15.84:0/1471477631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc153bb0 con 0x7f7abc153200 2023-10-06T02:56:32.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.714+0000 7f7aaa7fc700 1 -- 172.21.15.84:0/1471477631 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ab4020460 con 0x7f7abc153200 2023-10-06T02:56:32.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.714+0000 7f7aaa7fc700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a9c066f30 0x7f7a9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.715+0000 7f7aaa7fc700 1 -- 172.21.15.84:0/1471477631 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7ab4084750 con 0x7f7abc153200 2023-10-06T02:56:32.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.715+0000 7f7aba59c700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a9c066f30 0x7f7a9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.715+0000 7f7aba59c700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a9c066f30 0x7f7a9c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7aac001da0 tx=0x7f7aac015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7ac9c50b80 1 Processor -- start 2023-10-06T02:56:32.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7ac9c50b80 1 -- start start 2023-10-06T02:56:32.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 0x555cc4399c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 0x555cc43e9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc42f0ac0 con 0x555cc43e9c50 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc42ee2c0 con 0x555cc4399890 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cc42ea0b0 con 0x555cc439ad10 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43ea0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52294/0 (socket says 172.21.15.84:52294) 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.717+0000 7f7abad9d700 1 -- 172.21.15.84:0/2739683681 learned_addr learned my addr 172.21.15.84:0/2739683681 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7ab9d9b700 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 0x555cc43e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7aba59c700 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 0x555cc4399c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7abad9d700 1 -- 172.21.15.84:0/2739683681 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 msgr2=0x555cc43e9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7abad9d700 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 0x555cc43e9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7abad9d700 1 -- 172.21.15.84:0/2739683681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 msgr2=0x555cc4399c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7abad9d700 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 0x555cc4399c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7abad9d700 1 -- 172.21.15.84:0/2739683681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cc41842c0 con 0x555cc43e9c50 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7aba59c700 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 0x555cc4399c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7abad9d700 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43ea0a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40091e0 tx=0x7f7ab4082930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d339f0b1b723c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7a9b7fe700 1 -- 172.21.15.84:0/2739683681 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40553e0 con 0x555cc43e9c50 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7a9b7fe700 1 -- 172.21.15.84:0/2739683681 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab4058630 con 0x555cc43e9c50 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.718+0000 7f7a9b7fe700 1 -- 172.21.15.84:0/2739683681 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab405c380 con 0x555cc43e9c50 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/2739683681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 msgr2=0x555cc43ea0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43ea0a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40091e0 tx=0x7f7ab4082930 comp rx=0 tx=0).stop 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/2739683681 shutdown_connections 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 0x555cc4399c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43ea0a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/2739683681 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 0x555cc43e9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/2739683681 >> 172.21.15.84:0/2739683681 conn(0x555cc439b1b0 msgr2=0x555cc439b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/2739683681 shutdown_connections 2023-10-06T02:56:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/2739683681 wait complete. 2023-10-06T02:56:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 -- start start 2023-10-06T02:56:32.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.719+0000 7f7ac9c50b80 1 Processor -- start 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 0x555cc43d8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 0x555cc43e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43e2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc42958e0 con 0x555cc43e9c50 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc42b0ef0 con 0x555cc439ad10 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cc416ce80 con 0x555cc4399890 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7ac9c50b80 10 client.0 _ll_register_callbacks cb 0x555cc435cec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43e2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52304/0 (socket says 172.21.15.84:52304) 2023-10-06T02:56:32.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.720+0000 7f7abad9d700 1 -- 172.21.15.84:0/3161221221 learned_addr learned my addr 172.21.15.84:0/3161221221 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7aba59c700 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 0x555cc43d8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ab9d9b700 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 0x555cc43e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7abad9d700 1 -- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 msgr2=0x555cc43d8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7abad9d700 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 0x555cc43d8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7abad9d700 1 -- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 msgr2=0x555cc43e23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7abad9d700 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 0x555cc43e23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7abad9d700 1 -- 172.21.15.84:0/3161221221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc153bb0 con 0x555cc43e9c50 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7abad9d700 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43e2930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40550e0 tx=0x7f7ab406c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215ee137b2ad2612 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7a98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7a98ff9700 1 -- 172.21.15.84:0/3161221221 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4053780 con 0x555cc43e9c50 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7a98ff9700 1 -- 172.21.15.84:0/3161221221 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7ab40548d0 con 0x555cc43e9c50 2023-10-06T02:56:32.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3161221221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555cc438e990 con 0x555cc43e9c50 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7a98ff9700 1 -- 172.21.15.84:0/3161221221 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab405bef0 con 0x555cc43e9c50 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ac9c50b80 10 client.5436 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3161221221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x555cc4127030 con 0x555cc43e9c50 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7a98ff9700 1 -- 172.21.15.84:0/3161221221 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555cc438e990 con 0x555cc43e9c50 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7a98ff9700 1 -- 172.21.15.84:0/3161221221 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f7ab405a3e0 con 0x555cc43e9c50 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ac9c50b80 10 client.5436 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ac9c50b80 10 client.5436 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ac9c50b80 20 client.5436 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x555cc43c2d90 0x555cc43e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ac9c50b80 4 client.5436 mds_command: new command op to 5124 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.721+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3161221221 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555cc436b8c0 con 0x555cc43c2d90 2023-10-06T02:56:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.722+0000 7f7aba59c700 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x555cc43c2d90 0x555cc43e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.722+0000 7f7aba59c700 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x555cc43c2d90 0x555cc43e0e40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4497825adb814a9d server_cookie=3b54d0f00d6ff588 in_seq=0 out_seq=0 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.722+0000 7f7a98ff9700 10 client.5436 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7a98ff9700 1 -- 172.21.15.84:0/3161221221 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555cc436b8c0 con 0x555cc43c2d90 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7a98ff9700 10 client.5436 handle_command_reply: tid=0 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 client.5436 shutdown 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3161221221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 msgr2=0x555cc43e2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43e2930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40550e0 tx=0x7f7ab406c000 comp rx=0 tx=0).stop 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3161221221 shutdown_connections 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x555cc43c2d90 0x555cc43e0e40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43e2930 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7a98ff9700 0 client.5436 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 0x555cc43d8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3161221221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 0x555cc43e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3161221221 >> 172.21.15.84:0/3161221221 conn(0x555cc439b1b0 msgr2=0x555cc439a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3161221221 shutdown_connections 2023-10-06T02:56:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3161221221 wait complete. 2023-10-06T02:56:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.723+0000 7f7ac9c50b80 20 client.5436 trim_cache size 0 max 16384 2023-10-06T02:56:32.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7ac9c50b80 1 Processor -- start 2023-10-06T02:56:32.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7ac9c50b80 1 -- start start 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 0x555cc4398730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 0x555cc43df3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43df920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc439c080 con 0x555cc43e9c50 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc4396b10 con 0x555cc439ad10 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cc43e3130 con 0x555cc4399890 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43df920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52318/0 (socket says 172.21.15.84:52318) 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.737+0000 7f7abad9d700 1 -- 172.21.15.84:0/3677073323 learned_addr learned my addr 172.21.15.84:0/3677073323 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7ab9d9b700 1 --2- 172.21.15.84:0/3677073323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 0x555cc43df3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7aba59c700 1 --2- 172.21.15.84:0/3677073323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 0x555cc4398730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7abad9d700 1 -- 172.21.15.84:0/3677073323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 msgr2=0x555cc4398730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7abad9d700 1 --2- 172.21.15.84:0/3677073323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 0x555cc4398730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7abad9d700 1 -- 172.21.15.84:0/3677073323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 msgr2=0x555cc43df3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7abad9d700 1 --2- 172.21.15.84:0/3677073323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 0x555cc43df3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7abad9d700 1 -- 172.21.15.84:0/3677073323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cc42b87d0 con 0x555cc43e9c50 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7abad9d700 1 --2- 172.21.15.84:0/3677073323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43df920 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4000c00 tx=0x7f7ab407e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b40683915f44d33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7a9bfff700 1 -- 172.21.15.84:0/3677073323 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40548d0 con 0x555cc43e9c50 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7a9bfff700 1 -- 172.21.15.84:0/3677073323 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab405c380 con 0x555cc43e9c50 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7a9bfff700 1 -- 172.21.15.84:0/3677073323 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4054340 con 0x555cc43e9c50 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3677073323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 msgr2=0x555cc43df920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3677073323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43df920 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4000c00 tx=0x7f7ab407e000 comp rx=0 tx=0).stop 2023-10-06T02:56:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3677073323 shutdown_connections 2023-10-06T02:56:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3677073323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc43df920 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3677073323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc4399890 0x555cc4398730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/3677073323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc439ad10 0x555cc43df3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3677073323 >> 172.21.15.84:0/3677073323 conn(0x555cc439b1b0 msgr2=0x555cc439a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.738+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3677073323 shutdown_connections 2023-10-06T02:56:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.739+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/3677073323 wait complete. 2023-10-06T02:56:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.739+0000 7f7ac9c50b80 1 -- start start 2023-10-06T02:56:32.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.739+0000 7f7ac9c50b80 1 Processor -- start 2023-10-06T02:56:32.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 0x555cc43eef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 0x555cc444c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7ac9c50b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc444ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc43e13e0 con 0x555cc43e9c50 2023-10-06T02:56:32.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc44495a0 con 0x555cc4399890 2023-10-06T02:56:32.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7ac9c50b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cc43e1190 con 0x555cc439ad10 2023-10-06T02:56:32.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7ac9c50b80 10 client.0 _ll_register_callbacks cb 0x555cc435cec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:32.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc444ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7abad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc444ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52320/0 (socket says 172.21.15.84:52320) 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7abad9d700 1 -- 172.21.15.84:0/1965664599 learned_addr learned my addr 172.21.15.84:0/1965664599 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7aba59c700 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 0x555cc43eef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7ab9d9b700 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 0x555cc444c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7abad9d700 1 -- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 msgr2=0x555cc444c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7abad9d700 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 0x555cc444c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7abad9d700 1 -- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 msgr2=0x555cc43eef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7abad9d700 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 0x555cc43eef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7abad9d700 1 -- 172.21.15.84:0/1965664599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555cc4127030 con 0x555cc43e9c50 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7abad9d700 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc444ce50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009fd0 tx=0x7f7ab406d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991f4468430da851 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.740+0000 7f7a98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7a98ff9700 1 -- 172.21.15.84:0/1965664599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4006b10 con 0x555cc43e9c50 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7a98ff9700 1 -- 172.21.15.84:0/1965664599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7ab40548d0 con 0x555cc43e9c50 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/1965664599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ab4058630 con 0x555cc43e9c50 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7a98ff9700 1 -- 172.21.15.84:0/1965664599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab405a3e0 con 0x555cc43e9c50 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7ac9c50b80 10 client.5442 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/1965664599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x555cc429f4c0 con 0x555cc43e9c50 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7a98ff9700 1 -- 172.21.15.84:0/1965664599 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab4058630 con 0x555cc43e9c50 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7a98ff9700 1 -- 172.21.15.84:0/1965664599 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f7ab40511d0 con 0x555cc43e9c50 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7ac9c50b80 10 client.5442 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7ac9c50b80 10 client.5442 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7ac9c50b80 20 client.5442 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:32.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x555cc43c2210 0x555cc43f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7ac9c50b80 4 client.5442 mds_command: new command op to 5124 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:56:32.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/1965664599 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555cc428ce50 con 0x555cc43c2210 2023-10-06T02:56:32.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7aba59c700 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x555cc43c2210 0x555cc43f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7a98ff9700 10 client.5442 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:32.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.741+0000 7f7aba59c700 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x555cc43c2210 0x555cc43f7fb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56906e1cee1a0ac6 server_cookie=7062c85c0916ba1e in_seq=0 out_seq=0 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7a98ff9700 1 -- 172.21.15.84:0/1965664599 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555cc428ce50 con 0x555cc43c2210 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7a98ff9700 10 client.5442 handle_command_reply: tid=0 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7ac9c50b80 1 client.5442 shutdown 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/1965664599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 msgr2=0x555cc444ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc444ce50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009fd0 tx=0x7f7ab406d040 comp rx=0 tx=0).stop 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/1965664599 shutdown_connections 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x555cc43c2210 0x555cc43f7fb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cc4399890 0x555cc43eef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7a98ff9700 0 client.5442 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:32.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cc43e9c50 0x555cc444ce50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7ac9c50b80 1 --2- 172.21.15.84:0/1965664599 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555cc439ad10 0x555cc444c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.756+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/1965664599 >> 172.21.15.84:0/1965664599 conn(0x555cc439b1b0 msgr2=0x555cc43deae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/1965664599 shutdown_connections 2023-10-06T02:56:32.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac9c50b80 1 -- 172.21.15.84:0/1965664599 wait complete. 2023-10-06T02:56:32.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac9c50b80 20 client.5442 trim_cache size 0 max 16384 2023-10-06T02:56:32.760 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:56:32.760 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T02:56:32.760 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:56:32.761 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:56:32.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 -- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a9c066f30 msgr2=0x7f7a9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a9c066f30 0x7f7a9c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7aac001da0 tx=0x7f7aac015000 comp rx=0 tx=0).stop 2023-10-06T02:56:32.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 -- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7abc153200 msgr2=0x7f7abc153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7abc153200 0x7f7abc153670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7abc06d3b0 tx=0x7f7ab4008040 comp rx=0 tx=0).stop 2023-10-06T02:56:32.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 -- 172.21.15.84:0/1471477631 shutdown_connections 2023-10-06T02:56:32.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a9c066f30 0x7f7a9c0693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa4004b70 0x7f7abc14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7abc153200 0x7f7abc153670 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 --2- 172.21.15.84:0/1471477631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7abc0aee70 0x7f7abc0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 -- 172.21.15.84:0/1471477631 >> 172.21.15.84:0/1471477631 conn(0x7f7abc0cc0d0 msgr2=0x7f7abc0c8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 -- 172.21.15.84:0/1471477631 shutdown_connections 2023-10-06T02:56:32.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.757+0000 7f7ac0958700 1 -- 172.21.15.84:0/1471477631 wait complete. 2023-10-06T02:56:32.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:1 flush journal 2023-10-06T02:56:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.885+0000 7f89e25e8700 1 Processor -- start 2023-10-06T02:56:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.885+0000 7f89e25e8700 1 -- start start 2023-10-06T02:56:32.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e25e8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f89dc0cbb50 0x7f89dc0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e25e8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89dc0c6610 0x7f89dc0ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e25e8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc0b2e60 con 0x7f89dc0b2a90 2023-10-06T02:56:32.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e25e8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc0cf5d0 con 0x7f89dc0c6610 2023-10-06T02:56:32.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e25e8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc0cf8b0 con 0x7f89dc0cbb50 2023-10-06T02:56:32.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e0b85700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89dc0c6610 0x7f89dc0ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e0b85700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f89dc0c6610 0x7f89dc0ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52324/0 (socket says 172.21.15.84:52324) 2023-10-06T02:56:32.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e0b85700 1 -- 172.21.15.84:0/696789185 learned_addr learned my addr 172.21.15.84:0/696789185 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89db7fe700 1 --2- 172.21.15.84:0/696789185 >> v2:172.21.15.131:3300/0 conn(0x7f89dc0cbb50 0x7f89dc0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e0b85700 1 -- 172.21.15.84:0/696789185 >> v2:172.21.15.131:3300/0 conn(0x7f89dc0cbb50 msgr2=0x7f89dc0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e0b85700 1 --2- 172.21.15.84:0/696789185 >> v2:172.21.15.131:3300/0 conn(0x7f89dc0cbb50 0x7f89dc0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e0b85700 1 -- 172.21.15.84:0/696789185 >> v1:172.21.15.131:6789/0 conn(0x7f89dc0b2a90 legacy=0x7f89dc0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e0b85700 1 -- 172.21.15.84:0/696789185 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc0cfb90 con 0x7f89dc0c6610 2023-10-06T02:56:32.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89e0b85700 1 --2- 172.21.15.84:0/696789185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 0x7f89dc0ced90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f89dc088cd0 tx=0x7f89d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71be76be57d38b7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89daffd700 1 -- 172.21.15.84:0/696789185 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400e070 con 0x7f89dc0c6610 2023-10-06T02:56:32.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89daffd700 1 -- 172.21.15.84:0/696789185 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400ba10 con 0x7f89dc0c6610 2023-10-06T02:56:32.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.886+0000 7f89daffd700 1 -- 172.21.15.84:0/696789185 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40092e0 con 0x7f89dc0c6610 2023-10-06T02:56:32.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.887+0000 7f89e25e8700 1 -- 172.21.15.84:0/696789185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 msgr2=0x7f89dc0ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.887+0000 7f89e25e8700 1 --2- 172.21.15.84:0/696789185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 0x7f89dc0ced90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f89dc088cd0 tx=0x7f89d4009840 comp rx=0 tx=0).stop 2023-10-06T02:56:32.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.887+0000 7f89e25e8700 1 -- 172.21.15.84:0/696789185 shutdown_connections 2023-10-06T02:56:32.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.887+0000 7f89e25e8700 1 --2- 172.21.15.84:0/696789185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 0x7f89dc0ced90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.887+0000 7f89e25e8700 1 --2- 172.21.15.84:0/696789185 >> v2:172.21.15.131:3300/0 conn(0x7f89dc0cbb50 0x7f89dc0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.887+0000 7f89e25e8700 1 -- 172.21.15.84:0/696789185 >> 172.21.15.84:0/696789185 conn(0x7f89dc099740 msgr2=0x7f89dc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.887+0000 7f89e25e8700 1 -- 172.21.15.84:0/696789185 shutdown_connections 2023-10-06T02:56:32.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.887+0000 7f89e25e8700 1 -- 172.21.15.84:0/696789185 wait complete. 2023-10-06T02:56:32.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.888+0000 7f89e25e8700 1 Processor -- start 2023-10-06T02:56:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.888+0000 7f89e25e8700 1 -- start start 2023-10-06T02:56:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89e25e8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89dc0b2a90 0x7f89dc16aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89e25e8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 0x7f89dc15e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89e25e8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89dc0cbb50 0x7f89dc09b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89e25e8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc149560 con 0x7f89dc0c6610 2023-10-06T02:56:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89e25e8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc16b280 con 0x7f89dc0b2a90 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89e25e8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc16b560 con 0x7f89dc0cbb50 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 0x7f89dc15e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 0x7f89dc15e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52332/0 (socket says 172.21.15.84:52332) 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89db7fe700 1 -- 172.21.15.84:0/788392038 learned_addr learned my addr 172.21.15.84:0/788392038 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89dbfff700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89dc0b2a90 0x7f89dc16aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89db7fe700 1 -- 172.21.15.84:0/788392038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89dc0cbb50 msgr2=0x7f89dc09b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89db7fe700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89dc0cbb50 0x7f89dc09b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89db7fe700 1 -- 172.21.15.84:0/788392038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89dc0b2a90 msgr2=0x7f89dc16aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89db7fe700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89dc0b2a90 0x7f89dc16aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.889+0000 7f89db7fe700 1 -- 172.21.15.84:0/788392038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009ae0 con 0x7f89dc0c6610 2023-10-06T02:56:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.890+0000 7f89db7fe700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 0x7f89dc15e0f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00d860 tx=0x7f89cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.890+0000 7f89c3fff700 1 -- 172.21.15.84:0/788392038 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc009610 con 0x7f89dc0c6610 2023-10-06T02:56:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.890+0000 7f89c3fff700 1 -- 172.21.15.84:0/788392038 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc009770 con 0x7f89dc0c6610 2023-10-06T02:56:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.890+0000 7f89e25e8700 1 -- 172.21.15.84:0/788392038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc16b840 con 0x7f89dc0c6610 2023-10-06T02:56:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.890+0000 7f89c3fff700 1 -- 172.21.15.84:0/788392038 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc009b30 con 0x7f89dc0c6610 2023-10-06T02:56:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.890+0000 7f89e25e8700 1 -- 172.21.15.84:0/788392038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc16be00 con 0x7f89dc0c6610 2023-10-06T02:56:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.891+0000 7f89c3fff700 1 -- 172.21.15.84:0/788392038 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89cc01e460 con 0x7f89dc0c6610 2023-10-06T02:56:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.891+0000 7f89c3fff700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89c8066f30 0x7f89c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.892+0000 7f89c3fff700 1 -- 172.21.15.84:0/788392038 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f89cc084e40 con 0x7f89dc0c6610 2023-10-06T02:56:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.892+0000 7f89dbfff700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89c8066f30 0x7f89c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.892+0000 7f89dbfff700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89c8066f30 0x7f89c80693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89dc068710 tx=0x7f89d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.893+0000 7f89eb8e0b80 1 Processor -- start 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.893+0000 7f89eb8e0b80 1 -- start start 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.894+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8efe3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.894+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 0x55eb8f033710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.894+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8f033c50 0x55eb8f0340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.894+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb8ef3aac0 con 0x55eb8efe3890 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.894+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb8ef382c0 con 0x55eb8efe4d10 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.894+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb8ef340b0 con 0x55eb8f033c50 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.894+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8efe3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.894+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8efe3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52338/0 (socket says 172.21.15.84:52338) 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.894+0000 7f89dbfff700 1 -- 172.21.15.84:0/1247615033 learned_addr learned my addr 172.21.15.84:0/1247615033 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89dbfff700 1 -- 172.21.15.84:0/1247615033 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8f033c50 msgr2=0x55eb8f0340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89db7fe700 1 --2- 172.21.15.84:0/1247615033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 0x55eb8f033710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89dbfff700 1 --2- 172.21.15.84:0/1247615033 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8f033c50 0x55eb8f0340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89dbfff700 1 -- 172.21.15.84:0/1247615033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 msgr2=0x55eb8f033710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89dbfff700 1 --2- 172.21.15.84:0/1247615033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 0x55eb8f033710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89dbfff700 1 -- 172.21.15.84:0/1247615033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb8edce2c0 con 0x55eb8efe3890 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89db7fe700 1 --2- 172.21.15.84:0/1247615033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 0x55eb8f033710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89dbfff700 1 --2- 172.21.15.84:0/1247615033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8efe3c60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f89d0014a50 tx=0x7f89d0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baac5d6a29a34cf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89c17fa700 1 -- 172.21.15.84:0/1247615033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0012a70 con 0x55eb8efe3890 2023-10-06T02:56:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89c17fa700 1 -- 172.21.15.84:0/1247615033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d0012bd0 con 0x55eb8efe3890 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89c17fa700 1 -- 172.21.15.84:0/1247615033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d001f400 con 0x55eb8efe3890 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/1247615033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 msgr2=0x55eb8efe3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.895+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/1247615033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8efe3c60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f89d0014a50 tx=0x7f89d0014000 comp rx=0 tx=0).stop 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.896+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/1247615033 shutdown_connections 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.896+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/1247615033 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8f033c50 0x55eb8f0340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.896+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/1247615033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8efe3c60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.896+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/1247615033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 0x55eb8f033710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.896+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/1247615033 >> 172.21.15.84:0/1247615033 conn(0x55eb8efe51b0 msgr2=0x55eb8efe5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.896+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/1247615033 shutdown_connections 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.896+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/1247615033 wait complete. 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.896+0000 7f89eb8e0b80 1 -- start start 2023-10-06T02:56:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.896+0000 7f89eb8e0b80 1 Processor -- start 2023-10-06T02:56:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe3890 0x55eb8f00c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe4d10 0x55eb8f024770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8f033c50 0x55eb8f00e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb8eedf8e0 con 0x55eb8efe4d10 2023-10-06T02:56:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb8eefaef0 con 0x55eb8efe3890 2023-10-06T02:56:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb8edb6e80 con 0x55eb8f033c50 2023-10-06T02:56:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89eb8e0b80 10 client.0 _ll_register_callbacks cb 0x55eb8efa6ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe4d10 0x55eb8f024770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89db7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe4d10 0x55eb8f024770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52348/0 (socket says 172.21.15.84:52348) 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89db7fe700 1 -- 172.21.15.84:0/921869192 learned_addr learned my addr 172.21.15.84:0/921869192 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89dbfff700 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe3890 0x55eb8f00c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89e0b85700 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8f033c50 0x55eb8f00e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89db7fe700 1 -- 172.21.15.84:0/921869192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8f033c50 msgr2=0x55eb8f00e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89db7fe700 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8f033c50 0x55eb8f00e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89db7fe700 1 -- 172.21.15.84:0/921869192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe3890 msgr2=0x55eb8f00c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89db7fe700 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe3890 0x55eb8f00c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.897+0000 7f89db7fe700 1 -- 172.21.15.84:0/921869192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d00145b0 con 0x55eb8efe4d10 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89db7fe700 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe4d10 0x55eb8f024770 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f89cc006fd0 tx=0x7f89cc083020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9b7226245b8356 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89ba7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:32.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89ba7fc700 1 -- 172.21.15.84:0/921869192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc058da0 con 0x55eb8efe4d10 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89ba7fc700 1 -- 172.21.15.84:0/921869192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f89cc05ca70 con 0x55eb8efe4d10 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/921869192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb8efd8990 con 0x55eb8efe4d10 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89ba7fc700 1 -- 172.21.15.84:0/921869192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89cc0551d0 con 0x55eb8efe4d10 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89eb8e0b80 10 client.5454 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/921869192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55eb8ed71030 con 0x55eb8efe4d10 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89ba7fc700 1 -- 172.21.15.84:0/921869192 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc060030 con 0x55eb8efe4d10 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89ba7fc700 1 -- 172.21.15.84:0/921869192 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f89cc05c5e0 con 0x55eb8efe4d10 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89eb8e0b80 10 client.5454 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89eb8e0b80 10 client.5454 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.c 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89eb8e0b80 20 client.5454 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:32.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55eb8f02a880 0x55eb8f02ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89eb8e0b80 4 client.5454 mds_command: new command op to 5115 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/921869192 --> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb8efb58c0 con 0x55eb8f02a880 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.898+0000 7f89dbfff700 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55eb8f02a880 0x55eb8f02ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89ba7fc700 10 client.5454 ms_handle_connect on v2:172.21.15.84:6835/197493808 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89dbfff700 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55eb8f02a880 0x55eb8f02ac50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=91ec153b7d1df6ec server_cookie=e212f44b0c80b8b6 in_seq=0 out_seq=0 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89ba7fc700 1 -- 172.21.15.84:0/921869192 <== mds.1 v2:172.21.15.84:6835/197493808 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55eb8efb58c0 con 0x55eb8f02a880 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89ba7fc700 10 client.5454 handle_command_reply: tid=0 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 client.5454 shutdown 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/921869192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe4d10 msgr2=0x55eb8f024770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe4d10 0x55eb8f024770 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f89cc006fd0 tx=0x7f89cc083020 comp rx=0 tx=0).stop 2023-10-06T02:56:32.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/921869192 shutdown_connections 2023-10-06T02:56:32.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55eb8f02a880 0x55eb8f02ac50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe3890 0x55eb8f00c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89ba7fc700 0 client.5454 ms_handle_reset on v2:172.21.15.84:6835/197493808 2023-10-06T02:56:32.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8f033c50 0x55eb8f00e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/921869192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe4d10 0x55eb8f024770 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/921869192 >> 172.21.15.84:0/921869192 conn(0x55eb8efe51b0 msgr2=0x55eb8efe4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/921869192 shutdown_connections 2023-10-06T02:56:32.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/921869192 wait complete. 2023-10-06T02:56:32.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.899+0000 7f89eb8e0b80 20 client.5454 trim_cache size 0 max 16384 2023-10-06T02:56:32.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.913+0000 7f89eb8e0b80 1 Processor -- start 2023-10-06T02:56:32.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.913+0000 7f89eb8e0b80 1 -- start start 2023-10-06T02:56:32.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8f0333e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe4d10 0x55eb8f00c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8f033c50 0x55eb8f00cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb8efabe80 con 0x55eb8efe3890 2023-10-06T02:56:32.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb8f02d9b0 con 0x55eb8f033c50 2023-10-06T02:56:32.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb8efc3330 con 0x55eb8efe4d10 2023-10-06T02:56:32.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8f0333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89dbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8f0333e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52362/0 (socket says 172.21.15.84:52362) 2023-10-06T02:56:32.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89dbfff700 1 -- 172.21.15.84:0/615859080 learned_addr learned my addr 172.21.15.84:0/615859080 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89e0b85700 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8f033c50 0x55eb8f00cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89db7fe700 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe4d10 0x55eb8f00c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89dbfff700 1 -- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe4d10 msgr2=0x55eb8f00c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89dbfff700 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe4d10 0x55eb8f00c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89dbfff700 1 -- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8f033c50 msgr2=0x55eb8f00cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89dbfff700 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8f033c50 0x55eb8f00cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89dbfff700 1 -- 172.21.15.84:0/615859080 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb8ef027d0 con 0x55eb8efe3890 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89e0b85700 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8f033c50 0x55eb8f00cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89db7fe700 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe4d10 0x55eb8f00c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89dbfff700 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8f0333e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f89d0002080 tx=0x7f89d0016030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217d716cdf4f3cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89c1ffb700 1 -- 172.21.15.84:0/615859080 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0012a70 con 0x55eb8efe3890 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89c1ffb700 1 -- 172.21.15.84:0/615859080 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d002e070 con 0x55eb8efe3890 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.914+0000 7f89c1ffb700 1 -- 172.21.15.84:0/615859080 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d001f400 con 0x55eb8efe3890 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.915+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/615859080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 msgr2=0x55eb8f0333e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.915+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8f0333e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f89d0002080 tx=0x7f89d0016030 comp rx=0 tx=0).stop 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.915+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/615859080 shutdown_connections 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.915+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8f033c50 0x55eb8f00cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.915+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8efe3890 0x55eb8f0333e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.915+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/615859080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe4d10 0x55eb8f00c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.915+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/615859080 >> 172.21.15.84:0/615859080 conn(0x55eb8efe51b0 msgr2=0x55eb8f02ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.915+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/615859080 shutdown_connections 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.915+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/615859080 wait complete. 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.916+0000 7f89eb8e0b80 1 -- start start 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.916+0000 7f89eb8e0b80 1 Processor -- start 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.916+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe3890 0x55eb8f08f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.916+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 0x55eb8f00b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.916+0000 7f89eb8e0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8f033c50 0x55eb8f027020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.916+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb8f032830 con 0x55eb8f033c50 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.916+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb8f029b50 con 0x55eb8efe4d10 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.916+0000 7f89eb8e0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb8f027bf0 con 0x55eb8efe3890 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89eb8e0b80 10 client.0 _ll_register_callbacks cb 0x55eb8efa6ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:32.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89e0b85700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8f033c50 0x55eb8f027020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89e0b85700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8f033c50 0x55eb8f027020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52378/0 (socket says 172.21.15.84:52378) 2023-10-06T02:56:32.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89e0b85700 1 -- 172.21.15.84:0/489752542 learned_addr learned my addr 172.21.15.84:0/489752542 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:32.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89db7fe700 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 0x55eb8f00b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89dbfff700 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe3890 0x55eb8f08f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89e0b85700 1 -- 172.21.15.84:0/489752542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe3890 msgr2=0x55eb8f08f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89e0b85700 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe3890 0x55eb8f08f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89e0b85700 1 -- 172.21.15.84:0/489752542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 msgr2=0x55eb8f00b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:32.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89e0b85700 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 0x55eb8f00b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89e0b85700 1 -- 172.21.15.84:0/489752542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb8edce2c0 con 0x55eb8f033c50 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89dbfff700 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe3890 0x55eb8f08f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89e0b85700 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8f033c50 0x55eb8f027020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009fd0 tx=0x7f89d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5ae215c9f8b533 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89ba7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89ba7fc700 1 -- 172.21.15.84:0/489752542 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400bed0 con 0x55eb8f033c50 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89ba7fc700 1 -- 172.21.15.84:0/489752542 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f89d4012d60 con 0x55eb8f033c50 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/489752542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f89d0012bd0 con 0x55eb8f033c50 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89ba7fc700 1 -- 172.21.15.84:0/489752542 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89d40092e0 con 0x55eb8f033c50 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89eb8e0b80 10 client.5460 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/489752542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55eb8eee94c0 con 0x55eb8f033c50 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89ba7fc700 1 -- 172.21.15.84:0/489752542 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d0012bd0 con 0x55eb8f033c50 2023-10-06T02:56:32.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.917+0000 7f89ba7fc700 1 -- 172.21.15.84:0/489752542 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f89d4025020 con 0x55eb8f033c50 2023-10-06T02:56:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.918+0000 7f89eb8e0b80 10 client.5460 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.918+0000 7f89eb8e0b80 10 client.5460 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.c 2023-10-06T02:56:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.918+0000 7f89eb8e0b80 20 client.5460 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.918+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55eb8f00e880 0x55eb8f03c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.918+0000 7f89eb8e0b80 4 client.5460 mds_command: new command op to 5115 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:56:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.918+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/489752542 --> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eb8eed6e50 con 0x55eb8f00e880 2023-10-06T02:56:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.918+0000 7f89dbfff700 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55eb8f00e880 0x55eb8f03c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.918+0000 7f89ba7fc700 10 client.5460 ms_handle_connect on v2:172.21.15.84:6835/197493808 2023-10-06T02:56:32.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.918+0000 7f89dbfff700 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55eb8f00e880 0x55eb8f03c060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=adbea8b3c9739f71 server_cookie=1e954ddb3e0034f9 in_seq=0 out_seq=0 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.928+0000 7f89ba7fc700 1 -- 172.21.15.84:0/489752542 <== mds.1 v2:172.21.15.84:6835/197493808 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eb8eed6e50 con 0x55eb8f00e880 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.928+0000 7f89ba7fc700 10 client.5460 handle_command_reply: tid=0 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 client.5460 shutdown 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/489752542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8f033c50 msgr2=0x55eb8f027020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8f033c50 0x55eb8f027020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009fd0 tx=0x7f89d4017000 comp rx=0 tx=0).stop 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/489752542 shutdown_connections 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.84:6835/197493808,v1:172.21.15.84:6837/197493808] conn(0x55eb8f00e880 0x55eb8f03c060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55eb8f033c50 0x55eb8f027020 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89ba7fc700 0 client.5460 ms_handle_reset on v2:172.21.15.84:6835/197493808 2023-10-06T02:56:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55eb8efe3890 0x55eb8f08f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 --2- 172.21.15.84:0/489752542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb8efe4d10 0x55eb8f00b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/489752542 >> 172.21.15.84:0/489752542 conn(0x55eb8efe51b0 msgr2=0x55eb8f0332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/489752542 shutdown_connections 2023-10-06T02:56:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 1 -- 172.21.15.84:0/489752542 wait complete. 2023-10-06T02:56:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89eb8e0b80 20 client.5460 trim_cache size 0 max 16384 2023-10-06T02:56:32.932 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:56:32.932 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T02:56:32.932 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:56:32.932 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:56:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 -- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89c8066f30 msgr2=0x7f89c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89c8066f30 0x7f89c80693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89dc068710 tx=0x7f89d0009040 comp rx=0 tx=0).stop 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 -- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 msgr2=0x7f89dc15e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 0x7f89dc15e0f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00d860 tx=0x7f89cc008040 comp rx=0 tx=0).stop 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 -- 172.21.15.84:0/788392038 shutdown_connections 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89c8066f30 0x7f89c80693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89dc0b2a90 0x7f89dc16aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89dc0cbb50 0x7f89dc09b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 --2- 172.21.15.84:0/788392038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc0c6610 0x7f89dc15e0f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.929+0000 7f89e25e8700 1 -- 172.21.15.84:0/788392038 >> 172.21.15.84:0/788392038 conn(0x7f89dc099740 msgr2=0x7f89dc0cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.930+0000 7f89e25e8700 1 -- 172.21.15.84:0/788392038 shutdown_connections 2023-10-06T02:56:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:32.930+0000 7f89e25e8700 1 -- 172.21.15.84:0/788392038 wait complete. 2023-10-06T02:56:32.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:2 flush journal 2023-10-06T02:56:33.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.056+0000 7f623e7a3700 1 Processor -- start 2023-10-06T02:56:33.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.056+0000 7f623e7a3700 1 -- start start 2023-10-06T02:56:33.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.057+0000 7f623e7a3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62380c6610 0x7f62380cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.057+0000 7f623e7a3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62380b2e60 con 0x7f62380b2a90 2023-10-06T02:56:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.057+0000 7f623e7a3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62380cf5d0 con 0x7f62380cbb50 2023-10-06T02:56:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.057+0000 7f623e7a3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62380cf8b0 con 0x7f62380c6610 2023-10-06T02:56:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.057+0000 7f6237fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f62380b2a90 0x7f62380cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59370/0 (socket says 172.21.15.84:59370) 2023-10-06T02:56:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.057+0000 7f6237fff700 1 -- 172.21.15.84:0/800353722 learned_addr learned my addr 172.21.15.84:0/800353722 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.057+0000 7f623cd40700 1 --2- 172.21.15.84:0/800353722 >> v2:172.21.15.84:3300/0 conn(0x7f62380c6610 0x7f62380cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.057+0000 7f6236ffd700 1 -- 172.21.15.84:0/800353722 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586709975 0 0) 0x7f62380b2e60 con 0x7f62380b2a90 2023-10-06T02:56:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f6236ffd700 1 -- 172.21.15.84:0/800353722 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6220003570 con 0x7f62380b2a90 2023-10-06T02:56:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623cd40700 1 -- 172.21.15.84:0/800353722 >> v1:172.21.15.131:6789/0 conn(0x7f62380cbb50 legacy=0x7f62380ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:33.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623cd40700 1 -- 172.21.15.84:0/800353722 >> v1:172.21.15.84:6789/0 conn(0x7f62380b2a90 legacy=0x7f62380cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623cd40700 1 -- 172.21.15.84:0/800353722 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380cfb90 con 0x7f62380c6610 2023-10-06T02:56:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623cd40700 1 --2- 172.21.15.84:0/800353722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380c6610 0x7f62380cef60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6230009e60 tx=0x7f6230009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387124223632d6ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f6236ffd700 1 -- 172.21.15.84:0/800353722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623000e070 con 0x7f62380c6610 2023-10-06T02:56:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f6236ffd700 1 -- 172.21.15.84:0/800353722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623000bb20 con 0x7f62380c6610 2023-10-06T02:56:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f6236ffd700 1 -- 172.21.15.84:0/800353722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230012430 con 0x7f62380c6610 2023-10-06T02:56:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623e7a3700 1 -- 172.21.15.84:0/800353722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380c6610 msgr2=0x7f62380cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623e7a3700 1 --2- 172.21.15.84:0/800353722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380c6610 0x7f62380cef60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6230009e60 tx=0x7f6230009780 comp rx=0 tx=0).stop 2023-10-06T02:56:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623e7a3700 1 -- 172.21.15.84:0/800353722 shutdown_connections 2023-10-06T02:56:33.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623e7a3700 1 --2- 172.21.15.84:0/800353722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380c6610 0x7f62380cef60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623e7a3700 1 -- 172.21.15.84:0/800353722 >> 172.21.15.84:0/800353722 conn(0x7f6238099740 msgr2=0x7f623806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:33.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623e7a3700 1 -- 172.21.15.84:0/800353722 shutdown_connections 2023-10-06T02:56:33.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.058+0000 7f623e7a3700 1 -- 172.21.15.84:0/800353722 wait complete. 2023-10-06T02:56:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.059+0000 7f623e7a3700 1 Processor -- start 2023-10-06T02:56:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f623e7a3700 1 -- start start 2023-10-06T02:56:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f623e7a3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380b2a90 0x7f6238144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f623e7a3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62380c6610 0x7f623809ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f623e7a3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62380cbb50 0x7f62380ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f623e7a3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623809c0d0 con 0x7f62380b2a90 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f623e7a3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623809b4c0 con 0x7f62380c6610 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f623e7a3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623809b7a0 con 0x7f62380cbb50 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f6237fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380b2a90 0x7f6238144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f6237fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380b2a90 0x7f6238144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52398/0 (socket says 172.21.15.84:52398) 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.060+0000 7f6237fff700 1 -- 172.21.15.84:0/3538460824 learned_addr learned my addr 172.21.15.84:0/3538460824 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f62377fe700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62380c6610 0x7f623809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f623cd40700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62380cbb50 0x7f62380ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f6237fff700 1 -- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62380cbb50 msgr2=0x7f62380ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f6237fff700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62380cbb50 0x7f62380ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f6237fff700 1 -- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62380c6610 msgr2=0x7f623809ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f6237fff700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62380c6610 0x7f623809ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f6237fff700 1 -- 172.21.15.84:0/3538460824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230009a20 con 0x7f62380b2a90 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f623cd40700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62380cbb50 0x7f62380ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f62377fe700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62380c6610 0x7f623809ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f6237fff700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380b2a90 0x7f6238144670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f622800c790 tx=0x7f6228007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f621ffff700 1 -- 172.21.15.84:0/3538460824 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6228007300 con 0x7f62380b2a90 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f621ffff700 1 -- 172.21.15.84:0/3538460824 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6228007460 con 0x7f62380b2a90 2023-10-06T02:56:33.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f623e7a3700 1 -- 172.21.15.84:0/3538460824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623809ba80 con 0x7f62380b2a90 2023-10-06T02:56:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f621ffff700 1 -- 172.21.15.84:0/3538460824 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62280057f0 con 0x7f62380b2a90 2023-10-06T02:56:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.061+0000 7f623e7a3700 1 -- 172.21.15.84:0/3538460824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6238144bb0 con 0x7f62380b2a90 2023-10-06T02:56:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.062+0000 7f621ffff700 1 -- 172.21.15.84:0/3538460824 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6228005c20 con 0x7f62380b2a90 2023-10-06T02:56:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.063+0000 7f621ffff700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.063+0000 7f62377fe700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.063+0000 7f621ffff700 1 -- 172.21.15.84:0/3538460824 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6228084330 con 0x7f62380b2a90 2023-10-06T02:56:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.063+0000 7f62377fe700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6224066f30 0x7f62240693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f622c006fd0 tx=0x7f622c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:33.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.065+0000 7f6247a9bb80 1 Processor -- start 2023-10-06T02:56:33.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.065+0000 7f6247a9bb80 1 -- start start 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 0x563950066c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950067d10 0x5639500b6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 0x5639500b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394ffbdac0 con 0x563950067d10 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394ffbb2c0 con 0x563950066890 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56394ffb70b0 con 0x5639500b6c50 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f62377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950067d10 0x5639500b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f62377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950067d10 0x5639500b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52412/0 (socket says 172.21.15.84:52412) 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f62377fe700 1 -- 172.21.15.84:0/2066104150 learned_addr learned my addr 172.21.15.84:0/2066104150 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:33.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f623cd40700 1 --2- 172.21.15.84:0/2066104150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 0x5639500b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f6237fff700 1 --2- 172.21.15.84:0/2066104150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 0x563950066c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f62377fe700 1 -- 172.21.15.84:0/2066104150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 msgr2=0x5639500b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f62377fe700 1 --2- 172.21.15.84:0/2066104150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 0x5639500b70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f62377fe700 1 -- 172.21.15.84:0/2066104150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 msgr2=0x563950066c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f62377fe700 1 --2- 172.21.15.84:0/2066104150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 0x563950066c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f62377fe700 1 -- 172.21.15.84:0/2066104150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56394fe512c0 con 0x563950067d10 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f62377fe700 1 --2- 172.21.15.84:0/2066104150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950067d10 0x5639500b6710 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f622c00cb00 tx=0x7f622c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b679b6bf07d9c2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f621d7fa700 1 -- 172.21.15.84:0/2066104150 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c011880 con 0x563950067d10 2023-10-06T02:56:33.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f621d7fa700 1 -- 172.21.15.84:0/2066104150 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c011a00 con 0x563950067d10 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.066+0000 7f621d7fa700 1 -- 172.21.15.84:0/2066104150 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c011dc0 con 0x563950067d10 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.067+0000 7f6247a9bb80 1 -- 172.21.15.84:0/2066104150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950067d10 msgr2=0x5639500b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.067+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/2066104150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950067d10 0x5639500b6710 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f622c00cb00 tx=0x7f622c012000 comp rx=0 tx=0).stop 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.067+0000 7f6247a9bb80 1 -- 172.21.15.84:0/2066104150 shutdown_connections 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.067+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/2066104150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 0x563950066c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.067+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/2066104150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 0x5639500b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.067+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/2066104150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950067d10 0x5639500b6710 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.067+0000 7f6247a9bb80 1 -- 172.21.15.84:0/2066104150 >> 172.21.15.84:0/2066104150 conn(0x5639500681b0 msgr2=0x563950068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.067+0000 7f6247a9bb80 1 -- 172.21.15.84:0/2066104150 shutdown_connections 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.067+0000 7f6247a9bb80 1 -- 172.21.15.84:0/2066104150 wait complete. 2023-10-06T02:56:33.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.068+0000 7f6247a9bb80 1 -- start start 2023-10-06T02:56:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.068+0000 7f6247a9bb80 1 Processor -- start 2023-10-06T02:56:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950066890 0x56395008fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 0x5639500c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x5639500aa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394ff628e0 con 0x5639500b6c50 2023-10-06T02:56:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394ff7def0 con 0x563950067d10 2023-10-06T02:56:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56394fe39e80 con 0x563950066890 2023-10-06T02:56:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 10 client.0 _ll_register_callbacks cb 0x563950029ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:33.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f623cd40700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x5639500aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f623cd40700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x5639500aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52424/0 (socket says 172.21.15.84:52424) 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f623cd40700 1 -- 172.21.15.84:0/1369207049 learned_addr learned my addr 172.21.15.84:0/1369207049 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f62377fe700 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 0x5639500c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6237fff700 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950066890 0x56395008fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f623cd40700 1 -- 172.21.15.84:0/1369207049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950066890 msgr2=0x56395008fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f623cd40700 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950066890 0x56395008fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f623cd40700 1 -- 172.21.15.84:0/1369207049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 msgr2=0x5639500c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f623cd40700 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 0x5639500c0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f623cd40700 1 -- 172.21.15.84:0/1369207049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c00c660 con 0x5639500b6c50 2023-10-06T02:56:33.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f623cd40700 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x5639500aa490 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6230003000 tx=0x7f6230018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1999dccd22afc28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f62167fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f62167fc700 1 -- 172.21.15.84:0/1369207049 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230022070 con 0x5639500b6c50 2023-10-06T02:56:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f62167fc700 1 -- 172.21.15.84:0/1369207049 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6230012df0 con 0x5639500b6c50 2023-10-06T02:56:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1369207049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56395005b990 con 0x5639500b6c50 2023-10-06T02:56:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f62167fc700 1 -- 172.21.15.84:0/1369207049 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f623001c620 con 0x5639500b6c50 2023-10-06T02:56:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 10 client.5475 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.069+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1369207049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x56394fdf4030 con 0x5639500b6c50 2023-10-06T02:56:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f62167fc700 1 -- 172.21.15.84:0/1369207049 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56395005b990 con 0x5639500b6c50 2023-10-06T02:56:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f62167fc700 1 -- 172.21.15.84:0/1369207049 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f623000b050 con 0x5639500b6c50 2023-10-06T02:56:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f6247a9bb80 10 client.5475 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f6247a9bb80 10 client.5475 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.a 2023-10-06T02:56:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f6247a9bb80 20 client.5475 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x5639500ae370 0x5639500ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f6247a9bb80 4 client.5475 mds_command: new command op to 5112 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:56:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1369207049 --> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639500388c0 con 0x5639500ae370 2023-10-06T02:56:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f6237fff700 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x5639500ae370 0x5639500ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f62167fc700 10 client.5475 ms_handle_connect on v2:172.21.15.84:6834/1815868063 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.070+0000 7f6237fff700 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x5639500ae370 0x5639500ae740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22d01e158f8e59b9 server_cookie=7e720071e33040e6 in_seq=0 out_seq=0 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f62167fc700 1 -- 172.21.15.84:0/1369207049 <== mds.2 v2:172.21.15.84:6834/1815868063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5639500388c0 con 0x5639500ae370 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f62167fc700 10 client.5475 handle_command_reply: tid=0 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 client.5475 shutdown 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1369207049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 msgr2=0x5639500aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x5639500aa490 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6230003000 tx=0x7f6230018000 comp rx=0 tx=0).stop 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1369207049 shutdown_connections 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x5639500ae370 0x5639500ae740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x5639500aa490 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950066890 0x56395008fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f62167fc700 0 client.5475 ms_handle_reset on v2:172.21.15.84:6834/1815868063 2023-10-06T02:56:33.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1369207049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 0x5639500c0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1369207049 >> 172.21.15.84:0/1369207049 conn(0x5639500681b0 msgr2=0x563950067200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:33.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1369207049 shutdown_connections 2023-10-06T02:56:33.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1369207049 wait complete. 2023-10-06T02:56:33.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.071+0000 7f6247a9bb80 20 client.5475 trim_cache size 0 max 16384 2023-10-06T02:56:33.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.084+0000 7f6247a9bb80 1 Processor -- start 2023-10-06T02:56:33.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.085+0000 7f6247a9bb80 1 -- start start 2023-10-06T02:56:33.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.085+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950066890 0x5639500aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.085+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 0x5639500ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.085+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 0x5639500964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.085+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563950066240 con 0x563950066890 2023-10-06T02:56:33.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.085+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395006a1e0 con 0x563950067d10 2023-10-06T02:56:33.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.085+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563950067b80 con 0x5639500b6c50 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.085+0000 7f6237fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950066890 0x5639500aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.085+0000 7f6237fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950066890 0x5639500aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52438/0 (socket says 172.21.15.84:52438) 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f6237fff700 1 -- 172.21.15.84:0/310396603 learned_addr learned my addr 172.21.15.84:0/310396603 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f62377fe700 1 --2- 172.21.15.84:0/310396603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 0x5639500ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f623cd40700 1 --2- 172.21.15.84:0/310396603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 0x5639500964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f6237fff700 1 -- 172.21.15.84:0/310396603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 msgr2=0x5639500964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f6237fff700 1 --2- 172.21.15.84:0/310396603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 0x5639500964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f6237fff700 1 -- 172.21.15.84:0/310396603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 msgr2=0x5639500ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f6237fff700 1 --2- 172.21.15.84:0/310396603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 0x5639500ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f6237fff700 1 -- 172.21.15.84:0/310396603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56394ff857d0 con 0x563950066890 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f6237fff700 1 --2- 172.21.15.84:0/310396603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950066890 0x5639500aec60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f62280825a0 tx=0x7f622801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5d0e6a65470b15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f621dffb700 1 -- 172.21.15.84:0/310396603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62280581f0 con 0x563950066890 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f621dffb700 1 -- 172.21.15.84:0/310396603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622805bf40 con 0x563950066890 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.086+0000 7f621dffb700 1 -- 172.21.15.84:0/310396603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62280840b0 con 0x563950066890 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 -- 172.21.15.84:0/310396603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950066890 msgr2=0x5639500aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/310396603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950066890 0x5639500aec60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f62280825a0 tx=0x7f622801d040 comp rx=0 tx=0).stop 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 -- 172.21.15.84:0/310396603 shutdown_connections 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/310396603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639500b6c50 0x5639500964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/310396603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563950066890 0x5639500aec60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/310396603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950067d10 0x5639500ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 -- 172.21.15.84:0/310396603 >> 172.21.15.84:0/310396603 conn(0x5639500681b0 msgr2=0x563950067200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:33.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 -- 172.21.15.84:0/310396603 shutdown_connections 2023-10-06T02:56:33.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 -- 172.21.15.84:0/310396603 wait complete. 2023-10-06T02:56:33.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 -- start start 2023-10-06T02:56:33.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.087+0000 7f6247a9bb80 1 Processor -- start 2023-10-06T02:56:33.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 0x563950112d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950067d10 0x5639500964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f6247a9bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x563950096a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639500bf9b0 con 0x5639500b6c50 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639500b5990 con 0x563950066890 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f6247a9bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639500b5ec0 con 0x563950067d10 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f6247a9bb80 10 client.0 _ll_register_callbacks cb 0x563950029ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f623cd40700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x563950096a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f623cd40700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x563950096a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52446/0 (socket says 172.21.15.84:52446) 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f623cd40700 1 -- 172.21.15.84:0/1517944906 learned_addr learned my addr 172.21.15.84:0/1517944906 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f6237fff700 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 0x563950112d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f62377fe700 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950067d10 0x5639500964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f623cd40700 1 -- 172.21.15.84:0/1517944906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950067d10 msgr2=0x5639500964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f623cd40700 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950067d10 0x5639500964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f623cd40700 1 -- 172.21.15.84:0/1517944906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 msgr2=0x563950112d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.088+0000 7f623cd40700 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 0x563950112d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f623cd40700 1 -- 172.21.15.84:0/1517944906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6238144bb0 con 0x5639500b6c50 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f62377fe700 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950067d10 0x5639500964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f623cd40700 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x563950096a20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x5639500afa80 tx=0x7f6230022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb9cf6082d60b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f62167fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f62167fc700 1 -- 172.21.15.84:0/1517944906 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623001c8c0 con 0x5639500b6c50 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f62167fc700 1 -- 172.21.15.84:0/1517944906 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f623001ca20 con 0x5639500b6c50 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1517944906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f622c011a00 con 0x5639500b6c50 2023-10-06T02:56:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f62167fc700 1 -- 172.21.15.84:0/1517944906 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f623001cdf0 con 0x5639500b6c50 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6247a9bb80 10 client.5481 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1517944906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x56394ff6c4c0 con 0x5639500b6c50 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f62167fc700 1 -- 172.21.15.84:0/1517944906 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c011a00 con 0x5639500b6c50 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f62167fc700 1 -- 172.21.15.84:0/1517944906 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f6230034410 con 0x5639500b6c50 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6247a9bb80 10 client.5481 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6247a9bb80 10 client.5481 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.a 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6247a9bb80 20 client.5481 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x5639500b64f0 0x56395008e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6247a9bb80 4 client.5481 mds_command: new command op to 5112 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1517944906 --> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56394ff59e50 con 0x5639500b64f0 2023-10-06T02:56:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.089+0000 7f6237fff700 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x5639500b64f0 0x56395008e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.090+0000 7f62167fc700 10 client.5481 ms_handle_connect on v2:172.21.15.84:6834/1815868063 2023-10-06T02:56:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.090+0000 7f6237fff700 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x5639500b64f0 0x56395008e800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8225cfb6f86f0fa server_cookie=69c31ad16920a9ca in_seq=0 out_seq=0 2023-10-06T02:56:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f62167fc700 1 -- 172.21.15.84:0/1517944906 <== mds.2 v2:172.21.15.84:6834/1815868063 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56394ff59e50 con 0x5639500b64f0 2023-10-06T02:56:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f62167fc700 10 client.5481 handle_command_reply: tid=0 2023-10-06T02:56:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 client.5481 shutdown 2023-10-06T02:56:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1517944906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 msgr2=0x563950096a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x563950096a20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x5639500afa80 tx=0x7f6230022000 comp rx=0 tx=0).stop 2023-10-06T02:56:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1517944906 shutdown_connections 2023-10-06T02:56:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.84:6834/1815868063,v1:172.21.15.84:6836/1815868063] conn(0x5639500b64f0 0x56395008e800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563950066890 0x563950112d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639500b6c50 0x563950096a20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f62167fc700 0 client.5481 ms_handle_reset on v2:172.21.15.84:6834/1815868063 2023-10-06T02:56:33.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 --2- 172.21.15.84:0/1517944906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563950067d10 0x5639500964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1517944906 >> 172.21.15.84:0/1517944906 conn(0x5639500681b0 msgr2=0x5639500aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:33.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1517944906 shutdown_connections 2023-10-06T02:56:33.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 1 -- 172.21.15.84:0/1517944906 wait complete. 2023-10-06T02:56:33.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.097+0000 7f6247a9bb80 20 client.5481 trim_cache size 0 max 16384 2023-10-06T02:56:33.100 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:56:33.101 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T02:56:33.101 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:56:33.101 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:56:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 -- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6224066f30 msgr2=0x7f62240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6224066f30 0x7f62240693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f622c006fd0 tx=0x7f622c008040 comp rx=0 tx=0).stop 2023-10-06T02:56:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 -- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380b2a90 msgr2=0x7f6238144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380b2a90 0x7f6238144670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f622800c790 tx=0x7f6228007c80 comp rx=0 tx=0).stop 2023-10-06T02:56:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 -- 172.21.15.84:0/3538460824 shutdown_connections 2023-10-06T02:56:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f62380cbb50 0x7f62380ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380b2a90 0x7f6238144670 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 --2- 172.21.15.84:0/3538460824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62380c6610 0x7f623809ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 -- 172.21.15.84:0/3538460824 >> 172.21.15.84:0/3538460824 conn(0x7f6238099740 msgr2=0x7f6238069210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 -- 172.21.15.84:0/3538460824 shutdown_connections 2023-10-06T02:56:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:33.098+0000 7f623e7a3700 1 -- 172.21.15.84:0/3538460824 wait complete. 2023-10-06T02:56:33.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:56:33.111 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-10-06T02:56:33.133 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/ 2023-10-06T02:56:33.133 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4 2023-10-06T02:56:33.133 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5 2023-10-06T02:56:33.134 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6 2023-10-06T02:56:33.134 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7 2023-10-06T02:56:33.134 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-10-06T02:56:33.135 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:56:33.135 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:56:33.135 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:56:33.135 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:56:33.135 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-10-06T02:56:33.135 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:56:33.239 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627778 2023-10-06T02:56:33.428 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:56:33.428 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:56:33.428 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:56:33.428 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:56:33.428 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-10-06T02:56:33.428 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:56:33.531 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627779 2023-10-06T02:56:33.721 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:56:33.721 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:56:33.721 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:56:33.721 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:56:33.721 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-10-06T02:56:33.721 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:56:33.825 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627780 2023-10-06T02:56:34.014 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:56:34.014 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:56:34.014 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:56:34.014 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:56:34.014 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-10-06T02:56:34.014 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:56:34.117 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627781 2023-10-06T02:56:34.307 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:56:34.307 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:56:34.307 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:56:34.307 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:56:34.307 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-10-06T02:56:34.307 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:56:34.411 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627782 2023-10-06T02:56:34.600 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:56:34.600 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:56:34.600 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:56:34.600 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:56:34.600 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-10-06T02:56:34.600 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:56:34.703 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627783 2023-10-06T02:56:34.894 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 tag path /d1/d2/d3 tag123 2023-10-06T02:56:35.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.052+0000 7f5d61988700 1 Processor -- start 2023-10-06T02:56:35.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.052+0000 7f5d61988700 1 -- start start 2023-10-06T02:56:35.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d61988700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5d5c0b23a0 0x7f5d5c0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d61988700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5c0b2d20 con 0x7f5d5c0aee20 2023-10-06T02:56:35.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d61988700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5c0b0450 con 0x7f5d5c06ed20 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d61988700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5c06fb80 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d527fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5d5c0b23a0 0x7f5d5c0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d5b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5d5c0aee20 0x7f5d5c0af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59378/0 (socket says 172.21.15.84:59378) 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/1615041964 learned_addr learned my addr 172.21.15.84:0/1615041964 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d527fc700 1 -- 172.21.15.84:0/1615041964 >> v1:172.21.15.131:6789/0 conn(0x7f5d5c06ed20 legacy=0x7f5d5c06f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d527fc700 1 -- 172.21.15.84:0/1615041964 >> v1:172.21.15.84:6789/0 conn(0x7f5d5c0aee20 legacy=0x7f5d5c0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d527fc700 1 -- 172.21.15.84:0/1615041964 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c0b2a40 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.053+0000 7f5d5a7fc700 1 -- 172.21.15.84:0/1615041964 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539367259 0 0) 0x7f5d5c0b2d20 con 0x7f5d5c0aee20 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d527fc700 1 --2- 172.21.15.84:0/1615041964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 0x7f5d5c0b08e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5d440098e0 tx=0x7f5d440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8101fa694db86d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d5a7fc700 1 -- 172.21.15.84:0/1615041964 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44009e80 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d5a7fc700 1 -- 172.21.15.84:0/1615041964 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400b820 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d5a7fc700 1 -- 172.21.15.84:0/1615041964 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400bba0 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d61988700 1 -- 172.21.15.84:0/1615041964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 msgr2=0x7f5d5c0b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d61988700 1 --2- 172.21.15.84:0/1615041964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 0x7f5d5c0b08e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5d440098e0 tx=0x7f5d440091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d61988700 1 -- 172.21.15.84:0/1615041964 shutdown_connections 2023-10-06T02:56:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d61988700 1 --2- 172.21.15.84:0/1615041964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 0x7f5d5c0b08e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d61988700 1 -- 172.21.15.84:0/1615041964 >> 172.21.15.84:0/1615041964 conn(0x7f5d5c068330 msgr2=0x7f5d5c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d61988700 1 -- 172.21.15.84:0/1615041964 shutdown_connections 2023-10-06T02:56:35.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.054+0000 7f5d61988700 1 -- 172.21.15.84:0/1615041964 wait complete. 2023-10-06T02:56:35.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d61988700 1 Processor -- start 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d61988700 1 -- start start 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d61988700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d5c06ed20 0x7f5d5c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d61988700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d5c0aee20 0x7f5d5c0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d61988700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 0x7f5d5c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d61988700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c1562e0 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d61988700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c157b50 con 0x7f5d5c06ed20 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d61988700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5c157e30 con 0x7f5d5c0aee20 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 0x7f5d5c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 0x7f5d5c0cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52458/0 (socket says 172.21.15.84:52458) 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.056+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/499589358 learned_addr learned my addr 172.21.15.84:0/499589358 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d5affd700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d5c06ed20 0x7f5d5c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d527fc700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d5c0aee20 0x7f5d5c0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/499589358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d5c0aee20 msgr2=0x7f5d5c0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d5c0aee20 0x7f5d5c0cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/499589358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d5c06ed20 msgr2=0x7f5d5c15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d5c06ed20 0x7f5d5c15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/499589358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009420 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d5affd700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d5c06ed20 0x7f5d5c15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 0x7f5d5c0cc780 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400cbf0 tx=0x7f5d540019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d537fe700 1 -- 172.21.15.84:0/499589358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400a9c0 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d537fe700 1 -- 172.21.15.84:0/499589358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400ab20 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d537fe700 1 -- 172.21.15.84:0/499589358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d540070f0 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d61988700 1 -- 172.21.15.84:0/499589358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5c158110 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.057+0000 7f5d61988700 1 -- 172.21.15.84:0/499589358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c15c670 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.058+0000 7f5d537fe700 1 -- 172.21.15.84:0/499589358 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d54007520 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.059+0000 7f5d537fe700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d3c066f30 0x7f5d3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.059+0000 7f5d537fe700 1 -- 172.21.15.84:0/499589358 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5d54084c50 con 0x7f5d5c0b23a0 2023-10-06T02:56:35.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.059+0000 7f5d5affd700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d3c066f30 0x7f5d3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.059+0000 7f5d5affd700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d3c066f30 0x7f5d3c0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c006fd0 tx=0x7f5d4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.061+0000 7f5d6ac80b80 1 Processor -- start 2023-10-06T02:56:35.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.061+0000 7f5d6ac80b80 1 -- start start 2023-10-06T02:56:35.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8cdccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d2c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d2d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c8c33b30 con 0x5559c8d2ccc0 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c8c31330 con 0x5559c8cdc900 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559c8c2d120 con 0x5559c8cddd80 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d2d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d2d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52474/0 (socket says 172.21.15.84:52474) 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3220568869 learned_addr learned my addr 172.21.15.84:0/3220568869 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5affd700 1 --2- 172.21.15.84:0/3220568869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8cdccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d527fc700 1 --2- 172.21.15.84:0/3220568869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d2c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3220568869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 msgr2=0x5559c8d2c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/3220568869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d2c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3220568869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 msgr2=0x5559c8cdccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/3220568869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8cdccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3220568869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c8ac7330 con 0x5559c8d2ccc0 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/3220568869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d2d110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5d54082e00 tx=0x7f5d54082d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d64bac36ac3507 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d3bfff700 1 -- 172.21.15.84:0/3220568869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d540558c0 con 0x5559c8d2ccc0 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d3bfff700 1 -- 172.21.15.84:0/3220568869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d54058b10 con 0x5559c8d2ccc0 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.062+0000 7f5d3bfff700 1 -- 172.21.15.84:0/3220568869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5405c860 con 0x5559c8d2ccc0 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.063+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3220568869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 msgr2=0x5559c8d2d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.063+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3220568869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d2d110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5d54082e00 tx=0x7f5d54082d90 comp rx=0 tx=0).stop 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.063+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3220568869 shutdown_connections 2023-10-06T02:56:35.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.063+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3220568869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8cdccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.063+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3220568869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d2d110 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.063+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3220568869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d2c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.063+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3220568869 >> 172.21.15.84:0/3220568869 conn(0x5559c8cde220 msgr2=0x5559c8cde5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.063+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3220568869 shutdown_connections 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.063+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3220568869 wait complete. 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.064+0000 7f5d6ac80b80 1 -- start start 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.064+0000 7f5d6ac80b80 1 Processor -- start 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.064+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cdc900 0x5559c8d04e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cddd80 0x5559c8cd9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8cd9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c8bd8950 con 0x5559c8d2ccc0 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c8bf3f60 con 0x5559c8cddd80 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559c8aafef0 con 0x5559c8cdc900 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d6ac80b80 10 client.0 _ll_register_callbacks cb 0x5559c8c9ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8cd9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8cd9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52476/0 (socket says 172.21.15.84:52476) 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3484939700 learned_addr learned my addr 172.21.15.84:0/3484939700 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d527fc700 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cddd80 0x5559c8cd9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5affd700 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cdc900 0x5559c8d04e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cdc900 msgr2=0x5559c8d04e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cdc900 0x5559c8d04e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cddd80 msgr2=0x5559c8cd9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cddd80 0x5559c8cd9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/3484939700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5c15c670 con 0x5559c8d2ccc0 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8cd9950 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5d54051dc0 tx=0x7f5d54082000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4130841aadbe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d397fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d397fa700 1 -- 172.21.15.84:0/3484939700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54054db0 con 0x5559c8d2ccc0 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d397fa700 1 -- 172.21.15.84:0/3484939700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5d54054f10 con 0x5559c8d2ccc0 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3484939700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559c8cd1a00 con 0x5559c8d2ccc0 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d397fa700 1 -- 172.21.15.84:0/3484939700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d5405c3d0 con 0x5559c8d2ccc0 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d6ac80b80 10 client.5496 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.065+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3484939700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5559c8a6a0a0 con 0x5559c8d2ccc0 2023-10-06T02:56:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d397fa700 1 -- 172.21.15.84:0/3484939700 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5406f070 con 0x5559c8d2ccc0 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d397fa700 1 -- 172.21.15.84:0/3484939700 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f5d5401ac10 con 0x5559c8d2ccc0 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d6ac80b80 10 client.5496 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d6ac80b80 10 client.5496 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d6ac80b80 20 client.5496 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5559c8d2a320 0x5559c8d2b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d6ac80b80 4 client.5496 mds_command: new command op to 5124 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3484939700 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559c8cae930 con 0x5559c8d2a320 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d5affd700 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5559c8d2a320 0x5559c8d2b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d397fa700 10 client.5496 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.066+0000 7f5d5affd700 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5559c8d2a320 0x5559c8d2b870 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89ea492541296cb4 server_cookie=a2d4315aa69a47df in_seq=0 out_seq=0 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d397fa700 1 -- 172.21.15.84:0/3484939700 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5559c8cae930 con 0x5559c8d2a320 2023-10-06T02:56:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d397fa700 10 client.5496 handle_command_reply: tid=0 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 client.5496 shutdown 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3484939700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 msgr2=0x5559c8cd9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8cd9950 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5d54051dc0 tx=0x7f5d54082000 comp rx=0 tx=0).stop 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3484939700 shutdown_connections 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5559c8d2a320 0x5559c8d2b870 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8cd9950 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cdc900 0x5559c8d04e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/3484939700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cddd80 0x5559c8cd9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d397fa700 0 client.5496 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3484939700 >> 172.21.15.84:0/3484939700 conn(0x5559c8cde220 msgr2=0x5559c8d204b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3484939700 shutdown_connections 2023-10-06T02:56:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/3484939700 wait complete. 2023-10-06T02:56:35.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.067+0000 7f5d6ac80b80 20 client.5496 trim_cache size 0 max 16384 2023-10-06T02:56:35.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.084+0000 7f5d6ac80b80 1 Processor -- start 2023-10-06T02:56:35.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.084+0000 7f5d6ac80b80 1 -- start start 2023-10-06T02:56:35.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8cde220 0x5559c8cde7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8d26fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d27510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c8d26850 con 0x5559c8cde220 2023-10-06T02:56:35.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c8d45b40 con 0x5559c8cdc900 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559c8cbc3a0 con 0x5559c8cddd80 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8cde220 0x5559c8cde7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8cde220 0x5559c8cde7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52492/0 (socket says 172.21.15.84:52492) 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5affd700 1 -- 172.21.15.84:0/1409939342 learned_addr learned my addr 172.21.15.84:0/1409939342 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d527fc700 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8d26fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5affd700 1 -- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 msgr2=0x5559c8d27510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d27510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5affd700 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d27510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5affd700 1 -- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 msgr2=0x5559c8d26fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5affd700 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8d26fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5affd700 1 -- 172.21.15.84:0/1409939342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559c8bfb840 con 0x5559c8cde220 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d527fc700 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8d26fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d27510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d5affd700 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8cde220 0x5559c8cde7c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009310 tx=0x7f5d4c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447b4758e12635ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d50ff9700 1 -- 172.21.15.84:0/1409939342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0250e0 con 0x5559c8cde220 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d50ff9700 1 -- 172.21.15.84:0/1409939342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c00de10 con 0x5559c8cde220 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.085+0000 7f5d50ff9700 1 -- 172.21.15.84:0/1409939342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c013db0 con 0x5559c8cde220 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.086+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/1409939342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8cde220 msgr2=0x5559c8cde7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.086+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8cde220 0x5559c8cde7c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009310 tx=0x7f5d4c014040 comp rx=0 tx=0).stop 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.086+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/1409939342 shutdown_connections 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.086+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d27510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.086+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8cde220 0x5559c8cde7c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.086+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/1409939342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8d26fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.086+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/1409939342 >> 172.21.15.84:0/1409939342 conn(0x5559c8ce0170 msgr2=0x5559c8d21bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.086+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/1409939342 shutdown_connections 2023-10-06T02:56:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.086+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/1409939342 wait complete. 2023-10-06T02:56:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.087+0000 7f5d6ac80b80 1 -- start start 2023-10-06T02:56:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.087+0000 7f5d6ac80b80 1 Processor -- start 2023-10-06T02:56:35.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.087+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8d6fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.087+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d01f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d223c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c8d89c00 con 0x5559c8d2ccc0 2023-10-06T02:56:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559c8d01aa0 con 0x5559c8cdc900 2023-10-06T02:56:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559c8d00e90 con 0x5559c8cddd80 2023-10-06T02:56:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 10 client.0 _ll_register_callbacks cb 0x5559c8c9ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52504/0 (socket says 172.21.15.84:52504) 2023-10-06T02:56:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/2740516626 learned_addr learned my addr 172.21.15.84:0/2740516626 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d527fc700 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d01f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5affd700 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8d6fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 msgr2=0x5559c8d01f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d01f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 msgr2=0x5559c8d6fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8d6fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5b7fe700 1 -- 172.21.15.84:0/2740516626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c00e040 con 0x5559c8d2ccc0 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d527fc700 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d01f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d5b7fe700 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d223c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5d5405ca20 tx=0x7f5d5405f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30119b38e7bb150 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d397fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d397fa700 1 -- 172.21.15.84:0/2740516626 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54056040 con 0x5559c8d2ccc0 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d397fa700 1 -- 172.21.15.84:0/2740516626 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5d54082f40 con 0x5559c8d2ccc0 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/2740516626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d54058b10 con 0x5559c8d2ccc0 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d397fa700 1 -- 172.21.15.84:0/2740516626 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d5401ac10 con 0x5559c8d2ccc0 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 10 client.5502 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/2740516626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5559c8be2530 con 0x5559c8d2ccc0 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d397fa700 1 -- 172.21.15.84:0/2740516626 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d54058b10 con 0x5559c8d2ccc0 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d397fa700 1 -- 172.21.15.84:0/2740516626 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f5d54054db0 con 0x5559c8d2ccc0 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 10 client.5502 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 10 client.5502 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-10-06T02:56:35.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 20 client.5502 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5559c8d038f0 0x5559c8d22900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 4 client.5502 mds_command: new command op to 5124 tid=0[{"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}] 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.088+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/2740516626 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}) v1 -- 0x5559c8bcfec0 con 0x5559c8d038f0 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.089+0000 7f5d5affd700 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5559c8d038f0 0x5559c8d22900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.089+0000 7f5d397fa700 10 client.5502 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.089+0000 7f5d5affd700 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5559c8d038f0 0x5559c8d22900 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d6a84b8c2b6d15e server_cookie=8c9fa35d56c06d51 in_seq=0 out_seq=0 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d397fa700 1 -- 172.21.15.84:0/2740516626 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+80 (crc 0 0 0) 0x5559c8bcfec0 con 0x5559c8d038f0 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d397fa700 10 client.5502 handle_command_reply: tid=0 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 client.5502 shutdown 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/2740516626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 msgr2=0x5559c8d223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d223c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5d5405ca20 tx=0x7f5d5405f070 comp rx=0 tx=0).stop 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/2740516626 shutdown_connections 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x5559c8d038f0 0x5559c8d22900 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559c8cdc900 0x5559c8d6fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559c8d2ccc0 0x5559c8d223c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 --2- 172.21.15.84:0/2740516626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5559c8cddd80 0x5559c8d01f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d397fa700 0 client.5502 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/2740516626 >> 172.21.15.84:0/2740516626 conn(0x5559c8ce0170 msgr2=0x5559c8d04e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/2740516626 shutdown_connections 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 1 -- 172.21.15.84:0/2740516626 wait complete. 2023-10-06T02:56:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.090+0000 7f5d6ac80b80 20 client.5502 trim_cache size 0 max 16384 2023-10-06T02:56:35.103 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:56:35.103 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2023-10-06T02:56:35.103 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "tag123", 2023-10-06T02:56:35.103 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2023-10-06T02:56:35.103 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:56:35.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 -- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d3c066f30 msgr2=0x7f5d3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d3c066f30 0x7f5d3c0693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c006fd0 tx=0x7f5d4c008040 comp rx=0 tx=0).stop 2023-10-06T02:56:35.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 -- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 msgr2=0x7f5d5c0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 0x7f5d5c0cc780 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400cbf0 tx=0x7f5d540019b0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 -- 172.21.15.84:0/499589358 shutdown_connections 2023-10-06T02:56:35.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5d3c066f30 0x7f5d3c0693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d5c06ed20 0x7f5d5c15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d5c0b23a0 0x7f5d5c0cc780 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 --2- 172.21.15.84:0/499589358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5d5c0aee20 0x7f5d5c0cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 -- 172.21.15.84:0/499589358 >> 172.21.15.84:0/499589358 conn(0x7f5d5c068330 msgr2=0x7f5d5c0b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 -- 172.21.15.84:0/499589358 shutdown_connections 2023-10-06T02:56:35.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.091+0000 7f5d61988700 1 -- 172.21.15.84:0/499589358 wait complete. 2023-10-06T02:56:35.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-10-06T02:56:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.221+0000 7f6a78ac7700 1 Processor -- start 2023-10-06T02:56:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.221+0000 7f6a78ac7700 1 -- start start 2023-10-06T02:56:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a78ac7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a740b2a30 0x7f6a74164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a78ac7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a740cc9b0 con 0x7f6a740b2660 2023-10-06T02:56:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a78ac7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a740cbda0 con 0x7f6a740cd400 2023-10-06T02:56:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a78ac7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a740cc080 con 0x7f6a740b2a30 2023-10-06T02:56:35.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a737fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a740b2660 0x7f6a740cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59394/0 (socket says 172.21.15.84:59394) 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a737fe700 1 -- 172.21.15.84:0/1813846311 learned_addr learned my addr 172.21.15.84:0/1813846311 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a73fff700 1 --2- 172.21.15.84:0/1813846311 >> v2:172.21.15.84:3300/0 conn(0x7f6a740b2a30 0x7f6a74164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a727fc700 1 -- 172.21.15.84:0/1813846311 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141669564 0 0) 0x7f6a740cc9b0 con 0x7f6a740b2660 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a727fc700 1 -- 172.21.15.84:0/1813846311 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a5c003570 con 0x7f6a740b2660 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a73fff700 1 -- 172.21.15.84:0/1813846311 >> v1:172.21.15.131:6789/0 conn(0x7f6a740cd400 legacy=0x7f6a740ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a73fff700 1 -- 172.21.15.84:0/1813846311 >> v1:172.21.15.84:6789/0 conn(0x7f6a740b2660 legacy=0x7f6a740cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.222+0000 7f6a73fff700 1 -- 172.21.15.84:0/1813846311 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a740cc360 con 0x7f6a740b2a30 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a73fff700 1 --2- 172.21.15.84:0/1813846311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2a30 0x7f6a74164360 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0098e0 tx=0x7f6a6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2931a8a2534c6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a727fc700 1 -- 172.21.15.84:0/1813846311 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00b640 con 0x7f6a740b2a30 2023-10-06T02:56:35.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a727fc700 1 -- 172.21.15.84:0/1813846311 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00b7a0 con 0x7f6a740b2a30 2023-10-06T02:56:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a727fc700 1 -- 172.21.15.84:0/1813846311 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00bb40 con 0x7f6a740b2a30 2023-10-06T02:56:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a78ac7700 1 -- 172.21.15.84:0/1813846311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2a30 msgr2=0x7f6a74164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a78ac7700 1 --2- 172.21.15.84:0/1813846311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2a30 0x7f6a74164360 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0098e0 tx=0x7f6a6c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a78ac7700 1 -- 172.21.15.84:0/1813846311 shutdown_connections 2023-10-06T02:56:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a78ac7700 1 --2- 172.21.15.84:0/1813846311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2a30 0x7f6a74164360 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a78ac7700 1 -- 172.21.15.84:0/1813846311 >> 172.21.15.84:0/1813846311 conn(0x7f6a74099560 msgr2=0x7f6a7406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a78ac7700 1 -- 172.21.15.84:0/1813846311 shutdown_connections 2023-10-06T02:56:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.223+0000 7f6a78ac7700 1 -- 172.21.15.84:0/1813846311 wait complete. 2023-10-06T02:56:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a78ac7700 1 Processor -- start 2023-10-06T02:56:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a78ac7700 1 -- start start 2023-10-06T02:56:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a78ac7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2660 0x7f6a7416aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a78ac7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a740b2a30 0x7f6a741531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a78ac7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a740cd400 0x7f6a740c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a78ac7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740b3df0 con 0x7f6a740b2660 2023-10-06T02:56:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a78ac7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740b3170 con 0x7f6a740cd400 2023-10-06T02:56:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a78ac7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a740b3450 con 0x7f6a740b2a30 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2660 0x7f6a7416aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2660 0x7f6a7416aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52526/0 (socket says 172.21.15.84:52526) 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.225+0000 7f6a737fe700 1 -- 172.21.15.84:0/3654578037 learned_addr learned my addr 172.21.15.84:0/3654578037 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a73fff700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a740cd400 0x7f6a740c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a740b2a30 0x7f6a741531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a737fe700 1 -- 172.21.15.84:0/3654578037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a740b2a30 msgr2=0x7f6a741531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a737fe700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a740b2a30 0x7f6a741531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a737fe700 1 -- 172.21.15.84:0/3654578037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a740cd400 msgr2=0x7f6a740c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a737fe700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a740cd400 0x7f6a740c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a737fe700 1 -- 172.21.15.84:0/3654578037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c009420 con 0x7f6a740b2660 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a73fff700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a740cd400 0x7f6a740c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:56:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a737fe700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2660 0x7f6a7416aa50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c900 tx=0x7f6a64002740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a5b7fe700 1 -- 172.21.15.84:0/3654578037 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400cea0 con 0x7f6a740b2660 2023-10-06T02:56:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a5b7fe700 1 -- 172.21.15.84:0/3654578037 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64005d80 con 0x7f6a740b2660 2023-10-06T02:56:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a5b7fe700 1 -- 172.21.15.84:0/3654578037 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400a7e0 con 0x7f6a740b2660 2023-10-06T02:56:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a78ac7700 1 -- 172.21.15.84:0/3654578037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a740b3730 con 0x7f6a740b2660 2023-10-06T02:56:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.226+0000 7f6a78ac7700 1 -- 172.21.15.84:0/3654578037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a740c6ab0 con 0x7f6a740b2660 2023-10-06T02:56:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.227+0000 7f6a5b7fe700 1 -- 172.21.15.84:0/3654578037 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a6400ac10 con 0x7f6a740b2660 2023-10-06T02:56:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.228+0000 7f6a5b7fe700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a60066f30 0x7f6a600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.228+0000 7f6a5b7fe700 1 -- 172.21.15.84:0/3654578037 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6a64084640 con 0x7f6a740b2660 2023-10-06T02:56:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.228+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a60066f30 0x7f6a600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.228+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a60066f30 0x7f6a600693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6a74070c30 tx=0x7f6a68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.230+0000 7f6a83021b80 1 Processor -- start 2023-10-06T02:56:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.230+0000 7f6a83021b80 1 -- start start 2023-10-06T02:56:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb299dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a3310 0x560eb299e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a4a60 0x560eb299e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a83021b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eb28f8ac0 con 0x560eb29c2ea0 2023-10-06T02:56:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a83021b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eb28f62c0 con 0x560eb29a3310 2023-10-06T02:56:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a83021b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560eb28f20b0 con 0x560eb29a4a60 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb299dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb299dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52528/0 (socket says 172.21.15.84:52528) 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a737fe700 1 -- 172.21.15.84:0/3459155275 learned_addr learned my addr 172.21.15.84:0/3459155275 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a73fff700 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a4a60 0x560eb299e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a737fe700 1 -- 172.21.15.84:0/3459155275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a4a60 msgr2=0x560eb299e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a737fe700 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a4a60 0x560eb299e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a737fe700 1 -- 172.21.15.84:0/3459155275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a3310 msgr2=0x560eb299e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a3310 0x560eb299e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a737fe700 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a3310 0x560eb299e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a737fe700 1 -- 172.21.15.84:0/3459155275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560eb278c2c0 con 0x560eb29c2ea0 2023-10-06T02:56:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a3310 0x560eb299e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a737fe700 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb299dd10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6a640828c0 tx=0x7f6a64082820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477bdcc58bc83183 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a58ff9700 1 -- 172.21.15.84:0/3459155275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64055350 con 0x560eb29c2ea0 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a58ff9700 1 -- 172.21.15.84:0/3459155275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a640585a0 con 0x560eb29c2ea0 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.231+0000 7f6a58ff9700 1 -- 172.21.15.84:0/3459155275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6405c2f0 con 0x560eb29c2ea0 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.232+0000 7f6a83021b80 1 -- 172.21.15.84:0/3459155275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 msgr2=0x560eb299dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.232+0000 7f6a83021b80 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb299dd10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6a640828c0 tx=0x7f6a64082820 comp rx=0 tx=0).stop 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.232+0000 7f6a83021b80 1 -- 172.21.15.84:0/3459155275 shutdown_connections 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.232+0000 7f6a83021b80 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a4a60 0x560eb299e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.232+0000 7f6a83021b80 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb299dd10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.232+0000 7f6a83021b80 1 --2- 172.21.15.84:0/3459155275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a3310 0x560eb299e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.232+0000 7f6a83021b80 1 -- 172.21.15.84:0/3459155275 >> 172.21.15.84:0/3459155275 conn(0x560eb29a2ed0 msgr2=0x560eb29a3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.232+0000 7f6a83021b80 1 -- 172.21.15.84:0/3459155275 shutdown_connections 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.232+0000 7f6a83021b80 1 -- 172.21.15.84:0/3459155275 wait complete. 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.233+0000 7f6a83021b80 1 -- start start 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.233+0000 7f6a83021b80 1 Processor -- start 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29e9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a4a60 0x560eb29ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb29f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a83021b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eb289d8e0 con 0x560eb29c2ea0 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a83021b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eb28b8ef0 con 0x560eb29a4a60 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a83021b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560eb2774e80 con 0x560eb29a3310 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a83021b80 10 client.0 _ll_register_callbacks cb 0x560eb2965070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a73fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb29f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a73fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb29f87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52530/0 (socket says 172.21.15.84:52530) 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a73fff700 1 -- 172.21.15.84:0/2194212680 learned_addr learned my addr 172.21.15.84:0/2194212680 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a737fe700 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a4a60 0x560eb29ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a73fff700 1 -- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 msgr2=0x560eb29e9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a73fff700 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29e9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a73fff700 1 -- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a4a60 msgr2=0x560eb29ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a73fff700 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a4a60 0x560eb29ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a73fff700 1 -- 172.21.15.84:0/2194212680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a740c6ab0 con 0x560eb29c2ea0 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a73fff700 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb29f87d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0093f0 tx=0x7f6a6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126346f81e03c033 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a51ffb700 1 -- 172.21.15.84:0/2194212680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c01a6b0 con 0x560eb29c2ea0 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a51ffb700 1 -- 172.21.15.84:0/2194212680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6a6c01a810 con 0x560eb29c2ea0 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a83021b80 1 -- 172.21.15.84:0/2194212680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560eb2996990 con 0x560eb29c2ea0 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.234+0000 7f6a51ffb700 1 -- 172.21.15.84:0/2194212680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a6c01abe0 con 0x560eb29c2ea0 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a83021b80 10 client.5517 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a83021b80 1 -- 172.21.15.84:0/2194212680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x560eb272f030 con 0x560eb29c2ea0 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a51ffb700 1 -- 172.21.15.84:0/2194212680 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560eb2996990 con 0x560eb29c2ea0 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a51ffb700 1 -- 172.21.15.84:0/2194212680 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f6a6c023070 con 0x560eb29c2ea0 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a83021b80 10 client.5517 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a83021b80 10 client.5517 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a83021b80 20 client.5517 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:35.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a83021b80 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x560eb29eb3a0 0x560eb29d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a83021b80 4 client.5517 mds_command: new command op to 5124 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:56:35.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a83021b80 1 -- 172.21.15.84:0/2194212680 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560eb29738c0 con 0x560eb29eb3a0 2023-10-06T02:56:35.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a737fe700 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x560eb29eb3a0 0x560eb29d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a51ffb700 10 client.5517 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:35.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.235+0000 7f6a737fe700 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x560eb29eb3a0 0x560eb29d0570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8f42847c733fc41 server_cookie=9af2de2711e768f in_seq=0 out_seq=0 2023-10-06T02:56:35.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a51ffb700 1 -- 172.21.15.84:0/2194212680 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560eb29738c0 con 0x560eb29eb3a0 2023-10-06T02:56:35.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a51ffb700 10 client.5517 handle_command_reply: tid=0 2023-10-06T02:56:35.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 client.5517 shutdown 2023-10-06T02:56:35.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 -- 172.21.15.84:0/2194212680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 msgr2=0x560eb29f87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb29f87d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0093f0 tx=0x7f6a6c017000 comp rx=0 tx=0).stop 2023-10-06T02:56:35.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 -- 172.21.15.84:0/2194212680 shutdown_connections 2023-10-06T02:56:35.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x560eb29eb3a0 0x560eb29d0570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29c2ea0 0x560eb29f87d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a51ffb700 0 client.5517 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:35.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 --2- 172.21.15.84:0/2194212680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29a4a60 0x560eb29ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 -- 172.21.15.84:0/2194212680 >> 172.21.15.84:0/2194212680 conn(0x560eb29a2ed0 msgr2=0x560eb29a3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 -- 172.21.15.84:0/2194212680 shutdown_connections 2023-10-06T02:56:35.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 1 -- 172.21.15.84:0/2194212680 wait complete. 2023-10-06T02:56:35.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.236+0000 7f6a83021b80 20 client.5517 trim_cache size 0 max 16384 2023-10-06T02:56:35.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.252+0000 7f6a83021b80 1 Processor -- start 2023-10-06T02:56:35.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.252+0000 7f6a83021b80 1 -- start start 2023-10-06T02:56:35.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29cab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29c2ea0 0x560eb29ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a83021b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eb29c35b0 con 0x560eb29a4a60 2023-10-06T02:56:35.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a83021b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eb29c0900 con 0x560eb29c2ea0 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a83021b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560eb297a230 con 0x560eb29a3310 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52534/0 (socket says 172.21.15.84:52534) 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a72ffd700 1 -- 172.21.15.84:0/472554601 learned_addr learned my addr 172.21.15.84:0/472554601 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a72ffd700 1 -- 172.21.15.84:0/472554601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 msgr2=0x560eb29cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/472554601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a72ffd700 1 -- 172.21.15.84:0/472554601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29c2ea0 msgr2=0x560eb29ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/472554601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29c2ea0 0x560eb29ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a72ffd700 1 -- 172.21.15.84:0/472554601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7416a810 con 0x560eb29a4a60 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/472554601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29cdbe0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6a740cd800 tx=0x7f6a68014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fe5e4065c34ce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a597fa700 1 -- 172.21.15.84:0/472554601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800ee50 con 0x560eb29a4a60 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a597fa700 1 -- 172.21.15.84:0/472554601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a68013630 con 0x560eb29a4a60 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.253+0000 7f6a597fa700 1 -- 172.21.15.84:0/472554601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a680139d0 con 0x560eb29a4a60 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 -- 172.21.15.84:0/472554601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 msgr2=0x560eb29cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 --2- 172.21.15.84:0/472554601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29cdbe0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6a740cd800 tx=0x7f6a68014000 comp rx=0 tx=0).stop 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 -- 172.21.15.84:0/472554601 shutdown_connections 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 --2- 172.21.15.84:0/472554601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29c2ea0 0x560eb29ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 --2- 172.21.15.84:0/472554601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 --2- 172.21.15.84:0/472554601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29cdbe0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 -- 172.21.15.84:0/472554601 >> 172.21.15.84:0/472554601 conn(0x560eb29a2ed0 msgr2=0x560eb29e9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 -- 172.21.15.84:0/472554601 shutdown_connections 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 -- 172.21.15.84:0/472554601 wait complete. 2023-10-06T02:56:35.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.254+0000 7f6a83021b80 1 -- start start 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a83021b80 1 Processor -- start 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a83021b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29c2ea0 0x560eb29e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a83021b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eb29cead0 con 0x560eb29a4a60 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a83021b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eb29c7fa0 con 0x560eb29c2ea0 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a83021b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560eb29a40f0 con 0x560eb29a3310 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a83021b80 10 client.0 _ll_register_callbacks cb 0x560eb2965070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52546/0 (socket says 172.21.15.84:52546) 2023-10-06T02:56:35.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.255+0000 7f6a72ffd700 1 -- 172.21.15.84:0/1547221560 learned_addr learned my addr 172.21.15.84:0/1547221560 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a73fff700 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29c2ea0 0x560eb29e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a737fe700 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a72ffd700 1 -- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 msgr2=0x560eb29ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a72ffd700 1 -- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29c2ea0 msgr2=0x560eb29e9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29c2ea0 0x560eb29e9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a72ffd700 1 -- 172.21.15.84:0/1547221560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a68018040 con 0x560eb29a4a60 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a72ffd700 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29c7520 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6a68021000 tx=0x7f6a68020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503ffd5971256149 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a51ffb700 1 -- 172.21.15.84:0/1547221560 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6802a7a0 con 0x560eb29a4a60 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a51ffb700 1 -- 172.21.15.84:0/1547221560 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6a6802a900 con 0x560eb29a4a60 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a83021b80 1 -- 172.21.15.84:0/1547221560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a640585a0 con 0x560eb29a4a60 2023-10-06T02:56:35.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a51ffb700 1 -- 172.21.15.84:0/1547221560 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a6802acf0 con 0x560eb29a4a60 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a83021b80 10 client.5523 fetch_fsmap learned FSMap version 24 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a83021b80 1 -- 172.21.15.84:0/1547221560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x560eb28c07d0 con 0x560eb29a4a60 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a51ffb700 1 -- 172.21.15.84:0/1547221560 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a640585a0 con 0x560eb29a4a60 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a51ffb700 1 -- 172.21.15.84:0/1547221560 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f6a68028450 con 0x560eb29a4a60 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a83021b80 10 client.5523 fetch_fsmap finished waiting for FSMap version 24 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a83021b80 10 client.5523 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a83021b80 20 client.5523 populate_metadata read hostname 'smithi084' 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a83021b80 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x560eb29eb3a0 0x560eb29ea460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a83021b80 4 client.5523 mds_command: new command op to 5124 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.256+0000 7f6a83021b80 1 -- 172.21.15.84:0/1547221560 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560eb2894e50 con 0x560eb29eb3a0 2023-10-06T02:56:35.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a737fe700 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x560eb29eb3a0 0x560eb29ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a51ffb700 10 client.5523 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a737fe700 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x560eb29eb3a0 0x560eb29ea460 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba4b2f3852f155d server_cookie=9ce8b157ee05b7ee in_seq=0 out_seq=0 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a51ffb700 1 -- 172.21.15.84:0/1547221560 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+207 (crc 0 0 0) 0x560eb2894e50 con 0x560eb29eb3a0 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a51ffb700 10 client.5523 handle_command_reply: tid=0 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 client.5523 shutdown 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 -- 172.21.15.84:0/1547221560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 msgr2=0x560eb29c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29c7520 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6a68021000 tx=0x7f6a68020000 comp rx=0 tx=0).stop 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 -- 172.21.15.84:0/1547221560 shutdown_connections 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x560eb29eb3a0 0x560eb29ea460 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560eb29c2ea0 0x560eb29e9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560eb29a3310 0x560eb29ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a51ffb700 0 client.5523 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:56:35.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 --2- 172.21.15.84:0/1547221560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560eb29a4a60 0x560eb29c7520 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 -- 172.21.15.84:0/1547221560 >> 172.21.15.84:0/1547221560 conn(0x560eb29a2ed0 msgr2=0x560eb29a1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 -- 172.21.15.84:0/1547221560 shutdown_connections 2023-10-06T02:56:35.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 1 -- 172.21.15.84:0/1547221560 wait complete. 2023-10-06T02:56:35.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.257+0000 7f6a83021b80 20 client.5523 trim_cache size 0 max 16384 2023-10-06T02:56:35.267 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:56:35.267 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T02:56:35.267 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T02:56:35.267 INFO:teuthology.orchestra.run.smithi084.stdout: "tag123": { 2023-10-06T02:56:35.268 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T02:56:35.268 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "tag123", 2023-10-06T02:56:35.268 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T02:56:35.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:56:35.268 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:56:35.268 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:56:35.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 -- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a60066f30 msgr2=0x7f6a600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a60066f30 0x7f6a600693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6a74070c30 tx=0x7f6a68009040 comp rx=0 tx=0).stop 2023-10-06T02:56:35.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 -- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2660 msgr2=0x7f6a7416aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:56:35.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2660 0x7f6a7416aa50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c900 tx=0x7f6a64002740 comp rx=0 tx=0).stop 2023-10-06T02:56:35.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 -- 172.21.15.84:0/3654578037 shutdown_connections 2023-10-06T02:56:35.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a60066f30 0x7f6a600693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a740cd400 0x7f6a740c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a740b2660 0x7f6a7416aa50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 --2- 172.21.15.84:0/3654578037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a740b2a30 0x7f6a741531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:56:35.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 -- 172.21.15.84:0/3654578037 >> 172.21.15.84:0/3654578037 conn(0x7f6a74099560 msgr2=0x7f6a7406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:56:35.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 -- 172.21.15.84:0/3654578037 shutdown_connections 2023-10-06T02:56:35.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:56:35.258+0000 7f6a78ac7700 1 -- 172.21.15.84:0/3654578037 wait complete. 2023-10-06T02:56:35.271 INFO:tasks.cephfs.filesystem:scrub status for tag:tag123 - {'path': '/d1/d2/d3', 'tag': 'tag123', 'options': 'recursive,force'} 2023-10-06T02:56:36.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:56:36.312 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:05.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-10-06T02:57:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.396+0000 7f1a56e39700 1 Processor -- start 2023-10-06T02:57:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.396+0000 7f1a56e39700 1 -- start start 2023-10-06T02:57:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a56e39700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a500b2660 0x7f1a500cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a56e39700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1a500b2a30 0x7f1a500cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a56e39700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a500cc9b0 con 0x7f1a500ceae0 2023-10-06T02:57:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a56e39700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a500cbda0 con 0x7f1a500b2660 2023-10-06T02:57:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a56e39700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a500cc080 con 0x7f1a500b2a30 2023-10-06T02:57:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a55e37700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a500b2660 0x7f1a500cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a55e37700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a500b2660 0x7f1a500cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60132/0 (socket says 172.21.15.84:60132) 2023-10-06T02:57:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a55e37700 1 -- 172.21.15.84:0/3370436319 learned_addr learned my addr 172.21.15.84:0/3370436319 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a55636700 1 --2- 172.21.15.84:0/3370436319 >> v2:172.21.15.131:3300/0 conn(0x7f1a500b2a30 0x7f1a500cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.397+0000 7f1a55e37700 1 -- 172.21.15.84:0/3370436319 >> v2:172.21.15.131:3300/0 conn(0x7f1a500b2a30 msgr2=0x7f1a500cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a55e37700 1 --2- 172.21.15.84:0/3370436319 >> v2:172.21.15.131:3300/0 conn(0x7f1a500b2a30 0x7f1a500cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a55e37700 1 -- 172.21.15.84:0/3370436319 >> v1:172.21.15.131:6789/0 conn(0x7f1a500ceae0 legacy=0x7f1a500cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a55e37700 1 -- 172.21.15.84:0/3370436319 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500cc360 con 0x7f1a500b2660 2023-10-06T02:57:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a55636700 1 --2- 172.21.15.84:0/3370436319 >> v2:172.21.15.131:3300/0 conn(0x7f1a500b2a30 0x7f1a500cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:05.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a55e37700 1 --2- 172.21.15.84:0/3370436319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 0x7f1a500cccf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1a500b6310 tx=0x7f1a4c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168cff1f2b4f3664 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a54e35700 1 -- 172.21.15.84:0/3370436319 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c005c10 con 0x7f1a500b2660 2023-10-06T02:57:05.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a54e35700 1 -- 172.21.15.84:0/3370436319 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c005d70 con 0x7f1a500b2660 2023-10-06T02:57:05.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a54e35700 1 -- 172.21.15.84:0/3370436319 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00b880 con 0x7f1a500b2660 2023-10-06T02:57:05.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a56e39700 1 -- 172.21.15.84:0/3370436319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 msgr2=0x7f1a500cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a56e39700 1 --2- 172.21.15.84:0/3370436319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 0x7f1a500cccf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1a500b6310 tx=0x7f1a4c009220 comp rx=0 tx=0).stop 2023-10-06T02:57:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a56e39700 1 -- 172.21.15.84:0/3370436319 shutdown_connections 2023-10-06T02:57:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a56e39700 1 --2- 172.21.15.84:0/3370436319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 0x7f1a500cccf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a56e39700 1 --2- 172.21.15.84:0/3370436319 >> v2:172.21.15.131:3300/0 conn(0x7f1a500b2a30 0x7f1a500cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a56e39700 1 -- 172.21.15.84:0/3370436319 >> 172.21.15.84:0/3370436319 conn(0x7f1a50099560 msgr2=0x7f1a5006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a56e39700 1 -- 172.21.15.84:0/3370436319 shutdown_connections 2023-10-06T02:57:05.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.398+0000 7f1a56e39700 1 -- 172.21.15.84:0/3370436319 wait complete. 2023-10-06T02:57:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.399+0000 7f1a56e39700 1 Processor -- start 2023-10-06T02:57:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a56e39700 1 -- start start 2023-10-06T02:57:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a56e39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 0x7f1a5015d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a56e39700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a500b2a30 0x7f1a5015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a56e39700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a500ceae0 0x7f1a50149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a56e39700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5014a390 con 0x7f1a500b2660 2023-10-06T02:57:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a56e39700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5015ce70 con 0x7f1a500ceae0 2023-10-06T02:57:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a56e39700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5015c260 con 0x7f1a500b2a30 2023-10-06T02:57:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a55e37700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 0x7f1a5015d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a55e37700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 0x7f1a5015d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60142/0 (socket says 172.21.15.84:60142) 2023-10-06T02:57:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a55e37700 1 -- 172.21.15.84:0/1574997807 learned_addr learned my addr 172.21.15.84:0/1574997807 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.400+0000 7f1a56638700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a500ceae0 0x7f1a50149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a55636700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a500b2a30 0x7f1a5015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a55e37700 1 -- 172.21.15.84:0/1574997807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a500b2a30 msgr2=0x7f1a5015bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a55e37700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a500b2a30 0x7f1a5015bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a55e37700 1 -- 172.21.15.84:0/1574997807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a500ceae0 msgr2=0x7f1a50149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a55e37700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a500ceae0 0x7f1a50149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a55e37700 1 -- 172.21.15.84:0/1574997807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c009480 con 0x7f1a500b2660 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a56638700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a500ceae0 0x7f1a50149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a55e37700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 0x7f1a5015d300 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00b3c0 tx=0x7f1a4c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a45ffb700 1 -- 172.21.15.84:0/1574997807 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c011880 con 0x7f1a500b2660 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a45ffb700 1 -- 172.21.15.84:0/1574997807 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c020070 con 0x7f1a500b2660 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a56e39700 1 -- 172.21.15.84:0/1574997807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5015c540 con 0x7f1a500b2660 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a45ffb700 1 -- 172.21.15.84:0/1574997807 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c011c50 con 0x7f1a500b2660 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.401+0000 7f1a56e39700 1 -- 172.21.15.84:0/1574997807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5015cb00 con 0x7f1a500b2660 2023-10-06T02:57:05.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.403+0000 7f1a45ffb700 1 -- 172.21.15.84:0/1574997807 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a4c022030 con 0x7f1a500b2660 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.403+0000 7f1a45ffb700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a34066f30 0x7f1a340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.403+0000 7f1a45ffb700 1 -- 172.21.15.84:0/1574997807 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1a4c086490 con 0x7f1a500b2660 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.403+0000 7f1a55636700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a34066f30 0x7f1a340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.404+0000 7f1a55636700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a34066f30 0x7f1a340693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006f00 tx=0x7f1a40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.405+0000 7f1a61393b80 1 Processor -- start 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.405+0000 7f1a61393b80 1 -- start start 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c90ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c90b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 0x55a16c90b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a61393b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16c865ac0 con 0x55a16c910310 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a61393b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16c8632c0 con 0x55a16c911a60 2023-10-06T02:57:05.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a61393b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a16c85f0b0 con 0x55a16c92fea0 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55636700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c90b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55636700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c90b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60144/0 (socket says 172.21.15.84:60144) 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55636700 1 -- 172.21.15.84:0/3066714967 learned_addr learned my addr 172.21.15.84:0/3066714967 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a56638700 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 0x55a16c90b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55e37700 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c90ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55636700 1 -- 172.21.15.84:0/3066714967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 msgr2=0x55a16c90ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55636700 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c90ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55636700 1 -- 172.21.15.84:0/3066714967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 msgr2=0x55a16c90b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55636700 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 0x55a16c90b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55636700 1 -- 172.21.15.84:0/3066714967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a16c6f92c0 con 0x55a16c910310 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55e37700 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c90ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a55636700 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c90b250 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1a40010910 tx=0x7f1a40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99eabb069b910e73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a3affd700 1 -- 172.21.15.84:0/3066714967 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40010e50 con 0x55a16c910310 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a3affd700 1 -- 172.21.15.84:0/3066714967 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4001a070 con 0x55a16c910310 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.406+0000 7f1a3affd700 1 -- 172.21.15.84:0/3066714967 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40015d20 con 0x55a16c910310 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.407+0000 7f1a61393b80 1 -- 172.21.15.84:0/3066714967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 msgr2=0x55a16c90b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.407+0000 7f1a61393b80 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c90b250 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1a40010910 tx=0x7f1a40017000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.407+0000 7f1a61393b80 1 -- 172.21.15.84:0/3066714967 shutdown_connections 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.407+0000 7f1a61393b80 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 0x55a16c90b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.407+0000 7f1a61393b80 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c90ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.407+0000 7f1a61393b80 1 --2- 172.21.15.84:0/3066714967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c90b250 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.407+0000 7f1a61393b80 1 -- 172.21.15.84:0/3066714967 >> 172.21.15.84:0/3066714967 conn(0x55a16c90fed0 msgr2=0x55a16c910700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.407+0000 7f1a61393b80 1 -- 172.21.15.84:0/3066714967 shutdown_connections 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.407+0000 7f1a61393b80 1 -- 172.21.15.84:0/3066714967 wait complete. 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.408+0000 7f1a61393b80 1 -- start start 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.408+0000 7f1a61393b80 1 Processor -- start 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c959510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 0x55a16c93d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c93d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16c80a8e0 con 0x55a16c910310 2023-10-06T02:57:05.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16c825ef0 con 0x55a16c911a60 2023-10-06T02:57:05.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a16c6e1e80 con 0x55a16c92fea0 2023-10-06T02:57:05.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 10 client.0 _ll_register_callbacks cb 0x55a16c8d2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:05.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55e37700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c959510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55e37700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c959510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60158/0 (socket says 172.21.15.84:60158) 2023-10-06T02:57:05.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55e37700 1 -- 172.21.15.84:0/1498824199 learned_addr learned my addr 172.21.15.84:0/1498824199 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55636700 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 0x55a16c93d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a56638700 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c93d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55e37700 1 -- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 msgr2=0x55a16c93d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55e37700 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c93d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55e37700 1 -- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 msgr2=0x55a16c93d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55e37700 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 0x55a16c93d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55e37700 1 -- 172.21.15.84:0/1498824199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4000e050 con 0x55a16c910310 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55636700 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 0x55a16c93d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a56638700 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c93d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a55e37700 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c959510 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c011600 tx=0x7f1a4c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c068ee76505ea5f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a2ffff700 1 -- 172.21.15.84:0/1498824199 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c05e080 con 0x55a16c910310 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a2ffff700 1 -- 172.21.15.84:0/1498824199 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1a4c01a390 con 0x55a16c910310 2023-10-06T02:57:05.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 1 -- 172.21.15.84:0/1498824199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a16c903990 con 0x55a16c910310 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a2ffff700 1 -- 172.21.15.84:0/1498824199 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a4c057340 con 0x55a16c910310 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 10 client.5535 fetch_fsmap learned FSMap version 25 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.409+0000 7f1a61393b80 1 -- 172.21.15.84:0/1498824199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55a16c69c030 con 0x55a16c910310 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a2ffff700 1 -- 172.21.15.84:0/1498824199 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c082080 con 0x55a16c910310 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a2ffff700 1 -- 172.21.15.84:0/1498824199 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f1a4c0565d0 con 0x55a16c910310 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a61393b80 10 client.5535 fetch_fsmap finished waiting for FSMap version 25 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a61393b80 10 client.5535 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a61393b80 20 client.5535 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a61393b80 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x55a16c92d450 0x55a16c9687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a61393b80 4 client.5535 mds_command: new command op to 5124 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a61393b80 1 -- 172.21.15.84:0/1498824199 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a16c8e08c0 con 0x55a16c92d450 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a55636700 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x55a16c92d450 0x55a16c9687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a2ffff700 10 client.5535 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.410+0000 7f1a55636700 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x55a16c92d450 0x55a16c9687b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6720398b4cf6fa0 server_cookie=590e89352e6b6bea in_seq=0 out_seq=0 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a2ffff700 1 -- 172.21.15.84:0/1498824199 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a16c8e08c0 con 0x55a16c92d450 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a2ffff700 10 client.5535 handle_command_reply: tid=0 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 client.5535 shutdown 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 -- 172.21.15.84:0/1498824199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 msgr2=0x55a16c959510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c959510 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c011600 tx=0x7f1a4c01e040 comp rx=0 tx=0).stop 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 -- 172.21.15.84:0/1498824199 shutdown_connections 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x55a16c92d450 0x55a16c9687b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c93d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a2ffff700 0 client.5535 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:57:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c959510 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 --2- 172.21.15.84:0/1498824199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c911a60 0x55a16c93d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 -- 172.21.15.84:0/1498824199 >> 172.21.15.84:0/1498824199 conn(0x55a16c90fed0 msgr2=0x55a16c959b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 -- 172.21.15.84:0/1498824199 shutdown_connections 2023-10-06T02:57:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 1 -- 172.21.15.84:0/1498824199 wait complete. 2023-10-06T02:57:05.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.411+0000 7f1a61393b80 20 client.5535 trim_cache size 0 max 16384 2023-10-06T02:57:05.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.427+0000 7f1a61393b80 1 Processor -- start 2023-10-06T02:57:05.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.427+0000 7f1a61393b80 1 -- start start 2023-10-06T02:57:05.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c910310 0x55a16c92c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c911a60 0x55a16c96e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c93e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a61393b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16c907410 con 0x55a16c911a60 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a61393b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16c907870 con 0x55a16c910310 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a61393b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a16c90c740 con 0x55a16c92fea0 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a55636700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c911a60 0x55a16c96e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a55636700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c911a60 0x55a16c96e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60168/0 (socket says 172.21.15.84:60168) 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a55636700 1 -- 172.21.15.84:0/4292089026 learned_addr learned my addr 172.21.15.84:0/4292089026 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a55636700 1 -- 172.21.15.84:0/4292089026 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 msgr2=0x55a16c93e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a55636700 1 --2- 172.21.15.84:0/4292089026 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c93e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a55636700 1 -- 172.21.15.84:0/4292089026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c910310 msgr2=0x55a16c92c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a55636700 1 --2- 172.21.15.84:0/4292089026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c910310 0x55a16c92c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a55636700 1 -- 172.21.15.84:0/4292089026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a16c82d7d0 con 0x55a16c911a60 2023-10-06T02:57:05.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a55636700 1 --2- 172.21.15.84:0/4292089026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c911a60 0x55a16c96e9f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009550 tx=0x7f1a40032250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f118325712c7adc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a3b7fe700 1 -- 172.21.15.84:0/4292089026 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40031070 con 0x55a16c911a60 2023-10-06T02:57:05.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a3b7fe700 1 -- 172.21.15.84:0/4292089026 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a40015be0 con 0x55a16c911a60 2023-10-06T02:57:05.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.428+0000 7f1a3b7fe700 1 -- 172.21.15.84:0/4292089026 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40015d50 con 0x55a16c911a60 2023-10-06T02:57:05.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 -- 172.21.15.84:0/4292089026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c911a60 msgr2=0x55a16c96e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 --2- 172.21.15.84:0/4292089026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c911a60 0x55a16c96e9f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009550 tx=0x7f1a40032250 comp rx=0 tx=0).stop 2023-10-06T02:57:05.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 -- 172.21.15.84:0/4292089026 shutdown_connections 2023-10-06T02:57:05.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 --2- 172.21.15.84:0/4292089026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c910310 0x55a16c92c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 --2- 172.21.15.84:0/4292089026 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c92fea0 0x55a16c93e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 --2- 172.21.15.84:0/4292089026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c911a60 0x55a16c96e9f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 -- 172.21.15.84:0/4292089026 >> 172.21.15.84:0/4292089026 conn(0x55a16c90fed0 msgr2=0x55a16c959b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 -- 172.21.15.84:0/4292089026 shutdown_connections 2023-10-06T02:57:05.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 -- 172.21.15.84:0/4292089026 wait complete. 2023-10-06T02:57:05.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 -- start start 2023-10-06T02:57:05.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.429+0000 7f1a61393b80 1 Processor -- start 2023-10-06T02:57:05.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c930da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c911a60 0x55a16c9b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a61393b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c92fea0 0x55a16c9b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a61393b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16c92e020 con 0x55a16c910310 2023-10-06T02:57:05.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a61393b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16c92e480 con 0x55a16c92fea0 2023-10-06T02:57:05.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a61393b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a16c9b1580 con 0x55a16c911a60 2023-10-06T02:57:05.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a61393b80 10 client.0 _ll_register_callbacks cb 0x55a16c8d2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:05.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a55e37700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c930da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a55e37700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c930da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60176/0 (socket says 172.21.15.84:60176) 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a55e37700 1 -- 172.21.15.84:0/2962963708 learned_addr learned my addr 172.21.15.84:0/2962963708 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a55e37700 1 -- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c911a60 msgr2=0x55a16c9b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a55e37700 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c911a60 0x55a16c9b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a55e37700 1 -- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c92fea0 msgr2=0x55a16c9b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.430+0000 7f1a55e37700 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c92fea0 0x55a16c9b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a55e37700 1 -- 172.21.15.84:0/2962963708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a16c6f92c0 con 0x55a16c910310 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a55e37700 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c930da0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009010 tx=0x7f1a4c06b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2125006b8422f68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a2ffff700 1 -- 172.21.15.84:0/2962963708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c01a390 con 0x55a16c910310 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a2ffff700 1 -- 172.21.15.84:0/2962963708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1a4c05a330 con 0x55a16c910310 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a61393b80 1 -- 172.21.15.84:0/2962963708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a4001a070 con 0x55a16c910310 2023-10-06T02:57:05.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a2ffff700 1 -- 172.21.15.84:0/2962963708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a4c05e080 con 0x55a16c910310 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a61393b80 10 client.5541 fetch_fsmap learned FSMap version 25 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a61393b80 1 -- 172.21.15.84:0/2962963708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55a16c8144c0 con 0x55a16c910310 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a2ffff700 1 -- 172.21.15.84:0/2962963708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4001a070 con 0x55a16c910310 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a2ffff700 1 -- 172.21.15.84:0/2962963708 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f1a4c0565d0 con 0x55a16c910310 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a61393b80 10 client.5541 fetch_fsmap finished waiting for FSMap version 25 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a61393b80 10 client.5541 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a61393b80 20 client.5541 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a61393b80 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x55a16c9b4bc0 0x55a16c93abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a61393b80 4 client.5541 mds_command: new command op to 5124 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a61393b80 1 -- 172.21.15.84:0/2962963708 --> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a16c801e50 con 0x55a16c9b4bc0 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.431+0000 7f1a55636700 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x55a16c9b4bc0 0x55a16c93abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a2ffff700 10 client.5541 ms_handle_connect on v2:172.21.15.131:6833/781245140 2023-10-06T02:57:05.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a55636700 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x55a16c9b4bc0 0x55a16c93abe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e782234a83c17c3 server_cookie=ab7acbfae7e324a4 in_seq=0 out_seq=0 2023-10-06T02:57:05.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a2ffff700 1 -- 172.21.15.84:0/2962963708 <== mds.0 v2:172.21.15.131:6833/781245140 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a16c801e50 con 0x55a16c9b4bc0 2023-10-06T02:57:05.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a2ffff700 10 client.5541 handle_command_reply: tid=0 2023-10-06T02:57:05.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 client.5541 shutdown 2023-10-06T02:57:05.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 -- 172.21.15.84:0/2962963708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 msgr2=0x55a16c930da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c930da0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009010 tx=0x7f1a4c06b000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 -- 172.21.15.84:0/2962963708 shutdown_connections 2023-10-06T02:57:05.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:6833/781245140,v1:172.21.15.131:6835/781245140] conn(0x55a16c9b4bc0 0x55a16c93abe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a16c92fea0 0x55a16c9b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a16c910310 0x55a16c930da0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 --2- 172.21.15.84:0/2962963708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a16c911a60 0x55a16c9b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a2ffff700 0 client.5541 ms_handle_reset on v2:172.21.15.131:6833/781245140 2023-10-06T02:57:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 -- 172.21.15.84:0/2962963708 >> 172.21.15.84:0/2962963708 conn(0x55a16c90fed0 msgr2=0x55a16c9056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 -- 172.21.15.84:0/2962963708 shutdown_connections 2023-10-06T02:57:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 1 -- 172.21.15.84:0/2962963708 wait complete. 2023-10-06T02:57:05.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.432+0000 7f1a61393b80 20 client.5541 trim_cache size 0 max 16384 2023-10-06T02:57:05.442 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:57:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2023-10-06T02:57:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {} 2023-10-06T02:57:05.443 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 -- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a34066f30 msgr2=0x7f1a340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a34066f30 0x7f1a340693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006f00 tx=0x7f1a40008040 comp rx=0 tx=0).stop 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 -- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 msgr2=0x7f1a5015d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 0x7f1a5015d300 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00b3c0 tx=0x7f1a4c016000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 -- 172.21.15.84:0/1574997807 shutdown_connections 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a34066f30 0x7f1a340693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a500ceae0 0x7f1a50149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a500b2660 0x7f1a5015d300 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 --2- 172.21.15.84:0/1574997807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a500b2a30 0x7f1a5015bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 -- 172.21.15.84:0/1574997807 >> 172.21.15.84:0/1574997807 conn(0x7f1a50099560 msgr2=0x7f1a500ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 -- 172.21.15.84:0/1574997807 shutdown_connections 2023-10-06T02:57:05.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.433+0000 7f1a56e39700 1 -- 172.21.15.84:0/1574997807 wait complete. 2023-10-06T02:57:05.445 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T02:57:05.446 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000002.00000000 scrub_tag 2023-10-06T02:57:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.481+0000 7ff613d37000 1 Processor -- start 2023-10-06T02:57:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.481+0000 7ff613d37000 1 -- start start 2023-10-06T02:57:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff613d37000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dd954ddb10 0x55dd9556d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff613d37000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd954e0510 0x55dd955621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff613d37000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd955676e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff613d37000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd953e1980 con 0x55dd95569f50 2023-10-06T02:57:05.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff613d37000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd953e1620 con 0x55dd954e0510 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff613d37000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd953d8400 con 0x55dd954ddb10 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60d773700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd955676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60d773700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd955676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60196/0 (socket says 172.21.15.84:60196) 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60d773700 1 -- 172.21.15.84:0/545813590 learned_addr learned my addr 172.21.15.84:0/545813590 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60cf72700 1 --2- 172.21.15.84:0/545813590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dd954ddb10 0x55dd9556d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60c771700 1 --2- 172.21.15.84:0/545813590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd954e0510 0x55dd955621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60d773700 1 -- 172.21.15.84:0/545813590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dd954ddb10 msgr2=0x55dd9556d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60d773700 1 --2- 172.21.15.84:0/545813590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dd954ddb10 0x55dd9556d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60d773700 1 -- 172.21.15.84:0/545813590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd954e0510 msgr2=0x55dd955621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60d773700 1 --2- 172.21.15.84:0/545813590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd954e0510 0x55dd955621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60d773700 1 -- 172.21.15.84:0/545813590 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc00a0e0 con 0x55dd95569f50 2023-10-06T02:57:05.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60d773700 1 --2- 172.21.15.84:0/545813590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd955676e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff60400b320 tx=0x7ff6040068c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ec06f15dca5e1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60b76f700 1 -- 172.21.15.84:0/545813590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400bdf0 con 0x55dd95569f50 2023-10-06T02:57:05.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60b76f700 1 -- 172.21.15.84:0/545813590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400e570 con 0x55dd95569f50 2023-10-06T02:57:05.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.482+0000 7ff60b76f700 1 -- 172.21.15.84:0/545813590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400e930 con 0x55dd95569f50 2023-10-06T02:57:05.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 -- 172.21.15.84:0/545813590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 msgr2=0x55dd955676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 --2- 172.21.15.84:0/545813590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd955676e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff60400b320 tx=0x7ff6040068c0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 -- 172.21.15.84:0/545813590 shutdown_connections 2023-10-06T02:57:05.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 --2- 172.21.15.84:0/545813590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd955676e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 --2- 172.21.15.84:0/545813590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dd954ddb10 0x55dd9556d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 --2- 172.21.15.84:0/545813590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd954e0510 0x55dd955621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 -- 172.21.15.84:0/545813590 >> 172.21.15.84:0/545813590 conn(0x55dd954975d0 msgr2=0x55dd954999b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 -- 172.21.15.84:0/545813590 shutdown_connections 2023-10-06T02:57:05.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 -- 172.21.15.84:0/545813590 wait complete. 2023-10-06T02:57:05.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.483+0000 7ff613d37000 1 Processor -- start 2023-10-06T02:57:05.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff613d37000 1 -- start start 2023-10-06T02:57:05.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff613d37000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dd954ddb10 0x55dd954d62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff613d37000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd954e0510 0x55dd954dcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff613d37000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd95579650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff613d37000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd95561440 con 0x55dd95569f50 2023-10-06T02:57:05.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff613d37000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd954d67e0 con 0x55dd954e0510 2023-10-06T02:57:05.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff613d37000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd955646d0 con 0x55dd954ddb10 2023-10-06T02:57:05.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff60d773700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd95579650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff60d773700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd95579650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60200/0 (socket says 172.21.15.84:60200) 2023-10-06T02:57:05.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff60d773700 1 -- 172.21.15.84:0/3714996106 learned_addr learned my addr 172.21.15.84:0/3714996106 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.484+0000 7ff60cf72700 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dd954ddb10 0x55dd954d62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff60d773700 1 -- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dd954ddb10 msgr2=0x55dd954d62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff60d773700 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55dd954ddb10 0x55dd954d62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff60d773700 1 -- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd954e0510 msgr2=0x55dd954dcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff60d773700 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd954e0510 0x55dd954dcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff60d773700 1 -- 172.21.15.84:0/3714996106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604006ba0 con 0x55dd95569f50 2023-10-06T02:57:05.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff60d773700 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd95579650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff604006b50 tx=0x7ff604017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff609f6c700 1 -- 172.21.15.84:0/3714996106 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604006270 con 0x55dd95569f50 2023-10-06T02:57:05.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff609f6c700 1 -- 172.21.15.84:0/3714996106 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6040188f0 con 0x55dd95569f50 2023-10-06T02:57:05.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd953f03d0 con 0x55dd95569f50 2023-10-06T02:57:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff609f6c700 1 -- 172.21.15.84:0/3714996106 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604018cb0 con 0x55dd95569f50 2023-10-06T02:57:05.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.485+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd953e3ae0 con 0x55dd95569f50 2023-10-06T02:57:05.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.486+0000 7ff609f6c700 1 -- 172.21.15.84:0/3714996106 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff604014070 con 0x55dd95569f50 2023-10-06T02:57:05.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.486+0000 7ff609f6c700 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5f8065890 0x7ff5f8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.487+0000 7ff609f6c700 1 -- 172.21.15.84:0/3714996106 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff60401e040 con 0x55dd95569f50 2023-10-06T02:57:05.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.487+0000 7ff60cf72700 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5f8065890 0x7ff5f8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.487+0000 7ff613d37000 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x55dd9556a7f0 0x55dd95565860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.487+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 --> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44) v8 -- 0x55dd954c23c0 con 0x55dd9556a7f0 2023-10-06T02:57:05.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.487+0000 7ff60cf72700 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5f8065890 0x7ff5f8067d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc005d80 tx=0x7ff5fc015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.487+0000 7ff60c771700 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x55dd9556a7f0 0x55dd95565860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.488+0000 7ff60c771700 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x55dd9556a7f0 0x55dd95565860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.488+0000 7ff60c771700 1 -- 172.21.15.84:0/3714996106 <== osd.7 v2:172.21.15.131:6816/90924 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (10) out=10b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7ff600011040 con 0x55dd9556a7f0 2023-10-06T02:57:05.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.488+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x55dd9556a7f0 msgr2=0x55dd95565860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.488+0000 7ff613d37000 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x55dd9556a7f0 0x55dd95565860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.488+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5f8065890 msgr2=0x7ff5f8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.488+0000 7ff613d37000 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5f8065890 0x7ff5f8067d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc005d80 tx=0x7ff5fc015000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.488+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 msgr2=0x55dd95579650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.488+0000 7ff613d37000 1 --2- 172.21.15.84:0/3714996106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd95569f50 0x55dd95579650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff604006b50 tx=0x7ff604017000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.488+0000 7ff60d773700 1 -- 172.21.15.84:0/3714996106 reap_dead start 2023-10-06T02:57:05.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.489+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 shutdown_connections 2023-10-06T02:57:05.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.489+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 >> 172.21.15.84:0/3714996106 conn(0x55dd954975d0 msgr2=0x55dd954999b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.489+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 shutdown_connections 2023-10-06T02:57:05.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.489+0000 7ff613d37000 1 -- 172.21.15.84:0/3714996106 wait complete. 2023-10-06T02:57:05.672 INFO:teuthology.orchestra.run.smithi084.stdout:tag123 2023-10-06T02:57:05.672 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000003.00000000 scrub_tag 2023-10-06T02:57:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe7a74000 1 Processor -- start 2023-10-06T02:57:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe7a74000 1 -- start start 2023-10-06T02:57:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe7a74000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c2dfcd8e0 0x558c2e0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe7a74000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfe1be0 0x558c2e009fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe7a74000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 0x558c2e0a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe7a74000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2df2a980 con 0x558c2dfe1be0 2023-10-06T02:57:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe7a74000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2df2a620 con 0x558c2e0ad4a0 2023-10-06T02:57:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe7a74000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c2df21400 con 0x558c2dfcd8e0 2023-10-06T02:57:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe04ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfe1be0 0x558c2e009fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe04ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfe1be0 0x558c2e009fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60212/0 (socket says 172.21.15.84:60212) 2023-10-06T02:57:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.751+0000 7febe04ae700 1 -- 172.21.15.84:0/3893727459 learned_addr learned my addr 172.21.15.84:0/3893727459 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe14b0700 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 0x558c2e0a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe0caf700 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c2dfcd8e0 0x558c2e0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe04ae700 1 -- 172.21.15.84:0/3893727459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c2dfcd8e0 msgr2=0x558c2e0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe04ae700 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c2dfcd8e0 0x558c2e0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe04ae700 1 -- 172.21.15.84:0/3893727459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 msgr2=0x558c2e0a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe04ae700 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 0x558c2e0a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe04ae700 1 -- 172.21.15.84:0/3893727459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4005cf0 con 0x558c2dfe1be0 2023-10-06T02:57:05.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe14b0700 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 0x558c2e0a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:05.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe04ae700 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfe1be0 0x558c2e009fe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7febd400acc0 tx=0x7febd4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe19e729b4cb26ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febdf4ac700 1 -- 172.21.15.84:0/3893727459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4000bc0 con 0x558c2dfe1be0 2023-10-06T02:57:05.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febdf4ac700 1 -- 172.21.15.84:0/3893727459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4008970 con 0x558c2dfe1be0 2023-10-06T02:57:05.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febdf4ac700 1 -- 172.21.15.84:0/3893727459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4000d20 con 0x558c2dfe1be0 2023-10-06T02:57:05.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe7a74000 1 -- 172.21.15.84:0/3893727459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfe1be0 msgr2=0x558c2e009fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe7a74000 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfe1be0 0x558c2e009fe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7febd400acc0 tx=0x7febd4016000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe7a74000 1 -- 172.21.15.84:0/3893727459 shutdown_connections 2023-10-06T02:57:05.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe7a74000 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 0x558c2e0a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe7a74000 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c2dfcd8e0 0x558c2e0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe7a74000 1 --2- 172.21.15.84:0/3893727459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfe1be0 0x558c2e009fe0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.752+0000 7febe7a74000 1 -- 172.21.15.84:0/3893727459 >> 172.21.15.84:0/3893727459 conn(0x558c2dfe07d0 msgr2=0x558c2e0b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.753+0000 7febe7a74000 1 -- 172.21.15.84:0/3893727459 shutdown_connections 2023-10-06T02:57:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.753+0000 7febe7a74000 1 -- 172.21.15.84:0/3893727459 wait complete. 2023-10-06T02:57:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.753+0000 7febe7a74000 1 Processor -- start 2023-10-06T02:57:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.753+0000 7febe7a74000 1 -- start start 2023-10-06T02:57:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe7a74000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfcd8e0 0x558c2e098890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe7a74000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c2dfe1be0 0x558c2e0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe7a74000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 0x558c2e0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe7a74000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2e0a6130 con 0x558c2dfcd8e0 2023-10-06T02:57:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe7a74000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c2e0a2e80 con 0x558c2e0ad4a0 2023-10-06T02:57:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe7a74000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c2e0a3120 con 0x558c2dfe1be0 2023-10-06T02:57:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe0caf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfcd8e0 0x558c2e098890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe0caf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfcd8e0 0x558c2e098890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60228/0 (socket says 172.21.15.84:60228) 2023-10-06T02:57:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe0caf700 1 -- 172.21.15.84:0/1853843609 learned_addr learned my addr 172.21.15.84:0/1853843609 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe14b0700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 0x558c2e0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe04ae700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c2dfe1be0 0x558c2e0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe0caf700 1 -- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c2dfe1be0 msgr2=0x558c2e0b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe0caf700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558c2dfe1be0 0x558c2e0b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe0caf700 1 -- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 msgr2=0x558c2e0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe0caf700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c2e0ad4a0 0x558c2e0b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe0caf700 1 -- 172.21.15.84:0/1853843609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c2df531c0 con 0x558c2dfcd8e0 2023-10-06T02:57:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febe0caf700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfcd8e0 0x558c2e098890 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7febd000d4c0 tx=0x7febd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.754+0000 7febddca9700 1 -- 172.21.15.84:0/1853843609 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd00060d0 con 0x558c2dfcd8e0 2023-10-06T02:57:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.755+0000 7febddca9700 1 -- 172.21.15.84:0/1853843609 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0006230 con 0x558c2dfcd8e0 2023-10-06T02:57:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.755+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558c2df393d0 con 0x558c2dfcd8e0 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.755+0000 7febddca9700 1 -- 172.21.15.84:0/1853843609 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0004750 con 0x558c2dfcd8e0 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.755+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c2df2cae0 con 0x558c2dfcd8e0 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.756+0000 7febddca9700 1 -- 172.21.15.84:0/1853843609 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febd0004b00 con 0x558c2dfcd8e0 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.756+0000 7febddca9700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7febcc065940 0x7febcc067df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.756+0000 7febddca9700 1 -- 172.21.15.84:0/1853843609 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7febd0082de0 con 0x558c2dfcd8e0 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.756+0000 7febe04ae700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7febcc065940 0x7febcc067df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.756+0000 7febe7a74000 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x558c2e00dbb0 0x558c2e00df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.756+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 --> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] -- osd_op(unknown.0.0:1 6.12 6:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44) v8 -- 0x558c2e00e4c0 con 0x558c2e00dbb0 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe04ae700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7febcc065940 0x7febcc067df0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7febd400c010 tx=0x7febd401e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe14b0700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x558c2e00dbb0 0x558c2e00df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe14b0700 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x558c2e00dbb0 0x558c2e00df80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe14b0700 1 -- 172.21.15.84:0/1853843609 <== osd.7 v2:172.21.15.131:6816/90924 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr (10) out=10b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7febd8007a40 con 0x558c2e00dbb0 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x558c2e00dbb0 msgr2=0x558c2e00df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe7a74000 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x558c2e00dbb0 0x558c2e00df80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7febcc065940 msgr2=0x7febcc067df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe7a74000 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7febcc065940 0x7febcc067df0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7febd400c010 tx=0x7febd401e000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfcd8e0 msgr2=0x558c2e098890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe7a74000 1 --2- 172.21.15.84:0/1853843609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c2dfcd8e0 0x558c2e098890 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7febd000d4c0 tx=0x7febd0008040 comp rx=0 tx=0).stop 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe14b0700 1 -- 172.21.15.84:0/1853843609 reap_dead start 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.757+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 shutdown_connections 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.758+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 >> 172.21.15.84:0/1853843609 conn(0x558c2dfe07d0 msgr2=0x558c2e027460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.758+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 shutdown_connections 2023-10-06T02:57:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.758+0000 7febe7a74000 1 -- 172.21.15.84:0/1853843609 wait complete. 2023-10-06T02:57:05.776 INFO:teuthology.orchestra.run.smithi084.stdout:tag123 2023-10-06T02:57:05.777 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000004.00000000 scrub_tag 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.853+0000 7f935dde1000 1 Processor -- start 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.853+0000 7f935dde1000 1 -- start start 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935dde1000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f5761ce00 0x560f57645010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935dde1000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f57647df0 0x560f5765dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935dde1000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f576d8ca0 0x560f5765f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935dde1000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f57563980 con 0x560f57647df0 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935dde1000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f57563620 con 0x560f5761ce00 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935dde1000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f5755a400 con 0x560f576d8ca0 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f934e81b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f57647df0 0x560f5765dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f934e81b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f57647df0 0x560f5765dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60254/0 (socket says 172.21.15.84:60254) 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f934e81b700 1 -- 172.21.15.84:0/2125582944 learned_addr learned my addr 172.21.15.84:0/2125582944 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935701c700 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f5761ce00 0x560f57645010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f934e81b700 1 -- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f576d8ca0 msgr2=0x560f5765f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935781d700 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f576d8ca0 0x560f5765f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f934e81b700 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f576d8ca0 0x560f5765f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f934e81b700 1 -- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f5761ce00 msgr2=0x560f57645010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f934e81b700 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f5761ce00 0x560f57645010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f934e81b700 1 -- 172.21.15.84:0/2125582944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935000a0e0 con 0x560f57647df0 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935701c700 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f5761ce00 0x560f57645010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:05.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.854+0000 7f935781d700 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f576d8ca0 0x560f5765f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f934e81b700 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f57647df0 0x560f5765dca0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f934000a870 tx=0x7f9340005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f722be87b78e7af3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935601a700 1 -- 172.21.15.84:0/2125582944 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934000f070 con 0x560f57647df0 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935601a700 1 -- 172.21.15.84:0/2125582944 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93400088a0 con 0x560f57647df0 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935601a700 1 -- 172.21.15.84:0/2125582944 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340008c40 con 0x560f57647df0 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935dde1000 1 -- 172.21.15.84:0/2125582944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f57647df0 msgr2=0x560f5765dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935dde1000 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f57647df0 0x560f5765dca0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f934000a870 tx=0x7f9340005be0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935dde1000 1 -- 172.21.15.84:0/2125582944 shutdown_connections 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935dde1000 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f5761ce00 0x560f57645010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935dde1000 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f576d8ca0 0x560f5765f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935dde1000 1 --2- 172.21.15.84:0/2125582944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f57647df0 0x560f5765dca0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935dde1000 1 -- 172.21.15.84:0/2125582944 >> 172.21.15.84:0/2125582944 conn(0x560f5761b2e0 msgr2=0x560f57662f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935dde1000 1 -- 172.21.15.84:0/2125582944 shutdown_connections 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.855+0000 7f935dde1000 1 -- 172.21.15.84:0/2125582944 wait complete. 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.856+0000 7f935dde1000 1 Processor -- start 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.856+0000 7f935dde1000 1 -- start start 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.856+0000 7f935dde1000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f5761ce00 0x560f57702780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.856+0000 7f935dde1000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f57647df0 0x560f576ff880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.856+0000 7f935dde1000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f576d8ca0 0x560f576f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.856+0000 7f935dde1000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f57702cc0 con 0x560f5761ce00 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.856+0000 7f935dde1000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f576f10c0 con 0x560f576d8ca0 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.856+0000 7f935dde1000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f576f1360 con 0x560f57647df0 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935701c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f5761ce00 0x560f57702780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935701c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f5761ce00 0x560f57702780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60264/0 (socket says 172.21.15.84:60264) 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935701c700 1 -- 172.21.15.84:0/1497513473 learned_addr learned my addr 172.21.15.84:0/1497513473 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f934e81b700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f57647df0 0x560f576ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935781d700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f576d8ca0 0x560f576f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935701c700 1 -- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f57647df0 msgr2=0x560f576ff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935701c700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560f57647df0 0x560f576ff880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935701c700 1 -- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f576d8ca0 msgr2=0x560f576f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935701c700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f576d8ca0 0x560f576f0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935701c700 1 -- 172.21.15.84:0/1497513473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934000a440 con 0x560f5761ce00 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935781d700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560f576d8ca0 0x560f576f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935701c700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f5761ce00 0x560f57702780 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f934800ce20 tx=0x7f9348000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f9354817700 1 -- 172.21.15.84:0/1497513473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800ad50 con 0x560f5761ce00 2023-10-06T02:57:05.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f9354817700 1 -- 172.21.15.84:0/1497513473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800e440 con 0x560f5761ce00 2023-10-06T02:57:05.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f575723d0 con 0x560f5761ce00 2023-10-06T02:57:05.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f9354817700 1 -- 172.21.15.84:0/1497513473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800e7e0 con 0x560f5761ce00 2023-10-06T02:57:05.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.857+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f57565ae0 con 0x560f5761ce00 2023-10-06T02:57:05.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.859+0000 7f9354817700 1 -- 172.21.15.84:0/1497513473 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f934800ebd0 con 0x560f5761ce00 2023-10-06T02:57:05.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.859+0000 7f9354817700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93380658c0 0x7f9338067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.859+0000 7f9354817700 1 -- 172.21.15.84:0/1497513473 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f93480837e0 con 0x560f5761ce00 2023-10-06T02:57:05.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.859+0000 7f934e81b700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93380658c0 0x7f9338067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.859+0000 7f935dde1000 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x560f576f08b0 0x560f576f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.859+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 --> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] -- osd_op(unknown.0.0:1 6.5 6:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44) v8 -- 0x560f576ffdc0 con 0x560f576f08b0 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.859+0000 7f934e81b700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93380658c0 0x7f9338067d70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f934000a810 tx=0x7f9340019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.860+0000 7f935781d700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x560f576f08b0 0x560f576f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.860+0000 7f935781d700 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x560f576f08b0 0x560f576f1d40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935781d700 1 -- 172.21.15.84:0/1497513473 <== osd.7 v2:172.21.15.131:6816/90924 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f9350016020 con 0x560f576f08b0 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x560f576f08b0 msgr2=0x560f576f1d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x560f576f08b0 0x560f576f1d40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93380658c0 msgr2=0x7f9338067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93380658c0 0x7f9338067d70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f934000a810 tx=0x7f9340019000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f5761ce00 msgr2=0x560f57702780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 --2- 172.21.15.84:0/1497513473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560f5761ce00 0x560f57702780 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f934800ce20 tx=0x7f9348000bc0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935781d700 1 -- 172.21.15.84:0/1497513473 reap_dead start 2023-10-06T02:57:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 shutdown_connections 2023-10-06T02:57:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 >> 172.21.15.84:0/1497513473 conn(0x560f5761b2e0 msgr2=0x560f5761c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 shutdown_connections 2023-10-06T02:57:05.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.861+0000 7f935dde1000 1 -- 172.21.15.84:0/1497513473 wait complete. 2023-10-06T02:57:05.870 INFO:teuthology.orchestra.run.smithi084.stdout:tag123 2023-10-06T02:57:05.870 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000005.00000000 scrub_tag 2023-10-06T02:57:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.948+0000 7f18f58fd000 1 Processor -- start 2023-10-06T02:57:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.948+0000 7f18f58fd000 1 -- start start 2023-10-06T02:57:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18f58fd000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a1dc0 0x5591dc3a2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18f58fd000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc302750 0x5591dc3ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18f58fd000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591dc3a0c00 0x5591dc3b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18f58fd000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591dc27d320 con 0x5591dc3a1dc0 2023-10-06T02:57:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18f58fd000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591dc221980 con 0x5591dc302750 2023-10-06T02:57:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18f58fd000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591dc221620 con 0x5591dc3a0c00 2023-10-06T02:57:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18eeb38700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a1dc0 0x5591dc3a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18eeb38700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a1dc0 0x5591dc3a2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60278/0 (socket says 172.21.15.84:60278) 2023-10-06T02:57:05.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18eeb38700 1 -- 172.21.15.84:0/3300949008 learned_addr learned my addr 172.21.15.84:0/3300949008 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18ef339700 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591dc3a0c00 0x5591dc3b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18ee337700 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc302750 0x5591dc3ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18eeb38700 1 -- 172.21.15.84:0/3300949008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591dc3a0c00 msgr2=0x5591dc3b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18eeb38700 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591dc3a0c00 0x5591dc3b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18eeb38700 1 -- 172.21.15.84:0/3300949008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc302750 msgr2=0x5591dc3ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:05.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18eeb38700 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc302750 0x5591dc3ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18eeb38700 1 -- 172.21.15.84:0/3300949008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591dc223ae0 con 0x5591dc3a1dc0 2023-10-06T02:57:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18ee337700 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc302750 0x5591dc3ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18eeb38700 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a1dc0 0x5591dc3a2190 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f18e000e300 tx=0x7f18e0001780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92f9973034b9319 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18ed335700 1 -- 172.21.15.84:0/3300949008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0016030 con 0x5591dc3a1dc0 2023-10-06T02:57:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18ed335700 1 -- 172.21.15.84:0/3300949008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e0008070 con 0x5591dc3a1dc0 2023-10-06T02:57:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.949+0000 7f18ed335700 1 -- 172.21.15.84:0/3300949008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000ed10 con 0x5591dc3a1dc0 2023-10-06T02:57:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 -- 172.21.15.84:0/3300949008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a1dc0 msgr2=0x5591dc3a2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a1dc0 0x5591dc3a2190 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f18e000e300 tx=0x7f18e0001780 comp rx=0 tx=0).stop 2023-10-06T02:57:05.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 -- 172.21.15.84:0/3300949008 shutdown_connections 2023-10-06T02:57:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591dc3a0c00 0x5591dc3b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a1dc0 0x5591dc3a2190 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 --2- 172.21.15.84:0/3300949008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc302750 0x5591dc3ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 -- 172.21.15.84:0/3300949008 >> 172.21.15.84:0/3300949008 conn(0x5591dc2d77d0 msgr2=0x5591dc2d9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 -- 172.21.15.84:0/3300949008 shutdown_connections 2023-10-06T02:57:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 -- 172.21.15.84:0/3300949008 wait complete. 2023-10-06T02:57:05.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 Processor -- start 2023-10-06T02:57:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.950+0000 7f18f58fd000 1 -- start start 2023-10-06T02:57:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18f58fd000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591dc302750 0x5591dc3a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18f58fd000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a0c00 0x5591dc3bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18f58fd000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc3a1dc0 0x5591dc3bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18f58fd000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591dc218400 con 0x5591dc3a0c00 2023-10-06T02:57:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18f58fd000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591dc3a7830 con 0x5591dc3a1dc0 2023-10-06T02:57:05.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18f58fd000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591dc31fc60 con 0x5591dc302750 2023-10-06T02:57:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18ee337700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a0c00 0x5591dc3bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18ee337700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a0c00 0x5591dc3bebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60290/0 (socket says 172.21.15.84:60290) 2023-10-06T02:57:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18ee337700 1 -- 172.21.15.84:0/3113804175 learned_addr learned my addr 172.21.15.84:0/3113804175 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18ef339700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc3a1dc0 0x5591dc3bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18eeb38700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591dc302750 0x5591dc3a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18ee337700 1 -- 172.21.15.84:0/3113804175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591dc302750 msgr2=0x5591dc3a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18ee337700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5591dc302750 0x5591dc3a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18ee337700 1 -- 172.21.15.84:0/3113804175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc3a1dc0 msgr2=0x5591dc3bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18ee337700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591dc3a1dc0 0x5591dc3bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.951+0000 7f18ee337700 1 -- 172.21.15.84:0/3113804175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e000a040 con 0x5591dc3a0c00 2023-10-06T02:57:05.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.952+0000 7f18ee337700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a0c00 0x5591dc3bebb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f18d8008b80 tx=0x7f18d800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.952+0000 7f18e77fe700 1 -- 172.21.15.84:0/3113804175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800f040 con 0x5591dc3a0c00 2023-10-06T02:57:05.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.952+0000 7f18e77fe700 1 -- 172.21.15.84:0/3113804175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8009430 con 0x5591dc3a0c00 2023-10-06T02:57:05.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.952+0000 7f18e77fe700 1 -- 172.21.15.84:0/3113804175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8006c30 con 0x5591dc3a0c00 2023-10-06T02:57:05.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.952+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5591dc223540 con 0x5591dc3a0c00 2023-10-06T02:57:05.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.952+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591dc3a7a20 con 0x5591dc3a0c00 2023-10-06T02:57:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.953+0000 7f18e77fe700 1 -- 172.21.15.84:0/3113804175 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18d8016410 con 0x5591dc3a0c00 2023-10-06T02:57:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.953+0000 7f18e77fe700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f18d0065890 0x7f18d0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.953+0000 7f18e77fe700 1 -- 172.21.15.84:0/3113804175 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f18d8084230 con 0x5591dc3a0c00 2023-10-06T02:57:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.953+0000 7f18eeb38700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f18d0065890 0x7f18d0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x5591dc3a9410 0x5591dc3bcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- osd_op(unknown.0.0:1 6.9 6:9258b67d:::10000000005.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44) v8 -- 0x5591dc3bd520 con 0x5591dc3a9410 2023-10-06T02:57:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18ef339700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x5591dc3a9410 0x5591dc3bcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18eeb38700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f18d0065890 0x7f18d0067d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18e0002ee0 tx=0x7f18e0019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18ef339700 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x5591dc3a9410 0x5591dc3bcfe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18ef339700 1 -- 172.21.15.84:0/3113804175 <== osd.0 v2:172.21.15.84:6808/90632 1 ==== osd_op_reply(1 10000000005.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f18e8018040 con 0x5591dc3a9410 2023-10-06T02:57:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x5591dc3a9410 msgr2=0x5591dc3bcfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x5591dc3a9410 0x5591dc3bcfe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f18d0065890 msgr2=0x7f18d0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f18d0065890 0x7f18d0067d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18e0002ee0 tx=0x7f18e0019000 comp rx=0 tx=0).stop 2023-10-06T02:57:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a0c00 msgr2=0x5591dc3bebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 --2- 172.21.15.84:0/3113804175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591dc3a0c00 0x5591dc3bebb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f18d8008b80 tx=0x7f18d800c040 comp rx=0 tx=0).stop 2023-10-06T02:57:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18ef339700 1 -- 172.21.15.84:0/3113804175 reap_dead start 2023-10-06T02:57:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 shutdown_connections 2023-10-06T02:57:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.954+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 >> 172.21.15.84:0/3113804175 conn(0x5591dc2d77d0 msgr2=0x5591dc3a5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:05.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.955+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 shutdown_connections 2023-10-06T02:57:05.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:05.955+0000 7f18f58fd000 1 -- 172.21.15.84:0/3113804175 wait complete. 2023-10-06T02:57:05.968 INFO:teuthology.orchestra.run.smithi084.stdout:tag123 2023-10-06T02:57:05.968 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000006.00000000 scrub_tag 2023-10-06T02:57:06.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.045+0000 7f3373733000 1 Processor -- start 2023-10-06T02:57:06.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.045+0000 7f3373733000 1 -- start start 2023-10-06T02:57:06.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.045+0000 7f3373733000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33540030b0 0x563597ad8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.045+0000 7f3373733000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.045+0000 7f3373733000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 0x563597ad4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.045+0000 7f3373733000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635979a8320 con 0x563597acfa70 2023-10-06T02:57:06.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.045+0000 7f3373733000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56359794c980 con 0x563597acf550 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.045+0000 7f3373733000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56359794c620 con 0x7f33540030b0 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c16d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c16d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60322/0 (socket says 172.21.15.84:60322) 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c16d700 1 -- 172.21.15.84:0/4274446393 learned_addr learned my addr 172.21.15.84:0/4274446393 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c96e700 1 --2- 172.21.15.84:0/4274446393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33540030b0 0x563597ad8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336d16f700 1 --2- 172.21.15.84:0/4274446393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 0x563597ad4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c16d700 1 -- 172.21.15.84:0/4274446393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33540030b0 msgr2=0x563597ad8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c16d700 1 --2- 172.21.15.84:0/4274446393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33540030b0 0x563597ad8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c16d700 1 -- 172.21.15.84:0/4274446393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 msgr2=0x563597ad4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c16d700 1 --2- 172.21.15.84:0/4274446393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 0x563597ad4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c16d700 1 -- 172.21.15.84:0/4274446393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56359794eae0 con 0x563597acfa70 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336c16d700 1 --2- 172.21.15.84:0/4274446393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acf010 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3360001800 tx=0x7f3360016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4978dbd7957024c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336b16b700 1 -- 172.21.15.84:0/4274446393 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360000d00 con 0x563597acfa70 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336b16b700 1 -- 172.21.15.84:0/4274446393 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3360021070 con 0x563597acfa70 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.046+0000 7f336b16b700 1 -- 172.21.15.84:0/4274446393 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336000bcd0 con 0x563597acfa70 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 -- 172.21.15.84:0/4274446393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 msgr2=0x563597acf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 --2- 172.21.15.84:0/4274446393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acf010 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3360001800 tx=0x7f3360016000 comp rx=0 tx=0).stop 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 -- 172.21.15.84:0/4274446393 shutdown_connections 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 --2- 172.21.15.84:0/4274446393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 0x563597ad4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 --2- 172.21.15.84:0/4274446393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33540030b0 0x563597ad8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 --2- 172.21.15.84:0/4274446393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acf010 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 -- 172.21.15.84:0/4274446393 >> 172.21.15.84:0/4274446393 conn(0x563597a027d0 msgr2=0x563597ad5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 -- 172.21.15.84:0/4274446393 shutdown_connections 2023-10-06T02:57:06.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 -- 172.21.15.84:0/4274446393 wait complete. 2023-10-06T02:57:06.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 Processor -- start 2023-10-06T02:57:06.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.047+0000 7f3373733000 1 -- start start 2023-10-06T02:57:06.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f3373733000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 0x563597ad5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f3373733000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f3373733000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33540030b0 0x563597a2d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f3373733000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563597943400 con 0x563597acfa70 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f3373733000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563597ad6510 con 0x563597acf550 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f3373733000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563597a4aab0 con 0x7f33540030b0 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c16d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c16d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60330/0 (socket says 172.21.15.84:60330) 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c16d700 1 -- 172.21.15.84:0/4125098678 learned_addr learned my addr 172.21.15.84:0/4125098678 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c96e700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 0x563597ad5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336d16f700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33540030b0 0x563597a2d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c16d700 1 -- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33540030b0 msgr2=0x563597a2d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c16d700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33540030b0 0x563597a2d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c16d700 1 -- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 msgr2=0x563597ad5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c16d700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 0x563597ad5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c16d700 1 -- 172.21.15.84:0/4125098678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3354001e10 con 0x563597acfa70 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c96e700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563597acf550 0x563597ad5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.048+0000 7f336c16d700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acb440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3360001830 tx=0x7f336001f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.049+0000 7f3369968700 1 -- 172.21.15.84:0/4125098678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336001a690 con 0x563597acfa70 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.049+0000 7f3369968700 1 -- 172.21.15.84:0/4125098678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336001a7f0 con 0x563597acfa70 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.049+0000 7f3369968700 1 -- 172.21.15.84:0/4125098678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336001a960 con 0x563597acfa70 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.049+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56359794e540 con 0x563597acfa70 2023-10-06T02:57:06.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.049+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563597a2ca90 con 0x563597acfa70 2023-10-06T02:57:06.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.050+0000 7f3369968700 1 -- 172.21.15.84:0/4125098678 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f336001ad10 con 0x563597acfa70 2023-10-06T02:57:06.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.050+0000 7f3369968700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33580658c0 0x7f3358067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.050+0000 7f3369968700 1 -- 172.21.15.84:0/4125098678 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f33600861f0 con 0x563597acfa70 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.050+0000 7f336c96e700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33580658c0 0x7f3358067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.050+0000 7f3373733000 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x563597a2d710 0x563597a03690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.050+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 --> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] -- osd_op(unknown.0.0:1 6.5 6:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44) v8 -- 0x563597a48200 con 0x563597a2d710 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f336c96e700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33580658c0 0x7f3358067d70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f335c005b20 tx=0x7f335c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f336d16f700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x563597a2d710 0x563597a03690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f336d16f700 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x563597a2d710 0x563597a03690 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f336d16f700 1 -- 172.21.15.84:0/4125098678 <== osd.7 v2:172.21.15.131:6816/90924 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f336400f900 con 0x563597a2d710 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x563597a2d710 msgr2=0x563597a03690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f3373733000 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x563597a2d710 0x563597a03690 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33580658c0 msgr2=0x7f3358067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f3373733000 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33580658c0 0x7f3358067d70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f335c005b20 tx=0x7f335c007040 comp rx=0 tx=0).stop 2023-10-06T02:57:06.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 msgr2=0x563597acb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f3373733000 1 --2- 172.21.15.84:0/4125098678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563597acfa70 0x563597acb440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3360001830 tx=0x7f336001f070 comp rx=0 tx=0).stop 2023-10-06T02:57:06.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.051+0000 7f336d16f700 1 -- 172.21.15.84:0/4125098678 reap_dead start 2023-10-06T02:57:06.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.052+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 shutdown_connections 2023-10-06T02:57:06.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.052+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 >> 172.21.15.84:0/4125098678 conn(0x563597a027d0 msgr2=0x563597ad77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.052+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 shutdown_connections 2023-10-06T02:57:06.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.052+0000 7f3373733000 1 -- 172.21.15.84:0/4125098678 wait complete. 2023-10-06T02:57:06.061 INFO:teuthology.orchestra.run.smithi084.stdout:tag123 2023-10-06T02:57:06.061 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000007.00000000 scrub_tag 2023-10-06T02:57:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a7cfe000 1 Processor -- start 2023-10-06T02:57:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a7cfe000 1 -- start start 2023-10-06T02:57:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a7cfe000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56477b5188e0 0x56477b5ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a7cfe000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 0x56477b5f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a7cfe000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5f84a0 0x56477b5f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a7cfe000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56477b475980 con 0x56477b5f84a0 2023-10-06T02:57:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a7cfe000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56477b475620 con 0x56477b5188e0 2023-10-06T02:57:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a7cfe000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56477b46c400 con 0x56477b52cbe0 2023-10-06T02:57:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a173a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5f84a0 0x56477b5f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a173a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5f84a0 0x56477b5f0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60350/0 (socket says 172.21.15.84:60350) 2023-10-06T02:57:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f39a173a700 1 -- 172.21.15.84:0/906307850 learned_addr learned my addr 172.21.15.84:0/906307850 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.138+0000 7f399bfff700 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 0x56477b5f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a0f39700 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56477b5188e0 0x56477b5ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a173a700 1 -- 172.21.15.84:0/906307850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 msgr2=0x56477b5f02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a173a700 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 0x56477b5f02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a173a700 1 -- 172.21.15.84:0/906307850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56477b5188e0 msgr2=0x56477b5ffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a173a700 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56477b5188e0 0x56477b5ffdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a173a700 1 -- 172.21.15.84:0/906307850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c00a0e0 con 0x56477b5f84a0 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f399bfff700 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 0x56477b5f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a173a700 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5f84a0 0x56477b5f0ee0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f399c00f690 tx=0x7f399c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adeebd0771d91a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f399affd700 1 -- 172.21.15.84:0/906307850 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00f860 con 0x56477b5f84a0 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f399affd700 1 -- 172.21.15.84:0/906307850 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c00f9e0 con 0x56477b5f84a0 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f399affd700 1 -- 172.21.15.84:0/906307850 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0246c0 con 0x56477b5f84a0 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a7cfe000 1 -- 172.21.15.84:0/906307850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5f84a0 msgr2=0x56477b5f0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a7cfe000 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5f84a0 0x56477b5f0ee0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f399c00f690 tx=0x7f399c015000 comp rx=0 tx=0).stop 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a7cfe000 1 -- 172.21.15.84:0/906307850 shutdown_connections 2023-10-06T02:57:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a7cfe000 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56477b5188e0 0x56477b5ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a7cfe000 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5f84a0 0x56477b5f0ee0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a7cfe000 1 --2- 172.21.15.84:0/906307850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 0x56477b5f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a7cfe000 1 -- 172.21.15.84:0/906307850 >> 172.21.15.84:0/906307850 conn(0x56477b52b7d0 msgr2=0x56477b5ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a7cfe000 1 -- 172.21.15.84:0/906307850 shutdown_connections 2023-10-06T02:57:06.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.139+0000 7f39a7cfe000 1 -- 172.21.15.84:0/906307850 wait complete. 2023-10-06T02:57:06.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.140+0000 7f39a7cfe000 1 Processor -- start 2023-10-06T02:57:06.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.140+0000 7f39a7cfe000 1 -- start start 2023-10-06T02:57:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a7cfe000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5188e0 0x56477b5eeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a7cfe000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 0x56477b5fa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a7cfe000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56477b5f84a0 0x56477b5585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a7cfe000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56477b557c80 con 0x56477b5188e0 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a7cfe000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56477b5f0790 con 0x56477b5f84a0 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a7cfe000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56477b557eb0 con 0x56477b52cbe0 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a0f39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5188e0 0x56477b5eeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a0f39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5188e0 0x56477b5eeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60360/0 (socket says 172.21.15.84:60360) 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a0f39700 1 -- 172.21.15.84:0/3212479206 learned_addr learned my addr 172.21.15.84:0/3212479206 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a173a700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56477b5f84a0 0x56477b5585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f399bfff700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 0x56477b5fa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a0f39700 1 -- 172.21.15.84:0/3212479206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 msgr2=0x56477b5fa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a0f39700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56477b52cbe0 0x56477b5fa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a0f39700 1 -- 172.21.15.84:0/3212479206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56477b5f84a0 msgr2=0x56477b5585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a0f39700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56477b5f84a0 0x56477b5585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a0f39700 1 -- 172.21.15.84:0/3212479206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56477b49e1c0 con 0x56477b5188e0 2023-10-06T02:57:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a0f39700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5188e0 0x56477b5eeb30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f39940087b0 tx=0x7f3994005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39997fa700 1 -- 172.21.15.84:0/3212479206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994006840 con 0x56477b5188e0 2023-10-06T02:57:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39997fa700 1 -- 172.21.15.84:0/3212479206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3994010040 con 0x56477b5188e0 2023-10-06T02:57:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56477b4843d0 con 0x56477b5188e0 2023-10-06T02:57:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39997fa700 1 -- 172.21.15.84:0/3212479206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994006bf0 con 0x56477b5188e0 2023-10-06T02:57:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.141+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56477b477ae0 con 0x56477b5188e0 2023-10-06T02:57:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.143+0000 7f39997fa700 1 -- 172.21.15.84:0/3212479206 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f399401e460 con 0x56477b5188e0 2023-10-06T02:57:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.143+0000 7f39997fa700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3984065890 0x7f3984067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.143+0000 7f39997fa700 1 -- 172.21.15.84:0/3212479206 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f39940838b0 con 0x56477b5188e0 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.143+0000 7f399bfff700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3984065890 0x7f3984067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.143+0000 7f39a7cfe000 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x56477b5ffd90 0x56477b5fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.143+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 --> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] -- osd_op(unknown.0.0:1 6.1d 6:bbf5850a:::10000000007.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44) v8 -- 0x56477b5fc8f0 con 0x56477b5ffd90 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.143+0000 7f39a173a700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x56477b5ffd90 0x56477b5fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.143+0000 7f399bfff700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3984065890 0x7f3984067d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f398c001ed0 tx=0x7f398c001880 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a173a700 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x56477b5ffd90 0x56477b5fc3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a173a700 1 -- 172.21.15.84:0/3212479206 <== osd.1 v2:172.21.15.84:6816/90643 1 ==== osd_op_reply(1 10000000007.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f399c020030 con 0x56477b5ffd90 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x56477b5ffd90 msgr2=0x56477b5fc3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x56477b5ffd90 0x56477b5fc3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3984065890 msgr2=0x7f3984067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3984065890 0x7f3984067d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f398c001ed0 tx=0x7f398c001880 comp rx=0 tx=0).stop 2023-10-06T02:57:06.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5188e0 msgr2=0x56477b5eeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 --2- 172.21.15.84:0/3212479206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56477b5188e0 0x56477b5eeb30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f39940087b0 tx=0x7f3994005ca0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a173a700 1 -- 172.21.15.84:0/3212479206 reap_dead start 2023-10-06T02:57:06.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 shutdown_connections 2023-10-06T02:57:06.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 >> 172.21.15.84:0/3212479206 conn(0x56477b52b7d0 msgr2=0x56477b5545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 shutdown_connections 2023-10-06T02:57:06.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.144+0000 7f39a7cfe000 1 -- 172.21.15.84:0/3212479206 wait complete. 2023-10-06T02:57:06.153 INFO:teuthology.orchestra.run.smithi084.stdout:tag123 2023-10-06T02:57:06.153 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:57:06.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:06.228 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:06.273 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:57:06.273 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:57:06.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:06.273 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:06.307 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:57:06.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:06.307 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:57:06.362 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:06.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:06.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.516+0000 7f31a4bc8700 1 Processor -- start 2023-10-06T02:57:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.516+0000 7f31a4bc8700 1 -- start start 2023-10-06T02:57:06.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.517+0000 7f31a4bc8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31a01595a0 0x7f31a00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.517+0000 7f31a4bc8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f31a00b49e0 0x7f31a00aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.517+0000 7f31a4bc8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a00b0ca0 con 0x7f31a00b07a0 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.517+0000 7f31a4bc8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a00b0f80 con 0x7f31a01595a0 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.517+0000 7f31a4bc8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a00b1260 con 0x7f31a00b49e0 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.517+0000 7f319e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31a01595a0 0x7f31a00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.517+0000 7f319e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31a01595a0 0x7f31a00aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60376/0 (socket says 172.21.15.84:60376) 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.517+0000 7f319e59c700 1 -- 172.21.15.84:0/103466666 learned_addr learned my addr 172.21.15.84:0/103466666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319e59c700 1 -- 172.21.15.84:0/103466666 >> v2:172.21.15.131:3300/0 conn(0x7f31a00b49e0 msgr2=0x7f31a00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319dd9b700 1 --2- 172.21.15.84:0/103466666 >> v2:172.21.15.131:3300/0 conn(0x7f31a00b49e0 0x7f31a00aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319e59c700 1 --2- 172.21.15.84:0/103466666 >> v2:172.21.15.131:3300/0 conn(0x7f31a00b49e0 0x7f31a00aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319e59c700 1 -- 172.21.15.84:0/103466666 >> v1:172.21.15.131:6789/0 conn(0x7f31a00b07a0 legacy=0x7f31a00b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319e59c700 1 -- 172.21.15.84:0/103466666 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a00b1540 con 0x7f31a01595a0 2023-10-06T02:57:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319dd9b700 1 --2- 172.21.15.84:0/103466666 >> v2:172.21.15.131:3300/0 conn(0x7f31a00b49e0 0x7f31a00aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319e59c700 1 --2- 172.21.15.84:0/103466666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 0x7f31a00aa570 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3190009f70 tx=0x7f3190009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b99af5a1f285da0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319d59a700 1 -- 172.21.15.84:0/103466666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000e070 con 0x7f31a01595a0 2023-10-06T02:57:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319d59a700 1 -- 172.21.15.84:0/103466666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319000ba50 con 0x7f31a01595a0 2023-10-06T02:57:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f319d59a700 1 -- 172.21.15.84:0/103466666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900092e0 con 0x7f31a01595a0 2023-10-06T02:57:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f31a4bc8700 1 -- 172.21.15.84:0/103466666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 msgr2=0x7f31a00aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f31a4bc8700 1 --2- 172.21.15.84:0/103466666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 0x7f31a00aa570 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3190009f70 tx=0x7f3190009840 comp rx=0 tx=0).stop 2023-10-06T02:57:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f31a4bc8700 1 -- 172.21.15.84:0/103466666 shutdown_connections 2023-10-06T02:57:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f31a4bc8700 1 --2- 172.21.15.84:0/103466666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 0x7f31a00aa570 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f31a4bc8700 1 --2- 172.21.15.84:0/103466666 >> v2:172.21.15.131:3300/0 conn(0x7f31a00b49e0 0x7f31a00aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f31a4bc8700 1 -- 172.21.15.84:0/103466666 >> 172.21.15.84:0/103466666 conn(0x7f31a0099830 msgr2=0x7f31a006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.518+0000 7f31a4bc8700 1 -- 172.21.15.84:0/103466666 shutdown_connections 2023-10-06T02:57:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.519+0000 7f31a4bc8700 1 -- 172.21.15.84:0/103466666 wait complete. 2023-10-06T02:57:06.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f31a4bc8700 1 Processor -- start 2023-10-06T02:57:06.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f31a4bc8700 1 -- start start 2023-10-06T02:57:06.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f31a4bc8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00b07a0 0x7f31a009d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f31a4bc8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00b49e0 0x7f31a00d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f31a4bc8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 0x7f31a015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f31a4bc8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a0159a90 con 0x7f31a01595a0 2023-10-06T02:57:06.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f31a4bc8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a009d920 con 0x7f31a00b07a0 2023-10-06T02:57:06.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f31a4bc8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a009dc00 con 0x7f31a00b49e0 2023-10-06T02:57:06.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f319ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 0x7f31a015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f319ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 0x7f31a015a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60392/0 (socket says 172.21.15.84:60392) 2023-10-06T02:57:06.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f319ed9d700 1 -- 172.21.15.84:0/3600270737 learned_addr learned my addr 172.21.15.84:0/3600270737 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:06.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f319e59c700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00b07a0 0x7f31a009d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.520+0000 7f319dd9b700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00b49e0 0x7f31a00d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f319ed9d700 1 -- 172.21.15.84:0/3600270737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00b49e0 msgr2=0x7f31a00d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f319ed9d700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00b49e0 0x7f31a00d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f319ed9d700 1 -- 172.21.15.84:0/3600270737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00b07a0 msgr2=0x7f31a009d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f319ed9d700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00b07a0 0x7f31a009d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f319ed9d700 1 -- 172.21.15.84:0/3600270737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190009ae0 con 0x7f31a01595a0 2023-10-06T02:57:06.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f319e59c700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00b07a0 0x7f31a009d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:06.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f319ed9d700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 0x7f31a015a250 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f319800c5b0 tx=0x7f3198007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f318e7fc700 1 -- 172.21.15.84:0/3600270737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198011590 con 0x7f31a01595a0 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f318e7fc700 1 -- 172.21.15.84:0/3600270737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3198011710 con 0x7f31a01595a0 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a0159d30 con 0x7f31a01595a0 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f318e7fc700 1 -- 172.21.15.84:0/3600270737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198011ad0 con 0x7f31a01595a0 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.521+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a0156d00 con 0x7f31a01595a0 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.522+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a0159f20 con 0x7f31a01595a0 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.522+0000 7f318e7fc700 1 -- 172.21.15.84:0/3600270737 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f319801c460 con 0x7f31a01595a0 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.522+0000 7f318e7fc700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3180066f30 0x7f31800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.523+0000 7f318e7fc700 1 -- 172.21.15.84:0/3600270737 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f31980844e0 con 0x7f31a01595a0 2023-10-06T02:57:06.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.523+0000 7f319e59c700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3180066f30 0x7f31800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.523+0000 7f319e59c700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3180066f30 0x7f31800693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3190009880 tx=0x7f3190017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.527+0000 7f318e7fc700 1 -- 172.21.15.84:0/3600270737 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3198051470 con 0x7f31a01595a0 2023-10-06T02:57:06.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.755+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31a0064ad0 con 0x7f31a01595a0 2023-10-06T02:57:06.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.756+0000 7f318e7fc700 1 -- 172.21.15.84:0/3600270737 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4628 (secure 0 0 0) 0x7f3198054a90 con 0x7f31a01595a0 2023-10-06T02:57:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:06.757 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:56:04.813024+0000","modified":"2023-10-06T02:56:37.132278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5124,"mds_1":5115,"mds_2":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6836/1815868063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1815868063},{"type":"v1","addr":"172.21.15.84:6836","nonce":1815868063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5115":{"gid":5115,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6837/197493808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":197493808},{"type":"v1","addr":"172.21.15.84:6837","nonce":197493808}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5124":{"gid":5124,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6835/781245140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":781245140},{"type":"v1","addr":"172.21.15.131:6835","nonce":781245140}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:57:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.757+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3180066f30 msgr2=0x7f31800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.757+0000 7f31a4bc8700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3180066f30 0x7f31800693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3190009880 tx=0x7f3190017000 comp rx=0 tx=0).stop 2023-10-06T02:57:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.757+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 msgr2=0x7f31a015a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.757+0000 7f31a4bc8700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 0x7f31a015a250 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f319800c5b0 tx=0x7f3198007f60 comp rx=0 tx=0).stop 2023-10-06T02:57:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.758+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 shutdown_connections 2023-10-06T02:57:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.758+0000 7f31a4bc8700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3180066f30 0x7f31800693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.758+0000 7f31a4bc8700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31a00b07a0 0x7f31a009d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.758+0000 7f31a4bc8700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31a01595a0 0x7f31a015a250 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.758+0000 7f31a4bc8700 1 --2- 172.21.15.84:0/3600270737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31a00b49e0 0x7f31a00d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.758+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 >> 172.21.15.84:0/3600270737 conn(0x7f31a0099830 msgr2=0x7f31a00b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.758+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 shutdown_connections 2023-10-06T02:57:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.758+0000 7f31a4bc8700 1 -- 172.21.15.84:0/3600270737 wait complete. 2023-10-06T02:57:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2023-10-06T02:57:06.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.883+0000 7f21fb833700 1 Processor -- start 2023-10-06T02:57:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.883+0000 7f21fb833700 1 -- start start 2023-10-06T02:57:06.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21fb833700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f40b07a0 0x7f21f40ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21fb833700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f40b0ca0 con 0x7f21f40b49e0 2023-10-06T02:57:06.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21fb833700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f40b0f80 con 0x7f21f41595a0 2023-10-06T02:57:06.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21fb833700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40ab390 con 0x7f21f40b07a0 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f8dce700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f21f40b49e0 0x7f21f40aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54890/0 (socket says 172.21.15.84:54890) 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f8dce700 1 -- 172.21.15.84:0/4243141360 learned_addr learned my addr 172.21.15.84:0/4243141360 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849924280 0 0) 0x7f21f40b0ca0 con 0x7f21f40b49e0 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21dc003570 con 0x7f21f40b49e0 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f9dd0700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f40b07a0 0x7f21f40ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861959483 0 0) 0x7f21dc003570 con 0x7f21f40b49e0 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f40b07a0 msgr2=0x7f21f40ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f40b07a0 0x7f21f40ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 >> v1:172.21.15.131:6789/0 conn(0x7f21f41595a0 legacy=0x7f21f40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40b1260 con 0x7f21f40b49e0 2023-10-06T02:57:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f21e8001470 con 0x7f21f40b49e0 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 >> v1:172.21.15.84:6789/0 conn(0x7f21f40b49e0 legacy=0x7f21f40aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc003a90 0x7f21dc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f40b07a0 0x7f21dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21dc004da0 0x7f21dc0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40ab390 con 0x7f21dc003a90 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc00bc20 con 0x7f21dc004da0 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc00bde0 con 0x7f21f40b07a0 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f95cf700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc003a90 0x7f21dc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.884+0000 7f21f8dce700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f40b07a0 0x7f21dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f9dd0700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21dc004da0 0x7f21dc0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f95cf700 1 -- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f40b07a0 msgr2=0x7f21dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f95cf700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f40b07a0 0x7f21dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f95cf700 1 -- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21dc004da0 msgr2=0x7f21dc0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f95cf700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21dc004da0 0x7f21dc0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f95cf700 1 -- 172.21.15.84:0/4243141360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc003570 con 0x7f21dc003a90 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f9dd0700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21dc004da0 0x7f21dc0051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f95cf700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc003a90 0x7f21dc003ea0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c2a0 tx=0x7f21e4001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91660cc9c00d7114 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4001d80 con 0x7f21dc003a90 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e400cb70 con 0x7f21dc003a90 2023-10-06T02:57:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21f3fff700 1 -- 172.21.15.84:0/4243141360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4012400 con 0x7f21dc003a90 2023-10-06T02:57:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21fb833700 1 -- 172.21.15.84:0/4243141360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc003a90 msgr2=0x7f21dc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.885+0000 7f21fb833700 1 --2- 172.21.15.84:0/4243141360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21dc003a90 0x7f21dc003ea0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c2a0 tx=0x7f21e4001a70 comp rx=0 tx=0).stop 2023-10-06T02:57:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.886+0000 7f21f9dd0700 1 -- 172.21.15.84:0/4243141360 reap_dead start 2023-10-06T02:57:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.886+0000 7f21fb833700 1 -- 172.21.15.84:0/4243141360 shutdown_connections 2023-10-06T02:57:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.886+0000 7f21fb833700 1 -- 172.21.15.84:0/4243141360 >> 172.21.15.84:0/4243141360 conn(0x7f21f4099830 msgr2=0x7f21f406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.886+0000 7f21fb833700 1 -- 172.21.15.84:0/4243141360 shutdown_connections 2023-10-06T02:57:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.886+0000 7f21fb833700 1 -- 172.21.15.84:0/4243141360 wait complete. 2023-10-06T02:57:06.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.887+0000 7f21fb833700 1 Processor -- start 2023-10-06T02:57:06.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.887+0000 7f21fb833700 1 -- start start 2023-10-06T02:57:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21fb833700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21dc003a90 0x7f21f40d0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21fb833700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f40d09c0 0x7f21f4148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21fb833700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f4148940 0x7f21f409c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21fb833700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f4099f90 con 0x7f21f4148940 2023-10-06T02:57:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21fb833700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f409a1e0 con 0x7f21f40d09c0 2023-10-06T02:57:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21fb833700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f409a4c0 con 0x7f21dc003a90 2023-10-06T02:57:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f9dd0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f4148940 0x7f21f409c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f9dd0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f4148940 0x7f21f409c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60410/0 (socket says 172.21.15.84:60410) 2023-10-06T02:57:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f9dd0700 1 -- 172.21.15.84:0/3048246072 learned_addr learned my addr 172.21.15.84:0/3048246072 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f95cf700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21dc003a90 0x7f21f40d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f9dd0700 1 -- 172.21.15.84:0/3048246072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21dc003a90 msgr2=0x7f21f40d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f9dd0700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21dc003a90 0x7f21f40d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f9dd0700 1 -- 172.21.15.84:0/3048246072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f40d09c0 msgr2=0x7f21f4148400 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T02:57:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f9dd0700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f40d09c0 0x7f21f4148400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f9dd0700 1 -- 172.21.15.84:0/3048246072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f409a7a0 con 0x7f21f4148940 2023-10-06T02:57:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f9dd0700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f4148940 0x7f21f409c890 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f21ec006fd0 tx=0x7f21ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f17fa700 1 -- 172.21.15.84:0/3048246072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec014670 con 0x7f21f4148940 2023-10-06T02:57:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f17fa700 1 -- 172.21.15.84:0/3048246072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec0147d0 con 0x7f21f4148940 2023-10-06T02:57:06.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21f17fa700 1 -- 172.21.15.84:0/3048246072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec014b90 con 0x7f21f4148940 2023-10-06T02:57:06.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f409aa80 con 0x7f21f4148940 2023-10-06T02:57:06.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f409cdd0 con 0x7f21f4148940 2023-10-06T02:57:06.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.889+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f409ac70 con 0x7f21f4148940 2023-10-06T02:57:06.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.890+0000 7f21f17fa700 1 -- 172.21.15.84:0/3048246072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21ec01d400 con 0x7f21f4148940 2023-10-06T02:57:06.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.890+0000 7f21f17fa700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21e0066f30 0x7f21e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:06.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.890+0000 7f21f17fa700 1 -- 172.21.15.84:0/3048246072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f21ec084b20 con 0x7f21f4148940 2023-10-06T02:57:06.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.890+0000 7f21f95cf700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21e0066f30 0x7f21e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:06.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.890+0000 7f21f95cf700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21e0066f30 0x7f21e00693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c2a0 tx=0x7f21e4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:06.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:06.895+0000 7f21f17fa700 1 -- 172.21.15.84:0/3048246072 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21ec051ab0 con 0x7f21f4148940 2023-10-06T02:57:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.077+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21f4064ad0 con 0x7f21f4148940 2023-10-06T02:57:07.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.077+0000 7f21f17fa700 1 -- 172.21.15.84:0/3048246072 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17165 (secure 0 0 0) 0x7f21ec0550d0 con 0x7f21f4148940 2023-10-06T02:57:07.083 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:07.083 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:56:50.167990+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:56:02.609660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:56:03.782698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.6","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.079+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21e0066f30 msgr2=0x7f21e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21e0066f30 0x7f21e00693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c2a0 tx=0x7f21e4016000 comp rx=0 tx=0).stop 2023-10-06T02:57:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f4148940 msgr2=0x7f21f409c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f4148940 0x7f21f409c890 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f21ec006fd0 tx=0x7f21ec008040 comp rx=0 tx=0).stop 2023-10-06T02:57:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 shutdown_connections 2023-10-06T02:57:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21e0066f30 0x7f21e00693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21f4148940 0x7f21f409c890 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21dc003a90 0x7f21f40d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 --2- 172.21.15.84:0/3048246072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f40d09c0 0x7f21f4148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 >> 172.21.15.84:0/3048246072 conn(0x7f21f4099830 msgr2=0x7f21f40b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 shutdown_connections 2023-10-06T02:57:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.080+0000 7f21fb833700 1 -- 172.21.15.84:0/3048246072 wait complete. 2023-10-06T02:57:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:56:02.609660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:56:03.782698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:57:07.095 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:57:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.211+0000 7f63c90cf700 1 Processor -- start 2023-10-06T02:57:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.211+0000 7f63c90cf700 1 -- start start 2023-10-06T02:57:07.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63c90cf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c4159510 0x7f63c40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63c90cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63c41598e0 0x7f63c40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63c90cf700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f63c40ce820 0x7f63c40cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63c90cf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c40cf610 con 0x7f63c41598e0 2023-10-06T02:57:07.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63c90cf700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c40cf8f0 con 0x7f63c40ce820 2023-10-06T02:57:07.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63c90cf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40cfbd0 con 0x7f63c4159510 2023-10-06T02:57:07.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63ba59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63c41598e0 0x7f63c40cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63ba59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63c41598e0 0x7f63c40cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60426/0 (socket says 172.21.15.84:60426) 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63ba59c700 1 -- 172.21.15.84:0/1825613423 learned_addr learned my addr 172.21.15.84:0/1825613423 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63ba59c700 1 -- 172.21.15.84:0/1825613423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c4159510 msgr2=0x7f63c40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63ba59c700 1 --2- 172.21.15.84:0/1825613423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c4159510 0x7f63c40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63ba59c700 1 -- 172.21.15.84:0/1825613423 >> v2:172.21.15.131:3300/0 conn(0x7f63c40ce820 msgr2=0x7f63c40cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63ba59c700 1 --2- 172.21.15.84:0/1825613423 >> v2:172.21.15.131:3300/0 conn(0x7f63c40ce820 0x7f63c40cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.212+0000 7f63ba59c700 1 -- 172.21.15.84:0/1825613423 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40cfeb0 con 0x7f63c41598e0 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63ba59c700 1 --2- 172.21.15.84:0/1825613423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 0x7f63c40cbae0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f63c408acb0 tx=0x7f63ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6284b9906589163 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c259c700 1 -- 172.21.15.84:0/1825613423 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00b860 con 0x7f63c41598e0 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c259c700 1 -- 172.21.15.84:0/1825613423 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac00b9c0 con 0x7f63c41598e0 2023-10-06T02:57:07.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c259c700 1 -- 172.21.15.84:0/1825613423 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00bd60 con 0x7f63c41598e0 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c90cf700 1 -- 172.21.15.84:0/1825613423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 msgr2=0x7f63c40cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c90cf700 1 --2- 172.21.15.84:0/1825613423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 0x7f63c40cbae0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f63c408acb0 tx=0x7f63ac009250 comp rx=0 tx=0).stop 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c90cf700 1 -- 172.21.15.84:0/1825613423 shutdown_connections 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c90cf700 1 --2- 172.21.15.84:0/1825613423 >> v2:172.21.15.131:3300/0 conn(0x7f63c40ce820 0x7f63c40cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c90cf700 1 --2- 172.21.15.84:0/1825613423 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c4159510 0x7f63c40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c90cf700 1 --2- 172.21.15.84:0/1825613423 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 0x7f63c40cbae0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c90cf700 1 -- 172.21.15.84:0/1825613423 >> 172.21.15.84:0/1825613423 conn(0x7f63c4089e90 msgr2=0x7f63c40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c90cf700 1 -- 172.21.15.84:0/1825613423 shutdown_connections 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.213+0000 7f63c90cf700 1 -- 172.21.15.84:0/1825613423 wait complete. 2023-10-06T02:57:07.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.214+0000 7f63c90cf700 1 Processor -- start 2023-10-06T02:57:07.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.214+0000 7f63c90cf700 1 -- start start 2023-10-06T02:57:07.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c90cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c40ce820 0x7f63c4169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c90cf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c4159510 0x7f63c41518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c90cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 0x7f63c4151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c90cf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4150340 con 0x7f63c41598e0 2023-10-06T02:57:07.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c90cf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c413c810 con 0x7f63c40ce820 2023-10-06T02:57:07.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c90cf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4159cd0 con 0x7f63c4159510 2023-10-06T02:57:07.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 0x7f63c4151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 0x7f63c4151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60428/0 (socket says 172.21.15.84:60428) 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c359e700 1 -- 172.21.15.84:0/2434042285 learned_addr learned my addr 172.21.15.84:0/2434042285 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63ba59c700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c4159510 0x7f63c41518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.215+0000 7f63c2d9d700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c40ce820 0x7f63c4169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63c359e700 1 -- 172.21.15.84:0/2434042285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c4159510 msgr2=0x7f63c41518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63c359e700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c4159510 0x7f63c41518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63c359e700 1 -- 172.21.15.84:0/2434042285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c40ce820 msgr2=0x7f63c4169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63c359e700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c40ce820 0x7f63c4169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63c359e700 1 -- 172.21.15.84:0/2434042285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0094f0 con 0x7f63c41598e0 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63c2d9d700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c40ce820 0x7f63c4169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63c359e700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 0x7f63c4151e20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00bc60 tx=0x7f63bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63bb7fe700 1 -- 172.21.15.84:0/2434042285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0092e0 con 0x7f63c41598e0 2023-10-06T02:57:07.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63bb7fe700 1 -- 172.21.15.84:0/2434042285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc00c6e0 con 0x7f63c41598e0 2023-10-06T02:57:07.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c415a850 con 0x7f63c41598e0 2023-10-06T02:57:07.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63bb7fe700 1 -- 172.21.15.84:0/2434042285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc00caa0 con 0x7f63c41598e0 2023-10-06T02:57:07.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.216+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c415a200 con 0x7f63c41598e0 2023-10-06T02:57:07.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.217+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c415a9e0 con 0x7f63c41598e0 2023-10-06T02:57:07.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.217+0000 7f63bb7fe700 1 -- 172.21.15.84:0/2434042285 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63bc012070 con 0x7f63c41598e0 2023-10-06T02:57:07.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.218+0000 7f63bb7fe700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63a4066f30 0x7f63a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.218+0000 7f63c2d9d700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63a4066f30 0x7f63a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.218+0000 7f63bb7fe700 1 -- 172.21.15.84:0/2434042285 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f63bc084420 con 0x7f63c41598e0 2023-10-06T02:57:07.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.218+0000 7f63c2d9d700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63a4066f30 0x7f63a40693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f63b4006fd0 tx=0x7f63b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.222+0000 7f63bb7fe700 1 -- 172.21.15.84:0/2434042285 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63bc0513b0 con 0x7f63c41598e0 2023-10-06T02:57:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.406+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63c4064ad0 con 0x7f63c41598e0 2023-10-06T02:57:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.406+0000 7f63bb7fe700 1 -- 172.21.15.84:0/2434042285 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63bc0549d0 con 0x7f63c41598e0 2023-10-06T02:57:07.407 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:57:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63a4066f30 msgr2=0x7f63a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63a4066f30 0x7f63a40693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f63b4006fd0 tx=0x7f63b4008040 comp rx=0 tx=0).stop 2023-10-06T02:57:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 msgr2=0x7f63c4151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 0x7f63c4151e20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00bc60 tx=0x7f63bc009840 comp rx=0 tx=0).stop 2023-10-06T02:57:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 shutdown_connections 2023-10-06T02:57:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63a4066f30 0x7f63a40693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c40ce820 0x7f63c4169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63c41598e0 0x7f63c4151e20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 --2- 172.21.15.84:0/2434042285 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63c4159510 0x7f63c41518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 >> 172.21.15.84:0/2434042285 conn(0x7f63c4089e90 msgr2=0x7f63c40c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:07.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 shutdown_connections 2023-10-06T02:57:07.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.409+0000 7f63c90cf700 1 -- 172.21.15.84:0/2434042285 wait complete. 2023-10-06T02:57:07.422 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:57:07.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.538+0000 7f821356d700 1 Processor -- start 2023-10-06T02:57:07.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.538+0000 7f821356d700 1 -- start start 2023-10-06T02:57:07.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.539+0000 7f821356d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f820c159510 0x7f820c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.539+0000 7f821356d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c0cbae0 0x7f820c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.539+0000 7f821356d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c0cbef0 con 0x7f820c1598e0 2023-10-06T02:57:07.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.539+0000 7f821356d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c0cf610 con 0x7f820c159510 2023-10-06T02:57:07.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.539+0000 7f821356d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0cf8f0 con 0x7f820c0cbae0 2023-10-06T02:57:07.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.539+0000 7f8211309700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f820c159510 0x7f820c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.539+0000 7f8210b08700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f820c1598e0 0x7f820c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54900/0 (socket says 172.21.15.84:54900) 2023-10-06T02:57:07.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.539+0000 7f8210b08700 1 -- 172.21.15.84:0/4067795399 learned_addr learned my addr 172.21.15.84:0/4067795399 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:07.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.539+0000 7f8211b0a700 1 --2- 172.21.15.84:0/4067795399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c0cbae0 0x7f820c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f8211309700 1 -- 172.21.15.84:0/4067795399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c0cbae0 msgr2=0x7f820c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:07.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f8211309700 1 --2- 172.21.15.84:0/4067795399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c0cbae0 0x7f820c0cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f8211309700 1 -- 172.21.15.84:0/4067795399 >> v1:172.21.15.84:6789/0 conn(0x7f820c1598e0 legacy=0x7f820c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f8211309700 1 -- 172.21.15.84:0/4067795399 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0cfbd0 con 0x7f820c159510 2023-10-06T02:57:07.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f8203fff700 1 -- 172.21.15.84:0/4067795399 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899533322 0 0) 0x7f820c0cbef0 con 0x7f820c1598e0 2023-10-06T02:57:07.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f8211309700 1 --2- 172.21.15.84:0/4067795399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c159510 0x7f820c0cb5a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8208009e60 tx=0x7f8208009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4ed1884e02d144 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f8203fff700 1 -- 172.21.15.84:0/4067795399 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800e070 con 0x7f820c159510 2023-10-06T02:57:07.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f8203fff700 1 -- 172.21.15.84:0/4067795399 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800bc30 con 0x7f820c159510 2023-10-06T02:57:07.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f8203fff700 1 -- 172.21.15.84:0/4067795399 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208012430 con 0x7f820c159510 2023-10-06T02:57:07.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f821356d700 1 -- 172.21.15.84:0/4067795399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c159510 msgr2=0x7f820c0cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f821356d700 1 --2- 172.21.15.84:0/4067795399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c159510 0x7f820c0cb5a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8208009e60 tx=0x7f8208009780 comp rx=0 tx=0).stop 2023-10-06T02:57:07.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f821356d700 1 -- 172.21.15.84:0/4067795399 shutdown_connections 2023-10-06T02:57:07.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f821356d700 1 --2- 172.21.15.84:0/4067795399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c0cbae0 0x7f820c0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f821356d700 1 --2- 172.21.15.84:0/4067795399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c159510 0x7f820c0cb5a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.540+0000 7f821356d700 1 -- 172.21.15.84:0/4067795399 >> 172.21.15.84:0/4067795399 conn(0x7f820c089e90 msgr2=0x7f820c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:07.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.541+0000 7f821356d700 1 -- 172.21.15.84:0/4067795399 shutdown_connections 2023-10-06T02:57:07.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.541+0000 7f821356d700 1 -- 172.21.15.84:0/4067795399 wait complete. 2023-10-06T02:57:07.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.542+0000 7f821356d700 1 Processor -- start 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.542+0000 7f821356d700 1 -- start start 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.542+0000 7f821356d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f820c0cbae0 0x7f820c0b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.542+0000 7f821356d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c159510 0x7f820c16a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.542+0000 7f821356d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c1598e0 0x7f820c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.542+0000 7f821356d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0b4410 con 0x7f820c1598e0 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f821356d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0b5090 con 0x7f820c0cbae0 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f821356d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0b4170 con 0x7f820c159510 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211b0a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c1598e0 0x7f820c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211b0a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c1598e0 0x7f820c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60442/0 (socket says 172.21.15.84:60442) 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211b0a700 1 -- 172.21.15.84:0/3807939918 learned_addr learned my addr 172.21.15.84:0/3807939918 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211309700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f820c0cbae0 0x7f820c0b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8210b08700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c159510 0x7f820c16a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211b0a700 1 -- 172.21.15.84:0/3807939918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c159510 msgr2=0x7f820c16a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211b0a700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c159510 0x7f820c16a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211b0a700 1 -- 172.21.15.84:0/3807939918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f820c0cbae0 msgr2=0x7f820c0b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211b0a700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f820c0cbae0 0x7f820c0b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211b0a700 1 -- 172.21.15.84:0/3807939918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009a20 con 0x7f820c1598e0 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f8211b0a700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c1598e0 0x7f820c0b3c30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f820400d890 tx=0x7f8204008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f82017fa700 1 -- 172.21.15.84:0/3807939918 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82040125f0 con 0x7f820c1598e0 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f82017fa700 1 -- 172.21.15.84:0/3807939918 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8204012770 con 0x7f820c1598e0 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f82017fa700 1 -- 172.21.15.84:0/3807939918 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204012b30 con 0x7f820c1598e0 2023-10-06T02:57:07.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c0b4760 con 0x7f820c1598e0 2023-10-06T02:57:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.543+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c0b4d20 con 0x7f820c1598e0 2023-10-06T02:57:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.544+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c0b5220 con 0x7f820c1598e0 2023-10-06T02:57:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.545+0000 7f82017fa700 1 -- 172.21.15.84:0/3807939918 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f820401e460 con 0x7f820c1598e0 2023-10-06T02:57:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.545+0000 7f82017fa700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f81f0066f30 0x7f81f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.545+0000 7f82017fa700 1 -- 172.21.15.84:0/3807939918 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f8204084e00 con 0x7f820c1598e0 2023-10-06T02:57:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.545+0000 7f8211309700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f81f0066f30 0x7f81f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.545+0000 7f8211309700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f81f0066f30 0x7f81f00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8208009e60 tx=0x7f8208019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.549+0000 7f82017fa700 1 -- 172.21.15.84:0/3807939918 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8204051d90 con 0x7f820c1598e0 2023-10-06T02:57:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.729+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f820c064ad0 con 0x7f820c1598e0 2023-10-06T02:57:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.729+0000 7f82017fa700 1 -- 172.21.15.84:0/3807939918 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f82040553b0 con 0x7f820c1598e0 2023-10-06T02:57:07.730 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:57:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f81f0066f30 msgr2=0x7f81f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f81f0066f30 0x7f81f00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8208009e60 tx=0x7f8208019000 comp rx=0 tx=0).stop 2023-10-06T02:57:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c1598e0 msgr2=0x7f820c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c1598e0 0x7f820c0b3c30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f820400d890 tx=0x7f8204008040 comp rx=0 tx=0).stop 2023-10-06T02:57:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 shutdown_connections 2023-10-06T02:57:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f81f0066f30 0x7f81f00693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f820c0cbae0 0x7f820c0b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f820c1598e0 0x7f820c0b3c30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 --2- 172.21.15.84:0/3807939918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f820c159510 0x7f820c16a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 >> 172.21.15.84:0/3807939918 conn(0x7f820c089e90 msgr2=0x7f820c15d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 shutdown_connections 2023-10-06T02:57:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.731+0000 7f821356d700 1 -- 172.21.15.84:0/3807939918 wait complete. 2023-10-06T02:57:07.743 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:57:07.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.859+0000 7fc0f0699700 1 Processor -- start 2023-10-06T02:57:07.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.860+0000 7fc0f0699700 1 -- start start 2023-10-06T02:57:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.860+0000 7fc0f0699700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc0e80cd980 0x7fc0e8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.860+0000 7fc0f0699700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0e80b4eb0 0x7fc0e8163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.860+0000 7fc0f0699700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e80b5f30 con 0x7fc0e80b4a60 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.860+0000 7fc0f0699700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e80b3640 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.860+0000 7fc0f0699700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e80b63c0 con 0x7fc0e80cd980 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0eec36700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0e80b4eb0 0x7fc0e8163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0edc34700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc0e80b4a60 0x7fc0e80d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54916/0 (socket says 172.21.15.84:54916) 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0edc34700 1 -- 172.21.15.84:0/1066224541 learned_addr learned my addr 172.21.15.84:0/1066224541 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0ee435700 1 --2- 172.21.15.84:0/1066224541 >> v2:172.21.15.131:3300/0 conn(0x7fc0e80cd980 0x7fc0e8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0eec36700 1 -- 172.21.15.84:0/1066224541 >> v2:172.21.15.131:3300/0 conn(0x7fc0e80cd980 msgr2=0x7fc0e8159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0eec36700 1 --2- 172.21.15.84:0/1066224541 >> v2:172.21.15.131:3300/0 conn(0x7fc0e80cd980 0x7fc0e8159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0eec36700 1 -- 172.21.15.84:0/1066224541 >> v1:172.21.15.84:6789/0 conn(0x7fc0e80b4a60 legacy=0x7fc0e80d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0eec36700 1 -- 172.21.15.84:0/1066224541 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e80b5320 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0ed433700 1 -- 172.21.15.84:0/1066224541 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616191103 0 0) 0x7fc0e80b5f30 con 0x7fc0e80b4a60 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0eec36700 1 --2- 172.21.15.84:0/1066224541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 0x7fc0e8163240 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8088d10 tx=0x7fc0d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86215d99588cae5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0ed433700 1 -- 172.21.15.84:0/1066224541 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800e070 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0ed433700 1 -- 172.21.15.84:0/1066224541 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d800bb60 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.861+0000 7fc0ed433700 1 -- 172.21.15.84:0/1066224541 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8012430 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.862+0000 7fc0f0699700 1 -- 172.21.15.84:0/1066224541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 msgr2=0x7fc0e8163240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.862+0000 7fc0f0699700 1 --2- 172.21.15.84:0/1066224541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 0x7fc0e8163240 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8088d10 tx=0x7fc0d8009780 comp rx=0 tx=0).stop 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.862+0000 7fc0f0699700 1 -- 172.21.15.84:0/1066224541 shutdown_connections 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.862+0000 7fc0f0699700 1 --2- 172.21.15.84:0/1066224541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 0x7fc0e8163240 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.862+0000 7fc0f0699700 1 --2- 172.21.15.84:0/1066224541 >> v2:172.21.15.131:3300/0 conn(0x7fc0e80cd980 0x7fc0e8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.862+0000 7fc0f0699700 1 -- 172.21.15.84:0/1066224541 >> 172.21.15.84:0/1066224541 conn(0x7fc0e806ed20 msgr2=0x7fc0e806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.862+0000 7fc0f0699700 1 -- 172.21.15.84:0/1066224541 shutdown_connections 2023-10-06T02:57:07.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.862+0000 7fc0f0699700 1 -- 172.21.15.84:0/1066224541 wait complete. 2023-10-06T02:57:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.863+0000 7fc0f0699700 1 Processor -- start 2023-10-06T02:57:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.863+0000 7fc0f0699700 1 -- start start 2023-10-06T02:57:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0f0699700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0e80b4a60 0x7fc0e80c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0f0699700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 0x7fc0e80c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0f0699700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0e80cd980 0x7fc0e8143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0f0699700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80c8e50 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0f0699700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80c69a0 con 0x7fc0e80b4a60 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0f0699700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80c6c80 con 0x7fc0e80cd980 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0edc34700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 0x7fc0e80c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0edc34700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 0x7fc0e80c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60458/0 (socket says 172.21.15.84:60458) 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0edc34700 1 -- 172.21.15.84:0/3674101504 learned_addr learned my addr 172.21.15.84:0/3674101504 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0ee435700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0e80b4a60 0x7fc0e80c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0eec36700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0e80cd980 0x7fc0e8143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0edc34700 1 -- 172.21.15.84:0/3674101504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0e80cd980 msgr2=0x7fc0e8143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0edc34700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0e80cd980 0x7fc0e8143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0edc34700 1 -- 172.21.15.84:0/3674101504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0e80b4a60 msgr2=0x7fc0e80c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0edc34700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0e80b4a60 0x7fc0e80c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0edc34700 1 -- 172.21.15.84:0/3674101504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8009a20 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0edc34700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 0x7fc0e80c8910 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00c7e0 tx=0x7fc0dc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0e67fc700 1 -- 172.21.15.84:0/3674101504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc005b30 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0e67fc700 1 -- 172.21.15.84:0/3674101504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc005c90 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e80c6f60 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0e67fc700 1 -- 172.21.15.84:0/3674101504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc007300 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.864+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e80c7520 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.865+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e8064ad0 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.866+0000 7fc0e67fc700 1 -- 172.21.15.84:0/3674101504 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0dc01b3b0 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.866+0000 7fc0e67fc700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc0d4066f30 0x7fc0d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.866+0000 7fc0ee435700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc0d4066f30 0x7fc0d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.866+0000 7fc0e67fc700 1 -- 172.21.15.84:0/3674101504 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc0dc083d30 con 0x7fc0e80b4eb0 2023-10-06T02:57:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.867+0000 7fc0ee435700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc0d4066f30 0x7fc0d40693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009d10 tx=0x7fc0e00091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:07.870+0000 7fc0e67fc700 1 -- 172.21.15.84:0/3674101504 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0dc050cc0 con 0x7fc0e80b4eb0 2023-10-06T02:57:08.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.051+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0e80b5600 con 0x7fc0e80b4eb0 2023-10-06T02:57:08.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.051+0000 7fc0e67fc700 1 -- 172.21.15.84:0/3674101504 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0dc0170a0 con 0x7fc0e80b4eb0 2023-10-06T02:57:08.052 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:57:08.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc0d4066f30 msgr2=0x7fc0d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc0d4066f30 0x7fc0d40693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009d10 tx=0x7fc0e00091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 msgr2=0x7fc0e80c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 0x7fc0e80c8910 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00c7e0 tx=0x7fc0dc007df0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 shutdown_connections 2023-10-06T02:57:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc0d4066f30 0x7fc0d40693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0e80b4a60 0x7fc0e80c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0e80cd980 0x7fc0e8143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 --2- 172.21.15.84:0/3674101504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e80b4eb0 0x7fc0e80c8910 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 >> 172.21.15.84:0/3674101504 conn(0x7fc0e806ed20 msgr2=0x7fc0e8157990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 shutdown_connections 2023-10-06T02:57:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.053+0000 7fc0f0699700 1 -- 172.21.15.84:0/3674101504 wait complete. 2023-10-06T02:57:08.066 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:57:08.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.182+0000 7f4798ba9700 1 Processor -- start 2023-10-06T02:57:08.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.182+0000 7f4798ba9700 1 -- start start 2023-10-06T02:57:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4798ba9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940b2660 0x7f47940cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4798ba9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47940cf1f0 0x7f47940cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4798ba9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47940cc9b0 con 0x7f47940b2a30 2023-10-06T02:57:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4798ba9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47940cbda0 con 0x7f47940cf1f0 2023-10-06T02:57:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4798ba9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47940cc080 con 0x7f47940b2660 2023-10-06T02:57:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4793fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47940cf1f0 0x7f47940cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4793fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47940cf1f0 0x7f47940cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60472/0 (socket says 172.21.15.84:60472) 2023-10-06T02:57:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4793fff700 1 -- 172.21.15.84:0/768941724 learned_addr learned my addr 172.21.15.84:0/768941724 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f47937fe700 1 --2- 172.21.15.84:0/768941724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940b2660 0x7f47940cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4793fff700 1 -- 172.21.15.84:0/768941724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940b2660 msgr2=0x7f47940cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4793fff700 1 --2- 172.21.15.84:0/768941724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940b2660 0x7f47940cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4793fff700 1 -- 172.21.15.84:0/768941724 >> v1:172.21.15.131:6789/0 conn(0x7f47940b2a30 legacy=0x7f47940ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4793fff700 1 -- 172.21.15.84:0/768941724 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47940cc360 con 0x7f47940cf1f0 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.183+0000 7f4793fff700 1 --2- 172.21.15.84:0/768941724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940cf1f0 0x7f47940cd230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f478c009f20 tx=0x7f478c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d9a576fa992645 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f47927fc700 1 -- 172.21.15.84:0/768941724 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00e070 con 0x7f47940cf1f0 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f47927fc700 1 -- 172.21.15.84:0/768941724 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00ba40 con 0x7f47940cf1f0 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f47927fc700 1 -- 172.21.15.84:0/768941724 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c0092e0 con 0x7f47940cf1f0 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f4798ba9700 1 -- 172.21.15.84:0/768941724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940cf1f0 msgr2=0x7f47940cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f4798ba9700 1 --2- 172.21.15.84:0/768941724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940cf1f0 0x7f47940cd230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f478c009f20 tx=0x7f478c009840 comp rx=0 tx=0).stop 2023-10-06T02:57:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f4798ba9700 1 -- 172.21.15.84:0/768941724 shutdown_connections 2023-10-06T02:57:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f4798ba9700 1 --2- 172.21.15.84:0/768941724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940cf1f0 0x7f47940cd230 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f4798ba9700 1 --2- 172.21.15.84:0/768941724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940b2660 0x7f47940cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f4798ba9700 1 -- 172.21.15.84:0/768941724 >> 172.21.15.84:0/768941724 conn(0x7f4794099560 msgr2=0x7f479406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f4798ba9700 1 -- 172.21.15.84:0/768941724 shutdown_connections 2023-10-06T02:57:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.184+0000 7f4798ba9700 1 -- 172.21.15.84:0/768941724 wait complete. 2023-10-06T02:57:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.185+0000 7f4798ba9700 1 Processor -- start 2023-10-06T02:57:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.185+0000 7f4798ba9700 1 -- start start 2023-10-06T02:57:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4798ba9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47940b2660 0x7f479413f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4798ba9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940b2a30 0x7f47940b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4798ba9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940cf1f0 0x7f479416ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4798ba9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479413f980 con 0x7f47940b2a30 2023-10-06T02:57:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4798ba9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47940b4e10 con 0x7f47940b2660 2023-10-06T02:57:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4798ba9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47940b4240 con 0x7f47940cf1f0 2023-10-06T02:57:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4792ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940b2a30 0x7f47940b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4792ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940b2a30 0x7f47940b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60482/0 (socket says 172.21.15.84:60482) 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4792ffd700 1 -- 172.21.15.84:0/3818536206 learned_addr learned my addr 172.21.15.84:0/3818536206 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f4793fff700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940cf1f0 0x7f479416ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.186+0000 7f47937fe700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47940b2660 0x7f479413f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f4792ffd700 1 -- 172.21.15.84:0/3818536206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940cf1f0 msgr2=0x7f479416ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f4792ffd700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940cf1f0 0x7f479416ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f4792ffd700 1 -- 172.21.15.84:0/3818536206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47940b2660 msgr2=0x7f479413f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f4792ffd700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47940b2660 0x7f479413f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f4792ffd700 1 -- 172.21.15.84:0/3818536206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009ae0 con 0x7f47940b2a30 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f4792ffd700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940b2a30 0x7f47940b52a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f478800c600 tx=0x7f4788007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f477b7fe700 1 -- 172.21.15.84:0/3818536206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788011590 con 0x7f47940b2a30 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f477b7fe700 1 -- 172.21.15.84:0/3818536206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788011710 con 0x7f47940b2a30 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f477b7fe700 1 -- 172.21.15.84:0/3818536206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788011ad0 con 0x7f47940b2a30 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47940b44e0 con 0x7f47940b2a30 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.187+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47940b4aa0 con 0x7f47940b2a30 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.188+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47940b4fa0 con 0x7f47940b2a30 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.188+0000 7f477b7fe700 1 -- 172.21.15.84:0/3818536206 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f478801c460 con 0x7f47940b2a30 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.189+0000 7f477b7fe700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4780066f30 0x7f47800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.189+0000 7f47937fe700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4780066f30 0x7f47800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.189+0000 7f477b7fe700 1 -- 172.21.15.84:0/3818536206 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f47880844b0 con 0x7f47940b2a30 2023-10-06T02:57:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.189+0000 7f47937fe700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4780066f30 0x7f47800693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47840061f0 tx=0x7f4784008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.193+0000 7f477b7fe700 1 -- 172.21.15.84:0/3818536206 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4788051440 con 0x7f47940b2a30 2023-10-06T02:57:08.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.375+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f479405f270 con 0x7f47940b2a30 2023-10-06T02:57:08.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.375+0000 7f477b7fe700 1 -- 172.21.15.84:0/3818536206 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4788054a60 con 0x7f47940b2a30 2023-10-06T02:57:08.376 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:57:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4780066f30 msgr2=0x7f47800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4780066f30 0x7f47800693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f47840061f0 tx=0x7f4784008040 comp rx=0 tx=0).stop 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940b2a30 msgr2=0x7f47940b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940b2a30 0x7f47940b52a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f478800c600 tx=0x7f4788007f60 comp rx=0 tx=0).stop 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 shutdown_connections 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4780066f30 0x7f47800693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47940b2660 0x7f479413f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47940cf1f0 0x7f479416ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 --2- 172.21.15.84:0/3818536206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47940b2a30 0x7f47940b52a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 >> 172.21.15.84:0/3818536206 conn(0x7f4794099560 msgr2=0x7f47940c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.377+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 shutdown_connections 2023-10-06T02:57:08.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.378+0000 7f4798ba9700 1 -- 172.21.15.84:0/3818536206 wait complete. 2023-10-06T02:57:08.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:08.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.505+0000 7f3e85880700 1 Processor -- start 2023-10-06T02:57:08.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.505+0000 7f3e85880700 1 -- start start 2023-10-06T02:57:08.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.506+0000 7f3e85880700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e8015db50 0x7f3e800cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.506+0000 7f3e85880700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e800ced30 con 0x7f3e800ad620 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.506+0000 7f3e85880700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e800cf010 con 0x7f3e800ad250 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.506+0000 7f3e85880700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e800ccad0 con 0x7f3e8015db50 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.506+0000 7f3e767fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e8015db50 0x7f3e800cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.506+0000 7f3e7f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3e800ad620 0x7f3e800ca100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54932/0 (socket says 172.21.15.84:54932) 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.506+0000 7f3e767fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3e8015db50 0x7f3e800cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60496/0 (socket says 172.21.15.84:60496) 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.506+0000 7f3e7f7fe700 1 -- 172.21.15.84:0/3177915923 learned_addr learned my addr 172.21.15.84:0/3177915923 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.507+0000 7f3e767fc700 1 -- 172.21.15.84:0/3177915923 >> v1:172.21.15.131:6789/0 conn(0x7f3e800ad250 legacy=0x7f3e8015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.507+0000 7f3e767fc700 1 -- 172.21.15.84:0/3177915923 >> v1:172.21.15.84:6789/0 conn(0x7f3e800ad620 legacy=0x7f3e800ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.507+0000 7f3e767fc700 1 -- 172.21.15.84:0/3177915923 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e800ccdb0 con 0x7f3e8015db50 2023-10-06T02:57:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.507+0000 7f3e767fc700 1 --2- 172.21.15.84:0/3177915923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 0x7f3e800cd2d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3e680098e0 tx=0x7f3e680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca2b7ac4b082574 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.507+0000 7f3e7e7fc700 1 -- 172.21.15.84:0/3177915923 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68009e80 con 0x7f3e8015db50 2023-10-06T02:57:08.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.507+0000 7f3e7e7fc700 1 -- 172.21.15.84:0/3177915923 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6800b860 con 0x7f3e8015db50 2023-10-06T02:57:08.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.507+0000 7f3e7e7fc700 1 -- 172.21.15.84:0/3177915923 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800bbe0 con 0x7f3e8015db50 2023-10-06T02:57:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.508+0000 7f3e85880700 1 -- 172.21.15.84:0/3177915923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 msgr2=0x7f3e800cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.508+0000 7f3e85880700 1 --2- 172.21.15.84:0/3177915923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 0x7f3e800cd2d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3e680098e0 tx=0x7f3e680091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.508+0000 7f3e85880700 1 -- 172.21.15.84:0/3177915923 shutdown_connections 2023-10-06T02:57:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.508+0000 7f3e85880700 1 --2- 172.21.15.84:0/3177915923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 0x7f3e800cd2d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.508+0000 7f3e85880700 1 -- 172.21.15.84:0/3177915923 >> 172.21.15.84:0/3177915923 conn(0x7f3e80067dd0 msgr2=0x7f3e800ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.508+0000 7f3e85880700 1 -- 172.21.15.84:0/3177915923 shutdown_connections 2023-10-06T02:57:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.508+0000 7f3e85880700 1 -- 172.21.15.84:0/3177915923 wait complete. 2023-10-06T02:57:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.509+0000 7f3e85880700 1 Processor -- start 2023-10-06T02:57:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.509+0000 7f3e85880700 1 -- start start 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e85880700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e800ad250 0x7f3e800add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e85880700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e800ad620 0x7f3e80148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e85880700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 0x7f3e80149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e85880700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e801498a0 con 0x7f3e8015db50 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e85880700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800c4600 con 0x7f3e800ad250 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e85880700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800c3a80 con 0x7f3e800ad620 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 0x7f3e80149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 0x7f3e80149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60512/0 (socket says 172.21.15.84:60512) 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7f7fe700 1 -- 172.21.15.84:0/3378124003 learned_addr learned my addr 172.21.15.84:0/3378124003 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7effd700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e800ad250 0x7f3e800add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e767fc700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e800ad620 0x7f3e80148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7f7fe700 1 -- 172.21.15.84:0/3378124003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e800ad620 msgr2=0x7f3e80148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7f7fe700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e800ad620 0x7f3e80148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7f7fe700 1 -- 172.21.15.84:0/3378124003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e800ad250 msgr2=0x7f3e800add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7f7fe700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e800ad250 0x7f3e800add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7f7fe700 1 -- 172.21.15.84:0/3378124003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e68009420 con 0x7f3e8015db50 2023-10-06T02:57:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e7f7fe700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 0x7f3e80149360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800cc40 tx=0x7f3e78001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e777fe700 1 -- 172.21.15.84:0/3378124003 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7800a9c0 con 0x7f3e8015db50 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e777fe700 1 -- 172.21.15.84:0/3378124003 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7800ab40 con 0x7f3e8015db50 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e800c3d60 con 0x7f3e8015db50 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.510+0000 7f3e777fe700 1 -- 172.21.15.84:0/3378124003 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780070f0 con 0x7f3e8015db50 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.511+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e800c4320 con 0x7f3e8015db50 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.511+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e800c5ab0 con 0x7f3e8015db50 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.512+0000 7f3e777fe700 1 -- 172.21.15.84:0/3378124003 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e780074a0 con 0x7f3e8015db50 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.512+0000 7f3e777fe700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e60066f30 0x7f3e600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.512+0000 7f3e777fe700 1 -- 172.21.15.84:0/3378124003 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f3e78084b50 con 0x7f3e8015db50 2023-10-06T02:57:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.512+0000 7f3e7effd700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e60066f30 0x7f3e600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.513+0000 7f3e7effd700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e60066f30 0x7f3e600693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e700038d0 tx=0x7f3e70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.516+0000 7f3e777fe700 1 -- 172.21.15.84:0/3378124003 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e800c5ab0 con 0x7f3e8015db50 2023-10-06T02:57:08.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.741+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e800c5ab0 con 0x7f3e8015db50 2023-10-06T02:57:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.742+0000 7f3e777fe700 1 -- 172.21.15.84:0/3378124003 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4628 (secure 0 0 0) 0x7f3e800c5ab0 con 0x7f3e8015db50 2023-10-06T02:57:08.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:08.743 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:56:04.813024+0000","modified":"2023-10-06T02:56:37.132278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5124,"mds_1":5115,"mds_2":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6836/1815868063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1815868063},{"type":"v1","addr":"172.21.15.84:6836","nonce":1815868063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5115":{"gid":5115,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6837/197493808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":197493808},{"type":"v1","addr":"172.21.15.84:6837","nonce":197493808}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5124":{"gid":5124,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6835/781245140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":781245140},{"type":"v1","addr":"172.21.15.131:6835","nonce":781245140}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:57:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e60066f30 msgr2=0x7f3e600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e60066f30 0x7f3e600693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e700038d0 tx=0x7f3e70009040 comp rx=0 tx=0).stop 2023-10-06T02:57:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 msgr2=0x7f3e80149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 0x7f3e80149360 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800cc40 tx=0x7f3e78001a50 comp rx=0 tx=0).stop 2023-10-06T02:57:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 shutdown_connections 2023-10-06T02:57:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3e60066f30 0x7f3e600693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e800ad250 0x7f3e800add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e8015db50 0x7f3e80149360 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 --2- 172.21.15.84:0/3378124003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3e800ad620 0x7f3e80148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 >> 172.21.15.84:0/3378124003 conn(0x7f3e80067dd0 msgr2=0x7f3e8006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 shutdown_connections 2023-10-06T02:57:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.744+0000 7f3e85880700 1 -- 172.21.15.84:0/3378124003 wait complete. 2023-10-06T02:57:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2023-10-06T02:57:08.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:08.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.870+0000 7f3468f05700 1 Processor -- start 2023-10-06T02:57:08.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.870+0000 7f3468f05700 1 -- start start 2023-10-06T02:57:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.871+0000 7f3468f05700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3464159480 0x7f34640b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.871+0000 7f3468f05700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34640b2140 0x7f34640b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.871+0000 7f3468f05700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640cb7e0 con 0x7f34640b3610 2023-10-06T02:57:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.871+0000 7f3468f05700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34640b08a0 con 0x7f34640b2140 2023-10-06T02:57:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.871+0000 7f3468f05700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34640cb190 con 0x7f3464159480 2023-10-06T02:57:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.871+0000 7f3463fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34640b2140 0x7f34640b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.871+0000 7f3463fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34640b2140 0x7f34640b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60528/0 (socket says 172.21.15.84:60528) 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.871+0000 7f3463fff700 1 -- 172.21.15.84:0/3574637849 learned_addr learned my addr 172.21.15.84:0/3574637849 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.871+0000 7f34637fe700 1 --2- 172.21.15.84:0/3574637849 >> v2:172.21.15.131:3300/0 conn(0x7f3464159480 0x7f34640b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3463fff700 1 -- 172.21.15.84:0/3574637849 >> v2:172.21.15.131:3300/0 conn(0x7f3464159480 msgr2=0x7f34640b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3463fff700 1 --2- 172.21.15.84:0/3574637849 >> v2:172.21.15.131:3300/0 conn(0x7f3464159480 0x7f34640b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3463fff700 1 -- 172.21.15.84:0/3574637849 >> v1:172.21.15.131:6789/0 conn(0x7f34640b3610 legacy=0x7f34640cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3463fff700 1 -- 172.21.15.84:0/3574637849 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640cb470 con 0x7f34640b2140 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3463fff700 1 --2- 172.21.15.84:0/3574637849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b2140 0x7f34640b2560 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f346406fa30 tx=0x7f345c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7db93772214c32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f34627fc700 1 -- 172.21.15.84:0/3574637849 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c00e070 con 0x7f34640b2140 2023-10-06T02:57:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f34627fc700 1 -- 172.21.15.84:0/3574637849 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c00ba20 con 0x7f34640b2140 2023-10-06T02:57:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f34627fc700 1 -- 172.21.15.84:0/3574637849 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c0092e0 con 0x7f34640b2140 2023-10-06T02:57:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3468f05700 1 -- 172.21.15.84:0/3574637849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b2140 msgr2=0x7f34640b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3468f05700 1 --2- 172.21.15.84:0/3574637849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b2140 0x7f34640b2560 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f346406fa30 tx=0x7f345c009840 comp rx=0 tx=0).stop 2023-10-06T02:57:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3468f05700 1 -- 172.21.15.84:0/3574637849 shutdown_connections 2023-10-06T02:57:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3468f05700 1 --2- 172.21.15.84:0/3574637849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b2140 0x7f34640b2560 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3468f05700 1 --2- 172.21.15.84:0/3574637849 >> v2:172.21.15.131:3300/0 conn(0x7f3464159480 0x7f34640b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3468f05700 1 -- 172.21.15.84:0/3574637849 >> 172.21.15.84:0/3574637849 conn(0x7f346406ed20 msgr2=0x7f346406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3468f05700 1 -- 172.21.15.84:0/3574637849 shutdown_connections 2023-10-06T02:57:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.872+0000 7f3468f05700 1 -- 172.21.15.84:0/3574637849 wait complete. 2023-10-06T02:57:08.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.874+0000 7f3468f05700 1 Processor -- start 2023-10-06T02:57:08.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.874+0000 7f3468f05700 1 -- start start 2023-10-06T02:57:08.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.874+0000 7f3468f05700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34640b2140 0x7f3464155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.874+0000 7f3468f05700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b3610 0x7f346415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.874+0000 7f3468f05700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3464159480 0x7f346415be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.874+0000 7f3468f05700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346415d460 con 0x7f34640b3610 2023-10-06T02:57:08.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.874+0000 7f3468f05700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346415c4b0 con 0x7f3464159480 2023-10-06T02:57:08.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.874+0000 7f3468f05700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346415c790 con 0x7f34640b2140 2023-10-06T02:57:08.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.874+0000 7f3462ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b3610 0x7f346415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3462ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b3610 0x7f346415b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60532/0 (socket says 172.21.15.84:60532) 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3462ffd700 1 -- 172.21.15.84:0/2770523853 learned_addr learned my addr 172.21.15.84:0/2770523853 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3463fff700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3464159480 0x7f346415be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f34637fe700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34640b2140 0x7f3464155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3462ffd700 1 -- 172.21.15.84:0/2770523853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34640b2140 msgr2=0x7f3464155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3462ffd700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34640b2140 0x7f3464155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3462ffd700 1 -- 172.21.15.84:0/2770523853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3464159480 msgr2=0x7f346415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3462ffd700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3464159480 0x7f346415be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3462ffd700 1 -- 172.21.15.84:0/2770523853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c009ae0 con 0x7f34640b3610 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3462ffd700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b3610 0x7f346415b8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f345800c590 tx=0x7f345800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f344b7fe700 1 -- 172.21.15.84:0/2770523853 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458011590 con 0x7f34640b3610 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f344b7fe700 1 -- 172.21.15.84:0/2770523853 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3458011710 con 0x7f34640b3610 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346415d0f0 con 0x7f34640b3610 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f344b7fe700 1 -- 172.21.15.84:0/2770523853 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458011ad0 con 0x7f34640b3610 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.875+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3464155b80 con 0x7f34640b3610 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.876+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346415cf50 con 0x7f34640b3610 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.876+0000 7f344b7fe700 1 -- 172.21.15.84:0/2770523853 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f345801b3b0 con 0x7f34640b3610 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.877+0000 7f344b7fe700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3450066f30 0x7f34500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.877+0000 7f344b7fe700 1 -- 172.21.15.84:0/2770523853 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f3458083ca0 con 0x7f34640b3610 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.877+0000 7f34637fe700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3450066f30 0x7f34500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.877+0000 7f34637fe700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3450066f30 0x7f34500693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3454009d10 tx=0x7f34540091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:08.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:08.881+0000 7f344b7fe700 1 -- 172.21.15.84:0/2770523853 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f346415cf50 con 0x7f34640b3610 2023-10-06T02:57:09.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.067+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f346415cf50 con 0x7f34640b3610 2023-10-06T02:57:09.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.068+0000 7f344b7fe700 1 -- 172.21.15.84:0/2770523853 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17165 (secure 0 0 0) 0x7f346415cf50 con 0x7f34640b3610 2023-10-06T02:57:09.069 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:09.069 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:56:50.167990+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:56:02.609660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:56:03.782698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.6","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:09.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3450066f30 msgr2=0x7f34500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3450066f30 0x7f34500693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3454009d10 tx=0x7f34540091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b3610 msgr2=0x7f346415b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b3610 0x7f346415b8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f345800c590 tx=0x7f345800c8a0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 shutdown_connections 2023-10-06T02:57:09.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3450066f30 0x7f34500693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3464159480 0x7f346415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34640b2140 0x7f3464155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 --2- 172.21.15.84:0/2770523853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34640b3610 0x7f346415b8f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 >> 172.21.15.84:0/2770523853 conn(0x7f346406ed20 msgr2=0x7f34640b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 shutdown_connections 2023-10-06T02:57:09.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.070+0000 7f3468f05700 1 -- 172.21.15.84:0/2770523853 wait complete. 2023-10-06T02:57:09.083 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:57:09.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:09.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.196+0000 7fc918433700 1 Processor -- start 2023-10-06T02:57:09.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.196+0000 7fc918433700 1 -- start start 2023-10-06T02:57:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc918433700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9101595a0 0x7fc9100aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc918433700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b49e0 0x7fc9100aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc918433700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9100b0ca0 con 0x7fc9100b07a0 2023-10-06T02:57:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc918433700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100b0f80 con 0x7fc9101595a0 2023-10-06T02:57:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc918433700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100b1260 con 0x7fc9100b49e0 2023-10-06T02:57:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc9161cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9101595a0 0x7fc9100aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc9161cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9101595a0 0x7fc9100aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60536/0 (socket says 172.21.15.84:60536) 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc9161cf700 1 -- 172.21.15.84:0/1412353915 learned_addr learned my addr 172.21.15.84:0/1412353915 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc9159ce700 1 --2- 172.21.15.84:0/1412353915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b49e0 0x7fc9100aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc9161cf700 1 -- 172.21.15.84:0/1412353915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b49e0 msgr2=0x7fc9100aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc9161cf700 1 --2- 172.21.15.84:0/1412353915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b49e0 0x7fc9100aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc9161cf700 1 -- 172.21.15.84:0/1412353915 >> v1:172.21.15.131:6789/0 conn(0x7fc9100b07a0 legacy=0x7fc9100b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.197+0000 7fc9161cf700 1 -- 172.21.15.84:0/1412353915 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100b1540 con 0x7fc9101595a0 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc9161cf700 1 --2- 172.21.15.84:0/1412353915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9101595a0 0x7fc9100aa570 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009f70 tx=0x7fc90c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6dc84cd13baa05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc9151cd700 1 -- 172.21.15.84:0/1412353915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00e070 con 0x7fc9101595a0 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc9151cd700 1 -- 172.21.15.84:0/1412353915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c00ba20 con 0x7fc9101595a0 2023-10-06T02:57:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc9151cd700 1 -- 172.21.15.84:0/1412353915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0092e0 con 0x7fc9101595a0 2023-10-06T02:57:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc918433700 1 -- 172.21.15.84:0/1412353915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9101595a0 msgr2=0x7fc9100aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc918433700 1 --2- 172.21.15.84:0/1412353915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9101595a0 0x7fc9100aa570 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009f70 tx=0x7fc90c009840 comp rx=0 tx=0).stop 2023-10-06T02:57:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc918433700 1 -- 172.21.15.84:0/1412353915 shutdown_connections 2023-10-06T02:57:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc918433700 1 --2- 172.21.15.84:0/1412353915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9101595a0 0x7fc9100aa570 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc918433700 1 --2- 172.21.15.84:0/1412353915 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b49e0 0x7fc9100aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc918433700 1 -- 172.21.15.84:0/1412353915 >> 172.21.15.84:0/1412353915 conn(0x7fc910099830 msgr2=0x7fc91006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc918433700 1 -- 172.21.15.84:0/1412353915 shutdown_connections 2023-10-06T02:57:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.198+0000 7fc918433700 1 -- 172.21.15.84:0/1412353915 wait complete. 2023-10-06T02:57:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.199+0000 7fc918433700 1 Processor -- start 2023-10-06T02:57:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc918433700 1 -- start start 2023-10-06T02:57:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc918433700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b07a0 0x7fc91016d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc918433700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9100b49e0 0x7fc91016da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc918433700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9101595a0 0x7fc910155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc918433700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9101569a0 con 0x7fc9100b49e0 2023-10-06T02:57:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc918433700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc910155d90 con 0x7fc9101595a0 2023-10-06T02:57:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc918433700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc910156070 con 0x7fc9100b07a0 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc9159ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9100b49e0 0x7fc91016da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc9159ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9100b49e0 0x7fc91016da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60542/0 (socket says 172.21.15.84:60542) 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc9159ce700 1 -- 172.21.15.84:0/946907899 learned_addr learned my addr 172.21.15.84:0/946907899 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc9169d0700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9101595a0 0x7fc910155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.200+0000 7fc9161cf700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b07a0 0x7fc91016d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc9159ce700 1 -- 172.21.15.84:0/946907899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b07a0 msgr2=0x7fc91016d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc9159ce700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b07a0 0x7fc91016d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc9159ce700 1 -- 172.21.15.84:0/946907899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9101595a0 msgr2=0x7fc910155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc9159ce700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9101595a0 0x7fc910155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc9159ce700 1 -- 172.21.15.84:0/946907899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c009ae0 con 0x7fc9100b49e0 2023-10-06T02:57:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc9159ce700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9100b49e0 0x7fc91016da40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc90000ec80 tx=0x7fc9000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc9067fc700 1 -- 172.21.15.84:0/946907899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000c850 con 0x7fc9100b49e0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc9067fc700 1 -- 172.21.15.84:0/946907899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000c9b0 con 0x7fc9100b49e0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc910156350 con 0x7fc9100b49e0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc9067fc700 1 -- 172.21.15.84:0/946907899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000cd50 con 0x7fc9100b49e0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.201+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91015c9a0 con 0x7fc9100b49e0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.202+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91015a6b0 con 0x7fc9100b49e0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.202+0000 7fc9067fc700 1 -- 172.21.15.84:0/946907899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc900013680 con 0x7fc9100b49e0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.203+0000 7fc9067fc700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc8f4066f30 0x7fc8f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.203+0000 7fc9067fc700 1 -- 172.21.15.84:0/946907899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc900084a30 con 0x7fc9100b49e0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.203+0000 7fc9161cf700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc8f4066f30 0x7fc8f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.203+0000 7fc9161cf700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc8f4066f30 0x7fc8f40693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009880 tx=0x7fc90c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.207+0000 7fc9067fc700 1 -- 172.21.15.84:0/946907899 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc91015a6b0 con 0x7fc9100b49e0 2023-10-06T02:57:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.433+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc91015a6b0 con 0x7fc9100b49e0 2023-10-06T02:57:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.433+0000 7fc9067fc700 1 -- 172.21.15.84:0/946907899 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4628 (secure 0 0 0) 0x7fc91015a6b0 con 0x7fc9100b49e0 2023-10-06T02:57:09.434 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:09.434 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:56:04.813024+0000","modified":"2023-10-06T02:56:37.132278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5124,"mds_1":5115,"mds_2":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6836/1815868063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1815868063},{"type":"v1","addr":"172.21.15.84:6836","nonce":1815868063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5115":{"gid":5115,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6837/197493808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":197493808},{"type":"v1","addr":"172.21.15.84:6837","nonce":197493808}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5124":{"gid":5124,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6835/781245140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":781245140},{"type":"v1","addr":"172.21.15.131:6835","nonce":781245140}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:57:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc8f4066f30 msgr2=0x7fc8f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc8f4066f30 0x7fc8f40693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009880 tx=0x7fc90c018000 comp rx=0 tx=0).stop 2023-10-06T02:57:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9100b49e0 msgr2=0x7fc91016da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9100b49e0 0x7fc91016da40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc90000ec80 tx=0x7fc9000091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 shutdown_connections 2023-10-06T02:57:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc8f4066f30 0x7fc8f40693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9101595a0 0x7fc910155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9100b07a0 0x7fc91016d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 --2- 172.21.15.84:0/946907899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9100b49e0 0x7fc91016da40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 >> 172.21.15.84:0/946907899 conn(0x7fc910099830 msgr2=0x7fc910069bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 shutdown_connections 2023-10-06T02:57:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.435+0000 7fc918433700 1 -- 172.21.15.84:0/946907899 wait complete. 2023-10-06T02:57:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2023-10-06T02:57:09.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.561+0000 7f9b9759e700 1 Processor -- start 2023-10-06T02:57:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.561+0000 7f9b9759e700 1 -- start start 2023-10-06T02:57:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b98159480 0x7f9b980b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b980b2140 0x7f9b980b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9759e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980cb7e0 con 0x7f9b980b3610 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b980b08a0 con 0x7f9b98159480 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980cb190 con 0x7f9b980b2140 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b98159480 0x7f9b980b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b98159480 0x7f9b980b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60554/0 (socket says 172.21.15.84:60554) 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9659c700 1 -- 172.21.15.84:0/975035009 learned_addr learned my addr 172.21.15.84:0/975035009 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b96d9d700 1 --2- 172.21.15.84:0/975035009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b980b2140 0x7f9b980b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9659c700 1 -- 172.21.15.84:0/975035009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b980b2140 msgr2=0x7f9b980b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9659c700 1 --2- 172.21.15.84:0/975035009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b980b2140 0x7f9b980b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9659c700 1 -- 172.21.15.84:0/975035009 >> v1:172.21.15.131:6789/0 conn(0x7f9b980b3610 legacy=0x7f9b980cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9659c700 1 -- 172.21.15.84:0/975035009 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b980cb470 con 0x7f9b98159480 2023-10-06T02:57:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b96d9d700 1 --2- 172.21.15.84:0/975035009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b980b2140 0x7f9b980b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.562+0000 7f9b9659c700 1 --2- 172.21.15.84:0/975035009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98159480 0x7f9b980b30d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9b800099b0 tx=0x7f9b80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d925aabf0b6a6e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9559a700 1 -- 172.21.15.84:0/975035009 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000b820 con 0x7f9b98159480 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9559a700 1 -- 172.21.15.84:0/975035009 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000b980 con 0x7f9b98159480 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9559a700 1 -- 172.21.15.84:0/975035009 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000bd20 con 0x7f9b98159480 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9759e700 1 -- 172.21.15.84:0/975035009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98159480 msgr2=0x7f9b980b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9759e700 1 --2- 172.21.15.84:0/975035009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98159480 0x7f9b980b30d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9b800099b0 tx=0x7f9b80009250 comp rx=0 tx=0).stop 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9759e700 1 -- 172.21.15.84:0/975035009 shutdown_connections 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9759e700 1 --2- 172.21.15.84:0/975035009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b980b2140 0x7f9b980b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9759e700 1 --2- 172.21.15.84:0/975035009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b98159480 0x7f9b980b30d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9759e700 1 -- 172.21.15.84:0/975035009 >> 172.21.15.84:0/975035009 conn(0x7f9b9806ed20 msgr2=0x7f9b9806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9759e700 1 -- 172.21.15.84:0/975035009 shutdown_connections 2023-10-06T02:57:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.563+0000 7f9b9759e700 1 -- 172.21.15.84:0/975035009 wait complete. 2023-10-06T02:57:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.564+0000 7f9b9759e700 1 Processor -- start 2023-10-06T02:57:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.564+0000 7f9b9759e700 1 -- start start 2023-10-06T02:57:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b9759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b980b2140 0x7f9b98154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b9759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b980b3610 0x7f9b980c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b9759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b98159480 0x7f9b980c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b9759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9815d4a0 con 0x7f9b980b3610 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b9759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9815d7b0 con 0x7f9b980b2140 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b9759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9815da90 con 0x7f9b98159480 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b95d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b980b3610 0x7f9b980c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b95d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b980b3610 0x7f9b980c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60556/0 (socket says 172.21.15.84:60556) 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b95d9b700 1 -- 172.21.15.84:0/3994461667 learned_addr learned my addr 172.21.15.84:0/3994461667 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b9659c700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b980b2140 0x7f9b98154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.565+0000 7f9b96d9d700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b98159480 0x7f9b980c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b95d9b700 1 -- 172.21.15.84:0/3994461667 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b98159480 msgr2=0x7f9b980c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b95d9b700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b98159480 0x7f9b980c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b95d9b700 1 -- 172.21.15.84:0/3994461667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b980b2140 msgr2=0x7f9b98154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b95d9b700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b980b2140 0x7f9b98154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b95d9b700 1 -- 172.21.15.84:0/3994461667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800094f0 con 0x7f9b980b3610 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b95d9b700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b980b3610 0x7f9b980c7310 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800c5d0 tx=0x7f9b88007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b8e7fc700 1 -- 172.21.15.84:0/3994461667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88011590 con 0x7f9b980b3610 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b8e7fc700 1 -- 172.21.15.84:0/3994461667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b88011710 con 0x7f9b980b3610 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9815dd70 con 0x7f9b980b3610 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b8e7fc700 1 -- 172.21.15.84:0/3994461667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88011ad0 con 0x7f9b980b3610 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.566+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9815e3b0 con 0x7f9b980b3610 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.567+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9815e540 con 0x7f9b980b3610 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.567+0000 7f9b8e7fc700 1 -- 172.21.15.84:0/3994461667 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b8801c460 con 0x7f9b980b3610 2023-10-06T02:57:09.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.567+0000 7f9b8e7fc700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b78066f30 0x7f9b780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.568+0000 7f9b8e7fc700 1 -- 172.21.15.84:0/3994461667 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f9b880844d0 con 0x7f9b980b3610 2023-10-06T02:57:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.568+0000 7f9b9659c700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b78066f30 0x7f9b780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.568+0000 7f9b9659c700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b78066f30 0x7f9b780693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9b800099b0 tx=0x7f9b80016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.572+0000 7f9b8e7fc700 1 -- 172.21.15.84:0/3994461667 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b88051460 con 0x7f9b980b3610 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.795+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b9805f270 con 0x7f9b980b3610 2023-10-06T02:57:09.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.796+0000 7f9b8e7fc700 1 -- 172.21.15.84:0/3994461667 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4628 (secure 0 0 0) 0x7f9b88054a80 con 0x7f9b980b3610 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:09.797 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:56:04.813024+0000","modified":"2023-10-06T02:56:37.132278+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5124,"mds_1":5115,"mds_2":5112},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5112":{"gid":5112,"name":"a","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6836/1815868063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1815868063},{"type":"v1","addr":"172.21.15.84:6836","nonce":1815868063}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5115":{"gid":5115,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6837/197493808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":197493808},{"type":"v1","addr":"172.21.15.84:6837","nonce":197493808}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5124":{"gid":5124,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6835/781245140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":781245140},{"type":"v1","addr":"172.21.15.131:6835","nonce":781245140}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T02:57:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b78066f30 msgr2=0x7f9b780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b78066f30 0x7f9b780693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9b800099b0 tx=0x7f9b80016000 comp rx=0 tx=0).stop 2023-10-06T02:57:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b980b3610 msgr2=0x7f9b980c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b980b3610 0x7f9b980c7310 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800c5d0 tx=0x7f9b88007f60 comp rx=0 tx=0).stop 2023-10-06T02:57:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 shutdown_connections 2023-10-06T02:57:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9b78066f30 0x7f9b780693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b980b2140 0x7f9b98154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b98159480 0x7f9b980c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 --2- 172.21.15.84:0/3994461667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b980b3610 0x7f9b980c7310 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 >> 172.21.15.84:0/3994461667 conn(0x7f9b9806ed20 msgr2=0x7f9b98156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 shutdown_connections 2023-10-06T02:57:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.798+0000 7f9b9759e700 1 -- 172.21.15.84:0/3994461667 wait complete. 2023-10-06T02:57:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2023-10-06T02:57:09.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:09.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.924+0000 7fa5eed2c700 1 Processor -- start 2023-10-06T02:57:09.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.924+0000 7fa5eed2c700 1 -- start start 2023-10-06T02:57:09.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5eed2c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa5e80b49e0 0x7fa5e80aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5eed2c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b07a0 0x7fa5e80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5eed2c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e80b0ca0 con 0x7fa5e81595a0 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5eed2c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e80b0f80 con 0x7fa5e80b49e0 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5eed2c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e80b1260 con 0x7fa5e80b07a0 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5e7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa5e80b49e0 0x7fa5e80aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5ecac8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa5e81595a0 0x7fa5e80aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54942/0 (socket says 172.21.15.84:54942) 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5ecac8700 1 -- 172.21.15.84:0/622189996 learned_addr learned my addr 172.21.15.84:0/622189996 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5e7fff700 1 -- 172.21.15.84:0/622189996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b07a0 msgr2=0x7fa5e80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5ed2c9700 1 --2- 172.21.15.84:0/622189996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b07a0 0x7fa5e80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5e7fff700 1 --2- 172.21.15.84:0/622189996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b07a0 0x7fa5e80b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5e7fff700 1 -- 172.21.15.84:0/622189996 >> v1:172.21.15.84:6789/0 conn(0x7fa5e81595a0 legacy=0x7fa5e80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5e77fe700 1 -- 172.21.15.84:0/622189996 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889342077 0 0) 0x7fa5e80b0ca0 con 0x7fa5e81595a0 2023-10-06T02:57:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5e7fff700 1 -- 172.21.15.84:0/622189996 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80b1540 con 0x7fa5e80b49e0 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5ed2c9700 1 --2- 172.21.15.84:0/622189996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b07a0 0x7fa5e80b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5e7fff700 1 --2- 172.21.15.84:0/622189996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b49e0 0x7fa5e80aac80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009910 tx=0x7fa5d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71142a6101859f46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.925+0000 7fa5e77fe700 1 -- 172.21.15.84:0/622189996 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400b820 con 0x7fa5e80b49e0 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5e77fe700 1 -- 172.21.15.84:0/622189996 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d400b980 con 0x7fa5e80b49e0 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5e77fe700 1 -- 172.21.15.84:0/622189996 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400bd20 con 0x7fa5e80b49e0 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5eed2c700 1 -- 172.21.15.84:0/622189996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b49e0 msgr2=0x7fa5e80aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5eed2c700 1 --2- 172.21.15.84:0/622189996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b49e0 0x7fa5e80aac80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009910 tx=0x7fa5d40091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5eed2c700 1 -- 172.21.15.84:0/622189996 shutdown_connections 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5eed2c700 1 --2- 172.21.15.84:0/622189996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b07a0 0x7fa5e80b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5eed2c700 1 --2- 172.21.15.84:0/622189996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b49e0 0x7fa5e80aac80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5eed2c700 1 -- 172.21.15.84:0/622189996 >> 172.21.15.84:0/622189996 conn(0x7fa5e8099830 msgr2=0x7fa5e806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:09.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5eed2c700 1 -- 172.21.15.84:0/622189996 shutdown_connections 2023-10-06T02:57:09.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.926+0000 7fa5eed2c700 1 -- 172.21.15.84:0/622189996 wait complete. 2023-10-06T02:57:09.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.927+0000 7fa5eed2c700 1 Processor -- start 2023-10-06T02:57:09.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.927+0000 7fa5eed2c700 1 -- start start 2023-10-06T02:57:09.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5eed2c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b07a0 0x7fa5e8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5eed2c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b49e0 0x7fa5e809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5eed2c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e81595a0 0x7fa5e815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5eed2c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e816a370 con 0x7fa5e80b07a0 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5eed2c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e809b2f0 con 0x7fa5e81595a0 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5eed2c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e8169a40 con 0x7fa5e80b49e0 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5ecac8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b07a0 0x7fa5e8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5ecac8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b07a0 0x7fa5e8158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60574/0 (socket says 172.21.15.84:60574) 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5ecac8700 1 -- 172.21.15.84:0/3947189224 learned_addr learned my addr 172.21.15.84:0/3947189224 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5ecac8700 1 -- 172.21.15.84:0/3947189224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b49e0 msgr2=0x7fa5e809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5ecac8700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b49e0 0x7fa5e809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5ecac8700 1 -- 172.21.15.84:0/3947189224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e81595a0 msgr2=0x7fa5e815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5ecac8700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e81595a0 0x7fa5e815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5ecac8700 1 -- 172.21.15.84:0/3947189224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4009420 con 0x7fa5e80b07a0 2023-10-06T02:57:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.928+0000 7fa5ecac8700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b07a0 0x7fa5e8158a60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00c590 tx=0x7fa5dc007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.929+0000 7fa5e4ff9700 1 -- 172.21.15.84:0/3947189224 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0072e0 con 0x7fa5e80b07a0 2023-10-06T02:57:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.929+0000 7fa5e4ff9700 1 -- 172.21.15.84:0/3947189224 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc007480 con 0x7fa5e80b07a0 2023-10-06T02:57:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.929+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e8169d20 con 0x7fa5e80b07a0 2023-10-06T02:57:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.929+0000 7fa5e4ff9700 1 -- 172.21.15.84:0/3947189224 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0057f0 con 0x7fa5e80b07a0 2023-10-06T02:57:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.929+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e8158fa0 con 0x7fa5e80b07a0 2023-10-06T02:57:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.930+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e8064ad0 con 0x7fa5e80b07a0 2023-10-06T02:57:09.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.930+0000 7fa5e4ff9700 1 -- 172.21.15.84:0/3947189224 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5dc005ba0 con 0x7fa5e80b07a0 2023-10-06T02:57:09.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.930+0000 7fa5e4ff9700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5cc066f30 0x7fa5cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:09.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.930+0000 7fa5e4ff9700 1 -- 172.21.15.84:0/3947189224 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fa5dc083be0 con 0x7fa5e80b07a0 2023-10-06T02:57:09.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.930+0000 7fa5e7fff700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5cc066f30 0x7fa5cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:09.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.931+0000 7fa5e7fff700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5cc066f30 0x7fa5cc0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009910 tx=0x7fa5d4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:09.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:09.934+0000 7fa5e4ff9700 1 -- 172.21.15.84:0/3947189224 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5dc04b5a0 con 0x7fa5e80b07a0 2023-10-06T02:57:10.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.117+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5e80b1820 con 0x7fa5e80b07a0 2023-10-06T02:57:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.117+0000 7fa5e4ff9700 1 -- 172.21.15.84:0/3947189224 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+17165 (secure 0 0 0) 0x7fa5dc050c20 con 0x7fa5e80b07a0 2023-10-06T02:57:10.119 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:10.119 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:56:50.167990+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:56:02.609660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T02:56:03.782698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.6","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5cc066f30 msgr2=0x7fa5cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5cc066f30 0x7fa5cc0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009910 tx=0x7fa5d4017000 comp rx=0 tx=0).stop 2023-10-06T02:57:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b07a0 msgr2=0x7fa5e8158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b07a0 0x7fa5e8158a60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00c590 tx=0x7fa5dc007e80 comp rx=0 tx=0).stop 2023-10-06T02:57:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 shutdown_connections 2023-10-06T02:57:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa5cc066f30 0x7fa5cc0693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e81595a0 0x7fa5e815a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5e80b07a0 0x7fa5e8158a60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 --2- 172.21.15.84:0/3947189224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5e80b49e0 0x7fa5e809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.119+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 >> 172.21.15.84:0/3947189224 conn(0x7fa5e8099830 msgr2=0x7fa5e8069670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.120+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 shutdown_connections 2023-10-06T02:57:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.120+0000 7fa5eed2c700 1 -- 172.21.15.84:0/3947189224 wait complete. 2023-10-06T02:57:10.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:57:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.248+0000 7f4594835700 1 Processor -- start 2023-10-06T02:57:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.248+0000 7f4594835700 1 -- start start 2023-10-06T02:57:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f4594835700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 0x7f45900b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f4594835700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f45900b3610 0x7f45900cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f4594835700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45900cb7e0 con 0x7f45900cc1b0 2023-10-06T02:57:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f4594835700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45900b08a0 con 0x7f45900b3610 2023-10-06T02:57:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f4594835700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cb190 con 0x7f4590159480 2023-10-06T02:57:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f458effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f45900b3610 0x7f45900cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f458effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f45900b3610 0x7f45900cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60576/0 (socket says 172.21.15.84:60576) 2023-10-06T02:57:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f458effd700 1 -- 172.21.15.84:0/2835287538 learned_addr learned my addr 172.21.15.84:0/2835287538 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f458f7fe700 1 --2- 172.21.15.84:0/2835287538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 0x7f45900b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f458effd700 1 -- 172.21.15.84:0/2835287538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 msgr2=0x7f45900b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f458effd700 1 --2- 172.21.15.84:0/2835287538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 0x7f45900b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f458effd700 1 -- 172.21.15.84:0/2835287538 >> v1:172.21.15.131:6789/0 conn(0x7f45900cc1b0 legacy=0x7f45900b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.249+0000 7f458effd700 1 -- 172.21.15.84:0/2835287538 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900cb470 con 0x7f45900b3610 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f458effd700 1 --2- 172.21.15.84:0/2835287538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 0x7f45900cbc70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f45840099b0 tx=0x7f4584009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab70787c1c3d6e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f458e7fc700 1 -- 172.21.15.84:0/2835287538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584009ea0 con 0x7f45900b3610 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f458e7fc700 1 -- 172.21.15.84:0/2835287538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458400b860 con 0x7f45900b3610 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f458e7fc700 1 -- 172.21.15.84:0/2835287538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458400bc00 con 0x7f45900b3610 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f4594835700 1 -- 172.21.15.84:0/2835287538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 msgr2=0x7f45900cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f4594835700 1 --2- 172.21.15.84:0/2835287538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 0x7f45900cbc70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f45840099b0 tx=0x7f4584009250 comp rx=0 tx=0).stop 2023-10-06T02:57:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f4594835700 1 -- 172.21.15.84:0/2835287538 shutdown_connections 2023-10-06T02:57:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f4594835700 1 --2- 172.21.15.84:0/2835287538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 0x7f45900b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f4594835700 1 --2- 172.21.15.84:0/2835287538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 0x7f45900cbc70 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f4594835700 1 -- 172.21.15.84:0/2835287538 >> 172.21.15.84:0/2835287538 conn(0x7f459006ed20 msgr2=0x7f459006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f4594835700 1 -- 172.21.15.84:0/2835287538 shutdown_connections 2023-10-06T02:57:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.250+0000 7f4594835700 1 -- 172.21.15.84:0/2835287538 wait complete. 2023-10-06T02:57:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.251+0000 7f4594835700 1 Processor -- start 2023-10-06T02:57:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f4594835700 1 -- start start 2023-10-06T02:57:10.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f4594835700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 0x7f45900d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f4594835700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45900cc1b0 0x7f45900c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f4594835700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 0x7f45900ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f4594835700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cf730 con 0x7f45900b3610 2023-10-06T02:57:10.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f4594835700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cee90 con 0x7f45900cc1b0 2023-10-06T02:57:10.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f4594835700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cf170 con 0x7f4590159480 2023-10-06T02:57:10.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f458f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 0x7f45900d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f458f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 0x7f45900d0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60584/0 (socket says 172.21.15.84:60584) 2023-10-06T02:57:10.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f458f7fe700 1 -- 172.21.15.84:0/1382187533 learned_addr learned my addr 172.21.15.84:0/1382187533 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f458ffff700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 0x7f45900ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.252+0000 7f458effd700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45900cc1b0 0x7f45900c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f458f7fe700 1 -- 172.21.15.84:0/1382187533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 msgr2=0x7f45900ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f458f7fe700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 0x7f45900ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f458f7fe700 1 -- 172.21.15.84:0/1382187533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45900cc1b0 msgr2=0x7f45900c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f458f7fe700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45900cc1b0 0x7f45900c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f458f7fe700 1 -- 172.21.15.84:0/1382187533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45840094f0 con 0x7f45900b3610 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f458f7fe700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 0x7f45900d0090 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4580009e50 tx=0x7f458000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f45777fe700 1 -- 172.21.15.84:0/1382187533 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000caa0 con 0x7f45900b3610 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f45777fe700 1 -- 172.21.15.84:0/1382187533 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458000f040 con 0x7f45900b3610 2023-10-06T02:57:10.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45900cf450 con 0x7f45900b3610 2023-10-06T02:57:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f45777fe700 1 -- 172.21.15.84:0/1382187533 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000ce30 con 0x7f45900b3610 2023-10-06T02:57:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.253+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45900d05d0 con 0x7f45900b3610 2023-10-06T02:57:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.254+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45900c7ea0 con 0x7f45900b3610 2023-10-06T02:57:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.254+0000 7f45777fe700 1 -- 172.21.15.84:0/1382187533 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4580014690 con 0x7f45900b3610 2023-10-06T02:57:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.255+0000 7f45777fe700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f457c066f30 0x7f457c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.255+0000 7f45777fe700 1 -- 172.21.15.84:0/1382187533 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f4580084fe0 con 0x7f45900b3610 2023-10-06T02:57:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.255+0000 7f458effd700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f457c066f30 0x7f457c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.255+0000 7f458effd700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f457c066f30 0x7f457c0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f45840099b0 tx=0x7f4584017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.259+0000 7f45777fe700 1 -- 172.21.15.84:0/1382187533 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4580051f70 con 0x7f45900b3610 2023-10-06T02:57:10.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.483+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f45900c8050 con 0x7f45900b3610 2023-10-06T02:57:10.484 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T02:57:10.483+0000 7fedbe922700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:57:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.489+0000 7f45777fe700 1 -- 172.21.15.84:0/1382187533 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4580055590 con 0x7f45900b3610 2023-10-06T02:57:10.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f457c066f30 msgr2=0x7f457c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f457c066f30 0x7f457c0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f45840099b0 tx=0x7f4584017000 comp rx=0 tx=0).stop 2023-10-06T02:57:10.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 msgr2=0x7f45900d0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 0x7f45900d0090 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4580009e50 tx=0x7f458000b040 comp rx=0 tx=0).stop 2023-10-06T02:57:10.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 shutdown_connections 2023-10-06T02:57:10.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f457c066f30 0x7f457c0693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4590159480 0x7f45900ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3610 0x7f45900d0090 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 --2- 172.21.15.84:0/1382187533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45900cc1b0 0x7f45900c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 >> 172.21.15.84:0/1382187533 conn(0x7f459006ed20 msgr2=0x7f45900680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 shutdown_connections 2023-10-06T02:57:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.491+0000 7f4594835700 1 -- 172.21.15.84:0/1382187533 wait complete. 2023-10-06T02:57:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:57:10.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:57:10.515 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T02:57:10.519 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T02:57:10.523 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T02:57:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.625+0000 7fe19b0d4700 1 Processor -- start 2023-10-06T02:57:10.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.625+0000 7fe19b0d4700 1 -- start start 2023-10-06T02:57:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.626+0000 7fe19b0d4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe19406a090 0x7fe19406b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.626+0000 7fe19b0d4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19415d170 con 0x7fe19406a460 2023-10-06T02:57:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.626+0000 7fe19b0d4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19415d3c0 con 0x7fe19415a5f0 2023-10-06T02:57:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.626+0000 7fe19b0d4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19415a9f0 con 0x7fe19406a090 2023-10-06T02:57:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.626+0000 7fe18bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe19406a460 0x7fe194159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54974/0 (socket says 172.21.15.84:54974) 2023-10-06T02:57:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.626+0000 7fe18bfff700 1 -- 172.21.15.84:0/632030812 learned_addr learned my addr 172.21.15.84:0/632030812 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe198e70700 1 --2- 172.21.15.84:0/632030812 >> v2:172.21.15.131:3300/0 conn(0x7fe19406a090 0x7fe19406b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356876634 0 0) 0x7fe19415d170 con 0x7fe19406a460 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe17c003570 con 0x7fe19406a460 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816654257 0 0) 0x7fe19415d3c0 con 0x7fe19415a5f0 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe19415d170 con 0x7fe19415a5f0 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1117211939 0 0) 0x7fe17c003570 con 0x7fe19406a460 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 >> v2:172.21.15.131:3300/0 conn(0x7fe19406a090 msgr2=0x7fe19406b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 --2- 172.21.15.84:0/632030812 >> v2:172.21.15.131:3300/0 conn(0x7fe19406a090 0x7fe19406b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 >> v1:172.21.15.131:6789/0 conn(0x7fe19415a5f0 legacy=0x7fe194068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19415d6a0 con 0x7fe19406a460 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fe184001470 con 0x7fe19406a460 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe198e70700 1 --2- 172.21.15.84:0/632030812 >> v2:172.21.15.131:3300/0 conn(0x7fe19406a090 0x7fe19406b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 >> v1:172.21.15.84:6789/0 conn(0x7fe19406a460 legacy=0x7fe194159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe17c003bf0 0x7fe17c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe17c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c005230 0x7fe17c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19415a9f0 con 0x7fe17c004810 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c00c200 con 0x7fe17c005230 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c00c3c0 con 0x7fe17c003bf0 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18bfff700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe17c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe198e70700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe17c003bf0 0x7fe17c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe199671700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c005230 0x7fe17c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18bfff700 1 -- 172.21.15.84:0/632030812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe17c003bf0 msgr2=0x7fe17c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:10.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18bfff700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe17c003bf0 0x7fe17c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18bfff700 1 -- 172.21.15.84:0/632030812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c005230 msgr2=0x7fe17c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18bfff700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe17c005230 0x7fe17c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe199671700 1 -- 172.21.15.84:0/632030812 reap_dead start 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.627+0000 7fe18bfff700 1 -- 172.21.15.84:0/632030812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c003570 con 0x7fe17c004810 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe18bfff700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe17c004c80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c2a0 tx=0x7fe184001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a77ca01530140dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400cb70 con 0x7fe17c004810 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18400ccf0 con 0x7fe17c004810 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe18b7fe700 1 -- 172.21.15.84:0/632030812 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184005b70 con 0x7fe17c004810 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe19b0d4700 1 -- 172.21.15.84:0/632030812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 msgr2=0x7fe17c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe19b0d4700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe17c004c80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c2a0 tx=0x7fe184001e10 comp rx=0 tx=0).stop 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe19b0d4700 1 -- 172.21.15.84:0/632030812 shutdown_connections 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe19b0d4700 1 --2- 172.21.15.84:0/632030812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe17c004c80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe19b0d4700 1 -- 172.21.15.84:0/632030812 >> 172.21.15.84:0/632030812 conn(0x7fe1940ce330 msgr2=0x7fe1940ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe19b0d4700 1 -- 172.21.15.84:0/632030812 shutdown_connections 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.628+0000 7fe19b0d4700 1 -- 172.21.15.84:0/632030812 wait complete. 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.629+0000 7fe19b0d4700 1 Processor -- start 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe19b0d4700 1 -- start start 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe19b0d4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe1941548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe19b0d4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1940c2ab0 0x7fe1941536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe19b0d4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe194153c00 0x7fe1941529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe19b0d4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19416a560 con 0x7fe17c004810 2023-10-06T02:57:10.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe19b0d4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe194157220 con 0x7fe1940c2ab0 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe19b0d4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe194157500 con 0x7fe194153c00 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe198e70700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe1941548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe198e70700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe1941548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60624/0 (socket says 172.21.15.84:60624) 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.630+0000 7fe198e70700 1 -- 172.21.15.84:0/2301313286 learned_addr learned my addr 172.21.15.84:0/2301313286 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe198e70700 1 -- 172.21.15.84:0/2301313286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe194153c00 msgr2=0x7fe1941529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe198e70700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe194153c00 0x7fe1941529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe198e70700 1 -- 172.21.15.84:0/2301313286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1940c2ab0 msgr2=0x7fe1941536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe198e70700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1940c2ab0 0x7fe1941536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe198e70700 1 -- 172.21.15.84:0/2301313286 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1941577e0 con 0x7fe17c004810 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe198e70700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe1941548e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe19000f2b0 tx=0x7fe19000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:10.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe188ff9700 1 -- 172.21.15.84:0/2301313286 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000e040 con 0x7fe17c004810 2023-10-06T02:57:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe188ff9700 1 -- 172.21.15.84:0/2301313286 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000f040 con 0x7fe17c004810 2023-10-06T02:57:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe194157ac0 con 0x7fe17c004810 2023-10-06T02:57:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe188ff9700 1 -- 172.21.15.84:0/2301313286 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190015660 con 0x7fe17c004810 2023-10-06T02:57:10.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.631+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19416a1c0 con 0x7fe17c004810 2023-10-06T02:57:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.632+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe194157cb0 con 0x7fe17c004810 2023-10-06T02:57:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.632+0000 7fe188ff9700 1 -- 172.21.15.84:0/2301313286 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe190015a50 con 0x7fe17c004810 2023-10-06T02:57:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.633+0000 7fe188ff9700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe180066f30 0x7fe1800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.633+0000 7fe188ff9700 1 -- 172.21.15.84:0/2301313286 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6694+0+0 (secure 0 0 0) 0x7fe1900857b0 con 0x7fe17c004810 2023-10-06T02:57:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.633+0000 7fe18bfff700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe180066f30 0x7fe1800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.633+0000 7fe18bfff700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe180066f30 0x7fe1800693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe19416cca0 tx=0x7fe184015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:10.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.637+0000 7fe188ff9700 1 -- 172.21.15.84:0/2301313286 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe190052640 con 0x7fe17c004810 2023-10-06T02:57:10.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:10.863+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe19416a6a0 con 0x7fe17c004810 2023-10-06T02:57:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.487+0000 7fe188ff9700 1 -- 172.21.15.84:0/2301313286 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe190055c60 con 0x7fe17c004810 2023-10-06T02:57:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe180066f30 msgr2=0x7fe1800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe180066f30 0x7fe1800693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe19416cca0 tx=0x7fe184015000 comp rx=0 tx=0).stop 2023-10-06T02:57:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 msgr2=0x7fe1941548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe1941548e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe19000f2b0 tx=0x7fe19000b040 comp rx=0 tx=0).stop 2023-10-06T02:57:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 shutdown_connections 2023-10-06T02:57:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe180066f30 0x7fe1800693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe194153c00 0x7fe1941529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe17c004810 0x7fe1941548e0 secure :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe19000f2b0 tx=0x7fe19000b040 comp rx=0 tx=0).stop 2023-10-06T02:57:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 --2- 172.21.15.84:0/2301313286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1940c2ab0 0x7fe1941536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 >> 172.21.15.84:0/2301313286 conn(0x7fe1940ce330 msgr2=0x7fe1941568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 shutdown_connections 2023-10-06T02:57:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.490+0000 7fe19b0d4700 1 -- 172.21.15.84:0/2301313286 wait complete. 2023-10-06T02:57:11.503 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:57:11.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.661+0000 7efbfffff700 1 Processor -- start 2023-10-06T02:57:11.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.661+0000 7efbfffff700 1 -- start start 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.662+0000 7efbfffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc001539d0 0x7efc0015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.662+0000 7efbfffff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efc000d0a00 0x7efc000ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.662+0000 7efbfffff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000cdc30 con 0x7efc000ccab0 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.662+0000 7efbfffff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000cb500 con 0x7efc000d0a00 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.662+0000 7efbfffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0015a8f0 con 0x7efc001539d0 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.662+0000 7efbff7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efc000d0a00 0x7efc000ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.662+0000 7efbfeffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc001539d0 0x7efc0015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.662+0000 7efbf67fc700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7efc000ccab0 0x7efc000d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:46338/0 (socket says 172.21.15.84:46338) 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.662+0000 7efbf67fc700 1 -- 172.21.15.84:0/1680751521 learned_addr learned my addr 172.21.15.84:0/1680751521 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.663+0000 7efbfeffd700 1 -- 172.21.15.84:0/1680751521 >> v2:172.21.15.131:3300/0 conn(0x7efc000d0a00 msgr2=0x7efc000ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:11.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.663+0000 7efbfeffd700 1 --2- 172.21.15.84:0/1680751521 >> v2:172.21.15.131:3300/0 conn(0x7efc000d0a00 0x7efc000ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.663+0000 7efbfeffd700 1 -- 172.21.15.84:0/1680751521 >> v1:172.21.15.131:6789/0 conn(0x7efc000ccab0 legacy=0x7efc000d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.663+0000 7efbfeffd700 1 -- 172.21.15.84:0/1680751521 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000cd020 con 0x7efc001539d0 2023-10-06T02:57:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.663+0000 7efbff7fe700 1 --2- 172.21.15.84:0/1680751521 >> v2:172.21.15.131:3300/0 conn(0x7efc000d0a00 0x7efc000ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.663+0000 7efbfeffd700 1 --2- 172.21.15.84:0/1680751521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc001539d0 0x7efc0015a3b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efbf00098e0 tx=0x7efbf00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6b442584e29be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.663+0000 7efbfe7fc700 1 -- 172.21.15.84:0/1680751521 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000b640 con 0x7efc001539d0 2023-10-06T02:57:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.663+0000 7efbfe7fc700 1 -- 172.21.15.84:0/1680751521 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf000b7a0 con 0x7efc001539d0 2023-10-06T02:57:11.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.663+0000 7efbfe7fc700 1 -- 172.21.15.84:0/1680751521 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000bb40 con 0x7efc001539d0 2023-10-06T02:57:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.664+0000 7efbfffff700 1 -- 172.21.15.84:0/1680751521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc001539d0 msgr2=0x7efc0015a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.664+0000 7efbfffff700 1 --2- 172.21.15.84:0/1680751521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc001539d0 0x7efc0015a3b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efbf00098e0 tx=0x7efbf00091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.664+0000 7efbfffff700 1 -- 172.21.15.84:0/1680751521 shutdown_connections 2023-10-06T02:57:11.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.664+0000 7efbfffff700 1 --2- 172.21.15.84:0/1680751521 >> v2:172.21.15.131:3300/0 conn(0x7efc000d0a00 0x7efc000ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.664+0000 7efbfffff700 1 --2- 172.21.15.84:0/1680751521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc001539d0 0x7efc0015a3b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.664+0000 7efbfffff700 1 -- 172.21.15.84:0/1680751521 >> 172.21.15.84:0/1680751521 conn(0x7efc00068100 msgr2=0x7efc000684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.664+0000 7efbfffff700 1 -- 172.21.15.84:0/1680751521 shutdown_connections 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.664+0000 7efbfffff700 1 -- 172.21.15.84:0/1680751521 wait complete. 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.665+0000 7efbfffff700 1 Processor -- start 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.665+0000 7efbfffff700 1 -- start start 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc000ccab0 0x7efc00151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc000d0a00 0x7efc000b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc001539d0 0x7efc000b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000b4e40 con 0x7efc000ccab0 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c76f0 con 0x7efc001539d0 2023-10-06T02:57:11.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000b4230 con 0x7efc000d0a00 2023-10-06T02:57:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc000ccab0 0x7efc00151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc000ccab0 0x7efc00151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60638/0 (socket says 172.21.15.84:60638) 2023-10-06T02:57:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfeffd700 1 -- 172.21.15.84:0/1348540194 learned_addr learned my addr 172.21.15.84:0/1348540194 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbff7fe700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc001539d0 0x7efc000b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbf67fc700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc000d0a00 0x7efc000b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfeffd700 1 -- 172.21.15.84:0/1348540194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc000d0a00 msgr2=0x7efc000b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfeffd700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc000d0a00 0x7efc000b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfeffd700 1 -- 172.21.15.84:0/1348540194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc001539d0 msgr2=0x7efc000b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfeffd700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc001539d0 0x7efc000b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfeffd700 1 -- 172.21.15.84:0/1348540194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8009a20 con 0x7efc000ccab0 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfeffd700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc000ccab0 0x7efc00151690 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efbf000a010 tx=0x7efbf0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbf77fe700 1 -- 172.21.15.84:0/1348540194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf001f070 con 0x7efc000ccab0 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbf77fe700 1 -- 172.21.15.84:0/1348540194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf001aab0 con 0x7efc000ccab0 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbf77fe700 1 -- 172.21.15.84:0/1348540194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf001ae50 con 0x7efc000ccab0 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf0009420 con 0x7efc000ccab0 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.666+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc000b47f0 con 0x7efc000ccab0 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.667+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0005f270 con 0x7efc000ccab0 2023-10-06T02:57:11.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.668+0000 7efbf77fe700 1 -- 172.21.15.84:0/1348540194 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efbf0023070 con 0x7efc000ccab0 2023-10-06T02:57:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.668+0000 7efbf77fe700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efbe0066f30 0x7efbe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.668+0000 7efbf77fe700 1 -- 172.21.15.84:0/1348540194 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6694+0+0 (secure 0 0 0) 0x7efbf0085970 con 0x7efc000ccab0 2023-10-06T02:57:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.668+0000 7efbf67fc700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efbe0066f30 0x7efbe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:11.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.669+0000 7efbf67fc700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efbe0066f30 0x7efbe00693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efc00156700 tx=0x7efbe8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:11.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.672+0000 7efbf77fe700 1 -- 172.21.15.84:0/1348540194 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efbf0052800 con 0x7efc000ccab0 2023-10-06T02:57:11.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:11.855+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc000cd300 con 0x7efc000ccab0 2023-10-06T02:57:12.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.496+0000 7efbf77fe700 1 -- 172.21.15.84:0/1348540194 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7efbf002a020 con 0x7efc000ccab0 2023-10-06T02:57:12.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efbe0066f30 msgr2=0x7efbe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efbe0066f30 0x7efbe00693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efc00156700 tx=0x7efbe8009040 comp rx=0 tx=0).stop 2023-10-06T02:57:12.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc000ccab0 msgr2=0x7efc00151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc000ccab0 0x7efc00151690 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efbf000a010 tx=0x7efbf0017000 comp rx=0 tx=0).stop 2023-10-06T02:57:12.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 shutdown_connections 2023-10-06T02:57:12.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efbe0066f30 0x7efbe00693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc001539d0 0x7efc000b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc000ccab0 0x7efc00151690 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 --2- 172.21.15.84:0/1348540194 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc000d0a00 0x7efc000b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 >> 172.21.15.84:0/1348540194 conn(0x7efc00068100 msgr2=0x7efc00153090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:12.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 shutdown_connections 2023-10-06T02:57:12.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.498+0000 7efbfffff700 1 -- 172.21.15.84:0/1348540194 wait complete. 2023-10-06T02:57:12.500 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:57:12.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:57:12.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.635+0000 7f3ed4d7c700 1 Processor -- start 2023-10-06T02:57:12.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.635+0000 7f3ed4d7c700 1 -- start start 2023-10-06T02:57:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ed4d7c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ed0156f90 0x7f3ed00cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ed4d7c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed006d610 0x7f3ed00b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ed4d7c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00cd5b0 con 0x7f3ed0157360 2023-10-06T02:57:12.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ed4d7c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed00cd120 con 0x7f3ed0156f90 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ed4d7c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00cc510 con 0x7f3ed006d610 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ecf7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ed0156f90 0x7f3ed00cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3eceffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3ed0157360 0x7f3ed006cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41894/0 (socket says 172.21.15.84:41894) 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3eceffd700 1 -- 172.21.15.84:0/3729308939 learned_addr learned my addr 172.21.15.84:0/3729308939 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ecf7fe700 1 -- 172.21.15.84:0/3729308939 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed006d610 msgr2=0x7f3ed00b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ecf7fe700 1 --2- 172.21.15.84:0/3729308939 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed006d610 0x7f3ed00b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ecf7fe700 1 -- 172.21.15.84:0/3729308939 >> v1:172.21.15.84:6789/0 conn(0x7f3ed0157360 legacy=0x7f3ed006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ecf7fe700 1 -- 172.21.15.84:0/3729308939 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00cc7f0 con 0x7f3ed0156f90 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ece7fc700 1 -- 172.21.15.84:0/3729308939 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503437548 0 0) 0x7f3ec4001110 con 0x7f3ed0157360 2023-10-06T02:57:12.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ecf7fe700 1 --2- 172.21.15.84:0/3729308939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0156f90 0x7f3ed00cbe30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009e60 tx=0x7f3ec0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e61cb2b533c5de4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.636+0000 7f3ece7fc700 1 -- 172.21.15.84:0/3729308939 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000e070 con 0x7f3ed0156f90 2023-10-06T02:57:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ece7fc700 1 -- 172.21.15.84:0/3729308939 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec000bc30 con 0x7f3ed0156f90 2023-10-06T02:57:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ece7fc700 1 -- 172.21.15.84:0/3729308939 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0012430 con 0x7f3ed0156f90 2023-10-06T02:57:12.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/3729308939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0156f90 msgr2=0x7f3ed00cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ed4d7c700 1 --2- 172.21.15.84:0/3729308939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0156f90 0x7f3ed00cbe30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009e60 tx=0x7f3ec0009780 comp rx=0 tx=0).stop 2023-10-06T02:57:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/3729308939 shutdown_connections 2023-10-06T02:57:12.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ed4d7c700 1 --2- 172.21.15.84:0/3729308939 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed006d610 0x7f3ed00b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ed4d7c700 1 --2- 172.21.15.84:0/3729308939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0156f90 0x7f3ed00cbe30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/3729308939 >> 172.21.15.84:0/3729308939 conn(0x7f3ed00675f0 msgr2=0x7f3ed00679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/3729308939 shutdown_connections 2023-10-06T02:57:12.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.637+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/3729308939 wait complete. 2023-10-06T02:57:12.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.638+0000 7f3ed4d7c700 1 Processor -- start 2023-10-06T02:57:12.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.638+0000 7f3ed4d7c700 1 -- start start 2023-10-06T02:57:12.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ed4d7c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed006d610 0x7f3ed016af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ed4d7c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ed0156f90 0x7f3ed0145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ed4d7c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0157360 0x7f3ed0166f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ed4d7c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00c3c90 con 0x7f3ed0157360 2023-10-06T02:57:12.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ed4d7c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed016b490 con 0x7f3ed0156f90 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ed4d7c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00c3080 con 0x7f3ed006d610 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0157360 0x7f3ed0166f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0157360 0x7f3ed0166f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38818/0 (socket says 172.21.15.84:38818) 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ecffff700 1 -- 172.21.15.84:0/2948645245 learned_addr learned my addr 172.21.15.84:0/2948645245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ecf7fe700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed006d610 0x7f3ed016af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3eceffd700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ed0156f90 0x7f3ed0145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ecffff700 1 -- 172.21.15.84:0/2948645245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed006d610 msgr2=0x7f3ed016af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ecffff700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed006d610 0x7f3ed016af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ecffff700 1 -- 172.21.15.84:0/2948645245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ed0156f90 msgr2=0x7f3ed0145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.639+0000 7f3ecffff700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ed0156f90 0x7f3ed0145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.640+0000 7f3ecffff700 1 -- 172.21.15.84:0/2948645245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009a20 con 0x7f3ed0157360 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.640+0000 7f3ecffff700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0157360 0x7f3ed0166f90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800b600 tx=0x7f3ec80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.640+0000 7f3eb77fe700 1 -- 172.21.15.84:0/2948645245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800f510 con 0x7f3ed0157360 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.640+0000 7f3eb77fe700 1 -- 172.21.15.84:0/2948645245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec800f690 con 0x7f3ed0157360 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.640+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed00c3360 con 0x7f3ed0157360 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.640+0000 7f3eb77fe700 1 -- 172.21.15.84:0/2948645245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800fa50 con 0x7f3ed0157360 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.640+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed00c3920 con 0x7f3ed0157360 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.641+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed005f270 con 0x7f3ed0157360 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.641+0000 7f3eb77fe700 1 -- 172.21.15.84:0/2948645245 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ec801a400 con 0x7f3ed0157360 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.641+0000 7f3eb77fe700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ebc066f30 0x7f3ebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.641+0000 7f3eb77fe700 1 -- 172.21.15.84:0/2948645245 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6256+0+0 (secure 0 0 0) 0x7f3ec8084310 con 0x7f3ed0157360 2023-10-06T02:57:12.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.642+0000 7f3ecf7fe700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ebc066f30 0x7f3ebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:12.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.642+0000 7f3ecf7fe700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ebc066f30 0x7f3ebc0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009e60 tx=0x7f3ec0019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:12.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.646+0000 7f3eb77fe700 1 -- 172.21.15.84:0/2948645245 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ec80513e0 con 0x7f3ed0157360 2023-10-06T02:57:12.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:12.828+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ed00c3dd0 con 0x7f3ed0157360 2023-10-06T02:57:13.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.498+0000 7f3eb77fe700 1 -- 172.21.15.84:0/2948645245 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3ec8054a00 con 0x7f3ed0157360 2023-10-06T02:57:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ebc066f30 msgr2=0x7f3ebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ebc066f30 0x7f3ebc0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009e60 tx=0x7f3ec0019000 comp rx=0 tx=0).stop 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0157360 msgr2=0x7f3ed0166f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0157360 0x7f3ed0166f90 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800b600 tx=0x7f3ec80091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 shutdown_connections 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ebc066f30 0x7f3ebc0693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed0157360 0x7f3ed0166f90 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed006d610 0x7f3ed016af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 --2- 172.21.15.84:0/2948645245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ed0156f90 0x7f3ed0145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 >> 172.21.15.84:0/2948645245 conn(0x7f3ed00675f0 msgr2=0x7f3ed01561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 shutdown_connections 2023-10-06T02:57:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.502+0000 7f3ed4d7c700 1 -- 172.21.15.84:0/2948645245 wait complete. 2023-10-06T02:57:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T02:57:13.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:57:13.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.632+0000 7fc543fff700 1 Processor -- start 2023-10-06T02:57:13.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.632+0000 7fc543fff700 1 -- start start 2023-10-06T02:57:13.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc543fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc544156130 0x7fc544159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc543fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc54406e1a0 0x7fc54406e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc543fff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54406eb40 con 0x7fc5440ae0f0 2023-10-06T02:57:13.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc543fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5440acb10 con 0x7fc54406e1a0 2023-10-06T02:57:13.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc543fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc544156500 con 0x7fc544156130 2023-10-06T02:57:13.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc5437fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc54406e1a0 0x7fc54406e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc5437fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc54406e1a0 0x7fc54406e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38822/0 (socket says 172.21.15.84:38822) 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc5437fe700 1 -- 172.21.15.84:0/3783725023 learned_addr learned my addr 172.21.15.84:0/3783725023 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc5437fe700 1 -- 172.21.15.84:0/3783725023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc544156130 msgr2=0x7fc544159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc542ffd700 1 --2- 172.21.15.84:0/3783725023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc544156130 0x7fc544159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc5437fe700 1 --2- 172.21.15.84:0/3783725023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc544156130 0x7fc544159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc5437fe700 1 -- 172.21.15.84:0/3783725023 >> v1:172.21.15.131:6789/0 conn(0x7fc5440ae0f0 legacy=0x7fc5440c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc5437fe700 1 -- 172.21.15.84:0/3783725023 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54415a310 con 0x7fc54406e1a0 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc5437fe700 1 --2- 172.21.15.84:0/3783725023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc54406e1a0 0x7fc54406e600 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009f20 tx=0x7fc53c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becbf5df05c94202 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc541ffb700 1 -- 172.21.15.84:0/3783725023 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00e070 con 0x7fc54406e1a0 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc541ffb700 1 -- 172.21.15.84:0/3783725023 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c00ba40 con 0x7fc54406e1a0 2023-10-06T02:57:13.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.633+0000 7fc541ffb700 1 -- 172.21.15.84:0/3783725023 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0092e0 con 0x7fc54406e1a0 2023-10-06T02:57:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.634+0000 7fc543fff700 1 -- 172.21.15.84:0/3783725023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc54406e1a0 msgr2=0x7fc54406e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.634+0000 7fc543fff700 1 --2- 172.21.15.84:0/3783725023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc54406e1a0 0x7fc54406e600 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009f20 tx=0x7fc53c009840 comp rx=0 tx=0).stop 2023-10-06T02:57:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.634+0000 7fc543fff700 1 -- 172.21.15.84:0/3783725023 shutdown_connections 2023-10-06T02:57:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.634+0000 7fc543fff700 1 --2- 172.21.15.84:0/3783725023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc54406e1a0 0x7fc54406e600 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.634+0000 7fc543fff700 1 --2- 172.21.15.84:0/3783725023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc544156130 0x7fc544159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.634+0000 7fc543fff700 1 -- 172.21.15.84:0/3783725023 >> 172.21.15.84:0/3783725023 conn(0x7fc5440cbf10 msgr2=0x7fc5440cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.634+0000 7fc543fff700 1 -- 172.21.15.84:0/3783725023 shutdown_connections 2023-10-06T02:57:13.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.634+0000 7fc543fff700 1 -- 172.21.15.84:0/3783725023 wait complete. 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.635+0000 7fc543fff700 1 Processor -- start 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.635+0000 7fc543fff700 1 -- start start 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc543fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc54406e1a0 0x7fc5440cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc543fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5440ae0f0 0x7fc54414e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc543fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544156130 0x7fc544158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc543fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc544157040 con 0x7fc544156130 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc543fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5441572b0 con 0x7fc54406e1a0 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc543fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc544157590 con 0x7fc5440ae0f0 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc5437fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544156130 0x7fc544158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc5437fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544156130 0x7fc544158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38830/0 (socket says 172.21.15.84:38830) 2023-10-06T02:57:13.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc5437fe700 1 -- 172.21.15.84:0/1936248105 learned_addr learned my addr 172.21.15.84:0/1936248105 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc542ffd700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc54406e1a0 0x7fc5440cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc5437fe700 1 -- 172.21.15.84:0/1936248105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5440ae0f0 msgr2=0x7fc54414e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc5427fc700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5440ae0f0 0x7fc54414e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc5437fe700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5440ae0f0 0x7fc54414e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc5437fe700 1 -- 172.21.15.84:0/1936248105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc54406e1a0 msgr2=0x7fc5440cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc5437fe700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc54406e1a0 0x7fc5440cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.636+0000 7fc5437fe700 1 -- 172.21.15.84:0/1936248105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c009ae0 con 0x7fc544156130 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.637+0000 7fc5437fe700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544156130 0x7fc544158690 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc54406cdf0 tx=0x7fc53c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.637+0000 7fc52affd700 1 -- 172.21.15.84:0/1936248105 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0032f0 con 0x7fc544156130 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.637+0000 7fc52affd700 1 -- 172.21.15.84:0/1936248105 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c012e60 con 0x7fc544156130 2023-10-06T02:57:13.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.637+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc544157870 con 0x7fc544156130 2023-10-06T02:57:13.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.637+0000 7fc52affd700 1 -- 172.21.15.84:0/1936248105 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c01d670 con 0x7fc544156130 2023-10-06T02:57:13.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.637+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc544157e30 con 0x7fc544156130 2023-10-06T02:57:13.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.638+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5440c89c0 con 0x7fc544156130 2023-10-06T02:57:13.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.638+0000 7fc52affd700 1 -- 172.21.15.84:0/1936248105 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc53c01daa0 con 0x7fc544156130 2023-10-06T02:57:13.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.638+0000 7fc52affd700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc530066f30 0x7fc5300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.639+0000 7fc542ffd700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc530066f30 0x7fc5300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.639+0000 7fc52affd700 1 -- 172.21.15.84:0/1936248105 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fc53c085e00 con 0x7fc544156130 2023-10-06T02:57:13.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.639+0000 7fc542ffd700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc530066f30 0x7fc5300693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc534006fd0 tx=0x7fc534008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:13.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.643+0000 7fc52affd700 1 -- 172.21.15.84:0/1936248105 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc53c053020 con 0x7fc544156130 2023-10-06T02:57:13.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.825+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc54406eb40 con 0x7fc544156130 2023-10-06T02:57:13.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.828+0000 7fc52affd700 1 -- 172.21.15.84:0/1936248105 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc54406eb40 con 0x7fc544156130 2023-10-06T02:57:13.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc530066f30 msgr2=0x7fc5300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc530066f30 0x7fc5300693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc534006fd0 tx=0x7fc534008040 comp rx=0 tx=0).stop 2023-10-06T02:57:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544156130 msgr2=0x7fc544158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544156130 0x7fc544158690 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc54406cdf0 tx=0x7fc53c017000 comp rx=0 tx=0).stop 2023-10-06T02:57:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 shutdown_connections 2023-10-06T02:57:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc530066f30 0x7fc5300693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc54406e1a0 0x7fc5440cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc544156130 0x7fc544158690 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 --2- 172.21.15.84:0/1936248105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5440ae0f0 0x7fc54414e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 >> 172.21.15.84:0/1936248105 conn(0x7fc5440cbf10 msgr2=0x7fc5440aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:13.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 shutdown_connections 2023-10-06T02:57:13.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.831+0000 7fc543fff700 1 -- 172.21.15.84:0/1936248105 wait complete. 2023-10-06T02:57:13.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2023-10-06T02:57:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.956+0000 7f9afc7f3700 1 Processor -- start 2023-10-06T02:57:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.956+0000 7f9afc7f3700 1 -- start start 2023-10-06T02:57:13.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.957+0000 7f9afc7f3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9af41595c0 0x7f9af406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.957+0000 7f9afc7f3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af4067d00 0x7f9af40b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.957+0000 7f9afc7f3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40cde70 con 0x7f9af406e9e0 2023-10-06T02:57:13.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.957+0000 7f9afc7f3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af406ef60 con 0x7f9af41595c0 2023-10-06T02:57:13.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.957+0000 7f9afc7f3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af406f240 con 0x7f9af4067d00 2023-10-06T02:57:13.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.957+0000 7f9af9d8e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9af406e9e0 0x7f9af40675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41902/0 (socket says 172.21.15.84:41902) 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.957+0000 7f9af9d8e700 1 -- 172.21.15.84:0/3561280901 learned_addr learned my addr 172.21.15.84:0/3561280901 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9afad90700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af4067d00 0x7f9af40b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9afa58f700 1 --2- 172.21.15.84:0/3561280901 >> v2:172.21.15.131:3300/0 conn(0x7f9af41595c0 0x7f9af406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692509157 0 0) 0x7f9af40cde70 con 0x7f9af406e9e0 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae0003570 con 0x7f9af406e9e0 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308515373 0 0) 0x7f9ae0003570 con 0x7f9af406e9e0 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af4067d00 msgr2=0x7f9af40b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af4067d00 0x7f9af40b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 >> v2:172.21.15.131:3300/0 conn(0x7f9af41595c0 msgr2=0x7f9af406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 --2- 172.21.15.84:0/3561280901 >> v2:172.21.15.131:3300/0 conn(0x7f9af41595c0 0x7f9af406e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40b0190 con 0x7f9af406e9e0 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f9ae4001470 con 0x7f9af406e9e0 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 >> v1:172.21.15.84:6789/0 conn(0x7f9af406e9e0 legacy=0x7f9af40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae0003a60 0x7f9ae0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af4067d00 0x7f9ae0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0004d50 0x7f9ae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af406ef60 con 0x7f9ae0003a60 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af406f240 con 0x7f9ae0004d50 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae000ba60 con 0x7f9af4067d00 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9afa58f700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae0003a60 0x7f9ae0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9af9d8e700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af4067d00 0x7f9ae0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9afad90700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0004d50 0x7f9ae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9afa58f700 1 -- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af4067d00 msgr2=0x7f9ae0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9afa58f700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af4067d00 0x7f9ae0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9afa58f700 1 -- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0004d50 msgr2=0x7f9ae00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9afa58f700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0004d50 0x7f9ae00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.958+0000 7f9afa58f700 1 -- 172.21.15.84:0/3561280901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae0003570 con 0x7f9ae0003a60 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9afa58f700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae0003a60 0x7f9ae0003e70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9af000e210 tx=0x7f9af000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c8bcaae2926581 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000ea60 con 0x7f9ae0003a60 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af000f040 con 0x7f9ae0003a60 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9af958d700 1 -- 172.21.15.84:0/3561280901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000ee10 con 0x7f9ae0003a60 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9afc7f3700 1 -- 172.21.15.84:0/3561280901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae0003a60 msgr2=0x7f9ae0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9afc7f3700 1 --2- 172.21.15.84:0/3561280901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae0003a60 0x7f9ae0003e70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9af000e210 tx=0x7f9af000b040 comp rx=0 tx=0).stop 2023-10-06T02:57:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9afad90700 1 -- 172.21.15.84:0/3561280901 reap_dead start 2023-10-06T02:57:13.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9afc7f3700 1 -- 172.21.15.84:0/3561280901 shutdown_connections 2023-10-06T02:57:13.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9afc7f3700 1 -- 172.21.15.84:0/3561280901 >> 172.21.15.84:0/3561280901 conn(0x7f9af4069180 msgr2=0x7f9af40cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:13.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9afc7f3700 1 -- 172.21.15.84:0/3561280901 shutdown_connections 2023-10-06T02:57:13.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.959+0000 7f9afc7f3700 1 -- 172.21.15.84:0/3561280901 wait complete. 2023-10-06T02:57:13.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afc7f3700 1 Processor -- start 2023-10-06T02:57:13.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afc7f3700 1 -- start start 2023-10-06T02:57:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afc7f3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0003a60 0x7f9af40c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afc7f3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af40c6b70 0x7f9af40af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afc7f3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9af40ac4b0 0x7f9af414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afc7f3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40af760 con 0x7f9af40ac4b0 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afc7f3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40c5ad0 con 0x7f9ae0003a60 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afc7f3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40c5db0 con 0x7f9af40c6b70 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afad90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9af40ac4b0 0x7f9af414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afad90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9af40ac4b0 0x7f9af414a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38844/0 (socket says 172.21.15.84:38844) 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afad90700 1 -- 172.21.15.84:0/1298587542 learned_addr learned my addr 172.21.15.84:0/1298587542 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9af9d8e700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af40c6b70 0x7f9af40af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.961+0000 7f9afa58f700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0003a60 0x7f9af40c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9afad90700 1 -- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af40c6b70 msgr2=0x7f9af40af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9afad90700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af40c6b70 0x7f9af40af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9afad90700 1 -- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0003a60 msgr2=0x7f9af40c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9afad90700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0003a60 0x7f9af40c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9afad90700 1 -- 172.21.15.84:0/1298587542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40c6090 con 0x7f9af40ac4b0 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9af9d8e700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af40c6b70 0x7f9af40af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9afa58f700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0003a60 0x7f9af40c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9afad90700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9af40ac4b0 0x7f9af414a280 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9af40765f0 tx=0x7f9aec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9aea7fc700 1 -- 172.21.15.84:0/1298587542 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec015670 con 0x7f9af40ac4b0 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9aea7fc700 1 -- 172.21.15.84:0/1298587542 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec0157f0 con 0x7f9af40ac4b0 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af40c6370 con 0x7f9af40ac4b0 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9aea7fc700 1 -- 172.21.15.84:0/1298587542 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec015bb0 con 0x7f9af40ac4b0 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.962+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af40ac900 con 0x7f9af40ac4b0 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.963+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af40c6890 con 0x7f9af40ac4b0 2023-10-06T02:57:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.963+0000 7f9aea7fc700 1 -- 172.21.15.84:0/1298587542 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9aec01e400 con 0x7f9af40ac4b0 2023-10-06T02:57:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.964+0000 7f9aea7fc700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ad8066f00 0x7f9ad80693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.964+0000 7f9afa58f700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ad8066f00 0x7f9ad80693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.964+0000 7f9aea7fc700 1 -- 172.21.15.84:0/1298587542 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f9aec084c50 con 0x7f9af40ac4b0 2023-10-06T02:57:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.964+0000 7f9afa58f700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ad8066f00 0x7f9ad80693b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9af000afd0 tx=0x7f9af001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:13.970+0000 7f9aea7fc700 1 -- 172.21.15.84:0/1298587542 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9af40c6890 con 0x7f9af40ac4b0 2023-10-06T02:57:14.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.231+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) v1 -- 0x7f9af40c6890 con 0x7f9af40ac4b0 2023-10-06T02:57:14.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.497+0000 7f9aea7fc700 1 -- 172.21.15.84:0/1298587542 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v126) v1 ==== 136+0+0 (secure 0 0 0) 0x7f9af40c6890 con 0x7f9af40ac4b0 2023-10-06T02:57:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ad8066f00 msgr2=0x7f9ad80693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ad8066f00 0x7f9ad80693b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9af000afd0 tx=0x7f9af001a000 comp rx=0 tx=0).stop 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9af40ac4b0 msgr2=0x7f9af414a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9af40ac4b0 0x7f9af414a280 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9af40765f0 tx=0x7f9aec008040 comp rx=0 tx=0).stop 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 shutdown_connections 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ad8066f00 0x7f9ad80693b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ae0003a60 0x7f9af40c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9af40ac4b0 0x7f9af414a280 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 --2- 172.21.15.84:0/1298587542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9af40c6b70 0x7f9af40af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 >> 172.21.15.84:0/1298587542 conn(0x7f9af4069180 msgr2=0x7f9af40c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 shutdown_connections 2023-10-06T02:57:14.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.500+0000 7f9afc7f3700 1 -- 172.21.15.84:0/1298587542 wait complete. 2023-10-06T02:57:14.512 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-10-06T02:57:14.513 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-10-06T02:57:14.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2023-10-06T02:57:14.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.626+0000 7f0fb264d700 1 Processor -- start 2023-10-06T02:57:14.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.626+0000 7f0fb264d700 1 -- start start 2023-10-06T02:57:14.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.627+0000 7f0fb264d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0fac0b49e0 0x7f0fac0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.627+0000 7f0fb264d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0fac0b07a0 0x7f0fac0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.627+0000 7f0fb264d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac0b0ca0 con 0x7f0fac1595a0 2023-10-06T02:57:14.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.627+0000 7f0fb264d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac0b0f80 con 0x7f0fac0b07a0 2023-10-06T02:57:14.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.627+0000 7f0fb264d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac0b1260 con 0x7f0fac0b49e0 2023-10-06T02:57:14.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.627+0000 7f0fb0bea700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0fac0b07a0 0x7f0fac0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.627+0000 7f0fabfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0fac1595a0 0x7f0fac0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41906/0 (socket says 172.21.15.84:41906) 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.627+0000 7f0fabfff700 1 -- 172.21.15.84:0/2629126491 learned_addr learned my addr 172.21.15.84:0/2629126491 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fab7fe700 1 --2- 172.21.15.84:0/2629126491 >> v2:172.21.15.131:3300/0 conn(0x7f0fac0b49e0 0x7f0fac0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb0bea700 1 -- 172.21.15.84:0/2629126491 >> v2:172.21.15.131:3300/0 conn(0x7f0fac0b49e0 msgr2=0x7f0fac0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb0bea700 1 --2- 172.21.15.84:0/2629126491 >> v2:172.21.15.131:3300/0 conn(0x7f0fac0b49e0 0x7f0fac0aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb0bea700 1 -- 172.21.15.84:0/2629126491 >> v1:172.21.15.84:6789/0 conn(0x7f0fac1595a0 legacy=0x7f0fac0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb0bea700 1 -- 172.21.15.84:0/2629126491 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0b1540 con 0x7f0fac0b07a0 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0faaffd700 1 -- 172.21.15.84:0/2629126491 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922330161 0 0) 0x7f0fac0b0ca0 con 0x7f0fac1595a0 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fab7fe700 1 --2- 172.21.15.84:0/2629126491 >> v2:172.21.15.131:3300/0 conn(0x7f0fac0b49e0 0x7f0fac0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb0bea700 1 --2- 172.21.15.84:0/2629126491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b07a0 0x7f0fac0b1c00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009e60 tx=0x7f0fa4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85c1dac6dd2a3a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0faaffd700 1 -- 172.21.15.84:0/2629126491 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400e070 con 0x7f0fac0b07a0 2023-10-06T02:57:14.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0faaffd700 1 -- 172.21.15.84:0/2629126491 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400bbf0 con 0x7f0fac0b07a0 2023-10-06T02:57:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0faaffd700 1 -- 172.21.15.84:0/2629126491 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4012430 con 0x7f0fac0b07a0 2023-10-06T02:57:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb264d700 1 -- 172.21.15.84:0/2629126491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b07a0 msgr2=0x7f0fac0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb264d700 1 --2- 172.21.15.84:0/2629126491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b07a0 0x7f0fac0b1c00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009e60 tx=0x7f0fa4009780 comp rx=0 tx=0).stop 2023-10-06T02:57:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb264d700 1 -- 172.21.15.84:0/2629126491 shutdown_connections 2023-10-06T02:57:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb264d700 1 --2- 172.21.15.84:0/2629126491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b07a0 0x7f0fac0b1c00 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb264d700 1 --2- 172.21.15.84:0/2629126491 >> v2:172.21.15.131:3300/0 conn(0x7f0fac0b49e0 0x7f0fac0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.628+0000 7f0fb264d700 1 -- 172.21.15.84:0/2629126491 >> 172.21.15.84:0/2629126491 conn(0x7f0fac099830 msgr2=0x7f0fac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.629+0000 7f0fb264d700 1 -- 172.21.15.84:0/2629126491 shutdown_connections 2023-10-06T02:57:14.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.629+0000 7f0fb264d700 1 -- 172.21.15.84:0/2629126491 wait complete. 2023-10-06T02:57:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.630+0000 7f0fb264d700 1 Processor -- start 2023-10-06T02:57:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.630+0000 7f0fb264d700 1 -- start start 2023-10-06T02:57:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.630+0000 7f0fb264d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fac0b07a0 0x7f0fac09dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.630+0000 7f0fb264d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b49e0 0x7f0fac1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.630+0000 7f0fb264d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fac1595a0 0x7f0fac09b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.630+0000 7f0fb264d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac09e0f0 con 0x7f0fac0b49e0 2023-10-06T02:57:14.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.630+0000 7f0fb264d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac099f90 con 0x7f0fac1595a0 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.630+0000 7f0fb264d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac09adf0 con 0x7f0fac0b07a0 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b49e0 0x7f0fac1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fab7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b49e0 0x7f0fac1589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38870/0 (socket says 172.21.15.84:38870) 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fab7fe700 1 -- 172.21.15.84:0/73690629 learned_addr learned my addr 172.21.15.84:0/73690629 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fabfff700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fac0b07a0 0x7f0fac09dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fb0bea700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fac1595a0 0x7f0fac09b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fab7fe700 1 -- 172.21.15.84:0/73690629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fac0b07a0 msgr2=0x7f0fac09dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fab7fe700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fac0b07a0 0x7f0fac09dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fab7fe700 1 -- 172.21.15.84:0/73690629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fac1595a0 msgr2=0x7f0fac09b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fab7fe700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fac1595a0 0x7f0fac09b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fab7fe700 1 -- 172.21.15.84:0/73690629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa4009a20 con 0x7f0fac0b49e0 2023-10-06T02:57:14.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fabfff700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fac0b07a0 0x7f0fac09dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fab7fe700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b49e0 0x7f0fac1589f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c830 tx=0x7f0fa0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0f93fff700 1 -- 172.21.15.84:0/73690629 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0011600 con 0x7f0fac0b49e0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0f93fff700 1 -- 172.21.15.84:0/73690629 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa0011760 con 0x7f0fac0b49e0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac09a1e0 con 0x7f0fac0b49e0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0f93fff700 1 -- 172.21.15.84:0/73690629 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0011b20 con 0x7f0fac0b49e0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.631+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac09a820 con 0x7f0fac0b49e0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.632+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac064ad0 con 0x7f0fac0b49e0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.633+0000 7f0f93fff700 1 -- 172.21.15.84:0/73690629 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fa001a450 con 0x7f0fac0b49e0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.633+0000 7f0f93fff700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f98066f30 0x7f0f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.633+0000 7f0f93fff700 1 -- 172.21.15.84:0/73690629 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f0fa0084330 con 0x7f0fac0b49e0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.633+0000 7f0fabfff700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f98066f30 0x7f0f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:14.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.633+0000 7f0fabfff700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f98066f30 0x7f0f980693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c001890 tx=0x7f0f9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:14.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.637+0000 7f0f93fff700 1 -- 172.21.15.84:0/73690629 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fa0051550 con 0x7f0fac0b49e0 2023-10-06T02:57:14.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:14.902+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) v1 -- 0x7f0fac09af30 con 0x7f0fac0b49e0 2023-10-06T02:57:15.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.500+0000 7f0f93fff700 1 -- 172.21.15.84:0/73690629 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v127) v1 ==== 146+0+0 (secure 0 0 0) 0x7f0fa0054b70 con 0x7f0fac0b49e0 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f98066f30 msgr2=0x7f0f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f98066f30 0x7f0f980693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c001890 tx=0x7f0f9c009040 comp rx=0 tx=0).stop 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b49e0 msgr2=0x7f0fac1589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b49e0 0x7f0fac1589f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000c830 tx=0x7f0fa0008040 comp rx=0 tx=0).stop 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 shutdown_connections 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f98066f30 0x7f0f980693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fac1595a0 0x7f0fac09b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0fac0b07a0 0x7f0fac09dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 --2- 172.21.15.84:0/73690629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fac0b49e0 0x7f0fac1589f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 >> 172.21.15.84:0/73690629 conn(0x7f0fac099830 msgr2=0x7f0fac0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:15.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 shutdown_connections 2023-10-06T02:57:15.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.503+0000 7f0fb264d700 1 -- 172.21.15.84:0/73690629 wait complete. 2023-10-06T02:57:15.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:57:15.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.632+0000 7f3a3c9cc700 1 Processor -- start 2023-10-06T02:57:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.632+0000 7f3a3c9cc700 1 -- start start 2023-10-06T02:57:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a3c9cc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a380cbcb0 0x7f3a380cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a3c9cc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a380cf610 con 0x7f3a381598e0 2023-10-06T02:57:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a3c9cc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a380cf8f0 con 0x7f3a38159510 2023-10-06T02:57:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a3c9cc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a380cfbd0 con 0x7f3a380cbcb0 2023-10-06T02:57:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a36d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a380cbcb0 0x7f3a380cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a2dd9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3a381598e0 0x7f3a380ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41912/0 (socket says 172.21.15.84:41912) 2023-10-06T02:57:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a2dd9b700 1 -- 172.21.15.84:0/1272636410 learned_addr learned my addr 172.21.15.84:0/1272636410 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a36d9d700 1 -- 172.21.15.84:0/1272636410 >> v1:172.21.15.131:6789/0 conn(0x7f3a38159510 legacy=0x7f3a380cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a36d9d700 1 -- 172.21.15.84:0/1272636410 >> v1:172.21.15.84:6789/0 conn(0x7f3a381598e0 legacy=0x7f3a380ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a35d9b700 1 -- 172.21.15.84:0/1272636410 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348294757 0 0) 0x7f3a380cf610 con 0x7f3a381598e0 2023-10-06T02:57:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a36d9d700 1 -- 172.21.15.84:0/1272636410 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a380cfeb0 con 0x7f3a380cbcb0 2023-10-06T02:57:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.633+0000 7f3a36d9d700 1 --2- 172.21.15.84:0/1272636410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a380cbcb0 0x7f3a380cef30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009e60 tx=0x7f3a30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e72f50c60a20510 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a35d9b700 1 -- 172.21.15.84:0/1272636410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000e070 con 0x7f3a380cbcb0 2023-10-06T02:57:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a35d9b700 1 -- 172.21.15.84:0/1272636410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3000bbf0 con 0x7f3a380cbcb0 2023-10-06T02:57:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a35d9b700 1 -- 172.21.15.84:0/1272636410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30012430 con 0x7f3a380cbcb0 2023-10-06T02:57:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/1272636410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a380cbcb0 msgr2=0x7f3a380cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a3c9cc700 1 --2- 172.21.15.84:0/1272636410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a380cbcb0 0x7f3a380cef30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009e60 tx=0x7f3a30009780 comp rx=0 tx=0).stop 2023-10-06T02:57:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/1272636410 shutdown_connections 2023-10-06T02:57:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a3c9cc700 1 --2- 172.21.15.84:0/1272636410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a380cbcb0 0x7f3a380cef30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/1272636410 >> 172.21.15.84:0/1272636410 conn(0x7f3a38089e90 msgr2=0x7f3a380997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/1272636410 shutdown_connections 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.634+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/1272636410 wait complete. 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.635+0000 7f3a3c9cc700 1 Processor -- start 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.635+0000 7f3a3c9cc700 1 -- start start 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a3c9cc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380cbcb0 0x7f3a38149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a3c9cc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a38159510 0x7f3a38157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a3c9cc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a381598e0 0x7f3a380c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a3c9cc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38158b90 con 0x7f3a38159510 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a3c9cc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3815acd0 con 0x7f3a380cbcb0 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a3c9cc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38149960 con 0x7f3a381598e0 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a2dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a38159510 0x7f3a38157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a2dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a38159510 0x7f3a38157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38892/0 (socket says 172.21.15.84:38892) 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a2dd9b700 1 -- 172.21.15.84:0/2322607661 learned_addr learned my addr 172.21.15.84:0/2322607661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a3659c700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380cbcb0 0x7f3a38149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a36d9d700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a381598e0 0x7f3a380c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a2dd9b700 1 -- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a381598e0 msgr2=0x7f3a380c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a2dd9b700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a381598e0 0x7f3a380c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a2dd9b700 1 -- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380cbcb0 msgr2=0x7f3a38149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a2dd9b700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380cbcb0 0x7f3a38149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a2dd9b700 1 -- 172.21.15.84:0/2322607661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30009a20 con 0x7f3a38159510 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a3659c700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380cbcb0 0x7f3a38149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.636+0000 7f3a36d9d700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a381598e0 0x7f3a380c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.637+0000 7f3a2dd9b700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a38159510 0x7f3a38157d50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c510 tx=0x7f3a2000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.637+0000 7f3a2effd700 1 -- 172.21.15.84:0/2322607661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20005b30 con 0x7f3a38159510 2023-10-06T02:57:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.637+0000 7f3a2effd700 1 -- 172.21.15.84:0/2322607661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20005c90 con 0x7f3a38159510 2023-10-06T02:57:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.637+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3815a0c0 con 0x7f3a38159510 2023-10-06T02:57:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.637+0000 7f3a2effd700 1 -- 172.21.15.84:0/2322607661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20007300 con 0x7f3a38159510 2023-10-06T02:57:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.637+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3815a680 con 0x7f3a38159510 2023-10-06T02:57:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.638+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a38064ad0 con 0x7f3a38159510 2023-10-06T02:57:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.638+0000 7f3a2effd700 1 -- 172.21.15.84:0/2322607661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a2001b3b0 con 0x7f3a38159510 2023-10-06T02:57:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.639+0000 7f3a2effd700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a18066f30 0x7f3a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.639+0000 7f3a2effd700 1 -- 172.21.15.84:0/2322607661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f3a20083ab0 con 0x7f3a38159510 2023-10-06T02:57:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.639+0000 7f3a3659c700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a18066f30 0x7f3a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.639+0000 7f3a3659c700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a18066f30 0x7f3a180693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a28006fd0 tx=0x7f3a28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.643+0000 7f3a2effd700 1 -- 172.21.15.84:0/2322607661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a20050cd0 con 0x7f3a38159510 2023-10-06T02:57:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.823+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3a3815ae10 con 0x7f3a38159510 2023-10-06T02:57:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.828+0000 7f3a2effd700 1 -- 172.21.15.84:0/2322607661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3a20017020 con 0x7f3a38159510 2023-10-06T02:57:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a18066f30 msgr2=0x7f3a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a18066f30 0x7f3a180693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a28006fd0 tx=0x7f3a28008040 comp rx=0 tx=0).stop 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a38159510 msgr2=0x7f3a38157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a38159510 0x7f3a38157d50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c510 tx=0x7f3a2000c8d0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 shutdown_connections 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a18066f30 0x7f3a180693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380cbcb0 0x7f3a38149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a381598e0 0x7f3a380c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 --2- 172.21.15.84:0/2322607661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a38159510 0x7f3a38157d50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 >> 172.21.15.84:0/2322607661 conn(0x7f3a38089e90 msgr2=0x7f3a380d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 shutdown_connections 2023-10-06T02:57:15.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:15.831+0000 7f3a3c9cc700 1 -- 172.21.15.84:0/2322607661 wait complete. 2023-10-06T02:57:15.843 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:57:15.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:15.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:57:15.925 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:57:15.925 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:57:15.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:16.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.039+0000 7f20280a9700 1 Processor -- start 2023-10-06T02:57:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.039+0000 7f20280a9700 1 -- start start 2023-10-06T02:57:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f20280a9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f20201595a0 0x7f20200aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f20280a9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20200b07a0 0x7f20200b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f20280a9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20200b0ca0 con 0x7f20200b49e0 2023-10-06T02:57:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f20280a9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20200b0f80 con 0x7f20201595a0 2023-10-06T02:57:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f20280a9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20200b1260 con 0x7f20200b07a0 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2025e45700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f20201595a0 0x7f20200aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2025e45700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f20201595a0 0x7f20200aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38908/0 (socket says 172.21.15.84:38908) 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2025e45700 1 -- 172.21.15.84:0/1079896312 learned_addr learned my addr 172.21.15.84:0/1079896312 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2026646700 1 --2- 172.21.15.84:0/1079896312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20200b07a0 0x7f20200b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2025e45700 1 -- 172.21.15.84:0/1079896312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20200b07a0 msgr2=0x7f20200b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2025e45700 1 --2- 172.21.15.84:0/1079896312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20200b07a0 0x7f20200b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2025e45700 1 -- 172.21.15.84:0/1079896312 >> v1:172.21.15.131:6789/0 conn(0x7f20200b49e0 legacy=0x7f20200aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2025e45700 1 -- 172.21.15.84:0/1079896312 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20200b1540 con 0x7f20201595a0 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2026646700 1 --2- 172.21.15.84:0/1079896312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20200b07a0 0x7f20200b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2025e45700 1 --2- 172.21.15.84:0/1079896312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20201595a0 0x7f20200aa570 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f201c009fa0 tx=0x7f201c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6308ad42146b25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2024e43700 1 -- 172.21.15.84:0/1079896312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00e070 con 0x7f20201595a0 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2024e43700 1 -- 172.21.15.84:0/1079896312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c00bac0 con 0x7f20201595a0 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.040+0000 7f2024e43700 1 -- 172.21.15.84:0/1079896312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0092e0 con 0x7f20201595a0 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.041+0000 7f20280a9700 1 -- 172.21.15.84:0/1079896312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20201595a0 msgr2=0x7f20200aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.041+0000 7f20280a9700 1 --2- 172.21.15.84:0/1079896312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20201595a0 0x7f20200aa570 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f201c009fa0 tx=0x7f201c009840 comp rx=0 tx=0).stop 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.041+0000 7f20280a9700 1 -- 172.21.15.84:0/1079896312 shutdown_connections 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.041+0000 7f20280a9700 1 --2- 172.21.15.84:0/1079896312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20200b07a0 0x7f20200b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.041+0000 7f20280a9700 1 --2- 172.21.15.84:0/1079896312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20201595a0 0x7f20200aa570 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.041+0000 7f20280a9700 1 -- 172.21.15.84:0/1079896312 >> 172.21.15.84:0/1079896312 conn(0x7f2020099830 msgr2=0x7f202006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.041+0000 7f20280a9700 1 -- 172.21.15.84:0/1079896312 shutdown_connections 2023-10-06T02:57:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.041+0000 7f20280a9700 1 -- 172.21.15.84:0/1079896312 wait complete. 2023-10-06T02:57:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.042+0000 7f20280a9700 1 Processor -- start 2023-10-06T02:57:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.042+0000 7f20280a9700 1 -- start start 2023-10-06T02:57:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f20280a9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200b07a0 0x7f20200ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f20280a9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20200b49e0 0x7f20200aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f20280a9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20201595a0 0x7f202009a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f20280a9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202009c0a0 con 0x7f20200b49e0 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f20280a9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202009c380 con 0x7f20200b07a0 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f20280a9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202009c660 con 0x7f20201595a0 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025644700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20200b49e0 0x7f20200aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025644700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20200b49e0 0x7f20200aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38920/0 (socket says 172.21.15.84:38920) 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025644700 1 -- 172.21.15.84:0/2694614126 learned_addr learned my addr 172.21.15.84:0/2694614126 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025e45700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200b07a0 0x7f20200ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2026646700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20201595a0 0x7f202009a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025644700 1 -- 172.21.15.84:0/2694614126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20201595a0 msgr2=0x7f202009a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025644700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20201595a0 0x7f202009a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025644700 1 -- 172.21.15.84:0/2694614126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200b07a0 msgr2=0x7f20200ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025644700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200b07a0 0x7f20200ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025644700 1 -- 172.21.15.84:0/2694614126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009ae0 con 0x7f20200b49e0 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.043+0000 7f2025644700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20200b49e0 0x7f20200aea90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f201000c790 tx=0x7f2010007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.044+0000 7f2015ffb700 1 -- 172.21.15.84:0/2694614126 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2010011590 con 0x7f20200b49e0 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.044+0000 7f2015ffb700 1 -- 172.21.15.84:0/2694614126 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20100116f0 con 0x7f20200b49e0 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.044+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202009c940 con 0x7f20200b49e0 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.044+0000 7f2015ffb700 1 -- 172.21.15.84:0/2694614126 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2010011ab0 con 0x7f20200b49e0 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.044+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20200aefd0 con 0x7f20200b49e0 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.045+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202009ce60 con 0x7f20200b49e0 2023-10-06T02:57:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.045+0000 7f2015ffb700 1 -- 172.21.15.84:0/2694614126 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f201001b3b0 con 0x7f20200b49e0 2023-10-06T02:57:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.045+0000 7f2015ffb700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2004066f30 0x7f20040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.045+0000 7f2015ffb700 1 -- 172.21.15.84:0/2694614126 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f2010083a50 con 0x7f20200b49e0 2023-10-06T02:57:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.045+0000 7f2025e45700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2004066f30 0x7f20040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.046+0000 7f2025e45700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2004066f30 0x7f20040693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f201c009880 tx=0x7f201c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.049+0000 7f2015ffb700 1 -- 172.21.15.84:0/2694614126 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f202009ce60 con 0x7f20200b49e0 2023-10-06T02:57:16.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.274+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f202009ce60 con 0x7f20200b49e0 2023-10-06T02:57:16.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.275+0000 7f2015ffb700 1 -- 172.21.15.84:0/2694614126 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f202009ce60 con 0x7f20200b49e0 2023-10-06T02:57:16.275 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:16.276 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/735486037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":735486037},{"type":"v1","addr":"172.21.15.131:6834","nonce":735486037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5317,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1196811730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1196811730},{"type":"v1","addr":"172.21.15.131:6835","nonce":1196811730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3544057999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3544057999},{"type":"v1","addr":"172.21.15.84:6835","nonce":3544057999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5706,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3792507729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":3792507729},{"type":"v1","addr":"172.21.15.84:6837","nonce":3792507729}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-10-06T02:57:16.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2004066f30 msgr2=0x7f20040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2004066f30 0x7f20040693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f201c009880 tx=0x7f201c018000 comp rx=0 tx=0).stop 2023-10-06T02:57:16.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20200b49e0 msgr2=0x7f20200aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:16.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20200b49e0 0x7f20200aea90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f201000c790 tx=0x7f2010007f20 comp rx=0 tx=0).stop 2023-10-06T02:57:16.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 shutdown_connections 2023-10-06T02:57:16.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2004066f30 0x7f20040693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20200b07a0 0x7f20200ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f20201595a0 0x7f202009a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 --2- 172.21.15.84:0/2694614126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f20200b49e0 0x7f20200aea90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:16.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 >> 172.21.15.84:0/2694614126 conn(0x7f2020099830 msgr2=0x7f2020068f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:16.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 shutdown_connections 2023-10-06T02:57:16.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:16.277+0000 7f20280a9700 1 -- 172.21.15.84:0/2694614126 wait complete. 2023-10-06T02:57:16.279 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2023-10-06T02:57:16.290 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:57:16.290 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:57:16.290 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:57:16.290 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:57:16.291 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:57:16.291 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:57:16.291 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:57:16.291 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:57:16.291 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:57:16.292 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:57:16.293 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:57:16.293 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:57:16.294 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:57:16.294 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:57:16.294 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:57:16.294 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:57:16.299 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:57:16.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:57:16.300 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:57:16.300 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:57:16.306 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:57:16.306 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:57:16.342 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:57:16.342 DEBUG:teuthology.parallel:result is None 2023-10-06T02:57:16.343 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:57:16.343 DEBUG:teuthology.parallel:result is None 2023-10-06T02:57:16.348 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:57:16.349 DEBUG:teuthology.parallel:result is None 2023-10-06T02:57:16.415 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T02:57:16.415 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T02:57:16.426 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T02:57:16.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-06T02:57:22.306 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:57:22.306 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:57:22.309 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:57:22.309 DEBUG:teuthology.parallel:result is None 2023-10-06T02:57:22.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:57:22.390 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T02:57:22.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.431+0000 7f5cfaba3700 1 Processor -- start 2023-10-06T02:57:22.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.431+0000 7f5cfaba3700 1 -- start start 2023-10-06T02:57:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.432+0000 7f5cfaba3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5cf4069720 0x7f5cf4069af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.432+0000 7f5cfaba3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf406e710 con 0x7f5cf40adaa0 2023-10-06T02:57:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.432+0000 7f5cfaba3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf406db00 con 0x7f5cf406d390 2023-10-06T02:57:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.432+0000 7f5cfaba3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf40cd040 con 0x7f5cf4069720 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.432+0000 7f5cf893f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5cf4069720 0x7f5cf4069af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.432+0000 7f5cebfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5cf40adaa0 0x7f5cf40aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49718/0 (socket says 172.21.15.84:49718) 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.432+0000 7f5cebfff700 1 -- 172.21.15.84:0/852588682 learned_addr learned my addr 172.21.15.84:0/852588682 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.433+0000 7f5cf893f700 1 -- 172.21.15.84:0/852588682 >> v1:172.21.15.131:6789/0 conn(0x7f5cf406d390 legacy=0x7f5cf406eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.433+0000 7f5cf893f700 1 -- 172.21.15.84:0/852588682 >> v1:172.21.15.84:6789/0 conn(0x7f5cf40adaa0 legacy=0x7f5cf40aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.433+0000 7f5cf893f700 1 -- 172.21.15.84:0/852588682 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf406dde0 con 0x7f5cf4069720 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.433+0000 7f5ceb7fe700 1 -- 172.21.15.84:0/852588682 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962613343 0 0) 0x7f5cf406e710 con 0x7f5cf40adaa0 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.433+0000 7f5cf893f700 1 --2- 172.21.15.84:0/852588682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf4069720 0x7f5cf4069af0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098e0 tx=0x7f5cf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebe5adf2b87b8d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.433+0000 7f5ceb7fe700 1 -- 172.21.15.84:0/852588682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0009e80 con 0x7f5cf4069720 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.433+0000 7f5ceb7fe700 1 -- 172.21.15.84:0/852588682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf000b860 con 0x7f5cf4069720 2023-10-06T02:57:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.433+0000 7f5ceb7fe700 1 -- 172.21.15.84:0/852588682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000bbe0 con 0x7f5cf4069720 2023-10-06T02:57:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.434+0000 7f5cfaba3700 1 -- 172.21.15.84:0/852588682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf4069720 msgr2=0x7f5cf4069af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.434+0000 7f5cfaba3700 1 --2- 172.21.15.84:0/852588682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf4069720 0x7f5cf4069af0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098e0 tx=0x7f5cf00091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.434+0000 7f5cfaba3700 1 -- 172.21.15.84:0/852588682 shutdown_connections 2023-10-06T02:57:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.434+0000 7f5cfaba3700 1 --2- 172.21.15.84:0/852588682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf4069720 0x7f5cf4069af0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.434+0000 7f5cfaba3700 1 -- 172.21.15.84:0/852588682 >> 172.21.15.84:0/852588682 conn(0x7f5cf40680c0 msgr2=0x7f5cf40cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.434+0000 7f5cfaba3700 1 -- 172.21.15.84:0/852588682 shutdown_connections 2023-10-06T02:57:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.434+0000 7f5cfaba3700 1 -- 172.21.15.84:0/852588682 wait complete. 2023-10-06T02:57:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.435+0000 7f5cfaba3700 1 Processor -- start 2023-10-06T02:57:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.435+0000 7f5cfaba3700 1 -- start start 2023-10-06T02:57:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cfaba3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cf4069720 0x7f5cf40b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cfaba3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cf406d390 0x7f5cf40c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cfaba3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40adaa0 0x7f5cf416d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cfaba3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf40b08e0 con 0x7f5cf40adaa0 2023-10-06T02:57:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cfaba3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4157160 con 0x7f5cf4069720 2023-10-06T02:57:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cfaba3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf40b1710 con 0x7f5cf406d390 2023-10-06T02:57:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf9140700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40adaa0 0x7f5cf416d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf9140700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40adaa0 0x7f5cf416d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33390/0 (socket says 172.21.15.84:33390) 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf9140700 1 -- 172.21.15.84:0/919915198 learned_addr learned my addr 172.21.15.84:0/919915198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf893f700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cf4069720 0x7f5cf40b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cebfff700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cf406d390 0x7f5cf40c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf9140700 1 -- 172.21.15.84:0/919915198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cf406d390 msgr2=0x7f5cf40c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf9140700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cf406d390 0x7f5cf40c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf9140700 1 -- 172.21.15.84:0/919915198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cf4069720 msgr2=0x7f5cf40b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf9140700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cf4069720 0x7f5cf40b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf9140700 1 -- 172.21.15.84:0/919915198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009420 con 0x7f5cf40adaa0 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cebfff700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cf406d390 0x7f5cf40c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cf9140700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40adaa0 0x7f5cf416d510 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c8e0 tx=0x7f5cec001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5ce8ff9700 1 -- 172.21.15.84:0/919915198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec012630 con 0x7f5cf40adaa0 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5ce8ff9700 1 -- 172.21.15.84:0/919915198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec012790 con 0x7f5cf40adaa0 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf40b0b00 con 0x7f5cf40adaa0 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5ce8ff9700 1 -- 172.21.15.84:0/919915198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec012b50 con 0x7f5cf40adaa0 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.436+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf40b10c0 con 0x7f5cf40adaa0 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.437+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf4064ad0 con 0x7f5cf40adaa0 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.438+0000 7f5ce8ff9700 1 -- 172.21.15.84:0/919915198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cec00a3b0 con 0x7f5cf40adaa0 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.438+0000 7f5ce8ff9700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ce0066f30 0x7f5ce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.438+0000 7f5ce8ff9700 1 -- 172.21.15.84:0/919915198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f5cec084800 con 0x7f5cf40adaa0 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.438+0000 7f5cf893f700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ce0066f30 0x7f5ce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.438+0000 7f5cf893f700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ce0066f30 0x7f5ce00693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00093f0 tx=0x7f5cf0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:22.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.442+0000 7f5ce8ff9700 1 -- 172.21.15.84:0/919915198 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cec051a20 con 0x7f5cf40adaa0 2023-10-06T02:57:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:22.640+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5cf40b1850 con 0x7f5cf40adaa0 2023-10-06T02:57:23.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-06T02:57:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.121+0000 7f5ce8ff9700 1 -- 172.21.15.84:0/919915198 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5cec055040 con 0x7f5cf40adaa0 2023-10-06T02:57:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ce0066f30 msgr2=0x7f5ce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ce0066f30 0x7f5ce00693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00093f0 tx=0x7f5cf0017000 comp rx=0 tx=0).stop 2023-10-06T02:57:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40adaa0 msgr2=0x7f5cf416d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40adaa0 0x7f5cf416d510 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c8e0 tx=0x7f5cec001710 comp rx=0 tx=0).stop 2023-10-06T02:57:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 shutdown_connections 2023-10-06T02:57:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ce0066f30 0x7f5ce00693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cf4069720 0x7f5cf40b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cf40adaa0 0x7f5cf416d510 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 --2- 172.21.15.84:0/919915198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5cf406d390 0x7f5cf40c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 >> 172.21.15.84:0/919915198 conn(0x7f5cf40680c0 msgr2=0x7f5cf41599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 shutdown_connections 2023-10-06T02:57:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.124+0000 7f5cfaba3700 1 -- 172.21.15.84:0/919915198 wait complete. 2023-10-06T02:57:24.127 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T02:57:24.141 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:57:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.259+0000 7f3a19d24700 1 Processor -- start 2023-10-06T02:57:24.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.259+0000 7f3a19d24700 1 -- start start 2023-10-06T02:57:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.260+0000 7f3a19d24700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a140adba0 0x7f3a140ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.260+0000 7f3a19d24700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a1415af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.260+0000 7f3a19d24700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a14157e20 con 0x7f3a140ca3b0 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.260+0000 7f3a19d24700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140cbbd0 con 0x7f3a140adba0 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.260+0000 7f3a19d24700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140ceb50 con 0x7f3a140ce710 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.260+0000 7f3a12ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a140adba0 0x7f3a140ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.260+0000 7f3a137fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3a140ca3b0 0x7f3a141582b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49728/0 (socket says 172.21.15.84:49728) 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.260+0000 7f3a137fe700 1 -- 172.21.15.84:0/3561822130 learned_addr learned my addr 172.21.15.84:0/3561822130 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a13fff700 1 --2- 172.21.15.84:0/3561822130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a1415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a12ffd700 1 -- 172.21.15.84:0/3561822130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 msgr2=0x7f3a1415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a12ffd700 1 --2- 172.21.15.84:0/3561822130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a1415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a127fc700 1 -- 172.21.15.84:0/3561822130 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764445195 0 0) 0x7f3a14157e20 con 0x7f3a140ca3b0 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a12ffd700 1 -- 172.21.15.84:0/3561822130 >> v1:172.21.15.84:6789/0 conn(0x7f3a140ca3b0 legacy=0x7f3a141582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a12ffd700 1 -- 172.21.15.84:0/3561822130 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140cb610 con 0x7f3a140adba0 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a13fff700 1 --2- 172.21.15.84:0/3561822130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a1415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a12ffd700 1 --2- 172.21.15.84:0/3561822130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 0x7f3a140ce1d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3a080098e0 tx=0x7f3a080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6f22fecb094da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a127fc700 1 -- 172.21.15.84:0/3561822130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08009e80 con 0x7f3a140adba0 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a127fc700 1 -- 172.21.15.84:0/3561822130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0800b860 con 0x7f3a140adba0 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a127fc700 1 -- 172.21.15.84:0/3561822130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0800bbe0 con 0x7f3a140adba0 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a19d24700 1 -- 172.21.15.84:0/3561822130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 msgr2=0x7f3a140ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a19d24700 1 --2- 172.21.15.84:0/3561822130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 0x7f3a140ce1d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3a080098e0 tx=0x7f3a080091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a19d24700 1 -- 172.21.15.84:0/3561822130 shutdown_connections 2023-10-06T02:57:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a19d24700 1 --2- 172.21.15.84:0/3561822130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a1415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a19d24700 1 --2- 172.21.15.84:0/3561822130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 0x7f3a140ce1d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a19d24700 1 -- 172.21.15.84:0/3561822130 >> 172.21.15.84:0/3561822130 conn(0x7f3a14070810 msgr2=0x7f3a14070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.261+0000 7f3a19d24700 1 -- 172.21.15.84:0/3561822130 shutdown_connections 2023-10-06T02:57:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.262+0000 7f3a19d24700 1 -- 172.21.15.84:0/3561822130 wait complete. 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.263+0000 7f3a19d24700 1 Processor -- start 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.263+0000 7f3a19d24700 1 -- start start 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.263+0000 7f3a19d24700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 0x7f3a1415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.263+0000 7f3a19d24700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a140ca3b0 0x7f3a14151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a19d24700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a14151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a19d24700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14068c10 con 0x7f3a140adba0 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a19d24700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1415c3a0 con 0x7f3a140ca3b0 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a19d24700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1415c680 con 0x7f3a140ce710 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a137fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 0x7f3a1415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a137fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 0x7f3a1415ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33406/0 (socket says 172.21.15.84:33406) 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a137fe700 1 -- 172.21.15.84:0/4022738436 learned_addr learned my addr 172.21.15.84:0/4022738436 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a12ffd700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a140ca3b0 0x7f3a14151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a137fe700 1 -- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 msgr2=0x7f3a14151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a13fff700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a14151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a137fe700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a14151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a137fe700 1 -- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a140ca3b0 msgr2=0x7f3a14151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a137fe700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a140ca3b0 0x7f3a14151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a137fe700 1 -- 172.21.15.84:0/4022738436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08009420 con 0x7f3a140adba0 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a12ffd700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a140ca3b0 0x7f3a14151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a13fff700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a14151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:24.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a137fe700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 0x7f3a1415ba50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400cd80 tx=0x7f3a04001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f39fb7fe700 1 -- 172.21.15.84:0/4022738436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400ab10 con 0x7f3a140adba0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f39fb7fe700 1 -- 172.21.15.84:0/4022738436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0400ac70 con 0x7f3a140adba0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f39fb7fe700 1 -- 172.21.15.84:0/4022738436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a040070f0 con 0x7f3a140adba0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a140688a0 con 0x7f3a140adba0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.264+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1415bf90 con 0x7f3a140adba0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.265+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a14068700 con 0x7f3a140adba0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.266+0000 7f39fb7fe700 1 -- 172.21.15.84:0/4022738436 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a040074e0 con 0x7f3a140adba0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.266+0000 7f39fb7fe700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a00066f30 0x7f3a000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.266+0000 7f39fb7fe700 1 -- 172.21.15.84:0/4022738436 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f3a040849b0 con 0x7f3a140adba0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.266+0000 7f3a12ffd700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a00066f30 0x7f3a000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.267+0000 7f3a12ffd700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a00066f30 0x7f3a000693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a140adfe0 tx=0x7f3a08017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.270+0000 7f39fb7fe700 1 -- 172.21.15.84:0/4022738436 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a14068700 con 0x7f3a140adba0 2023-10-06T02:57:24.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.527+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3a14068700 con 0x7f3a140adba0 2023-10-06T02:57:24.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.527+0000 7f39fb7fe700 1 -- 172.21.15.84:0/4022738436 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3a14068700 con 0x7f3a140adba0 2023-10-06T02:57:24.529 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:24.529 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:57:24.529 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lFrNmJBAAeVhw9betN9snqLPgSK9efw==", 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.530 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lbi6hLxAAICzxeAsbJ5rhbyMBkPcrAQ==", 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lSCo1KxAAuETY4PeWDJS3bGzqTpHLpQ==", 2023-10-06T02:57:24.531 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lvPxyNhAAKlqBTG/Fr8/2Rf+lcGQxIg==", 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:57:24.532 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDUdh9lV3sRIRAAoUtG7F6EMyew6CX3NaNufw==", 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.533 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.534 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.534 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T02:57:24.534 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDXdh9ls5OxHhAAanGTRmjW75UAwrqzL0CIdw==", 2023-10-06T02:57:24.534 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.534 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:24.534 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:57:24.534 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.534 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDadh9lQeJTHhAAFeayQY1F10UDCck78/ja4w==", 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDddh9l+cx8HhAAeAcoLzCUiCC+9O+WZYYTsA==", 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T02:57:24.536 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDjdh9lA4upJxAAdFHhR2/rMyG2NbQEu7JpLw==", 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDmdh9lOGETJRAA7nLtgcumxqfum8cirnbaRA==", 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:24.537 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDpdh9lSbDhJBAAnMWhjKSKYcLaZeRk9drdgA==", 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.538 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDsdh9lImOeIhAAPUO3jy2/cPZW+eKukBywcw==", 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.539 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lRRw/OhAAwavsq3e0HeVF3/G4SX0v+A==", 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lftv/BhAAo8sb1EG96nHv77bn3af/dg==", 2023-10-06T02:57:24.540 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lxOX6AxAAWDpHCodRcEc2/YF5yqnkQg==", 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:57:24.541 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lheJnDBAAqAQeFxMQ9Qv108TLz65mVw==", 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:57:24.542 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9l8qZuCBAArPoeoGgydlQPFp7XYwI9KQ==", 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.543 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9ly2pdIRAAX7YmT9B/MzoD8xJH347ruQ==", 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:24.544 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lW/KSHBAAEvgj/BAe20tCp8uwBEIVbA==", 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T02:57:24.545 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a00066f30 msgr2=0x7f3a000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a00066f30 0x7f3a000693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a140adfe0 tx=0x7f3a08017000 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 msgr2=0x7f3a1415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 0x7f3a1415ba50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400cd80 tx=0x7f3a04001ae0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 shutdown_connections 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a00066f30 0x7f3a000693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a140ce710 0x7f3a14151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140adba0 0x7f3a1415ba50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 --2- 172.21.15.84:0/4022738436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a140ca3b0 0x7f3a14151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 >> 172.21.15.84:0/4022738436 conn(0x7f3a14070810 msgr2=0x7f3a1414d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 shutdown_connections 2023-10-06T02:57:24.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.530+0000 7f3a19d24700 1 -- 172.21.15.84:0/4022738436 wait complete. 2023-10-06T02:57:24.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:24.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.660+0000 7fe108d74700 1 Processor -- start 2023-10-06T02:57:24.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.660+0000 7fe108d74700 1 -- start start 2023-10-06T02:57:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe108d74700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe1040b07a0 0x7fe1040ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe108d74700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040b0ca0 con 0x7fe1040b49e0 2023-10-06T02:57:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe108d74700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040b0f80 con 0x7fe1041595a0 2023-10-06T02:57:24.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe108d74700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1040ab390 con 0x7fe1040b07a0 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe102d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe1040b07a0 0x7fe1040ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe0f9d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe1040b49e0 0x7fe1040aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49732/0 (socket says 172.21.15.84:49732) 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe0f9d9b700 1 -- 172.21.15.84:0/2214090891 learned_addr learned my addr 172.21.15.84:0/2214090891 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe102d9d700 1 -- 172.21.15.84:0/2214090891 >> v1:172.21.15.131:6789/0 conn(0x7fe1041595a0 legacy=0x7fe1040aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe102d9d700 1 -- 172.21.15.84:0/2214090891 >> v1:172.21.15.84:6789/0 conn(0x7fe1040b49e0 legacy=0x7fe1040aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe101d9b700 1 -- 172.21.15.84:0/2214090891 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522265887 0 0) 0x7fe1040b0ca0 con 0x7fe1040b49e0 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.661+0000 7fe102d9d700 1 -- 172.21.15.84:0/2214090891 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1040b1260 con 0x7fe1040b07a0 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe102d9d700 1 --2- 172.21.15.84:0/2214090891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 0x7fe1040ccfd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009e90 tx=0x7fe0fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd7d556c692f84e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe101d9b700 1 -- 172.21.15.84:0/2214090891 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00e070 con 0x7fe1040b07a0 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe101d9b700 1 -- 172.21.15.84:0/2214090891 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc00bbb0 con 0x7fe1040b07a0 2023-10-06T02:57:24.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe101d9b700 1 -- 172.21.15.84:0/2214090891 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc012430 con 0x7fe1040b07a0 2023-10-06T02:57:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe108d74700 1 -- 172.21.15.84:0/2214090891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 msgr2=0x7fe1040ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe108d74700 1 --2- 172.21.15.84:0/2214090891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 0x7fe1040ccfd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009e90 tx=0x7fe0fc009780 comp rx=0 tx=0).stop 2023-10-06T02:57:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe108d74700 1 -- 172.21.15.84:0/2214090891 shutdown_connections 2023-10-06T02:57:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe108d74700 1 --2- 172.21.15.84:0/2214090891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 0x7fe1040ccfd0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe108d74700 1 -- 172.21.15.84:0/2214090891 >> 172.21.15.84:0/2214090891 conn(0x7fe104099830 msgr2=0x7fe10406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe108d74700 1 -- 172.21.15.84:0/2214090891 shutdown_connections 2023-10-06T02:57:24.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.662+0000 7fe108d74700 1 -- 172.21.15.84:0/2214090891 wait complete. 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.663+0000 7fe108d74700 1 Processor -- start 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe108d74700 1 -- start start 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe108d74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 0x7fe104157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe108d74700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1040b49e0 0x7fe1040ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe108d74700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1041595a0 0x7fe1040ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe108d74700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040acb70 con 0x7fe1040b07a0 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe108d74700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040abf60 con 0x7fe1040b49e0 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe108d74700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040ac240 con 0x7fe1041595a0 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe10259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 0x7fe104157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe10259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 0x7fe104157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33420/0 (socket says 172.21.15.84:33420) 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.664+0000 7fe10259c700 1 -- 172.21.15.84:0/3713135303 learned_addr learned my addr 172.21.15.84:0/3713135303 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe102d9d700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1041595a0 0x7fe1040ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe0f9d9b700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1040b49e0 0x7fe1040ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe10259c700 1 -- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1041595a0 msgr2=0x7fe1040ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe10259c700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1041595a0 0x7fe1040ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe10259c700 1 -- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1040b49e0 msgr2=0x7fe1040ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe10259c700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1040b49e0 0x7fe1040ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe10259c700 1 -- 172.21.15.84:0/3713135303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc009a20 con 0x7fe1040b07a0 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe102d9d700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1041595a0 0x7fe1040ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe0f9d9b700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1040b49e0 0x7fe1040ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:24.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe10259c700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 0x7fe104157b10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400b5e0 tx=0x7fe0f40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe0faffd700 1 -- 172.21.15.84:0/3713135303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400f510 con 0x7fe1040b07a0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe0faffd700 1 -- 172.21.15.84:0/3713135303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f400f690 con 0x7fe1040b07a0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1040ac520 con 0x7fe1040b07a0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe0faffd700 1 -- 172.21.15.84:0/3713135303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400fa50 con 0x7fe1040b07a0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.665+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe104158050 con 0x7fe1040b07a0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.666+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe104064ad0 con 0x7fe1040b07a0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.666+0000 7fe0faffd700 1 -- 172.21.15.84:0/3713135303 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0f401a400 con 0x7fe1040b07a0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.666+0000 7fe0faffd700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe0e4066f30 0x7fe0e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.666+0000 7fe0faffd700 1 -- 172.21.15.84:0/3713135303 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fe0f4083f50 con 0x7fe1040b07a0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.667+0000 7fe0f9d9b700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe0e4066f30 0x7fe0e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.667+0000 7fe0f9d9b700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe0e4066f30 0x7fe0e40693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe10409e110 tx=0x7fe0ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.670+0000 7fe0faffd700 1 -- 172.21.15.84:0/3713135303 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0f40512f0 con 0x7fe1040b07a0 2023-10-06T02:57:24.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.854+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1040b1540 con 0x7fe1040b07a0 2023-10-06T02:57:24.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.855+0000 7fe0faffd700 1 -- 172.21.15.84:0/3713135303 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13855 (secure 0 0 0) 0x7fe0f4054910 con 0x7fe1040b07a0 2023-10-06T02:57:24.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:24.857 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":52,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:57:24.116649+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:24.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe0e4066f30 msgr2=0x7fe0e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe0e4066f30 0x7fe0e40693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe10409e110 tx=0x7fe0ec009040 comp rx=0 tx=0).stop 2023-10-06T02:57:24.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 msgr2=0x7fe104157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 0x7fe104157b10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400b5e0 tx=0x7fe0f40090f0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 shutdown_connections 2023-10-06T02:57:24.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe0e4066f30 0x7fe0e40693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1041595a0 0x7fe1040ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1040b07a0 0x7fe104157b10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 --2- 172.21.15.84:0/3713135303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1040b49e0 0x7fe1040ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 >> 172.21.15.84:0/3713135303 conn(0x7fe104099830 msgr2=0x7fe1041589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 shutdown_connections 2023-10-06T02:57:24.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.857+0000 7fe108d74700 1 -- 172.21.15.84:0/3713135303 wait complete. 2023-10-06T02:57:24.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:57:24.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:57:24.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.987+0000 7f7d76235700 1 Processor -- start 2023-10-06T02:57:24.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.987+0000 7f7d76235700 1 -- start start 2023-10-06T02:57:24.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d76235700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d700cbcb0 0x7f7d700cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d76235700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d700cf610 con 0x7f7d701598e0 2023-10-06T02:57:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d76235700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d700cf8f0 con 0x7f7d70159510 2023-10-06T02:57:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d76235700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d700cfbd0 con 0x7f7d700cbcb0 2023-10-06T02:57:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d700cbcb0 0x7f7d700cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7d701598e0 0x7f7d700ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49748/0 (socket says 172.21.15.84:49748) 2023-10-06T02:57:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6effd700 1 -- 172.21.15.84:0/469051541 learned_addr learned my addr 172.21.15.84:0/469051541 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6ffff700 1 -- 172.21.15.84:0/469051541 >> v1:172.21.15.131:6789/0 conn(0x7f7d70159510 legacy=0x7f7d700cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6ffff700 1 -- 172.21.15.84:0/469051541 >> v1:172.21.15.84:6789/0 conn(0x7f7d701598e0 legacy=0x7f7d700ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6e7fc700 1 -- 172.21.15.84:0/469051541 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647481255 0 0) 0x7f7d700cf610 con 0x7f7d701598e0 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6ffff700 1 -- 172.21.15.84:0/469051541 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d700cfeb0 con 0x7f7d700cbcb0 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6ffff700 1 --2- 172.21.15.84:0/469051541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d700cbcb0 0x7f7d700cef30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7d600098e0 tx=0x7f7d600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90213571a7f4e6b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6e7fc700 1 -- 172.21.15.84:0/469051541 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60009e80 con 0x7f7d700cbcb0 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6e7fc700 1 -- 172.21.15.84:0/469051541 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000b820 con 0x7f7d700cbcb0 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.988+0000 7f7d6e7fc700 1 -- 172.21.15.84:0/469051541 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000bbe0 con 0x7f7d700cbcb0 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.989+0000 7f7d76235700 1 -- 172.21.15.84:0/469051541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d700cbcb0 msgr2=0x7f7d700cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.989+0000 7f7d76235700 1 --2- 172.21.15.84:0/469051541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d700cbcb0 0x7f7d700cef30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7d600098e0 tx=0x7f7d600091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.989+0000 7f7d76235700 1 -- 172.21.15.84:0/469051541 shutdown_connections 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.989+0000 7f7d76235700 1 --2- 172.21.15.84:0/469051541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d700cbcb0 0x7f7d700cef30 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.989+0000 7f7d76235700 1 -- 172.21.15.84:0/469051541 >> 172.21.15.84:0/469051541 conn(0x7f7d70089e90 msgr2=0x7f7d700997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.989+0000 7f7d76235700 1 -- 172.21.15.84:0/469051541 shutdown_connections 2023-10-06T02:57:24.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.989+0000 7f7d76235700 1 -- 172.21.15.84:0/469051541 wait complete. 2023-10-06T02:57:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.990+0000 7f7d76235700 1 Processor -- start 2023-10-06T02:57:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.990+0000 7f7d76235700 1 -- start start 2023-10-06T02:57:24.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d76235700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbcb0 0x7f7d70149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d76235700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159510 0x7f7d7015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d76235700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d701598e0 0x7f7d700c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d76235700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7015ac60 con 0x7f7d70159510 2023-10-06T02:57:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d76235700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70149870 con 0x7f7d700cbcb0 2023-10-06T02:57:24.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d76235700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7015a050 con 0x7f7d701598e0 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159510 0x7f7d7015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159510 0x7f7d7015b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33440/0 (socket says 172.21.15.84:33440) 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6effd700 1 -- 172.21.15.84:0/445234818 learned_addr learned my addr 172.21.15.84:0/445234818 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6ffff700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d701598e0 0x7f7d700c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6f7fe700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbcb0 0x7f7d70149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6effd700 1 -- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d701598e0 msgr2=0x7f7d700c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6effd700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d701598e0 0x7f7d700c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6effd700 1 -- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbcb0 msgr2=0x7f7d70149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6effd700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbcb0 0x7f7d70149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:24.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6effd700 1 -- 172.21.15.84:0/445234818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009420 con 0x7f7d70159510 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6ffff700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d701598e0 0x7f7d700c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6f7fe700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbcb0 0x7f7d70149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.991+0000 7f7d6effd700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159510 0x7f7d7015b910 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800c510 tx=0x7f7d5800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.992+0000 7f7d677fe700 1 -- 172.21.15.84:0/445234818 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d58005b30 con 0x7f7d70159510 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.992+0000 7f7d677fe700 1 -- 172.21.15.84:0/445234818 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d58005cb0 con 0x7f7d70159510 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.992+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7015a330 con 0x7f7d70159510 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.992+0000 7f7d677fe700 1 -- 172.21.15.84:0/445234818 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d58007320 con 0x7f7d70159510 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.992+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7015a6c0 con 0x7f7d70159510 2023-10-06T02:57:24.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.992+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7015ae10 con 0x7f7d70159510 2023-10-06T02:57:24.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.993+0000 7f7d677fe700 1 -- 172.21.15.84:0/445234818 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d5801b3b0 con 0x7f7d70159510 2023-10-06T02:57:24.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.993+0000 7f7d677fe700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:24.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.993+0000 7f7d677fe700 1 -- 172.21.15.84:0/445234818 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7d580839b0 con 0x7f7d70159510 2023-10-06T02:57:24.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.993+0000 7f7d6f7fe700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:24.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.994+0000 7f7d6f7fe700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d50066f30 0x7f7d500693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7d68007fd0 tx=0x7f7d68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:24.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:24.998+0000 7f7d677fe700 1 -- 172.21.15.84:0/445234818 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d7015ae10 con 0x7f7d70159510 2023-10-06T02:57:25.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.178+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d70064ad0 con 0x7f7d70159510 2023-10-06T02:57:25.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.178+0000 7f7d677fe700 1 -- 172.21.15.84:0/445234818 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d58017020 con 0x7f7d70159510 2023-10-06T02:57:25.180 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:57:25.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d50066f30 msgr2=0x7f7d500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d50066f30 0x7f7d500693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7d68007fd0 tx=0x7f7d68009040 comp rx=0 tx=0).stop 2023-10-06T02:57:25.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159510 msgr2=0x7f7d7015b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159510 0x7f7d7015b910 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800c510 tx=0x7f7d5800c8d0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 shutdown_connections 2023-10-06T02:57:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbcb0 0x7f7d70149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d701598e0 0x7f7d700c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 --2- 172.21.15.84:0/445234818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159510 0x7f7d7015b910 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 >> 172.21.15.84:0/445234818 conn(0x7f7d70089e90 msgr2=0x7f7d7014a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 shutdown_connections 2023-10-06T02:57:25.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.180+0000 7f7d76235700 1 -- 172.21.15.84:0/445234818 wait complete. 2023-10-06T02:57:25.194 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:57:25.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.309+0000 7f10597ca700 1 Processor -- start 2023-10-06T02:57:25.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.309+0000 7f10597ca700 1 -- start start 2023-10-06T02:57:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f10597ca700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f10540cd400 0x7f10540ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f10597ca700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10540cc9b0 con 0x7f10540b2a30 2023-10-06T02:57:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f10597ca700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10540cbda0 con 0x7f10540b2660 2023-10-06T02:57:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f10597ca700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10540cc080 con 0x7f10540cd400 2023-10-06T02:57:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f10537fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f10540cd400 0x7f10540ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f1058fc9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f10540b2a30 0x7f10540c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49760/0 (socket says 172.21.15.84:49760) 2023-10-06T02:57:25.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f1058fc9700 1 -- 172.21.15.84:0/1372857020 learned_addr learned my addr 172.21.15.84:0/1372857020 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f10537fe700 1 -- 172.21.15.84:0/1372857020 >> v1:172.21.15.131:6789/0 conn(0x7f10540b2660 legacy=0x7f10540cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f10537fe700 1 -- 172.21.15.84:0/1372857020 >> v1:172.21.15.84:6789/0 conn(0x7f10540b2a30 legacy=0x7f10540c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f10537fe700 1 -- 172.21.15.84:0/1372857020 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10540cc360 con 0x7f10540cd400 2023-10-06T02:57:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f1052ffd700 1 -- 172.21.15.84:0/1372857020 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602178768 0 0) 0x7f10540cc9b0 con 0x7f10540b2a30 2023-10-06T02:57:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.310+0000 7f10537fe700 1 --2- 172.21.15.84:0/1372857020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 0x7f10540ceae0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f10480098e0 tx=0x7f10480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4b1b4fa8b355f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f1052ffd700 1 -- 172.21.15.84:0/1372857020 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048009e80 con 0x7f10540cd400 2023-10-06T02:57:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f1052ffd700 1 -- 172.21.15.84:0/1372857020 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104800b820 con 0x7f10540cd400 2023-10-06T02:57:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f1052ffd700 1 -- 172.21.15.84:0/1372857020 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104800bba0 con 0x7f10540cd400 2023-10-06T02:57:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f10597ca700 1 -- 172.21.15.84:0/1372857020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 msgr2=0x7f10540ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f10597ca700 1 --2- 172.21.15.84:0/1372857020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 0x7f10540ceae0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f10480098e0 tx=0x7f10480091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f10597ca700 1 -- 172.21.15.84:0/1372857020 shutdown_connections 2023-10-06T02:57:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f10597ca700 1 --2- 172.21.15.84:0/1372857020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 0x7f10540ceae0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f10597ca700 1 -- 172.21.15.84:0/1372857020 >> 172.21.15.84:0/1372857020 conn(0x7f1054099560 msgr2=0x7f105406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f10597ca700 1 -- 172.21.15.84:0/1372857020 shutdown_connections 2023-10-06T02:57:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.311+0000 7f10597ca700 1 -- 172.21.15.84:0/1372857020 wait complete. 2023-10-06T02:57:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.312+0000 7f10597ca700 1 Processor -- start 2023-10-06T02:57:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.312+0000 7f10597ca700 1 -- start start 2023-10-06T02:57:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f10597ca700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10540b2660 0x7f10540c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f10597ca700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10540b2a30 0x7f1054159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f10597ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 0x7f10540c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f10597ca700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10540c8540 con 0x7f10540cd400 2023-10-06T02:57:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f10597ca700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10540c7f80 con 0x7f10540b2660 2023-10-06T02:57:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f10597ca700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105415a7b0 con 0x7f10540b2a30 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f1058fc9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 0x7f10540c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f1058fc9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 0x7f10540c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33464/0 (socket says 172.21.15.84:33464) 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f1058fc9700 1 -- 172.21.15.84:0/382107113 learned_addr learned my addr 172.21.15.84:0/382107113 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f1053fff700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10540b2660 0x7f10540c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f10537fe700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10540b2a30 0x7f1054159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f1058fc9700 1 -- 172.21.15.84:0/382107113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10540b2a30 msgr2=0x7f1054159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f1058fc9700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10540b2a30 0x7f1054159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f1058fc9700 1 -- 172.21.15.84:0/382107113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10540b2660 msgr2=0x7f10540c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f1058fc9700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10540b2660 0x7f10540c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.313+0000 7f1058fc9700 1 -- 172.21.15.84:0/382107113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1048009420 con 0x7f10540cd400 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.314+0000 7f1053fff700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10540b2660 0x7f10540c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.314+0000 7f1058fc9700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 0x7f10540c9870 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f104c00ccc0 tx=0x7f104c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.314+0000 7f103bfff700 1 -- 172.21.15.84:0/382107113 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c00ab10 con 0x7f10540cd400 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.314+0000 7f103bfff700 1 -- 172.21.15.84:0/382107113 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c00ac70 con 0x7f10540cd400 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.314+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105415aa90 con 0x7f10540cd400 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.314+0000 7f103bfff700 1 -- 172.21.15.84:0/382107113 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0070f0 con 0x7f10540cd400 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.314+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10541555b0 con 0x7f10540cd400 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.315+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105405f270 con 0x7f10540cd400 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.315+0000 7f103bfff700 1 -- 172.21.15.84:0/382107113 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f104c007520 con 0x7f10540cd400 2023-10-06T02:57:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.315+0000 7f103bfff700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1040066f30 0x7f10400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.316+0000 7f1053fff700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1040066f30 0x7f10400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.316+0000 7f103bfff700 1 -- 172.21.15.84:0/382107113 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f104c0848d0 con 0x7f10540cd400 2023-10-06T02:57:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.316+0000 7f1053fff700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1040066f30 0x7f10400693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f10440099f0 tx=0x7f1044008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.320+0000 7f103bfff700 1 -- 172.21.15.84:0/382107113 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f104c051c70 con 0x7f10540cd400 2023-10-06T02:57:25.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.501+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f10540cc640 con 0x7f10540cd400 2023-10-06T02:57:25.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.501+0000 7f103bfff700 1 -- 172.21.15.84:0/382107113 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7f104c055290 con 0x7f10540cd400 2023-10-06T02:57:25.503 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:57:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.503+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1040066f30 msgr2=0x7f10400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.503+0000 7f10597ca700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1040066f30 0x7f10400693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f10440099f0 tx=0x7f1044008040 comp rx=0 tx=0).stop 2023-10-06T02:57:25.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.503+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 msgr2=0x7f10540c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.504+0000 7f10597ca700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 0x7f10540c9870 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f104c00ccc0 tx=0x7f104c001a20 comp rx=0 tx=0).stop 2023-10-06T02:57:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.504+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 shutdown_connections 2023-10-06T02:57:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.504+0000 7f10597ca700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1040066f30 0x7f10400693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.504+0000 7f10597ca700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10540b2660 0x7f10540c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.504+0000 7f10597ca700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10540cd400 0x7f10540c9870 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.504+0000 7f10597ca700 1 --2- 172.21.15.84:0/382107113 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10540b2a30 0x7f1054159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.504+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 >> 172.21.15.84:0/382107113 conn(0x7f1054099560 msgr2=0x7f1054156760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.504+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 shutdown_connections 2023-10-06T02:57:25.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.504+0000 7f10597ca700 1 -- 172.21.15.84:0/382107113 wait complete. 2023-10-06T02:57:25.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:57:25.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.630+0000 7fc1aa50d700 1 Processor -- start 2023-10-06T02:57:25.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.630+0000 7fc1aa50d700 1 -- start start 2023-10-06T02:57:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1aa50d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc1a40cbc70 0x7fc1a40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1aa50d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1a40b2140 0x7fc1a40b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1aa50d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a40cb7e0 con 0x7fc1a4159480 2023-10-06T02:57:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1aa50d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a40b08a0 con 0x7fc1a40b2140 2023-10-06T02:57:25.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1aa50d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a40cb190 con 0x7fc1a40cbc70 2023-10-06T02:57:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1a9d0c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1a40b2140 0x7fc1a40b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1a950b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc1a4159480 0x7fc1a40b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49764/0 (socket says 172.21.15.84:49764) 2023-10-06T02:57:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1a950b700 1 -- 172.21.15.84:0/1551861748 learned_addr learned my addr 172.21.15.84:0/1551861748 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1a8d0a700 1 --2- 172.21.15.84:0/1551861748 >> v2:172.21.15.131:3300/0 conn(0x7fc1a40cbc70 0x7fc1a40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1a9d0c700 1 -- 172.21.15.84:0/1551861748 >> v2:172.21.15.131:3300/0 conn(0x7fc1a40cbc70 msgr2=0x7fc1a40cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1a9d0c700 1 --2- 172.21.15.84:0/1551861748 >> v2:172.21.15.131:3300/0 conn(0x7fc1a40cbc70 0x7fc1a40cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1a9d0c700 1 -- 172.21.15.84:0/1551861748 >> v1:172.21.15.84:6789/0 conn(0x7fc1a4159480 legacy=0x7fc1a40b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1a9d0c700 1 -- 172.21.15.84:0/1551861748 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a40cb470 con 0x7fc1a40b2140 2023-10-06T02:57:25.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.631+0000 7fc1a8d0a700 1 --2- 172.21.15.84:0/1551861748 >> v2:172.21.15.131:3300/0 conn(0x7fc1a40cbc70 0x7fc1a40cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc1a9d0c700 1 --2- 172.21.15.84:0/1551861748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 0x7fc1a40b2560 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40d0260 tx=0x7fc19c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f7d1fb2c197c08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc19bfff700 1 -- 172.21.15.84:0/1551861748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00e070 con 0x7fc1a40b2140 2023-10-06T02:57:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc19bfff700 1 -- 172.21.15.84:0/1551861748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c00bc30 con 0x7fc1a40b2140 2023-10-06T02:57:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc19bfff700 1 -- 172.21.15.84:0/1551861748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c012430 con 0x7fc1a40b2140 2023-10-06T02:57:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1551861748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 msgr2=0x7fc1a40b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc1aa50d700 1 --2- 172.21.15.84:0/1551861748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 0x7fc1a40b2560 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40d0260 tx=0x7fc19c009780 comp rx=0 tx=0).stop 2023-10-06T02:57:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1551861748 shutdown_connections 2023-10-06T02:57:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc1aa50d700 1 --2- 172.21.15.84:0/1551861748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 0x7fc1a40b2560 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc1aa50d700 1 --2- 172.21.15.84:0/1551861748 >> v2:172.21.15.131:3300/0 conn(0x7fc1a40cbc70 0x7fc1a40cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1551861748 >> 172.21.15.84:0/1551861748 conn(0x7fc1a406ed20 msgr2=0x7fc1a406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:25.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1551861748 shutdown_connections 2023-10-06T02:57:25.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.632+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1551861748 wait complete. 2023-10-06T02:57:25.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.633+0000 7fc1aa50d700 1 Processor -- start 2023-10-06T02:57:25.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.633+0000 7fc1aa50d700 1 -- start start 2023-10-06T02:57:25.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1aa50d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 0x7fc1a416bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1aa50d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1a40cbc70 0x7fc1a415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1aa50d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1a4159480 0x7fc1a415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1aa50d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a415a980 con 0x7fc1a40b2140 2023-10-06T02:57:25.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1aa50d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4169b60 con 0x7fc1a40cbc70 2023-10-06T02:57:25.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1aa50d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a416c1e0 con 0x7fc1a4159480 2023-10-06T02:57:25.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1a950b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 0x7fc1a416bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1a950b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 0x7fc1a416bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33494/0 (socket says 172.21.15.84:33494) 2023-10-06T02:57:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1a950b700 1 -- 172.21.15.84:0/1740428569 learned_addr learned my addr 172.21.15.84:0/1740428569 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1a8d0a700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1a40cbc70 0x7fc1a415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.634+0000 7fc1a9d0c700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1a4159480 0x7fc1a415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1a950b700 1 -- 172.21.15.84:0/1740428569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1a4159480 msgr2=0x7fc1a415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1a950b700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1a4159480 0x7fc1a415c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1a950b700 1 -- 172.21.15.84:0/1740428569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1a40cbc70 msgr2=0x7fc1a415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1a950b700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1a40cbc70 0x7fc1a415beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1a950b700 1 -- 172.21.15.84:0/1740428569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c009a20 con 0x7fc1a40b2140 2023-10-06T02:57:25.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1a8d0a700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1a40cbc70 0x7fc1a415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1a950b700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 0x7fc1a416bca0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000c560 tx=0x7fc1a0001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1997fa700 1 -- 172.21.15.84:0/1740428569 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0005b30 con 0x7fc1a40b2140 2023-10-06T02:57:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1997fa700 1 -- 172.21.15.84:0/1740428569 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a0005cb0 con 0x7fc1a40b2140 2023-10-06T02:57:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1997fa700 1 -- 172.21.15.84:0/1740428569 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0007320 con 0x7fc1a40b2140 2023-10-06T02:57:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a4168f50 con 0x7fc1a40b2140 2023-10-06T02:57:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.635+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a4169510 con 0x7fc1a40b2140 2023-10-06T02:57:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.636+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a4169e40 con 0x7fc1a40b2140 2023-10-06T02:57:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.636+0000 7fc1997fa700 1 -- 172.21.15.84:0/1740428569 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1a001b3b0 con 0x7fc1a40b2140 2023-10-06T02:57:25.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.637+0000 7fc1997fa700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc188066f30 0x7fc1880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.637+0000 7fc1997fa700 1 -- 172.21.15.84:0/1740428569 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc1a00839a0 con 0x7fc1a40b2140 2023-10-06T02:57:25.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.637+0000 7fc1a8d0a700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc188066f30 0x7fc1880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.637+0000 7fc1a8d0a700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc188066f30 0x7fc1880693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4158e10 tx=0x7fc194006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.641+0000 7fc1997fa700 1 -- 172.21.15.84:0/1740428569 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1a0050cc0 con 0x7fc1a40b2140 2023-10-06T02:57:25.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.823+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc1a405f270 con 0x7fc1a40b2140 2023-10-06T02:57:25.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.824+0000 7fc1997fa700 1 -- 172.21.15.84:0/1740428569 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc1a0017020 con 0x7fc1a40b2140 2023-10-06T02:57:25.825 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:57:25.826 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T02:57:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc188066f30 msgr2=0x7fc1880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc188066f30 0x7fc1880693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4158e10 tx=0x7fc194006f90 comp rx=0 tx=0).stop 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 msgr2=0x7fc1a416bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 0x7fc1a416bca0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000c560 tx=0x7fc1a0001020 comp rx=0 tx=0).stop 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 shutdown_connections 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc188066f30 0x7fc1880693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1a4159480 0x7fc1a415c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1a40b2140 0x7fc1a416bca0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 --2- 172.21.15.84:0/1740428569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1a40cbc70 0x7fc1a415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 >> 172.21.15.84:0/1740428569 conn(0x7fc1a406ed20 msgr2=0x7fc1a40d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 shutdown_connections 2023-10-06T02:57:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.826+0000 7fc1aa50d700 1 -- 172.21.15.84:0/1740428569 wait complete. 2023-10-06T02:57:25.839 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:57:25.839 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:57:25.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.955+0000 7f2ccafa9700 1 Processor -- start 2023-10-06T02:57:25.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.955+0000 7f2ccafa9700 1 -- start start 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.956+0000 7f2ccafa9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2cc40b0760 0x7f2cc40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.956+0000 7f2ccafa9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40c30d0 0x7f2cc40c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.956+0000 7f2ccafa9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc40c4170 con 0x7f2cc40c4b40 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.956+0000 7f2ccafa9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc40c3560 con 0x7f2cc40b0760 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.956+0000 7f2ccafa9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40c3840 con 0x7f2cc40c30d0 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.956+0000 7f2cc9546700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2cc40c4b40 0x7f2cc40c8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49780/0 (socket says 172.21.15.84:49780) 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.956+0000 7f2cc9546700 1 -- 172.21.15.84:0/1235886951 learned_addr learned my addr 172.21.15.84:0/1235886951 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.956+0000 7f2cc8d45700 1 --2- 172.21.15.84:0/1235886951 >> v2:172.21.15.131:3300/0 conn(0x7f2cc40b0760 0x7f2cc40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cbbfff700 1 --2- 172.21.15.84:0/1235886951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40c30d0 0x7f2cc40c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/1235886951 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215065605 0 0) 0x7f2cc40c4170 con 0x7f2cc40c4b40 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/1235886951 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cac003570 con 0x7f2cc40c4b40 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cc8d45700 1 -- 172.21.15.84:0/1235886951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40c30d0 msgr2=0x7f2cc40c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cc8d45700 1 --2- 172.21.15.84:0/1235886951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40c30d0 0x7f2cc40c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cc8d45700 1 -- 172.21.15.84:0/1235886951 >> v1:172.21.15.84:6789/0 conn(0x7f2cc40c4b40 legacy=0x7f2cc40c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/1235886951 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1685227957 0 0) 0x7f2cac003570 con 0x7f2cc40c4b40 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cc8d45700 1 -- 172.21.15.84:0/1235886951 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc40c3b20 con 0x7f2cc40b0760 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cbbfff700 1 --2- 172.21.15.84:0/1235886951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40c30d0 0x7f2cc40c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cc8d45700 1 --2- 172.21.15.84:0/1235886951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cc40b0760 0x7f2cc40b10f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009eb0 tx=0x7f2cc0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d865c371a071436a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/1235886951 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc000e070 con 0x7f2cc40b0760 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/1235886951 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc000b900 con 0x7f2cc40b0760 2023-10-06T02:57:25.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.957+0000 7f2cbb7fe700 1 -- 172.21.15.84:0/1235886951 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc001470 con 0x7f2cc40b0760 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.958+0000 7f2ccafa9700 1 -- 172.21.15.84:0/1235886951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cc40b0760 msgr2=0x7f2cc40b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.958+0000 7f2ccafa9700 1 --2- 172.21.15.84:0/1235886951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cc40b0760 0x7f2cc40b10f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009eb0 tx=0x7f2cc0009780 comp rx=0 tx=0).stop 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.958+0000 7f2ccafa9700 1 -- 172.21.15.84:0/1235886951 shutdown_connections 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.958+0000 7f2ccafa9700 1 --2- 172.21.15.84:0/1235886951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cc40b0760 0x7f2cc40b10f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.958+0000 7f2ccafa9700 1 --2- 172.21.15.84:0/1235886951 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40c30d0 0x7f2cc40c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.958+0000 7f2ccafa9700 1 -- 172.21.15.84:0/1235886951 >> 172.21.15.84:0/1235886951 conn(0x7f2cc4088000 msgr2=0x7f2cc40ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.958+0000 7f2ccafa9700 1 -- 172.21.15.84:0/1235886951 shutdown_connections 2023-10-06T02:57:25.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.958+0000 7f2ccafa9700 1 -- 172.21.15.84:0/1235886951 wait complete. 2023-10-06T02:57:25.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.959+0000 7f2ccafa9700 1 Processor -- start 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.959+0000 7f2ccafa9700 1 -- start start 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2ccafa9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40b0760 0x7f2cc4157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2ccafa9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc40c30d0 0x7f2cc4167c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2ccafa9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cc40c4b40 0x7f2cc41681a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2ccafa9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc415a360 con 0x7f2cc40c30d0 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2ccafa9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40c86a0 con 0x7f2cc40c4b40 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2ccafa9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40b22e0 con 0x7f2cc40b0760 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc40c30d0 0x7f2cc4167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc40c30d0 0x7f2cc4167c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33510/0 (socket says 172.21.15.84:33510) 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cbbfff700 1 -- 172.21.15.84:0/3211204675 learned_addr learned my addr 172.21.15.84:0/3211204675 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cc8d45700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40b0760 0x7f2cc4157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cc9546700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cc40c4b40 0x7f2cc41681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cbbfff700 1 -- 172.21.15.84:0/3211204675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40b0760 msgr2=0x7f2cc4157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cbbfff700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40b0760 0x7f2cc4157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cbbfff700 1 -- 172.21.15.84:0/3211204675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cc40c4b40 msgr2=0x7f2cc41681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cbbfff700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cc40c4b40 0x7f2cc41681a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cbbfff700 1 -- 172.21.15.84:0/3211204675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb4009420 con 0x7f2cc40c30d0 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.960+0000 7f2cbbfff700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc40c30d0 0x7f2cc4167c60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400ece0 tx=0x7f2cb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.961+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/3211204675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400ee90 con 0x7f2cc40c30d0 2023-10-06T02:57:25.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.961+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/3211204675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb400cbe0 con 0x7f2cc40c30d0 2023-10-06T02:57:25.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.961+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc0009a20 con 0x7f2cc40c30d0 2023-10-06T02:57:25.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.961+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/3211204675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4013470 con 0x7f2cc40c30d0 2023-10-06T02:57:25.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.961+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc415a830 con 0x7f2cc40c30d0 2023-10-06T02:57:25.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.962+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc4064ad0 con 0x7f2cc40c30d0 2023-10-06T02:57:25.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.962+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/3211204675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cb4013820 con 0x7f2cc40c30d0 2023-10-06T02:57:25.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.962+0000 7f2cb8ff9700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2cb0066f30 0x7f2cb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:25.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.962+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/3211204675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2cb4084910 con 0x7f2cc40c30d0 2023-10-06T02:57:25.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.962+0000 7f2cc8d45700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2cb0066f30 0x7f2cb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:25.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.963+0000 7f2cc8d45700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2cb0066f30 0x7f2cb00693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00099a0 tx=0x7f2cc0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:25.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:25.966+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/3211204675 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cb4051c30 con 0x7f2cc40c30d0 2023-10-06T02:57:26.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:26.152+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2cc40b2420 con 0x7f2cc40c30d0 2023-10-06T02:57:27.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.135+0000 7f2cb8ff9700 1 -- 172.21.15.84:0/3211204675 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2cb40170b0 con 0x7f2cc40c30d0 2023-10-06T02:57:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2cb0066f30 msgr2=0x7f2cb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2cb0066f30 0x7f2cb00693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00099a0 tx=0x7f2cc0018000 comp rx=0 tx=0).stop 2023-10-06T02:57:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc40c30d0 msgr2=0x7f2cc4167c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc40c30d0 0x7f2cc4167c60 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400ece0 tx=0x7f2cb40091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 shutdown_connections 2023-10-06T02:57:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2cb0066f30 0x7f2cb00693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cc40c4b40 0x7f2cc41681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cc40b0760 0x7f2cc4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 --2- 172.21.15.84:0/3211204675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cc40c30d0 0x7f2cc4167c60 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.139+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 >> 172.21.15.84:0/3211204675 conn(0x7f2cc4088000 msgr2=0x7f2cc406b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.140+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 shutdown_connections 2023-10-06T02:57:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.140+0000 7f2ccafa9700 1 -- 172.21.15.84:0/3211204675 wait complete. 2023-10-06T02:57:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T02:57:27.157 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:57:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.280+0000 7f07374b0700 1 Processor -- start 2023-10-06T02:57:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.281+0000 7f07374b0700 1 -- start start 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.281+0000 7f07374b0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0730150820 0x7f0730157530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.281+0000 7f07374b0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f073006b900 0x7f07300ab160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.281+0000 7f07374b0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07300c7d10 con 0x7f073006b4b0 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f07374b0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300c91b0 con 0x7f073006b900 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f07374b0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073006bda0 con 0x7f0730150820 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0735a4d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f073006b900 0x7f07300ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0735a4d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f073006b900 0x7f07300ab160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33512/0 (socket says 172.21.15.84:33512) 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0735a4d700 1 -- 172.21.15.84:0/1887947362 learned_addr learned my addr 172.21.15.84:0/1887947362 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0735a4d700 1 -- 172.21.15.84:0/1887947362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0730150820 msgr2=0x7f0730157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f073524c700 1 --2- 172.21.15.84:0/1887947362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0730150820 0x7f0730157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0735a4d700 1 --2- 172.21.15.84:0/1887947362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0730150820 0x7f0730157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0735a4d700 1 -- 172.21.15.84:0/1887947362 >> v1:172.21.15.131:6789/0 conn(0x7f073006b4b0 legacy=0x7f073006e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:27.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0735a4d700 1 -- 172.21.15.84:0/1887947362 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073006c080 con 0x7f073006b900 2023-10-06T02:57:27.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0735a4d700 1 --2- 172.21.15.84:0/1887947362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b900 0x7f07300ab160 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0728009f20 tx=0x7f0728009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1654ae3549a01486 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:27.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0727fff700 1 -- 172.21.15.84:0/1887947362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072800e070 con 0x7f073006b900 2023-10-06T02:57:27.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0727fff700 1 -- 172.21.15.84:0/1887947362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072800ba40 con 0x7f073006b900 2023-10-06T02:57:27.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.282+0000 7f0727fff700 1 -- 172.21.15.84:0/1887947362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07280092e0 con 0x7f073006b900 2023-10-06T02:57:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.283+0000 7f07374b0700 1 -- 172.21.15.84:0/1887947362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b900 msgr2=0x7f07300ab160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.283+0000 7f07374b0700 1 --2- 172.21.15.84:0/1887947362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b900 0x7f07300ab160 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0728009f20 tx=0x7f0728009840 comp rx=0 tx=0).stop 2023-10-06T02:57:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.283+0000 7f07374b0700 1 -- 172.21.15.84:0/1887947362 shutdown_connections 2023-10-06T02:57:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.283+0000 7f07374b0700 1 --2- 172.21.15.84:0/1887947362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b900 0x7f07300ab160 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.283+0000 7f07374b0700 1 --2- 172.21.15.84:0/1887947362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0730150820 0x7f0730157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.283+0000 7f07374b0700 1 -- 172.21.15.84:0/1887947362 >> 172.21.15.84:0/1887947362 conn(0x7f07300691d0 msgr2=0x7f07300cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.283+0000 7f07374b0700 1 -- 172.21.15.84:0/1887947362 shutdown_connections 2023-10-06T02:57:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.283+0000 7f07374b0700 1 -- 172.21.15.84:0/1887947362 wait complete. 2023-10-06T02:57:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.284+0000 7f07374b0700 1 Processor -- start 2023-10-06T02:57:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.284+0000 7f07374b0700 1 -- start start 2023-10-06T02:57:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f07374b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b4b0 0x7f073014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f07374b0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073006b900 0x7f07300aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f07374b0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0730150820 0x7f07300b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f07374b0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0730168bb0 con 0x7f073006b4b0 2023-10-06T02:57:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f07374b0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07301501b0 con 0x7f0730150820 2023-10-06T02:57:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f07374b0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0730167fa0 con 0x7f073006b900 2023-10-06T02:57:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f073524c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b4b0 0x7f073014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f073524c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b4b0 0x7f073014fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33520/0 (socket says 172.21.15.84:33520) 2023-10-06T02:57:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f073524c700 1 -- 172.21.15.84:0/1709770249 learned_addr learned my addr 172.21.15.84:0/1709770249 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f0735a4d700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0730150820 0x7f07300b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f0734a4b700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073006b900 0x7f07300aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f073524c700 1 -- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073006b900 msgr2=0x7f07300aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f073524c700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073006b900 0x7f07300aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f073524c700 1 -- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0730150820 msgr2=0x7f07300b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f073524c700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0730150820 0x7f07300b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f073524c700 1 -- 172.21.15.84:0/1709770249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728009ae0 con 0x7f073006b4b0 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f0735a4d700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0730150820 0x7f07300b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f0734a4b700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073006b900 0x7f07300aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.285+0000 7f073524c700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b4b0 0x7f073014fc70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f072c00c880 tx=0x7f072c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.286+0000 7f07257fa700 1 -- 172.21.15.84:0/1709770249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c011600 con 0x7f073006b4b0 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.286+0000 7f07257fa700 1 -- 172.21.15.84:0/1709770249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c011780 con 0x7f073006b4b0 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.286+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0730168280 con 0x7f073006b4b0 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.286+0000 7f07257fa700 1 -- 172.21.15.84:0/1709770249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c011b40 con 0x7f073006b4b0 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.286+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0730168840 con 0x7f073006b4b0 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.287+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0730064ad0 con 0x7f073006b4b0 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.287+0000 7f07257fa700 1 -- 172.21.15.84:0/1709770249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f072c018360 con 0x7f073006b4b0 2023-10-06T02:57:27.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.287+0000 7f07257fa700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0714066f30 0x7f07140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:27.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.287+0000 7f07257fa700 1 -- 172.21.15.84:0/1709770249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f072c084300 con 0x7f073006b4b0 2023-10-06T02:57:27.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.287+0000 7f0734a4b700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0714066f30 0x7f07140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:27.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.288+0000 7f0734a4b700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0714066f30 0x7f07140693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0730153f00 tx=0x7f0720009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:27.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.292+0000 7f07257fa700 1 -- 172.21.15.84:0/1709770249 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f072c054f40 con 0x7f073006b4b0 2023-10-06T02:57:27.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:27.473+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f07300c79a0 con 0x7f073006b4b0 2023-10-06T02:57:28.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.140+0000 7f07257fa700 1 -- 172.21.15.84:0/1709770249 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v54) v1 ==== 170+0+0 (secure 0 0 0) 0x7f072c054ad0 con 0x7f073006b4b0 2023-10-06T02:57:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.143+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0714066f30 msgr2=0x7f07140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.143+0000 7f07374b0700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0714066f30 0x7f07140693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0730153f00 tx=0x7f0720009040 comp rx=0 tx=0).stop 2023-10-06T02:57:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.143+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b4b0 msgr2=0x7f073014fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.143+0000 7f07374b0700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b4b0 0x7f073014fc70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f072c00c880 tx=0x7f072c008040 comp rx=0 tx=0).stop 2023-10-06T02:57:28.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.144+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 shutdown_connections 2023-10-06T02:57:28.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.144+0000 7f07374b0700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0714066f30 0x7f07140693e0 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0730153f00 tx=0x7f0720009040 comp rx=0 tx=0).stop 2023-10-06T02:57:28.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.144+0000 7f07374b0700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0730150820 0x7f07300b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.144+0000 7f07374b0700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073006b4b0 0x7f073014fc70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.144+0000 7f07374b0700 1 --2- 172.21.15.84:0/1709770249 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073006b900 0x7f07300aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.144+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 >> 172.21.15.84:0/1709770249 conn(0x7f07300691d0 msgr2=0x7f07300cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:28.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.155+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 shutdown_connections 2023-10-06T02:57:28.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.155+0000 7f07374b0700 1 -- 172.21.15.84:0/1709770249 wait complete. 2023-10-06T02:57:28.157 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T02:57:28.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:57:28.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.286+0000 7f0f6c4d0700 1 Processor -- start 2023-10-06T02:57:28.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.286+0000 7f0f6c4d0700 1 -- start start 2023-10-06T02:57:28.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.287+0000 7f0f6c4d0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640cc860 0x7f0f640ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.287+0000 7f0f6c4d0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0f6406eff0 0x7f0f640c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.287+0000 7f0f6c4d0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f640cbfb0 con 0x7f0f640675f0 2023-10-06T02:57:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.287+0000 7f0f6c4d0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f64159c00 con 0x7f0f6406eff0 2023-10-06T02:57:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.287+0000 7f0f6c4d0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6406f460 con 0x7f0f640cc860 2023-10-06T02:57:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.287+0000 7f0f69a6b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0f6406eff0 0x7f0f640c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.287+0000 7f0f6aa6d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0f640675f0 0x7f0f640cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49784/0 (socket says 172.21.15.84:49784) 2023-10-06T02:57:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.287+0000 7f0f6aa6d700 1 -- 172.21.15.84:0/172157105 learned_addr learned my addr 172.21.15.84:0/172157105 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.287+0000 7f0f6a26c700 1 --2- 172.21.15.84:0/172157105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640cc860 0x7f0f640ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f69a6b700 1 -- 172.21.15.84:0/172157105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640cc860 msgr2=0x7f0f640ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f69a6b700 1 --2- 172.21.15.84:0/172157105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640cc860 0x7f0f640ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f69a6b700 1 -- 172.21.15.84:0/172157105 >> v1:172.21.15.84:6789/0 conn(0x7f0f640675f0 legacy=0x7f0f640cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f69a6b700 1 -- 172.21.15.84:0/172157105 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64159df0 con 0x7f0f6406eff0 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f6926a700 1 -- 172.21.15.84:0/172157105 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422509818 0 0) 0x7f0f640cbfb0 con 0x7f0f640675f0 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f69a6b700 1 --2- 172.21.15.84:0/172157105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 0x7f0f640c9260 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0f540098e0 tx=0x7f0f540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c75223a0a61ee62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f6926a700 1 -- 172.21.15.84:0/172157105 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400b640 con 0x7f0f6406eff0 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f6926a700 1 -- 172.21.15.84:0/172157105 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400b7a0 con 0x7f0f6406eff0 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f6926a700 1 -- 172.21.15.84:0/172157105 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400bb40 con 0x7f0f6406eff0 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.288+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/172157105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 msgr2=0x7f0f640c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.289+0000 7f0f6c4d0700 1 --2- 172.21.15.84:0/172157105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 0x7f0f640c9260 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0f540098e0 tx=0x7f0f540091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.289+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/172157105 shutdown_connections 2023-10-06T02:57:28.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.289+0000 7f0f6c4d0700 1 --2- 172.21.15.84:0/172157105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640cc860 0x7f0f640ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.289+0000 7f0f6c4d0700 1 --2- 172.21.15.84:0/172157105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 0x7f0f640c9260 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.289+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/172157105 >> 172.21.15.84:0/172157105 conn(0x7f0f640691d0 msgr2=0x7f0f640cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:28.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.289+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/172157105 shutdown_connections 2023-10-06T02:57:28.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.289+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/172157105 wait complete. 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.290+0000 7f0f6c4d0700 1 Processor -- start 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.290+0000 7f0f6c4d0700 1 -- start start 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.290+0000 7f0f6c4d0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640675f0 0x7f0f64154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.290+0000 7f0f6c4d0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 0x7f0f641581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.290+0000 7f0f6c4d0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f640cc860 0x7f0f640ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.290+0000 7f0f6c4d0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640b0100 con 0x7f0f6406eff0 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.290+0000 7f0f6c4d0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64159500 con 0x7f0f640cc860 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.290+0000 7f0f6c4d0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64158c60 con 0x7f0f640675f0 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.290+0000 7f0f69a6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 0x7f0f641581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f69a6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 0x7f0f641581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33536/0 (socket says 172.21.15.84:33536) 2023-10-06T02:57:28.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f69a6b700 1 -- 172.21.15.84:0/2701657341 learned_addr learned my addr 172.21.15.84:0/2701657341 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f6a26c700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640675f0 0x7f0f64154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f6aa6d700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f640cc860 0x7f0f640ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f69a6b700 1 -- 172.21.15.84:0/2701657341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640675f0 msgr2=0x7f0f64154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f69a6b700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640675f0 0x7f0f64154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f69a6b700 1 -- 172.21.15.84:0/2701657341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f640cc860 msgr2=0x7f0f640ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f69a6b700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f640cc860 0x7f0f640ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f69a6b700 1 -- 172.21.15.84:0/2701657341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54009420 con 0x7f0f6406eff0 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f6aa6d700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f640cc860 0x7f0f640ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f69a6b700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 0x7f0f641581e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0f6406dff0 tx=0x7f0f54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f5a7fc700 1 -- 172.21.15.84:0/2701657341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5401f070 con 0x7f0f6406eff0 2023-10-06T02:57:28.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f5a7fc700 1 -- 172.21.15.84:0/2701657341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400b910 con 0x7f0f6406eff0 2023-10-06T02:57:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f64158f40 con 0x7f0f6406eff0 2023-10-06T02:57:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f5a7fc700 1 -- 172.21.15.84:0/2701657341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54011420 con 0x7f0f6406eff0 2023-10-06T02:57:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.291+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f64154850 con 0x7f0f6406eff0 2023-10-06T02:57:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.292+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f640c7d10 con 0x7f0f6406eff0 2023-10-06T02:57:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.293+0000 7f0f5a7fc700 1 -- 172.21.15.84:0/2701657341 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f540117d0 con 0x7f0f6406eff0 2023-10-06T02:57:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.293+0000 7f0f5a7fc700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f48066f30 0x7f0f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.293+0000 7f0f6a26c700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f48066f30 0x7f0f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.293+0000 7f0f5a7fc700 1 -- 172.21.15.84:0/2701657341 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f0f54085b20 con 0x7f0f6406eff0 2023-10-06T02:57:28.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.294+0000 7f0f6a26c700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f48066f30 0x7f0f480693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009d10 tx=0x7f0f600091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:28.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.298+0000 7f0f5a7fc700 1 -- 172.21.15.84:0/2701657341 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f54052b50 con 0x7f0f6406eff0 2023-10-06T02:57:28.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:28.523+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0f64064ad0 con 0x7f0f6406eff0 2023-10-06T02:57:29.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.158+0000 7f0f5a7fc700 1 -- 172.21.15.84:0/2701657341 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0f540280c0 con 0x7f0f6406eff0 2023-10-06T02:57:29.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.163+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f48066f30 msgr2=0x7f0f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.163+0000 7f0f6c4d0700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f48066f30 0x7f0f480693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009d10 tx=0x7f0f600091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.163+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 msgr2=0x7f0f641581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.163+0000 7f0f6c4d0700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 0x7f0f641581e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0f6406dff0 tx=0x7f0f54017000 comp rx=0 tx=0).stop 2023-10-06T02:57:29.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.164+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 shutdown_connections 2023-10-06T02:57:29.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.164+0000 7f0f6c4d0700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f48066f30 0x7f0f480693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.164+0000 7f0f6c4d0700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f640cc860 0x7f0f640ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.164+0000 7f0f6c4d0700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f640675f0 0x7f0f64154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.164+0000 7f0f6c4d0700 1 --2- 172.21.15.84:0/2701657341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f6406eff0 0x7f0f641581e0 secure :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0f6406dff0 tx=0x7f0f54017000 comp rx=0 tx=0).stop 2023-10-06T02:57:29.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.164+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 >> 172.21.15.84:0/2701657341 conn(0x7f0f640691d0 msgr2=0x7f0f6406e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:29.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.164+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 shutdown_connections 2023-10-06T02:57:29.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.164+0000 7f0f6c4d0700 1 -- 172.21.15.84:0/2701657341 wait complete. 2023-10-06T02:57:29.167 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 8 and data pool 9 2023-10-06T02:57:29.182 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.295+0000 7f2adfe6e700 1 Processor -- start 2023-10-06T02:57:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.295+0000 7f2adfe6e700 1 -- start start 2023-10-06T02:57:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2adfe6e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 0x7f2ad80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2adfe6e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ad80b07a0 0x7f2ad80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2adfe6e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad80b0ca0 con 0x7f2ad80b49e0 2023-10-06T02:57:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2adfe6e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad80b0f80 con 0x7f2ad80b07a0 2023-10-06T02:57:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2adfe6e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80b1260 con 0x7f2ad81595a0 2023-10-06T02:57:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2ade40b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ad80b07a0 0x7f2ad80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2ade40b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ad80b07a0 0x7f2ad80b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33540/0 (socket says 172.21.15.84:33540) 2023-10-06T02:57:29.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2ade40b700 1 -- 172.21.15.84:0/1096745540 learned_addr learned my addr 172.21.15.84:0/1096745540 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2addc0a700 1 --2- 172.21.15.84:0/1096745540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 0x7f2ad80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2ade40b700 1 -- 172.21.15.84:0/1096745540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 msgr2=0x7f2ad80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2ade40b700 1 --2- 172.21.15.84:0/1096745540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 0x7f2ad80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2ade40b700 1 -- 172.21.15.84:0/1096745540 >> v1:172.21.15.131:6789/0 conn(0x7f2ad80b49e0 legacy=0x7f2ad80aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2ade40b700 1 -- 172.21.15.84:0/1096745540 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80b1540 con 0x7f2ad80b07a0 2023-10-06T02:57:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2ade40b700 1 --2- 172.21.15.84:0/1096745540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b07a0 0x7f2ad80b1c00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009f20 tx=0x7f2ad0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383a8bc63673f99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2adcc08700 1 -- 172.21.15.84:0/1096745540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000e070 con 0x7f2ad80b07a0 2023-10-06T02:57:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2adcc08700 1 -- 172.21.15.84:0/1096745540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad000b9d0 con 0x7f2ad80b07a0 2023-10-06T02:57:29.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.296+0000 7f2adcc08700 1 -- 172.21.15.84:0/1096745540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00092e0 con 0x7f2ad80b07a0 2023-10-06T02:57:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.297+0000 7f2adfe6e700 1 -- 172.21.15.84:0/1096745540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b07a0 msgr2=0x7f2ad80b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.297+0000 7f2adfe6e700 1 --2- 172.21.15.84:0/1096745540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b07a0 0x7f2ad80b1c00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009f20 tx=0x7f2ad0009840 comp rx=0 tx=0).stop 2023-10-06T02:57:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.297+0000 7f2adfe6e700 1 -- 172.21.15.84:0/1096745540 shutdown_connections 2023-10-06T02:57:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.297+0000 7f2adfe6e700 1 --2- 172.21.15.84:0/1096745540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b07a0 0x7f2ad80b1c00 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.297+0000 7f2adfe6e700 1 --2- 172.21.15.84:0/1096745540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 0x7f2ad80aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.297+0000 7f2adfe6e700 1 -- 172.21.15.84:0/1096745540 >> 172.21.15.84:0/1096745540 conn(0x7f2ad8099830 msgr2=0x7f2ad806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.297+0000 7f2adfe6e700 1 -- 172.21.15.84:0/1096745540 shutdown_connections 2023-10-06T02:57:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.297+0000 7f2adfe6e700 1 -- 172.21.15.84:0/1096745540 wait complete. 2023-10-06T02:57:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.298+0000 7f2adfe6e700 1 Processor -- start 2023-10-06T02:57:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.298+0000 7f2adfe6e700 1 -- start start 2023-10-06T02:57:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2adfe6e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad80b07a0 0x7f2ad816da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2adfe6e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b49e0 0x7f2ad81699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2adfe6e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 0x7f2ad80ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2adfe6e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad816af20 con 0x7f2ad80b49e0 2023-10-06T02:57:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2adfe6e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad816a2a0 con 0x7f2ad80b07a0 2023-10-06T02:57:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2adfe6e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad816a580 con 0x7f2ad81595a0 2023-10-06T02:57:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2add409700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b49e0 0x7f2ad81699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2add409700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b49e0 0x7f2ad81699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33554/0 (socket says 172.21.15.84:33554) 2023-10-06T02:57:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2add409700 1 -- 172.21.15.84:0/3449835974 learned_addr learned my addr 172.21.15.84:0/3449835974 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:29.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2addc0a700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad80b07a0 0x7f2ad816da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2ade40b700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 0x7f2ad80ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2add409700 1 -- 172.21.15.84:0/3449835974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 msgr2=0x7f2ad80ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2add409700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 0x7f2ad80ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2add409700 1 -- 172.21.15.84:0/3449835974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad80b07a0 msgr2=0x7f2ad816da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2add409700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad80b07a0 0x7f2ad816da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2add409700 1 -- 172.21.15.84:0/3449835974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0009ae0 con 0x7f2ad80b49e0 2023-10-06T02:57:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2add409700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b49e0 0x7f2ad81699a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800c7c0 tx=0x7f2ac8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2acdffb700 1 -- 172.21.15.84:0/3449835974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8011590 con 0x7f2ad80b49e0 2023-10-06T02:57:29.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.299+0000 7f2acdffb700 1 -- 172.21.15.84:0/3449835974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac80116f0 con 0x7f2ad80b49e0 2023-10-06T02:57:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.300+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad816a860 con 0x7f2ad80b49e0 2023-10-06T02:57:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.300+0000 7f2acdffb700 1 -- 172.21.15.84:0/3449835974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8011ab0 con 0x7f2ad80b49e0 2023-10-06T02:57:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.300+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad8169ee0 con 0x7f2ad80b49e0 2023-10-06T02:57:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.301+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad816b090 con 0x7f2ad80b49e0 2023-10-06T02:57:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.301+0000 7f2acdffb700 1 -- 172.21.15.84:0/3449835974 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ac801b3b0 con 0x7f2ad80b49e0 2023-10-06T02:57:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.301+0000 7f2acdffb700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2abc066f30 0x7f2abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.301+0000 7f2acdffb700 1 -- 172.21.15.84:0/3449835974 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2ac8083ba0 con 0x7f2ad80b49e0 2023-10-06T02:57:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.301+0000 7f2addc0a700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2abc066f30 0x7f2abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.302+0000 7f2addc0a700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2abc066f30 0x7f2abc0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009d00 tx=0x7f2ad4009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:29.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.306+0000 7f2acdffb700 1 -- 172.21.15.84:0/3449835974 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ac8050b70 con 0x7f2ad80b49e0 2023-10-06T02:57:29.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.489+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad8064ad0 con 0x7f2ad80b49e0 2023-10-06T02:57:29.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.490+0000 7f2acdffb700 1 -- 172.21.15.84:0/3449835974 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f2ac8017070 con 0x7f2ad80b49e0 2023-10-06T02:57:29.492 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:29.492 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":55,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:57:28.525456+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:26.170794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:27.492251+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2abc066f30 msgr2=0x7f2abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2abc066f30 0x7f2abc0693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009d00 tx=0x7f2ad4009120 comp rx=0 tx=0).stop 2023-10-06T02:57:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b49e0 msgr2=0x7f2ad81699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b49e0 0x7f2ad81699a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800c7c0 tx=0x7f2ac8007f50 comp rx=0 tx=0).stop 2023-10-06T02:57:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 shutdown_connections 2023-10-06T02:57:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2abc066f30 0x7f2abc0693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad80b07a0 0x7f2ad816da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ad81595a0 0x7f2ad80ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 --2- 172.21.15.84:0/3449835974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad80b49e0 0x7f2ad81699a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 >> 172.21.15.84:0/3449835974 conn(0x7f2ad8099830 msgr2=0x7f2ad80b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 shutdown_connections 2023-10-06T02:57:29.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.492+0000 7f2adfe6e700 1 -- 172.21.15.84:0/3449835974 wait complete. 2023-10-06T02:57:29.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:29.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.617+0000 7fc6366f5700 1 Processor -- start 2023-10-06T02:57:29.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.617+0000 7fc6366f5700 1 -- start start 2023-10-06T02:57:29.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc6366f5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc630068600 0x7fc630068a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc6366f5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6300aa460 0x7fc6300aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc6366f5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc630068fb0 con 0x7fc630159690 2023-10-06T02:57:29.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc6366f5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300a9fd0 con 0x7fc630068600 2023-10-06T02:57:29.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc6366f5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300abfe0 con 0x7fc6300aa460 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc62f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc630068600 0x7fc630068a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc62f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc630068600 0x7fc630068a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33564/0 (socket says 172.21.15.84:33564) 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc62f7fe700 1 -- 172.21.15.84:0/2628436918 learned_addr learned my addr 172.21.15.84:0/2628436918 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc634c92700 1 --2- 172.21.15.84:0/2628436918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6300aa460 0x7fc6300aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc62f7fe700 1 -- 172.21.15.84:0/2628436918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6300aa460 msgr2=0x7fc6300aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc62f7fe700 1 --2- 172.21.15.84:0/2628436918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6300aa460 0x7fc6300aa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc62f7fe700 1 -- 172.21.15.84:0/2628436918 >> v1:172.21.15.131:6789/0 conn(0x7fc630159690 legacy=0x7fc6300ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.618+0000 7fc62f7fe700 1 -- 172.21.15.84:0/2628436918 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300abd00 con 0x7fc630068600 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc62f7fe700 1 --2- 172.21.15.84:0/2628436918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 0x7fc630068a70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc6240099b0 tx=0x7fc624009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e494dd22c0345013 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:29.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc62effd700 1 -- 172.21.15.84:0/2628436918 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624009ea0 con 0x7fc630068600 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc62effd700 1 -- 172.21.15.84:0/2628436918 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62400b860 con 0x7fc630068600 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc62effd700 1 -- 172.21.15.84:0/2628436918 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400bc00 con 0x7fc630068600 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc6366f5700 1 -- 172.21.15.84:0/2628436918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 msgr2=0x7fc630068a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc6366f5700 1 --2- 172.21.15.84:0/2628436918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 0x7fc630068a70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc6240099b0 tx=0x7fc624009250 comp rx=0 tx=0).stop 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc6366f5700 1 -- 172.21.15.84:0/2628436918 shutdown_connections 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc6366f5700 1 --2- 172.21.15.84:0/2628436918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6300aa460 0x7fc6300aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc6366f5700 1 --2- 172.21.15.84:0/2628436918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 0x7fc630068a70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc6366f5700 1 -- 172.21.15.84:0/2628436918 >> 172.21.15.84:0/2628436918 conn(0x7fc63006de80 msgr2=0x7fc63006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc6366f5700 1 -- 172.21.15.84:0/2628436918 shutdown_connections 2023-10-06T02:57:29.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.619+0000 7fc6366f5700 1 -- 172.21.15.84:0/2628436918 wait complete. 2023-10-06T02:57:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.620+0000 7fc6366f5700 1 Processor -- start 2023-10-06T02:57:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc6366f5700 1 -- start start 2023-10-06T02:57:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc6366f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 0x7fc63014b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc6366f5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6300aa460 0x7fc6300b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc6366f5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc630159690 0x7fc6300b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc6366f5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc630159da0 con 0x7fc630068600 2023-10-06T02:57:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc6366f5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63014beb0 con 0x7fc6300aa460 2023-10-06T02:57:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc6366f5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63006b9b0 con 0x7fc630159690 2023-10-06T02:57:29.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc62ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 0x7fc63014b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc62ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 0x7fc63014b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33572/0 (socket says 172.21.15.84:33572) 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc62ffff700 1 -- 172.21.15.84:0/3685587942 learned_addr learned my addr 172.21.15.84:0/3685587942 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc634c92700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc630159690 0x7fc6300b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.621+0000 7fc62f7fe700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6300aa460 0x7fc6300b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc62ffff700 1 -- 172.21.15.84:0/3685587942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc630159690 msgr2=0x7fc6300b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc62ffff700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc630159690 0x7fc6300b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc62ffff700 1 -- 172.21.15.84:0/3685587942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6300aa460 msgr2=0x7fc6300b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc62ffff700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6300aa460 0x7fc6300b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc62ffff700 1 -- 172.21.15.84:0/3685587942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240094f0 con 0x7fc630068600 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc62ffff700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 0x7fc63014b970 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c570 tx=0x7fc620001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:29.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc617fff700 1 -- 172.21.15.84:0/3685587942 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620011590 con 0x7fc630068600 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc617fff700 1 -- 172.21.15.84:0/3685587942 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6200116f0 con 0x7fc630068600 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6301538b0 con 0x7fc630068600 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc617fff700 1 -- 172.21.15.84:0/3685587942 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620011ab0 con 0x7fc630068600 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.622+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc630153260 con 0x7fc630068600 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.623+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc630064ad0 con 0x7fc630068600 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.623+0000 7fc617fff700 1 -- 172.21.15.84:0/3685587942 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc62001b3b0 con 0x7fc630068600 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.624+0000 7fc617fff700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc61c066f60 0x7fc61c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.624+0000 7fc617fff700 1 -- 172.21.15.84:0/3685587942 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc620083b20 con 0x7fc630068600 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.624+0000 7fc62f7fe700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc61c066f60 0x7fc61c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.624+0000 7fc62f7fe700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc61c066f60 0x7fc61c069410 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc6240099b0 tx=0x7fc624017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:29.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.628+0000 7fc617fff700 1 -- 172.21.15.84:0/3685587942 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc620050ba0 con 0x7fc630068600 2023-10-06T02:57:29.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.810+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc63004bb80 con 0x7fc630068600 2023-10-06T02:57:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.811+0000 7fc617fff700 1 -- 172.21.15.84:0/3685587942 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17084 (secure 0 0 0) 0x7fc620017070 con 0x7fc630068600 2023-10-06T02:57:29.813 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:29.813 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":55,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:57:28.525456+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:26.170794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:27.492251+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc61c066f60 msgr2=0x7fc61c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc61c066f60 0x7fc61c069410 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc6240099b0 tx=0x7fc624017000 comp rx=0 tx=0).stop 2023-10-06T02:57:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 msgr2=0x7fc63014b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 0x7fc63014b970 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c570 tx=0x7fc620001070 comp rx=0 tx=0).stop 2023-10-06T02:57:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 shutdown_connections 2023-10-06T02:57:29.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc61c066f60 0x7fc61c069410 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc630159690 0x7fc6300b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc630068600 0x7fc63014b970 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 --2- 172.21.15.84:0/3685587942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6300aa460 0x7fc6300b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 >> 172.21.15.84:0/3685587942 conn(0x7fc63006de80 msgr2=0x7fc63014e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 shutdown_connections 2023-10-06T02:57:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.813+0000 7fc6366f5700 1 -- 172.21.15.84:0/3685587942 wait complete. 2023-10-06T02:57:29.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:57:29.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.942+0000 7f965e3e3700 1 Processor -- start 2023-10-06T02:57:29.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.942+0000 7f965e3e3700 1 -- start start 2023-10-06T02:57:29.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965e3e3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f96581598e0 0x7f96580ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965e3e3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 0x7f96580ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965e3e3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96580cf610 con 0x7f9658159510 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965e3e3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96580cf8f0 con 0x7f96581598e0 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965e3e3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96580cfbd0 con 0x7f96580cbcb0 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f9657fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9658159510 0x7f96580cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49788/0 (socket says 172.21.15.84:49788) 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f9657fff700 1 -- 172.21.15.84:0/3395525056 learned_addr learned my addr 172.21.15.84:0/3395525056 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965c980700 1 --2- 172.21.15.84:0/3395525056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 0x7f96580ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f96577fe700 1 --2- 172.21.15.84:0/3395525056 >> v2:172.21.15.131:3300/0 conn(0x7f96581598e0 0x7f96580ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f9656ffd700 1 -- 172.21.15.84:0/3395525056 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965569953 0 0) 0x7f96580cf610 con 0x7f9658159510 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f9656ffd700 1 -- 172.21.15.84:0/3395525056 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9640003570 con 0x7f9658159510 2023-10-06T02:57:29.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965c980700 1 -- 172.21.15.84:0/3395525056 >> v2:172.21.15.131:3300/0 conn(0x7f96581598e0 msgr2=0x7f96580ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965c980700 1 --2- 172.21.15.84:0/3395525056 >> v2:172.21.15.131:3300/0 conn(0x7f96581598e0 0x7f96580ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965c980700 1 -- 172.21.15.84:0/3395525056 >> v1:172.21.15.84:6789/0 conn(0x7f9658159510 legacy=0x7f96580cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f965c980700 1 -- 172.21.15.84:0/3395525056 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580cfeb0 con 0x7f96580cbcb0 2023-10-06T02:57:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.943+0000 7f96577fe700 1 --2- 172.21.15.84:0/3395525056 >> v2:172.21.15.131:3300/0 conn(0x7f96581598e0 0x7f96580ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f965c980700 1 --2- 172.21.15.84:0/3395525056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 0x7f96580ced60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9650009e60 tx=0x7f9650009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7021babf2c517379 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f9656ffd700 1 -- 172.21.15.84:0/3395525056 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965000e070 con 0x7f96580cbcb0 2023-10-06T02:57:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f9656ffd700 1 -- 172.21.15.84:0/3395525056 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965000bab0 con 0x7f96580cbcb0 2023-10-06T02:57:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f9656ffd700 1 -- 172.21.15.84:0/3395525056 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965000be30 con 0x7f96580cbcb0 2023-10-06T02:57:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f965e3e3700 1 -- 172.21.15.84:0/3395525056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 msgr2=0x7f96580ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f965e3e3700 1 --2- 172.21.15.84:0/3395525056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 0x7f96580ced60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9650009e60 tx=0x7f9650009780 comp rx=0 tx=0).stop 2023-10-06T02:57:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f965e3e3700 1 -- 172.21.15.84:0/3395525056 shutdown_connections 2023-10-06T02:57:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f965e3e3700 1 --2- 172.21.15.84:0/3395525056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 0x7f96580ced60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f965e3e3700 1 --2- 172.21.15.84:0/3395525056 >> v2:172.21.15.131:3300/0 conn(0x7f96581598e0 0x7f96580ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.944+0000 7f965e3e3700 1 -- 172.21.15.84:0/3395525056 >> 172.21.15.84:0/3395525056 conn(0x7f9658089e90 msgr2=0x7f96580997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.945+0000 7f965e3e3700 1 -- 172.21.15.84:0/3395525056 shutdown_connections 2023-10-06T02:57:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.945+0000 7f965e3e3700 1 -- 172.21.15.84:0/3395525056 wait complete. 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.946+0000 7f965e3e3700 1 Processor -- start 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.946+0000 7f965e3e3700 1 -- start start 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.946+0000 7f965e3e3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 0x7f965814a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.946+0000 7f965e3e3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9658159510 0x7f9658151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.946+0000 7f965e3e3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96581598e0 0x7f965814f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.946+0000 7f965e3e3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965814ad40 con 0x7f9658159510 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.946+0000 7f965e3e3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965814ee10 con 0x7f96581598e0 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.946+0000 7f965e3e3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96581518e0 con 0x7f96580cbcb0 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f96577fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9658159510 0x7f9658151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f96577fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9658159510 0x7f9658151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33588/0 (socket says 172.21.15.84:33588) 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f96577fe700 1 -- 172.21.15.84:0/4122203380 learned_addr learned my addr 172.21.15.84:0/4122203380 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f9657fff700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 0x7f965814a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f965c980700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96581598e0 0x7f965814f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f96577fe700 1 -- 172.21.15.84:0/4122203380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 msgr2=0x7f965814a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f96577fe700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 0x7f965814a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f96577fe700 1 -- 172.21.15.84:0/4122203380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96581598e0 msgr2=0x7f965814f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f96577fe700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96581598e0 0x7f965814f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f96577fe700 1 -- 172.21.15.84:0/4122203380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964c009420 con 0x7f9658159510 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f96577fe700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9658159510 0x7f9658151040 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f964c00ea50 tx=0x7f964c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f963ffff700 1 -- 172.21.15.84:0/4122203380 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c009660 con 0x7f9658159510 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f963ffff700 1 -- 172.21.15.84:0/4122203380 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c00ee90 con 0x7f9658159510 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9650009a20 con 0x7f9658159510 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f963ffff700 1 -- 172.21.15.84:0/4122203380 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00caa0 con 0x7f9658159510 2023-10-06T02:57:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.947+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965814eaa0 con 0x7f9658159510 2023-10-06T02:57:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.948+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965814efc0 con 0x7f9658159510 2023-10-06T02:57:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.949+0000 7f963ffff700 1 -- 172.21.15.84:0/4122203380 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f964c013470 con 0x7f9658159510 2023-10-06T02:57:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.949+0000 7f963ffff700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9644066f30 0x7f96440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.949+0000 7f963ffff700 1 -- 172.21.15.84:0/4122203380 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f964c0848b0 con 0x7f9658159510 2023-10-06T02:57:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.949+0000 7f9657fff700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9644066f30 0x7f96440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.949+0000 7f9657fff700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9644066f30 0x7f96440693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9648007fd0 tx=0x7f9648009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:29.953+0000 7f963ffff700 1 -- 172.21.15.84:0/4122203380 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f965814efc0 con 0x7f9658159510 2023-10-06T02:57:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:30.184+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f965814ef80 con 0x7f9658159510 2023-10-06T02:57:31.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.169+0000 7f963ffff700 1 -- 172.21.15.84:0/4122203380 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7f964c055080 con 0x7f9658159510 2023-10-06T02:57:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9644066f30 msgr2=0x7f96440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9644066f30 0x7f96440693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9648007fd0 tx=0x7f9648009040 comp rx=0 tx=0).stop 2023-10-06T02:57:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9658159510 msgr2=0x7f9658151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9658159510 0x7f9658151040 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f964c00ea50 tx=0x7f964c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 shutdown_connections 2023-10-06T02:57:31.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9644066f30 0x7f96440693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96581598e0 0x7f965814f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96580cbcb0 0x7f965814a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 --2- 172.21.15.84:0/4122203380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9658159510 0x7f9658151040 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 >> 172.21.15.84:0/4122203380 conn(0x7f9658089e90 msgr2=0x7f96580ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:31.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 shutdown_connections 2023-10-06T02:57:31.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.171+0000 7f965e3e3700 1 -- 172.21.15.84:0/4122203380 wait complete. 2023-10-06T02:57:31.186 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:57:31.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.301+0000 7f6ccb8f5700 1 Processor -- start 2023-10-06T02:57:31.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.302+0000 7f6ccb8f5700 1 -- start start 2023-10-06T02:57:31.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.302+0000 7f6ccb8f5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc41598e0 0x7f6cc40ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.302+0000 7f6ccb8f5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cc40cbcb0 0x7f6cc40ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.302+0000 7f6ccb8f5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc40cf610 con 0x7f6cc4159510 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.302+0000 7f6ccb8f5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc40cf8f0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.302+0000 7f6ccb8f5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40cfbd0 con 0x7f6cc41598e0 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cc9e92700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cc40cbcb0 0x7f6cc40ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cc9e92700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cc40cbcb0 0x7f6cc40ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33594/0 (socket says 172.21.15.84:33594) 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cc9e92700 1 -- 172.21.15.84:0/947911636 learned_addr learned my addr 172.21.15.84:0/947911636 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cc8e90700 1 --2- 172.21.15.84:0/947911636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc41598e0 0x7f6cc40ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cc9e92700 1 -- 172.21.15.84:0/947911636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc41598e0 msgr2=0x7f6cc40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cc9e92700 1 --2- 172.21.15.84:0/947911636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc41598e0 0x7f6cc40ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cc9e92700 1 -- 172.21.15.84:0/947911636 >> v1:172.21.15.131:6789/0 conn(0x7f6cc4159510 legacy=0x7f6cc40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cc9e92700 1 -- 172.21.15.84:0/947911636 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40cfeb0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cc9e92700 1 --2- 172.21.15.84:0/947911636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 0x7f6cc40ced60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0099b0 tx=0x7f6cbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4974050d9bc061 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cbbfff700 1 -- 172.21.15.84:0/947911636 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00b860 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cbbfff700 1 -- 172.21.15.84:0/947911636 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc00b9c0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.303+0000 7f6cbbfff700 1 -- 172.21.15.84:0/947911636 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc00bd60 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.304+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/947911636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 msgr2=0x7f6cc40ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.304+0000 7f6ccb8f5700 1 --2- 172.21.15.84:0/947911636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 0x7f6cc40ced60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0099b0 tx=0x7f6cbc009250 comp rx=0 tx=0).stop 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.304+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/947911636 shutdown_connections 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.304+0000 7f6ccb8f5700 1 --2- 172.21.15.84:0/947911636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 0x7f6cc40ced60 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.304+0000 7f6ccb8f5700 1 --2- 172.21.15.84:0/947911636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc41598e0 0x7f6cc40ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.304+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/947911636 >> 172.21.15.84:0/947911636 conn(0x7f6cc4089e90 msgr2=0x7f6cc40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:31.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.304+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/947911636 shutdown_connections 2023-10-06T02:57:31.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.304+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/947911636 wait complete. 2023-10-06T02:57:31.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.305+0000 7f6ccb8f5700 1 Processor -- start 2023-10-06T02:57:31.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.305+0000 7f6ccb8f5700 1 -- start start 2023-10-06T02:57:31.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6ccb8f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 0x7f6cc414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:31.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6ccb8f5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc4159510 0x7f6cc415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6ccb8f5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cc41598e0 0x7f6cc415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6ccb8f5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc414ca60 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6ccb8f5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc414d5e0 con 0x7f6cc41598e0 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6ccb8f5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc414da70 con 0x7f6cc4159510 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9691700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 0x7f6cc414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9691700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 0x7f6cc414b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33596/0 (socket says 172.21.15.84:33596) 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9691700 1 -- 172.21.15.84:0/3957734635 learned_addr learned my addr 172.21.15.84:0/3957734635 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9e92700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cc41598e0 0x7f6cc415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc8e90700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc4159510 0x7f6cc415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9691700 1 -- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc4159510 msgr2=0x7f6cc415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9691700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc4159510 0x7f6cc415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9691700 1 -- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cc41598e0 msgr2=0x7f6cc415d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9691700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cc41598e0 0x7f6cc415d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9691700 1 -- 172.21.15.84:0/3957734635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0094f0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc9e92700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cc41598e0 0x7f6cc415d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.306+0000 7f6cc8e90700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc4159510 0x7f6cc415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.307+0000 7f6cc9691700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 0x7f6cc414b3b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000cb40 tx=0x7f6cc00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.307+0000 7f6cb97fa700 1 -- 172.21.15.84:0/3957734635 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000a7a0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.307+0000 7f6cb97fa700 1 -- 172.21.15.84:0/3957734635 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc000a920 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.307+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc414ccb0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.307+0000 7f6cb97fa700 1 -- 172.21.15.84:0/3957734635 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000ace0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.307+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc414d270 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.308+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc4064ad0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.308+0000 7f6cb97fa700 1 -- 172.21.15.84:0/3957734635 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cc0003030 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.308+0000 7f6cb97fa700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ca8066f30 0x7f6ca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.308+0000 7f6cb97fa700 1 -- 172.21.15.84:0/3957734635 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6cc0084930 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.308+0000 7f6cc8e90700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ca8066f30 0x7f6ca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.309+0000 7f6cc8e90700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ca8066f30 0x7f6ca80693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6cc415e1c0 tx=0x7f6cb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:31.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.313+0000 7f6cb97fa700 1 -- 172.21.15.84:0/3957734635 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cc00519b0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:31.538+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6cc40cf2a0 con 0x7f6cc40cbcb0 2023-10-06T02:57:31.837 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T02:57:31.835+0000 7f011a10e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:57:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.178+0000 7f6cb97fa700 1 -- 172.21.15.84:0/3957734635 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6cc0054fd0 con 0x7f6cc40cbcb0 2023-10-06T02:57:32.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ca8066f30 msgr2=0x7f6ca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ca8066f30 0x7f6ca80693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6cc415e1c0 tx=0x7f6cb4008040 comp rx=0 tx=0).stop 2023-10-06T02:57:32.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 msgr2=0x7f6cc414b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 0x7f6cc414b3b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000cb40 tx=0x7f6cc00017b0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 shutdown_connections 2023-10-06T02:57:32.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6ca8066f30 0x7f6ca80693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cc41598e0 0x7f6cc415d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cc40cbcb0 0x7f6cc414b3b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 --2- 172.21.15.84:0/3957734635 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cc4159510 0x7f6cc415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 >> 172.21.15.84:0/3957734635 conn(0x7f6cc4089e90 msgr2=0x7f6cc414c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:32.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 shutdown_connections 2023-10-06T02:57:32.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.180+0000 7f6ccb8f5700 1 -- 172.21.15.84:0/3957734635 wait complete. 2023-10-06T02:57:32.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:32.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.308+0000 7fa2f54ab700 1 Processor -- start 2023-10-06T02:57:32.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.308+0000 7fa2f54ab700 1 -- start start 2023-10-06T02:57:32.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2f54ab700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f00cbc70 0x7fa2f00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2f54ab700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f00cb7e0 con 0x7fa2f00b2140 2023-10-06T02:57:32.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2f54ab700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f00b08a0 con 0x7fa2f0159480 2023-10-06T02:57:32.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2f54ab700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00cb190 con 0x7fa2f00cbc70 2023-10-06T02:57:32.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2f4caa700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa2f00b2140 0x7fa2f00b25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49790/0 (socket says 172.21.15.84:49790) 2023-10-06T02:57:32.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2f4caa700 1 -- 172.21.15.84:0/858560038 learned_addr learned my addr 172.21.15.84:0/858560038 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2ef7fe700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f00cbc70 0x7fa2f00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371360776 0 0) 0x7fa2f00cb7e0 con 0x7fa2f00b2140 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d8003570 con 0x7fa2f00b2140 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.309+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844707687 0 0) 0x7fa2f00b08a0 con 0x7fa2f0159480 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f00cb7e0 con 0x7fa2f0159480 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1753361127 0 0) 0x7fa2d8003570 con 0x7fa2f00b2140 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f00cbc70 msgr2=0x7fa2f00cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f00cbc70 0x7fa2f00cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 >> v1:172.21.15.131:6789/0 conn(0x7fa2f0159480 legacy=0x7fa2f00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00cb470 con 0x7fa2f00b2140 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fa2e80017f0 con 0x7fa2f00b2140 2023-10-06T02:57:32.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 >> v1:172.21.15.84:6789/0 conn(0x7fa2f00b2140 legacy=0x7fa2f00b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2d8003c20 0x7fa2d8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f00cbc70 0x7fa2d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d8004d50 0x7fa2d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00cb190 con 0x7fa2d8004d50 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d800bb40 con 0x7fa2d8003c20 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d800bd00 con 0x7fa2f00cbc70 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2f4caa700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d8004d50 0x7fa2d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2effff700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2d8003c20 0x7fa2d8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2ef7fe700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f00cbc70 0x7fa2d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2f4caa700 1 -- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f00cbc70 msgr2=0x7fa2d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2f4caa700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f00cbc70 0x7fa2d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2f4caa700 1 -- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2d8003c20 msgr2=0x7fa2d8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2f4caa700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2d8003c20 0x7fa2d8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2f4caa700 1 -- 172.21.15.84:0/858560038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8003570 con 0x7fa2d8004d50 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2f4caa700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d8004d50 0x7fa2d80051c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800a8d0 tx=0x7fa2e8002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c67f09d262dede2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e80070d0 con 0x7fa2d8004d50 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8007230 con 0x7fa2d8004d50 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.310+0000 7fa2eeffd700 1 -- 172.21.15.84:0/858560038 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e80075f0 con 0x7fa2d8004d50 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.311+0000 7fa2f54ab700 1 -- 172.21.15.84:0/858560038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d8004d50 msgr2=0x7fa2d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.311+0000 7fa2f54ab700 1 --2- 172.21.15.84:0/858560038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2d8004d50 0x7fa2d80051c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800a8d0 tx=0x7fa2e8002190 comp rx=0 tx=0).stop 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.311+0000 7fa2f4caa700 1 -- 172.21.15.84:0/858560038 reap_dead start 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.311+0000 7fa2f54ab700 1 -- 172.21.15.84:0/858560038 shutdown_connections 2023-10-06T02:57:32.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.311+0000 7fa2f54ab700 1 -- 172.21.15.84:0/858560038 >> 172.21.15.84:0/858560038 conn(0x7fa2f006ed20 msgr2=0x7fa2f006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:32.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.311+0000 7fa2f54ab700 1 -- 172.21.15.84:0/858560038 shutdown_connections 2023-10-06T02:57:32.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.311+0000 7fa2f54ab700 1 -- 172.21.15.84:0/858560038 wait complete. 2023-10-06T02:57:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.312+0000 7fa2f54ab700 1 Processor -- start 2023-10-06T02:57:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.312+0000 7fa2f54ab700 1 -- start start 2023-10-06T02:57:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f54ab700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f016c960 0x7fa2f00c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f54ab700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2f016cd30 0x7fa2f01541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f54ab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2f0154710 0x7fa2f015efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f54ab700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f016a220 con 0x7fa2f0154710 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f54ab700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00c8d10 con 0x7fa2f016cd30 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f54ab700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00ce240 con 0x7fa2f016c960 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f4caa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2f0154710 0x7fa2f015efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f4caa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2f0154710 0x7fa2f015efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33600/0 (socket says 172.21.15.84:33600) 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f4caa700 1 -- 172.21.15.84:0/3919396945 learned_addr learned my addr 172.21.15.84:0/3919396945 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2ef7fe700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2f016cd30 0x7fa2f01541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f4caa700 1 -- 172.21.15.84:0/3919396945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f016c960 msgr2=0x7fa2f00c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f4caa700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f016c960 0x7fa2f00c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f4caa700 1 -- 172.21.15.84:0/3919396945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2f016cd30 msgr2=0x7fa2f01541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f4caa700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2f016cd30 0x7fa2f01541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f4caa700 1 -- 172.21.15.84:0/3919396945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00c8f60 con 0x7fa2f0154710 2023-10-06T02:57:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.313+0000 7fa2f4caa700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2f0154710 0x7fa2f015efb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8000f80 tx=0x7fa2e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.314+0000 7fa2d7fff700 1 -- 172.21.15.84:0/3919396945 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8023070 con 0x7fa2f0154710 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.314+0000 7fa2d7fff700 1 -- 172.21.15.84:0/3919396945 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8007af0 con 0x7fa2f0154710 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.314+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f00c9240 con 0x7fa2f0154710 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.314+0000 7fa2d7fff700 1 -- 172.21.15.84:0/3919396945 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e801e8b0 con 0x7fa2f0154710 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.314+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f00ca500 con 0x7fa2f0154710 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.314+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f005f270 con 0x7fa2f0154710 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.315+0000 7fa2d7fff700 1 -- 172.21.15.84:0/3919396945 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2e801ec60 con 0x7fa2f0154710 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.315+0000 7fa2d7fff700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2dc066f30 0x7fa2dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.315+0000 7fa2d7fff700 1 -- 172.21.15.84:0/3919396945 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa2e80862a0 con 0x7fa2f0154710 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.315+0000 7fa2effff700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2dc066f30 0x7fa2dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.316+0000 7fa2effff700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2dc066f30 0x7fa2dc0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0007e40 tx=0x7fa2e0007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:32.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.320+0000 7fa2d7fff700 1 -- 172.21.15.84:0/3919396945 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2e8053270 con 0x7fa2f0154710 2023-10-06T02:57:32.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.544+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2f00ce3d0 con 0x7fa2f0154710 2023-10-06T02:57:32.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.544+0000 7fa2d7fff700 1 -- 172.21.15.84:0/3919396945 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fa2e8056890 con 0x7fa2f0154710 2023-10-06T02:57:32.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:32.546 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5778,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:57:32.169083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2dc066f30 msgr2=0x7fa2dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2dc066f30 0x7fa2dc0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0007e40 tx=0x7fa2e0007d30 comp rx=0 tx=0).stop 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2f0154710 msgr2=0x7fa2f015efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2f0154710 0x7fa2f015efb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8000f80 tx=0x7fa2e8016000 comp rx=0 tx=0).stop 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 shutdown_connections 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2dc066f30 0x7fa2dc0693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2f0154710 0x7fa2f015efb0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2f016c960 0x7fa2f00c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 --2- 172.21.15.84:0/3919396945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2f016cd30 0x7fa2f01541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 >> 172.21.15.84:0/3919396945 conn(0x7fa2f006ed20 msgr2=0x7fa2f0155240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:32.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 shutdown_connections 2023-10-06T02:57:32.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.546+0000 7fa2f54ab700 1 -- 172.21.15.84:0/3919396945 wait complete. 2023-10-06T02:57:32.549 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 34 2023-10-06T02:57:32.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:57:32.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.672+0000 7f63db081700 1 Processor -- start 2023-10-06T02:57:32.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.672+0000 7f63db081700 1 -- start start 2023-10-06T02:57:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63db081700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63d40b07a0 0x7f63d40ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63db081700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d40b0ca0 con 0x7f63d41595a0 2023-10-06T02:57:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63db081700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d40b0f80 con 0x7f63d40b49e0 2023-10-06T02:57:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63db081700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d40ab390 con 0x7f63d40b07a0 2023-10-06T02:57:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63d961e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63d40b07a0 0x7f63d40ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63d8e1d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f63d41595a0 0x7f63d40aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48152/0 (socket says 172.21.15.84:48152) 2023-10-06T02:57:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63d8e1d700 1 -- 172.21.15.84:0/1807666168 learned_addr learned my addr 172.21.15.84:0/1807666168 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:32.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63d961e700 1 -- 172.21.15.84:0/1807666168 >> v1:172.21.15.131:6789/0 conn(0x7f63d40b49e0 legacy=0x7f63d40aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63d961e700 1 -- 172.21.15.84:0/1807666168 >> v1:172.21.15.84:6789/0 conn(0x7f63d41595a0 legacy=0x7f63d40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63d37fe700 1 -- 172.21.15.84:0/1807666168 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790993340 0 0) 0x7f63d40b0ca0 con 0x7f63d41595a0 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.673+0000 7f63d961e700 1 -- 172.21.15.84:0/1807666168 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40b1260 con 0x7f63d40b07a0 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63d961e700 1 --2- 172.21.15.84:0/1807666168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 0x7f63d40ccfd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009e90 tx=0x7f63cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d6afeb8e1827cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63d37fe700 1 -- 172.21.15.84:0/1807666168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00e070 con 0x7f63d40b07a0 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63d37fe700 1 -- 172.21.15.84:0/1807666168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc00bbb0 con 0x7f63d40b07a0 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63d37fe700 1 -- 172.21.15.84:0/1807666168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc012430 con 0x7f63d40b07a0 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63db081700 1 -- 172.21.15.84:0/1807666168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 msgr2=0x7f63d40ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63db081700 1 --2- 172.21.15.84:0/1807666168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 0x7f63d40ccfd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009e90 tx=0x7f63cc009780 comp rx=0 tx=0).stop 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63db081700 1 -- 172.21.15.84:0/1807666168 shutdown_connections 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63db081700 1 --2- 172.21.15.84:0/1807666168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 0x7f63d40ccfd0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63db081700 1 -- 172.21.15.84:0/1807666168 >> 172.21.15.84:0/1807666168 conn(0x7f63d4099830 msgr2=0x7f63d406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:32.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63db081700 1 -- 172.21.15.84:0/1807666168 shutdown_connections 2023-10-06T02:57:32.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.674+0000 7f63db081700 1 -- 172.21.15.84:0/1807666168 wait complete. 2023-10-06T02:57:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.675+0000 7f63db081700 1 Processor -- start 2023-10-06T02:57:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.675+0000 7f63db081700 1 -- start start 2023-10-06T02:57:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.676+0000 7f63db081700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 0x7f63d4158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.676+0000 7f63db081700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63d40b49e0 0x7f63d409a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.676+0000 7f63db081700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d41595a0 0x7f63d415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.676+0000 7f63db081700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4159a10 con 0x7f63d40b07a0 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.676+0000 7f63db081700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4159cf0 con 0x7f63d41595a0 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.676+0000 7f63db081700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4159fd0 con 0x7f63d40b49e0 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.676+0000 7f63d8e1d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 0x7f63d4158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.676+0000 7f63d8e1d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 0x7f63d4158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57864/0 (socket says 172.21.15.84:57864) 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.676+0000 7f63d8e1d700 1 -- 172.21.15.84:0/1581939193 learned_addr learned my addr 172.21.15.84:0/1581939193 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d8e1d700 1 -- 172.21.15.84:0/1581939193 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63d40b49e0 msgr2=0x7f63d409a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d961e700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d41595a0 0x7f63d415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d8e1d700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63d40b49e0 0x7f63d409a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d8e1d700 1 -- 172.21.15.84:0/1581939193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d41595a0 msgr2=0x7f63d415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d8e1d700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d41595a0 0x7f63d415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d8e1d700 1 -- 172.21.15.84:0/1581939193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc009a20 con 0x7f63d40b07a0 2023-10-06T02:57:32.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d8e1d700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 0x7f63d4158960 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f63c800c5e0 tx=0x7f63c8007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d0ff9700 1 -- 172.21.15.84:0/1581939193 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c80072e0 con 0x7f63d40b07a0 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d0ff9700 1 -- 172.21.15.84:0/1581939193 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c8007440 con 0x7f63d40b07a0 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d415a2b0 con 0x7f63d40b07a0 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63d0ff9700 1 -- 172.21.15.84:0/1581939193 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c80057f0 con 0x7f63d40b07a0 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.677+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d4158ea0 con 0x7f63d40b07a0 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.678+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d415a7d0 con 0x7f63d40b07a0 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.678+0000 7f63d0ff9700 1 -- 172.21.15.84:0/1581939193 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63c8005c00 con 0x7f63d40b07a0 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.679+0000 7f63d0ff9700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63b8066f30 0x7f63b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.679+0000 7f63d0ff9700 1 -- 172.21.15.84:0/1581939193 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f63c8083d70 con 0x7f63d40b07a0 2023-10-06T02:57:32.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.679+0000 7f63d3fff700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63b8066f30 0x7f63b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.679+0000 7f63d3fff700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63b8066f30 0x7f63b80693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f63d40b62c0 tx=0x7f63c0006ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:32.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.683+0000 7f63d0ff9700 1 -- 172.21.15.84:0/1581939193 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63d415a7d0 con 0x7f63d40b07a0 2023-10-06T02:57:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.866+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63d415a7d0 con 0x7f63d40b07a0 2023-10-06T02:57:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.867+0000 7f63d0ff9700 1 -- 172.21.15.84:0/1581939193 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f63d415a7d0 con 0x7f63d40b07a0 2023-10-06T02:57:32.868 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:32.869 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":56,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:57:30.140568+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:26.170794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:27.492251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:57:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63b8066f30 msgr2=0x7f63b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63b8066f30 0x7f63b80693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f63d40b62c0 tx=0x7f63c0006ce0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 msgr2=0x7f63d4158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 0x7f63d4158960 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f63c800c5e0 tx=0x7f63c8007e80 comp rx=0 tx=0).stop 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 shutdown_connections 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f63b8066f30 0x7f63b80693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63d41595a0 0x7f63d415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d40b07a0 0x7f63d4158960 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 --2- 172.21.15.84:0/1581939193 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63d40b49e0 0x7f63d409a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 >> 172.21.15.84:0/1581939193 conn(0x7f63d4099830 msgr2=0x7f63d4069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 shutdown_connections 2023-10-06T02:57:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.869+0000 7f63db081700 1 -- 172.21.15.84:0/1581939193 wait complete. 2023-10-06T02:57:32.882 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:57:32.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:57:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.995+0000 7f9b00964700 1 Processor -- start 2023-10-06T02:57:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.995+0000 7f9b00964700 1 -- start start 2023-10-06T02:57:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.996+0000 7f9b00964700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9afc06e8f0 0x7f9afc068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.996+0000 7f9b00964700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc0cad60 con 0x7f9afc068b40 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.996+0000 7f9b00964700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc068f40 con 0x7f9afc157130 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.996+0000 7f9b00964700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc06a5a0 con 0x7f9afc06e8f0 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.996+0000 7f9afaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9afc06e8f0 0x7f9afc068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.996+0000 7f9afbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9afc068b40 0x7f9afc0cb520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48158/0 (socket says 172.21.15.84:48158) 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.996+0000 7f9afbfff700 1 -- 172.21.15.84:0/2036593321 learned_addr learned my addr 172.21.15.84:0/2036593321 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.997+0000 7f9afaffd700 1 -- 172.21.15.84:0/2036593321 >> v1:172.21.15.131:6789/0 conn(0x7f9afc157130 legacy=0x7f9afc069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.997+0000 7f9afaffd700 1 -- 172.21.15.84:0/2036593321 >> v1:172.21.15.84:6789/0 conn(0x7f9afc068b40 legacy=0x7f9afc0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.997+0000 7f9afaffd700 1 -- 172.21.15.84:0/2036593321 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc06a880 con 0x7f9afc06e8f0 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.997+0000 7f9afa7fc700 1 -- 172.21.15.84:0/2036593321 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113467238 0 0) 0x7f9afc0cad60 con 0x7f9afc068b40 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.997+0000 7f9afaffd700 1 --2- 172.21.15.84:0/2036593321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc06e8f0 0x7f9afc068600 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9af00098e0 tx=0x7f9af00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c4d110f9e3dba2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.997+0000 7f9afa7fc700 1 -- 172.21.15.84:0/2036593321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0009e80 con 0x7f9afc06e8f0 2023-10-06T02:57:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.997+0000 7f9afa7fc700 1 -- 172.21.15.84:0/2036593321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af000b860 con 0x7f9afc06e8f0 2023-10-06T02:57:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.997+0000 7f9afa7fc700 1 -- 172.21.15.84:0/2036593321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000bbe0 con 0x7f9afc06e8f0 2023-10-06T02:57:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.997+0000 7f9b00964700 1 -- 172.21.15.84:0/2036593321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc06e8f0 msgr2=0x7f9afc068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.998+0000 7f9b00964700 1 --2- 172.21.15.84:0/2036593321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc06e8f0 0x7f9afc068600 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9af00098e0 tx=0x7f9af00091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.998+0000 7f9b00964700 1 -- 172.21.15.84:0/2036593321 shutdown_connections 2023-10-06T02:57:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.998+0000 7f9b00964700 1 --2- 172.21.15.84:0/2036593321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc06e8f0 0x7f9afc068600 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.998+0000 7f9b00964700 1 -- 172.21.15.84:0/2036593321 >> 172.21.15.84:0/2036593321 conn(0x7f9afc0c9c50 msgr2=0x7f9afc06db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.998+0000 7f9b00964700 1 -- 172.21.15.84:0/2036593321 shutdown_connections 2023-10-06T02:57:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.998+0000 7f9b00964700 1 -- 172.21.15.84:0/2036593321 wait complete. 2023-10-06T02:57:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.999+0000 7f9b00964700 1 Processor -- start 2023-10-06T02:57:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:32.999+0000 7f9b00964700 1 -- start start 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9b00964700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9afc068b40 0x7f9afc1430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9b00964700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9afc06e8f0 0x7f9afc0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9b00964700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc157130 0x7f9afc0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9b00964700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc14e620 con 0x7f9afc157130 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9b00964700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc14e900 con 0x7f9afc06e8f0 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9b00964700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc14ebe0 con 0x7f9afc068b40 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc157130 0x7f9afc0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc157130 0x7f9afc0af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57882/0 (socket says 172.21.15.84:57882) 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afbfff700 1 -- 172.21.15.84:0/4258990700 learned_addr learned my addr 172.21.15.84:0/4258990700 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afaffd700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9afc06e8f0 0x7f9afc0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afb7fe700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9afc068b40 0x7f9afc1430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afbfff700 1 -- 172.21.15.84:0/4258990700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9afc068b40 msgr2=0x7f9afc1430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afbfff700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9afc068b40 0x7f9afc1430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afbfff700 1 -- 172.21.15.84:0/4258990700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9afc06e8f0 msgr2=0x7f9afc0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afbfff700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9afc06e8f0 0x7f9afc0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afbfff700 1 -- 172.21.15.84:0/4258990700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0009420 con 0x7f9afc157130 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9afbfff700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc157130 0x7f9afc0af7c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9af40011e0 tx=0x7f9af4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9ae37fe700 1 -- 172.21.15.84:0/4258990700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4005b30 con 0x7f9afc157130 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9ae37fe700 1 -- 172.21.15.84:0/4258990700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af4005c90 con 0x7f9afc157130 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc14eec0 con 0x7f9afc157130 2023-10-06T02:57:33.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9ae37fe700 1 -- 172.21.15.84:0/4258990700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4007320 con 0x7f9afc157130 2023-10-06T02:57:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.000+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc14f480 con 0x7f9afc157130 2023-10-06T02:57:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.001+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc14f670 con 0x7f9afc157130 2023-10-06T02:57:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.002+0000 7f9ae37fe700 1 -- 172.21.15.84:0/4258990700 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9af4007690 con 0x7f9afc157130 2023-10-06T02:57:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.002+0000 7f9ae37fe700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ae8066f30 0x7f9ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.002+0000 7f9ae37fe700 1 -- 172.21.15.84:0/4258990700 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9af4083c80 con 0x7f9afc157130 2023-10-06T02:57:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.002+0000 7f9afb7fe700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ae8066f30 0x7f9ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.002+0000 7f9afb7fe700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ae8066f30 0x7f9ae80693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9aec007fd0 tx=0x7f9aec001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.006+0000 7f9ae37fe700 1 -- 172.21.15.84:0/4258990700 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9af4050bc0 con 0x7f9afc157130 2023-10-06T02:57:33.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.185+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9afc05f270 con 0x7f9ae8066f30 2023-10-06T02:57:33.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.194+0000 7f9ae37fe700 1 -- 172.21.15.84:0/4258990700 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308482 (secure 0 0 0) 0x7f9afc05f270 con 0x7f9ae8066f30 2023-10-06T02:57:33.200 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.197+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ae8066f30 msgr2=0x7f9ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.197+0000 7f9b00964700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ae8066f30 0x7f9ae80693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9aec007fd0 tx=0x7f9aec001650 comp rx=0 tx=0).stop 2023-10-06T02:57:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc157130 msgr2=0x7f9afc0af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc157130 0x7f9afc0af7c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9af40011e0 tx=0x7f9af4007d30 comp rx=0 tx=0).stop 2023-10-06T02:57:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 shutdown_connections 2023-10-06T02:57:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ae8066f30 0x7f9ae80693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9afc157130 0x7f9afc0af7c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9afc068b40 0x7f9afc1430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 --2- 172.21.15.84:0/4258990700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9afc06e8f0 0x7f9afc0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 >> 172.21.15.84:0/4258990700 conn(0x7f9afc0c9c50 msgr2=0x7f9afc0675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 shutdown_connections 2023-10-06T02:57:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.198+0000 7f9b00964700 1 -- 172.21.15.84:0/4258990700 wait complete. 2023-10-06T02:57:33.204 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:57:33.212 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-10-06T02:57:31.834112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384464,"kb_used_data":6160,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590256,"statfs":{"total":773094113280,"available":770652422144,"internally_reserved":0,"allocated":6307840,"data_stored":3531831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.699330"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145474+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:45.068433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146997+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:49.829140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148684+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:13.552024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.150306+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:21.534628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143123+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:52.821253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147807+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144942+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147561+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:15.152388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144825+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148493+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.638210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.149635+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:02.677073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147171+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:13.552024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.142885+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:39.535114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144582+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144482+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147528+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146715+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.150264+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:59.497675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.142965+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:22.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146535+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.153242+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:44.264633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147640+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:54.010722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.149806+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:03.080903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143566+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:45.068433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.142934+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:03.724169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147909+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:30.485637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147573+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143328+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:56.992770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.152346+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:02.462105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.150021+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:30.485637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143667+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:39.535114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147012+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146706+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154223+0000","last_change":"2023-10-06T02:57:28.154223+0000","last_active":"2023-10-06T02:57:28.154223+0000","last_peered":"2023-10-06T02:57:28.154223+0000","last_clean":"2023-10-06T02:57:28.154223+0000","last_became_active":"2023-10-06T02:57:28.153990+0000","last_became_peered":"2023-10-06T02:57:28.153990+0000","last_unstale":"2023-10-06T02:57:28.154223+0000","last_undegraded":"2023-10-06T02:57:28.154223+0000","last_fullsized":"2023-10-06T02:57:28.154223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:12.546662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148635+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:51.022047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160875+0000","last_change":"2023-10-06T02:57:28.160875+0000","last_active":"2023-10-06T02:57:28.160875+0000","last_peered":"2023-10-06T02:57:28.160875+0000","last_clean":"2023-10-06T02:57:28.160875+0000","last_became_active":"2023-10-06T02:57:28.160629+0000","last_became_peered":"2023-10-06T02:57:28.160629+0000","last_unstale":"2023-10-06T02:57:28.160875+0000","last_undegraded":"2023-10-06T02:57:28.160875+0000","last_fullsized":"2023-10-06T02:57:28.160875+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146124+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:53.278507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154910+0000","last_change":"2023-10-06T02:57:28.154910+0000","last_active":"2023-10-06T02:57:28.154910+0000","last_peered":"2023-10-06T02:57:28.154910+0000","last_clean":"2023-10-06T02:57:28.154910+0000","last_became_active":"2023-10-06T02:57:28.154656+0000","last_became_peered":"2023-10-06T02:57:28.154656+0000","last_unstale":"2023-10-06T02:57:28.154910+0000","last_undegraded":"2023-10-06T02:57:28.154910+0000","last_fullsized":"2023-10-06T02:57:28.154910+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147021+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158739+0000","last_change":"2023-10-06T02:57:28.158739+0000","last_active":"2023-10-06T02:57:28.158739+0000","last_peered":"2023-10-06T02:57:28.158739+0000","last_clean":"2023-10-06T02:57:28.158739+0000","last_became_active":"2023-10-06T02:57:28.158477+0000","last_became_peered":"2023-10-06T02:57:28.158477+0000","last_unstale":"2023-10-06T02:57:28.158739+0000","last_undegraded":"2023-10-06T02:57:28.158739+0000","last_fullsized":"2023-10-06T02:57:28.158739+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:29.634384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146528+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154727+0000","last_change":"2023-10-06T02:57:28.154727+0000","last_active":"2023-10-06T02:57:28.154727+0000","last_peered":"2023-10-06T02:57:28.154727+0000","last_clean":"2023-10-06T02:57:28.154727+0000","last_became_active":"2023-10-06T02:57:28.154457+0000","last_became_peered":"2023-10-06T02:57:28.154457+0000","last_unstale":"2023-10-06T02:57:28.154727+0000","last_undegraded":"2023-10-06T02:57:28.154727+0000","last_fullsized":"2023-10-06T02:57:28.154727+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146855+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:58.527683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.156466+0000","last_change":"2023-10-06T02:57:28.156466+0000","last_active":"2023-10-06T02:57:28.156466+0000","last_peered":"2023-10-06T02:57:28.156466+0000","last_clean":"2023-10-06T02:57:28.156466+0000","last_became_active":"2023-10-06T02:57:28.156258+0000","last_became_peered":"2023-10-06T02:57:28.156258+0000","last_unstale":"2023-10-06T02:57:28.156466+0000","last_undegraded":"2023-10-06T02:57:28.156466+0000","last_fullsized":"2023-10-06T02:57:28.156466+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:02.075540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.142646+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:56.992770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154919+0000","last_change":"2023-10-06T02:57:28.154919+0000","last_active":"2023-10-06T02:57:28.154919+0000","last_peered":"2023-10-06T02:57:28.154919+0000","last_clean":"2023-10-06T02:57:28.154919+0000","last_became_active":"2023-10-06T02:57:28.154620+0000","last_became_peered":"2023-10-06T02:57:28.154620+0000","last_unstale":"2023-10-06T02:57:28.154919+0000","last_undegraded":"2023-10-06T02:57:28.154919+0000","last_fullsized":"2023-10-06T02:57:28.154919+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:27.029195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.149387+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:44.291549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154846+0000","last_change":"2023-10-06T02:57:28.154846+0000","last_active":"2023-10-06T02:57:28.154846+0000","last_peered":"2023-10-06T02:57:28.154846+0000","last_clean":"2023-10-06T02:57:28.154846+0000","last_became_active":"2023-10-06T02:57:28.154580+0000","last_became_peered":"2023-10-06T02:57:28.154580+0000","last_unstale":"2023-10-06T02:57:28.154846+0000","last_undegraded":"2023-10-06T02:57:28.154846+0000","last_fullsized":"2023-10-06T02:57:28.154846+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143162+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.162028+0000","last_change":"2023-10-06T02:57:28.162028+0000","last_active":"2023-10-06T02:57:28.162028+0000","last_peered":"2023-10-06T02:57:28.162028+0000","last_clean":"2023-10-06T02:57:28.162028+0000","last_became_active":"2023-10-06T02:57:28.161784+0000","last_became_peered":"2023-10-06T02:57:28.161784+0000","last_unstale":"2023-10-06T02:57:28.162028+0000","last_undegraded":"2023-10-06T02:57:28.162028+0000","last_fullsized":"2023-10-06T02:57:28.162028+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:22.612517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147961+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:55.050417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158578+0000","last_change":"2023-10-06T02:57:28.158578+0000","last_active":"2023-10-06T02:57:28.158578+0000","last_peered":"2023-10-06T02:57:28.158578+0000","last_clean":"2023-10-06T02:57:28.158578+0000","last_became_active":"2023-10-06T02:57:28.158361+0000","last_became_peered":"2023-10-06T02:57:28.158361+0000","last_unstale":"2023-10-06T02:57:28.158578+0000","last_undegraded":"2023-10-06T02:57:28.158578+0000","last_fullsized":"2023-10-06T02:57:28.158578+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.151744+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:24.455071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.162959+0000","last_change":"2023-10-06T02:57:28.162959+0000","last_active":"2023-10-06T02:57:28.162959+0000","last_peered":"2023-10-06T02:57:28.162959+0000","last_clean":"2023-10-06T02:57:28.162959+0000","last_became_active":"2023-10-06T02:57:28.162660+0000","last_became_peered":"2023-10-06T02:57:28.162660+0000","last_unstale":"2023-10-06T02:57:28.162959+0000","last_undegraded":"2023-10-06T02:57:28.162959+0000","last_fullsized":"2023-10-06T02:57:28.162959+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:32.327057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147644+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:28.034558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155523+0000","last_change":"2023-10-06T02:57:28.155523+0000","last_active":"2023-10-06T02:57:28.155523+0000","last_peered":"2023-10-06T02:57:28.155523+0000","last_clean":"2023-10-06T02:57:28.155523+0000","last_became_active":"2023-10-06T02:57:28.155251+0000","last_became_peered":"2023-10-06T02:57:28.155251+0000","last_unstale":"2023-10-06T02:57:28.155523+0000","last_undegraded":"2023-10-06T02:57:28.155523+0000","last_fullsized":"2023-10-06T02:57:28.155523+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148136+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:01.634204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160083+0000","last_change":"2023-10-06T02:57:28.160083+0000","last_active":"2023-10-06T02:57:28.160083+0000","last_peered":"2023-10-06T02:57:28.160083+0000","last_clean":"2023-10-06T02:57:28.160083+0000","last_became_active":"2023-10-06T02:57:28.158968+0000","last_became_peered":"2023-10-06T02:57:28.158968+0000","last_unstale":"2023-10-06T02:57:28.160083+0000","last_undegraded":"2023-10-06T02:57:28.160083+0000","last_fullsized":"2023-10-06T02:57:28.160083+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148597+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:30.639746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.157931+0000","last_change":"2023-10-06T02:57:28.157931+0000","last_active":"2023-10-06T02:57:28.157931+0000","last_peered":"2023-10-06T02:57:28.157931+0000","last_clean":"2023-10-06T02:57:28.157931+0000","last_became_active":"2023-10-06T02:57:28.157645+0000","last_became_peered":"2023-10-06T02:57:28.157645+0000","last_unstale":"2023-10-06T02:57:28.157931+0000","last_undegraded":"2023-10-06T02:57:28.157931+0000","last_fullsized":"2023-10-06T02:57:28.157931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:02.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145080+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160747+0000","last_change":"2023-10-06T02:57:28.160747+0000","last_active":"2023-10-06T02:57:28.160747+0000","last_peered":"2023-10-06T02:57:28.160747+0000","last_clean":"2023-10-06T02:57:28.160747+0000","last_became_active":"2023-10-06T02:57:28.160491+0000","last_became_peered":"2023-10-06T02:57:28.160491+0000","last_unstale":"2023-10-06T02:57:28.160747+0000","last_undegraded":"2023-10-06T02:57:28.160747+0000","last_fullsized":"2023-10-06T02:57:28.160747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:54.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148637+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:51.680609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.163501+0000","last_change":"2023-10-06T02:57:28.163501+0000","last_active":"2023-10-06T02:57:28.163501+0000","last_peered":"2023-10-06T02:57:28.163501+0000","last_clean":"2023-10-06T02:57:28.163501+0000","last_became_active":"2023-10-06T02:57:28.163221+0000","last_became_peered":"2023-10-06T02:57:28.163221+0000","last_unstale":"2023-10-06T02:57:28.163501+0000","last_undegraded":"2023-10-06T02:57:28.163501+0000","last_fullsized":"2023-10-06T02:57:28.163501+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:21.591868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147226+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:59.497675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155033+0000","last_change":"2023-10-06T02:57:28.155033+0000","last_active":"2023-10-06T02:57:28.155033+0000","last_peered":"2023-10-06T02:57:28.155033+0000","last_clean":"2023-10-06T02:57:28.155033+0000","last_became_active":"2023-10-06T02:57:28.154759+0000","last_became_peered":"2023-10-06T02:57:28.154759+0000","last_unstale":"2023-10-06T02:57:28.155033+0000","last_undegraded":"2023-10-06T02:57:28.155033+0000","last_fullsized":"2023-10-06T02:57:28.155033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:40.908455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148917+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:44.264633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.156381+0000","last_change":"2023-10-06T02:57:28.156381+0000","last_active":"2023-10-06T02:57:28.156381+0000","last_peered":"2023-10-06T02:57:28.156381+0000","last_clean":"2023-10-06T02:57:28.156381+0000","last_became_active":"2023-10-06T02:57:28.156172+0000","last_became_peered":"2023-10-06T02:57:28.156172+0000","last_unstale":"2023-10-06T02:57:28.156381+0000","last_undegraded":"2023-10-06T02:57:28.156381+0000","last_fullsized":"2023-10-06T02:57:28.156381+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:50.675247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148511+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.148715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.150712+0000","last_change":"2023-10-06T02:57:28.150712+0000","last_active":"2023-10-06T02:57:28.150712+0000","last_peered":"2023-10-06T02:57:28.150712+0000","last_clean":"2023-10-06T02:57:28.150712+0000","last_became_active":"2023-10-06T02:57:28.150426+0000","last_became_peered":"2023-10-06T02:57:28.150426+0000","last_unstale":"2023-10-06T02:57:28.150712+0000","last_undegraded":"2023-10-06T02:57:28.150712+0000","last_fullsized":"2023-10-06T02:57:28.150712+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:47.960513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145749+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158040+0000","last_change":"2023-10-06T02:57:28.158040+0000","last_active":"2023-10-06T02:57:28.158040+0000","last_peered":"2023-10-06T02:57:28.158040+0000","last_clean":"2023-10-06T02:57:28.158040+0000","last_became_active":"2023-10-06T02:57:28.157767+0000","last_became_peered":"2023-10-06T02:57:28.157767+0000","last_unstale":"2023-10-06T02:57:28.158040+0000","last_undegraded":"2023-10-06T02:57:28.158040+0000","last_fullsized":"2023-10-06T02:57:28.158040+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:56.163695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144377+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.153360+0000","last_change":"2023-10-06T02:57:28.153360+0000","last_active":"2023-10-06T02:57:28.153360+0000","last_peered":"2023-10-06T02:57:28.153360+0000","last_clean":"2023-10-06T02:57:28.153360+0000","last_became_active":"2023-10-06T02:57:28.153120+0000","last_became_peered":"2023-10-06T02:57:28.153120+0000","last_unstale":"2023-10-06T02:57:28.153360+0000","last_undegraded":"2023-10-06T02:57:28.153360+0000","last_fullsized":"2023-10-06T02:57:28.153360+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:44.063071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147591+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:06.275776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155104+0000","last_change":"2023-10-06T02:57:28.155104+0000","last_active":"2023-10-06T02:57:28.155104+0000","last_peered":"2023-10-06T02:57:28.155104+0000","last_clean":"2023-10-06T02:57:28.155104+0000","last_became_active":"2023-10-06T02:57:28.154822+0000","last_became_peered":"2023-10-06T02:57:28.154822+0000","last_unstale":"2023-10-06T02:57:28.155104+0000","last_undegraded":"2023-10-06T02:57:28.155104+0000","last_fullsized":"2023-10-06T02:57:28.155104+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147894+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:06.133045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160730+0000","last_change":"2023-10-06T02:57:28.160730+0000","last_active":"2023-10-06T02:57:28.160730+0000","last_peered":"2023-10-06T02:57:28.160730+0000","last_clean":"2023-10-06T02:57:28.160730+0000","last_became_active":"2023-10-06T02:57:28.160482+0000","last_became_peered":"2023-10-06T02:57:28.160482+0000","last_unstale":"2023-10-06T02:57:28.160730+0000","last_undegraded":"2023-10-06T02:57:28.160730+0000","last_fullsized":"2023-10-06T02:57:28.160730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:48.044243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146691+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.151353+0000","last_change":"2023-10-06T02:57:28.151353+0000","last_active":"2023-10-06T02:57:28.151353+0000","last_peered":"2023-10-06T02:57:28.151353+0000","last_clean":"2023-10-06T02:57:28.151353+0000","last_became_active":"2023-10-06T02:57:28.151093+0000","last_became_peered":"2023-10-06T02:57:28.151093+0000","last_unstale":"2023-10-06T02:57:28.151353+0000","last_undegraded":"2023-10-06T02:57:28.151353+0000","last_fullsized":"2023-10-06T02:57:28.151353+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.150074+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158553+0000","last_change":"2023-10-06T02:57:28.158553+0000","last_active":"2023-10-06T02:57:28.158553+0000","last_peered":"2023-10-06T02:57:28.158553+0000","last_clean":"2023-10-06T02:57:28.158553+0000","last_became_active":"2023-10-06T02:57:28.158316+0000","last_became_peered":"2023-10-06T02:57:28.158316+0000","last_unstale":"2023-10-06T02:57:28.158553+0000","last_undegraded":"2023-10-06T02:57:28.158553+0000","last_fullsized":"2023-10-06T02:57:28.158553+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:58.492313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.145174+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:57:27.145174+0000","last_peered":"2023-10-06T02:57:27.145174+0000","last_clean":"2023-10-06T02:57:27.145174+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:57:27.145174+0000","last_undegraded":"2023-10-06T02:57:27.145174+0000","last_fullsized":"2023-10-06T02:57:27.145174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145262+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:44.264633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158916+0000","last_change":"2023-10-06T02:57:28.158916+0000","last_active":"2023-10-06T02:57:28.158916+0000","last_peered":"2023-10-06T02:57:28.158916+0000","last_clean":"2023-10-06T02:57:28.158916+0000","last_became_active":"2023-10-06T02:57:28.158666+0000","last_became_peered":"2023-10-06T02:57:28.158666+0000","last_unstale":"2023-10-06T02:57:28.158916+0000","last_undegraded":"2023-10-06T02:57:28.158916+0000","last_fullsized":"2023-10-06T02:57:28.158916+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:05.270414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.142981+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:57:27.142981+0000","last_peered":"2023-10-06T02:57:27.142981+0000","last_clean":"2023-10-06T02:57:27.142981+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:57:27.142981+0000","last_undegraded":"2023-10-06T02:57:27.142981+0000","last_fullsized":"2023-10-06T02:57:27.142981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147492+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:03.080903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155037+0000","last_change":"2023-10-06T02:57:28.155037+0000","last_active":"2023-10-06T02:57:28.155037+0000","last_peered":"2023-10-06T02:57:28.155037+0000","last_clean":"2023-10-06T02:57:28.155037+0000","last_became_active":"2023-10-06T02:57:28.154790+0000","last_became_peered":"2023-10-06T02:57:28.154790+0000","last_unstale":"2023-10-06T02:57:28.155037+0000","last_undegraded":"2023-10-06T02:57:28.155037+0000","last_fullsized":"2023-10-06T02:57:28.155037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.136393+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:57:27.136393+0000","last_peered":"2023-10-06T02:57:27.136393+0000","last_clean":"2023-10-06T02:57:27.136393+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:57:27.136393+0000","last_undegraded":"2023-10-06T02:57:27.136393+0000","last_fullsized":"2023-10-06T02:57:27.136393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144726+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.153262+0000","last_change":"2023-10-06T02:57:28.153262+0000","last_active":"2023-10-06T02:57:28.153262+0000","last_peered":"2023-10-06T02:57:28.153262+0000","last_clean":"2023-10-06T02:57:28.153262+0000","last_became_active":"2023-10-06T02:57:28.152963+0000","last_became_peered":"2023-10-06T02:57:28.152963+0000","last_unstale":"2023-10-06T02:57:28.153262+0000","last_undegraded":"2023-10-06T02:57:28.153262+0000","last_fullsized":"2023-10-06T02:57:28.153262+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:21.640991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.143019+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:57:27.143019+0000","last_peered":"2023-10-06T02:57:27.143019+0000","last_clean":"2023-10-06T02:57:27.143019+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:57:27.143019+0000","last_undegraded":"2023-10-06T02:57:27.143019+0000","last_fullsized":"2023-10-06T02:57:27.143019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.140838+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:57:27.140838+0000","last_peered":"2023-10-06T02:57:27.140838+0000","last_clean":"2023-10-06T02:57:27.140838+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:57:27.140838+0000","last_undegraded":"2023-10-06T02:57:27.140838+0000","last_fullsized":"2023-10-06T02:57:27.140838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145614+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:21.534628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158519+0000","last_change":"2023-10-06T02:57:28.158519+0000","last_active":"2023-10-06T02:57:28.158519+0000","last_peered":"2023-10-06T02:57:28.158519+0000","last_clean":"2023-10-06T02:57:28.158519+0000","last_became_active":"2023-10-06T02:57:28.158257+0000","last_became_peered":"2023-10-06T02:57:28.158257+0000","last_unstale":"2023-10-06T02:57:28.158519+0000","last_undegraded":"2023-10-06T02:57:28.158519+0000","last_fullsized":"2023-10-06T02:57:28.158519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:29.265968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.140858+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:57:27.140858+0000","last_peered":"2023-10-06T02:57:27.140858+0000","last_clean":"2023-10-06T02:57:27.140858+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:57:27.140858+0000","last_undegraded":"2023-10-06T02:57:27.140858+0000","last_fullsized":"2023-10-06T02:57:27.140858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148325+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:48.865612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.159275+0000","last_change":"2023-10-06T02:57:28.159275+0000","last_active":"2023-10-06T02:57:28.159275+0000","last_peered":"2023-10-06T02:57:28.159275+0000","last_clean":"2023-10-06T02:57:28.159275+0000","last_became_active":"2023-10-06T02:57:28.158956+0000","last_became_peered":"2023-10-06T02:57:28.158956+0000","last_unstale":"2023-10-06T02:57:28.159275+0000","last_undegraded":"2023-10-06T02:57:28.159275+0000","last_fullsized":"2023-10-06T02:57:28.159275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:22.990325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.140908+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:57:27.140908+0000","last_peered":"2023-10-06T02:57:27.140908+0000","last_clean":"2023-10-06T02:57:27.140908+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:57:27.140908+0000","last_undegraded":"2023-10-06T02:57:27.140908+0000","last_fullsized":"2023-10-06T02:57:27.140908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148206+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:57.169057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155416+0000","last_change":"2023-10-06T02:57:28.155416+0000","last_active":"2023-10-06T02:57:28.155416+0000","last_peered":"2023-10-06T02:57:28.155416+0000","last_clean":"2023-10-06T02:57:28.155416+0000","last_became_active":"2023-10-06T02:57:28.155144+0000","last_became_peered":"2023-10-06T02:57:28.155144+0000","last_unstale":"2023-10-06T02:57:28.155416+0000","last_undegraded":"2023-10-06T02:57:28.155416+0000","last_fullsized":"2023-10-06T02:57:28.155416+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.145205+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:57:27.145205+0000","last_peered":"2023-10-06T02:57:27.145205+0000","last_clean":"2023-10-06T02:57:27.145205+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:57:27.145205+0000","last_undegraded":"2023-10-06T02:57:27.145205+0000","last_fullsized":"2023-10-06T02:57:27.145205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144437+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158264+0000","last_change":"2023-10-06T02:57:28.158264+0000","last_active":"2023-10-06T02:57:28.158264+0000","last_peered":"2023-10-06T02:57:28.158264+0000","last_clean":"2023-10-06T02:57:28.158264+0000","last_became_active":"2023-10-06T02:57:28.157981+0000","last_became_peered":"2023-10-06T02:57:28.157981+0000","last_unstale":"2023-10-06T02:57:28.158264+0000","last_undegraded":"2023-10-06T02:57:28.158264+0000","last_fullsized":"2023-10-06T02:57:28.158264+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:47.860250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.138307+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:57:27.138307+0000","last_peered":"2023-10-06T02:57:27.138307+0000","last_clean":"2023-10-06T02:57:27.138307+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:57:27.138307+0000","last_undegraded":"2023-10-06T02:57:27.138307+0000","last_fullsized":"2023-10-06T02:57:27.138307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073344,"statfs":{"total":96636764160,"available":96331104256,"internally_reserved":0,"allocated":1236992,"data_stored":885500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.311},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65600000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.31,"15min":0.31},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59599999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65700000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.5},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67000000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64900000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.433},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68400000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":295132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":3.415,"15min":3.415},"last":0.497},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":1.546,"15min":1.546},"last":0.623},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68899999999999995,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63400000000000001,"5min":1.74,"15min":1.74},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.70399999999999996,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.71599999999999997,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.74299999999999999,"5min":3.577,"15min":3.577},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.67300000000000004,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.66300000000000003,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68000000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.87}]},{"osd":7,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.88200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073928,"statfs":{"total":96636764160,"available":96331702272,"internally_reserved":0,"allocated":638976,"data_stored":294121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.22,"5min":0.19,"15min":0.19},"max":{"1min":0.48499999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.376,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59999999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":1.21,"15min":1.3500000000000001},"min":{"1min":0.24299999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51800000000000002,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65500000000000003,"5min":1.181,"15min":1.181},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":1.02,"15min":1.02},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.629,"5min":1.4339999999999999,"15min":1.5680000000000001},"min":{"1min":0.46800000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85599999999999998,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.423,"15min":1.5529999999999999},"min":{"1min":0.45000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95699999999999996,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.504,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82099999999999995,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.628,"5min":1.452,"15min":1.5900000000000001},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":21.166,"15min":21.166},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81999999999999995,"5min":0.997,"15min":0.997},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073348,"statfs":{"total":96636764160,"available":96331108352,"internally_reserved":0,"allocated":1232896,"data_stored":884489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.434,"5min":0.441,"15min":0.441},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.27600000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.374,"15min":0.372},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.317,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.32500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72699999999999998,"5min":0.879,"15min":0.879},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73799999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73099999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":295132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.31,"15min":0.30599999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47399999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.317},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.5,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.312}]},{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65000000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58799999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.499},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.747,"5min":0.755,"15min":0.755},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55500000000000005},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71899999999999997,"5min":1.077,"15min":1.077},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.435,"15min":0.435},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073928,"statfs":{"total":96636764160,"available":96331702272,"internally_reserved":0,"allocated":638976,"data_stored":294121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.623,"5min":2.569,"15min":2.569},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.53800000000000003,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.27700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.439,"15min":0.44900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57699999999999996,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56200000000000006,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.23799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.49399999999999999,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.28999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.77600000000000002,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77800000000000002,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69099999999999995,"15min":0.70299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77000000000000002,"5min":2.532,"15min":2.532},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72899999999999998,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.497,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.78300000000000003,"5min":2.496,"15min":2.496},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76200000000000001,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.40799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297904,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073936,"statfs":{"total":96636764160,"available":96331710464,"internally_reserved":0,"allocated":630784,"data_stored":288204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.44}]},{"osd":3,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":1.0109999999999999,"15min":1.073},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.503},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":295132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.38100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67400000000000004,"5min":1.167,"15min":1.167},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.44500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.117,"15min":1.117},"last":0.495},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.35499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":1.2,"15min":1.2},"last":0.626},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.68899999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68400000000000005,"5min":1.135,"15min":1.135},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81599999999999995,"5min":1.208,"15min":1.208},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":0.87},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.89200000000000002,"5min":1.054,"15min":1.054},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.377,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.008},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:57:33.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:57:33.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.365+0000 7faf1af92700 1 Processor -- start 2023-10-06T02:57:33.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.365+0000 7faf1af92700 1 -- start start 2023-10-06T02:57:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.366+0000 7faf1af92700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faf141595a0 0x7faf140aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.366+0000 7faf1af92700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf140b49e0 0x7faf140aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.366+0000 7faf1af92700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf140b0ca0 con 0x7faf140b07a0 2023-10-06T02:57:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.366+0000 7faf1af92700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf140b0f80 con 0x7faf140b49e0 2023-10-06T02:57:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.366+0000 7faf1af92700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf140b1260 con 0x7faf141595a0 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.366+0000 7faf0bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf140b49e0 0x7faf140aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.366+0000 7faf0bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf140b49e0 0x7faf140aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57884/0 (socket says 172.21.15.84:57884) 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.366+0000 7faf0bfff700 1 -- 172.21.15.84:0/3572904072 learned_addr learned my addr 172.21.15.84:0/3572904072 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.366+0000 7faf18d2e700 1 --2- 172.21.15.84:0/3572904072 >> v2:172.21.15.131:3300/0 conn(0x7faf141595a0 0x7faf140aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf0bfff700 1 -- 172.21.15.84:0/3572904072 >> v2:172.21.15.131:3300/0 conn(0x7faf141595a0 msgr2=0x7faf140aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf0bfff700 1 --2- 172.21.15.84:0/3572904072 >> v2:172.21.15.131:3300/0 conn(0x7faf141595a0 0x7faf140aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf0bfff700 1 -- 172.21.15.84:0/3572904072 >> v1:172.21.15.131:6789/0 conn(0x7faf140b07a0 legacy=0x7faf140b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf0bfff700 1 -- 172.21.15.84:0/3572904072 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf140b1540 con 0x7faf140b49e0 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf0bfff700 1 --2- 172.21.15.84:0/3572904072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 0x7faf140aaab0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7faf040099b0 tx=0x7faf04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d120bfb43593ed08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf0b7fe700 1 -- 172.21.15.84:0/3572904072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0400b7e0 con 0x7faf140b49e0 2023-10-06T02:57:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf0b7fe700 1 -- 172.21.15.84:0/3572904072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0400b940 con 0x7faf140b49e0 2023-10-06T02:57:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf0b7fe700 1 -- 172.21.15.84:0/3572904072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0400bce0 con 0x7faf140b49e0 2023-10-06T02:57:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf1af92700 1 -- 172.21.15.84:0/3572904072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 msgr2=0x7faf140aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf1af92700 1 --2- 172.21.15.84:0/3572904072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 0x7faf140aaab0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7faf040099b0 tx=0x7faf04009250 comp rx=0 tx=0).stop 2023-10-06T02:57:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf1af92700 1 -- 172.21.15.84:0/3572904072 shutdown_connections 2023-10-06T02:57:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf1af92700 1 --2- 172.21.15.84:0/3572904072 >> v2:172.21.15.131:3300/0 conn(0x7faf141595a0 0x7faf140aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf1af92700 1 --2- 172.21.15.84:0/3572904072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 0x7faf140aaab0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf1af92700 1 -- 172.21.15.84:0/3572904072 >> 172.21.15.84:0/3572904072 conn(0x7faf14099830 msgr2=0x7faf1406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf1af92700 1 -- 172.21.15.84:0/3572904072 shutdown_connections 2023-10-06T02:57:33.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.367+0000 7faf1af92700 1 -- 172.21.15.84:0/3572904072 wait complete. 2023-10-06T02:57:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.368+0000 7faf1af92700 1 Processor -- start 2023-10-06T02:57:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf1af92700 1 -- start start 2023-10-06T02:57:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf1af92700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf140b07a0 0x7faf1414a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf1af92700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 0x7faf1409d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf1af92700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf141595a0 0x7faf1409b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf1af92700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1409a130 con 0x7faf140b49e0 2023-10-06T02:57:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf1af92700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1409a410 con 0x7faf140b07a0 2023-10-06T02:57:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf1af92700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1409a6f0 con 0x7faf141595a0 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf0bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 0x7faf1409d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf0bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 0x7faf1409d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57892/0 (socket says 172.21.15.84:57892) 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.369+0000 7faf0bfff700 1 -- 172.21.15.84:0/919643413 learned_addr learned my addr 172.21.15.84:0/919643413 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf18d2e700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf140b07a0 0x7faf1414a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf1952f700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf141595a0 0x7faf1409b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf0bfff700 1 -- 172.21.15.84:0/919643413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf141595a0 msgr2=0x7faf1409b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf0bfff700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf141595a0 0x7faf1409b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf0bfff700 1 -- 172.21.15.84:0/919643413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf140b07a0 msgr2=0x7faf1414a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf0bfff700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf140b07a0 0x7faf1414a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf0bfff700 1 -- 172.21.15.84:0/919643413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040094f0 con 0x7faf140b49e0 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf1952f700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf141595a0 0x7faf1409b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf0bfff700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 0x7faf1409d9a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7faf040030c0 tx=0x7faf04016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf08ff9700 1 -- 172.21.15.84:0/919643413 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04011d90 con 0x7faf140b49e0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf08ff9700 1 -- 172.21.15.84:0/919643413 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf04020070 con 0x7faf140b49e0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1409a9d0 con 0x7faf140b49e0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf08ff9700 1 -- 172.21.15.84:0/919643413 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0401b6a0 con 0x7faf140b49e0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.370+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1414ade0 con 0x7faf140b49e0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.371+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1409aef0 con 0x7faf140b49e0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.371+0000 7faf08ff9700 1 -- 172.21.15.84:0/919643413 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf04022030 con 0x7faf140b49e0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.372+0000 7faf08ff9700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf00066f30 0x7faf000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.372+0000 7faf08ff9700 1 -- 172.21.15.84:0/919643413 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7faf04086780 con 0x7faf140b49e0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.372+0000 7faf18d2e700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf00066f30 0x7faf000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.372+0000 7faf18d2e700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf00066f30 0x7faf000693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf10007540 tx=0x7faf10009750 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.376+0000 7faf08ff9700 1 -- 172.21.15.84:0/919643413 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf1409aef0 con 0x7faf140b49e0 2023-10-06T02:57:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.553+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf1409aef0 con 0x7faf00066f30 2023-10-06T02:57:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.562+0000 7faf08ff9700 1 -- 172.21.15.84:0/919643413 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308482 (secure 0 0 0) 0x7faf1409aef0 con 0x7faf00066f30 2023-10-06T02:57:33.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf00066f30 msgr2=0x7faf000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf00066f30 0x7faf000693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf10007540 tx=0x7faf10009750 comp rx=0 tx=0).stop 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 msgr2=0x7faf1409d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 0x7faf1409d9a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7faf040030c0 tx=0x7faf04016000 comp rx=0 tx=0).stop 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 shutdown_connections 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf00066f30 0x7faf000693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf140b07a0 0x7faf1414a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf141595a0 0x7faf1409b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 --2- 172.21.15.84:0/919643413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf140b49e0 0x7faf1409d9a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 >> 172.21.15.84:0/919643413 conn(0x7faf14099830 msgr2=0x7faf14158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 shutdown_connections 2023-10-06T02:57:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.565+0000 7faf1af92700 1 -- 172.21.15.84:0/919643413 wait complete. 2023-10-06T02:57:33.572 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:57:33.578 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-10-06T02:57:31.834112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384464,"kb_used_data":6160,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590256,"statfs":{"total":773094113280,"available":770652422144,"internally_reserved":0,"allocated":6307840,"data_stored":3531831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.699330"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145474+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:45.068433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146997+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:49.829140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148684+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:13.552024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.150306+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:21.534628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143123+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:52.821253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147807+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144942+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147561+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:15.152388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144825+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148493+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.638210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.149635+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:02.677073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147171+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:13.552024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.142885+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:39.535114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144582+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144482+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147528+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146715+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.150264+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:59.497675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.142965+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:22.646353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146535+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.153242+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:44.264633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147640+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:54.010722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.149806+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:03.080903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143566+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:45.068433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.142934+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:03.724169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147909+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:30.485637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147573+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143328+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:56.992770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.152346+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:02.462105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.150021+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:30.485637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143667+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:39.535114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147012+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146706+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154223+0000","last_change":"2023-10-06T02:57:28.154223+0000","last_active":"2023-10-06T02:57:28.154223+0000","last_peered":"2023-10-06T02:57:28.154223+0000","last_clean":"2023-10-06T02:57:28.154223+0000","last_became_active":"2023-10-06T02:57:28.153990+0000","last_became_peered":"2023-10-06T02:57:28.153990+0000","last_unstale":"2023-10-06T02:57:28.154223+0000","last_undegraded":"2023-10-06T02:57:28.154223+0000","last_fullsized":"2023-10-06T02:57:28.154223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:12.546662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148635+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:51.022047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160875+0000","last_change":"2023-10-06T02:57:28.160875+0000","last_active":"2023-10-06T02:57:28.160875+0000","last_peered":"2023-10-06T02:57:28.160875+0000","last_clean":"2023-10-06T02:57:28.160875+0000","last_became_active":"2023-10-06T02:57:28.160629+0000","last_became_peered":"2023-10-06T02:57:28.160629+0000","last_unstale":"2023-10-06T02:57:28.160875+0000","last_undegraded":"2023-10-06T02:57:28.160875+0000","last_fullsized":"2023-10-06T02:57:28.160875+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146124+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:53.278507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154910+0000","last_change":"2023-10-06T02:57:28.154910+0000","last_active":"2023-10-06T02:57:28.154910+0000","last_peered":"2023-10-06T02:57:28.154910+0000","last_clean":"2023-10-06T02:57:28.154910+0000","last_became_active":"2023-10-06T02:57:28.154656+0000","last_became_peered":"2023-10-06T02:57:28.154656+0000","last_unstale":"2023-10-06T02:57:28.154910+0000","last_undegraded":"2023-10-06T02:57:28.154910+0000","last_fullsized":"2023-10-06T02:57:28.154910+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147021+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158739+0000","last_change":"2023-10-06T02:57:28.158739+0000","last_active":"2023-10-06T02:57:28.158739+0000","last_peered":"2023-10-06T02:57:28.158739+0000","last_clean":"2023-10-06T02:57:28.158739+0000","last_became_active":"2023-10-06T02:57:28.158477+0000","last_became_peered":"2023-10-06T02:57:28.158477+0000","last_unstale":"2023-10-06T02:57:28.158739+0000","last_undegraded":"2023-10-06T02:57:28.158739+0000","last_fullsized":"2023-10-06T02:57:28.158739+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:29.634384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146528+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154727+0000","last_change":"2023-10-06T02:57:28.154727+0000","last_active":"2023-10-06T02:57:28.154727+0000","last_peered":"2023-10-06T02:57:28.154727+0000","last_clean":"2023-10-06T02:57:28.154727+0000","last_became_active":"2023-10-06T02:57:28.154457+0000","last_became_peered":"2023-10-06T02:57:28.154457+0000","last_unstale":"2023-10-06T02:57:28.154727+0000","last_undegraded":"2023-10-06T02:57:28.154727+0000","last_fullsized":"2023-10-06T02:57:28.154727+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146855+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:58.527683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.156466+0000","last_change":"2023-10-06T02:57:28.156466+0000","last_active":"2023-10-06T02:57:28.156466+0000","last_peered":"2023-10-06T02:57:28.156466+0000","last_clean":"2023-10-06T02:57:28.156466+0000","last_became_active":"2023-10-06T02:57:28.156258+0000","last_became_peered":"2023-10-06T02:57:28.156258+0000","last_unstale":"2023-10-06T02:57:28.156466+0000","last_undegraded":"2023-10-06T02:57:28.156466+0000","last_fullsized":"2023-10-06T02:57:28.156466+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:02.075540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.142646+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:56.992770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154919+0000","last_change":"2023-10-06T02:57:28.154919+0000","last_active":"2023-10-06T02:57:28.154919+0000","last_peered":"2023-10-06T02:57:28.154919+0000","last_clean":"2023-10-06T02:57:28.154919+0000","last_became_active":"2023-10-06T02:57:28.154620+0000","last_became_peered":"2023-10-06T02:57:28.154620+0000","last_unstale":"2023-10-06T02:57:28.154919+0000","last_undegraded":"2023-10-06T02:57:28.154919+0000","last_fullsized":"2023-10-06T02:57:28.154919+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:27.029195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.149387+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:44.291549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.154846+0000","last_change":"2023-10-06T02:57:28.154846+0000","last_active":"2023-10-06T02:57:28.154846+0000","last_peered":"2023-10-06T02:57:28.154846+0000","last_clean":"2023-10-06T02:57:28.154846+0000","last_became_active":"2023-10-06T02:57:28.154580+0000","last_became_peered":"2023-10-06T02:57:28.154580+0000","last_unstale":"2023-10-06T02:57:28.154846+0000","last_undegraded":"2023-10-06T02:57:28.154846+0000","last_fullsized":"2023-10-06T02:57:28.154846+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.143162+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.162028+0000","last_change":"2023-10-06T02:57:28.162028+0000","last_active":"2023-10-06T02:57:28.162028+0000","last_peered":"2023-10-06T02:57:28.162028+0000","last_clean":"2023-10-06T02:57:28.162028+0000","last_became_active":"2023-10-06T02:57:28.161784+0000","last_became_peered":"2023-10-06T02:57:28.161784+0000","last_unstale":"2023-10-06T02:57:28.162028+0000","last_undegraded":"2023-10-06T02:57:28.162028+0000","last_fullsized":"2023-10-06T02:57:28.162028+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:22.612517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147961+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:55.050417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158578+0000","last_change":"2023-10-06T02:57:28.158578+0000","last_active":"2023-10-06T02:57:28.158578+0000","last_peered":"2023-10-06T02:57:28.158578+0000","last_clean":"2023-10-06T02:57:28.158578+0000","last_became_active":"2023-10-06T02:57:28.158361+0000","last_became_peered":"2023-10-06T02:57:28.158361+0000","last_unstale":"2023-10-06T02:57:28.158578+0000","last_undegraded":"2023-10-06T02:57:28.158578+0000","last_fullsized":"2023-10-06T02:57:28.158578+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.151744+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:24.455071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.162959+0000","last_change":"2023-10-06T02:57:28.162959+0000","last_active":"2023-10-06T02:57:28.162959+0000","last_peered":"2023-10-06T02:57:28.162959+0000","last_clean":"2023-10-06T02:57:28.162959+0000","last_became_active":"2023-10-06T02:57:28.162660+0000","last_became_peered":"2023-10-06T02:57:28.162660+0000","last_unstale":"2023-10-06T02:57:28.162959+0000","last_undegraded":"2023-10-06T02:57:28.162959+0000","last_fullsized":"2023-10-06T02:57:28.162959+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:32.327057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147644+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:28.034558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155523+0000","last_change":"2023-10-06T02:57:28.155523+0000","last_active":"2023-10-06T02:57:28.155523+0000","last_peered":"2023-10-06T02:57:28.155523+0000","last_clean":"2023-10-06T02:57:28.155523+0000","last_became_active":"2023-10-06T02:57:28.155251+0000","last_became_peered":"2023-10-06T02:57:28.155251+0000","last_unstale":"2023-10-06T02:57:28.155523+0000","last_undegraded":"2023-10-06T02:57:28.155523+0000","last_fullsized":"2023-10-06T02:57:28.155523+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148136+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:01.634204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160083+0000","last_change":"2023-10-06T02:57:28.160083+0000","last_active":"2023-10-06T02:57:28.160083+0000","last_peered":"2023-10-06T02:57:28.160083+0000","last_clean":"2023-10-06T02:57:28.160083+0000","last_became_active":"2023-10-06T02:57:28.158968+0000","last_became_peered":"2023-10-06T02:57:28.158968+0000","last_unstale":"2023-10-06T02:57:28.160083+0000","last_undegraded":"2023-10-06T02:57:28.160083+0000","last_fullsized":"2023-10-06T02:57:28.160083+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148597+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:30.639746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.157931+0000","last_change":"2023-10-06T02:57:28.157931+0000","last_active":"2023-10-06T02:57:28.157931+0000","last_peered":"2023-10-06T02:57:28.157931+0000","last_clean":"2023-10-06T02:57:28.157931+0000","last_became_active":"2023-10-06T02:57:28.157645+0000","last_became_peered":"2023-10-06T02:57:28.157645+0000","last_unstale":"2023-10-06T02:57:28.157931+0000","last_undegraded":"2023-10-06T02:57:28.157931+0000","last_fullsized":"2023-10-06T02:57:28.157931+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:02.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145080+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160747+0000","last_change":"2023-10-06T02:57:28.160747+0000","last_active":"2023-10-06T02:57:28.160747+0000","last_peered":"2023-10-06T02:57:28.160747+0000","last_clean":"2023-10-06T02:57:28.160747+0000","last_became_active":"2023-10-06T02:57:28.160491+0000","last_became_peered":"2023-10-06T02:57:28.160491+0000","last_unstale":"2023-10-06T02:57:28.160747+0000","last_undegraded":"2023-10-06T02:57:28.160747+0000","last_fullsized":"2023-10-06T02:57:28.160747+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:54.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148637+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:51.680609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.163501+0000","last_change":"2023-10-06T02:57:28.163501+0000","last_active":"2023-10-06T02:57:28.163501+0000","last_peered":"2023-10-06T02:57:28.163501+0000","last_clean":"2023-10-06T02:57:28.163501+0000","last_became_active":"2023-10-06T02:57:28.163221+0000","last_became_peered":"2023-10-06T02:57:28.163221+0000","last_unstale":"2023-10-06T02:57:28.163501+0000","last_undegraded":"2023-10-06T02:57:28.163501+0000","last_fullsized":"2023-10-06T02:57:28.163501+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:21.591868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147226+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:59.497675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155033+0000","last_change":"2023-10-06T02:57:28.155033+0000","last_active":"2023-10-06T02:57:28.155033+0000","last_peered":"2023-10-06T02:57:28.155033+0000","last_clean":"2023-10-06T02:57:28.155033+0000","last_became_active":"2023-10-06T02:57:28.154759+0000","last_became_peered":"2023-10-06T02:57:28.154759+0000","last_unstale":"2023-10-06T02:57:28.155033+0000","last_undegraded":"2023-10-06T02:57:28.155033+0000","last_fullsized":"2023-10-06T02:57:28.155033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:40.908455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148917+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:44.264633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.156381+0000","last_change":"2023-10-06T02:57:28.156381+0000","last_active":"2023-10-06T02:57:28.156381+0000","last_peered":"2023-10-06T02:57:28.156381+0000","last_clean":"2023-10-06T02:57:28.156381+0000","last_became_active":"2023-10-06T02:57:28.156172+0000","last_became_peered":"2023-10-06T02:57:28.156172+0000","last_unstale":"2023-10-06T02:57:28.156381+0000","last_undegraded":"2023-10-06T02:57:28.156381+0000","last_fullsized":"2023-10-06T02:57:28.156381+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:50.675247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148511+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.148715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.150712+0000","last_change":"2023-10-06T02:57:28.150712+0000","last_active":"2023-10-06T02:57:28.150712+0000","last_peered":"2023-10-06T02:57:28.150712+0000","last_clean":"2023-10-06T02:57:28.150712+0000","last_became_active":"2023-10-06T02:57:28.150426+0000","last_became_peered":"2023-10-06T02:57:28.150426+0000","last_unstale":"2023-10-06T02:57:28.150712+0000","last_undegraded":"2023-10-06T02:57:28.150712+0000","last_fullsized":"2023-10-06T02:57:28.150712+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:47.960513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145749+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158040+0000","last_change":"2023-10-06T02:57:28.158040+0000","last_active":"2023-10-06T02:57:28.158040+0000","last_peered":"2023-10-06T02:57:28.158040+0000","last_clean":"2023-10-06T02:57:28.158040+0000","last_became_active":"2023-10-06T02:57:28.157767+0000","last_became_peered":"2023-10-06T02:57:28.157767+0000","last_unstale":"2023-10-06T02:57:28.158040+0000","last_undegraded":"2023-10-06T02:57:28.158040+0000","last_fullsized":"2023-10-06T02:57:28.158040+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:56.163695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144377+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.153360+0000","last_change":"2023-10-06T02:57:28.153360+0000","last_active":"2023-10-06T02:57:28.153360+0000","last_peered":"2023-10-06T02:57:28.153360+0000","last_clean":"2023-10-06T02:57:28.153360+0000","last_became_active":"2023-10-06T02:57:28.153120+0000","last_became_peered":"2023-10-06T02:57:28.153120+0000","last_unstale":"2023-10-06T02:57:28.153360+0000","last_undegraded":"2023-10-06T02:57:28.153360+0000","last_fullsized":"2023-10-06T02:57:28.153360+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:44.063071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147591+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:06.275776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155104+0000","last_change":"2023-10-06T02:57:28.155104+0000","last_active":"2023-10-06T02:57:28.155104+0000","last_peered":"2023-10-06T02:57:28.155104+0000","last_clean":"2023-10-06T02:57:28.155104+0000","last_became_active":"2023-10-06T02:57:28.154822+0000","last_became_peered":"2023-10-06T02:57:28.154822+0000","last_unstale":"2023-10-06T02:57:28.155104+0000","last_undegraded":"2023-10-06T02:57:28.155104+0000","last_fullsized":"2023-10-06T02:57:28.155104+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147894+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:06.133045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160730+0000","last_change":"2023-10-06T02:57:28.160730+0000","last_active":"2023-10-06T02:57:28.160730+0000","last_peered":"2023-10-06T02:57:28.160730+0000","last_clean":"2023-10-06T02:57:28.160730+0000","last_became_active":"2023-10-06T02:57:28.160482+0000","last_became_peered":"2023-10-06T02:57:28.160482+0000","last_unstale":"2023-10-06T02:57:28.160730+0000","last_undegraded":"2023-10-06T02:57:28.160730+0000","last_fullsized":"2023-10-06T02:57:28.160730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:48.044243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.146691+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.151353+0000","last_change":"2023-10-06T02:57:28.151353+0000","last_active":"2023-10-06T02:57:28.151353+0000","last_peered":"2023-10-06T02:57:28.151353+0000","last_clean":"2023-10-06T02:57:28.151353+0000","last_became_active":"2023-10-06T02:57:28.151093+0000","last_became_peered":"2023-10-06T02:57:28.151093+0000","last_unstale":"2023-10-06T02:57:28.151353+0000","last_undegraded":"2023-10-06T02:57:28.151353+0000","last_fullsized":"2023-10-06T02:57:28.151353+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.150074+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158553+0000","last_change":"2023-10-06T02:57:28.158553+0000","last_active":"2023-10-06T02:57:28.158553+0000","last_peered":"2023-10-06T02:57:28.158553+0000","last_clean":"2023-10-06T02:57:28.158553+0000","last_became_active":"2023-10-06T02:57:28.158316+0000","last_became_peered":"2023-10-06T02:57:28.158316+0000","last_unstale":"2023-10-06T02:57:28.158553+0000","last_undegraded":"2023-10-06T02:57:28.158553+0000","last_fullsized":"2023-10-06T02:57:28.158553+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:58.492313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.145174+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:57:27.145174+0000","last_peered":"2023-10-06T02:57:27.145174+0000","last_clean":"2023-10-06T02:57:27.145174+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:57:27.145174+0000","last_undegraded":"2023-10-06T02:57:27.145174+0000","last_fullsized":"2023-10-06T02:57:27.145174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145262+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:44.264633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158916+0000","last_change":"2023-10-06T02:57:28.158916+0000","last_active":"2023-10-06T02:57:28.158916+0000","last_peered":"2023-10-06T02:57:28.158916+0000","last_clean":"2023-10-06T02:57:28.158916+0000","last_became_active":"2023-10-06T02:57:28.158666+0000","last_became_peered":"2023-10-06T02:57:28.158666+0000","last_unstale":"2023-10-06T02:57:28.158916+0000","last_undegraded":"2023-10-06T02:57:28.158916+0000","last_fullsized":"2023-10-06T02:57:28.158916+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:05.270414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.142981+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:57:27.142981+0000","last_peered":"2023-10-06T02:57:27.142981+0000","last_clean":"2023-10-06T02:57:27.142981+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:57:27.142981+0000","last_undegraded":"2023-10-06T02:57:27.142981+0000","last_fullsized":"2023-10-06T02:57:27.142981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147492+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:03.080903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155037+0000","last_change":"2023-10-06T02:57:28.155037+0000","last_active":"2023-10-06T02:57:28.155037+0000","last_peered":"2023-10-06T02:57:28.155037+0000","last_clean":"2023-10-06T02:57:28.155037+0000","last_became_active":"2023-10-06T02:57:28.154790+0000","last_became_peered":"2023-10-06T02:57:28.154790+0000","last_unstale":"2023-10-06T02:57:28.155037+0000","last_undegraded":"2023-10-06T02:57:28.155037+0000","last_fullsized":"2023-10-06T02:57:28.155037+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.136393+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:57:27.136393+0000","last_peered":"2023-10-06T02:57:27.136393+0000","last_clean":"2023-10-06T02:57:27.136393+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:57:27.136393+0000","last_undegraded":"2023-10-06T02:57:27.136393+0000","last_fullsized":"2023-10-06T02:57:27.136393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144726+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.153262+0000","last_change":"2023-10-06T02:57:28.153262+0000","last_active":"2023-10-06T02:57:28.153262+0000","last_peered":"2023-10-06T02:57:28.153262+0000","last_clean":"2023-10-06T02:57:28.153262+0000","last_became_active":"2023-10-06T02:57:28.152963+0000","last_became_peered":"2023-10-06T02:57:28.152963+0000","last_unstale":"2023-10-06T02:57:28.153262+0000","last_undegraded":"2023-10-06T02:57:28.153262+0000","last_fullsized":"2023-10-06T02:57:28.153262+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:21.640991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.143019+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:57:27.143019+0000","last_peered":"2023-10-06T02:57:27.143019+0000","last_clean":"2023-10-06T02:57:27.143019+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:57:27.143019+0000","last_undegraded":"2023-10-06T02:57:27.143019+0000","last_fullsized":"2023-10-06T02:57:27.143019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.140838+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:57:27.140838+0000","last_peered":"2023-10-06T02:57:27.140838+0000","last_clean":"2023-10-06T02:57:27.140838+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:57:27.140838+0000","last_undegraded":"2023-10-06T02:57:27.140838+0000","last_fullsized":"2023-10-06T02:57:27.140838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.145614+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:21.534628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158519+0000","last_change":"2023-10-06T02:57:28.158519+0000","last_active":"2023-10-06T02:57:28.158519+0000","last_peered":"2023-10-06T02:57:28.158519+0000","last_clean":"2023-10-06T02:57:28.158519+0000","last_became_active":"2023-10-06T02:57:28.158257+0000","last_became_peered":"2023-10-06T02:57:28.158257+0000","last_unstale":"2023-10-06T02:57:28.158519+0000","last_undegraded":"2023-10-06T02:57:28.158519+0000","last_fullsized":"2023-10-06T02:57:28.158519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:29.265968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.140858+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:57:27.140858+0000","last_peered":"2023-10-06T02:57:27.140858+0000","last_clean":"2023-10-06T02:57:27.140858+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:57:27.140858+0000","last_undegraded":"2023-10-06T02:57:27.140858+0000","last_fullsized":"2023-10-06T02:57:27.140858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148325+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:48.865612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.159275+0000","last_change":"2023-10-06T02:57:28.159275+0000","last_active":"2023-10-06T02:57:28.159275+0000","last_peered":"2023-10-06T02:57:28.159275+0000","last_clean":"2023-10-06T02:57:28.159275+0000","last_became_active":"2023-10-06T02:57:28.158956+0000","last_became_peered":"2023-10-06T02:57:28.158956+0000","last_unstale":"2023-10-06T02:57:28.159275+0000","last_undegraded":"2023-10-06T02:57:28.159275+0000","last_fullsized":"2023-10-06T02:57:28.159275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:22.990325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.140908+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:57:27.140908+0000","last_peered":"2023-10-06T02:57:27.140908+0000","last_clean":"2023-10-06T02:57:27.140908+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:57:27.140908+0000","last_undegraded":"2023-10-06T02:57:27.140908+0000","last_fullsized":"2023-10-06T02:57:27.140908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148206+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:57.169057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155416+0000","last_change":"2023-10-06T02:57:28.155416+0000","last_active":"2023-10-06T02:57:28.155416+0000","last_peered":"2023-10-06T02:57:28.155416+0000","last_clean":"2023-10-06T02:57:28.155416+0000","last_became_active":"2023-10-06T02:57:28.155144+0000","last_became_peered":"2023-10-06T02:57:28.155144+0000","last_unstale":"2023-10-06T02:57:28.155416+0000","last_undegraded":"2023-10-06T02:57:28.155416+0000","last_fullsized":"2023-10-06T02:57:28.155416+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.145205+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:57:27.145205+0000","last_peered":"2023-10-06T02:57:27.145205+0000","last_clean":"2023-10-06T02:57:27.145205+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:57:27.145205+0000","last_undegraded":"2023-10-06T02:57:27.145205+0000","last_fullsized":"2023-10-06T02:57:27.145205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.144437+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158264+0000","last_change":"2023-10-06T02:57:28.158264+0000","last_active":"2023-10-06T02:57:28.158264+0000","last_peered":"2023-10-06T02:57:28.158264+0000","last_clean":"2023-10-06T02:57:28.158264+0000","last_became_active":"2023-10-06T02:57:28.157981+0000","last_became_peered":"2023-10-06T02:57:28.157981+0000","last_unstale":"2023-10-06T02:57:28.158264+0000","last_undegraded":"2023-10-06T02:57:28.158264+0000","last_fullsized":"2023-10-06T02:57:28.158264+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:47.860250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.138307+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:57:27.138307+0000","last_peered":"2023-10-06T02:57:27.138307+0000","last_clean":"2023-10-06T02:57:27.138307+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:57:27.138307+0000","last_undegraded":"2023-10-06T02:57:27.138307+0000","last_fullsized":"2023-10-06T02:57:27.138307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298496,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073344,"statfs":{"total":96636764160,"available":96331104256,"internally_reserved":0,"allocated":1236992,"data_stored":885500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.311},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65600000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.31,"15min":0.31},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59599999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65700000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.5},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67000000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38300000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64900000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.433},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68400000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":295132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":3.415,"15min":3.415},"last":0.497},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":1.546,"15min":1.546},"last":0.623},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68899999999999995,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63400000000000001,"5min":1.74,"15min":1.74},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.70399999999999996,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.71599999999999997,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.74299999999999999,"5min":3.577,"15min":3.577},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.67300000000000004,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.66300000000000003,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68000000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.87}]},{"osd":7,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.88200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073928,"statfs":{"total":96636764160,"available":96331702272,"internally_reserved":0,"allocated":638976,"data_stored":294121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.22,"5min":0.19,"15min":0.19},"max":{"1min":0.48499999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.376,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59999999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":1.21,"15min":1.3500000000000001},"min":{"1min":0.24299999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51800000000000002,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65500000000000003,"5min":1.181,"15min":1.181},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":1.02,"15min":1.02},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.629,"5min":1.4339999999999999,"15min":1.5680000000000001},"min":{"1min":0.46800000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85599999999999998,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.423,"15min":1.5529999999999999},"min":{"1min":0.45000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95699999999999996,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.504,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82099999999999995,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.628,"5min":1.452,"15min":1.5900000000000001},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":21.166,"15min":21.166},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81999999999999995,"5min":0.997,"15min":0.997},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073348,"statfs":{"total":96636764160,"available":96331108352,"internally_reserved":0,"allocated":1232896,"data_stored":884489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.434,"5min":0.441,"15min":0.441},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.27600000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.374,"15min":0.372},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.317,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.32500000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72699999999999998,"5min":0.879,"15min":0.879},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73799999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73099999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":295132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.31,"15min":0.30599999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47399999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.317},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.5,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.312}]},{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65000000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58799999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.499},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.747,"5min":0.755,"15min":0.755},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55500000000000005},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71899999999999997,"5min":1.077,"15min":1.077},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.435,"15min":0.435},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073928,"statfs":{"total":96636764160,"available":96331702272,"internally_reserved":0,"allocated":638976,"data_stored":294121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.623,"5min":2.569,"15min":2.569},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.53800000000000003,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.27700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.439,"15min":0.44900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57699999999999996,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56200000000000006,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.23799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.49399999999999999,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.28999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.77600000000000002,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77800000000000002,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69099999999999995,"15min":0.70299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77000000000000002,"5min":2.532,"15min":2.532},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72899999999999998,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.497,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.78300000000000003,"5min":2.496,"15min":2.496},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76200000000000001,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.40799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297904,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073936,"statfs":{"total":96636764160,"available":96331710464,"internally_reserved":0,"allocated":630784,"data_stored":288204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.44}]},{"osd":3,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":1.0109999999999999,"15min":1.073},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.503},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":295132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.38100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67400000000000004,"5min":1.167,"15min":1.167},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.44500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.117,"15min":1.117},"last":0.495},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.35499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":1.2,"15min":1.2},"last":0.626},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.68899999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68400000000000005,"5min":1.135,"15min":1.135},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81599999999999995,"5min":1.208,"15min":1.208},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":0.87},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.89200000000000002,"5min":1.054,"15min":1.054},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.377,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.008},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:57:33.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:57:33.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.730+0000 7ff8795c7700 1 Processor -- start 2023-10-06T02:57:33.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.730+0000 7ff8795c7700 1 -- start start 2023-10-06T02:57:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.731+0000 7ff8795c7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff8740b49e0 0x7ff8740aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.731+0000 7ff8795c7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740b07a0 0x7ff8740b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.731+0000 7ff8795c7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740b0ca0 con 0x7ff8741595a0 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.731+0000 7ff8795c7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8740b0f80 con 0x7ff8740b49e0 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.731+0000 7ff8795c7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740b1260 con 0x7ff8740b07a0 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.731+0000 7ff872ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff8741595a0 0x7ff8740aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48166/0 (socket says 172.21.15.84:48166) 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.731+0000 7ff872ffd700 1 -- 172.21.15.84:0/1719408240 learned_addr learned my addr 172.21.15.84:0/1719408240 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.731+0000 7ff8737fe700 1 --2- 172.21.15.84:0/1719408240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740b07a0 0x7ff8740b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.731+0000 7ff86a7fc700 1 --2- 172.21.15.84:0/1719408240 >> v2:172.21.15.131:3300/0 conn(0x7ff8740b49e0 0x7ff8740aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8727fc700 1 -- 172.21.15.84:0/1719408240 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250669067 0 0) 0x7ff8740b0ca0 con 0x7ff8741595a0 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8727fc700 1 -- 172.21.15.84:0/1719408240 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff860003570 con 0x7ff8741595a0 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8737fe700 1 -- 172.21.15.84:0/1719408240 >> v2:172.21.15.131:3300/0 conn(0x7ff8740b49e0 msgr2=0x7ff8740aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8737fe700 1 --2- 172.21.15.84:0/1719408240 >> v2:172.21.15.131:3300/0 conn(0x7ff8740b49e0 0x7ff8740aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8737fe700 1 -- 172.21.15.84:0/1719408240 >> v1:172.21.15.84:6789/0 conn(0x7ff8741595a0 legacy=0x7ff8740aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8737fe700 1 -- 172.21.15.84:0/1719408240 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740b1540 con 0x7ff8740b07a0 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8737fe700 1 --2- 172.21.15.84:0/1719408240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740b07a0 0x7ff8740b1c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009e90 tx=0x7ff86c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc3f7d596781d6a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8727fc700 1 -- 172.21.15.84:0/1719408240 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00e070 con 0x7ff8740b07a0 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8727fc700 1 -- 172.21.15.84:0/1719408240 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c00bb40 con 0x7ff8740b07a0 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.732+0000 7ff8727fc700 1 -- 172.21.15.84:0/1719408240 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c012430 con 0x7ff8740b07a0 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.733+0000 7ff8795c7700 1 -- 172.21.15.84:0/1719408240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740b07a0 msgr2=0x7ff8740b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.733+0000 7ff8795c7700 1 --2- 172.21.15.84:0/1719408240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740b07a0 0x7ff8740b1c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009e90 tx=0x7ff86c009780 comp rx=0 tx=0).stop 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.733+0000 7ff8795c7700 1 -- 172.21.15.84:0/1719408240 shutdown_connections 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.733+0000 7ff8795c7700 1 --2- 172.21.15.84:0/1719408240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740b07a0 0x7ff8740b1c00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.733+0000 7ff8795c7700 1 --2- 172.21.15.84:0/1719408240 >> v2:172.21.15.131:3300/0 conn(0x7ff8740b49e0 0x7ff8740aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.733+0000 7ff8795c7700 1 -- 172.21.15.84:0/1719408240 >> 172.21.15.84:0/1719408240 conn(0x7ff874099830 msgr2=0x7ff87406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.733+0000 7ff8795c7700 1 -- 172.21.15.84:0/1719408240 shutdown_connections 2023-10-06T02:57:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.733+0000 7ff8795c7700 1 -- 172.21.15.84:0/1719408240 wait complete. 2023-10-06T02:57:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.734+0000 7ff8795c7700 1 Processor -- start 2023-10-06T02:57:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.734+0000 7ff8795c7700 1 -- start start 2023-10-06T02:57:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff8795c7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8740b07a0 0x7ff8740abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff8795c7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8740b49e0 0x7ff874157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff8795c7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8741595a0 0x7ff87409c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff8795c7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87409ddf0 con 0x7ff8740b07a0 2023-10-06T02:57:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff8795c7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87409d960 con 0x7ff8740b49e0 2023-10-06T02:57:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff8795c7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff874158150 con 0x7ff8741595a0 2023-10-06T02:57:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8740b07a0 0x7ff8740abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff872ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8740b07a0 0x7ff8740abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57894/0 (socket says 172.21.15.84:57894) 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff872ffd700 1 -- 172.21.15.84:0/3990747196 learned_addr learned my addr 172.21.15.84:0/3990747196 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff8737fe700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8741595a0 0x7ff87409c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff86a7fc700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8740b49e0 0x7ff874157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff872ffd700 1 -- 172.21.15.84:0/3990747196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8741595a0 msgr2=0x7ff87409c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff872ffd700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8741595a0 0x7ff87409c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff872ffd700 1 -- 172.21.15.84:0/3990747196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8740b49e0 msgr2=0x7ff874157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff872ffd700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8740b49e0 0x7ff874157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff872ffd700 1 -- 172.21.15.84:0/3990747196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c009a20 con 0x7ff8740b07a0 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff872ffd700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8740b07a0 0x7ff8740abe90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c790 tx=0x7ff864007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff86b7fe700 1 -- 172.21.15.84:0/3990747196 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640072e0 con 0x7ff8740b07a0 2023-10-06T02:57:33.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff86b7fe700 1 -- 172.21.15.84:0/3990747196 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff864007440 con 0x7ff8740b07a0 2023-10-06T02:57:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87409cd50 con 0x7ff8740b07a0 2023-10-06T02:57:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff86b7fe700 1 -- 172.21.15.84:0/3990747196 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640057f0 con 0x7ff8740b07a0 2023-10-06T02:57:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.735+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87409d310 con 0x7ff8740b07a0 2023-10-06T02:57:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.736+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8740af7a0 con 0x7ff8740b07a0 2023-10-06T02:57:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.737+0000 7ff86b7fe700 1 -- 172.21.15.84:0/3990747196 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff864005ba0 con 0x7ff8740b07a0 2023-10-06T02:57:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.737+0000 7ff86b7fe700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.737+0000 7ff86b7fe700 1 -- 172.21.15.84:0/3990747196 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff864083a70 con 0x7ff8740b07a0 2023-10-06T02:57:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.737+0000 7ff86a7fc700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.737+0000 7ff86a7fc700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff87409a5c0 tx=0x7ff85c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:33.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.741+0000 7ff86b7fe700 1 -- 172.21.15.84:0/3990747196 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff86404b5a0 con 0x7ff8740b07a0 2023-10-06T02:57:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.922+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff87409daa0 con 0x7ff854066f30 2023-10-06T02:57:33.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.930+0000 7ff86b7fe700 1 -- 172.21.15.84:0/3990747196 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311154 (secure 0 0 0) 0x7ff85c011a20 con 0x7ff854066f30 2023-10-06T02:57:33.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 msgr2=0x7ff8540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff87409a5c0 tx=0x7ff85c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8740b07a0 msgr2=0x7ff8740abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8740b07a0 0x7ff8740abe90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c790 tx=0x7ff864007c80 comp rx=0 tx=0).stop 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 shutdown_connections 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8741595a0 0x7ff87409c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8740b07a0 0x7ff8740abe90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 --2- 172.21.15.84:0/3990747196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8740b49e0 0x7ff874157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:33.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.933+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 >> 172.21.15.84:0/3990747196 conn(0x7ff874099830 msgr2=0x7ff8740cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.934+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 shutdown_connections 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:33.934+0000 7ff8795c7700 1 -- 172.21.15.84:0/3990747196 wait complete. 2023-10-06T02:57:33.942 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:57:33.947 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-10-06T02:57:33.834525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384704,"kb_used_data":6400,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590016,"statfs":{"total":773094113280,"available":770652176384,"internally_reserved":0,"allocated":6553600,"data_stored":3644060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001138"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165677+0000","last_change":"2023-10-06T02:57:29.159693+0000","last_active":"2023-10-06T02:57:29.165677+0000","last_peered":"2023-10-06T02:57:29.165677+0000","last_clean":"2023-10-06T02:57:29.165677+0000","last_became_active":"2023-10-06T02:57:29.159469+0000","last_became_peered":"2023-10-06T02:57:29.159469+0000","last_unstale":"2023-10-06T02:57:29.165677+0000","last_undegraded":"2023-10-06T02:57:29.165677+0000","last_fullsized":"2023-10-06T02:57:29.165677+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.148715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157359+0000","last_change":"2023-10-06T02:57:29.152975+0000","last_active":"2023-10-06T02:57:29.157359+0000","last_peered":"2023-10-06T02:57:29.157359+0000","last_clean":"2023-10-06T02:57:29.157359+0000","last_became_active":"2023-10-06T02:57:29.152728+0000","last_became_peered":"2023-10-06T02:57:29.152728+0000","last_unstale":"2023-10-06T02:57:29.157359+0000","last_undegraded":"2023-10-06T02:57:29.157359+0000","last_fullsized":"2023-10-06T02:57:29.157359+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:51.466721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170492+0000","last_change":"2023-10-06T02:57:29.166875+0000","last_active":"2023-10-06T02:57:29.170492+0000","last_peered":"2023-10-06T02:57:29.170492+0000","last_clean":"2023-10-06T02:57:29.170492+0000","last_became_active":"2023-10-06T02:57:29.166606+0000","last_became_peered":"2023-10-06T02:57:29.166606+0000","last_unstale":"2023-10-06T02:57:29.170492+0000","last_undegraded":"2023-10-06T02:57:29.170492+0000","last_fullsized":"2023-10-06T02:57:29.170492+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:01.634204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161080+0000","last_change":"2023-10-06T02:57:29.157387+0000","last_active":"2023-10-06T02:57:29.161080+0000","last_peered":"2023-10-06T02:57:29.161080+0000","last_clean":"2023-10-06T02:57:29.161080+0000","last_became_active":"2023-10-06T02:57:29.157093+0000","last_became_peered":"2023-10-06T02:57:29.157093+0000","last_unstale":"2023-10-06T02:57:29.161080+0000","last_undegraded":"2023-10-06T02:57:29.161080+0000","last_fullsized":"2023-10-06T02:57:29.161080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168600+0000","last_change":"2023-10-06T02:57:29.162615+0000","last_active":"2023-10-06T02:57:29.168600+0000","last_peered":"2023-10-06T02:57:29.168600+0000","last_clean":"2023-10-06T02:57:29.168600+0000","last_became_active":"2023-10-06T02:57:29.162354+0000","last_became_peered":"2023-10-06T02:57:29.162354+0000","last_unstale":"2023-10-06T02:57:29.168600+0000","last_undegraded":"2023-10-06T02:57:29.168600+0000","last_fullsized":"2023-10-06T02:57:29.168600+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:30.271330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165266+0000","last_change":"2023-10-06T02:57:29.154923+0000","last_active":"2023-10-06T02:57:29.165266+0000","last_peered":"2023-10-06T02:57:29.165266+0000","last_clean":"2023-10-06T02:57:29.165266+0000","last_became_active":"2023-10-06T02:57:29.153381+0000","last_became_peered":"2023-10-06T02:57:29.153381+0000","last_unstale":"2023-10-06T02:57:29.165266+0000","last_undegraded":"2023-10-06T02:57:29.165266+0000","last_fullsized":"2023-10-06T02:57:29.165266+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:54.010722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168976+0000","last_change":"2023-10-06T02:57:29.163260+0000","last_active":"2023-10-06T02:57:29.168976+0000","last_peered":"2023-10-06T02:57:29.168976+0000","last_clean":"2023-10-06T02:57:29.168976+0000","last_became_active":"2023-10-06T02:57:29.162996+0000","last_became_peered":"2023-10-06T02:57:29.162996+0000","last_unstale":"2023-10-06T02:57:29.168976+0000","last_undegraded":"2023-10-06T02:57:29.168976+0000","last_fullsized":"2023-10-06T02:57:29.168976+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:44.291549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175383+0000","last_change":"2023-10-06T02:57:29.170539+0000","last_active":"2023-10-06T02:57:29.175383+0000","last_peered":"2023-10-06T02:57:29.175383+0000","last_clean":"2023-10-06T02:57:29.175383+0000","last_became_active":"2023-10-06T02:57:29.170262+0000","last_became_peered":"2023-10-06T02:57:29.170262+0000","last_unstale":"2023-10-06T02:57:29.175383+0000","last_undegraded":"2023-10-06T02:57:29.175383+0000","last_fullsized":"2023-10-06T02:57:29.175383+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:20.249704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175960+0000","last_change":"2023-10-06T02:57:29.168884+0000","last_active":"2023-10-06T02:57:29.175960+0000","last_peered":"2023-10-06T02:57:29.175960+0000","last_clean":"2023-10-06T02:57:29.175960+0000","last_became_active":"2023-10-06T02:57:29.168677+0000","last_became_peered":"2023-10-06T02:57:29.168677+0000","last_unstale":"2023-10-06T02:57:29.175960+0000","last_undegraded":"2023-10-06T02:57:29.175960+0000","last_fullsized":"2023-10-06T02:57:29.175960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:58.527683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148493+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.638210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.149635+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:02.677073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163216+0000","last_change":"2023-10-06T02:57:29.160084+0000","last_active":"2023-10-06T02:57:29.163216+0000","last_peered":"2023-10-06T02:57:29.163216+0000","last_clean":"2023-10-06T02:57:29.163216+0000","last_became_active":"2023-10-06T02:57:29.159823+0000","last_became_peered":"2023-10-06T02:57:29.159823+0000","last_unstale":"2023-10-06T02:57:29.163216+0000","last_undegraded":"2023-10-06T02:57:29.163216+0000","last_fullsized":"2023-10-06T02:57:29.163216+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.173580+0000","last_change":"2023-10-06T02:57:29.168630+0000","last_active":"2023-10-06T02:57:29.173580+0000","last_peered":"2023-10-06T02:57:29.173580+0000","last_clean":"2023-10-06T02:57:29.173580+0000","last_became_active":"2023-10-06T02:57:29.168373+0000","last_became_peered":"2023-10-06T02:57:29.168373+0000","last_unstale":"2023-10-06T02:57:29.173580+0000","last_undegraded":"2023-10-06T02:57:29.173580+0000","last_fullsized":"2023-10-06T02:57:29.173580+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:49.049605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169050+0000","last_change":"2023-10-06T02:57:29.164304+0000","last_active":"2023-10-06T02:57:29.169050+0000","last_peered":"2023-10-06T02:57:29.169050+0000","last_clean":"2023-10-06T02:57:29.169050+0000","last_became_active":"2023-10-06T02:57:29.163293+0000","last_became_peered":"2023-10-06T02:57:29.163293+0000","last_unstale":"2023-10-06T02:57:29.169050+0000","last_undegraded":"2023-10-06T02:57:29.169050+0000","last_fullsized":"2023-10-06T02:57:29.169050+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168995+0000","last_change":"2023-10-06T02:57:29.164093+0000","last_active":"2023-10-06T02:57:29.168995+0000","last_peered":"2023-10-06T02:57:29.168995+0000","last_clean":"2023-10-06T02:57:29.168995+0000","last_became_active":"2023-10-06T02:57:29.162936+0000","last_became_peered":"2023-10-06T02:57:29.162936+0000","last_unstale":"2023-10-06T02:57:29.168995+0000","last_undegraded":"2023-10-06T02:57:29.168995+0000","last_fullsized":"2023-10-06T02:57:29.168995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:49.829140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172261+0000","last_change":"2023-10-06T02:57:29.168216+0000","last_active":"2023-10-06T02:57:29.172261+0000","last_peered":"2023-10-06T02:57:29.172261+0000","last_clean":"2023-10-06T02:57:29.172261+0000","last_became_active":"2023-10-06T02:57:29.167959+0000","last_became_peered":"2023-10-06T02:57:29.167959+0000","last_unstale":"2023-10-06T02:57:29.172261+0000","last_undegraded":"2023-10-06T02:57:29.172261+0000","last_fullsized":"2023-10-06T02:57:29.172261+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:22.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170283+0000","last_change":"2023-10-06T02:57:29.163607+0000","last_active":"2023-10-06T02:57:29.170283+0000","last_peered":"2023-10-06T02:57:29.170283+0000","last_clean":"2023-10-06T02:57:29.170283+0000","last_became_active":"2023-10-06T02:57:29.163324+0000","last_became_peered":"2023-10-06T02:57:29.163324+0000","last_unstale":"2023-10-06T02:57:29.170283+0000","last_undegraded":"2023-10-06T02:57:29.170283+0000","last_fullsized":"2023-10-06T02:57:29.170283+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:22.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169338+0000","last_change":"2023-10-06T02:57:29.159474+0000","last_active":"2023-10-06T02:57:29.169338+0000","last_peered":"2023-10-06T02:57:29.169338+0000","last_clean":"2023-10-06T02:57:29.169338+0000","last_became_active":"2023-10-06T02:57:29.159225+0000","last_became_peered":"2023-10-06T02:57:29.159225+0000","last_unstale":"2023-10-06T02:57:29.169338+0000","last_undegraded":"2023-10-06T02:57:29.169338+0000","last_fullsized":"2023-10-06T02:57:29.169338+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:21.534628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165913+0000","last_change":"2023-10-06T02:57:29.159191+0000","last_active":"2023-10-06T02:57:29.165913+0000","last_peered":"2023-10-06T02:57:29.165913+0000","last_clean":"2023-10-06T02:57:29.165913+0000","last_became_active":"2023-10-06T02:57:29.159012+0000","last_became_peered":"2023-10-06T02:57:29.159012+0000","last_unstale":"2023-10-06T02:57:29.165913+0000","last_undegraded":"2023-10-06T02:57:29.165913+0000","last_fullsized":"2023-10-06T02:57:29.165913+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:48.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.164401+0000","last_change":"2023-10-06T02:57:29.156281+0000","last_active":"2023-10-06T02:57:29.164401+0000","last_peered":"2023-10-06T02:57:29.164401+0000","last_clean":"2023-10-06T02:57:29.164401+0000","last_became_active":"2023-10-06T02:57:29.156042+0000","last_became_peered":"2023-10-06T02:57:29.156042+0000","last_unstale":"2023-10-06T02:57:29.164401+0000","last_undegraded":"2023-10-06T02:57:29.164401+0000","last_fullsized":"2023-10-06T02:57:29.164401+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:28.748475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.167987+0000","last_change":"2023-10-06T02:57:29.158339+0000","last_active":"2023-10-06T02:57:29.167987+0000","last_peered":"2023-10-06T02:57:29.167987+0000","last_clean":"2023-10-06T02:57:29.167987+0000","last_became_active":"2023-10-06T02:57:29.158061+0000","last_became_peered":"2023-10-06T02:57:29.158061+0000","last_unstale":"2023-10-06T02:57:29.167987+0000","last_undegraded":"2023-10-06T02:57:29.167987+0000","last_fullsized":"2023-10-06T02:57:29.167987+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157500+0000","last_change":"2023-10-06T02:57:29.154424+0000","last_active":"2023-10-06T02:57:29.157500+0000","last_peered":"2023-10-06T02:57:29.157500+0000","last_clean":"2023-10-06T02:57:29.157500+0000","last_became_active":"2023-10-06T02:57:29.154181+0000","last_became_peered":"2023-10-06T02:57:29.154181+0000","last_unstale":"2023-10-06T02:57:29.157500+0000","last_undegraded":"2023-10-06T02:57:29.157500+0000","last_fullsized":"2023-10-06T02:57:29.157500+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:33.824959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169436+0000","last_change":"2023-10-06T02:57:29.160645+0000","last_active":"2023-10-06T02:57:29.169436+0000","last_peered":"2023-10-06T02:57:29.169436+0000","last_clean":"2023-10-06T02:57:29.169436+0000","last_became_active":"2023-10-06T02:57:29.160178+0000","last_became_peered":"2023-10-06T02:57:29.160178+0000","last_unstale":"2023-10-06T02:57:29.169436+0000","last_undegraded":"2023-10-06T02:57:29.169436+0000","last_fullsized":"2023-10-06T02:57:29.169436+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.173573+0000","last_change":"2023-10-06T02:57:29.168580+0000","last_active":"2023-10-06T02:57:29.173573+0000","last_peered":"2023-10-06T02:57:29.173573+0000","last_clean":"2023-10-06T02:57:29.173573+0000","last_became_active":"2023-10-06T02:57:29.168310+0000","last_became_peered":"2023-10-06T02:57:29.168310+0000","last_unstale":"2023-10-06T02:57:29.173573+0000","last_undegraded":"2023-10-06T02:57:29.173573+0000","last_fullsized":"2023-10-06T02:57:29.173573+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:41.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163459+0000","last_change":"2023-10-06T02:57:29.157101+0000","last_active":"2023-10-06T02:57:29.163459+0000","last_peered":"2023-10-06T02:57:29.163459+0000","last_clean":"2023-10-06T02:57:29.163459+0000","last_became_active":"2023-10-06T02:57:29.156829+0000","last_became_peered":"2023-10-06T02:57:29.156829+0000","last_unstale":"2023-10-06T02:57:29.163459+0000","last_undegraded":"2023-10-06T02:57:29.163459+0000","last_fullsized":"2023-10-06T02:57:29.163459+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:41.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169559+0000","last_change":"2023-10-06T02:57:29.164996+0000","last_active":"2023-10-06T02:57:29.169559+0000","last_peered":"2023-10-06T02:57:29.169559+0000","last_clean":"2023-10-06T02:57:29.169559+0000","last_became_active":"2023-10-06T02:57:29.164679+0000","last_became_peered":"2023-10-06T02:57:29.164679+0000","last_unstale":"2023-10-06T02:57:29.169559+0000","last_undegraded":"2023-10-06T02:57:29.169559+0000","last_fullsized":"2023-10-06T02:57:29.169559+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172324+0000","last_change":"2023-10-06T02:57:29.168679+0000","last_active":"2023-10-06T02:57:29.172324+0000","last_peered":"2023-10-06T02:57:29.172324+0000","last_clean":"2023-10-06T02:57:29.172324+0000","last_became_active":"2023-10-06T02:57:29.168426+0000","last_became_peered":"2023-10-06T02:57:29.168426+0000","last_unstale":"2023-10-06T02:57:29.172324+0000","last_undegraded":"2023-10-06T02:57:29.172324+0000","last_fullsized":"2023-10-06T02:57:29.172324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:20.249704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.155897+0000","last_change":"2023-10-06T02:57:29.151549+0000","last_active":"2023-10-06T02:57:29.155897+0000","last_peered":"2023-10-06T02:57:29.155897+0000","last_clean":"2023-10-06T02:57:29.155897+0000","last_became_active":"2023-10-06T02:57:29.151181+0000","last_became_peered":"2023-10-06T02:57:29.151181+0000","last_unstale":"2023-10-06T02:57:29.155897+0000","last_undegraded":"2023-10-06T02:57:29.155897+0000","last_fullsized":"2023-10-06T02:57:29.155897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:06.133045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.164949+0000","last_change":"2023-10-06T02:57:29.158104+0000","last_active":"2023-10-06T02:57:29.164949+0000","last_peered":"2023-10-06T02:57:29.164949+0000","last_clean":"2023-10-06T02:57:29.164949+0000","last_became_active":"2023-10-06T02:57:29.157801+0000","last_became_peered":"2023-10-06T02:57:29.157801+0000","last_unstale":"2023-10-06T02:57:29.164949+0000","last_undegraded":"2023-10-06T02:57:29.164949+0000","last_fullsized":"2023-10-06T02:57:29.164949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:15.012510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170380+0000","last_change":"2023-10-06T02:57:29.167425+0000","last_active":"2023-10-06T02:57:29.170380+0000","last_peered":"2023-10-06T02:57:29.170380+0000","last_clean":"2023-10-06T02:57:29.170380+0000","last_became_active":"2023-10-06T02:57:29.167207+0000","last_became_peered":"2023-10-06T02:57:29.167207+0000","last_unstale":"2023-10-06T02:57:29.170380+0000","last_undegraded":"2023-10-06T02:57:29.170380+0000","last_fullsized":"2023-10-06T02:57:29.170380+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.156443+0000","last_change":"2023-10-06T02:57:29.154381+0000","last_active":"2023-10-06T02:57:29.156443+0000","last_peered":"2023-10-06T02:57:29.156443+0000","last_clean":"2023-10-06T02:57:29.156443+0000","last_became_active":"2023-10-06T02:57:29.154008+0000","last_became_peered":"2023-10-06T02:57:29.154008+0000","last_unstale":"2023-10-06T02:57:29.156443+0000","last_undegraded":"2023-10-06T02:57:29.156443+0000","last_fullsized":"2023-10-06T02:57:29.156443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:49.049605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168315+0000","last_change":"2023-10-06T02:57:29.158071+0000","last_active":"2023-10-06T02:57:29.168315+0000","last_peered":"2023-10-06T02:57:29.168315+0000","last_clean":"2023-10-06T02:57:29.168315+0000","last_became_active":"2023-10-06T02:57:29.157887+0000","last_became_peered":"2023-10-06T02:57:29.157887+0000","last_unstale":"2023-10-06T02:57:29.168315+0000","last_undegraded":"2023-10-06T02:57:29.168315+0000","last_fullsized":"2023-10-06T02:57:29.168315+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:33.041583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168319+0000","last_change":"2023-10-06T02:57:29.161075+0000","last_active":"2023-10-06T02:57:29.168319+0000","last_peered":"2023-10-06T02:57:29.168319+0000","last_clean":"2023-10-06T02:57:29.168319+0000","last_became_active":"2023-10-06T02:57:29.160817+0000","last_became_peered":"2023-10-06T02:57:29.160817+0000","last_unstale":"2023-10-06T02:57:29.168319+0000","last_undegraded":"2023-10-06T02:57:29.168319+0000","last_fullsized":"2023-10-06T02:57:29.168319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'4","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.179503+0000","last_change":"2023-10-06T02:57:28.154223+0000","last_active":"2023-10-06T02:57:29.179503+0000","last_peered":"2023-10-06T02:57:29.179503+0000","last_clean":"2023-10-06T02:57:29.179503+0000","last_became_active":"2023-10-06T02:57:28.153990+0000","last_became_peered":"2023-10-06T02:57:28.153990+0000","last_unstale":"2023-10-06T02:57:29.179503+0000","last_undegraded":"2023-10-06T02:57:29.179503+0000","last_fullsized":"2023-10-06T02:57:29.179503+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:12.546662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148635+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:51.022047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176350+0000","last_change":"2023-10-06T02:57:28.160875+0000","last_active":"2023-10-06T02:57:29.176350+0000","last_peered":"2023-10-06T02:57:29.176350+0000","last_clean":"2023-10-06T02:57:29.176350+0000","last_became_active":"2023-10-06T02:57:28.160629+0000","last_became_peered":"2023-10-06T02:57:28.160629+0000","last_unstale":"2023-10-06T02:57:29.176350+0000","last_undegraded":"2023-10-06T02:57:29.176350+0000","last_fullsized":"2023-10-06T02:57:29.176350+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168188+0000","last_change":"2023-10-06T02:57:29.157464+0000","last_active":"2023-10-06T02:57:29.168188+0000","last_peered":"2023-10-06T02:57:29.168188+0000","last_clean":"2023-10-06T02:57:29.168188+0000","last_became_active":"2023-10-06T02:57:29.157219+0000","last_became_peered":"2023-10-06T02:57:29.157219+0000","last_unstale":"2023-10-06T02:57:29.168188+0000","last_undegraded":"2023-10-06T02:57:29.168188+0000","last_fullsized":"2023-10-06T02:57:29.168188+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:49.829140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176172+0000","last_change":"2023-10-06T02:57:28.154910+0000","last_active":"2023-10-06T02:57:29.176172+0000","last_peered":"2023-10-06T02:57:29.176172+0000","last_clean":"2023-10-06T02:57:29.176172+0000","last_became_active":"2023-10-06T02:57:28.154656+0000","last_became_peered":"2023-10-06T02:57:28.154656+0000","last_unstale":"2023-10-06T02:57:29.176172+0000","last_undegraded":"2023-10-06T02:57:29.176172+0000","last_fullsized":"2023-10-06T02:57:29.176172+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168622+0000","last_change":"2023-10-06T02:57:29.162359+0000","last_active":"2023-10-06T02:57:29.168622+0000","last_peered":"2023-10-06T02:57:29.168622+0000","last_clean":"2023-10-06T02:57:29.168622+0000","last_became_active":"2023-10-06T02:57:29.162140+0000","last_became_peered":"2023-10-06T02:57:29.162140+0000","last_unstale":"2023-10-06T02:57:29.168622+0000","last_undegraded":"2023-10-06T02:57:29.168622+0000","last_fullsized":"2023-10-06T02:57:29.168622+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:44.291549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.173802+0000","last_change":"2023-10-06T02:57:28.158739+0000","last_active":"2023-10-06T02:57:29.173802+0000","last_peered":"2023-10-06T02:57:29.173802+0000","last_clean":"2023-10-06T02:57:29.173802+0000","last_became_active":"2023-10-06T02:57:28.158477+0000","last_became_peered":"2023-10-06T02:57:28.158477+0000","last_unstale":"2023-10-06T02:57:29.173802+0000","last_undegraded":"2023-10-06T02:57:29.173802+0000","last_fullsized":"2023-10-06T02:57:29.173802+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:29.634384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168293+0000","last_change":"2023-10-06T02:57:29.164378+0000","last_active":"2023-10-06T02:57:29.168293+0000","last_peered":"2023-10-06T02:57:29.168293+0000","last_clean":"2023-10-06T02:57:29.168293+0000","last_became_active":"2023-10-06T02:57:29.156693+0000","last_became_peered":"2023-10-06T02:57:29.156693+0000","last_unstale":"2023-10-06T02:57:29.168293+0000","last_undegraded":"2023-10-06T02:57:29.168293+0000","last_fullsized":"2023-10-06T02:57:29.168293+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:26.397679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169348+0000","last_change":"2023-10-06T02:57:28.154727+0000","last_active":"2023-10-06T02:57:29.169348+0000","last_peered":"2023-10-06T02:57:29.169348+0000","last_clean":"2023-10-06T02:57:29.169348+0000","last_became_active":"2023-10-06T02:57:28.154457+0000","last_became_peered":"2023-10-06T02:57:28.154457+0000","last_unstale":"2023-10-06T02:57:29.169348+0000","last_undegraded":"2023-10-06T02:57:29.169348+0000","last_fullsized":"2023-10-06T02:57:29.169348+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157671+0000","last_change":"2023-10-06T02:57:29.154297+0000","last_active":"2023-10-06T02:57:29.157671+0000","last_peered":"2023-10-06T02:57:29.157671+0000","last_clean":"2023-10-06T02:57:29.157671+0000","last_became_active":"2023-10-06T02:57:29.154053+0000","last_became_peered":"2023-10-06T02:57:29.154053+0000","last_unstale":"2023-10-06T02:57:29.157671+0000","last_undegraded":"2023-10-06T02:57:29.157671+0000","last_fullsized":"2023-10-06T02:57:29.157671+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:07.324323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176991+0000","last_change":"2023-10-06T02:57:28.156466+0000","last_active":"2023-10-06T02:57:29.176991+0000","last_peered":"2023-10-06T02:57:29.176991+0000","last_clean":"2023-10-06T02:57:29.176991+0000","last_became_active":"2023-10-06T02:57:28.156258+0000","last_became_peered":"2023-10-06T02:57:28.156258+0000","last_unstale":"2023-10-06T02:57:29.176991+0000","last_undegraded":"2023-10-06T02:57:29.176991+0000","last_fullsized":"2023-10-06T02:57:29.176991+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:02.075540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163036+0000","last_change":"2023-10-06T02:57:29.159827+0000","last_active":"2023-10-06T02:57:29.163036+0000","last_peered":"2023-10-06T02:57:29.163036+0000","last_clean":"2023-10-06T02:57:29.163036+0000","last_became_active":"2023-10-06T02:57:29.159543+0000","last_became_peered":"2023-10-06T02:57:29.159543+0000","last_unstale":"2023-10-06T02:57:29.163036+0000","last_undegraded":"2023-10-06T02:57:29.163036+0000","last_fullsized":"2023-10-06T02:57:29.163036+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:30.271330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147822+0000","last_change":"2023-10-06T02:57:28.154919+0000","last_active":"2023-10-06T02:57:29.147822+0000","last_peered":"2023-10-06T02:57:29.147822+0000","last_clean":"2023-10-06T02:57:29.147822+0000","last_became_active":"2023-10-06T02:57:28.154620+0000","last_became_peered":"2023-10-06T02:57:28.154620+0000","last_unstale":"2023-10-06T02:57:29.147822+0000","last_undegraded":"2023-10-06T02:57:29.147822+0000","last_fullsized":"2023-10-06T02:57:29.147822+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:27.029195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175549+0000","last_change":"2023-10-06T02:57:29.168450+0000","last_active":"2023-10-06T02:57:29.175549+0000","last_peered":"2023-10-06T02:57:29.175549+0000","last_clean":"2023-10-06T02:57:29.175549+0000","last_became_active":"2023-10-06T02:57:29.162935+0000","last_became_peered":"2023-10-06T02:57:29.162935+0000","last_unstale":"2023-10-06T02:57:29.175549+0000","last_undegraded":"2023-10-06T02:57:29.175549+0000","last_fullsized":"2023-10-06T02:57:29.175549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:40.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.153192+0000","last_change":"2023-10-06T02:57:28.154846+0000","last_active":"2023-10-06T02:57:29.153192+0000","last_peered":"2023-10-06T02:57:29.153192+0000","last_clean":"2023-10-06T02:57:29.153192+0000","last_became_active":"2023-10-06T02:57:28.154580+0000","last_became_peered":"2023-10-06T02:57:28.154580+0000","last_unstale":"2023-10-06T02:57:29.153192+0000","last_undegraded":"2023-10-06T02:57:29.153192+0000","last_fullsized":"2023-10-06T02:57:29.153192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168676+0000","last_change":"2023-10-06T02:57:29.164564+0000","last_active":"2023-10-06T02:57:29.168676+0000","last_peered":"2023-10-06T02:57:29.168676+0000","last_clean":"2023-10-06T02:57:29.168676+0000","last_became_active":"2023-10-06T02:57:29.164307+0000","last_became_peered":"2023-10-06T02:57:29.164307+0000","last_unstale":"2023-10-06T02:57:29.168676+0000","last_undegraded":"2023-10-06T02:57:29.168676+0000","last_fullsized":"2023-10-06T02:57:29.168676+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:15.152388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147830+0000","last_change":"2023-10-06T02:57:28.162028+0000","last_active":"2023-10-06T02:57:29.147830+0000","last_peered":"2023-10-06T02:57:29.147830+0000","last_clean":"2023-10-06T02:57:29.147830+0000","last_became_active":"2023-10-06T02:57:28.161784+0000","last_became_peered":"2023-10-06T02:57:28.161784+0000","last_unstale":"2023-10-06T02:57:29.147830+0000","last_undegraded":"2023-10-06T02:57:29.147830+0000","last_fullsized":"2023-10-06T02:57:29.147830+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:22.612517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.167888+0000","last_change":"2023-10-06T02:57:29.157912+0000","last_active":"2023-10-06T02:57:29.167888+0000","last_peered":"2023-10-06T02:57:29.167888+0000","last_clean":"2023-10-06T02:57:29.167888+0000","last_became_active":"2023-10-06T02:57:29.157687+0000","last_became_peered":"2023-10-06T02:57:29.157687+0000","last_unstale":"2023-10-06T02:57:29.167888+0000","last_undegraded":"2023-10-06T02:57:29.167888+0000","last_fullsized":"2023-10-06T02:57:29.167888+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.143197+0000","last_change":"2023-10-06T02:57:28.158578+0000","last_active":"2023-10-06T02:57:29.143197+0000","last_peered":"2023-10-06T02:57:29.143197+0000","last_clean":"2023-10-06T02:57:29.143197+0000","last_became_active":"2023-10-06T02:57:28.158361+0000","last_became_peered":"2023-10-06T02:57:28.158361+0000","last_unstale":"2023-10-06T02:57:29.143197+0000","last_undegraded":"2023-10-06T02:57:29.143197+0000","last_fullsized":"2023-10-06T02:57:29.143197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.151744+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:24.455071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176092+0000","last_change":"2023-10-06T02:57:28.162959+0000","last_active":"2023-10-06T02:57:29.176092+0000","last_peered":"2023-10-06T02:57:29.176092+0000","last_clean":"2023-10-06T02:57:29.176092+0000","last_became_active":"2023-10-06T02:57:28.162660+0000","last_became_peered":"2023-10-06T02:57:28.162660+0000","last_unstale":"2023-10-06T02:57:29.176092+0000","last_undegraded":"2023-10-06T02:57:29.176092+0000","last_fullsized":"2023-10-06T02:57:29.176092+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:32.327057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170473+0000","last_change":"2023-10-06T02:57:29.162522+0000","last_active":"2023-10-06T02:57:29.170473+0000","last_peered":"2023-10-06T02:57:29.170473+0000","last_clean":"2023-10-06T02:57:29.170473+0000","last_became_active":"2023-10-06T02:57:29.162186+0000","last_became_peered":"2023-10-06T02:57:29.162186+0000","last_unstale":"2023-10-06T02:57:29.170473+0000","last_undegraded":"2023-10-06T02:57:29.170473+0000","last_fullsized":"2023-10-06T02:57:29.170473+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'6","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.178971+0000","last_change":"2023-10-06T02:57:28.155523+0000","last_active":"2023-10-06T02:57:29.178971+0000","last_peered":"2023-10-06T02:57:29.178971+0000","last_clean":"2023-10-06T02:57:29.178971+0000","last_became_active":"2023-10-06T02:57:28.155251+0000","last_became_peered":"2023-10-06T02:57:28.155251+0000","last_unstale":"2023-10-06T02:57:29.178971+0000","last_undegraded":"2023-10-06T02:57:29.178971+0000","last_fullsized":"2023-10-06T02:57:29.178971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161062+0000","last_change":"2023-10-06T02:57:29.157777+0000","last_active":"2023-10-06T02:57:29.161062+0000","last_peered":"2023-10-06T02:57:29.161062+0000","last_clean":"2023-10-06T02:57:29.161062+0000","last_became_active":"2023-10-06T02:57:29.157437+0000","last_became_peered":"2023-10-06T02:57:29.157437+0000","last_unstale":"2023-10-06T02:57:29.161062+0000","last_undegraded":"2023-10-06T02:57:29.161062+0000","last_fullsized":"2023-10-06T02:57:29.161062+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.177436+0000","last_change":"2023-10-06T02:57:28.160083+0000","last_active":"2023-10-06T02:57:29.177436+0000","last_peered":"2023-10-06T02:57:29.177436+0000","last_clean":"2023-10-06T02:57:29.177436+0000","last_became_active":"2023-10-06T02:57:28.158968+0000","last_became_peered":"2023-10-06T02:57:28.158968+0000","last_unstale":"2023-10-06T02:57:29.177436+0000","last_undegraded":"2023-10-06T02:57:29.177436+0000","last_fullsized":"2023-10-06T02:57:29.177436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169518+0000","last_change":"2023-10-06T02:57:29.161672+0000","last_active":"2023-10-06T02:57:29.169518+0000","last_peered":"2023-10-06T02:57:29.169518+0000","last_clean":"2023-10-06T02:57:29.169518+0000","last_became_active":"2023-10-06T02:57:29.161419+0000","last_became_peered":"2023-10-06T02:57:29.161419+0000","last_unstale":"2023-10-06T02:57:29.169518+0000","last_undegraded":"2023-10-06T02:57:29.169518+0000","last_fullsized":"2023-10-06T02:57:29.169518+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154494+0000","last_change":"2023-10-06T02:57:28.157931+0000","last_active":"2023-10-06T02:57:29.154494+0000","last_peered":"2023-10-06T02:57:29.154494+0000","last_clean":"2023-10-06T02:57:29.154494+0000","last_became_active":"2023-10-06T02:57:28.157645+0000","last_became_peered":"2023-10-06T02:57:28.157645+0000","last_unstale":"2023-10-06T02:57:29.154494+0000","last_undegraded":"2023-10-06T02:57:29.154494+0000","last_fullsized":"2023-10-06T02:57:29.154494+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:02.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165639+0000","last_change":"2023-10-06T02:57:29.160639+0000","last_active":"2023-10-06T02:57:29.165639+0000","last_peered":"2023-10-06T02:57:29.165639+0000","last_clean":"2023-10-06T02:57:29.165639+0000","last_became_active":"2023-10-06T02:57:29.160386+0000","last_became_peered":"2023-10-06T02:57:29.160386+0000","last_unstale":"2023-10-06T02:57:29.165639+0000","last_undegraded":"2023-10-06T02:57:29.165639+0000","last_fullsized":"2023-10-06T02:57:29.165639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:54.010722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147731+0000","last_change":"2023-10-06T02:57:28.160747+0000","last_active":"2023-10-06T02:57:29.147731+0000","last_peered":"2023-10-06T02:57:29.147731+0000","last_clean":"2023-10-06T02:57:29.147731+0000","last_became_active":"2023-10-06T02:57:28.160491+0000","last_became_peered":"2023-10-06T02:57:28.160491+0000","last_unstale":"2023-10-06T02:57:29.147731+0000","last_undegraded":"2023-10-06T02:57:29.147731+0000","last_fullsized":"2023-10-06T02:57:29.147731+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:54.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169454+0000","last_change":"2023-10-06T02:57:29.160795+0000","last_active":"2023-10-06T02:57:29.169454+0000","last_peered":"2023-10-06T02:57:29.169454+0000","last_clean":"2023-10-06T02:57:29.169454+0000","last_became_active":"2023-10-06T02:57:29.160448+0000","last_became_peered":"2023-10-06T02:57:29.160448+0000","last_unstale":"2023-10-06T02:57:29.169454+0000","last_undegraded":"2023-10-06T02:57:29.169454+0000","last_fullsized":"2023-10-06T02:57:29.169454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'8","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.177299+0000","last_change":"2023-10-06T02:57:28.163501+0000","last_active":"2023-10-06T02:57:29.177299+0000","last_peered":"2023-10-06T02:57:29.177299+0000","last_clean":"2023-10-06T02:57:29.177299+0000","last_became_active":"2023-10-06T02:57:28.163221+0000","last_became_peered":"2023-10-06T02:57:28.163221+0000","last_unstale":"2023-10-06T02:57:29.177299+0000","last_undegraded":"2023-10-06T02:57:29.177299+0000","last_fullsized":"2023-10-06T02:57:29.177299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:21.591868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161107+0000","last_change":"2023-10-06T02:57:29.157590+0000","last_active":"2023-10-06T02:57:29.161107+0000","last_peered":"2023-10-06T02:57:29.161107+0000","last_clean":"2023-10-06T02:57:29.161107+0000","last_became_active":"2023-10-06T02:57:29.157329+0000","last_became_peered":"2023-10-06T02:57:29.157329+0000","last_unstale":"2023-10-06T02:57:29.161107+0000","last_undegraded":"2023-10-06T02:57:29.161107+0000","last_fullsized":"2023-10-06T02:57:29.161107+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.995687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155033+0000","last_change":"2023-10-06T02:57:28.155033+0000","last_active":"2023-10-06T02:57:28.155033+0000","last_peered":"2023-10-06T02:57:28.155033+0000","last_clean":"2023-10-06T02:57:28.155033+0000","last_became_active":"2023-10-06T02:57:28.154759+0000","last_became_peered":"2023-10-06T02:57:28.154759+0000","last_unstale":"2023-10-06T02:57:28.155033+0000","last_undegraded":"2023-10-06T02:57:28.155033+0000","last_fullsized":"2023-10-06T02:57:28.155033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:40.908455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163188+0000","last_change":"2023-10-06T02:57:29.160336+0000","last_active":"2023-10-06T02:57:29.163188+0000","last_peered":"2023-10-06T02:57:29.163188+0000","last_clean":"2023-10-06T02:57:29.163188+0000","last_became_active":"2023-10-06T02:57:29.159485+0000","last_became_peered":"2023-10-06T02:57:29.159485+0000","last_unstale":"2023-10-06T02:57:29.163188+0000","last_undegraded":"2023-10-06T02:57:29.163188+0000","last_fullsized":"2023-10-06T02:57:29.163188+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:57:30.152180+0000","last_change":"2023-10-06T02:57:28.156381+0000","last_active":"2023-10-06T02:57:30.152180+0000","last_peered":"2023-10-06T02:57:30.152180+0000","last_clean":"2023-10-06T02:57:30.152180+0000","last_became_active":"2023-10-06T02:57:28.156172+0000","last_became_peered":"2023-10-06T02:57:28.156172+0000","last_unstale":"2023-10-06T02:57:30.152180+0000","last_undegraded":"2023-10-06T02:57:30.152180+0000","last_fullsized":"2023-10-06T02:57:30.152180+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:50.675247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148511+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.148715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154555+0000","last_change":"2023-10-06T02:57:28.150712+0000","last_active":"2023-10-06T02:57:29.154555+0000","last_peered":"2023-10-06T02:57:29.154555+0000","last_clean":"2023-10-06T02:57:29.154555+0000","last_became_active":"2023-10-06T02:57:28.150426+0000","last_became_peered":"2023-10-06T02:57:28.150426+0000","last_unstale":"2023-10-06T02:57:29.154555+0000","last_undegraded":"2023-10-06T02:57:29.154555+0000","last_fullsized":"2023-10-06T02:57:29.154555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:47.960513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168602+0000","last_change":"2023-10-06T02:57:29.162357+0000","last_active":"2023-10-06T02:57:29.168602+0000","last_peered":"2023-10-06T02:57:29.168602+0000","last_clean":"2023-10-06T02:57:29.168602+0000","last_became_active":"2023-10-06T02:57:29.162107+0000","last_became_peered":"2023-10-06T02:57:29.162107+0000","last_unstale":"2023-10-06T02:57:29.168602+0000","last_undegraded":"2023-10-06T02:57:29.168602+0000","last_fullsized":"2023-10-06T02:57:29.168602+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:20.349987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.149462+0000","last_change":"2023-10-06T02:57:28.158040+0000","last_active":"2023-10-06T02:57:29.149462+0000","last_peered":"2023-10-06T02:57:29.149462+0000","last_clean":"2023-10-06T02:57:29.149462+0000","last_became_active":"2023-10-06T02:57:28.157767+0000","last_became_peered":"2023-10-06T02:57:28.157767+0000","last_unstale":"2023-10-06T02:57:29.149462+0000","last_undegraded":"2023-10-06T02:57:29.149462+0000","last_fullsized":"2023-10-06T02:57:29.149462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:56.163695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.164477+0000","last_change":"2023-10-06T02:57:29.157425+0000","last_active":"2023-10-06T02:57:29.164477+0000","last_peered":"2023-10-06T02:57:29.164477+0000","last_clean":"2023-10-06T02:57:29.164477+0000","last_became_active":"2023-10-06T02:57:29.156688+0000","last_became_peered":"2023-10-06T02:57:29.156688+0000","last_unstale":"2023-10-06T02:57:29.164477+0000","last_undegraded":"2023-10-06T02:57:29.164477+0000","last_fullsized":"2023-10-06T02:57:29.164477+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:33.041583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.153360+0000","last_change":"2023-10-06T02:57:28.153360+0000","last_active":"2023-10-06T02:57:28.153360+0000","last_peered":"2023-10-06T02:57:28.153360+0000","last_clean":"2023-10-06T02:57:28.153360+0000","last_became_active":"2023-10-06T02:57:28.153120+0000","last_became_peered":"2023-10-06T02:57:28.153120+0000","last_unstale":"2023-10-06T02:57:28.153360+0000","last_undegraded":"2023-10-06T02:57:28.153360+0000","last_fullsized":"2023-10-06T02:57:28.153360+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:44.063071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169312+0000","last_change":"2023-10-06T02:57:29.158979+0000","last_active":"2023-10-06T02:57:29.169312+0000","last_peered":"2023-10-06T02:57:29.169312+0000","last_clean":"2023-10-06T02:57:29.169312+0000","last_became_active":"2023-10-06T02:57:29.158726+0000","last_became_peered":"2023-10-06T02:57:29.158726+0000","last_unstale":"2023-10-06T02:57:29.169312+0000","last_undegraded":"2023-10-06T02:57:29.169312+0000","last_fullsized":"2023-10-06T02:57:29.169312+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:53.278507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.156524+0000","last_change":"2023-10-06T02:57:28.155104+0000","last_active":"2023-10-06T02:57:29.156524+0000","last_peered":"2023-10-06T02:57:29.156524+0000","last_clean":"2023-10-06T02:57:29.156524+0000","last_became_active":"2023-10-06T02:57:28.154822+0000","last_became_peered":"2023-10-06T02:57:28.154822+0000","last_unstale":"2023-10-06T02:57:29.156524+0000","last_undegraded":"2023-10-06T02:57:29.156524+0000","last_fullsized":"2023-10-06T02:57:29.156524+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147894+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:06.133045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160730+0000","last_change":"2023-10-06T02:57:28.160730+0000","last_active":"2023-10-06T02:57:28.160730+0000","last_peered":"2023-10-06T02:57:28.160730+0000","last_clean":"2023-10-06T02:57:28.160730+0000","last_became_active":"2023-10-06T02:57:28.160482+0000","last_became_peered":"2023-10-06T02:57:28.160482+0000","last_unstale":"2023-10-06T02:57:28.160730+0000","last_undegraded":"2023-10-06T02:57:28.160730+0000","last_fullsized":"2023-10-06T02:57:28.160730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:48.044243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168562+0000","last_change":"2023-10-06T02:57:29.159938+0000","last_active":"2023-10-06T02:57:29.168562+0000","last_peered":"2023-10-06T02:57:29.168562+0000","last_clean":"2023-10-06T02:57:29.168562+0000","last_became_active":"2023-10-06T02:57:29.158530+0000","last_became_peered":"2023-10-06T02:57:29.158530+0000","last_unstale":"2023-10-06T02:57:29.168562+0000","last_undegraded":"2023-10-06T02:57:29.168562+0000","last_fullsized":"2023-10-06T02:57:29.168562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:59.957180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.142933+0000","last_change":"2023-10-06T02:57:28.151353+0000","last_active":"2023-10-06T02:57:29.142933+0000","last_peered":"2023-10-06T02:57:29.142933+0000","last_clean":"2023-10-06T02:57:29.142933+0000","last_became_active":"2023-10-06T02:57:28.151093+0000","last_became_peered":"2023-10-06T02:57:28.151093+0000","last_unstale":"2023-10-06T02:57:29.142933+0000","last_undegraded":"2023-10-06T02:57:29.142933+0000","last_fullsized":"2023-10-06T02:57:29.142933+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.160961+0000","last_change":"2023-10-06T02:57:29.153490+0000","last_active":"2023-10-06T02:57:29.160961+0000","last_peered":"2023-10-06T02:57:29.160961+0000","last_clean":"2023-10-06T02:57:29.160961+0000","last_became_active":"2023-10-06T02:57:29.153227+0000","last_became_peered":"2023-10-06T02:57:29.153227+0000","last_unstale":"2023-10-06T02:57:29.160961+0000","last_undegraded":"2023-10-06T02:57:29.160961+0000","last_fullsized":"2023-10-06T02:57:29.160961+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.177927+0000","last_change":"2023-10-06T02:57:28.158553+0000","last_active":"2023-10-06T02:57:29.177927+0000","last_peered":"2023-10-06T02:57:29.177927+0000","last_clean":"2023-10-06T02:57:29.177927+0000","last_became_active":"2023-10-06T02:57:28.158316+0000","last_became_peered":"2023-10-06T02:57:28.158316+0000","last_unstale":"2023-10-06T02:57:29.177927+0000","last_undegraded":"2023-10-06T02:57:29.177927+0000","last_fullsized":"2023-10-06T02:57:29.177927+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:58.492313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.145174+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:57:27.145174+0000","last_peered":"2023-10-06T02:57:27.145174+0000","last_clean":"2023-10-06T02:57:27.145174+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:57:27.145174+0000","last_undegraded":"2023-10-06T02:57:27.145174+0000","last_fullsized":"2023-10-06T02:57:27.145174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168418+0000","last_change":"2023-10-06T02:57:29.160818+0000","last_active":"2023-10-06T02:57:29.168418+0000","last_peered":"2023-10-06T02:57:29.168418+0000","last_clean":"2023-10-06T02:57:29.168418+0000","last_became_active":"2023-10-06T02:57:29.160528+0000","last_became_peered":"2023-10-06T02:57:29.160528+0000","last_unstale":"2023-10-06T02:57:29.168418+0000","last_undegraded":"2023-10-06T02:57:29.168418+0000","last_fullsized":"2023-10-06T02:57:29.168418+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:58.527683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147156+0000","last_change":"2023-10-06T02:57:28.158916+0000","last_active":"2023-10-06T02:57:29.147156+0000","last_peered":"2023-10-06T02:57:29.147156+0000","last_clean":"2023-10-06T02:57:29.147156+0000","last_became_active":"2023-10-06T02:57:28.158666+0000","last_became_peered":"2023-10-06T02:57:28.158666+0000","last_unstale":"2023-10-06T02:57:29.147156+0000","last_undegraded":"2023-10-06T02:57:29.147156+0000","last_fullsized":"2023-10-06T02:57:29.147156+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:05.270414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.150368+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:57:29.150368+0000","last_peered":"2023-10-06T02:57:29.150368+0000","last_clean":"2023-10-06T02:57:29.150368+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:57:29.150368+0000","last_undegraded":"2023-10-06T02:57:29.150368+0000","last_fullsized":"2023-10-06T02:57:29.150368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161083+0000","last_change":"2023-10-06T02:57:29.158084+0000","last_active":"2023-10-06T02:57:29.161083+0000","last_peered":"2023-10-06T02:57:29.161083+0000","last_clean":"2023-10-06T02:57:29.161083+0000","last_became_active":"2023-10-06T02:57:29.157809+0000","last_became_peered":"2023-10-06T02:57:29.157809+0000","last_unstale":"2023-10-06T02:57:29.161083+0000","last_undegraded":"2023-10-06T02:57:29.161083+0000","last_fullsized":"2023-10-06T02:57:29.161083+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:53.278507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176722+0000","last_change":"2023-10-06T02:57:28.155037+0000","last_active":"2023-10-06T02:57:29.176722+0000","last_peered":"2023-10-06T02:57:29.176722+0000","last_clean":"2023-10-06T02:57:29.176722+0000","last_became_active":"2023-10-06T02:57:28.154790+0000","last_became_peered":"2023-10-06T02:57:28.154790+0000","last_unstale":"2023-10-06T02:57:29.176722+0000","last_undegraded":"2023-10-06T02:57:29.176722+0000","last_fullsized":"2023-10-06T02:57:29.176722+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.148271+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:57:29.148271+0000","last_peered":"2023-10-06T02:57:29.148271+0000","last_clean":"2023-10-06T02:57:29.148271+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:57:29.148271+0000","last_undegraded":"2023-10-06T02:57:29.148271+0000","last_fullsized":"2023-10-06T02:57:29.148271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157069+0000","last_change":"2023-10-06T02:57:29.153722+0000","last_active":"2023-10-06T02:57:29.157069+0000","last_peered":"2023-10-06T02:57:29.157069+0000","last_clean":"2023-10-06T02:57:29.157069+0000","last_became_active":"2023-10-06T02:57:29.153463+0000","last_became_peered":"2023-10-06T02:57:29.153463+0000","last_unstale":"2023-10-06T02:57:29.157069+0000","last_undegraded":"2023-10-06T02:57:29.157069+0000","last_fullsized":"2023-10-06T02:57:29.157069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:49.958572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154456+0000","last_change":"2023-10-06T02:57:28.153262+0000","last_active":"2023-10-06T02:57:29.154456+0000","last_peered":"2023-10-06T02:57:29.154456+0000","last_clean":"2023-10-06T02:57:29.154456+0000","last_became_active":"2023-10-06T02:57:28.152963+0000","last_became_peered":"2023-10-06T02:57:28.152963+0000","last_unstale":"2023-10-06T02:57:29.154456+0000","last_undegraded":"2023-10-06T02:57:29.154456+0000","last_fullsized":"2023-10-06T02:57:29.154456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:21.640991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147690+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:57:29.147690+0000","last_peered":"2023-10-06T02:57:29.147690+0000","last_clean":"2023-10-06T02:57:29.147690+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:57:29.147690+0000","last_undegraded":"2023-10-06T02:57:29.147690+0000","last_fullsized":"2023-10-06T02:57:29.147690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147602+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:57:29.147602+0000","last_peered":"2023-10-06T02:57:29.147602+0000","last_clean":"2023-10-06T02:57:29.147602+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:57:29.147602+0000","last_undegraded":"2023-10-06T02:57:29.147602+0000","last_fullsized":"2023-10-06T02:57:29.147602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172336+0000","last_change":"2023-10-06T02:57:29.168415+0000","last_active":"2023-10-06T02:57:29.172336+0000","last_peered":"2023-10-06T02:57:29.172336+0000","last_clean":"2023-10-06T02:57:29.172336+0000","last_became_active":"2023-10-06T02:57:29.168146+0000","last_became_peered":"2023-10-06T02:57:29.168146+0000","last_unstale":"2023-10-06T02:57:29.172336+0000","last_undegraded":"2023-10-06T02:57:29.172336+0000","last_fullsized":"2023-10-06T02:57:29.172336+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:15.152388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158519+0000","last_change":"2023-10-06T02:57:28.158519+0000","last_active":"2023-10-06T02:57:28.158519+0000","last_peered":"2023-10-06T02:57:28.158519+0000","last_clean":"2023-10-06T02:57:28.158519+0000","last_became_active":"2023-10-06T02:57:28.158257+0000","last_became_peered":"2023-10-06T02:57:28.158257+0000","last_unstale":"2023-10-06T02:57:28.158519+0000","last_undegraded":"2023-10-06T02:57:28.158519+0000","last_fullsized":"2023-10-06T02:57:28.158519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:29.265968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147687+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:57:29.147687+0000","last_peered":"2023-10-06T02:57:29.147687+0000","last_clean":"2023-10-06T02:57:29.147687+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:57:29.147687+0000","last_undegraded":"2023-10-06T02:57:29.147687+0000","last_fullsized":"2023-10-06T02:57:29.147687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170428+0000","last_change":"2023-10-06T02:57:29.166606+0000","last_active":"2023-10-06T02:57:29.170428+0000","last_peered":"2023-10-06T02:57:29.170428+0000","last_clean":"2023-10-06T02:57:29.170428+0000","last_became_active":"2023-10-06T02:57:29.162754+0000","last_became_peered":"2023-10-06T02:57:29.162754+0000","last_unstale":"2023-10-06T02:57:29.170428+0000","last_undegraded":"2023-10-06T02:57:29.170428+0000","last_fullsized":"2023-10-06T02:57:29.170428+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.995687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175565+0000","last_change":"2023-10-06T02:57:28.159275+0000","last_active":"2023-10-06T02:57:29.175565+0000","last_peered":"2023-10-06T02:57:29.175565+0000","last_clean":"2023-10-06T02:57:29.175565+0000","last_became_active":"2023-10-06T02:57:28.158956+0000","last_became_peered":"2023-10-06T02:57:28.158956+0000","last_unstale":"2023-10-06T02:57:29.175565+0000","last_undegraded":"2023-10-06T02:57:29.175565+0000","last_fullsized":"2023-10-06T02:57:29.175565+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:22.990325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.152122+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:57:29.152122+0000","last_peered":"2023-10-06T02:57:29.152122+0000","last_clean":"2023-10-06T02:57:29.152122+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:57:29.152122+0000","last_undegraded":"2023-10-06T02:57:29.152122+0000","last_fullsized":"2023-10-06T02:57:29.152122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170455+0000","last_change":"2023-10-06T02:57:29.162353+0000","last_active":"2023-10-06T02:57:29.170455+0000","last_peered":"2023-10-06T02:57:29.170455+0000","last_clean":"2023-10-06T02:57:29.170455+0000","last_became_active":"2023-10-06T02:57:29.162100+0000","last_became_peered":"2023-10-06T02:57:29.162100+0000","last_unstale":"2023-10-06T02:57:29.170455+0000","last_undegraded":"2023-10-06T02:57:29.170455+0000","last_fullsized":"2023-10-06T02:57:29.170455+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.151069+0000","last_change":"2023-10-06T02:57:28.155416+0000","last_active":"2023-10-06T02:57:29.151069+0000","last_peered":"2023-10-06T02:57:29.151069+0000","last_clean":"2023-10-06T02:57:29.151069+0000","last_became_active":"2023-10-06T02:57:28.155144+0000","last_became_peered":"2023-10-06T02:57:28.155144+0000","last_unstale":"2023-10-06T02:57:29.151069+0000","last_undegraded":"2023-10-06T02:57:29.151069+0000","last_fullsized":"2023-10-06T02:57:29.151069+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.145205+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:57:27.145205+0000","last_peered":"2023-10-06T02:57:27.145205+0000","last_clean":"2023-10-06T02:57:27.145205+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:57:27.145205+0000","last_undegraded":"2023-10-06T02:57:27.145205+0000","last_fullsized":"2023-10-06T02:57:27.145205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175506+0000","last_change":"2023-10-06T02:57:29.170783+0000","last_active":"2023-10-06T02:57:29.175506+0000","last_peered":"2023-10-06T02:57:29.175506+0000","last_clean":"2023-10-06T02:57:29.175506+0000","last_became_active":"2023-10-06T02:57:29.170473+0000","last_became_peered":"2023-10-06T02:57:29.170473+0000","last_unstale":"2023-10-06T02:57:29.175506+0000","last_undegraded":"2023-10-06T02:57:29.175506+0000","last_fullsized":"2023-10-06T02:57:29.175506+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:20.349987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.174018+0000","last_change":"2023-10-06T02:57:28.158264+0000","last_active":"2023-10-06T02:57:29.174018+0000","last_peered":"2023-10-06T02:57:29.174018+0000","last_clean":"2023-10-06T02:57:29.174018+0000","last_became_active":"2023-10-06T02:57:28.157981+0000","last_became_peered":"2023-10-06T02:57:28.157981+0000","last_unstale":"2023-10-06T02:57:29.174018+0000","last_undegraded":"2023-10-06T02:57:29.174018+0000","last_fullsized":"2023-10-06T02:57:29.174018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:47.860250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154572+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:57:29.154572+0000","last_peered":"2023-10-06T02:57:29.154572+0000","last_clean":"2023-10-06T02:57:29.154572+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:57:29.154572+0000","last_undegraded":"2023-10-06T02:57:29.154572+0000","last_fullsized":"2023-10-06T02:57:29.154572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298528,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073312,"statfs":{"total":96636764160,"available":96331071488,"internally_reserved":0,"allocated":1269760,"data_stored":900057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.439},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65600000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.31,"15min":0.31},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.375}]},{"osd":4,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59599999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65700000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67000000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40600000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64900000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68400000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.34599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297940,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073900,"statfs":{"total":96636764160,"available":96331673600,"internally_reserved":0,"allocated":667648,"data_stored":309529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":3.415,"15min":3.415},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.627}]},{"osd":1,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":1.546,"15min":1.546},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68899999999999995,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63400000000000001,"5min":1.74,"15min":1.74},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.70399999999999996,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.71599999999999997,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.74299999999999999,"5min":3.577,"15min":3.577},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.67300000000000004,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.66300000000000003,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68000000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073928,"statfs":{"total":96636764160,"available":96331702272,"internally_reserved":0,"allocated":638976,"data_stored":294121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.22,"5min":0.19,"15min":0.19},"max":{"1min":0.48499999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.376,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59999999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":1.21,"15min":1.3500000000000001},"min":{"1min":0.24299999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51800000000000002,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65500000000000003,"5min":1.181,"15min":1.181},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":1.02,"15min":1.02},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.629,"5min":1.4339999999999999,"15min":1.5680000000000001},"min":{"1min":0.46800000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85599999999999998,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.423,"15min":1.5529999999999999},"min":{"1min":0.45000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95699999999999996,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.504,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82099999999999995,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.628,"5min":1.452,"15min":1.5900000000000001},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":21.166,"15min":21.166},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81999999999999995,"5min":0.997,"15min":0.997},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298532,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073308,"statfs":{"total":96636764160,"available":96331067392,"internally_reserved":0,"allocated":1273856,"data_stored":900976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.434,"5min":0.441,"15min":0.441},"last":0.246},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.27600000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.374,"15min":0.372},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.317,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.27400000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72699999999999998,"5min":0.879,"15min":0.879},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73799999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73099999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297948,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073892,"statfs":{"total":96636764160,"available":96331665408,"internally_reserved":0,"allocated":675840,"data_stored":309585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.31,"15min":0.30599999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47399999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.317},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.5,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.313},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65000000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58799999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.747,"5min":0.755,"15min":0.755},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55500000000000005},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71899999999999997,"5min":1.077,"15min":1.077},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.435,"15min":0.435},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297944,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073896,"statfs":{"total":96636764160,"available":96331669504,"internally_reserved":0,"allocated":671744,"data_stored":308574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.623,"5min":2.569,"15min":2.569},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.53800000000000003,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.27700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.439,"15min":0.44900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57699999999999996,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56200000000000006,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.23799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.49399999999999999,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.28999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.77600000000000002,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77800000000000002,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69099999999999995,"15min":0.70299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77000000000000002,"5min":2.532,"15min":2.532},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72899999999999998,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.497,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.78300000000000003,"5min":2.496,"15min":2.496},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76200000000000001,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.40799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":311065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":1.0109999999999999,"15min":1.073},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.437}]},{"osd":7,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.625},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297948,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073892,"statfs":{"total":96636764160,"available":96331665408,"internally_reserved":0,"allocated":675840,"data_stored":310153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.38100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67400000000000004,"5min":1.167,"15min":1.167},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.44500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.117,"15min":1.117},"last":0.44},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.35499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":1.2,"15min":1.2},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.68899999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68400000000000005,"5min":1.135,"15min":1.135},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81599999999999995,"5min":1.208,"15min":1.208},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":0.87},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.89200000000000002,"5min":1.054,"15min":1.054},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.377,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.008},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:57:33.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-06T02:57:33.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:57:28.134821+0000', 'last_change': '2023-10-06T02:57:28.148493+0000', 'last_active': '2023-10-06T02:57:28.134821+0000', 'last_peered': '2023-10-06T02:57:28.134821+0000', 'last_clean': '2023-10-06T02:57:28.134821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:57:28.134821+0000', 'last_undegraded': '2023-10-06T02:57:28.134821+0000', 'last_fullsized': '2023-10-06T02:57:28.134821+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_clean_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:28:56.638210+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:57:33.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-06T02:57:33.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:57:28.134821+0000', 'last_change': '2023-10-06T02:57:28.149635+0000', 'last_active': '2023-10-06T02:57:28.134821+0000', 'last_peered': '2023-10-06T02:57:28.134821+0000', 'last_clean': '2023-10-06T02:57:28.134821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:57:28.134821+0000', 'last_undegraded': '2023-10-06T02:57:28.134821+0000', 'last_fullsized': '2023-10-06T02:57:28.134821+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_clean_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:50:02.677073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:57:33.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-06T02:57:33.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:57:28.134821+0000', 'last_change': '2023-10-06T02:57:28.148635+0000', 'last_active': '2023-10-06T02:57:28.134821+0000', 'last_peered': '2023-10-06T02:57:28.134821+0000', 'last_clean': '2023-10-06T02:57:28.134821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:57:28.134821+0000', 'last_undegraded': '2023-10-06T02:57:28.134821+0000', 'last_fullsized': '2023-10-06T02:57:28.134821+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_clean_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:38:51.022047+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:57:33.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-06T02:57:33.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:57:28.134821+0000', 'last_change': '2023-10-06T02:57:28.151744+0000', 'last_active': '2023-10-06T02:57:28.134821+0000', 'last_peered': '2023-10-06T02:57:28.134821+0000', 'last_clean': '2023-10-06T02:57:28.134821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:57:28.134821+0000', 'last_undegraded': '2023-10-06T02:57:28.134821+0000', 'last_fullsized': '2023-10-06T02:57:28.134821+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_clean_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:05:24.455071+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:57:33.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-06T02:57:33.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:57:28.134821+0000', 'last_change': '2023-10-06T02:57:28.148511+0000', 'last_active': '2023-10-06T02:57:28.134821+0000', 'last_peered': '2023-10-06T02:57:28.134821+0000', 'last_clean': '2023-10-06T02:57:28.134821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:57:28.134821+0000', 'last_undegraded': '2023-10-06T02:57:28.134821+0000', 'last_fullsized': '2023-10-06T02:57:28.134821+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_clean_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:20:37.148715+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:57:33.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-06T02:57:33.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T02:57:28.134821+0000', 'last_change': '2023-10-06T02:57:28.147894+0000', 'last_active': '2023-10-06T02:57:28.134821+0000', 'last_peered': '2023-10-06T02:57:28.134821+0000', 'last_clean': '2023-10-06T02:57:28.134821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T02:57:28.134821+0000', 'last_undegraded': '2023-10-06T02:57:28.134821+0000', 'last_fullsized': '2023-10-06T02:57:28.134821+0000', 'mapping_epoch': 54, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 54, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'last_clean_scrub_stamp': '2023-10-06T02:57:28.134821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:24:06.133045+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T02:57:33.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:57:34.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.099+0000 7f6730437700 1 Processor -- start 2023-10-06T02:57:34.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.099+0000 7f6730437700 1 -- start start 2023-10-06T02:57:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f6730437700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f67280b49e0 0x7f67280aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f6730437700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67280b07a0 0x7f67280b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f6730437700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67280b0ca0 con 0x7f67281595a0 2023-10-06T02:57:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f6730437700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67280b0f80 con 0x7f67280b07a0 2023-10-06T02:57:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f6730437700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67280b1260 con 0x7f67280b49e0 2023-10-06T02:57:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672e9d4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67280b07a0 0x7f67280b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672e9d4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67280b07a0 0x7f67280b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57910/0 (socket says 172.21.15.84:57910) 2023-10-06T02:57:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672e9d4700 1 -- 172.21.15.84:0/3181665051 learned_addr learned my addr 172.21.15.84:0/3181665051 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672d9d2700 1 --2- 172.21.15.84:0/3181665051 >> v2:172.21.15.131:3300/0 conn(0x7f67280b49e0 0x7f67280aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672e9d4700 1 -- 172.21.15.84:0/3181665051 >> v2:172.21.15.131:3300/0 conn(0x7f67280b49e0 msgr2=0x7f67280aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672e9d4700 1 --2- 172.21.15.84:0/3181665051 >> v2:172.21.15.131:3300/0 conn(0x7f67280b49e0 0x7f67280aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672e9d4700 1 -- 172.21.15.84:0/3181665051 >> v1:172.21.15.131:6789/0 conn(0x7f67281595a0 legacy=0x7f67280aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672e9d4700 1 -- 172.21.15.84:0/3181665051 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280b1540 con 0x7f67280b07a0 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672d9d2700 1 --2- 172.21.15.84:0/3181665051 >> v2:172.21.15.131:3300/0 conn(0x7f67280b49e0 0x7f67280aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672e9d4700 1 --2- 172.21.15.84:0/3181665051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b07a0 0x7f67280b1c00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f67200099b0 tx=0x7f6720009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81139d70593e2251 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672d1d1700 1 -- 172.21.15.84:0/3181665051 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672000b820 con 0x7f67280b07a0 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672d1d1700 1 -- 172.21.15.84:0/3181665051 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672000b980 con 0x7f67280b07a0 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.100+0000 7f672d1d1700 1 -- 172.21.15.84:0/3181665051 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672000bd20 con 0x7f67280b07a0 2023-10-06T02:57:34.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.101+0000 7f6730437700 1 -- 172.21.15.84:0/3181665051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b07a0 msgr2=0x7f67280b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.101+0000 7f6730437700 1 --2- 172.21.15.84:0/3181665051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b07a0 0x7f67280b1c00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f67200099b0 tx=0x7f6720009250 comp rx=0 tx=0).stop 2023-10-06T02:57:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.101+0000 7f6730437700 1 -- 172.21.15.84:0/3181665051 shutdown_connections 2023-10-06T02:57:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.101+0000 7f6730437700 1 --2- 172.21.15.84:0/3181665051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b07a0 0x7f67280b1c00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.101+0000 7f6730437700 1 --2- 172.21.15.84:0/3181665051 >> v2:172.21.15.131:3300/0 conn(0x7f67280b49e0 0x7f67280aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.101+0000 7f6730437700 1 -- 172.21.15.84:0/3181665051 >> 172.21.15.84:0/3181665051 conn(0x7f6728099830 msgr2=0x7f672806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.101+0000 7f6730437700 1 -- 172.21.15.84:0/3181665051 shutdown_connections 2023-10-06T02:57:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.101+0000 7f6730437700 1 -- 172.21.15.84:0/3181665051 wait complete. 2023-10-06T02:57:34.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.102+0000 7f6730437700 1 Processor -- start 2023-10-06T02:57:34.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.102+0000 7f6730437700 1 -- start start 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f6730437700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67280b07a0 0x7f67280abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f6730437700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b49e0 0x7f6728158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f6730437700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67281595a0 0x7f67280b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f6730437700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672815b930 con 0x7f67280b49e0 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f6730437700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67280ac130 con 0x7f67281595a0 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f6730437700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672815ad20 con 0x7f67280b07a0 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f672d9d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b49e0 0x7f6728158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f672d9d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b49e0 0x7f6728158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57922/0 (socket says 172.21.15.84:57922) 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f672d9d2700 1 -- 172.21.15.84:0/2433908944 learned_addr learned my addr 172.21.15.84:0/2433908944 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f672d9d2700 1 -- 172.21.15.84:0/2433908944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67280b07a0 msgr2=0x7f67280abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f672d9d2700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67280b07a0 0x7f67280abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f672d9d2700 1 -- 172.21.15.84:0/2433908944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67281595a0 msgr2=0x7f67280b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f672d9d2700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67281595a0 0x7f67280b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f672d9d2700 1 -- 172.21.15.84:0/2433908944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200094f0 con 0x7f67280b49e0 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f672d9d2700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b49e0 0x7f6728158850 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f671800e8a0 tx=0x7f6718008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.103+0000 7f671e7fc700 1 -- 172.21.15.84:0/2433908944 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671800c430 con 0x7f67280b49e0 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.104+0000 7f671e7fc700 1 -- 172.21.15.84:0/2433908944 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671800c590 con 0x7f67280b49e0 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.104+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672815b000 con 0x7f67280b49e0 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.104+0000 7f671e7fc700 1 -- 172.21.15.84:0/2433908944 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671800c930 con 0x7f67280b49e0 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.104+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672815b5c0 con 0x7f67280b49e0 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.104+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6728070c80 con 0x7f67280b49e0 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.105+0000 7f671e7fc700 1 -- 172.21.15.84:0/2433908944 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f671800cd20 con 0x7f67280b49e0 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.105+0000 7f671e7fc700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f670c066f30 0x7f670c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.105+0000 7f671e7fc700 1 -- 172.21.15.84:0/2433908944 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f67180846b0 con 0x7f67280b49e0 2023-10-06T02:57:34.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.105+0000 7f672e1d3700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f670c066f30 0x7f670c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.106+0000 7f672e1d3700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f670c066f30 0x7f670c0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6724000f80 tx=0x7f67240016e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.110+0000 7f671e7fc700 1 -- 172.21.15.84:0/2433908944 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6718055110 con 0x7f67280b49e0 2023-10-06T02:57:34.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.371+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6728064ad0 con 0x7f67280b49e0 2023-10-06T02:57:34.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.371+0000 7f671e7fc700 1 -- 172.21.15.84:0/2433908944 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1520 (secure 0 0 0) 0x7f6718054ca0 con 0x7f67280b49e0 2023-10-06T02:57:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:34.373 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":172,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":99},{"state_name":"creating+peering","count":6}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592674,"bytes_used":2441936896,"bytes_avail":770652176384,"bytes_total":773094113280,"inactive_pgs_ratio":0.05714285746216774,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":34,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5781}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-06T02:56:57.827607+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:57:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f670c066f30 msgr2=0x7f670c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f670c066f30 0x7f670c0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6724000f80 tx=0x7f67240016e0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b49e0 msgr2=0x7f6728158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b49e0 0x7f6728158850 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f671800e8a0 tx=0x7f6718008040 comp rx=0 tx=0).stop 2023-10-06T02:57:34.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 shutdown_connections 2023-10-06T02:57:34.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f670c066f30 0x7f670c0693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67281595a0 0x7f67280b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f67280b07a0 0x7f67280abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 --2- 172.21.15.84:0/2433908944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67280b49e0 0x7f6728158850 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 >> 172.21.15.84:0/2433908944 conn(0x7f6728099830 msgr2=0x7f6728069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:34.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 shutdown_connections 2023-10-06T02:57:34.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.373+0000 7f6730437700 1 -- 172.21.15.84:0/2433908944 wait complete. 2023-10-06T02:57:34.387 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:57:34.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:57:34.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.499+0000 7f4310678700 1 Processor -- start 2023-10-06T02:57:34.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.499+0000 7f4310678700 1 -- start start 2023-10-06T02:57:34.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.500+0000 7f4310678700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f43081595a0 0x7f43080aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.500+0000 7f4310678700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f43080b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.500+0000 7f4310678700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43080b0ca0 con 0x7f43080b49e0 2023-10-06T02:57:34.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.500+0000 7f4310678700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43080b0f80 con 0x7f43081595a0 2023-10-06T02:57:34.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.500+0000 7f4310678700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43080b1260 con 0x7f43080b07a0 2023-10-06T02:57:34.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430e414700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f43081595a0 0x7f43080aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430ec15700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f43080b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430dc13700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f43080b49e0 0x7f43080aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:52696/0 (socket says 172.21.15.84:52696) 2023-10-06T02:57:34.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430ec15700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f43080b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:43358/0 (socket says 172.21.15.84:43358) 2023-10-06T02:57:34.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430e414700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f43081595a0 0x7f43080aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:39698/0 (socket says 172.21.15.84:39698) 2023-10-06T02:57:34.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430dc13700 1 -- 172.21.15.84:0/4161374100 learned_addr learned my addr 172.21.15.84:0/4161374100 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:34.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430ec15700 1 -- 172.21.15.84:0/4161374100 >> v2:172.21.15.131:3300/0 conn(0x7f43081595a0 msgr2=0x7f43080aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:34.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430ec15700 1 --2- 172.21.15.84:0/4161374100 >> v2:172.21.15.131:3300/0 conn(0x7f43081595a0 0x7f43080aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430ec15700 1 -- 172.21.15.84:0/4161374100 >> v1:172.21.15.131:6789/0 conn(0x7f43080b49e0 legacy=0x7f43080aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430ec15700 1 -- 172.21.15.84:0/4161374100 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43080b1540 con 0x7f43080b07a0 2023-10-06T02:57:34.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430e414700 1 --2- 172.21.15.84:0/4161374100 >> v2:172.21.15.131:3300/0 conn(0x7f43081595a0 0x7f43080aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:57:34.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430ec15700 1 --2- 172.21.15.84:0/4161374100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f43080b1c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4300009e90 tx=0x7f4300009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=107f8b8b89470b66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:34.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430d412700 1 -- 172.21.15.84:0/4161374100 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000e070 con 0x7f43080b07a0 2023-10-06T02:57:34.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430d412700 1 -- 172.21.15.84:0/4161374100 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000bbf0 con 0x7f43080b07a0 2023-10-06T02:57:34.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.501+0000 7f430d412700 1 -- 172.21.15.84:0/4161374100 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300012430 con 0x7f43080b07a0 2023-10-06T02:57:34.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.502+0000 7f4310678700 1 -- 172.21.15.84:0/4161374100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 msgr2=0x7f43080b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.502+0000 7f4310678700 1 --2- 172.21.15.84:0/4161374100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f43080b1c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4300009e90 tx=0x7f4300009780 comp rx=0 tx=0).stop 2023-10-06T02:57:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.502+0000 7f4310678700 1 -- 172.21.15.84:0/4161374100 shutdown_connections 2023-10-06T02:57:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.502+0000 7f4310678700 1 --2- 172.21.15.84:0/4161374100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f43080b1c00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.502+0000 7f4310678700 1 --2- 172.21.15.84:0/4161374100 >> v2:172.21.15.131:3300/0 conn(0x7f43081595a0 0x7f43080aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.502+0000 7f4310678700 1 -- 172.21.15.84:0/4161374100 >> 172.21.15.84:0/4161374100 conn(0x7f4308099830 msgr2=0x7f430806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.502+0000 7f4310678700 1 -- 172.21.15.84:0/4161374100 shutdown_connections 2023-10-06T02:57:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.502+0000 7f4310678700 1 -- 172.21.15.84:0/4161374100 wait complete. 2023-10-06T02:57:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.503+0000 7f4310678700 1 Processor -- start 2023-10-06T02:57:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.503+0000 7f4310678700 1 -- start start 2023-10-06T02:57:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f4310678700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f430809a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f4310678700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43080b49e0 0x7f43080abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f4310678700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43081595a0 0x7f4308157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f4310678700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080ac3c0 con 0x7f43081595a0 2023-10-06T02:57:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f4310678700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430809a750 con 0x7f43080b49e0 2023-10-06T02:57:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f4310678700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430809aa30 con 0x7f43080b07a0 2023-10-06T02:57:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430ec15700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43081595a0 0x7f4308157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430ec15700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43081595a0 0x7f4308157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57924/0 (socket says 172.21.15.84:57924) 2023-10-06T02:57:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430ec15700 1 -- 172.21.15.84:0/3253182748 learned_addr learned my addr 172.21.15.84:0/3253182748 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430e414700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f430809a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430dc13700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43080b49e0 0x7f43080abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430ec15700 1 -- 172.21.15.84:0/3253182748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 msgr2=0x7f430809a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430ec15700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f430809a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430ec15700 1 -- 172.21.15.84:0/3253182748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43080b49e0 msgr2=0x7f43080abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430ec15700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43080b49e0 0x7f43080abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430ec15700 1 -- 172.21.15.84:0/3253182748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43040093c0 con 0x7f43081595a0 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.504+0000 7f430ec15700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43081595a0 0x7f4308157a50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f43080b13a0 tx=0x7f4300019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.505+0000 7f42fe7fc700 1 -- 172.21.15.84:0/3253182748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300027470 con 0x7f43081595a0 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.505+0000 7f42fe7fc700 1 -- 172.21.15.84:0/3253182748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43000275d0 con 0x7f43081595a0 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.505+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4300009a20 con 0x7f43081595a0 2023-10-06T02:57:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.505+0000 7f42fe7fc700 1 -- 172.21.15.84:0/3253182748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300027990 con 0x7f43081595a0 2023-10-06T02:57:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.505+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430809aff0 con 0x7f43081595a0 2023-10-06T02:57:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.505+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430809b210 con 0x7f43081595a0 2023-10-06T02:57:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.506+0000 7f42fe7fc700 1 -- 172.21.15.84:0/3253182748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4300024070 con 0x7f43081595a0 2023-10-06T02:57:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.506+0000 7f42fe7fc700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42ec066f30 0x7f42ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.506+0000 7f42fe7fc700 1 -- 172.21.15.84:0/3253182748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4300086ee0 con 0x7f43081595a0 2023-10-06T02:57:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.506+0000 7f430e414700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42ec066f30 0x7f42ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.507+0000 7f430e414700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42ec066f30 0x7f42ec0693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4304009e90 tx=0x7f4304009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.510+0000 7f42fe7fc700 1 -- 172.21.15.84:0/3253182748 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4300053eb0 con 0x7f43081595a0 2023-10-06T02:57:34.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.689+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4308064ad0 con 0x7f42ec066f30 2023-10-06T02:57:34.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.697+0000 7f42fe7fc700 1 -- 172.21.15.84:0/3253182748 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311154 (secure 0 0 0) 0x7f4308064ad0 con 0x7f42ec066f30 2023-10-06T02:57:34.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:34.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42ec066f30 msgr2=0x7f42ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42ec066f30 0x7f42ec0693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4304009e90 tx=0x7f4304009120 comp rx=0 tx=0).stop 2023-10-06T02:57:34.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43081595a0 msgr2=0x7f4308157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:34.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43081595a0 0x7f4308157a50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f43080b13a0 tx=0x7f4300019000 comp rx=0 tx=0).stop 2023-10-06T02:57:34.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 shutdown_connections 2023-10-06T02:57:34.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42ec066f30 0x7f42ec0693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43081595a0 0x7f4308157a50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43080b07a0 0x7f430809a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 --2- 172.21.15.84:0/3253182748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43080b49e0 0x7f43080abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:34.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.700+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 >> 172.21.15.84:0/3253182748 conn(0x7f4308099830 msgr2=0x7f4308158930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:34.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.701+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 shutdown_connections 2023-10-06T02:57:34.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:34.701+0000 7f4310678700 1 -- 172.21.15.84:0/3253182748 wait complete. 2023-10-06T02:57:34.706 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:57:34.713 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-10-06T02:57:33.834525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384704,"kb_used_data":6400,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590016,"statfs":{"total":773094113280,"available":770652176384,"internally_reserved":0,"allocated":6553600,"data_stored":3644060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001138"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165677+0000","last_change":"2023-10-06T02:57:29.159693+0000","last_active":"2023-10-06T02:57:29.165677+0000","last_peered":"2023-10-06T02:57:29.165677+0000","last_clean":"2023-10-06T02:57:29.165677+0000","last_became_active":"2023-10-06T02:57:29.159469+0000","last_became_peered":"2023-10-06T02:57:29.159469+0000","last_unstale":"2023-10-06T02:57:29.165677+0000","last_undegraded":"2023-10-06T02:57:29.165677+0000","last_fullsized":"2023-10-06T02:57:29.165677+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.148715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157359+0000","last_change":"2023-10-06T02:57:29.152975+0000","last_active":"2023-10-06T02:57:29.157359+0000","last_peered":"2023-10-06T02:57:29.157359+0000","last_clean":"2023-10-06T02:57:29.157359+0000","last_became_active":"2023-10-06T02:57:29.152728+0000","last_became_peered":"2023-10-06T02:57:29.152728+0000","last_unstale":"2023-10-06T02:57:29.157359+0000","last_undegraded":"2023-10-06T02:57:29.157359+0000","last_fullsized":"2023-10-06T02:57:29.157359+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:51.466721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170492+0000","last_change":"2023-10-06T02:57:29.166875+0000","last_active":"2023-10-06T02:57:29.170492+0000","last_peered":"2023-10-06T02:57:29.170492+0000","last_clean":"2023-10-06T02:57:29.170492+0000","last_became_active":"2023-10-06T02:57:29.166606+0000","last_became_peered":"2023-10-06T02:57:29.166606+0000","last_unstale":"2023-10-06T02:57:29.170492+0000","last_undegraded":"2023-10-06T02:57:29.170492+0000","last_fullsized":"2023-10-06T02:57:29.170492+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:01.634204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161080+0000","last_change":"2023-10-06T02:57:29.157387+0000","last_active":"2023-10-06T02:57:29.161080+0000","last_peered":"2023-10-06T02:57:29.161080+0000","last_clean":"2023-10-06T02:57:29.161080+0000","last_became_active":"2023-10-06T02:57:29.157093+0000","last_became_peered":"2023-10-06T02:57:29.157093+0000","last_unstale":"2023-10-06T02:57:29.161080+0000","last_undegraded":"2023-10-06T02:57:29.161080+0000","last_fullsized":"2023-10-06T02:57:29.161080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168600+0000","last_change":"2023-10-06T02:57:29.162615+0000","last_active":"2023-10-06T02:57:29.168600+0000","last_peered":"2023-10-06T02:57:29.168600+0000","last_clean":"2023-10-06T02:57:29.168600+0000","last_became_active":"2023-10-06T02:57:29.162354+0000","last_became_peered":"2023-10-06T02:57:29.162354+0000","last_unstale":"2023-10-06T02:57:29.168600+0000","last_undegraded":"2023-10-06T02:57:29.168600+0000","last_fullsized":"2023-10-06T02:57:29.168600+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:30.271330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165266+0000","last_change":"2023-10-06T02:57:29.154923+0000","last_active":"2023-10-06T02:57:29.165266+0000","last_peered":"2023-10-06T02:57:29.165266+0000","last_clean":"2023-10-06T02:57:29.165266+0000","last_became_active":"2023-10-06T02:57:29.153381+0000","last_became_peered":"2023-10-06T02:57:29.153381+0000","last_unstale":"2023-10-06T02:57:29.165266+0000","last_undegraded":"2023-10-06T02:57:29.165266+0000","last_fullsized":"2023-10-06T02:57:29.165266+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:54.010722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168976+0000","last_change":"2023-10-06T02:57:29.163260+0000","last_active":"2023-10-06T02:57:29.168976+0000","last_peered":"2023-10-06T02:57:29.168976+0000","last_clean":"2023-10-06T02:57:29.168976+0000","last_became_active":"2023-10-06T02:57:29.162996+0000","last_became_peered":"2023-10-06T02:57:29.162996+0000","last_unstale":"2023-10-06T02:57:29.168976+0000","last_undegraded":"2023-10-06T02:57:29.168976+0000","last_fullsized":"2023-10-06T02:57:29.168976+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:44.291549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175383+0000","last_change":"2023-10-06T02:57:29.170539+0000","last_active":"2023-10-06T02:57:29.175383+0000","last_peered":"2023-10-06T02:57:29.175383+0000","last_clean":"2023-10-06T02:57:29.175383+0000","last_became_active":"2023-10-06T02:57:29.170262+0000","last_became_peered":"2023-10-06T02:57:29.170262+0000","last_unstale":"2023-10-06T02:57:29.175383+0000","last_undegraded":"2023-10-06T02:57:29.175383+0000","last_fullsized":"2023-10-06T02:57:29.175383+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:20.249704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175960+0000","last_change":"2023-10-06T02:57:29.168884+0000","last_active":"2023-10-06T02:57:29.175960+0000","last_peered":"2023-10-06T02:57:29.175960+0000","last_clean":"2023-10-06T02:57:29.175960+0000","last_became_active":"2023-10-06T02:57:29.168677+0000","last_became_peered":"2023-10-06T02:57:29.168677+0000","last_unstale":"2023-10-06T02:57:29.175960+0000","last_undegraded":"2023-10-06T02:57:29.175960+0000","last_fullsized":"2023-10-06T02:57:29.175960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:58.527683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148493+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:56.638210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.149635+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:02.677073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163216+0000","last_change":"2023-10-06T02:57:29.160084+0000","last_active":"2023-10-06T02:57:29.163216+0000","last_peered":"2023-10-06T02:57:29.163216+0000","last_clean":"2023-10-06T02:57:29.163216+0000","last_became_active":"2023-10-06T02:57:29.159823+0000","last_became_peered":"2023-10-06T02:57:29.159823+0000","last_unstale":"2023-10-06T02:57:29.163216+0000","last_undegraded":"2023-10-06T02:57:29.163216+0000","last_fullsized":"2023-10-06T02:57:29.163216+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.173580+0000","last_change":"2023-10-06T02:57:29.168630+0000","last_active":"2023-10-06T02:57:29.173580+0000","last_peered":"2023-10-06T02:57:29.173580+0000","last_clean":"2023-10-06T02:57:29.173580+0000","last_became_active":"2023-10-06T02:57:29.168373+0000","last_became_peered":"2023-10-06T02:57:29.168373+0000","last_unstale":"2023-10-06T02:57:29.173580+0000","last_undegraded":"2023-10-06T02:57:29.173580+0000","last_fullsized":"2023-10-06T02:57:29.173580+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:49.049605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169050+0000","last_change":"2023-10-06T02:57:29.164304+0000","last_active":"2023-10-06T02:57:29.169050+0000","last_peered":"2023-10-06T02:57:29.169050+0000","last_clean":"2023-10-06T02:57:29.169050+0000","last_became_active":"2023-10-06T02:57:29.163293+0000","last_became_peered":"2023-10-06T02:57:29.163293+0000","last_unstale":"2023-10-06T02:57:29.169050+0000","last_undegraded":"2023-10-06T02:57:29.169050+0000","last_fullsized":"2023-10-06T02:57:29.169050+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168995+0000","last_change":"2023-10-06T02:57:29.164093+0000","last_active":"2023-10-06T02:57:29.168995+0000","last_peered":"2023-10-06T02:57:29.168995+0000","last_clean":"2023-10-06T02:57:29.168995+0000","last_became_active":"2023-10-06T02:57:29.162936+0000","last_became_peered":"2023-10-06T02:57:29.162936+0000","last_unstale":"2023-10-06T02:57:29.168995+0000","last_undegraded":"2023-10-06T02:57:29.168995+0000","last_fullsized":"2023-10-06T02:57:29.168995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:49.829140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172261+0000","last_change":"2023-10-06T02:57:29.168216+0000","last_active":"2023-10-06T02:57:29.172261+0000","last_peered":"2023-10-06T02:57:29.172261+0000","last_clean":"2023-10-06T02:57:29.172261+0000","last_became_active":"2023-10-06T02:57:29.167959+0000","last_became_peered":"2023-10-06T02:57:29.167959+0000","last_unstale":"2023-10-06T02:57:29.172261+0000","last_undegraded":"2023-10-06T02:57:29.172261+0000","last_fullsized":"2023-10-06T02:57:29.172261+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:22.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170283+0000","last_change":"2023-10-06T02:57:29.163607+0000","last_active":"2023-10-06T02:57:29.170283+0000","last_peered":"2023-10-06T02:57:29.170283+0000","last_clean":"2023-10-06T02:57:29.170283+0000","last_became_active":"2023-10-06T02:57:29.163324+0000","last_became_peered":"2023-10-06T02:57:29.163324+0000","last_unstale":"2023-10-06T02:57:29.170283+0000","last_undegraded":"2023-10-06T02:57:29.170283+0000","last_fullsized":"2023-10-06T02:57:29.170283+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:22.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169338+0000","last_change":"2023-10-06T02:57:29.159474+0000","last_active":"2023-10-06T02:57:29.169338+0000","last_peered":"2023-10-06T02:57:29.169338+0000","last_clean":"2023-10-06T02:57:29.169338+0000","last_became_active":"2023-10-06T02:57:29.159225+0000","last_became_peered":"2023-10-06T02:57:29.159225+0000","last_unstale":"2023-10-06T02:57:29.169338+0000","last_undegraded":"2023-10-06T02:57:29.169338+0000","last_fullsized":"2023-10-06T02:57:29.169338+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:21.534628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165913+0000","last_change":"2023-10-06T02:57:29.159191+0000","last_active":"2023-10-06T02:57:29.165913+0000","last_peered":"2023-10-06T02:57:29.165913+0000","last_clean":"2023-10-06T02:57:29.165913+0000","last_became_active":"2023-10-06T02:57:29.159012+0000","last_became_peered":"2023-10-06T02:57:29.159012+0000","last_unstale":"2023-10-06T02:57:29.165913+0000","last_undegraded":"2023-10-06T02:57:29.165913+0000","last_fullsized":"2023-10-06T02:57:29.165913+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:48.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.164401+0000","last_change":"2023-10-06T02:57:29.156281+0000","last_active":"2023-10-06T02:57:29.164401+0000","last_peered":"2023-10-06T02:57:29.164401+0000","last_clean":"2023-10-06T02:57:29.164401+0000","last_became_active":"2023-10-06T02:57:29.156042+0000","last_became_peered":"2023-10-06T02:57:29.156042+0000","last_unstale":"2023-10-06T02:57:29.164401+0000","last_undegraded":"2023-10-06T02:57:29.164401+0000","last_fullsized":"2023-10-06T02:57:29.164401+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:28.748475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.167987+0000","last_change":"2023-10-06T02:57:29.158339+0000","last_active":"2023-10-06T02:57:29.167987+0000","last_peered":"2023-10-06T02:57:29.167987+0000","last_clean":"2023-10-06T02:57:29.167987+0000","last_became_active":"2023-10-06T02:57:29.158061+0000","last_became_peered":"2023-10-06T02:57:29.158061+0000","last_unstale":"2023-10-06T02:57:29.167987+0000","last_undegraded":"2023-10-06T02:57:29.167987+0000","last_fullsized":"2023-10-06T02:57:29.167987+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157500+0000","last_change":"2023-10-06T02:57:29.154424+0000","last_active":"2023-10-06T02:57:29.157500+0000","last_peered":"2023-10-06T02:57:29.157500+0000","last_clean":"2023-10-06T02:57:29.157500+0000","last_became_active":"2023-10-06T02:57:29.154181+0000","last_became_peered":"2023-10-06T02:57:29.154181+0000","last_unstale":"2023-10-06T02:57:29.157500+0000","last_undegraded":"2023-10-06T02:57:29.157500+0000","last_fullsized":"2023-10-06T02:57:29.157500+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:33.824959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169436+0000","last_change":"2023-10-06T02:57:29.160645+0000","last_active":"2023-10-06T02:57:29.169436+0000","last_peered":"2023-10-06T02:57:29.169436+0000","last_clean":"2023-10-06T02:57:29.169436+0000","last_became_active":"2023-10-06T02:57:29.160178+0000","last_became_peered":"2023-10-06T02:57:29.160178+0000","last_unstale":"2023-10-06T02:57:29.169436+0000","last_undegraded":"2023-10-06T02:57:29.169436+0000","last_fullsized":"2023-10-06T02:57:29.169436+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.173573+0000","last_change":"2023-10-06T02:57:29.168580+0000","last_active":"2023-10-06T02:57:29.173573+0000","last_peered":"2023-10-06T02:57:29.173573+0000","last_clean":"2023-10-06T02:57:29.173573+0000","last_became_active":"2023-10-06T02:57:29.168310+0000","last_became_peered":"2023-10-06T02:57:29.168310+0000","last_unstale":"2023-10-06T02:57:29.173573+0000","last_undegraded":"2023-10-06T02:57:29.173573+0000","last_fullsized":"2023-10-06T02:57:29.173573+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:41.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163459+0000","last_change":"2023-10-06T02:57:29.157101+0000","last_active":"2023-10-06T02:57:29.163459+0000","last_peered":"2023-10-06T02:57:29.163459+0000","last_clean":"2023-10-06T02:57:29.163459+0000","last_became_active":"2023-10-06T02:57:29.156829+0000","last_became_peered":"2023-10-06T02:57:29.156829+0000","last_unstale":"2023-10-06T02:57:29.163459+0000","last_undegraded":"2023-10-06T02:57:29.163459+0000","last_fullsized":"2023-10-06T02:57:29.163459+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:41.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169559+0000","last_change":"2023-10-06T02:57:29.164996+0000","last_active":"2023-10-06T02:57:29.169559+0000","last_peered":"2023-10-06T02:57:29.169559+0000","last_clean":"2023-10-06T02:57:29.169559+0000","last_became_active":"2023-10-06T02:57:29.164679+0000","last_became_peered":"2023-10-06T02:57:29.164679+0000","last_unstale":"2023-10-06T02:57:29.169559+0000","last_undegraded":"2023-10-06T02:57:29.169559+0000","last_fullsized":"2023-10-06T02:57:29.169559+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172324+0000","last_change":"2023-10-06T02:57:29.168679+0000","last_active":"2023-10-06T02:57:29.172324+0000","last_peered":"2023-10-06T02:57:29.172324+0000","last_clean":"2023-10-06T02:57:29.172324+0000","last_became_active":"2023-10-06T02:57:29.168426+0000","last_became_peered":"2023-10-06T02:57:29.168426+0000","last_unstale":"2023-10-06T02:57:29.172324+0000","last_undegraded":"2023-10-06T02:57:29.172324+0000","last_fullsized":"2023-10-06T02:57:29.172324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:20.249704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.155897+0000","last_change":"2023-10-06T02:57:29.151549+0000","last_active":"2023-10-06T02:57:29.155897+0000","last_peered":"2023-10-06T02:57:29.155897+0000","last_clean":"2023-10-06T02:57:29.155897+0000","last_became_active":"2023-10-06T02:57:29.151181+0000","last_became_peered":"2023-10-06T02:57:29.151181+0000","last_unstale":"2023-10-06T02:57:29.155897+0000","last_undegraded":"2023-10-06T02:57:29.155897+0000","last_fullsized":"2023-10-06T02:57:29.155897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:06.133045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.164949+0000","last_change":"2023-10-06T02:57:29.158104+0000","last_active":"2023-10-06T02:57:29.164949+0000","last_peered":"2023-10-06T02:57:29.164949+0000","last_clean":"2023-10-06T02:57:29.164949+0000","last_became_active":"2023-10-06T02:57:29.157801+0000","last_became_peered":"2023-10-06T02:57:29.157801+0000","last_unstale":"2023-10-06T02:57:29.164949+0000","last_undegraded":"2023-10-06T02:57:29.164949+0000","last_fullsized":"2023-10-06T02:57:29.164949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:15.012510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170380+0000","last_change":"2023-10-06T02:57:29.167425+0000","last_active":"2023-10-06T02:57:29.170380+0000","last_peered":"2023-10-06T02:57:29.170380+0000","last_clean":"2023-10-06T02:57:29.170380+0000","last_became_active":"2023-10-06T02:57:29.167207+0000","last_became_peered":"2023-10-06T02:57:29.167207+0000","last_unstale":"2023-10-06T02:57:29.170380+0000","last_undegraded":"2023-10-06T02:57:29.170380+0000","last_fullsized":"2023-10-06T02:57:29.170380+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.156443+0000","last_change":"2023-10-06T02:57:29.154381+0000","last_active":"2023-10-06T02:57:29.156443+0000","last_peered":"2023-10-06T02:57:29.156443+0000","last_clean":"2023-10-06T02:57:29.156443+0000","last_became_active":"2023-10-06T02:57:29.154008+0000","last_became_peered":"2023-10-06T02:57:29.154008+0000","last_unstale":"2023-10-06T02:57:29.156443+0000","last_undegraded":"2023-10-06T02:57:29.156443+0000","last_fullsized":"2023-10-06T02:57:29.156443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:49.049605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168315+0000","last_change":"2023-10-06T02:57:29.158071+0000","last_active":"2023-10-06T02:57:29.168315+0000","last_peered":"2023-10-06T02:57:29.168315+0000","last_clean":"2023-10-06T02:57:29.168315+0000","last_became_active":"2023-10-06T02:57:29.157887+0000","last_became_peered":"2023-10-06T02:57:29.157887+0000","last_unstale":"2023-10-06T02:57:29.168315+0000","last_undegraded":"2023-10-06T02:57:29.168315+0000","last_fullsized":"2023-10-06T02:57:29.168315+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:33.041583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168319+0000","last_change":"2023-10-06T02:57:29.161075+0000","last_active":"2023-10-06T02:57:29.168319+0000","last_peered":"2023-10-06T02:57:29.168319+0000","last_clean":"2023-10-06T02:57:29.168319+0000","last_became_active":"2023-10-06T02:57:29.160817+0000","last_became_peered":"2023-10-06T02:57:29.160817+0000","last_unstale":"2023-10-06T02:57:29.168319+0000","last_undegraded":"2023-10-06T02:57:29.168319+0000","last_fullsized":"2023-10-06T02:57:29.168319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'4","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.179503+0000","last_change":"2023-10-06T02:57:28.154223+0000","last_active":"2023-10-06T02:57:29.179503+0000","last_peered":"2023-10-06T02:57:29.179503+0000","last_clean":"2023-10-06T02:57:29.179503+0000","last_became_active":"2023-10-06T02:57:28.153990+0000","last_became_peered":"2023-10-06T02:57:28.153990+0000","last_unstale":"2023-10-06T02:57:29.179503+0000","last_undegraded":"2023-10-06T02:57:29.179503+0000","last_fullsized":"2023-10-06T02:57:29.179503+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:12.546662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148635+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:51.022047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176350+0000","last_change":"2023-10-06T02:57:28.160875+0000","last_active":"2023-10-06T02:57:29.176350+0000","last_peered":"2023-10-06T02:57:29.176350+0000","last_clean":"2023-10-06T02:57:29.176350+0000","last_became_active":"2023-10-06T02:57:28.160629+0000","last_became_peered":"2023-10-06T02:57:28.160629+0000","last_unstale":"2023-10-06T02:57:29.176350+0000","last_undegraded":"2023-10-06T02:57:29.176350+0000","last_fullsized":"2023-10-06T02:57:29.176350+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168188+0000","last_change":"2023-10-06T02:57:29.157464+0000","last_active":"2023-10-06T02:57:29.168188+0000","last_peered":"2023-10-06T02:57:29.168188+0000","last_clean":"2023-10-06T02:57:29.168188+0000","last_became_active":"2023-10-06T02:57:29.157219+0000","last_became_peered":"2023-10-06T02:57:29.157219+0000","last_unstale":"2023-10-06T02:57:29.168188+0000","last_undegraded":"2023-10-06T02:57:29.168188+0000","last_fullsized":"2023-10-06T02:57:29.168188+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:49.829140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176172+0000","last_change":"2023-10-06T02:57:28.154910+0000","last_active":"2023-10-06T02:57:29.176172+0000","last_peered":"2023-10-06T02:57:29.176172+0000","last_clean":"2023-10-06T02:57:29.176172+0000","last_became_active":"2023-10-06T02:57:28.154656+0000","last_became_peered":"2023-10-06T02:57:28.154656+0000","last_unstale":"2023-10-06T02:57:29.176172+0000","last_undegraded":"2023-10-06T02:57:29.176172+0000","last_fullsized":"2023-10-06T02:57:29.176172+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168622+0000","last_change":"2023-10-06T02:57:29.162359+0000","last_active":"2023-10-06T02:57:29.168622+0000","last_peered":"2023-10-06T02:57:29.168622+0000","last_clean":"2023-10-06T02:57:29.168622+0000","last_became_active":"2023-10-06T02:57:29.162140+0000","last_became_peered":"2023-10-06T02:57:29.162140+0000","last_unstale":"2023-10-06T02:57:29.168622+0000","last_undegraded":"2023-10-06T02:57:29.168622+0000","last_fullsized":"2023-10-06T02:57:29.168622+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:44.291549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.173802+0000","last_change":"2023-10-06T02:57:28.158739+0000","last_active":"2023-10-06T02:57:29.173802+0000","last_peered":"2023-10-06T02:57:29.173802+0000","last_clean":"2023-10-06T02:57:29.173802+0000","last_became_active":"2023-10-06T02:57:28.158477+0000","last_became_peered":"2023-10-06T02:57:28.158477+0000","last_unstale":"2023-10-06T02:57:29.173802+0000","last_undegraded":"2023-10-06T02:57:29.173802+0000","last_fullsized":"2023-10-06T02:57:29.173802+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:29.634384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168293+0000","last_change":"2023-10-06T02:57:29.164378+0000","last_active":"2023-10-06T02:57:29.168293+0000","last_peered":"2023-10-06T02:57:29.168293+0000","last_clean":"2023-10-06T02:57:29.168293+0000","last_became_active":"2023-10-06T02:57:29.156693+0000","last_became_peered":"2023-10-06T02:57:29.156693+0000","last_unstale":"2023-10-06T02:57:29.168293+0000","last_undegraded":"2023-10-06T02:57:29.168293+0000","last_fullsized":"2023-10-06T02:57:29.168293+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:26.397679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169348+0000","last_change":"2023-10-06T02:57:28.154727+0000","last_active":"2023-10-06T02:57:29.169348+0000","last_peered":"2023-10-06T02:57:29.169348+0000","last_clean":"2023-10-06T02:57:29.169348+0000","last_became_active":"2023-10-06T02:57:28.154457+0000","last_became_peered":"2023-10-06T02:57:28.154457+0000","last_unstale":"2023-10-06T02:57:29.169348+0000","last_undegraded":"2023-10-06T02:57:29.169348+0000","last_fullsized":"2023-10-06T02:57:29.169348+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157671+0000","last_change":"2023-10-06T02:57:29.154297+0000","last_active":"2023-10-06T02:57:29.157671+0000","last_peered":"2023-10-06T02:57:29.157671+0000","last_clean":"2023-10-06T02:57:29.157671+0000","last_became_active":"2023-10-06T02:57:29.154053+0000","last_became_peered":"2023-10-06T02:57:29.154053+0000","last_unstale":"2023-10-06T02:57:29.157671+0000","last_undegraded":"2023-10-06T02:57:29.157671+0000","last_fullsized":"2023-10-06T02:57:29.157671+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:07.324323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176991+0000","last_change":"2023-10-06T02:57:28.156466+0000","last_active":"2023-10-06T02:57:29.176991+0000","last_peered":"2023-10-06T02:57:29.176991+0000","last_clean":"2023-10-06T02:57:29.176991+0000","last_became_active":"2023-10-06T02:57:28.156258+0000","last_became_peered":"2023-10-06T02:57:28.156258+0000","last_unstale":"2023-10-06T02:57:29.176991+0000","last_undegraded":"2023-10-06T02:57:29.176991+0000","last_fullsized":"2023-10-06T02:57:29.176991+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:02.075540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163036+0000","last_change":"2023-10-06T02:57:29.159827+0000","last_active":"2023-10-06T02:57:29.163036+0000","last_peered":"2023-10-06T02:57:29.163036+0000","last_clean":"2023-10-06T02:57:29.163036+0000","last_became_active":"2023-10-06T02:57:29.159543+0000","last_became_peered":"2023-10-06T02:57:29.159543+0000","last_unstale":"2023-10-06T02:57:29.163036+0000","last_undegraded":"2023-10-06T02:57:29.163036+0000","last_fullsized":"2023-10-06T02:57:29.163036+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:30.271330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147822+0000","last_change":"2023-10-06T02:57:28.154919+0000","last_active":"2023-10-06T02:57:29.147822+0000","last_peered":"2023-10-06T02:57:29.147822+0000","last_clean":"2023-10-06T02:57:29.147822+0000","last_became_active":"2023-10-06T02:57:28.154620+0000","last_became_peered":"2023-10-06T02:57:28.154620+0000","last_unstale":"2023-10-06T02:57:29.147822+0000","last_undegraded":"2023-10-06T02:57:29.147822+0000","last_fullsized":"2023-10-06T02:57:29.147822+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:27.029195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175549+0000","last_change":"2023-10-06T02:57:29.168450+0000","last_active":"2023-10-06T02:57:29.175549+0000","last_peered":"2023-10-06T02:57:29.175549+0000","last_clean":"2023-10-06T02:57:29.175549+0000","last_became_active":"2023-10-06T02:57:29.162935+0000","last_became_peered":"2023-10-06T02:57:29.162935+0000","last_unstale":"2023-10-06T02:57:29.175549+0000","last_undegraded":"2023-10-06T02:57:29.175549+0000","last_fullsized":"2023-10-06T02:57:29.175549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:40.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.153192+0000","last_change":"2023-10-06T02:57:28.154846+0000","last_active":"2023-10-06T02:57:29.153192+0000","last_peered":"2023-10-06T02:57:29.153192+0000","last_clean":"2023-10-06T02:57:29.153192+0000","last_became_active":"2023-10-06T02:57:28.154580+0000","last_became_peered":"2023-10-06T02:57:28.154580+0000","last_unstale":"2023-10-06T02:57:29.153192+0000","last_undegraded":"2023-10-06T02:57:29.153192+0000","last_fullsized":"2023-10-06T02:57:29.153192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168676+0000","last_change":"2023-10-06T02:57:29.164564+0000","last_active":"2023-10-06T02:57:29.168676+0000","last_peered":"2023-10-06T02:57:29.168676+0000","last_clean":"2023-10-06T02:57:29.168676+0000","last_became_active":"2023-10-06T02:57:29.164307+0000","last_became_peered":"2023-10-06T02:57:29.164307+0000","last_unstale":"2023-10-06T02:57:29.168676+0000","last_undegraded":"2023-10-06T02:57:29.168676+0000","last_fullsized":"2023-10-06T02:57:29.168676+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:15.152388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147830+0000","last_change":"2023-10-06T02:57:28.162028+0000","last_active":"2023-10-06T02:57:29.147830+0000","last_peered":"2023-10-06T02:57:29.147830+0000","last_clean":"2023-10-06T02:57:29.147830+0000","last_became_active":"2023-10-06T02:57:28.161784+0000","last_became_peered":"2023-10-06T02:57:28.161784+0000","last_unstale":"2023-10-06T02:57:29.147830+0000","last_undegraded":"2023-10-06T02:57:29.147830+0000","last_fullsized":"2023-10-06T02:57:29.147830+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:22.612517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.167888+0000","last_change":"2023-10-06T02:57:29.157912+0000","last_active":"2023-10-06T02:57:29.167888+0000","last_peered":"2023-10-06T02:57:29.167888+0000","last_clean":"2023-10-06T02:57:29.167888+0000","last_became_active":"2023-10-06T02:57:29.157687+0000","last_became_peered":"2023-10-06T02:57:29.157687+0000","last_unstale":"2023-10-06T02:57:29.167888+0000","last_undegraded":"2023-10-06T02:57:29.167888+0000","last_fullsized":"2023-10-06T02:57:29.167888+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.143197+0000","last_change":"2023-10-06T02:57:28.158578+0000","last_active":"2023-10-06T02:57:29.143197+0000","last_peered":"2023-10-06T02:57:29.143197+0000","last_clean":"2023-10-06T02:57:29.143197+0000","last_became_active":"2023-10-06T02:57:28.158361+0000","last_became_peered":"2023-10-06T02:57:28.158361+0000","last_unstale":"2023-10-06T02:57:29.143197+0000","last_undegraded":"2023-10-06T02:57:29.143197+0000","last_fullsized":"2023-10-06T02:57:29.143197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.151744+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:24.455071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176092+0000","last_change":"2023-10-06T02:57:28.162959+0000","last_active":"2023-10-06T02:57:29.176092+0000","last_peered":"2023-10-06T02:57:29.176092+0000","last_clean":"2023-10-06T02:57:29.176092+0000","last_became_active":"2023-10-06T02:57:28.162660+0000","last_became_peered":"2023-10-06T02:57:28.162660+0000","last_unstale":"2023-10-06T02:57:29.176092+0000","last_undegraded":"2023-10-06T02:57:29.176092+0000","last_fullsized":"2023-10-06T02:57:29.176092+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:32.327057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170473+0000","last_change":"2023-10-06T02:57:29.162522+0000","last_active":"2023-10-06T02:57:29.170473+0000","last_peered":"2023-10-06T02:57:29.170473+0000","last_clean":"2023-10-06T02:57:29.170473+0000","last_became_active":"2023-10-06T02:57:29.162186+0000","last_became_peered":"2023-10-06T02:57:29.162186+0000","last_unstale":"2023-10-06T02:57:29.170473+0000","last_undegraded":"2023-10-06T02:57:29.170473+0000","last_fullsized":"2023-10-06T02:57:29.170473+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'6","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.178971+0000","last_change":"2023-10-06T02:57:28.155523+0000","last_active":"2023-10-06T02:57:29.178971+0000","last_peered":"2023-10-06T02:57:29.178971+0000","last_clean":"2023-10-06T02:57:29.178971+0000","last_became_active":"2023-10-06T02:57:28.155251+0000","last_became_peered":"2023-10-06T02:57:28.155251+0000","last_unstale":"2023-10-06T02:57:29.178971+0000","last_undegraded":"2023-10-06T02:57:29.178971+0000","last_fullsized":"2023-10-06T02:57:29.178971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161062+0000","last_change":"2023-10-06T02:57:29.157777+0000","last_active":"2023-10-06T02:57:29.161062+0000","last_peered":"2023-10-06T02:57:29.161062+0000","last_clean":"2023-10-06T02:57:29.161062+0000","last_became_active":"2023-10-06T02:57:29.157437+0000","last_became_peered":"2023-10-06T02:57:29.157437+0000","last_unstale":"2023-10-06T02:57:29.161062+0000","last_undegraded":"2023-10-06T02:57:29.161062+0000","last_fullsized":"2023-10-06T02:57:29.161062+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.177436+0000","last_change":"2023-10-06T02:57:28.160083+0000","last_active":"2023-10-06T02:57:29.177436+0000","last_peered":"2023-10-06T02:57:29.177436+0000","last_clean":"2023-10-06T02:57:29.177436+0000","last_became_active":"2023-10-06T02:57:28.158968+0000","last_became_peered":"2023-10-06T02:57:28.158968+0000","last_unstale":"2023-10-06T02:57:29.177436+0000","last_undegraded":"2023-10-06T02:57:29.177436+0000","last_fullsized":"2023-10-06T02:57:29.177436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169518+0000","last_change":"2023-10-06T02:57:29.161672+0000","last_active":"2023-10-06T02:57:29.169518+0000","last_peered":"2023-10-06T02:57:29.169518+0000","last_clean":"2023-10-06T02:57:29.169518+0000","last_became_active":"2023-10-06T02:57:29.161419+0000","last_became_peered":"2023-10-06T02:57:29.161419+0000","last_unstale":"2023-10-06T02:57:29.169518+0000","last_undegraded":"2023-10-06T02:57:29.169518+0000","last_fullsized":"2023-10-06T02:57:29.169518+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154494+0000","last_change":"2023-10-06T02:57:28.157931+0000","last_active":"2023-10-06T02:57:29.154494+0000","last_peered":"2023-10-06T02:57:29.154494+0000","last_clean":"2023-10-06T02:57:29.154494+0000","last_became_active":"2023-10-06T02:57:28.157645+0000","last_became_peered":"2023-10-06T02:57:28.157645+0000","last_unstale":"2023-10-06T02:57:29.154494+0000","last_undegraded":"2023-10-06T02:57:29.154494+0000","last_fullsized":"2023-10-06T02:57:29.154494+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:02.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165639+0000","last_change":"2023-10-06T02:57:29.160639+0000","last_active":"2023-10-06T02:57:29.165639+0000","last_peered":"2023-10-06T02:57:29.165639+0000","last_clean":"2023-10-06T02:57:29.165639+0000","last_became_active":"2023-10-06T02:57:29.160386+0000","last_became_peered":"2023-10-06T02:57:29.160386+0000","last_unstale":"2023-10-06T02:57:29.165639+0000","last_undegraded":"2023-10-06T02:57:29.165639+0000","last_fullsized":"2023-10-06T02:57:29.165639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:54.010722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147731+0000","last_change":"2023-10-06T02:57:28.160747+0000","last_active":"2023-10-06T02:57:29.147731+0000","last_peered":"2023-10-06T02:57:29.147731+0000","last_clean":"2023-10-06T02:57:29.147731+0000","last_became_active":"2023-10-06T02:57:28.160491+0000","last_became_peered":"2023-10-06T02:57:28.160491+0000","last_unstale":"2023-10-06T02:57:29.147731+0000","last_undegraded":"2023-10-06T02:57:29.147731+0000","last_fullsized":"2023-10-06T02:57:29.147731+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:54.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169454+0000","last_change":"2023-10-06T02:57:29.160795+0000","last_active":"2023-10-06T02:57:29.169454+0000","last_peered":"2023-10-06T02:57:29.169454+0000","last_clean":"2023-10-06T02:57:29.169454+0000","last_became_active":"2023-10-06T02:57:29.160448+0000","last_became_peered":"2023-10-06T02:57:29.160448+0000","last_unstale":"2023-10-06T02:57:29.169454+0000","last_undegraded":"2023-10-06T02:57:29.169454+0000","last_fullsized":"2023-10-06T02:57:29.169454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'8","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.177299+0000","last_change":"2023-10-06T02:57:28.163501+0000","last_active":"2023-10-06T02:57:29.177299+0000","last_peered":"2023-10-06T02:57:29.177299+0000","last_clean":"2023-10-06T02:57:29.177299+0000","last_became_active":"2023-10-06T02:57:28.163221+0000","last_became_peered":"2023-10-06T02:57:28.163221+0000","last_unstale":"2023-10-06T02:57:29.177299+0000","last_undegraded":"2023-10-06T02:57:29.177299+0000","last_fullsized":"2023-10-06T02:57:29.177299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:21.591868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161107+0000","last_change":"2023-10-06T02:57:29.157590+0000","last_active":"2023-10-06T02:57:29.161107+0000","last_peered":"2023-10-06T02:57:29.161107+0000","last_clean":"2023-10-06T02:57:29.161107+0000","last_became_active":"2023-10-06T02:57:29.157329+0000","last_became_peered":"2023-10-06T02:57:29.157329+0000","last_unstale":"2023-10-06T02:57:29.161107+0000","last_undegraded":"2023-10-06T02:57:29.161107+0000","last_fullsized":"2023-10-06T02:57:29.161107+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.995687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.155033+0000","last_change":"2023-10-06T02:57:28.155033+0000","last_active":"2023-10-06T02:57:28.155033+0000","last_peered":"2023-10-06T02:57:28.155033+0000","last_clean":"2023-10-06T02:57:28.155033+0000","last_became_active":"2023-10-06T02:57:28.154759+0000","last_became_peered":"2023-10-06T02:57:28.154759+0000","last_unstale":"2023-10-06T02:57:28.155033+0000","last_undegraded":"2023-10-06T02:57:28.155033+0000","last_fullsized":"2023-10-06T02:57:28.155033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:40.908455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163188+0000","last_change":"2023-10-06T02:57:29.160336+0000","last_active":"2023-10-06T02:57:29.163188+0000","last_peered":"2023-10-06T02:57:29.163188+0000","last_clean":"2023-10-06T02:57:29.163188+0000","last_became_active":"2023-10-06T02:57:29.159485+0000","last_became_peered":"2023-10-06T02:57:29.159485+0000","last_unstale":"2023-10-06T02:57:29.163188+0000","last_undegraded":"2023-10-06T02:57:29.163188+0000","last_fullsized":"2023-10-06T02:57:29.163188+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:57:30.152180+0000","last_change":"2023-10-06T02:57:28.156381+0000","last_active":"2023-10-06T02:57:30.152180+0000","last_peered":"2023-10-06T02:57:30.152180+0000","last_clean":"2023-10-06T02:57:30.152180+0000","last_became_active":"2023-10-06T02:57:28.156172+0000","last_became_peered":"2023-10-06T02:57:28.156172+0000","last_unstale":"2023-10-06T02:57:30.152180+0000","last_undegraded":"2023-10-06T02:57:30.152180+0000","last_fullsized":"2023-10-06T02:57:30.152180+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:50.675247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.148511+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.148715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154555+0000","last_change":"2023-10-06T02:57:28.150712+0000","last_active":"2023-10-06T02:57:29.154555+0000","last_peered":"2023-10-06T02:57:29.154555+0000","last_clean":"2023-10-06T02:57:29.154555+0000","last_became_active":"2023-10-06T02:57:28.150426+0000","last_became_peered":"2023-10-06T02:57:28.150426+0000","last_unstale":"2023-10-06T02:57:29.154555+0000","last_undegraded":"2023-10-06T02:57:29.154555+0000","last_fullsized":"2023-10-06T02:57:29.154555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:47.960513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168602+0000","last_change":"2023-10-06T02:57:29.162357+0000","last_active":"2023-10-06T02:57:29.168602+0000","last_peered":"2023-10-06T02:57:29.168602+0000","last_clean":"2023-10-06T02:57:29.168602+0000","last_became_active":"2023-10-06T02:57:29.162107+0000","last_became_peered":"2023-10-06T02:57:29.162107+0000","last_unstale":"2023-10-06T02:57:29.168602+0000","last_undegraded":"2023-10-06T02:57:29.168602+0000","last_fullsized":"2023-10-06T02:57:29.168602+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:20.349987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.149462+0000","last_change":"2023-10-06T02:57:28.158040+0000","last_active":"2023-10-06T02:57:29.149462+0000","last_peered":"2023-10-06T02:57:29.149462+0000","last_clean":"2023-10-06T02:57:29.149462+0000","last_became_active":"2023-10-06T02:57:28.157767+0000","last_became_peered":"2023-10-06T02:57:28.157767+0000","last_unstale":"2023-10-06T02:57:29.149462+0000","last_undegraded":"2023-10-06T02:57:29.149462+0000","last_fullsized":"2023-10-06T02:57:29.149462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:56.163695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.164477+0000","last_change":"2023-10-06T02:57:29.157425+0000","last_active":"2023-10-06T02:57:29.164477+0000","last_peered":"2023-10-06T02:57:29.164477+0000","last_clean":"2023-10-06T02:57:29.164477+0000","last_became_active":"2023-10-06T02:57:29.156688+0000","last_became_peered":"2023-10-06T02:57:29.156688+0000","last_unstale":"2023-10-06T02:57:29.164477+0000","last_undegraded":"2023-10-06T02:57:29.164477+0000","last_fullsized":"2023-10-06T02:57:29.164477+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:33.041583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.153360+0000","last_change":"2023-10-06T02:57:28.153360+0000","last_active":"2023-10-06T02:57:28.153360+0000","last_peered":"2023-10-06T02:57:28.153360+0000","last_clean":"2023-10-06T02:57:28.153360+0000","last_became_active":"2023-10-06T02:57:28.153120+0000","last_became_peered":"2023-10-06T02:57:28.153120+0000","last_unstale":"2023-10-06T02:57:28.153360+0000","last_undegraded":"2023-10-06T02:57:28.153360+0000","last_fullsized":"2023-10-06T02:57:28.153360+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:44.063071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169312+0000","last_change":"2023-10-06T02:57:29.158979+0000","last_active":"2023-10-06T02:57:29.169312+0000","last_peered":"2023-10-06T02:57:29.169312+0000","last_clean":"2023-10-06T02:57:29.169312+0000","last_became_active":"2023-10-06T02:57:29.158726+0000","last_became_peered":"2023-10-06T02:57:29.158726+0000","last_unstale":"2023-10-06T02:57:29.169312+0000","last_undegraded":"2023-10-06T02:57:29.169312+0000","last_fullsized":"2023-10-06T02:57:29.169312+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:53.278507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.156524+0000","last_change":"2023-10-06T02:57:28.155104+0000","last_active":"2023-10-06T02:57:29.156524+0000","last_peered":"2023-10-06T02:57:29.156524+0000","last_clean":"2023-10-06T02:57:29.156524+0000","last_became_active":"2023-10-06T02:57:28.154822+0000","last_became_peered":"2023-10-06T02:57:28.154822+0000","last_unstale":"2023-10-06T02:57:29.156524+0000","last_undegraded":"2023-10-06T02:57:29.156524+0000","last_fullsized":"2023-10-06T02:57:29.156524+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:57:28.134821+0000","last_change":"2023-10-06T02:57:28.147894+0000","last_active":"2023-10-06T02:57:28.134821+0000","last_peered":"2023-10-06T02:57:28.134821+0000","last_clean":"2023-10-06T02:57:28.134821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:57:28.134821+0000","last_undegraded":"2023-10-06T02:57:28.134821+0000","last_fullsized":"2023-10-06T02:57:28.134821+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:06.133045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.160730+0000","last_change":"2023-10-06T02:57:28.160730+0000","last_active":"2023-10-06T02:57:28.160730+0000","last_peered":"2023-10-06T02:57:28.160730+0000","last_clean":"2023-10-06T02:57:28.160730+0000","last_became_active":"2023-10-06T02:57:28.160482+0000","last_became_peered":"2023-10-06T02:57:28.160482+0000","last_unstale":"2023-10-06T02:57:28.160730+0000","last_undegraded":"2023-10-06T02:57:28.160730+0000","last_fullsized":"2023-10-06T02:57:28.160730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:48.044243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168562+0000","last_change":"2023-10-06T02:57:29.159938+0000","last_active":"2023-10-06T02:57:29.168562+0000","last_peered":"2023-10-06T02:57:29.168562+0000","last_clean":"2023-10-06T02:57:29.168562+0000","last_became_active":"2023-10-06T02:57:29.158530+0000","last_became_peered":"2023-10-06T02:57:29.158530+0000","last_unstale":"2023-10-06T02:57:29.168562+0000","last_undegraded":"2023-10-06T02:57:29.168562+0000","last_fullsized":"2023-10-06T02:57:29.168562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:59.957180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.142933+0000","last_change":"2023-10-06T02:57:28.151353+0000","last_active":"2023-10-06T02:57:29.142933+0000","last_peered":"2023-10-06T02:57:29.142933+0000","last_clean":"2023-10-06T02:57:29.142933+0000","last_became_active":"2023-10-06T02:57:28.151093+0000","last_became_peered":"2023-10-06T02:57:28.151093+0000","last_unstale":"2023-10-06T02:57:29.142933+0000","last_undegraded":"2023-10-06T02:57:29.142933+0000","last_fullsized":"2023-10-06T02:57:29.142933+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.160961+0000","last_change":"2023-10-06T02:57:29.153490+0000","last_active":"2023-10-06T02:57:29.160961+0000","last_peered":"2023-10-06T02:57:29.160961+0000","last_clean":"2023-10-06T02:57:29.160961+0000","last_became_active":"2023-10-06T02:57:29.153227+0000","last_became_peered":"2023-10-06T02:57:29.153227+0000","last_unstale":"2023-10-06T02:57:29.160961+0000","last_undegraded":"2023-10-06T02:57:29.160961+0000","last_fullsized":"2023-10-06T02:57:29.160961+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.177927+0000","last_change":"2023-10-06T02:57:28.158553+0000","last_active":"2023-10-06T02:57:29.177927+0000","last_peered":"2023-10-06T02:57:29.177927+0000","last_clean":"2023-10-06T02:57:29.177927+0000","last_became_active":"2023-10-06T02:57:28.158316+0000","last_became_peered":"2023-10-06T02:57:28.158316+0000","last_unstale":"2023-10-06T02:57:29.177927+0000","last_undegraded":"2023-10-06T02:57:29.177927+0000","last_fullsized":"2023-10-06T02:57:29.177927+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:58.492313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.145174+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:57:27.145174+0000","last_peered":"2023-10-06T02:57:27.145174+0000","last_clean":"2023-10-06T02:57:27.145174+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:57:27.145174+0000","last_undegraded":"2023-10-06T02:57:27.145174+0000","last_fullsized":"2023-10-06T02:57:27.145174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168418+0000","last_change":"2023-10-06T02:57:29.160818+0000","last_active":"2023-10-06T02:57:29.168418+0000","last_peered":"2023-10-06T02:57:29.168418+0000","last_clean":"2023-10-06T02:57:29.168418+0000","last_became_active":"2023-10-06T02:57:29.160528+0000","last_became_peered":"2023-10-06T02:57:29.160528+0000","last_unstale":"2023-10-06T02:57:29.168418+0000","last_undegraded":"2023-10-06T02:57:29.168418+0000","last_fullsized":"2023-10-06T02:57:29.168418+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:58.527683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147156+0000","last_change":"2023-10-06T02:57:28.158916+0000","last_active":"2023-10-06T02:57:29.147156+0000","last_peered":"2023-10-06T02:57:29.147156+0000","last_clean":"2023-10-06T02:57:29.147156+0000","last_became_active":"2023-10-06T02:57:28.158666+0000","last_became_peered":"2023-10-06T02:57:28.158666+0000","last_unstale":"2023-10-06T02:57:29.147156+0000","last_undegraded":"2023-10-06T02:57:29.147156+0000","last_fullsized":"2023-10-06T02:57:29.147156+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:05.270414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.150368+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:57:29.150368+0000","last_peered":"2023-10-06T02:57:29.150368+0000","last_clean":"2023-10-06T02:57:29.150368+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:57:29.150368+0000","last_undegraded":"2023-10-06T02:57:29.150368+0000","last_fullsized":"2023-10-06T02:57:29.150368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161083+0000","last_change":"2023-10-06T02:57:29.158084+0000","last_active":"2023-10-06T02:57:29.161083+0000","last_peered":"2023-10-06T02:57:29.161083+0000","last_clean":"2023-10-06T02:57:29.161083+0000","last_became_active":"2023-10-06T02:57:29.157809+0000","last_became_peered":"2023-10-06T02:57:29.157809+0000","last_unstale":"2023-10-06T02:57:29.161083+0000","last_undegraded":"2023-10-06T02:57:29.161083+0000","last_fullsized":"2023-10-06T02:57:29.161083+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:53.278507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176722+0000","last_change":"2023-10-06T02:57:28.155037+0000","last_active":"2023-10-06T02:57:29.176722+0000","last_peered":"2023-10-06T02:57:29.176722+0000","last_clean":"2023-10-06T02:57:29.176722+0000","last_became_active":"2023-10-06T02:57:28.154790+0000","last_became_peered":"2023-10-06T02:57:28.154790+0000","last_unstale":"2023-10-06T02:57:29.176722+0000","last_undegraded":"2023-10-06T02:57:29.176722+0000","last_fullsized":"2023-10-06T02:57:29.176722+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.148271+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:57:29.148271+0000","last_peered":"2023-10-06T02:57:29.148271+0000","last_clean":"2023-10-06T02:57:29.148271+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:57:29.148271+0000","last_undegraded":"2023-10-06T02:57:29.148271+0000","last_fullsized":"2023-10-06T02:57:29.148271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157069+0000","last_change":"2023-10-06T02:57:29.153722+0000","last_active":"2023-10-06T02:57:29.157069+0000","last_peered":"2023-10-06T02:57:29.157069+0000","last_clean":"2023-10-06T02:57:29.157069+0000","last_became_active":"2023-10-06T02:57:29.153463+0000","last_became_peered":"2023-10-06T02:57:29.153463+0000","last_unstale":"2023-10-06T02:57:29.157069+0000","last_undegraded":"2023-10-06T02:57:29.157069+0000","last_fullsized":"2023-10-06T02:57:29.157069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:49.958572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154456+0000","last_change":"2023-10-06T02:57:28.153262+0000","last_active":"2023-10-06T02:57:29.154456+0000","last_peered":"2023-10-06T02:57:29.154456+0000","last_clean":"2023-10-06T02:57:29.154456+0000","last_became_active":"2023-10-06T02:57:28.152963+0000","last_became_peered":"2023-10-06T02:57:28.152963+0000","last_unstale":"2023-10-06T02:57:29.154456+0000","last_undegraded":"2023-10-06T02:57:29.154456+0000","last_fullsized":"2023-10-06T02:57:29.154456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:21.640991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147690+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:57:29.147690+0000","last_peered":"2023-10-06T02:57:29.147690+0000","last_clean":"2023-10-06T02:57:29.147690+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:57:29.147690+0000","last_undegraded":"2023-10-06T02:57:29.147690+0000","last_fullsized":"2023-10-06T02:57:29.147690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147602+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:57:29.147602+0000","last_peered":"2023-10-06T02:57:29.147602+0000","last_clean":"2023-10-06T02:57:29.147602+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:57:29.147602+0000","last_undegraded":"2023-10-06T02:57:29.147602+0000","last_fullsized":"2023-10-06T02:57:29.147602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172336+0000","last_change":"2023-10-06T02:57:29.168415+0000","last_active":"2023-10-06T02:57:29.172336+0000","last_peered":"2023-10-06T02:57:29.172336+0000","last_clean":"2023-10-06T02:57:29.172336+0000","last_became_active":"2023-10-06T02:57:29.168146+0000","last_became_peered":"2023-10-06T02:57:29.168146+0000","last_unstale":"2023-10-06T02:57:29.172336+0000","last_undegraded":"2023-10-06T02:57:29.172336+0000","last_fullsized":"2023-10-06T02:57:29.172336+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:15.152388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T02:57:28.158519+0000","last_change":"2023-10-06T02:57:28.158519+0000","last_active":"2023-10-06T02:57:28.158519+0000","last_peered":"2023-10-06T02:57:28.158519+0000","last_clean":"2023-10-06T02:57:28.158519+0000","last_became_active":"2023-10-06T02:57:28.158257+0000","last_became_peered":"2023-10-06T02:57:28.158257+0000","last_unstale":"2023-10-06T02:57:28.158519+0000","last_undegraded":"2023-10-06T02:57:28.158519+0000","last_fullsized":"2023-10-06T02:57:28.158519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:29.265968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147687+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:57:29.147687+0000","last_peered":"2023-10-06T02:57:29.147687+0000","last_clean":"2023-10-06T02:57:29.147687+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:57:29.147687+0000","last_undegraded":"2023-10-06T02:57:29.147687+0000","last_fullsized":"2023-10-06T02:57:29.147687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170428+0000","last_change":"2023-10-06T02:57:29.166606+0000","last_active":"2023-10-06T02:57:29.170428+0000","last_peered":"2023-10-06T02:57:29.170428+0000","last_clean":"2023-10-06T02:57:29.170428+0000","last_became_active":"2023-10-06T02:57:29.162754+0000","last_became_peered":"2023-10-06T02:57:29.162754+0000","last_unstale":"2023-10-06T02:57:29.170428+0000","last_undegraded":"2023-10-06T02:57:29.170428+0000","last_fullsized":"2023-10-06T02:57:29.170428+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.995687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175565+0000","last_change":"2023-10-06T02:57:28.159275+0000","last_active":"2023-10-06T02:57:29.175565+0000","last_peered":"2023-10-06T02:57:29.175565+0000","last_clean":"2023-10-06T02:57:29.175565+0000","last_became_active":"2023-10-06T02:57:28.158956+0000","last_became_peered":"2023-10-06T02:57:28.158956+0000","last_unstale":"2023-10-06T02:57:29.175565+0000","last_undegraded":"2023-10-06T02:57:29.175565+0000","last_fullsized":"2023-10-06T02:57:29.175565+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:22.990325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.152122+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:57:29.152122+0000","last_peered":"2023-10-06T02:57:29.152122+0000","last_clean":"2023-10-06T02:57:29.152122+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:57:29.152122+0000","last_undegraded":"2023-10-06T02:57:29.152122+0000","last_fullsized":"2023-10-06T02:57:29.152122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170455+0000","last_change":"2023-10-06T02:57:29.162353+0000","last_active":"2023-10-06T02:57:29.170455+0000","last_peered":"2023-10-06T02:57:29.170455+0000","last_clean":"2023-10-06T02:57:29.170455+0000","last_became_active":"2023-10-06T02:57:29.162100+0000","last_became_peered":"2023-10-06T02:57:29.162100+0000","last_unstale":"2023-10-06T02:57:29.170455+0000","last_undegraded":"2023-10-06T02:57:29.170455+0000","last_fullsized":"2023-10-06T02:57:29.170455+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.151069+0000","last_change":"2023-10-06T02:57:28.155416+0000","last_active":"2023-10-06T02:57:29.151069+0000","last_peered":"2023-10-06T02:57:29.151069+0000","last_clean":"2023-10-06T02:57:29.151069+0000","last_became_active":"2023-10-06T02:57:28.155144+0000","last_became_peered":"2023-10-06T02:57:28.155144+0000","last_unstale":"2023-10-06T02:57:29.151069+0000","last_undegraded":"2023-10-06T02:57:29.151069+0000","last_fullsized":"2023-10-06T02:57:29.151069+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T02:57:27.145205+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:57:27.145205+0000","last_peered":"2023-10-06T02:57:27.145205+0000","last_clean":"2023-10-06T02:57:27.145205+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:57:27.145205+0000","last_undegraded":"2023-10-06T02:57:27.145205+0000","last_fullsized":"2023-10-06T02:57:27.145205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175506+0000","last_change":"2023-10-06T02:57:29.170783+0000","last_active":"2023-10-06T02:57:29.175506+0000","last_peered":"2023-10-06T02:57:29.175506+0000","last_clean":"2023-10-06T02:57:29.175506+0000","last_became_active":"2023-10-06T02:57:29.170473+0000","last_became_peered":"2023-10-06T02:57:29.170473+0000","last_unstale":"2023-10-06T02:57:29.175506+0000","last_undegraded":"2023-10-06T02:57:29.175506+0000","last_fullsized":"2023-10-06T02:57:29.175506+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:20.349987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.174018+0000","last_change":"2023-10-06T02:57:28.158264+0000","last_active":"2023-10-06T02:57:29.174018+0000","last_peered":"2023-10-06T02:57:29.174018+0000","last_clean":"2023-10-06T02:57:29.174018+0000","last_became_active":"2023-10-06T02:57:28.157981+0000","last_became_peered":"2023-10-06T02:57:28.157981+0000","last_unstale":"2023-10-06T02:57:29.174018+0000","last_undegraded":"2023-10-06T02:57:29.174018+0000","last_fullsized":"2023-10-06T02:57:29.174018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:47.860250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154572+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:57:29.154572+0000","last_peered":"2023-10-06T02:57:29.154572+0000","last_clean":"2023-10-06T02:57:29.154572+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:57:29.154572+0000","last_undegraded":"2023-10-06T02:57:29.154572+0000","last_fullsized":"2023-10-06T02:57:29.154572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298528,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073312,"statfs":{"total":96636764160,"available":96331071488,"internally_reserved":0,"allocated":1269760,"data_stored":900057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.439},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65600000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.31,"15min":0.31},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.375}]},{"osd":4,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59599999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65700000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67000000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40600000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64900000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68400000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.34599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297940,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073900,"statfs":{"total":96636764160,"available":96331673600,"internally_reserved":0,"allocated":667648,"data_stored":309529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":3.415,"15min":3.415},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.627}]},{"osd":1,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":1.546,"15min":1.546},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68899999999999995,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63400000000000001,"5min":1.74,"15min":1.74},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.70399999999999996,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.71599999999999997,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.74299999999999999,"5min":3.577,"15min":3.577},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.67300000000000004,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.66300000000000003,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68000000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297912,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073928,"statfs":{"total":96636764160,"available":96331702272,"internally_reserved":0,"allocated":638976,"data_stored":294121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.22,"5min":0.19,"15min":0.19},"max":{"1min":0.48499999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.376,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59999999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":1.21,"15min":1.3500000000000001},"min":{"1min":0.24299999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51800000000000002,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65500000000000003,"5min":1.181,"15min":1.181},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":1.02,"15min":1.02},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.629,"5min":1.4339999999999999,"15min":1.5680000000000001},"min":{"1min":0.46800000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85599999999999998,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.423,"15min":1.5529999999999999},"min":{"1min":0.45000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95699999999999996,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.504,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82099999999999995,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.628,"5min":1.452,"15min":1.5900000000000001},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":21.166,"15min":21.166},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81999999999999995,"5min":0.997,"15min":0.997},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298532,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073308,"statfs":{"total":96636764160,"available":96331067392,"internally_reserved":0,"allocated":1273856,"data_stored":900976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.434,"5min":0.441,"15min":0.441},"last":0.246},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.27600000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.374,"15min":0.372},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.317,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.27400000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72699999999999998,"5min":0.879,"15min":0.879},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73799999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73099999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297948,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073892,"statfs":{"total":96636764160,"available":96331665408,"internally_reserved":0,"allocated":675840,"data_stored":309585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.31,"15min":0.30599999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47399999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.317},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.5,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.313},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65000000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58799999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.747,"5min":0.755,"15min":0.755},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55500000000000005},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71899999999999997,"5min":1.077,"15min":1.077},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.435,"15min":0.435},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297944,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073896,"statfs":{"total":96636764160,"available":96331669504,"internally_reserved":0,"allocated":671744,"data_stored":308574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.623,"5min":2.569,"15min":2.569},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.53800000000000003,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.27700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.439,"15min":0.44900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57699999999999996,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56200000000000006,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.23799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.49399999999999999,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.28999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.77600000000000002,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77800000000000002,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69099999999999995,"15min":0.70299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77000000000000002,"5min":2.532,"15min":2.532},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72899999999999998,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.497,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.78300000000000003,"5min":2.496,"15min":2.496},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76200000000000001,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.40799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":311065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":1.0109999999999999,"15min":1.073},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.437}]},{"osd":7,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.625},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297948,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073892,"statfs":{"total":96636764160,"available":96331665408,"internally_reserved":0,"allocated":675840,"data_stored":310153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.38100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67400000000000004,"5min":1.167,"15min":1.167},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.44500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.117,"15min":1.117},"last":0.44},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.35499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":1.2,"15min":1.2},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.68899999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68400000000000005,"5min":1.135,"15min":1.135},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81599999999999995,"5min":1.208,"15min":1.208},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":0.87},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.89200000000000002,"5min":1.054,"15min":1.054},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.377,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.008},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:57:36.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:36.464 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:57:37.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:57:37.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.847+0000 7f8d22a9c700 1 Processor -- start 2023-10-06T02:57:37.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.847+0000 7f8d22a9c700 1 -- start start 2023-10-06T02:57:37.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.848+0000 7f8d22a9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d1c1595a0 0x7f8d1c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:37.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.848+0000 7f8d22a9c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 0x7f8d1c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.848+0000 7f8d22a9c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8d1c0b07a0 0x7f8d1c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.848+0000 7f8d22a9c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c0b0ca0 con 0x7f8d1c1595a0 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.848+0000 7f8d22a9c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c0b0f80 con 0x7f8d1c0b07a0 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.848+0000 7f8d22a9c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c0b1260 con 0x7f8d1c0b49e0 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.848+0000 7f8d20838700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d1c1595a0 0x7f8d1c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.848+0000 7f8d20838700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d1c1595a0 0x7f8d1c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57932/0 (socket says 172.21.15.84:57932) 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.848+0000 7f8d20838700 1 -- 172.21.15.84:0/1365724844 learned_addr learned my addr 172.21.15.84:0/1365724844 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d13fff700 1 --2- 172.21.15.84:0/1365724844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 0x7f8d1c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d21039700 1 --2- 172.21.15.84:0/1365724844 >> v2:172.21.15.131:3300/0 conn(0x7f8d1c0b07a0 0x7f8d1c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d20838700 1 -- 172.21.15.84:0/1365724844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 msgr2=0x7f8d1c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:37.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d20838700 1 --2- 172.21.15.84:0/1365724844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 0x7f8d1c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d20838700 1 -- 172.21.15.84:0/1365724844 >> v2:172.21.15.131:3300/0 conn(0x7f8d1c0b07a0 msgr2=0x7f8d1c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d20838700 1 --2- 172.21.15.84:0/1365724844 >> v2:172.21.15.131:3300/0 conn(0x7f8d1c0b07a0 0x7f8d1c0b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d20838700 1 -- 172.21.15.84:0/1365724844 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c0b1540 con 0x7f8d1c1595a0 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d20838700 1 --2- 172.21.15.84:0/1365724844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 0x7f8d1c0aa570 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0d04a0 tx=0x7f8d18009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d5b48fb32df8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d137fe700 1 -- 172.21.15.84:0/1365724844 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18005c10 con 0x7f8d1c1595a0 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d137fe700 1 -- 172.21.15.84:0/1365724844 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d18005d70 con 0x7f8d1c1595a0 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d137fe700 1 -- 172.21.15.84:0/1365724844 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800b880 con 0x7f8d1c1595a0 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1365724844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 msgr2=0x7f8d1c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1365724844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 0x7f8d1c0aa570 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0d04a0 tx=0x7f8d18009220 comp rx=0 tx=0).stop 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1365724844 shutdown_connections 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1365724844 >> v2:172.21.15.131:3300/0 conn(0x7f8d1c0b07a0 0x7f8d1c0b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:37.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1365724844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 0x7f8d1c0aa570 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:37.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.849+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1365724844 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 0x7f8d1c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:37.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.850+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1365724844 >> 172.21.15.84:0/1365724844 conn(0x7f8d1c099830 msgr2=0x7f8d1c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:37.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.850+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1365724844 shutdown_connections 2023-10-06T02:57:37.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.850+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1365724844 wait complete. 2023-10-06T02:57:37.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.851+0000 7f8d22a9c700 1 Processor -- start 2023-10-06T02:57:37.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.851+0000 7f8d22a9c700 1 -- start start 2023-10-06T02:57:37.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d22a9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d1c0b07a0 0x7f8d1c156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d22a9c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 0x7f8d1c09d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d22a9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 0x7f8d1c0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d22a9c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c09ad40 con 0x7f8d1c1595a0 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d22a9c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c09a130 con 0x7f8d1c0b07a0 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d22a9c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c09a410 con 0x7f8d1c0b49e0 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d21039700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 0x7f8d1c0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d21039700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 0x7f8d1c0b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57940/0 (socket says 172.21.15.84:57940) 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d21039700 1 -- 172.21.15.84:0/1054724223 learned_addr learned my addr 172.21.15.84:0/1054724223 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d13fff700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 0x7f8d1c09d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d20838700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d1c0b07a0 0x7f8d1c156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d21039700 1 -- 172.21.15.84:0/1054724223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 msgr2=0x7f8d1c09d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d21039700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 0x7f8d1c09d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d21039700 1 -- 172.21.15.84:0/1054724223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d1c0b07a0 msgr2=0x7f8d1c156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d21039700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d1c0b07a0 0x7f8d1c156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d21039700 1 -- 172.21.15.84:0/1054724223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18009480 con 0x7f8d1c1595a0 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d21039700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 0x7f8d1c0b3270 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009fa0 tx=0x7f8d14009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d10ff9700 1 -- 172.21.15.84:0/1054724223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1400ebc0 con 0x7f8d1c1595a0 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d10ff9700 1 -- 172.21.15.84:0/1054724223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1400ed20 con 0x7f8d1c1595a0 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1c09a6f0 con 0x7f8d1c1595a0 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d10ff9700 1 -- 172.21.15.84:0/1054724223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14014670 con 0x7f8d1c1595a0 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.852+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c156f90 con 0x7f8d1c1595a0 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.853+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c09aef0 con 0x7f8d1c1595a0 2023-10-06T02:57:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.854+0000 7f8d10ff9700 1 -- 172.21.15.84:0/1054724223 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d140149e0 con 0x7f8d1c1595a0 2023-10-06T02:57:37.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.854+0000 7f8d10ff9700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d08066f30 0x7f8d080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:37.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.854+0000 7f8d10ff9700 1 -- 172.21.15.84:0/1054724223 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8d14084e30 con 0x7f8d1c1595a0 2023-10-06T02:57:37.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.854+0000 7f8d20838700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d08066f30 0x7f8d080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:37.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.854+0000 7f8d20838700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d08066f30 0x7f8d080693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009260 tx=0x7f8d18016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:37.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:37.858+0000 7f8d10ff9700 1 -- 172.21.15.84:0/1054724223 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d1c09aef0 con 0x7f8d1c1595a0 2023-10-06T02:57:38.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.036+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d1c064ad0 con 0x7f8d08066f30 2023-10-06T02:57:38.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.045+0000 7f8d10ff9700 1 -- 172.21.15.84:0/1054724223 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311422 (secure 0 0 0) 0x7f8d1c064ad0 con 0x7f8d08066f30 2023-10-06T02:57:38.052 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:38.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d08066f30 msgr2=0x7f8d080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d08066f30 0x7f8d080693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009260 tx=0x7f8d18016000 comp rx=0 tx=0).stop 2023-10-06T02:57:38.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 msgr2=0x7f8d1c0b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 0x7f8d1c0b3270 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009fa0 tx=0x7f8d14009900 comp rx=0 tx=0).stop 2023-10-06T02:57:38.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 shutdown_connections 2023-10-06T02:57:38.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d08066f30 0x7f8d080693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d1c0b07a0 0x7f8d1c156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d1c1595a0 0x7f8d1c0b3270 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 --2- 172.21.15.84:0/1054724223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8d1c0b49e0 0x7f8d1c09d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 >> 172.21.15.84:0/1054724223 conn(0x7f8d1c099830 msgr2=0x7f8d1c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:38.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 shutdown_connections 2023-10-06T02:57:38.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.048+0000 7f8d22a9c700 1 -- 172.21.15.84:0/1054724223 wait complete. 2023-10-06T02:57:38.056 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:57:38.061 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-10-06T02:57:37.835326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384732,"kb_used_data":6428,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589988,"statfs":{"total":773094113280,"available":770652147712,"internally_reserved":0,"allocated":6582272,"data_stored":3658547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.694202"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165677+0000","last_change":"2023-10-06T02:57:29.159693+0000","last_active":"2023-10-06T02:57:29.165677+0000","last_peered":"2023-10-06T02:57:29.165677+0000","last_clean":"2023-10-06T02:57:29.165677+0000","last_became_active":"2023-10-06T02:57:29.159469+0000","last_became_peered":"2023-10-06T02:57:29.159469+0000","last_unstale":"2023-10-06T02:57:29.165677+0000","last_undegraded":"2023-10-06T02:57:29.165677+0000","last_fullsized":"2023-10-06T02:57:29.165677+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:37.148715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157359+0000","last_change":"2023-10-06T02:57:29.152975+0000","last_active":"2023-10-06T02:57:29.157359+0000","last_peered":"2023-10-06T02:57:29.157359+0000","last_clean":"2023-10-06T02:57:29.157359+0000","last_became_active":"2023-10-06T02:57:29.152728+0000","last_became_peered":"2023-10-06T02:57:29.152728+0000","last_unstale":"2023-10-06T02:57:29.157359+0000","last_undegraded":"2023-10-06T02:57:29.157359+0000","last_fullsized":"2023-10-06T02:57:29.157359+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:51.466721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170492+0000","last_change":"2023-10-06T02:57:29.166875+0000","last_active":"2023-10-06T02:57:29.170492+0000","last_peered":"2023-10-06T02:57:29.170492+0000","last_clean":"2023-10-06T02:57:29.170492+0000","last_became_active":"2023-10-06T02:57:29.166606+0000","last_became_peered":"2023-10-06T02:57:29.166606+0000","last_unstale":"2023-10-06T02:57:29.170492+0000","last_undegraded":"2023-10-06T02:57:29.170492+0000","last_fullsized":"2023-10-06T02:57:29.170492+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:01.634204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161080+0000","last_change":"2023-10-06T02:57:29.157387+0000","last_active":"2023-10-06T02:57:29.161080+0000","last_peered":"2023-10-06T02:57:29.161080+0000","last_clean":"2023-10-06T02:57:29.161080+0000","last_became_active":"2023-10-06T02:57:29.157093+0000","last_became_peered":"2023-10-06T02:57:29.157093+0000","last_unstale":"2023-10-06T02:57:29.161080+0000","last_undegraded":"2023-10-06T02:57:29.161080+0000","last_fullsized":"2023-10-06T02:57:29.161080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168600+0000","last_change":"2023-10-06T02:57:29.162615+0000","last_active":"2023-10-06T02:57:29.168600+0000","last_peered":"2023-10-06T02:57:29.168600+0000","last_clean":"2023-10-06T02:57:29.168600+0000","last_became_active":"2023-10-06T02:57:29.162354+0000","last_became_peered":"2023-10-06T02:57:29.162354+0000","last_unstale":"2023-10-06T02:57:29.168600+0000","last_undegraded":"2023-10-06T02:57:29.168600+0000","last_fullsized":"2023-10-06T02:57:29.168600+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:30.271330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165266+0000","last_change":"2023-10-06T02:57:29.154923+0000","last_active":"2023-10-06T02:57:29.165266+0000","last_peered":"2023-10-06T02:57:29.165266+0000","last_clean":"2023-10-06T02:57:29.165266+0000","last_became_active":"2023-10-06T02:57:29.153381+0000","last_became_peered":"2023-10-06T02:57:29.153381+0000","last_unstale":"2023-10-06T02:57:29.165266+0000","last_undegraded":"2023-10-06T02:57:29.165266+0000","last_fullsized":"2023-10-06T02:57:29.165266+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:54.010722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168976+0000","last_change":"2023-10-06T02:57:29.163260+0000","last_active":"2023-10-06T02:57:29.168976+0000","last_peered":"2023-10-06T02:57:29.168976+0000","last_clean":"2023-10-06T02:57:29.168976+0000","last_became_active":"2023-10-06T02:57:29.162996+0000","last_became_peered":"2023-10-06T02:57:29.162996+0000","last_unstale":"2023-10-06T02:57:29.168976+0000","last_undegraded":"2023-10-06T02:57:29.168976+0000","last_fullsized":"2023-10-06T02:57:29.168976+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:44.291549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175383+0000","last_change":"2023-10-06T02:57:29.170539+0000","last_active":"2023-10-06T02:57:29.175383+0000","last_peered":"2023-10-06T02:57:29.175383+0000","last_clean":"2023-10-06T02:57:29.175383+0000","last_became_active":"2023-10-06T02:57:29.170262+0000","last_became_peered":"2023-10-06T02:57:29.170262+0000","last_unstale":"2023-10-06T02:57:29.175383+0000","last_undegraded":"2023-10-06T02:57:29.175383+0000","last_fullsized":"2023-10-06T02:57:29.175383+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:20.249704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175960+0000","last_change":"2023-10-06T02:57:29.168884+0000","last_active":"2023-10-06T02:57:29.175960+0000","last_peered":"2023-10-06T02:57:29.175960+0000","last_clean":"2023-10-06T02:57:29.175960+0000","last_became_active":"2023-10-06T02:57:29.168677+0000","last_became_peered":"2023-10-06T02:57:29.168677+0000","last_unstale":"2023-10-06T02:57:29.175960+0000","last_undegraded":"2023-10-06T02:57:29.175960+0000","last_fullsized":"2023-10-06T02:57:29.175960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:58.527683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.162865+0000","last_change":"2023-10-06T02:57:29.159920+0000","last_active":"2023-10-06T02:57:29.162865+0000","last_peered":"2023-10-06T02:57:29.162865+0000","last_clean":"2023-10-06T02:57:29.162865+0000","last_became_active":"2023-10-06T02:57:29.159668+0000","last_became_peered":"2023-10-06T02:57:29.159668+0000","last_unstale":"2023-10-06T02:57:29.162865+0000","last_undegraded":"2023-10-06T02:57:29.162865+0000","last_fullsized":"2023-10-06T02:57:29.162865+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:48:37.837660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172716+0000","last_change":"2023-10-06T02:57:29.169149+0000","last_active":"2023-10-06T02:57:29.172716+0000","last_peered":"2023-10-06T02:57:29.172716+0000","last_clean":"2023-10-06T02:57:29.172716+0000","last_became_active":"2023-10-06T02:57:29.168899+0000","last_became_peered":"2023-10-06T02:57:29.168899+0000","last_unstale":"2023-10-06T02:57:29.172716+0000","last_undegraded":"2023-10-06T02:57:29.172716+0000","last_fullsized":"2023-10-06T02:57:29.172716+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:35:35.526924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163216+0000","last_change":"2023-10-06T02:57:29.160084+0000","last_active":"2023-10-06T02:57:29.163216+0000","last_peered":"2023-10-06T02:57:29.163216+0000","last_clean":"2023-10-06T02:57:29.163216+0000","last_became_active":"2023-10-06T02:57:29.159823+0000","last_became_peered":"2023-10-06T02:57:29.159823+0000","last_unstale":"2023-10-06T02:57:29.163216+0000","last_undegraded":"2023-10-06T02:57:29.163216+0000","last_fullsized":"2023-10-06T02:57:29.163216+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.173580+0000","last_change":"2023-10-06T02:57:29.168630+0000","last_active":"2023-10-06T02:57:29.173580+0000","last_peered":"2023-10-06T02:57:29.173580+0000","last_clean":"2023-10-06T02:57:29.173580+0000","last_became_active":"2023-10-06T02:57:29.168373+0000","last_became_peered":"2023-10-06T02:57:29.168373+0000","last_unstale":"2023-10-06T02:57:29.173580+0000","last_undegraded":"2023-10-06T02:57:29.173580+0000","last_fullsized":"2023-10-06T02:57:29.173580+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:49.049605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169050+0000","last_change":"2023-10-06T02:57:29.164304+0000","last_active":"2023-10-06T02:57:29.169050+0000","last_peered":"2023-10-06T02:57:29.169050+0000","last_clean":"2023-10-06T02:57:29.169050+0000","last_became_active":"2023-10-06T02:57:29.163293+0000","last_became_peered":"2023-10-06T02:57:29.163293+0000","last_unstale":"2023-10-06T02:57:29.169050+0000","last_undegraded":"2023-10-06T02:57:29.169050+0000","last_fullsized":"2023-10-06T02:57:29.169050+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168995+0000","last_change":"2023-10-06T02:57:29.164093+0000","last_active":"2023-10-06T02:57:29.168995+0000","last_peered":"2023-10-06T02:57:29.168995+0000","last_clean":"2023-10-06T02:57:29.168995+0000","last_became_active":"2023-10-06T02:57:29.162936+0000","last_became_peered":"2023-10-06T02:57:29.162936+0000","last_unstale":"2023-10-06T02:57:29.168995+0000","last_undegraded":"2023-10-06T02:57:29.168995+0000","last_fullsized":"2023-10-06T02:57:29.168995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:49.829140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172261+0000","last_change":"2023-10-06T02:57:29.168216+0000","last_active":"2023-10-06T02:57:29.172261+0000","last_peered":"2023-10-06T02:57:29.172261+0000","last_clean":"2023-10-06T02:57:29.172261+0000","last_became_active":"2023-10-06T02:57:29.167959+0000","last_became_peered":"2023-10-06T02:57:29.167959+0000","last_unstale":"2023-10-06T02:57:29.172261+0000","last_undegraded":"2023-10-06T02:57:29.172261+0000","last_fullsized":"2023-10-06T02:57:29.172261+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:22.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170283+0000","last_change":"2023-10-06T02:57:29.163607+0000","last_active":"2023-10-06T02:57:29.170283+0000","last_peered":"2023-10-06T02:57:29.170283+0000","last_clean":"2023-10-06T02:57:29.170283+0000","last_became_active":"2023-10-06T02:57:29.163324+0000","last_became_peered":"2023-10-06T02:57:29.163324+0000","last_unstale":"2023-10-06T02:57:29.170283+0000","last_undegraded":"2023-10-06T02:57:29.170283+0000","last_fullsized":"2023-10-06T02:57:29.170283+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:28:22.432485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169338+0000","last_change":"2023-10-06T02:57:29.159474+0000","last_active":"2023-10-06T02:57:29.169338+0000","last_peered":"2023-10-06T02:57:29.169338+0000","last_clean":"2023-10-06T02:57:29.169338+0000","last_became_active":"2023-10-06T02:57:29.159225+0000","last_became_peered":"2023-10-06T02:57:29.159225+0000","last_unstale":"2023-10-06T02:57:29.169338+0000","last_undegraded":"2023-10-06T02:57:29.169338+0000","last_fullsized":"2023-10-06T02:57:29.169338+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:21.534628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165913+0000","last_change":"2023-10-06T02:57:29.159191+0000","last_active":"2023-10-06T02:57:29.165913+0000","last_peered":"2023-10-06T02:57:29.165913+0000","last_clean":"2023-10-06T02:57:29.165913+0000","last_became_active":"2023-10-06T02:57:29.159012+0000","last_became_peered":"2023-10-06T02:57:29.159012+0000","last_unstale":"2023-10-06T02:57:29.165913+0000","last_undegraded":"2023-10-06T02:57:29.165913+0000","last_fullsized":"2023-10-06T02:57:29.165913+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:40:48.035244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.164401+0000","last_change":"2023-10-06T02:57:29.156281+0000","last_active":"2023-10-06T02:57:29.164401+0000","last_peered":"2023-10-06T02:57:29.164401+0000","last_clean":"2023-10-06T02:57:29.164401+0000","last_became_active":"2023-10-06T02:57:29.156042+0000","last_became_peered":"2023-10-06T02:57:29.156042+0000","last_unstale":"2023-10-06T02:57:29.164401+0000","last_undegraded":"2023-10-06T02:57:29.164401+0000","last_fullsized":"2023-10-06T02:57:29.164401+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:28.748475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.167987+0000","last_change":"2023-10-06T02:57:29.158339+0000","last_active":"2023-10-06T02:57:29.167987+0000","last_peered":"2023-10-06T02:57:29.167987+0000","last_clean":"2023-10-06T02:57:29.167987+0000","last_became_active":"2023-10-06T02:57:29.158061+0000","last_became_peered":"2023-10-06T02:57:29.158061+0000","last_unstale":"2023-10-06T02:57:29.167987+0000","last_undegraded":"2023-10-06T02:57:29.167987+0000","last_fullsized":"2023-10-06T02:57:29.167987+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157500+0000","last_change":"2023-10-06T02:57:29.154424+0000","last_active":"2023-10-06T02:57:29.157500+0000","last_peered":"2023-10-06T02:57:29.157500+0000","last_clean":"2023-10-06T02:57:29.157500+0000","last_became_active":"2023-10-06T02:57:29.154181+0000","last_became_peered":"2023-10-06T02:57:29.154181+0000","last_unstale":"2023-10-06T02:57:29.157500+0000","last_undegraded":"2023-10-06T02:57:29.157500+0000","last_fullsized":"2023-10-06T02:57:29.157500+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:33.824959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169436+0000","last_change":"2023-10-06T02:57:29.160645+0000","last_active":"2023-10-06T02:57:29.169436+0000","last_peered":"2023-10-06T02:57:29.169436+0000","last_clean":"2023-10-06T02:57:29.169436+0000","last_became_active":"2023-10-06T02:57:29.160178+0000","last_became_peered":"2023-10-06T02:57:29.160178+0000","last_unstale":"2023-10-06T02:57:29.169436+0000","last_undegraded":"2023-10-06T02:57:29.169436+0000","last_fullsized":"2023-10-06T02:57:29.169436+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.173573+0000","last_change":"2023-10-06T02:57:29.168580+0000","last_active":"2023-10-06T02:57:29.173573+0000","last_peered":"2023-10-06T02:57:29.173573+0000","last_clean":"2023-10-06T02:57:29.173573+0000","last_became_active":"2023-10-06T02:57:29.168310+0000","last_became_peered":"2023-10-06T02:57:29.168310+0000","last_unstale":"2023-10-06T02:57:29.173573+0000","last_undegraded":"2023-10-06T02:57:29.173573+0000","last_fullsized":"2023-10-06T02:57:29.173573+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:41.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163459+0000","last_change":"2023-10-06T02:57:29.157101+0000","last_active":"2023-10-06T02:57:29.163459+0000","last_peered":"2023-10-06T02:57:29.163459+0000","last_clean":"2023-10-06T02:57:29.163459+0000","last_became_active":"2023-10-06T02:57:29.156829+0000","last_became_peered":"2023-10-06T02:57:29.156829+0000","last_unstale":"2023-10-06T02:57:29.163459+0000","last_undegraded":"2023-10-06T02:57:29.163459+0000","last_fullsized":"2023-10-06T02:57:29.163459+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:41.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169559+0000","last_change":"2023-10-06T02:57:29.164996+0000","last_active":"2023-10-06T02:57:29.169559+0000","last_peered":"2023-10-06T02:57:29.169559+0000","last_clean":"2023-10-06T02:57:29.169559+0000","last_became_active":"2023-10-06T02:57:29.164679+0000","last_became_peered":"2023-10-06T02:57:29.164679+0000","last_unstale":"2023-10-06T02:57:29.169559+0000","last_undegraded":"2023-10-06T02:57:29.169559+0000","last_fullsized":"2023-10-06T02:57:29.169559+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:06:24.881118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172324+0000","last_change":"2023-10-06T02:57:29.168679+0000","last_active":"2023-10-06T02:57:29.172324+0000","last_peered":"2023-10-06T02:57:29.172324+0000","last_clean":"2023-10-06T02:57:29.172324+0000","last_became_active":"2023-10-06T02:57:29.168426+0000","last_became_peered":"2023-10-06T02:57:29.168426+0000","last_unstale":"2023-10-06T02:57:29.172324+0000","last_undegraded":"2023-10-06T02:57:29.172324+0000","last_fullsized":"2023-10-06T02:57:29.172324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:20.249704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.155897+0000","last_change":"2023-10-06T02:57:29.151549+0000","last_active":"2023-10-06T02:57:29.155897+0000","last_peered":"2023-10-06T02:57:29.155897+0000","last_clean":"2023-10-06T02:57:29.155897+0000","last_became_active":"2023-10-06T02:57:29.151181+0000","last_became_peered":"2023-10-06T02:57:29.151181+0000","last_unstale":"2023-10-06T02:57:29.155897+0000","last_undegraded":"2023-10-06T02:57:29.155897+0000","last_fullsized":"2023-10-06T02:57:29.155897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:06.133045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.164949+0000","last_change":"2023-10-06T02:57:29.158104+0000","last_active":"2023-10-06T02:57:29.164949+0000","last_peered":"2023-10-06T02:57:29.164949+0000","last_clean":"2023-10-06T02:57:29.164949+0000","last_became_active":"2023-10-06T02:57:29.157801+0000","last_became_peered":"2023-10-06T02:57:29.157801+0000","last_unstale":"2023-10-06T02:57:29.164949+0000","last_undegraded":"2023-10-06T02:57:29.164949+0000","last_fullsized":"2023-10-06T02:57:29.164949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:15.012510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170380+0000","last_change":"2023-10-06T02:57:29.167425+0000","last_active":"2023-10-06T02:57:29.170380+0000","last_peered":"2023-10-06T02:57:29.170380+0000","last_clean":"2023-10-06T02:57:29.170380+0000","last_became_active":"2023-10-06T02:57:29.167207+0000","last_became_peered":"2023-10-06T02:57:29.167207+0000","last_unstale":"2023-10-06T02:57:29.170380+0000","last_undegraded":"2023-10-06T02:57:29.170380+0000","last_fullsized":"2023-10-06T02:57:29.170380+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:01.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.156443+0000","last_change":"2023-10-06T02:57:29.154381+0000","last_active":"2023-10-06T02:57:29.156443+0000","last_peered":"2023-10-06T02:57:29.156443+0000","last_clean":"2023-10-06T02:57:29.156443+0000","last_became_active":"2023-10-06T02:57:29.154008+0000","last_became_peered":"2023-10-06T02:57:29.154008+0000","last_unstale":"2023-10-06T02:57:29.156443+0000","last_undegraded":"2023-10-06T02:57:29.156443+0000","last_fullsized":"2023-10-06T02:57:29.156443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:49.049605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168315+0000","last_change":"2023-10-06T02:57:29.158071+0000","last_active":"2023-10-06T02:57:29.168315+0000","last_peered":"2023-10-06T02:57:29.168315+0000","last_clean":"2023-10-06T02:57:29.168315+0000","last_became_active":"2023-10-06T02:57:29.157887+0000","last_became_peered":"2023-10-06T02:57:29.157887+0000","last_unstale":"2023-10-06T02:57:29.168315+0000","last_undegraded":"2023-10-06T02:57:29.168315+0000","last_fullsized":"2023-10-06T02:57:29.168315+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:33.041583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168319+0000","last_change":"2023-10-06T02:57:29.161075+0000","last_active":"2023-10-06T02:57:29.168319+0000","last_peered":"2023-10-06T02:57:29.168319+0000","last_clean":"2023-10-06T02:57:29.168319+0000","last_became_active":"2023-10-06T02:57:29.160817+0000","last_became_peered":"2023-10-06T02:57:29.160817+0000","last_unstale":"2023-10-06T02:57:29.168319+0000","last_undegraded":"2023-10-06T02:57:29.168319+0000","last_fullsized":"2023-10-06T02:57:29.168319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'4","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.179503+0000","last_change":"2023-10-06T02:57:28.154223+0000","last_active":"2023-10-06T02:57:29.179503+0000","last_peered":"2023-10-06T02:57:29.179503+0000","last_clean":"2023-10-06T02:57:29.179503+0000","last_became_active":"2023-10-06T02:57:28.153990+0000","last_became_peered":"2023-10-06T02:57:28.153990+0000","last_unstale":"2023-10-06T02:57:29.179503+0000","last_undegraded":"2023-10-06T02:57:29.179503+0000","last_fullsized":"2023-10-06T02:57:29.179503+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:12.546662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169310+0000","last_change":"2023-10-06T02:57:29.163438+0000","last_active":"2023-10-06T02:57:29.169310+0000","last_peered":"2023-10-06T02:57:29.169310+0000","last_clean":"2023-10-06T02:57:29.169310+0000","last_became_active":"2023-10-06T02:57:29.158549+0000","last_became_peered":"2023-10-06T02:57:29.158549+0000","last_unstale":"2023-10-06T02:57:29.169310+0000","last_undegraded":"2023-10-06T02:57:29.169310+0000","last_fullsized":"2023-10-06T02:57:29.169310+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:11.314856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176350+0000","last_change":"2023-10-06T02:57:28.160875+0000","last_active":"2023-10-06T02:57:29.176350+0000","last_peered":"2023-10-06T02:57:29.176350+0000","last_clean":"2023-10-06T02:57:29.176350+0000","last_became_active":"2023-10-06T02:57:28.160629+0000","last_became_peered":"2023-10-06T02:57:28.160629+0000","last_unstale":"2023-10-06T02:57:29.176350+0000","last_undegraded":"2023-10-06T02:57:29.176350+0000","last_fullsized":"2023-10-06T02:57:29.176350+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168188+0000","last_change":"2023-10-06T02:57:29.157464+0000","last_active":"2023-10-06T02:57:29.168188+0000","last_peered":"2023-10-06T02:57:29.168188+0000","last_clean":"2023-10-06T02:57:29.168188+0000","last_became_active":"2023-10-06T02:57:29.157219+0000","last_became_peered":"2023-10-06T02:57:29.157219+0000","last_unstale":"2023-10-06T02:57:29.168188+0000","last_undegraded":"2023-10-06T02:57:29.168188+0000","last_fullsized":"2023-10-06T02:57:29.168188+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:49.829140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176172+0000","last_change":"2023-10-06T02:57:28.154910+0000","last_active":"2023-10-06T02:57:29.176172+0000","last_peered":"2023-10-06T02:57:29.176172+0000","last_clean":"2023-10-06T02:57:29.176172+0000","last_became_active":"2023-10-06T02:57:28.154656+0000","last_became_peered":"2023-10-06T02:57:28.154656+0000","last_unstale":"2023-10-06T02:57:29.176172+0000","last_undegraded":"2023-10-06T02:57:29.176172+0000","last_fullsized":"2023-10-06T02:57:29.176172+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168622+0000","last_change":"2023-10-06T02:57:29.162359+0000","last_active":"2023-10-06T02:57:29.168622+0000","last_peered":"2023-10-06T02:57:29.168622+0000","last_clean":"2023-10-06T02:57:29.168622+0000","last_became_active":"2023-10-06T02:57:29.162140+0000","last_became_peered":"2023-10-06T02:57:29.162140+0000","last_unstale":"2023-10-06T02:57:29.168622+0000","last_undegraded":"2023-10-06T02:57:29.168622+0000","last_fullsized":"2023-10-06T02:57:29.168622+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:44.291549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.173802+0000","last_change":"2023-10-06T02:57:28.158739+0000","last_active":"2023-10-06T02:57:29.173802+0000","last_peered":"2023-10-06T02:57:29.173802+0000","last_clean":"2023-10-06T02:57:29.173802+0000","last_became_active":"2023-10-06T02:57:28.158477+0000","last_became_peered":"2023-10-06T02:57:28.158477+0000","last_unstale":"2023-10-06T02:57:29.173802+0000","last_undegraded":"2023-10-06T02:57:29.173802+0000","last_fullsized":"2023-10-06T02:57:29.173802+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:29.634384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168293+0000","last_change":"2023-10-06T02:57:29.164378+0000","last_active":"2023-10-06T02:57:29.168293+0000","last_peered":"2023-10-06T02:57:29.168293+0000","last_clean":"2023-10-06T02:57:29.168293+0000","last_became_active":"2023-10-06T02:57:29.156693+0000","last_became_peered":"2023-10-06T02:57:29.156693+0000","last_unstale":"2023-10-06T02:57:29.168293+0000","last_undegraded":"2023-10-06T02:57:29.168293+0000","last_fullsized":"2023-10-06T02:57:29.168293+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:01:26.397679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169348+0000","last_change":"2023-10-06T02:57:28.154727+0000","last_active":"2023-10-06T02:57:29.169348+0000","last_peered":"2023-10-06T02:57:29.169348+0000","last_clean":"2023-10-06T02:57:29.169348+0000","last_became_active":"2023-10-06T02:57:28.154457+0000","last_became_peered":"2023-10-06T02:57:28.154457+0000","last_unstale":"2023-10-06T02:57:29.169348+0000","last_undegraded":"2023-10-06T02:57:29.169348+0000","last_fullsized":"2023-10-06T02:57:29.169348+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:00.628842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157671+0000","last_change":"2023-10-06T02:57:29.154297+0000","last_active":"2023-10-06T02:57:29.157671+0000","last_peered":"2023-10-06T02:57:29.157671+0000","last_clean":"2023-10-06T02:57:29.157671+0000","last_became_active":"2023-10-06T02:57:29.154053+0000","last_became_peered":"2023-10-06T02:57:29.154053+0000","last_unstale":"2023-10-06T02:57:29.157671+0000","last_undegraded":"2023-10-06T02:57:29.157671+0000","last_fullsized":"2023-10-06T02:57:29.157671+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:07.324323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176991+0000","last_change":"2023-10-06T02:57:28.156466+0000","last_active":"2023-10-06T02:57:29.176991+0000","last_peered":"2023-10-06T02:57:29.176991+0000","last_clean":"2023-10-06T02:57:29.176991+0000","last_became_active":"2023-10-06T02:57:28.156258+0000","last_became_peered":"2023-10-06T02:57:28.156258+0000","last_unstale":"2023-10-06T02:57:29.176991+0000","last_undegraded":"2023-10-06T02:57:29.176991+0000","last_fullsized":"2023-10-06T02:57:29.176991+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:02.075540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163036+0000","last_change":"2023-10-06T02:57:29.159827+0000","last_active":"2023-10-06T02:57:29.163036+0000","last_peered":"2023-10-06T02:57:29.163036+0000","last_clean":"2023-10-06T02:57:29.163036+0000","last_became_active":"2023-10-06T02:57:29.159543+0000","last_became_peered":"2023-10-06T02:57:29.159543+0000","last_unstale":"2023-10-06T02:57:29.163036+0000","last_undegraded":"2023-10-06T02:57:29.163036+0000","last_fullsized":"2023-10-06T02:57:29.163036+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:30.271330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147822+0000","last_change":"2023-10-06T02:57:28.154919+0000","last_active":"2023-10-06T02:57:29.147822+0000","last_peered":"2023-10-06T02:57:29.147822+0000","last_clean":"2023-10-06T02:57:29.147822+0000","last_became_active":"2023-10-06T02:57:28.154620+0000","last_became_peered":"2023-10-06T02:57:28.154620+0000","last_unstale":"2023-10-06T02:57:29.147822+0000","last_undegraded":"2023-10-06T02:57:29.147822+0000","last_fullsized":"2023-10-06T02:57:29.147822+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:27.029195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175549+0000","last_change":"2023-10-06T02:57:29.168450+0000","last_active":"2023-10-06T02:57:29.175549+0000","last_peered":"2023-10-06T02:57:29.175549+0000","last_clean":"2023-10-06T02:57:29.175549+0000","last_became_active":"2023-10-06T02:57:29.162935+0000","last_became_peered":"2023-10-06T02:57:29.162935+0000","last_unstale":"2023-10-06T02:57:29.175549+0000","last_undegraded":"2023-10-06T02:57:29.175549+0000","last_fullsized":"2023-10-06T02:57:29.175549+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:40.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.153192+0000","last_change":"2023-10-06T02:57:28.154846+0000","last_active":"2023-10-06T02:57:29.153192+0000","last_peered":"2023-10-06T02:57:29.153192+0000","last_clean":"2023-10-06T02:57:29.153192+0000","last_became_active":"2023-10-06T02:57:28.154580+0000","last_became_peered":"2023-10-06T02:57:28.154580+0000","last_unstale":"2023-10-06T02:57:29.153192+0000","last_undegraded":"2023-10-06T02:57:29.153192+0000","last_fullsized":"2023-10-06T02:57:29.153192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168676+0000","last_change":"2023-10-06T02:57:29.164564+0000","last_active":"2023-10-06T02:57:29.168676+0000","last_peered":"2023-10-06T02:57:29.168676+0000","last_clean":"2023-10-06T02:57:29.168676+0000","last_became_active":"2023-10-06T02:57:29.164307+0000","last_became_peered":"2023-10-06T02:57:29.164307+0000","last_unstale":"2023-10-06T02:57:29.168676+0000","last_undegraded":"2023-10-06T02:57:29.168676+0000","last_fullsized":"2023-10-06T02:57:29.168676+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:15.152388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147830+0000","last_change":"2023-10-06T02:57:28.162028+0000","last_active":"2023-10-06T02:57:29.147830+0000","last_peered":"2023-10-06T02:57:29.147830+0000","last_clean":"2023-10-06T02:57:29.147830+0000","last_became_active":"2023-10-06T02:57:28.161784+0000","last_became_peered":"2023-10-06T02:57:28.161784+0000","last_unstale":"2023-10-06T02:57:29.147830+0000","last_undegraded":"2023-10-06T02:57:29.147830+0000","last_fullsized":"2023-10-06T02:57:29.147830+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:10:22.612517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.167888+0000","last_change":"2023-10-06T02:57:29.157912+0000","last_active":"2023-10-06T02:57:29.167888+0000","last_peered":"2023-10-06T02:57:29.167888+0000","last_clean":"2023-10-06T02:57:29.167888+0000","last_became_active":"2023-10-06T02:57:29.157687+0000","last_became_peered":"2023-10-06T02:57:29.157687+0000","last_unstale":"2023-10-06T02:57:29.167888+0000","last_undegraded":"2023-10-06T02:57:29.167888+0000","last_fullsized":"2023-10-06T02:57:29.167888+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:31.972353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.143197+0000","last_change":"2023-10-06T02:57:28.158578+0000","last_active":"2023-10-06T02:57:29.143197+0000","last_peered":"2023-10-06T02:57:29.143197+0000","last_clean":"2023-10-06T02:57:29.143197+0000","last_became_active":"2023-10-06T02:57:28.158361+0000","last_became_peered":"2023-10-06T02:57:28.158361+0000","last_unstale":"2023-10-06T02:57:29.143197+0000","last_undegraded":"2023-10-06T02:57:29.143197+0000","last_fullsized":"2023-10-06T02:57:29.143197+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:43.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169297+0000","last_change":"2023-10-06T02:57:29.163257+0000","last_active":"2023-10-06T02:57:29.169297+0000","last_peered":"2023-10-06T02:57:29.169297+0000","last_clean":"2023-10-06T02:57:29.169297+0000","last_became_active":"2023-10-06T02:57:29.163013+0000","last_became_peered":"2023-10-06T02:57:29.163013+0000","last_unstale":"2023-10-06T02:57:29.169297+0000","last_undegraded":"2023-10-06T02:57:29.169297+0000","last_fullsized":"2023-10-06T02:57:29.169297+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:14:18.662383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176092+0000","last_change":"2023-10-06T02:57:28.162959+0000","last_active":"2023-10-06T02:57:29.176092+0000","last_peered":"2023-10-06T02:57:29.176092+0000","last_clean":"2023-10-06T02:57:29.176092+0000","last_became_active":"2023-10-06T02:57:28.162660+0000","last_became_peered":"2023-10-06T02:57:28.162660+0000","last_unstale":"2023-10-06T02:57:29.176092+0000","last_undegraded":"2023-10-06T02:57:29.176092+0000","last_fullsized":"2023-10-06T02:57:29.176092+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:55:32.327057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170473+0000","last_change":"2023-10-06T02:57:29.162522+0000","last_active":"2023-10-06T02:57:29.170473+0000","last_peered":"2023-10-06T02:57:29.170473+0000","last_clean":"2023-10-06T02:57:29.170473+0000","last_became_active":"2023-10-06T02:57:29.162186+0000","last_became_peered":"2023-10-06T02:57:29.162186+0000","last_unstale":"2023-10-06T02:57:29.170473+0000","last_undegraded":"2023-10-06T02:57:29.170473+0000","last_fullsized":"2023-10-06T02:57:29.170473+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:47.477179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'6","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.178971+0000","last_change":"2023-10-06T02:57:28.155523+0000","last_active":"2023-10-06T02:57:29.178971+0000","last_peered":"2023-10-06T02:57:29.178971+0000","last_clean":"2023-10-06T02:57:29.178971+0000","last_became_active":"2023-10-06T02:57:28.155251+0000","last_became_peered":"2023-10-06T02:57:28.155251+0000","last_unstale":"2023-10-06T02:57:29.178971+0000","last_undegraded":"2023-10-06T02:57:29.178971+0000","last_fullsized":"2023-10-06T02:57:29.178971+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161062+0000","last_change":"2023-10-06T02:57:29.157777+0000","last_active":"2023-10-06T02:57:29.161062+0000","last_peered":"2023-10-06T02:57:29.161062+0000","last_clean":"2023-10-06T02:57:29.161062+0000","last_became_active":"2023-10-06T02:57:29.157437+0000","last_became_peered":"2023-10-06T02:57:29.157437+0000","last_unstale":"2023-10-06T02:57:29.161062+0000","last_undegraded":"2023-10-06T02:57:29.161062+0000","last_fullsized":"2023-10-06T02:57:29.161062+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.177436+0000","last_change":"2023-10-06T02:57:28.160083+0000","last_active":"2023-10-06T02:57:29.177436+0000","last_peered":"2023-10-06T02:57:29.177436+0000","last_clean":"2023-10-06T02:57:29.177436+0000","last_became_active":"2023-10-06T02:57:28.158968+0000","last_became_peered":"2023-10-06T02:57:28.158968+0000","last_unstale":"2023-10-06T02:57:29.177436+0000","last_undegraded":"2023-10-06T02:57:29.177436+0000","last_fullsized":"2023-10-06T02:57:29.177436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.529266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169518+0000","last_change":"2023-10-06T02:57:29.161672+0000","last_active":"2023-10-06T02:57:29.169518+0000","last_peered":"2023-10-06T02:57:29.169518+0000","last_clean":"2023-10-06T02:57:29.169518+0000","last_became_active":"2023-10-06T02:57:29.161419+0000","last_became_peered":"2023-10-06T02:57:29.161419+0000","last_unstale":"2023-10-06T02:57:29.169518+0000","last_undegraded":"2023-10-06T02:57:29.169518+0000","last_fullsized":"2023-10-06T02:57:29.169518+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:24.580249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154494+0000","last_change":"2023-10-06T02:57:28.157931+0000","last_active":"2023-10-06T02:57:29.154494+0000","last_peered":"2023-10-06T02:57:29.154494+0000","last_clean":"2023-10-06T02:57:29.154494+0000","last_became_active":"2023-10-06T02:57:28.157645+0000","last_became_peered":"2023-10-06T02:57:28.157645+0000","last_unstale":"2023-10-06T02:57:29.154494+0000","last_undegraded":"2023-10-06T02:57:29.154494+0000","last_fullsized":"2023-10-06T02:57:29.154494+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:02.718807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.165639+0000","last_change":"2023-10-06T02:57:29.160639+0000","last_active":"2023-10-06T02:57:29.165639+0000","last_peered":"2023-10-06T02:57:29.165639+0000","last_clean":"2023-10-06T02:57:29.165639+0000","last_became_active":"2023-10-06T02:57:29.160386+0000","last_became_peered":"2023-10-06T02:57:29.160386+0000","last_unstale":"2023-10-06T02:57:29.165639+0000","last_undegraded":"2023-10-06T02:57:29.165639+0000","last_fullsized":"2023-10-06T02:57:29.165639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:11:54.010722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147731+0000","last_change":"2023-10-06T02:57:28.160747+0000","last_active":"2023-10-06T02:57:29.147731+0000","last_peered":"2023-10-06T02:57:29.147731+0000","last_clean":"2023-10-06T02:57:29.147731+0000","last_became_active":"2023-10-06T02:57:28.160491+0000","last_became_peered":"2023-10-06T02:57:28.160491+0000","last_unstale":"2023-10-06T02:57:29.147731+0000","last_undegraded":"2023-10-06T02:57:29.147731+0000","last_fullsized":"2023-10-06T02:57:29.147731+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:54.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169454+0000","last_change":"2023-10-06T02:57:29.160795+0000","last_active":"2023-10-06T02:57:29.169454+0000","last_peered":"2023-10-06T02:57:29.169454+0000","last_clean":"2023-10-06T02:57:29.169454+0000","last_became_active":"2023-10-06T02:57:29.160448+0000","last_became_peered":"2023-10-06T02:57:29.160448+0000","last_unstale":"2023-10-06T02:57:29.169454+0000","last_undegraded":"2023-10-06T02:57:29.169454+0000","last_fullsized":"2023-10-06T02:57:29.169454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:50.037997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'8","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.177299+0000","last_change":"2023-10-06T02:57:28.163501+0000","last_active":"2023-10-06T02:57:29.177299+0000","last_peered":"2023-10-06T02:57:29.177299+0000","last_clean":"2023-10-06T02:57:29.177299+0000","last_became_active":"2023-10-06T02:57:28.163221+0000","last_became_peered":"2023-10-06T02:57:28.163221+0000","last_unstale":"2023-10-06T02:57:29.177299+0000","last_undegraded":"2023-10-06T02:57:29.177299+0000","last_fullsized":"2023-10-06T02:57:29.177299+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:21.591868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161107+0000","last_change":"2023-10-06T02:57:29.157590+0000","last_active":"2023-10-06T02:57:29.161107+0000","last_peered":"2023-10-06T02:57:29.161107+0000","last_clean":"2023-10-06T02:57:29.161107+0000","last_became_active":"2023-10-06T02:57:29.157329+0000","last_became_peered":"2023-10-06T02:57:29.157329+0000","last_unstale":"2023-10-06T02:57:29.161107+0000","last_undegraded":"2023-10-06T02:57:29.161107+0000","last_fullsized":"2023-10-06T02:57:29.161107+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.995687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175857+0000","last_change":"2023-10-06T02:57:28.155033+0000","last_active":"2023-10-06T02:57:29.175857+0000","last_peered":"2023-10-06T02:57:29.175857+0000","last_clean":"2023-10-06T02:57:29.175857+0000","last_became_active":"2023-10-06T02:57:28.154759+0000","last_became_peered":"2023-10-06T02:57:28.154759+0000","last_unstale":"2023-10-06T02:57:29.175857+0000","last_undegraded":"2023-10-06T02:57:29.175857+0000","last_fullsized":"2023-10-06T02:57:29.175857+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:40.908455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.163188+0000","last_change":"2023-10-06T02:57:29.160336+0000","last_active":"2023-10-06T02:57:29.163188+0000","last_peered":"2023-10-06T02:57:29.163188+0000","last_clean":"2023-10-06T02:57:29.163188+0000","last_became_active":"2023-10-06T02:57:29.159485+0000","last_became_peered":"2023-10-06T02:57:29.159485+0000","last_unstale":"2023-10-06T02:57:29.163188+0000","last_undegraded":"2023-10-06T02:57:29.163188+0000","last_fullsized":"2023-10-06T02:57:29.163188+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T02:57:30.152180+0000","last_change":"2023-10-06T02:57:28.156381+0000","last_active":"2023-10-06T02:57:30.152180+0000","last_peered":"2023-10-06T02:57:30.152180+0000","last_clean":"2023-10-06T02:57:30.152180+0000","last_became_active":"2023-10-06T02:57:28.156172+0000","last_became_peered":"2023-10-06T02:57:28.156172+0000","last_unstale":"2023-10-06T02:57:30.152180+0000","last_undegraded":"2023-10-06T02:57:30.152180+0000","last_fullsized":"2023-10-06T02:57:30.152180+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:50.675247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169318+0000","last_change":"2023-10-06T02:57:29.163252+0000","last_active":"2023-10-06T02:57:29.169318+0000","last_peered":"2023-10-06T02:57:29.169318+0000","last_clean":"2023-10-06T02:57:29.169318+0000","last_became_active":"2023-10-06T02:57:29.162989+0000","last_became_peered":"2023-10-06T02:57:29.162989+0000","last_unstale":"2023-10-06T02:57:29.169318+0000","last_undegraded":"2023-10-06T02:57:29.169318+0000","last_fullsized":"2023-10-06T02:57:29.169318+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:39.185325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154555+0000","last_change":"2023-10-06T02:57:28.150712+0000","last_active":"2023-10-06T02:57:29.154555+0000","last_peered":"2023-10-06T02:57:29.154555+0000","last_clean":"2023-10-06T02:57:29.154555+0000","last_became_active":"2023-10-06T02:57:28.150426+0000","last_became_peered":"2023-10-06T02:57:28.150426+0000","last_unstale":"2023-10-06T02:57:29.154555+0000","last_undegraded":"2023-10-06T02:57:29.154555+0000","last_fullsized":"2023-10-06T02:57:29.154555+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:47.960513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168602+0000","last_change":"2023-10-06T02:57:29.162357+0000","last_active":"2023-10-06T02:57:29.168602+0000","last_peered":"2023-10-06T02:57:29.168602+0000","last_clean":"2023-10-06T02:57:29.168602+0000","last_became_active":"2023-10-06T02:57:29.162107+0000","last_became_peered":"2023-10-06T02:57:29.162107+0000","last_unstale":"2023-10-06T02:57:29.168602+0000","last_undegraded":"2023-10-06T02:57:29.168602+0000","last_fullsized":"2023-10-06T02:57:29.168602+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:20.349987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.149462+0000","last_change":"2023-10-06T02:57:28.158040+0000","last_active":"2023-10-06T02:57:29.149462+0000","last_peered":"2023-10-06T02:57:29.149462+0000","last_clean":"2023-10-06T02:57:29.149462+0000","last_became_active":"2023-10-06T02:57:28.157767+0000","last_became_peered":"2023-10-06T02:57:28.157767+0000","last_unstale":"2023-10-06T02:57:29.149462+0000","last_undegraded":"2023-10-06T02:57:29.149462+0000","last_fullsized":"2023-10-06T02:57:29.149462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:10:56.163695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.164477+0000","last_change":"2023-10-06T02:57:29.157425+0000","last_active":"2023-10-06T02:57:29.164477+0000","last_peered":"2023-10-06T02:57:29.164477+0000","last_clean":"2023-10-06T02:57:29.164477+0000","last_became_active":"2023-10-06T02:57:29.156688+0000","last_became_peered":"2023-10-06T02:57:29.156688+0000","last_unstale":"2023-10-06T02:57:29.164477+0000","last_undegraded":"2023-10-06T02:57:29.164477+0000","last_fullsized":"2023-10-06T02:57:29.164477+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:59:33.041583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.145833+0000","last_change":"2023-10-06T02:57:28.153360+0000","last_active":"2023-10-06T02:57:29.145833+0000","last_peered":"2023-10-06T02:57:29.145833+0000","last_clean":"2023-10-06T02:57:29.145833+0000","last_became_active":"2023-10-06T02:57:28.153120+0000","last_became_peered":"2023-10-06T02:57:28.153120+0000","last_unstale":"2023-10-06T02:57:29.145833+0000","last_undegraded":"2023-10-06T02:57:29.145833+0000","last_fullsized":"2023-10-06T02:57:29.145833+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:44.063071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.169312+0000","last_change":"2023-10-06T02:57:29.158979+0000","last_active":"2023-10-06T02:57:29.169312+0000","last_peered":"2023-10-06T02:57:29.169312+0000","last_clean":"2023-10-06T02:57:29.169312+0000","last_became_active":"2023-10-06T02:57:29.158726+0000","last_became_peered":"2023-10-06T02:57:29.158726+0000","last_unstale":"2023-10-06T02:57:29.169312+0000","last_undegraded":"2023-10-06T02:57:29.169312+0000","last_fullsized":"2023-10-06T02:57:29.169312+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:53.278507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.156524+0000","last_change":"2023-10-06T02:57:28.155104+0000","last_active":"2023-10-06T02:57:29.156524+0000","last_peered":"2023-10-06T02:57:29.156524+0000","last_clean":"2023-10-06T02:57:29.156524+0000","last_became_active":"2023-10-06T02:57:28.154822+0000","last_became_peered":"2023-10-06T02:57:28.154822+0000","last_unstale":"2023-10-06T02:57:29.156524+0000","last_undegraded":"2023-10-06T02:57:29.156524+0000","last_fullsized":"2023-10-06T02:57:29.156524+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.166276+0000","last_change":"2023-10-06T02:57:29.161515+0000","last_active":"2023-10-06T02:57:29.166276+0000","last_peered":"2023-10-06T02:57:29.166276+0000","last_clean":"2023-10-06T02:57:29.166276+0000","last_became_active":"2023-10-06T02:57:29.161243+0000","last_became_peered":"2023-10-06T02:57:29.161243+0000","last_unstale":"2023-10-06T02:57:29.166276+0000","last_undegraded":"2023-10-06T02:57:29.166276+0000","last_fullsized":"2023-10-06T02:57:29.166276+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:38:50.730881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.145769+0000","last_change":"2023-10-06T02:57:28.160730+0000","last_active":"2023-10-06T02:57:29.145769+0000","last_peered":"2023-10-06T02:57:29.145769+0000","last_clean":"2023-10-06T02:57:29.145769+0000","last_became_active":"2023-10-06T02:57:28.160482+0000","last_became_peered":"2023-10-06T02:57:28.160482+0000","last_unstale":"2023-10-06T02:57:29.145769+0000","last_undegraded":"2023-10-06T02:57:29.145769+0000","last_fullsized":"2023-10-06T02:57:29.145769+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:48.044243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168562+0000","last_change":"2023-10-06T02:57:29.159938+0000","last_active":"2023-10-06T02:57:29.168562+0000","last_peered":"2023-10-06T02:57:29.168562+0000","last_clean":"2023-10-06T02:57:29.168562+0000","last_became_active":"2023-10-06T02:57:29.158530+0000","last_became_peered":"2023-10-06T02:57:29.158530+0000","last_unstale":"2023-10-06T02:57:29.168562+0000","last_undegraded":"2023-10-06T02:57:29.168562+0000","last_fullsized":"2023-10-06T02:57:29.168562+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:59.957180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.142933+0000","last_change":"2023-10-06T02:57:28.151353+0000","last_active":"2023-10-06T02:57:29.142933+0000","last_peered":"2023-10-06T02:57:29.142933+0000","last_clean":"2023-10-06T02:57:29.142933+0000","last_became_active":"2023-10-06T02:57:28.151093+0000","last_became_peered":"2023-10-06T02:57:28.151093+0000","last_unstale":"2023-10-06T02:57:29.142933+0000","last_undegraded":"2023-10-06T02:57:29.142933+0000","last_fullsized":"2023-10-06T02:57:29.142933+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:00.988530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.160961+0000","last_change":"2023-10-06T02:57:29.153490+0000","last_active":"2023-10-06T02:57:29.160961+0000","last_peered":"2023-10-06T02:57:29.160961+0000","last_clean":"2023-10-06T02:57:29.160961+0000","last_became_active":"2023-10-06T02:57:29.153227+0000","last_became_peered":"2023-10-06T02:57:29.153227+0000","last_unstale":"2023-10-06T02:57:29.160961+0000","last_undegraded":"2023-10-06T02:57:29.160961+0000","last_fullsized":"2023-10-06T02:57:29.160961+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:02.981327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.177927+0000","last_change":"2023-10-06T02:57:28.158553+0000","last_active":"2023-10-06T02:57:29.177927+0000","last_peered":"2023-10-06T02:57:29.177927+0000","last_clean":"2023-10-06T02:57:29.177927+0000","last_became_active":"2023-10-06T02:57:28.158316+0000","last_became_peered":"2023-10-06T02:57:28.158316+0000","last_unstale":"2023-10-06T02:57:29.177927+0000","last_undegraded":"2023-10-06T02:57:29.177927+0000","last_fullsized":"2023-10-06T02:57:29.177927+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:20:58.492313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.145994+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:57:29.145994+0000","last_peered":"2023-10-06T02:57:29.145994+0000","last_clean":"2023-10-06T02:57:29.145994+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:57:29.145994+0000","last_undegraded":"2023-10-06T02:57:29.145994+0000","last_fullsized":"2023-10-06T02:57:29.145994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.168418+0000","last_change":"2023-10-06T02:57:29.160818+0000","last_active":"2023-10-06T02:57:29.168418+0000","last_peered":"2023-10-06T02:57:29.168418+0000","last_clean":"2023-10-06T02:57:29.168418+0000","last_became_active":"2023-10-06T02:57:29.160528+0000","last_became_peered":"2023-10-06T02:57:29.160528+0000","last_unstale":"2023-10-06T02:57:29.168418+0000","last_undegraded":"2023-10-06T02:57:29.168418+0000","last_fullsized":"2023-10-06T02:57:29.168418+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:58.527683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147156+0000","last_change":"2023-10-06T02:57:28.158916+0000","last_active":"2023-10-06T02:57:29.147156+0000","last_peered":"2023-10-06T02:57:29.147156+0000","last_clean":"2023-10-06T02:57:29.147156+0000","last_became_active":"2023-10-06T02:57:28.158666+0000","last_became_peered":"2023-10-06T02:57:28.158666+0000","last_unstale":"2023-10-06T02:57:29.147156+0000","last_undegraded":"2023-10-06T02:57:29.147156+0000","last_fullsized":"2023-10-06T02:57:29.147156+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:05.270414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.150368+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:57:29.150368+0000","last_peered":"2023-10-06T02:57:29.150368+0000","last_clean":"2023-10-06T02:57:29.150368+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:57:29.150368+0000","last_undegraded":"2023-10-06T02:57:29.150368+0000","last_fullsized":"2023-10-06T02:57:29.150368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.161083+0000","last_change":"2023-10-06T02:57:29.158084+0000","last_active":"2023-10-06T02:57:29.161083+0000","last_peered":"2023-10-06T02:57:29.161083+0000","last_clean":"2023-10-06T02:57:29.161083+0000","last_became_active":"2023-10-06T02:57:29.157809+0000","last_became_peered":"2023-10-06T02:57:29.157809+0000","last_unstale":"2023-10-06T02:57:29.161083+0000","last_undegraded":"2023-10-06T02:57:29.161083+0000","last_fullsized":"2023-10-06T02:57:29.161083+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:53:53.278507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'2","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.176722+0000","last_change":"2023-10-06T02:57:28.155037+0000","last_active":"2023-10-06T02:57:29.176722+0000","last_peered":"2023-10-06T02:57:29.176722+0000","last_clean":"2023-10-06T02:57:29.176722+0000","last_became_active":"2023-10-06T02:57:28.154790+0000","last_became_peered":"2023-10-06T02:57:28.154790+0000","last_unstale":"2023-10-06T02:57:29.176722+0000","last_undegraded":"2023-10-06T02:57:29.176722+0000","last_fullsized":"2023-10-06T02:57:29.176722+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.148271+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:57:29.148271+0000","last_peered":"2023-10-06T02:57:29.148271+0000","last_clean":"2023-10-06T02:57:29.148271+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:57:29.148271+0000","last_undegraded":"2023-10-06T02:57:29.148271+0000","last_fullsized":"2023-10-06T02:57:29.148271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.157069+0000","last_change":"2023-10-06T02:57:29.153722+0000","last_active":"2023-10-06T02:57:29.157069+0000","last_peered":"2023-10-06T02:57:29.157069+0000","last_clean":"2023-10-06T02:57:29.157069+0000","last_became_active":"2023-10-06T02:57:29.153463+0000","last_became_peered":"2023-10-06T02:57:29.153463+0000","last_unstale":"2023-10-06T02:57:29.157069+0000","last_undegraded":"2023-10-06T02:57:29.157069+0000","last_fullsized":"2023-10-06T02:57:29.157069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:49.958572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154456+0000","last_change":"2023-10-06T02:57:28.153262+0000","last_active":"2023-10-06T02:57:29.154456+0000","last_peered":"2023-10-06T02:57:29.154456+0000","last_clean":"2023-10-06T02:57:29.154456+0000","last_became_active":"2023-10-06T02:57:28.152963+0000","last_became_peered":"2023-10-06T02:57:28.152963+0000","last_unstale":"2023-10-06T02:57:29.154456+0000","last_undegraded":"2023-10-06T02:57:29.154456+0000","last_fullsized":"2023-10-06T02:57:29.154456+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:21.640991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147690+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:57:29.147690+0000","last_peered":"2023-10-06T02:57:29.147690+0000","last_clean":"2023-10-06T02:57:29.147690+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:57:29.147690+0000","last_undegraded":"2023-10-06T02:57:29.147690+0000","last_fullsized":"2023-10-06T02:57:29.147690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147602+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:57:29.147602+0000","last_peered":"2023-10-06T02:57:29.147602+0000","last_clean":"2023-10-06T02:57:29.147602+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:57:29.147602+0000","last_undegraded":"2023-10-06T02:57:29.147602+0000","last_fullsized":"2023-10-06T02:57:29.147602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.172336+0000","last_change":"2023-10-06T02:57:29.168415+0000","last_active":"2023-10-06T02:57:29.172336+0000","last_peered":"2023-10-06T02:57:29.172336+0000","last_clean":"2023-10-06T02:57:29.172336+0000","last_became_active":"2023-10-06T02:57:29.168146+0000","last_became_peered":"2023-10-06T02:57:29.168146+0000","last_unstale":"2023-10-06T02:57:29.172336+0000","last_undegraded":"2023-10-06T02:57:29.172336+0000","last_fullsized":"2023-10-06T02:57:29.172336+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:15.152388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.145991+0000","last_change":"2023-10-06T02:57:28.158519+0000","last_active":"2023-10-06T02:57:29.145991+0000","last_peered":"2023-10-06T02:57:29.145991+0000","last_clean":"2023-10-06T02:57:29.145991+0000","last_became_active":"2023-10-06T02:57:28.158257+0000","last_became_peered":"2023-10-06T02:57:28.158257+0000","last_unstale":"2023-10-06T02:57:29.145991+0000","last_undegraded":"2023-10-06T02:57:29.145991+0000","last_fullsized":"2023-10-06T02:57:29.145991+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:29.265968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.147687+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:57:29.147687+0000","last_peered":"2023-10-06T02:57:29.147687+0000","last_clean":"2023-10-06T02:57:29.147687+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:57:29.147687+0000","last_undegraded":"2023-10-06T02:57:29.147687+0000","last_fullsized":"2023-10-06T02:57:29.147687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170428+0000","last_change":"2023-10-06T02:57:29.166606+0000","last_active":"2023-10-06T02:57:29.170428+0000","last_peered":"2023-10-06T02:57:29.170428+0000","last_clean":"2023-10-06T02:57:29.170428+0000","last_became_active":"2023-10-06T02:57:29.162754+0000","last_became_peered":"2023-10-06T02:57:29.162754+0000","last_unstale":"2023-10-06T02:57:29.170428+0000","last_undegraded":"2023-10-06T02:57:29.170428+0000","last_fullsized":"2023-10-06T02:57:29.170428+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:23.995687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175565+0000","last_change":"2023-10-06T02:57:28.159275+0000","last_active":"2023-10-06T02:57:29.175565+0000","last_peered":"2023-10-06T02:57:29.175565+0000","last_clean":"2023-10-06T02:57:29.175565+0000","last_became_active":"2023-10-06T02:57:28.158956+0000","last_became_peered":"2023-10-06T02:57:28.158956+0000","last_unstale":"2023-10-06T02:57:29.175565+0000","last_undegraded":"2023-10-06T02:57:29.175565+0000","last_fullsized":"2023-10-06T02:57:29.175565+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:22.990325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.152122+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:57:29.152122+0000","last_peered":"2023-10-06T02:57:29.152122+0000","last_clean":"2023-10-06T02:57:29.152122+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:57:29.152122+0000","last_undegraded":"2023-10-06T02:57:29.152122+0000","last_fullsized":"2023-10-06T02:57:29.152122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.170455+0000","last_change":"2023-10-06T02:57:29.162353+0000","last_active":"2023-10-06T02:57:29.170455+0000","last_peered":"2023-10-06T02:57:29.170455+0000","last_clean":"2023-10-06T02:57:29.170455+0000","last_became_active":"2023-10-06T02:57:29.162100+0000","last_became_peered":"2023-10-06T02:57:29.162100+0000","last_unstale":"2023-10-06T02:57:29.170455+0000","last_undegraded":"2023-10-06T02:57:29.170455+0000","last_fullsized":"2023-10-06T02:57:29.170455+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:59.301597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.151069+0000","last_change":"2023-10-06T02:57:28.155416+0000","last_active":"2023-10-06T02:57:29.151069+0000","last_peered":"2023-10-06T02:57:29.151069+0000","last_clean":"2023-10-06T02:57:29.151069+0000","last_became_active":"2023-10-06T02:57:28.155144+0000","last_became_peered":"2023-10-06T02:57:28.155144+0000","last_unstale":"2023-10-06T02:57:29.151069+0000","last_undegraded":"2023-10-06T02:57:29.151069+0000","last_fullsized":"2023-10-06T02:57:29.151069+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:29.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.146038+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:57:29.146038+0000","last_peered":"2023-10-06T02:57:29.146038+0000","last_clean":"2023-10-06T02:57:29.146038+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:57:29.146038+0000","last_undegraded":"2023-10-06T02:57:29.146038+0000","last_fullsized":"2023-10-06T02:57:29.146038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.175506+0000","last_change":"2023-10-06T02:57:29.170783+0000","last_active":"2023-10-06T02:57:29.175506+0000","last_peered":"2023-10-06T02:57:29.175506+0000","last_clean":"2023-10-06T02:57:29.175506+0000","last_became_active":"2023-10-06T02:57:29.170473+0000","last_became_peered":"2023-10-06T02:57:29.170473+0000","last_unstale":"2023-10-06T02:57:29.175506+0000","last_undegraded":"2023-10-06T02:57:29.175506+0000","last_fullsized":"2023-10-06T02:57:29.175506+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:28.134821+0000","last_clean_scrub_stamp":"2023-10-06T02:57:28.134821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:20.349987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"55'1","reported_seq":11,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.174018+0000","last_change":"2023-10-06T02:57:28.158264+0000","last_active":"2023-10-06T02:57:29.174018+0000","last_peered":"2023-10-06T02:57:29.174018+0000","last_clean":"2023-10-06T02:57:29.174018+0000","last_became_active":"2023-10-06T02:57:28.157981+0000","last_became_peered":"2023-10-06T02:57:28.157981+0000","last_unstale":"2023-10-06T02:57:29.174018+0000","last_undegraded":"2023-10-06T02:57:29.174018+0000","last_fullsized":"2023-10-06T02:57:29.174018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:57:27.129458+0000","last_clean_scrub_stamp":"2023-10-06T02:57:27.129458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:47.860250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T02:57:29.154572+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:57:29.154572+0000","last_peered":"2023-10-06T02:57:29.154572+0000","last_clean":"2023-10-06T02:57:29.154572+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:57:29.154572+0000","last_undegraded":"2023-10-06T02:57:29.154572+0000","last_fullsized":"2023-10-06T02:57:29.154572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298528,"kb_used_data":1240,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073312,"statfs":{"total":96636764160,"available":96331071488,"internally_reserved":0,"allocated":1269760,"data_stored":900057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.439},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65000000000000002,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69199999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65600000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.31,"15min":0.31},"max":{"1min":0.70599999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.375}]},{"osd":4,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59599999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.30199999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65700000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.55100000000000005,"15min":0.56399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67000000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40600000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64900000000000002,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68400000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.34599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297940,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073900,"statfs":{"total":96636764160,"available":96331673600,"internally_reserved":0,"allocated":667648,"data_stored":309529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.60199999999999998,"15min":0.61799999999999999},"min":{"1min":0.38300000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63700000000000001,"5min":3.415,"15min":3.415},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72099999999999997,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.627}]},{"osd":1,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":1.546,"15min":1.546},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68899999999999995,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63400000000000001,"5min":1.74,"15min":1.74},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.70399999999999996,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.71599999999999997,"15min":0.73799999999999999},"min":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.74299999999999999,"5min":3.577,"15min":3.577},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.67300000000000004,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.66300000000000003,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68000000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73499999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42899999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297940,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073900,"statfs":{"total":96636764160,"available":96331673600,"internally_reserved":0,"allocated":667648,"data_stored":308608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.39700000000000002,"15min":0.40799999999999997},"min":{"1min":0.22,"5min":0.19,"15min":0.19},"max":{"1min":0.48499999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.251},{"interface":"front","average":{"1min":0.38,"5min":0.376,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59999999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":1.21,"15min":1.3500000000000001},"min":{"1min":0.24299999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51800000000000002,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65500000000000003,"5min":1.181,"15min":1.181},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58399999999999996,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.30099999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":1.02,"15min":1.02},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.629,"5min":1.4339999999999999,"15min":1.5680000000000001},"min":{"1min":0.46800000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85599999999999998,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.423,"15min":1.5529999999999999},"min":{"1min":0.45000000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95699999999999996,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.501},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.504,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.82099999999999995,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.628,"5min":1.452,"15min":1.5900000000000001},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.92600000000000005,"5min":21.166,"15min":21.166},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Oct 6 02:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.46400000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81999999999999995,"5min":0.997,"15min":0.997},"last":0.54800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298532,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073308,"statfs":{"total":96636764160,"available":96331067392,"internally_reserved":0,"allocated":1273856,"data_stored":900976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.434,"5min":0.441,"15min":0.441},"last":0.246},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.27600000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.374,"15min":0.372},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.317,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.27400000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.37,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72899999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79900000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72699999999999998,"5min":0.879,"15min":0.879},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77000000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.73799999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63,"15min":0.63600000000000001},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73099999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297948,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073892,"statfs":{"total":96636764160,"available":96331665408,"internally_reserved":0,"allocated":675840,"data_stored":309585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.31,"15min":0.30599999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.47399999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.317},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.5,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.313},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.27800000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65000000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55400000000000005,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58799999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.747,"5min":0.755,"15min":0.755},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55500000000000005},"min":{"1min":0.42399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.51400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.45200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71899999999999997,"5min":1.077,"15min":1.077},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:56:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.435,"15min":0.435},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297944,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073896,"statfs":{"total":96636764160,"available":96331669504,"internally_reserved":0,"allocated":671744,"data_stored":308574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.623,"5min":2.569,"15min":2.569},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.44900000000000001,"15min":0.46100000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.53800000000000003,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.27700000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.439,"15min":0.44900000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57699999999999996,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56200000000000006,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.23799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46600000000000003,"15min":0.47499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.49399999999999999,"15min":0.505},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.623,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.28999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.77600000000000002,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.67400000000000004,"15min":0.68799999999999994},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77800000000000002,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.69099999999999995,"15min":0.70299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77000000000000002,"5min":2.532,"15min":2.532},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72899999999999998,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.70299999999999996,"15min":0.71299999999999997},"min":{"1min":0.497,"5min":0.436,"15min":0.436},"max":{"1min":0.80700000000000005,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.436,"5min":0.434,"15min":0.434},"max":{"1min":0.78300000000000003,"5min":2.496,"15min":2.496},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76200000000000001,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.40799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297952,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073888,"statfs":{"total":96636764160,"available":96331661312,"internally_reserved":0,"allocated":679936,"data_stored":311065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70799999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.435,"5min":0.378,"15min":0.378},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":1.0109999999999999,"15min":1.073},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.77800000000000002,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56200000000000006,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.437}]},{"osd":7,"last update":"Fri Oct 6 02:57:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.625},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89100000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297948,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073892,"statfs":{"total":96636764160,"available":96331665408,"internally_reserved":0,"allocated":675840,"data_stored":310153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.38100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67400000000000004,"5min":1.167,"15min":1.167},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.44500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.117,"15min":1.117},"last":0.44},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.505},"min":{"1min":0.35499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69399999999999995,"5min":1.2,"15min":1.2},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.68899999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68400000000000005,"5min":1.135,"15min":1.135},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81599999999999995,"5min":1.208,"15min":1.208},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76200000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60799999999999998,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":0.87,"15min":0.87},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.89200000000000002,"5min":1.054,"15min":1.054},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80600000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59099999999999997,"15min":0.59599999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.377,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.008},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:57:38.070 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:57:38.070 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:57:38.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.222+0000 7f719c951700 1 Processor -- start 2023-10-06T02:57:38.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.222+0000 7f719c951700 1 -- start start 2023-10-06T02:57:38.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.222+0000 7f719c951700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f71980cbcb0 0x7f71980cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.222+0000 7f719c951700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71980cf610 con 0x7f7198159510 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.222+0000 7f719c951700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71980cf8f0 con 0x7f71981598e0 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.222+0000 7f719c951700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71980cfbd0 con 0x7f71980cbcb0 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f719659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7198159510 0x7f71980cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48172/0 (socket says 172.21.15.84:48172) 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f719659c700 1 -- 172.21.15.84:0/1904314216 learned_addr learned my addr 172.21.15.84:0/1904314216 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800549735 0 0) 0x7f71980cf610 con 0x7f7198159510 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7196d9d700 1 --2- 172.21.15.84:0/1904314216 >> v2:172.21.15.131:3300/0 conn(0x7f71980cbcb0 0x7f71980cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7184003570 con 0x7f7198159510 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 475697355 0 0) 0x7f7184003570 con 0x7f7198159510 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 >> v2:172.21.15.131:3300/0 conn(0x7f71980cbcb0 msgr2=0x7f71980cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 --2- 172.21.15.84:0/1904314216 >> v2:172.21.15.131:3300/0 conn(0x7f71980cbcb0 0x7f71980cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 >> v1:172.21.15.131:6789/0 conn(0x7f71981598e0 legacy=0x7f71980ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980cfeb0 con 0x7f7198159510 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f71880017f0 con 0x7f7198159510 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 >> v1:172.21.15.84:6789/0 conn(0x7f7198159510 legacy=0x7f71980cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7184003a60 0x7f7184003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184004810 0x7f7184004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71840051c0 0x7f718400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980cfbd0 con 0x7f7184004810 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718400c0d0 con 0x7f7184003a60 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718400c290 con 0x7f71840051c0 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f718dd9b700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184004810 0x7f7184004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f719659c700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7184003a60 0x7f7184003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f7196d9d700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71840051c0 0x7f718400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f718dd9b700 1 -- 172.21.15.84:0/1904314216 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71840051c0 msgr2=0x7f718400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f718dd9b700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71840051c0 0x7f718400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f718dd9b700 1 -- 172.21.15.84:0/1904314216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7184003a60 msgr2=0x7f7184003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f718dd9b700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7184003a60 0x7f7184003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.223+0000 7f718dd9b700 1 -- 172.21.15.84:0/1904314216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184003570 con 0x7f7184004810 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f7196d9d700 1 -- 172.21.15.84:0/1904314216 reap_dead start 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f718dd9b700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184004810 0x7f7184004c80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7198067d30 tx=0x7f7180007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11245bc48fb04ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180012420 con 0x7f7184004810 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7180012580 con 0x7f7184004810 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f7195d9b700 1 -- 172.21.15.84:0/1904314216 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180012920 con 0x7f7184004810 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f719c951700 1 -- 172.21.15.84:0/1904314216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184004810 msgr2=0x7f7184004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f719c951700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184004810 0x7f7184004c80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7198067d30 tx=0x7f7180007d30 comp rx=0 tx=0).stop 2023-10-06T02:57:38.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f719c951700 1 -- 172.21.15.84:0/1904314216 shutdown_connections 2023-10-06T02:57:38.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f719c951700 1 --2- 172.21.15.84:0/1904314216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7184004810 0x7f7184004c80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f719c951700 1 -- 172.21.15.84:0/1904314216 >> 172.21.15.84:0/1904314216 conn(0x7f7198089e90 msgr2=0x7f71980997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:38.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f719c951700 1 -- 172.21.15.84:0/1904314216 shutdown_connections 2023-10-06T02:57:38.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.224+0000 7f719c951700 1 -- 172.21.15.84:0/1904314216 wait complete. 2023-10-06T02:57:38.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.225+0000 7f719c951700 1 Processor -- start 2023-10-06T02:57:38.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f719c951700 1 -- start start 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f719c951700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7184004810 0x7f71980b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f719c951700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71980c9f50 0x7f71980d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f719c951700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f719813ead0 0x7f719813ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f719c951700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980ca3c0 con 0x7f719813ead0 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f719c951700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719813f460 con 0x7f7184004810 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f719c951700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71980b5160 con 0x7f71980c9f50 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f7196d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f719813ead0 0x7f719813ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f7196d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f719813ead0 0x7f719813ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57962/0 (socket says 172.21.15.84:57962) 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f7196d9d700 1 -- 172.21.15.84:0/2116681824 learned_addr learned my addr 172.21.15.84:0/2116681824 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f719659c700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7184004810 0x7f71980b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.226+0000 7f718dd9b700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71980c9f50 0x7f71980d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f7196d9d700 1 -- 172.21.15.84:0/2116681824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71980c9f50 msgr2=0x7f71980d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f7196d9d700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71980c9f50 0x7f71980d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f7196d9d700 1 -- 172.21.15.84:0/2116681824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7184004810 msgr2=0x7f71980b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f7196d9d700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7184004810 0x7f71980b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f7196d9d700 1 -- 172.21.15.84:0/2116681824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980b5440 con 0x7f719813ead0 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f7196d9d700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f719813ead0 0x7f719813ef20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f71980cc0b0 tx=0x7f7190008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f718effd700 1 -- 172.21.15.84:0/2116681824 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190011ed0 con 0x7f719813ead0 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f718effd700 1 -- 172.21.15.84:0/2116681824 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190015670 con 0x7f719813ead0 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71980b5720 con 0x7f719813ead0 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f718effd700 1 -- 172.21.15.84:0/2116681824 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190015a10 con 0x7f719813ead0 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.227+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71980b5ce0 con 0x7f719813ead0 2023-10-06T02:57:38.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.228+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71980b5f00 con 0x7f719813ead0 2023-10-06T02:57:38.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.228+0000 7f718effd700 1 -- 172.21.15.84:0/2116681824 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7190020460 con 0x7f719813ead0 2023-10-06T02:57:38.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.229+0000 7f718effd700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7178066f30 0x7f71780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.229+0000 7f719659c700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7178066f30 0x7f71780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.229+0000 7f718effd700 1 -- 172.21.15.84:0/2116681824 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7190084890 con 0x7f719813ead0 2023-10-06T02:57:38.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.229+0000 7f719659c700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7178066f30 0x7f71780693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7188004f80 tx=0x7f7188006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:38.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.233+0000 7f718effd700 1 -- 172.21.15.84:0/2116681824 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71900552f0 con 0x7f719813ead0 2023-10-06T02:57:38.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.493+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7198064ad0 con 0x7f719813ead0 2023-10-06T02:57:38.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.496+0000 7f718effd700 1 -- 172.21.15.84:0/2116681824 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7190054e80 con 0x7f719813ead0 2023-10-06T02:57:38.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7178066f30 msgr2=0x7f71780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7178066f30 0x7f71780693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7188004f80 tx=0x7f7188006040 comp rx=0 tx=0).stop 2023-10-06T02:57:38.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f719813ead0 msgr2=0x7f719813ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f719813ead0 0x7f719813ef20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f71980cc0b0 tx=0x7f7190008040 comp rx=0 tx=0).stop 2023-10-06T02:57:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 shutdown_connections 2023-10-06T02:57:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7178066f30 0x7f71780693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7184004810 0x7f71980b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f719813ead0 0x7f719813ef20 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 --2- 172.21.15.84:0/2116681824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f71980c9f50 0x7f71980d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.498+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 >> 172.21.15.84:0/2116681824 conn(0x7f7198089e90 msgr2=0x7f71980c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.499+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 shutdown_connections 2023-10-06T02:57:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.499+0000 7f719c951700 1 -- 172.21.15.84:0/2116681824 wait complete. 2023-10-06T02:57:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T02:57:38.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.624+0000 7f8bc4a97700 1 Processor -- start 2023-10-06T02:57:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.624+0000 7f8bc4a97700 1 -- start start 2023-10-06T02:57:38.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.625+0000 7f8bc4a97700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8bc00b07a0 0x7f8bc00ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.625+0000 7f8bc4a97700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc00b0ca0 con 0x7f8bc00b49e0 2023-10-06T02:57:38.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.625+0000 7f8bc4a97700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc00b0f80 con 0x7f8bc01595a0 2023-10-06T02:57:38.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.625+0000 7f8bc4a97700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc00ab390 con 0x7f8bc00b07a0 2023-10-06T02:57:38.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.625+0000 7f8bbed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8bc00b07a0 0x7f8bc00ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.625+0000 7f8bb5d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8bc00b49e0 0x7f8bc00aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48180/0 (socket says 172.21.15.84:48180) 2023-10-06T02:57:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.625+0000 7f8bb5d9b700 1 -- 172.21.15.84:0/2615572112 learned_addr learned my addr 172.21.15.84:0/2615572112 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.625+0000 7f8bbed9d700 1 -- 172.21.15.84:0/2615572112 >> v1:172.21.15.131:6789/0 conn(0x7f8bc01595a0 legacy=0x7f8bc00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bbed9d700 1 -- 172.21.15.84:0/2615572112 >> v1:172.21.15.84:6789/0 conn(0x7f8bc00b49e0 legacy=0x7f8bc00aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bbed9d700 1 -- 172.21.15.84:0/2615572112 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00b1260 con 0x7f8bc00b07a0 2023-10-06T02:57:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bbdd9b700 1 -- 172.21.15.84:0/2615572112 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094214678 0 0) 0x7f8bc00b0ca0 con 0x7f8bc00b49e0 2023-10-06T02:57:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bbed9d700 1 --2- 172.21.15.84:0/2615572112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b07a0 0x7f8bc00ccfd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009e90 tx=0x7f8bb8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8a062f0d13a9b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bbdd9b700 1 -- 172.21.15.84:0/2615572112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800e070 con 0x7f8bc00b07a0 2023-10-06T02:57:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bbdd9b700 1 -- 172.21.15.84:0/2615572112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb800bbb0 con 0x7f8bc00b07a0 2023-10-06T02:57:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bbdd9b700 1 -- 172.21.15.84:0/2615572112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8012430 con 0x7f8bc00b07a0 2023-10-06T02:57:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bc4a97700 1 -- 172.21.15.84:0/2615572112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b07a0 msgr2=0x7f8bc00ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bc4a97700 1 --2- 172.21.15.84:0/2615572112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b07a0 0x7f8bc00ccfd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009e90 tx=0x7f8bb8009780 comp rx=0 tx=0).stop 2023-10-06T02:57:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bc4a97700 1 -- 172.21.15.84:0/2615572112 shutdown_connections 2023-10-06T02:57:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bc4a97700 1 --2- 172.21.15.84:0/2615572112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b07a0 0x7f8bc00ccfd0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bc4a97700 1 -- 172.21.15.84:0/2615572112 >> 172.21.15.84:0/2615572112 conn(0x7f8bc0099830 msgr2=0x7f8bc006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bc4a97700 1 -- 172.21.15.84:0/2615572112 shutdown_connections 2023-10-06T02:57:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.626+0000 7f8bc4a97700 1 -- 172.21.15.84:0/2615572112 wait complete. 2023-10-06T02:57:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bc4a97700 1 Processor -- start 2023-10-06T02:57:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bc4a97700 1 -- start start 2023-10-06T02:57:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bc4a97700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bc00b07a0 0x7f8bc015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bc4a97700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b49e0 0x7f8bc0157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bc4a97700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bc01595a0 0x7f8bc015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bc4a97700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc0158050 con 0x7f8bc00b49e0 2023-10-06T02:57:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bc4a97700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc009aa40 con 0x7f8bc01595a0 2023-10-06T02:57:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bc4a97700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc009dbb0 con 0x7f8bc00b07a0 2023-10-06T02:57:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bb5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b49e0 0x7f8bc0157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bb5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b49e0 0x7f8bc0157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57974/0 (socket says 172.21.15.84:57974) 2023-10-06T02:57:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.628+0000 7f8bb5d9b700 1 -- 172.21.15.84:0/637842141 learned_addr learned my addr 172.21.15.84:0/637842141 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bb5d9b700 1 -- 172.21.15.84:0/637842141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bc00b07a0 msgr2=0x7f8bc015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bb5d9b700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bc00b07a0 0x7f8bc015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bb5d9b700 1 -- 172.21.15.84:0/637842141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bc01595a0 msgr2=0x7f8bc015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bb5d9b700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bc01595a0 0x7f8bc015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bb5d9b700 1 -- 172.21.15.84:0/637842141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8009a20 con 0x7f8bc00b49e0 2023-10-06T02:57:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bb5d9b700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b49e0 0x7f8bc0157b10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c810 tx=0x7f8ba8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bb6ffd700 1 -- 172.21.15.84:0/637842141 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8005c00 con 0x7f8bc00b49e0 2023-10-06T02:57:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bb6ffd700 1 -- 172.21.15.84:0/637842141 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba8005d60 con 0x7f8bc00b49e0 2023-10-06T02:57:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bb6ffd700 1 -- 172.21.15.84:0/637842141 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80072e0 con 0x7f8bc00b49e0 2023-10-06T02:57:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc009acb0 con 0x7f8bc00b49e0 2023-10-06T02:57:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.629+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc015c640 con 0x7f8bc00b49e0 2023-10-06T02:57:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.630+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc009aea0 con 0x7f8bc00b49e0 2023-10-06T02:57:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.630+0000 7f8bb6ffd700 1 -- 172.21.15.84:0/637842141 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ba801b3b0 con 0x7f8bc00b49e0 2023-10-06T02:57:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.631+0000 7f8bb6ffd700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ba0066f30 0x7f8ba00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.631+0000 7f8bb6ffd700 1 -- 172.21.15.84:0/637842141 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8ba8083c20 con 0x7f8bc00b49e0 2023-10-06T02:57:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.631+0000 7f8bbe59c700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ba0066f30 0x7f8ba00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.631+0000 7f8bbe59c700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ba0066f30 0x7f8ba00693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009720 tx=0x7f8bb0006c30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:38.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.635+0000 7f8bb6ffd700 1 -- 172.21.15.84:0/637842141 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ba804b5a0 con 0x7f8bc00b49e0 2023-10-06T02:57:38.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.859+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bc0064ad0 con 0x7f8bc00b49e0 2023-10-06T02:57:38.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.859+0000 7f8bb6ffd700 1 -- 172.21.15.84:0/637842141 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f8ba8017090 con 0x7f8bc00b49e0 2023-10-06T02:57:38.861 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:38.861 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5778,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:57:32.169083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:57:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.861+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ba0066f30 msgr2=0x7f8ba00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.861+0000 7f8bc4a97700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ba0066f30 0x7f8ba00693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009720 tx=0x7f8bb0006c30 comp rx=0 tx=0).stop 2023-10-06T02:57:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.861+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b49e0 msgr2=0x7f8bc0157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.861+0000 7f8bc4a97700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b49e0 0x7f8bc0157b10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c810 tx=0x7f8ba8007d90 comp rx=0 tx=0).stop 2023-10-06T02:57:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.861+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 shutdown_connections 2023-10-06T02:57:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.861+0000 7f8bc4a97700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ba0066f30 0x7f8ba00693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.862+0000 7f8bc4a97700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bc01595a0 0x7f8bc015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.862+0000 7f8bc4a97700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8bc00b07a0 0x7f8bc015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.862+0000 7f8bc4a97700 1 --2- 172.21.15.84:0/637842141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bc00b49e0 0x7f8bc0157b10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.862+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 >> 172.21.15.84:0/637842141 conn(0x7f8bc0099830 msgr2=0x7f8bc00b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.862+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 shutdown_connections 2023-10-06T02:57:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:38.862+0000 7f8bc4a97700 1 -- 172.21.15.84:0/637842141 wait complete. 2023-10-06T02:57:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 34 2023-10-06T02:57:39.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:57:28.525780+0000', 'modified': '2023-10-06T02:57:32.169083+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5781}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5781': {'gid': 5781, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6836/1444717080', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1444717080}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 1444717080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:57:39.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:57:39.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:57:39.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.393+0000 7f0f8bfff700 1 Processor -- start 2023-10-06T02:57:39.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.393+0000 7f0f8bfff700 1 -- start start 2023-10-06T02:57:39.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.394+0000 7f0f8bfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0f8c159480 0x7f0f8c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.394+0000 7f0f8bfff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8c0cb7e0 con 0x7f0f8c0b2140 2023-10-06T02:57:39.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.394+0000 7f0f8bfff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8c0b08a0 con 0x7f0f8c0b3610 2023-10-06T02:57:39.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.394+0000 7f0f8bfff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8c0cb190 con 0x7f0f8c159480 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.394+0000 7f0f8b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0f8c0b2140 0x7f0f8c0b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48186/0 (socket says 172.21.15.84:48186) 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.394+0000 7f0f8b7fe700 1 -- 172.21.15.84:0/3492552976 learned_addr learned my addr 172.21.15.84:0/3492552976 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.394+0000 7f0f8affd700 1 --2- 172.21.15.84:0/3492552976 >> v2:172.21.15.131:3300/0 conn(0x7f0f8c159480 0x7f0f8c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.394+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849988966 0 0) 0x7f0f8c0cb7e0 con 0x7f0f8c0b2140 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.394+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f78003570 con 0x7f0f8c0b2140 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3331890365 0 0) 0x7f0f78003570 con 0x7f0f8c0b2140 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 >> v2:172.21.15.131:3300/0 conn(0x7f0f8c159480 msgr2=0x7f0f8c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 --2- 172.21.15.84:0/3492552976 >> v2:172.21.15.131:3300/0 conn(0x7f0f8c159480 0x7f0f8c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 >> v1:172.21.15.131:6789/0 conn(0x7f0f8c0b3610 legacy=0x7f0f8c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c0cb470 con 0x7f0f8c0b2140 2023-10-06T02:57:39.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f0f840017f0 con 0x7f0f8c0b2140 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 >> v1:172.21.15.84:6789/0 conn(0x7f0f8c0b2140 legacy=0x7f0f8c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f78003a60 0x7f0f78003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f78004810 0x7f0f78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f780051c0 0x7f0f7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0cb190 con 0x7f0f78003a60 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7800c0e0 con 0x7f0f78004810 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7800c2a0 con 0x7f0f780051c0 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8affd700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f78003a60 0x7f0f78003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f827fc700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f78004810 0x7f0f78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8affd700 1 -- 172.21.15.84:0/3492552976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f780051c0 msgr2=0x7f0f7800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8affd700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f780051c0 0x7f0f7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8affd700 1 -- 172.21.15.84:0/3492552976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f78004810 msgr2=0x7f0f78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8affd700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f78004810 0x7f0f78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8affd700 1 -- 172.21.15.84:0/3492552976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f78003570 con 0x7f0f78003a60 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8b7fe700 1 -- 172.21.15.84:0/3492552976 reap_dead start 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8affd700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f78003a60 0x7f0f78003e30 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009c00 tx=0x7f0f7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda6e4c2b950b918 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00e710 con 0x7f0f78003a60 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c00e870 con 0x7f0f78003a60 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.395+0000 7f0f8a7fc700 1 -- 172.21.15.84:0/3492552976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00ec30 con 0x7f0f78003a60 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.396+0000 7f0f8bfff700 1 -- 172.21.15.84:0/3492552976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f78003a60 msgr2=0x7f0f78003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.396+0000 7f0f8bfff700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f78003a60 0x7f0f78003e30 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009c00 tx=0x7f0f7c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.396+0000 7f0f8bfff700 1 -- 172.21.15.84:0/3492552976 shutdown_connections 2023-10-06T02:57:39.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.396+0000 7f0f8bfff700 1 --2- 172.21.15.84:0/3492552976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f78003a60 0x7f0f78003e30 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.396+0000 7f0f8bfff700 1 -- 172.21.15.84:0/3492552976 >> 172.21.15.84:0/3492552976 conn(0x7f0f8c06ed20 msgr2=0x7f0f8c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.396+0000 7f0f8bfff700 1 -- 172.21.15.84:0/3492552976 shutdown_connections 2023-10-06T02:57:39.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.396+0000 7f0f8bfff700 1 -- 172.21.15.84:0/3492552976 wait complete. 2023-10-06T02:57:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.397+0000 7f0f8bfff700 1 Processor -- start 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.397+0000 7f0f8bfff700 1 -- start start 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f8bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f78003a60 0x7f0f8c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f8bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c0d0980 0x7f0f8c0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f8bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8c0b4e30 0x7f0f8c0b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f8bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0b57e0 con 0x7f0f8c0d0980 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f8bfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0c6450 con 0x7f0f78003a60 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f8bfff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0c9180 con 0x7f0f8c0b4e30 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f827fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c0d0980 0x7f0f8c0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f827fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c0d0980 0x7f0f8c0c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57994/0 (socket says 172.21.15.84:57994) 2023-10-06T02:57:39.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f827fc700 1 -- 172.21.15.84:0/1388215649 learned_addr learned my addr 172.21.15.84:0/1388215649 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f8b7fe700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8c0b4e30 0x7f0f8c0b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f8affd700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f78003a60 0x7f0f8c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f827fc700 1 -- 172.21.15.84:0/1388215649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8c0b4e30 msgr2=0x7f0f8c0b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f827fc700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8c0b4e30 0x7f0f8c0b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f827fc700 1 -- 172.21.15.84:0/1388215649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f78003a60 msgr2=0x7f0f8c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f827fc700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f78003a60 0x7f0f8c0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f827fc700 1 -- 172.21.15.84:0/1388215649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c0ca120 con 0x7f0f8c0d0980 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.398+0000 7f0f827fc700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c0d0980 0x7f0f8c0c9540 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0f74002ad0 tx=0x7f0f74007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.399+0000 7f0f837fe700 1 -- 172.21.15.84:0/1388215649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400f940 con 0x7f0f8c0d0980 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.399+0000 7f0f837fe700 1 -- 172.21.15.84:0/1388215649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7400faa0 con 0x7f0f8c0d0980 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.399+0000 7f0f8bfff700 1 -- 172.21.15.84:0/1388215649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8c0c9e40 con 0x7f0f8c0d0980 2023-10-06T02:57:39.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.399+0000 7f0f837fe700 1 -- 172.21.15.84:0/1388215649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400fe60 con 0x7f0f8c0d0980 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.399+0000 7f0f8bfff700 1 -- 172.21.15.84:0/1388215649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c0c60e0 con 0x7f0f8c0d0980 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.400+0000 7f0f837fe700 1 -- 172.21.15.84:0/1388215649 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f74013600 con 0x7f0f8c0d0980 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.400+0000 7f0f837fe700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f6c066f30 0x7f0f6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.401+0000 7f0f837fe700 1 -- 172.21.15.84:0/1388215649 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0f74084e00 con 0x7f0f8c0d0980 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.401+0000 7f0f8affd700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f6c066f30 0x7f0f6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.401+0000 7f0f8affd700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f6c066f30 0x7f0f6c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0091e0 tx=0x7f0f7c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.402+0000 7f0f9a672b80 1 Processor -- start 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f9a672b80 1 -- start start 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fab1e50 0x56360fa8ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa922c0 0x56360fa8d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa93a10 0x56360fa8d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56360f9e7a70 con 0x56360fab1e50 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56360f9e5270 con 0x56360fa922c0 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56360f9e1060 con 0x56360fa93a10 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f8affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fab1e50 0x56360fa8ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f8affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fab1e50 0x56360fa8ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57996/0 (socket says 172.21.15.84:57996) 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.403+0000 7f0f8affd700 1 -- 172.21.15.84:0/1614693421 learned_addr learned my addr 172.21.15.84:0/1614693421 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f8affd700 1 -- 172.21.15.84:0/1614693421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa93a10 msgr2=0x56360fa8d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f8affd700 1 --2- 172.21.15.84:0/1614693421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa93a10 0x56360fa8d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f8affd700 1 -- 172.21.15.84:0/1614693421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa922c0 msgr2=0x56360fa8d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f8affd700 1 --2- 172.21.15.84:0/1614693421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa922c0 0x56360fa8d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f8affd700 1 -- 172.21.15.84:0/1614693421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56360f87b270 con 0x56360fab1e50 2023-10-06T02:57:39.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f8affd700 1 --2- 172.21.15.84:0/1614693421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fab1e50 0x56360fa8ccc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e4b0 tx=0x7f0f7c01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d364db78377983a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f6bfff700 1 -- 172.21.15.84:0/1614693421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c030070 con 0x56360fab1e50 2023-10-06T02:57:39.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f6bfff700 1 -- 172.21.15.84:0/1614693421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c023040 con 0x56360fab1e50 2023-10-06T02:57:39.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f6bfff700 1 -- 172.21.15.84:0/1614693421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c013470 con 0x56360fab1e50 2023-10-06T02:57:39.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f9a672b80 1 -- 172.21.15.84:0/1614693421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fab1e50 msgr2=0x56360fa8ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.404+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/1614693421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fab1e50 0x56360fa8ccc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e4b0 tx=0x7f0f7c01f050 comp rx=0 tx=0).stop 2023-10-06T02:57:39.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.405+0000 7f0f9a672b80 1 -- 172.21.15.84:0/1614693421 shutdown_connections 2023-10-06T02:57:39.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.405+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/1614693421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa93a10 0x56360fa8d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.405+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/1614693421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fab1e50 0x56360fa8ccc0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.405+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/1614693421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa922c0 0x56360fa8d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.405+0000 7f0f9a672b80 1 -- 172.21.15.84:0/1614693421 >> 172.21.15.84:0/1614693421 conn(0x56360fa91e80 msgr2=0x56360fa926b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.405+0000 7f0f9a672b80 1 -- 172.21.15.84:0/1614693421 shutdown_connections 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.405+0000 7f0f9a672b80 1 -- 172.21.15.84:0/1614693421 wait complete. 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.405+0000 7f0f9a672b80 1 -- start start 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.405+0000 7f0f9a672b80 1 Processor -- start 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fae7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa93a10 0x56360faa96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fab1e50 0x56360fabf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56360f98c890 con 0x56360fa922c0 2023-10-06T02:57:39.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56360f9a7ea0 con 0x56360fab1e50 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56360f863e30 con 0x56360fa93a10 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f9a672b80 10 client.0 _ll_register_callbacks cb 0x56360fa54020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f8affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fae7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f8affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fae7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58004/0 (socket says 172.21.15.84:58004) 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f8affd700 1 -- 172.21.15.84:0/2763436935 learned_addr learned my addr 172.21.15.84:0/2763436935 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f8b7fe700 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fab1e50 0x56360fabf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f827fc700 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa93a10 0x56360faa96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f8affd700 1 -- 172.21.15.84:0/2763436935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa93a10 msgr2=0x56360faa96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f8affd700 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa93a10 0x56360faa96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f8affd700 1 -- 172.21.15.84:0/2763436935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fab1e50 msgr2=0x56360fabf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f8affd700 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fab1e50 0x56360fabf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.406+0000 7f0f8affd700 1 -- 172.21.15.84:0/2763436935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f78003570 con 0x56360fa922c0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f8affd700 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fae7680 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e840 tx=0x7f0f7c02d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598eb66cea9be4f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f697fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f697fa700 1 -- 172.21.15.84:0/2763436935 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c030040 con 0x56360fa922c0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f697fa700 1 -- 172.21.15.84:0/2763436935 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0f7c01c450 con 0x56360fa922c0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f9a672b80 1 -- 172.21.15.84:0/2763436935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56360fa85940 con 0x56360fa922c0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f697fa700 1 -- 172.21.15.84:0/2763436935 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f7c00ee30 con 0x56360fa922c0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f9a672b80 10 client.5967 fetch_fsmap learned FSMap version 34 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f9a672b80 1 -- 172.21.15.84:0/2763436935 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x56360f81dfe0 con 0x56360fa922c0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f697fa700 1 -- 172.21.15.84:0/2763436935 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56360fa85940 con 0x56360fa922c0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f697fa700 1 -- 172.21.15.84:0/2763436935 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0f7c01c820 con 0x56360fa922c0 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f9a672b80 10 client.5967 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T02:57:39.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f9a672b80 10 client.5967 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f9a672b80 20 client.5967 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x56360faad220 0x56360faaa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f9a672b80 4 client.5967 mds_command: new command op to 5781 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f9a672b80 1 -- 172.21.15.84:0/2763436935 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56360fa62870 con 0x56360faad220 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.407+0000 7f0f827fc700 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x56360faad220 0x56360faaa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.408+0000 7f0f697fa700 10 client.5967 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.408+0000 7f0f827fc700 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x56360faad220 0x56360faaa630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e4145b7e58feb2 server_cookie=4143489a4b9b140e in_seq=0 out_seq=0 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.408+0000 7f0f697fa700 1 -- 172.21.15.84:0/2763436935 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56360fa62870 con 0x56360faad220 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.408+0000 7f0f697fa700 10 client.5967 handle_command_reply: tid=0 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.408+0000 7f0f9a672b80 1 client.5967 shutdown 2023-10-06T02:57:39.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.408+0000 7f0f9a672b80 1 -- 172.21.15.84:0/2763436935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 msgr2=0x56360fae7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.408+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fae7680 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e840 tx=0x7f0f7c02d050 comp rx=0 tx=0).stop 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f9a672b80 1 -- 172.21.15.84:0/2763436935 shutdown_connections 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x56360faad220 0x56360faaa630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fab1e50 0x56360fabf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fae7680 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/2763436935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa93a10 0x56360faa96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f697fa700 0 client.5967 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f9a672b80 1 -- 172.21.15.84:0/2763436935 >> 172.21.15.84:0/2763436935 conn(0x56360fa91e80 msgr2=0x56360fa90e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f9a672b80 1 -- 172.21.15.84:0/2763436935 shutdown_connections 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f9a672b80 1 -- 172.21.15.84:0/2763436935 wait complete. 2023-10-06T02:57:39.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.409+0000 7f0f9a672b80 20 client.5967 trim_cache size 0 max 16384 2023-10-06T02:57:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.425+0000 7f0f9a672b80 1 Processor -- start 2023-10-06T02:57:39.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.425+0000 7f0f9a672b80 1 -- start start 2023-10-06T02:57:39.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa922c0 0x56360fa875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa93a10 0x56360faa96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fab1e50 0x56360faf1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56360fac1160 con 0x56360fa93a10 2023-10-06T02:57:39.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56360fa94930 con 0x56360fab1e50 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56360fa85700 con 0x56360fa922c0 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f827fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa93a10 0x56360faa96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f827fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa93a10 0x56360faa96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58018/0 (socket says 172.21.15.84:58018) 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f827fc700 1 -- 172.21.15.84:0/745376208 learned_addr learned my addr 172.21.15.84:0/745376208 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f827fc700 1 -- 172.21.15.84:0/745376208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa922c0 msgr2=0x56360fa875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f827fc700 1 --2- 172.21.15.84:0/745376208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa922c0 0x56360fa875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f827fc700 1 -- 172.21.15.84:0/745376208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fab1e50 msgr2=0x56360faf1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f827fc700 1 --2- 172.21.15.84:0/745376208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fab1e50 0x56360faf1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f827fc700 1 -- 172.21.15.84:0/745376208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56360f9af780 con 0x56360fa93a10 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f827fc700 1 --2- 172.21.15.84:0/745376208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa93a10 0x56360faa96e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400f4b0 tx=0x7f0f7401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af68907cb62c3a9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f80ff9700 1 -- 172.21.15.84:0/745376208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7405ca30 con 0x56360fa93a10 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f80ff9700 1 -- 172.21.15.84:0/745376208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f74083190 con 0x56360fa93a10 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.426+0000 7f0f80ff9700 1 -- 172.21.15.84:0/745376208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74053e30 con 0x56360fa93a10 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.427+0000 7f0f9a672b80 1 -- 172.21.15.84:0/745376208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa93a10 msgr2=0x56360faa96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.427+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/745376208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa93a10 0x56360faa96e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400f4b0 tx=0x7f0f7401e040 comp rx=0 tx=0).stop 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.427+0000 7f0f9a672b80 1 -- 172.21.15.84:0/745376208 shutdown_connections 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.427+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/745376208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fab1e50 0x56360faf1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.427+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/745376208 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fa922c0 0x56360fa875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.427+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/745376208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa93a10 0x56360faa96e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.427+0000 7f0f9a672b80 1 -- 172.21.15.84:0/745376208 >> 172.21.15.84:0/745376208 conn(0x56360fa91e80 msgr2=0x56360fae9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.427+0000 7f0f9a672b80 1 -- 172.21.15.84:0/745376208 shutdown_connections 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.427+0000 7f0f9a672b80 1 -- 172.21.15.84:0/745376208 wait complete. 2023-10-06T02:57:39.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.428+0000 7f0f9a672b80 1 -- start start 2023-10-06T02:57:39.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.428+0000 7f0f9a672b80 1 Processor -- start 2023-10-06T02:57:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.428+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fa8cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.428+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa93a10 0x56360fb39510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.428+0000 7f0f9a672b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fab1e50 0x56360faa9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.428+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56360fb3ccb0 con 0x56360fa922c0 2023-10-06T02:57:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.428+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56360fa8d010 con 0x56360fa93a10 2023-10-06T02:57:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.428+0000 7f0f9a672b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56360fa87ae0 con 0x56360fab1e50 2023-10-06T02:57:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f9a672b80 10 client.0 _ll_register_callbacks cb 0x56360fa54020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fa8cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fa8cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58028/0 (socket says 172.21.15.84:58028) 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8affd700 1 -- 172.21.15.84:0/3672577378 learned_addr learned my addr 172.21.15.84:0/3672577378 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f827fc700 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa93a10 0x56360fb39510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8b7fe700 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fab1e50 0x56360faa9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8affd700 1 -- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fab1e50 msgr2=0x56360faa9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8affd700 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fab1e50 0x56360faa9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8affd700 1 -- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa93a10 msgr2=0x56360fb39510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8affd700 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa93a10 0x56360fb39510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8affd700 1 -- 172.21.15.84:0/3672577378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c0c60e0 con 0x56360fa922c0 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f827fc700 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa93a10 0x56360fb39510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8b7fe700 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fab1e50 0x56360faa9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f8affd700 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fa8cad0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e5b0 tx=0x7f0f7c01e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0f10605bbde5eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f697fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f697fa700 1 -- 172.21.15.84:0/3672577378 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c030040 con 0x56360fa922c0 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f697fa700 1 -- 172.21.15.84:0/3672577378 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0f7c01c450 con 0x56360fa922c0 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f9a672b80 1 -- 172.21.15.84:0/3672577378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f7c023040 con 0x56360fa922c0 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f697fa700 1 -- 172.21.15.84:0/3672577378 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f7c00edb0 con 0x56360fa922c0 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f9a672b80 10 client.5973 fetch_fsmap learned FSMap version 34 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f9a672b80 1 -- 172.21.15.84:0/3672577378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x56360f996470 con 0x56360fa922c0 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f697fa700 1 -- 172.21.15.84:0/3672577378 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c023040 con 0x56360fa922c0 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f697fa700 1 -- 172.21.15.84:0/3672577378 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0f7c03c910 con 0x56360fa922c0 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.429+0000 7f0f9a672b80 10 client.5973 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 10 client.5973 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:57:39.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 20 client.5973 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x56360fad5550 0x56360fad5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 4 client.5973 mds_command: new command op to 5781 tid=0[{"prefix": "status"}] 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 -- 172.21.15.84:0/3672577378 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56360f983e00 con 0x56360fad5550 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f827fc700 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x56360fad5550 0x56360fad5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f827fc700 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x56360fad5550 0x56360fad5920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a716b056e8d7f56 server_cookie=dfa578fd52c227ac in_seq=0 out_seq=0 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f697fa700 10 client.5973 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f697fa700 1 -- 172.21.15.84:0/3672577378 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56360f983e00 con 0x56360fad5550 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f697fa700 10 client.5973 handle_command_reply: tid=0 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 client.5973 shutdown 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 -- 172.21.15.84:0/3672577378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 msgr2=0x56360fa8cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fa8cad0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e5b0 tx=0x7f0f7c01e050 comp rx=0 tx=0).stop 2023-10-06T02:57:39.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 -- 172.21.15.84:0/3672577378 shutdown_connections 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56360fab1e50 0x56360faa9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56360fa922c0 0x56360fa8cad0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x56360fad5550 0x56360fad5920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 --2- 172.21.15.84:0/3672577378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56360fa93a10 0x56360fb39510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 -- 172.21.15.84:0/3672577378 >> 172.21.15.84:0/3672577378 conn(0x56360fa91e80 msgr2=0x56360fa8dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f697fa700 0 client.5973 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 -- 172.21.15.84:0/3672577378 shutdown_connections 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.430+0000 7f0f9a672b80 1 -- 172.21.15.84:0/3672577378 wait complete. 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f9a672b80 20 client.5973 trim_cache size 0 max 16384 2023-10-06T02:57:39.440 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5781, 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 10.275577341, 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 34, 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 56, 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 56, 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 23.016045586000001 2023-10-06T02:57:39.441 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:57:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 -- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f6c066f30 msgr2=0x7f0f6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f6c066f30 0x7f0f6c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0091e0 tx=0x7f0f7c01a000 comp rx=0 tx=0).stop 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 -- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c0d0980 msgr2=0x7f0f8c0c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c0d0980 0x7f0f8c0c9540 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0f74002ad0 tx=0x7f0f74007d10 comp rx=0 tx=0).stop 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 -- 172.21.15.84:0/1388215649 shutdown_connections 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0f6c066f30 0x7f0f6c0693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f78003a60 0x7f0f8c0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f8c0b4e30 0x7f0f8c0b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 --2- 172.21.15.84:0/1388215649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c0d0980 0x7f0f8c0c9540 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 -- 172.21.15.84:0/1388215649 >> 172.21.15.84:0/1388215649 conn(0x7f0f8c06ed20 msgr2=0x7f0f8c0b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 -- 172.21.15.84:0/1388215649 shutdown_connections 2023-10-06T02:57:39.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.431+0000 7f0f8bfff700 1 -- 172.21.15.84:0/1388215649 wait complete. 2023-10-06T02:57:39.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:57:39.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.556+0000 7fa1398db700 1 Processor -- start 2023-10-06T02:57:39.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.556+0000 7fa1398db700 1 -- start start 2023-10-06T02:57:39.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.557+0000 7fa1398db700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa1340b49e0 0x7fa1340aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.557+0000 7fa1398db700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1340b0ca0 con 0x7fa1341595a0 2023-10-06T02:57:39.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.557+0000 7fa1398db700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1340b0f80 con 0x7fa1340b07a0 2023-10-06T02:57:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.557+0000 7fa1398db700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1340b1260 con 0x7fa1340b49e0 2023-10-06T02:57:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.557+0000 7fa132ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa1341595a0 0x7fa1340aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48188/0 (socket says 172.21.15.84:48188) 2023-10-06T02:57:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.557+0000 7fa132ffd700 1 -- 172.21.15.84:0/1144111108 learned_addr learned my addr 172.21.15.84:0/1144111108 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.557+0000 7fa12a7fc700 1 --2- 172.21.15.84:0/1144111108 >> v2:172.21.15.131:3300/0 conn(0x7fa1340b49e0 0x7fa1340aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.557+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378588085 0 0) 0x7fa1340b0ca0 con 0x7fa1341595a0 2023-10-06T02:57:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.557+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa120003570 con 0x7fa1341595a0 2023-10-06T02:57:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1683095186 0 0) 0x7fa120003570 con 0x7fa1341595a0 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 >> v2:172.21.15.131:3300/0 conn(0x7fa1340b49e0 msgr2=0x7fa1340aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 --2- 172.21.15.84:0/1144111108 >> v2:172.21.15.131:3300/0 conn(0x7fa1340b49e0 0x7fa1340aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 >> v1:172.21.15.131:6789/0 conn(0x7fa1340b07a0 legacy=0x7fa1340b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340b1540 con 0x7fa1341595a0 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fa1240015f0 con 0x7fa1341595a0 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 >> v1:172.21.15.84:6789/0 conn(0x7fa1341595a0 legacy=0x7fa1340aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa120003a90 0x7fa120003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa120004810 0x7fa120004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa120005210 0x7fa12000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340b1260 con 0x7fa120005210 2023-10-06T02:57:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000c130 con 0x7fa120004810 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000c2c0 con 0x7fa120003a90 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1337fe700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa120005210 0x7fa12000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa12a7fc700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa120004810 0x7fa120004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa132ffd700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa120003a90 0x7fa120003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1337fe700 1 -- 172.21.15.84:0/1144111108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa120003a90 msgr2=0x7fa120003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1337fe700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa120003a90 0x7fa120003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1337fe700 1 -- 172.21.15.84:0/1144111108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa120004810 msgr2=0x7fa120004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1337fe700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa120004810 0x7fa120004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1337fe700 1 -- 172.21.15.84:0/1144111108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa120003570 con 0x7fa120005210 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1337fe700 1 -- 172.21.15.84:0/1144111108 reap_dead start 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.558+0000 7fa1337fe700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa120005210 0x7fa12000ba60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa12c001ff0 tx=0x7fa12c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc46e35072d35935 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c001950 con 0x7fa120005210 2023-10-06T02:57:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c00c870 con 0x7fa120005210 2023-10-06T02:57:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1327fc700 1 -- 172.21.15.84:0/1144111108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00cc10 con 0x7fa120005210 2023-10-06T02:57:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1398db700 1 -- 172.21.15.84:0/1144111108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa120005210 msgr2=0x7fa12000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1398db700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa120005210 0x7fa12000ba60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa12c001ff0 tx=0x7fa12c001640 comp rx=0 tx=0).stop 2023-10-06T02:57:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1398db700 1 -- 172.21.15.84:0/1144111108 shutdown_connections 2023-10-06T02:57:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1398db700 1 --2- 172.21.15.84:0/1144111108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa120005210 0x7fa12000ba60 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1398db700 1 -- 172.21.15.84:0/1144111108 >> 172.21.15.84:0/1144111108 conn(0x7fa134099830 msgr2=0x7fa13406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1398db700 1 -- 172.21.15.84:0/1144111108 shutdown_connections 2023-10-06T02:57:39.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.559+0000 7fa1398db700 1 -- 172.21.15.84:0/1144111108 wait complete. 2023-10-06T02:57:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.560+0000 7fa1398db700 1 Processor -- start 2023-10-06T02:57:39.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.560+0000 7fa1398db700 1 -- start start 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1398db700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa120005210 0x7fa13409cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1398db700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa134099f90 0x7fa13416a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1398db700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa13409a400 0x7fa13416a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1398db700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13409d0a0 con 0x7fa13409a400 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1398db700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13409a8e0 con 0x7fa120005210 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1398db700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13409abc0 con 0x7fa134099f90 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa13409a400 0x7fa13416a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa13409a400 0x7fa13416a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58056/0 (socket says 172.21.15.84:58056) 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1337fe700 1 -- 172.21.15.84:0/3932479019 learned_addr learned my addr 172.21.15.84:0/3932479019 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1337fe700 1 -- 172.21.15.84:0/3932479019 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa134099f90 msgr2=0x7fa13416a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1337fe700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa134099f90 0x7fa13416a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1337fe700 1 -- 172.21.15.84:0/3932479019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa120005210 msgr2=0x7fa13409cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1337fe700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa120005210 0x7fa13409cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.561+0000 7fa1337fe700 1 -- 172.21.15.84:0/3932479019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13409aea0 con 0x7fa13409a400 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.562+0000 7fa1337fe700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa13409a400 0x7fa13416a6d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa1340b2f50 tx=0x7fa12c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.562+0000 7fa12b7fe700 1 -- 172.21.15.84:0/3932479019 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c001950 con 0x7fa13409a400 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.562+0000 7fa12b7fe700 1 -- 172.21.15.84:0/3932479019 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c01e640 con 0x7fa13409a400 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.562+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13409b180 con 0x7fa13409a400 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.562+0000 7fa12b7fe700 1 -- 172.21.15.84:0/3932479019 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00cee0 con 0x7fa13409a400 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.562+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13416add0 con 0x7fa13409a400 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.563+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1340b5760 con 0x7fa13409a400 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.563+0000 7fa12b7fe700 1 -- 172.21.15.84:0/3932479019 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa12c01ecf0 con 0x7fa13409a400 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.564+0000 7fa12b7fe700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa114066f30 0x7fa1140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:39.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.564+0000 7fa12b7fe700 1 -- 172.21.15.84:0/3932479019 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa12c0863d0 con 0x7fa13409a400 2023-10-06T02:57:39.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.564+0000 7fa132ffd700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa114066f30 0x7fa1140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:39.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.564+0000 7fa132ffd700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa114066f30 0x7fa1140693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa124000ef0 tx=0x7fa124009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:39.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.568+0000 7fa12b7fe700 1 -- 172.21.15.84:0/3932479019 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa12c0533a0 con 0x7fa13409a400 2023-10-06T02:57:39.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.792+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa1340cc9b0 con 0x7fa13409a400 2023-10-06T02:57:39.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.793+0000 7fa12b7fe700 1 -- 172.21.15.84:0/3932479019 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa12c017070 con 0x7fa13409a400 2023-10-06T02:57:39.795 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:57:39.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa114066f30 msgr2=0x7fa1140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa114066f30 0x7fa1140693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa124000ef0 tx=0x7fa124009040 comp rx=0 tx=0).stop 2023-10-06T02:57:39.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa13409a400 msgr2=0x7fa13416a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:39.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa13409a400 0x7fa13416a6d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa1340b2f50 tx=0x7fa12c015000 comp rx=0 tx=0).stop 2023-10-06T02:57:39.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 shutdown_connections 2023-10-06T02:57:39.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa114066f30 0x7fa1140693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa120005210 0x7fa13409cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa13409a400 0x7fa13416a6d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 --2- 172.21.15.84:0/3932479019 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa134099f90 0x7fa13416a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:39.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 >> 172.21.15.84:0/3932479019 conn(0x7fa134099830 msgr2=0x7fa134158b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:39.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 shutdown_connections 2023-10-06T02:57:39.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:39.795+0000 7fa1398db700 1 -- 172.21.15.84:0/3932479019 wait complete. 2023-10-06T02:57:39.808 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:57:39.808 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:57:39.809 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T02:57:39.809 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:57:39.809 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:39.809 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:57:39.809 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:57:39.809 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:57:39.809 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:57:39.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:39.810 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T02:57:39.825 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:57:39.825 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:57:39.825 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:57:39.825 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:39.825 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T02:57:39.825 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:57:39.826 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42349sec preferred_lft 42349sec 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c4d3:64ff:fe4d:ee22/64 scope link 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::41f:f5ff:fe77:615a/64 scope link 2023-10-06T02:57:39.827 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:39.828 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:57:39.828 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 66:ce:03:f1:65:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:57:39.828 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::64ce:3ff:fef1:6538/64 scope link 2023-10-06T02:57:39.828 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:57:39.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:39.828 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:57:39.889 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T02:57:39.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:39.890 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:57:39.947 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:57:39.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:39.948 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:57:39.948 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:57:39.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:57:39.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:57:39.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:57:39.948 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:57:40.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:40.047 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T02:57:40.062 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:57:40.062 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:57:40.062 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:57:40.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:40.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T02:57:40.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:57:40.126 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:40.181 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:57:40.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:57:40.181 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:40.236 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T02:57:40.292 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:57:40.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:57:40.332 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:57:40.332 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:57:40.332 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:57:40.341 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:57:40.341 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:57:40.341 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:57:40.341 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:57:40.342 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:57:40.363 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:57:40.363 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:57:40.364 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:57:40.364 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:57:40.364 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:57:40.364 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T02:57:40.364 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T02:57:40.364 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T02:57:40.365 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:57:40.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:57:40.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:57:40.430 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-10-06T02:57:40.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.585+0000 7f8b1759e700 1 Processor -- start 2023-10-06T02:57:40.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.585+0000 7f8b1759e700 1 -- start start 2023-10-06T02:57:40.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.586+0000 7f8b1759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b18140ab0 0x7f8b180ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.586+0000 7f8b1759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180cc680 con 0x7f8b180caf80 2023-10-06T02:57:40.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.586+0000 7f8b1759e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180ccc20 con 0x7f8b18140e80 2023-10-06T02:57:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.586+0000 7f8b1759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180c9e30 con 0x7f8b18140ab0 2023-10-06T02:57:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.586+0000 7f8b16d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8b180caf80 0x7f8b180ad760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48198/0 (socket says 172.21.15.84:48198) 2023-10-06T02:57:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.586+0000 7f8b16d9d700 1 -- 172.21.15.84:0/2035573145 learned_addr learned my addr 172.21.15.84:0/2035573145 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.586+0000 7f8b1659c700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b18140ab0 0x7f8b180ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.586+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528780817 0 0) 0x7f8b180cc680 con 0x7f8b180caf80 2023-10-06T02:57:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b04003570 con 0x7f8b180caf80 2023-10-06T02:57:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 462333611 0 0) 0x7f8b04003570 con 0x7f8b180caf80 2023-10-06T02:57:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b18140ab0 msgr2=0x7f8b180ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b18140ab0 0x7f8b180ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 >> v1:172.21.15.131:6789/0 conn(0x7f8b18140e80 legacy=0x7f8b180ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180cd0b0 con 0x7f8b180caf80 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f8b100017f0 con 0x7f8b180caf80 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 >> v1:172.21.15.84:6789/0 conn(0x7f8b180caf80 legacy=0x7f8b180ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b04003a90 0x7f8b04003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b04004810 0x7f8b04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b18140ab0 0x7f8b040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0400bb10 con 0x7f8b04004810 2023-10-06T02:57:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0400bc50 con 0x7f8b04003a90 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0400be10 con 0x7f8b18140ab0 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b0dd9b700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b04004810 0x7f8b04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b1659c700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b04003a90 0x7f8b04003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b18140ab0 0x7f8b040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b0dd9b700 1 -- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b18140ab0 msgr2=0x7f8b040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b0dd9b700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b18140ab0 0x7f8b040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b0dd9b700 1 -- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b04003a90 msgr2=0x7f8b04003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b0dd9b700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b04003a90 0x7f8b04003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b0dd9b700 1 -- 172.21.15.84:0/2035573145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04003570 con 0x7f8b04004810 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b18140ab0 0x7f8b040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b0dd9b700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b04004810 0x7f8b04004c80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8b00001a60 tx=0x7f8b00007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2579ad1418e6720 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.587+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00001ea0 con 0x7f8b04004810 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.588+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0000c590 con 0x7f8b04004810 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.588+0000 7f8b15d9b700 1 -- 172.21.15.84:0/2035573145 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000c930 con 0x7f8b04004810 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.588+0000 7f8b1759e700 1 -- 172.21.15.84:0/2035573145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b04004810 msgr2=0x7f8b04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.588+0000 7f8b1759e700 1 --2- 172.21.15.84:0/2035573145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b04004810 0x7f8b04004c80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8b00001a60 tx=0x7f8b00007d30 comp rx=0 tx=0).stop 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.588+0000 7f8b16d9d700 1 -- 172.21.15.84:0/2035573145 reap_dead start 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.588+0000 7f8b1759e700 1 -- 172.21.15.84:0/2035573145 shutdown_connections 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.588+0000 7f8b1759e700 1 -- 172.21.15.84:0/2035573145 >> 172.21.15.84:0/2035573145 conn(0x7f8b1806b370 msgr2=0x7f8b1806b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.588+0000 7f8b1759e700 1 -- 172.21.15.84:0/2035573145 shutdown_connections 2023-10-06T02:57:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.588+0000 7f8b1759e700 1 -- 172.21.15.84:0/2035573145 wait complete. 2023-10-06T02:57:40.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.589+0000 7f8b1759e700 1 Processor -- start 2023-10-06T02:57:40.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.589+0000 7f8b1759e700 1 -- start start 2023-10-06T02:57:40.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b1759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b04004810 0x7f8b18158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b1759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b180c6a50 0x7f8b180c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b1759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b1813e7d0 0x7f8b1813ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b1759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18158f40 con 0x7f8b1813e7d0 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b1759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1813f190 con 0x7f8b180c6a50 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b1759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180ad940 con 0x7f8b04004810 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b16d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b1813e7d0 0x7f8b1813ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b16d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b1813e7d0 0x7f8b1813ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58076/0 (socket says 172.21.15.84:58076) 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b16d9d700 1 -- 172.21.15.84:0/3367407801 learned_addr learned my addr 172.21.15.84:0/3367407801 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b0dd9b700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b180c6a50 0x7f8b180c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.590+0000 7f8b1659c700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b04004810 0x7f8b18158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b16d9d700 1 -- 172.21.15.84:0/3367407801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b04004810 msgr2=0x7f8b18158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b04004810 0x7f8b18158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b16d9d700 1 -- 172.21.15.84:0/3367407801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b180c6a50 msgr2=0x7f8b180c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b180c6a50 0x7f8b180c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b16d9d700 1 -- 172.21.15.84:0/3367407801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180c7510 con 0x7f8b1813e7d0 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b1813e7d0 0x7f8b1813ec50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8b1806df10 tx=0x7f8b100013f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b0effd700 1 -- 172.21.15.84:0/3367407801 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10017070 con 0x7f8b1813e7d0 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b0effd700 1 -- 172.21.15.84:0/3367407801 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1000eab0 con 0x7f8b1813e7d0 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b0effd700 1 -- 172.21.15.84:0/3367407801 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000ee50 con 0x7f8b1813e7d0 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b180c77f0 con 0x7f8b1813e7d0 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.591+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b180c7db0 con 0x7f8b1813e7d0 2023-10-06T02:57:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.592+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1806f670 con 0x7f8b1813e7d0 2023-10-06T02:57:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.592+0000 7f8b0effd700 1 -- 172.21.15.84:0/3367407801 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b10013630 con 0x7f8b1813e7d0 2023-10-06T02:57:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.593+0000 7f8b0effd700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8af8066f30 0x7f8af80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.593+0000 7f8b1659c700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8af8066f30 0x7f8af80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.593+0000 7f8b0effd700 1 -- 172.21.15.84:0/3367407801 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8b10084550 con 0x7f8b1813e7d0 2023-10-06T02:57:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.593+0000 7f8b1659c700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8af8066f30 0x7f8af80693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8b08006f00 tx=0x7f8b080091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.597+0000 7f8b0effd700 1 -- 172.21.15.84:0/3367407801 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b10051520 con 0x7f8b1813e7d0 2023-10-06T02:57:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:40.824+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f8b18140120 con 0x7f8b1813e7d0 2023-10-06T02:57:41.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.199+0000 7f8b0effd700 1 -- 172.21.15.84:0/3367407801 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v35) v1 ==== 105+0+0 (secure 0 0 0) 0x7f8b1005a070 con 0x7f8b1813e7d0 2023-10-06T02:57:41.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8af8066f30 msgr2=0x7f8af80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8af8066f30 0x7f8af80693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8b08006f00 tx=0x7f8b080091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b1813e7d0 msgr2=0x7f8b1813ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b1813e7d0 0x7f8b1813ec50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8b1806df10 tx=0x7f8b100013f0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 shutdown_connections 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8af8066f30 0x7f8af80693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b1813e7d0 0x7f8b1813ec50 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b04004810 0x7f8b18158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 --2- 172.21.15.84:0/3367407801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b180c6a50 0x7f8b180c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 >> 172.21.15.84:0/3367407801 conn(0x7f8b1806b370 msgr2=0x7f8b180c3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 shutdown_connections 2023-10-06T02:57:41.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.201+0000 7f8b1759e700 1 -- 172.21.15.84:0/3367407801 wait complete. 2023-10-06T02:57:41.219 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:41.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.332+0000 7ff691544700 1 Processor -- start 2023-10-06T02:57:41.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.332+0000 7ff691544700 1 -- start start 2023-10-06T02:57:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff691544700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff68c0b49e0 0x7ff68c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff691544700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff68c0b07a0 0x7ff68c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff691544700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68c0b0ca0 con 0x7ff68c1595a0 2023-10-06T02:57:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff691544700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68c0b0f80 con 0x7ff68c0b07a0 2023-10-06T02:57:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff691544700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68c0b1260 con 0x7ff68c0b49e0 2023-10-06T02:57:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff68b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff68c0b07a0 0x7ff68c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff68b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff68c0b07a0 0x7ff68c0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58078/0 (socket says 172.21.15.84:58078) 2023-10-06T02:57:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff68b7fe700 1 -- 172.21.15.84:0/3956156727 learned_addr learned my addr 172.21.15.84:0/3956156727 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff68b7fe700 1 -- 172.21.15.84:0/3956156727 >> v2:172.21.15.131:3300/0 conn(0x7ff68c0b49e0 msgr2=0x7ff68c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff68b7fe700 1 --2- 172.21.15.84:0/3956156727 >> v2:172.21.15.131:3300/0 conn(0x7ff68c0b49e0 0x7ff68c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff68b7fe700 1 -- 172.21.15.84:0/3956156727 >> v1:172.21.15.131:6789/0 conn(0x7ff68c1595a0 legacy=0x7ff68c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff68b7fe700 1 -- 172.21.15.84:0/3956156727 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c0b1540 con 0x7ff68c0b07a0 2023-10-06T02:57:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff68b7fe700 1 --2- 172.21.15.84:0/3956156727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b07a0 0x7ff68c0b1c00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff684009f20 tx=0x7ff684009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e107fe4ea3756727 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff689ffb700 1 -- 172.21.15.84:0/3956156727 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68400e070 con 0x7ff68c0b07a0 2023-10-06T02:57:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff689ffb700 1 -- 172.21.15.84:0/3956156727 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68400ba00 con 0x7ff68c0b07a0 2023-10-06T02:57:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.333+0000 7ff689ffb700 1 -- 172.21.15.84:0/3956156727 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6840092e0 con 0x7ff68c0b07a0 2023-10-06T02:57:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.334+0000 7ff691544700 1 -- 172.21.15.84:0/3956156727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b07a0 msgr2=0x7ff68c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.334+0000 7ff691544700 1 --2- 172.21.15.84:0/3956156727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b07a0 0x7ff68c0b1c00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff684009f20 tx=0x7ff684009840 comp rx=0 tx=0).stop 2023-10-06T02:57:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.334+0000 7ff691544700 1 -- 172.21.15.84:0/3956156727 shutdown_connections 2023-10-06T02:57:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.334+0000 7ff691544700 1 --2- 172.21.15.84:0/3956156727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b07a0 0x7ff68c0b1c00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.334+0000 7ff691544700 1 --2- 172.21.15.84:0/3956156727 >> v2:172.21.15.131:3300/0 conn(0x7ff68c0b49e0 0x7ff68c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.334+0000 7ff691544700 1 -- 172.21.15.84:0/3956156727 >> 172.21.15.84:0/3956156727 conn(0x7ff68c099830 msgr2=0x7ff68c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.334+0000 7ff691544700 1 -- 172.21.15.84:0/3956156727 shutdown_connections 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.334+0000 7ff691544700 1 -- 172.21.15.84:0/3956156727 wait complete. 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.335+0000 7ff691544700 1 Processor -- start 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.335+0000 7ff691544700 1 -- start start 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff691544700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff68c0b07a0 0x7ff68c157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff691544700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b49e0 0x7ff68c0aa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff691544700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff68c1595a0 0x7ff68c0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff691544700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c16aac0 con 0x7ff68c0b49e0 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff691544700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0ad910 con 0x7ff68c1595a0 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff691544700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c158300 con 0x7ff68c0b07a0 2023-10-06T02:57:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b49e0 0x7ff68c0aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b49e0 0x7ff68c0aa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58084/0 (socket says 172.21.15.84:58084) 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68a7fc700 1 -- 172.21.15.84:0/626247553 learned_addr learned my addr 172.21.15.84:0/626247553 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68b7fe700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff68c1595a0 0x7ff68c0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68affd700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff68c0b07a0 0x7ff68c157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68a7fc700 1 -- 172.21.15.84:0/626247553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff68c0b07a0 msgr2=0x7ff68c157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68a7fc700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff68c0b07a0 0x7ff68c157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68a7fc700 1 -- 172.21.15.84:0/626247553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff68c1595a0 msgr2=0x7ff68c0b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68a7fc700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff68c1595a0 0x7ff68c0b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68a7fc700 1 -- 172.21.15.84:0/626247553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff684009ae0 con 0x7ff68c0b49e0 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68affd700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff68c0b07a0 0x7ff68c157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.336+0000 7ff68a7fc700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b49e0 0x7ff68c0aa820 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff68000b7e0 tx=0x7ff680009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.337+0000 7ff672ffd700 1 -- 172.21.15.84:0/626247553 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000f570 con 0x7ff68c0b49e0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.337+0000 7ff672ffd700 1 -- 172.21.15.84:0/626247553 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68000f6d0 con 0x7ff68c0b49e0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.337+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68c169f10 con 0x7ff68c0b49e0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.337+0000 7ff672ffd700 1 -- 172.21.15.84:0/626247553 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000fa90 con 0x7ff68c0b49e0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.337+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68c16a750 con 0x7ff68c0b49e0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.337+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68c0ada80 con 0x7ff68c0b49e0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.338+0000 7ff672ffd700 1 -- 172.21.15.84:0/626247553 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff68001a460 con 0x7ff68c0b49e0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.338+0000 7ff672ffd700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff678066f30 0x7ff6780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.338+0000 7ff672ffd700 1 -- 172.21.15.84:0/626247553 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff6800844c0 con 0x7ff68c0b49e0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.338+0000 7ff68affd700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff678066f30 0x7ff6780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.339+0000 7ff68affd700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff678066f30 0x7ff6780693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00a900 tx=0x7ff67c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.342+0000 7ff672ffd700 1 -- 172.21.15.84:0/626247553 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff68c0ada80 con 0x7ff68c0b49e0 2023-10-06T02:57:41.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.568+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff68c0ada80 con 0x7ff68c0b49e0 2023-10-06T02:57:41.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.569+0000 7ff672ffd700 1 -- 172.21.15.84:0/626247553 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4616 (secure 0 0 0) 0x7ff68c0ada80 con 0x7ff68c0b49e0 2023-10-06T02:57:41.570 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:41.571 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:57:41.200389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":5781,"mds_1":5778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:creating","state_seq":1,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:57:41.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff678066f30 msgr2=0x7ff6780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:41.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff678066f30 0x7ff6780693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00a900 tx=0x7ff67c008040 comp rx=0 tx=0).stop 2023-10-06T02:57:41.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b49e0 msgr2=0x7ff68c0aa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:41.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b49e0 0x7ff68c0aa820 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff68000b7e0 tx=0x7ff680009220 comp rx=0 tx=0).stop 2023-10-06T02:57:41.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 shutdown_connections 2023-10-06T02:57:41.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff678066f30 0x7ff6780693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff68c1595a0 0x7ff68c0b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff68c0b07a0 0x7ff68c157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 --2- 172.21.15.84:0/626247553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff68c0b49e0 0x7ff68c0aa820 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:41.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 >> 172.21.15.84:0/626247553 conn(0x7ff68c099830 msgr2=0x7ff68c1589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:41.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 shutdown_connections 2023-10-06T02:57:41.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:41.571+0000 7ff691544700 1 -- 172.21.15.84:0/626247553 wait complete. 2023-10-06T02:57:41.574 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 36 2023-10-06T02:57:41.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:57:28.525780+0000', 'modified': '2023-10-06T02:57:41.200389+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 5781, 'mds_1': 5778}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5778': {'gid': 5778, 'name': 'c', 'rank': 1, 'incarnation': 36, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.84:6837/4228087397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 4228087397}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 4228087397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5781': {'gid': 5781, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6836/1444717080', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1444717080}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 1444717080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:57:41.988 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5778:up:creating 2023-10-06T02:57:42.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:43.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.115+0000 7efd0359e700 1 Processor -- start 2023-10-06T02:57:43.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.115+0000 7efd0359e700 1 -- start start 2023-10-06T02:57:43.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd0359e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efd040cbc70 0x7efd040cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd0359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040b2140 0x7efd040b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd0359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd040cb7e0 con 0x7efd04159480 2023-10-06T02:57:43.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd0359e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd040b08a0 con 0x7efd040cbc70 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd0359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd040cb190 con 0x7efd040b2140 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd0259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efd04159480 0x7efd040b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53040/0 (socket says 172.21.15.84:53040) 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd0259c700 1 -- 172.21.15.84:0/4274841288 learned_addr learned my addr 172.21.15.84:0/4274841288 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503456209 0 0) 0x7efd040cb7e0 con 0x7efd04159480 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcec003570 con 0x7efd04159480 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd01d9b700 1 --2- 172.21.15.84:0/4274841288 >> v2:172.21.15.131:3300/0 conn(0x7efd040cbc70 0x7efd040cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.116+0000 7efd02d9d700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040b2140 0x7efd040b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4291953565 0 0) 0x7efcec003570 con 0x7efd04159480 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040b2140 msgr2=0x7efd040b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040b2140 0x7efd040b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 >> v2:172.21.15.131:3300/0 conn(0x7efd040cbc70 msgr2=0x7efd040cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 --2- 172.21.15.84:0/4274841288 >> v2:172.21.15.131:3300/0 conn(0x7efd040cbc70 0x7efd040cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd040cb470 con 0x7efd04159480 2023-10-06T02:57:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7efcf40017f0 con 0x7efd04159480 2023-10-06T02:57:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 >> v1:172.21.15.84:6789/0 conn(0x7efd04159480 legacy=0x7efd040b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcec003a60 0x7efcec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040b2140 0x7efcec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcec004d50 0x7efcec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040b08a0 con 0x7efcec004d50 2023-10-06T02:57:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040cb190 con 0x7efcec003a60 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec00ba60 con 0x7efd040b2140 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd02d9d700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcec004d50 0x7efcec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd0259c700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcec003a60 0x7efcec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd01d9b700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040b2140 0x7efcec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd02d9d700 1 -- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040b2140 msgr2=0x7efcec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd02d9d700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040b2140 0x7efcec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd02d9d700 1 -- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcec003a60 msgr2=0x7efcec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd02d9d700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcec003a60 0x7efcec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd02d9d700 1 -- 172.21.15.84:0/4274841288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec003570 con 0x7efcec004d50 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.117+0000 7efd02d9d700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcec004d50 0x7efcec0051c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009c00 tx=0x7efcfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2667c540342b70f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc00e6b0 con 0x7efcec004d50 2023-10-06T02:57:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc00e810 con 0x7efcec004d50 2023-10-06T02:57:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd0159a700 1 -- 172.21.15.84:0/4274841288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc00ebd0 con 0x7efcec004d50 2023-10-06T02:57:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd0359e700 1 -- 172.21.15.84:0/4274841288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcec004d50 msgr2=0x7efcec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd0359e700 1 --2- 172.21.15.84:0/4274841288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efcec004d50 0x7efcec0051c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009c00 tx=0x7efcfc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd02d9d700 1 -- 172.21.15.84:0/4274841288 reap_dead start 2023-10-06T02:57:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd0359e700 1 -- 172.21.15.84:0/4274841288 shutdown_connections 2023-10-06T02:57:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd0359e700 1 -- 172.21.15.84:0/4274841288 >> 172.21.15.84:0/4274841288 conn(0x7efd0406ed20 msgr2=0x7efd0406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd0359e700 1 -- 172.21.15.84:0/4274841288 shutdown_connections 2023-10-06T02:57:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.118+0000 7efd0359e700 1 -- 172.21.15.84:0/4274841288 wait complete. 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.119+0000 7efd0359e700 1 Processor -- start 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.119+0000 7efd0359e700 1 -- start start 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd0359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcec004d50 0x7efd040c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd0359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd040cf7c0 0x7efd04155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd0359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040cc730 0x7efd040ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd0359e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040c4e70 con 0x7efd040cf7c0 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd0359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd040cd0e0 con 0x7efcec004d50 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd0359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd040c4260 con 0x7efd040cc730 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd01d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd040cf7c0 0x7efd04155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd01d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd040cf7c0 0x7efd04155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37710/0 (socket says 172.21.15.84:37710) 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd01d9b700 1 -- 172.21.15.84:0/945348691 learned_addr learned my addr 172.21.15.84:0/945348691 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd0259c700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcec004d50 0x7efd040c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.120+0000 7efd02d9d700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040cc730 0x7efd040ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efd01d9b700 1 -- 172.21.15.84:0/945348691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040cc730 msgr2=0x7efd040ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efd01d9b700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040cc730 0x7efd040ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efd01d9b700 1 -- 172.21.15.84:0/945348691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcec004d50 msgr2=0x7efd040c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efd01d9b700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcec004d50 0x7efd040c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efd01d9b700 1 -- 172.21.15.84:0/945348691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd040c4540 con 0x7efd040cf7c0 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efd01d9b700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd040cf7c0 0x7efd04155640 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efcf8011b10 tx=0x7efcf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efcf27fc700 1 -- 172.21.15.84:0/945348691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf800f940 con 0x7efd040cf7c0 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efcf27fc700 1 -- 172.21.15.84:0/945348691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf800faa0 con 0x7efd040cf7c0 2023-10-06T02:57:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd040c4820 con 0x7efd040cf7c0 2023-10-06T02:57:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efcf27fc700 1 -- 172.21.15.84:0/945348691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf800fe20 con 0x7efd040cf7c0 2023-10-06T02:57:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.121+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd040cfc30 con 0x7efd040cf7c0 2023-10-06T02:57:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.122+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0405f270 con 0x7efd040cf7c0 2023-10-06T02:57:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.122+0000 7efcf27fc700 1 -- 172.21.15.84:0/945348691 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcf8014650 con 0x7efd040cf7c0 2023-10-06T02:57:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.122+0000 7efcf27fc700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efce4066f30 0x7efce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.123+0000 7efcf27fc700 1 -- 172.21.15.84:0/945348691 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efcf8018030 con 0x7efd040cf7c0 2023-10-06T02:57:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.123+0000 7efd0259c700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efce4066f30 0x7efce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.123+0000 7efd0259c700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efce4066f30 0x7efce40693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efcf400a100 tx=0x7efcf4006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.127+0000 7efcf27fc700 1 -- 172.21.15.84:0/945348691 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcf8052150 con 0x7efd040cf7c0 2023-10-06T02:57:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.354+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd04159850 con 0x7efd040cf7c0 2023-10-06T02:57:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.355+0000 7efcf27fc700 1 -- 172.21.15.84:0/945348691 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4628 (secure 0 0 0) 0x7efcf8055770 con 0x7efd040cf7c0 2023-10-06T02:57:43.357 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:43.357 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:57:43.213063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":8,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:57:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efce4066f30 msgr2=0x7efce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efce4066f30 0x7efce40693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efcf400a100 tx=0x7efcf4006040 comp rx=0 tx=0).stop 2023-10-06T02:57:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd040cf7c0 msgr2=0x7efd04155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd040cf7c0 0x7efd04155640 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efcf8011b10 tx=0x7efcf80091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 shutdown_connections 2023-10-06T02:57:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efce4066f30 0x7efce40693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efcec004d50 0x7efd040c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd040cc730 0x7efd040ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 --2- 172.21.15.84:0/945348691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd040cf7c0 0x7efd04155640 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 >> 172.21.15.84:0/945348691 conn(0x7efd0406ed20 msgr2=0x7efd04158650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 shutdown_connections 2023-10-06T02:57:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.357+0000 7efd0359e700 1 -- 172.21.15.84:0/945348691 wait complete. 2023-10-06T02:57:43.360 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2023-10-06T02:57:43.773 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:57:28.525780+0000', 'modified': '2023-10-06T02:57:43.213063+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 5781, 'mds_1': 5778, 'mds_2': 5377}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5377': {'gid': 5377, 'name': 'b', 'rank': 2, 'incarnation': 38, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.131:6835/802742000', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 802742000}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 802742000}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5778': {'gid': 5778, 'name': 'c', 'rank': 1, 'incarnation': 36, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.84:6837/4228087397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 4228087397}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 4228087397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5781': {'gid': 5781, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6836/1444717080', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1444717080}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 1444717080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:57:43.773 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-06T02:57:43.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T02:57:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.890+0000 7f4fac27a700 1 Processor -- start 2023-10-06T02:57:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.890+0000 7f4fac27a700 1 -- start start 2023-10-06T02:57:43.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.891+0000 7f4fac27a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fa4159990 0x7f4fa40675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.891+0000 7f4fac27a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4fa4067b30 0x7f4fa40b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.891+0000 7f4fac27a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa4067f70 con 0x7f4fa41595c0 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.891+0000 7f4fac27a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa40cde70 con 0x7f4fa4067b30 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.891+0000 7f4fac27a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa406ef60 con 0x7f4fa4159990 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.891+0000 7f4faa016700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4fa41595c0 0x7f4fa406e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53048/0 (socket says 172.21.15.84:53048) 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.891+0000 7f4faa016700 1 -- 172.21.15.84:0/3897475510 learned_addr learned my addr 172.21.15.84:0/3897475510 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171032619 0 0) 0x7f4fa4067f70 con 0x7f4fa41595c0 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4faa817700 1 --2- 172.21.15.84:0/3897475510 >> v2:172.21.15.131:3300/0 conn(0x7f4fa4067b30 0x7f4fa40b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9815700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fa4159990 0x7f4fa40675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f90003570 con 0x7f4fa41595c0 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3625910989 0 0) 0x7f4f90003570 con 0x7f4fa41595c0 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fa4159990 msgr2=0x7f4fa40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fa4159990 0x7f4fa40675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 >> v2:172.21.15.131:3300/0 conn(0x7f4fa4067b30 msgr2=0x7f4fa40b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 --2- 172.21.15.84:0/3897475510 >> v2:172.21.15.131:3300/0 conn(0x7f4fa4067b30 0x7f4fa40b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa406f240 con 0x7f4fa41595c0 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f4fa00017f0 con 0x7f4fa41595c0 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 >> v1:172.21.15.84:6789/0 conn(0x7f4fa41595c0 legacy=0x7f4fa406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fa4159990 0x7f4f90003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90003fe0 0x7f4f90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f90004d50 0x7f4f900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40cde70 con 0x7f4f90003fe0 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa406ef60 con 0x7f4f90004d50 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9000ba90 con 0x7f4fa4159990 2023-10-06T02:57:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9815700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90003fe0 0x7f4f90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4faa016700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fa4159990 0x7f4f90003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4faa817700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f90004d50 0x7f4f900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9815700 1 -- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fa4159990 msgr2=0x7f4f90003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9815700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4fa4159990 0x7f4f90003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9815700 1 -- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f90004d50 msgr2=0x7f4f900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9815700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f90004d50 0x7f4f900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9815700 1 -- 172.21.15.84:0/3897475510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90003570 con 0x7f4f90003fe0 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4faa817700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f90004d50 0x7f4f900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.892+0000 7f4fa9815700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90003fe0 0x7f4f90004810 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009c00 tx=0x7f4f940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8539100ab9735f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400e6b0 con 0x7f4f90003fe0 2023-10-06T02:57:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9400e810 con 0x7f4f90003fe0 2023-10-06T02:57:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4fa9014700 1 -- 172.21.15.84:0/3897475510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400ebd0 con 0x7f4f90003fe0 2023-10-06T02:57:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4fac27a700 1 -- 172.21.15.84:0/3897475510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90003fe0 msgr2=0x7f4f90004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4fac27a700 1 --2- 172.21.15.84:0/3897475510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90003fe0 0x7f4f90004810 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009c00 tx=0x7f4f940091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4faa817700 1 -- 172.21.15.84:0/3897475510 reap_dead start 2023-10-06T02:57:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4fac27a700 1 -- 172.21.15.84:0/3897475510 shutdown_connections 2023-10-06T02:57:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4fac27a700 1 -- 172.21.15.84:0/3897475510 >> 172.21.15.84:0/3897475510 conn(0x7f4fa4069180 msgr2=0x7f4fa40cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4fac27a700 1 -- 172.21.15.84:0/3897475510 shutdown_connections 2023-10-06T02:57:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.893+0000 7f4fac27a700 1 -- 172.21.15.84:0/3897475510 wait complete. 2023-10-06T02:57:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.894+0000 7f4fac27a700 1 Processor -- start 2023-10-06T02:57:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.894+0000 7f4fac27a700 1 -- start start 2023-10-06T02:57:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fac27a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f90003fe0 0x7f4fa40c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fac27a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fa414faa0 0x7f4fa415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fac27a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fa40cb1d0 0x7f4fa40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fac27a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40cbb80 con 0x7f4fa414faa0 2023-10-06T02:57:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fac27a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa415c9e0 con 0x7f4fa40cb1d0 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fac27a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa414ff10 con 0x7f4f90003fe0 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fa9815700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fa414faa0 0x7f4fa415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fa9815700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fa414faa0 0x7f4fa415b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37726/0 (socket says 172.21.15.84:37726) 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fa9815700 1 -- 172.21.15.84:0/936214543 learned_addr learned my addr 172.21.15.84:0/936214543 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4faa016700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f90003fe0 0x7f4fa40c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4faa817700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fa40cb1d0 0x7f4fa40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fa9815700 1 -- 172.21.15.84:0/936214543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f90003fe0 msgr2=0x7f4fa40c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fa9815700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f90003fe0 0x7f4fa40c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fa9815700 1 -- 172.21.15.84:0/936214543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fa40cb1d0 msgr2=0x7f4fa40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fa9815700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fa40cb1d0 0x7f4fa40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4fa9815700 1 -- 172.21.15.84:0/936214543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa415bdd0 con 0x7f4fa414faa0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.895+0000 7f4faa817700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fa40cb1d0 0x7f4fa40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.896+0000 7f4fa9815700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fa414faa0 0x7f4fa415b4f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4f90004730 tx=0x7f4f9401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.896+0000 7f4f9a7fc700 1 -- 172.21.15.84:0/936214543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94022070 con 0x7f4fa414faa0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.896+0000 7f4f9a7fc700 1 -- 172.21.15.84:0/936214543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9400e980 con 0x7f4fa414faa0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.896+0000 7f4f9a7fc700 1 -- 172.21.15.84:0/936214543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94027470 con 0x7f4fa414faa0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.896+0000 7f4fac27a700 1 -- 172.21.15.84:0/936214543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa415c0b0 con 0x7f4fa414faa0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.896+0000 7f4fac27a700 1 -- 172.21.15.84:0/936214543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa415c670 con 0x7f4fa414faa0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.897+0000 7f4f9a7fc700 1 -- 172.21.15.84:0/936214543 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f9401c450 con 0x7f4fa414faa0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.897+0000 7f4f9a7fc700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f88066f30 0x7f4f880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.897+0000 7f4f9a7fc700 1 -- 172.21.15.84:0/936214543 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4f94086380 con 0x7f4fa414faa0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.898+0000 7f4faa016700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f88066f30 0x7f4f880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.898+0000 7f4faa016700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f88066f30 0x7f4f880693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00019a0 tx=0x7f4fa0006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4fb5572b80 1 Processor -- start 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4fb5572b80 1 -- start start 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3d840 0x556a54a3dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a8d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a8e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a54994a70 con 0x556a54a3d840 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a54992270 con 0x556a54a8dc00 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a5498e060 con 0x556a54a3ecc0 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4faa016700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3d840 0x556a54a3dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4faa016700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3d840 0x556a54a3dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37728/0 (socket says 172.21.15.84:37728) 2023-10-06T02:57:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.900+0000 7f4faa016700 1 -- 172.21.15.84:0/3723672271 learned_addr learned my addr 172.21.15.84:0/3723672271 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4fa9815700 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a8d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4faa817700 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a8e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4faa016700 1 -- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 msgr2=0x556a54a8d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4faa016700 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a8d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4faa016700 1 -- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 msgr2=0x556a54a8e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4faa016700 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a8e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4faa016700 1 -- 172.21.15.84:0/3723672271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a54828270 con 0x556a54a3d840 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4fa9815700 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a8d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4faa817700 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a8e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4faa016700 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3d840 0x556a54a3dc10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0007ba0 tx=0x7f4fa0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7446455011c9b8a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4f877fe700 1 -- 172.21.15.84:0/3723672271 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0015e60 con 0x556a54a3d840 2023-10-06T02:57:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4f877fe700 1 -- 172.21.15.84:0/3723672271 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0021450 con 0x556a54a3d840 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.901+0000 7f4f877fe700 1 -- 172.21.15.84:0/3723672271 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00217d0 con 0x556a54a3d840 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3723672271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3d840 msgr2=0x556a54a3dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3d840 0x556a54a3dc10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0007ba0 tx=0x7f4fa0017000 comp rx=0 tx=0).stop 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3723672271 shutdown_connections 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a8e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3d840 0x556a54a3dc10 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3723672271 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a8d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3723672271 >> 172.21.15.84:0/3723672271 conn(0x556a54a3f160 msgr2=0x556a54a3f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3723672271 shutdown_connections 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3723672271 wait complete. 2023-10-06T02:57:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 -- start start 2023-10-06T02:57:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.902+0000 7f4fb5572b80 1 Processor -- start 2023-10-06T02:57:43.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 0x556a54a8ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a97100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a8dc00 0x556a54a97640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a54939890 con 0x556a54a8dc00 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a54954ea0 con 0x556a54a3d840 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a54810e30 con 0x556a54a3ecc0 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4fb5572b80 10 client.0 _ll_register_callbacks cb 0x556a54a00e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4faa817700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a8dc00 0x556a54a97640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4faa817700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a8dc00 0x556a54a97640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37738/0 (socket says 172.21.15.84:37738) 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.903+0000 7f4faa817700 1 -- 172.21.15.84:0/3407692396 learned_addr learned my addr 172.21.15.84:0/3407692396 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4faa016700 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 0x556a54a8ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fa9815700 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a97100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4faa817700 1 -- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 msgr2=0x556a54a97100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4faa817700 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a97100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4faa817700 1 -- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 msgr2=0x556a54a8ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4faa817700 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 0x556a54a8ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4faa817700 1 -- 172.21.15.84:0/3407692396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa406f240 con 0x556a54a8dc00 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fa9815700 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a97100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4faa817700 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a8dc00 0x556a54a97640 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40b3300 tx=0x7f4f9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31eeff113b9c6614 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4f84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4f84ff9700 1 -- 172.21.15.84:0/3407692396 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c017470 con 0x556a54a8dc00 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4f84ff9700 1 -- 172.21.15.84:0/3407692396 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4f9c0175d0 con 0x556a54a8dc00 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3407692396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a54a32940 con 0x556a54a8dc00 2023-10-06T02:57:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4f84ff9700 1 -- 172.21.15.84:0/3407692396 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f9c0179a0 con 0x556a54a8dc00 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fb5572b80 10 client.6009 fetch_fsmap learned FSMap version 39 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3407692396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x556a547cafe0 con 0x556a54a8dc00 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4f84ff9700 1 -- 172.21.15.84:0/3407692396 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a54a32940 con 0x556a54a8dc00 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4f84ff9700 1 -- 172.21.15.84:0/3407692396 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f4f9c017b00 con 0x556a54a8dc00 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fb5572b80 10 client.6009 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fb5572b80 10 client.6009 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fb5572b80 20 client.6009 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x556a54a7ced0 0x556a54a7d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fb5572b80 4 client.6009 mds_command: new command op to 5377 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.904+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3407692396 --> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a54a0f870 con 0x556a54a7ced0 2023-10-06T02:57:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.905+0000 7f4faa016700 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x556a54a7ced0 0x556a54a7d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.905+0000 7f4f84ff9700 10 client.6009 ms_handle_connect on v2:172.21.15.131:6834/802742000 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.905+0000 7f4faa016700 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x556a54a7ced0 0x556a54a7d2a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9ee473b5d5420323 server_cookie=fae44f445a92caca in_seq=0 out_seq=0 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4f84ff9700 1 -- 172.21.15.84:0/3407692396 <== mds.2 v2:172.21.15.131:6834/802742000 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x556a54a0f870 con 0x556a54a7ced0 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4f84ff9700 10 client.6009 handle_command_reply: tid=0 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 client.6009 shutdown 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3407692396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a8dc00 msgr2=0x556a54a97640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a8dc00 0x556a54a97640 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40b3300 tx=0x7f4f9c008040 comp rx=0 tx=0).stop 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3407692396 shutdown_connections 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x556a54a7ced0 0x556a54a7d2a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 0x556a54a8ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a8dc00 0x556a54a97640 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4f84ff9700 0 client.6009 ms_handle_reset on v2:172.21.15.131:6834/802742000 2023-10-06T02:57:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/3407692396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3ecc0 0x556a54a97100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3407692396 >> 172.21.15.84:0/3407692396 conn(0x556a54a3f160 msgr2=0x556a54a38a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3407692396 shutdown_connections 2023-10-06T02:57:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 1 -- 172.21.15.84:0/3407692396 wait complete. 2023-10-06T02:57:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.906+0000 7f4fb5572b80 20 client.6009 trim_cache size 0 max 16384 2023-10-06T02:57:43.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.923+0000 7f4fb5572b80 1 Processor -- start 2023-10-06T02:57:43.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.923+0000 7f4fb5572b80 1 -- start start 2023-10-06T02:57:43.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3d840 0x556a54a8cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a81360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a818a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a54a3ca40 con 0x556a54a3ecc0 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a54a87480 con 0x556a54a8dc00 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a54a36840 con 0x556a54a3d840 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fa9815700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a81360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fa9815700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a81360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37742/0 (socket says 172.21.15.84:37742) 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fa9815700 1 -- 172.21.15.84:0/1142262664 learned_addr learned my addr 172.21.15.84:0/1142262664 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4faa817700 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a818a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4faa016700 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3d840 0x556a54a8cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fa9815700 1 -- 172.21.15.84:0/1142262664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3d840 msgr2=0x556a54a8cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fa9815700 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3d840 0x556a54a8cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fa9815700 1 -- 172.21.15.84:0/1142262664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 msgr2=0x556a54a818a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fa9815700 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a818a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fa9815700 1 -- 172.21.15.84:0/1142262664 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a5495c780 con 0x556a54a3ecc0 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4faa817700 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a818a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4fa9815700 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a81360 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400e4b0 tx=0x7f4f9401f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90c6976b790da58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4f87fff700 1 -- 172.21.15.84:0/1142262664 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94053350 con 0x556a54a3ecc0 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4f87fff700 1 -- 172.21.15.84:0/1142262664 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9405a260 con 0x556a54a3ecc0 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.924+0000 7f4f87fff700 1 -- 172.21.15.84:0/1142262664 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9405dfb0 con 0x556a54a3ecc0 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1142262664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 msgr2=0x556a54a81360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a81360 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400e4b0 tx=0x7f4f9401f040 comp rx=0 tx=0).stop 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1142262664 shutdown_connections 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a8dc00 0x556a54a818a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a3d840 0x556a54a8cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1142262664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a81360 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1142262664 >> 172.21.15.84:0/1142262664 conn(0x556a54a3f160 msgr2=0x556a54a6d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1142262664 shutdown_connections 2023-10-06T02:57:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1142262664 wait complete. 2023-10-06T02:57:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.925+0000 7f4fb5572b80 1 -- start start 2023-10-06T02:57:43.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.926+0000 7f4fb5572b80 1 Processor -- start 2023-10-06T02:57:43.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.926+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 0x556a54ae9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.926+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a7d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.926+0000 7f4fb5572b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a8dc00 0x556a54a7d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.926+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a54a7e1c0 con 0x556a54a3ecc0 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.926+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a54a97dc0 con 0x556a54a3d840 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.926+0000 7f4fb5572b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a54a7dd20 con 0x556a54a8dc00 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.926+0000 7f4fb5572b80 10 client.0 _ll_register_callbacks cb 0x556a54a00e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.926+0000 7f4fa9815700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a7d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fa9815700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a7d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37746/0 (socket says 172.21.15.84:37746) 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fa9815700 1 -- 172.21.15.84:0/1614620666 learned_addr learned my addr 172.21.15.84:0/1614620666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4faa016700 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 0x556a54ae9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4faa817700 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a8dc00 0x556a54a7d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fa9815700 1 -- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a8dc00 msgr2=0x556a54a7d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fa9815700 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a8dc00 0x556a54a7d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fa9815700 1 -- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 msgr2=0x556a54ae9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fa9815700 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 0x556a54ae9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fa9815700 1 -- 172.21.15.84:0/1614620666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa415c670 con 0x556a54a3ecc0 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fa9815700 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a7d2a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4f940846e0 tx=0x7f4f9405a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27677d4c5908c7af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4f84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4f84ff9700 1 -- 172.21.15.84:0/1614620666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940860b0 con 0x556a54a3ecc0 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4f84ff9700 1 -- 172.21.15.84:0/1614620666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4f94057270 con 0x556a54a3ecc0 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1614620666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fa0021450 con 0x556a54a3ecc0 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4f84ff9700 1 -- 172.21.15.84:0/1614620666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f94086210 con 0x556a54a3ecc0 2023-10-06T02:57:43.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fb5572b80 10 client.6015 fetch_fsmap learned FSMap version 39 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1614620666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x556a54943470 con 0x556a54a3ecc0 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4f84ff9700 1 -- 172.21.15.84:0/1614620666 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0021450 con 0x556a54a3ecc0 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4f84ff9700 1 -- 172.21.15.84:0/1614620666 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f4f94056500 con 0x556a54a3ecc0 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fb5572b80 10 client.6015 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fb5572b80 10 client.6015 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fb5572b80 20 client.6015 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x556a54a877d0 0x556a54a97040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fb5572b80 4 client.6015 mds_command: new command op to 5377 tid=0[{"prefix": "status"}] 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.927+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1614620666 --> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556a54930e00 con 0x556a54a877d0 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4faa016700 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x556a54a877d0 0x556a54a97040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4f84ff9700 10 client.6015 ms_handle_connect on v2:172.21.15.131:6834/802742000 2023-10-06T02:57:43.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4faa016700 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x556a54a877d0 0x556a54a97040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f089a66577f3d2b5 server_cookie=b772e6c65351123e in_seq=0 out_seq=0 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4f84ff9700 1 -- 172.21.15.84:0/1614620666 <== mds.2 v2:172.21.15.131:6834/802742000 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x556a54930e00 con 0x556a54a877d0 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4f84ff9700 10 client.6015 handle_command_reply: tid=0 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 client.6015 shutdown 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1614620666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 msgr2=0x556a54a7d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a7d2a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4f940846e0 tx=0x7f4f9405a000 comp rx=0 tx=0).stop 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1614620666 shutdown_connections 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x556a54a877d0 0x556a54a97040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a54a3d840 0x556a54ae9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4f84ff9700 0 client.6015 ms_handle_reset on v2:172.21.15.131:6834/802742000 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a54a8dc00 0x556a54a7d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 --2- 172.21.15.84:0/1614620666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a54a3ecc0 0x556a54a7d2a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1614620666 >> 172.21.15.84:0/1614620666 conn(0x556a54a3f160 msgr2=0x556a54a86f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:43.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1614620666 shutdown_connections 2023-10-06T02:57:43.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.928+0000 7f4fb5572b80 1 -- 172.21.15.84:0/1614620666 wait complete. 2023-10-06T02:57:43.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fb5572b80 20 client.6015 trim_cache size 0 max 16384 2023-10-06T02:57:43.938 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:57:43.938 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:57:43.938 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2023-10-06T02:57:43.938 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5377, 2023-10-06T02:57:43.938 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:57:43.938 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:57:43.939 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:57:43.939 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 1.716157691, 2023-10-06T02:57:43.939 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 39, 2023-10-06T02:57:43.939 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 56, 2023-10-06T02:57:43.939 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 56, 2023-10-06T02:57:43.939 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 21.538297166 2023-10-06T02:57:43.939 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:57:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 -- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f88066f30 msgr2=0x7f4f880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f88066f30 0x7f4f880693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00019a0 tx=0x7f4fa0006040 comp rx=0 tx=0).stop 2023-10-06T02:57:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 -- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fa414faa0 msgr2=0x7f4fa415b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fa414faa0 0x7f4fa415b4f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4f90004730 tx=0x7f4f9401a000 comp rx=0 tx=0).stop 2023-10-06T02:57:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 -- 172.21.15.84:0/936214543 shutdown_connections 2023-10-06T02:57:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f88066f30 0x7f4f880693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fa40cb1d0 0x7f4fa40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f90003fe0 0x7f4fa40c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 --2- 172.21.15.84:0/936214543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fa414faa0 0x7f4fa415b4f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:43.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 -- 172.21.15.84:0/936214543 >> 172.21.15.84:0/936214543 conn(0x7f4fa4069180 msgr2=0x7f4fa4157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:43.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 -- 172.21.15.84:0/936214543 shutdown_connections 2023-10-06T02:57:43.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:43.929+0000 7f4fac27a700 1 -- 172.21.15.84:0/936214543 wait complete. 2023-10-06T02:57:43.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:57:44.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.054+0000 7fd863d5a700 1 Processor -- start 2023-10-06T02:57:44.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.054+0000 7fd863d5a700 1 -- start start 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd863d5a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c1595a0 0x7fd85c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd863d5a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd85c0b07a0 0x7fd85c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd863d5a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c0b0ca0 con 0x7fd85c0b49e0 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd863d5a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c0b0f80 con 0x7fd85c0b07a0 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd863d5a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0b1260 con 0x7fd85c1595a0 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd8612f5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd85c0b49e0 0x7fd85c0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53050/0 (socket says 172.21.15.84:53050) 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd8612f5700 1 -- 172.21.15.84:0/2697002343 learned_addr learned my addr 172.21.15.84:0/2697002343 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd8622f7700 1 --2- 172.21.15.84:0/2697002343 >> v2:172.21.15.131:3300/0 conn(0x7fd85c0b07a0 0x7fd85c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd861af6700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c1595a0 0x7fd85c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.055+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410176446 0 0) 0x7fd85c0b0ca0 con 0x7fd85c0b49e0 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd848003570 con 0x7fd85c0b49e0 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 395131264 0 0) 0x7fd848003570 con 0x7fd85c0b49e0 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c1595a0 msgr2=0x7fd85c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c1595a0 0x7fd85c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 >> v2:172.21.15.131:3300/0 conn(0x7fd85c0b07a0 msgr2=0x7fd85c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 --2- 172.21.15.84:0/2697002343 >> v2:172.21.15.131:3300/0 conn(0x7fd85c0b07a0 0x7fd85c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c0b1540 con 0x7fd85c0b49e0 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fd84c001470 con 0x7fd85c0b49e0 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 >> v1:172.21.15.84:6789/0 conn(0x7fd85c0b49e0 legacy=0x7fd85c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848003a60 0x7fd848003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd848004810 0x7fd848004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c1595a0 0x7fd8480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0b0f80 con 0x7fd848004810 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0b1260 con 0x7fd848003a60 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84800ba60 con 0x7fd85c1595a0 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd8612f5700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd848004810 0x7fd848004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd861af6700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848003a60 0x7fd848003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd8622f7700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c1595a0 0x7fd8480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd8612f5700 1 -- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c1595a0 msgr2=0x7fd8480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd8612f5700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c1595a0 0x7fd8480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd8612f5700 1 -- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848003a60 msgr2=0x7fd848003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd8612f5700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848003a60 0x7fd848003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd8612f5700 1 -- 172.21.15.84:0/2697002343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848003570 con 0x7fd848004810 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd8622f7700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c1595a0 0x7fd8480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd8612f5700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd848004810 0x7fd848004c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c3c0 tx=0x7fd84c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbdeda5dd830632 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.056+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00cc50 con 0x7fd848004810 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.057+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c00cdd0 con 0x7fd848004810 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.057+0000 7fd860af4700 1 -- 172.21.15.84:0/2697002343 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c005b70 con 0x7fd848004810 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.057+0000 7fd863d5a700 1 -- 172.21.15.84:0/2697002343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd848004810 msgr2=0x7fd848004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.057+0000 7fd863d5a700 1 --2- 172.21.15.84:0/2697002343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd848004810 0x7fd848004c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c3c0 tx=0x7fd84c001e90 comp rx=0 tx=0).stop 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.057+0000 7fd8622f7700 1 -- 172.21.15.84:0/2697002343 reap_dead start 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.057+0000 7fd863d5a700 1 -- 172.21.15.84:0/2697002343 shutdown_connections 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.057+0000 7fd863d5a700 1 -- 172.21.15.84:0/2697002343 >> 172.21.15.84:0/2697002343 conn(0x7fd85c099830 msgr2=0x7fd85c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.057+0000 7fd863d5a700 1 -- 172.21.15.84:0/2697002343 shutdown_connections 2023-10-06T02:57:44.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.057+0000 7fd863d5a700 1 -- 172.21.15.84:0/2697002343 wait complete. 2023-10-06T02:57:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.058+0000 7fd863d5a700 1 Processor -- start 2023-10-06T02:57:44.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.058+0000 7fd863d5a700 1 -- start start 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd863d5a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848004810 0x7fd85c16cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd863d5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd85c169ff0 0x7fd85c09ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd863d5a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c09cfb0 0x7fd85c09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd863d5a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c15ad70 con 0x7fd85c169ff0 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd863d5a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c15a480 con 0x7fd848004810 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd863d5a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c15a720 con 0x7fd85c09cfb0 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8612f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd85c169ff0 0x7fd85c09ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8612f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd85c169ff0 0x7fd85c09ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37760/0 (socket says 172.21.15.84:37760) 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8612f5700 1 -- 172.21.15.84:0/2836510723 learned_addr learned my addr 172.21.15.84:0/2836510723 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd861af6700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848004810 0x7fd85c16cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8622f7700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c09cfb0 0x7fd85c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8612f5700 1 -- 172.21.15.84:0/2836510723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c09cfb0 msgr2=0x7fd85c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8612f5700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c09cfb0 0x7fd85c09aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8612f5700 1 -- 172.21.15.84:0/2836510723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848004810 msgr2=0x7fd85c16cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8612f5700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848004810 0x7fd85c16cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8612f5700 1 -- 172.21.15.84:0/2836510723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c15aa00 con 0x7fd85c169ff0 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8622f7700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c09cfb0 0x7fd85c09aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.059+0000 7fd8612f5700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd85c169ff0 0x7fd85c09ca70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd84c007d10 tx=0x7fd84c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.060+0000 7fd851ffb700 1 -- 172.21.15.84:0/2836510723 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0072e0 con 0x7fd85c169ff0 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.060+0000 7fd851ffb700 1 -- 172.21.15.84:0/2836510723 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c007460 con 0x7fd85c169ff0 2023-10-06T02:57:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.060+0000 7fd851ffb700 1 -- 172.21.15.84:0/2836510723 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c007820 con 0x7fd85c169ff0 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.060+0000 7fd863d5a700 1 -- 172.21.15.84:0/2836510723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c09d4f0 con 0x7fd85c169ff0 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.060+0000 7fd863d5a700 1 -- 172.21.15.84:0/2836510723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c16a460 con 0x7fd85c169ff0 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.061+0000 7fd851ffb700 1 -- 172.21.15.84:0/2836510723 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd84c019030 con 0x7fd85c169ff0 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.061+0000 7fd851ffb700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd840066f30 0x7fd8400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.062+0000 7fd851ffb700 1 -- 172.21.15.84:0/2836510723 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd84c085ce0 con 0x7fd85c169ff0 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.062+0000 7fd861af6700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd840066f30 0x7fd8400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.062+0000 7fd861af6700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd840066f30 0x7fd8400693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd858009390 tx=0x7fd85800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.063+0000 7fd86d052b80 1 Processor -- start 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd86d052b80 1 -- start start 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fbe8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 0x55a01fc386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fc38c00 0x55a01fc39050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd86d052b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01fb3fa70 con 0x55a01fbe8840 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd86d052b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01fb3d270 con 0x55a01fbe9cc0 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd86d052b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a01fb39060 con 0x55a01fc38c00 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd861af6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fbe8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd861af6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fbe8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37776/0 (socket says 172.21.15.84:37776) 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.064+0000 7fd861af6700 1 -- 172.21.15.84:0/303767027 learned_addr learned my addr 172.21.15.84:0/303767027 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd8612f5700 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 0x55a01fc386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd8622f7700 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fc38c00 0x55a01fc39050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd861af6700 1 -- 172.21.15.84:0/303767027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fc38c00 msgr2=0x55a01fc39050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd861af6700 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fc38c00 0x55a01fc39050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd861af6700 1 -- 172.21.15.84:0/303767027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 msgr2=0x55a01fc386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd861af6700 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 0x55a01fc386c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd861af6700 1 -- 172.21.15.84:0/303767027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a01f9d3270 con 0x55a01fbe8840 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd8622f7700 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fc38c00 0x55a01fc39050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd861af6700 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fbe8c10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd858016460 tx=0x7fd85801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d460b406e017095c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd83effd700 1 -- 172.21.15.84:0/303767027 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800e040 con 0x55a01fbe8840 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd83effd700 1 -- 172.21.15.84:0/303767027 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85800f040 con 0x55a01fbe8840 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd83effd700 1 -- 172.21.15.84:0/303767027 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858023440 con 0x55a01fbe8840 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd86d052b80 1 -- 172.21.15.84:0/303767027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 msgr2=0x55a01fbe8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.065+0000 7fd86d052b80 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fbe8c10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd858016460 tx=0x7fd85801a000 comp rx=0 tx=0).stop 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.066+0000 7fd86d052b80 1 -- 172.21.15.84:0/303767027 shutdown_connections 2023-10-06T02:57:44.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.066+0000 7fd86d052b80 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fc38c00 0x55a01fc39050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.066+0000 7fd86d052b80 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fbe8c10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.066+0000 7fd86d052b80 1 --2- 172.21.15.84:0/303767027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 0x55a01fc386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.066+0000 7fd86d052b80 1 -- 172.21.15.84:0/303767027 >> 172.21.15.84:0/303767027 conn(0x55a01fbea160 msgr2=0x55a01fbea530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.066+0000 7fd86d052b80 1 -- 172.21.15.84:0/303767027 shutdown_connections 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.066+0000 7fd86d052b80 1 -- 172.21.15.84:0/303767027 wait complete. 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.066+0000 7fd86d052b80 1 -- start start 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.066+0000 7fd86d052b80 1 Processor -- start 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fc37b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe9cc0 0x55a01fc36170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 0x55a01fc27210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd86d052b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01fae4890 con 0x55a01fbe8840 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd86d052b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01faffea0 con 0x55a01fc38c00 2023-10-06T02:57:44.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd86d052b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a01f9bbe30 con 0x55a01fbe9cc0 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd86d052b80 10 client.0 _ll_register_callbacks cb 0x55a01fbabe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd861af6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fc37b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd861af6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fc37b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37788/0 (socket says 172.21.15.84:37788) 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd861af6700 1 -- 172.21.15.84:0/3238651138 learned_addr learned my addr 172.21.15.84:0/3238651138 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd8622f7700 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 0x55a01fc27210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.067+0000 7fd8612f5700 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe9cc0 0x55a01fc36170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd861af6700 1 -- 172.21.15.84:0/3238651138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe9cc0 msgr2=0x55a01fc36170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd861af6700 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe9cc0 0x55a01fc36170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd861af6700 1 -- 172.21.15.84:0/3238651138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 msgr2=0x55a01fc27210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd861af6700 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 0x55a01fc27210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd861af6700 1 -- 172.21.15.84:0/3238651138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd858013d70 con 0x55a01fbe8840 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd8612f5700 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe9cc0 0x55a01fc36170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd861af6700 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fc37b60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd858014010 tx=0x7fd85801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5300e71174b5a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd837fff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd837fff700 1 -- 172.21.15.84:0/3238651138 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800e040 con 0x55a01fbe8840 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd837fff700 1 -- 172.21.15.84:0/3238651138 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd858013310 con 0x55a01fbe8840 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd86d052b80 1 -- 172.21.15.84:0/3238651138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a01fbdd940 con 0x55a01fbe8840 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd837fff700 1 -- 172.21.15.84:0/3238651138 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd858023cd0 con 0x55a01fbe8840 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd86d052b80 10 client.6027 fetch_fsmap learned FSMap version 39 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd86d052b80 1 -- 172.21.15.84:0/3238651138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55a01f975fe0 con 0x55a01fbe8840 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd837fff700 1 -- 172.21.15.84:0/3238651138 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a01fbdd940 con 0x55a01fbe8840 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd837fff700 1 -- 172.21.15.84:0/3238651138 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fd858037430 con 0x55a01fbe8840 2023-10-06T02:57:44.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd86d052b80 10 client.6027 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd86d052b80 10 client.6027 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd86d052b80 20 client.6027 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55a01fbe57d0 0x55a01fbe5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd86d052b80 4 client.6027 mds_command: new command op to 5778 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd86d052b80 1 -- 172.21.15.84:0/3238651138 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a01fbba870 con 0x55a01fbe57d0 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.068+0000 7fd8612f5700 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55a01fbe57d0 0x55a01fbe5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd837fff700 10 client.6027 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd8612f5700 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55a01fbe57d0 0x55a01fbe5ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c6498d9df4be258e server_cookie=62e8a3a5a2feac0a in_seq=0 out_seq=0 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd837fff700 1 -- 172.21.15.84:0/3238651138 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a01fbba870 con 0x55a01fbe57d0 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd837fff700 10 client.6027 handle_command_reply: tid=0 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd86d052b80 1 client.6027 shutdown 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd86d052b80 1 -- 172.21.15.84:0/3238651138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 msgr2=0x55a01fc37b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fc37b60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd858014010 tx=0x7fd85801d000 comp rx=0 tx=0).stop 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd86d052b80 1 -- 172.21.15.84:0/3238651138 shutdown_connections 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55a01fbe57d0 0x55a01fbe5ba0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 0x55a01fc27210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd837fff700 0 client.6027 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe8840 0x55a01fc37b60 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3238651138 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe9cc0 0x55a01fc36170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.069+0000 7fd86d052b80 1 -- 172.21.15.84:0/3238651138 >> 172.21.15.84:0/3238651138 conn(0x55a01fbea160 msgr2=0x55a01fbe3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.070+0000 7fd86d052b80 1 -- 172.21.15.84:0/3238651138 shutdown_connections 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.070+0000 7fd86d052b80 1 -- 172.21.15.84:0/3238651138 wait complete. 2023-10-06T02:57:44.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.070+0000 7fd86d052b80 20 client.6027 trim_cache size 0 max 16384 2023-10-06T02:57:44.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.086+0000 7fd86d052b80 1 Processor -- start 2023-10-06T02:57:44.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.086+0000 7fd86d052b80 1 -- start start 2023-10-06T02:57:44.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 0x55a01fbe4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 0x55a01fc31ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fc38c00 0x55a01fc37b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd86d052b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01fc34d70 con 0x55a01fc38c00 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd86d052b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01fc26be0 con 0x55a01fbe9cc0 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd86d052b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a01fbe3cd0 con 0x55a01fbe8840 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd8622f7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fc38c00 0x55a01fc37b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd8622f7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fc38c00 0x55a01fc37b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37794/0 (socket says 172.21.15.84:37794) 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd8622f7700 1 -- 172.21.15.84:0/3583084095 learned_addr learned my addr 172.21.15.84:0/3583084095 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd861af6700 1 --2- 172.21.15.84:0/3583084095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 0x55a01fbe4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd8612f5700 1 --2- 172.21.15.84:0/3583084095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 0x55a01fc31ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd8622f7700 1 -- 172.21.15.84:0/3583084095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 msgr2=0x55a01fbe4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd8622f7700 1 --2- 172.21.15.84:0/3583084095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 0x55a01fbe4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd8622f7700 1 -- 172.21.15.84:0/3583084095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 msgr2=0x55a01fc31ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd8622f7700 1 --2- 172.21.15.84:0/3583084095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 0x55a01fc31ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.087+0000 7fd8622f7700 1 -- 172.21.15.84:0/3583084095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a01fb07780 con 0x55a01fc38c00 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd8622f7700 1 --2- 172.21.15.84:0/3583084095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fc38c00 0x55a01fc37b40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0d0470 tx=0x7fd854008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3771c75fbfea7dec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd83f7fe700 1 -- 172.21.15.84:0/3583084095 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854016bb0 con 0x55a01fc38c00 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd83f7fe700 1 -- 172.21.15.84:0/3583084095 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854016d10 con 0x55a01fc38c00 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd83f7fe700 1 -- 172.21.15.84:0/3583084095 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85401f680 con 0x55a01fc38c00 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd86d052b80 1 -- 172.21.15.84:0/3583084095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fc38c00 msgr2=0x55a01fc37b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3583084095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fc38c00 0x55a01fc37b40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0d0470 tx=0x7fd854008040 comp rx=0 tx=0).stop 2023-10-06T02:57:44.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd86d052b80 1 -- 172.21.15.84:0/3583084095 shutdown_connections 2023-10-06T02:57:44.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3583084095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fc38c00 0x55a01fc37b40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3583084095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 0x55a01fbe4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd86d052b80 1 --2- 172.21.15.84:0/3583084095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fbe9cc0 0x55a01fc31ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd86d052b80 1 -- 172.21.15.84:0/3583084095 >> 172.21.15.84:0/3583084095 conn(0x55a01fbea160 msgr2=0x55a01fc11c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd86d052b80 1 -- 172.21.15.84:0/3583084095 shutdown_connections 2023-10-06T02:57:44.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.088+0000 7fd86d052b80 1 -- 172.21.15.84:0/3583084095 wait complete. 2023-10-06T02:57:44.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.089+0000 7fd86d052b80 1 -- start start 2023-10-06T02:57:44.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.089+0000 7fd86d052b80 1 Processor -- start 2023-10-06T02:57:44.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 0x55a01fc94560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe9cc0 0x55a01fc111c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 0x55a01fc27c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01fc28620 con 0x55a01fbe9cc0 2023-10-06T02:57:44.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01fc315a0 con 0x55a01fc38c00 2023-10-06T02:57:44.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a01fc48610 con 0x55a01fbe8840 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 10 client.0 _ll_register_callbacks cb 0x55a01fbabe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8612f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe9cc0 0x55a01fc111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8612f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe9cc0 0x55a01fc111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37798/0 (socket says 172.21.15.84:37798) 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8612f5700 1 -- 172.21.15.84:0/1021986476 learned_addr learned my addr 172.21.15.84:0/1021986476 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8622f7700 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 0x55a01fc27c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd861af6700 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 0x55a01fc94560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8612f5700 1 -- 172.21.15.84:0/1021986476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 msgr2=0x55a01fc94560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8612f5700 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 0x55a01fc94560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8612f5700 1 -- 172.21.15.84:0/1021986476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 msgr2=0x55a01fc27c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8612f5700 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 0x55a01fc27c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8612f5700 1 -- 172.21.15.84:0/1021986476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd854009960 con 0x55a01fbe9cc0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd8612f5700 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe9cc0 0x55a01fc111c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd84c001ed0 tx=0x7fd84c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d502aaeff0549e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd837fff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd837fff700 1 -- 172.21.15.84:0/1021986476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c059bc0 con 0x55a01fbe9cc0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd837fff700 1 -- 172.21.15.84:0/1021986476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd84c05d910 con 0x55a01fbe9cc0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 1 -- 172.21.15.84:0/1021986476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd85800f040 con 0x55a01fbe9cc0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd837fff700 1 -- 172.21.15.84:0/1021986476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd84c056bd0 con 0x55a01fbe9cc0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 10 client.6033 fetch_fsmap learned FSMap version 39 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.090+0000 7fd86d052b80 1 -- 172.21.15.84:0/1021986476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55a01faee470 con 0x55a01fbe9cc0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd837fff700 1 -- 172.21.15.84:0/1021986476 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c061020 con 0x55a01fbe9cc0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd837fff700 1 -- 172.21.15.84:0/1021986476 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fd84c055e60 con 0x55a01fbe9cc0 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 10 client.6033 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 10 client.6033 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:57:44.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 20 client.6033 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55a01fc25bf0 0x55a01fc25fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 4 client.6033 mds_command: new command op to 5778 tid=0[{"prefix": "status"}] 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 -- 172.21.15.84:0/1021986476 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a01fadbe00 con 0x55a01fc25bf0 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd861af6700 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55a01fc25bf0 0x55a01fc25fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd837fff700 10 client.6033 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd861af6700 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55a01fc25bf0 0x55a01fc25fc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5acc89d869ab05d1 server_cookie=ecfc024976080af8 in_seq=0 out_seq=0 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd837fff700 1 -- 172.21.15.84:0/1021986476 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55a01fadbe00 con 0x55a01fc25bf0 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd837fff700 10 client.6033 handle_command_reply: tid=0 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 client.6033 shutdown 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 -- 172.21.15.84:0/1021986476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe9cc0 msgr2=0x55a01fc111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe9cc0 0x55a01fc111c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd84c001ed0 tx=0x7fd84c020040 comp rx=0 tx=0).stop 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 -- 172.21.15.84:0/1021986476 shutdown_connections 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55a01fc25bf0 0x55a01fc25fc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a01fc38c00 0x55a01fc27c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a01fbe8840 0x55a01fc94560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd837fff700 0 client.6033 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 --2- 172.21.15.84:0/1021986476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a01fbe9cc0 0x55a01fc111c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.091+0000 7fd86d052b80 1 -- 172.21.15.84:0/1021986476 >> 172.21.15.84:0/1021986476 conn(0x55a01fbea160 msgr2=0x55a01fc37860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd86d052b80 1 -- 172.21.15.84:0/1021986476 shutdown_connections 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd86d052b80 1 -- 172.21.15.84:0/1021986476 wait complete. 2023-10-06T02:57:44.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd86d052b80 20 client.6033 trim_cache size 0 max 16384 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5778, 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 2.8886203830000001, 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 39, 2023-10-06T02:57:44.102 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 56, 2023-10-06T02:57:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 56, 2023-10-06T02:57:44.103 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 27.677210396 2023-10-06T02:57:44.103 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:57:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 -- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd840066f30 msgr2=0x7fd8400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd840066f30 0x7fd8400693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd858009390 tx=0x7fd85800b040 comp rx=0 tx=0).stop 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 -- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd85c169ff0 msgr2=0x7fd85c09ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd85c169ff0 0x7fd85c09ca70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd84c007d10 tx=0x7fd84c015000 comp rx=0 tx=0).stop 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 -- 172.21.15.84:0/2836510723 shutdown_connections 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd840066f30 0x7fd8400693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848004810 0x7fd85c16cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd85c09cfb0 0x7fd85c09aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 --2- 172.21.15.84:0/2836510723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd85c169ff0 0x7fd85c09ca70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 -- 172.21.15.84:0/2836510723 >> 172.21.15.84:0/2836510723 conn(0x7fd85c099830 msgr2=0x7fd85c1573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 -- 172.21.15.84:0/2836510723 shutdown_connections 2023-10-06T02:57:44.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.092+0000 7fd863d5a700 1 -- 172.21.15.84:0/2836510723 wait complete. 2023-10-06T02:57:44.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:57:44.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.223+0000 7fcce759e700 1 Processor -- start 2023-10-06T02:57:44.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.223+0000 7fcce759e700 1 -- start start 2023-10-06T02:57:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159440 0x7fcce815a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce815a8d0 con 0x7fcce806e450 2023-10-06T02:57:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce759e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce806dfc0 con 0x7fcce8159070 2023-10-06T02:57:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80c76c0 con 0x7fcce8159440 2023-10-06T02:57:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcce806e450 0x7fcce8069ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53062/0 (socket says 172.21.15.84:53062) 2023-10-06T02:57:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce6d9d700 1 -- 172.21.15.84:0/1156380251 learned_addr learned my addr 172.21.15.84:0/1156380251 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/1156380251 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159440 0x7fcce815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce559a700 1 -- 172.21.15.84:0/1156380251 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699668074 0 0) 0x7fcce0001490 con 0x7fcce806e450 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce559a700 1 -- 172.21.15.84:0/1156380251 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd0003570 con 0x7fcce806e450 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce559a700 1 -- 172.21.15.84:0/1156380251 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891607999 0 0) 0x7fcce806dfc0 con 0x7fcce8159070 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce559a700 1 -- 172.21.15.84:0/1156380251 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce0001490 con 0x7fcce8159070 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce5d9b700 1 -- 172.21.15.84:0/1156380251 >> v1:172.21.15.131:6789/0 conn(0x7fcce8159070 legacy=0x7fcce80675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce5d9b700 1 -- 172.21.15.84:0/1156380251 >> v1:172.21.15.84:6789/0 conn(0x7fcce806e450 legacy=0x7fcce8069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce5d9b700 1 -- 172.21.15.84:0/1156380251 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce806a820 con 0x7fcce8159440 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/1156380251 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159440 0x7fcce815a390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009910 tx=0x7fccdc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32bb2e90733728 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.224+0000 7fcce559a700 1 -- 172.21.15.84:0/1156380251 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc011630 con 0x7fcce8159440 2023-10-06T02:57:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.225+0000 7fcce559a700 1 -- 172.21.15.84:0/1156380251 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc011790 con 0x7fcce8159440 2023-10-06T02:57:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.225+0000 7fcce559a700 1 -- 172.21.15.84:0/1156380251 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc011b30 con 0x7fcce8159440 2023-10-06T02:57:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.225+0000 7fcce759e700 1 -- 172.21.15.84:0/1156380251 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159440 msgr2=0x7fcce815a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.225+0000 7fcce759e700 1 --2- 172.21.15.84:0/1156380251 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159440 0x7fcce815a390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009910 tx=0x7fccdc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.225+0000 7fcce759e700 1 -- 172.21.15.84:0/1156380251 shutdown_connections 2023-10-06T02:57:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.225+0000 7fcce759e700 1 --2- 172.21.15.84:0/1156380251 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159440 0x7fcce815a390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.225+0000 7fcce759e700 1 -- 172.21.15.84:0/1156380251 >> 172.21.15.84:0/1156380251 conn(0x7fcce80cc6e0 msgr2=0x7fcce80ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.225+0000 7fcce759e700 1 -- 172.21.15.84:0/1156380251 shutdown_connections 2023-10-06T02:57:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.225+0000 7fcce759e700 1 -- 172.21.15.84:0/1156380251 wait complete. 2023-10-06T02:57:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.226+0000 7fcce759e700 1 Processor -- start 2023-10-06T02:57:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.226+0000 7fcce759e700 1 -- start start 2023-10-06T02:57:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcce806e450 0x7fcce80c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159070 0x7fcce815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce8159440 0x7fcce815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80abdb0 con 0x7fcce806e450 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80ae580 con 0x7fcce8159440 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80ad4e0 con 0x7fcce8159070 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcce806e450 0x7fcce80c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcce806e450 0x7fcce80c56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37812/0 (socket says 172.21.15.84:37812) 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce659c700 1 -- 172.21.15.84:0/3967671773 learned_addr learned my addr 172.21.15.84:0/3967671773 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce8159440 0x7fcce815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.227+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159070 0x7fcce815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fcce659c700 1 -- 172.21.15.84:0/3967671773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159070 msgr2=0x7fcce815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fcce659c700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159070 0x7fcce815b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fcce659c700 1 -- 172.21.15.84:0/3967671773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce8159440 msgr2=0x7fcce815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fcce659c700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce8159440 0x7fcce815b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fcce659c700 1 -- 172.21.15.84:0/3967671773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc009420 con 0x7fcce806e450 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce8159440 0x7fcce815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fcce659c700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcce806e450 0x7fcce80c56c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fccd800c790 tx=0x7fccd8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fccd67fc700 1 -- 172.21.15.84:0/3967671773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8010510 con 0x7fcce806e450 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fccd67fc700 1 -- 172.21.15.84:0/3967671773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd8010670 con 0x7fcce806e450 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fcce759e700 1 -- 172.21.15.84:0/3967671773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce80ad7c0 con 0x7fcce806e450 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fccd67fc700 1 -- 172.21.15.84:0/3967671773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8010a10 con 0x7fcce806e450 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.228+0000 7fcce759e700 1 -- 172.21.15.84:0/3967671773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce80add80 con 0x7fcce806e450 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.229+0000 7fccd67fc700 1 -- 172.21.15.84:0/3967671773 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccd801b400 con 0x7fcce806e450 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.230+0000 7fccd67fc700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccc8066f30 0x7fccc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.230+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccc8066f30 0x7fccc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.230+0000 7fccd67fc700 1 -- 172.21.15.84:0/3967671773 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fccd80845a0 con 0x7fcce806e450 2023-10-06T02:57:44.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.230+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccc8066f30 0x7fccc80693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009860 tx=0x7fccdc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.232+0000 7fccf61b0b80 1 Processor -- start 2023-10-06T02:57:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.232+0000 7fccf61b0b80 1 -- start start 2023-10-06T02:57:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.232+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f634ebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.232+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f634ec200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.232+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634ec740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.232+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f63446a70 con 0x556f634f2a10 2023-10-06T02:57:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.232+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f63444270 con 0x556f634f12c0 2023-10-06T02:57:44.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.232+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f63440060 con 0x556f63510e50 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634ec740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634ec740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37818/0 (socket says 172.21.15.84:37818) 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce6d9d700 1 -- 172.21.15.84:0/3014822582 learned_addr learned my addr 172.21.15.84:0/3014822582 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/3014822582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f634ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce659c700 1 --2- 172.21.15.84:0/3014822582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f634ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce6d9d700 1 -- 172.21.15.84:0/3014822582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 msgr2=0x556f634ebcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/3014822582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f634ebcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce6d9d700 1 -- 172.21.15.84:0/3014822582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 msgr2=0x556f634ec200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/3014822582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f634ec200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce6d9d700 1 -- 172.21.15.84:0/3014822582 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f632da270 con 0x556f634f2a10 2023-10-06T02:57:44.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/3014822582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634ec740 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcce000e350 tx=0x7fcce0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c536b68d013e468a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fccc77fe700 1 -- 172.21.15.84:0/3014822582 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000ee90 con 0x556f634f2a10 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fccc77fe700 1 -- 172.21.15.84:0/3014822582 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce0014480 con 0x556f634f2a10 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.233+0000 7fccc77fe700 1 -- 172.21.15.84:0/3014822582 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0014800 con 0x556f634f2a10 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.234+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3014822582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 msgr2=0x556f634ec740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.234+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/3014822582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634ec740 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcce000e350 tx=0x7fcce0009040 comp rx=0 tx=0).stop 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.234+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3014822582 shutdown_connections 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.234+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/3014822582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634ec740 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.234+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/3014822582 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f634ebcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.234+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/3014822582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f634ec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.234+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3014822582 >> 172.21.15.84:0/3014822582 conn(0x556f634f0e80 msgr2=0x556f634f16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.234+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3014822582 shutdown_connections 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.234+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3014822582 wait complete. 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.235+0000 7fccf61b0b80 1 -- start start 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.235+0000 7fccf61b0b80 1 Processor -- start 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f6350eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63536940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f63511800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f633eb890 con 0x556f634f2a10 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f63406ea0 con 0x556f634f12c0 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f632c2e30 con 0x556f63510e50 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 10 client.0 _ll_register_callbacks cb 0x556f634b3020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63536940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63536940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37832/0 (socket says 172.21.15.84:37832) 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce5d9b700 1 -- 172.21.15.84:0/2504300979 learned_addr learned my addr 172.21.15.84:0/2504300979 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce659c700 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f6350eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f63511800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce5d9b700 1 -- 172.21.15.84:0/2504300979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 msgr2=0x556f63511800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f63511800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce5d9b700 1 -- 172.21.15.84:0/2504300979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 msgr2=0x556f6350eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f6350eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce5d9b700 1 -- 172.21.15.84:0/2504300979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce000f040 con 0x556f634f2a10 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f63511800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63536940 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fccdc013000 tx=0x7fccdc021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e6ad999d8612d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccc4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2504300979 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc02f070 con 0x556f634f2a10 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2504300979 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fccdc027720 con 0x556f634f2a10 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2504300979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f634e4940 con 0x556f634f2a10 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2504300979 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccdc021070 con 0x556f634f2a10 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 10 client.6045 fetch_fsmap learned FSMap version 39 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.236+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2504300979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x556f6327cfe0 con 0x556f634f2a10 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2504300979 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f634e4940 con 0x556f634f2a10 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2504300979 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fccdc027af0 con 0x556f634f2a10 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccf61b0b80 10 client.6045 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccf61b0b80 10 client.6045 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:57:44.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccf61b0b80 20 client.6045 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x556f635393d0 0x556f635397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccf61b0b80 4 client.6045 mds_command: new command op to 5781 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2504300979 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f634c1870 con 0x556f635393d0 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fcce659c700 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x556f635393d0 0x556f635397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccc4ff9700 10 client.6045 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fcce659c700 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x556f635393d0 0x556f635397a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf6d8d42e4f6efea server_cookie=f34f74cc7dc03453 in_seq=0 out_seq=0 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.237+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2504300979 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x556f634c1870 con 0x556f635393d0 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccc4ff9700 10 client.6045 handle_command_reply: tid=0 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 client.6045 shutdown 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2504300979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 msgr2=0x556f63536940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63536940 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fccdc013000 tx=0x7fccdc021000 comp rx=0 tx=0).stop 2023-10-06T02:57:44.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2504300979 shutdown_connections 2023-10-06T02:57:44.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x556f635393d0 0x556f635397a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f6350eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccc4ff9700 0 client.6045 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:44.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f63511800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2504300979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63536940 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2504300979 >> 172.21.15.84:0/2504300979 conn(0x556f634f0e80 msgr2=0x556f634efc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2504300979 shutdown_connections 2023-10-06T02:57:44.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2504300979 wait complete. 2023-10-06T02:57:44.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.238+0000 7fccf61b0b80 20 client.6045 trim_cache size 0 max 16384 2023-10-06T02:57:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.254+0000 7fccf61b0b80 1 Processor -- start 2023-10-06T02:57:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.254+0000 7fccf61b0b80 1 -- start start 2023-10-06T02:57:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f634f12c0 0x556f634f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634f1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f63510e50 0x556f6351c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f634f1bd0 con 0x556f634f2a10 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f634cf2e0 con 0x556f63510e50 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f635435b0 con 0x556f634f12c0 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634f1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37838/0 (socket says 172.21.15.84:37838) 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce5d9b700 1 -- 172.21.15.84:0/3223480647 learned_addr learned my addr 172.21.15.84:0/3223480647 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f63510e50 0x556f6351c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce659c700 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f634f12c0 0x556f634f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce5d9b700 1 -- 172.21.15.84:0/3223480647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f634f12c0 msgr2=0x556f634f1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f634f12c0 0x556f634f1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce5d9b700 1 -- 172.21.15.84:0/3223480647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f63510e50 msgr2=0x556f6351c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f63510e50 0x556f6351c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce5d9b700 1 -- 172.21.15.84:0/3223480647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f6340e780 con 0x556f634f2a10 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.255+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f63510e50 0x556f6351c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634f1690 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fccdc000cb0 tx=0x7fccdc02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb71f6ba0062b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccc7fff700 1 -- 172.21.15.84:0/3223480647 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc021050 con 0x556f634f2a10 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccc7fff700 1 -- 172.21.15.84:0/3223480647 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc027720 con 0x556f634f2a10 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccc7fff700 1 -- 172.21.15.84:0/3223480647 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0091a0 con 0x556f634f2a10 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3223480647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 msgr2=0x556f634f1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634f1690 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fccdc000cb0 tx=0x7fccdc02f000 comp rx=0 tx=0).stop 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3223480647 shutdown_connections 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f63510e50 0x556f6351c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f634f12c0 0x556f634f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/3223480647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f634f1690 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3223480647 >> 172.21.15.84:0/3223480647 conn(0x556f634f0e80 msgr2=0x556f634ece10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3223480647 shutdown_connections 2023-10-06T02:57:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.256+0000 7fccf61b0b80 1 -- 172.21.15.84:0/3223480647 wait complete. 2023-10-06T02:57:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.257+0000 7fccf61b0b80 1 -- start start 2023-10-06T02:57:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.257+0000 7fccf61b0b80 1 Processor -- start 2023-10-06T02:57:44.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f6359bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63547e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccf61b0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f6354f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f635192d0 con 0x556f634f2a10 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f63517770 con 0x556f634f12c0 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccf61b0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f63511820 con 0x556f63510e50 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccf61b0b80 10 client.0 _ll_register_callbacks cb 0x556f634b3020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63547e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63547e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37844/0 (socket says 172.21.15.84:37844) 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce5d9b700 1 -- 172.21.15.84:0/2812851275 learned_addr learned my addr 172.21.15.84:0/2812851275 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce659c700 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f6359bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce6d9d700 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f6354f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce5d9b700 1 -- 172.21.15.84:0/2812851275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 msgr2=0x556f6354f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f6354f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce5d9b700 1 -- 172.21.15.84:0/2812851275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 msgr2=0x556f6359bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f6359bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce5d9b700 1 -- 172.21.15.84:0/2812851275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f6327cfe0 con 0x556f634f2a10 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fcce5d9b700 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63547e90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009f00 tx=0x7fccdc00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de70429ebe8e139e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccc4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2812851275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc02f070 con 0x556f634f2a10 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2812851275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fccdc045450 con 0x556f634f2a10 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.258+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2812851275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcce0014480 con 0x556f634f2a10 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2812851275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccdc021070 con 0x556f634f2a10 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 10 client.6051 fetch_fsmap learned FSMap version 39 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2812851275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x556f633f5470 con 0x556f634f2a10 2023-10-06T02:57:44.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2812851275 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce0014480 con 0x556f634f2a10 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2812851275 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 39) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fccdc045820 con 0x556f634f2a10 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 10 client.6051 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 10 client.6051 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 20 client.6051 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x556f63516f90 0x556f6354f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 4 client.6051 mds_command: new command op to 5781 tid=0[{"prefix": "status"}] 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2812851275 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556f633e2e00 con 0x556f63516f90 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fcce659c700 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x556f63516f90 0x556f6354f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccc4ff9700 10 client.6051 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fcce659c700 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x556f63516f90 0x556f6354f980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55790cb1a67dde14 server_cookie=ae27f1d0c862a8 in_seq=0 out_seq=0 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccc4ff9700 1 -- 172.21.15.84:0/2812851275 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556f633e2e00 con 0x556f63516f90 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccc4ff9700 10 client.6051 handle_command_reply: tid=0 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 client.6051 shutdown 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2812851275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 msgr2=0x556f63547e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63547e90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009f00 tx=0x7fccdc00d000 comp rx=0 tx=0).stop 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2812851275 shutdown_connections 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x556f63516f90 0x556f6354f980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f634f12c0 0x556f6359bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccc4ff9700 0 client.6051 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556f63510e50 0x556f6354f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 --2- 172.21.15.84:0/2812851275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556f634f2a10 0x556f63547e90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.259+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2812851275 >> 172.21.15.84:0/2812851275 conn(0x556f634f0e80 msgr2=0x556f6350d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2812851275 shutdown_connections 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fccf61b0b80 1 -- 172.21.15.84:0/2812851275 wait complete. 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fccf61b0b80 20 client.6051 trim_cache size 0 max 16384 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5781, 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:57:44.269 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:57:44.270 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:57:44.270 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 15.104766905, 2023-10-06T02:57:44.270 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 39, 2023-10-06T02:57:44.270 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 56, 2023-10-06T02:57:44.270 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 56, 2023-10-06T02:57:44.270 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 27.845235899999999 2023-10-06T02:57:44.270 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:57:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 -- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccc8066f30 msgr2=0x7fccc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccc8066f30 0x7fccc80693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009860 tx=0x7fccdc017000 comp rx=0 tx=0).stop 2023-10-06T02:57:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 -- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcce806e450 msgr2=0x7fcce80c56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcce806e450 0x7fcce80c56c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fccd800c790 tx=0x7fccd8007e10 comp rx=0 tx=0).stop 2023-10-06T02:57:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 -- 172.21.15.84:0/3967671773 shutdown_connections 2023-10-06T02:57:44.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccc8066f30 0x7fccc80693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcce8159440 0x7fcce815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcce806e450 0x7fcce80c56c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 --2- 172.21.15.84:0/3967671773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcce8159070 0x7fcce815b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 -- 172.21.15.84:0/3967671773 >> 172.21.15.84:0/3967671773 conn(0x7fcce80cc6e0 msgr2=0x7fcce815d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 -- 172.21.15.84:0/3967671773 shutdown_connections 2023-10-06T02:57:44.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.260+0000 7fcce759e700 1 -- 172.21.15.84:0/3967671773 wait complete. 2023-10-06T02:57:44.273 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:57:44.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.386+0000 7f6f213b3700 1 Processor -- start 2023-10-06T02:57:44.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.386+0000 7f6f213b3700 1 -- start start 2023-10-06T02:57:44.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.387+0000 7f6f213b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f1c0cb630 0x7f6f1c0691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.387+0000 7f6f213b3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1c068d50 con 0x7f6f1c069720 2023-10-06T02:57:44.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.387+0000 7f6f213b3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1c15a6b0 con 0x7f6f1c15a220 2023-10-06T02:57:44.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.387+0000 7f6f213b3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1c154060 con 0x7f6f1c0cb630 2023-10-06T02:57:44.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.387+0000 7f6f1affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f1c0cb630 0x7f6f1c0691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.387+0000 7f6f1a7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6f1c069720 0x7f6f1c159b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53068/0 (socket says 172.21.15.84:53068) 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.387+0000 7f6f1a7fc700 1 -- 172.21.15.84:0/3711221316 learned_addr learned my addr 172.21.15.84:0/3711221316 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f1affd700 1 -- 172.21.15.84:0/3711221316 >> v1:172.21.15.131:6789/0 conn(0x7f6f1c15a220 legacy=0x7f6f1c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f1affd700 1 -- 172.21.15.84:0/3711221316 >> v1:172.21.15.84:6789/0 conn(0x7f6f1c069720 legacy=0x7f6f1c159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f1affd700 1 -- 172.21.15.84:0/3711221316 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c15a990 con 0x7f6f1c0cb630 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f1affd700 1 --2- 172.21.15.84:0/3711221316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c0cb630 0x7f6f1c0691e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009e60 tx=0x7f6f0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3927aa97d1c76d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f19ffb700 1 -- 172.21.15.84:0/3711221316 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00e070 con 0x7f6f1c0cb630 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f19ffb700 1 -- 172.21.15.84:0/3711221316 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c00bc30 con 0x7f6f1c0cb630 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f19ffb700 1 -- 172.21.15.84:0/3711221316 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c012430 con 0x7f6f1c0cb630 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f213b3700 1 -- 172.21.15.84:0/3711221316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c0cb630 msgr2=0x7f6f1c0691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f213b3700 1 --2- 172.21.15.84:0/3711221316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c0cb630 0x7f6f1c0691e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009e60 tx=0x7f6f0c009780 comp rx=0 tx=0).stop 2023-10-06T02:57:44.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.388+0000 7f6f213b3700 1 -- 172.21.15.84:0/3711221316 shutdown_connections 2023-10-06T02:57:44.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.389+0000 7f6f213b3700 1 --2- 172.21.15.84:0/3711221316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c0cb630 0x7f6f1c0691e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.389+0000 7f6f213b3700 1 -- 172.21.15.84:0/3711221316 >> 172.21.15.84:0/3711221316 conn(0x7f6f1c070810 msgr2=0x7f6f1c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.389+0000 7f6f213b3700 1 -- 172.21.15.84:0/3711221316 shutdown_connections 2023-10-06T02:57:44.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.389+0000 7f6f213b3700 1 -- 172.21.15.84:0/3711221316 wait complete. 2023-10-06T02:57:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.390+0000 7f6f213b3700 1 Processor -- start 2023-10-06T02:57:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.390+0000 7f6f213b3700 1 -- start start 2023-10-06T02:57:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.390+0000 7f6f213b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f1c069720 0x7f6f1c16e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.390+0000 7f6f213b3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f1c0cb630 0x7f6f1c150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f213b3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c15a220 0x7f6f1c0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f213b3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c0b1430 con 0x7f6f1c15a220 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f213b3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c16e860 con 0x7f6f1c069720 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f213b3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c0c3190 con 0x7f6f1c0cb630 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c15a220 0x7f6f1c0b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c15a220 0x7f6f1c0b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37852/0 (socket says 172.21.15.84:37852) 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1b7fe700 1 -- 172.21.15.84:0/1055990226 learned_addr learned my addr 172.21.15.84:0/1055990226 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1affd700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f1c069720 0x7f6f1c16e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1b7fe700 1 -- 172.21.15.84:0/1055990226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f1c0cb630 msgr2=0x7f6f1c150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1b7fe700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f1c0cb630 0x7f6f1c150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1b7fe700 1 -- 172.21.15.84:0/1055990226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f1c069720 msgr2=0x7f6f1c16e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1b7fe700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f1c069720 0x7f6f1c16e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1b7fe700 1 -- 172.21.15.84:0/1055990226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c009a20 con 0x7f6f1c15a220 2023-10-06T02:57:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f1b7fe700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c15a220 0x7f6f1c0b18c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400c590 tx=0x7f6f14007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f02ffd700 1 -- 172.21.15.84:0/1055990226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14011590 con 0x7f6f1c15a220 2023-10-06T02:57:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f02ffd700 1 -- 172.21.15.84:0/1055990226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f140116f0 con 0x7f6f1c15a220 2023-10-06T02:57:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c0c3470 con 0x7f6f1c15a220 2023-10-06T02:57:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f02ffd700 1 -- 172.21.15.84:0/1055990226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14011ab0 con 0x7f6f1c15a220 2023-10-06T02:57:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.391+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1c0b10c0 con 0x7f6f1c15a220 2023-10-06T02:57:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.392+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1c0b15e0 con 0x7f6f1c15a220 2023-10-06T02:57:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.393+0000 7f6f02ffd700 1 -- 172.21.15.84:0/1055990226 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f1401b3b0 con 0x7f6f1c15a220 2023-10-06T02:57:44.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.393+0000 7f6f02ffd700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f08066f30 0x7f6f080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:44.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.393+0000 7f6f02ffd700 1 -- 172.21.15.84:0/1055990226 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6f14083cc0 con 0x7f6f1c15a220 2023-10-06T02:57:44.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.393+0000 7f6f1affd700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f08066f30 0x7f6f080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:44.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.393+0000 7f6f1affd700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f08066f30 0x7f6f080693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009e60 tx=0x7f6f0c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.397+0000 7f6f02ffd700 1 -- 172.21.15.84:0/1055990226 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f1c0b15e0 con 0x7f6f1c15a220 2023-10-06T02:57:44.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.622+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f1c0b15e0 con 0x7f6f1c15a220 2023-10-06T02:57:44.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.623+0000 7f6f02ffd700 1 -- 172.21.15.84:0/1055990226 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4628 (secure 0 0 0) 0x7f6f1c0b15e0 con 0x7f6f1c15a220 2023-10-06T02:57:44.626 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:57:44.626 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:57:43.213063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":8,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:57:44.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.624+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f08066f30 msgr2=0x7f6f080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.624+0000 7f6f213b3700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f08066f30 0x7f6f080693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009e60 tx=0x7f6f0c019000 comp rx=0 tx=0).stop 2023-10-06T02:57:44.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c15a220 msgr2=0x7f6f1c0b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c15a220 0x7f6f1c0b18c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400c590 tx=0x7f6f14007ef0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 shutdown_connections 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f08066f30 0x7f6f080693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f1c069720 0x7f6f1c16e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c15a220 0x7f6f1c0b18c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 --2- 172.21.15.84:0/1055990226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f1c0cb630 0x7f6f1c150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 >> 172.21.15.84:0/1055990226 conn(0x7f6f1c070810 msgr2=0x7f6f1c159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 shutdown_connections 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:44.625+0000 7f6f213b3700 1 -- 172.21.15.84:0/1055990226 wait complete. 2023-10-06T02:57:44.628 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 39 2023-10-06T02:57:44.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:44.639 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T02:57:44.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:44.664 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T02:57:44.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:44.727 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-10-06T02:57:44.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:44.783 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-10-06T02:57:44.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:44.839 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-10-06T02:57:44.895 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:57:45.066 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:57:45.066 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:57:45.066 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:57:47.068 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:57:47.213 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:57:47.213 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:57:47.213 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:57:49.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:57:49.358 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:57:49.358 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:57:49.359 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:57:51.359 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:57:51.505 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2023-10-06T02:57:51.506 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:57:51.506 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:57:53.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:57:53.651 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-10-06T02:57:53.652 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:57:53.652 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:57:53.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:57:53.782 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T02:57:53.783 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:57:53.783 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:57:55.784 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:57:55.927 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T02:57:55.927 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:57:55.928 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:57:57.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:57:58.071 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T02:57:58.072 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:57:58.072 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:57:58.073 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-10-06T02:57:58.215 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T02:57:58.216 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:57:58.218 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:57:58.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2023-10-06T02:57:58.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.334+0000 7f3bbcf4f700 1 Processor -- start 2023-10-06T02:57:58.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.334+0000 7f3bbcf4f700 1 -- start start 2023-10-06T02:57:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bbcf4f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8142f20 0x7f3bb806b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bbcf4f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bb806bb80 0x7f3bb80675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bbcf4f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb806b1b0 con 0x7f3bb8067b30 2023-10-06T02:57:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bbcf4f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb8067fb0 con 0x7f3bb806bb80 2023-10-06T02:57:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bbcf4f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81432f0 con 0x7f3bb8142f20 2023-10-06T02:57:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb5d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bb806bb80 0x7f3bb80675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3bb8067b30 0x7f3bb80c7830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45984/0 (socket says 172.21.15.84:45984) 2023-10-06T02:57:58.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb6d9d700 1 -- 172.21.15.84:0/2666292930 learned_addr learned my addr 172.21.15.84:0/2666292930 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb659c700 1 --2- 172.21.15.84:0/2666292930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8142f20 0x7f3bb806b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/2666292930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8142f20 msgr2=0x7f3bb806b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/2666292930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8142f20 0x7f3bb806b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/2666292930 >> v1:172.21.15.84:6789/0 conn(0x7f3bb8067b30 legacy=0x7f3bb80c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/2666292930 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80cba10 con 0x7f3bb806bb80 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb559a700 1 -- 172.21.15.84:0/2666292930 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638749791 0 0) 0x7f3bb806b1b0 con 0x7f3bb8067b30 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb659c700 1 --2- 172.21.15.84:0/2666292930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8142f20 0x7f3bb806b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/2666292930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 0x7f3bb80675f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0098e0 tx=0x7f3bac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cc880b54bd90ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb559a700 1 -- 172.21.15.84:0/2666292930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac009e80 con 0x7f3bb806bb80 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb559a700 1 -- 172.21.15.84:0/2666292930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00b860 con 0x7f3bb806bb80 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.335+0000 7f3bb559a700 1 -- 172.21.15.84:0/2666292930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00bbe0 con 0x7f3bb806bb80 2023-10-06T02:57:58.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.336+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/2666292930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 msgr2=0x7f3bb80675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.336+0000 7f3bbcf4f700 1 --2- 172.21.15.84:0/2666292930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 0x7f3bb80675f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0098e0 tx=0x7f3bac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.336+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/2666292930 shutdown_connections 2023-10-06T02:57:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.336+0000 7f3bbcf4f700 1 --2- 172.21.15.84:0/2666292930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8142f20 0x7f3bb806b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.336+0000 7f3bbcf4f700 1 --2- 172.21.15.84:0/2666292930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 0x7f3bb80675f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.336+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/2666292930 >> 172.21.15.84:0/2666292930 conn(0x7f3bb80cd1f0 msgr2=0x7f3bb80cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.336+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/2666292930 shutdown_connections 2023-10-06T02:57:58.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.336+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/2666292930 wait complete. 2023-10-06T02:57:58.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.337+0000 7f3bbcf4f700 1 Processor -- start 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.337+0000 7f3bbcf4f700 1 -- start start 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bbcf4f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8067b30 0x7f3bb816d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bbcf4f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 0x7f3bb815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bbcf4f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb8142f20 0x7f3bb813fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bbcf4f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb816cc70 con 0x7f3bb806bb80 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bbcf4f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80b06f0 con 0x7f3bb8142f20 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bbcf4f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb816d1c0 con 0x7f3bb8067b30 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 0x7f3bb815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 0x7f3bb815ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35640/0 (socket says 172.21.15.84:35640) 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/273440453 learned_addr learned my addr 172.21.15.84:0/273440453 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb6d9d700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb8142f20 0x7f3bb813fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb659c700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8067b30 0x7f3bb816d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/273440453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8067b30 msgr2=0x7f3bb816d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8067b30 0x7f3bb816d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/273440453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb8142f20 msgr2=0x7f3bb813fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb8142f20 0x7f3bb813fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/273440453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009420 con 0x7f3bb806bb80 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 0x7f3bb815ea20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8063d90 tx=0x7f3bac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3ba67fc700 1 -- 172.21.15.84:0/273440453 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00bbe0 con 0x7f3bb806bb80 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3ba67fc700 1 -- 172.21.15.84:0/273440453 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac011420 con 0x7f3bb806bb80 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/273440453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb816db90 con 0x7f3bb806bb80 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3ba67fc700 1 -- 172.21.15.84:0/273440453 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac011800 con 0x7f3bb806bb80 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.338+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/273440453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb80b0410 con 0x7f3bb806bb80 2023-10-06T02:57:58.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.340+0000 7f3ba67fc700 1 -- 172.21.15.84:0/273440453 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bac011c30 con 0x7f3bb806bb80 2023-10-06T02:57:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.340+0000 7f3ba67fc700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b98066f30 0x7f3b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.340+0000 7f3ba67fc700 1 -- 172.21.15.84:0/273440453 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3bac0861e0 con 0x7f3bb806bb80 2023-10-06T02:57:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.340+0000 7f3bb659c700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b98066f30 0x7f3b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.340+0000 7f3bb659c700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b98066f30 0x7f3b980693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000f600 tx=0x7f3bb00077b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.342+0000 7f3bc6247b80 1 Processor -- start 2023-10-06T02:57:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.342+0000 7f3bc6247b80 1 -- start start 2023-10-06T02:57:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0e7dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ecd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0ece0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0dd4ac0 con 0x55d1a0e7d890 2023-10-06T02:57:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0dd22c0 con 0x55d1a0e7ed10 2023-10-06T02:57:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0dce0b0 con 0x55d1a0ecdc50 2023-10-06T02:57:58.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0e7dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0e7dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35656/0 (socket says 172.21.15.84:35656) 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb659c700 1 -- 172.21.15.84:0/2506533044 learned_addr learned my addr 172.21.15.84:0/2506533044 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/2506533044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ecd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb6d9d700 1 --2- 172.21.15.84:0/2506533044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0ece0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb659c700 1 -- 172.21.15.84:0/2506533044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 msgr2=0x55d1a0ece0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb659c700 1 --2- 172.21.15.84:0/2506533044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0ece0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb659c700 1 -- 172.21.15.84:0/2506533044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 msgr2=0x55d1a0ecd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb659c700 1 --2- 172.21.15.84:0/2506533044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ecd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb659c700 1 -- 172.21.15.84:0/2506533044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1a0c682c0 con 0x55d1a0e7d890 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3bb659c700 1 --2- 172.21.15.84:0/2506533044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0e7dc60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3bb001a940 tx=0x7f3bb0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677c78191b71349f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3b977fe700 1 -- 172.21.15.84:0/2506533044 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb001a260 con 0x55d1a0e7d890 2023-10-06T02:57:58.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3b977fe700 1 -- 172.21.15.84:0/2506533044 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0018550 con 0x55d1a0e7d890 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.343+0000 7f3b977fe700 1 -- 172.21.15.84:0/2506533044 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb00188d0 con 0x55d1a0e7d890 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.344+0000 7f3bc6247b80 1 -- 172.21.15.84:0/2506533044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 msgr2=0x55d1a0e7dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.344+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/2506533044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0e7dc60 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3bb001a940 tx=0x7f3bb0015000 comp rx=0 tx=0).stop 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.344+0000 7f3bc6247b80 1 -- 172.21.15.84:0/2506533044 shutdown_connections 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.344+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/2506533044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0ece0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.344+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/2506533044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0e7dc60 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.344+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/2506533044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ecd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.344+0000 7f3bc6247b80 1 -- 172.21.15.84:0/2506533044 >> 172.21.15.84:0/2506533044 conn(0x55d1a0e7f1b0 msgr2=0x55d1a0e7f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.344+0000 7f3bc6247b80 1 -- 172.21.15.84:0/2506533044 shutdown_connections 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.344+0000 7f3bc6247b80 1 -- 172.21.15.84:0/2506533044 wait complete. 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.345+0000 7f3bc6247b80 1 -- start start 2023-10-06T02:57:58.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.345+0000 7f3bc6247b80 1 Processor -- start 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ebba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0ec5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0d798e0 con 0x55d1a0e7ed10 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0d94ef0 con 0x55d1a0e7d890 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0c50e80 con 0x55d1a0ecdc50 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bc6247b80 10 client.0 _ll_register_callbacks cb 0x55d1a0e40ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ebba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ebba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35670/0 (socket says 172.21.15.84:35670) 2023-10-06T02:57:58.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/80104225 learned_addr learned my addr 172.21.15.84:0/80104225 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb659c700 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb6d9d700 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0ec5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/80104225 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 msgr2=0x55d1a0ec5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0ec5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/80104225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7d890 msgr2=0x55d1a0ec7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb5d9b700 1 -- 172.21.15.84:0/80104225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb001a4a0 con 0x55d1a0e7ed10 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ebba60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3bac006f00 tx=0x7f3bac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67d83eefacf3f0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3b94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3b94ff9700 1 -- 172.21.15.84:0/80104225 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac06d070 con 0x55d1a0e7ed10 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3b94ff9700 1 -- 172.21.15.84:0/80104225 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3bac056e70 con 0x55d1a0e7ed10 2023-10-06T02:57:58.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3bc6247b80 1 -- 172.21.15.84:0/80104225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1a0e72990 con 0x55d1a0e7ed10 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.346+0000 7f3b94ff9700 1 -- 172.21.15.84:0/80104225 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bac05a0c0 con 0x55d1a0e7ed10 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bc6247b80 10 client.6075 fetch_fsmap learned FSMap version 41 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bc6247b80 1 -- 172.21.15.84:0/80104225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55d1a0c0b030 con 0x55d1a0e7ed10 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3b94ff9700 1 -- 172.21.15.84:0/80104225 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac082020 con 0x55d1a0e7ed10 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3b94ff9700 1 -- 172.21.15.84:0/80104225 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f3bac056360 con 0x55d1a0e7ed10 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bc6247b80 10 client.6075 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bc6247b80 10 client.6075 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bc6247b80 20 client.6075 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x55d1a0ebbfa0 0x55d1a0ebf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bc6247b80 4 client.6075 mds_command: new command op to 5781 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:57:58.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bc6247b80 1 -- 172.21.15.84:0/80104225 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1a0e4f8c0 con 0x55d1a0ebbfa0 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bb659c700 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x55d1a0ebbfa0 0x55d1a0ebf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3b94ff9700 10 client.6075 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.347+0000 7f3bb659c700 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x55d1a0ebbfa0 0x55d1a0ebf260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3057938ccc279 server_cookie=a4f80bfa9dd75c51 in_seq=0 out_seq=0 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3b94ff9700 1 -- 172.21.15.84:0/80104225 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d1a0e4f8c0 con 0x55d1a0ebbfa0 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3b94ff9700 10 client.6075 handle_command_reply: tid=0 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 client.6075 shutdown 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 -- 172.21.15.84:0/80104225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7ed10 msgr2=0x55d1a0ebba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ebba60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3bac006f00 tx=0x7f3bac008040 comp rx=0 tx=0).stop 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 -- 172.21.15.84:0/80104225 shutdown_connections 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x55d1a0ebbfa0 0x55d1a0ebf260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3b94ff9700 0 client.6075 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:58.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0ec5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/80104225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ebba60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 -- 172.21.15.84:0/80104225 >> 172.21.15.84:0/80104225 conn(0x55d1a0e7f1b0 msgr2=0x55d1a0ea6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 -- 172.21.15.84:0/80104225 shutdown_connections 2023-10-06T02:57:58.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 1 -- 172.21.15.84:0/80104225 wait complete. 2023-10-06T02:57:58.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.348+0000 7f3bc6247b80 20 client.6075 trim_cache size 0 max 16384 2023-10-06T02:57:58.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.362+0000 7f3bc6247b80 1 Processor -- start 2023-10-06T02:57:58.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.362+0000 7f3bc6247b80 1 -- start start 2023-10-06T02:57:58.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0edc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0e7a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0ece4a0 con 0x55d1a0e7d890 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0ee5830 con 0x55d1a0e7ed10 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0ece1e0 con 0x55d1a0ecdc50 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35682/0 (socket says 172.21.15.84:35682) 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb659c700 1 -- 172.21.15.84:0/347535710 learned_addr learned my addr 172.21.15.84:0/347535710 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb659c700 1 -- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 msgr2=0x55d1a0e7a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0edc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb6d9d700 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0e7a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb659c700 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0e7a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb659c700 1 -- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 msgr2=0x55d1a0edc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb659c700 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0edc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb659c700 1 -- 172.21.15.84:0/347535710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1a0d9c7d0 con 0x55d1a0e7d890 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0edc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb6d9d700 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0e7a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3bb659c700 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec5200 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0025040 tx=0x7f3bb0032250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428cf2695ccb1836 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3b97fff700 1 -- 172.21.15.84:0/347535710 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0007ec0 con 0x55d1a0e7d890 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3b97fff700 1 -- 172.21.15.84:0/347535710 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb00186c0 con 0x55d1a0e7d890 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.363+0000 7f3b97fff700 1 -- 172.21.15.84:0/347535710 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0018830 con 0x55d1a0e7d890 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.364+0000 7f3bc6247b80 1 -- 172.21.15.84:0/347535710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 msgr2=0x55d1a0ec5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.364+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec5200 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0025040 tx=0x7f3bb0032250 comp rx=0 tx=0).stop 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.364+0000 7f3bc6247b80 1 -- 172.21.15.84:0/347535710 shutdown_connections 2023-10-06T02:57:58.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.364+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0ecdc50 0x55d1a0e7a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.364+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0e7d890 0x55d1a0ec5200 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.364+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/347535710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0edc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.364+0000 7f3bc6247b80 1 -- 172.21.15.84:0/347535710 >> 172.21.15.84:0/347535710 conn(0x55d1a0e7f1b0 msgr2=0x55d1a0e762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.364+0000 7f3bc6247b80 1 -- 172.21.15.84:0/347535710 shutdown_connections 2023-10-06T02:57:58.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.364+0000 7f3bc6247b80 1 -- 172.21.15.84:0/347535710 wait complete. 2023-10-06T02:57:58.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.365+0000 7f3bc6247b80 1 -- start start 2023-10-06T02:57:58.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.365+0000 7f3bc6247b80 1 Processor -- start 2023-10-06T02:57:58.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.365+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0e7d890 0x55d1a0e79530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.365+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ea22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.365+0000 7f3bc6247b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0ecdc50 0x55d1a0ea2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.365+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0eccef0 con 0x55d1a0ecdc50 2023-10-06T02:57:58.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.365+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0ecd5e0 con 0x55d1a0e7ed10 2023-10-06T02:57:58.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.365+0000 7f3bc6247b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1a0eccb10 con 0x55d1a0e7d890 2023-10-06T02:57:58.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.365+0000 7f3bc6247b80 10 client.0 _ll_register_callbacks cb 0x55d1a0ead810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:58.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0ecdc50 0x55d1a0ea2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb659c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0e7d890 0x55d1a0e79530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0ecdc50 0x55d1a0ea2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35690/0 (socket says 172.21.15.84:35690) 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb6d9d700 1 -- 172.21.15.84:0/3265195373 learned_addr learned my addr 172.21.15.84:0/3265195373 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb5d9b700 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ea22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb6d9d700 1 -- 172.21.15.84:0/3265195373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0e7d890 msgr2=0x55d1a0e79530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb6d9d700 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0e7d890 0x55d1a0e79530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb6d9d700 1 -- 172.21.15.84:0/3265195373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 msgr2=0x55d1a0ea22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb6d9d700 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ea22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb6d9d700 1 -- 172.21.15.84:0/3265195373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1a0c682c0 con 0x55d1a0ecdc50 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bb6d9d700 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0ecdc50 0x55d1a0ea2830 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3bb815e1e0 tx=0x7f3ba8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8da833ac053eadc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3b94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3b94ff9700 1 -- 172.21.15.84:0/3265195373 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8017640 con 0x55d1a0ecdc50 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3b94ff9700 1 -- 172.21.15.84:0/3265195373 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3ba801cb40 con 0x55d1a0ecdc50 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bc6247b80 1 -- 172.21.15.84:0/3265195373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3bb0018550 con 0x55d1a0ecdc50 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3b94ff9700 1 -- 172.21.15.84:0/3265195373 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ba80177a0 con 0x55d1a0ecdc50 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bc6247b80 10 client.6081 fetch_fsmap learned FSMap version 41 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bc6247b80 1 -- 172.21.15.84:0/3265195373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55d1a0d834c0 con 0x55d1a0ecdc50 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3b94ff9700 1 -- 172.21.15.84:0/3265195373 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0018550 con 0x55d1a0ecdc50 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3b94ff9700 1 -- 172.21.15.84:0/3265195373 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f3ba8012070 con 0x55d1a0ecdc50 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bc6247b80 10 client.6081 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bc6247b80 10 client.6081 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:57:58.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bc6247b80 20 client.6081 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:58.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x55d1a0ecafb0 0x55d1a0ecb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bc6247b80 4 client.6081 mds_command: new command op to 5781 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:57:58.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.366+0000 7f3bc6247b80 1 -- 172.21.15.84:0/3265195373 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d1a0d70e50 con 0x55d1a0ecafb0 2023-10-06T02:57:58.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.367+0000 7f3bb659c700 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x55d1a0ecafb0 0x55d1a0ecb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.367+0000 7f3b94ff9700 10 client.6081 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:58.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.367+0000 7f3bb659c700 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x55d1a0ecafb0 0x55d1a0ecb3b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75431162374a2e80 server_cookie=3de56b1eca2296c0 in_seq=0 out_seq=0 2023-10-06T02:57:58.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.378+0000 7f3b94ff9700 1 -- 172.21.15.84:0/3265195373 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d1a0d70e50 con 0x55d1a0ecafb0 2023-10-06T02:57:58.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.378+0000 7f3b94ff9700 10 client.6081 handle_command_reply: tid=0 2023-10-06T02:57:58.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.378+0000 7f3bc6247b80 1 client.6081 shutdown 2023-10-06T02:57:58.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 -- 172.21.15.84:0/3265195373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0ecdc50 msgr2=0x55d1a0ea2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0ecdc50 0x55d1a0ea2830 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3bb815e1e0 tx=0x7f3ba8009040 comp rx=0 tx=0).stop 2023-10-06T02:57:58.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 -- 172.21.15.84:0/3265195373 shutdown_connections 2023-10-06T02:57:58.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1a0ecdc50 0x55d1a0ea2830 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d1a0e7d890 0x55d1a0e79530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x55d1a0ecafb0 0x55d1a0ecb3b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 --2- 172.21.15.84:0/3265195373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d1a0e7ed10 0x55d1a0ea22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3b94ff9700 0 client.6081 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:57:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 -- 172.21.15.84:0/3265195373 >> 172.21.15.84:0/3265195373 conn(0x55d1a0e7f1b0 msgr2=0x55d1a0edc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 -- 172.21.15.84:0/3265195373 shutdown_connections 2023-10-06T02:57:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 1 -- 172.21.15.84:0/3265195373 wait complete. 2023-10-06T02:57:58.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.379+0000 7f3bc6247b80 20 client.6081 trim_cache size 0 max 16384 2023-10-06T02:57:58.382 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:57:58.383 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T02:57:58.383 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:57:58.383 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b98066f30 msgr2=0x7f3b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b98066f30 0x7f3b980693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000f600 tx=0x7f3bb00077b0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 msgr2=0x7f3bb815ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 0x7f3bb815ea20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8063d90 tx=0x7f3bac017000 comp rx=0 tx=0).stop 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/273440453 shutdown_connections 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3b98066f30 0x7f3b980693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bb8142f20 0x7f3bb813fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bb8067b30 0x7f3bb816d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 --2- 172.21.15.84:0/273440453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bb806bb80 0x7f3bb815ea20 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/273440453 >> 172.21.15.84:0/273440453 conn(0x7f3bb80cd1f0 msgr2=0x7f3bb80ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/273440453 shutdown_connections 2023-10-06T02:57:58.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.380+0000 7f3bbcf4f700 1 -- 172.21.15.84:0/273440453 wait complete. 2023-10-06T02:57:58.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 flush journal 2023-10-06T02:57:58.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.507+0000 7f26198db700 1 Processor -- start 2023-10-06T02:57:58.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.507+0000 7f26198db700 1 -- start start 2023-10-06T02:57:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26198db700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26140b2660 0x7f26140cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26198db700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140cf1f0 0x7f26140cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26198db700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26140cc9b0 con 0x7f26140b2a30 2023-10-06T02:57:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26198db700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140cbda0 con 0x7f26140b2660 2023-10-06T02:57:58.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26198db700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140cc080 con 0x7f26140cf1f0 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26188d9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26140b2660 0x7f26140cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26188d9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26140b2660 0x7f26140cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35706/0 (socket says 172.21.15.84:35706) 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26188d9700 1 -- 172.21.15.84:0/429993961 learned_addr learned my addr 172.21.15.84:0/429993961 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26190da700 1 --2- 172.21.15.84:0/429993961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140cf1f0 0x7f26140cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26188d9700 1 -- 172.21.15.84:0/429993961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140cf1f0 msgr2=0x7f26140cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26188d9700 1 --2- 172.21.15.84:0/429993961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140cf1f0 0x7f26140cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26188d9700 1 -- 172.21.15.84:0/429993961 >> v1:172.21.15.131:6789/0 conn(0x7f26140b2a30 legacy=0x7f26140ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26188d9700 1 -- 172.21.15.84:0/429993961 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140cc360 con 0x7f26140b2660 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.508+0000 7f26188d9700 1 --2- 172.21.15.84:0/429993961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2660 0x7f26140cccf0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2608009990 tx=0x7f2608009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7774e6a75c17b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26137fe700 1 -- 172.21.15.84:0/429993961 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608005c10 con 0x7f26140b2660 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26137fe700 1 -- 172.21.15.84:0/429993961 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608005d70 con 0x7f26140b2660 2023-10-06T02:57:58.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26137fe700 1 -- 172.21.15.84:0/429993961 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260800b880 con 0x7f26140b2660 2023-10-06T02:57:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26198db700 1 -- 172.21.15.84:0/429993961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2660 msgr2=0x7f26140cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26198db700 1 --2- 172.21.15.84:0/429993961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2660 0x7f26140cccf0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2608009990 tx=0x7f2608009220 comp rx=0 tx=0).stop 2023-10-06T02:57:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26198db700 1 -- 172.21.15.84:0/429993961 shutdown_connections 2023-10-06T02:57:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26198db700 1 --2- 172.21.15.84:0/429993961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140cf1f0 0x7f26140cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26198db700 1 --2- 172.21.15.84:0/429993961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2660 0x7f26140cccf0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26198db700 1 -- 172.21.15.84:0/429993961 >> 172.21.15.84:0/429993961 conn(0x7f2614099560 msgr2=0x7f261406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26198db700 1 -- 172.21.15.84:0/429993961 shutdown_connections 2023-10-06T02:57:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.509+0000 7f26198db700 1 -- 172.21.15.84:0/429993961 wait complete. 2023-10-06T02:57:58.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.510+0000 7f26198db700 1 Processor -- start 2023-10-06T02:57:58.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.510+0000 7f26198db700 1 -- start start 2023-10-06T02:57:58.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f26198db700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140b2660 0x7f261409dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f26198db700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2a30 0x7f261409ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f26198db700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140cf1f0 0x7f26140b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f26198db700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261409d340 con 0x7f26140b2a30 2023-10-06T02:57:58.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f26198db700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261416a380 con 0x7f26140cf1f0 2023-10-06T02:57:58.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f26198db700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2614169770 con 0x7f26140b2660 2023-10-06T02:57:58.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f2613fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2a30 0x7f261409ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f2613fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2a30 0x7f261409ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35712/0 (socket says 172.21.15.84:35712) 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f2613fff700 1 -- 172.21.15.84:0/1953547886 learned_addr learned my addr 172.21.15.84:0/1953547886 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f26190da700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140cf1f0 0x7f26140b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.511+0000 7f26188d9700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140b2660 0x7f261409dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f2613fff700 1 -- 172.21.15.84:0/1953547886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140b2660 msgr2=0x7f261409dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f2613fff700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140b2660 0x7f261409dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f2613fff700 1 -- 172.21.15.84:0/1953547886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140cf1f0 msgr2=0x7f26140b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f2613fff700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140cf1f0 0x7f26140b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f2613fff700 1 -- 172.21.15.84:0/1953547886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2608009480 con 0x7f26140b2a30 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f2613fff700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2a30 0x7f261409ce00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f260000c7c0 tx=0x7f2600007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f2610ff9700 1 -- 172.21.15.84:0/1953547886 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600011590 con 0x7f26140b2a30 2023-10-06T02:57:58.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f2610ff9700 1 -- 172.21.15.84:0/1953547886 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000116f0 con 0x7f26140b2a30 2023-10-06T02:57:58.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f26198db700 1 -- 172.21.15.84:0/1953547886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2614169a50 con 0x7f26140b2a30 2023-10-06T02:57:58.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f2610ff9700 1 -- 172.21.15.84:0/1953547886 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600011ab0 con 0x7f26140b2a30 2023-10-06T02:57:58.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.512+0000 7f26198db700 1 -- 172.21.15.84:0/1953547886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261416a090 con 0x7f26140b2a30 2023-10-06T02:57:58.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.513+0000 7f2610ff9700 1 -- 172.21.15.84:0/1953547886 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f260001b3b0 con 0x7f26140b2a30 2023-10-06T02:57:58.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.514+0000 7f2610ff9700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.514+0000 7f2610ff9700 1 -- 172.21.15.84:0/1953547886 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2600083ba0 con 0x7f26140b2a30 2023-10-06T02:57:58.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.514+0000 7f26188d9700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.514+0000 7f26188d9700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f26140b5500 tx=0x7f2608016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2623e35b80 1 Processor -- start 2023-10-06T02:57:58.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2623e35b80 1 -- start start 2023-10-06T02:57:58.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb7dea0 0x564eedb58d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedb59250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5fa60 0x564eedb59790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2623e35b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eedab3ac0 con 0x564eedb5e310 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2623e35b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eedab12c0 con 0x564eedb5fa60 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2623e35b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eedaad0b0 con 0x564eedb7dea0 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2613fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedb59250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2613fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedb59250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35726/0 (socket says 172.21.15.84:35726) 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.516+0000 7f2613fff700 1 -- 172.21.15.84:0/2068372053 learned_addr learned my addr 172.21.15.84:0/2068372053 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2613fff700 1 -- 172.21.15.84:0/2068372053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb7dea0 msgr2=0x564eedb58d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f26188d9700 1 --2- 172.21.15.84:0/2068372053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb7dea0 0x564eedb58d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f26190da700 1 --2- 172.21.15.84:0/2068372053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5fa60 0x564eedb59790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2613fff700 1 --2- 172.21.15.84:0/2068372053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb7dea0 0x564eedb58d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2613fff700 1 -- 172.21.15.84:0/2068372053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5fa60 msgr2=0x564eedb59790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2613fff700 1 --2- 172.21.15.84:0/2068372053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5fa60 0x564eedb59790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2613fff700 1 -- 172.21.15.84:0/2068372053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eed9472c0 con 0x564eedb5e310 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2613fff700 1 --2- 172.21.15.84:0/2068372053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedb59250 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f260000a040 tx=0x7f2600081d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b5859bb1da90d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f25fdffb700 1 -- 172.21.15.84:0/2068372053 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600057a80 con 0x564eedb5e310 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f25fdffb700 1 -- 172.21.15.84:0/2068372053 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260005b7d0 con 0x564eedb5e310 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f25fdffb700 1 -- 172.21.15.84:0/2068372053 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600052970 con 0x564eedb5e310 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2623e35b80 1 -- 172.21.15.84:0/2068372053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 msgr2=0x564eedb59250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2623e35b80 1 --2- 172.21.15.84:0/2068372053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedb59250 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f260000a040 tx=0x7f2600081d80 comp rx=0 tx=0).stop 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2623e35b80 1 -- 172.21.15.84:0/2068372053 shutdown_connections 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2623e35b80 1 --2- 172.21.15.84:0/2068372053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5fa60 0x564eedb59790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2623e35b80 1 --2- 172.21.15.84:0/2068372053 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb7dea0 0x564eedb58d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2623e35b80 1 --2- 172.21.15.84:0/2068372053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedb59250 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.517+0000 7f2623e35b80 1 -- 172.21.15.84:0/2068372053 >> 172.21.15.84:0/2068372053 conn(0x564eedb5ded0 msgr2=0x564eedb5e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.518+0000 7f2623e35b80 1 -- 172.21.15.84:0/2068372053 shutdown_connections 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.518+0000 7f2623e35b80 1 -- 172.21.15.84:0/2068372053 wait complete. 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.518+0000 7f2623e35b80 1 -- start start 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.518+0000 7f2623e35b80 1 Processor -- start 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedbb27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 0x564eedbb38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb7dea0 0x564eedb7e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f2623e35b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eeda588e0 con 0x564eedb5e310 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f2623e35b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eeda73ef0 con 0x564eedb7dea0 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f2623e35b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eed92fe80 con 0x564eedb5fa60 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f2623e35b80 10 client.0 _ll_register_callbacks cb 0x564eedb20070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f26188d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedbb27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f26188d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedbb27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35728/0 (socket says 172.21.15.84:35728) 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f26188d9700 1 -- 172.21.15.84:0/509018245 learned_addr learned my addr 172.21.15.84:0/509018245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f2613fff700 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 0x564eedbb38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f26190da700 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb7dea0 0x564eedb7e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f26188d9700 1 -- 172.21.15.84:0/509018245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 msgr2=0x564eedbb38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f26188d9700 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 0x564eedbb38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f26188d9700 1 -- 172.21.15.84:0/509018245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb7dea0 msgr2=0x564eedb7e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f26188d9700 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb7dea0 0x564eedb7e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.519+0000 7f26188d9700 1 -- 172.21.15.84:0/509018245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261416a090 con 0x564eedb5e310 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f26188d9700 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedbb27e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2608012000 tx=0x7f2608021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe7e3af628d0ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f25f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f25f2ffd700 1 -- 172.21.15.84:0/509018245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260802e070 con 0x564eedb5e310 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f25f2ffd700 1 -- 172.21.15.84:0/509018245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2608033d60 con 0x564eedb5e310 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2623e35b80 1 -- 172.21.15.84:0/509018245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564eedb51990 con 0x564eedb5e310 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f25f2ffd700 1 -- 172.21.15.84:0/509018245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2608021070 con 0x564eedb5e310 2023-10-06T02:57:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2623e35b80 10 client.6093 fetch_fsmap learned FSMap version 41 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2623e35b80 1 -- 172.21.15.84:0/509018245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x564eed8ea030 con 0x564eedb5e310 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f25f2ffd700 1 -- 172.21.15.84:0/509018245 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564eedb51990 con 0x564eedb5e310 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f25f2ffd700 1 -- 172.21.15.84:0/509018245 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f2608029a10 con 0x564eedb5e310 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2623e35b80 10 client.6093 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2623e35b80 10 client.6093 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2623e35b80 20 client.6093 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2623e35b80 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x564eedbb4070 0x564eedbb55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2623e35b80 4 client.6093 mds_command: new command op to 5778 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2623e35b80 1 -- 172.21.15.84:0/509018245 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564eedb2e8c0 con 0x564eedbb4070 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.520+0000 7f2613fff700 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x564eedbb4070 0x564eedbb55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2613fff700 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x564eedbb4070 0x564eedbb55d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=458894e37dacc22f server_cookie=e496e5124ada29d0 in_seq=0 out_seq=0 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f25f2ffd700 10 client.6093 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f25f2ffd700 1 -- 172.21.15.84:0/509018245 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564eedb2e8c0 con 0x564eedbb4070 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f25f2ffd700 10 client.6093 handle_command_reply: tid=0 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 client.6093 shutdown 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 -- 172.21.15.84:0/509018245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 msgr2=0x564eedbb27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedbb27e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2608012000 tx=0x7f2608021000 comp rx=0 tx=0).stop 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 -- 172.21.15.84:0/509018245 shutdown_connections 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x564eedbb4070 0x564eedbb55d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb7dea0 0x564eedb7e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5e310 0x564eedbb27e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 --2- 172.21.15.84:0/509018245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 0x564eedbb38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f25f2ffd700 0 client.6093 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:57:58.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 -- 172.21.15.84:0/509018245 >> 172.21.15.84:0/509018245 conn(0x564eedb5ded0 msgr2=0x564eedb5ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 -- 172.21.15.84:0/509018245 shutdown_connections 2023-10-06T02:57:58.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 1 -- 172.21.15.84:0/509018245 wait complete. 2023-10-06T02:57:58.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.521+0000 7f2623e35b80 20 client.6093 trim_cache size 0 max 16384 2023-10-06T02:57:58.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.535+0000 7f2623e35b80 1 Processor -- start 2023-10-06T02:57:58.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.535+0000 7f2623e35b80 1 -- start start 2023-10-06T02:57:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5ded0 0x564eedb7bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5e310 0x564eedba65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 0x564eedb58b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f2623e35b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eedb5a580 con 0x564eedb5ded0 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f2623e35b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eedb7efa0 con 0x564eedb5e310 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f2623e35b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eedb3c330 con 0x564eedb5fa60 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26188d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5ded0 0x564eedb7bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26188d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5ded0 0x564eedb7bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35736/0 (socket says 172.21.15.84:35736) 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26188d9700 1 -- 172.21.15.84:0/463700706 learned_addr learned my addr 172.21.15.84:0/463700706 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f2613fff700 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5e310 0x564eedba65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26190da700 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 0x564eedb58b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26188d9700 1 -- 172.21.15.84:0/463700706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 msgr2=0x564eedb58b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26188d9700 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 0x564eedb58b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26188d9700 1 -- 172.21.15.84:0/463700706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5e310 msgr2=0x564eedba65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26188d9700 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5e310 0x564eedba65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26188d9700 1 -- 172.21.15.84:0/463700706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eeda7b7d0 con 0x564eedb5ded0 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f2613fff700 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5e310 0x564eedba65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.536+0000 7f26188d9700 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5ded0 0x564eedb7bba0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f260800b3c0 tx=0x7f260802b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2459bcfa6de0320 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f25fe7fc700 1 -- 172.21.15.84:0/463700706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260802e070 con 0x564eedb5ded0 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f25fe7fc700 1 -- 172.21.15.84:0/463700706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608029a10 con 0x564eedb5ded0 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f25fe7fc700 1 -- 172.21.15.84:0/463700706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608021070 con 0x564eedb5ded0 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f2623e35b80 1 -- 172.21.15.84:0/463700706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5ded0 msgr2=0x564eedb7bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f2623e35b80 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5ded0 0x564eedb7bba0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f260800b3c0 tx=0x7f260802b050 comp rx=0 tx=0).stop 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f2623e35b80 1 -- 172.21.15.84:0/463700706 shutdown_connections 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f2623e35b80 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5fa60 0x564eedb58b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f2623e35b80 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5ded0 0x564eedb7bba0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f2623e35b80 1 --2- 172.21.15.84:0/463700706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5e310 0x564eedba65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f2623e35b80 1 -- 172.21.15.84:0/463700706 >> 172.21.15.84:0/463700706 conn(0x564eedb8cd50 msgr2=0x564eedb8a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f2623e35b80 1 -- 172.21.15.84:0/463700706 shutdown_connections 2023-10-06T02:57:58.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.537+0000 7f2623e35b80 1 -- 172.21.15.84:0/463700706 wait complete. 2023-10-06T02:57:58.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.538+0000 7f2623e35b80 1 -- start start 2023-10-06T02:57:58.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.538+0000 7f2623e35b80 1 Processor -- start 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5ded0 0x564eedb594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5e310 0x564eedb7c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5fa60 0x564eedb7c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eedb7cc10 con 0x564eedb5fa60 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eedc09bc0 con 0x564eedb5ded0 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eedb7ce60 con 0x564eedb5e310 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 10 client.0 _ll_register_callbacks cb 0x564eedb20070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26190da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5fa60 0x564eedb7c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26190da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5fa60 0x564eedb7c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35744/0 (socket says 172.21.15.84:35744) 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26190da700 1 -- 172.21.15.84:0/1676583153 learned_addr learned my addr 172.21.15.84:0/1676583153 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26188d9700 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5ded0 0x564eedb594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2613fff700 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5e310 0x564eedb7c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26190da700 1 -- 172.21.15.84:0/1676583153 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5e310 msgr2=0x564eedb7c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26190da700 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5e310 0x564eedb7c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26190da700 1 -- 172.21.15.84:0/1676583153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5ded0 msgr2=0x564eedb594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26190da700 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5ded0 0x564eedb594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26190da700 1 -- 172.21.15.84:0/1676583153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564eed8ea030 con 0x564eedb5fa60 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f26190da700 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5fa60 0x564eedb7c690 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f260c016e70 tx=0x7f260c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b3ba67e058757e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f25f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f25f2ffd700 1 -- 172.21.15.84:0/1676583153 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c007e50 con 0x564eedb5fa60 2023-10-06T02:57:58.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f25f2ffd700 1 -- 172.21.15.84:0/1676583153 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f260c018420 con 0x564eedb5fa60 2023-10-06T02:57:58.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 1 -- 172.21.15.84:0/1676583153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f260005b7d0 con 0x564eedb5fa60 2023-10-06T02:57:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f25f2ffd700 1 -- 172.21.15.84:0/1676583153 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f260c0187f0 con 0x564eedb5fa60 2023-10-06T02:57:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 10 client.6099 fetch_fsmap learned FSMap version 41 2023-10-06T02:57:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f2623e35b80 1 -- 172.21.15.84:0/1676583153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x564eeda624c0 con 0x564eedb5fa60 2023-10-06T02:57:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.539+0000 7f25f2ffd700 1 -- 172.21.15.84:0/1676583153 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260005b7d0 con 0x564eedb5fa60 2023-10-06T02:57:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f25f2ffd700 1 -- 172.21.15.84:0/1676583153 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f260c01e020 con 0x564eedb5fa60 2023-10-06T02:57:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f2623e35b80 10 client.6099 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:57:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f2623e35b80 10 client.6099 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2023-10-06T02:57:58.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f2623e35b80 20 client.6099 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f2623e35b80 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x564eedb7dea0 0x564eedb88e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f2623e35b80 4 client.6099 mds_command: new command op to 5778 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:57:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f2623e35b80 1 -- 172.21.15.84:0/1676583153 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564eeda4fe50 con 0x564eedb7dea0 2023-10-06T02:57:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f26188d9700 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x564eedb7dea0 0x564eedb88e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f25f2ffd700 10 client.6099 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:57:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.540+0000 7f26188d9700 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x564eedb7dea0 0x564eedb88e70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e070f1a4ac54d9d server_cookie=3ac959fe0742406 in_seq=0 out_seq=0 2023-10-06T02:57:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f25f2ffd700 1 -- 172.21.15.84:0/1676583153 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564eeda4fe50 con 0x564eedb7dea0 2023-10-06T02:57:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f25f2ffd700 10 client.6099 handle_command_reply: tid=0 2023-10-06T02:57:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 client.6099 shutdown 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 -- 172.21.15.84:0/1676583153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5fa60 msgr2=0x564eedb7c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5fa60 0x564eedb7c690 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f260c016e70 tx=0x7f260c00b040 comp rx=0 tx=0).stop 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 -- 172.21.15.84:0/1676583153 shutdown_connections 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x564eedb7dea0 0x564eedb88e70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564eedb5ded0 0x564eedb594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f25f2ffd700 0 client.6099 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564eedb5fa60 0x564eedb7c690 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 --2- 172.21.15.84:0/1676583153 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564eedb5e310 0x564eedb7c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 -- 172.21.15.84:0/1676583153 >> 172.21.15.84:0/1676583153 conn(0x564eedb8cd50 msgr2=0x564eedb53a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 -- 172.21.15.84:0/1676583153 shutdown_connections 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.548+0000 7f2623e35b80 1 -- 172.21.15.84:0/1676583153 wait complete. 2023-10-06T02:57:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f2623e35b80 20 client.6099 trim_cache size 0 max 16384 2023-10-06T02:57:58.553 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:57:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T02:57:58.553 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:57:58.553 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:57:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 -- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 msgr2=0x7f25f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f26140b5500 tx=0x7f2608016000 comp rx=0 tx=0).stop 2023-10-06T02:57:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 -- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2a30 msgr2=0x7f261409ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2a30 0x7f261409ce00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f260000c7c0 tx=0x7f2600007f50 comp rx=0 tx=0).stop 2023-10-06T02:57:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 -- 172.21.15.84:0/1953547886 shutdown_connections 2023-10-06T02:57:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140cf1f0 0x7f26140b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140b2660 0x7f261409dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 --2- 172.21.15.84:0/1953547886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140b2a30 0x7f261409ce00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 -- 172.21.15.84:0/1953547886 >> 172.21.15.84:0/1953547886 conn(0x7f2614099560 msgr2=0x7f26140cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 -- 172.21.15.84:0/1953547886 shutdown_connections 2023-10-06T02:57:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.549+0000 7f26198db700 1 -- 172.21.15.84:0/1953547886 wait complete. 2023-10-06T02:57:58.562 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:2 flush journal 2023-10-06T02:57:58.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.677+0000 7f16e2d76700 1 Processor -- start 2023-10-06T02:57:58.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.677+0000 7f16e2d76700 1 -- start start 2023-10-06T02:57:58.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2d76700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0cd400 0x7f16dc0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2d76700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16dc0b2a30 0x7f16dc0cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2d76700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0cc9b0 con 0x7f16dc0b2660 2023-10-06T02:57:58.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2d76700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0cf560 con 0x7f16dc0b2a30 2023-10-06T02:57:58.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2d76700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0cbda0 con 0x7f16dc0cd400 2023-10-06T02:57:58.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2575700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16dc0b2a30 0x7f16dc0cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2575700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16dc0b2a30 0x7f16dc0cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35756/0 (socket says 172.21.15.84:35756) 2023-10-06T02:57:58.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2575700 1 -- 172.21.15.84:0/1374693192 learned_addr learned my addr 172.21.15.84:0/1374693192 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e1573700 1 --2- 172.21.15.84:0/1374693192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0cd400 0x7f16dc0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2575700 1 -- 172.21.15.84:0/1374693192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0cd400 msgr2=0x7f16dc0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2575700 1 --2- 172.21.15.84:0/1374693192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0cd400 0x7f16dc0ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2575700 1 -- 172.21.15.84:0/1374693192 >> v1:172.21.15.131:6789/0 conn(0x7f16dc0b2660 legacy=0x7f16dc0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2575700 1 -- 172.21.15.84:0/1374693192 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0cc080 con 0x7f16dc0b2a30 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.678+0000 7f16e2575700 1 --2- 172.21.15.84:0/1374693192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0b2a30 0x7f16dc0cf020 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009f20 tx=0x7f16cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4674757875c7ed33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e0d72700 1 -- 172.21.15.84:0/1374693192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc00e070 con 0x7f16dc0b2a30 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e0d72700 1 -- 172.21.15.84:0/1374693192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc00ba80 con 0x7f16dc0b2a30 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e0d72700 1 -- 172.21.15.84:0/1374693192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0092e0 con 0x7f16dc0b2a30 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e2d76700 1 -- 172.21.15.84:0/1374693192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0b2a30 msgr2=0x7f16dc0cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e2d76700 1 --2- 172.21.15.84:0/1374693192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0b2a30 0x7f16dc0cf020 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009f20 tx=0x7f16cc009840 comp rx=0 tx=0).stop 2023-10-06T02:57:58.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e2d76700 1 -- 172.21.15.84:0/1374693192 shutdown_connections 2023-10-06T02:57:58.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e2d76700 1 --2- 172.21.15.84:0/1374693192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0b2a30 0x7f16dc0cf020 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e2d76700 1 --2- 172.21.15.84:0/1374693192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0cd400 0x7f16dc0ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e2d76700 1 -- 172.21.15.84:0/1374693192 >> 172.21.15.84:0/1374693192 conn(0x7f16dc099560 msgr2=0x7f16dc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e2d76700 1 -- 172.21.15.84:0/1374693192 shutdown_connections 2023-10-06T02:57:58.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.679+0000 7f16e2d76700 1 -- 172.21.15.84:0/1374693192 wait complete. 2023-10-06T02:57:58.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.680+0000 7f16e2d76700 1 Processor -- start 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.680+0000 7f16e2d76700 1 -- start start 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2d76700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0b2660 0x7f16dc0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2d76700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16dc0b2a30 0x7f16dc154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2d76700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0cd400 0x7f16dc157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2d76700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc15ab10 con 0x7f16dc0cd400 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2d76700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0b60b0 con 0x7f16dc0b2a30 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2d76700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc154890 con 0x7f16dc0b2660 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2575700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0cd400 0x7f16dc157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2575700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0cd400 0x7f16dc157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35762/0 (socket says 172.21.15.84:35762) 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2575700 1 -- 172.21.15.84:0/2576224825 learned_addr learned my addr 172.21.15.84:0/2576224825 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e1573700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16dc0b2a30 0x7f16dc154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e1d74700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0b2660 0x7f16dc0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2575700 1 -- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0b2660 msgr2=0x7f16dc0b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2575700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0b2660 0x7f16dc0b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2575700 1 -- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16dc0b2a30 msgr2=0x7f16dc154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2575700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16dc0b2a30 0x7f16dc154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e2575700 1 -- 172.21.15.84:0/2576224825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc009ae0 con 0x7f16dc0cd400 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e1d74700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0b2660 0x7f16dc0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.681+0000 7f16e1573700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16dc0b2a30 0x7f16dc154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.682+0000 7f16e2575700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0cd400 0x7f16dc157ea0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f16cc012000 tx=0x7f16cc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.682+0000 7f16d9ffb700 1 -- 172.21.15.84:0/2576224825 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0094e0 con 0x7f16dc0cd400 2023-10-06T02:57:58.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.682+0000 7f16d9ffb700 1 -- 172.21.15.84:0/2576224825 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc008e80 con 0x7f16dc0cd400 2023-10-06T02:57:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.682+0000 7f16e2d76700 1 -- 172.21.15.84:0/2576224825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc159d50 con 0x7f16dc0cd400 2023-10-06T02:57:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.682+0000 7f16d9ffb700 1 -- 172.21.15.84:0/2576224825 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0266b0 con 0x7f16dc0cd400 2023-10-06T02:57:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.682+0000 7f16e2d76700 1 -- 172.21.15.84:0/2576224825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc15a310 con 0x7f16dc0cd400 2023-10-06T02:57:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.684+0000 7f16d9ffb700 1 -- 172.21.15.84:0/2576224825 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16cc003040 con 0x7f16dc0cd400 2023-10-06T02:57:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.684+0000 7f16d9ffb700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16c8066f30 0x7f16c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.684+0000 7f16d9ffb700 1 -- 172.21.15.84:0/2576224825 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f16cc086820 con 0x7f16dc0cd400 2023-10-06T02:57:58.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.684+0000 7f16e1d74700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16c8066f30 0x7f16c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.685+0000 7f16e1d74700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16c8066f30 0x7f16c80693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001850 tx=0x7f16d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.686+0000 7f16ed2d0b80 1 Processor -- start 2023-10-06T02:57:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.686+0000 7f16ed2d0b80 1 -- start start 2023-10-06T02:57:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.686+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf4eea0 0x5635fbf29d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.686+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf2f310 0x5635fbf2a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.686+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf30a60 0x5635fbf2a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.686+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fbe84ac0 con 0x5635fbf30a60 2023-10-06T02:57:58.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.686+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fbe822c0 con 0x5635fbf2f310 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.686+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5635fbe7e0b0 con 0x5635fbf4eea0 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e2575700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf30a60 0x5635fbf2a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e2575700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf30a60 0x5635fbf2a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35768/0 (socket says 172.21.15.84:35768) 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e2575700 1 -- 172.21.15.84:0/2040010658 learned_addr learned my addr 172.21.15.84:0/2040010658 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e1d74700 1 --2- 172.21.15.84:0/2040010658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf4eea0 0x5635fbf29d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e1573700 1 --2- 172.21.15.84:0/2040010658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf2f310 0x5635fbf2a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e2575700 1 -- 172.21.15.84:0/2040010658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf4eea0 msgr2=0x5635fbf29d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e2575700 1 --2- 172.21.15.84:0/2040010658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf4eea0 0x5635fbf29d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e2575700 1 -- 172.21.15.84:0/2040010658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf2f310 msgr2=0x5635fbf2a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e2575700 1 --2- 172.21.15.84:0/2040010658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf2f310 0x5635fbf2a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e2575700 1 -- 172.21.15.84:0/2040010658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635fbd182c0 con 0x5635fbf30a60 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16e2575700 1 --2- 172.21.15.84:0/2040010658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf30a60 0x5635fbf2a790 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0090a0 tx=0x7f16cc084a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2fd691c0a43ef6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16c2ffd700 1 -- 172.21.15.84:0/2040010658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc00e070 con 0x5635fbf30a60 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16c2ffd700 1 -- 172.21.15.84:0/2040010658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc0575e0 con 0x5635fbf30a60 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.687+0000 7f16c2ffd700 1 -- 172.21.15.84:0/2040010658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc05a700 con 0x5635fbf30a60 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2040010658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf30a60 msgr2=0x5635fbf2a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2040010658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf30a60 0x5635fbf2a790 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0090a0 tx=0x7f16cc084a00 comp rx=0 tx=0).stop 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2040010658 shutdown_connections 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2040010658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf30a60 0x5635fbf2a790 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2040010658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf4eea0 0x5635fbf29d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2040010658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf2f310 0x5635fbf2a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2040010658 >> 172.21.15.84:0/2040010658 conn(0x5635fbf2eed0 msgr2=0x5635fbf2f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2040010658 shutdown_connections 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2040010658 wait complete. 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 -- start start 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.688+0000 7f16ed2d0b80 1 Processor -- start 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf4f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf30a60 0x5635fbf3dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf4eea0 0x5635fbf3e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fbe298e0 con 0x5635fbf2f310 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fbe44ef0 con 0x5635fbf4eea0 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5635fbd00e80 con 0x5635fbf30a60 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16ed2d0b80 10 client.0 _ll_register_callbacks cb 0x5635fbef1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16e1d74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf4f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16e1d74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf4f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35778/0 (socket says 172.21.15.84:35778) 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16e1d74700 1 -- 172.21.15.84:0/4168088021 learned_addr learned my addr 172.21.15.84:0/4168088021 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16e2575700 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf4eea0 0x5635fbf3e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.689+0000 7f16e1573700 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf30a60 0x5635fbf3dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16e1d74700 1 -- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf30a60 msgr2=0x5635fbf3dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16e1d74700 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf30a60 0x5635fbf3dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16e1d74700 1 -- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf4eea0 msgr2=0x5635fbf3e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16e1d74700 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf4eea0 0x5635fbf3e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16e1d74700 1 -- 172.21.15.84:0/4168088021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc15a310 con 0x5635fbf2f310 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16e1d74700 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf4f350 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f16d400efb0 tx=0x7f16d4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7308a81f2e8a3433 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16bbfff700 1 -- 172.21.15.84:0/4168088021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4013da0 con 0x5635fbf2f310 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/4168088021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635fbf22990 con 0x5635fbf2f310 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16bbfff700 1 -- 172.21.15.84:0/4168088021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f16d4022430 con 0x5635fbf2f310 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16bbfff700 1 -- 172.21.15.84:0/4168088021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d4022840 con 0x5635fbf2f310 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16ed2d0b80 10 client.6111 fetch_fsmap learned FSMap version 41 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/4168088021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5635fbcbb030 con 0x5635fbf2f310 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16bbfff700 1 -- 172.21.15.84:0/4168088021 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5635fbf22990 con 0x5635fbf2f310 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.690+0000 7f16bbfff700 1 -- 172.21.15.84:0/4168088021 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f16d40229a0 con 0x5635fbf2f310 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.691+0000 7f16ed2d0b80 10 client.6111 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.691+0000 7f16ed2d0b80 10 client.6111 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.b 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.691+0000 7f16ed2d0b80 20 client.6111 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:58.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.691+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5635fbf83d00 0x5635fbf84100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.691+0000 7f16ed2d0b80 4 client.6111 mds_command: new command op to 5377 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.691+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/4168088021 --> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635fbeff8c0 con 0x5635fbf83d00 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.691+0000 7f16e1573700 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5635fbf83d00 0x5635fbf84100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.691+0000 7f16bbfff700 10 client.6111 ms_handle_connect on v2:172.21.15.131:6834/802742000 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.691+0000 7f16e1573700 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5635fbf83d00 0x5635fbf84100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c4d65d9697e6e1d server_cookie=f3ebd673b0ed25df in_seq=0 out_seq=0 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16bbfff700 1 -- 172.21.15.84:0/4168088021 <== mds.2 v2:172.21.15.131:6834/802742000 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5635fbeff8c0 con 0x5635fbf83d00 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16bbfff700 10 client.6111 handle_command_reply: tid=0 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 client.6111 shutdown 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/4168088021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 msgr2=0x5635fbf4f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf4f350 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f16d400efb0 tx=0x7f16d4013000 comp rx=0 tx=0).stop 2023-10-06T02:57:58.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/4168088021 shutdown_connections 2023-10-06T02:57:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5635fbf83d00 0x5635fbf84100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf4eea0 0x5635fbf3e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16bbfff700 0 client.6111 ms_handle_reset on v2:172.21.15.131:6834/802742000 2023-10-06T02:57:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf4f350 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/4168088021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf30a60 0x5635fbf3dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/4168088021 >> 172.21.15.84:0/4168088021 conn(0x5635fbf2eed0 msgr2=0x5635fbf2dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/4168088021 shutdown_connections 2023-10-06T02:57:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/4168088021 wait complete. 2023-10-06T02:57:58.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.692+0000 7f16ed2d0b80 20 client.6111 trim_cache size 0 max 16384 2023-10-06T02:57:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.706+0000 7f16ed2d0b80 1 Processor -- start 2023-10-06T02:57:58.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.706+0000 7f16ed2d0b80 1 -- start start 2023-10-06T02:57:58.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2eed0 0x5635fbf59be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf5a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 0x5635fbf2dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fbf579b0 con 0x5635fbf2f310 2023-10-06T02:57:58.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fbf576d0 con 0x5635fbf30a60 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5635fbf78b60 con 0x5635fbf2eed0 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1573700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf5a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1573700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf5a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35786/0 (socket says 172.21.15.84:35786) 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1573700 1 -- 172.21.15.84:0/2678807629 learned_addr learned my addr 172.21.15.84:0/2678807629 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e2575700 1 --2- 172.21.15.84:0/2678807629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 0x5635fbf2dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1d74700 1 --2- 172.21.15.84:0/2678807629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2eed0 0x5635fbf59be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1573700 1 -- 172.21.15.84:0/2678807629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2eed0 msgr2=0x5635fbf59be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1573700 1 --2- 172.21.15.84:0/2678807629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2eed0 0x5635fbf59be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1573700 1 -- 172.21.15.84:0/2678807629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 msgr2=0x5635fbf2dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1573700 1 --2- 172.21.15.84:0/2678807629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 0x5635fbf2dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1573700 1 -- 172.21.15.84:0/2678807629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635fbe4c7d0 con 0x5635fbf2f310 2023-10-06T02:57:58.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16e1573700 1 --2- 172.21.15.84:0/2678807629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf5a120 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f16d0006fd0 tx=0x7f16d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee783a0c74ad443 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16c37fe700 1 -- 172.21.15.84:0/2678807629 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d00180d0 con 0x5635fbf2f310 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16c37fe700 1 -- 172.21.15.84:0/2678807629 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d0018230 con 0x5635fbf2f310 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.707+0000 7f16c37fe700 1 -- 172.21.15.84:0/2678807629 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0018c20 con 0x5635fbf2f310 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.708+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2678807629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 msgr2=0x5635fbf5a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.708+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2678807629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf5a120 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f16d0006fd0 tx=0x7f16d0008040 comp rx=0 tx=0).stop 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.708+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2678807629 shutdown_connections 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.708+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2678807629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 0x5635fbf2dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.708+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2678807629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2eed0 0x5635fbf59be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.708+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2678807629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2f310 0x5635fbf5a120 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.708+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2678807629 >> 172.21.15.84:0/2678807629 conn(0x5635fbf5dd50 msgr2=0x5635fbf5a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.708+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2678807629 shutdown_connections 2023-10-06T02:57:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.708+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2678807629 wait complete. 2023-10-06T02:57:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.709+0000 7f16ed2d0b80 1 -- start start 2023-10-06T02:57:58.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.709+0000 7f16ed2d0b80 1 Processor -- start 2023-10-06T02:57:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2eed0 0x5635fbf4ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2f310 0x5635fbfccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 0x5635fbf2dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fbf4d7d0 con 0x5635fbf2eed0 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635fbfcd510 con 0x5635fbf30a60 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5635fbf4d580 con 0x5635fbf2f310 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 10 client.0 _ll_register_callbacks cb 0x5635fbef1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1d74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2eed0 0x5635fbf4ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1d74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2eed0 0x5635fbf4ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35798/0 (socket says 172.21.15.84:35798) 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1d74700 1 -- 172.21.15.84:0/2309459981 learned_addr learned my addr 172.21.15.84:0/2309459981 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1573700 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2f310 0x5635fbfccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e2575700 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 0x5635fbf2dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1d74700 1 -- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2f310 msgr2=0x5635fbfccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1d74700 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2f310 0x5635fbfccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1d74700 1 -- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 msgr2=0x5635fbf2dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1d74700 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 0x5635fbf2dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1d74700 1 -- 172.21.15.84:0/2309459981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d000e040 con 0x5635fbf2eed0 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16e1d74700 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2eed0 0x5635fbf4ced0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001670 tx=0x7f16d4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17509d82fde7ea6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16bbfff700 1 -- 172.21.15.84:0/2309459981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4036070 con 0x5635fbf2eed0 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16bbfff700 1 -- 172.21.15.84:0/2309459981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f16d4022430 con 0x5635fbf2eed0 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2309459981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16cc0575e0 con 0x5635fbf2eed0 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16bbfff700 1 -- 172.21.15.84:0/2309459981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d4022a50 con 0x5635fbf2eed0 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 10 client.6117 fetch_fsmap learned FSMap version 41 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2309459981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5635fbe334c0 con 0x5635fbf2eed0 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.710+0000 7f16bbfff700 1 -- 172.21.15.84:0/2309459981 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc0575e0 con 0x5635fbf2eed0 2023-10-06T02:57:58.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16bbfff700 1 -- 172.21.15.84:0/2309459981 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f16d4039020 con 0x5635fbf2eed0 2023-10-06T02:57:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16ed2d0b80 10 client.6117 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:57:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16ed2d0b80 10 client.6117 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.b 2023-10-06T02:57:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16ed2d0b80 20 client.6117 populate_metadata read hostname 'smithi084' 2023-10-06T02:57:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5635fbf4eea0 0x5635fbf2e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:57:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16ed2d0b80 4 client.6117 mds_command: new command op to 5377 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:57:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2309459981 --> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5635fbe20e50 con 0x5635fbf4eea0 2023-10-06T02:57:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16e1573700 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5635fbf4eea0 0x5635fbf2e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:57:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16bbfff700 10 client.6117 ms_handle_connect on v2:172.21.15.131:6834/802742000 2023-10-06T02:57:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.711+0000 7f16e1573700 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5635fbf4eea0 0x5635fbf2e2e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=362beefb23fe406b server_cookie=502bd4669a5d31f6 in_seq=0 out_seq=0 2023-10-06T02:57:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16bbfff700 1 -- 172.21.15.84:0/2309459981 <== mds.2 v2:172.21.15.131:6834/802742000 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5635fbe20e50 con 0x5635fbf4eea0 2023-10-06T02:57:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16bbfff700 10 client.6117 handle_command_reply: tid=0 2023-10-06T02:57:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 client.6117 shutdown 2023-10-06T02:57:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2309459981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2eed0 msgr2=0x5635fbf4ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2eed0 0x5635fbf4ced0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001670 tx=0x7f16d4014000 comp rx=0 tx=0).stop 2023-10-06T02:57:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2309459981 shutdown_connections 2023-10-06T02:57:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5635fbf4eea0 0x5635fbf2e2e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635fbf30a60 0x5635fbf2dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16bbfff700 0 client.6117 ms_handle_reset on v2:172.21.15.131:6834/802742000 2023-10-06T02:57:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635fbf2eed0 0x5635fbf4ced0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 --2- 172.21.15.84:0/2309459981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5635fbf2f310 0x5635fbfccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2309459981 >> 172.21.15.84:0/2309459981 conn(0x5635fbf5dd50 msgr2=0x5635fbf840d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2309459981 shutdown_connections 2023-10-06T02:57:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.723+0000 7f16ed2d0b80 1 -- 172.21.15.84:0/2309459981 wait complete. 2023-10-06T02:57:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16ed2d0b80 20 client.6117 trim_cache size 0 max 16384 2023-10-06T02:57:58.727 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:57:58.727 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T02:57:58.727 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:57:58.727 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:57:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 -- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16c8066f30 msgr2=0x7f16c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16c8066f30 0x7f16c80693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001850 tx=0x7f16d4009040 comp rx=0 tx=0).stop 2023-10-06T02:57:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 -- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0cd400 msgr2=0x7f16dc157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:57:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0cd400 0x7f16dc157ea0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f16cc012000 tx=0x7f16cc018000 comp rx=0 tx=0).stop 2023-10-06T02:57:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 -- 172.21.15.84:0/2576224825 shutdown_connections 2023-10-06T02:57:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16c8066f30 0x7f16c80693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16dc0cd400 0x7f16dc157ea0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16dc0b2660 0x7f16dc0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 --2- 172.21.15.84:0/2576224825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16dc0b2a30 0x7f16dc154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:57:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 -- 172.21.15.84:0/2576224825 >> 172.21.15.84:0/2576224825 conn(0x7f16dc099560 msgr2=0x7f16dc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:57:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 -- 172.21.15.84:0/2576224825 shutdown_connections 2023-10-06T02:57:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:57:58.724+0000 7f16e2d76700 1 -- 172.21.15.84:0/2576224825 wait complete. 2023-10-06T02:57:58.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:57:58.737 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-10-06T02:57:58.758 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/ 2023-10-06T02:57:58.759 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4 2023-10-06T02:57:58.759 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5 2023-10-06T02:57:58.759 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6 2023-10-06T02:57:58.759 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7 2023-10-06T02:57:58.759 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-10-06T02:57:58.759 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:57:58.759 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:57:58.759 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:57:58.760 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:57:58.760 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-10-06T02:57:58.760 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:57:58.863 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627778 2023-10-06T02:57:59.052 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:57:59.052 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:57:59.052 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:57:59.052 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:57:59.052 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-10-06T02:57:59.052 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:57:59.155 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627779 2023-10-06T02:57:59.344 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:57:59.344 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:57:59.344 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:57:59.344 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:57:59.345 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-10-06T02:57:59.345 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:57:59.448 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627780 2023-10-06T02:57:59.637 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:57:59.637 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:57:59.637 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:57:59.638 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:57:59.638 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-10-06T02:57:59.638 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:57:59.741 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627781 2023-10-06T02:57:59.930 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:57:59.930 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:57:59.930 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:57:59.930 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:57:59.930 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-10-06T02:57:59.931 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:58:00.034 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627782 2023-10-06T02:58:00.223 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:58:00.223 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:58:00.223 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:58:00.224 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:58:00.224 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-10-06T02:58:00.224 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:58:00.326 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627783 2023-10-06T02:58:00.515 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2023-10-06T02:58:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.591+0000 7f82fd464000 1 Processor -- start 2023-10-06T02:58:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.591+0000 7f82fd464000 1 -- start start 2023-10-06T02:58:00.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82fd464000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561953be080 0x556195462590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82fd464000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82fd464000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556195461f50 0x5561953ba900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82fd464000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561952d9980 con 0x5561953d8510 2023-10-06T02:58:00.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82fd464000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561952d9620 con 0x556195461f50 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82fd464000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561952d0400 con 0x5561953be080 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82f5e9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82f5e9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953ba3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35824/0 (socket says 172.21.15.84:35824) 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82f5e9e700 1 -- 172.21.15.84:0/3170796891 learned_addr learned my addr 172.21.15.84:0/3170796891 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82f5e9e700 1 -- 172.21.15.84:0/3170796891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561953be080 msgr2=0x556195462590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82f5e9e700 1 --2- 172.21.15.84:0/3170796891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561953be080 0x556195462590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82f5e9e700 1 -- 172.21.15.84:0/3170796891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556195461f50 msgr2=0x5561953ba900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82f5e9e700 1 --2- 172.21.15.84:0/3170796891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556195461f50 0x5561953ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.592+0000 7f82f5e9e700 1 -- 172.21.15.84:0/3170796891 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec005cf0 con 0x5561953d8510 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82f5e9e700 1 --2- 172.21.15.84:0/3170796891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953ba3c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x5561953bbe00 tx=0x7f82ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6d7db928fdbaf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82f4e9c700 1 -- 172.21.15.84:0/3170796891 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec000bc0 con 0x5561953d8510 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82f4e9c700 1 -- 172.21.15.84:0/3170796891 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec0089d0 con 0x5561953d8510 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82f4e9c700 1 -- 172.21.15.84:0/3170796891 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec01c410 con 0x5561953d8510 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82fd464000 1 -- 172.21.15.84:0/3170796891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 msgr2=0x5561953ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82fd464000 1 --2- 172.21.15.84:0/3170796891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953ba3c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x5561953bbe00 tx=0x7f82ec016000 comp rx=0 tx=0).stop 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82fd464000 1 -- 172.21.15.84:0/3170796891 shutdown_connections 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82fd464000 1 --2- 172.21.15.84:0/3170796891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556195461f50 0x5561953ba900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82fd464000 1 --2- 172.21.15.84:0/3170796891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5561953be080 0x556195462590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82fd464000 1 --2- 172.21.15.84:0/3170796891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953ba3c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82fd464000 1 -- 172.21.15.84:0/3170796891 >> 172.21.15.84:0/3170796891 conn(0x55619538f5d0 msgr2=0x5561953919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82fd464000 1 -- 172.21.15.84:0/3170796891 shutdown_connections 2023-10-06T02:58:00.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.593+0000 7f82fd464000 1 -- 172.21.15.84:0/3170796891 wait complete. 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.594+0000 7f82fd464000 1 Processor -- start 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.594+0000 7f82fd464000 1 -- start start 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.594+0000 7f82fd464000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561953be080 0x5561953d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.594+0000 7f82fd464000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.594+0000 7f82fd464000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556195461f50 0x556195458490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.594+0000 7f82fd464000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561953d42b0 con 0x5561953d8510 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.594+0000 7f82fd464000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561953d4550 con 0x5561953be080 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.594+0000 7f82fd464000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561953d47f0 con 0x556195461f50 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f5e9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f5e9e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953bb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35828/0 (socket says 172.21.15.84:35828) 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f5e9e700 1 -- 172.21.15.84:0/369901250 learned_addr learned my addr 172.21.15.84:0/369901250 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f669f700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561953be080 0x5561953d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f6ea0700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556195461f50 0x556195458490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f5e9e700 1 -- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556195461f50 msgr2=0x556195458490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f5e9e700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556195461f50 0x556195458490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f5e9e700 1 -- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561953be080 msgr2=0x5561953d51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f5e9e700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561953be080 0x5561953d51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f5e9e700 1 -- 172.21.15.84:0/369901250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561953021c0 con 0x5561953d8510 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82f5e9e700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953bb0b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f82ec020040 tx=0x7f82ec01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82e6ffd700 1 -- 172.21.15.84:0/369901250 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec000bc0 con 0x5561953d8510 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82e6ffd700 1 -- 172.21.15.84:0/369901250 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec026660 con 0x5561953d8510 2023-10-06T02:58:00.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561952e83d0 con 0x5561953d8510 2023-10-06T02:58:00.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82e6ffd700 1 -- 172.21.15.84:0/369901250 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec026a20 con 0x5561953d8510 2023-10-06T02:58:00.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.595+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561952dbae0 con 0x5561953d8510 2023-10-06T02:58:00.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.596+0000 7f82e6ffd700 1 -- 172.21.15.84:0/369901250 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82ec012410 con 0x5561953d8510 2023-10-06T02:58:00.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.597+0000 7f82e6ffd700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f82d8065890 0x7f82d8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.597+0000 7f82e6ffd700 1 -- 172.21.15.84:0/369901250 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f82ec0863b0 con 0x5561953d8510 2023-10-06T02:58:00.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.597+0000 7f82f669f700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f82d8065890 0x7f82d8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.597+0000 7f82fd464000 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5561954589d0 0x55619545a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.597+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- osd_op(unknown.0.0:1 8.12 8:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) v8 -- 0x5561953d3e50 con 0x5561954589d0 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.597+0000 7f82f669f700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f82d8065890 0x7f82d8067d40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f82e800e720 tx=0x7f82e8000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.597+0000 7f82f6ea0700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5561954589d0 0x55619545a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.598+0000 7f82f6ea0700 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5561954589d0 0x55619545a7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82f6ea0700 1 -- 172.21.15.84:0/369901250 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v56'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f82f000c9a0 con 0x5561954589d0 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5561954589d0 msgr2=0x55619545a7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5561954589d0 0x55619545a7b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f82d8065890 msgr2=0x7f82d8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f82d8065890 0x7f82d8067d40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f82e800e720 tx=0x7f82e8000bc0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 msgr2=0x5561953bb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 --2- 172.21.15.84:0/369901250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5561953d8510 0x5561953bb0b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f82ec020040 tx=0x7f82ec01d000 comp rx=0 tx=0).stop 2023-10-06T02:58:00.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82f6ea0700 1 -- 172.21.15.84:0/369901250 reap_dead start 2023-10-06T02:58:00.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 shutdown_connections 2023-10-06T02:58:00.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 >> 172.21.15.84:0/369901250 conn(0x55619538f5d0 msgr2=0x5561953919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 shutdown_connections 2023-10-06T02:58:00.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.599+0000 7f82fd464000 1 -- 172.21.15.84:0/369901250 wait complete. 2023-10-06T02:58:00.606 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2023-10-06T02:58:00.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.680+0000 7f312aa6d000 1 Processor -- start 2023-10-06T02:58:00.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.680+0000 7f312aa6d000 1 -- start start 2023-10-06T02:58:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f312aa6d000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a5972c0 0x558a9a63d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f312aa6d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a9a597f60 0x558a9a63d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f312aa6d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558a9a6386b0 0x558a9a56aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f312aa6d000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9a4b4980 con 0x558a9a5972c0 2023-10-06T02:58:00.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f312aa6d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9a4b4620 con 0x558a9a597f60 2023-10-06T02:58:00.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f312aa6d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a9a4ab400 con 0x558a9a6386b0 2023-10-06T02:58:00.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3123ca8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a5972c0 0x558a9a63d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3123ca8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a5972c0 0x558a9a63d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35836/0 (socket says 172.21.15.84:35836) 2023-10-06T02:58:00.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3123ca8700 1 -- 172.21.15.84:0/995571885 learned_addr learned my addr 172.21.15.84:0/995571885 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3123ca8700 1 -- 172.21.15.84:0/995571885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558a9a6386b0 msgr2=0x558a9a56aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3123ca8700 1 --2- 172.21.15.84:0/995571885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558a9a6386b0 0x558a9a56aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3123ca8700 1 -- 172.21.15.84:0/995571885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a9a597f60 msgr2=0x558a9a63d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3123ca8700 1 --2- 172.21.15.84:0/995571885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a9a597f60 0x558a9a63d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3123ca8700 1 -- 172.21.15.84:0/995571885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3114005cf0 con 0x558a9a5972c0 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3123ca8700 1 --2- 172.21.15.84:0/995571885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a5972c0 0x558a9a63d280 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f311400ad70 tx=0x7f3114016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b7986be4146de5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3122ca6700 1 -- 172.21.15.84:0/995571885 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114000bc0 con 0x558a9a5972c0 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3122ca6700 1 -- 172.21.15.84:0/995571885 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3114008970 con 0x558a9a5972c0 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.681+0000 7f3122ca6700 1 -- 172.21.15.84:0/995571885 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311401c440 con 0x558a9a5972c0 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 -- 172.21.15.84:0/995571885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a5972c0 msgr2=0x558a9a63d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 --2- 172.21.15.84:0/995571885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a5972c0 0x558a9a63d280 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f311400ad70 tx=0x7f3114016000 comp rx=0 tx=0).stop 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 -- 172.21.15.84:0/995571885 shutdown_connections 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 --2- 172.21.15.84:0/995571885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558a9a6386b0 0x558a9a56aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 --2- 172.21.15.84:0/995571885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a5972c0 0x558a9a63d280 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 --2- 172.21.15.84:0/995571885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a9a597f60 0x558a9a63d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 -- 172.21.15.84:0/995571885 >> 172.21.15.84:0/995571885 conn(0x558a9a56a7d0 msgr2=0x558a9a595750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 -- 172.21.15.84:0/995571885 shutdown_connections 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 -- 172.21.15.84:0/995571885 wait complete. 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 Processor -- start 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.682+0000 7f312aa6d000 1 -- start start 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f312aa6d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a9a5972c0 0x558a9a63d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f312aa6d000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a597f60 0x558a9a633de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f312aa6d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558a9a6386b0 0x558a9a633350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f312aa6d000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9a641d20 con 0x558a9a597f60 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f312aa6d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a9a63db30 con 0x558a9a5972c0 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f312aa6d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a9a641f80 con 0x558a9a6386b0 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f311b4a7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a597f60 0x558a9a633de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f311b4a7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a597f60 0x558a9a633de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35842/0 (socket says 172.21.15.84:35842) 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f311b4a7700 1 -- 172.21.15.84:0/1384062485 learned_addr learned my addr 172.21.15.84:0/1384062485 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f3123ca8700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a9a5972c0 0x558a9a63d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.683+0000 7f31244a9700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558a9a6386b0 0x558a9a633350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f311b4a7700 1 -- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558a9a6386b0 msgr2=0x558a9a633350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f311b4a7700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558a9a6386b0 0x558a9a633350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f311b4a7700 1 -- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a9a5972c0 msgr2=0x558a9a63d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f311b4a7700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a9a5972c0 0x558a9a63d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f311b4a7700 1 -- 172.21.15.84:0/1384062485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a9a4dd1c0 con 0x558a9a597f60 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f31244a9700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558a9a6386b0 0x558a9a633350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f311b4a7700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a597f60 0x558a9a633de0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f310c006750 tx=0x7f310c005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f31214a3700 1 -- 172.21.15.84:0/1384062485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c00e070 con 0x558a9a597f60 2023-10-06T02:58:00.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f31214a3700 1 -- 172.21.15.84:0/1384062485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c007410 con 0x558a9a597f60 2023-10-06T02:58:00.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a9a4c33d0 con 0x558a9a597f60 2023-10-06T02:58:00.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f31214a3700 1 -- 172.21.15.84:0/1384062485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0077f0 con 0x558a9a597f60 2023-10-06T02:58:00.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.684+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a9a4b6ae0 con 0x558a9a597f60 2023-10-06T02:58:00.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.685+0000 7f31214a3700 1 -- 172.21.15.84:0/1384062485 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f310c007c20 con 0x558a9a597f60 2023-10-06T02:58:00.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.686+0000 7f31214a3700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3104065890 0x7f3104067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.686+0000 7f31214a3700 1 -- 172.21.15.84:0/1384062485 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f310c0829d0 con 0x558a9a597f60 2023-10-06T02:58:00.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.686+0000 7f3123ca8700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3104065890 0x7f3104067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.686+0000 7f312aa6d000 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x558a9a6454e0 0x558a9a650d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.686+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- osd_op(unknown.0.0:1 8.12 8:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) v8 -- 0x558a9a6512a0 con 0x558a9a6454e0 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.686+0000 7f31244a9700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x558a9a6454e0 0x558a9a650d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.686+0000 7f3123ca8700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3104065890 0x7f3104067d40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f311400ad70 tx=0x7f3114003050 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.686+0000 7f31244a9700 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x558a9a6454e0 0x558a9a650d60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f31244a9700 1 -- 172.21.15.84:0/1384062485 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v56'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f311c0018e0 con 0x558a9a6454e0 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x558a9a6454e0 msgr2=0x558a9a650d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x558a9a6454e0 0x558a9a650d60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3104065890 msgr2=0x7f3104067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3104065890 0x7f3104067d40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f311400ad70 tx=0x7f3114003050 comp rx=0 tx=0).stop 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a597f60 msgr2=0x558a9a633de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 --2- 172.21.15.84:0/1384062485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558a9a597f60 0x558a9a633de0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f310c006750 tx=0x7f310c005b40 comp rx=0 tx=0).stop 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f31244a9700 1 -- 172.21.15.84:0/1384062485 reap_dead start 2023-10-06T02:58:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 shutdown_connections 2023-10-06T02:58:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 >> 172.21.15.84:0/1384062485 conn(0x558a9a56a7d0 msgr2=0x558a9a595ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 shutdown_connections 2023-10-06T02:58:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.688+0000 7f312aa6d000 1 -- 172.21.15.84:0/1384062485 wait complete. 2023-10-06T02:58:00.695 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2023-10-06T02:58:00.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.769+0000 7f8d43f8d000 1 Processor -- start 2023-10-06T02:58:00.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.769+0000 7f8d43f8d000 1 -- start start 2023-10-06T02:58:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d43f8d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f7f44d3b0 0x559f7f4e6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d43f8d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9580 0x559f7f4e9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d43f8d000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f4d9950 0x559f7f434560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d43f8d000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f7f351980 con 0x559f7f4d9950 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d43f8d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f7f351620 con 0x559f7f4d9580 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d43f8d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f7f348400 con 0x559f7f44d3b0 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d9c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f4d9950 0x559f7f434560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d9c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f4d9950 0x559f7f434560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35862/0 (socket says 172.21.15.84:35862) 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d9c9700 1 -- 172.21.15.84:0/2900036643 learned_addr learned my addr 172.21.15.84:0/2900036643 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3c9c7700 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9580 0x559f7f4e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d1c8700 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f7f44d3b0 0x559f7f4e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d9c9700 1 -- 172.21.15.84:0/2900036643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f7f44d3b0 msgr2=0x559f7f4e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d9c9700 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f7f44d3b0 0x559f7f4e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d9c9700 1 -- 172.21.15.84:0/2900036643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9580 msgr2=0x559f7f4e9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d9c9700 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9580 0x559f7f4e9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d9c9700 1 -- 172.21.15.84:0/2900036643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34005db0 con 0x559f7f4d9950 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3c9c7700 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9580 0x559f7f4e9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d3d9c9700 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f4d9950 0x559f7f434560 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8d38002680 tx=0x7f8d38006b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c728c69f6f78588 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d2f7fe700 1 -- 172.21.15.84:0/2900036643 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800e470 con 0x559f7f4d9950 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d2f7fe700 1 -- 172.21.15.84:0/2900036643 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3800e5f0 con 0x559f7f4d9950 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.770+0000 7f8d2f7fe700 1 -- 172.21.15.84:0/2900036643 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800e9b0 con 0x559f7f4d9950 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 -- 172.21.15.84:0/2900036643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f4d9950 msgr2=0x559f7f434560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f4d9950 0x559f7f434560 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8d38002680 tx=0x7f8d38006b80 comp rx=0 tx=0).stop 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 -- 172.21.15.84:0/2900036643 shutdown_connections 2023-10-06T02:58:00.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f4d9950 0x559f7f434560 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f7f44d3b0 0x559f7f4e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 --2- 172.21.15.84:0/2900036643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9580 0x559f7f4e9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 -- 172.21.15.84:0/2900036643 >> 172.21.15.84:0/2900036643 conn(0x559f7f4077d0 msgr2=0x559f7f408cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 -- 172.21.15.84:0/2900036643 shutdown_connections 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 -- 172.21.15.84:0/2900036643 wait complete. 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.771+0000 7f8d43f8d000 1 Processor -- start 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d43f8d000 1 -- start start 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d43f8d000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f44d3b0 0x559f7f4eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d43f8d000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f7f4d9580 0x559f7f4d3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d43f8d000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9950 0x559f7f408c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d43f8d000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f7f42d260 con 0x559f7f44d3b0 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d43f8d000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f7f4d48e0 con 0x559f7f4d9950 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d43f8d000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f7f4d4b80 con 0x559f7f4d9580 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d3d1c8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f44d3b0 0x559f7f4eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d3d1c8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f44d3b0 0x559f7f4eda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35868/0 (socket says 172.21.15.84:35868) 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d3d1c8700 1 -- 172.21.15.84:0/3602055337 learned_addr learned my addr 172.21.15.84:0/3602055337 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.772+0000 7f8d3c9c7700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f7f4d9580 0x559f7f4d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d3d9c9700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9950 0x559f7f408c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d3d1c8700 1 -- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f7f4d9580 msgr2=0x559f7f4d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d3d1c8700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f7f4d9580 0x559f7f4d3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d3d1c8700 1 -- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9950 msgr2=0x559f7f408c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d3d1c8700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9950 0x559f7f408c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d3d1c8700 1 -- 172.21.15.84:0/3602055337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38006e40 con 0x559f7f44d3b0 2023-10-06T02:58:00.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d3d9c9700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f7f4d9950 0x559f7f408c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:00.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d3d1c8700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f44d3b0 0x559f7f4eda90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8d30008770 tx=0x7f8d30005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d2dffb700 1 -- 172.21.15.84:0/3602055337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000f070 con 0x559f7f44d3b0 2023-10-06T02:58:00.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d2dffb700 1 -- 172.21.15.84:0/3602055337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d30006750 con 0x559f7f44d3b0 2023-10-06T02:58:00.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559f7f3603d0 con 0x559f7f44d3b0 2023-10-06T02:58:00.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d2dffb700 1 -- 172.21.15.84:0/3602055337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30006af0 con 0x559f7f44d3b0 2023-10-06T02:58:00.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.773+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f7f353ae0 con 0x559f7f44d3b0 2023-10-06T02:58:00.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.774+0000 7f8d2dffb700 1 -- 172.21.15.84:0/3602055337 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d3001c3b0 con 0x559f7f44d3b0 2023-10-06T02:58:00.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.775+0000 7f8d2dffb700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d20065890 0x7f8d20067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.775+0000 7f8d2dffb700 1 -- 172.21.15.84:0/3602055337 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8d30082fd0 con 0x559f7f44d3b0 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.775+0000 7f8d3c9c7700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d20065890 0x7f8d20067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.775+0000 7f8d43f8d000 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559f7f4edfd0 0x559f7f42cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.775+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- osd_op(unknown.0.0:1 8.5 8:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) v8 -- 0x559f7f4d36a0 con 0x559f7f4edfd0 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.775+0000 7f8d3d9c9700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559f7f4edfd0 0x559f7f42cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.775+0000 7f8d3c9c7700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d20065890 0x7f8d20067d40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400a650 tx=0x7f8d34015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.776+0000 7f8d3d9c9700 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559f7f4edfd0 0x559f7f42cb10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d3d9c9700 1 -- 172.21.15.84:0/3602055337 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v56'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8d38018040 con 0x559f7f4edfd0 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559f7f4edfd0 msgr2=0x559f7f42cb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559f7f4edfd0 0x559f7f42cb10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d20065890 msgr2=0x7f8d20067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d20065890 0x7f8d20067d40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400a650 tx=0x7f8d34015000 comp rx=0 tx=0).stop 2023-10-06T02:58:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f44d3b0 msgr2=0x559f7f4eda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 --2- 172.21.15.84:0/3602055337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f7f44d3b0 0x559f7f4eda90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8d30008770 tx=0x7f8d30005bd0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d3d9c9700 1 -- 172.21.15.84:0/3602055337 reap_dead start 2023-10-06T02:58:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 shutdown_connections 2023-10-06T02:58:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 >> 172.21.15.84:0/3602055337 conn(0x559f7f4077d0 msgr2=0x559f7f4dc350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 shutdown_connections 2023-10-06T02:58:00.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.777+0000 7f8d43f8d000 1 -- 172.21.15.84:0/3602055337 wait complete. 2023-10-06T02:58:00.785 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2023-10-06T02:58:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.859+0000 7f1bb9654000 1 Processor -- start 2023-10-06T02:58:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.859+0000 7f1bb9654000 1 -- start start 2023-10-06T02:58:00.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb9654000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b9c0030b0 0x5616d20304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb9654000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d20144b0 0x5616d1f584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb9654000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616d2014a20 0x5616d2031c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb9654000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616d1efc320 con 0x5616d20144b0 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb9654000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616d1ea0980 con 0x7f1b9c0030b0 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb9654000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616d1ea0620 con 0x5616d2014a20 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb208e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d20144b0 0x5616d1f584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb208e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d20144b0 0x5616d1f584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35886/0 (socket says 172.21.15.84:35886) 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb208e700 1 -- 172.21.15.84:0/1180048840 learned_addr learned my addr 172.21.15.84:0/1180048840 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb3090700 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616d2014a20 0x5616d2031c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb288f700 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b9c0030b0 0x5616d20304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb208e700 1 -- 172.21.15.84:0/1180048840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616d2014a20 msgr2=0x5616d2031c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb208e700 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616d2014a20 0x5616d2031c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb208e700 1 -- 172.21.15.84:0/1180048840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b9c0030b0 msgr2=0x5616d20304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb208e700 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b9c0030b0 0x5616d20304c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb208e700 1 -- 172.21.15.84:0/1180048840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616d1ea2ae0 con 0x5616d20144b0 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb288f700 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b9c0030b0 0x5616d20304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb208e700 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d20144b0 0x5616d1f584b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009590 tx=0x7f1ba8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f545a8138b285ddc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb108c700 1 -- 172.21.15.84:0/1180048840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba800beb0 con 0x5616d20144b0 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb108c700 1 -- 172.21.15.84:0/1180048840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba800bb00 con 0x5616d20144b0 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.860+0000 7f1bb108c700 1 -- 172.21.15.84:0/1180048840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8000ed0 con 0x5616d20144b0 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.861+0000 7f1bb9654000 1 -- 172.21.15.84:0/1180048840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d20144b0 msgr2=0x5616d1f584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.861+0000 7f1bb9654000 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d20144b0 0x5616d1f584b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009590 tx=0x7f1ba8017000 comp rx=0 tx=0).stop 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.861+0000 7f1bb9654000 1 -- 172.21.15.84:0/1180048840 shutdown_connections 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.861+0000 7f1bb9654000 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b9c0030b0 0x5616d20304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.861+0000 7f1bb9654000 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5616d2014a20 0x5616d2031c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.861+0000 7f1bb9654000 1 --2- 172.21.15.84:0/1180048840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d20144b0 0x5616d1f584b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.861+0000 7f1bb9654000 1 -- 172.21.15.84:0/1180048840 >> 172.21.15.84:0/1180048840 conn(0x5616d1f565d0 msgr2=0x5616d1f996b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.861+0000 7f1bb9654000 1 -- 172.21.15.84:0/1180048840 shutdown_connections 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.861+0000 7f1bb9654000 1 -- 172.21.15.84:0/1180048840 wait complete. 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb9654000 1 Processor -- start 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb9654000 1 -- start start 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb9654000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616d20144b0 0x5616d202c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb9654000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d2014a20 0x5616d202e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb9654000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b9c0030b0 0x5616d202e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb9654000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616d1e97400 con 0x5616d2014a20 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb9654000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616d2013e70 con 0x5616d20144b0 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb9654000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616d203d130 con 0x7f1b9c0030b0 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb208e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d2014a20 0x5616d202e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb208e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d2014a20 0x5616d202e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35896/0 (socket says 172.21.15.84:35896) 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb208e700 1 -- 172.21.15.84:0/1379579298 learned_addr learned my addr 172.21.15.84:0/1379579298 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb288f700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616d20144b0 0x5616d202c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.862+0000 7f1bb3090700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b9c0030b0 0x5616d202e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1bb208e700 1 -- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b9c0030b0 msgr2=0x5616d202e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1bb208e700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b9c0030b0 0x5616d202e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1bb208e700 1 -- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616d20144b0 msgr2=0x5616d202c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1bb208e700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616d20144b0 0x5616d202c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1bb208e700 1 -- 172.21.15.84:0/1379579298 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c001e10 con 0x5616d2014a20 2023-10-06T02:58:00.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1bb208e700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d2014a20 0x5616d202e130 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009360 tx=0x7f1ba801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1ba37fe700 1 -- 172.21.15.84:0/1379579298 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8001c30 con 0x5616d2014a20 2023-10-06T02:58:00.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1ba37fe700 1 -- 172.21.15.84:0/1379579298 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba8001a10 con 0x5616d2014a20 2023-10-06T02:58:00.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616d1ea2540 con 0x5616d2014a20 2023-10-06T02:58:00.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1ba37fe700 1 -- 172.21.15.84:0/1379579298 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba80236a0 con 0x5616d2014a20 2023-10-06T02:58:00.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.863+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616d2031fe0 con 0x5616d2014a20 2023-10-06T02:58:00.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.864+0000 7f1ba37fe700 1 -- 172.21.15.84:0/1379579298 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ba8023a90 con 0x5616d2014a20 2023-10-06T02:58:00.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.865+0000 7f1ba37fe700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b98065890 0x7f1b98067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.865+0000 7f1ba37fe700 1 -- 172.21.15.84:0/1379579298 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1ba8086980 con 0x5616d2014a20 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.865+0000 7f1bb288f700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b98065890 0x7f1b98067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.865+0000 7f1bb9654000 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5616d1f9c6d0 0x5616d20132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.865+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- osd_op(unknown.0.0:1 8.9 8:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) v8 -- 0x5616d2013820 con 0x5616d1f9c6d0 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.865+0000 7f1bb288f700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b98065890 0x7f1b98067d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5616d1f2c740 tx=0x7f1ba400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.865+0000 7f1bb3090700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5616d1f9c6d0 0x5616d20132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.866+0000 7f1bb3090700 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5616d1f9c6d0 0x5616d20132e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb3090700 1 -- 172.21.15.84:0/1379579298 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v56'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1bac0037c0 con 0x5616d1f9c6d0 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5616d1f9c6d0 msgr2=0x5616d20132e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5616d1f9c6d0 0x5616d20132e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b98065890 msgr2=0x7f1b98067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b98065890 0x7f1b98067d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x5616d1f2c740 tx=0x7f1ba400c040 comp rx=0 tx=0).stop 2023-10-06T02:58:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d2014a20 msgr2=0x5616d202e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 --2- 172.21.15.84:0/1379579298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5616d2014a20 0x5616d202e130 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009360 tx=0x7f1ba801f000 comp rx=0 tx=0).stop 2023-10-06T02:58:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb3090700 1 -- 172.21.15.84:0/1379579298 reap_dead start 2023-10-06T02:58:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 shutdown_connections 2023-10-06T02:58:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 >> 172.21.15.84:0/1379579298 conn(0x5616d1f565d0 msgr2=0x5616d1f9a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 shutdown_connections 2023-10-06T02:58:00.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.867+0000 7f1bb9654000 1 -- 172.21.15.84:0/1379579298 wait complete. 2023-10-06T02:58:00.875 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2023-10-06T02:58:00.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.950+0000 7f77452a4000 1 Processor -- start 2023-10-06T02:58:00.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.950+0000 7f77452a4000 1 -- start start 2023-10-06T02:58:00.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f77452a4000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e9168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f77452a4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 0x5590e9092540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f77452a4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 0x5590e9092a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f77452a4000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e8fdf980 con 0x5590e90dbb10 2023-10-06T02:58:00.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f77452a4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e8fdf620 con 0x5590e9167f50 2023-10-06T02:58:00.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f77452a4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590e8fd6400 con 0x5590e90de6e0 2023-10-06T02:58:00.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773e4df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e9168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773e4df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e9168ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35918/0 (socket says 172.21.15.84:35918) 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773e4df700 1 -- 172.21.15.84:0/3076448034 learned_addr learned my addr 172.21.15.84:0/3076448034 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773ece0700 1 --2- 172.21.15.84:0/3076448034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 0x5590e9092a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773dcde700 1 --2- 172.21.15.84:0/3076448034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 0x5590e9092540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773e4df700 1 -- 172.21.15.84:0/3076448034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 msgr2=0x5590e9092540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773e4df700 1 --2- 172.21.15.84:0/3076448034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 0x5590e9092540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773e4df700 1 -- 172.21.15.84:0/3076448034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 msgr2=0x5590e9092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773e4df700 1 --2- 172.21.15.84:0/3076448034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 0x5590e9092a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773e4df700 1 -- 172.21.15.84:0/3076448034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7738005cf0 con 0x5590e90dbb10 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.951+0000 7f773e4df700 1 --2- 172.21.15.84:0/3076448034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e9168ee0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7730009770 tx=0x7f7730007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863e853bcc424af1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f773ccdc700 1 -- 172.21.15.84:0/3076448034 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730010600 con 0x5590e90dbb10 2023-10-06T02:58:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f773ccdc700 1 -- 172.21.15.84:0/3076448034 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730010760 con 0x5590e90dbb10 2023-10-06T02:58:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f773ccdc700 1 -- 172.21.15.84:0/3076448034 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730010b00 con 0x5590e90dbb10 2023-10-06T02:58:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f77452a4000 1 -- 172.21.15.84:0/3076448034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 msgr2=0x5590e9168ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f77452a4000 1 --2- 172.21.15.84:0/3076448034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e9168ee0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7730009770 tx=0x7f7730007040 comp rx=0 tx=0).stop 2023-10-06T02:58:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f77452a4000 1 -- 172.21.15.84:0/3076448034 shutdown_connections 2023-10-06T02:58:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f77452a4000 1 --2- 172.21.15.84:0/3076448034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 0x5590e9092a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f77452a4000 1 --2- 172.21.15.84:0/3076448034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e9168ee0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f77452a4000 1 --2- 172.21.15.84:0/3076448034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 0x5590e9092540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f77452a4000 1 -- 172.21.15.84:0/3076448034 >> 172.21.15.84:0/3076448034 conn(0x5590e90955d0 msgr2=0x5590e90979b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f77452a4000 1 -- 172.21.15.84:0/3076448034 shutdown_connections 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.952+0000 7f77452a4000 1 -- 172.21.15.84:0/3076448034 wait complete. 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f77452a4000 1 Processor -- start 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f77452a4000 1 -- start start 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f77452a4000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e91626b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f77452a4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 0x5590e9162bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f77452a4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 0x5590e90959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f77452a4000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e9097f20 con 0x5590e90dbb10 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f77452a4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e90c4680 con 0x5590e9167f50 2023-10-06T02:58:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f77452a4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590e9097540 con 0x5590e90de6e0 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f773e4df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e91626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f773e4df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e91626b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35920/0 (socket says 172.21.15.84:35920) 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.953+0000 7f773e4df700 1 -- 172.21.15.84:0/3559688839 learned_addr learned my addr 172.21.15.84:0/3559688839 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773ece0700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 0x5590e90959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773dcde700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 0x5590e9162bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773e4df700 1 -- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 msgr2=0x5590e9162bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773e4df700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 0x5590e9162bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773e4df700 1 -- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 msgr2=0x5590e90959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773e4df700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 0x5590e90959a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773e4df700 1 -- 172.21.15.84:0/3559688839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77300092c0 con 0x5590e90dbb10 2023-10-06T02:58:00.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773ece0700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590e9167f50 0x5590e90959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:00.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773dcde700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5590e90de6e0 0x5590e9162bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:00.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f773e4df700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e91626b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7730009ec0 tx=0x7f7730019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f772effd700 1 -- 172.21.15.84:0/3559688839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773001f070 con 0x5590e90dbb10 2023-10-06T02:58:00.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f772effd700 1 -- 172.21.15.84:0/3559688839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773000b040 con 0x5590e90dbb10 2023-10-06T02:58:00.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590e8fee3d0 con 0x5590e90dbb10 2023-10-06T02:58:00.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f772effd700 1 -- 172.21.15.84:0/3559688839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730010b00 con 0x5590e90dbb10 2023-10-06T02:58:00.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.954+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590e8fe1ae0 con 0x5590e90dbb10 2023-10-06T02:58:00.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.955+0000 7f772effd700 1 -- 172.21.15.84:0/3559688839 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7730023070 con 0x5590e90dbb10 2023-10-06T02:58:00.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.955+0000 7f772effd700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7720065890 0x7f7720067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.956+0000 7f772effd700 1 -- 172.21.15.84:0/3559688839 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7730084c40 con 0x5590e90dbb10 2023-10-06T02:58:00.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.956+0000 7f773dcde700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7720065890 0x7f7720067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.956+0000 7f77452a4000 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5590e90d45d0 0x5590e917bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:00.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.956+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- osd_op(unknown.0.0:1 8.5 8:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) v8 -- 0x5590e917c1b0 con 0x5590e90d45d0 2023-10-06T02:58:00.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.956+0000 7f773ece0700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5590e90d45d0 0x5590e917bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:00.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.956+0000 7f773dcde700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7720065890 0x7f7720067d40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7734000c00 tx=0x7f77340068d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.956+0000 7f773ece0700 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5590e90d45d0 0x5590e917bc70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:00.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.957+0000 7f773ece0700 1 -- 172.21.15.84:0/3559688839 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v56'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f773801d420 con 0x5590e90d45d0 2023-10-06T02:58:00.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.957+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5590e90d45d0 msgr2=0x5590e917bc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.957+0000 7f77452a4000 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x5590e90d45d0 0x5590e917bc70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.958+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7720065890 msgr2=0x7f7720067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.958+0000 7f77452a4000 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7720065890 0x7f7720067d40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7734000c00 tx=0x7f77340068d0 comp rx=0 tx=0).stop 2023-10-06T02:58:00.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.958+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 msgr2=0x5590e91626b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:00.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.958+0000 7f77452a4000 1 --2- 172.21.15.84:0/3559688839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5590e90dbb10 0x5590e91626b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7730009ec0 tx=0x7f7730019000 comp rx=0 tx=0).stop 2023-10-06T02:58:00.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.958+0000 7f773ece0700 1 -- 172.21.15.84:0/3559688839 reap_dead start 2023-10-06T02:58:00.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.958+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 shutdown_connections 2023-10-06T02:58:00.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.958+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 >> 172.21.15.84:0/3559688839 conn(0x5590e90955d0 msgr2=0x5590e9092540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:00.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.958+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 shutdown_connections 2023-10-06T02:58:00.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:00.958+0000 7f77452a4000 1 -- 172.21.15.84:0/3559688839 wait complete. 2023-10-06T02:58:00.967 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2023-10-06T02:58:01.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.042+0000 7f69fd0b6000 1 Processor -- start 2023-10-06T02:58:01.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.042+0000 7f69fd0b6000 1 -- start start 2023-10-06T02:58:01.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69fd0b6000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc2c0 0x55de8a96bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69fd0b6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de8a8cc690 0x55de8a96c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69fd0b6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de8a96d6b0 0x55de8a89fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69fd0b6000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de8a7e9980 con 0x55de8a8cc2c0 2023-10-06T02:58:01.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69fd0b6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de8a7e9620 con 0x55de8a8cc690 2023-10-06T02:58:01.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69fd0b6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de8a7e0400 con 0x55de8a96d6b0 2023-10-06T02:58:01.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69f62f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc2c0 0x55de8a96bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69f62f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc2c0 0x55de8a96bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35922/0 (socket says 172.21.15.84:35922) 2023-10-06T02:58:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69f62f1700 1 -- 172.21.15.84:0/557344548 learned_addr learned my addr 172.21.15.84:0/557344548 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69f62f1700 1 -- 172.21.15.84:0/557344548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de8a96d6b0 msgr2=0x55de8a89fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69f62f1700 1 --2- 172.21.15.84:0/557344548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de8a96d6b0 0x55de8a89fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69f62f1700 1 -- 172.21.15.84:0/557344548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de8a8cc690 msgr2=0x55de8a96c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69f62f1700 1 --2- 172.21.15.84:0/557344548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de8a8cc690 0x55de8a96c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69f62f1700 1 -- 172.21.15.84:0/557344548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8005cf0 con 0x55de8a8cc2c0 2023-10-06T02:58:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.043+0000 7f69f62f1700 1 --2- 172.21.15.84:0/557344548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc2c0 0x55de8a96bec0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f69e80099e0 tx=0x7f69e800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdeb93b272e8022 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69f52ef700 1 -- 172.21.15.84:0/557344548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800f040 con 0x55de8a8cc2c0 2023-10-06T02:58:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69f52ef700 1 -- 172.21.15.84:0/557344548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e8008af0 con 0x55de8a8cc2c0 2023-10-06T02:58:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69f52ef700 1 -- 172.21.15.84:0/557344548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8008e70 con 0x55de8a8cc2c0 2023-10-06T02:58:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69fd0b6000 1 -- 172.21.15.84:0/557344548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc2c0 msgr2=0x55de8a96bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69fd0b6000 1 --2- 172.21.15.84:0/557344548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc2c0 0x55de8a96bec0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f69e80099e0 tx=0x7f69e800c040 comp rx=0 tx=0).stop 2023-10-06T02:58:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69fd0b6000 1 -- 172.21.15.84:0/557344548 shutdown_connections 2023-10-06T02:58:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69fd0b6000 1 --2- 172.21.15.84:0/557344548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de8a96d6b0 0x55de8a89fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69fd0b6000 1 --2- 172.21.15.84:0/557344548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc2c0 0x55de8a96bec0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69fd0b6000 1 --2- 172.21.15.84:0/557344548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de8a8cc690 0x55de8a96c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69fd0b6000 1 -- 172.21.15.84:0/557344548 >> 172.21.15.84:0/557344548 conn(0x55de8a89f7d0 msgr2=0x55de8a8ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69fd0b6000 1 -- 172.21.15.84:0/557344548 shutdown_connections 2023-10-06T02:58:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.044+0000 7f69fd0b6000 1 -- 172.21.15.84:0/557344548 wait complete. 2023-10-06T02:58:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69fd0b6000 1 Processor -- start 2023-10-06T02:58:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69fd0b6000 1 -- start start 2023-10-06T02:58:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69fd0b6000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de8a8cc2c0 0x55de8a9680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69fd0b6000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc690 0x55de8a968620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69fd0b6000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de8a96d6b0 0x55de8a96bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69fd0b6000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de8a8e4420 con 0x55de8a8cc690 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69fd0b6000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de8a96ec00 con 0x55de8a8cc2c0 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69fd0b6000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de8a96eea0 con 0x55de8a96d6b0 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69edaf0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc690 0x55de8a968620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69edaf0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc690 0x55de8a968620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35928/0 (socket says 172.21.15.84:35928) 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.045+0000 7f69edaf0700 1 -- 172.21.15.84:0/925791650 learned_addr learned my addr 172.21.15.84:0/925791650 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69f6af2700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de8a96d6b0 0x55de8a96bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69f62f1700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de8a8cc2c0 0x55de8a9680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69edaf0700 1 -- 172.21.15.84:0/925791650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de8a96d6b0 msgr2=0x55de8a96bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69edaf0700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55de8a96d6b0 0x55de8a96bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69edaf0700 1 -- 172.21.15.84:0/925791650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de8a8cc2c0 msgr2=0x55de8a9680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69edaf0700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55de8a8cc2c0 0x55de8a9680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69edaf0700 1 -- 172.21.15.84:0/925791650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80095e0 con 0x55de8a8cc690 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69edaf0700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc690 0x55de8a968620 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f69e000bdb0 tx=0x7f69e0001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69ef7fe700 1 -- 172.21.15.84:0/925791650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0009c90 con 0x55de8a8cc690 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69ef7fe700 1 -- 172.21.15.84:0/925791650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e0009e10 con 0x55de8a8cc690 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f000a0e0 con 0x55de8a8cc690 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69ef7fe700 1 -- 172.21.15.84:0/925791650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000e6c0 con 0x55de8a8cc690 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.046+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de8a7f83d0 con 0x55de8a8cc690 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.047+0000 7f69ef7fe700 1 -- 172.21.15.84:0/925791650 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69e000eaf0 con 0x55de8a8cc690 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.048+0000 7f69ef7fe700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f69d8065890 0x7f69d8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.048+0000 7f69ef7fe700 1 -- 172.21.15.84:0/925791650 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f69e0083430 con 0x55de8a8cc690 2023-10-06T02:58:01.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.048+0000 7f69f62f1700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f69d8065890 0x7f69d8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.048+0000 7f69fd0b6000 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55de8a8cdc10 0x55de8a98f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.048+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- osd_op(unknown.0.0:1 8.1d 8:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56) v8 -- 0x55de8a8ca750 con 0x55de8a8cdc10 2023-10-06T02:58:01.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.048+0000 7f69f6af2700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55de8a8cdc10 0x55de8a98f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.048+0000 7f69f62f1700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f69d8065890 0x7f69d8067d40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009980 tx=0x7f69e8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.048+0000 7f69f6af2700 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55de8a8cdc10 0x55de8a98f590 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.049+0000 7f69f6af2700 1 -- 172.21.15.84:0/925791650 <== osd.0 v2:172.21.15.84:6808/90632 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v56'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f69f0016020 con 0x55de8a8cdc10 2023-10-06T02:58:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.049+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55de8a8cdc10 msgr2=0x55de8a98f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.049+0000 7f69fd0b6000 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55de8a8cdc10 0x55de8a98f590 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.049+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f69d8065890 msgr2=0x7f69d8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.049+0000 7f69fd0b6000 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f69d8065890 0x7f69d8067d40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009980 tx=0x7f69e8016000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.049+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc690 msgr2=0x55de8a968620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.049+0000 7f69fd0b6000 1 --2- 172.21.15.84:0/925791650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de8a8cc690 0x55de8a968620 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f69e000bdb0 tx=0x7f69e0001820 comp rx=0 tx=0).stop 2023-10-06T02:58:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.049+0000 7f69f6af2700 1 -- 172.21.15.84:0/925791650 reap_dead start 2023-10-06T02:58:01.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.050+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 shutdown_connections 2023-10-06T02:58:01.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.050+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 >> 172.21.15.84:0/925791650 conn(0x55de8a89f7d0 msgr2=0x55de8a968c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.050+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 shutdown_connections 2023-10-06T02:58:01.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.050+0000 7f69fd0b6000 1 -- 172.21.15.84:0/925791650 wait complete. 2023-10-06T02:58:01.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /d1/d2/d3 recursive,force 2023-10-06T02:58:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.219+0000 7fcf56b1d700 1 Processor -- start 2023-10-06T02:58:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.219+0000 7fcf56b1d700 1 -- start start 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.220+0000 7fcf56b1d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcf5006ed20 0x7fcf500b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.220+0000 7fcf56b1d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf500aee20 0x7fcf500af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.220+0000 7fcf56b1d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500b2d20 con 0x7fcf5006f0f0 2023-10-06T02:58:01.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.220+0000 7fcf56b1d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5006fb80 con 0x7fcf500aee20 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.220+0000 7fcf56b1d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500b0450 con 0x7fcf5006ed20 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.220+0000 7fcf550ba700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf500aee20 0x7fcf500af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.220+0000 7fcf47fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcf5006f0f0 0x7fcf500b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46032/0 (socket says 172.21.15.84:46032) 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.220+0000 7fcf47fff700 1 -- 172.21.15.84:0/486408060 learned_addr learned my addr 172.21.15.84:0/486408060 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf548b9700 1 --2- 172.21.15.84:0/486408060 >> v2:172.21.15.131:3300/0 conn(0x7fcf5006ed20 0x7fcf500b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf550ba700 1 -- 172.21.15.84:0/486408060 >> v2:172.21.15.131:3300/0 conn(0x7fcf5006ed20 msgr2=0x7fcf500b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf550ba700 1 --2- 172.21.15.84:0/486408060 >> v2:172.21.15.131:3300/0 conn(0x7fcf5006ed20 0x7fcf500b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf550ba700 1 -- 172.21.15.84:0/486408060 >> v1:172.21.15.84:6789/0 conn(0x7fcf5006f0f0 legacy=0x7fcf500b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf550ba700 1 -- 172.21.15.84:0/486408060 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500af7c0 con 0x7fcf500aee20 2023-10-06T02:58:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf477fe700 1 -- 172.21.15.84:0/486408060 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163419087 0 0) 0x7fcf500b2d20 con 0x7fcf5006f0f0 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf550ba700 1 --2- 172.21.15.84:0/486408060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 0x7fcf500af280 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcf500cdd30 tx=0x7fcf48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59feddf0ef3fdd93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf477fe700 1 -- 172.21.15.84:0/486408060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800e070 con 0x7fcf500aee20 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf477fe700 1 -- 172.21.15.84:0/486408060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4800bc30 con 0x7fcf500aee20 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf477fe700 1 -- 172.21.15.84:0/486408060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48012430 con 0x7fcf500aee20 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf56b1d700 1 -- 172.21.15.84:0/486408060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 msgr2=0x7fcf500af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf56b1d700 1 --2- 172.21.15.84:0/486408060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 0x7fcf500af280 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcf500cdd30 tx=0x7fcf48009780 comp rx=0 tx=0).stop 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf56b1d700 1 -- 172.21.15.84:0/486408060 shutdown_connections 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf56b1d700 1 --2- 172.21.15.84:0/486408060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 0x7fcf500af280 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf56b1d700 1 --2- 172.21.15.84:0/486408060 >> v2:172.21.15.131:3300/0 conn(0x7fcf5006ed20 0x7fcf500b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf56b1d700 1 -- 172.21.15.84:0/486408060 >> 172.21.15.84:0/486408060 conn(0x7fcf50068330 msgr2=0x7fcf50068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf56b1d700 1 -- 172.21.15.84:0/486408060 shutdown_connections 2023-10-06T02:58:01.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.221+0000 7fcf56b1d700 1 -- 172.21.15.84:0/486408060 wait complete. 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.222+0000 7fcf56b1d700 1 Processor -- start 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.223+0000 7fcf56b1d700 1 -- start start 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.223+0000 7fcf56b1d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf5006ed20 0x7fcf50158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.223+0000 7fcf56b1d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5006f0f0 0x7fcf500cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.223+0000 7fcf56b1d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 0x7fcf500d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.223+0000 7fcf56b1d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50158870 con 0x7fcf500aee20 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.223+0000 7fcf56b1d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c7ea0 con 0x7fcf5006ed20 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.223+0000 7fcf56b1d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c8930 con 0x7fcf5006f0f0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.223+0000 7fcf550ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 0x7fcf500d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf550ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 0x7fcf500d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35948/0 (socket says 172.21.15.84:35948) 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf550ba700 1 -- 172.21.15.84:0/2874423687 learned_addr learned my addr 172.21.15.84:0/2874423687 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf548b9700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf5006ed20 0x7fcf50158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf47fff700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5006f0f0 0x7fcf500cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf550ba700 1 -- 172.21.15.84:0/2874423687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5006f0f0 msgr2=0x7fcf500cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf550ba700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5006f0f0 0x7fcf500cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf550ba700 1 -- 172.21.15.84:0/2874423687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf5006ed20 msgr2=0x7fcf50158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf550ba700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf5006ed20 0x7fcf50158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf550ba700 1 -- 172.21.15.84:0/2874423687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48009a20 con 0x7fcf500aee20 2023-10-06T02:58:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf550ba700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 0x7fcf500d04e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcf500893c0 tx=0x7fcf48019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf44ff9700 1 -- 172.21.15.84:0/2874423687 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48012e10 con 0x7fcf500aee20 2023-10-06T02:58:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf44ff9700 1 -- 172.21.15.84:0/2874423687 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4801d630 con 0x7fcf500aee20 2023-10-06T02:58:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf44ff9700 1 -- 172.21.15.84:0/2874423687 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4801d9f0 con 0x7fcf500aee20 2023-10-06T02:58:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf56b1d700 1 -- 172.21.15.84:0/2874423687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf500c8090 con 0x7fcf500aee20 2023-10-06T02:58:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.224+0000 7fcf56b1d700 1 -- 172.21.15.84:0/2874423687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf500c8650 con 0x7fcf500aee20 2023-10-06T02:58:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.225+0000 7fcf44ff9700 1 -- 172.21.15.84:0/2874423687 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf48024070 con 0x7fcf500aee20 2023-10-06T02:58:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.226+0000 7fcf44ff9700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.226+0000 7fcf44ff9700 1 -- 172.21.15.84:0/2874423687 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcf48087110 con 0x7fcf500aee20 2023-10-06T02:58:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.226+0000 7fcf548b9700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.226+0000 7fcf548b9700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c006fd0 tx=0x7fcf4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.228+0000 7fcf5fe15b80 1 Processor -- start 2023-10-06T02:58:01.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.228+0000 7fcf5fe15b80 1 -- start start 2023-10-06T02:58:01.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.228+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 0x562f40657cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.228+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f40658da0 0x562f406a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.228+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f406a7ce0 0x562f406a8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.228+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f405aeb50 con 0x562f406a7ce0 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.228+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f405ac350 con 0x562f40657920 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.228+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f405a8140 con 0x562f40658da0 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf550ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f406a7ce0 0x562f406a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf550ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f406a7ce0 0x562f406a8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35962/0 (socket says 172.21.15.84:35962) 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf548b9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 0x562f40657cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf550ba700 1 -- 172.21.15.84:0/2714342109 learned_addr learned my addr 172.21.15.84:0/2714342109 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf47fff700 1 --2- 172.21.15.84:0/2714342109 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f40658da0 0x562f406a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf550ba700 1 -- 172.21.15.84:0/2714342109 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f40658da0 msgr2=0x562f406a77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf550ba700 1 --2- 172.21.15.84:0/2714342109 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f40658da0 0x562f406a77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf550ba700 1 -- 172.21.15.84:0/2714342109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 msgr2=0x562f40657cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf550ba700 1 --2- 172.21.15.84:0/2714342109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 0x562f40657cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf550ba700 1 -- 172.21.15.84:0/2714342109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f40442350 con 0x562f406a7ce0 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf550ba700 1 --2- 172.21.15.84:0/2714342109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f406a7ce0 0x562f406a8130 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcf480852c0 tx=0x7fcf48085250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8184557a28c18d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf35ffb700 1 -- 172.21.15.84:0/2714342109 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800e040 con 0x562f406a7ce0 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf35ffb700 1 -- 172.21.15.84:0/2714342109 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4806e120 con 0x562f406a7ce0 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.229+0000 7fcf35ffb700 1 -- 172.21.15.84:0/2714342109 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48058480 con 0x562f406a7ce0 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2714342109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f406a7ce0 msgr2=0x562f406a8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/2714342109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f406a7ce0 0x562f406a8130 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcf480852c0 tx=0x7fcf48085250 comp rx=0 tx=0).stop 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2714342109 shutdown_connections 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/2714342109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 0x562f40657cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/2714342109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f406a7ce0 0x562f406a8130 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/2714342109 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f40658da0 0x562f406a77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2714342109 >> 172.21.15.84:0/2714342109 conn(0x562f40659240 msgr2=0x562f40659610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2714342109 shutdown_connections 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2714342109 wait complete. 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.230+0000 7fcf5fe15b80 1 -- start start 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.231+0000 7fcf5fe15b80 1 Processor -- start 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.231+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 0x562f406818f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.231+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40658da0 0x562f4069a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.231+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 0x562f406a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.231+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f40553970 con 0x562f40658da0 2023-10-06T02:58:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.231+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f4056ef80 con 0x562f40657920 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.231+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f4042af10 con 0x562f406a7ce0 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.231+0000 7fcf5fe15b80 10 client.0 _ll_register_callbacks cb 0x562f4061af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf47fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40658da0 0x562f4069a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf47fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40658da0 0x562f4069a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35972/0 (socket says 172.21.15.84:35972) 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf47fff700 1 -- 172.21.15.84:0/1088414422 learned_addr learned my addr 172.21.15.84:0/1088414422 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf548b9700 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 0x562f406818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf550ba700 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 0x562f406a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf47fff700 1 -- 172.21.15.84:0/1088414422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 msgr2=0x562f406a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf47fff700 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 0x562f406a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf47fff700 1 -- 172.21.15.84:0/1088414422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 msgr2=0x562f406818f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf47fff700 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 0x562f406818f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf47fff700 1 -- 172.21.15.84:0/1088414422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf500c8650 con 0x562f40658da0 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf47fff700 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40658da0 0x562f4069a670 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007910 tx=0x7fcf40007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff42944cdb2f16f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf2effd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf2effd700 1 -- 172.21.15.84:0/1088414422 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4001a030 con 0x562f40658da0 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf2effd700 1 -- 172.21.15.84:0/1088414422 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcf4001b070 con 0x562f40658da0 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/1088414422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f4064ca20 con 0x562f40658da0 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf2effd700 1 -- 172.21.15.84:0/1088414422 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf40018c40 con 0x562f40658da0 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf5fe15b80 10 client.6195 fetch_fsmap learned FSMap version 41 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/1088414422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x562f403e50c0 con 0x562f40658da0 2023-10-06T02:58:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf2effd700 1 -- 172.21.15.84:0/1088414422 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40024020 con 0x562f40658da0 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.232+0000 7fcf2effd700 1 -- 172.21.15.84:0/1088414422 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fcf40012070 con 0x562f40658da0 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf5fe15b80 10 client.6195 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf5fe15b80 10 client.6195 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf5fe15b80 20 client.6195 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x562f4069fa90 0x562f4069fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf5fe15b80 4 client.6195 mds_command: new command op to 5781 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/1088414422 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f40629950 con 0x562f4069fa90 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf548b9700 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x562f4069fa90 0x562f4069fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf2effd700 10 client.6195 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf548b9700 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x562f4069fa90 0x562f4069fe90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5e6a77afc7f474 server_cookie=5e1630098d006800 in_seq=0 out_seq=0 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf2effd700 1 -- 172.21.15.84:0/1088414422 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562f40629950 con 0x562f4069fa90 2023-10-06T02:58:01.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf2effd700 10 client.6195 handle_command_reply: tid=0 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.233+0000 7fcf5fe15b80 1 client.6195 shutdown 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/1088414422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40658da0 msgr2=0x562f4069a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40658da0 0x562f4069a670 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007910 tx=0x7fcf40007f50 comp rx=0 tx=0).stop 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/1088414422 shutdown_connections 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x562f4069fa90 0x562f4069fe90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40657920 0x562f406818f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 0x562f406a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf2effd700 0 client.6195 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/1088414422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40658da0 0x562f4069a670 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/1088414422 >> 172.21.15.84:0/1088414422 conn(0x562f40659240 msgr2=0x562f40658290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/1088414422 shutdown_connections 2023-10-06T02:58:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/1088414422 wait complete. 2023-10-06T02:58:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.234+0000 7fcf5fe15b80 20 client.6195 trim_cache size 0 max 16384 2023-10-06T02:58:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf5fe15b80 1 Processor -- start 2023-10-06T02:58:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf5fe15b80 1 -- start start 2023-10-06T02:58:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f4067d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f40658da0 0x562f406867e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f406a7ce0 0x562f40686d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f4069cae0 con 0x562f40657920 2023-10-06T02:58:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f406373c0 con 0x562f406a7ce0 2023-10-06T02:58:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f4069e660 con 0x562f40658da0 2023-10-06T02:58:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf548b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f4067d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf548b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f4067d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35982/0 (socket says 172.21.15.84:35982) 2023-10-06T02:58:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.250+0000 7fcf548b9700 1 -- 172.21.15.84:0/2564442671 learned_addr learned my addr 172.21.15.84:0/2564442671 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf548b9700 1 -- 172.21.15.84:0/2564442671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f40658da0 msgr2=0x562f406867e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf548b9700 1 --2- 172.21.15.84:0/2564442671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f40658da0 0x562f406867e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf548b9700 1 -- 172.21.15.84:0/2564442671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f406a7ce0 msgr2=0x562f40686d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf548b9700 1 --2- 172.21.15.84:0/2564442671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f406a7ce0 0x562f40686d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf548b9700 1 -- 172.21.15.84:0/2564442671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f4069f430 con 0x562f40657920 2023-10-06T02:58:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf548b9700 1 --2- 172.21.15.84:0/2564442671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f4067d100 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c010010 tx=0x7fcf4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4019b591af5938e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf367fc700 1 -- 172.21.15.84:0/2564442671 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c027070 con 0x562f40657920 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf367fc700 1 -- 172.21.15.84:0/2564442671 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00c040 con 0x562f40657920 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf367fc700 1 -- 172.21.15.84:0/2564442671 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c015ca0 con 0x562f40657920 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2564442671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 msgr2=0x562f4067d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/2564442671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f4067d100 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c010010 tx=0x7fcf4c017000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2564442671 shutdown_connections 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/2564442671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f406a7ce0 0x562f40686d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/2564442671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f4067d100 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/2564442671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f40658da0 0x562f406867e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.251+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2564442671 >> 172.21.15.84:0/2564442671 conn(0x562f40659240 msgr2=0x562f4069a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.252+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2564442671 shutdown_connections 2023-10-06T02:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.252+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/2564442671 wait complete. 2023-10-06T02:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.252+0000 7fcf5fe15b80 1 -- start start 2023-10-06T02:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.252+0000 7fcf5fe15b80 1 Processor -- start 2023-10-06T02:58:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f406faf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40658da0 0x562f4069a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf5fe15b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 0x562f4069a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f40706350 con 0x562f40657920 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f407064f0 con 0x562f40658da0 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf5fe15b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f40705580 con 0x562f406a7ce0 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf5fe15b80 10 client.0 _ll_register_callbacks cb 0x562f4061af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf548b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f406faf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf548b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f406faf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35992/0 (socket says 172.21.15.84:35992) 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf548b9700 1 -- 172.21.15.84:0/821217810 learned_addr learned my addr 172.21.15.84:0/821217810 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf550ba700 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 0x562f4069a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf47fff700 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40658da0 0x562f4069a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf548b9700 1 -- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 msgr2=0x562f4069a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf548b9700 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 0x562f4069a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf548b9700 1 -- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40658da0 msgr2=0x562f4069a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf548b9700 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40658da0 0x562f4069a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf548b9700 1 -- 172.21.15.84:0/821217810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c00fbe0 con 0x562f40657920 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf550ba700 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 0x562f4069a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.253+0000 7fcf47fff700 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40658da0 0x562f4069a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf548b9700 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f406faf70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c008010 tx=0x7fcf4c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a659d0d30bd50dd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf2effd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf2effd700 1 -- 172.21.15.84:0/821217810 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c021970 con 0x562f40657920 2023-10-06T02:58:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf2effd700 1 -- 172.21.15.84:0/821217810 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcf4c01a040 con 0x562f40657920 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/821217810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf4806e120 con 0x562f40657920 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf2effd700 1 -- 172.21.15.84:0/821217810 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf4c021ce0 con 0x562f40657920 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf5fe15b80 10 client.6201 fetch_fsmap learned FSMap version 41 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/821217810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x562f40576860 con 0x562f40657920 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf2effd700 1 -- 172.21.15.84:0/821217810 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4806e120 con 0x562f40657920 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf2effd700 1 -- 172.21.15.84:0/821217810 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fcf4c035440 con 0x562f40657920 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf5fe15b80 10 client.6201 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf5fe15b80 10 client.6201 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf5fe15b80 20 client.6201 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x562f406ac710 0x562f406b7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf5fe15b80 4 client.6201 mds_command: new command op to 5781 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2023-10-06T02:58:01.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/821217810 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x562f4054aee0 con 0x562f406ac710 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.254+0000 7fcf47fff700 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x562f406ac710 0x562f406b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf2effd700 10 client.6201 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf47fff700 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x562f406ac710 0x562f406b7580 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f7f31a85153b8f server_cookie=48c270f908056435 in_seq=0 out_seq=0 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf2effd700 1 -- 172.21.15.84:0/821217810 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562f4054aee0 con 0x562f406ac710 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf2effd700 10 client.6201 handle_command_reply: tid=0 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf5fe15b80 1 client.6201 shutdown 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/821217810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 msgr2=0x562f406faf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f406faf70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c008010 tx=0x7fcf4c022000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/821217810 shutdown_connections 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f406a7ce0 0x562f4069a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f40657920 0x562f406faf70 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x562f406ac710 0x562f406b7580 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf5fe15b80 1 --2- 172.21.15.84:0/821217810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f40658da0 0x562f4069a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.265 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T02:58:01.255+0000 7f0116907700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-10-06T02:57:44.658631+0000 1=0+1) n(v3 rc2023-10-06T02:57:44.892628+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={5494=pAsLsXsFsx/pAsLsXsFsx@5},l=5494 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55904afa6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.658631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.892628+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.658631+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-10-06T02:57:44.892628+0000 6=0+6)","error_str":""},"return_code":-61} 2023-10-06T02:58:01.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf2effd700 0 client.6201 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:01.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.255+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/821217810 >> 172.21.15.84:0/821217810 conn(0x562f40659240 msgr2=0x562f40658290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/821217810 shutdown_connections 2023-10-06T02:58:01.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf5fe15b80 1 -- 172.21.15.84:0/821217810 wait complete. 2023-10-06T02:58:01.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf5fe15b80 20 client.6201 trim_cache size 0 max 16384 2023-10-06T02:58:01.266 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:01.266 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2023-10-06T02:58:01.267 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "5663f936-413a-4fe6-b290-02fbda602b28", 2023-10-06T02:58:01.267 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2023-10-06T02:58:01.267 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:01.267 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T02:58:01.256+0000 7f52fc1e2700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-10-06T02:57:44.660631+0000 1=0+1) n(v2 rc2023-10-06T02:57:44.892628+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={5494=pAsLsXsFsx/pAsLsXsFsx@4},l=5494 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55ca2bd92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.660631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.892628+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.660631+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-10-06T02:57:44.892628+0000 4=0+4)","error_str":""},"return_code":-61} 2023-10-06T02:58:01.268 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-10-06T02:58:01.257+0000 7ff3384ec700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1) n(v0 rc2023-10-06T02:57:44.661631+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={5494=pAsLsXsFsx/pAsLsXsFsx@4},l=5494 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55ef0a5f3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.661631+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-10-06T02:57:44.661631+0000 2=0+2)","error_str":""},"return_code":-61} 2023-10-06T02:58:01.268 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-10-06T02:58:01.257+0000 7ff3384ec700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={5494=pAsLsXsFsx/AsLsXsFsx@2},l=5494 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55ef097b6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-10-06T02:58:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 -- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 msgr2=0x7fcf3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c006fd0 tx=0x7fcf4c008040 comp rx=0 tx=0).stop 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 -- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 msgr2=0x7fcf500d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 0x7fcf500d04e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcf500893c0 tx=0x7fcf48019000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 -- 172.21.15.84:0/2874423687 shutdown_connections 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcf3c066f30 0x7fcf3c0693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf5006ed20 0x7fcf50158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf500aee20 0x7fcf500d04e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 --2- 172.21.15.84:0/2874423687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcf5006f0f0 0x7fcf500cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.256+0000 7fcf56b1d700 1 -- 172.21.15.84:0/2874423687 >> 172.21.15.84:0/2874423687 conn(0x7fcf50068330 msgr2=0x7fcf501567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.257+0000 7fcf56b1d700 1 -- 172.21.15.84:0/2874423687 shutdown_connections 2023-10-06T02:58:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.257+0000 7fcf56b1d700 1 -- 172.21.15.84:0/2874423687 wait complete. 2023-10-06T02:58:01.270 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T02:58:01.257+0000 7f011c913700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-10-06T02:57:44.659631+0000 1=0+1) n(v4 rc2023-10-06T02:57:44.892628+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={5494=pAsLsXsFs/pAsLsXsFsx@9} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55904afa7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.659631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.892628+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.659631+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-10-06T02:57:44.892628+0000 5=0+5)","error_str":""},"return_code":-61} 2023-10-06T02:58:01.270 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T02:58:01.258+0000 7f53021ee700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1) n(v1 rc2023-10-06T02:57:44.892628+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={5494=pAsLsXsFs/pAsLsXsFsx@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55ca2bd93700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.661631+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-06T02:57:44.892628+0000 3=0+3)","error_str":""},"return_code":-61} 2023-10-06T02:58:01.271 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub abort 2023-10-06T02:58:01.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.385+0000 7fcb00fa8700 1 Processor -- start 2023-10-06T02:58:01.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.385+0000 7fcb00fa8700 1 -- start start 2023-10-06T02:58:01.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcb00fa8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 0x7fcafc0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcb00fa8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcafc0c6610 0x7fcafc0ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcb00fa8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcafc0b2e60 con 0x7fcafc0b2a90 2023-10-06T02:58:01.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcb00fa8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcafc0cf5d0 con 0x7fcafc0c6610 2023-10-06T02:58:01.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcb00fa8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc0cf8b0 con 0x7fcafc0cbb50 2023-10-06T02:58:01.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcafad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcafc0c6610 0x7fcafc0ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcafad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcafc0c6610 0x7fcafc0ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36002/0 (socket says 172.21.15.84:36002) 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcafad9d700 1 -- 172.21.15.84:0/3663437091 learned_addr learned my addr 172.21.15.84:0/3663437091 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/3663437091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 0x7fcafc0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcafad9d700 1 -- 172.21.15.84:0/3663437091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 msgr2=0x7fcafc0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcafad9d700 1 --2- 172.21.15.84:0/3663437091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 0x7fcafc0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcafad9d700 1 -- 172.21.15.84:0/3663437091 >> v1:172.21.15.131:6789/0 conn(0x7fcafc0b2a90 legacy=0x7fcafc0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.386+0000 7fcafad9d700 1 -- 172.21.15.84:0/3663437091 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc0cfb90 con 0x7fcafc0c6610 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcafad9d700 1 --2- 172.21.15.84:0/3663437091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 0x7fcafc0ced90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009f20 tx=0x7fcaf4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babea9830bddd59c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcaf9d9b700 1 -- 172.21.15.84:0/3663437091 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400e070 con 0x7fcafc0c6610 2023-10-06T02:58:01.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcaf9d9b700 1 -- 172.21.15.84:0/3663437091 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf400ba80 con 0x7fcafc0c6610 2023-10-06T02:58:01.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcaf9d9b700 1 -- 172.21.15.84:0/3663437091 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40092e0 con 0x7fcafc0c6610 2023-10-06T02:58:01.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcb00fa8700 1 -- 172.21.15.84:0/3663437091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 msgr2=0x7fcafc0ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcb00fa8700 1 --2- 172.21.15.84:0/3663437091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 0x7fcafc0ced90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009f20 tx=0x7fcaf4009840 comp rx=0 tx=0).stop 2023-10-06T02:58:01.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcb00fa8700 1 -- 172.21.15.84:0/3663437091 shutdown_connections 2023-10-06T02:58:01.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcb00fa8700 1 --2- 172.21.15.84:0/3663437091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 0x7fcafc0ced90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcb00fa8700 1 --2- 172.21.15.84:0/3663437091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 0x7fcafc0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcb00fa8700 1 -- 172.21.15.84:0/3663437091 >> 172.21.15.84:0/3663437091 conn(0x7fcafc099740 msgr2=0x7fcafc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcb00fa8700 1 -- 172.21.15.84:0/3663437091 shutdown_connections 2023-10-06T02:58:01.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.387+0000 7fcb00fa8700 1 -- 172.21.15.84:0/3663437091 wait complete. 2023-10-06T02:58:01.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcb00fa8700 1 Processor -- start 2023-10-06T02:58:01.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcb00fa8700 1 -- start start 2023-10-06T02:58:01.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcb00fa8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcafc0b2a90 0x7fcafc0c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcb00fa8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 0x7fcafc0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcb00fa8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 0x7fcafc0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcb00fa8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc0ca540 con 0x7fcafc0c6610 2023-10-06T02:58:01.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcb00fa8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc0c80e0 con 0x7fcafc0b2a90 2023-10-06T02:58:01.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcb00fa8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc16a5a0 con 0x7fcafc0cbb50 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcaf1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 0x7fcafc0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcaf1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 0x7fcafc0c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36018/0 (socket says 172.21.15.84:36018) 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcaf1d9b700 1 -- 172.21.15.84:0/1949519484 learned_addr learned my addr 172.21.15.84:0/1949519484 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.389+0000 7fcafa59c700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcafc0b2a90 0x7fcafc0c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcafad9d700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 0x7fcafc0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcaf1d9b700 1 -- 172.21.15.84:0/1949519484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 msgr2=0x7fcafc0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 0x7fcafc0ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcaf1d9b700 1 -- 172.21.15.84:0/1949519484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcafc0b2a90 msgr2=0x7fcafc0c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcafc0b2a90 0x7fcafc0c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcaf1d9b700 1 -- 172.21.15.84:0/1949519484 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf4009ae0 con 0x7fcafc0c6610 2023-10-06T02:58:01.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 0x7fcafc0c9ec0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcae400d860 tx=0x7fcae4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcaf2ffd700 1 -- 172.21.15.84:0/1949519484 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae40125f0 con 0x7fcafc0c6610 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcaf2ffd700 1 -- 172.21.15.84:0/1949519484 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4012750 con 0x7fcafc0c6610 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcb00fa8700 1 -- 172.21.15.84:0/1949519484 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc169a00 con 0x7fcafc0c6610 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcaf2ffd700 1 -- 172.21.15.84:0/1949519484 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4012b10 con 0x7fcafc0c6610 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.390+0000 7fcb00fa8700 1 -- 172.21.15.84:0/1949519484 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc169f50 con 0x7fcafc0c6610 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.391+0000 7fcaf2ffd700 1 -- 172.21.15.84:0/1949519484 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcae401e460 con 0x7fcafc0c6610 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.392+0000 7fcaf2ffd700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcadc066f30 0x7fcadc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.392+0000 7fcaf2ffd700 1 -- 172.21.15.84:0/1949519484 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcae4084d00 con 0x7fcafc0c6610 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.392+0000 7fcafa59c700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcadc066f30 0x7fcadc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.392+0000 7fcafa59c700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcadc066f30 0x7fcadc0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcaec007fd0 tx=0x7fcaec007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.394+0000 7fcb0a2a0b80 1 Processor -- start 2023-10-06T02:58:01.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.394+0000 7fcb0a2a0b80 1 -- start start 2023-10-06T02:58:01.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e57880 0x559f97e57c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e58d00 0x559f97ea7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97ea7c40 0x559f97ea8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f97daeab0 con 0x559f97e57880 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f97dac2b0 con 0x559f97ea7c40 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f97da80a0 con 0x559f97e58d00 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e57880 0x559f97e57c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e57880 0x559f97e57c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36034/0 (socket says 172.21.15.84:36034) 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafa59c700 1 -- 172.21.15.84:0/4068640890 learned_addr learned my addr 172.21.15.84:0/4068640890 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/4068640890 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e58d00 0x559f97ea7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafad9d700 1 --2- 172.21.15.84:0/4068640890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97ea7c40 0x559f97ea8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafa59c700 1 -- 172.21.15.84:0/4068640890 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e58d00 msgr2=0x559f97ea7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafa59c700 1 --2- 172.21.15.84:0/4068640890 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e58d00 0x559f97ea7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafa59c700 1 -- 172.21.15.84:0/4068640890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97ea7c40 msgr2=0x559f97ea8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafa59c700 1 --2- 172.21.15.84:0/4068640890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97ea7c40 0x559f97ea8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafa59c700 1 -- 172.21.15.84:0/4068640890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f97c422b0 con 0x559f97e57880 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcafa59c700 1 --2- 172.21.15.84:0/4068640890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e57880 0x559f97e57c50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fcaec002aa0 tx=0x7fcaec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119ab217bfda16a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcadb7fe700 1 -- 172.21.15.84:0/4068640890 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec014660 con 0x559f97e57880 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcadb7fe700 1 -- 172.21.15.84:0/4068640890 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec0147c0 con 0x559f97e57880 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.395+0000 7fcadb7fe700 1 -- 172.21.15.84:0/4068640890 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec014b60 con 0x559f97e57880 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.396+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/4068640890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e57880 msgr2=0x559f97e57c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.396+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/4068640890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e57880 0x559f97e57c50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fcaec002aa0 tx=0x7fcaec015000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.396+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/4068640890 shutdown_connections 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.396+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/4068640890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97ea7c40 0x559f97ea8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.396+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/4068640890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e57880 0x559f97e57c50 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.396+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/4068640890 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e58d00 0x559f97ea7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.396+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/4068640890 >> 172.21.15.84:0/4068640890 conn(0x559f97e591a0 msgr2=0x559f97e59570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.396+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/4068640890 shutdown_connections 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.396+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/4068640890 wait complete. 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.397+0000 7fcb0a2a0b80 1 -- start start 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.397+0000 7fcb0a2a0b80 1 Processor -- start 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e57880 0x559f97e7d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e58d00 0x559f97e84af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97ea7c40 0x559f97e86680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f97d538d0 con 0x559f97e58d00 2023-10-06T02:58:01.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f97d6eee0 con 0x559f97e57880 2023-10-06T02:58:01.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f97c2ae70 con 0x559f97ea7c40 2023-10-06T02:58:01.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcb0a2a0b80 10 client.0 _ll_register_callbacks cb 0x559f97e1aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:01.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcaf1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e58d00 0x559f97e84af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcaf1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e58d00 0x559f97e84af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36050/0 (socket says 172.21.15.84:36050) 2023-10-06T02:58:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcaf1d9b700 1 -- 172.21.15.84:0/2256371408 learned_addr learned my addr 172.21.15.84:0/2256371408 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcaf1d9b700 1 -- 172.21.15.84:0/2256371408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97ea7c40 msgr2=0x559f97e86680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97ea7c40 0x559f97e86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcaf1d9b700 1 -- 172.21.15.84:0/2256371408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e57880 msgr2=0x559f97e7d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e57880 0x559f97e7d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcaf1d9b700 1 -- 172.21.15.84:0/2256371408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc0b2e60 con 0x559f97e58d00 2023-10-06T02:58:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e58d00 0x559f97e84af0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcae400de50 tx=0x7fcae4082ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e12f86ca69d6013 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcad8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcad8ff9700 1 -- 172.21.15.84:0/2256371408 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4053d30 con 0x559f97e58d00 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcad8ff9700 1 -- 172.21.15.84:0/2256371408 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcae4055bf0 con 0x559f97e58d00 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/2256371408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f97e4c980 con 0x559f97e58d00 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.398+0000 7fcad8ff9700 1 -- 172.21.15.84:0/2256371408 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcae4054e80 con 0x559f97e58d00 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcb0a2a0b80 10 client.6213 fetch_fsmap learned FSMap version 41 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/2256371408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x559f97be5020 con 0x559f97e58d00 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcad8ff9700 1 -- 172.21.15.84:0/2256371408 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f97e4c980 con 0x559f97e58d00 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcad8ff9700 1 -- 172.21.15.84:0/2256371408 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fcae405c4a0 con 0x559f97e58d00 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcb0a2a0b80 10 client.6213 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcb0a2a0b80 10 client.6213 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcb0a2a0b80 20 client.6213 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x559f97e870b0 0x559f97e95eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcb0a2a0b80 4 client.6213 mds_command: new command op to 5781 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/2256371408 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f97e298b0 con 0x559f97e870b0 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcafa59c700 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x559f97e870b0 0x559f97e95eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcad8ff9700 10 client.6213 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.399+0000 7fcafa59c700 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x559f97e870b0 0x559f97e95eb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=289a354625d6e52e server_cookie=e44f5b339a9f73b6 in_seq=0 out_seq=0 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcad8ff9700 1 -- 172.21.15.84:0/2256371408 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559f97e298b0 con 0x559f97e870b0 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcad8ff9700 10 client.6213 handle_command_reply: tid=0 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 client.6213 shutdown 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/2256371408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e58d00 msgr2=0x559f97e84af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e58d00 0x559f97e84af0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcae400de50 tx=0x7fcae4082ee0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/2256371408 shutdown_connections 2023-10-06T02:58:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x559f97e870b0 0x559f97e95eb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e57880 0x559f97e7d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcad8ff9700 0 client.6213 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:01.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97ea7c40 0x559f97e86680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/2256371408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97e58d00 0x559f97e84af0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/2256371408 >> 172.21.15.84:0/2256371408 conn(0x559f97e591a0 msgr2=0x559f97e9b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/2256371408 shutdown_connections 2023-10-06T02:58:01.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/2256371408 wait complete. 2023-10-06T02:58:01.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.400+0000 7fcb0a2a0b80 20 client.6213 trim_cache size 0 max 16384 2023-10-06T02:58:01.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.416+0000 7fcb0a2a0b80 1 Processor -- start 2023-10-06T02:58:01.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.416+0000 7fcb0a2a0b80 1 -- start start 2023-10-06T02:58:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.416+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 0x559f97e84a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.416+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 0x559f97eb7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.416+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97eb0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.416+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f97e526f0 con 0x559f97ea7c40 2023-10-06T02:58:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.416+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f97e95880 con 0x559f97e58d00 2023-10-06T02:58:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.416+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f97ea73c0 con 0x559f97e57880 2023-10-06T02:58:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97eb0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97eb0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36060/0 (socket says 172.21.15.84:36060) 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafad9d700 1 -- 172.21.15.84:0/1622481739 learned_addr learned my addr 172.21.15.84:0/1622481739 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafa59c700 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 0x559f97e84a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 0x559f97eb7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafad9d700 1 -- 172.21.15.84:0/1622481739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 msgr2=0x559f97e84a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafad9d700 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 0x559f97e84a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafad9d700 1 -- 172.21.15.84:0/1622481739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 msgr2=0x559f97eb7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafad9d700 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 0x559f97eb7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafad9d700 1 -- 172.21.15.84:0/1622481739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f97d767c0 con 0x559f97ea7c40 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafa59c700 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 0x559f97e84a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.417+0000 7fcafad9d700 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97eb0340 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4012000 tx=0x7fcaf4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec0ed201d1e9b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcadbfff700 1 -- 172.21.15.84:0/1622481739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4023070 con 0x559f97ea7c40 2023-10-06T02:58:01.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcadbfff700 1 -- 172.21.15.84:0/1622481739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf4007260 con 0x559f97ea7c40 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcadbfff700 1 -- 172.21.15.84:0/1622481739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400be40 con 0x559f97ea7c40 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/1622481739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 msgr2=0x559f97eb0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97eb0340 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4012000 tx=0x7fcaf4018000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/1622481739 shutdown_connections 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97eb0340 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 0x559f97e84a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/1622481739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 0x559f97eb7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/1622481739 >> 172.21.15.84:0/1622481739 conn(0x559f97e591a0 msgr2=0x559f97e502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/1622481739 shutdown_connections 2023-10-06T02:58:01.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.418+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/1622481739 wait complete. 2023-10-06T02:58:01.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.419+0000 7fcb0a2a0b80 1 -- start start 2023-10-06T02:58:01.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.419+0000 7fcb0a2a0b80 1 Processor -- start 2023-10-06T02:58:01.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 0x559f97e96910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 0x559f97e821d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcb0a2a0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97e83f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f97e82ba0 con 0x559f97ea7c40 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f97e9be30 con 0x559f97e58d00 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcb0a2a0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f97e96e50 con 0x559f97e57880 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcb0a2a0b80 10 client.0 _ll_register_callbacks cb 0x559f97e1aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcafad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97e83f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcafad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97e83f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36072/0 (socket says 172.21.15.84:36072) 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcafad9d700 1 -- 172.21.15.84:0/3380522161 learned_addr learned my addr 172.21.15.84:0/3380522161 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcafa59c700 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 0x559f97e96910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcaf1d9b700 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 0x559f97e821d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcafad9d700 1 -- 172.21.15.84:0/3380522161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 msgr2=0x559f97e96910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcafad9d700 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 0x559f97e96910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcafad9d700 1 -- 172.21.15.84:0/3380522161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 msgr2=0x559f97e821d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcafad9d700 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 0x559f97e821d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.420+0000 7fcafad9d700 1 -- 172.21.15.84:0/3380522161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f97c422b0 con 0x559f97ea7c40 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcafad9d700 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97e83f20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009ab0 tx=0x7fcaf4023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2eacce25ed69e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcad8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcad8ff9700 1 -- 172.21.15.84:0/3380522161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4007a30 con 0x559f97ea7c40 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcad8ff9700 1 -- 172.21.15.84:0/3380522161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcaf4034d60 con 0x559f97ea7c40 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/3380522161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcaec0147c0 con 0x559f97ea7c40 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcad8ff9700 1 -- 172.21.15.84:0/3380522161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaf4007da0 con 0x559f97ea7c40 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcb0a2a0b80 10 client.6219 fetch_fsmap learned FSMap version 41 2023-10-06T02:58:01.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/3380522161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x7fcafc0cfb90 con 0x559f97ea7c40 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcad8ff9700 1 -- 172.21.15.84:0/3380522161 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec0147c0 con 0x559f97ea7c40 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcad8ff9700 1 -- 172.21.15.84:0/3380522161 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fcaf4019070 con 0x559f97ea7c40 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcb0a2a0b80 10 client.6219 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcb0a2a0b80 10 client.6219 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcb0a2a0b80 20 client.6219 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x559f97e84460 0x559f97efa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcb0a2a0b80 4 client.6219 mds_command: new command op to 5781 tid=0[{"prefix": "scrub abort"}] 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/3380522161 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x559f97d4ae40 con 0x559f97e84460 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.421+0000 7fcafa59c700 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x559f97e84460 0x559f97efa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcad8ff9700 10 client.6219 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcafa59c700 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x559f97e84460 0x559f97efa450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5ddfd6e8ade8b5d server_cookie=5ad0c17c935c073d in_seq=0 out_seq=0 2023-10-06T02:58:01.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcad8ff9700 1 -- 172.21.15.84:0/3380522161 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x559f97d4ae40 con 0x559f97e84460 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcad8ff9700 10 client.6219 handle_command_reply: tid=0 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 client.6219 shutdown 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/3380522161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 msgr2=0x559f97e83f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97e83f20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009ab0 tx=0x7fcaf4023000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/3380522161 shutdown_connections 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559f97ea7c40 0x559f97e83f20 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559f97e57880 0x559f97e96910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x559f97e84460 0x559f97efa450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 --2- 172.21.15.84:0/3380522161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f97e58d00 0x559f97e821d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcad8ff9700 0 client.6219 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/3380522161 >> 172.21.15.84:0/3380522161 conn(0x559f97e591a0 msgr2=0x559f97eb79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/3380522161 shutdown_connections 2023-10-06T02:58:01.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 1 -- 172.21.15.84:0/3380522161 wait complete. 2023-10-06T02:58:01.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.422+0000 7fcb0a2a0b80 20 client.6219 trim_cache size 0 max 16384 2023-10-06T02:58:01.433 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:01.433 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:58:01.433 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:01.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 -- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcadc066f30 msgr2=0x7fcadc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcadc066f30 0x7fcadc0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcaec007fd0 tx=0x7fcaec007eb0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 -- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 msgr2=0x7fcafc0c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 0x7fcafc0c9ec0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fcae400d860 tx=0x7fcae4008040 comp rx=0 tx=0).stop 2023-10-06T02:58:01.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 -- 172.21.15.84:0/1949519484 shutdown_connections 2023-10-06T02:58:01.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcadc066f30 0x7fcadc0693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcafc0b2a90 0x7fcafc0c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcafc0cbb50 0x7fcafc0ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 --2- 172.21.15.84:0/1949519484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcafc0c6610 0x7fcafc0c9ec0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 -- 172.21.15.84:0/1949519484 >> 172.21.15.84:0/1949519484 conn(0x7fcafc099740 msgr2=0x7fcafc069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 -- 172.21.15.84:0/1949519484 shutdown_connections 2023-10-06T02:58:01.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.423+0000 7fcb00fa8700 1 -- 172.21.15.84:0/1949519484 wait complete. 2023-10-06T02:58:01.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2023-10-06T02:58:01.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.550+0000 7f43fad90700 1 Processor -- start 2023-10-06T02:58:01.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.550+0000 7f43fad90700 1 -- start start 2023-10-06T02:58:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.551+0000 7f43fad90700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43f406bff0 0x7f43f4157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.551+0000 7f43fad90700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f40afbf0 con 0x7f43f415b980 2023-10-06T02:58:01.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.551+0000 7f43fad90700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f40afed0 con 0x7f43f4158250 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.551+0000 7f43fad90700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40b01b0 con 0x7f43f406bff0 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.551+0000 7f43f8b2c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f43f415b980 0x7f43f406b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46046/0 (socket says 172.21.15.84:46046) 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.551+0000 7f43f8b2c700 1 -- 172.21.15.84:0/3445269831 learned_addr learned my addr 172.21.15.84:0/3445269831 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78257605 0 0) 0x7f43f40afbf0 con 0x7f43f415b980 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43dc003570 con 0x7f43f415b980 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43ebfff700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43f406bff0 0x7f43f4157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1794866167 0 0) 0x7f43dc003570 con 0x7f43f415b980 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43f406bff0 msgr2=0x7f43f4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43f406bff0 0x7f43f4157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 >> v1:172.21.15.131:6789/0 conn(0x7f43f4158250 legacy=0x7f43f4158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f40b0490 con 0x7f43f415b980 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f43f00017f0 con 0x7f43f415b980 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 >> v1:172.21.15.84:6789/0 conn(0x7f43f415b980 legacy=0x7f43f406b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc003a90 0x7f43dc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43dc004810 0x7f43dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc0052e0 0x7f43dc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40b01b0 con 0x7f43dc004810 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc00c230 con 0x7f43dc0052e0 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc00c3f0 con 0x7f43dc003a90 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43ebfff700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43f406bff0 0x7f43f4157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43f932d700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc0052e0 0x7f43dc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc003a90 0x7f43dc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43ebfff700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43dc004810 0x7f43dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43ebfff700 1 -- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc003a90 msgr2=0x7f43dc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43ebfff700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc003a90 0x7f43dc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43ebfff700 1 -- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc0052e0 msgr2=0x7f43dc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43ebfff700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc0052e0 0x7f43dc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43ebfff700 1 -- 172.21.15.84:0/3445269831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc003570 con 0x7f43dc004810 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.552+0000 7f43f932d700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43dc0052e0 0x7f43dc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43ebfff700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43dc004810 0x7f43dc004c80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f43e4006f00 tx=0x7f43e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38d5abb3c4cf211 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400c070 con 0x7f43dc004810 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e4013410 con 0x7f43dc004810 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43eb7fe700 1 -- 172.21.15.84:0/3445269831 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40135a0 con 0x7f43dc004810 2023-10-06T02:58:01.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43fad90700 1 -- 172.21.15.84:0/3445269831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43dc004810 msgr2=0x7f43dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43fad90700 1 --2- 172.21.15.84:0/3445269831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43dc004810 0x7f43dc004c80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f43e4006f00 tx=0x7f43e4008040 comp rx=0 tx=0).stop 2023-10-06T02:58:01.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43f932d700 1 -- 172.21.15.84:0/3445269831 reap_dead start 2023-10-06T02:58:01.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43fad90700 1 -- 172.21.15.84:0/3445269831 shutdown_connections 2023-10-06T02:58:01.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43fad90700 1 -- 172.21.15.84:0/3445269831 >> 172.21.15.84:0/3445269831 conn(0x7f43f40ce330 msgr2=0x7f43f40ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43fad90700 1 -- 172.21.15.84:0/3445269831 shutdown_connections 2023-10-06T02:58:01.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.553+0000 7f43fad90700 1 -- 172.21.15.84:0/3445269831 wait complete. 2023-10-06T02:58:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.554+0000 7f43fad90700 1 Processor -- start 2023-10-06T02:58:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43fad90700 1 -- start start 2023-10-06T02:58:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43fad90700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc004810 0x7f43f414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43fad90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f4155bb0 0x7f43f4156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43fad90700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40cc370 0x7f43f40cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43fad90700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f4151c70 con 0x7f43f4155bb0 2023-10-06T02:58:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43fad90700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40ccd30 con 0x7f43f40cc370 2023-10-06T02:58:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43fad90700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f41566a0 con 0x7f43dc004810 2023-10-06T02:58:01.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43ebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f4155bb0 0x7f43f4156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43ebfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f4155bb0 0x7f43f4156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36086/0 (socket says 172.21.15.84:36086) 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43ebfff700 1 -- 172.21.15.84:0/584095092 learned_addr learned my addr 172.21.15.84:0/584095092 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43f932d700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40cc370 0x7f43f40cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.555+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc004810 0x7f43f414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43ebfff700 1 -- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc004810 msgr2=0x7f43f414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43ebfff700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc004810 0x7f43f414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43ebfff700 1 -- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40cc370 msgr2=0x7f43f40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43ebfff700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40cc370 0x7f43f40cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43ebfff700 1 -- 172.21.15.84:0/584095092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4156980 con 0x7f43f4155bb0 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43f932d700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40cc370 0x7f43f40cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc004810 0x7f43f414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:01.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43ebfff700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f4155bb0 0x7f43f4156020 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f43f40ce2c0 tx=0x7f43e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43e8ff9700 1 -- 172.21.15.84:0/584095092 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4013e50 con 0x7f43f4155bb0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43e8ff9700 1 -- 172.21.15.84:0/584095092 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e4013580 con 0x7f43f4155bb0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43fad90700 1 -- 172.21.15.84:0/584095092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f4151e80 con 0x7f43f4155bb0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43e8ff9700 1 -- 172.21.15.84:0/584095092 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e401b810 con 0x7f43f4155bb0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.556+0000 7f43fad90700 1 -- 172.21.15.84:0/584095092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f414e1f0 con 0x7f43f4155bb0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.558+0000 7f43e8ff9700 1 -- 172.21.15.84:0/584095092 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43e401bc40 con 0x7f43f4155bb0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.558+0000 7f43e8ff9700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43e0066f30 0x7f43e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.558+0000 7f43e8ff9700 1 -- 172.21.15.84:0/584095092 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f43e4085c70 con 0x7f43f4155bb0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.558+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43e0066f30 0x7f43e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.558+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43e0066f30 0x7f43e00693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f43f0001920 tx=0x7f43f0006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.560+0000 7f4404088b80 1 Processor -- start 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.560+0000 7f4404088b80 1 -- start start 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.560+0000 7f4404088b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b7276640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.560+0000 7f4404088b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b72496c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.560+0000 7f4404088b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b7290180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.560+0000 7f4404088b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555b71a0ac0 con 0x5555b7249c00 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.560+0000 7f4404088b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555b719e2c0 con 0x5555b7293b40 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.560+0000 7f4404088b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555b719a0b0 con 0x5555b7276270 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.560+0000 7f43f932d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b7290180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43f932d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b7290180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36094/0 (socket says 172.21.15.84:36094) 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43f932d700 1 -- 172.21.15.84:0/2921841770 learned_addr learned my addr 172.21.15.84:0/2921841770 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/2921841770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b7276640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43ebfff700 1 --2- 172.21.15.84:0/2921841770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b72496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43f932d700 1 -- 172.21.15.84:0/2921841770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 msgr2=0x5555b7276640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43f932d700 1 --2- 172.21.15.84:0/2921841770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b7276640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43f932d700 1 -- 172.21.15.84:0/2921841770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 msgr2=0x5555b72496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43f932d700 1 --2- 172.21.15.84:0/2921841770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b72496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43f932d700 1 -- 172.21.15.84:0/2921841770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555b70342c0 con 0x5555b7249c00 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43f932d700 1 --2- 172.21.15.84:0/2921841770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b7290180 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f43f40af430 tx=0x7f43ec009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ffa5202f6873c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43d9ffb700 1 -- 172.21.15.84:0/2921841770 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec01a070 con 0x5555b7249c00 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43d9ffb700 1 -- 172.21.15.84:0/2921841770 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec013610 con 0x5555b7249c00 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.561+0000 7f43d9ffb700 1 -- 172.21.15.84:0/2921841770 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec013990 con 0x5555b7249c00 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 -- 172.21.15.84:0/2921841770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 msgr2=0x5555b7290180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 --2- 172.21.15.84:0/2921841770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b7290180 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f43f40af430 tx=0x7f43ec009040 comp rx=0 tx=0).stop 2023-10-06T02:58:01.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 -- 172.21.15.84:0/2921841770 shutdown_connections 2023-10-06T02:58:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 --2- 172.21.15.84:0/2921841770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b7290180 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 --2- 172.21.15.84:0/2921841770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b7276640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 --2- 172.21.15.84:0/2921841770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b72496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 -- 172.21.15.84:0/2921841770 >> 172.21.15.84:0/2921841770 conn(0x5555b724b1b0 msgr2=0x5555b724b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 -- 172.21.15.84:0/2921841770 shutdown_connections 2023-10-06T02:58:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 -- 172.21.15.84:0/2921841770 wait complete. 2023-10-06T02:58:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.562+0000 7f4404088b80 1 -- start start 2023-10-06T02:58:01.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f4404088b80 1 Processor -- start 2023-10-06T02:58:01.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f4404088b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b728d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f4404088b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b72a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f4404088b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b7244ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f4404088b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555b71458e0 con 0x5555b7249c00 2023-10-06T02:58:01.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f4404088b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555b7160ef0 con 0x5555b7293b40 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f4404088b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555b701ce80 con 0x5555b7276270 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f43f8b2c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b728d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f4404088b80 10 client.0 _ll_register_callbacks cb 0x5555b720cec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f43f8b2c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b728d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36110/0 (socket says 172.21.15.84:36110) 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f43f8b2c700 1 -- 172.21.15.84:0/3773000359 learned_addr learned my addr 172.21.15.84:0/3773000359 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.563+0000 7f43ebfff700 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b72a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43f932d700 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b7244ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43f8b2c700 1 -- 172.21.15.84:0/3773000359 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 msgr2=0x5555b72a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b72a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43f8b2c700 1 -- 172.21.15.84:0/3773000359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 msgr2=0x5555b7244ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b7244ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43f8b2c700 1 -- 172.21.15.84:0/3773000359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f40afed0 con 0x5555b7249c00 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43f932d700 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b7244ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b728d850 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f43f0007c50 tx=0x7f43f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8b9f6cdcf2b60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43d2ffd700 1 -- 172.21.15.84:0/3773000359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0014e00 con 0x5555b7249c00 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43d2ffd700 1 -- 172.21.15.84:0/3773000359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f43f001a040 con 0x5555b7249c00 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f4404088b80 1 -- 172.21.15.84:0/3773000359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555b723e990 con 0x5555b7249c00 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43d2ffd700 1 -- 172.21.15.84:0/3773000359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43f0026d20 con 0x5555b7249c00 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f4404088b80 10 client.6231 fetch_fsmap learned FSMap version 41 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f4404088b80 1 -- 172.21.15.84:0/3773000359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5555b6fd7030 con 0x5555b7249c00 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43d2ffd700 1 -- 172.21.15.84:0/3773000359 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5555b723e990 con 0x5555b7249c00 2023-10-06T02:58:01.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f43d2ffd700 1 -- 172.21.15.84:0/3773000359 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f43f0022400 con 0x5555b7249c00 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f4404088b80 10 client.6231 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f4404088b80 10 client.6231 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f4404088b80 20 client.6231 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f4404088b80 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x5555b72753a0 0x5555b7278820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f4404088b80 4 client.6231 mds_command: new command op to 5778 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.564+0000 7f4404088b80 1 -- 172.21.15.84:0/3773000359 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555b721b8c0 con 0x5555b72753a0 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f43ebfff700 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x5555b72753a0 0x5555b7278820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f43d2ffd700 10 client.6231 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f43ebfff700 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x5555b72753a0 0x5555b7278820 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53a8ab087e48265e server_cookie=89f90a87d262babc in_seq=0 out_seq=0 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f43d2ffd700 1 -- 172.21.15.84:0/3773000359 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5555b721b8c0 con 0x5555b72753a0 2023-10-06T02:58:01.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f43d2ffd700 10 client.6231 handle_command_reply: tid=0 2023-10-06T02:58:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f4404088b80 1 client.6231 shutdown 2023-10-06T02:58:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f4404088b80 1 -- 172.21.15.84:0/3773000359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 msgr2=0x5555b728d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f4404088b80 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b728d850 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f43f0007c50 tx=0x7f43f0017000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f4404088b80 1 -- 172.21.15.84:0/3773000359 shutdown_connections 2023-10-06T02:58:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f4404088b80 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x5555b72753a0 0x5555b7278820 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f4404088b80 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b7244ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f43d2ffd700 0 client.6231 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f4404088b80 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b728d850 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f4404088b80 1 --2- 172.21.15.84:0/3773000359 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b72a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.565+0000 7f4404088b80 1 -- 172.21.15.84:0/3773000359 >> 172.21.15.84:0/3773000359 conn(0x5555b724b1b0 msgr2=0x5555b7245a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.566+0000 7f4404088b80 1 -- 172.21.15.84:0/3773000359 shutdown_connections 2023-10-06T02:58:01.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.566+0000 7f4404088b80 1 -- 172.21.15.84:0/3773000359 wait complete. 2023-10-06T02:58:01.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.566+0000 7f4404088b80 20 client.6231 trim_cache size 0 max 16384 2023-10-06T02:58:01.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.581+0000 7f4404088b80 1 Processor -- start 2023-10-06T02:58:01.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.581+0000 7f4404088b80 1 -- start start 2023-10-06T02:58:01.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f4404088b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7249c00 0x5555b728ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f4404088b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b7246580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f4404088b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7293b40 0x5555b7246ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f4404088b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555b7275c50 con 0x5555b7293b40 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f4404088b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555b72757f0 con 0x5555b7249c00 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f4404088b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555b7222230 con 0x5555b7276270 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f43f932d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7293b40 0x5555b7246ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f43f932d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7293b40 0x5555b7246ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36120/0 (socket says 172.21.15.84:36120) 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f43f932d700 1 -- 172.21.15.84:0/1893543161 learned_addr learned my addr 172.21.15.84:0/1893543161 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f43f932d700 1 -- 172.21.15.84:0/1893543161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 msgr2=0x5555b7246580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f43f932d700 1 --2- 172.21.15.84:0/1893543161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b7246580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f43f932d700 1 -- 172.21.15.84:0/1893543161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7249c00 msgr2=0x5555b728ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f43f932d700 1 --2- 172.21.15.84:0/1893543161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7249c00 0x5555b728ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.582+0000 7f43f932d700 1 -- 172.21.15.84:0/1893543161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555b71687d0 con 0x5555b7293b40 2023-10-06T02:58:01.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f43f932d700 1 --2- 172.21.15.84:0/1893543161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7293b40 0x5555b7246ac0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x5555b7249320 tx=0x7f43ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da70c9bcdbd97830 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f43da7fc700 1 -- 172.21.15.84:0/1893543161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec01a030 con 0x5555b7293b40 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f43da7fc700 1 -- 172.21.15.84:0/1893543161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec013780 con 0x5555b7293b40 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f43da7fc700 1 -- 172.21.15.84:0/1893543161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec021430 con 0x5555b7293b40 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f4404088b80 1 -- 172.21.15.84:0/1893543161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7293b40 msgr2=0x5555b7246ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f4404088b80 1 --2- 172.21.15.84:0/1893543161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7293b40 0x5555b7246ac0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x5555b7249320 tx=0x7f43ec016000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f4404088b80 1 -- 172.21.15.84:0/1893543161 shutdown_connections 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f4404088b80 1 --2- 172.21.15.84:0/1893543161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7249c00 0x5555b728ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f4404088b80 1 --2- 172.21.15.84:0/1893543161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7293b40 0x5555b7246ac0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f4404088b80 1 --2- 172.21.15.84:0/1893543161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b7246580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f4404088b80 1 -- 172.21.15.84:0/1893543161 >> 172.21.15.84:0/1893543161 conn(0x5555b724b1b0 msgr2=0x5555b72422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f4404088b80 1 -- 172.21.15.84:0/1893543161 shutdown_connections 2023-10-06T02:58:01.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.583+0000 7f4404088b80 1 -- 172.21.15.84:0/1893543161 wait complete. 2023-10-06T02:58:01.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.584+0000 7f4404088b80 1 -- start start 2023-10-06T02:58:01.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.584+0000 7f4404088b80 1 Processor -- start 2023-10-06T02:58:01.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f4404088b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b72fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f4404088b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b728d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f4404088b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b728d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f4404088b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555b7292430 con 0x5555b7249c00 2023-10-06T02:58:01.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f4404088b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555b72faed0 con 0x5555b7293b40 2023-10-06T02:58:01.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f4404088b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555b724cfc0 con 0x5555b7276270 2023-10-06T02:58:01.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f4404088b80 10 client.0 _ll_register_callbacks cb 0x5555b720cec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:01.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f8b2c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b72fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f8b2c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b72fa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36136/0 (socket says 172.21.15.84:36136) 2023-10-06T02:58:01.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f8b2c700 1 -- 172.21.15.84:0/1591590094 learned_addr learned my addr 172.21.15.84:0/1591590094 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:01.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f932d700 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b728d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43ebfff700 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b728d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f8b2c700 1 -- 172.21.15.84:0/1591590094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 msgr2=0x5555b728d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b728d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f8b2c700 1 -- 172.21.15.84:0/1591590094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 msgr2=0x5555b728d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b728d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f8b2c700 1 -- 172.21.15.84:0/1591590094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555b70342c0 con 0x5555b7249c00 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43f8b2c700 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b72fa0c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f43f0007730 tx=0x7f43f0009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8874a12120569ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.585+0000 7f43d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f43d2ffd700 1 -- 172.21.15.84:0/1591590094 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0022960 con 0x5555b7249c00 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f43d2ffd700 1 -- 172.21.15.84:0/1591590094 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f43f001a050 con 0x5555b7249c00 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f4404088b80 1 -- 172.21.15.84:0/1591590094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43ec013610 con 0x5555b7249c00 2023-10-06T02:58:01.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f43d2ffd700 1 -- 172.21.15.84:0/1591590094 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43f0014e00 con 0x5555b7249c00 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f4404088b80 10 client.6237 fetch_fsmap learned FSMap version 41 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f4404088b80 1 -- 172.21.15.84:0/1591590094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5555b714f4c0 con 0x5555b7249c00 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f43d2ffd700 1 -- 172.21.15.84:0/1591590094 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec013610 con 0x5555b7249c00 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f43d2ffd700 1 -- 172.21.15.84:0/1591590094 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 41) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f43f0026220 con 0x5555b7249c00 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f4404088b80 10 client.6237 fetch_fsmap finished waiting for FSMap version 41 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f4404088b80 10 client.6237 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f4404088b80 20 client.6237 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f4404088b80 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x5555b72abef0 0x5555b72ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f4404088b80 4 client.6237 mds_command: new command op to 5778 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f4404088b80 1 -- 172.21.15.84:0/1591590094 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5555b713ce50 con 0x5555b72abef0 2023-10-06T02:58:01.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f43ebfff700 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x5555b72abef0 0x5555b72ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f43d2ffd700 10 client.6237 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.586+0000 7f43ebfff700 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x5555b72abef0 0x5555b72ac2f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b09c16466c87463a server_cookie=98cd18149e9e1d5a in_seq=0 out_seq=0 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f43d2ffd700 1 -- 172.21.15.84:0/1591590094 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5555b713ce50 con 0x5555b72abef0 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f43d2ffd700 10 client.6237 handle_command_reply: tid=0 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 client.6237 shutdown 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 -- 172.21.15.84:0/1591590094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 msgr2=0x5555b72fa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b72fa0c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f43f0007730 tx=0x7f43f0009070 comp rx=0 tx=0).stop 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 -- 172.21.15.84:0/1591590094 shutdown_connections 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x5555b72abef0 0x5555b72ac2f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555b7293b40 0x5555b728d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5555b7249c00 0x5555b72fa0c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f43d2ffd700 0 client.6237 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:01.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 --2- 172.21.15.84:0/1591590094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5555b7276270 0x5555b728d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 -- 172.21.15.84:0/1591590094 >> 172.21.15.84:0/1591590094 conn(0x5555b724b1b0 msgr2=0x5555b724b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 -- 172.21.15.84:0/1591590094 shutdown_connections 2023-10-06T02:58:01.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 1 -- 172.21.15.84:0/1591590094 wait complete. 2023-10-06T02:58:01.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f4404088b80 20 client.6237 trim_cache size 0 max 16384 2023-10-06T02:58:01.596 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:01.596 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T02:58:01.596 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T02:58:01.596 INFO:teuthology.orchestra.run.smithi084.stdout: "5663f936-413a-4fe6-b290-02fbda602b28": { 2023-10-06T02:58:01.597 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T02:58:01.597 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "5663f936-413a-4fe6-b290-02fbda602b28", 2023-10-06T02:58:01.597 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T02:58:01.597 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:01.597 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:01.597 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:01.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f43fad90700 1 -- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43e0066f30 msgr2=0x7f43e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f43fad90700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43e0066f30 0x7f43e00693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f43f0001920 tx=0x7f43f0006040 comp rx=0 tx=0).stop 2023-10-06T02:58:01.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f43fad90700 1 -- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f4155bb0 msgr2=0x7f43f4156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:01.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f43fad90700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f4155bb0 0x7f43f4156020 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f43f40ce2c0 tx=0x7f43e4019000 comp rx=0 tx=0).stop 2023-10-06T02:58:01.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.587+0000 7f43fad90700 1 -- 172.21.15.84:0/584095092 shutdown_connections 2023-10-06T02:58:01.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.588+0000 7f43fad90700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43e0066f30 0x7f43e00693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.588+0000 7f43fad90700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43f40cc370 0x7f43f40cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.588+0000 7f43fad90700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43dc004810 0x7f43f414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.588+0000 7f43fad90700 1 --2- 172.21.15.84:0/584095092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43f4155bb0 0x7f43f4156020 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:01.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.588+0000 7f43fad90700 1 -- 172.21.15.84:0/584095092 >> 172.21.15.84:0/584095092 conn(0x7f43f40ce330 msgr2=0x7f43f40c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:01.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.588+0000 7f43fad90700 1 -- 172.21.15.84:0/584095092 shutdown_connections 2023-10-06T02:58:01.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:01.588+0000 7f43fad90700 1 -- 172.21.15.84:0/584095092 wait complete. 2023-10-06T02:58:05.264 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T02:58:05.264+0000 7fedc1127700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T02:58:06.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:06.528 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:06.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2023-10-06T02:58:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.725+0000 7feb7d9e7700 1 Processor -- start 2023-10-06T02:58:06.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.725+0000 7feb7d9e7700 1 -- start start 2023-10-06T02:58:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.725+0000 7feb7d9e7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb780b2a90 0x7feb780cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.725+0000 7feb7d9e7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780cb980 0x7feb780ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb7d9e7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb780cbdf0 con 0x7feb780ced90 2023-10-06T02:58:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb7d9e7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb780b2e60 con 0x7feb780b2a90 2023-10-06T02:58:06.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb7d9e7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb780cf5d0 con 0x7feb780cb980 2023-10-06T02:58:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb76ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb780b2a90 0x7feb780cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb76ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb780b2a90 0x7feb780cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41922/0 (socket says 172.21.15.84:41922) 2023-10-06T02:58:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb76ffd700 1 -- 172.21.15.84:0/2861034813 learned_addr learned my addr 172.21.15.84:0/2861034813 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb76ffd700 1 -- 172.21.15.84:0/2861034813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780cb980 msgr2=0x7feb780ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb76ffd700 1 --2- 172.21.15.84:0/2861034813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780cb980 0x7feb780ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb76ffd700 1 -- 172.21.15.84:0/2861034813 >> v1:172.21.15.131:6789/0 conn(0x7feb780ced90 legacy=0x7feb780c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb76ffd700 1 -- 172.21.15.84:0/2861034813 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780cf8b0 con 0x7feb780b2a90 2023-10-06T02:58:06.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb76ffd700 1 --2- 172.21.15.84:0/2861034813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 0x7feb780cb440 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7feb70009f70 tx=0x7feb70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aeaaa735d10ca56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb75ffb700 1 -- 172.21.15.84:0/2861034813 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000e070 con 0x7feb780b2a90 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb75ffb700 1 -- 172.21.15.84:0/2861034813 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000bad0 con 0x7feb780b2a90 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.726+0000 7feb75ffb700 1 -- 172.21.15.84:0/2861034813 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700092e0 con 0x7feb780b2a90 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.727+0000 7feb7d9e7700 1 -- 172.21.15.84:0/2861034813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 msgr2=0x7feb780cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.727+0000 7feb7d9e7700 1 --2- 172.21.15.84:0/2861034813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 0x7feb780cb440 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7feb70009f70 tx=0x7feb70009840 comp rx=0 tx=0).stop 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.727+0000 7feb7d9e7700 1 -- 172.21.15.84:0/2861034813 shutdown_connections 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.727+0000 7feb7d9e7700 1 --2- 172.21.15.84:0/2861034813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 0x7feb780cb440 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.727+0000 7feb7d9e7700 1 --2- 172.21.15.84:0/2861034813 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780cb980 0x7feb780ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.727+0000 7feb7d9e7700 1 -- 172.21.15.84:0/2861034813 >> 172.21.15.84:0/2861034813 conn(0x7feb78099740 msgr2=0x7feb7806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.727+0000 7feb7d9e7700 1 -- 172.21.15.84:0/2861034813 shutdown_connections 2023-10-06T02:58:06.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.727+0000 7feb7d9e7700 1 -- 172.21.15.84:0/2861034813 wait complete. 2023-10-06T02:58:06.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.728+0000 7feb7d9e7700 1 Processor -- start 2023-10-06T02:58:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.728+0000 7feb7d9e7700 1 -- start start 2023-10-06T02:58:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb7d9e7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 0x7feb7815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb7d9e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb780cb980 0x7feb7814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb7d9e7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780ced90 0x7feb780b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb7d9e7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7814e620 con 0x7feb780b2a90 2023-10-06T02:58:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb7d9e7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb781534e0 con 0x7feb780cb980 2023-10-06T02:58:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb7d9e7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7815d5c0 con 0x7feb780ced90 2023-10-06T02:58:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb76ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 0x7feb7815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb76ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 0x7feb7815cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41938/0 (socket says 172.21.15.84:41938) 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb76ffd700 1 -- 172.21.15.84:0/904639668 learned_addr learned my addr 172.21.15.84:0/904639668 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb767fc700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb780cb980 0x7feb7814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb76ffd700 1 -- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780ced90 msgr2=0x7feb780b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb777fe700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780ced90 0x7feb780b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb76ffd700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780ced90 0x7feb780b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb76ffd700 1 -- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb780cb980 msgr2=0x7feb7814e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb76ffd700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb780cb980 0x7feb7814e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb76ffd700 1 -- 172.21.15.84:0/904639668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70009ae0 con 0x7feb780b2a90 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb767fc700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb780cb980 0x7feb7814e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:06.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb777fe700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780ced90 0x7feb780b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.729+0000 7feb76ffd700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 0x7feb7815cfb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7feb7000b770 tx=0x7feb70018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.730+0000 7feb6effd700 1 -- 172.21.15.84:0/904639668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70008c60 con 0x7feb780b2a90 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.730+0000 7feb6effd700 1 -- 172.21.15.84:0/904639668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70008dc0 con 0x7feb780b2a90 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.730+0000 7feb6effd700 1 -- 172.21.15.84:0/904639668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700266b0 con 0x7feb780b2a90 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.730+0000 7feb7d9e7700 1 -- 172.21.15.84:0/904639668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7815d8a0 con 0x7feb780b2a90 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.730+0000 7feb7d9e7700 1 -- 172.21.15.84:0/904639668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb78153a40 con 0x7feb780b2a90 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.731+0000 7feb6effd700 1 -- 172.21.15.84:0/904639668 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb70003040 con 0x7feb780b2a90 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.731+0000 7feb6effd700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb58066f30 0x7feb580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.732+0000 7feb767fc700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb58066f30 0x7feb580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.732+0000 7feb6effd700 1 -- 172.21.15.84:0/904639668 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7feb700866a0 con 0x7feb780b2a90 2023-10-06T02:58:06.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.732+0000 7feb767fc700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb58066f30 0x7feb580693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb60006fd0 tx=0x7feb60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.733+0000 7feb86cdfb80 1 Processor -- start 2023-10-06T02:58:06.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb86cdfb80 1 -- start start 2023-10-06T02:58:06.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b44c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 0x55ca37b94710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b94c50 0x55ca37b950a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca37a9bac0 con 0x55ca37b44890 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca37a992c0 con 0x55ca37b45d10 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca37a950b0 con 0x55ca37b94c50 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb76ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b44c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb76ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b44c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41950/0 (socket says 172.21.15.84:41950) 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.734+0000 7feb76ffd700 1 -- 172.21.15.84:0/1463653221 learned_addr learned my addr 172.21.15.84:0/1463653221 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb76ffd700 1 -- 172.21.15.84:0/1463653221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b94c50 msgr2=0x55ca37b950a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb76ffd700 1 --2- 172.21.15.84:0/1463653221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b94c50 0x55ca37b950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb767fc700 1 --2- 172.21.15.84:0/1463653221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 0x55ca37b94710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb76ffd700 1 -- 172.21.15.84:0/1463653221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 msgr2=0x55ca37b94710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb76ffd700 1 --2- 172.21.15.84:0/1463653221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 0x55ca37b94710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb76ffd700 1 -- 172.21.15.84:0/1463653221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca3792f2c0 con 0x55ca37b44890 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb76ffd700 1 --2- 172.21.15.84:0/1463653221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b44c60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7feb70084920 tx=0x7feb70084880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792f0cea9b377fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb57fff700 1 -- 172.21.15.84:0/1463653221 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000e070 con 0x55ca37b44890 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb57fff700 1 -- 172.21.15.84:0/1463653221 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70057330 con 0x55ca37b44890 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb57fff700 1 -- 172.21.15.84:0/1463653221 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7005a580 con 0x55ca37b44890 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb86cdfb80 1 -- 172.21.15.84:0/1463653221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 msgr2=0x55ca37b44c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.735+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/1463653221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b44c60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7feb70084920 tx=0x7feb70084880 comp rx=0 tx=0).stop 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.736+0000 7feb86cdfb80 1 -- 172.21.15.84:0/1463653221 shutdown_connections 2023-10-06T02:58:06.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.736+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/1463653221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b94c50 0x55ca37b950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.736+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/1463653221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b44c60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.736+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/1463653221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 0x55ca37b94710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.736+0000 7feb86cdfb80 1 -- 172.21.15.84:0/1463653221 >> 172.21.15.84:0/1463653221 conn(0x55ca37b461b0 msgr2=0x55ca37b46580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.736+0000 7feb86cdfb80 1 -- 172.21.15.84:0/1463653221 shutdown_connections 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.736+0000 7feb86cdfb80 1 -- 172.21.15.84:0/1463653221 wait complete. 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.736+0000 7feb86cdfb80 1 -- start start 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.736+0000 7feb86cdfb80 1 Processor -- start 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 0x55ca37b70e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b94c50 0x55ca37b71380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca37a408e0 con 0x55ca37b44890 2023-10-06T02:58:06.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca37a5bef0 con 0x55ca37b45d10 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca37917e80 con 0x55ca37b94c50 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb76ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb86cdfb80 10 client.0 _ll_register_callbacks cb 0x55ca37b07ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb76ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41954/0 (socket says 172.21.15.84:41954) 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb76ffd700 1 -- 172.21.15.84:0/4047984699 learned_addr learned my addr 172.21.15.84:0/4047984699 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb777fe700 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b94c50 0x55ca37b71380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.737+0000 7feb767fc700 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 0x55ca37b70e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb76ffd700 1 -- 172.21.15.84:0/4047984699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b94c50 msgr2=0x55ca37b71380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb76ffd700 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b94c50 0x55ca37b71380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb76ffd700 1 -- 172.21.15.84:0/4047984699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 msgr2=0x55ca37b70e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb76ffd700 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 0x55ca37b70e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb76ffd700 1 -- 172.21.15.84:0/4047984699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb78153a40 con 0x55ca37b44890 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb76ffd700 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7feb70084a00 tx=0x7feb7006f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dab34d92fade0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb557fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb557fa700 1 -- 172.21.15.84:0/4047984699 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700577a0 con 0x55ca37b44890 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb557fa700 1 -- 172.21.15.84:0/4047984699 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7feb70056820 con 0x55ca37b44890 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb86cdfb80 1 -- 172.21.15.84:0/4047984699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca37b39990 con 0x55ca37b44890 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb557fa700 1 -- 172.21.15.84:0/4047984699 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb7005de40 con 0x55ca37b44890 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb86cdfb80 10 client.6249 fetch_fsmap learned FSMap version 44 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb86cdfb80 1 -- 172.21.15.84:0/4047984699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55ca378d2030 con 0x55ca37b44890 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb557fa700 1 -- 172.21.15.84:0/4047984699 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca37b39990 con 0x55ca37b44890 2023-10-06T02:58:06.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb557fa700 1 -- 172.21.15.84:0/4047984699 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 44) v1 ==== 3140+0+0 (secure 0 0 0) 0x7feb70069b80 con 0x55ca37b44890 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb86cdfb80 10 client.6249 fetch_fsmap finished waiting for FSMap version 44 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb86cdfb80 10 client.6249 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb86cdfb80 20 client.6249 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55ca37b86010 0x55ca37b9e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb86cdfb80 4 client.6249 mds_command: new command op to 5778 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb86cdfb80 1 -- 172.21.15.84:0/4047984699 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca37b168c0 con 0x55ca37b86010 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.738+0000 7feb767fc700 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55ca37b86010 0x55ca37b9e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb557fa700 10 client.6249 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb767fc700 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55ca37b86010 0x55ca37b9e230 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ceac059fc49da316 server_cookie=6f0278635a537160 in_seq=0 out_seq=0 2023-10-06T02:58:06.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb557fa700 1 -- 172.21.15.84:0/4047984699 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ca37b168c0 con 0x55ca37b86010 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb557fa700 10 client.6249 handle_command_reply: tid=0 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb86cdfb80 1 client.6249 shutdown 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb86cdfb80 1 -- 172.21.15.84:0/4047984699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 msgr2=0x55ca37b86f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7feb70084a00 tx=0x7feb7006f000 comp rx=0 tx=0).stop 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb86cdfb80 1 -- 172.21.15.84:0/4047984699 shutdown_connections 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55ca37b86010 0x55ca37b9e230 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b94c50 0x55ca37b71380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb557fa700 0 client.6249 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.739+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/4047984699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b45d10 0x55ca37b70e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.740+0000 7feb86cdfb80 1 -- 172.21.15.84:0/4047984699 >> 172.21.15.84:0/4047984699 conn(0x55ca37b461b0 msgr2=0x55ca37b45200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.740+0000 7feb86cdfb80 1 -- 172.21.15.84:0/4047984699 shutdown_connections 2023-10-06T02:58:06.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.740+0000 7feb86cdfb80 1 -- 172.21.15.84:0/4047984699 wait complete. 2023-10-06T02:58:06.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.740+0000 7feb86cdfb80 20 client.6249 trim_cache size 0 max 16384 2023-10-06T02:58:06.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.755+0000 7feb86cdfb80 1 Processor -- start 2023-10-06T02:58:06.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.755+0000 7feb86cdfb80 1 -- start start 2023-10-06T02:58:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 0x55ca37b87fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b94c50 0x55ca37b88510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca37bad6f0 con 0x55ca37b44890 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca37b8a110 con 0x55ca37b94c50 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca37b6e580 con 0x55ca37b45d10 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb76ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb76ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41964/0 (socket says 172.21.15.84:41964) 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb76ffd700 1 -- 172.21.15.84:0/846924108 learned_addr learned my addr 172.21.15.84:0/846924108 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb777fe700 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b94c50 0x55ca37b88510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb767fc700 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 0x55ca37b87fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb76ffd700 1 -- 172.21.15.84:0/846924108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 msgr2=0x55ca37b87fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb76ffd700 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 0x55ca37b87fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb76ffd700 1 -- 172.21.15.84:0/846924108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b94c50 msgr2=0x55ca37b88510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb76ffd700 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b94c50 0x55ca37b88510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.756+0000 7feb76ffd700 1 -- 172.21.15.84:0/846924108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca37a637d0 con 0x55ca37b44890 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb767fc700 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 0x55ca37b87fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb76ffd700 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7feb70056540 tx=0x7feb70071040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f64b80d9d4cbfe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb6cff9700 1 -- 172.21.15.84:0/846924108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70056820 con 0x55ca37b44890 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb6cff9700 1 -- 172.21.15.84:0/846924108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70009480 con 0x55ca37b44890 2023-10-06T02:58:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb6cff9700 1 -- 172.21.15.84:0/846924108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7005c650 con 0x55ca37b44890 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb86cdfb80 1 -- 172.21.15.84:0/846924108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 msgr2=0x55ca37b86f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7feb70056540 tx=0x7feb70071040 comp rx=0 tx=0).stop 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb86cdfb80 1 -- 172.21.15.84:0/846924108 shutdown_connections 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b94c50 0x55ca37b88510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b44890 0x55ca37b86f00 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/846924108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 0x55ca37b87fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb86cdfb80 1 -- 172.21.15.84:0/846924108 >> 172.21.15.84:0/846924108 conn(0x55ca37b461b0 msgr2=0x55ca37b6b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb86cdfb80 1 -- 172.21.15.84:0/846924108 shutdown_connections 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.757+0000 7feb86cdfb80 1 -- 172.21.15.84:0/846924108 wait complete. 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.758+0000 7feb86cdfb80 1 -- start start 2023-10-06T02:58:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.758+0000 7feb86cdfb80 1 Processor -- start 2023-10-06T02:58:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b44890 0x55ca37b8e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 0x55ca37b454a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb86cdfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b94c50 0x55ca37b691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca37b8d9b0 con 0x55ca37b94c50 2023-10-06T02:58:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca37b40e50 con 0x55ca37b44890 2023-10-06T02:58:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb86cdfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca37b86510 con 0x55ca37b45d10 2023-10-06T02:58:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb86cdfb80 10 client.0 _ll_register_callbacks cb 0x55ca37b07ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb777fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b94c50 0x55ca37b691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb777fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b94c50 0x55ca37b691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41976/0 (socket says 172.21.15.84:41976) 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb777fe700 1 -- 172.21.15.84:0/3601785198 learned_addr learned my addr 172.21.15.84:0/3601785198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb76ffd700 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b44890 0x55ca37b8e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb767fc700 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 0x55ca37b454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb777fe700 1 -- 172.21.15.84:0/3601785198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 msgr2=0x55ca37b454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb777fe700 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 0x55ca37b454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb777fe700 1 -- 172.21.15.84:0/3601785198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b44890 msgr2=0x55ca37b8e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb777fe700 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b44890 0x55ca37b8e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb777fe700 1 -- 172.21.15.84:0/3601785198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca378d2030 con 0x55ca37b94c50 2023-10-06T02:58:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb777fe700 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b94c50 0x55ca37b691f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x55ca37b87b80 tx=0x7feb68009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5244995ce4ced0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.759+0000 7feb557fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb557fa700 1 -- 172.21.15.84:0/3601785198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68019070 con 0x55ca37b94c50 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb557fa700 1 -- 172.21.15.84:0/3601785198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7feb68010dd0 con 0x55ca37b94c50 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb86cdfb80 1 -- 172.21.15.84:0/3601785198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb70057330 con 0x55ca37b94c50 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb557fa700 1 -- 172.21.15.84:0/3601785198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb68016be0 con 0x55ca37b94c50 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb86cdfb80 10 client.6255 fetch_fsmap learned FSMap version 44 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb86cdfb80 1 -- 172.21.15.84:0/3601785198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55ca37a4a4c0 con 0x55ca37b94c50 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb557fa700 1 -- 172.21.15.84:0/3601785198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70057330 con 0x55ca37b94c50 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb557fa700 1 -- 172.21.15.84:0/3601785198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 44) v1 ==== 3140+0+0 (secure 0 0 0) 0x7feb6801c020 con 0x55ca37b94c50 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb86cdfb80 10 client.6255 fetch_fsmap finished waiting for FSMap version 44 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb86cdfb80 10 client.6255 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2023-10-06T02:58:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb86cdfb80 20 client.6255 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55ca37b9dcf0 0x55ca37b84930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb86cdfb80 4 client.6255 mds_command: new command op to 5778 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:58:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb86cdfb80 1 -- 172.21.15.84:0/3601785198 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ca37a37e50 con 0x55ca37b9dcf0 2023-10-06T02:58:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb76ffd700 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55ca37b9dcf0 0x55ca37b84930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb557fa700 10 client.6255 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.760+0000 7feb76ffd700 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55ca37b9dcf0 0x55ca37b84930 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78a2daf4b5206dcf server_cookie=a6c7bc2d6b0a65eb in_seq=0 out_seq=0 2023-10-06T02:58:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb557fa700 1 -- 172.21.15.84:0/3601785198 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55ca37a37e50 con 0x55ca37b9dcf0 2023-10-06T02:58:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb557fa700 10 client.6255 handle_command_reply: tid=0 2023-10-06T02:58:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 client.6255 shutdown 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 -- 172.21.15.84:0/3601785198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b94c50 msgr2=0x55ca37b691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b94c50 0x55ca37b691f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x55ca37b87b80 tx=0x7feb68009040 comp rx=0 tx=0).stop 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 -- 172.21.15.84:0/3601785198 shutdown_connections 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55ca37b9dcf0 0x55ca37b84930 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca37b44890 0x55ca37b8e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb557fa700 0 client.6255 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca37b94c50 0x55ca37b691f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 --2- 172.21.15.84:0/3601785198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ca37b45d10 0x55ca37b454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 -- 172.21.15.84:0/3601785198 >> 172.21.15.84:0/3601785198 conn(0x55ca37b461b0 msgr2=0x55ca37b87f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 -- 172.21.15.84:0/3601785198 shutdown_connections 2023-10-06T02:58:06.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 1 -- 172.21.15.84:0/3601785198 wait complete. 2023-10-06T02:58:06.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb86cdfb80 20 client.6255 trim_cache size 0 max 16384 2023-10-06T02:58:06.771 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T02:58:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T02:58:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "5663f936-413a-4fe6-b290-02fbda602b28": { 2023-10-06T02:58:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T02:58:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "5663f936-413a-4fe6-b290-02fbda602b28", 2023-10-06T02:58:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T02:58:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:06.772 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 -- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb58066f30 msgr2=0x7feb580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb58066f30 0x7feb580693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb60006fd0 tx=0x7feb60008040 comp rx=0 tx=0).stop 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 -- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 msgr2=0x7feb7815cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 0x7feb7815cfb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7feb7000b770 tx=0x7feb70018000 comp rx=0 tx=0).stop 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 -- 172.21.15.84:0/904639668 shutdown_connections 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb58066f30 0x7feb580693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb780ced90 0x7feb780b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb780b2a90 0x7feb7815cfb0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 --2- 172.21.15.84:0/904639668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb780cb980 0x7feb7814e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 -- 172.21.15.84:0/904639668 >> 172.21.15.84:0/904639668 conn(0x7feb78099740 msgr2=0x7feb780b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:06.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.761+0000 7feb7d9e7700 1 -- 172.21.15.84:0/904639668 shutdown_connections 2023-10-06T02:58:06.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:06.762+0000 7feb7d9e7700 1 -- 172.21.15.84:0/904639668 wait complete. 2023-10-06T02:58:11.775 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2023-10-06T02:58:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.905+0000 7fdcbf625700 1 Processor -- start 2023-10-06T02:58:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.905+0000 7fdcbf625700 1 -- start start 2023-10-06T02:58:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcbf625700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdcb80b2a90 0x7fdcb80cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcbf625700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb80c6610 0x7fdcb80cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcbf625700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb80cbdf0 con 0x7fdcb80cb980 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcbf625700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb80b2e60 con 0x7fdcb80b2a90 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcbf625700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80cf5d0 con 0x7fdcb80c6610 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcbcbc0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdcb80cb980 0x7fdcb80ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45460/0 (socket says 172.21.15.84:45460) 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcbcbc0700 1 -- 172.21.15.84:0/1929902654 learned_addr learned my addr 172.21.15.84:0/1929902654 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/1929902654 >> v2:172.21.15.131:3300/0 conn(0x7fdcb80b2a90 0x7fdcb80cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb80c6610 0x7fdcb80cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306299567 0 0) 0x7fdcb80cbdf0 con 0x7fdcb80cb980 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdca0003570 con 0x7fdcb80cb980 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2233900932 0 0) 0x7fdca0003570 con 0x7fdcb80cb980 2023-10-06T02:58:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb80c6610 msgr2=0x7fdcb80cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcb7fff700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb80c6610 0x7fdcb80cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 >> v2:172.21.15.131:3300/0 conn(0x7fdcb80b2a90 msgr2=0x7fdcb80cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcb7fff700 1 --2- 172.21.15.84:0/1929902654 >> v2:172.21.15.131:3300/0 conn(0x7fdcb80b2a90 0x7fdcb80cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80cf8b0 con 0x7fdcb80cb980 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.906+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fdcac001470 con 0x7fdcb80cb980 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 >> v1:172.21.15.84:6789/0 conn(0x7fdcb80cb980 legacy=0x7fdcb80ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb80c6610 0x7fdca0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdca0003fe0 0x7fdca0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca0004d50 0x7fdca00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80b2e60 con 0x7fdca0004d50 2023-10-06T02:58:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80cf5d0 con 0x7fdca0003fe0 2023-10-06T02:58:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca000bb40 con 0x7fdcb80c6610 2023-10-06T02:58:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca0004d50 0x7fdca00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb80c6610 0x7fdca0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdca0003fe0 0x7fdca0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcbdbc2700 1 -- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb80c6610 msgr2=0x7fdca0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb80c6610 0x7fdca0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcbdbc2700 1 -- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdca0003fe0 msgr2=0x7fdca0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdca0003fe0 0x7fdca0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcbdbc2700 1 -- 172.21.15.84:0/1929902654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0003570 con 0x7fdca0004d50 2023-10-06T02:58:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca0004d50 0x7fdca00051c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdca8006f00 tx=0x7fdca80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc3ee38d38ac91b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800e710 con 0x7fdca0004d50 2023-10-06T02:58:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca800e870 con 0x7fdca0004d50 2023-10-06T02:58:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.907+0000 7fdcb7fff700 1 -- 172.21.15.84:0/1929902654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800ec30 con 0x7fdca0004d50 2023-10-06T02:58:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.908+0000 7fdcbf625700 1 -- 172.21.15.84:0/1929902654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca0004d50 msgr2=0x7fdca00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.908+0000 7fdcbf625700 1 --2- 172.21.15.84:0/1929902654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdca0004d50 0x7fdca00051c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdca8006f00 tx=0x7fdca80091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.908+0000 7fdcbdbc2700 1 -- 172.21.15.84:0/1929902654 reap_dead start 2023-10-06T02:58:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.908+0000 7fdcbf625700 1 -- 172.21.15.84:0/1929902654 shutdown_connections 2023-10-06T02:58:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.908+0000 7fdcbf625700 1 -- 172.21.15.84:0/1929902654 >> 172.21.15.84:0/1929902654 conn(0x7fdcb8099740 msgr2=0x7fdcb806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.908+0000 7fdcbf625700 1 -- 172.21.15.84:0/1929902654 shutdown_connections 2023-10-06T02:58:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.908+0000 7fdcbf625700 1 -- 172.21.15.84:0/1929902654 wait complete. 2023-10-06T02:58:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.909+0000 7fdcbf625700 1 Processor -- start 2023-10-06T02:58:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.910+0000 7fdcbf625700 1 -- start start 2023-10-06T02:58:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.910+0000 7fdcbf625700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb8157010 0x7fdcb80c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.910+0000 7fdcbf625700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcb8069530 0x7fdcb80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.910+0000 7fdcbf625700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcb80c75a0 0x7fdcb80c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.910+0000 7fdcbf625700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8069ee0 con 0x7fdcb80c75a0 2023-10-06T02:58:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.910+0000 7fdcbf625700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80c7f50 con 0x7fdcb8069530 2023-10-06T02:58:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.910+0000 7fdcbf625700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80c8220 con 0x7fdcb8157010 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbdbc2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcb80c75a0 0x7fdcb80c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbdbc2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcb80c75a0 0x7fdcb80c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41980/0 (socket says 172.21.15.84:41980) 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbdbc2700 1 -- 172.21.15.84:0/792552876 learned_addr learned my addr 172.21.15.84:0/792552876 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb8157010 0x7fdcb80c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcb8069530 0x7fdcb80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbdbc2700 1 -- 172.21.15.84:0/792552876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb8157010 msgr2=0x7fdcb80c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb8157010 0x7fdcb80c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbdbc2700 1 -- 172.21.15.84:0/792552876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcb8069530 msgr2=0x7fdcb80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcb8069530 0x7fdcb80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbdbc2700 1 -- 172.21.15.84:0/792552876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80c8500 con 0x7fdcb80c75a0 2023-10-06T02:58:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcb8069530 0x7fdcb80699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcb80c75a0 0x7fdcb80c7a10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdca000ba90 tx=0x7fdca801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcb57fa700 1 -- 172.21.15.84:0/792552876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8022070 con 0x7fdcb80c75a0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcb57fa700 1 -- 172.21.15.84:0/792552876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca8013e60 con 0x7fdcb80c75a0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbf625700 1 -- 172.21.15.84:0/792552876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb80c87e0 con 0x7fdcb80c75a0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcb57fa700 1 -- 172.21.15.84:0/792552876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca800e710 con 0x7fdcb80c75a0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.911+0000 7fdcbf625700 1 -- 172.21.15.84:0/792552876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb80c8da0 con 0x7fdcb80c75a0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.913+0000 7fdcb57fa700 1 -- 172.21.15.84:0/792552876 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdca801c950 con 0x7fdcb80c75a0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.913+0000 7fdcb57fa700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdca4066f60 0x7fdca4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.913+0000 7fdcb57fa700 1 -- 172.21.15.84:0/792552876 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdca80856f0 con 0x7fdcb80c75a0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.913+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdca4066f60 0x7fdca4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.914+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdca4066f60 0x7fdca4069410 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00094d0 tx=0x7fdcb000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.915+0000 7fdcc891db80 1 Processor -- start 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.915+0000 7fdcc891db80 1 -- start start 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 0x55f52bb41c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb91710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb91c50 0x55f52bb920a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcc891db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52ba98ac0 con 0x55f52bb42d10 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcc891db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52ba962c0 con 0x55f52bb41890 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcc891db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f52ba920b0 con 0x55f52bb91c50 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbcbc0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb91710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbcbc0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb91710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41988/0 (socket says 172.21.15.84:41988) 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbcbc0700 1 -- 172.21.15.84:0/4021190593 learned_addr learned my addr 172.21.15.84:0/4021190593 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/4021190593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 0x55f52bb41c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/4021190593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb91c50 0x55f52bb920a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbcbc0700 1 -- 172.21.15.84:0/4021190593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb91c50 msgr2=0x55f52bb920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/4021190593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb91c50 0x55f52bb920a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbcbc0700 1 -- 172.21.15.84:0/4021190593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 msgr2=0x55f52bb41c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/4021190593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 0x55f52bb41c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbcbc0700 1 -- 172.21.15.84:0/4021190593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f52b92c2c0 con 0x55f52bb42d10 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/4021190593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb91710 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdcac007c00 tx=0x7fdcac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64366d16d1c5954 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdc9e7fc700 1 -- 172.21.15.84:0/4021190593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac007180 con 0x55f52bb42d10 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdc9e7fc700 1 -- 172.21.15.84:0/4021190593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac0072e0 con 0x55f52bb42d10 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.916+0000 7fdc9e7fc700 1 -- 172.21.15.84:0/4021190593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac007680 con 0x55f52bb42d10 2023-10-06T02:58:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.917+0000 7fdcc891db80 1 -- 172.21.15.84:0/4021190593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 msgr2=0x55f52bb91710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.917+0000 7fdcc891db80 1 --2- 172.21.15.84:0/4021190593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb91710 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fdcac007c00 tx=0x7fdcac009040 comp rx=0 tx=0).stop 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.917+0000 7fdcc891db80 1 -- 172.21.15.84:0/4021190593 shutdown_connections 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.917+0000 7fdcc891db80 1 --2- 172.21.15.84:0/4021190593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 0x55f52bb41c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.917+0000 7fdcc891db80 1 --2- 172.21.15.84:0/4021190593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb91c50 0x55f52bb920a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.917+0000 7fdcc891db80 1 --2- 172.21.15.84:0/4021190593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb91710 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.917+0000 7fdcc891db80 1 -- 172.21.15.84:0/4021190593 >> 172.21.15.84:0/4021190593 conn(0x55f52bb431b0 msgr2=0x55f52bb43580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.917+0000 7fdcc891db80 1 -- 172.21.15.84:0/4021190593 shutdown_connections 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.917+0000 7fdcc891db80 1 -- 172.21.15.84:0/4021190593 wait complete. 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.918+0000 7fdcc891db80 1 -- start start 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.918+0000 7fdcc891db80 1 Processor -- start 2023-10-06T02:58:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb41890 0x55f52bb3ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb42d10 0x55f52bb3cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb91c50 0x55f52bb803a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52ba3d8e0 con 0x55f52bb41890 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52ba58ef0 con 0x55f52bb91c50 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f52b914e80 con 0x55f52bb42d10 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 10 client.0 _ll_register_callbacks cb 0x55f52bb04ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbd3c1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb41890 0x55f52bb3ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbd3c1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb41890 0x55f52bb3ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42000/0 (socket says 172.21.15.84:42000) 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbd3c1700 1 -- 172.21.15.84:0/2882276259 learned_addr learned my addr 172.21.15.84:0/2882276259 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb42d10 0x55f52bb3cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb91c50 0x55f52bb803a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbd3c1700 1 -- 172.21.15.84:0/2882276259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb42d10 msgr2=0x55f52bb3cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb42d10 0x55f52bb3cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbd3c1700 1 -- 172.21.15.84:0/2882276259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb91c50 msgr2=0x55f52bb803a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb91c50 0x55f52bb803a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbd3c1700 1 -- 172.21.15.84:0/2882276259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac00f040 con 0x55f52bb41890 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb41890 0x55f52bb3ca60 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00164e0 tx=0x7fdcb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cbbf4d67cb4f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdc977fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdc977fe700 1 -- 172.21.15.84:0/2882276259 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb000e040 con 0x55f52bb41890 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdc977fe700 1 -- 172.21.15.84:0/2882276259 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdcb0016de0 con 0x55f52bb41890 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 1 -- 172.21.15.84:0/2882276259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f52bb36990 con 0x55f52bb41890 2023-10-06T02:58:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdc977fe700 1 -- 172.21.15.84:0/2882276259 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcb0025600 con 0x55f52bb41890 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 10 client.6267 fetch_fsmap learned FSMap version 44 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.919+0000 7fdcc891db80 1 -- 172.21.15.84:0/2882276259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55f52b8cf030 con 0x55f52bb41890 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdc977fe700 1 -- 172.21.15.84:0/2882276259 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f52bb36990 con 0x55f52bb41890 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdc977fe700 1 -- 172.21.15.84:0/2882276259 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 44) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fdcb0024070 con 0x55f52bb41890 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdcc891db80 10 client.6267 fetch_fsmap finished waiting for FSMap version 44 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdcc891db80 10 client.6267 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdcc891db80 20 client.6267 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55f52bb89370 0x55f52bb80dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdcc891db80 4 client.6267 mds_command: new command op to 5778 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdcc891db80 1 -- 172.21.15.84:0/2882276259 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f52bb138c0 con 0x55f52bb89370 2023-10-06T02:58:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55f52bb89370 0x55f52bb80dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdc977fe700 10 client.6267 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.920+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55f52bb89370 0x55f52bb80dd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=17f3160a508c18c1 server_cookie=272767e07b8c93db in_seq=0 out_seq=0 2023-10-06T02:58:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdc977fe700 1 -- 172.21.15.84:0/2882276259 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f52bb138c0 con 0x55f52bb89370 2023-10-06T02:58:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdc977fe700 10 client.6267 handle_command_reply: tid=0 2023-10-06T02:58:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 client.6267 shutdown 2023-10-06T02:58:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 -- 172.21.15.84:0/2882276259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb41890 msgr2=0x55f52bb3ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb41890 0x55f52bb3ca60 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00164e0 tx=0x7fdcb0017000 comp rx=0 tx=0).stop 2023-10-06T02:58:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 -- 172.21.15.84:0/2882276259 shutdown_connections 2023-10-06T02:58:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55f52bb89370 0x55f52bb80dd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb91c50 0x55f52bb803a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdc977fe700 0 client.6267 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb41890 0x55f52bb3ca60 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2882276259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb42d10 0x55f52bb3cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 -- 172.21.15.84:0/2882276259 >> 172.21.15.84:0/2882276259 conn(0x55f52bb431b0 msgr2=0x55f52bb852f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:11.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 -- 172.21.15.84:0/2882276259 shutdown_connections 2023-10-06T02:58:11.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 1 -- 172.21.15.84:0/2882276259 wait complete. 2023-10-06T02:58:11.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.921+0000 7fdcc891db80 20 client.6267 trim_cache size 0 max 16384 2023-10-06T02:58:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.937+0000 7fdcc891db80 1 Processor -- start 2023-10-06T02:58:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.937+0000 7fdcc891db80 1 -- start start 2023-10-06T02:58:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb431b0 0x55f52bb90550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb41890 0x55f52bb43580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcc891db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52bb86e70 con 0x55f52bb431b0 2023-10-06T02:58:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcc891db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52bb8e3a0 con 0x55f52bb42d10 2023-10-06T02:58:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcc891db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f52bb89160 con 0x55f52bb41890 2023-10-06T02:58:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbd3c1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb431b0 0x55f52bb90550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbd3c1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb431b0 0x55f52bb90550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42012/0 (socket says 172.21.15.84:42012) 2023-10-06T02:58:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbd3c1700 1 -- 172.21.15.84:0/1676619559 learned_addr learned my addr 172.21.15.84:0/1676619559 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/1676619559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/1676619559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb41890 0x55f52bb43580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbd3c1700 1 -- 172.21.15.84:0/1676619559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb41890 msgr2=0x55f52bb43580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/1676619559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb41890 0x55f52bb43580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbd3c1700 1 -- 172.21.15.84:0/1676619559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb42d10 msgr2=0x55f52bb43ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/1676619559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbd3c1700 1 -- 172.21.15.84:0/1676619559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f52ba607d0 con 0x55f52bb431b0 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/1676619559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb431b0 0x55f52bb90550 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0003430 tx=0x7fdcb001b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67dd1c4e2b67cb54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdc9effd700 1 -- 172.21.15.84:0/1676619559 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb000e040 con 0x55f52bb431b0 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdc9effd700 1 -- 172.21.15.84:0/1676619559 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb000f040 con 0x55f52bb431b0 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.938+0000 7fdc9effd700 1 -- 172.21.15.84:0/1676619559 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0025600 con 0x55f52bb431b0 2023-10-06T02:58:11.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 -- 172.21.15.84:0/1676619559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb431b0 msgr2=0x55f52bb90550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 --2- 172.21.15.84:0/1676619559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb431b0 0x55f52bb90550 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0003430 tx=0x7fdcb001b030 comp rx=0 tx=0).stop 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 -- 172.21.15.84:0/1676619559 shutdown_connections 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 --2- 172.21.15.84:0/1676619559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 --2- 172.21.15.84:0/1676619559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb431b0 0x55f52bb90550 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 --2- 172.21.15.84:0/1676619559 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb41890 0x55f52bb43580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 -- 172.21.15.84:0/1676619559 >> 172.21.15.84:0/1676619559 conn(0x55f52bb408f0 msgr2=0x55f52bb44cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 -- 172.21.15.84:0/1676619559 shutdown_connections 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 -- 172.21.15.84:0/1676619559 wait complete. 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 -- start start 2023-10-06T02:58:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.939+0000 7fdcc891db80 1 Processor -- start 2023-10-06T02:58:11.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 0x55f52bb43580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcc891db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb431b0 0x55f52bb8c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcc891db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52bb94bd0 con 0x55f52bb42d10 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcc891db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52bb9a6e0 con 0x55f52bb41890 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcc891db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f52bb71a30 con 0x55f52bb431b0 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcc891db80 10 client.0 _ll_register_callbacks cb 0x55f52bb04ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcbcbc0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcbcbc0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42020/0 (socket says 172.21.15.84:42020) 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcbcbc0700 1 -- 172.21.15.84:0/2692558672 learned_addr learned my addr 172.21.15.84:0/2692558672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcbdbc2700 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb431b0 0x55f52bb8c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.940+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 0x55f52bb43580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcbcbc0700 1 -- 172.21.15.84:0/2692558672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb431b0 msgr2=0x55f52bb8c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb431b0 0x55f52bb8c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcbcbc0700 1 -- 172.21.15.84:0/2692558672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 msgr2=0x55f52bb43580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 0x55f52bb43580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcbcbc0700 1 -- 172.21.15.84:0/2692558672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f52b8cf030 con 0x55f52bb42d10 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcbcbc0700 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdcac019040 tx=0x7fdcac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e47c0ce187de62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdc977fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdc977fe700 1 -- 172.21.15.84:0/2692558672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac007180 con 0x55f52bb42d10 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdc977fe700 1 -- 172.21.15.84:0/2692558672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdcac007450 con 0x55f52bb42d10 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcc891db80 1 -- 172.21.15.84:0/2692558672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdcac0072e0 con 0x55f52bb42d10 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdc977fe700 1 -- 172.21.15.84:0/2692558672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcac025600 con 0x55f52bb42d10 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcc891db80 10 client.6273 fetch_fsmap learned FSMap version 44 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcc891db80 1 -- 172.21.15.84:0/2692558672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55f52ba474c0 con 0x55f52bb42d10 2023-10-06T02:58:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdc977fe700 1 -- 172.21.15.84:0/2692558672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac0072e0 con 0x55f52bb42d10 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdc977fe700 1 -- 172.21.15.84:0/2692558672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 44) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fdcac025760 con 0x55f52bb42d10 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcc891db80 10 client.6273 fetch_fsmap finished waiting for FSMap version 44 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcc891db80 10 client.6273 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcc891db80 20 client.6273 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55f52bb91c50 0x55f52bb8c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcc891db80 4 client.6273 mds_command: new command op to 5778 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcc891db80 1 -- 172.21.15.84:0/2692558672 --> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f52ba34e50 con 0x55f52bb91c50 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.941+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55f52bb91c50 0x55f52bb8c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdc977fe700 10 client.6273 ms_handle_connect on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcbd3c1700 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55f52bb91c50 0x55f52bb8c7f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d7b99f685856db6 server_cookie=aa4a9765650b6fb5 in_seq=0 out_seq=0 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdc977fe700 1 -- 172.21.15.84:0/2692558672 <== mds.1 v2:172.21.15.84:6835/4228087397 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f52ba34e50 con 0x55f52bb91c50 2023-10-06T02:58:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdc977fe700 10 client.6273 handle_command_reply: tid=0 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 client.6273 shutdown 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 -- 172.21.15.84:0/2692558672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 msgr2=0x55f52bb43ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdcac019040 tx=0x7fdcac009040 comp rx=0 tx=0).stop 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 -- 172.21.15.84:0/2692558672 shutdown_connections 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.84:6835/4228087397,v1:172.21.15.84:6837/4228087397] conn(0x55f52bb91c50 0x55f52bb8c7f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f52bb41890 0x55f52bb43580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdc977fe700 0 client.6273 ms_handle_reset on v2:172.21.15.84:6835/4228087397 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f52bb431b0 0x55f52bb8c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 --2- 172.21.15.84:0/2692558672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f52bb42d10 0x55f52bb43ac0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 -- 172.21.15.84:0/2692558672 >> 172.21.15.84:0/2692558672 conn(0x55f52bb408f0 msgr2=0x55f52bb44cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:11.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 -- 172.21.15.84:0/2692558672 shutdown_connections 2023-10-06T02:58:11.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 1 -- 172.21.15.84:0/2692558672 wait complete. 2023-10-06T02:58:11.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.942+0000 7fdcc891db80 20 client.6273 trim_cache size 0 max 16384 2023-10-06T02:58:11.951 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:11.951 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2023-10-06T02:58:11.951 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {} 2023-10-06T02:58:11.951 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:11.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 -- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdca4066f60 msgr2=0x7fdca4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdca4066f60 0x7fdca4069410 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00094d0 tx=0x7fdcb000b040 comp rx=0 tx=0).stop 2023-10-06T02:58:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 -- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcb80c75a0 msgr2=0x7fdcb80c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcb80c75a0 0x7fdcb80c7a10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdca000ba90 tx=0x7fdca801a000 comp rx=0 tx=0).stop 2023-10-06T02:58:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 -- 172.21.15.84:0/792552876 shutdown_connections 2023-10-06T02:58:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdca4066f60 0x7fdca4069410 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcb80c75a0 0x7fdcb80c7a10 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcb8157010 0x7fdcb80c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 --2- 172.21.15.84:0/792552876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcb8069530 0x7fdcb80699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:11.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 -- 172.21.15.84:0/792552876 >> 172.21.15.84:0/792552876 conn(0x7fdcb8099740 msgr2=0x7fdcb80d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:11.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 -- 172.21.15.84:0/792552876 shutdown_connections 2023-10-06T02:58:11.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:11.943+0000 7fdcbf625700 1 -- 172.21.15.84:0/792552876 wait complete. 2023-10-06T02:58:11.955 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T02:58:11.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:2 scrub status 2023-10-06T02:58:12.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.070+0000 7f99eb892700 1 Processor -- start 2023-10-06T02:58:12.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.070+0000 7f99eb892700 1 -- start start 2023-10-06T02:58:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99eb892700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e40cbb50 0x7f99e40ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99eb892700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e40b2e60 con 0x7f99e40c6610 2023-10-06T02:58:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99eb892700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e40cf5d0 con 0x7f99e40b2a90 2023-10-06T02:58:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99eb892700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e40cf8b0 con 0x7f99e40cbb50 2023-10-06T02:58:12.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99e8e2d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99e40cbb50 0x7f99e40ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99e9e2f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f99e40c6610 0x7f99e40ced90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45464/0 (socket says 172.21.15.84:45464) 2023-10-06T02:58:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99e9e2f700 1 -- 172.21.15.84:0/661869277 learned_addr learned my addr 172.21.15.84:0/661869277 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99e8e2d700 1 -- 172.21.15.84:0/661869277 >> v1:172.21.15.131:6789/0 conn(0x7f99e40b2a90 legacy=0x7f99e40cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99e8e2d700 1 -- 172.21.15.84:0/661869277 >> v1:172.21.15.84:6789/0 conn(0x7f99e40c6610 legacy=0x7f99e40ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99e8e2d700 1 -- 172.21.15.84:0/661869277 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40cfb90 con 0x7f99e40cbb50 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.071+0000 7f99dbfff700 1 -- 172.21.15.84:0/661869277 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854388989 0 0) 0x7f99e40b2e60 con 0x7f99e40c6610 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.072+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/661869277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40cbb50 0x7f99e40ce850 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f99d40098e0 tx=0x7f99d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb482b215119cd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.072+0000 7f99dbfff700 1 -- 172.21.15.84:0/661869277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4009e80 con 0x7f99e40cbb50 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.072+0000 7f99dbfff700 1 -- 172.21.15.84:0/661869277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d400b820 con 0x7f99e40cbb50 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.072+0000 7f99dbfff700 1 -- 172.21.15.84:0/661869277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d400bba0 con 0x7f99e40cbb50 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.072+0000 7f99eb892700 1 -- 172.21.15.84:0/661869277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40cbb50 msgr2=0x7f99e40ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.072+0000 7f99eb892700 1 --2- 172.21.15.84:0/661869277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40cbb50 0x7f99e40ce850 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f99d40098e0 tx=0x7f99d40091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.072+0000 7f99eb892700 1 -- 172.21.15.84:0/661869277 shutdown_connections 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.072+0000 7f99eb892700 1 --2- 172.21.15.84:0/661869277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40cbb50 0x7f99e40ce850 secure :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f99d40098e0 tx=0x7f99d40091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.072+0000 7f99eb892700 1 -- 172.21.15.84:0/661869277 >> 172.21.15.84:0/661869277 conn(0x7f99e4099740 msgr2=0x7f99e406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.073+0000 7f99eb892700 1 -- 172.21.15.84:0/661869277 shutdown_connections 2023-10-06T02:58:12.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.073+0000 7f99eb892700 1 -- 172.21.15.84:0/661869277 wait complete. 2023-10-06T02:58:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.074+0000 7f99eb892700 1 Processor -- start 2023-10-06T02:58:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.074+0000 7f99eb892700 1 -- start start 2023-10-06T02:58:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.074+0000 7f99eb892700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b2a90 0x7f99e40ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.074+0000 7f99eb892700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99e40c6610 0x7f99e415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99eb892700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99e40ce810 0x7f99e40cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99eb892700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e415dc80 con 0x7f99e40b2a90 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99eb892700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40cf1f0 con 0x7f99e40c6610 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99eb892700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40c9560 con 0x7f99e40ce810 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e962e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b2a90 0x7f99e40ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e962e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b2a90 0x7f99e40ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42030/0 (socket says 172.21.15.84:42030) 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e962e700 1 -- 172.21.15.84:0/1021578400 learned_addr learned my addr 172.21.15.84:0/1021578400 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99e40c6610 0x7f99e415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e9e2f700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99e40ce810 0x7f99e40cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e962e700 1 -- 172.21.15.84:0/1021578400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99e40ce810 msgr2=0x7f99e40cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e962e700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99e40ce810 0x7f99e40cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e962e700 1 -- 172.21.15.84:0/1021578400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99e40c6610 msgr2=0x7f99e415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e962e700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99e40c6610 0x7f99e415de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e962e700 1 -- 172.21.15.84:0/1021578400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d4009420 con 0x7f99e40b2a90 2023-10-06T02:58:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99e962e700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b2a90 0x7f99e40ca180 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c5b0 tx=0x7f99e00020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99d97fa700 1 -- 172.21.15.84:0/1021578400 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0011590 con 0x7f99e40b2a90 2023-10-06T02:58:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99d97fa700 1 -- 172.21.15.84:0/1021578400 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e00116f0 con 0x7f99e40b2a90 2023-10-06T02:58:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99eb892700 1 -- 172.21.15.84:0/1021578400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e416ae40 con 0x7f99e40b2a90 2023-10-06T02:58:12.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99d97fa700 1 -- 172.21.15.84:0/1021578400 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0011a90 con 0x7f99e40b2a90 2023-10-06T02:58:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.075+0000 7f99eb892700 1 -- 172.21.15.84:0/1021578400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e40c8c30 con 0x7f99e40b2a90 2023-10-06T02:58:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.077+0000 7f99d97fa700 1 -- 172.21.15.84:0/1021578400 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99e001c460 con 0x7f99e40b2a90 2023-10-06T02:58:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.077+0000 7f99d97fa700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f99c8066f30 0x7f99c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.077+0000 7f99d97fa700 1 -- 172.21.15.84:0/1021578400 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f99e0084460 con 0x7f99e40b2a90 2023-10-06T02:58:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.077+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f99c8066f30 0x7f99c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.077+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f99c8066f30 0x7f99c80693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f99e4088840 tx=0x7f99d4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.079+0000 7f99f4b8ab80 1 Processor -- start 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.079+0000 7f99f4b8ab80 1 -- start start 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c1fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c20d10 0x5596d3c6f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596d3b76ac0 con 0x5596d3c1f890 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596d3b742c0 con 0x5596d3c6fc50 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596d3b700b0 con 0x5596d3c20d10 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e962e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c1fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e962e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c1fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42040/0 (socket says 172.21.15.84:42040) 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e962e700 1 -- 172.21.15.84:0/2561274565 learned_addr learned my addr 172.21.15.84:0/2561274565 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e962e700 1 -- 172.21.15.84:0/2561274565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c20d10 msgr2=0x5596d3c6f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e962e700 1 --2- 172.21.15.84:0/2561274565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c20d10 0x5596d3c6f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e962e700 1 -- 172.21.15.84:0/2561274565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 msgr2=0x5596d3c700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e9e2f700 1 --2- 172.21.15.84:0/2561274565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e962e700 1 --2- 172.21.15.84:0/2561274565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e962e700 1 -- 172.21.15.84:0/2561274565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596d3a0a2c0 con 0x5596d3c1f890 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e9e2f700 1 --2- 172.21.15.84:0/2561274565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99e962e700 1 --2- 172.21.15.84:0/2561274565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c1fc60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f99e000a040 tx=0x7f99e0082640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d348f60ae9022965 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99ce7fc700 1 -- 172.21.15.84:0/2561274565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0055170 con 0x5596d3c1f890 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99ce7fc700 1 -- 172.21.15.84:0/2561274565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e0058340 con 0x5596d3c1f890 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.080+0000 7f99ce7fc700 1 -- 172.21.15.84:0/2561274565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e005c090 con 0x5596d3c1f890 2023-10-06T02:58:12.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.081+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2561274565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 msgr2=0x5596d3c1fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.081+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2561274565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c1fc60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f99e000a040 tx=0x7f99e0082640 comp rx=0 tx=0).stop 2023-10-06T02:58:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.081+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2561274565 shutdown_connections 2023-10-06T02:58:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.081+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2561274565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.081+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2561274565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c1fc60 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.081+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2561274565 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c20d10 0x5596d3c6f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.081+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2561274565 >> 172.21.15.84:0/2561274565 conn(0x5596d3c211b0 msgr2=0x5596d3c21580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.081+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2561274565 shutdown_connections 2023-10-06T02:58:12.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.081+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2561274565 wait complete. 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.082+0000 7f99f4b8ab80 1 -- start start 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.082+0000 7f99f4b8ab80 1 Processor -- start 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.082+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c20d10 0x5596d3c4ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c6fc50 0x5596d3c4b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596d3b1b8e0 con 0x5596d3c1f890 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596d3b36ef0 con 0x5596d3c20d10 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596d39f2e80 con 0x5596d3c6fc50 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99f4b8ab80 10 client.0 _ll_register_callbacks cb 0x5596d3be2ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e962e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e962e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42048/0 (socket says 172.21.15.84:42048) 2023-10-06T02:58:12.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e962e700 1 -- 172.21.15.84:0/1251314550 learned_addr learned my addr 172.21.15.84:0/1251314550 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e962e700 1 -- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c6fc50 msgr2=0x5596d3c4b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e962e700 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c6fc50 0x5596d3c4b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e962e700 1 -- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c20d10 msgr2=0x5596d3c4ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c20d10 0x5596d3c4ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e962e700 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c20d10 0x5596d3c4ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e962e700 1 -- 172.21.15.84:0/1251314550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e40c8c30 con 0x5596d3c1f890 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99e962e700 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4a830 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f99e0000c00 tx=0x7f99e006c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c886d422758a57a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99c37fe700 1 -- 172.21.15.84:0/1251314550 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0081070 con 0x5596d3c1f890 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99c37fe700 1 -- 172.21.15.84:0/1251314550 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f99e0011c70 con 0x5596d3c1f890 2023-10-06T02:58:12.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/1251314550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596d3c14990 con 0x5596d3c1f890 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99c37fe700 1 -- 172.21.15.84:0/1251314550 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99e00842d0 con 0x5596d3c1f890 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99f4b8ab80 10 client.6288 fetch_fsmap learned FSMap version 44 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/1251314550 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5596d39ad030 con 0x5596d3c1f890 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.083+0000 7f99c37fe700 1 -- 172.21.15.84:0/1251314550 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596d3c14990 con 0x5596d3c1f890 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99c37fe700 1 -- 172.21.15.84:0/1251314550 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 44) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f99e0055350 con 0x5596d3c1f890 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99f4b8ab80 10 client.6288 fetch_fsmap finished waiting for FSMap version 44 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99f4b8ab80 10 client.6288 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.b 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99f4b8ab80 20 client.6288 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5596d3c48d90 0x5596d3c67400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99f4b8ab80 4 client.6288 mds_command: new command op to 5377 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/1251314550 --> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596d3bf18c0 con 0x5596d3c48d90 2023-10-06T02:58:12.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5596d3c48d90 0x5596d3c67400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99c37fe700 10 client.6288 ms_handle_connect on v2:172.21.15.131:6834/802742000 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.084+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5596d3c48d90 0x5596d3c67400 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=386c30e6ac4d14f3 server_cookie=2b24accebd084ebe in_seq=0 out_seq=0 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99c37fe700 1 -- 172.21.15.84:0/1251314550 <== mds.2 v2:172.21.15.131:6834/802742000 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5596d3bf18c0 con 0x5596d3c48d90 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99c37fe700 10 client.6288 handle_command_reply: tid=0 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 client.6288 shutdown 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/1251314550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 msgr2=0x5596d3c4a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4a830 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f99e0000c00 tx=0x7f99e006c000 comp rx=0 tx=0).stop 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/1251314550 shutdown_connections 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5596d3c48d90 0x5596d3c67400 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c6fc50 0x5596d3c4b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4a830 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99c37fe700 0 client.6288 ms_handle_reset on v2:172.21.15.131:6834/802742000 2023-10-06T02:58:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/1251314550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c20d10 0x5596d3c4ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/1251314550 >> 172.21.15.84:0/1251314550 conn(0x5596d3c211b0 msgr2=0x5596d3c635b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/1251314550 shutdown_connections 2023-10-06T02:58:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/1251314550 wait complete. 2023-10-06T02:58:12.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.085+0000 7f99f4b8ab80 20 client.6288 trim_cache size 0 max 16384 2023-10-06T02:58:12.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.101+0000 7f99f4b8ab80 1 Processor -- start 2023-10-06T02:58:12.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.101+0000 7f99f4b8ab80 1 -- start start 2023-10-06T02:58:12.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c20d10 0x5596d3c67400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c67940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596d3c20560 con 0x5596d3c1f890 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596d3bff330 con 0x5596d3c6fc50 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596d3c635b0 con 0x5596d3c20d10 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e962e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e962e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42052/0 (socket says 172.21.15.84:42052) 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e962e700 1 -- 172.21.15.84:0/3072717885 learned_addr learned my addr 172.21.15.84:0/3072717885 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e9e2f700 1 --2- 172.21.15.84:0/3072717885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c67940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/3072717885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c20d10 0x5596d3c67400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e962e700 1 -- 172.21.15.84:0/3072717885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c20d10 msgr2=0x5596d3c67400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e962e700 1 --2- 172.21.15.84:0/3072717885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c20d10 0x5596d3c67400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e962e700 1 -- 172.21.15.84:0/3072717885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 msgr2=0x5596d3c67940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e962e700 1 --2- 172.21.15.84:0/3072717885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c67940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e962e700 1 -- 172.21.15.84:0/3072717885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596d3b3e7d0 con 0x5596d3c1f890 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99e962e700 1 --2- 172.21.15.84:0/3072717885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4bcb0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f99e0054bc0 tx=0x7f99e007d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b2ca19371a865e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99ceffd700 1 -- 172.21.15.84:0/3072717885 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0081040 con 0x5596d3c1f890 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99ceffd700 1 -- 172.21.15.84:0/3072717885 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e00842d0 con 0x5596d3c1f890 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.102+0000 7f99ceffd700 1 -- 172.21.15.84:0/3072717885 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00550f0 con 0x5596d3c1f890 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/3072717885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 msgr2=0x5596d3c4bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/3072717885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4bcb0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f99e0054bc0 tx=0x7f99e007d000 comp rx=0 tx=0).stop 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/3072717885 shutdown_connections 2023-10-06T02:58:12.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/3072717885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c67940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/3072717885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c1f890 0x5596d3c4bcb0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/3072717885 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c20d10 0x5596d3c67400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/3072717885 >> 172.21.15.84:0/3072717885 conn(0x5596d3c211b0 msgr2=0x5596d3c4f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/3072717885 shutdown_connections 2023-10-06T02:58:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/3072717885 wait complete. 2023-10-06T02:58:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.103+0000 7f99f4b8ab80 1 -- start start 2023-10-06T02:58:12.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.104+0000 7f99f4b8ab80 1 Processor -- start 2023-10-06T02:58:12.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.104+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c1f890 0x5596d3ccb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.104+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c20d10 0x5596d3c681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.104+0000 7f99f4b8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c68720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.104+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596d3ccf2c0 con 0x5596d3c20d10 2023-10-06T02:58:12.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.104+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596d3c6d8f0 con 0x5596d3c6fc50 2023-10-06T02:58:12.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.104+0000 7f99f4b8ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596d3c609b0 con 0x5596d3c1f890 2023-10-06T02:58:12.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99f4b8ab80 10 client.0 _ll_register_callbacks cb 0x5596d3be2ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:12.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e8e2d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c20d10 0x5596d3c681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e8e2d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c20d10 0x5596d3c681e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42068/0 (socket says 172.21.15.84:42068) 2023-10-06T02:58:12.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e8e2d700 1 -- 172.21.15.84:0/2524981693 learned_addr learned my addr 172.21.15.84:0/2524981693 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e9e2f700 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c68720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e962e700 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c1f890 0x5596d3ccb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e8e2d700 1 -- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c1f890 msgr2=0x5596d3ccb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c1f890 0x5596d3ccb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e8e2d700 1 -- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 msgr2=0x5596d3c68720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c68720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e8e2d700 1 -- 172.21.15.84:0/2524981693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e40c8c30 con 0x5596d3c20d10 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e962e700 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c1f890 0x5596d3ccb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99e8e2d700 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c20d10 0x5596d3c681e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99d4002000 tx=0x7f99d402a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f67572eb591ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99c37fe700 1 -- 172.21.15.84:0/2524981693 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d402e040 con 0x5596d3c20d10 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99c37fe700 1 -- 172.21.15.84:0/2524981693 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f99d4011800 con 0x5596d3c20d10 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2524981693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99e0058340 con 0x5596d3c20d10 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99c37fe700 1 -- 172.21.15.84:0/2524981693 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99d4021070 con 0x5596d3c20d10 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99f4b8ab80 10 client.6294 fetch_fsmap learned FSMap version 44 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2524981693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5596d3b254c0 con 0x5596d3c20d10 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.105+0000 7f99c37fe700 1 -- 172.21.15.84:0/2524981693 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e0058340 con 0x5596d3c20d10 2023-10-06T02:58:12.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99c37fe700 1 -- 172.21.15.84:0/2524981693 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 44) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f99d4011bd0 con 0x5596d3c20d10 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 10 client.6294 fetch_fsmap finished waiting for FSMap version 44 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 10 client.6294 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.b 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 20 client.6294 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5596d3c603c0 0x5596d3c1c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 4 client.6294 mds_command: new command op to 5377 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2524981693 --> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5596d3b12e50 con 0x5596d3c603c0 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99e962e700 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5596d3c603c0 0x5596d3c1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99e962e700 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5596d3c603c0 0x5596d3c1c100 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5d16edeba49f7bf server_cookie=af1fd02b66bb2fe6 in_seq=0 out_seq=0 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99c37fe700 10 client.6294 ms_handle_connect on v2:172.21.15.131:6834/802742000 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99c37fe700 1 -- 172.21.15.84:0/2524981693 <== mds.2 v2:172.21.15.131:6834/802742000 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5596d3b12e50 con 0x5596d3c603c0 2023-10-06T02:58:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99c37fe700 10 client.6294 handle_command_reply: tid=0 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 1 client.6294 shutdown 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2524981693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c20d10 msgr2=0x5596d3c681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c20d10 0x5596d3c681e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99d4002000 tx=0x7f99d402a040 comp rx=0 tx=0).stop 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2524981693 shutdown_connections 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.106+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:6834/802742000,v1:172.21.15.131:6835/802742000] conn(0x5596d3c603c0 0x5596d3c1c100 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596d3c6fc50 0x5596d3c68720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5596d3c1f890 0x5596d3ccb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99f4b8ab80 1 --2- 172.21.15.84:0/2524981693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596d3c20d10 0x5596d3c681e0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99c37fe700 0 client.6294 ms_handle_reset on v2:172.21.15.131:6834/802742000 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2524981693 >> 172.21.15.84:0/2524981693 conn(0x5596d3c211b0 msgr2=0x5596d3c65980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2524981693 shutdown_connections 2023-10-06T02:58:12.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99f4b8ab80 1 -- 172.21.15.84:0/2524981693 wait complete. 2023-10-06T02:58:12.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99f4b8ab80 20 client.6294 trim_cache size 0 max 16384 2023-10-06T02:58:12.116 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:12.116 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2023-10-06T02:58:12.116 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {} 2023-10-06T02:58:12.116 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:12.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 -- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f99c8066f30 msgr2=0x7f99c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f99c8066f30 0x7f99c80693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f99e4088840 tx=0x7f99d4016000 comp rx=0 tx=0).stop 2023-10-06T02:58:12.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 -- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b2a90 msgr2=0x7f99e40ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b2a90 0x7f99e40ca180 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c5b0 tx=0x7f99e00020e0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 -- 172.21.15.84:0/1021578400 shutdown_connections 2023-10-06T02:58:12.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f99c8066f30 0x7f99c80693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99e40ce810 0x7f99e40cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99e40b2a90 0x7f99e40ca180 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 --2- 172.21.15.84:0/1021578400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99e40c6610 0x7f99e415de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 -- 172.21.15.84:0/1021578400 >> 172.21.15.84:0/1021578400 conn(0x7f99e4099740 msgr2=0x7f99e4069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 -- 172.21.15.84:0/1021578400 shutdown_connections 2023-10-06T02:58:12.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.107+0000 7f99eb892700 1 -- 172.21.15.84:0/1021578400 wait complete. 2023-10-06T02:58:12.119 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T02:58:12.119 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-10-06T02:58:12.123 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T02:58:12.122+0000 7fedc1127700 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T02:58:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.234+0000 7f8b6c731700 1 Processor -- start 2023-10-06T02:58:12.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.234+0000 7f8b6c731700 1 -- start start 2023-10-06T02:58:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.235+0000 7f8b6c731700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b640cbb50 0x7f8b640ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.235+0000 7f8b6c731700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8b640c6610 0x7f8b640ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.235+0000 7f8b6c731700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b640b2e60 con 0x7f8b640b2a90 2023-10-06T02:58:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.235+0000 7f8b6c731700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b640cf5d0 con 0x7f8b640cbb50 2023-10-06T02:58:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.235+0000 7f8b6c731700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b640cf8b0 con 0x7f8b640c6610 2023-10-06T02:58:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.235+0000 7f8b69ccc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b640cbb50 0x7f8b640ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.235+0000 7f8b69ccc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b640cbb50 0x7f8b640ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42078/0 (socket says 172.21.15.84:42078) 2023-10-06T02:58:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.235+0000 7f8b69ccc700 1 -- 172.21.15.84:0/1238544544 learned_addr learned my addr 172.21.15.84:0/1238544544 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.235+0000 7f8b6acce700 1 --2- 172.21.15.84:0/1238544544 >> v2:172.21.15.131:3300/0 conn(0x7f8b640c6610 0x7f8b640ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b69ccc700 1 -- 172.21.15.84:0/1238544544 >> v2:172.21.15.131:3300/0 conn(0x7f8b640c6610 msgr2=0x7f8b640ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/1238544544 >> v2:172.21.15.131:3300/0 conn(0x7f8b640c6610 0x7f8b640ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b69ccc700 1 -- 172.21.15.84:0/1238544544 >> v1:172.21.15.131:6789/0 conn(0x7f8b640b2a90 legacy=0x7f8b640cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b69ccc700 1 -- 172.21.15.84:0/1238544544 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640cfb90 con 0x7f8b640cbb50 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/1238544544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 0x7f8b640ce850 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8b640c7250 tx=0x7f8b54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8512b7c28b73f9c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b694cb700 1 -- 172.21.15.84:0/1238544544 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400b860 con 0x7f8b640cbb50 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b694cb700 1 -- 172.21.15.84:0/1238544544 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5400b9c0 con 0x7f8b640cbb50 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b694cb700 1 -- 172.21.15.84:0/1238544544 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400bd60 con 0x7f8b640cbb50 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b6c731700 1 -- 172.21.15.84:0/1238544544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 msgr2=0x7f8b640ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.236+0000 7f8b6c731700 1 --2- 172.21.15.84:0/1238544544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 0x7f8b640ce850 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8b640c7250 tx=0x7f8b54009250 comp rx=0 tx=0).stop 2023-10-06T02:58:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.237+0000 7f8b6c731700 1 -- 172.21.15.84:0/1238544544 shutdown_connections 2023-10-06T02:58:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.237+0000 7f8b6c731700 1 --2- 172.21.15.84:0/1238544544 >> v2:172.21.15.131:3300/0 conn(0x7f8b640c6610 0x7f8b640ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.237+0000 7f8b6c731700 1 --2- 172.21.15.84:0/1238544544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 0x7f8b640ce850 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.237+0000 7f8b6c731700 1 -- 172.21.15.84:0/1238544544 >> 172.21.15.84:0/1238544544 conn(0x7f8b64099740 msgr2=0x7f8b6406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.237+0000 7f8b6c731700 1 -- 172.21.15.84:0/1238544544 shutdown_connections 2023-10-06T02:58:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.237+0000 7f8b6c731700 1 -- 172.21.15.84:0/1238544544 wait complete. 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.238+0000 7f8b6c731700 1 Processor -- start 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.238+0000 7f8b6c731700 1 -- start start 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.238+0000 7f8b6c731700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b640b2a90 0x7f8b64169710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.238+0000 7f8b6c731700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b640c6610 0x7f8b6409a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.238+0000 7f8b6c731700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 0x7f8b6409d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.238+0000 7f8b6c731700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6409c690 con 0x7f8b640cbb50 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.238+0000 7f8b6c731700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6409cef0 con 0x7f8b640c6610 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.238+0000 7f8b6c731700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6415ddd0 con 0x7f8b640b2a90 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6acce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 0x7f8b6409d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6acce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 0x7f8b6409d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42092/0 (socket says 172.21.15.84:42092) 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6acce700 1 -- 172.21.15.84:0/3529488163 learned_addr learned my addr 172.21.15.84:0/3529488163 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b640c6610 0x7f8b6409a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b640b2a90 0x7f8b64169710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6acce700 1 -- 172.21.15.84:0/3529488163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b640b2a90 msgr2=0x7f8b64169710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6acce700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b640b2a90 0x7f8b64169710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6acce700 1 -- 172.21.15.84:0/3529488163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b640c6610 msgr2=0x7f8b6409a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6acce700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b640c6610 0x7f8b6409a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6acce700 1 -- 172.21.15.84:0/3529488163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b540094f0 con 0x7f8b640cbb50 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b640b2a90 0x7f8b64169710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6acce700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 0x7f8b6409d380 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00d890 tx=0x7f8b5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b5a7fc700 1 -- 172.21.15.84:0/3529488163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c0125f0 con 0x7f8b640cbb50 2023-10-06T02:58:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b5a7fc700 1 -- 172.21.15.84:0/3529488163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c012770 con 0x7f8b640cbb50 2023-10-06T02:58:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6c731700 1 -- 172.21.15.84:0/3529488163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6409c8a0 con 0x7f8b640cbb50 2023-10-06T02:58:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b5a7fc700 1 -- 172.21.15.84:0/3529488163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c012b30 con 0x7f8b640cbb50 2023-10-06T02:58:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.239+0000 7f8b6c731700 1 -- 172.21.15.84:0/3529488163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b641582b0 con 0x7f8b640cbb50 2023-10-06T02:58:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.241+0000 7f8b5a7fc700 1 -- 172.21.15.84:0/3529488163 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b5c01e460 con 0x7f8b640cbb50 2023-10-06T02:58:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.241+0000 7f8b5a7fc700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b48066f30 0x7f8b480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.241+0000 7f8b5a7fc700 1 -- 172.21.15.84:0/3529488163 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8b5c084e60 con 0x7f8b640cbb50 2023-10-06T02:58:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.241+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b48066f30 0x7f8b480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.242+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b48066f30 0x7f8b480693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000e310 tx=0x7f8b60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.243+0000 7f8b75a29b80 1 Processor -- start 2023-10-06T02:58:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.243+0000 7f8b75a29b80 1 -- start start 2023-10-06T02:58:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566243890 0x564566243c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x564566293710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566293c50 0x5645662940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456619aac0 con 0x564566244d10 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645661982c0 con 0x564566243890 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645661940b0 con 0x564566293c50 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b69ccc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x564566293710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b69ccc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x564566293710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42104/0 (socket says 172.21.15.84:42104) 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b69ccc700 1 -- 172.21.15.84:0/563803604 learned_addr learned my addr 172.21.15.84:0/563803604 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b69ccc700 1 -- 172.21.15.84:0/563803604 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566293c50 msgr2=0x5645662940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/563803604 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566293c50 0x5645662940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b69ccc700 1 -- 172.21.15.84:0/563803604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566243890 msgr2=0x564566243c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/563803604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566243890 0x564566243c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b69ccc700 1 -- 172.21.15.84:0/563803604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56456602e2c0 con 0x564566244d10 2023-10-06T02:58:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.244+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/563803604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x564566293710 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8b54006fd0 tx=0x7f8b54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444755c3bd8321a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b477fe700 1 -- 172.21.15.84:0/563803604 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54021070 con 0x564566244d10 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b477fe700 1 -- 172.21.15.84:0/563803604 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5400bb30 con 0x564566244d10 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b477fe700 1 -- 172.21.15.84:0/563803604 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54011630 con 0x564566244d10 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b75a29b80 1 -- 172.21.15.84:0/563803604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 msgr2=0x564566293710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/563803604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x564566293710 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8b54006fd0 tx=0x7f8b54017000 comp rx=0 tx=0).stop 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b75a29b80 1 -- 172.21.15.84:0/563803604 shutdown_connections 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/563803604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566243890 0x564566243c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/563803604 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566293c50 0x5645662940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/563803604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x564566293710 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b75a29b80 1 -- 172.21.15.84:0/563803604 >> 172.21.15.84:0/563803604 conn(0x5645662451b0 msgr2=0x564566245580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b75a29b80 1 -- 172.21.15.84:0/563803604 shutdown_connections 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.245+0000 7f8b75a29b80 1 -- 172.21.15.84:0/563803604 wait complete. 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.246+0000 7f8b75a29b80 1 -- start start 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.246+0000 7f8b75a29b80 1 Processor -- start 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 0x564566283950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x56456629bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566293c50 0x56456629c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456613f8e0 con 0x564566244d10 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456615aef0 con 0x564566293c50 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564566016e80 con 0x564566243890 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b75a29b80 10 client.0 _ll_register_callbacks cb 0x564566206ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b69ccc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x56456629bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b69ccc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x56456629bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42110/0 (socket says 172.21.15.84:42110) 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b69ccc700 1 -- 172.21.15.84:0/594136613 learned_addr learned my addr 172.21.15.84:0/594136613 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 0x564566283950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b6acce700 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566293c50 0x56456629c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b69ccc700 1 -- 172.21.15.84:0/594136613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 msgr2=0x564566283950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 0x564566283950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b69ccc700 1 -- 172.21.15.84:0/594136613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566293c50 msgr2=0x56456629c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566293c50 0x56456629c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b69ccc700 1 -- 172.21.15.84:0/594136613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b640cfb90 con 0x564566244d10 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x56456629bfd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8b5401e000 tx=0x7f8b54021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25974157445a4e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b44ff9700 1 -- 172.21.15.84:0/594136613 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b540119e0 con 0x564566244d10 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b44ff9700 1 -- 172.21.15.84:0/594136613 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8b54011b40 con 0x564566244d10 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.247+0000 7f8b75a29b80 1 -- 172.21.15.84:0/594136613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564566238990 con 0x564566244d10 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b44ff9700 1 -- 172.21.15.84:0/594136613 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b54030460 con 0x564566244d10 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b75a29b80 10 client.6306 fetch_fsmap learned FSMap version 44 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b75a29b80 1 -- 172.21.15.84:0/594136613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x564565fd1030 con 0x564566244d10 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b44ff9700 1 -- 172.21.15.84:0/594136613 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564566238990 con 0x564566244d10 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b44ff9700 1 -- 172.21.15.84:0/594136613 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 44) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f8b5402c070 con 0x564566244d10 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b75a29b80 10 client.6306 fetch_fsmap finished waiting for FSMap version 44 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b75a29b80 10 client.6306 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:58:12.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b75a29b80 20 client.6306 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x564566299eb0 0x56456629a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b75a29b80 4 client.6306 mds_command: new command op to 5781 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b75a29b80 1 -- 172.21.15.84:0/594136613 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645662158c0 con 0x564566299eb0 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x564566299eb0 0x56456629a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b44ff9700 10 client.6306 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.248+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x564566299eb0 0x56456629a2b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c6c7cda1ba4bc server_cookie=6bec5ca225bb63c6 in_seq=0 out_seq=0 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b44ff9700 1 -- 172.21.15.84:0/594136613 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5645662158c0 con 0x564566299eb0 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b44ff9700 10 client.6306 handle_command_reply: tid=0 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 client.6306 shutdown 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 -- 172.21.15.84:0/594136613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 msgr2=0x56456629bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x56456629bfd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8b5401e000 tx=0x7f8b54021000 comp rx=0 tx=0).stop 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 -- 172.21.15.84:0/594136613 shutdown_connections 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x564566299eb0 0x56456629a2b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566293c50 0x56456629c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 0x564566283950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/594136613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566244d10 0x56456629bfd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b44ff9700 0 client.6306 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 -- 172.21.15.84:0/594136613 >> 172.21.15.84:0/594136613 conn(0x5645662451b0 msgr2=0x564566244200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 -- 172.21.15.84:0/594136613 shutdown_connections 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 1 -- 172.21.15.84:0/594136613 wait complete. 2023-10-06T02:58:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.249+0000 7f8b75a29b80 20 client.6306 trim_cache size 0 max 16384 2023-10-06T02:58:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.265+0000 7f8b75a29b80 1 Processor -- start 2023-10-06T02:58:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.265+0000 7f8b75a29b80 1 -- start start 2023-10-06T02:58:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 0x564566292eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566244d10 0x564566286b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x564566287060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564566299930 con 0x564566293c50 2023-10-06T02:58:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564566223330 con 0x564566244d10 2023-10-06T02:58:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56456623c2d0 con 0x564566243890 2023-10-06T02:58:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6acce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x564566287060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6acce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x564566287060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42114/0 (socket says 172.21.15.84:42114) 2023-10-06T02:58:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6acce700 1 -- 172.21.15.84:0/2824491305 learned_addr learned my addr 172.21.15.84:0/2824491305 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 0x564566292eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566244d10 0x564566286b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6acce700 1 -- 172.21.15.84:0/2824491305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 msgr2=0x564566292eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6acce700 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 0x564566292eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6acce700 1 -- 172.21.15.84:0/2824491305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566244d10 msgr2=0x564566286b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6acce700 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566244d10 0x564566286b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6acce700 1 -- 172.21.15.84:0/2824491305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645661627d0 con 0x564566293c50 2023-10-06T02:58:12.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 0x564566292eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:12.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b6acce700 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x564566287060 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00df30 tx=0x7f8b5c082fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdc5353165743ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b47fff700 1 -- 172.21.15.84:0/2824491305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c055820 con 0x564566293c50 2023-10-06T02:58:12.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b47fff700 1 -- 172.21.15.84:0/2824491305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c055a50 con 0x564566293c50 2023-10-06T02:58:12.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.266+0000 7f8b47fff700 1 -- 172.21.15.84:0/2824491305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c058ca0 con 0x564566293c50 2023-10-06T02:58:12.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2824491305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 msgr2=0x564566287060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x564566287060 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00df30 tx=0x7f8b5c082fa0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2824491305 shutdown_connections 2023-10-06T02:58:12.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x564566287060 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566243890 0x564566292eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2824491305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566244d10 0x564566286b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2824491305 >> 172.21.15.84:0/2824491305 conn(0x5645662451b0 msgr2=0x564566244200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2824491305 shutdown_connections 2023-10-06T02:58:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2824491305 wait complete. 2023-10-06T02:58:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 -- start start 2023-10-06T02:58:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.267+0000 7f8b75a29b80 1 Processor -- start 2023-10-06T02:58:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566243890 0x564566286b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566244d10 0x564566287060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b75a29b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x5645662973c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456628d6f0 con 0x564566293c50 2023-10-06T02:58:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564566294020 con 0x564566243890 2023-10-06T02:58:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b75a29b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564566299150 con 0x564566244d10 2023-10-06T02:58:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b75a29b80 10 client.0 _ll_register_callbacks cb 0x564566206ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b6acce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x5645662973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b6acce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x5645662973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42122/0 (socket says 172.21.15.84:42122) 2023-10-06T02:58:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.268+0000 7f8b6acce700 1 -- 172.21.15.84:0/2759041688 learned_addr learned my addr 172.21.15.84:0/2759041688 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566243890 0x564566286b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566244d10 0x564566287060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b6acce700 1 -- 172.21.15.84:0/2759041688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566244d10 msgr2=0x564566287060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b6acce700 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566244d10 0x564566287060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b6acce700 1 -- 172.21.15.84:0/2759041688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566243890 msgr2=0x564566286b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b6acce700 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566243890 0x564566286b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b6acce700 1 -- 172.21.15.84:0/2759041688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b641582b0 con 0x564566293c50 2023-10-06T02:58:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b69ccc700 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566244d10 0x564566287060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b6acce700 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x5645662973c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c055750 tx=0x7f8b5c06f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8980302659a889 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b44ff9700 1 -- 172.21.15.84:0/2759041688 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c055cb0 con 0x564566293c50 2023-10-06T02:58:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b44ff9700 1 -- 172.21.15.84:0/2759041688 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8b5c055e10 con 0x564566293c50 2023-10-06T02:58:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2759041688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b5400bb30 con 0x564566293c50 2023-10-06T02:58:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b44ff9700 1 -- 172.21.15.84:0/2759041688 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b5c055150 con 0x564566293c50 2023-10-06T02:58:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b75a29b80 10 client.6312 fetch_fsmap learned FSMap version 44 2023-10-06T02:58:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2759041688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5645661494c0 con 0x564566293c50 2023-10-06T02:58:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b44ff9700 1 -- 172.21.15.84:0/2759041688 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c068020 con 0x564566293c50 2023-10-06T02:58:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b44ff9700 1 -- 172.21.15.84:0/2759041688 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 44) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f8b5c06b070 con 0x564566293c50 2023-10-06T02:58:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b75a29b80 10 client.6312 fetch_fsmap finished waiting for FSMap version 44 2023-10-06T02:58:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b75a29b80 10 client.6312 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-10-06T02:58:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b75a29b80 20 client.6312 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x564566283120 0x564566297900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b75a29b80 4 client.6312 mds_command: new command op to 5781 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:58:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.269+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2759041688 --> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564566136e50 con 0x564566283120 2023-10-06T02:58:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x564566283120 0x564566297900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b44ff9700 10 client.6312 ms_handle_connect on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b6a4cd700 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x564566283120 0x564566297900 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cf5b9571ce0bfbf server_cookie=c4bcb08f6ce790a0 in_seq=0 out_seq=0 2023-10-06T02:58:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b44ff9700 1 -- 172.21.15.84:0/2759041688 <== mds.0 v2:172.21.15.84:6834/1444717080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564566136e50 con 0x564566283120 2023-10-06T02:58:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b44ff9700 10 client.6312 handle_command_reply: tid=0 2023-10-06T02:58:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 client.6312 shutdown 2023-10-06T02:58:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2759041688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 msgr2=0x5645662973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x5645662973c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c055750 tx=0x7f8b5c06f000 comp rx=0 tx=0).stop 2023-10-06T02:58:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2759041688 shutdown_connections 2023-10-06T02:58:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.84:6834/1444717080,v1:172.21.15.84:6836/1444717080] conn(0x564566283120 0x564566297900 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564566243890 0x564566286b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b44ff9700 0 client.6312 ms_handle_reset on v2:172.21.15.84:6834/1444717080 2023-10-06T02:58:12.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564566293c50 0x5645662973c0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 --2- 172.21.15.84:0/2759041688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564566244d10 0x564566287060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2759041688 >> 172.21.15.84:0/2759041688 conn(0x5645662451b0 msgr2=0x564566283800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2759041688 shutdown_connections 2023-10-06T02:58:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 1 -- 172.21.15.84:0/2759041688 wait complete. 2023-10-06T02:58:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.270+0000 7f8b75a29b80 20 client.6312 trim_cache size 0 max 16384 2023-10-06T02:58:12.286 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:12.286 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2023-10-06T02:58:12.286 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {} 2023-10-06T02:58:12.286 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 -- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b48066f30 msgr2=0x7f8b480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b48066f30 0x7f8b480693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000e310 tx=0x7f8b60009040 comp rx=0 tx=0).stop 2023-10-06T02:58:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 -- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 msgr2=0x7f8b6409d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 0x7f8b6409d380 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00d890 tx=0x7f8b5c008040 comp rx=0 tx=0).stop 2023-10-06T02:58:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 -- 172.21.15.84:0/3529488163 shutdown_connections 2023-10-06T02:58:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b48066f30 0x7f8b480693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b640cbb50 0x7f8b6409d380 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b640b2a90 0x7f8b64169710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 --2- 172.21.15.84:0/3529488163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b640c6610 0x7f8b6409a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 -- 172.21.15.84:0/3529488163 >> 172.21.15.84:0/3529488163 conn(0x7f8b64099740 msgr2=0x7f8b641590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 -- 172.21.15.84:0/3529488163 shutdown_connections 2023-10-06T02:58:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.271+0000 7f8b6c731700 1 -- 172.21.15.84:0/3529488163 wait complete. 2023-10-06T02:58:12.289 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T02:58:12.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:12.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.441+0000 7feff687c700 1 Processor -- start 2023-10-06T02:58:12.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.441+0000 7feff687c700 1 -- start start 2023-10-06T02:58:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.442+0000 7feff687c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00cbc70 0x7feff00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.442+0000 7feff687c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff00cb7e0 con 0x7feff00b2140 2023-10-06T02:58:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.442+0000 7feff687c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff00b08a0 con 0x7feff0159480 2023-10-06T02:58:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.442+0000 7feff687c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff00cb190 con 0x7feff00cbc70 2023-10-06T02:58:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.442+0000 7feff607b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feff00b2140 0x7feff00b25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54448/0 (socket says 172.21.15.84:54448) 2023-10-06T02:58:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.442+0000 7feff607b700 1 -- 172.21.15.84:0/2393659847 learned_addr learned my addr 172.21.15.84:0/2393659847 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.442+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728729673 0 0) 0x7feff00cb7e0 con 0x7feff00b2140 2023-10-06T02:58:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.442+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefdc003570 con 0x7feff00b2140 2023-10-06T02:58:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.442+0000 7feff5079700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00cbc70 0x7feff00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 538318052 0 0) 0x7fefdc003570 con 0x7feff00b2140 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00cbc70 msgr2=0x7feff00cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00cbc70 0x7feff00cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 >> v1:172.21.15.131:6789/0 conn(0x7feff0159480 legacy=0x7feff00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00cb470 con 0x7feff00b2140 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fefe80017f0 con 0x7feff00b2140 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 >> v1:172.21.15.84:6789/0 conn(0x7feff00b2140 legacy=0x7feff00b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00cbc70 0x7fefdc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7fefdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefdc004d50 0x7fefdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00cb190 con 0x7fefdc004010 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc00bbf0 con 0x7fefdc004d50 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc00bdb0 con 0x7feff00cbc70 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff5079700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7fefdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff587a700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00cbc70 0x7fefdc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff607b700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefdc004d50 0x7fefdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff5079700 1 -- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00cbc70 msgr2=0x7fefdc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff5079700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00cbc70 0x7fefdc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff5079700 1 -- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefdc004d50 msgr2=0x7fefdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff5079700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefdc004d50 0x7fefdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff5079700 1 -- 172.21.15.84:0/2393659847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc003570 con 0x7fefdc004010 2023-10-06T02:58:12.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff607b700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefdc004d50 0x7fefdc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff587a700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00cbc70 0x7fefdc003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff5079700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7fefdc004810 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006f00 tx=0x7fefe00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ce1c309e025207 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000e710 con 0x7fefdc004010 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe000e870 con 0x7fefdc004010 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.443+0000 7feff4878700 1 -- 172.21.15.84:0/2393659847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000ec30 con 0x7fefdc004010 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.444+0000 7feff687c700 1 -- 172.21.15.84:0/2393659847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 msgr2=0x7fefdc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.444+0000 7feff687c700 1 --2- 172.21.15.84:0/2393659847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7fefdc004810 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006f00 tx=0x7fefe00091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.444+0000 7feff607b700 1 -- 172.21.15.84:0/2393659847 reap_dead start 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.444+0000 7feff687c700 1 -- 172.21.15.84:0/2393659847 shutdown_connections 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.444+0000 7feff687c700 1 -- 172.21.15.84:0/2393659847 >> 172.21.15.84:0/2393659847 conn(0x7feff006ed20 msgr2=0x7feff006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.444+0000 7feff687c700 1 -- 172.21.15.84:0/2393659847 shutdown_connections 2023-10-06T02:58:12.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.444+0000 7feff687c700 1 -- 172.21.15.84:0/2393659847 wait complete. 2023-10-06T02:58:12.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.445+0000 7feff687c700 1 Processor -- start 2023-10-06T02:58:12.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.445+0000 7feff687c700 1 -- start start 2023-10-06T02:58:12.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff687c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7feff0154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff687c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff015c680 0x7feff00afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff687c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00c91b0 0x7feff00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff687c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00c81a0 con 0x7fefdc004010 2023-10-06T02:58:12.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff687c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00c9b90 con 0x7feff015c680 2023-10-06T02:58:12.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff687c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff0154da0 con 0x7feff00c91b0 2023-10-06T02:58:12.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff587a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7feff0154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff587a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7feff0154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53900/0 (socket says 172.21.15.84:53900) 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff587a700 1 -- 172.21.15.84:0/1349718573 learned_addr learned my addr 172.21.15.84:0/1349718573 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff5079700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff015c680 0x7feff00afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff607b700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00c91b0 0x7feff00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff587a700 1 -- 172.21.15.84:0/1349718573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00c91b0 msgr2=0x7feff00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff587a700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00c91b0 0x7feff00c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff587a700 1 -- 172.21.15.84:0/1349718573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff015c680 msgr2=0x7feff00afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff587a700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff015c680 0x7feff00afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff587a700 1 -- 172.21.15.84:0/1349718573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00b0530 con 0x7fefdc004010 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7feff587a700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7feff0154860 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fefec00e840 tx=0x7fefec009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.446+0000 7fefe5ffb700 1 -- 172.21.15.84:0/1349718573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec010520 con 0x7fefdc004010 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.447+0000 7fefe5ffb700 1 -- 172.21.15.84:0/1349718573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefec010680 con 0x7fefdc004010 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.447+0000 7fefe5ffb700 1 -- 172.21.15.84:0/1349718573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec010a40 con 0x7fefdc004010 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.447+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff00c8390 con 0x7fefdc004010 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.447+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff00c8950 con 0x7fefdc004010 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.448+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff005f270 con 0x7fefdc004010 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.448+0000 7fefe5ffb700 1 -- 172.21.15.84:0/1349718573 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefec014480 con 0x7fefdc004010 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.448+0000 7fefe5ffb700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefd4066f60 0x7fefd4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.448+0000 7fefe5ffb700 1 -- 172.21.15.84:0/1349718573 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fefec084110 con 0x7fefdc004010 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.448+0000 7feff5079700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefd4066f60 0x7fefd4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.449+0000 7feff5079700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefd4066f60 0x7fefd4069410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fefe00091e0 tx=0x7fefe001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.452+0000 7fefe5ffb700 1 -- 172.21.15.84:0/1349718573 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefec04d5a0 con 0x7fefdc004010 2023-10-06T02:58:12.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.676+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feff0159850 con 0x7fefdc004010 2023-10-06T02:58:12.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.676+0000 7fefe5ffb700 1 -- 172.21.15.84:0/1349718573 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4637 (secure 0 0 0) 0x7fefec051190 con 0x7fefdc004010 2023-10-06T02:58:12.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:12.677 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:58:06.271875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:58:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefd4066f60 msgr2=0x7fefd4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefd4066f60 0x7fefd4069410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fefe00091e0 tx=0x7fefe001a000 comp rx=0 tx=0).stop 2023-10-06T02:58:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 msgr2=0x7feff0154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7feff0154860 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fefec00e840 tx=0x7fefec009040 comp rx=0 tx=0).stop 2023-10-06T02:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 shutdown_connections 2023-10-06T02:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefd4066f60 0x7fefd4069410 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feff00c91b0 0x7feff00c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefdc004010 0x7feff0154860 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 --2- 172.21.15.84:0/1349718573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feff015c680 0x7feff00afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 >> 172.21.15.84:0/1349718573 conn(0x7feff006ed20 msgr2=0x7feff0155590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 shutdown_connections 2023-10-06T02:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.679+0000 7feff687c700 1 -- 172.21.15.84:0/1349718573 wait complete. 2023-10-06T02:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 44 2023-10-06T02:58:12.691 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T02:58:12.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:58:12.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.804+0000 7f1b0746a700 1 Processor -- start 2023-10-06T02:58:12.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.804+0000 7f1b0746a700 1 -- start start 2023-10-06T02:58:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b0746a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1b001595a0 0x7f1b000aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b0746a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b07a0 0x7f1b000b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b0746a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b000b0ca0 con 0x7f1b000b49e0 2023-10-06T02:58:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b0746a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b000b0f80 con 0x7f1b001595a0 2023-10-06T02:58:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b0746a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000b1260 con 0x7f1b000b07a0 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b04a05700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1b000b49e0 0x7f1b000aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54452/0 (socket says 172.21.15.84:54452) 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b04a05700 1 -- 172.21.15.84:0/716757857 learned_addr learned my addr 172.21.15.84:0/716757857 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709709308 0 0) 0x7f1b000b0ca0 con 0x7f1b000b49e0 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aec003570 con 0x7f1b000b49e0 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b05206700 1 --2- 172.21.15.84:0/716757857 >> v2:172.21.15.131:3300/0 conn(0x7f1b001595a0 0x7f1b000aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b05a07700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b07a0 0x7f1b000b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1195154420 0 0) 0x7f1aec003570 con 0x7f1b000b49e0 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b07a0 msgr2=0x7f1b000b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1af7fff700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b07a0 0x7f1b000b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 >> v2:172.21.15.131:3300/0 conn(0x7f1b001595a0 msgr2=0x7f1b000aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1af7fff700 1 --2- 172.21.15.84:0/716757857 >> v2:172.21.15.131:3300/0 conn(0x7f1b001595a0 0x7f1b000aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000b1540 con 0x7f1b000b49e0 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f1af0001470 con 0x7f1b000b49e0 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.805+0000 7f1b05a07700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b07a0 0x7f1b000b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 >> v1:172.21.15.84:6789/0 conn(0x7f1b000b49e0 legacy=0x7f1b000aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec003a60 0x7f1aec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b07a0 0x7f1aec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1aec004d50 0x7f1aec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000b0f80 con 0x7f1aec003a60 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000b1260 con 0x7f1aec004d50 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec00bb60 con 0x7f1b000b07a0 2023-10-06T02:58:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b05206700 1 --2- 172.21.15.84:0/716757857 >> v2:172.21.15.131:3300/0 conn(0x7f1b001595a0 0x7f1b000aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b05206700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec003a60 0x7f1aec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b04a05700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b07a0 0x7f1aec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b05a07700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1aec004d50 0x7f1aec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b05206700 1 -- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b07a0 msgr2=0x7f1aec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b05206700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b07a0 0x7f1aec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b05206700 1 -- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1aec004d50 msgr2=0x7f1aec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b05206700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1aec004d50 0x7f1aec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b05206700 1 -- 172.21.15.84:0/716757857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec003570 con 0x7f1aec003a60 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1b05206700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec003a60 0x7f1aec003e70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009ba0 tx=0x7f1afc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5a52bdc076a6d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc00c070 con 0x7f1aec003a60 2023-10-06T02:58:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc005a00 con 0x7f1aec003a60 2023-10-06T02:58:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.806+0000 7f1af7fff700 1 -- 172.21.15.84:0/716757857 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0094e0 con 0x7f1aec003a60 2023-10-06T02:58:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.807+0000 7f1b0746a700 1 -- 172.21.15.84:0/716757857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec003a60 msgr2=0x7f1aec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.807+0000 7f1b0746a700 1 --2- 172.21.15.84:0/716757857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec003a60 0x7f1aec003e70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009ba0 tx=0x7f1afc008040 comp rx=0 tx=0).stop 2023-10-06T02:58:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.807+0000 7f1b05a07700 1 -- 172.21.15.84:0/716757857 reap_dead start 2023-10-06T02:58:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.807+0000 7f1b0746a700 1 -- 172.21.15.84:0/716757857 shutdown_connections 2023-10-06T02:58:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.807+0000 7f1b0746a700 1 -- 172.21.15.84:0/716757857 >> 172.21.15.84:0/716757857 conn(0x7f1b00099830 msgr2=0x7f1b0006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:12.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.807+0000 7f1b0746a700 1 -- 172.21.15.84:0/716757857 shutdown_connections 2023-10-06T02:58:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.807+0000 7f1b0746a700 1 -- 172.21.15.84:0/716757857 wait complete. 2023-10-06T02:58:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.808+0000 7f1b0746a700 1 Processor -- start 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.808+0000 7f1b0746a700 1 -- start start 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b0746a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1aec003a60 0x7f1b00157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b0746a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b0009b300 0x7f1b000cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b0746a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000ac5f0 0x7f1b0015a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b0746a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0009c3a0 con 0x7f1b0009b300 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b0746a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0009b790 con 0x7f1aec003a60 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b0746a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0009ba70 con 0x7f1b000ac5f0 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b04a05700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b0009b300 0x7f1b000cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b04a05700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b0009b300 0x7f1b000cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53916/0 (socket says 172.21.15.84:53916) 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b04a05700 1 -- 172.21.15.84:0/1543399148 learned_addr learned my addr 172.21.15.84:0/1543399148 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:12.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b05206700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1aec003a60 0x7f1b00157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b05a07700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000ac5f0 0x7f1b0015a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b04a05700 1 -- 172.21.15.84:0/1543399148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000ac5f0 msgr2=0x7f1b0015a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b04a05700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000ac5f0 0x7f1b0015a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b04a05700 1 -- 172.21.15.84:0/1543399148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1aec003a60 msgr2=0x7f1b00157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b04a05700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1aec003a60 0x7f1b00157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b04a05700 1 -- 172.21.15.84:0/1543399148 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0009bd50 con 0x7f1b0009b300 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.809+0000 7f1b04a05700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b0009b300 0x7f1b000cc770 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1af00073c0 tx=0x7f1af0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.810+0000 7f1af57fa700 1 -- 172.21.15.84:0/1543399148 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0018030 con 0x7f1b0009b300 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.810+0000 7f1af57fa700 1 -- 172.21.15.84:0/1543399148 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af000f850 con 0x7f1b0009b300 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.810+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0009c030 con 0x7f1b0009b300 2023-10-06T02:58:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.810+0000 7f1af57fa700 1 -- 172.21.15.84:0/1543399148 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af000fc30 con 0x7f1b0009b300 2023-10-06T02:58:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.810+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b000cccb0 con 0x7f1b0009b300 2023-10-06T02:58:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.811+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b00064ad0 con 0x7f1b0009b300 2023-10-06T02:58:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.811+0000 7f1af57fa700 1 -- 172.21.15.84:0/1543399148 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1af001b070 con 0x7f1b0009b300 2023-10-06T02:58:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.811+0000 7f1af57fa700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ae4066f30 0x7f1ae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.811+0000 7f1af57fa700 1 -- 172.21.15.84:0/1543399148 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1af0019070 con 0x7f1b0009b300 2023-10-06T02:58:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.811+0000 7f1b05206700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ae4066f30 0x7f1ae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:12.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.812+0000 7f1b05206700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ae4066f30 0x7f1ae40693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0092e0 tx=0x7f1afc01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:12.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:12.816+0000 7f1af57fa700 1 -- 172.21.15.84:0/1543399148 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1af00516f0 con 0x7f1b0009b300 2023-10-06T02:58:13.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.077+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1b0009c4e0 con 0x7f1b0009b300 2023-10-06T02:58:13.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.077+0000 7f1af57fa700 1 -- 172.21.15.84:0/1543399148 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1967 (secure 0 0 0) 0x7f1af0054d10 con 0x7f1b0009b300 2023-10-06T02:58:13.078 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:13.078 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":210,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2442276864,"bytes_avail":770651836416,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":44,"id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"b","status":"up:active","gid":5377},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":5778},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5781}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-10-06T02:58:07.841848+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:58:13.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ae4066f30 msgr2=0x7f1ae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:13.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ae4066f30 0x7f1ae40693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0092e0 tx=0x7f1afc01a000 comp rx=0 tx=0).stop 2023-10-06T02:58:13.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b0009b300 msgr2=0x7f1b000cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:13.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b0009b300 0x7f1b000cc770 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1af00073c0 tx=0x7f1af0001e50 comp rx=0 tx=0).stop 2023-10-06T02:58:13.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 shutdown_connections 2023-10-06T02:58:13.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ae4066f30 0x7f1ae40693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:13.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1aec003a60 0x7f1b00157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:13.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000ac5f0 0x7f1b0015a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:13.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 --2- 172.21.15.84:0/1543399148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b0009b300 0x7f1b000cc770 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:13.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 >> 172.21.15.84:0/1543399148 conn(0x7f1b00099830 msgr2=0x7f1b000cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:13.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.079+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 shutdown_connections 2023-10-06T02:58:13.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:13.080+0000 7f1b0746a700 1 -- 172.21.15.84:0/1543399148 wait complete. 2023-10-06T02:58:13.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'b': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2023-10-06T02:58:14.093 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.210+0000 7fdb5e70a700 1 Processor -- start 2023-10-06T02:58:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.210+0000 7fdb5e70a700 1 -- start start 2023-10-06T02:58:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5e70a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb581595a0 0x7fdb580aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5e70a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdb580b07a0 0x7fdb580b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5e70a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580b0ca0 con 0x7fdb580b49e0 2023-10-06T02:58:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5e70a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb580b0f80 con 0x7fdb580b07a0 2023-10-06T02:58:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5e70a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580b1260 con 0x7fdb581595a0 2023-10-06T02:58:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5cca7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdb580b07a0 0x7fdb580b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb57fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb581595a0 0x7fdb580aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb577fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fdb580b49e0 0x7fdb580aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:42982/0 (socket says 172.21.15.84:42982) 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5cca7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdb580b07a0 0x7fdb580b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:54358/0 (socket says 172.21.15.84:54358) 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb577fe700 1 -- 172.21.15.84:0/2513965396 learned_addr learned my addr 172.21.15.84:0/2513965396 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5cca7700 1 -- 172.21.15.84:0/2513965396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb581595a0 msgr2=0x7fdb580aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5cca7700 1 --2- 172.21.15.84:0/2513965396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb581595a0 0x7fdb580aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5cca7700 1 -- 172.21.15.84:0/2513965396 >> v1:172.21.15.131:6789/0 conn(0x7fdb580b49e0 legacy=0x7fdb580aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb5cca7700 1 -- 172.21.15.84:0/2513965396 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580b1540 con 0x7fdb580b07a0 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.211+0000 7fdb57fff700 1 --2- 172.21.15.84:0/2513965396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb581595a0 0x7fdb580aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb5cca7700 1 --2- 172.21.15.84:0/2513965396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b07a0 0x7fdb580b1c00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009e60 tx=0x7fdb50009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b17da92d1be7b142 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb56ffd700 1 -- 172.21.15.84:0/2513965396 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000e070 con 0x7fdb580b07a0 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb56ffd700 1 -- 172.21.15.84:0/2513965396 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5000bb60 con 0x7fdb580b07a0 2023-10-06T02:58:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb56ffd700 1 -- 172.21.15.84:0/2513965396 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50012430 con 0x7fdb580b07a0 2023-10-06T02:58:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb5e70a700 1 -- 172.21.15.84:0/2513965396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b07a0 msgr2=0x7fdb580b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb5e70a700 1 --2- 172.21.15.84:0/2513965396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b07a0 0x7fdb580b1c00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009e60 tx=0x7fdb50009780 comp rx=0 tx=0).stop 2023-10-06T02:58:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb5e70a700 1 -- 172.21.15.84:0/2513965396 shutdown_connections 2023-10-06T02:58:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb5e70a700 1 --2- 172.21.15.84:0/2513965396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b07a0 0x7fdb580b1c00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb5e70a700 1 --2- 172.21.15.84:0/2513965396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb581595a0 0x7fdb580aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb5e70a700 1 -- 172.21.15.84:0/2513965396 >> 172.21.15.84:0/2513965396 conn(0x7fdb58099830 msgr2=0x7fdb5806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb5e70a700 1 -- 172.21.15.84:0/2513965396 shutdown_connections 2023-10-06T02:58:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.212+0000 7fdb5e70a700 1 -- 172.21.15.84:0/2513965396 wait complete. 2023-10-06T02:58:14.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.213+0000 7fdb5e70a700 1 Processor -- start 2023-10-06T02:58:14.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5e70a700 1 -- start start 2023-10-06T02:58:14.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5e70a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb580b07a0 0x7fdb5816a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5e70a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b49e0 0x7fdb5816a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5e70a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb581595a0 0x7fdb5816c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5e70a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5816a640 con 0x7fdb581595a0 2023-10-06T02:58:14.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5e70a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5816adf0 con 0x7fdb580b49e0 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5e70a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580ac7b0 con 0x7fdb580b07a0 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5cca7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb581595a0 0x7fdb5816c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5cca7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb581595a0 0x7fdb5816c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53932/0 (socket says 172.21.15.84:53932) 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.214+0000 7fdb5cca7700 1 -- 172.21.15.84:0/3265321168 learned_addr learned my addr 172.21.15.84:0/3265321168 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb57fff700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb580b07a0 0x7fdb5816a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb577fe700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b49e0 0x7fdb5816a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb5cca7700 1 -- 172.21.15.84:0/3265321168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb580b07a0 msgr2=0x7fdb5816a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb5cca7700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb580b07a0 0x7fdb5816a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb5cca7700 1 -- 172.21.15.84:0/3265321168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b49e0 msgr2=0x7fdb5816a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb5cca7700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b49e0 0x7fdb5816a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb5cca7700 1 -- 172.21.15.84:0/3265321168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480093c0 con 0x7fdb581595a0 2023-10-06T02:58:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb577fe700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b49e0 0x7fdb5816a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb5cca7700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb581595a0 0x7fdb5816c480 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdb58067c60 tx=0x7fdb50019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb3ffff700 1 -- 172.21.15.84:0/3265321168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50027470 con 0x7fdb581595a0 2023-10-06T02:58:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb3ffff700 1 -- 172.21.15.84:0/3265321168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500275f0 con 0x7fdb581595a0 2023-10-06T02:58:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb3ffff700 1 -- 172.21.15.84:0/3265321168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500279b0 con 0x7fdb581595a0 2023-10-06T02:58:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb50009a20 con 0x7fdb581595a0 2023-10-06T02:58:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.215+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb580acd70 con 0x7fdb581595a0 2023-10-06T02:58:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.216+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb58064ad0 con 0x7fdb581595a0 2023-10-06T02:58:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.216+0000 7fdb3ffff700 1 -- 172.21.15.84:0/3265321168 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb50024070 con 0x7fdb581595a0 2023-10-06T02:58:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.217+0000 7fdb3ffff700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdb44066f30 0x7fdb440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.217+0000 7fdb3ffff700 1 -- 172.21.15.84:0/3265321168 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdb50087290 con 0x7fdb581595a0 2023-10-06T02:58:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.217+0000 7fdb57fff700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdb44066f30 0x7fdb440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.217+0000 7fdb57fff700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdb44066f30 0x7fdb440693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009390 tx=0x7fdb48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:14.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.221+0000 7fdb3ffff700 1 -- 172.21.15.84:0/3265321168 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb50054260 con 0x7fdb581595a0 2023-10-06T02:58:14.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.448+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb5806a200 con 0x7fdb581595a0 2023-10-06T02:58:14.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.448+0000 7fdb3ffff700 1 -- 172.21.15.84:0/3265321168 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4637 (secure 0 0 0) 0x7fdb50057880 con 0x7fdb581595a0 2023-10-06T02:58:14.449 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:14.449 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:58:06.271875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:58:14.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdb44066f30 msgr2=0x7fdb440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdb44066f30 0x7fdb440693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009390 tx=0x7fdb48008040 comp rx=0 tx=0).stop 2023-10-06T02:58:14.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb581595a0 msgr2=0x7fdb5816c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb581595a0 0x7fdb5816c480 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdb58067c60 tx=0x7fdb50019000 comp rx=0 tx=0).stop 2023-10-06T02:58:14.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 shutdown_connections 2023-10-06T02:58:14.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdb44066f30 0x7fdb440693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb581595a0 0x7fdb5816c480 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb580b07a0 0x7fdb5816a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 --2- 172.21.15.84:0/3265321168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb580b49e0 0x7fdb5816a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 >> 172.21.15.84:0/3265321168 conn(0x7fdb58099830 msgr2=0x7fdb580b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:14.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 shutdown_connections 2023-10-06T02:58:14.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.450+0000 7fdb5e70a700 1 -- 172.21.15.84:0/3265321168 wait complete. 2023-10-06T02:58:14.452 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 44 2023-10-06T02:58:14.462 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T02:58:14.462 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:58:14.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.574+0000 7f8b76b09700 1 Processor -- start 2023-10-06T02:58:14.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.574+0000 7f8b76b09700 1 -- start start 2023-10-06T02:58:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.575+0000 7f8b76b09700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b701595a0 0x7f8b700aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.575+0000 7f8b76b09700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b700b49e0 0x7f8b700aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.575+0000 7f8b76b09700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b700b0ca0 con 0x7f8b700b07a0 2023-10-06T02:58:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.575+0000 7f8b76b09700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b700b0f80 con 0x7f8b701595a0 2023-10-06T02:58:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.575+0000 7f8b76b09700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b700b1260 con 0x7f8b700b49e0 2023-10-06T02:58:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.575+0000 7f8b748a5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b701595a0 0x7f8b700aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.575+0000 7f8b750a6700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8b700b07a0 0x7f8b700b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54466/0 (socket says 172.21.15.84:54466) 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.575+0000 7f8b750a6700 1 -- 172.21.15.84:0/2080776718 learned_addr learned my addr 172.21.15.84:0/2080776718 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b748a5700 1 -- 172.21.15.84:0/2080776718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b700b49e0 msgr2=0x7f8b700aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b6ffff700 1 --2- 172.21.15.84:0/2080776718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b700b49e0 0x7f8b700aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b748a5700 1 --2- 172.21.15.84:0/2080776718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b700b49e0 0x7f8b700aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b748a5700 1 -- 172.21.15.84:0/2080776718 >> v1:172.21.15.84:6789/0 conn(0x7f8b700b07a0 legacy=0x7f8b700b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b748a5700 1 -- 172.21.15.84:0/2080776718 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b700b1540 con 0x7f8b701595a0 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b6f7fe700 1 -- 172.21.15.84:0/2080776718 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341174260 0 0) 0x7f8b700b0ca0 con 0x7f8b700b07a0 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b6ffff700 1 --2- 172.21.15.84:0/2080776718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b700b49e0 0x7f8b700aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b748a5700 1 --2- 172.21.15.84:0/2080776718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b701595a0 0x7f8b700aa570 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009eb0 tx=0x7f8b60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3b7165fe36ab2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b6f7fe700 1 -- 172.21.15.84:0/2080776718 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000e070 con 0x7f8b701595a0 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b6f7fe700 1 -- 172.21.15.84:0/2080776718 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6000bc30 con 0x7f8b701595a0 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b6f7fe700 1 -- 172.21.15.84:0/2080776718 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60012430 con 0x7f8b701595a0 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b76b09700 1 -- 172.21.15.84:0/2080776718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b701595a0 msgr2=0x7f8b700aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b76b09700 1 --2- 172.21.15.84:0/2080776718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b701595a0 0x7f8b700aa570 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009eb0 tx=0x7f8b60009780 comp rx=0 tx=0).stop 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b76b09700 1 -- 172.21.15.84:0/2080776718 shutdown_connections 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b76b09700 1 --2- 172.21.15.84:0/2080776718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b701595a0 0x7f8b700aa570 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b76b09700 1 --2- 172.21.15.84:0/2080776718 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b700b49e0 0x7f8b700aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b76b09700 1 -- 172.21.15.84:0/2080776718 >> 172.21.15.84:0/2080776718 conn(0x7f8b70099830 msgr2=0x7f8b7006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b76b09700 1 -- 172.21.15.84:0/2080776718 shutdown_connections 2023-10-06T02:58:14.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.576+0000 7f8b76b09700 1 -- 172.21.15.84:0/2080776718 wait complete. 2023-10-06T02:58:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.577+0000 7f8b76b09700 1 Processor -- start 2023-10-06T02:58:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.578+0000 7f8b76b09700 1 -- start start 2023-10-06T02:58:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.578+0000 7f8b76b09700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b700b07a0 0x7f8b7014aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.578+0000 7f8b76b09700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b700b49e0 0x7f8b7015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.578+0000 7f8b76b09700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b701595a0 0x7f8b7015c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.578+0000 7f8b76b09700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7015a7d0 con 0x7f8b700b49e0 2023-10-06T02:58:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.578+0000 7f8b76b09700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7009ddd0 con 0x7f8b700b07a0 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.578+0000 7f8b76b09700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7015a340 con 0x7f8b701595a0 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b700b49e0 0x7f8b7015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b700b49e0 0x7f8b7015bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53938/0 (socket says 172.21.15.84:53938) 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b748a5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b700b07a0 0x7f8b7014aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6ffff700 1 -- 172.21.15.84:0/1004428358 learned_addr learned my addr 172.21.15.84:0/1004428358 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b750a6700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b701595a0 0x7f8b7015c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6ffff700 1 -- 172.21.15.84:0/1004428358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b701595a0 msgr2=0x7f8b7015c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6ffff700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b701595a0 0x7f8b7015c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6ffff700 1 -- 172.21.15.84:0/1004428358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b700b07a0 msgr2=0x7f8b7014aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6ffff700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b700b07a0 0x7f8b7014aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6ffff700 1 -- 172.21.15.84:0/1004428358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60009a20 con 0x7f8b700b49e0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6ffff700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b700b49e0 0x7f8b7015bb20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400c860 tx=0x7f8b64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6cff9700 1 -- 172.21.15.84:0/1004428358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64011600 con 0x7f8b700b49e0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6cff9700 1 -- 172.21.15.84:0/1004428358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b64011760 con 0x7f8b700b49e0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7015c700 con 0x7f8b700b49e0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b6cff9700 1 -- 172.21.15.84:0/1004428358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64011b20 con 0x7f8b700b49e0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.579+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b70159cf0 con 0x7f8b700b49e0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.580+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b70064ad0 con 0x7f8b700b49e0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.580+0000 7f8b6cff9700 1 -- 172.21.15.84:0/1004428358 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b640193b0 con 0x7f8b700b49e0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.581+0000 7f8b6cff9700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b5c066f30 0x7f8b5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.581+0000 7f8b6cff9700 1 -- 172.21.15.84:0/1004428358 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8b64084780 con 0x7f8b700b49e0 2023-10-06T02:58:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.581+0000 7f8b748a5700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b5c066f30 0x7f8b5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.581+0000 7f8b748a5700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b5c066f30 0x7f8b5c0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009eb0 tx=0x7f8b60017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.585+0000 7f8b6cff9700 1 -- 172.21.15.84:0/1004428358 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b64051750 con 0x7f8b700b49e0 2023-10-06T02:58:14.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.841+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8b7015a480 con 0x7f8b700b49e0 2023-10-06T02:58:14.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.841+0000 7f8b6cff9700 1 -- 172.21.15.84:0/1004428358 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1921 (secure 0 0 0) 0x7f8b64054d70 con 0x7f8b700b49e0 2023-10-06T02:58:14.842 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:14.842 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":212,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2442276864,"bytes_avail":770651836416,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":44,"id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"b","status":"up:active","gid":5377},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":5778},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5781}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-10-06T02:58:13.843385+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:58:14.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b5c066f30 msgr2=0x7f8b5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b5c066f30 0x7f8b5c0693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009eb0 tx=0x7f8b60017000 comp rx=0 tx=0).stop 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b700b49e0 msgr2=0x7f8b7015bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b700b49e0 0x7f8b7015bb20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400c860 tx=0x7f8b64008040 comp rx=0 tx=0).stop 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 shutdown_connections 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8b5c066f30 0x7f8b5c0693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b700b07a0 0x7f8b7014aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b701595a0 0x7f8b7015c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 --2- 172.21.15.84:0/1004428358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b700b49e0 0x7f8b7015bb20 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.843+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 >> 172.21.15.84:0/1004428358 conn(0x7f8b70099830 msgr2=0x7f8b700d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.844+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 shutdown_connections 2023-10-06T02:58:14.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:14.844+0000 7f8b76b09700 1 -- 172.21.15.84:0/1004428358 wait complete. 2023-10-06T02:58:14.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2023-10-06T02:58:15.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:15.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.976+0000 7fc0194cb700 1 Processor -- start 2023-10-06T02:58:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.976+0000 7fc0194cb700 1 -- start start 2023-10-06T02:58:15.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc0194cb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc014159480 0x7fc0140b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:15.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc0194cb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 0x7fc0140cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:15.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc0194cb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc0140cc1b0 0x7fc0140b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:15.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc0194cb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140cb7e0 con 0x7fc014159480 2023-10-06T02:58:15.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc0194cb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140b08a0 con 0x7fc0140cc1b0 2023-10-06T02:58:15.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc0194cb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140cb190 con 0x7fc0140b3610 2023-10-06T02:58:15.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc013fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc014159480 0x7fc0140b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc013fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc014159480 0x7fc0140b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53954/0 (socket says 172.21.15.84:53954) 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc013fff700 1 -- 172.21.15.84:0/2563835032 learned_addr learned my addr 172.21.15.84:0/2563835032 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc0137fe700 1 --2- 172.21.15.84:0/2563835032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 0x7fc0140cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc018cca700 1 --2- 172.21.15.84:0/2563835032 >> v2:172.21.15.131:3300/0 conn(0x7fc0140cc1b0 0x7fc0140b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc013fff700 1 -- 172.21.15.84:0/2563835032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 msgr2=0x7fc0140cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc013fff700 1 --2- 172.21.15.84:0/2563835032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 0x7fc0140cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc013fff700 1 -- 172.21.15.84:0/2563835032 >> v2:172.21.15.131:3300/0 conn(0x7fc0140cc1b0 msgr2=0x7fc0140b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc013fff700 1 --2- 172.21.15.84:0/2563835032 >> v2:172.21.15.131:3300/0 conn(0x7fc0140cc1b0 0x7fc0140b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc013fff700 1 -- 172.21.15.84:0/2563835032 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140cb470 con 0x7fc014159480 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc018cca700 1 --2- 172.21.15.84:0/2563835032 >> v2:172.21.15.131:3300/0 conn(0x7fc0140cc1b0 0x7fc0140b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.977+0000 7fc013fff700 1 --2- 172.21.15.84:0/2563835032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 0x7fc0140b30d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc01415cf30 tx=0x7fc008009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6518d164eebeaa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:15.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc012ffd700 1 -- 172.21.15.84:0/2563835032 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008009e70 con 0x7fc014159480 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc012ffd700 1 -- 172.21.15.84:0/2563835032 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00800b860 con 0x7fc014159480 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc012ffd700 1 -- 172.21.15.84:0/2563835032 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800bc00 con 0x7fc014159480 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc0194cb700 1 -- 172.21.15.84:0/2563835032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 msgr2=0x7fc0140b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc0194cb700 1 --2- 172.21.15.84:0/2563835032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 0x7fc0140b30d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc01415cf30 tx=0x7fc008009250 comp rx=0 tx=0).stop 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc0194cb700 1 -- 172.21.15.84:0/2563835032 shutdown_connections 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc0194cb700 1 --2- 172.21.15.84:0/2563835032 >> v2:172.21.15.131:3300/0 conn(0x7fc0140cc1b0 0x7fc0140b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc0194cb700 1 --2- 172.21.15.84:0/2563835032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 0x7fc0140b30d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc0194cb700 1 --2- 172.21.15.84:0/2563835032 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 0x7fc0140cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc0194cb700 1 -- 172.21.15.84:0/2563835032 >> 172.21.15.84:0/2563835032 conn(0x7fc01406ed20 msgr2=0x7fc01406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc0194cb700 1 -- 172.21.15.84:0/2563835032 shutdown_connections 2023-10-06T02:58:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.978+0000 7fc0194cb700 1 -- 172.21.15.84:0/2563835032 wait complete. 2023-10-06T02:58:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.979+0000 7fc0194cb700 1 Processor -- start 2023-10-06T02:58:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.979+0000 7fc0194cb700 1 -- start start 2023-10-06T02:58:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc0194cb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 0x7fc0141547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc0194cb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0140cc1b0 0x7fc0140ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc0194cb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 0x7fc0140cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc0194cb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01415ee40 con 0x7fc014159480 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc0194cb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01415fc40 con 0x7fc0140cc1b0 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc0194cb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01415f030 con 0x7fc0140b3610 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc018cca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 0x7fc0140cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc018cca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 0x7fc0140cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53970/0 (socket says 172.21.15.84:53970) 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc018cca700 1 -- 172.21.15.84:0/3976083363 learned_addr learned my addr 172.21.15.84:0/3976083363 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc0137fe700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0140cc1b0 0x7fc0140ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.980+0000 7fc013fff700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 0x7fc0141547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fc018cca700 1 -- 172.21.15.84:0/3976083363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 msgr2=0x7fc0141547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fc018cca700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 0x7fc0141547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fc018cca700 1 -- 172.21.15.84:0/3976083363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0140cc1b0 msgr2=0x7fc0140ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fc018cca700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0140cc1b0 0x7fc0140ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fc018cca700 1 -- 172.21.15.84:0/3976083363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080094f0 con 0x7fc014159480 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fc013fff700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 0x7fc0141547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fc018cca700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 0x7fc0140cf040 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00d180 tx=0x7fc00c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fbffbfff700 1 -- 172.21.15.84:0/3976083363 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00dd70 con 0x7fc014159480 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fbffbfff700 1 -- 172.21.15.84:0/3976083363 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00f040 con 0x7fc014159480 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01415f310 con 0x7fc014159480 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fbffbfff700 1 -- 172.21.15.84:0/3976083363 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c015690 con 0x7fc014159480 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.981+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01415f8d0 con 0x7fc014159480 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.982+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01405f270 con 0x7fc014159480 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.982+0000 7fbffbfff700 1 -- 172.21.15.84:0/3976083363 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc00c01e3b0 con 0x7fc014159480 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.983+0000 7fbffbfff700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc000066f30 0x7fc0000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.983+0000 7fbffbfff700 1 -- 172.21.15.84:0/3976083363 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc00c084cc0 con 0x7fc014159480 2023-10-06T02:58:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.983+0000 7fc013fff700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc000066f30 0x7fc0000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.983+0000 7fc013fff700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc000066f30 0x7fc0000693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc01415cf30 tx=0x7fc008017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:15.987+0000 7fbffbfff700 1 -- 172.21.15.84:0/3976083363 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc00c051c90 con 0x7fc014159480 2023-10-06T02:58:16.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.211+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc014159850 con 0x7fc014159480 2023-10-06T02:58:16.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.212+0000 7fbffbfff700 1 -- 172.21.15.84:0/3976083363 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4637 (secure 0 0 0) 0x7fc00c01a090 con 0x7fc014159480 2023-10-06T02:58:16.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:16.212 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:58:06.271875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:58:16.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc000066f30 msgr2=0x7fc0000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:16.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc000066f30 0x7fc0000693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc01415cf30 tx=0x7fc008017000 comp rx=0 tx=0).stop 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 msgr2=0x7fc0140cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 0x7fc0140cf040 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00d180 tx=0x7fc00c009a50 comp rx=0 tx=0).stop 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 shutdown_connections 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc000066f30 0x7fc0000693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc014159480 0x7fc0140cf040 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0140b3610 0x7fc0141547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 --2- 172.21.15.84:0/3976083363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0140cc1b0 0x7fc0140ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 >> 172.21.15.84:0/3976083363 conn(0x7fc01406ed20 msgr2=0x7fc0140b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 shutdown_connections 2023-10-06T02:58:16.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.214+0000 7fc0194cb700 1 -- 172.21.15.84:0/3976083363 wait complete. 2023-10-06T02:58:16.216 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 44 2023-10-06T02:58:16.226 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T02:58:16.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:58:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.340+0000 7f7d1fbb8700 1 Processor -- start 2023-10-06T02:58:16.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.340+0000 7f7d1fbb8700 1 -- start start 2023-10-06T02:58:16.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.341+0000 7f7d1fbb8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7d181595a0 0x7f7d180aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.341+0000 7f7d1fbb8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d180b49e0 0x7f7d180aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.341+0000 7f7d1fbb8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d180b07a0 0x7f7d180b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.341+0000 7f7d1fbb8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180b0ca0 con 0x7f7d180b49e0 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.341+0000 7f7d1fbb8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180b0f80 con 0x7f7d181595a0 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.341+0000 7f7d1fbb8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180b1260 con 0x7f7d180b07a0 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.341+0000 7f7d1d153700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d180b49e0 0x7f7d180aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.341+0000 7f7d1d153700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d180b49e0 0x7f7d180aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53982/0 (socket says 172.21.15.84:53982) 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.341+0000 7f7d1d153700 1 -- 172.21.15.84:0/3123474836 learned_addr learned my addr 172.21.15.84:0/3123474836 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1d153700 1 -- 172.21.15.84:0/3123474836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d180b07a0 msgr2=0x7f7d180b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:16.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1d954700 1 --2- 172.21.15.84:0/3123474836 >> v2:172.21.15.131:3300/0 conn(0x7f7d181595a0 0x7f7d180aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1e155700 1 --2- 172.21.15.84:0/3123474836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d180b07a0 0x7f7d180b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1d153700 1 --2- 172.21.15.84:0/3123474836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d180b07a0 0x7f7d180b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1d153700 1 -- 172.21.15.84:0/3123474836 >> v2:172.21.15.131:3300/0 conn(0x7f7d181595a0 msgr2=0x7f7d180aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1d153700 1 --2- 172.21.15.84:0/3123474836 >> v2:172.21.15.131:3300/0 conn(0x7f7d181595a0 0x7f7d180aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1d153700 1 -- 172.21.15.84:0/3123474836 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180b1540 con 0x7f7d180b49e0 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1d954700 1 --2- 172.21.15.84:0/3123474836 >> v2:172.21.15.131:3300/0 conn(0x7f7d181595a0 0x7f7d180aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1e155700 1 --2- 172.21.15.84:0/3123474836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d180b07a0 0x7f7d180b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1d153700 1 --2- 172.21.15.84:0/3123474836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b49e0 0x7f7d180aaab0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7d080099b0 tx=0x7f7d08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc521ab8336b9551 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1c952700 1 -- 172.21.15.84:0/3123474836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800b820 con 0x7f7d180b49e0 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1c952700 1 -- 172.21.15.84:0/3123474836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0800b980 con 0x7f7d180b49e0 2023-10-06T02:58:16.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1c952700 1 -- 172.21.15.84:0/3123474836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800bd20 con 0x7f7d180b49e0 2023-10-06T02:58:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/3123474836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b49e0 msgr2=0x7f7d180aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/3123474836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b49e0 0x7f7d180aaab0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f7d080099b0 tx=0x7f7d08009250 comp rx=0 tx=0).stop 2023-10-06T02:58:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/3123474836 shutdown_connections 2023-10-06T02:58:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/3123474836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d180b07a0 0x7f7d180b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/3123474836 >> v2:172.21.15.131:3300/0 conn(0x7f7d181595a0 0x7f7d180aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/3123474836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b49e0 0x7f7d180aaab0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.342+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/3123474836 >> 172.21.15.84:0/3123474836 conn(0x7f7d18099830 msgr2=0x7f7d1806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.343+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/3123474836 shutdown_connections 2023-10-06T02:58:16.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.343+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/3123474836 wait complete. 2023-10-06T02:58:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1fbb8700 1 Processor -- start 2023-10-06T02:58:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1fbb8700 1 -- start start 2023-10-06T02:58:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1fbb8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b07a0 0x7f7d180cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1fbb8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d180b49e0 0x7f7d1815c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1fbb8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d181595a0 0x7f7d18156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1fbb8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1815bc30 con 0x7f7d180b07a0 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1fbb8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1815c1f0 con 0x7f7d180b49e0 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1fbb8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1809dbb0 con 0x7f7d181595a0 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1d954700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b07a0 0x7f7d180cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1d954700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b07a0 0x7f7d180cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53986/0 (socket says 172.21.15.84:53986) 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.344+0000 7f7d1d954700 1 -- 172.21.15.84:0/1051791836 learned_addr learned my addr 172.21.15.84:0/1051791836 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1d153700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d180b49e0 0x7f7d1815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1e155700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d181595a0 0x7f7d18156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1d954700 1 -- 172.21.15.84:0/1051791836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d181595a0 msgr2=0x7f7d18156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:16.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1d954700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d181595a0 0x7f7d18156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1d954700 1 -- 172.21.15.84:0/1051791836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d180b49e0 msgr2=0x7f7d1815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1d954700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d180b49e0 0x7f7d1815c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1d954700 1 -- 172.21.15.84:0/1051791836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d080094f0 con 0x7f7d180b07a0 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1d954700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b07a0 0x7f7d180cc650 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a360 tx=0x7f7d140078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d0dffb700 1 -- 172.21.15.84:0/1051791836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14015440 con 0x7f7d180b07a0 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d0dffb700 1 -- 172.21.15.84:0/1051791836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d140155a0 con 0x7f7d180b07a0 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1809de20 con 0x7f7d180b07a0 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d0dffb700 1 -- 172.21.15.84:0/1051791836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14015940 con 0x7f7d180b07a0 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.345+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d18157ac0 con 0x7f7d180b07a0 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.346+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1815c4d0 con 0x7f7d180b07a0 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.346+0000 7f7d0dffb700 1 -- 172.21.15.84:0/1051791836 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d14015cb0 con 0x7f7d180b07a0 2023-10-06T02:58:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.347+0000 7f7d0dffb700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7cfc066f30 0x7f7cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.347+0000 7f7d0dffb700 1 -- 172.21.15.84:0/1051791836 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7d14084f40 con 0x7f7d180b07a0 2023-10-06T02:58:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.347+0000 7f7d1d153700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7cfc066f30 0x7f7cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.347+0000 7f7d1d153700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7cfc066f30 0x7f7cfc0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7d18088e20 tx=0x7f7d08017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.351+0000 7f7d0dffb700 1 -- 172.21.15.84:0/1051791836 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d1404e5a0 con 0x7f7d180b07a0 2023-10-06T02:58:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.610+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7d18064ad0 con 0x7f7d180b07a0 2023-10-06T02:58:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.611+0000 7f7d0dffb700 1 -- 172.21.15.84:0/1051791836 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1921 (secure 0 0 0) 0x7f7d1401a7a0 con 0x7f7d180b07a0 2023-10-06T02:58:16.611 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:16.612 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":214,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2442276864,"bytes_avail":770651836416,"bytes_total":773094113280,"write_bytes_sec":767,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":44,"id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"b","status":"up:active","gid":5377},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":5778},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5781}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-10-06T02:58:13.843385+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:58:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7cfc066f30 msgr2=0x7f7cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7cfc066f30 0x7f7cfc0693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7d18088e20 tx=0x7f7d08017000 comp rx=0 tx=0).stop 2023-10-06T02:58:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b07a0 msgr2=0x7f7d180cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b07a0 0x7f7d180cc650 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a360 tx=0x7f7d140078c0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 shutdown_connections 2023-10-06T02:58:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7cfc066f30 0x7f7cfc0693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d181595a0 0x7f7d18156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d180b07a0 0x7f7d180cc650 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 --2- 172.21.15.84:0/1051791836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d180b49e0 0x7f7d1815c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 >> 172.21.15.84:0/1051791836 conn(0x7f7d18099830 msgr2=0x7f7d180ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 shutdown_connections 2023-10-06T02:58:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:16.613+0000 7f7d1fbb8700 1 -- 172.21.15.84:0/1051791836 wait complete. 2023-10-06T02:58:16.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2023-10-06T02:58:17.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.743+0000 7f4e4ffff700 1 Processor -- start 2023-10-06T02:58:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.743+0000 7f4e4ffff700 1 -- start start 2023-10-06T02:58:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e4ffff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4e50159580 0x7f4e500ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e4ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4e50159950 0x7f4e500ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e4ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 0x7f4e500ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e4ffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e500cf250 con 0x7f4e50159950 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e4ffff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e500ae250 con 0x7f4e50159580 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e4ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e500ad3a0 con 0x7f4e500ce890 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e467fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4e50159950 0x7f4e500ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e467fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4e50159950 0x7f4e500ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54002/0 (socket says 172.21.15.84:54002) 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e467fc700 1 -- 172.21.15.84:0/381164433 learned_addr learned my addr 172.21.15.84:0/381164433 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e4effd700 1 --2- 172.21.15.84:0/381164433 >> v2:172.21.15.131:3300/0 conn(0x7f4e50159580 0x7f4e500ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e4f7fe700 1 --2- 172.21.15.84:0/381164433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 0x7f4e500ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e467fc700 1 -- 172.21.15.84:0/381164433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 msgr2=0x7f4e500ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e467fc700 1 --2- 172.21.15.84:0/381164433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 0x7f4e500ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e467fc700 1 -- 172.21.15.84:0/381164433 >> v2:172.21.15.131:3300/0 conn(0x7f4e50159580 msgr2=0x7f4e500ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:17.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e467fc700 1 --2- 172.21.15.84:0/381164433 >> v2:172.21.15.131:3300/0 conn(0x7f4e50159580 0x7f4e500ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.744+0000 7f4e467fc700 1 -- 172.21.15.84:0/381164433 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e500ad640 con 0x7f4e50159950 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e467fc700 1 --2- 172.21.15.84:0/381164433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159950 0x7f4e500ae6e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4e50088cd0 tx=0x7f4e38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289d34fcaf8f3372 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4e7fc700 1 -- 172.21.15.84:0/381164433 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800b860 con 0x7f4e50159950 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4e7fc700 1 -- 172.21.15.84:0/381164433 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3800b9c0 con 0x7f4e50159950 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4e7fc700 1 -- 172.21.15.84:0/381164433 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800bd60 con 0x7f4e50159950 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4ffff700 1 -- 172.21.15.84:0/381164433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159950 msgr2=0x7f4e500ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/381164433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159950 0x7f4e500ae6e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4e50088cd0 tx=0x7f4e38009250 comp rx=0 tx=0).stop 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4ffff700 1 -- 172.21.15.84:0/381164433 shutdown_connections 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/381164433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 0x7f4e500ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/381164433 >> v2:172.21.15.131:3300/0 conn(0x7f4e50159580 0x7f4e500ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/381164433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159950 0x7f4e500ae6e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4ffff700 1 -- 172.21.15.84:0/381164433 >> 172.21.15.84:0/381164433 conn(0x7f4e50099560 msgr2=0x7f4e5006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4ffff700 1 -- 172.21.15.84:0/381164433 shutdown_connections 2023-10-06T02:58:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.745+0000 7f4e4ffff700 1 -- 172.21.15.84:0/381164433 wait complete. 2023-10-06T02:58:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e4ffff700 1 Processor -- start 2023-10-06T02:58:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e4ffff700 1 -- start start 2023-10-06T02:58:17.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e4ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 0x7f4e500c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:17.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e4ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159580 0x7f4e500c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:17.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e4ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e50159950 0x7f4e5015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:17.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e4ffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5015d530 con 0x7f4e50159580 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e4ffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e500c8aa0 con 0x7f4e50159950 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e4ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5016a870 con 0x7f4e500ce890 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e467fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159580 0x7f4e500c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e467fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159580 0x7f4e500c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54008/0 (socket says 172.21.15.84:54008) 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.747+0000 7f4e467fc700 1 -- 172.21.15.84:0/3495625879 learned_addr learned my addr 172.21.15.84:0/3495625879 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e4effd700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 0x7f4e500c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e4f7fe700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e50159950 0x7f4e5015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e467fc700 1 -- 172.21.15.84:0/3495625879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 msgr2=0x7f4e500c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e467fc700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 0x7f4e500c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e467fc700 1 -- 172.21.15.84:0/3495625879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e50159950 msgr2=0x7f4e5015d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e467fc700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e50159950 0x7f4e5015d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e467fc700 1 -- 172.21.15.84:0/3495625879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380094f0 con 0x7f4e50159580 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e467fc700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159580 0x7f4e500c7360 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4e50067e90 tx=0x7f4e38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e477fe700 1 -- 172.21.15.84:0/3495625879 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38011dc0 con 0x7f4e50159580 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e477fe700 1 -- 172.21.15.84:0/3495625879 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e38024440 con 0x7f4e50159580 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5016ab50 con 0x7f4e50159580 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e477fe700 1 -- 172.21.15.84:0/3495625879 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38024800 con 0x7f4e50159580 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.748+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e500b5980 con 0x7f4e50159580 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.749+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e50070b80 con 0x7f4e50159580 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.749+0000 7f4e477fe700 1 -- 172.21.15.84:0/3495625879 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e3801a420 con 0x7f4e50159580 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.750+0000 7f4e477fe700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4e30066f30 0x7f4e300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.750+0000 7f4e477fe700 1 -- 172.21.15.84:0/3495625879 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4e380865c0 con 0x7f4e50159580 2023-10-06T02:58:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.750+0000 7f4e4effd700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4e30066f30 0x7f4e300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.750+0000 7f4e4effd700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4e30066f30 0x7f4e300693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e500cf4e0 tx=0x7f4e40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.754+0000 7f4e477fe700 1 -- 172.21.15.84:0/3495625879 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e38053610 con 0x7f4e50159580 2023-10-06T02:58:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.981+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e5005f270 con 0x7f4e50159580 2023-10-06T02:58:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.981+0000 7f4e477fe700 1 -- 172.21.15.84:0/3495625879 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4637 (secure 0 0 0) 0x7f4e38056c30 con 0x7f4e50159580 2023-10-06T02:58:17.982 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:17.982 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:58:06.271875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:58:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4e30066f30 msgr2=0x7f4e300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4e30066f30 0x7f4e300693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4e500cf4e0 tx=0x7f4e40008040 comp rx=0 tx=0).stop 2023-10-06T02:58:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159580 msgr2=0x7f4e500c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159580 0x7f4e500c7360 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4e50067e90 tx=0x7f4e38017000 comp rx=0 tx=0).stop 2023-10-06T02:58:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 shutdown_connections 2023-10-06T02:58:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4e30066f30 0x7f4e300693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e50159950 0x7f4e5015d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4e500ce890 0x7f4e500c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 --2- 172.21.15.84:0/3495625879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e50159580 0x7f4e500c7360 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 >> 172.21.15.84:0/3495625879 conn(0x7f4e50099560 msgr2=0x7f4e500ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 shutdown_connections 2023-10-06T02:58:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:17.983+0000 7f4e4ffff700 1 -- 172.21.15.84:0/3495625879 wait complete. 2023-10-06T02:58:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 44 2023-10-06T02:58:17.996 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T02:58:17.996 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:58:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.108+0000 7f03ba9ce700 1 Processor -- start 2023-10-06T02:58:18.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.108+0000 7f03ba9ce700 1 -- start start 2023-10-06T02:58:18.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.109+0000 7f03ba9ce700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b40b49e0 0x7f03b40aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.109+0000 7f03ba9ce700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b40b0ca0 con 0x7f03b40b07a0 2023-10-06T02:58:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.109+0000 7f03ba9ce700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b40b0f80 con 0x7f03b41595a0 2023-10-06T02:58:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.109+0000 7f03ba9ce700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40b1260 con 0x7f03b40b49e0 2023-10-06T02:58:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.109+0000 7f03b8f6b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f03b40b07a0 0x7f03b40b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54482/0 (socket says 172.21.15.84:54482) 2023-10-06T02:58:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.109+0000 7f03b8f6b700 1 -- 172.21.15.84:0/2728516395 learned_addr learned my addr 172.21.15.84:0/2728516395 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.109+0000 7f03b37fe700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b40b49e0 0x7f03b40aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.109+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231153997 0 0) 0x7f03b40b0ca0 con 0x7f03b40b07a0 2023-10-06T02:58:18.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.109+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f039c003570 con 0x7f03b40b07a0 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245841349 0 0) 0x7f039c003570 con 0x7f03b40b07a0 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b40b49e0 msgr2=0x7f03b40aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b40b49e0 0x7f03b40aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 >> v1:172.21.15.131:6789/0 conn(0x7f03b41595a0 legacy=0x7f03b40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40b1540 con 0x7f03b40b07a0 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f03ac0017f0 con 0x7f03b40b07a0 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 >> v1:172.21.15.84:6789/0 conn(0x7f03b40b07a0 legacy=0x7f03b40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f039c003a90 0x7f039c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b40b49e0 0x7f039c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c004d50 0x7f039c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40b1260 con 0x7f039c004d50 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c00bb10 con 0x7f039c003a90 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c00bcd0 con 0x7f03b40b49e0 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b8f6b700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c004d50 0x7f039c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b37fe700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b40b49e0 0x7f039c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b3fff700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f039c003a90 0x7f039c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b8f6b700 1 -- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b40b49e0 msgr2=0x7f039c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b8f6b700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b40b49e0 0x7f039c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b8f6b700 1 -- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f039c003a90 msgr2=0x7f039c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b8f6b700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f039c003a90 0x7f039c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b8f6b700 1 -- 172.21.15.84:0/2728516395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c003570 con 0x7f039c004d50 2023-10-06T02:58:18.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b37fe700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b40b49e0 0x7f039c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b3fff700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f039c003a90 0x7f039c003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b8f6b700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c004d50 0x7f039c0051c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00a950 tx=0x7f03ac0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55948ec3c201f5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac0070d0 con 0x7f039c004d50 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac007230 con 0x7f039c004d50 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.110+0000 7f03b2ffd700 1 -- 172.21.15.84:0/2728516395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac0075f0 con 0x7f039c004d50 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.111+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2728516395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c004d50 msgr2=0x7f039c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.111+0000 7f03ba9ce700 1 --2- 172.21.15.84:0/2728516395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c004d50 0x7f039c0051c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00a950 tx=0x7f03ac0021f0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.111+0000 7f03b8f6b700 1 -- 172.21.15.84:0/2728516395 reap_dead start 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.111+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2728516395 shutdown_connections 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.111+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2728516395 >> 172.21.15.84:0/2728516395 conn(0x7f03b4099830 msgr2=0x7f03b406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.111+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2728516395 shutdown_connections 2023-10-06T02:58:18.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.111+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2728516395 wait complete. 2023-10-06T02:58:18.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.112+0000 7f03ba9ce700 1 Processor -- start 2023-10-06T02:58:18.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.112+0000 7f03ba9ce700 1 -- start start 2023-10-06T02:58:18.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03ba9ce700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03b41560f0 0x7f03b41564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03ba9ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b416a6f0 0x7f03b40cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03ba9ce700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b4156b20 0x7f03b40ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03ba9ce700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b409b9e0 con 0x7f03b416a6f0 2023-10-06T02:58:18.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03ba9ce700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40cc2d0 con 0x7f03b41560f0 2023-10-06T02:58:18.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03ba9ce700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40cbff0 con 0x7f03b4156b20 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b416a6f0 0x7f03b40cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b416a6f0 0x7f03b40cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54026/0 (socket says 172.21.15.84:54026) 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b37fe700 1 -- 172.21.15.84:0/2582031968 learned_addr learned my addr 172.21.15.84:0/2582031968 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b3fff700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03b41560f0 0x7f03b41564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b8f6b700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b4156b20 0x7f03b40ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b37fe700 1 -- 172.21.15.84:0/2582031968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b4156b20 msgr2=0x7f03b40ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b37fe700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b4156b20 0x7f03b40ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b37fe700 1 -- 172.21.15.84:0/2582031968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03b41560f0 msgr2=0x7f03b41564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b37fe700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03b41560f0 0x7f03b41564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b37fe700 1 -- 172.21.15.84:0/2582031968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4169c10 con 0x7f03b416a6f0 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b8f6b700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b4156b20 0x7f03b40ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.113+0000 7f03b37fe700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b416a6f0 0x7f03b40cb7a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f03a8011960 tx=0x7f03a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.114+0000 7f039bfff700 1 -- 172.21.15.84:0/2582031968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8015670 con 0x7f03b416a6f0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.114+0000 7f039bfff700 1 -- 172.21.15.84:0/2582031968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a80157d0 con 0x7f03b416a6f0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.114+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b4169ef0 con 0x7f03b416a6f0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.114+0000 7f039bfff700 1 -- 172.21.15.84:0/2582031968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8015b50 con 0x7f03b416a6f0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.114+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b40cbce0 con 0x7f03b416a6f0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.115+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b4169a70 con 0x7f03b416a6f0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.115+0000 7f039bfff700 1 -- 172.21.15.84:0/2582031968 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03a8013410 con 0x7f03b416a6f0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.115+0000 7f039bfff700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f03a0066f30 0x7f03a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.115+0000 7f039bfff700 1 -- 172.21.15.84:0/2582031968 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f03a8084f00 con 0x7f03b416a6f0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.115+0000 7f03b3fff700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f03a0066f30 0x7f03a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.116+0000 7f03b3fff700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f03a0066f30 0x7f03a00693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f03a4000c00 tx=0x7f03a400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:18.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.119+0000 7f039bfff700 1 -- 172.21.15.84:0/2582031968 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03b4169a70 con 0x7f03b416a6f0 2023-10-06T02:58:18.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.379+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f03b4169a70 con 0x7f03b416a6f0 2023-10-06T02:58:18.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.380+0000 7f039bfff700 1 -- 172.21.15.84:0/2582031968 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1698 (secure 0 0 0) 0x7f03b4169a70 con 0x7f03b416a6f0 2023-10-06T02:58:18.381 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:18.381 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":216,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2442276864,"bytes_avail":770651836416,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":44,"id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"b","status":"up:active","gid":5377},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":5778},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5781}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-06T02:58:17.844109+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:58:18.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f03a0066f30 msgr2=0x7f03a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f03a0066f30 0x7f03a00693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f03a4000c00 tx=0x7f03a400c040 comp rx=0 tx=0).stop 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b416a6f0 msgr2=0x7f03b40cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b416a6f0 0x7f03b40cb7a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f03a8011960 tx=0x7f03a8008040 comp rx=0 tx=0).stop 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 shutdown_connections 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f03a0066f30 0x7f03a00693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03b41560f0 0x7f03b41564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f03b4156b20 0x7f03b40ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 --2- 172.21.15.84:0/2582031968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b416a6f0 0x7f03b40cb7a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 >> 172.21.15.84:0/2582031968 conn(0x7f03b4099830 msgr2=0x7f03b40b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 shutdown_connections 2023-10-06T02:58:18.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.382+0000 7f03ba9ce700 1 -- 172.21.15.84:0/2582031968 wait complete. 2023-10-06T02:58:18.394 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T02:58:18.394 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:58:18.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:58:18.431 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:58:18.486 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:58:18.486 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:58:18.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:58:18.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:58:18.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:58:18.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:18.533 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:58:18.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.701+0000 7f0f09667700 1 Processor -- start 2023-10-06T02:58:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.701+0000 7f0f09667700 1 -- start start 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f09667700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0f041595a0 0x7f0f040aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f09667700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0f040b49e0 0x7f0f040aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f09667700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f040b07a0 0x7f0f040b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f09667700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040b0ca0 con 0x7f0f040b49e0 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f09667700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040b0f80 con 0x7f0f041595a0 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f09667700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040b1260 con 0x7f0f040b07a0 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f027fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0f040b49e0 0x7f0f040aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f027fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0f040b49e0 0x7f0f040aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54038/0 (socket says 172.21.15.84:54038) 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f027fc700 1 -- 172.21.15.84:0/225699346 learned_addr learned my addr 172.21.15.84:0/225699346 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f02ffd700 1 --2- 172.21.15.84:0/225699346 >> v2:172.21.15.131:3300/0 conn(0x7f0f041595a0 0x7f0f040aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f037fe700 1 --2- 172.21.15.84:0/225699346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f040b07a0 0x7f0f040b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f027fc700 1 -- 172.21.15.84:0/225699346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f040b07a0 msgr2=0x7f0f040b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f027fc700 1 --2- 172.21.15.84:0/225699346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f040b07a0 0x7f0f040b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f027fc700 1 -- 172.21.15.84:0/225699346 >> v2:172.21.15.131:3300/0 conn(0x7f0f041595a0 msgr2=0x7f0f040aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f027fc700 1 --2- 172.21.15.84:0/225699346 >> v2:172.21.15.131:3300/0 conn(0x7f0f041595a0 0x7f0f040aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f027fc700 1 -- 172.21.15.84:0/225699346 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040b1540 con 0x7f0f040b49e0 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f037fe700 1 --2- 172.21.15.84:0/225699346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f040b07a0 0x7f0f040b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f027fc700 1 --2- 172.21.15.84:0/225699346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 0x7f0f040aaab0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80099b0 tx=0x7f0ef8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f0f6c0bdeccd51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f01ffb700 1 -- 172.21.15.84:0/225699346 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef800b820 con 0x7f0f040b49e0 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f01ffb700 1 -- 172.21.15.84:0/225699346 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef800b980 con 0x7f0f040b49e0 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.702+0000 7f0f01ffb700 1 -- 172.21.15.84:0/225699346 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef800bd20 con 0x7f0f040b49e0 2023-10-06T02:58:18.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.703+0000 7f0f09667700 1 -- 172.21.15.84:0/225699346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 msgr2=0x7f0f040aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.703+0000 7f0f09667700 1 --2- 172.21.15.84:0/225699346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 0x7f0f040aaab0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80099b0 tx=0x7f0ef8009250 comp rx=0 tx=0).stop 2023-10-06T02:58:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.703+0000 7f0f09667700 1 -- 172.21.15.84:0/225699346 shutdown_connections 2023-10-06T02:58:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.703+0000 7f0f09667700 1 --2- 172.21.15.84:0/225699346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f040b07a0 0x7f0f040b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.703+0000 7f0f09667700 1 --2- 172.21.15.84:0/225699346 >> v2:172.21.15.131:3300/0 conn(0x7f0f041595a0 0x7f0f040aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.703+0000 7f0f09667700 1 --2- 172.21.15.84:0/225699346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 0x7f0f040aaab0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.703+0000 7f0f09667700 1 -- 172.21.15.84:0/225699346 >> 172.21.15.84:0/225699346 conn(0x7f0f04099830 msgr2=0x7f0f0406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.703+0000 7f0f09667700 1 -- 172.21.15.84:0/225699346 shutdown_connections 2023-10-06T02:58:18.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.703+0000 7f0f09667700 1 -- 172.21.15.84:0/225699346 wait complete. 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.704+0000 7f0f09667700 1 Processor -- start 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.704+0000 7f0f09667700 1 -- start start 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f09667700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f040b07a0 0x7f0f040cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f09667700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 0x7f0f0415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f09667700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f041595a0 0x7f0f04156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f09667700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415bc30 con 0x7f0f040b49e0 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f09667700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0415c1f0 con 0x7f0f040b07a0 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f09667700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0409dbb0 con 0x7f0f041595a0 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f027fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 0x7f0f0415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f027fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 0x7f0f0415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54042/0 (socket says 172.21.15.84:54042) 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f027fc700 1 -- 172.21.15.84:0/1689473321 learned_addr learned my addr 172.21.15.84:0/1689473321 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f02ffd700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f040b07a0 0x7f0f040cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f037fe700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f041595a0 0x7f0f04156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f027fc700 1 -- 172.21.15.84:0/1689473321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f041595a0 msgr2=0x7f0f04156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f027fc700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f041595a0 0x7f0f04156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f027fc700 1 -- 172.21.15.84:0/1689473321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f040b07a0 msgr2=0x7f0f040cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f027fc700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f040b07a0 0x7f0f040cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f027fc700 1 -- 172.21.15.84:0/1689473321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef80094f0 con 0x7f0f040b49e0 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.705+0000 7f0f02ffd700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f040b07a0 0x7f0f040cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.706+0000 7f0f027fc700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 0x7f0f0415c680 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009290 tx=0x7f0ef8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.706+0000 7f0eeaffd700 1 -- 172.21.15.84:0/1689473321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8011e50 con 0x7f0f040b49e0 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.706+0000 7f0eeaffd700 1 -- 172.21.15.84:0/1689473321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef8024440 con 0x7f0f040b49e0 2023-10-06T02:58:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.706+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0409de20 con 0x7f0f040b49e0 2023-10-06T02:58:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.706+0000 7f0eeaffd700 1 -- 172.21.15.84:0/1689473321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8024800 con 0x7f0f040b49e0 2023-10-06T02:58:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.706+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f04157ac0 con 0x7f0f040b49e0 2023-10-06T02:58:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.707+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0409e010 con 0x7f0f040b49e0 2023-10-06T02:58:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.707+0000 7f0eeaffd700 1 -- 172.21.15.84:0/1689473321 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ef801a420 con 0x7f0f040b49e0 2023-10-06T02:58:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.707+0000 7f0eeaffd700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0ef0066f30 0x7f0ef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.708+0000 7f0eeaffd700 1 -- 172.21.15.84:0/1689473321 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0ef8086660 con 0x7f0f040b49e0 2023-10-06T02:58:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.708+0000 7f0f02ffd700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0ef0066f30 0x7f0ef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:18.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.708+0000 7f0f02ffd700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0ef0066f30 0x7f0ef00693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4006aa0 tx=0x7f0ef4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:18.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.712+0000 7f0eeaffd700 1 -- 172.21.15.84:0/1689473321 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ef8053630 con 0x7f0f040b49e0 2023-10-06T02:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.937+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f04064ad0 con 0x7f0f040b49e0 2023-10-06T02:58:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.937+0000 7f0eeaffd700 1 -- 172.21.15.84:0/1689473321 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4637 (secure 0 0 0) 0x7f0ef8015090 con 0x7f0f040b49e0 2023-10-06T02:58:18.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:18.938 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:58:06.271875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:58:18.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0ef0066f30 msgr2=0x7f0ef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0ef0066f30 0x7f0ef00693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4006aa0 tx=0x7f0ef4008040 comp rx=0 tx=0).stop 2023-10-06T02:58:18.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 msgr2=0x7f0f0415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:18.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 0x7f0f0415c680 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009290 tx=0x7f0ef8017000 comp rx=0 tx=0).stop 2023-10-06T02:58:18.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 shutdown_connections 2023-10-06T02:58:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0ef0066f30 0x7f0ef00693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f040b07a0 0x7f0f040cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0f041595a0 0x7f0f04156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 --2- 172.21.15.84:0/1689473321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f040b49e0 0x7f0f0415c680 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 >> 172.21.15.84:0/1689473321 conn(0x7f0f04099830 msgr2=0x7f0f040ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 shutdown_connections 2023-10-06T02:58:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:18.939+0000 7f0f09667700 1 -- 172.21.15.84:0/1689473321 wait complete. 2023-10-06T02:58:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 44 2023-10-06T02:58:18.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:58:19.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.066+0000 7fdfb4199700 1 Processor -- start 2023-10-06T02:58:19.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.066+0000 7fdfb4199700 1 -- start start 2023-10-06T02:58:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb4199700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdfac0ca3b0 0x7fdfac1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb4199700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdfac0adba0 0x7fdfac0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb4199700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 0x7fdfac15af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb4199700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac0cbbd0 con 0x7fdfac0adba0 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb4199700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac157e20 con 0x7fdfac0ca3b0 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb4199700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac0ceb50 con 0x7fdfac0ce710 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1734700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdfac0adba0 0x7fdfac0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1734700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdfac0adba0 0x7fdfac0ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54050/0 (socket says 172.21.15.84:54050) 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1734700 1 -- 172.21.15.84:0/4186576377 learned_addr learned my addr 172.21.15.84:0/4186576377 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1f35700 1 --2- 172.21.15.84:0/4186576377 >> v2:172.21.15.131:3300/0 conn(0x7fdfac0ca3b0 0x7fdfac1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb2736700 1 --2- 172.21.15.84:0/4186576377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 0x7fdfac15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1734700 1 -- 172.21.15.84:0/4186576377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 msgr2=0x7fdfac15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1734700 1 --2- 172.21.15.84:0/4186576377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 0x7fdfac15af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1734700 1 -- 172.21.15.84:0/4186576377 >> v2:172.21.15.131:3300/0 conn(0x7fdfac0ca3b0 msgr2=0x7fdfac1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1734700 1 --2- 172.21.15.84:0/4186576377 >> v2:172.21.15.131:3300/0 conn(0x7fdfac0ca3b0 0x7fdfac1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1734700 1 -- 172.21.15.84:0/4186576377 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0cb610 con 0x7fdfac0adba0 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb1734700 1 --2- 172.21.15.84:0/4186576377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 0x7fdfac0ce1d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fdfac06f300 tx=0x7fdf9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cbcf228fe92d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb0f33700 1 -- 172.21.15.84:0/4186576377 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c00b860 con 0x7fdfac0adba0 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb0f33700 1 -- 172.21.15.84:0/4186576377 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9c00b9c0 con 0x7fdfac0adba0 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.067+0000 7fdfb0f33700 1 -- 172.21.15.84:0/4186576377 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c00bd60 con 0x7fdfac0adba0 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.068+0000 7fdfb4199700 1 -- 172.21.15.84:0/4186576377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 msgr2=0x7fdfac0ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.068+0000 7fdfb4199700 1 --2- 172.21.15.84:0/4186576377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 0x7fdfac0ce1d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fdfac06f300 tx=0x7fdf9c009250 comp rx=0 tx=0).stop 2023-10-06T02:58:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.068+0000 7fdfb4199700 1 -- 172.21.15.84:0/4186576377 shutdown_connections 2023-10-06T02:58:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.068+0000 7fdfb4199700 1 --2- 172.21.15.84:0/4186576377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 0x7fdfac15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.068+0000 7fdfb4199700 1 --2- 172.21.15.84:0/4186576377 >> v2:172.21.15.131:3300/0 conn(0x7fdfac0ca3b0 0x7fdfac1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.068+0000 7fdfb4199700 1 --2- 172.21.15.84:0/4186576377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 0x7fdfac0ce1d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.068+0000 7fdfb4199700 1 -- 172.21.15.84:0/4186576377 >> 172.21.15.84:0/4186576377 conn(0x7fdfac070810 msgr2=0x7fdfac070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.068+0000 7fdfb4199700 1 -- 172.21.15.84:0/4186576377 shutdown_connections 2023-10-06T02:58:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.068+0000 7fdfb4199700 1 -- 172.21.15.84:0/4186576377 wait complete. 2023-10-06T02:58:19.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.069+0000 7fdfb4199700 1 Processor -- start 2023-10-06T02:58:19.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.069+0000 7fdfb4199700 1 -- start start 2023-10-06T02:58:19.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb4199700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 0x7fdfac0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb4199700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfac0ca3b0 0x7fdfac1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb4199700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 0x7fdfac159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb4199700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac16b7f0 con 0x7fdfac0adba0 2023-10-06T02:58:19.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb4199700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac16aec0 con 0x7fdfac0ca3b0 2023-10-06T02:58:19.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb4199700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac16b1a0 con 0x7fdfac0ce710 2023-10-06T02:58:19.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1f35700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 0x7fdfac0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1f35700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 0x7fdfac0c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54066/0 (socket says 172.21.15.84:54066) 2023-10-06T02:58:19.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1f35700 1 -- 172.21.15.84:0/316785507 learned_addr learned my addr 172.21.15.84:0/316785507 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:19.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1734700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfac0ca3b0 0x7fdfac1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb2736700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 0x7fdfac159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1f35700 1 -- 172.21.15.84:0/316785507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 msgr2=0x7fdfac159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1f35700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 0x7fdfac159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1f35700 1 -- 172.21.15.84:0/316785507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfac0ca3b0 msgr2=0x7fdfac1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1f35700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfac0ca3b0 0x7fdfac1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1f35700 1 -- 172.21.15.84:0/316785507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c0094f0 con 0x7fdfac0adba0 2023-10-06T02:58:19.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.070+0000 7fdfb1f35700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 0x7fdfac0c5b70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800d890 tx=0x7fdfa8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:19.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.071+0000 7fdfa1ffb700 1 -- 172.21.15.84:0/316785507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800b600 con 0x7fdfac0adba0 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.071+0000 7fdfa1ffb700 1 -- 172.21.15.84:0/316785507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa800b760 con 0x7fdfac0adba0 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.071+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac16b480 con 0x7fdfac0adba0 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.071+0000 7fdfa1ffb700 1 -- 172.21.15.84:0/316785507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800bae0 con 0x7fdfac0adba0 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.071+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac167950 con 0x7fdfac0adba0 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.072+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac064ad0 con 0x7fdfac0adba0 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.072+0000 7fdfa1ffb700 1 -- 172.21.15.84:0/316785507 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfa801e460 con 0x7fdfac0adba0 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.072+0000 7fdfa1ffb700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf90066f30 0x7fdf900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.072+0000 7fdfb1734700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf90066f30 0x7fdf900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.073+0000 7fdfa1ffb700 1 -- 172.21.15.84:0/316785507 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdfa8084df0 con 0x7fdfac0adba0 2023-10-06T02:58:19.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.073+0000 7fdfb1734700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf90066f30 0x7fdf900693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdfac06f300 tx=0x7fdf9c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:19.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.077+0000 7fdfa1ffb700 1 -- 172.21.15.84:0/316785507 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfa8051dc0 con 0x7fdfac0adba0 2023-10-06T02:58:19.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.260+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfac0cb8f0 con 0x7fdfac0adba0 2023-10-06T02:58:19.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.261+0000 7fdfa1ffb700 1 -- 172.21.15.84:0/316785507 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fdfa80553e0 con 0x7fdfac0adba0 2023-10-06T02:58:19.262 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:19.263 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":56,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:57:30.140568+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:26.170794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:27.492251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf90066f30 msgr2=0x7fdf900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf90066f30 0x7fdf900693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdfac06f300 tx=0x7fdf9c017000 comp rx=0 tx=0).stop 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 msgr2=0x7fdfac0c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 0x7fdfac0c5b70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800d890 tx=0x7fdfa8008040 comp rx=0 tx=0).stop 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 shutdown_connections 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf90066f30 0x7fdf900693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfac0ce710 0x7fdfac159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfac0adba0 0x7fdfac0c5b70 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 --2- 172.21.15.84:0/316785507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfac0ca3b0 0x7fdfac1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 >> 172.21.15.84:0/316785507 conn(0x7fdfac070810 msgr2=0x7fdfac1582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:19.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 shutdown_connections 2023-10-06T02:58:19.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.263+0000 7fdfb4199700 1 -- 172.21.15.84:0/316785507 wait complete. 2023-10-06T02:58:19.276 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:57:26.170794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:57:27.492251+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:58:19.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:58:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.393+0000 7f7fe9640700 1 Processor -- start 2023-10-06T02:58:19.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.393+0000 7f7fe9640700 1 -- start start 2023-10-06T02:58:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe9640700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 0x7f7fe40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe9640700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7fe41598e0 0x7f7fe40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe9640700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fe40ce820 0x7f7fe40cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe9640700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe40cf610 con 0x7f7fe40ce820 2023-10-06T02:58:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe9640700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe40cf8f0 con 0x7f7fe41598e0 2023-10-06T02:58:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe9640700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40cfbd0 con 0x7f7fe4159510 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fe40ce820 0x7f7fe40cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fe40ce820 0x7f7fe40cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54080/0 (socket says 172.21.15.84:54080) 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe37fe700 1 -- 172.21.15.84:0/1144712209 learned_addr learned my addr 172.21.15.84:0/1144712209 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fda7fc700 1 --2- 172.21.15.84:0/1144712209 >> v2:172.21.15.131:3300/0 conn(0x7f7fe41598e0 0x7f7fe40cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe2ffd700 1 --2- 172.21.15.84:0/1144712209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 0x7f7fe40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe37fe700 1 -- 172.21.15.84:0/1144712209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 msgr2=0x7f7fe40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe37fe700 1 --2- 172.21.15.84:0/1144712209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 0x7f7fe40cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe37fe700 1 -- 172.21.15.84:0/1144712209 >> v2:172.21.15.131:3300/0 conn(0x7f7fe41598e0 msgr2=0x7f7fe40cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe37fe700 1 --2- 172.21.15.84:0/1144712209 >> v2:172.21.15.131:3300/0 conn(0x7f7fe41598e0 0x7f7fe40cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fe37fe700 1 -- 172.21.15.84:0/1144712209 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe40cfeb0 con 0x7f7fe40ce820 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.394+0000 7f7fda7fc700 1 --2- 172.21.15.84:0/1144712209 >> v2:172.21.15.131:3300/0 conn(0x7f7fe41598e0 0x7f7fe40cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe37fe700 1 --2- 172.21.15.84:0/1144712209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 0x7f7fe40cec40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4089360 tx=0x7f7fdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8da02c43e9e1fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe27fc700 1 -- 172.21.15.84:0/1144712209 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00e070 con 0x7f7fe40ce820 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe27fc700 1 -- 172.21.15.84:0/1144712209 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc00ba50 con 0x7f7fe40ce820 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe27fc700 1 -- 172.21.15.84:0/1144712209 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0092e0 con 0x7f7fe40ce820 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe9640700 1 -- 172.21.15.84:0/1144712209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 msgr2=0x7f7fe40cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe9640700 1 --2- 172.21.15.84:0/1144712209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 0x7f7fe40cec40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4089360 tx=0x7f7fdc009840 comp rx=0 tx=0).stop 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe9640700 1 -- 172.21.15.84:0/1144712209 shutdown_connections 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe9640700 1 --2- 172.21.15.84:0/1144712209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 0x7f7fe40cec40 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe9640700 1 --2- 172.21.15.84:0/1144712209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 0x7f7fe40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe9640700 1 --2- 172.21.15.84:0/1144712209 >> v2:172.21.15.131:3300/0 conn(0x7f7fe41598e0 0x7f7fe40cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe9640700 1 -- 172.21.15.84:0/1144712209 >> 172.21.15.84:0/1144712209 conn(0x7f7fe4089e90 msgr2=0x7f7fe40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:19.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe9640700 1 -- 172.21.15.84:0/1144712209 shutdown_connections 2023-10-06T02:58:19.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.395+0000 7f7fe9640700 1 -- 172.21.15.84:0/1144712209 wait complete. 2023-10-06T02:58:19.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.397+0000 7f7fe9640700 1 Processor -- start 2023-10-06T02:58:19.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.397+0000 7f7fe9640700 1 -- start start 2023-10-06T02:58:19.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.397+0000 7f7fe9640700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 0x7f7fe414a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.397+0000 7f7fe9640700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 0x7f7fe40c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.397+0000 7f7fe9640700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fe41598e0 0x7f7fe40c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.397+0000 7f7fe9640700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe416cfb0 con 0x7f7fe40ce820 2023-10-06T02:58:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.397+0000 7f7fe9640700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40b4100 con 0x7f7fe41598e0 2023-10-06T02:58:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.397+0000 7f7fe9640700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40b43e0 con 0x7f7fe4159510 2023-10-06T02:58:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.397+0000 7f7fe2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 0x7f7fe414a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 0x7f7fe414a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54082/0 (socket says 172.21.15.84:54082) 2023-10-06T02:58:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe2ffd700 1 -- 172.21.15.84:0/4178960223 learned_addr learned my addr 172.21.15.84:0/4178960223 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fda7fc700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 0x7f7fe40c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe37fe700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fe41598e0 0x7f7fe40c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe2ffd700 1 -- 172.21.15.84:0/4178960223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 msgr2=0x7f7fe40c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe2ffd700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 0x7f7fe40c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe2ffd700 1 -- 172.21.15.84:0/4178960223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fe41598e0 msgr2=0x7f7fe40c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe2ffd700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fe41598e0 0x7f7fe40c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe2ffd700 1 -- 172.21.15.84:0/4178960223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc009ae0 con 0x7f7fe40ce820 2023-10-06T02:58:19.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe2ffd700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 0x7f7fe414a980 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400d890 tx=0x7f7fd4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/4178960223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40125f0 con 0x7f7fe40ce820 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/4178960223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd4012750 con 0x7f7fe40ce820 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe40b46c0 con 0x7f7fe40ce820 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/4178960223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4012af0 con 0x7f7fe40ce820 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.398+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe40b4c80 con 0x7f7fe40ce820 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.399+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe4064ad0 con 0x7f7fe40ce820 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.399+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/4178960223 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fd401e460 con 0x7f7fe40ce820 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.400+0000 7f7fdb7fe700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7fc4066f30 0x7f7fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.400+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/4178960223 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7fd4084d40 con 0x7f7fe40ce820 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.400+0000 7f7fda7fc700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7fc4066f30 0x7f7fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.400+0000 7f7fda7fc700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7fc4066f30 0x7f7fc40693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7fe409dd80 tx=0x7f7fcc006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:19.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.404+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/4178960223 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fd4051d10 con 0x7f7fe40ce820 2023-10-06T02:58:19.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.587+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fe40cf180 con 0x7f7fe40ce820 2023-10-06T02:58:19.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.587+0000 7f7fdb7fe700 1 -- 172.21.15.84:0/4178960223 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fd4055330 con 0x7f7fe40ce820 2023-10-06T02:58:19.588 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:58:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7fc4066f30 msgr2=0x7f7fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7fc4066f30 0x7f7fc40693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7fe409dd80 tx=0x7f7fcc006f90 comp rx=0 tx=0).stop 2023-10-06T02:58:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 msgr2=0x7f7fe414a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 0x7f7fe414a980 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400d890 tx=0x7f7fd4008040 comp rx=0 tx=0).stop 2023-10-06T02:58:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 shutdown_connections 2023-10-06T02:58:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7fc4066f30 0x7f7fc40693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7fe41598e0 0x7f7fe40c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fe40ce820 0x7f7fe414a980 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 --2- 172.21.15.84:0/4178960223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7fe4159510 0x7f7fe40c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 >> 172.21.15.84:0/4178960223 conn(0x7f7fe4089e90 msgr2=0x7f7fe40cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 shutdown_connections 2023-10-06T02:58:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.589+0000 7f7fe9640700 1 -- 172.21.15.84:0/4178960223 wait complete. 2023-10-06T02:58:19.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:58:19.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.718+0000 7fabf68b2700 1 Processor -- start 2023-10-06T02:58:19.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.718+0000 7fabf68b2700 1 -- start start 2023-10-06T02:58:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf68b2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabf00cd400 0x7fabf00ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf68b2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 0x7fabf00cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf68b2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf00cc9b0 con 0x7fabf00b2660 2023-10-06T02:58:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf68b2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00cf560 con 0x7fabf00cd400 2023-10-06T02:58:19.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf68b2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00cbda0 con 0x7fabf00b2a30 2023-10-06T02:58:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf50af700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabf00cd400 0x7fabf00ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf50af700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabf00cd400 0x7fabf00ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54084/0 (socket says 172.21.15.84:54084) 2023-10-06T02:58:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf50af700 1 -- 172.21.15.84:0/518149030 learned_addr learned my addr 172.21.15.84:0/518149030 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf60b1700 1 --2- 172.21.15.84:0/518149030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 0x7fabf00cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf50af700 1 -- 172.21.15.84:0/518149030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 msgr2=0x7fabf00cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf50af700 1 --2- 172.21.15.84:0/518149030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 0x7fabf00cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf50af700 1 -- 172.21.15.84:0/518149030 >> v1:172.21.15.131:6789/0 conn(0x7fabf00b2660 legacy=0x7fabf00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf50af700 1 -- 172.21.15.84:0/518149030 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00cc080 con 0x7fabf00cd400 2023-10-06T02:58:19.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.719+0000 7fabf50af700 1 --2- 172.21.15.84:0/518149030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00cd400 0x7fabf00ceae0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fabe40099b0 tx=0x7fabe4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25876a72249dc4bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf48ae700 1 -- 172.21.15.84:0/518149030 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4009ea0 con 0x7fabf00cd400 2023-10-06T02:58:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf48ae700 1 -- 172.21.15.84:0/518149030 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe400b860 con 0x7fabf00cd400 2023-10-06T02:58:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf48ae700 1 -- 172.21.15.84:0/518149030 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe400bc00 con 0x7fabf00cd400 2023-10-06T02:58:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf68b2700 1 -- 172.21.15.84:0/518149030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00cd400 msgr2=0x7fabf00ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf68b2700 1 --2- 172.21.15.84:0/518149030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00cd400 0x7fabf00ceae0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fabe40099b0 tx=0x7fabe4009250 comp rx=0 tx=0).stop 2023-10-06T02:58:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf68b2700 1 -- 172.21.15.84:0/518149030 shutdown_connections 2023-10-06T02:58:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf68b2700 1 --2- 172.21.15.84:0/518149030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 0x7fabf00cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf68b2700 1 --2- 172.21.15.84:0/518149030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00cd400 0x7fabf00ceae0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf68b2700 1 -- 172.21.15.84:0/518149030 >> 172.21.15.84:0/518149030 conn(0x7fabf0099560 msgr2=0x7fabf006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:19.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf68b2700 1 -- 172.21.15.84:0/518149030 shutdown_connections 2023-10-06T02:58:19.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.720+0000 7fabf68b2700 1 -- 172.21.15.84:0/518149030 wait complete. 2023-10-06T02:58:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.721+0000 7fabf68b2700 1 Processor -- start 2023-10-06T02:58:19.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.721+0000 7fabf68b2700 1 -- start start 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf68b2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00b2660 0x7fabf00b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf68b2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 0x7fabf015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf68b2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabf00cd400 0x7fabf01509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf68b2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf015bb10 con 0x7fabf00b2660 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf68b2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf015af90 con 0x7fabf00cd400 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf68b2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf015b270 con 0x7fabf00b2a30 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf58b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00b2660 0x7fabf00b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf58b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00b2660 0x7fabf00b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54100/0 (socket says 172.21.15.84:54100) 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf58b0700 1 -- 172.21.15.84:0/2677876244 learned_addr learned my addr 172.21.15.84:0/2677876244 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf60b1700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabf00cd400 0x7fabf01509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf50af700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 0x7fabf015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf58b0700 1 -- 172.21.15.84:0/2677876244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 msgr2=0x7fabf015c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.722+0000 7fabf58b0700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 0x7fabf015c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabf58b0700 1 -- 172.21.15.84:0/2677876244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabf00cd400 msgr2=0x7fabf01509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabf58b0700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabf00cd400 0x7fabf01509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabf58b0700 1 -- 172.21.15.84:0/2677876244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40094f0 con 0x7fabf00b2660 2023-10-06T02:58:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabf50af700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 0x7fabf015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:19.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabf58b0700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00b2660 0x7fabf00b4520 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c540 tx=0x7fabe8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabedffb700 1 -- 172.21.15.84:0/2677876244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8011590 con 0x7fabf00b2660 2023-10-06T02:58:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabedffb700 1 -- 172.21.15.84:0/2677876244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe80116f0 con 0x7fabf00b2660 2023-10-06T02:58:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf015b550 con 0x7fabf00b2660 2023-10-06T02:58:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabedffb700 1 -- 172.21.15.84:0/2677876244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8011ab0 con 0x7fabf00b2660 2023-10-06T02:58:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.723+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf015c370 con 0x7fabf00b2660 2023-10-06T02:58:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.724+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf00b30d0 con 0x7fabf00b2660 2023-10-06T02:58:19.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.724+0000 7fabedffb700 1 -- 172.21.15.84:0/2677876244 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabe801b3b0 con 0x7fabf00b2660 2023-10-06T02:58:19.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.725+0000 7fabedffb700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabdc066f30 0x7fabdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:19.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.725+0000 7fabedffb700 1 -- 172.21.15.84:0/2677876244 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fabe8083b50 con 0x7fabf00b2660 2023-10-06T02:58:19.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.725+0000 7fabf50af700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabdc066f30 0x7fabdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:19.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.725+0000 7fabf50af700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabdc066f30 0x7fabdc0693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fabe40099b0 tx=0x7fabe4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:19.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.729+0000 7fabedffb700 1 -- 172.21.15.84:0/2677876244 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabf00b30d0 con 0x7fabf00b2660 2023-10-06T02:58:19.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.911+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fabf00b30d0 con 0x7fabf00b2660 2023-10-06T02:58:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.911+0000 7fabedffb700 1 -- 172.21.15.84:0/2677876244 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7fabe8017070 con 0x7fabf00b2660 2023-10-06T02:58:19.912 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:58:19.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabdc066f30 msgr2=0x7fabdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabdc066f30 0x7fabdc0693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fabe40099b0 tx=0x7fabe4017000 comp rx=0 tx=0).stop 2023-10-06T02:58:19.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00b2660 msgr2=0x7fabf00b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:19.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00b2660 0x7fabf00b4520 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c540 tx=0x7fabe8001070 comp rx=0 tx=0).stop 2023-10-06T02:58:19.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 shutdown_connections 2023-10-06T02:58:19.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabdc066f30 0x7fabdc0693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabf00cd400 0x7fabf01509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf00b2660 0x7fabf00b4520 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 --2- 172.21.15.84:0/2677876244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf00b2a30 0x7fabf015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:19.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 >> 172.21.15.84:0/2677876244 conn(0x7fabf0099560 msgr2=0x7fabf0068150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:19.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 shutdown_connections 2023-10-06T02:58:19.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:19.913+0000 7fabf68b2700 1 -- 172.21.15.84:0/2677876244 wait complete. 2023-10-06T02:58:19.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:58:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.041+0000 7f1a4233b700 1 Processor -- start 2023-10-06T02:58:20.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.041+0000 7f1a4233b700 1 -- start start 2023-10-06T02:58:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a4233b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a3c0cbcb0 0x7f1a3c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a4233b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3c0cf610 con 0x7f1a3c1598e0 2023-10-06T02:58:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a4233b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3c0cf8f0 con 0x7f1a3c159510 2023-10-06T02:58:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a4233b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3c0cfbd0 con 0x7f1a3c0cbcb0 2023-10-06T02:58:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a408d8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a3c0cbcb0 0x7f1a3c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a3b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1a3c1598e0 0x7f1a3c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54484/0 (socket says 172.21.15.84:54484) 2023-10-06T02:58:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a3b7fe700 1 -- 172.21.15.84:0/373357959 learned_addr learned my addr 172.21.15.84:0/373357959 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a408d8700 1 -- 172.21.15.84:0/373357959 >> v1:172.21.15.131:6789/0 conn(0x7f1a3c159510 legacy=0x7f1a3c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:20.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a408d8700 1 -- 172.21.15.84:0/373357959 >> v1:172.21.15.84:6789/0 conn(0x7f1a3c1598e0 legacy=0x7f1a3c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a408d8700 1 -- 172.21.15.84:0/373357959 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0cfeb0 con 0x7f1a3c0cbcb0 2023-10-06T02:58:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a3affd700 1 -- 172.21.15.84:0/373357959 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389472480 0 0) 0x7f1a3c0cf610 con 0x7f1a3c1598e0 2023-10-06T02:58:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a408d8700 1 --2- 172.21.15.84:0/373357959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c0cbcb0 0x7f1a3c0cef30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009e60 tx=0x7f1a34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7637d1cc3c800c1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a3affd700 1 -- 172.21.15.84:0/373357959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400e070 con 0x7f1a3c0cbcb0 2023-10-06T02:58:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a3affd700 1 -- 172.21.15.84:0/373357959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3400bbf0 con 0x7f1a3c0cbcb0 2023-10-06T02:58:20.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.042+0000 7f1a3affd700 1 -- 172.21.15.84:0/373357959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34012430 con 0x7f1a3c0cbcb0 2023-10-06T02:58:20.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.043+0000 7f1a4233b700 1 -- 172.21.15.84:0/373357959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c0cbcb0 msgr2=0x7f1a3c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.043+0000 7f1a4233b700 1 --2- 172.21.15.84:0/373357959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c0cbcb0 0x7f1a3c0cef30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009e60 tx=0x7f1a34009780 comp rx=0 tx=0).stop 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.043+0000 7f1a4233b700 1 -- 172.21.15.84:0/373357959 shutdown_connections 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.043+0000 7f1a4233b700 1 --2- 172.21.15.84:0/373357959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c0cbcb0 0x7f1a3c0cef30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.043+0000 7f1a4233b700 1 -- 172.21.15.84:0/373357959 >> 172.21.15.84:0/373357959 conn(0x7f1a3c089e90 msgr2=0x7f1a3c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.043+0000 7f1a4233b700 1 -- 172.21.15.84:0/373357959 shutdown_connections 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.043+0000 7f1a4233b700 1 -- 172.21.15.84:0/373357959 wait complete. 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.044+0000 7f1a4233b700 1 Processor -- start 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.044+0000 7f1a4233b700 1 -- start start 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a4233b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a3c0cbcb0 0x7f1a3c149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a4233b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c159510 0x7f1a3c157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a4233b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c1598e0 0x7f1a3c0c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a4233b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c158b90 con 0x7f1a3c1598e0 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a4233b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c15acd0 con 0x7f1a3c159510 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a4233b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c149960 con 0x7f1a3c0cbcb0 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a408d8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c1598e0 0x7f1a3c0c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a408d8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c1598e0 0x7f1a3c0c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54114/0 (socket says 172.21.15.84:54114) 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a408d8700 1 -- 172.21.15.84:0/844099299 learned_addr learned my addr 172.21.15.84:0/844099299 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a408d8700 1 -- 172.21.15.84:0/844099299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a3c0cbcb0 msgr2=0x7f1a3c149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a3bfff700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a3c0cbcb0 0x7f1a3c149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a408d8700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a3c0cbcb0 0x7f1a3c149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a3b7fe700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c159510 0x7f1a3c157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a408d8700 1 -- 172.21.15.84:0/844099299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c159510 msgr2=0x7f1a3c157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a408d8700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c159510 0x7f1a3c157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a408d8700 1 -- 172.21.15.84:0/844099299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34009a20 con 0x7f1a3c1598e0 2023-10-06T02:58:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.045+0000 7f1a408d8700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c1598e0 0x7f1a3c0c5a20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1a340097c0 tx=0x7f1a34018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.046+0000 7f1a23fff700 1 -- 172.21.15.84:0/844099299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3401e710 con 0x7f1a3c1598e0 2023-10-06T02:58:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.046+0000 7f1a23fff700 1 -- 172.21.15.84:0/844099299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3401e890 con 0x7f1a3c1598e0 2023-10-06T02:58:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.046+0000 7f1a23fff700 1 -- 172.21.15.84:0/844099299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3401ec50 con 0x7f1a3c1598e0 2023-10-06T02:58:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.046+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3c15a0c0 con 0x7f1a3c1598e0 2023-10-06T02:58:20.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.046+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c15a680 con 0x7f1a3c1598e0 2023-10-06T02:58:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.047+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3c064ad0 con 0x7f1a3c1598e0 2023-10-06T02:58:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.047+0000 7f1a23fff700 1 -- 172.21.15.84:0/844099299 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a34024070 con 0x7f1a3c1598e0 2023-10-06T02:58:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.047+0000 7f1a23fff700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a28066f30 0x7f1a280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.047+0000 7f1a23fff700 1 -- 172.21.15.84:0/844099299 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1a34087350 con 0x7f1a3c1598e0 2023-10-06T02:58:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.047+0000 7f1a3bfff700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a28066f30 0x7f1a280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.048+0000 7f1a3bfff700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a28066f30 0x7f1a280693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00a8c0 tx=0x7f1a2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:20.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.052+0000 7f1a23fff700 1 -- 172.21.15.84:0/844099299 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a340543d0 con 0x7f1a3c1598e0 2023-10-06T02:58:20.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.232+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a3c15ae10 con 0x7f1a3c1598e0 2023-10-06T02:58:20.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.232+0000 7f1a23fff700 1 -- 172.21.15.84:0/844099299 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a3401edb0 con 0x7f1a3c1598e0 2023-10-06T02:58:20.234 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:58:20.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a28066f30 msgr2=0x7f1a280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a28066f30 0x7f1a280693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00a8c0 tx=0x7f1a2c008040 comp rx=0 tx=0).stop 2023-10-06T02:58:20.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c1598e0 msgr2=0x7f1a3c0c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c1598e0 0x7f1a3c0c5a20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1a340097c0 tx=0x7f1a34018000 comp rx=0 tx=0).stop 2023-10-06T02:58:20.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 shutdown_connections 2023-10-06T02:58:20.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1a28066f30 0x7f1a280693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a3c1598e0 0x7f1a3c0c5a20 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1a3c0cbcb0 0x7f1a3c149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 --2- 172.21.15.84:0/844099299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c159510 0x7f1a3c157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 >> 172.21.15.84:0/844099299 conn(0x7f1a3c089e90 msgr2=0x7f1a3c0d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:20.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 shutdown_connections 2023-10-06T02:58:20.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.235+0000 7f1a4233b700 1 -- 172.21.15.84:0/844099299 wait complete. 2023-10-06T02:58:20.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:58:20.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.365+0000 7fd792435700 1 Processor -- start 2023-10-06T02:58:20.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.365+0000 7fd792435700 1 -- start start 2023-10-06T02:58:20.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.366+0000 7fd792435700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd78c159340 0x7fd78c0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.366+0000 7fd792435700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd78c159710 0x7fd78c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.366+0000 7fd792435700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78c0cbed0 con 0x7fd78c0cba70 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.366+0000 7fd792435700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c0cf820 con 0x7fd78c159340 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.366+0000 7fd792435700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c0cfb00 con 0x7fd78c159710 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.366+0000 7fd78bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd78c159340 0x7fd78c0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.366+0000 7fd78bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd78c159340 0x7fd78c0af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54116/0 (socket says 172.21.15.84:54116) 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.366+0000 7fd78bfff700 1 -- 172.21.15.84:0/2548361505 learned_addr learned my addr 172.21.15.84:0/2548361505 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd78b7fe700 1 --2- 172.21.15.84:0/2548361505 >> v2:172.21.15.131:3300/0 conn(0x7fd78c159710 0x7fd78c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd78bfff700 1 -- 172.21.15.84:0/2548361505 >> v2:172.21.15.131:3300/0 conn(0x7fd78c159710 msgr2=0x7fd78c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:20.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd78bfff700 1 --2- 172.21.15.84:0/2548361505 >> v2:172.21.15.131:3300/0 conn(0x7fd78c159710 0x7fd78c0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd78bfff700 1 -- 172.21.15.84:0/2548361505 >> v1:172.21.15.131:6789/0 conn(0x7fd78c0cba70 legacy=0x7fd78c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd78bfff700 1 -- 172.21.15.84:0/2548361505 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0cfde0 con 0x7fd78c159340 2023-10-06T02:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd78bfff700 1 --2- 172.21.15.84:0/2548361505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159340 0x7fd78c0af4d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0af410 tx=0x7fd77c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2918d0979415531 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd78affd700 1 -- 172.21.15.84:0/2548361505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c005c10 con 0x7fd78c159340 2023-10-06T02:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd78affd700 1 -- 172.21.15.84:0/2548361505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c005d70 con 0x7fd78c159340 2023-10-06T02:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd78affd700 1 -- 172.21.15.84:0/2548361505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00b880 con 0x7fd78c159340 2023-10-06T02:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.367+0000 7fd792435700 1 -- 172.21.15.84:0/2548361505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159340 msgr2=0x7fd78c0af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.368+0000 7fd792435700 1 --2- 172.21.15.84:0/2548361505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159340 0x7fd78c0af4d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd78c0af410 tx=0x7fd77c009220 comp rx=0 tx=0).stop 2023-10-06T02:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.368+0000 7fd792435700 1 -- 172.21.15.84:0/2548361505 shutdown_connections 2023-10-06T02:58:20.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.368+0000 7fd792435700 1 --2- 172.21.15.84:0/2548361505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159340 0x7fd78c0af4d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.368+0000 7fd792435700 1 --2- 172.21.15.84:0/2548361505 >> v2:172.21.15.131:3300/0 conn(0x7fd78c159710 0x7fd78c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.368+0000 7fd792435700 1 -- 172.21.15.84:0/2548361505 >> 172.21.15.84:0/2548361505 conn(0x7fd78c099720 msgr2=0x7fd78c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:20.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.368+0000 7fd792435700 1 -- 172.21.15.84:0/2548361505 shutdown_connections 2023-10-06T02:58:20.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.368+0000 7fd792435700 1 -- 172.21.15.84:0/2548361505 wait complete. 2023-10-06T02:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.369+0000 7fd792435700 1 Processor -- start 2023-10-06T02:58:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.369+0000 7fd792435700 1 -- start start 2023-10-06T02:58:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd792435700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd78c0cba70 0x7fd78c15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd792435700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd78c159340 0x7fd78c15e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd792435700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159710 0x7fd78c16f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd792435700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0c9c30 con 0x7fd78c159710 2023-10-06T02:58:20.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd792435700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c16f0b0 con 0x7fd78c159340 2023-10-06T02:58:20.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd792435700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0c9300 con 0x7fd78c0cba70 2023-10-06T02:58:20.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd7909d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159710 0x7fd78c16f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd7909d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159710 0x7fd78c16f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54132/0 (socket says 172.21.15.84:54132) 2023-10-06T02:58:20.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd7909d2700 1 -- 172.21.15.84:0/3170695766 learned_addr learned my addr 172.21.15.84:0/3170695766 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd78bfff700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd78c0cba70 0x7fd78c15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd78b7fe700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd78c159340 0x7fd78c15e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd7909d2700 1 -- 172.21.15.84:0/3170695766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd78c0cba70 msgr2=0x7fd78c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd7909d2700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd78c0cba70 0x7fd78c15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd7909d2700 1 -- 172.21.15.84:0/3170695766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd78c159340 msgr2=0x7fd78c15e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd7909d2700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd78c159340 0x7fd78c15e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd7909d2700 1 -- 172.21.15.84:0/3170695766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c009480 con 0x7fd78c159710 2023-10-06T02:58:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd78bfff700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd78c0cba70 0x7fd78c15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd7909d2700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159710 0x7fd78c16f4e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c8e0 tx=0x7fd784001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:20.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd773fff700 1 -- 172.21.15.84:0/3170695766 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78400ce80 con 0x7fd78c159710 2023-10-06T02:58:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd773fff700 1 -- 172.21.15.84:0/3170695766 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78400a7e0 con 0x7fd78c159710 2023-10-06T02:58:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd773fff700 1 -- 172.21.15.84:0/3170695766 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78400ab80 con 0x7fd78c159710 2023-10-06T02:58:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c0c95e0 con 0x7fd78c159710 2023-10-06T02:58:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.370+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c0ca0c0 con 0x7fd78c159710 2023-10-06T02:58:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.371+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c064ad0 con 0x7fd78c159710 2023-10-06T02:58:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.372+0000 7fd773fff700 1 -- 172.21.15.84:0/3170695766 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd784012420 con 0x7fd78c159710 2023-10-06T02:58:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.372+0000 7fd773fff700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd778066f30 0x7fd7780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.372+0000 7fd773fff700 1 -- 172.21.15.84:0/3170695766 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd784084990 con 0x7fd78c159710 2023-10-06T02:58:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.372+0000 7fd78bfff700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd778066f30 0x7fd7780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.372+0000 7fd78bfff700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd778066f30 0x7fd7780693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009260 tx=0x7fd77c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:20.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.376+0000 7fd773fff700 1 -- 172.21.15.84:0/3170695766 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd784051960 con 0x7fd78c159710 2023-10-06T02:58:20.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.557+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd78c0cbed0 con 0x7fd78c159710 2023-10-06T02:58:20.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.558+0000 7fd773fff700 1 -- 172.21.15.84:0/3170695766 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd78c0cbed0 con 0x7fd78c159710 2023-10-06T02:58:20.559 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:58:20.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd778066f30 msgr2=0x7fd7780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd778066f30 0x7fd7780693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009260 tx=0x7fd77c016000 comp rx=0 tx=0).stop 2023-10-06T02:58:20.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159710 msgr2=0x7fd78c16f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159710 0x7fd78c16f4e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c8e0 tx=0x7fd784001710 comp rx=0 tx=0).stop 2023-10-06T02:58:20.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 shutdown_connections 2023-10-06T02:58:20.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd778066f30 0x7fd7780693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c159710 0x7fd78c16f4e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd78c0cba70 0x7fd78c15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 --2- 172.21.15.84:0/3170695766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd78c159340 0x7fd78c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 >> 172.21.15.84:0/3170695766 conn(0x7fd78c099720 msgr2=0x7fd78c068cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:20.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 shutdown_connections 2023-10-06T02:58:20.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.560+0000 7fd792435700 1 -- 172.21.15.84:0/3170695766 wait complete. 2023-10-06T02:58:20.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:20.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.685+0000 7fc4c7fff700 1 Processor -- start 2023-10-06T02:58:20.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.685+0000 7fc4c7fff700 1 -- start start 2023-10-06T02:58:20.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4c7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4c8159950 0x7fc4c80ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4c7fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c80ae250 con 0x7fc4c80c6060 2023-10-06T02:58:20.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4c7fff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c80ad640 con 0x7fc4c8159580 2023-10-06T02:58:20.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4c7fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c80ad920 con 0x7fc4c8159950 2023-10-06T02:58:20.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4be7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4c8159950 0x7fc4c80ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4c77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc4c80c6060 0x7fc4c80ce890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54492/0 (socket says 172.21.15.84:54492) 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4be7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4c8159950 0x7fc4c80ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54134/0 (socket says 172.21.15.84:54134) 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4c77fe700 1 -- 172.21.15.84:0/3059861181 learned_addr learned my addr 172.21.15.84:0/3059861181 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4be7fc700 1 -- 172.21.15.84:0/3059861181 >> v1:172.21.15.131:6789/0 conn(0x7fc4c8159580 legacy=0x7fc4c80ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4be7fc700 1 -- 172.21.15.84:0/3059861181 >> v1:172.21.15.84:6789/0 conn(0x7fc4c80c6060 legacy=0x7fc4c80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4be7fc700 1 -- 172.21.15.84:0/3059861181 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80adc00 con 0x7fc4c8159950 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.686+0000 7fc4c67fc700 1 -- 172.21.15.84:0/3059861181 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786702012 0 0) 0x7fc4c80ae250 con 0x7fc4c80c6060 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4be7fc700 1 --2- 172.21.15.84:0/3059861181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c8159950 0x7fc4c80ae6e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00098e0 tx=0x7fc4b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8939d1e56d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c67fc700 1 -- 172.21.15.84:0/3059861181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0009e80 con 0x7fc4c8159950 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c67fc700 1 -- 172.21.15.84:0/3059861181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b000b860 con 0x7fc4c8159950 2023-10-06T02:58:20.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c67fc700 1 -- 172.21.15.84:0/3059861181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000bbe0 con 0x7fc4c8159950 2023-10-06T02:58:20.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c7fff700 1 -- 172.21.15.84:0/3059861181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c8159950 msgr2=0x7fc4c80ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c7fff700 1 --2- 172.21.15.84:0/3059861181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c8159950 0x7fc4c80ae6e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00098e0 tx=0x7fc4b00091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c7fff700 1 -- 172.21.15.84:0/3059861181 shutdown_connections 2023-10-06T02:58:20.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c7fff700 1 --2- 172.21.15.84:0/3059861181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c8159950 0x7fc4c80ae6e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c7fff700 1 -- 172.21.15.84:0/3059861181 >> 172.21.15.84:0/3059861181 conn(0x7fc4c8099560 msgr2=0x7fc4c806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:20.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c7fff700 1 -- 172.21.15.84:0/3059861181 shutdown_connections 2023-10-06T02:58:20.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.687+0000 7fc4c7fff700 1 -- 172.21.15.84:0/3059861181 wait complete. 2023-10-06T02:58:20.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.688+0000 7fc4c7fff700 1 Processor -- start 2023-10-06T02:58:20.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c7fff700 1 -- start start 2023-10-06T02:58:20.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c80c6060 0x7fc4c80ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4c8159580 0x7fc4c8169720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4c8159950 0x7fc4c809c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c7fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c8169c60 con 0x7fc4c80c6060 2023-10-06T02:58:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c7fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c809cab0 con 0x7fc4c8159580 2023-10-06T02:58:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c809cd90 con 0x7fc4c8159950 2023-10-06T02:58:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c80c6060 0x7fc4c80ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c80c6060 0x7fc4c80ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54140/0 (socket says 172.21.15.84:54140) 2023-10-06T02:58:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.689+0000 7fc4c6ffd700 1 -- 172.21.15.84:0/2068253051 learned_addr learned my addr 172.21.15.84:0/2068253051 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:20.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4be7fc700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4c8159580 0x7fc4c8169720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4c77fe700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4c8159950 0x7fc4c809c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4c6ffd700 1 -- 172.21.15.84:0/2068253051 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4c8159950 msgr2=0x7fc4c809c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4c6ffd700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4c8159950 0x7fc4c809c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4c6ffd700 1 -- 172.21.15.84:0/2068253051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4c8159580 msgr2=0x7fc4c8169720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4c6ffd700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4c8159580 0x7fc4c8169720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4c6ffd700 1 -- 172.21.15.84:0/2068253051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0009420 con 0x7fc4c80c6060 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4c6ffd700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c80c6060 0x7fc4c80ca200 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800c790 tx=0x7fc4b8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4bf7fe700 1 -- 172.21.15.84:0/2068253051 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8006820 con 0x7fc4c80c6060 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4bf7fe700 1 -- 172.21.15.84:0/2068253051 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b8006980 con 0x7fc4c80c6060 2023-10-06T02:58:20.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c809d070 con 0x7fc4c80c6060 2023-10-06T02:58:20.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4bf7fe700 1 -- 172.21.15.84:0/2068253051 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8006d40 con 0x7fc4c80c6060 2023-10-06T02:58:20.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.690+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c809d630 con 0x7fc4c80c6060 2023-10-06T02:58:20.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.691+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c805f270 con 0x7fc4c80c6060 2023-10-06T02:58:20.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.691+0000 7fc4bf7fe700 1 -- 172.21.15.84:0/2068253051 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4b8007240 con 0x7fc4c80c6060 2023-10-06T02:58:20.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.692+0000 7fc4bf7fe700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc4a8066f30 0x7fc4a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:20.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.692+0000 7fc4bf7fe700 1 -- 172.21.15.84:0/2068253051 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc4b8083d40 con 0x7fc4c80c6060 2023-10-06T02:58:20.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.692+0000 7fc4be7fc700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc4a8066f30 0x7fc4a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:20.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.692+0000 7fc4be7fc700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc4a8066f30 0x7fc4a80693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00093f0 tx=0x7fc4b0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:20.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.696+0000 7fc4bf7fe700 1 -- 172.21.15.84:0/2068253051 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4b8050d10 con 0x7fc4c80c6060 2023-10-06T02:58:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.921+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4c81592f0 con 0x7fc4c80c6060 2023-10-06T02:58:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.922+0000 7fc4bf7fe700 1 -- 172.21.15.84:0/2068253051 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4637 (secure 0 0 0) 0x7fc4b8017070 con 0x7fc4c80c6060 2023-10-06T02:58:20.922 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:20.923 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:58:06.271875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:58:20.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.923+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc4a8066f30 msgr2=0x7fc4a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.923+0000 7fc4c7fff700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc4a8066f30 0x7fc4a80693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00093f0 tx=0x7fc4b0017000 comp rx=0 tx=0).stop 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.923+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c80c6060 msgr2=0x7fc4c80ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.923+0000 7fc4c7fff700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c80c6060 0x7fc4c80ca200 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800c790 tx=0x7fc4b8007f60 comp rx=0 tx=0).stop 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.923+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 shutdown_connections 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.923+0000 7fc4c7fff700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc4a8066f30 0x7fc4a80693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.923+0000 7fc4c7fff700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc4c8159950 0x7fc4c809c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.923+0000 7fc4c7fff700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c80c6060 0x7fc4c80ca200 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.923+0000 7fc4c7fff700 1 --2- 172.21.15.84:0/2068253051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4c8159580 0x7fc4c8169720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.924+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 >> 172.21.15.84:0/2068253051 conn(0x7fc4c8099560 msgr2=0x7fc4c80b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.924+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 shutdown_connections 2023-10-06T02:58:20.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:20.924+0000 7fc4c7fff700 1 -- 172.21.15.84:0/2068253051 wait complete. 2023-10-06T02:58:20.926 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 44 2023-10-06T02:58:20.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:58:21.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.050+0000 7f90c63d2700 1 Processor -- start 2023-10-06T02:58:21.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.050+0000 7f90c63d2700 1 -- start start 2023-10-06T02:58:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.050+0000 7f90c63d2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c01595a0 0x7f90c00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.050+0000 7f90c63d2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f90c00b07a0 0x7f90c00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.050+0000 7f90c63d2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c00b0ca0 con 0x7f90c00b49e0 2023-10-06T02:58:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.050+0000 7f90c63d2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c00b0f80 con 0x7f90c00b07a0 2023-10-06T02:58:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.050+0000 7f90c63d2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00b1260 con 0x7f90c01595a0 2023-10-06T02:58:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90bf7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f90c00b49e0 0x7f90c00aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54496/0 (socket says 172.21.15.84:54496) 2023-10-06T02:58:21.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90bf7fe700 1 -- 172.21.15.84:0/2953877160 learned_addr learned my addr 172.21.15.84:0/2953877160 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90bffff700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c01595a0 0x7f90c00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90c496f700 1 --2- 172.21.15.84:0/2953877160 >> v2:172.21.15.131:3300/0 conn(0x7f90c00b07a0 0x7f90c00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164428105 0 0) 0x7f90c00b0ca0 con 0x7f90c00b49e0 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a8003570 con 0x7f90c00b49e0 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 911643771 0 0) 0x7f90a8003570 con 0x7f90c00b49e0 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c01595a0 msgr2=0x7f90c00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c01595a0 0x7f90c00aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 >> v2:172.21.15.131:3300/0 conn(0x7f90c00b07a0 msgr2=0x7f90c00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 --2- 172.21.15.84:0/2953877160 >> v2:172.21.15.131:3300/0 conn(0x7f90c00b07a0 0x7f90c00b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00b1540 con 0x7f90c00b49e0 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f90b4001470 con 0x7f90c00b49e0 2023-10-06T02:58:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 >> v1:172.21.15.84:6789/0 conn(0x7f90c00b49e0 legacy=0x7f90c00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c01595a0 0x7f90a8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a8003fe0 0x7f90a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90a8004d50 0x7f90a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00b0f80 con 0x7f90a8004d50 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00b1260 con 0x7f90a8003fe0 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a800ba90 con 0x7f90c01595a0 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90c496f700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90a8004d50 0x7f90a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90bf7fe700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a8003fe0 0x7f90a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.051+0000 7f90bffff700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c01595a0 0x7f90a8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c496f700 1 -- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c01595a0 msgr2=0x7f90a8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c496f700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c01595a0 0x7f90a8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c496f700 1 -- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a8003fe0 msgr2=0x7f90a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c496f700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a8003fe0 0x7f90a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c496f700 1 -- 172.21.15.84:0/2953877160 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8003570 con 0x7f90a8004d50 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c496f700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90a8004d50 0x7f90a80051c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f90b800e210 tx=0x7f90b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a5e0b781f343aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800ea60 con 0x7f90a8004d50 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b800f040 con 0x7f90a8004d50 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90beffd700 1 -- 172.21.15.84:0/2953877160 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800ee10 con 0x7f90a8004d50 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c63d2700 1 -- 172.21.15.84:0/2953877160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90a8004d50 msgr2=0x7f90a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c63d2700 1 --2- 172.21.15.84:0/2953877160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90a8004d50 0x7f90a80051c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f90b800e210 tx=0x7f90b800b040 comp rx=0 tx=0).stop 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c496f700 1 -- 172.21.15.84:0/2953877160 reap_dead start 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c63d2700 1 -- 172.21.15.84:0/2953877160 shutdown_connections 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c63d2700 1 -- 172.21.15.84:0/2953877160 >> 172.21.15.84:0/2953877160 conn(0x7f90c0099830 msgr2=0x7f90c006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:21.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c63d2700 1 -- 172.21.15.84:0/2953877160 shutdown_connections 2023-10-06T02:58:21.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.052+0000 7f90c63d2700 1 -- 172.21.15.84:0/2953877160 wait complete. 2023-10-06T02:58:21.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.053+0000 7f90c63d2700 1 Processor -- start 2023-10-06T02:58:21.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90c63d2700 1 -- start start 2023-10-06T02:58:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90c63d2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c0157c80 0x7f90c009d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90c63d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90c009d5b0 0x7f90c0169a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90c63d2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90c0169fb0 0x7f90c00c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90c63d2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c009da20 con 0x7f90c009d5b0 2023-10-06T02:58:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90c63d2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c016a7a0 con 0x7f90c0169fb0 2023-10-06T02:58:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90c63d2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00c5270 con 0x7f90c0157c80 2023-10-06T02:58:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90bf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90c009d5b0 0x7f90c0169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90bf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90c009d5b0 0x7f90c0169a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54156/0 (socket says 172.21.15.84:54156) 2023-10-06T02:58:21.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.054+0000 7f90bf7fe700 1 -- 172.21.15.84:0/3592134086 learned_addr learned my addr 172.21.15.84:0/3592134086 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90bffff700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c0157c80 0x7f90c009d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90c496f700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90c0169fb0 0x7f90c00c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90bf7fe700 1 -- 172.21.15.84:0/3592134086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c0157c80 msgr2=0x7f90c009d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90bf7fe700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c0157c80 0x7f90c009d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90bf7fe700 1 -- 172.21.15.84:0/3592134086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90c0169fb0 msgr2=0x7f90c00c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90bf7fe700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90c0169fb0 0x7f90c00c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90bf7fe700 1 -- 172.21.15.84:0/3592134086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00c5550 con 0x7f90c009d5b0 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90bf7fe700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90c009d5b0 0x7f90c0169a70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f90b4007390 tx=0x7f90b4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90a7fff700 1 -- 172.21.15.84:0/3592134086 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4018030 con 0x7f90c009d5b0 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90a7fff700 1 -- 172.21.15.84:0/3592134086 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4007770 con 0x7f90c009d5b0 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c00c5830 con 0x7f90c009d5b0 2023-10-06T02:58:21.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90a7fff700 1 -- 172.21.15.84:0/3592134086 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400fb20 con 0x7f90c009d5b0 2023-10-06T02:58:21.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.055+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c0158050 con 0x7f90c009d5b0 2023-10-06T02:58:21.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.056+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c00c5d50 con 0x7f90c009d5b0 2023-10-06T02:58:21.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.056+0000 7f90a7fff700 1 -- 172.21.15.84:0/3592134086 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90b401b070 con 0x7f90c009d5b0 2023-10-06T02:58:21.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.057+0000 7f90a7fff700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90ac066f30 0x7f90ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.057+0000 7f90a7fff700 1 -- 172.21.15.84:0/3592134086 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f90b4019070 con 0x7f90c009d5b0 2023-10-06T02:58:21.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.057+0000 7f90bffff700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90ac066f30 0x7f90ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.057+0000 7f90bffff700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90ac066f30 0x7f90ac0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f90c009dc20 tx=0x7f90b0009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:21.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.061+0000 7f90a7fff700 1 -- 172.21.15.84:0/3592134086 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90c00c5d50 con 0x7f90c009d5b0 2023-10-06T02:58:21.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.246+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90c00c5d50 con 0x7f90c009d5b0 2023-10-06T02:58:21.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.247+0000 7f90a7fff700 1 -- 172.21.15.84:0/3592134086 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f90c00c5d50 con 0x7f90c009d5b0 2023-10-06T02:58:21.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:21.248 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":56,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:57:30.140568+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:26.170794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:27.492251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:58:21.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90ac066f30 msgr2=0x7f90ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90ac066f30 0x7f90ac0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f90c009dc20 tx=0x7f90b0009120 comp rx=0 tx=0).stop 2023-10-06T02:58:21.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90c009d5b0 msgr2=0x7f90c0169a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90c009d5b0 0x7f90c0169a70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f90b4007390 tx=0x7f90b4001e90 comp rx=0 tx=0).stop 2023-10-06T02:58:21.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 shutdown_connections 2023-10-06T02:58:21.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90ac066f30 0x7f90ac0693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90c0169fb0 0x7f90c00c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f90c0157c80 0x7f90c009d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 --2- 172.21.15.84:0/3592134086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90c009d5b0 0x7f90c0169a70 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 >> 172.21.15.84:0/3592134086 conn(0x7f90c0099830 msgr2=0x7f90c00ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:21.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 shutdown_connections 2023-10-06T02:58:21.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.249+0000 7f90c63d2700 1 -- 172.21.15.84:0/3592134086 wait complete. 2023-10-06T02:58:21.261 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:58:21.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:21.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.376+0000 7f84fd71c700 1 Processor -- start 2023-10-06T02:58:21.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.376+0000 7f84fd71c700 1 -- start start 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84fd71c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84f80b07a0 0x7f84f80ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84fd71c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f80b0ca0 con 0x7f84f80b49e0 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84fd71c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f80b0f80 con 0x7f84f81595a0 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84fd71c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f80ab390 con 0x7f84f80b07a0 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84ee7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f84f80b49e0 0x7f84f80aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54504/0 (socket says 172.21.15.84:54504) 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84ee7fc700 1 -- 172.21.15.84:0/1557569459 learned_addr learned my addr 172.21.15.84:0/1557569459 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f77fe700 1 --2- 172.21.15.84:0/1557569459 >> v2:172.21.15.131:3300/0 conn(0x7f84f80b07a0 0x7f84f80ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943386522 0 0) 0x7f84f80b0ca0 con 0x7f84f80b49e0 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e4003570 con 0x7f84f80b49e0 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578041925 0 0) 0x7f84e4003570 con 0x7f84f80b49e0 2023-10-06T02:58:21.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 >> v2:172.21.15.131:3300/0 conn(0x7f84f80b07a0 msgr2=0x7f84f80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 --2- 172.21.15.84:0/1557569459 >> v2:172.21.15.131:3300/0 conn(0x7f84f80b07a0 0x7f84f80ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 >> v1:172.21.15.131:6789/0 conn(0x7f84f81595a0 legacy=0x7f84f80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f80b1260 con 0x7f84f80b49e0 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f84e0001470 con 0x7f84f80b49e0 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 >> v1:172.21.15.84:6789/0 conn(0x7f84f80b49e0 legacy=0x7f84f80aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e4003a60 0x7f84e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84e4004810 0x7f84e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e40051c0 0x7f84e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80ab390 con 0x7f84e40051c0 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e400c0d0 con 0x7f84e4003a60 2023-10-06T02:58:21.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e400c290 con 0x7f84e4004810 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f77fe700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e40051c0 0x7f84e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.377+0000 7f84f6ffd700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e4003a60 0x7f84e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84ee7fc700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84e4004810 0x7f84e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f77fe700 1 -- 172.21.15.84:0/1557569459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84e4004810 msgr2=0x7f84e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f77fe700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84e4004810 0x7f84e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f77fe700 1 -- 172.21.15.84:0/1557569459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e4003a60 msgr2=0x7f84e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f77fe700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e4003a60 0x7f84e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f77fe700 1 -- 172.21.15.84:0/1557569459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4003570 con 0x7f84e40051c0 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84ee7fc700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84e4004810 0x7f84e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f77fe700 1 -- 172.21.15.84:0/1557569459 reap_dead start 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f77fe700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e40051c0 0x7f84e400ba60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f84f000e210 tx=0x7f84f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6c2c312fe5f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:21.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000eac0 con 0x7f84e40051c0 2023-10-06T02:58:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f000f040 con 0x7f84e40051c0 2023-10-06T02:58:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84f67fc700 1 -- 172.21.15.84:0/1557569459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000ee70 con 0x7f84e40051c0 2023-10-06T02:58:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84fd71c700 1 -- 172.21.15.84:0/1557569459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e40051c0 msgr2=0x7f84e400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84fd71c700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e40051c0 0x7f84e400ba60 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f84f000e210 tx=0x7f84f000b040 comp rx=0 tx=0).stop 2023-10-06T02:58:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84fd71c700 1 -- 172.21.15.84:0/1557569459 shutdown_connections 2023-10-06T02:58:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84fd71c700 1 --2- 172.21.15.84:0/1557569459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e40051c0 0x7f84e400ba60 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.378+0000 7f84fd71c700 1 -- 172.21.15.84:0/1557569459 >> 172.21.15.84:0/1557569459 conn(0x7f84f8099830 msgr2=0x7f84f806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.379+0000 7f84fd71c700 1 -- 172.21.15.84:0/1557569459 shutdown_connections 2023-10-06T02:58:21.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.379+0000 7f84fd71c700 1 -- 172.21.15.84:0/1557569459 wait complete. 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.380+0000 7f84fd71c700 1 Processor -- start 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.380+0000 7f84fd71c700 1 -- start start 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.380+0000 7f84fd71c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e40051c0 0x7f84f8157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.380+0000 7f84fd71c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f80cd7b0 0x7f84f8157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.380+0000 7f84fd71c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f8169dc0 0x7f84f816a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.380+0000 7f84fd71c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8151b20 con 0x7f84f80cd7b0 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.380+0000 7f84fd71c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80cdd70 con 0x7f84e40051c0 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.380+0000 7f84fd71c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80ce050 con 0x7f84f8169dc0 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ee7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f80cd7b0 0x7f84f8157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ee7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f80cd7b0 0x7f84f8157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54182/0 (socket says 172.21.15.84:54182) 2023-10-06T02:58:21.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ee7fc700 1 -- 172.21.15.84:0/4196380275 learned_addr learned my addr 172.21.15.84:0/4196380275 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84f6ffd700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e40051c0 0x7f84f8157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84f77fe700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f8169dc0 0x7f84f816a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ee7fc700 1 -- 172.21.15.84:0/4196380275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f8169dc0 msgr2=0x7f84f816a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ee7fc700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f8169dc0 0x7f84f816a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ee7fc700 1 -- 172.21.15.84:0/4196380275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e40051c0 msgr2=0x7f84f8157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ee7fc700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e40051c0 0x7f84f8157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ee7fc700 1 -- 172.21.15.84:0/4196380275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f80ce330 con 0x7f84f80cd7b0 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ee7fc700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f80cd7b0 0x7f84f8157c90 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f84e000eb00 tx=0x7f84e0000d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ef7fe700 1 -- 172.21.15.84:0/4196380275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000a550 con 0x7f84f80cd7b0 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ef7fe700 1 -- 172.21.15.84:0/4196380275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0010040 con 0x7f84f80cd7b0 2023-10-06T02:58:21.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84ef7fe700 1 -- 172.21.15.84:0/4196380275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000a8e0 con 0x7f84f80cd7b0 2023-10-06T02:58:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f80ce610 con 0x7f84f80cd7b0 2023-10-06T02:58:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.381+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f816a9c0 con 0x7f84f80cd7b0 2023-10-06T02:58:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.382+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f8151c60 con 0x7f84f80cd7b0 2023-10-06T02:58:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.383+0000 7f84ef7fe700 1 -- 172.21.15.84:0/4196380275 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84e00143f0 con 0x7f84f80cd7b0 2023-10-06T02:58:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.383+0000 7f84ef7fe700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f84d8066f30 0x7f84d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.383+0000 7f84ef7fe700 1 -- 172.21.15.84:0/4196380275 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f84e0083d50 con 0x7f84f80cd7b0 2023-10-06T02:58:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.383+0000 7f84f6ffd700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f84d8066f30 0x7f84d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.383+0000 7f84f6ffd700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f84d8066f30 0x7f84d80693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f84e8007e90 tx=0x7f84e8007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:21.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.387+0000 7f84ef7fe700 1 -- 172.21.15.84:0/4196380275 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84e004d5a0 con 0x7f84f80cd7b0 2023-10-06T02:58:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.609+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84f8064ad0 con 0x7f84f80cd7b0 2023-10-06T02:58:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.610+0000 7f84ef7fe700 1 -- 172.21.15.84:0/4196380275 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4637 (secure 0 0 0) 0x7f84e0019070 con 0x7f84f80cd7b0 2023-10-06T02:58:21.611 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:21.611 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:58:06.271875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:58:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f84d8066f30 msgr2=0x7f84d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f84d8066f30 0x7f84d80693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f84e8007e90 tx=0x7f84e8007d80 comp rx=0 tx=0).stop 2023-10-06T02:58:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f80cd7b0 msgr2=0x7f84f8157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f80cd7b0 0x7f84f8157c90 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f84e000eb00 tx=0x7f84e0000d70 comp rx=0 tx=0).stop 2023-10-06T02:58:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 shutdown_connections 2023-10-06T02:58:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f84d8066f30 0x7f84d80693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84e40051c0 0x7f84f8157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f8169dc0 0x7f84f816a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 --2- 172.21.15.84:0/4196380275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84f80cd7b0 0x7f84f8157c90 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 >> 172.21.15.84:0/4196380275 conn(0x7f84f8099830 msgr2=0x7f84f80aa830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 shutdown_connections 2023-10-06T02:58:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.612+0000 7f84fd71c700 1 -- 172.21.15.84:0/4196380275 wait complete. 2023-10-06T02:58:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 44 2023-10-06T02:58:21.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.738+0000 7fd40c767700 1 Processor -- start 2023-10-06T02:58:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.738+0000 7fd40c767700 1 -- start start 2023-10-06T02:58:21.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40c767700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 0x7fd4040aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40c767700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd4040b07a0 0x7fd4040b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40c767700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4040b0ca0 con 0x7fd4041595a0 2023-10-06T02:58:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40c767700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4040b0f80 con 0x7fd4040b07a0 2023-10-06T02:58:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40c767700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040b1260 con 0x7fd4040b49e0 2023-10-06T02:58:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40ad04700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd4040b07a0 0x7fd4040b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40ad04700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd4040b07a0 0x7fd4040b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54184/0 (socket says 172.21.15.84:54184) 2023-10-06T02:58:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40ad04700 1 -- 172.21.15.84:0/3415964696 learned_addr learned my addr 172.21.15.84:0/3415964696 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd409d02700 1 --2- 172.21.15.84:0/3415964696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 0x7fd4040aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40ad04700 1 -- 172.21.15.84:0/3415964696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 msgr2=0x7fd4040aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:21.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40ad04700 1 --2- 172.21.15.84:0/3415964696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 0x7fd4040aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40ad04700 1 -- 172.21.15.84:0/3415964696 >> v1:172.21.15.131:6789/0 conn(0x7fd4041595a0 legacy=0x7fd4040aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40ad04700 1 -- 172.21.15.84:0/3415964696 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4040b1540 con 0x7fd4040b07a0 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd40ad04700 1 --2- 172.21.15.84:0/3415964696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 0x7fd4040b1c00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009f20 tx=0x7fd3fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cdfa0a2280bb26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.739+0000 7fd409501700 1 -- 172.21.15.84:0/3415964696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00e070 con 0x7fd4040b07a0 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd409501700 1 -- 172.21.15.84:0/3415964696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc00b9d0 con 0x7fd4040b07a0 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd409501700 1 -- 172.21.15.84:0/3415964696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0092e0 con 0x7fd4040b07a0 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd40c767700 1 -- 172.21.15.84:0/3415964696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 msgr2=0x7fd4040b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd40c767700 1 --2- 172.21.15.84:0/3415964696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 0x7fd4040b1c00 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009f20 tx=0x7fd3fc009840 comp rx=0 tx=0).stop 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd40c767700 1 -- 172.21.15.84:0/3415964696 shutdown_connections 2023-10-06T02:58:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd40c767700 1 --2- 172.21.15.84:0/3415964696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 0x7fd4040b1c00 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd40c767700 1 --2- 172.21.15.84:0/3415964696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 0x7fd4040aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd40c767700 1 -- 172.21.15.84:0/3415964696 >> 172.21.15.84:0/3415964696 conn(0x7fd404099830 msgr2=0x7fd40406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd40c767700 1 -- 172.21.15.84:0/3415964696 shutdown_connections 2023-10-06T02:58:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.740+0000 7fd40c767700 1 -- 172.21.15.84:0/3415964696 wait complete. 2023-10-06T02:58:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.741+0000 7fd40c767700 1 Processor -- start 2023-10-06T02:58:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.741+0000 7fd40c767700 1 -- start start 2023-10-06T02:58:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40c767700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 0x7fd4041588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40c767700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 0x7fd40415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40c767700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4041595a0 0x7fd40415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40c767700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40415a380 con 0x7fd4040b07a0 2023-10-06T02:58:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40c767700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40415a620 con 0x7fd4041595a0 2023-10-06T02:58:21.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40c767700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40415a900 con 0x7fd4040b49e0 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40a503700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 0x7fd4041588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40a503700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 0x7fd4041588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54188/0 (socket says 172.21.15.84:54188) 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40a503700 1 -- 172.21.15.84:0/845805555 learned_addr learned my addr 172.21.15.84:0/845805555 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40ad04700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4041595a0 0x7fd40415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd409d02700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 0x7fd40415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40a503700 1 -- 172.21.15.84:0/845805555 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 msgr2=0x7fd40415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40a503700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 0x7fd40415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40a503700 1 -- 172.21.15.84:0/845805555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4041595a0 msgr2=0x7fd40415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40a503700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4041595a0 0x7fd40415cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40a503700 1 -- 172.21.15.84:0/845805555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc009ae0 con 0x7fd4040b07a0 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.742+0000 7fd40a503700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 0x7fd4041588c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c540 tx=0x7fd400001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:21.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.743+0000 7fd3fa7fc700 1 -- 172.21.15.84:0/845805555 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400011590 con 0x7fd4040b07a0 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.743+0000 7fd3fa7fc700 1 -- 172.21.15.84:0/845805555 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4000116f0 con 0x7fd4040b07a0 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.743+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40415abe0 con 0x7fd4040b07a0 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.743+0000 7fd3fa7fc700 1 -- 172.21.15.84:0/845805555 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400011ab0 con 0x7fd4040b07a0 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.743+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40415b1a0 con 0x7fd4040b07a0 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.744+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd404064ad0 con 0x7fd4040b07a0 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.744+0000 7fd3fa7fc700 1 -- 172.21.15.84:0/845805555 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd40001b3b0 con 0x7fd4040b07a0 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.744+0000 7fd3fa7fc700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd3e8066f30 0x7fd3e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.744+0000 7fd3fa7fc700 1 -- 172.21.15.84:0/845805555 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd400083ca0 con 0x7fd4040b07a0 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.744+0000 7fd409d02700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd3e8066f30 0x7fd3e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:21.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.745+0000 7fd409d02700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd3e8066f30 0x7fd3e80693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd4040cfe70 tx=0x7fd3f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:21.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.749+0000 7fd3fa7fc700 1 -- 172.21.15.84:0/845805555 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd400050d20 con 0x7fd4040b07a0 2023-10-06T02:58:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.975+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4040b1820 con 0x7fd4040b07a0 2023-10-06T02:58:21.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.976+0000 7fd3fa7fc700 1 -- 172.21.15.84:0/845805555 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4637 (secure 0 0 0) 0x7fd400017070 con 0x7fd4040b07a0 2023-10-06T02:58:21.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:21.976 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:57:28.525780+0000","modified":"2023-10-06T02:58:06.271875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5781,"mds_1":5778,"mds_2":5377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5377":{"gid":5377,"name":"b","rank":2,"incarnation":38,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/802742000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":802742000},{"type":"v1","addr":"172.21.15.131:6835","nonce":802742000}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5778":{"gid":5778,"name":"c","rank":1,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6837/4228087397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":4228087397},{"type":"v1","addr":"172.21.15.84:6837","nonce":4228087397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5781":{"gid":5781,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":14,"addr":"172.21.15.84:6836/1444717080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1444717080},{"type":"v1","addr":"172.21.15.84:6836","nonce":1444717080}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd3e8066f30 msgr2=0x7fd3e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd3e8066f30 0x7fd3e80693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd4040cfe70 tx=0x7fd3f4008040 comp rx=0 tx=0).stop 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 msgr2=0x7fd4041588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 0x7fd4041588c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c540 tx=0x7fd400001070 comp rx=0 tx=0).stop 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 shutdown_connections 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd3e8066f30 0x7fd3e80693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4041595a0 0x7fd40415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4040b07a0 0x7fd4041588c0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 --2- 172.21.15.84:0/845805555 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4040b49e0 0x7fd40415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 >> 172.21.15.84:0/845805555 conn(0x7fd404099830 msgr2=0x7fd404069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 shutdown_connections 2023-10-06T02:58:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:21.978+0000 7fd40c767700 1 -- 172.21.15.84:0/845805555 wait complete. 2023-10-06T02:58:21.980 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 44 2023-10-06T02:58:21.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:58:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.103+0000 7fdabc674700 1 Processor -- start 2023-10-06T02:58:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.103+0000 7fdabc674700 1 -- start start 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.104+0000 7fdabc674700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdab41595a0 0x7fdab40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.104+0000 7fdabc674700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdab40b07a0 0x7fdab40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.104+0000 7fdabc674700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab40b0ca0 con 0x7fdab40b49e0 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.104+0000 7fdabc674700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab40b0f80 con 0x7fdab40b07a0 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.104+0000 7fdabc674700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab40b1260 con 0x7fdab41595a0 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.104+0000 7fdabac11700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdab40b07a0 0x7fdab40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdab9c0f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdab40b49e0 0x7fdab40aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54518/0 (socket says 172.21.15.84:54518) 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdabac11700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdab40b07a0 0x7fdab40b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54200/0 (socket says 172.21.15.84:54200) 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdab9c0f700 1 -- 172.21.15.84:0/2312417925 learned_addr learned my addr 172.21.15.84:0/2312417925 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdaba410700 1 --2- 172.21.15.84:0/2312417925 >> v2:172.21.15.131:3300/0 conn(0x7fdab41595a0 0x7fdab40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdabac11700 1 -- 172.21.15.84:0/2312417925 >> v2:172.21.15.131:3300/0 conn(0x7fdab41595a0 msgr2=0x7fdab40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdabac11700 1 --2- 172.21.15.84:0/2312417925 >> v2:172.21.15.131:3300/0 conn(0x7fdab41595a0 0x7fdab40aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdabac11700 1 -- 172.21.15.84:0/2312417925 >> v1:172.21.15.84:6789/0 conn(0x7fdab40b49e0 legacy=0x7fdab40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdab940e700 1 -- 172.21.15.84:0/2312417925 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647127367 0 0) 0x7fdab40b0ca0 con 0x7fdab40b49e0 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdabac11700 1 -- 172.21.15.84:0/2312417925 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40b1540 con 0x7fdab40b07a0 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdabac11700 1 --2- 172.21.15.84:0/2312417925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b07a0 0x7fdab40b1c00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0098e0 tx=0x7fdaac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4df24591854cb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdab940e700 1 -- 172.21.15.84:0/2312417925 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac009e80 con 0x7fdab40b07a0 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdab940e700 1 -- 172.21.15.84:0/2312417925 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac00b820 con 0x7fdab40b07a0 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.105+0000 7fdab940e700 1 -- 172.21.15.84:0/2312417925 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00bba0 con 0x7fdab40b07a0 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.106+0000 7fdabc674700 1 -- 172.21.15.84:0/2312417925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b07a0 msgr2=0x7fdab40b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.106+0000 7fdabc674700 1 --2- 172.21.15.84:0/2312417925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b07a0 0x7fdab40b1c00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0098e0 tx=0x7fdaac0091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.106+0000 7fdabc674700 1 -- 172.21.15.84:0/2312417925 shutdown_connections 2023-10-06T02:58:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.106+0000 7fdabc674700 1 --2- 172.21.15.84:0/2312417925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b07a0 0x7fdab40b1c00 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.106+0000 7fdabc674700 1 --2- 172.21.15.84:0/2312417925 >> v2:172.21.15.131:3300/0 conn(0x7fdab41595a0 0x7fdab40aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.106+0000 7fdabc674700 1 -- 172.21.15.84:0/2312417925 >> 172.21.15.84:0/2312417925 conn(0x7fdab4099830 msgr2=0x7fdab406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.106+0000 7fdabc674700 1 -- 172.21.15.84:0/2312417925 shutdown_connections 2023-10-06T02:58:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.106+0000 7fdabc674700 1 -- 172.21.15.84:0/2312417925 wait complete. 2023-10-06T02:58:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.107+0000 7fdabc674700 1 Processor -- start 2023-10-06T02:58:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.107+0000 7fdabc674700 1 -- start start 2023-10-06T02:58:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.107+0000 7fdabc674700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab40b07a0 0x7fdab415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.107+0000 7fdabc674700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b49e0 0x7fdab41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.107+0000 7fdabc674700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdab41595a0 0x7fdab40ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.107+0000 7fdabc674700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab409b030 con 0x7fdab40b49e0 2023-10-06T02:58:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.107+0000 7fdabc674700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab409a420 con 0x7fdab40b07a0 2023-10-06T02:58:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.107+0000 7fdabc674700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab409a700 con 0x7fdab41595a0 2023-10-06T02:58:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdab9c0f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b49e0 0x7fdab41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdab9c0f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b49e0 0x7fdab41587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54216/0 (socket says 172.21.15.84:54216) 2023-10-06T02:58:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdab9c0f700 1 -- 172.21.15.84:0/1684037589 learned_addr learned my addr 172.21.15.84:0/1684037589 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdaba410700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab40b07a0 0x7fdab415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdabac11700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdab41595a0 0x7fdab40ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdab9c0f700 1 -- 172.21.15.84:0/1684037589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdab41595a0 msgr2=0x7fdab40ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdab9c0f700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdab41595a0 0x7fdab40ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdab9c0f700 1 -- 172.21.15.84:0/1684037589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab40b07a0 msgr2=0x7fdab415bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdab9c0f700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab40b07a0 0x7fdab415bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdab9c0f700 1 -- 172.21.15.84:0/1684037589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac009420 con 0x7fdab40b49e0 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdabac11700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdab41595a0 0x7fdab40ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdab9c0f700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b49e0 0x7fdab41587d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c7e0 tx=0x7fdaa4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdaaa7fc700 1 -- 172.21.15.84:0/1684037589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4005c00 con 0x7fdab40b49e0 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdaaa7fc700 1 -- 172.21.15.84:0/1684037589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4005d60 con 0x7fdab40b49e0 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdaaa7fc700 1 -- 172.21.15.84:0/1684037589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40072e0 con 0x7fdab40b49e0 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab409a9e0 con 0x7fdab40b49e0 2023-10-06T02:58:22.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.108+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab415c260 con 0x7fdab40b49e0 2023-10-06T02:58:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.109+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab409b1e0 con 0x7fdab40b49e0 2023-10-06T02:58:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.109+0000 7fdaaa7fc700 1 -- 172.21.15.84:0/1684037589 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdaa401b3b0 con 0x7fdab40b49e0 2023-10-06T02:58:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.110+0000 7fdaaa7fc700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda98066f30 0x7fda980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.110+0000 7fdaaa7fc700 1 -- 172.21.15.84:0/1684037589 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdaa4083bc0 con 0x7fdab40b49e0 2023-10-06T02:58:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.110+0000 7fdaba410700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda98066f30 0x7fda980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.110+0000 7fdaba410700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda98066f30 0x7fda980693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009fd0 tx=0x7fdab0009800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:22.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.114+0000 7fdaaa7fc700 1 -- 172.21.15.84:0/1684037589 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdaa404b5a0 con 0x7fdab40b49e0 2023-10-06T02:58:22.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.304+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdab4064ad0 con 0x7fdab40b49e0 2023-10-06T02:58:22.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.305+0000 7fdaaa7fc700 1 -- 172.21.15.84:0/1684037589 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fdaa4017020 con 0x7fdab40b49e0 2023-10-06T02:58:22.306 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:22.306 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":56,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:57:30.140568+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:57:26.170794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T02:57:27.492251+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:58:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda98066f30 msgr2=0x7fda980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda98066f30 0x7fda980693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009fd0 tx=0x7fdab0009800 comp rx=0 tx=0).stop 2023-10-06T02:58:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b49e0 msgr2=0x7fdab41587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b49e0 0x7fdab41587d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c7e0 tx=0x7fdaa4007d90 comp rx=0 tx=0).stop 2023-10-06T02:58:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 shutdown_connections 2023-10-06T02:58:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda98066f30 0x7fda980693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab40b07a0 0x7fdab415bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdab41595a0 0x7fdab40ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 --2- 172.21.15.84:0/1684037589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdab40b49e0 0x7fdab41587d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 >> 172.21.15.84:0/1684037589 conn(0x7fdab4099830 msgr2=0x7fdab4068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:22.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 shutdown_connections 2023-10-06T02:58:22.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.307+0000 7fdabc674700 1 -- 172.21.15.84:0/1684037589 wait complete. 2023-10-06T02:58:22.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:58:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.436+0000 7f49fa8b0700 1 Processor -- start 2023-10-06T02:58:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.436+0000 7f49fa8b0700 1 -- start start 2023-10-06T02:58:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49fa8b0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f406e690 0x7f49f406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49fa8b0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f49f40ad1f0 0x7f49f40ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49fa8b0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f406f040 con 0x7f49f4156540 2023-10-06T02:58:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49fa8b0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f406f470 con 0x7f49f40ad1f0 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49fa8b0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40acd60 con 0x7f49f406e690 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f49f4156540 0x7f49f40c7070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39316/0 (socket says 172.21.15.84:39316) 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f3fff700 1 -- 172.21.15.84:0/4248976620 learned_addr learned my addr 172.21.15.84:0/4248976620 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531426775 0 0) 0x7f49f406f040 con 0x7f49f4156540 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49dc003570 con 0x7f49f4156540 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f8e4d700 1 --2- 172.21.15.84:0/4248976620 >> v2:172.21.15.131:3300/0 conn(0x7f49f40ad1f0 0x7f49f40ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f37fe700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f406e690 0x7f49f406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3499595938 0 0) 0x7f49dc003570 con 0x7f49f4156540 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f406e690 msgr2=0x7f49f406eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f406e690 0x7f49f406eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 >> v2:172.21.15.131:3300/0 conn(0x7f49f40ad1f0 msgr2=0x7f49f40ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 --2- 172.21.15.84:0/4248976620 >> v2:172.21.15.131:3300/0 conn(0x7f49f40ad1f0 0x7f49f40ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f4156910 con 0x7f49f4156540 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f49e4001470 con 0x7f49f4156540 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 >> v1:172.21.15.84:6789/0 conn(0x7f49f4156540 legacy=0x7f49f40c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49dc003a60 0x7f49dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49dc004810 0x7f49dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f406e690 0x7f49dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f406f470 con 0x7f49dc004810 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40acd60 con 0x7f49dc003a60 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc00bb90 con 0x7f49f406e690 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.437+0000 7f49f8e4d700 1 --2- 172.21.15.84:0/4248976620 >> v2:172.21.15.131:3300/0 conn(0x7f49f40ad1f0 0x7f49f40ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:22.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f37fe700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49dc004810 0x7f49dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f3fff700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49dc003a60 0x7f49dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f8e4d700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f406e690 0x7f49dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f37fe700 1 -- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f406e690 msgr2=0x7f49dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f37fe700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f406e690 0x7f49dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f37fe700 1 -- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49dc003a60 msgr2=0x7f49dc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f37fe700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49dc003a60 0x7f49dc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f37fe700 1 -- 172.21.15.84:0/4248976620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc003570 con 0x7f49dc004810 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f37fe700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49dc004810 0x7f49dc004c80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f49e800bb90 tx=0x7f49e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d280b8e2b7f0b51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800d5d0 con 0x7f49dc004810 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e800d730 con 0x7f49dc004810 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.438+0000 7f49f2ffd700 1 -- 172.21.15.84:0/4248976620 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800daf0 con 0x7f49dc004810 2023-10-06T02:58:22.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.439+0000 7f49fa8b0700 1 -- 172.21.15.84:0/4248976620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49dc004810 msgr2=0x7f49dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.439+0000 7f49fa8b0700 1 --2- 172.21.15.84:0/4248976620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49dc004810 0x7f49dc004c80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f49e800bb90 tx=0x7f49e8008040 comp rx=0 tx=0).stop 2023-10-06T02:58:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.439+0000 7f49f8e4d700 1 -- 172.21.15.84:0/4248976620 reap_dead start 2023-10-06T02:58:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.439+0000 7f49fa8b0700 1 -- 172.21.15.84:0/4248976620 shutdown_connections 2023-10-06T02:58:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.439+0000 7f49fa8b0700 1 -- 172.21.15.84:0/4248976620 >> 172.21.15.84:0/4248976620 conn(0x7f49f40680c0 msgr2=0x7f49f40cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.439+0000 7f49fa8b0700 1 -- 172.21.15.84:0/4248976620 shutdown_connections 2023-10-06T02:58:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.439+0000 7f49fa8b0700 1 -- 172.21.15.84:0/4248976620 wait complete. 2023-10-06T02:58:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.440+0000 7f49fa8b0700 1 Processor -- start 2023-10-06T02:58:22.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.440+0000 7f49fa8b0700 1 -- start start 2023-10-06T02:58:22.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49fa8b0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49dc004810 0x7f49f40c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49fa8b0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f40c3360 0x7f49f41532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49fa8b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f41498b0 0x7f49f4153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49fa8b0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40c3a60 con 0x7f49f41498b0 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49fa8b0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40cc150 con 0x7f49dc004810 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49fa8b0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40cc3f0 con 0x7f49f40c3360 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f8e4d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f41498b0 0x7f49f4153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f8e4d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f41498b0 0x7f49f4153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48744/0 (socket says 172.21.15.84:48744) 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f8e4d700 1 -- 172.21.15.84:0/3527466786 learned_addr learned my addr 172.21.15.84:0/3527466786 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f37fe700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f40c3360 0x7f49f41532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f3fff700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49dc004810 0x7f49f40c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f8e4d700 1 -- 172.21.15.84:0/3527466786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f40c3360 msgr2=0x7f49f41532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f8e4d700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f40c3360 0x7f49f41532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f8e4d700 1 -- 172.21.15.84:0/3527466786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49dc004810 msgr2=0x7f49f40c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f8e4d700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49dc004810 0x7f49f40c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f8e4d700 1 -- 172.21.15.84:0/3527466786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40cc6d0 con 0x7f49f41498b0 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49f8e4d700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f41498b0 0x7f49f4153830 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f49f40bf970 tx=0x7f49ec0098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49dbfff700 1 -- 172.21.15.84:0/3527466786 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec002c80 con 0x7f49f41498b0 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49dbfff700 1 -- 172.21.15.84:0/3527466786 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec00f050 con 0x7f49f41498b0 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f40cc9b0 con 0x7f49f41498b0 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49dbfff700 1 -- 172.21.15.84:0/3527466786 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec014410 con 0x7f49f41498b0 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.441+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f4069560 con 0x7f49f41498b0 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.442+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f40c3bd0 con 0x7f49f41498b0 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.443+0000 7f49dbfff700 1 -- 172.21.15.84:0/3527466786 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49ec003040 con 0x7f49f41498b0 2023-10-06T02:58:22.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.443+0000 7f49dbfff700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f49e0066f30 0x7f49e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.443+0000 7f49dbfff700 1 -- 172.21.15.84:0/3527466786 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f49ec084b80 con 0x7f49f41498b0 2023-10-06T02:58:22.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.443+0000 7f49f3fff700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f49e0066f30 0x7f49e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.443+0000 7f49f3fff700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f49e0066f30 0x7f49e00693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f49e4001d20 tx=0x7f49e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:22.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.447+0000 7f49dbfff700 1 -- 172.21.15.84:0/3527466786 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49ec051b50 con 0x7f49f41498b0 2023-10-06T02:58:22.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.671+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f49f4064ad0 con 0x7f49f41498b0 2023-10-06T02:58:22.672 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T02:58:22.672+0000 7fedbe922700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:58:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.677+0000 7f49dbfff700 1 -- 172.21.15.84:0/3527466786 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7f49ec055170 con 0x7f49f41498b0 2023-10-06T02:58:22.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f49e0066f30 msgr2=0x7f49e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f49e0066f30 0x7f49e00693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f49e4001d20 tx=0x7f49e4009040 comp rx=0 tx=0).stop 2023-10-06T02:58:22.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f41498b0 msgr2=0x7f49f4153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f41498b0 0x7f49f4153830 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f49f40bf970 tx=0x7f49ec0098f0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 shutdown_connections 2023-10-06T02:58:22.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f49e0066f30 0x7f49e00693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49dc004810 0x7f49f40c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f41498b0 0x7f49f4153830 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 --2- 172.21.15.84:0/3527466786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49f40c3360 0x7f49f41532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.679+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 >> 172.21.15.84:0/3527466786 conn(0x7f49f40680c0 msgr2=0x7f49f41555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:22.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.680+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 shutdown_connections 2023-10-06T02:58:22.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.680+0000 7f49fa8b0700 1 -- 172.21.15.84:0/3527466786 wait complete. 2023-10-06T02:58:22.682 INFO:tasks.ceph.mds.b.smithi131.stderr: -912> 2023-10-06T02:58:01.257+0000 7ff3384ec700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1) n(v0 rc2023-10-06T02:57:44.661631+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={5494=pAsLsXsFsx/pAsLsXsFsx@4},l=5494 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55ef0a5f3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.661631+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-10-06T02:57:44.661631+0000 2=0+2)","error_str":""},"return_code":-61} 2023-10-06T02:58:22.682 INFO:tasks.ceph.mds.b.smithi131.stderr: -896> 2023-10-06T02:58:01.257+0000 7ff3384ec700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={5494=pAsLsXsFsx/AsLsXsFsx@2},l=5494 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55ef097b6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-10-06T02:58:22.682 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:58:22.683 INFO:tasks.ceph.mds.c.smithi084.stderr: -1081> 2023-10-06T02:58:01.256+0000 7f52fc1e2700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-10-06T02:57:44.660631+0000 1=0+1) n(v2 rc2023-10-06T02:57:44.892628+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={5494=pAsLsXsFsx/pAsLsXsFsx@4},l=5494 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55ca2bd92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.660631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.892628+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.660631+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-10-06T02:57:44.892628+0000 4=0+4)","error_str":""},"return_code":-61} 2023-10-06T02:58:22.683 INFO:tasks.ceph.mds.c.smithi084.stderr: -961> 2023-10-06T02:58:01.258+0000 7f53021ee700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1) n(v1 rc2023-10-06T02:57:44.892628+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={5494=pAsLsXsFs/pAsLsXsFsx@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55ca2bd93700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.661631+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.661631+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-06T02:57:44.892628+0000 3=0+3)","error_str":""},"return_code":-61} 2023-10-06T02:58:22.688 INFO:tasks.ceph.mds.a.smithi084.stderr: -2209> 2023-10-06T02:58:01.255+0000 7f0116907700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-10-06T02:57:44.658631+0000 1=0+1) n(v3 rc2023-10-06T02:57:44.892628+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={5494=pAsLsXsFsx/pAsLsXsFsx@5},l=5494 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55904afa6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.658631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.892628+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.658631+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-10-06T02:57:44.892628+0000 6=0+6)","error_str":""},"return_code":-61} 2023-10-06T02:58:22.688 INFO:tasks.ceph.mds.a.smithi084.stderr: -2106> 2023-10-06T02:58:01.257+0000 7f011c913700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-10-06T02:57:44.659631+0000 1=0+1) n(v4 rc2023-10-06T02:57:44.892628+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={5494=pAsLsXsFs/pAsLsXsFsx@9} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55904afa7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:57:44.659631+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:57:44.892628+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-10-06T02:57:44.659631+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-10-06T02:57:44.892628+0000 5=0+5)","error_str":""},"return_code":-61} 2023-10-06T02:58:22.694 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:58:22.704 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T02:58:22.705 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T02:58:22.711 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T02:58:22.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.812+0000 7fe4c8f45700 1 Processor -- start 2023-10-06T02:58:22.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.812+0000 7fe4c8f45700 1 -- start start 2023-10-06T02:58:22.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.813+0000 7fe4c8f45700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0830 0x7fe4c40c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.813+0000 7fe4c8f45700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe4c40c3fb0 0x7fe4c40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.813+0000 7fe4c8f45700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c40cdd00 con 0x7fe4c40b0460 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.813+0000 7fe4c8f45700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c40c4430 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.813+0000 7fe4c8f45700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c40cd0f0 con 0x7fe4c40b0830 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.813+0000 7fe4c37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe4c40b0460 0x7fe4c40cc5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39322/0 (socket says 172.21.15.84:39322) 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.813+0000 7fe4c37fe700 1 -- 172.21.15.84:0/1473292631 learned_addr learned my addr 172.21.15.84:0/1473292631 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.813+0000 7fe4c3fff700 1 --2- 172.21.15.84:0/1473292631 >> v2:172.21.15.84:3300/0 conn(0x7fe4c40c3fb0 0x7fe4c40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.813+0000 7fe4c2ffd700 1 --2- 172.21.15.84:0/1473292631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0830 0x7fe4c40c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c27fc700 1 -- 172.21.15.84:0/1473292631 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352061331 0 0) 0x7fe4c40cdd00 con 0x7fe4c40b0460 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c27fc700 1 -- 172.21.15.84:0/1473292631 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4ac003570 con 0x7fe4c40b0460 2023-10-06T02:58:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c3fff700 1 -- 172.21.15.84:0/1473292631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0830 msgr2=0x7fe4c40c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c3fff700 1 --2- 172.21.15.84:0/1473292631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0830 0x7fe4c40c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c3fff700 1 -- 172.21.15.84:0/1473292631 >> v1:172.21.15.84:6789/0 conn(0x7fe4c40b0460 legacy=0x7fe4c40cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c3fff700 1 -- 172.21.15.84:0/1473292631 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c40cd3d0 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c3fff700 1 --2- 172.21.15.84:0/1473292631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 0x7fe4c40c89f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009910 tx=0x7fe4bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629d33de72fd4591 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c27fc700 1 -- 172.21.15.84:0/1473292631 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc011630 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c27fc700 1 -- 172.21.15.84:0/1473292631 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc011790 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c27fc700 1 -- 172.21.15.84:0/1473292631 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc011b30 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1473292631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 msgr2=0x7fe4c40c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c8f45700 1 --2- 172.21.15.84:0/1473292631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 0x7fe4c40c89f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009910 tx=0x7fe4bc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1473292631 shutdown_connections 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c8f45700 1 --2- 172.21.15.84:0/1473292631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 0x7fe4c40c89f0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c8f45700 1 --2- 172.21.15.84:0/1473292631 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0830 0x7fe4c40c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1473292631 >> 172.21.15.84:0/1473292631 conn(0x7fe4c4096a70 msgr2=0x7fe4c4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:22.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.814+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1473292631 shutdown_connections 2023-10-06T02:58:22.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.815+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1473292631 wait complete. 2023-10-06T02:58:22.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.816+0000 7fe4c8f45700 1 Processor -- start 2023-10-06T02:58:22.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.816+0000 7fe4c8f45700 1 -- start start 2023-10-06T02:58:22.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.816+0000 7fe4c8f45700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0460 0x7fe4c4159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.816+0000 7fe4c8f45700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c40b0830 0x7fe4c40c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.816+0000 7fe4c8f45700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 0x7fe4c4155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.816+0000 7fe4c8f45700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c415a5e0 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.816+0000 7fe4c8f45700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c40c5220 con 0x7fe4c40b0830 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.816+0000 7fe4c8f45700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c40b3960 con 0x7fe4c40b0460 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 0x7fe4c4155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 0x7fe4c4155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48800/0 (socket says 172.21.15.84:48800) 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c3fff700 1 -- 172.21.15.84:0/1814808244 learned_addr learned my addr 172.21.15.84:0/1814808244 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c37fe700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0460 0x7fe4c4159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c2ffd700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c40b0830 0x7fe4c40c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c3fff700 1 -- 172.21.15.84:0/1814808244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0460 msgr2=0x7fe4c4159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c3fff700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0460 0x7fe4c4159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c3fff700 1 -- 172.21.15.84:0/1814808244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c40b0830 msgr2=0x7fe4c40c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c3fff700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c40b0830 0x7fe4c40c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c3fff700 1 -- 172.21.15.84:0/1814808244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc009420 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c3fff700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 0x7fe4c4155950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe4c406e420 tx=0x7fe4bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4ab7fe700 1 -- 172.21.15.84:0/1814808244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc01f070 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4ab7fe700 1 -- 172.21.15.84:0/1814808244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc011b10 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c40b3c40 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4ab7fe700 1 -- 172.21.15.84:0/1814808244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc023660 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.817+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c4155e90 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.818+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c405f270 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.819+0000 7fe4ab7fe700 1 -- 172.21.15.84:0/1814808244 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4bc02c3b0 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.819+0000 7fe4ab7fe700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe4b0066f30 0x7fe4b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:22.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.819+0000 7fe4ab7fe700 1 -- 172.21.15.84:0/1814808244 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6636+0+0 (secure 0 0 0) 0x7fe4bc085df0 con 0x7fe4c40c3fb0 2023-10-06T02:58:22.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.819+0000 7fe4c37fe700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe4b0066f30 0x7fe4b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:22.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.819+0000 7fe4c37fe700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe4b0066f30 0x7fe4b00693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005c50 tx=0x7fe4b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:22.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:22.823+0000 7fe4ab7fe700 1 -- 172.21.15.84:0/1814808244 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4bc052cc0 con 0x7fe4c40c3fb0 2023-10-06T02:58:23.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.051+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe4c40cd6b0 con 0x7fe4c40c3fb0 2023-10-06T02:58:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.676+0000 7fe4ab7fe700 1 -- 172.21.15.84:0/1814808244 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe4bc0562e0 con 0x7fe4c40c3fb0 2023-10-06T02:58:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.678+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe4b0066f30 msgr2=0x7fe4b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.678+0000 7fe4c8f45700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe4b0066f30 0x7fe4b00693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005c50 tx=0x7fe4b4009040 comp rx=0 tx=0).stop 2023-10-06T02:58:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.678+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 msgr2=0x7fe4c4155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.678+0000 7fe4c8f45700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 0x7fe4c4155950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe4c406e420 tx=0x7fe4bc017000 comp rx=0 tx=0).stop 2023-10-06T02:58:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.678+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 shutdown_connections 2023-10-06T02:58:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.678+0000 7fe4c8f45700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe4b0066f30 0x7fe4b00693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.678+0000 7fe4c8f45700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4c40c3fb0 0x7fe4c4155950 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.678+0000 7fe4c8f45700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe4c40b0460 0x7fe4c4159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.678+0000 7fe4c8f45700 1 --2- 172.21.15.84:0/1814808244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c40b0830 0x7fe4c40c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.679+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 >> 172.21.15.84:0/1814808244 conn(0x7fe4c4096a70 msgr2=0x7fe4c406b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.679+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 shutdown_connections 2023-10-06T02:58:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.679+0000 7fe4c8f45700 1 -- 172.21.15.84:0/1814808244 wait complete. 2023-10-06T02:58:23.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:58:23.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.851+0000 7f5e96329700 1 Processor -- start 2023-10-06T02:58:23.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.851+0000 7f5e96329700 1 -- start start 2023-10-06T02:58:23.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.851+0000 7f5e96329700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e900ccdb0 0x7f5e900a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:23.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.851+0000 7f5e96329700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e900695d0 con 0x7f5e9006ad20 2023-10-06T02:58:23.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.851+0000 7f5e96329700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e900ac760 con 0x7f5e900abc20 2023-10-06T02:58:23.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.851+0000 7f5e96329700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e900ad370 con 0x7f5e900ccdb0 2023-10-06T02:58:23.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e948c6700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5e9006ad20 0x7f5e900af2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39336/0 (socket says 172.21.15.84:39336) 2023-10-06T02:58:23.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e948c6700 1 -- 172.21.15.84:0/2513248259 learned_addr learned my addr 172.21.15.84:0/2513248259 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8f7fe700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e900ccdb0 0x7f5e900a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351835262 0 0) 0x7f5e900695d0 con 0x7f5e9006ad20 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e78003570 con 0x7f5e9006ad20 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663310453 0 0) 0x7f5e900ac760 con 0x7f5e900abc20 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e900695d0 con 0x7f5e900abc20 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596353374 0 0) 0x7f5e78003570 con 0x7f5e9006ad20 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e900ccdb0 msgr2=0x7f5e900a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e900ccdb0 0x7f5e900a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 >> v1:172.21.15.131:6789/0 conn(0x7f5e900abc20 legacy=0x7f5e900a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e900aca40 con 0x7f5e9006ad20 2023-10-06T02:58:23.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f5e880017f0 con 0x7f5e9006ad20 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 >> v1:172.21.15.84:6789/0 conn(0x7f5e9006ad20 legacy=0x7f5e900af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e78004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e78004810 0x7f5e78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e900ccdb0 0x7f5e780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7800bb10 con 0x7f5e78003c20 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7800bc80 con 0x7f5e78004810 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7800be40 con 0x7f5e900ccdb0 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8ffff700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e78004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e8f7fe700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e78004810 0x7f5e78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.852+0000 7f5e948c6700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e900ccdb0 0x7f5e780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:23.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8ffff700 1 -- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e900ccdb0 msgr2=0x7f5e780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8ffff700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e900ccdb0 0x7f5e780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8ffff700 1 -- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e78004810 msgr2=0x7f5e78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8ffff700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e78004810 0x7f5e78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8ffff700 1 -- 172.21.15.84:0/2513248259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78003570 con 0x7f5e78003c20 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8f7fe700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e78004810 0x7f5e78004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8ffff700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e78004010 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5e80001a10 tx=0x7f5e80007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371b07cb42ce1f26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8000c5d0 con 0x7f5e78003c20 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8000c730 con 0x7f5e78003c20 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e8effd700 1 -- 172.21.15.84:0/2513248259 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8000cad0 con 0x7f5e78003c20 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e96329700 1 -- 172.21.15.84:0/2513248259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 msgr2=0x7f5e78004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:23.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e96329700 1 --2- 172.21.15.84:0/2513248259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e78004010 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5e80001a10 tx=0x7f5e80007d30 comp rx=0 tx=0).stop 2023-10-06T02:58:23.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e948c6700 1 -- 172.21.15.84:0/2513248259 reap_dead start 2023-10-06T02:58:23.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e96329700 1 -- 172.21.15.84:0/2513248259 shutdown_connections 2023-10-06T02:58:23.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e96329700 1 -- 172.21.15.84:0/2513248259 >> 172.21.15.84:0/2513248259 conn(0x7f5e900cc110 msgr2=0x7f5e900cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:23.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e96329700 1 -- 172.21.15.84:0/2513248259 shutdown_connections 2023-10-06T02:58:23.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.853+0000 7f5e96329700 1 -- 172.21.15.84:0/2513248259 wait complete. 2023-10-06T02:58:23.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.854+0000 7f5e96329700 1 Processor -- start 2023-10-06T02:58:23.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.855+0000 7f5e96329700 1 -- start start 2023-10-06T02:58:23.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.855+0000 7f5e96329700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e90168500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:23.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.855+0000 7f5e96329700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e90098800 0x7f5e901657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:23.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.855+0000 7f5e96329700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900b1430 0x7f5e90096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.855+0000 7f5e96329700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e90165340 con 0x7f5e78003c20 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.855+0000 7f5e96329700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e90165010 con 0x7f5e900b1430 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.855+0000 7f5e96329700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e90168e00 con 0x7f5e90098800 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.855+0000 7f5e8ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e90168500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e90168500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48820/0 (socket says 172.21.15.84:48820) 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8ffff700 1 -- 172.21.15.84:0/2595371573 learned_addr learned my addr 172.21.15.84:0/2595371573 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8f7fe700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e90098800 0x7f5e901657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e948c6700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900b1430 0x7f5e90096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8ffff700 1 -- 172.21.15.84:0/2595371573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e90098800 msgr2=0x7f5e901657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8ffff700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e90098800 0x7f5e901657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8ffff700 1 -- 172.21.15.84:0/2595371573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900b1430 msgr2=0x7f5e90096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8ffff700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900b1430 0x7f5e90096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8ffff700 1 -- 172.21.15.84:0/2595371573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e901690e0 con 0x7f5e78003c20 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8f7fe700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e90098800 0x7f5e901657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e8ffff700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e90168500 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800bc50 tx=0x7f5e80015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e77fff700 1 -- 172.21.15.84:0/2595371573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8000c5d0 con 0x7f5e78003c20 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e77fff700 1 -- 172.21.15.84:0/2595371573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8000c3f0 con 0x7f5e78003c20 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e77fff700 1 -- 172.21.15.84:0/2595371573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80006a50 con 0x7f5e78003c20 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e901693c0 con 0x7f5e78003c20 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.856+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e90165d10 con 0x7f5e78003c20 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.857+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e90165620 con 0x7f5e78003c20 2023-10-06T02:58:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.857+0000 7f5e77fff700 1 -- 172.21.15.84:0/2595371573 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e80019070 con 0x7f5e78003c20 2023-10-06T02:58:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.858+0000 7f5e77fff700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5e7c066f20 0x7f5e7c0693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.858+0000 7f5e77fff700 1 -- 172.21.15.84:0/2595371573 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6636+0+0 (secure 0 0 0) 0x7f5e80085a50 con 0x7f5e78003c20 2023-10-06T02:58:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.858+0000 7f5e8f7fe700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5e7c066f20 0x7f5e7c0693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.858+0000 7f5e8f7fe700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5e7c066f20 0x7f5e7c0693d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e900cd220 tx=0x7f5e84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:23.862+0000 7f5e77fff700 1 -- 172.21.15.84:0/2595371573 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e800529d0 con 0x7f5e78003c20 2023-10-06T02:58:24.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.045+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5e90165f00 con 0x7f5e78003c20 2023-10-06T02:58:24.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.679+0000 7f5e77fff700 1 -- 172.21.15.84:0/2595371573 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5e800220d0 con 0x7f5e78003c20 2023-10-06T02:58:24.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5e7c066f20 msgr2=0x7f5e7c0693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:24.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5e7c066f20 0x7f5e7c0693d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e900cd220 tx=0x7f5e84008040 comp rx=0 tx=0).stop 2023-10-06T02:58:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 msgr2=0x7f5e90168500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e90168500 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800bc50 tx=0x7f5e80015000 comp rx=0 tx=0).stop 2023-10-06T02:58:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 shutdown_connections 2023-10-06T02:58:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5e7c066f20 0x7f5e7c0693d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900b1430 0x7f5e90096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e78003c20 0x7f5e90168500 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:24.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 --2- 172.21.15.84:0/2595371573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e90098800 0x7f5e901657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:24.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.682+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 >> 172.21.15.84:0/2595371573 conn(0x7f5e900cc110 msgr2=0x7f5e9006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:24.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.683+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 shutdown_connections 2023-10-06T02:58:24.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.683+0000 7f5e96329700 1 -- 172.21.15.84:0/2595371573 wait complete. 2023-10-06T02:58:24.686 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:58:24.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:58:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.812+0000 7f6bf0b2e700 1 Processor -- start 2023-10-06T02:58:24.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.812+0000 7f6bf0b2e700 1 -- start start 2023-10-06T02:58:24.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bf0b2e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6bec06ed20 0x7f6bec0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bf0b2e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bec0aee20 0x7f6bec0af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bf0b2e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec0b2d20 con 0x7f6bec06f0f0 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bf0b2e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec06fb80 con 0x7f6bec0aee20 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bf0b2e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0b0450 con 0x7f6bec06ed20 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bead9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bec0aee20 0x7f6bec0af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6be1d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6bec06f0f0 0x7f6bec0b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39348/0 (socket says 172.21.15.84:39348) 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6be1d9b700 1 -- 172.21.15.84:0/3560387237 learned_addr learned my addr 172.21.15.84:0/3560387237 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bead9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6bec0aee20 0x7f6bec0af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48822/0 (socket says 172.21.15.84:48822) 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bea59c700 1 --2- 172.21.15.84:0/3560387237 >> v2:172.21.15.131:3300/0 conn(0x7f6bec06ed20 0x7f6bec0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bead9d700 1 -- 172.21.15.84:0/3560387237 >> v2:172.21.15.131:3300/0 conn(0x7f6bec06ed20 msgr2=0x7f6bec0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:24.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bead9d700 1 --2- 172.21.15.84:0/3560387237 >> v2:172.21.15.131:3300/0 conn(0x7f6bec06ed20 0x7f6bec0b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bead9d700 1 -- 172.21.15.84:0/3560387237 >> v1:172.21.15.84:6789/0 conn(0x7f6bec06f0f0 legacy=0x7f6bec0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bead9d700 1 -- 172.21.15.84:0/3560387237 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0af7c0 con 0x7f6bec0aee20 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6be9d9b700 1 -- 172.21.15.84:0/3560387237 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403709488 0 0) 0x7f6bec0b2d20 con 0x7f6bec06f0f0 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.813+0000 7f6bea59c700 1 --2- 172.21.15.84:0/3560387237 >> v2:172.21.15.131:3300/0 conn(0x7f6bec06ed20 0x7f6bec0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6bead9d700 1 --2- 172.21.15.84:0/3560387237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 0x7f6bec0af280 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0cdd30 tx=0x7f6be4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6783a282487061a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6be9d9b700 1 -- 172.21.15.84:0/3560387237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be400e070 con 0x7f6bec0aee20 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6be9d9b700 1 -- 172.21.15.84:0/3560387237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be400bc30 con 0x7f6bec0aee20 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6be9d9b700 1 -- 172.21.15.84:0/3560387237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4012430 con 0x7f6bec0aee20 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/3560387237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 msgr2=0x7f6bec0af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6bf0b2e700 1 --2- 172.21.15.84:0/3560387237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 0x7f6bec0af280 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0cdd30 tx=0x7f6be4009780 comp rx=0 tx=0).stop 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/3560387237 shutdown_connections 2023-10-06T02:58:24.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6bf0b2e700 1 --2- 172.21.15.84:0/3560387237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 0x7f6bec0af280 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:24.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6bf0b2e700 1 --2- 172.21.15.84:0/3560387237 >> v2:172.21.15.131:3300/0 conn(0x7f6bec06ed20 0x7f6bec0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:24.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/3560387237 >> 172.21.15.84:0/3560387237 conn(0x7f6bec068330 msgr2=0x7f6bec068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:24.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/3560387237 shutdown_connections 2023-10-06T02:58:24.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.814+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/3560387237 wait complete. 2023-10-06T02:58:24.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.815+0000 7f6bf0b2e700 1 Processor -- start 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bf0b2e700 1 -- start start 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bf0b2e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bec06ed20 0x7f6bec1576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bf0b2e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bec06f0f0 0x7f6bec155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bf0b2e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 0x7f6bec068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bf0b2e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec15bd90 con 0x7f6bec0aee20 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bf0b2e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec159d30 con 0x7f6bec06ed20 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bf0b2e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec15a010 con 0x7f6bec06f0f0 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bead9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 0x7f6bec068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bead9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 0x7f6bec068700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48824/0 (socket says 172.21.15.84:48824) 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bead9d700 1 -- 172.21.15.84:0/2235123721 learned_addr learned my addr 172.21.15.84:0/2235123721 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:24.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6bea59c700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bec06ed20 0x7f6bec1576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.816+0000 7f6be1d9b700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bec06f0f0 0x7f6bec155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6bead9d700 1 -- 172.21.15.84:0/2235123721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bec06f0f0 msgr2=0x7f6bec155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6bead9d700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bec06f0f0 0x7f6bec155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6bead9d700 1 -- 172.21.15.84:0/2235123721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bec06ed20 msgr2=0x7f6bec1576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6bead9d700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bec06ed20 0x7f6bec1576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6bead9d700 1 -- 172.21.15.84:0/2235123721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4009a20 con 0x7f6bec0aee20 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6bead9d700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 0x7f6bec068700 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6be4012580 tx=0x7f6be4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6be2ffd700 1 -- 172.21.15.84:0/2235123721 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4027470 con 0x7f6bec0aee20 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6be2ffd700 1 -- 172.21.15.84:0/2235123721 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4027610 con 0x7f6bec0aee20 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec15a2f0 con 0x7f6bec0aee20 2023-10-06T02:58:24.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6be2ffd700 1 -- 172.21.15.84:0/2235123721 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40279d0 con 0x7f6bec0aee20 2023-10-06T02:58:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.817+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec15a5d0 con 0x7f6bec0aee20 2023-10-06T02:58:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.818+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec15bb60 con 0x7f6bec0aee20 2023-10-06T02:58:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.818+0000 7f6be2ffd700 1 -- 172.21.15.84:0/2235123721 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6be4024070 con 0x7f6bec0aee20 2023-10-06T02:58:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.819+0000 7f6be2ffd700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bcc066f30 0x7f6bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.819+0000 7f6be2ffd700 1 -- 172.21.15.84:0/2235123721 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6198+0+0 (secure 0 0 0) 0x7f6be4086e10 con 0x7f6bec0aee20 2023-10-06T02:58:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.819+0000 7f6bea59c700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bcc066f30 0x7f6bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.819+0000 7f6bea59c700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bcc066f30 0x7f6bcc0693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc006fd0 tx=0x7f6bdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:24.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:24.823+0000 7f6be2ffd700 1 -- 172.21.15.84:0/2235123721 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bec15bb60 con 0x7f6bec0aee20 2023-10-06T02:58:25.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.006+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6bec15bb60 con 0x7f6bec0aee20 2023-10-06T02:58:25.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.682+0000 7f6be2ffd700 1 -- 172.21.15.84:0/2235123721 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6bec15bb60 con 0x7f6bec0aee20 2023-10-06T02:58:25.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.684+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bcc066f30 msgr2=0x7f6bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bcc066f30 0x7f6bcc0693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc006fd0 tx=0x7f6bdc008040 comp rx=0 tx=0).stop 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 msgr2=0x7f6bec068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 0x7f6bec068700 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6be4012580 tx=0x7f6be4019000 comp rx=0 tx=0).stop 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 shutdown_connections 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6bcc066f30 0x7f6bcc0693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bec06ed20 0x7f6bec1576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bec0aee20 0x7f6bec068700 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 --2- 172.21.15.84:0/2235123721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bec06f0f0 0x7f6bec155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 >> 172.21.15.84:0/2235123721 conn(0x7f6bec068330 msgr2=0x7f6bec0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:25.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 shutdown_connections 2023-10-06T02:58:25.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.685+0000 7f6bf0b2e700 1 -- 172.21.15.84:0/2235123721 wait complete. 2023-10-06T02:58:25.688 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T02:58:25.699 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:58:25.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.814+0000 7f3fd754b700 1 Processor -- start 2023-10-06T02:58:25.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.814+0000 7f3fd754b700 1 -- start start 2023-10-06T02:58:25.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.815+0000 7f3fd754b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd013fcd0 0x7f3fd006e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.815+0000 7f3fd754b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd01400a0 con 0x7f3fd00c8040 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.815+0000 7f3fd754b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd006ea40 con 0x7f3fd0157460 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.815+0000 7f3fd754b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd006ed20 con 0x7f3fd013fcd0 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.815+0000 7f3fd5ae8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3fd00c8040 0x7f3fd00c9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39350/0 (socket says 172.21.15.84:39350) 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.815+0000 7f3fd5ae8700 1 -- 172.21.15.84:0/605429034 learned_addr learned my addr 172.21.15.84:0/605429034 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.815+0000 7f3fd52e7700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd013fcd0 0x7f3fd006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946241012 0 0) 0x7f3fd01400a0 con 0x7f3fd00c8040 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fbc003570 con 0x7f3fd00c8040 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071346574 0 0) 0x7f3fd006ea40 con 0x7f3fd0157460 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd01400a0 con 0x7f3fd0157460 2023-10-06T02:58:25.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055723640 0 0) 0x7f3fbc003570 con 0x7f3fd00c8040 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd013fcd0 msgr2=0x7f3fd006e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd013fcd0 0x7f3fd006e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 >> v1:172.21.15.131:6789/0 conn(0x7f3fd0157460 legacy=0x7f3fd00c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd006f000 con 0x7f3fd00c8040 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f3fc80017f0 con 0x7f3fd00c8040 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 >> v1:172.21.15.84:6789/0 conn(0x7f3fd00c8040 legacy=0x7f3fd00c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd013fcd0 0x7f3fbc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fbc004180 0x7f3fbc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fbc004d50 0x7f3fbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd006ed20 con 0x7f3fbc004180 2023-10-06T02:58:25.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc00ddb0 con 0x7f3fbc004d50 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc00df70 con 0x7f3fd013fcd0 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fd52e7700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd013fcd0 0x7f3fbc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fd5ae8700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fbc004d50 0x7f3fbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.816+0000 7f3fd4ae6700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fbc004180 0x7f3fbc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fd52e7700 1 -- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fbc004d50 msgr2=0x7f3fbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fd52e7700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fbc004d50 0x7f3fbc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fd52e7700 1 -- 172.21.15.84:0/605429034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fbc004180 msgr2=0x7f3fbc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fd52e7700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fbc004180 0x7f3fbc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fd52e7700 1 -- 172.21.15.84:0/605429034 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc003570 con 0x7f3fd013fcd0 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fd4ae6700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fbc004180 0x7f3fbc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:25.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fd52e7700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd013fcd0 0x7f3fbc003c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009c00 tx=0x7f3fcc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e72aa499a491e020 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00e710 con 0x7f3fd013fcd0 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00e870 con 0x7f3fd013fcd0 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.817+0000 7f3fc7fff700 1 -- 172.21.15.84:0/605429034 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00ec30 con 0x7f3fd013fcd0 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.818+0000 7f3fd754b700 1 -- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd013fcd0 msgr2=0x7f3fbc003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.818+0000 7f3fd754b700 1 --2- 172.21.15.84:0/605429034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd013fcd0 0x7f3fbc003c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009c00 tx=0x7f3fcc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.818+0000 7f3fd5ae8700 1 -- 172.21.15.84:0/605429034 reap_dead start 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.818+0000 7f3fd754b700 1 -- 172.21.15.84:0/605429034 shutdown_connections 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.818+0000 7f3fd754b700 1 -- 172.21.15.84:0/605429034 >> 172.21.15.84:0/605429034 conn(0x7f3fd00cc0d0 msgr2=0x7f3fd00cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.818+0000 7f3fd754b700 1 -- 172.21.15.84:0/605429034 shutdown_connections 2023-10-06T02:58:25.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.818+0000 7f3fd754b700 1 -- 172.21.15.84:0/605429034 wait complete. 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.819+0000 7f3fd754b700 1 Processor -- start 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.819+0000 7f3fd754b700 1 -- start start 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd754b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fd013fcd0 0x7f3fd0153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd754b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fd00c1630 0x7f3fd00c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd754b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd00c4870 0x7f3fd00c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd754b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00c1fe0 con 0x7f3fd013fcd0 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd754b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0157830 con 0x7f3fd00c1630 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd754b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0157b10 con 0x7f3fd00c4870 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd52e7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fd013fcd0 0x7f3fd0153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:25.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd52e7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fd013fcd0 0x7f3fd0153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48832/0 (socket says 172.21.15.84:48832) 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd52e7700 1 -- 172.21.15.84:0/2499515514 learned_addr learned my addr 172.21.15.84:0/2499515514 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd52e7700 1 -- 172.21.15.84:0/2499515514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd00c4870 msgr2=0x7f3fd00c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd52e7700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd00c4870 0x7f3fd00c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd52e7700 1 -- 172.21.15.84:0/2499515514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fd00c1630 msgr2=0x7f3fd00c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd52e7700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fd00c1630 0x7f3fd00c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd52e7700 1 -- 172.21.15.84:0/2499515514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0157df0 con 0x7f3fd013fcd0 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd52e7700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fd013fcd0 0x7f3fd0153c00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e100 tx=0x7f3fcc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fc57fa700 1 -- 172.21.15.84:0/2499515514 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc022070 con 0x7f3fd013fcd0 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fc57fa700 1 -- 172.21.15.84:0/2499515514 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00ebf0 con 0x7f3fd013fcd0 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd01580d0 con 0x7f3fd013fcd0 2023-10-06T02:58:25.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fc57fa700 1 -- 172.21.15.84:0/2499515514 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc01c680 con 0x7f3fd013fcd0 2023-10-06T02:58:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.820+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd00c5230 con 0x7f3fd013fcd0 2023-10-06T02:58:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.821+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd0064ad0 con 0x7f3fd013fcd0 2023-10-06T02:58:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.822+0000 7f3fc57fa700 1 -- 172.21.15.84:0/2499515514 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fcc01cab0 con 0x7f3fd013fcd0 2023-10-06T02:58:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.822+0000 7f3fc57fa700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3fb4066f30 0x7f3fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.822+0000 7f3fc57fa700 1 -- 172.21.15.84:0/2499515514 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f3fcc085d70 con 0x7f3fd013fcd0 2023-10-06T02:58:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.822+0000 7f3fd4ae6700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3fb4066f30 0x7f3fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.823+0000 7f3fd4ae6700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3fb4066f30 0x7f3fb40693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00010e0 tx=0x7f3fc0007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:25.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:25.826+0000 7f3fc57fa700 1 -- 172.21.15.84:0/2499515514 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fcc053080 con 0x7f3fd013fcd0 2023-10-06T02:58:26.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.009+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3fd00c1fe0 con 0x7f3fd013fcd0 2023-10-06T02:58:26.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.012+0000 7f3fc57fa700 1 -- 172.21.15.84:0/2499515514 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3fcc0170a0 con 0x7f3fd013fcd0 2023-10-06T02:58:26.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3fb4066f30 msgr2=0x7f3fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3fb4066f30 0x7f3fb40693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00010e0 tx=0x7f3fc0007d30 comp rx=0 tx=0).stop 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fd013fcd0 msgr2=0x7f3fd0153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fd013fcd0 0x7f3fd0153c00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e100 tx=0x7f3fcc01a000 comp rx=0 tx=0).stop 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 shutdown_connections 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3fb4066f30 0x7f3fb40693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3fd00c4870 0x7f3fd00c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fd013fcd0 0x7f3fd0153c00 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 --2- 172.21.15.84:0/2499515514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3fd00c1630 0x7f3fd00c1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 >> 172.21.15.84:0/2499515514 conn(0x7f3fd00cc0d0 msgr2=0x7f3fd013ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:26.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 shutdown_connections 2023-10-06T02:58:26.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.015+0000 7f3fd754b700 1 -- 172.21.15.84:0/2499515514 wait complete. 2023-10-06T02:58:26.028 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2023-10-06T02:58:26.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.140+0000 7f434b8c3700 1 Processor -- start 2023-10-06T02:58:26.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.140+0000 7f434b8c3700 1 -- start start 2023-10-06T02:58:26.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.141+0000 7f434b8c3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f43441595a0 0x7f43440aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.141+0000 7f434b8c3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43440b0ca0 con 0x7f43440b49e0 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.141+0000 7f434b8c3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43440b0f80 con 0x7f43440b07a0 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.141+0000 7f434b8c3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43440b1260 con 0x7f43441595a0 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.141+0000 7f434965f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f43441595a0 0x7f43440aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.141+0000 7f4348e5e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f43440b49e0 0x7f43440aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39362/0 (socket says 172.21.15.84:39362) 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.141+0000 7f4348e5e700 1 -- 172.21.15.84:0/300626361 learned_addr learned my addr 172.21.15.84:0/300626361 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.142+0000 7f434965f700 1 -- 172.21.15.84:0/300626361 >> v1:172.21.15.131:6789/0 conn(0x7f43440b07a0 legacy=0x7f43440b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.142+0000 7f434965f700 1 -- 172.21.15.84:0/300626361 >> v1:172.21.15.84:6789/0 conn(0x7f43440b49e0 legacy=0x7f43440aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.142+0000 7f4343fff700 1 -- 172.21.15.84:0/300626361 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108104515 0 0) 0x7f43440b0ca0 con 0x7f43440b49e0 2023-10-06T02:58:26.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.142+0000 7f434965f700 1 -- 172.21.15.84:0/300626361 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440b1540 con 0x7f43441595a0 2023-10-06T02:58:26.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.142+0000 7f434965f700 1 --2- 172.21.15.84:0/300626361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43441595a0 0x7f43440aa570 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f433c009ee0 tx=0x7f433c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd508596eda5b207 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:26.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.142+0000 7f4343fff700 1 -- 172.21.15.84:0/300626361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00e070 con 0x7f43441595a0 2023-10-06T02:58:26.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.142+0000 7f4343fff700 1 -- 172.21.15.84:0/300626361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c00bc10 con 0x7f43441595a0 2023-10-06T02:58:26.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.142+0000 7f4343fff700 1 -- 172.21.15.84:0/300626361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c012430 con 0x7f43441595a0 2023-10-06T02:58:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.143+0000 7f434b8c3700 1 -- 172.21.15.84:0/300626361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43441595a0 msgr2=0x7f43440aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.143+0000 7f434b8c3700 1 --2- 172.21.15.84:0/300626361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43441595a0 0x7f43440aa570 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f433c009ee0 tx=0x7f433c009780 comp rx=0 tx=0).stop 2023-10-06T02:58:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.143+0000 7f434b8c3700 1 -- 172.21.15.84:0/300626361 shutdown_connections 2023-10-06T02:58:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.143+0000 7f434b8c3700 1 --2- 172.21.15.84:0/300626361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43441595a0 0x7f43440aa570 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.143+0000 7f434b8c3700 1 -- 172.21.15.84:0/300626361 >> 172.21.15.84:0/300626361 conn(0x7f4344099830 msgr2=0x7f434406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.143+0000 7f434b8c3700 1 -- 172.21.15.84:0/300626361 shutdown_connections 2023-10-06T02:58:26.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.143+0000 7f434b8c3700 1 -- 172.21.15.84:0/300626361 wait complete. 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.144+0000 7f434b8c3700 1 Processor -- start 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.144+0000 7f434b8c3700 1 -- start start 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434b8c3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43440b07a0 0x7f434415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434b8c3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43440b49e0 0x7f43440ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434b8c3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43441595a0 0x7f43440ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434b8c3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440abea0 con 0x7f43440b07a0 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434b8c3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440ae220 con 0x7f43441595a0 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434b8c3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43440ad370 con 0x7f43440b49e0 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434965f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43440b07a0 0x7f434415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434965f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43440b07a0 0x7f434415bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48854/0 (socket says 172.21.15.84:48854) 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434965f700 1 -- 172.21.15.84:0/1305927866 learned_addr learned my addr 172.21.15.84:0/1305927866 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:26.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f4348e5e700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43440b49e0 0x7f43440ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f4349e60700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43441595a0 0x7f43440ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434965f700 1 -- 172.21.15.84:0/1305927866 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43440b49e0 msgr2=0x7f43440ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434965f700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43440b49e0 0x7f43440ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434965f700 1 -- 172.21.15.84:0/1305927866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43441595a0 msgr2=0x7f43440ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434965f700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43441595a0 0x7f43440ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434965f700 1 -- 172.21.15.84:0/1305927866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c009a20 con 0x7f43440b07a0 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434965f700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43440b07a0 0x7f434415bf80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f433c0099f0 tx=0x7f433c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f43417fa700 1 -- 172.21.15.84:0/1305927866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c012e40 con 0x7f43440b07a0 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f43417fa700 1 -- 172.21.15.84:0/1305927866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c01b630 con 0x7f43440b07a0 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434409b8e0 con 0x7f43440b07a0 2023-10-06T02:58:26.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f43417fa700 1 -- 172.21.15.84:0/1305927866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c01b9f0 con 0x7f43440b07a0 2023-10-06T02:58:26.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.145+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43440ad8f0 con 0x7f43440b07a0 2023-10-06T02:58:26.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.146+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4344159190 con 0x7f43440b07a0 2023-10-06T02:58:26.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.147+0000 7f43417fa700 1 -- 172.21.15.84:0/1305927866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f433c01c400 con 0x7f43440b07a0 2023-10-06T02:58:26.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.147+0000 7f43417fa700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4330066f30 0x7f43300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.147+0000 7f4348e5e700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4330066f30 0x7f43300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.147+0000 7f43417fa700 1 -- 172.21.15.84:0/1305927866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f433c0862b0 con 0x7f43440b07a0 2023-10-06T02:58:26.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.148+0000 7f4348e5e700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4330066f30 0x7f43300693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4344157300 tx=0x7f4338009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:26.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.151+0000 7f43417fa700 1 -- 172.21.15.84:0/1305927866 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f433c053640 con 0x7f43440b07a0 2023-10-06T02:58:26.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.407+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) v1 -- 0x7f4344064ad0 con 0x7f43440b07a0 2023-10-06T02:58:26.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.685+0000 7f43417fa700 1 -- 172.21.15.84:0/1305927866 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v183) v1 ==== 143+0+0 (secure 0 0 0) 0x7f433c056ba0 con 0x7f43440b07a0 2023-10-06T02:58:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.687+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4330066f30 msgr2=0x7f43300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.687+0000 7f434b8c3700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4330066f30 0x7f43300693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4344157300 tx=0x7f4338009040 comp rx=0 tx=0).stop 2023-10-06T02:58:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.687+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43440b07a0 msgr2=0x7f434415bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.687+0000 7f434b8c3700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43440b07a0 0x7f434415bf80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f433c0099f0 tx=0x7f433c019000 comp rx=0 tx=0).stop 2023-10-06T02:58:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.688+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 shutdown_connections 2023-10-06T02:58:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.688+0000 7f434b8c3700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4330066f30 0x7f43300693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.688+0000 7f434b8c3700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43441595a0 0x7f43440ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.688+0000 7f434b8c3700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43440b07a0 0x7f434415bf80 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.688+0000 7f434b8c3700 1 --2- 172.21.15.84:0/1305927866 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43440b49e0 0x7f43440ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.688+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 >> 172.21.15.84:0/1305927866 conn(0x7f4344099830 msgr2=0x7f4344069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.688+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 shutdown_connections 2023-10-06T02:58:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.688+0000 7f434b8c3700 1 -- 172.21.15.84:0/1305927866 wait complete. 2023-10-06T02:58:26.701 INFO:tasks.cephfs_test_runner:test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-10-06T02:58:26.701 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-10-06T02:58:26.702 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2023-10-06T02:58:26.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.813+0000 7f46ae2c5700 1 Processor -- start 2023-10-06T02:58:26.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.813+0000 7f46ae2c5700 1 -- start start 2023-10-06T02:58:26.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.814+0000 7f46ae2c5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80cbc70 0x7f46a80cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.814+0000 7f46ae2c5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a80cb7e0 con 0x7f46a8159480 2023-10-06T02:58:26.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.814+0000 7f46ae2c5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a80b08a0 con 0x7f46a80b2140 2023-10-06T02:58:26.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.814+0000 7f46ae2c5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80cb190 con 0x7f46a80cbc70 2023-10-06T02:58:26.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.814+0000 7f46ad2c3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f46a8159480 0x7f46a80b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39364/0 (socket says 172.21.15.84:39364) 2023-10-06T02:58:26.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.814+0000 7f46ad2c3700 1 -- 172.21.15.84:0/2308651305 learned_addr learned my addr 172.21.15.84:0/2308651305 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:26.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250814481 0 0) 0x7f46a80cb7e0 con 0x7f46a8159480 2023-10-06T02:58:26.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4694003570 con 0x7f46a8159480 2023-10-06T02:58:26.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f46acac2700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80cbc70 0x7f46a80cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1232554427 0 0) 0x7f4694003570 con 0x7f46a8159480 2023-10-06T02:58:26.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80cbc70 msgr2=0x7f46a80cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80cbc70 0x7f46a80cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 >> v1:172.21.15.131:6789/0 conn(0x7f46a80b2140 legacy=0x7f46a80b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80cb470 con 0x7f46a8159480 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f46a4001470 con 0x7f46a8159480 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 >> v1:172.21.15.84:6789/0 conn(0x7f46a8159480 legacy=0x7f46a80b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4694003a90 0x7f4694003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4694004810 0x7f4694004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80cbc70 0x7f4694005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80cb190 con 0x7f4694004810 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469400bc20 con 0x7f4694003a90 2023-10-06T02:58:26.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469400bde0 con 0x7f46a80cbc70 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f46acac2700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4694004810 0x7f4694004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f46ad2c3700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4694003a90 0x7f4694003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f46adac4700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80cbc70 0x7f4694005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f46acac2700 1 -- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80cbc70 msgr2=0x7f4694005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f46acac2700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80cbc70 0x7f4694005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f46acac2700 1 -- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4694003a90 msgr2=0x7f4694003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f46acac2700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4694003a90 0x7f4694003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.815+0000 7f46acac2700 1 -- 172.21.15.84:0/2308651305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694003570 con 0x7f4694004810 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f46acac2700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4694004810 0x7f4694004c80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f469800bb60 tx=0x7f4698008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ee2fd1cf55618c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:26.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800d5d0 con 0x7f4694004810 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800d730 con 0x7f4694004810 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f469ffff700 1 -- 172.21.15.84:0/2308651305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800daf0 con 0x7f4694004810 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f46ae2c5700 1 -- 172.21.15.84:0/2308651305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4694004810 msgr2=0x7f4694004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f46ae2c5700 1 --2- 172.21.15.84:0/2308651305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4694004810 0x7f4694004c80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f469800bb60 tx=0x7f4698008040 comp rx=0 tx=0).stop 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f46adac4700 1 -- 172.21.15.84:0/2308651305 reap_dead start 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f46ae2c5700 1 -- 172.21.15.84:0/2308651305 shutdown_connections 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f46ae2c5700 1 -- 172.21.15.84:0/2308651305 >> 172.21.15.84:0/2308651305 conn(0x7f46a806ed20 msgr2=0x7f46a806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f46ae2c5700 1 -- 172.21.15.84:0/2308651305 shutdown_connections 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.816+0000 7f46ae2c5700 1 -- 172.21.15.84:0/2308651305 wait complete. 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.817+0000 7f46ae2c5700 1 Processor -- start 2023-10-06T02:58:26.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.817+0000 7f46ae2c5700 1 -- start start 2023-10-06T02:58:26.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46ae2c5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4694004810 0x7f46a80c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46ae2c5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80c9650 0x7f46a815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46ae2c5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46a8158280 0x7f46a81543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46ae2c5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80c9280 con 0x7f46a8158280 2023-10-06T02:58:26.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46ae2c5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80c3cc0 con 0x7f4694004810 2023-10-06T02:58:26.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46ae2c5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80c89e0 con 0x7f46a80c9650 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46adac4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46a8158280 0x7f46a81543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46adac4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46a8158280 0x7f46a81543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48872/0 (socket says 172.21.15.84:48872) 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46adac4700 1 -- 172.21.15.84:0/1801417485 learned_addr learned my addr 172.21.15.84:0/1801417485 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46acac2700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80c9650 0x7f46a815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.818+0000 7f46ad2c3700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4694004810 0x7f46a80c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f46adac4700 1 -- 172.21.15.84:0/1801417485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80c9650 msgr2=0x7f46a815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f46adac4700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80c9650 0x7f46a815a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f46adac4700 1 -- 172.21.15.84:0/1801417485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4694004810 msgr2=0x7f46a80c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f46adac4700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4694004810 0x7f46a80c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:26.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f46adac4700 1 -- 172.21.15.84:0/1801417485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80c8cc0 con 0x7f46a8158280 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f46adac4700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46a8158280 0x7f46a81543e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f46a80b63e0 tx=0x7f46a0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f469d7fa700 1 -- 172.21.15.84:0/1801417485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a00032e0 con 0x7f46a8158280 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f469d7fa700 1 -- 172.21.15.84:0/1801417485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0001580 con 0x7f46a8158280 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a80c8fa0 con 0x7f46a8158280 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f469d7fa700 1 -- 172.21.15.84:0/1801417485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0003440 con 0x7f46a8158280 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.819+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a815a9e0 con 0x7f46a8158280 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.820+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a80c3e30 con 0x7f46a8158280 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.820+0000 7f469d7fa700 1 -- 172.21.15.84:0/1801417485 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46a0001b70 con 0x7f46a8158280 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.821+0000 7f469d7fa700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.821+0000 7f46ad2c3700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:26.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.821+0000 7f469d7fa700 1 -- 172.21.15.84:0/1801417485 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f46a0083f60 con 0x7f46a8158280 2023-10-06T02:58:26.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.821+0000 7f46ad2c3700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f468c066f30 0x7f468c0693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f46a4000c00 tx=0x7f46a4001e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:26.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:26.825+0000 7f469d7fa700 1 -- 172.21.15.84:0/1801417485 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46a00510e0 con 0x7f46a8158280 2023-10-06T02:58:27.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.086+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) v1 -- 0x7f46a805f270 con 0x7f46a8158280 2023-10-06T02:58:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.687+0000 7f469d7fa700 1 -- 172.21.15.84:0/1801417485 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v184) v1 ==== 145+0+0 (secure 0 0 0) 0x7f46a0019020 con 0x7f46a8158280 2023-10-06T02:58:27.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f468c066f30 msgr2=0x7f468c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:27.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f468c066f30 0x7f468c0693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f46a4000c00 tx=0x7f46a4001e50 comp rx=0 tx=0).stop 2023-10-06T02:58:27.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46a8158280 msgr2=0x7f46a81543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:27.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46a8158280 0x7f46a81543e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f46a80b63e0 tx=0x7f46a0009040 comp rx=0 tx=0).stop 2023-10-06T02:58:27.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 shutdown_connections 2023-10-06T02:58:27.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4694004810 0x7f46a80c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46a8158280 0x7f46a81543e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 --2- 172.21.15.84:0/1801417485 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46a80c9650 0x7f46a815a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 >> 172.21.15.84:0/1801417485 conn(0x7f46a806ed20 msgr2=0x7f46a8155590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 shutdown_connections 2023-10-06T02:58:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.689+0000 7f46ae2c5700 1 -- 172.21.15.84:0/1801417485 wait complete. 2023-10-06T02:58:27.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:58:27.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.818+0000 7f4cb9e7d700 1 Processor -- start 2023-10-06T02:58:27.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.818+0000 7f4cb9e7d700 1 -- start start 2023-10-06T02:58:27.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.819+0000 7f4cb9e7d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4cb4159510 0x7f4cb40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:27.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.819+0000 7f4cb9e7d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cb40cbae0 0x7f4cb40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:27.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.819+0000 7f4cb9e7d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb40cbf20 con 0x7f4cb41598e0 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.819+0000 7f4cb9e7d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb40cf610 con 0x7f4cb40cbae0 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.819+0000 7f4cb9e7d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb40cf8f0 con 0x7f4cb4159510 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.819+0000 7f4cb3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cb40cbae0 0x7f4cb40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.819+0000 7f4cb3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4cb40cbae0 0x7f4cb40cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48878/0 (socket says 172.21.15.84:48878) 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.819+0000 7f4cb3fff700 1 -- 172.21.15.84:0/3058357851 learned_addr learned my addr 172.21.15.84:0/3058357851 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb37fe700 1 --2- 172.21.15.84:0/3058357851 >> v2:172.21.15.131:3300/0 conn(0x7f4cb4159510 0x7f4cb40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb3fff700 1 -- 172.21.15.84:0/3058357851 >> v2:172.21.15.131:3300/0 conn(0x7f4cb4159510 msgr2=0x7f4cb40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb3fff700 1 --2- 172.21.15.84:0/3058357851 >> v2:172.21.15.131:3300/0 conn(0x7f4cb4159510 0x7f4cb40cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb3fff700 1 -- 172.21.15.84:0/3058357851 >> v1:172.21.15.131:6789/0 conn(0x7f4cb41598e0 legacy=0x7f4cb40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb3fff700 1 -- 172.21.15.84:0/3058357851 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb40cfbd0 con 0x7f4cb40cbae0 2023-10-06T02:58:27.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb37fe700 1 --2- 172.21.15.84:0/3058357851 >> v2:172.21.15.131:3300/0 conn(0x7f4cb4159510 0x7f4cb40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb3fff700 1 --2- 172.21.15.84:0/3058357851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb40cbae0 0x7f4cb40cef30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4088fb0 tx=0x7f4cac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78eaf58b2f9427c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb27fc700 1 -- 172.21.15.84:0/3058357851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac00e070 con 0x7f4cb40cbae0 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb27fc700 1 -- 172.21.15.84:0/3058357851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac00ba10 con 0x7f4cb40cbae0 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb27fc700 1 -- 172.21.15.84:0/3058357851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0092e0 con 0x7f4cb40cbae0 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/3058357851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb40cbae0 msgr2=0x7f4cb40cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb9e7d700 1 --2- 172.21.15.84:0/3058357851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb40cbae0 0x7f4cb40cef30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4088fb0 tx=0x7f4cac009840 comp rx=0 tx=0).stop 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/3058357851 shutdown_connections 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb9e7d700 1 --2- 172.21.15.84:0/3058357851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb40cbae0 0x7f4cb40cef30 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.820+0000 7f4cb9e7d700 1 --2- 172.21.15.84:0/3058357851 >> v2:172.21.15.131:3300/0 conn(0x7f4cb4159510 0x7f4cb40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.821+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/3058357851 >> 172.21.15.84:0/3058357851 conn(0x7f4cb4089e90 msgr2=0x7f4cb40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.821+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/3058357851 shutdown_connections 2023-10-06T02:58:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.821+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/3058357851 wait complete. 2023-10-06T02:58:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.822+0000 7f4cb9e7d700 1 Processor -- start 2023-10-06T02:58:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.822+0000 7f4cb9e7d700 1 -- start start 2023-10-06T02:58:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.822+0000 7f4cb9e7d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cb40cbae0 0x7f4cb41492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.822+0000 7f4cb9e7d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb4159510 0x7f4cb4159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.822+0000 7f4cb9e7d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cb41598e0 0x7f4cb415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.822+0000 7f4cb9e7d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb40b5b10 con 0x7f4cb4159510 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.822+0000 7f4cb9e7d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb415b4d0 con 0x7f4cb40cbae0 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.822+0000 7f4cb9e7d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb41497f0 con 0x7f4cb41598e0 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb4159510 0x7f4cb4159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb4159510 0x7f4cb4159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48882/0 (socket says 172.21.15.84:48882) 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb2ffd700 1 -- 172.21.15.84:0/2077510661 learned_addr learned my addr 172.21.15.84:0/2077510661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb3fff700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cb41598e0 0x7f4cb415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb37fe700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cb40cbae0 0x7f4cb41492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb2ffd700 1 -- 172.21.15.84:0/2077510661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cb41598e0 msgr2=0x7f4cb415a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb2ffd700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cb41598e0 0x7f4cb415a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb2ffd700 1 -- 172.21.15.84:0/2077510661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cb40cbae0 msgr2=0x7f4cb41492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb2ffd700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cb40cbae0 0x7f4cb41492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb2ffd700 1 -- 172.21.15.84:0/2077510661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac009ae0 con 0x7f4cb4159510 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb2ffd700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb4159510 0x7f4cb4159ce0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800b540 tx=0x7f4ca80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4c9b7fe700 1 -- 172.21.15.84:0/2077510661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800f510 con 0x7f4cb4159510 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4c9b7fe700 1 -- 172.21.15.84:0/2077510661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca800f670 con 0x7f4cb4159510 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb415a8c0 con 0x7f4cb4159510 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4c9b7fe700 1 -- 172.21.15.84:0/2077510661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800fa30 con 0x7f4cb4159510 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.823+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb415ae80 con 0x7f4cb4159510 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.824+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb415b680 con 0x7f4cb4159510 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.825+0000 7f4c9b7fe700 1 -- 172.21.15.84:0/2077510661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ca801a400 con 0x7f4cb4159510 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.825+0000 7f4c9b7fe700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ca0066f30 0x7f4ca00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.825+0000 7f4cb37fe700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ca0066f30 0x7f4ca00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.825+0000 7f4c9b7fe700 1 -- 172.21.15.84:0/2077510661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f4ca8083ee0 con 0x7f4cb4159510 2023-10-06T02:58:27.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.825+0000 7f4cb37fe700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ca0066f30 0x7f4ca00693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400adc0 tx=0x7f4ca4006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:27.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:27.829+0000 7f4c9b7fe700 1 -- 172.21.15.84:0/2077510661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cb415b680 con 0x7f4cb4159510 2023-10-06T02:58:28.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.011+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4cb415b680 con 0x7f4cb4159510 2023-10-06T02:58:28.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.015+0000 7f4c9b7fe700 1 -- 172.21.15.84:0/2077510661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4cb415b680 con 0x7f4cb4159510 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ca0066f30 msgr2=0x7f4ca00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ca0066f30 0x7f4ca00693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400adc0 tx=0x7f4ca4006f90 comp rx=0 tx=0).stop 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb4159510 msgr2=0x7f4cb4159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb4159510 0x7f4cb4159ce0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800b540 tx=0x7f4ca80090f0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 shutdown_connections 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ca0066f30 0x7f4ca00693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cb40cbae0 0x7f4cb41492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cb41598e0 0x7f4cb415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 --2- 172.21.15.84:0/2077510661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cb4159510 0x7f4cb4159ce0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 >> 172.21.15.84:0/2077510661 conn(0x7f4cb4089e90 msgr2=0x7f4cb414a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:28.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 shutdown_connections 2023-10-06T02:58:28.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.017+0000 7f4cb9e7d700 1 -- 172.21.15.84:0/2077510661 wait complete. 2023-10-06T02:58:28.030 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:58:28.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:58:28.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:58:28.115 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:58:28.115 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:58:28.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:28.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.227+0000 7fbbb3d3d700 1 Processor -- start 2023-10-06T02:58:28.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.227+0000 7fbbb3d3d700 1 -- start start 2023-10-06T02:58:28.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.228+0000 7fbbb3d3d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbbac1595a0 0x7fbbac0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.228+0000 7fbbb3d3d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbbac0b49e0 0x7fbbac0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.228+0000 7fbbb3d3d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac0b0ca0 con 0x7fbbac0b07a0 2023-10-06T02:58:28.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.228+0000 7fbbb3d3d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0b0f80 con 0x7fbbac0b49e0 2023-10-06T02:58:28.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.228+0000 7fbbb3d3d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac0b1260 con 0x7fbbac1595a0 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.228+0000 7fbbb12d8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbbac0b49e0 0x7fbbac0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.228+0000 7fbbb12d8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbbac0b49e0 0x7fbbac0aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48892/0 (socket says 172.21.15.84:48892) 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.228+0000 7fbbb12d8700 1 -- 172.21.15.84:0/2036737919 learned_addr learned my addr 172.21.15.84:0/2036737919 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb1ad9700 1 --2- 172.21.15.84:0/2036737919 >> v2:172.21.15.131:3300/0 conn(0x7fbbac1595a0 0x7fbbac0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb12d8700 1 -- 172.21.15.84:0/2036737919 >> v2:172.21.15.131:3300/0 conn(0x7fbbac1595a0 msgr2=0x7fbbac0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb12d8700 1 --2- 172.21.15.84:0/2036737919 >> v2:172.21.15.131:3300/0 conn(0x7fbbac1595a0 0x7fbbac0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb12d8700 1 -- 172.21.15.84:0/2036737919 >> v1:172.21.15.131:6789/0 conn(0x7fbbac0b07a0 legacy=0x7fbbac0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb12d8700 1 -- 172.21.15.84:0/2036737919 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac0b1540 con 0x7fbbac0b49e0 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb12d8700 1 --2- 172.21.15.84:0/2036737919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 0x7fbbac0aaab0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0099b0 tx=0x7fbb9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab811563214494ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb0ad7700 1 -- 172.21.15.84:0/2036737919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00b7e0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb0ad7700 1 -- 172.21.15.84:0/2036737919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c00b940 con 0x7fbbac0b49e0 2023-10-06T02:58:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb0ad7700 1 -- 172.21.15.84:0/2036737919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00bce0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/2036737919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 msgr2=0x7fbbac0aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb3d3d700 1 --2- 172.21.15.84:0/2036737919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 0x7fbbac0aaab0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0099b0 tx=0x7fbb9c009250 comp rx=0 tx=0).stop 2023-10-06T02:58:28.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/2036737919 shutdown_connections 2023-10-06T02:58:28.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb3d3d700 1 --2- 172.21.15.84:0/2036737919 >> v2:172.21.15.131:3300/0 conn(0x7fbbac1595a0 0x7fbbac0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb3d3d700 1 --2- 172.21.15.84:0/2036737919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 0x7fbbac0aaab0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/2036737919 >> 172.21.15.84:0/2036737919 conn(0x7fbbac099830 msgr2=0x7fbbac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:28.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.229+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/2036737919 shutdown_connections 2023-10-06T02:58:28.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.230+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/2036737919 wait complete. 2023-10-06T02:58:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb3d3d700 1 Processor -- start 2023-10-06T02:58:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb3d3d700 1 -- start start 2023-10-06T02:58:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb3d3d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbac0b07a0 0x7fbbac14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb3d3d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 0x7fbbac09d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb3d3d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbac1595a0 0x7fbbac09b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb3d3d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac09a130 con 0x7fbbac0b49e0 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb3d3d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac09a410 con 0x7fbbac0b07a0 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb3d3d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac09a6f0 con 0x7fbbac1595a0 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb12d8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 0x7fbbac09d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb12d8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 0x7fbbac09d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48900/0 (socket says 172.21.15.84:48900) 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb12d8700 1 -- 172.21.15.84:0/528325060 learned_addr learned my addr 172.21.15.84:0/528325060 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.231+0000 7fbbb1ad9700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbac0b07a0 0x7fbbac14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbbb22da700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbac1595a0 0x7fbbac09b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbbb12d8700 1 -- 172.21.15.84:0/528325060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbac1595a0 msgr2=0x7fbbac09b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbbb12d8700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbac1595a0 0x7fbbac09b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbbb12d8700 1 -- 172.21.15.84:0/528325060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbac0b07a0 msgr2=0x7fbbac14a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbbb12d8700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbac0b07a0 0x7fbbac14a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbbb12d8700 1 -- 172.21.15.84:0/528325060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c0094f0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbbb12d8700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 0x7fbbac09d9a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0030c0 tx=0x7fbb9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbba1ffb700 1 -- 172.21.15.84:0/528325060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c011ce0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbba1ffb700 1 -- 172.21.15.84:0/528325060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c020070 con 0x7fbbac0b49e0 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac09a9d0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbba1ffb700 1 -- 172.21.15.84:0/528325060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c01b6a0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.232+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac14ade0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.233+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac09aef0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.233+0000 7fbba1ffb700 1 -- 172.21.15.84:0/528325060 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb9c022030 con 0x7fbbac0b49e0 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.234+0000 7fbba1ffb700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb90066f30 0x7fbb900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.234+0000 7fbba1ffb700 1 -- 172.21.15.84:0/528325060 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fbb9c086460 con 0x7fbbac0b49e0 2023-10-06T02:58:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.234+0000 7fbbb1ad9700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb90066f30 0x7fbb900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.234+0000 7fbbb1ad9700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb90066f30 0x7fbb900693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbba80075e0 tx=0x7fbba8009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:28.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.238+0000 7fbba1ffb700 1 -- 172.21.15.84:0/528325060 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbac09aef0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.465+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbac09aef0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.465+0000 7fbba1ffb700 1 -- 172.21.15.84:0/528325060 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fbbac09aef0 con 0x7fbbac0b49e0 2023-10-06T02:58:28.467 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:28.467 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/1988414648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":1988414648},{"type":"v1","addr":"172.21.15.131:6833","nonce":1988414648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2087393260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2087393260},{"type":"v1","addr":"172.21.15.131:6835","nonce":2087393260}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6450,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1598539122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1598539122},{"type":"v1","addr":"172.21.15.84:6835","nonce":1598539122}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6456,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1046174819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1046174819},{"type":"v1","addr":"172.21.15.84:6837","nonce":1046174819}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[]} 2023-10-06T02:58:28.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb90066f30 msgr2=0x7fbb900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb90066f30 0x7fbb900693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbba80075e0 tx=0x7fbba8009830 comp rx=0 tx=0).stop 2023-10-06T02:58:28.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 msgr2=0x7fbbac09d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 0x7fbbac09d9a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0030c0 tx=0x7fbb9c016000 comp rx=0 tx=0).stop 2023-10-06T02:58:28.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 shutdown_connections 2023-10-06T02:58:28.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb90066f30 0x7fbb900693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbac0b07a0 0x7fbbac14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbbac1595a0 0x7fbbac09b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 --2- 172.21.15.84:0/528325060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac0b49e0 0x7fbbac09d9a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.467+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 >> 172.21.15.84:0/528325060 conn(0x7fbbac099830 msgr2=0x7fbbac158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:28.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.468+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 shutdown_connections 2023-10-06T02:58:28.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.468+0000 7fbbb3d3d700 1 -- 172.21.15.84:0/528325060 wait complete. 2023-10-06T02:58:28.471 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 46 2023-10-06T02:58:28.481 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:58:28.481 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:58:28.482 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:58:28.482 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:28.482 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:58:28.482 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:58:28.482 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:58:28.482 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:28.482 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:58:28.483 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:58:28.483 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:58:28.483 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:28.483 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:58:28.483 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:58:28.483 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:58:28.483 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:58:28.492 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:58:28.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:58:28.493 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:58:28.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:58:28.494 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:58:28.494 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:58:28.495 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:58:28.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:58:28.534 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:58:28.535 DEBUG:teuthology.parallel:result is None 2023-10-06T02:58:28.536 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:58:28.536 DEBUG:teuthology.parallel:result is None 2023-10-06T02:58:28.537 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:58:28.537 DEBUG:teuthology.parallel:result is None 2023-10-06T02:58:28.538 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:58:28.538 DEBUG:teuthology.parallel:result is None 2023-10-06T02:58:28.538 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:58:28.607 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T02:58:28.607 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T02:58:28.619 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T02:58:28.619 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T02:58:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.656+0000 7fea1001d700 1 Processor -- start 2023-10-06T02:58:28.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.656+0000 7fea1001d700 1 -- start start 2023-10-06T02:58:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea1001d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fea080caad0 0x7fea0806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea1001d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0806ed10 con 0x7fea080675f0 2023-10-06T02:58:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea1001d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080cb8b0 con 0x7fea0815caf0 2023-10-06T02:58:28.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea1001d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea080cbb90 con 0x7fea080caad0 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea0e5ba700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fea080675f0 0x7fea080679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39392/0 (socket says 172.21.15.84:39392) 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea0e5ba700 1 -- 172.21.15.84:0/200978424 learned_addr learned my addr 172.21.15.84:0/200978424 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea0d5b8700 1 --2- 172.21.15.84:0/200978424 >> v2:172.21.15.131:3300/0 conn(0x7fea080caad0 0x7fea0806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea0cdb7700 1 -- 172.21.15.84:0/200978424 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987687906 0 0) 0x7fea0806ed10 con 0x7fea080675f0 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea0cdb7700 1 -- 172.21.15.84:0/200978424 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f4003570 con 0x7fea080675f0 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea0d5b8700 1 -- 172.21.15.84:0/200978424 >> v1:172.21.15.131:6789/0 conn(0x7fea0815caf0 legacy=0x7fea080caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea0cdb7700 1 -- 172.21.15.84:0/200978424 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002915258 0 0) 0x7fea080cb8b0 con 0x7fea0815caf0 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea0d5b8700 1 -- 172.21.15.84:0/200978424 >> v1:172.21.15.84:6789/0 conn(0x7fea080675f0 legacy=0x7fea080679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.657+0000 7fea0d5b8700 1 -- 172.21.15.84:0/200978424 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0806e6c0 con 0x7fea080caad0 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea0d5b8700 1 --2- 172.21.15.84:0/200978424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 0x7fea0806f1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80098e0 tx=0x7fe9f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8040de82449f26ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:28.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea0cdb7700 1 -- 172.21.15.84:0/200978424 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000017f0 con 0x7fea080caad0 2023-10-06T02:58:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea0cdb7700 1 -- 172.21.15.84:0/200978424 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8011420 con 0x7fea080caad0 2023-10-06T02:58:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea0cdb7700 1 -- 172.21.15.84:0/200978424 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80117c0 con 0x7fea080caad0 2023-10-06T02:58:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea1001d700 1 -- 172.21.15.84:0/200978424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 msgr2=0x7fea0806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea1001d700 1 --2- 172.21.15.84:0/200978424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 0x7fea0806f1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80098e0 tx=0x7fe9f80091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea1001d700 1 -- 172.21.15.84:0/200978424 shutdown_connections 2023-10-06T02:58:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea1001d700 1 --2- 172.21.15.84:0/200978424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 0x7fea0806f1a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea1001d700 1 -- 172.21.15.84:0/200978424 >> 172.21.15.84:0/200978424 conn(0x7fea080cdef0 msgr2=0x7fea080c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea1001d700 1 -- 172.21.15.84:0/200978424 shutdown_connections 2023-10-06T02:58:28.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.658+0000 7fea1001d700 1 -- 172.21.15.84:0/200978424 wait complete. 2023-10-06T02:58:28.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.659+0000 7fea1001d700 1 Processor -- start 2023-10-06T02:58:28.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea1001d700 1 -- start start 2023-10-06T02:58:28.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea1001d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea080675f0 0x7fea08158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea1001d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 0x7fea0815aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea1001d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea0815caf0 0x7fea0815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea1001d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080ab4b0 con 0x7fea0815caf0 2023-10-06T02:58:28.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea1001d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080aa8a0 con 0x7fea080caad0 2023-10-06T02:58:28.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea1001d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea080aab80 con 0x7fea080675f0 2023-10-06T02:58:28.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea0e5ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea0815caf0 0x7fea0815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea0e5ba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea0815caf0 0x7fea0815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48958/0 (socket says 172.21.15.84:48958) 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea0e5ba700 1 -- 172.21.15.84:0/568474955 learned_addr learned my addr 172.21.15.84:0/568474955 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea0d5b8700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 0x7fea0815aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.660+0000 7fea0ddb9700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea080675f0 0x7fea08158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fea0e5ba700 1 -- 172.21.15.84:0/568474955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea080675f0 msgr2=0x7fea08158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fea0e5ba700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea080675f0 0x7fea08158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fea0e5ba700 1 -- 172.21.15.84:0/568474955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 msgr2=0x7fea0815aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fea0e5ba700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 0x7fea0815aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fea0e5ba700 1 -- 172.21.15.84:0/568474955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8009420 con 0x7fea0815caf0 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fea0d5b8700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 0x7fea0815aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:28.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fea0e5ba700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea0815caf0 0x7fea0815afc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fea0000ccf0 tx=0x7fea00007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fe9fdffb700 1 -- 172.21.15.84:0/568474955 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00004dc0 con 0x7fea0815caf0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fe9fdffb700 1 -- 172.21.15.84:0/568474955 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0000a700 con 0x7fea0815caf0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea080aae60 con 0x7fea0815caf0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fe9fdffb700 1 -- 172.21.15.84:0/568474955 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0000aac0 con 0x7fea0815caf0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.661+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea081565a0 con 0x7fea0815caf0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.662+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea080ab840 con 0x7fea0815caf0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.663+0000 7fe9fdffb700 1 -- 172.21.15.84:0/568474955 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea00007150 con 0x7fea0815caf0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.663+0000 7fe9fdffb700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe9ec066f30 0x7fe9ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.663+0000 7fe9fdffb700 1 -- 172.21.15.84:0/568474955 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fea00084150 con 0x7fea0815caf0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.663+0000 7fea0ddb9700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe9ec066f30 0x7fe9ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:28.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.663+0000 7fea0ddb9700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe9ec066f30 0x7fe9ec0693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fea04003a40 tx=0x7fea04007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:28.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.667+0000 7fe9fdffb700 1 -- 172.21.15.84:0/568474955 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea080ab840 con 0x7fea0815caf0 2023-10-06T02:58:28.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:28.871+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fea080ab840 con 0x7fea0815caf0 2023-10-06T02:58:29.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.703+0000 7fe9fdffb700 1 -- 172.21.15.84:0/568474955 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7fea080ab840 con 0x7fea0815caf0 2023-10-06T02:58:29.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe9ec066f30 msgr2=0x7fe9ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe9ec066f30 0x7fe9ec0693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fea04003a40 tx=0x7fea04007ec0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea0815caf0 msgr2=0x7fea0815afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea0815caf0 0x7fea0815afc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fea0000ccf0 tx=0x7fea00007e10 comp rx=0 tx=0).stop 2023-10-06T02:58:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 shutdown_connections 2023-10-06T02:58:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe9ec066f30 0x7fe9ec0693e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea0815caf0 0x7fea0815afc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea080675f0 0x7fea08158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 --2- 172.21.15.84:0/568474955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea080caad0 0x7fea0815aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 >> 172.21.15.84:0/568474955 conn(0x7fea080cdef0 msgr2=0x7fea080c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 shutdown_connections 2023-10-06T02:58:29.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.705+0000 7fea1001d700 1 -- 172.21.15.84:0/568474955 wait complete. 2023-10-06T02:58:29.708 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T02:58:29.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:58:29.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.834+0000 7f8d01ad5700 1 Processor -- start 2023-10-06T02:58:29.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.834+0000 7f8d01ad5700 1 -- start start 2023-10-06T02:58:29.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.835+0000 7f8d01ad5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8cfc1595a0 0x7f8cfc0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.835+0000 7f8d01ad5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc0b49e0 0x7f8cfc0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.835+0000 7f8d01ad5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc0b0ca0 con 0x7f8cfc0b07a0 2023-10-06T02:58:29.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.835+0000 7f8d01ad5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc0b0f80 con 0x7f8cfc1595a0 2023-10-06T02:58:29.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.835+0000 7f8d01ad5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc0b1260 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.835+0000 7f8cfaffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc0b49e0 0x7f8cfc0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.835+0000 7f8cfb7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8cfc1595a0 0x7f8cfc0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.835+0000 7f8cfaffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc0b49e0 0x7f8cfc0aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:56706/0 (socket says 172.21.15.84:56706) 2023-10-06T02:58:29.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.835+0000 7f8cfaffd700 1 -- 172.21.15.84:0/4288183705 learned_addr learned my addr 172.21.15.84:0/4288183705 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfb7fe700 1 -- 172.21.15.84:0/4288183705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc0b49e0 msgr2=0x7f8cfc0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfb7fe700 1 --2- 172.21.15.84:0/4288183705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc0b49e0 0x7f8cfc0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfb7fe700 1 -- 172.21.15.84:0/4288183705 >> v1:172.21.15.131:6789/0 conn(0x7f8cfc0b07a0 legacy=0x7f8cfc0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfa7fc700 1 -- 172.21.15.84:0/4288183705 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042740079 0 0) 0x7f8cfc0b0ca0 con 0x7f8cfc0b07a0 2023-10-06T02:58:29.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfb7fe700 1 -- 172.21.15.84:0/4288183705 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc0b1540 con 0x7f8cfc1595a0 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfaffd700 1 --2- 172.21.15.84:0/4288183705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc0b49e0 0x7f8cfc0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfb7fe700 1 --2- 172.21.15.84:0/4288183705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cfc1595a0 0x7f8cfc0aa570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009eb0 tx=0x7f8cec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed516f26c56e9a31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfa7fc700 1 -- 172.21.15.84:0/4288183705 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec00e070 con 0x7f8cfc1595a0 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfa7fc700 1 -- 172.21.15.84:0/4288183705 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec00bc30 con 0x7f8cfc1595a0 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.836+0000 7f8cfa7fc700 1 -- 172.21.15.84:0/4288183705 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec012430 con 0x7f8cfc1595a0 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.837+0000 7f8d01ad5700 1 -- 172.21.15.84:0/4288183705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cfc1595a0 msgr2=0x7f8cfc0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.837+0000 7f8d01ad5700 1 --2- 172.21.15.84:0/4288183705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cfc1595a0 0x7f8cfc0aa570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009eb0 tx=0x7f8cec009780 comp rx=0 tx=0).stop 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.837+0000 7f8d01ad5700 1 -- 172.21.15.84:0/4288183705 shutdown_connections 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.837+0000 7f8d01ad5700 1 --2- 172.21.15.84:0/4288183705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cfc1595a0 0x7f8cfc0aa570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.837+0000 7f8d01ad5700 1 --2- 172.21.15.84:0/4288183705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc0b49e0 0x7f8cfc0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.837+0000 7f8d01ad5700 1 -- 172.21.15.84:0/4288183705 >> 172.21.15.84:0/4288183705 conn(0x7f8cfc099830 msgr2=0x7f8cfc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.837+0000 7f8d01ad5700 1 -- 172.21.15.84:0/4288183705 shutdown_connections 2023-10-06T02:58:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.837+0000 7f8d01ad5700 1 -- 172.21.15.84:0/4288183705 wait complete. 2023-10-06T02:58:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.838+0000 7f8d01ad5700 1 Processor -- start 2023-10-06T02:58:29.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.838+0000 7f8d01ad5700 1 -- start start 2023-10-06T02:58:29.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8d01ad5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cfc0b07a0 0x7f8cfc14a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8d01ad5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cfc0b49e0 0x7f8cfc09bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8d01ad5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc1595a0 0x7f8cfc09d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8d01ad5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc09aa50 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8d01ad5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc14ae50 con 0x7f8cfc0b07a0 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8d01ad5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc09ac40 con 0x7f8cfc1595a0 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cfc0b49e0 0x7f8cfc09bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cfc0b49e0 0x7f8cfc09bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48972/0 (socket says 172.21.15.84:48972) 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfaffd700 1 -- 172.21.15.84:0/1677614984 learned_addr learned my addr 172.21.15.84:0/1677614984 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfb7fe700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cfc0b07a0 0x7f8cfc14a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfbfff700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc1595a0 0x7f8cfc09d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfaffd700 1 -- 172.21.15.84:0/1677614984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc1595a0 msgr2=0x7f8cfc09d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfaffd700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc1595a0 0x7f8cfc09d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfaffd700 1 -- 172.21.15.84:0/1677614984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cfc0b07a0 msgr2=0x7f8cfc14a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:29.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfaffd700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cfc0b07a0 0x7f8cfc14a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfaffd700 1 -- 172.21.15.84:0/1677614984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00094f0 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8cfaffd700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cfc0b49e0 0x7f8cfc09bce0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000ec50 tx=0x7f8cf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8ce37fe700 1 -- 172.21.15.84:0/1677614984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf000ca60 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8ce37fe700 1 -- 172.21.15.84:0/1677614984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf000cbc0 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec009a20 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8ce37fe700 1 -- 172.21.15.84:0/1677614984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0013470 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.839+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc09b4e0 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.840+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc09b040 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.841+0000 7f8ce37fe700 1 -- 172.21.15.84:0/1677614984 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cf0013820 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.841+0000 7f8ce37fe700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ce8066f60 0x7f8ce8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:29.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.841+0000 7f8ce37fe700 1 -- 172.21.15.84:0/1677614984 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8cf0084ce0 con 0x7f8cfc0b49e0 2023-10-06T02:58:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.841+0000 7f8cfb7fe700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ce8066f60 0x7f8ce8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.842+0000 7f8cfb7fe700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ce8066f60 0x7f8ce8069410 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009eb0 tx=0x7f8cec019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:29.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:29.845+0000 7f8ce37fe700 1 -- 172.21.15.84:0/1677614984 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cf0052000 con 0x7f8cfc0b49e0 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.099+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8cfc064ad0 con 0x7f8cfc0b49e0 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.100+0000 7f8ce37fe700 1 -- 172.21.15.84:0/1677614984 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8cf0055620 con 0x7f8cfc0b49e0 2023-10-06T02:58:30.101 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lFrNmJBAAeVhw9betN9snqLPgSK9efw==", 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.102 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lbi6hLxAAICzxeAsbJ5rhbyMBkPcrAQ==", 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lSCo1KxAAuETY4PeWDJS3bGzqTpHLpQ==", 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T02:58:30.104 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lvPxyNhAAKlqBTG/Fr8/2Rf+lcGQxIg==", 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDUdh9lV3sRIRAAoUtG7F6EMyew6CX3NaNufw==", 2023-10-06T02:58:30.105 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDXdh9ls5OxHhAAanGTRmjW75UAwrqzL0CIdw==", 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:58:30.106 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDadh9lQeJTHhAAFeayQY1F10UDCck78/ja4w==", 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.107 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDddh9l+cx8HhAAeAcoLzCUiCC+9O+WZYYTsA==", 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDjdh9lA4upJxAAdFHhR2/rMyG2NbQEu7JpLw==", 2023-10-06T02:58:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDmdh9lOGETJRAA7nLtgcumxqfum8cirnbaRA==", 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:58:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDpdh9lSbDhJBAAnMWhjKSKYcLaZeRk9drdgA==", 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.110 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDsdh9lImOeIhAAPUO3jy2/cPZW+eKukBywcw==", 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T02:58:30.111 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lRRw/OhAAwavsq3e0HeVF3/G4SX0v+A==", 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lftv/BhAAo8sb1EG96nHv77bn3af/dg==", 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:58:30.112 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lxOX6AxAAWDpHCodRcEc2/YF5yqnkQg==", 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:58:30.113 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lheJnDBAAqAQeFxMQ9Qv108TLz65mVw==", 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:58:30.114 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9l8qZuCBAArPoeoGgydlQPFp7XYwI9KQ==", 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.115 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9ly2pdIRAAX7YmT9B/MzoD8xJH347ruQ==", 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:30.116 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lW/KSHBAAEvgj/BAe20tCp8uwBEIVbA==", 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T02:58:30.117 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ce8066f60 msgr2=0x7f8ce8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ce8066f60 0x7f8ce8069410 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009eb0 tx=0x7f8cec019000 comp rx=0 tx=0).stop 2023-10-06T02:58:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cfc0b49e0 msgr2=0x7f8cfc09bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cfc0b49e0 0x7f8cfc09bce0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000ec50 tx=0x7f8cf0009250 comp rx=0 tx=0).stop 2023-10-06T02:58:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 shutdown_connections 2023-10-06T02:58:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8ce8066f60 0x7f8ce8069410 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cfc0b07a0 0x7f8cfc14a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cfc1595a0 0x7f8cfc09d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 --2- 172.21.15.84:0/1677614984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8cfc0b49e0 0x7f8cfc09bce0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 >> 172.21.15.84:0/1677614984 conn(0x7f8cfc099830 msgr2=0x7f8cfc0d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:30.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 shutdown_connections 2023-10-06T02:58:30.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.102+0000 7f8d01ad5700 1 -- 172.21.15.84:0/1677614984 wait complete. 2023-10-06T02:58:30.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:58:30.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.232+0000 7fc06efb9700 1 Processor -- start 2023-10-06T02:58:30.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.232+0000 7fc06efb9700 1 -- start start 2023-10-06T02:58:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.233+0000 7fc06efb9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0680b29f0 0x7fc068159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.233+0000 7fc06efb9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0680b0de0 con 0x7fc0680b2620 2023-10-06T02:58:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.233+0000 7fc06efb9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0680cbfe0 con 0x7fc0681596a0 2023-10-06T02:58:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.233+0000 7fc06efb9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0680cb3d0 con 0x7fc0680b29f0 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.233+0000 7fc067fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0680b29f0 0x7fc068159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.233+0000 7fc06cd55700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc0680b2620 0x7fc0680b06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39398/0 (socket says 172.21.15.84:39398) 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.233+0000 7fc06cd55700 1 -- 172.21.15.84:0/2587505970 learned_addr learned my addr 172.21.15.84:0/2587505970 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc067fff700 1 -- 172.21.15.84:0/2587505970 >> v1:172.21.15.131:6789/0 conn(0x7fc0681596a0 legacy=0x7fc0680cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc067fff700 1 -- 172.21.15.84:0/2587505970 >> v1:172.21.15.84:6789/0 conn(0x7fc0680b2620 legacy=0x7fc0680b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc067fff700 1 -- 172.21.15.84:0/2587505970 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0680cb6b0 con 0x7fc0680b29f0 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc0677fe700 1 -- 172.21.15.84:0/2587505970 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966612376 0 0) 0x7fc058001610 con 0x7fc0680b2620 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc067fff700 1 --2- 172.21.15.84:0/2587505970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 0x7fc068159160 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0098e0 tx=0x7fc05c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f18e06fb8402a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc0677fe700 1 -- 172.21.15.84:0/2587505970 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c009e80 con 0x7fc0680b29f0 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc0677fe700 1 -- 172.21.15.84:0/2587505970 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00b860 con 0x7fc0680b29f0 2023-10-06T02:58:30.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc0677fe700 1 -- 172.21.15.84:0/2587505970 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00bbe0 con 0x7fc0680b29f0 2023-10-06T02:58:30.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc06efb9700 1 -- 172.21.15.84:0/2587505970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 msgr2=0x7fc068159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.234+0000 7fc06efb9700 1 --2- 172.21.15.84:0/2587505970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 0x7fc068159160 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0098e0 tx=0x7fc05c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.235+0000 7fc06efb9700 1 -- 172.21.15.84:0/2587505970 shutdown_connections 2023-10-06T02:58:30.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.235+0000 7fc06efb9700 1 --2- 172.21.15.84:0/2587505970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 0x7fc068159160 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.235+0000 7fc06efb9700 1 -- 172.21.15.84:0/2587505970 >> 172.21.15.84:0/2587505970 conn(0x7fc06806ed20 msgr2=0x7fc06806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:30.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.235+0000 7fc06efb9700 1 -- 172.21.15.84:0/2587505970 shutdown_connections 2023-10-06T02:58:30.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.235+0000 7fc06efb9700 1 -- 172.21.15.84:0/2587505970 wait complete. 2023-10-06T02:58:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.236+0000 7fc06efb9700 1 Processor -- start 2023-10-06T02:58:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.236+0000 7fc06efb9700 1 -- start start 2023-10-06T02:58:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.236+0000 7fc06efb9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0680b2620 0x7fc06816e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.236+0000 7fc06efb9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 0x7fc0680c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.236+0000 7fc06efb9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0681596a0 0x7fc068150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc06efb9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06815e760 con 0x7fc0680b29f0 2023-10-06T02:58:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc06efb9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06816e5a0 con 0x7fc0681596a0 2023-10-06T02:58:30.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc06efb9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680c8080 con 0x7fc0680b2620 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc067fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 0x7fc0680c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc067fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 0x7fc0680c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48988/0 (socket says 172.21.15.84:48988) 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc067fff700 1 -- 172.21.15.84:0/2262882614 learned_addr learned my addr 172.21.15.84:0/2262882614 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc06cd55700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0680b2620 0x7fc06816e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc06d556700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0681596a0 0x7fc068150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc067fff700 1 -- 172.21.15.84:0/2262882614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0680b2620 msgr2=0x7fc06816e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc067fff700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0680b2620 0x7fc06816e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc067fff700 1 -- 172.21.15.84:0/2262882614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0681596a0 msgr2=0x7fc068150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc067fff700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0681596a0 0x7fc068150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc067fff700 1 -- 172.21.15.84:0/2262882614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c009420 con 0x7fc0680b29f0 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc06d556700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0681596a0 0x7fc068150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc067fff700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 0x7fc0680c7b40 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc0680696d0 tx=0x7fc05c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc064ff9700 1 -- 172.21.15.84:0/2262882614 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c01f070 con 0x7fc0680b29f0 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc064ff9700 1 -- 172.21.15.84:0/2262882614 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c000c90 con 0x7fc0680b29f0 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06815e480 con 0x7fc0680b29f0 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc064ff9700 1 -- 172.21.15.84:0/2262882614 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c025420 con 0x7fc0680b29f0 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.237+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0680b36c0 con 0x7fc0680b29f0 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.238+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06815e8a0 con 0x7fc0680b29f0 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.239+0000 7fc064ff9700 1 -- 172.21.15.84:0/2262882614 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc05c023070 con 0x7fc0680b29f0 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.239+0000 7fc064ff9700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc054066f30 0x7fc0540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.239+0000 7fc064ff9700 1 -- 172.21.15.84:0/2262882614 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc05c085a10 con 0x7fc0680b29f0 2023-10-06T02:58:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.239+0000 7fc06cd55700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc054066f30 0x7fc0540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.239+0000 7fc06cd55700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc054066f30 0x7fc0540693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc058000f80 tx=0x7fc058009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.243+0000 7fc064ff9700 1 -- 172.21.15.84:0/2262882614 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc05c052d30 con 0x7fc0680b29f0 2023-10-06T02:58:30.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.424+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc068064ad0 con 0x7fc0680b29f0 2023-10-06T02:58:30.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.425+0000 7fc064ff9700 1 -- 172.21.15.84:0/2262882614 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+13855 (secure 0 0 0) 0x7fc05c02a090 con 0x7fc0680b29f0 2023-10-06T02:58:30.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:30.427 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":64,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:58:29.700635+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:58:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc054066f30 msgr2=0x7fc0540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc054066f30 0x7fc0540693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc058000f80 tx=0x7fc058009040 comp rx=0 tx=0).stop 2023-10-06T02:58:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 msgr2=0x7fc0680c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 0x7fc0680c7b40 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc0680696d0 tx=0x7fc05c017000 comp rx=0 tx=0).stop 2023-10-06T02:58:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 shutdown_connections 2023-10-06T02:58:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc054066f30 0x7fc0540693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0681596a0 0x7fc068150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0680b2620 0x7fc06816e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 --2- 172.21.15.84:0/2262882614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0680b29f0 0x7fc0680c7b40 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 >> 172.21.15.84:0/2262882614 conn(0x7fc06806ed20 msgr2=0x7fc0680d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:30.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 shutdown_connections 2023-10-06T02:58:30.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.427+0000 7fc06efb9700 1 -- 172.21.15.84:0/2262882614 wait complete. 2023-10-06T02:58:30.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:58:30.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:58:30.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.557+0000 7fdf4759e700 1 Processor -- start 2023-10-06T02:58:30.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.557+0000 7fdf4759e700 1 -- start start 2023-10-06T02:58:30.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf4759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 0x7fdf480cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf4759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdf480b2a30 0x7fdf480cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf4759e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf480cc9b0 con 0x7fdf480ceae0 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf4759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf480cbda0 con 0x7fdf480b2a30 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf4759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480cc080 con 0x7fdf480b2660 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf3dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdf480b2a30 0x7fdf480cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf3dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdf480b2a30 0x7fdf480cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48990/0 (socket says 172.21.15.84:48990) 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf3dd9b700 1 -- 172.21.15.84:0/2737232819 learned_addr learned my addr 172.21.15.84:0/2737232819 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf4659c700 1 --2- 172.21.15.84:0/2737232819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 0x7fdf480cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf3dd9b700 1 -- 172.21.15.84:0/2737232819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 msgr2=0x7fdf480cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf3dd9b700 1 --2- 172.21.15.84:0/2737232819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 0x7fdf480cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf3dd9b700 1 -- 172.21.15.84:0/2737232819 >> v1:172.21.15.131:6789/0 conn(0x7fdf480ceae0 legacy=0x7fdf480cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf3dd9b700 1 -- 172.21.15.84:0/2737232819 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf480cc360 con 0x7fdf480b2a30 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf3dd9b700 1 --2- 172.21.15.84:0/2737232819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 0x7fdf480cd230 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fdf300099b0 tx=0x7fdf30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6648d980d886dce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf45d9b700 1 -- 172.21.15.84:0/2737232819 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000b820 con 0x7fdf480b2a30 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf45d9b700 1 -- 172.21.15.84:0/2737232819 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3000b980 con 0x7fdf480b2a30 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.558+0000 7fdf45d9b700 1 -- 172.21.15.84:0/2737232819 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000bd20 con 0x7fdf480b2a30 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.559+0000 7fdf4759e700 1 -- 172.21.15.84:0/2737232819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 msgr2=0x7fdf480cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.559+0000 7fdf4759e700 1 --2- 172.21.15.84:0/2737232819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 0x7fdf480cd230 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fdf300099b0 tx=0x7fdf30009250 comp rx=0 tx=0).stop 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.559+0000 7fdf4759e700 1 -- 172.21.15.84:0/2737232819 shutdown_connections 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.559+0000 7fdf4759e700 1 --2- 172.21.15.84:0/2737232819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 0x7fdf480cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.559+0000 7fdf4759e700 1 --2- 172.21.15.84:0/2737232819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 0x7fdf480cd230 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.559+0000 7fdf4759e700 1 -- 172.21.15.84:0/2737232819 >> 172.21.15.84:0/2737232819 conn(0x7fdf48099560 msgr2=0x7fdf4806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:30.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.559+0000 7fdf4759e700 1 -- 172.21.15.84:0/2737232819 shutdown_connections 2023-10-06T02:58:30.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.559+0000 7fdf4759e700 1 -- 172.21.15.84:0/2737232819 wait complete. 2023-10-06T02:58:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.560+0000 7fdf4759e700 1 Processor -- start 2023-10-06T02:58:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.560+0000 7fdf4759e700 1 -- start start 2023-10-06T02:58:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf4759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 0x7fdf481498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf4759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 0x7fdf48149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf4759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf480ceae0 0x7fdf4814a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf4759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4809d8d0 con 0x7fdf480b2a30 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf4759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4809ccc0 con 0x7fdf480ceae0 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf4759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4809cfa0 con 0x7fdf480b2660 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf3dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 0x7fdf48149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf3dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 0x7fdf48149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48996/0 (socket says 172.21.15.84:48996) 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf3dd9b700 1 -- 172.21.15.84:0/1694867628 learned_addr learned my addr 172.21.15.84:0/1694867628 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf3dd9b700 1 -- 172.21.15.84:0/1694867628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 msgr2=0x7fdf481498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf4659c700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 0x7fdf481498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf3dd9b700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 0x7fdf481498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf3dd9b700 1 -- 172.21.15.84:0/1694867628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf480ceae0 msgr2=0x7fdf4814a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf46d9d700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf480ceae0 0x7fdf4814a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf3dd9b700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf480ceae0 0x7fdf4814a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf3dd9b700 1 -- 172.21.15.84:0/1694867628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300094f0 con 0x7fdf480b2a30 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf46d9d700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf480ceae0 0x7fdf4814a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.561+0000 7fdf3dd9b700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 0x7fdf48149de0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009290 tx=0x7fdf30016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.562+0000 7fdf3effd700 1 -- 172.21.15.84:0/1694867628 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30011d90 con 0x7fdf480b2a30 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.562+0000 7fdf3effd700 1 -- 172.21.15.84:0/1694867628 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf30020070 con 0x7fdf480b2a30 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.562+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4809d280 con 0x7fdf480b2a30 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.562+0000 7fdf3effd700 1 -- 172.21.15.84:0/1694867628 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3001b6a0 con 0x7fdf480b2a30 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.562+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4814a860 con 0x7fdf480b2a30 2023-10-06T02:58:30.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.563+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4805f270 con 0x7fdf480b2a30 2023-10-06T02:58:30.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.563+0000 7fdf3effd700 1 -- 172.21.15.84:0/1694867628 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf30022030 con 0x7fdf480b2a30 2023-10-06T02:58:30.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.563+0000 7fdf3effd700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf28066f30 0x7fdf280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.563+0000 7fdf3effd700 1 -- 172.21.15.84:0/1694867628 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fdf300864a0 con 0x7fdf480b2a30 2023-10-06T02:58:30.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.563+0000 7fdf4659c700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf28066f30 0x7fdf280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.564+0000 7fdf4659c700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf28066f30 0x7fdf280693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdf38008900 tx=0x7fdf38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.568+0000 7fdf3effd700 1 -- 172.21.15.84:0/1694867628 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf300537c0 con 0x7fdf480b2a30 2023-10-06T02:58:30.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.750+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf4805f270 con 0x7fdf480b2a30 2023-10-06T02:58:30.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.750+0000 7fdf3effd700 1 -- 172.21.15.84:0/1694867628 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf30056de0 con 0x7fdf480b2a30 2023-10-06T02:58:30.752 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:58:30.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf28066f30 msgr2=0x7fdf280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf28066f30 0x7fdf280693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdf38008900 tx=0x7fdf38008040 comp rx=0 tx=0).stop 2023-10-06T02:58:30.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 msgr2=0x7fdf48149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 0x7fdf48149de0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009290 tx=0x7fdf30016000 comp rx=0 tx=0).stop 2023-10-06T02:58:30.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 shutdown_connections 2023-10-06T02:58:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf28066f30 0x7fdf280693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf480ceae0 0x7fdf4814a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf480b2660 0x7fdf481498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 --2- 172.21.15.84:0/1694867628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf480b2a30 0x7fdf48149de0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 >> 172.21.15.84:0/1694867628 conn(0x7fdf48099560 msgr2=0x7fdf48157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.752+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 shutdown_connections 2023-10-06T02:58:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.753+0000 7fdf4759e700 1 -- 172.21.15.84:0/1694867628 wait complete. 2023-10-06T02:58:30.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:58:30.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.881+0000 7f5b06148700 1 Processor -- start 2023-10-06T02:58:30.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.881+0000 7f5b06148700 1 -- start start 2023-10-06T02:58:30.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.882+0000 7f5b06148700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5b00159420 0x7f5b00068000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.882+0000 7f5b06148700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b001597f0 0x7f5b000af880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.882+0000 7f5b06148700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b00068540 con 0x7f5b0006dc10 2023-10-06T02:58:30.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.882+0000 7f5b06148700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b000af340 con 0x7f5b001597f0 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.882+0000 7f5b06148700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b000ac380 con 0x7f5b00159420 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.882+0000 7f5afeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b001597f0 0x7f5b000af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.882+0000 7f5afffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5b0006dc10 0x7f5b0015d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39402/0 (socket says 172.21.15.84:39402) 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.882+0000 7f5afffff700 1 -- 172.21.15.84:0/1391466956 learned_addr learned my addr 172.21.15.84:0/1391466956 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.882+0000 7f5aff7fe700 1 --2- 172.21.15.84:0/1391466956 >> v2:172.21.15.131:3300/0 conn(0x7f5b00159420 0x7f5b00068000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5afeffd700 1 -- 172.21.15.84:0/1391466956 >> v2:172.21.15.131:3300/0 conn(0x7f5b00159420 msgr2=0x7f5b00068000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5afeffd700 1 --2- 172.21.15.84:0/1391466956 >> v2:172.21.15.131:3300/0 conn(0x7f5b00159420 0x7f5b00068000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5afeffd700 1 -- 172.21.15.84:0/1391466956 >> v1:172.21.15.84:6789/0 conn(0x7f5b0006dc10 legacy=0x7f5b0015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5afeffd700 1 -- 172.21.15.84:0/1391466956 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000ac0a0 con 0x7f5b001597f0 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5afe7fc700 1 -- 172.21.15.84:0/1391466956 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247501330 0 0) 0x7f5af8001490 con 0x7f5b0006dc10 2023-10-06T02:58:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5afeffd700 1 --2- 172.21.15.84:0/1391466956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 0x7f5b000af880 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5b000af640 tx=0x7f5af40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c0b3a485a1c513 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5afe7fc700 1 -- 172.21.15.84:0/1391466956 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400b6b0 con 0x7f5b001597f0 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5afe7fc700 1 -- 172.21.15.84:0/1391466956 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400b810 con 0x7f5b001597f0 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5afe7fc700 1 -- 172.21.15.84:0/1391466956 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400bbb0 con 0x7f5b001597f0 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5b06148700 1 -- 172.21.15.84:0/1391466956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 msgr2=0x7f5b000af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5b06148700 1 --2- 172.21.15.84:0/1391466956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 0x7f5b000af880 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5b000af640 tx=0x7f5af40091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5b06148700 1 -- 172.21.15.84:0/1391466956 shutdown_connections 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5b06148700 1 --2- 172.21.15.84:0/1391466956 >> v2:172.21.15.131:3300/0 conn(0x7f5b00159420 0x7f5b00068000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5b06148700 1 --2- 172.21.15.84:0/1391466956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 0x7f5b000af880 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5b06148700 1 -- 172.21.15.84:0/1391466956 >> 172.21.15.84:0/1391466956 conn(0x7f5b000cd3d0 msgr2=0x7f5b000ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5b06148700 1 -- 172.21.15.84:0/1391466956 shutdown_connections 2023-10-06T02:58:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.883+0000 7f5b06148700 1 -- 172.21.15.84:0/1391466956 wait complete. 2023-10-06T02:58:30.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.885+0000 7f5b06148700 1 Processor -- start 2023-10-06T02:58:30.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.885+0000 7f5b06148700 1 -- start start 2023-10-06T02:58:30.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.885+0000 7f5b06148700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b0006dc10 0x7f5b0014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.885+0000 7f5b06148700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b00159420 0x7f5b00153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.885+0000 7f5b06148700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 0x7f5b000ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.885+0000 7f5b06148700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0014f820 con 0x7f5b001597f0 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.885+0000 7f5b06148700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015af90 con 0x7f5b0006dc10 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.885+0000 7f5b06148700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015c8d0 con 0x7f5b00159420 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 0x7f5b000ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 0x7f5b000ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49024/0 (socket says 172.21.15.84:49024) 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afffff700 1 -- 172.21.15.84:0/693389976 learned_addr learned my addr 172.21.15.84:0/693389976 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afeffd700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b00159420 0x7f5b00153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5aff7fe700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b0006dc10 0x7f5b0014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afffff700 1 -- 172.21.15.84:0/693389976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b00159420 msgr2=0x7f5b00153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afffff700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b00159420 0x7f5b00153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afffff700 1 -- 172.21.15.84:0/693389976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b0006dc10 msgr2=0x7f5b0014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afffff700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b0006dc10 0x7f5b0014f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afffff700 1 -- 172.21.15.84:0/693389976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4009420 con 0x7f5b001597f0 2023-10-06T02:58:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5afffff700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 0x7f5b000ad9b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5af800ccf0 tx=0x7f5af8001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5ae77fe700 1 -- 172.21.15.84:0/693389976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800a870 con 0x7f5b001597f0 2023-10-06T02:58:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5ae77fe700 1 -- 172.21.15.84:0/693389976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af800a9f0 con 0x7f5b001597f0 2023-10-06T02:58:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0015cb40 con 0x7f5b001597f0 2023-10-06T02:58:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5ae77fe700 1 -- 172.21.15.84:0/693389976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800adb0 con 0x7f5b001597f0 2023-10-06T02:58:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.886+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b00154070 con 0x7f5b001597f0 2023-10-06T02:58:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.887+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0015b140 con 0x7f5b001597f0 2023-10-06T02:58:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.888+0000 7f5ae77fe700 1 -- 172.21.15.84:0/693389976 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5af8007300 con 0x7f5b001597f0 2023-10-06T02:58:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.888+0000 7f5ae77fe700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aec066f30 0x7f5aec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.888+0000 7f5ae77fe700 1 -- 172.21.15.84:0/693389976 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5af8084760 con 0x7f5b001597f0 2023-10-06T02:58:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.888+0000 7f5aff7fe700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aec066f30 0x7f5aec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.888+0000 7f5aff7fe700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aec066f30 0x7f5aec0693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006fd0 tx=0x7f5af0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:30.892+0000 7f5ae77fe700 1 -- 172.21.15.84:0/693389976 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b0015b140 con 0x7f5b001597f0 2023-10-06T02:58:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.074+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b00068540 con 0x7f5b001597f0 2023-10-06T02:58:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.075+0000 7f5ae77fe700 1 -- 172.21.15.84:0/693389976 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b00068540 con 0x7f5b001597f0 2023-10-06T02:58:31.076 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:58:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.076+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aec066f30 msgr2=0x7f5aec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.076+0000 7f5b06148700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aec066f30 0x7f5aec0693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006fd0 tx=0x7f5af0008040 comp rx=0 tx=0).stop 2023-10-06T02:58:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 msgr2=0x7f5b000ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 0x7f5b000ad9b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5af800ccf0 tx=0x7f5af8001a10 comp rx=0 tx=0).stop 2023-10-06T02:58:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 shutdown_connections 2023-10-06T02:58:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5aec066f30 0x7f5aec0693e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b0006dc10 0x7f5b0014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b001597f0 0x7f5b000ad9b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 --2- 172.21.15.84:0/693389976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b00159420 0x7f5b00153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 >> 172.21.15.84:0/693389976 conn(0x7f5b000cd3d0 msgr2=0x7f5b00158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 shutdown_connections 2023-10-06T02:58:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.077+0000 7f5b06148700 1 -- 172.21.15.84:0/693389976 wait complete. 2023-10-06T02:58:31.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:58:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.203+0000 7f1c98dae700 1 Processor -- start 2023-10-06T02:58:31.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.203+0000 7f1c98dae700 1 -- start start 2023-10-06T02:58:31.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c98dae700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c940b49e0 0x7f1c940aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c98dae700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c940b0ca0 con 0x7f1c941595a0 2023-10-06T02:58:31.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c98dae700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c940b0f80 con 0x7f1c940b07a0 2023-10-06T02:58:31.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c98dae700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940b1260 con 0x7f1c940b49e0 2023-10-06T02:58:31.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c9259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1c941595a0 0x7f1c940aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39412/0 (socket says 172.21.15.84:39412) 2023-10-06T02:58:31.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c9259c700 1 -- 172.21.15.84:0/840773057 learned_addr learned my addr 172.21.15.84:0/840773057 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:31.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c91d9b700 1 --2- 172.21.15.84:0/840773057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c940b49e0 0x7f1c940aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c9159a700 1 -- 172.21.15.84:0/840773057 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831940289 0 0) 0x7f1c940b0ca0 con 0x7f1c941595a0 2023-10-06T02:58:31.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c9159a700 1 -- 172.21.15.84:0/840773057 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c7c003570 con 0x7f1c941595a0 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c9159a700 1 -- 172.21.15.84:0/840773057 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111764465 0 0) 0x7f1c940b0f80 con 0x7f1c940b07a0 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c9159a700 1 -- 172.21.15.84:0/840773057 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c940b0ca0 con 0x7f1c940b07a0 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c91d9b700 1 -- 172.21.15.84:0/840773057 >> v1:172.21.15.131:6789/0 conn(0x7f1c940b07a0 legacy=0x7f1c940b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c91d9b700 1 -- 172.21.15.84:0/840773057 >> v1:172.21.15.84:6789/0 conn(0x7f1c941595a0 legacy=0x7f1c940aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c9159a700 1 -- 172.21.15.84:0/840773057 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3123987769 0 0) 0x7f1c7c003570 con 0x7f1c941595a0 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.204+0000 7f1c91d9b700 1 -- 172.21.15.84:0/840773057 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c940b1540 con 0x7f1c940b49e0 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c91d9b700 1 --2- 172.21.15.84:0/840773057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c940b49e0 0x7f1c940aac80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009910 tx=0x7f1c880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c783899b7b73b697 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c9159a700 1 -- 172.21.15.84:0/840773057 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840015f0 con 0x7f1c940b49e0 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c9159a700 1 -- 172.21.15.84:0/840773057 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c88011420 con 0x7f1c940b49e0 2023-10-06T02:58:31.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c9159a700 1 -- 172.21.15.84:0/840773057 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880117c0 con 0x7f1c940b49e0 2023-10-06T02:58:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c98dae700 1 -- 172.21.15.84:0/840773057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c940b49e0 msgr2=0x7f1c940aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c98dae700 1 --2- 172.21.15.84:0/840773057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c940b49e0 0x7f1c940aac80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009910 tx=0x7f1c880091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c98dae700 1 -- 172.21.15.84:0/840773057 shutdown_connections 2023-10-06T02:58:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c98dae700 1 --2- 172.21.15.84:0/840773057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c940b49e0 0x7f1c940aac80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c98dae700 1 -- 172.21.15.84:0/840773057 >> 172.21.15.84:0/840773057 conn(0x7f1c94099830 msgr2=0x7f1c9406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c98dae700 1 -- 172.21.15.84:0/840773057 shutdown_connections 2023-10-06T02:58:31.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.205+0000 7f1c98dae700 1 -- 172.21.15.84:0/840773057 wait complete. 2023-10-06T02:58:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.206+0000 7f1c98dae700 1 Processor -- start 2023-10-06T02:58:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.206+0000 7f1c98dae700 1 -- start start 2023-10-06T02:58:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c98dae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c940b07a0 0x7f1c941578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c98dae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c940b49e0 0x7f1c9409b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c98dae700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c941595a0 0x7f1c9409b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c98dae700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c94157df0 con 0x7f1c940b07a0 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c98dae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9415b3e0 con 0x7f1c940b49e0 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c98dae700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9415aaf0 con 0x7f1c941595a0 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c9259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c940b07a0 0x7f1c941578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c9259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c940b07a0 0x7f1c941578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49040/0 (socket says 172.21.15.84:49040) 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c9259c700 1 -- 172.21.15.84:0/17254338 learned_addr learned my addr 172.21.15.84:0/17254338 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c91d9b700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c940b49e0 0x7f1c9409b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.207+0000 7f1c92d9d700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c941595a0 0x7f1c9409b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c9259c700 1 -- 172.21.15.84:0/17254338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c941595a0 msgr2=0x7f1c9409b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c9259c700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c941595a0 0x7f1c9409b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c9259c700 1 -- 172.21.15.84:0/17254338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c940b49e0 msgr2=0x7f1c9409b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c9259c700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c940b49e0 0x7f1c9409b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c9259c700 1 -- 172.21.15.84:0/17254338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c88009420 con 0x7f1c940b07a0 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c9259c700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c940b07a0 0x7f1c941578b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400cba0 tx=0x7f1c84002b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c827fc700 1 -- 172.21.15.84:0/17254338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840070f0 con 0x7f1c940b07a0 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c827fc700 1 -- 172.21.15.84:0/17254338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c84007270 con 0x7f1c940b07a0 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9409bd30 con 0x7f1c940b07a0 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c827fc700 1 -- 172.21.15.84:0/17254338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84007630 con 0x7f1c940b07a0 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.208+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9415b070 con 0x7f1c940b07a0 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.209+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c94064ad0 con 0x7f1c940b07a0 2023-10-06T02:58:31.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.209+0000 7f1c827fc700 1 -- 172.21.15.84:0/17254338 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c84005a00 con 0x7f1c940b07a0 2023-10-06T02:58:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.210+0000 7f1c827fc700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1c74066f30 0x7f1c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.210+0000 7f1c91d9b700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1c74066f30 0x7f1c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.210+0000 7f1c827fc700 1 -- 172.21.15.84:0/17254338 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1c84084080 con 0x7f1c940b07a0 2023-10-06T02:58:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.210+0000 7f1c91d9b700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1c74066f30 0x7f1c740693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1c880030c0 tx=0x7f1c88016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:31.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.214+0000 7f1c827fc700 1 -- 172.21.15.84:0/17254338 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c84051420 con 0x7f1c940b07a0 2023-10-06T02:58:31.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.398+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1c940b1820 con 0x7f1c940b07a0 2023-10-06T02:58:31.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.399+0000 7f1c827fc700 1 -- 172.21.15.84:0/17254338 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1c84054a40 con 0x7f1c940b07a0 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:58:31.401 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T02:58:31.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.400+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1c74066f30 msgr2=0x7f1c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.400+0000 7f1c98dae700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1c74066f30 0x7f1c740693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1c880030c0 tx=0x7f1c88016000 comp rx=0 tx=0).stop 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c940b07a0 msgr2=0x7f1c941578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c940b07a0 0x7f1c941578b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400cba0 tx=0x7f1c84002b10 comp rx=0 tx=0).stop 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 shutdown_connections 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1c74066f30 0x7f1c740693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c941595a0 0x7f1c9409b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c940b07a0 0x7f1c941578b0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 --2- 172.21.15.84:0/17254338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c940b49e0 0x7f1c9409b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 >> 172.21.15.84:0/17254338 conn(0x7f1c94099830 msgr2=0x7f1c94158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 shutdown_connections 2023-10-06T02:58:31.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.401+0000 7f1c98dae700 1 -- 172.21.15.84:0/17254338 wait complete. 2023-10-06T02:58:31.414 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:58:31.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:58:31.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.531+0000 7f96d39f8700 1 Processor -- start 2023-10-06T02:58:31.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.531+0000 7f96d39f8700 1 -- start start 2023-10-06T02:58:31.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.531+0000 7f96d39f8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06b600 0x7f96cc068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.531+0000 7f96d39f8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96cc06ad70 0x7f96cc068b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.531+0000 7f96d39f8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0c8a20 con 0x7f96cc06b9d0 2023-10-06T02:58:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.531+0000 7f96d39f8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0c7e10 con 0x7f96cc06ad70 2023-10-06T02:58:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.531+0000 7f96d39f8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0c80f0 con 0x7f96cc06b600 2023-10-06T02:58:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96d1f95700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96cc06ad70 0x7f96cc068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96d1f95700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96cc06ad70 0x7f96cc068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49046/0 (socket says 172.21.15.84:49046) 2023-10-06T02:58:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96d1f95700 1 -- 172.21.15.84:0/4067482990 learned_addr learned my addr 172.21.15.84:0/4067482990 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96d1794700 1 --2- 172.21.15.84:0/4067482990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06b600 0x7f96cc068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96d1f95700 1 -- 172.21.15.84:0/4067482990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06b600 msgr2=0x7f96cc068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96d1f95700 1 --2- 172.21.15.84:0/4067482990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06b600 0x7f96cc068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96d1f95700 1 -- 172.21.15.84:0/4067482990 >> v1:172.21.15.131:6789/0 conn(0x7f96cc06b9d0 legacy=0x7f96cc0a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96d1f95700 1 -- 172.21.15.84:0/4067482990 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0c83d0 con 0x7f96cc06ad70 2023-10-06T02:58:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96d1f95700 1 --2- 172.21.15.84:0/4067482990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06ad70 0x7f96cc068b40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f96c40099b0 tx=0x7f96c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24553cc81ebe9261 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96cbfff700 1 -- 172.21.15.84:0/4067482990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400b860 con 0x7f96cc06ad70 2023-10-06T02:58:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96cbfff700 1 -- 172.21.15.84:0/4067482990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c400b9c0 con 0x7f96cc06ad70 2023-10-06T02:58:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.532+0000 7f96cbfff700 1 -- 172.21.15.84:0/4067482990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400bd60 con 0x7f96cc06ad70 2023-10-06T02:58:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.533+0000 7f96d39f8700 1 -- 172.21.15.84:0/4067482990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06ad70 msgr2=0x7f96cc068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.533+0000 7f96d39f8700 1 --2- 172.21.15.84:0/4067482990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06ad70 0x7f96cc068b40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f96c40099b0 tx=0x7f96c4009250 comp rx=0 tx=0).stop 2023-10-06T02:58:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.533+0000 7f96d39f8700 1 -- 172.21.15.84:0/4067482990 shutdown_connections 2023-10-06T02:58:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.533+0000 7f96d39f8700 1 --2- 172.21.15.84:0/4067482990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06ad70 0x7f96cc068b40 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.533+0000 7f96d39f8700 1 --2- 172.21.15.84:0/4067482990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06b600 0x7f96cc068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.533+0000 7f96d39f8700 1 -- 172.21.15.84:0/4067482990 >> 172.21.15.84:0/4067482990 conn(0x7f96cc0c9e30 msgr2=0x7f96cc06dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.533+0000 7f96d39f8700 1 -- 172.21.15.84:0/4067482990 shutdown_connections 2023-10-06T02:58:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.533+0000 7f96d39f8700 1 -- 172.21.15.84:0/4067482990 wait complete. 2023-10-06T02:58:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.534+0000 7f96d39f8700 1 Processor -- start 2023-10-06T02:58:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.534+0000 7f96d39f8700 1 -- start start 2023-10-06T02:58:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d39f8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06ad70 0x7f96cc158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d39f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06b600 0x7f96cc0c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d39f8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96cc06b9d0 0x7f96cc0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d39f8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc148860 con 0x7f96cc06b600 2023-10-06T02:58:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d39f8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc158fc0 con 0x7f96cc06b9d0 2023-10-06T02:58:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d39f8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0c4e10 con 0x7f96cc06ad70 2023-10-06T02:58:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d0f93700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06b600 0x7f96cc0c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d0f93700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06b600 0x7f96cc0c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49054/0 (socket says 172.21.15.84:49054) 2023-10-06T02:58:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d0f93700 1 -- 172.21.15.84:0/4112326281 learned_addr learned my addr 172.21.15.84:0/4112326281 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d1794700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06ad70 0x7f96cc158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d1f95700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96cc06b9d0 0x7f96cc0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d0f93700 1 -- 172.21.15.84:0/4112326281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06ad70 msgr2=0x7f96cc158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d0f93700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06ad70 0x7f96cc158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d0f93700 1 -- 172.21.15.84:0/4112326281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96cc06b9d0 msgr2=0x7f96cc0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:31.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d0f93700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96cc06b9d0 0x7f96cc0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:31.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d0f93700 1 -- 172.21.15.84:0/4112326281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40094f0 con 0x7f96cc06b600 2023-10-06T02:58:31.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.535+0000 7f96d1794700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06ad70 0x7f96cc158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.536+0000 7f96d0f93700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06b600 0x7f96cc0c3900 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c590 tx=0x7f96c0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.536+0000 7f96c97fa700 1 -- 172.21.15.84:0/4112326281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0011590 con 0x7f96cc06b600 2023-10-06T02:58:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.536+0000 7f96c97fa700 1 -- 172.21.15.84:0/4112326281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c0011710 con 0x7f96cc06b600 2023-10-06T02:58:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.536+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc0c4200 con 0x7f96cc06b600 2023-10-06T02:58:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.536+0000 7f96c97fa700 1 -- 172.21.15.84:0/4112326281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0011ad0 con 0x7f96cc06b600 2023-10-06T02:58:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.536+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc0c47c0 con 0x7f96cc06b600 2023-10-06T02:58:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.537+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc064ad0 con 0x7f96cc06b600 2023-10-06T02:58:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.537+0000 7f96c97fa700 1 -- 172.21.15.84:0/4112326281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96c001b3b0 con 0x7f96cc06b600 2023-10-06T02:58:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.537+0000 7f96c97fa700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96b8066f30 0x7f96b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.537+0000 7f96c97fa700 1 -- 172.21.15.84:0/4112326281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f96c00838a0 con 0x7f96cc06b600 2023-10-06T02:58:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.537+0000 7f96d1794700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96b8066f30 0x7f96b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.538+0000 7f96d1794700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96b8066f30 0x7f96b80693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f96bc007540 tx=0x7f96bc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.541+0000 7f96c97fa700 1 -- 172.21.15.84:0/4112326281 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96c0050bc0 con 0x7f96cc06b600 2023-10-06T02:58:31.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:31.725+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f96cc0c4f50 con 0x7f96cc06b600 2023-10-06T02:58:32.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.714+0000 7f96c97fa700 1 -- 172.21.15.84:0/4112326281 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f96c0017070 con 0x7f96cc06b600 2023-10-06T02:58:32.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.717+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96b8066f30 msgr2=0x7f96b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:32.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.717+0000 7f96d39f8700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96b8066f30 0x7f96b80693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f96bc007540 tx=0x7f96bc00b040 comp rx=0 tx=0).stop 2023-10-06T02:58:32.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.717+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06b600 msgr2=0x7f96cc0c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:32.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.717+0000 7f96d39f8700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06b600 0x7f96cc0c3900 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c590 tx=0x7f96c0007f50 comp rx=0 tx=0).stop 2023-10-06T02:58:32.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.718+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 shutdown_connections 2023-10-06T02:58:32.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.718+0000 7f96d39f8700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f96b8066f30 0x7f96b80693e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.718+0000 7f96d39f8700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96cc06b9d0 0x7f96cc0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.718+0000 7f96d39f8700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96cc06ad70 0x7f96cc158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.718+0000 7f96d39f8700 1 --2- 172.21.15.84:0/4112326281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96cc06b600 0x7f96cc0c3900 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.718+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 >> 172.21.15.84:0/4112326281 conn(0x7f96cc0c9e30 msgr2=0x7f96cc0675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:32.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.718+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 shutdown_connections 2023-10-06T02:58:32.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.718+0000 7f96d39f8700 1 -- 172.21.15.84:0/4112326281 wait complete. 2023-10-06T02:58:32.722 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T02:58:32.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:58:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.856+0000 7fea6e816700 1 Processor -- start 2023-10-06T02:58:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.856+0000 7fea6e816700 1 -- start start 2023-10-06T02:58:32.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.857+0000 7fea6e816700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea680b2660 0x7fea680cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:32.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.857+0000 7fea6e816700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fea680b2a30 0x7fea680cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.857+0000 7fea6e816700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 0x7fea680cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.857+0000 7fea6e816700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea680cc9b0 con 0x7fea680b2660 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.857+0000 7fea6e816700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea680cf4c0 con 0x7fea680b2a30 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.857+0000 7fea6e816700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea680cbda0 con 0x7fea680ceae0 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.857+0000 7fea6d814700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea680b2660 0x7fea680cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.857+0000 7fea6d814700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea680b2660 0x7fea680cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36658/0 (socket says 172.21.15.84:36658) 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.857+0000 7fea6d814700 1 -- 172.21.15.84:0/3261899069 learned_addr learned my addr 172.21.15.84:0/3261899069 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6d814700 1 -- 172.21.15.84:0/3261899069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 msgr2=0x7fea680cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6d814700 1 --2- 172.21.15.84:0/3261899069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 0x7fea680cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6d814700 1 -- 172.21.15.84:0/3261899069 >> v2:172.21.15.131:3300/0 conn(0x7fea680b2a30 msgr2=0x7fea680cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6d814700 1 --2- 172.21.15.84:0/3261899069 >> v2:172.21.15.131:3300/0 conn(0x7fea680b2a30 0x7fea680cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6d814700 1 -- 172.21.15.84:0/3261899069 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680cc080 con 0x7fea680b2660 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6d814700 1 --2- 172.21.15.84:0/3261899069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 0x7fea680cccf0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fea680b6310 tx=0x7fea64009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb93049473ef66e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6c812700 1 -- 172.21.15.84:0/3261899069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64005c10 con 0x7fea680b2660 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6c812700 1 -- 172.21.15.84:0/3261899069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64005d70 con 0x7fea680b2660 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6c812700 1 -- 172.21.15.84:0/3261899069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400b880 con 0x7fea680b2660 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6e816700 1 -- 172.21.15.84:0/3261899069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 msgr2=0x7fea680cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6e816700 1 --2- 172.21.15.84:0/3261899069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 0x7fea680cccf0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fea680b6310 tx=0x7fea64009220 comp rx=0 tx=0).stop 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6e816700 1 -- 172.21.15.84:0/3261899069 shutdown_connections 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6e816700 1 --2- 172.21.15.84:0/3261899069 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 0x7fea680cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6e816700 1 --2- 172.21.15.84:0/3261899069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 0x7fea680cccf0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6e816700 1 --2- 172.21.15.84:0/3261899069 >> v2:172.21.15.131:3300/0 conn(0x7fea680b2a30 0x7fea680cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.858+0000 7fea6e816700 1 -- 172.21.15.84:0/3261899069 >> 172.21.15.84:0/3261899069 conn(0x7fea68099560 msgr2=0x7fea6806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.859+0000 7fea6e816700 1 -- 172.21.15.84:0/3261899069 shutdown_connections 2023-10-06T02:58:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.859+0000 7fea6e816700 1 -- 172.21.15.84:0/3261899069 wait complete. 2023-10-06T02:58:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6e816700 1 Processor -- start 2023-10-06T02:58:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6e816700 1 -- start start 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6e816700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 0x7fea681693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6e816700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea680b2a30 0x7fea680b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6e816700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 0x7fea680c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6e816700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6809acd0 con 0x7fea680b2660 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6e816700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6809a100 con 0x7fea680b2a30 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6e816700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6809a3a0 con 0x7fea680ceae0 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6d814700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 0x7fea681693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6d814700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 0x7fea681693b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36662/0 (socket says 172.21.15.84:36662) 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.860+0000 7fea6d814700 1 -- 172.21.15.84:0/3624448548 learned_addr learned my addr 172.21.15.84:0/3624448548 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6d013700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea680b2a30 0x7fea680b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6e015700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 0x7fea680c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6d814700 1 -- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 msgr2=0x7fea680c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6d814700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 0x7fea680c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6d814700 1 -- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea680b2a30 msgr2=0x7fea680b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6d814700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea680b2a30 0x7fea680b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6d814700 1 -- 172.21.15.84:0/3624448548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64009480 con 0x7fea680b2660 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6e015700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 0x7fea680c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6d013700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea680b2a30 0x7fea680b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6d814700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 0x7fea681693b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fea6400b3c0 tx=0x7fea64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea5dffb700 1 -- 172.21.15.84:0/3624448548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64011920 con 0x7fea680b2660 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea5dffb700 1 -- 172.21.15.84:0/3624448548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64020070 con 0x7fea680b2660 2023-10-06T02:58:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea5dffb700 1 -- 172.21.15.84:0/3624448548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64011cb0 con 0x7fea680b2660 2023-10-06T02:58:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6809a680 con 0x7fea680b2660 2023-10-06T02:58:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.861+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea680c8de0 con 0x7fea680b2660 2023-10-06T02:58:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.862+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6805f270 con 0x7fea680b2660 2023-10-06T02:58:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.863+0000 7fea5dffb700 1 -- 172.21.15.84:0/3624448548 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea64022030 con 0x7fea680b2660 2023-10-06T02:58:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.863+0000 7fea5dffb700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.863+0000 7fea5dffb700 1 -- 172.21.15.84:0/3624448548 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5896+0+0 (secure 0 0 0) 0x7fea64086190 con 0x7fea680b2660 2023-10-06T02:58:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.863+0000 7fea6d013700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.864+0000 7fea6d013700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea4c066f30 0x7fea4c0693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fea680b23c0 tx=0x7fea58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:32.868+0000 7fea5dffb700 1 -- 172.21.15.84:0/3624448548 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea64053340 con 0x7fea680b2660 2023-10-06T02:58:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.050+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fea680cc360 con 0x7fea680b2660 2023-10-06T02:58:33.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.720+0000 7fea5dffb700 1 -- 172.21.15.84:0/3624448548 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7fea64056960 con 0x7fea680b2660 2023-10-06T02:58:33.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea4c066f30 msgr2=0x7fea4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:33.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea4c066f30 0x7fea4c0693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fea680b23c0 tx=0x7fea58008040 comp rx=0 tx=0).stop 2023-10-06T02:58:33.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 msgr2=0x7fea681693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:33.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 0x7fea681693b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fea6400b3c0 tx=0x7fea64016000 comp rx=0 tx=0).stop 2023-10-06T02:58:33.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 shutdown_connections 2023-10-06T02:58:33.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea4c066f30 0x7fea4c0693e0 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fea680b23c0 tx=0x7fea58008040 comp rx=0 tx=0).stop 2023-10-06T02:58:33.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea680ceae0 0x7fea680c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:33.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea680b2660 0x7fea681693b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:33.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 --2- 172.21.15.84:0/3624448548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea680b2a30 0x7fea680b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:33.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.724+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 >> 172.21.15.84:0/3624448548 conn(0x7fea68099560 msgr2=0x7fea680ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:33.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.725+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 shutdown_connections 2023-10-06T02:58:33.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.725+0000 7fea6e816700 1 -- 172.21.15.84:0/3624448548 wait complete. 2023-10-06T02:58:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T02:58:33.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:58:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.864+0000 7f7a09ab7700 1 Processor -- start 2023-10-06T02:58:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.864+0000 7f7a09ab7700 1 -- start start 2023-10-06T02:58:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.864+0000 7f7a09ab7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7a041598e0 0x7f7a040ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.864+0000 7f7a09ab7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a040cbcb0 0x7f7a040ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.864+0000 7f7a09ab7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a040cf610 con 0x7f7a04159510 2023-10-06T02:58:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.864+0000 7f7a09ab7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a040cf8f0 con 0x7f7a040cbcb0 2023-10-06T02:58:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.864+0000 7f7a09ab7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a040cfbd0 con 0x7f7a041598e0 2023-10-06T02:58:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a03fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a040cbcb0 0x7f7a040ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a037fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a04159510 0x7f7a040cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37234/0 (socket says 172.21.15.84:37234) 2023-10-06T02:58:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a037fe700 1 -- 172.21.15.84:0/3120517126 learned_addr learned my addr 172.21.15.84:0/3120517126 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f79faffd700 1 --2- 172.21.15.84:0/3120517126 >> v2:172.21.15.131:3300/0 conn(0x7f7a041598e0 0x7f7a040ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a03fff700 1 -- 172.21.15.84:0/3120517126 >> v2:172.21.15.131:3300/0 conn(0x7f7a041598e0 msgr2=0x7f7a040ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a03fff700 1 --2- 172.21.15.84:0/3120517126 >> v2:172.21.15.131:3300/0 conn(0x7f7a041598e0 0x7f7a040ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a03fff700 1 -- 172.21.15.84:0/3120517126 >> v1:172.21.15.84:6789/0 conn(0x7f7a04159510 legacy=0x7f7a040cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a03fff700 1 -- 172.21.15.84:0/3120517126 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040cfeb0 con 0x7f7a040cbcb0 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a02ffd700 1 -- 172.21.15.84:0/3120517126 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083408188 0 0) 0x7f7a040cf610 con 0x7f7a04159510 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a03fff700 1 --2- 172.21.15.84:0/3120517126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 0x7f7a040ced60 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7a040c73b0 tx=0x7f79fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f706e209edac446a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a02ffd700 1 -- 172.21.15.84:0/3120517126 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00e070 con 0x7f7a040cbcb0 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a02ffd700 1 -- 172.21.15.84:0/3120517126 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00bc30 con 0x7f7a040cbcb0 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.865+0000 7f7a02ffd700 1 -- 172.21.15.84:0/3120517126 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc012430 con 0x7f7a040cbcb0 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.866+0000 7f7a09ab7700 1 -- 172.21.15.84:0/3120517126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 msgr2=0x7f7a040ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.866+0000 7f7a09ab7700 1 --2- 172.21.15.84:0/3120517126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 0x7f7a040ced60 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7a040c73b0 tx=0x7f79fc009780 comp rx=0 tx=0).stop 2023-10-06T02:58:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.866+0000 7f7a09ab7700 1 -- 172.21.15.84:0/3120517126 shutdown_connections 2023-10-06T02:58:33.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.866+0000 7f7a09ab7700 1 --2- 172.21.15.84:0/3120517126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 0x7f7a040ced60 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:33.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.866+0000 7f7a09ab7700 1 --2- 172.21.15.84:0/3120517126 >> v2:172.21.15.131:3300/0 conn(0x7f7a041598e0 0x7f7a040ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:33.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.866+0000 7f7a09ab7700 1 -- 172.21.15.84:0/3120517126 >> 172.21.15.84:0/3120517126 conn(0x7f7a04089e90 msgr2=0x7f7a040997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:33.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.866+0000 7f7a09ab7700 1 -- 172.21.15.84:0/3120517126 shutdown_connections 2023-10-06T02:58:33.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.866+0000 7f7a09ab7700 1 -- 172.21.15.84:0/3120517126 wait complete. 2023-10-06T02:58:33.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.867+0000 7f7a09ab7700 1 Processor -- start 2023-10-06T02:58:33.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.867+0000 7f7a09ab7700 1 -- start start 2023-10-06T02:58:33.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a09ab7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 0x7f7a0414a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:33.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a09ab7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a04159510 0x7f7a04149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a09ab7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a041598e0 0x7f7a040c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a09ab7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040ca1a0 con 0x7f7a040cbcb0 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a09ab7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0414c710 con 0x7f7a04159510 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a09ab7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040c9870 con 0x7f7a041598e0 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 0x7f7a0414a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 0x7f7a0414a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36680/0 (socket says 172.21.15.84:36680) 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a037fe700 1 -- 172.21.15.84:0/4119046003 learned_addr learned my addr 172.21.15.84:0/4119046003 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a037fe700 1 -- 172.21.15.84:0/4119046003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a041598e0 msgr2=0x7f7a040c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a037fe700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a041598e0 0x7f7a040c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a037fe700 1 -- 172.21.15.84:0/4119046003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a04159510 msgr2=0x7f7a04149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a037fe700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a04159510 0x7f7a04149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a037fe700 1 -- 172.21.15.84:0/4119046003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc009a20 con 0x7f7a040cbcb0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f7a037fe700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 0x7f7a0414a380 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f79f400c7e0 tx=0x7f79f4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f79fbfff700 1 -- 172.21.15.84:0/4119046003 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4005b30 con 0x7f7a040cbcb0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.868+0000 7f79fbfff700 1 -- 172.21.15.84:0/4119046003 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f4005c90 con 0x7f7a040cbcb0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.869+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a040c9b50 con 0x7f7a040cbcb0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.869+0000 7f79fbfff700 1 -- 172.21.15.84:0/4119046003 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4007300 con 0x7f7a040cbcb0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.869+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a040c8760 con 0x7f7a040cbcb0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.869+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a040ca310 con 0x7f7a040cbcb0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.870+0000 7f79fbfff700 1 -- 172.21.15.84:0/4119046003 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79f401b400 con 0x7f7a040cbcb0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.870+0000 7f79fbfff700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79e4066f30 0x7f79e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.870+0000 7f79fbfff700 1 -- 172.21.15.84:0/4119046003 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f79f40842f0 con 0x7f7a040cbcb0 2023-10-06T02:58:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.870+0000 7f79faffd700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79e4066f30 0x7f79e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.871+0000 7f79faffd700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79e4066f30 0x7f79e40693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a040ca580 tx=0x7f79ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:33.875+0000 7f79fbfff700 1 -- 172.21.15.84:0/4119046003 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79f40513a0 con 0x7f7a040cbcb0 2023-10-06T02:58:34.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.100+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7a04064ad0 con 0x7f7a040cbcb0 2023-10-06T02:58:34.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.736+0000 7f79fbfff700 1 -- 172.21.15.84:0/4119046003 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v48) v1 ==== 174+0+0 (secure 0 0 0) 0x7f79f40549c0 con 0x7f7a040cbcb0 2023-10-06T02:58:34.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79e4066f30 msgr2=0x7f79e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:34.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79e4066f30 0x7f79e40693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a040ca580 tx=0x7f79ec008040 comp rx=0 tx=0).stop 2023-10-06T02:58:34.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 msgr2=0x7f7a0414a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:34.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 0x7f7a0414a380 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f79f400c7e0 tx=0x7f79f4007df0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 shutdown_connections 2023-10-06T02:58:34.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79e4066f30 0x7f79e40693e0 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a040ca580 tx=0x7f79ec008040 comp rx=0 tx=0).stop 2023-10-06T02:58:34.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a041598e0 0x7f7a040c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a040cbcb0 0x7f7a0414a380 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 --2- 172.21.15.84:0/4119046003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a04159510 0x7f7a04149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.742+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 >> 172.21.15.84:0/4119046003 conn(0x7f7a04089e90 msgr2=0x7f7a0414b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:34.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.745+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 shutdown_connections 2023-10-06T02:58:34.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.745+0000 7f7a09ab7700 1 -- 172.21.15.84:0/4119046003 wait complete. 2023-10-06T02:58:34.748 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 10 and data pool 11 2023-10-06T02:58:34.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:58:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.875+0000 7f00dcfea700 1 Processor -- start 2023-10-06T02:58:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.875+0000 7f00dcfea700 1 -- start start 2023-10-06T02:58:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.876+0000 7f00dcfea700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f00d81595c0 0x7f00d806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.876+0000 7f00dcfea700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00d806e9e0 0x7f00d80675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.876+0000 7f00dcfea700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d80cde70 con 0x7f00d8159990 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.876+0000 7f00dcfea700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d806ef60 con 0x7f00d806e9e0 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.876+0000 7f00dcfea700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d806f240 con 0x7f00d81595c0 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.876+0000 7f00d5d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00d806e9e0 0x7f00d80675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.876+0000 7f00d6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f00d8159990 0x7f00d806a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37240/0 (socket says 172.21.15.84:37240) 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.876+0000 7f00d6d9d700 1 -- 172.21.15.84:0/3118983202 learned_addr learned my addr 172.21.15.84:0/3118983202 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d659c700 1 --2- 172.21.15.84:0/3118983202 >> v2:172.21.15.131:3300/0 conn(0x7f00d81595c0 0x7f00d806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d5d9b700 1 -- 172.21.15.84:0/3118983202 >> v2:172.21.15.131:3300/0 conn(0x7f00d81595c0 msgr2=0x7f00d806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d5d9b700 1 --2- 172.21.15.84:0/3118983202 >> v2:172.21.15.131:3300/0 conn(0x7f00d81595c0 0x7f00d806e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d5d9b700 1 -- 172.21.15.84:0/3118983202 >> v1:172.21.15.84:6789/0 conn(0x7f00d8159990 legacy=0x7f00d806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d5d9b700 1 -- 172.21.15.84:0/3118983202 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d80b0190 con 0x7f00d806e9e0 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d559a700 1 -- 172.21.15.84:0/3118983202 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982781663 0 0) 0x7f00d80cde70 con 0x7f00d8159990 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d5d9b700 1 --2- 172.21.15.84:0/3118983202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d806e9e0 0x7f00d80675f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f00d8070610 tx=0x7f00c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be61a39e7ef637ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d559a700 1 -- 172.21.15.84:0/3118983202 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c800b6b0 con 0x7f00d806e9e0 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d559a700 1 -- 172.21.15.84:0/3118983202 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c800b810 con 0x7f00d806e9e0 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00d559a700 1 -- 172.21.15.84:0/3118983202 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c800bbb0 con 0x7f00d806e9e0 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00dcfea700 1 -- 172.21.15.84:0/3118983202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d806e9e0 msgr2=0x7f00d80675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00dcfea700 1 --2- 172.21.15.84:0/3118983202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d806e9e0 0x7f00d80675f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f00d8070610 tx=0x7f00c80091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00dcfea700 1 -- 172.21.15.84:0/3118983202 shutdown_connections 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00dcfea700 1 --2- 172.21.15.84:0/3118983202 >> v2:172.21.15.131:3300/0 conn(0x7f00d81595c0 0x7f00d806e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00dcfea700 1 --2- 172.21.15.84:0/3118983202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d806e9e0 0x7f00d80675f0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.877+0000 7f00dcfea700 1 -- 172.21.15.84:0/3118983202 >> 172.21.15.84:0/3118983202 conn(0x7f00d8069180 msgr2=0x7f00d80cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.878+0000 7f00dcfea700 1 -- 172.21.15.84:0/3118983202 shutdown_connections 2023-10-06T02:58:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.878+0000 7f00dcfea700 1 -- 172.21.15.84:0/3118983202 wait complete. 2023-10-06T02:58:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00dcfea700 1 Processor -- start 2023-10-06T02:58:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00dcfea700 1 -- start start 2023-10-06T02:58:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00dcfea700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d806e9e0 0x7f00d80c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00dcfea700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d81595c0 0x7f00d8155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00dcfea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d8159990 0x7f00d80c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00dcfea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d815bd50 con 0x7f00d8159990 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00dcfea700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80c6ef0 con 0x7f00d806e9e0 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00dcfea700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80c71d0 con 0x7f00d81595c0 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00d6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d8159990 0x7f00d80c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00d6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d8159990 0x7f00d80c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36700/0 (socket says 172.21.15.84:36700) 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00d6d9d700 1 -- 172.21.15.84:0/1625421275 learned_addr learned my addr 172.21.15.84:0/1625421275 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00d659c700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d806e9e0 0x7f00d80c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.879+0000 7f00d5d9b700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d81595c0 0x7f00d8155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00d6d9d700 1 -- 172.21.15.84:0/1625421275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d81595c0 msgr2=0x7f00d8155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00d6d9d700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d81595c0 0x7f00d8155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00d6d9d700 1 -- 172.21.15.84:0/1625421275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d806e9e0 msgr2=0x7f00d80c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00d6d9d700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d806e9e0 0x7f00d80c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00d6d9d700 1 -- 172.21.15.84:0/1625421275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8009420 con 0x7f00d8159990 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00d6d9d700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d8159990 0x7f00d80c4ce0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f00d000cb90 tx=0x7f00d00019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00c67fc700 1 -- 172.21.15.84:0/1625421275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d000a7e0 con 0x7f00d8159990 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00c67fc700 1 -- 172.21.15.84:0/1625421275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d000a940 con 0x7f00d8159990 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d815b9e0 con 0x7f00d8159990 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00c67fc700 1 -- 172.21.15.84:0/1625421275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d000ad00 con 0x7f00d8159990 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.880+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d815b690 con 0x7f00d8159990 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.881+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d80c7de0 con 0x7f00d8159990 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.881+0000 7f00c67fc700 1 -- 172.21.15.84:0/1625421275 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00d0012610 con 0x7f00d8159990 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.882+0000 7f00c67fc700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f00b8066f30 0x7f00b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.882+0000 7f00c67fc700 1 -- 172.21.15.84:0/1625421275 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f00d00849f0 con 0x7f00d8159990 2023-10-06T02:58:34.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.882+0000 7f00d659c700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f00b8066f30 0x7f00b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:34.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.882+0000 7f00d659c700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f00b8066f30 0x7f00b80693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f00cc006fd0 tx=0x7f00cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:34.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:34.886+0000 7f00c67fc700 1 -- 172.21.15.84:0/1625421275 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00d0051a40 con 0x7f00d8159990 2023-10-06T02:58:35.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.070+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00d8064ad0 con 0x7f00d8159990 2023-10-06T02:58:35.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.071+0000 7f00c67fc700 1 -- 172.21.15.84:0/1625421275 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f00d000ae60 con 0x7f00d8159990 2023-10-06T02:58:35.073 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:35.073 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":67,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:58:34.101678+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:58:31.743689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:58:33.068884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:58:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f00b8066f30 msgr2=0x7f00b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f00b8066f30 0x7f00b80693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f00cc006fd0 tx=0x7f00cc008040 comp rx=0 tx=0).stop 2023-10-06T02:58:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d8159990 msgr2=0x7f00d80c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d8159990 0x7f00d80c4ce0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f00d000cb90 tx=0x7f00d00019a0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 shutdown_connections 2023-10-06T02:58:35.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f00b8066f30 0x7f00b80693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d806e9e0 0x7f00d80c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00d8159990 0x7f00d80c4ce0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 --2- 172.21.15.84:0/1625421275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00d81595c0 0x7f00d8155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 >> 172.21.15.84:0/1625421275 conn(0x7f00d8069180 msgr2=0x7f00d815f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 shutdown_connections 2023-10-06T02:58:35.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.073+0000 7f00dcfea700 1 -- 172.21.15.84:0/1625421275 wait complete. 2023-10-06T02:58:35.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:58:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.200+0000 7f36dffff700 1 Processor -- start 2023-10-06T02:58:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.200+0000 7f36dffff700 1 -- start start 2023-10-06T02:58:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36dffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36e0159480 0x7f36e00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36dffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e00cb7e0 con 0x7f36e00b2140 2023-10-06T02:58:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36dffff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e00b08a0 con 0x7f36e00b3610 2023-10-06T02:58:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36dffff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e00cb190 con 0x7f36e0159480 2023-10-06T02:58:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36deffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36e0159480 0x7f36e00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36df7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f36e00b2140 0x7f36e00b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37248/0 (socket says 172.21.15.84:37248) 2023-10-06T02:58:35.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36df7fe700 1 -- 172.21.15.84:0/1451355305 learned_addr learned my addr 172.21.15.84:0/1451355305 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36deffd700 1 -- 172.21.15.84:0/1451355305 >> v1:172.21.15.131:6789/0 conn(0x7f36e00b3610 legacy=0x7f36e00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36deffd700 1 -- 172.21.15.84:0/1451355305 >> v1:172.21.15.84:6789/0 conn(0x7f36e00b2140 legacy=0x7f36e00b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.201+0000 7f36deffd700 1 -- 172.21.15.84:0/1451355305 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00cb470 con 0x7f36e0159480 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36deffd700 1 --2- 172.21.15.84:0/1451355305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e0159480 0x7f36e00b30d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f36d00098e0 tx=0x7f36d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3343e9629243214 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36de7fc700 1 -- 172.21.15.84:0/1451355305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0009e80 con 0x7f36e0159480 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36de7fc700 1 -- 172.21.15.84:0/1451355305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d000b860 con 0x7f36e0159480 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36de7fc700 1 -- 172.21.15.84:0/1451355305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d000bbe0 con 0x7f36e0159480 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36dffff700 1 -- 172.21.15.84:0/1451355305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e0159480 msgr2=0x7f36e00b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36dffff700 1 --2- 172.21.15.84:0/1451355305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e0159480 0x7f36e00b30d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f36d00098e0 tx=0x7f36d00091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36dffff700 1 -- 172.21.15.84:0/1451355305 shutdown_connections 2023-10-06T02:58:35.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36dffff700 1 --2- 172.21.15.84:0/1451355305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e0159480 0x7f36e00b30d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36dffff700 1 -- 172.21.15.84:0/1451355305 >> 172.21.15.84:0/1451355305 conn(0x7f36e006ed20 msgr2=0x7f36e006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:35.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36dffff700 1 -- 172.21.15.84:0/1451355305 shutdown_connections 2023-10-06T02:58:35.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.202+0000 7f36dffff700 1 -- 172.21.15.84:0/1451355305 wait complete. 2023-10-06T02:58:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.203+0000 7f36dffff700 1 Processor -- start 2023-10-06T02:58:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36dffff700 1 -- start start 2023-10-06T02:58:35.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36dffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e00b2140 0x7f36e00cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36dffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f36e00b3610 0x7f36e00c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36dffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36e0159480 0x7f36e00c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36dffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e016dd20 con 0x7f36e00b2140 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36dffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e016ce30 con 0x7f36e0159480 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36dffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e016d110 con 0x7f36e00b3610 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36deffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e00b2140 0x7f36e00cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36deffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e00b2140 0x7f36e00cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36722/0 (socket says 172.21.15.84:36722) 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.204+0000 7f36deffd700 1 -- 172.21.15.84:0/2835459642 learned_addr learned my addr 172.21.15.84:0/2835459642 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36df7fe700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36e0159480 0x7f36e00c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36deffd700 1 -- 172.21.15.84:0/2835459642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f36e00b3610 msgr2=0x7f36e00c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36deffd700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f36e00b3610 0x7f36e00c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36deffd700 1 -- 172.21.15.84:0/2835459642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36e0159480 msgr2=0x7f36e00c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36deffd700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36e0159480 0x7f36e00c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36deffd700 1 -- 172.21.15.84:0/2835459642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0009420 con 0x7f36e00b2140 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36deffd700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e00b2140 0x7f36e00cde30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f36d00030c0 tx=0x7f36d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36d77fe700 1 -- 172.21.15.84:0/2835459642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d001b470 con 0x7f36e00b2140 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36d77fe700 1 -- 172.21.15.84:0/2835459642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d001b5d0 con 0x7f36e00b2140 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e016d3f0 con 0x7f36e00b2140 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36d77fe700 1 -- 172.21.15.84:0/2835459642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d001b970 con 0x7f36e00b2140 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.205+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e016d9b0 con 0x7f36e00b2140 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.206+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e005f270 con 0x7f36e00b2140 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.206+0000 7f36d77fe700 1 -- 172.21.15.84:0/2835459642 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36d001c450 con 0x7f36e00b2140 2023-10-06T02:58:35.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.207+0000 7f36d77fe700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36c0066f30 0x7f36c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.207+0000 7f36d77fe700 1 -- 172.21.15.84:0/2835459642 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f36d0086480 con 0x7f36e00b2140 2023-10-06T02:58:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.207+0000 7f36d67fc700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36c0066f30 0x7f36c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.207+0000 7f36d67fc700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36c0066f30 0x7f36c00693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f36c8007fd0 tx=0x7f36c8007b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:35.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.211+0000 7f36d77fe700 1 -- 172.21.15.84:0/2835459642 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36d0053450 con 0x7f36e00b2140 2023-10-06T02:58:35.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.397+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36e0159850 con 0x7f36e00b2140 2023-10-06T02:58:35.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.398+0000 7f36d77fe700 1 -- 172.21.15.84:0/2835459642 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f36d002a090 con 0x7f36e00b2140 2023-10-06T02:58:35.400 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:35.400 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":67,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:58:34.101678+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:58:31.743689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:58:33.068884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:58:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36c0066f30 msgr2=0x7f36c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36c0066f30 0x7f36c00693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f36c8007fd0 tx=0x7f36c8007b20 comp rx=0 tx=0).stop 2023-10-06T02:58:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e00b2140 msgr2=0x7f36e00cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e00b2140 0x7f36e00cde30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f36d00030c0 tx=0x7f36d0016000 comp rx=0 tx=0).stop 2023-10-06T02:58:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 shutdown_connections 2023-10-06T02:58:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f36c0066f30 0x7f36c00693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36e0159480 0x7f36e00c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36e00b2140 0x7f36e00cde30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 --2- 172.21.15.84:0/2835459642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f36e00b3610 0x7f36e00c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 >> 172.21.15.84:0/2835459642 conn(0x7f36e006ed20 msgr2=0x7f36e00b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 shutdown_connections 2023-10-06T02:58:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.400+0000 7f36dffff700 1 -- 172.21.15.84:0/2835459642 wait complete. 2023-10-06T02:58:35.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:58:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.530+0000 7fa859485700 1 Processor -- start 2023-10-06T02:58:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.530+0000 7fa859485700 1 -- start start 2023-10-06T02:58:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.531+0000 7fa859485700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2660 0x7fa8540cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.531+0000 7fa859485700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa8540cf1f0 0x7fa8540cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.531+0000 7fa859485700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8540cc9b0 con 0x7fa8540b2a30 2023-10-06T02:58:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.531+0000 7fa859485700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8540cbda0 con 0x7fa8540cf1f0 2023-10-06T02:58:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.531+0000 7fa859485700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540cc080 con 0x7fa8540b2660 2023-10-06T02:58:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.531+0000 7fa853fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2660 0x7fa8540cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.531+0000 7fa858c84700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa8540cf1f0 0x7fa8540cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.531+0000 7fa853fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2660 0x7fa8540cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:49996/0 (socket says 172.21.15.84:49996) 2023-10-06T02:58:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.531+0000 7fa853fff700 1 -- 172.21.15.84:0/75848227 learned_addr learned my addr 172.21.15.84:0/75848227 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.532+0000 7fa853fff700 1 -- 172.21.15.84:0/75848227 >> v2:172.21.15.131:3300/0 conn(0x7fa8540cf1f0 msgr2=0x7fa8540cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.532+0000 7fa853fff700 1 --2- 172.21.15.84:0/75848227 >> v2:172.21.15.131:3300/0 conn(0x7fa8540cf1f0 0x7fa8540cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.532+0000 7fa853fff700 1 -- 172.21.15.84:0/75848227 >> v1:172.21.15.131:6789/0 conn(0x7fa8540b2a30 legacy=0x7fa8540ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.532+0000 7fa853fff700 1 -- 172.21.15.84:0/75848227 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540cc360 con 0x7fa8540b2660 2023-10-06T02:58:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.532+0000 7fa858c84700 1 --2- 172.21.15.84:0/75848227 >> v2:172.21.15.131:3300/0 conn(0x7fa8540cf1f0 0x7fa8540cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.532+0000 7fa853fff700 1 --2- 172.21.15.84:0/75848227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2660 0x7fa8540cccf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa844009990 tx=0x7fa844009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57564fd169cca73e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.532+0000 7fa852ffd700 1 -- 172.21.15.84:0/75848227 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844009e80 con 0x7fa8540b2660 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.532+0000 7fa852ffd700 1 -- 172.21.15.84:0/75848227 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844005c10 con 0x7fa8540b2660 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.532+0000 7fa852ffd700 1 -- 172.21.15.84:0/75848227 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84400b650 con 0x7fa8540b2660 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.533+0000 7fa859485700 1 -- 172.21.15.84:0/75848227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2660 msgr2=0x7fa8540cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.533+0000 7fa859485700 1 --2- 172.21.15.84:0/75848227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2660 0x7fa8540cccf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa844009990 tx=0x7fa844009220 comp rx=0 tx=0).stop 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.533+0000 7fa859485700 1 -- 172.21.15.84:0/75848227 shutdown_connections 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.533+0000 7fa859485700 1 --2- 172.21.15.84:0/75848227 >> v2:172.21.15.131:3300/0 conn(0x7fa8540cf1f0 0x7fa8540cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.533+0000 7fa859485700 1 --2- 172.21.15.84:0/75848227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2660 0x7fa8540cccf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.533+0000 7fa859485700 1 -- 172.21.15.84:0/75848227 >> 172.21.15.84:0/75848227 conn(0x7fa854099560 msgr2=0x7fa85406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.533+0000 7fa859485700 1 -- 172.21.15.84:0/75848227 shutdown_connections 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.533+0000 7fa859485700 1 -- 172.21.15.84:0/75848227 wait complete. 2023-10-06T02:58:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.534+0000 7fa859485700 1 Processor -- start 2023-10-06T02:58:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.534+0000 7fa859485700 1 -- start start 2023-10-06T02:58:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa859485700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8540b2660 0x7fa854169f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa859485700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2a30 0x7fa85416af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa859485700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540cf1f0 0x7fa85409d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa859485700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85416b460 con 0x7fa8540b2660 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa859485700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85416b6c0 con 0x7fa8540cf1f0 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa859485700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85416b9a0 con 0x7fa8540b2a30 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa853fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8540b2660 0x7fa854169f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa853fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8540b2660 0x7fa854169f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36726/0 (socket says 172.21.15.84:36726) 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa853fff700 1 -- 172.21.15.84:0/380937469 learned_addr learned my addr 172.21.15.84:0/380937469 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa858c84700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540cf1f0 0x7fa85409d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa8537fe700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2a30 0x7fa85416af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa853fff700 1 -- 172.21.15.84:0/380937469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2a30 msgr2=0x7fa85416af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa853fff700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2a30 0x7fa85416af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa853fff700 1 -- 172.21.15.84:0/380937469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540cf1f0 msgr2=0x7fa85409d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:35.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa853fff700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540cf1f0 0x7fa85409d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa853fff700 1 -- 172.21.15.84:0/380937469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c009a20 con 0x7fa8540b2660 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.535+0000 7fa853fff700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8540b2660 0x7fa854169f20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa84400b3c0 tx=0x7fa844016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.536+0000 7fa83bfff700 1 -- 172.21.15.84:0/380937469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844011a30 con 0x7fa8540b2660 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.536+0000 7fa83bfff700 1 -- 172.21.15.84:0/380937469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844020070 con 0x7fa8540b2660 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.536+0000 7fa83bfff700 1 -- 172.21.15.84:0/380937469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844011de0 con 0x7fa8540b2660 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.536+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa844009480 con 0x7fa8540b2660 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.536+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85416bf60 con 0x7fa8540b2660 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.536+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85405f270 con 0x7fa8540b2660 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.537+0000 7fa83bfff700 1 -- 172.21.15.84:0/380937469 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa844022030 con 0x7fa8540b2660 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.537+0000 7fa83bfff700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa840066fb0 0x7fa840069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.537+0000 7fa83bfff700 1 -- 172.21.15.84:0/380937469 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa844086340 con 0x7fa8540b2660 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.537+0000 7fa8537fe700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa840066fb0 0x7fa840069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:35.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.538+0000 7fa8537fe700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa840066fb0 0x7fa840069460 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa85415a3d0 tx=0x7fa848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:35.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.541+0000 7fa83bfff700 1 -- 172.21.15.84:0/380937469 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa844053330 con 0x7fa8540b2660 2023-10-06T02:58:35.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:35.769+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa8540cc640 con 0x7fa8540b2660 2023-10-06T02:58:36.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:36.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:58:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.756+0000 7fa83bfff700 1 -- 172.21.15.84:0/380937469 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa844056950 con 0x7fa8540b2660 2023-10-06T02:58:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa840066fb0 msgr2=0x7fa840069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa840066fb0 0x7fa840069460 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa85415a3d0 tx=0x7fa848009040 comp rx=0 tx=0).stop 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8540b2660 msgr2=0x7fa854169f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8540b2660 0x7fa854169f20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa84400b3c0 tx=0x7fa844016000 comp rx=0 tx=0).stop 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 shutdown_connections 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa840066fb0 0x7fa840069460 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540cf1f0 0x7fa85409d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8540b2660 0x7fa854169f20 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 --2- 172.21.15.84:0/380937469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540b2a30 0x7fa85416af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 >> 172.21.15.84:0/380937469 conn(0x7fa854099560 msgr2=0x7fa8540b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 shutdown_connections 2023-10-06T02:58:36.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.758+0000 7fa859485700 1 -- 172.21.15.84:0/380937469 wait complete. 2023-10-06T02:58:36.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:58:36.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.890+0000 7f6e6c632700 1 Processor -- start 2023-10-06T02:58:36.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.890+0000 7f6e6c632700 1 -- start start 2023-10-06T02:58:36.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.891+0000 7f6e6c632700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e641598e0 0x7f6e640ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:36.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.891+0000 7f6e6c632700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e640cf610 con 0x7f6e640cbcb0 2023-10-06T02:58:36.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.891+0000 7f6e6c632700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e640cf8f0 con 0x7f6e64159510 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.891+0000 7f6e6c632700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e640cfbd0 con 0x7f6e641598e0 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.891+0000 7f6e6abcf700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6e640cbcb0 0x7f6e640ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37258/0 (socket says 172.21.15.84:37258) 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.891+0000 7f6e6abcf700 1 -- 172.21.15.84:0/3432956196 learned_addr learned my addr 172.21.15.84:0/3432956196 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.891+0000 7f6e69bcd700 1 --2- 172.21.15.84:0/3432956196 >> v2:172.21.15.131:3300/0 conn(0x7f6e641598e0 0x7f6e640ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.891+0000 7f6e693cc700 1 -- 172.21.15.84:0/3432956196 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592820991 0 0) 0x7f6e640cf610 con 0x7f6e640cbcb0 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.892+0000 7f6e693cc700 1 -- 172.21.15.84:0/3432956196 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e50003570 con 0x7f6e640cbcb0 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.892+0000 7f6e693cc700 1 -- 172.21.15.84:0/3432956196 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2312578631 0 0) 0x7f6e50003570 con 0x7f6e640cbcb0 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.892+0000 7f6e69bcd700 1 -- 172.21.15.84:0/3432956196 >> v1:172.21.15.131:6789/0 conn(0x7f6e64159510 legacy=0x7f6e640cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.892+0000 7f6e69bcd700 1 -- 172.21.15.84:0/3432956196 >> v1:172.21.15.84:6789/0 conn(0x7f6e640cbcb0 legacy=0x7f6e640ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.892+0000 7f6e69bcd700 1 -- 172.21.15.84:0/3432956196 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e640cfeb0 con 0x7f6e641598e0 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.892+0000 7f6e69bcd700 1 --2- 172.21.15.84:0/3432956196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e641598e0 0x7f6e640ce820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e540098e0 tx=0x7f6e540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3167263a13a2df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:36.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.892+0000 7f6e693cc700 1 -- 172.21.15.84:0/3432956196 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0017f0 con 0x7f6e641598e0 2023-10-06T02:58:36.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.892+0000 7f6e693cc700 1 -- 172.21.15.84:0/3432956196 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e54011420 con 0x7f6e641598e0 2023-10-06T02:58:36.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.892+0000 7f6e693cc700 1 -- 172.21.15.84:0/3432956196 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540117c0 con 0x7f6e641598e0 2023-10-06T02:58:36.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.893+0000 7f6e6c632700 1 -- 172.21.15.84:0/3432956196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e641598e0 msgr2=0x7f6e640ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:36.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.893+0000 7f6e6c632700 1 --2- 172.21.15.84:0/3432956196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e641598e0 0x7f6e640ce820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e540098e0 tx=0x7f6e540091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:36.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.893+0000 7f6e6c632700 1 -- 172.21.15.84:0/3432956196 shutdown_connections 2023-10-06T02:58:36.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.893+0000 7f6e6c632700 1 --2- 172.21.15.84:0/3432956196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e641598e0 0x7f6e640ce820 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:36.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.893+0000 7f6e6c632700 1 -- 172.21.15.84:0/3432956196 >> 172.21.15.84:0/3432956196 conn(0x7f6e64089e90 msgr2=0x7f6e640997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:36.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.893+0000 7f6e6c632700 1 -- 172.21.15.84:0/3432956196 shutdown_connections 2023-10-06T02:58:36.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.893+0000 7f6e6c632700 1 -- 172.21.15.84:0/3432956196 wait complete. 2023-10-06T02:58:36.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.894+0000 7f6e6c632700 1 Processor -- start 2023-10-06T02:58:36.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.894+0000 7f6e6c632700 1 -- start start 2023-10-06T02:58:36.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6c632700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e640cbcb0 0x7f6e640c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:36.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6c632700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e64159510 0x7f6e640b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:36.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6c632700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e641598e0 0x7f6e640ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6c632700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e640c88a0 con 0x7f6e64159510 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6c632700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e64159d00 con 0x7f6e641598e0 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6c632700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e640b5740 con 0x7f6e640cbcb0 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e69bcd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e64159510 0x7f6e640b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e69bcd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e64159510 0x7f6e640b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36742/0 (socket says 172.21.15.84:36742) 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e69bcd700 1 -- 172.21.15.84:0/2084215933 learned_addr learned my addr 172.21.15.84:0/2084215933 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6abcf700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e641598e0 0x7f6e640ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6a3ce700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e640cbcb0 0x7f6e640c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e69bcd700 1 -- 172.21.15.84:0/2084215933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e640cbcb0 msgr2=0x7f6e640c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:36.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e69bcd700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e640cbcb0 0x7f6e640c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:36.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e69bcd700 1 -- 172.21.15.84:0/2084215933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e641598e0 msgr2=0x7f6e640ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:36.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e69bcd700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e641598e0 0x7f6e640ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:36.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e69bcd700 1 -- 172.21.15.84:0/2084215933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54009420 con 0x7f6e64159510 2023-10-06T02:58:36.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e69bcd700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e64159510 0x7f6e640b5200 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6e540030c0 tx=0x7f6e54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:36.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e5a7fc700 1 -- 172.21.15.84:0/2084215933 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54010ac0 con 0x7f6e64159510 2023-10-06T02:58:36.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e5a7fc700 1 -- 172.21.15.84:0/2084215933 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e54010c20 con 0x7f6e64159510 2023-10-06T02:58:36.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e640b5a10 con 0x7f6e64159510 2023-10-06T02:58:36.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e5a7fc700 1 -- 172.21.15.84:0/2084215933 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5401d430 con 0x7f6e64159510 2023-10-06T02:58:36.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.895+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6415a230 con 0x7f6e64159510 2023-10-06T02:58:36.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.896+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e640b6390 con 0x7f6e64159510 2023-10-06T02:58:36.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.897+0000 7f6e5a7fc700 1 -- 172.21.15.84:0/2084215933 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e5401d7a0 con 0x7f6e64159510 2023-10-06T02:58:36.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.897+0000 7f6e5a7fc700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6e48066f30 0x7f6e480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:36.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.897+0000 7f6e5a7fc700 1 -- 172.21.15.84:0/2084215933 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6e54086070 con 0x7f6e64159510 2023-10-06T02:58:36.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.897+0000 7f6e6a3ce700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6e48066f30 0x7f6e480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:36.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.898+0000 7f6e6a3ce700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6e48066f30 0x7f6e480693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e60003b80 tx=0x7f6e60007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:36.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:36.902+0000 7f6e5a7fc700 1 -- 172.21.15.84:0/2084215933 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e54053040 con 0x7f6e64159510 2023-10-06T02:58:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:37.130+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6e64064ad0 con 0x7f6e64159510 2023-10-06T02:58:38.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.131+0000 7f6e5a7fc700 1 -- 172.21.15.84:0/2084215933 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6e54056660 con 0x7f6e64159510 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6e48066f30 msgr2=0x7f6e480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6e48066f30 0x7f6e480693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e60003b80 tx=0x7f6e60007e40 comp rx=0 tx=0).stop 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e64159510 msgr2=0x7f6e640b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e64159510 0x7f6e640b5200 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6e540030c0 tx=0x7f6e54017000 comp rx=0 tx=0).stop 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 shutdown_connections 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6e48066f30 0x7f6e480693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e641598e0 0x7f6e640ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e640cbcb0 0x7f6e640c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 --2- 172.21.15.84:0/2084215933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e64159510 0x7f6e640b5200 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 >> 172.21.15.84:0/2084215933 conn(0x7f6e64089e90 msgr2=0x7f6e640c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:38.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 shutdown_connections 2023-10-06T02:58:38.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.133+0000 7f6e6c632700 1 -- 172.21.15.84:0/2084215933 wait complete. 2023-10-06T02:58:38.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:38.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.264+0000 7fd8de673700 1 Processor -- start 2023-10-06T02:58:38.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.264+0000 7fd8de673700 1 -- start start 2023-10-06T02:58:38.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8de673700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd8d8159480 0x7fd8d80b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8de673700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d80cb7e0 con 0x7fd8d80b2140 2023-10-06T02:58:38.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8de673700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d80b08a0 con 0x7fd8d80b3610 2023-10-06T02:58:38.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8de673700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d80cb190 con 0x7fd8d8159480 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8dde72700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd8d80b2140 0x7fd8d80b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37268/0 (socket says 172.21.15.84:37268) 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8dd671700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd8d8159480 0x7fd8d80b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8dde72700 1 -- 172.21.15.84:0/3095298324 learned_addr learned my addr 172.21.15.84:0/3095298324 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8dd671700 1 -- 172.21.15.84:0/3095298324 >> v1:172.21.15.131:6789/0 conn(0x7fd8d80b3610 legacy=0x7fd8d80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8dd671700 1 -- 172.21.15.84:0/3095298324 >> v1:172.21.15.84:6789/0 conn(0x7fd8d80b2140 legacy=0x7fd8d80b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8dd671700 1 -- 172.21.15.84:0/3095298324 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80cb470 con 0x7fd8d8159480 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.265+0000 7fd8cffff700 1 -- 172.21.15.84:0/3095298324 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508435206 0 0) 0x7fd8d80cb7e0 con 0x7fd8d80b2140 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8dd671700 1 --2- 172.21.15.84:0/3095298324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d8159480 0x7fd8d80b30d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40098e0 tx=0x7fd8d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25603fd30e7c15a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8cffff700 1 -- 172.21.15.84:0/3095298324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4009e80 con 0x7fd8d8159480 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8cffff700 1 -- 172.21.15.84:0/3095298324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d400b860 con 0x7fd8d8159480 2023-10-06T02:58:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8cffff700 1 -- 172.21.15.84:0/3095298324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400bbe0 con 0x7fd8d8159480 2023-10-06T02:58:38.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8de673700 1 -- 172.21.15.84:0/3095298324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d8159480 msgr2=0x7fd8d80b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8de673700 1 --2- 172.21.15.84:0/3095298324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d8159480 0x7fd8d80b30d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40098e0 tx=0x7fd8d40091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8de673700 1 -- 172.21.15.84:0/3095298324 shutdown_connections 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8de673700 1 --2- 172.21.15.84:0/3095298324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d8159480 0x7fd8d80b30d0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8de673700 1 -- 172.21.15.84:0/3095298324 >> 172.21.15.84:0/3095298324 conn(0x7fd8d806ed20 msgr2=0x7fd8d806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8de673700 1 -- 172.21.15.84:0/3095298324 shutdown_connections 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.266+0000 7fd8de673700 1 -- 172.21.15.84:0/3095298324 wait complete. 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.267+0000 7fd8de673700 1 Processor -- start 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.267+0000 7fd8de673700 1 -- start start 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.268+0000 7fd8de673700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8d80b2140 0x7fd8d80c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.268+0000 7fd8de673700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d80b3610 0x7fd8d8153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.268+0000 7fd8de673700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8d8159480 0x7fd8d8157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.268+0000 7fd8de673700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8159c40 con 0x7fd8d80b3610 2023-10-06T02:58:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.268+0000 7fd8de673700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8159f20 con 0x7fd8d80b2140 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.268+0000 7fd8de673700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d815a200 con 0x7fd8d8159480 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.268+0000 7fd8dce70700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d80b3610 0x7fd8d8153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.268+0000 7fd8dce70700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d80b3610 0x7fd8d8153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36770/0 (socket says 172.21.15.84:36770) 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.268+0000 7fd8dce70700 1 -- 172.21.15.84:0/753603067 learned_addr learned my addr 172.21.15.84:0/753603067 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8dd671700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8d80b2140 0x7fd8d80c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8dde72700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8d8159480 0x7fd8d8157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8dce70700 1 -- 172.21.15.84:0/753603067 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8d8159480 msgr2=0x7fd8d8157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8dce70700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8d8159480 0x7fd8d8157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8dce70700 1 -- 172.21.15.84:0/753603067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8d80b2140 msgr2=0x7fd8d80c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8dce70700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8d80b2140 0x7fd8d80c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8dce70700 1 -- 172.21.15.84:0/753603067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4009420 con 0x7fd8d80b3610 2023-10-06T02:58:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8dce70700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d80b3610 0x7fd8d8153160 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800c790 tx=0x7fd8c8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:38.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8cd7fa700 1 -- 172.21.15.84:0/753603067 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8006820 con 0x7fd8d80b3610 2023-10-06T02:58:38.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8cd7fa700 1 -- 172.21.15.84:0/753603067 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8006980 con 0x7fd8d80b3610 2023-10-06T02:58:38.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8cd7fa700 1 -- 172.21.15.84:0/753603067 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8006d40 con 0x7fd8d80b3610 2023-10-06T02:58:38.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d815a4e0 con 0x7fd8d80b3610 2023-10-06T02:58:38.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.269+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d81536a0 con 0x7fd8d80b3610 2023-10-06T02:58:38.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.270+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d8153920 con 0x7fd8d80b3610 2023-10-06T02:58:38.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.270+0000 7fd8cd7fa700 1 -- 172.21.15.84:0/753603067 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8c8007240 con 0x7fd8d80b3610 2023-10-06T02:58:38.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.271+0000 7fd8cd7fa700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd8bc066f30 0x7fd8bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.271+0000 7fd8dd671700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd8bc066f30 0x7fd8bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.271+0000 7fd8cd7fa700 1 -- 172.21.15.84:0/753603067 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd8c8083d40 con 0x7fd8d80b3610 2023-10-06T02:58:38.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.271+0000 7fd8dd671700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd8bc066f30 0x7fd8bc0693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40093f0 tx=0x7fd8d4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:38.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.275+0000 7fd8cd7fa700 1 -- 172.21.15.84:0/753603067 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8d8153920 con 0x7fd8d80b3610 2023-10-06T02:58:38.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.497+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8d815aa00 con 0x7fd8d80b3610 2023-10-06T02:58:38.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.497+0000 7fd8cd7fa700 1 -- 172.21.15.84:0/753603067 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fd8d815aa00 con 0x7fd8d80b3610 2023-10-06T02:58:38.499 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:38.499 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":52,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5567,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4032170839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4032170839},{"type":"v1","addr":"172.21.15.131:6835","nonce":4032170839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6525,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1455824046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1455824046},{"type":"v1","addr":"172.21.15.84:6836","nonce":1455824046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:58:34.102008+0000","modified":"2023-10-06T02:58:38.129434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3591915780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3591915780},{"type":"v1","addr":"172.21.15.84:6837","nonce":3591915780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:58:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd8bc066f30 msgr2=0x7fd8bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd8bc066f30 0x7fd8bc0693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40093f0 tx=0x7fd8d4017000 comp rx=0 tx=0).stop 2023-10-06T02:58:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d80b3610 msgr2=0x7fd8d8153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d80b3610 0x7fd8d8153160 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800c790 tx=0x7fd8c8007f60 comp rx=0 tx=0).stop 2023-10-06T02:58:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 shutdown_connections 2023-10-06T02:58:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd8bc066f30 0x7fd8bc0693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8d80b2140 0x7fd8d80c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8d8159480 0x7fd8d8157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 --2- 172.21.15.84:0/753603067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8d80b3610 0x7fd8d8153160 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 >> 172.21.15.84:0/753603067 conn(0x7fd8d806ed20 msgr2=0x7fd8d81549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:38.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 shutdown_connections 2023-10-06T02:58:38.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.499+0000 7fd8de673700 1 -- 172.21.15.84:0/753603067 wait complete. 2023-10-06T02:58:38.502 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 52 2023-10-06T02:58:38.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:58:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.625+0000 7ff9f1ade700 1 Processor -- start 2023-10-06T02:58:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.625+0000 7ff9f1ade700 1 -- start start 2023-10-06T02:58:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.626+0000 7ff9f1ade700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b2620 0x7ff9ec0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.626+0000 7ff9f1ade700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff9ec0b29f0 0x7ff9ec159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.626+0000 7ff9f1ade700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9ec1596a0 0x7ff9ec068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.626+0000 7ff9f1ade700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec0cbfe0 con 0x7ff9ec1596a0 2023-10-06T02:58:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.626+0000 7ff9f1ade700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec0cb3d0 con 0x7ff9ec0b29f0 2023-10-06T02:58:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.626+0000 7ff9f1ade700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0cb6b0 con 0x7ff9ec0b2620 2023-10-06T02:58:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.626+0000 7ff9ebfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9ec1596a0 0x7ff9ec068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.626+0000 7ff9ebfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9ec1596a0 0x7ff9ec068580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36786/0 (socket says 172.21.15.84:36786) 2023-10-06T02:58:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.626+0000 7ff9ebfff700 1 -- 172.21.15.84:0/276720026 learned_addr learned my addr 172.21.15.84:0/276720026 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9eaffd700 1 --2- 172.21.15.84:0/276720026 >> v2:172.21.15.131:3300/0 conn(0x7ff9ec0b29f0 0x7ff9ec159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9eb7fe700 1 --2- 172.21.15.84:0/276720026 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b2620 0x7ff9ec0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9ebfff700 1 -- 172.21.15.84:0/276720026 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b2620 msgr2=0x7ff9ec0b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9ebfff700 1 --2- 172.21.15.84:0/276720026 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b2620 0x7ff9ec0b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9ebfff700 1 -- 172.21.15.84:0/276720026 >> v2:172.21.15.131:3300/0 conn(0x7ff9ec0b29f0 msgr2=0x7ff9ec159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9ebfff700 1 --2- 172.21.15.84:0/276720026 >> v2:172.21.15.131:3300/0 conn(0x7ff9ec0b29f0 0x7ff9ec159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9ebfff700 1 -- 172.21.15.84:0/276720026 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0cb990 con 0x7ff9ec1596a0 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9eaffd700 1 --2- 172.21.15.84:0/276720026 >> v2:172.21.15.131:3300/0 conn(0x7ff9ec0b29f0 0x7ff9ec159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9ebfff700 1 --2- 172.21.15.84:0/276720026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec1596a0 0x7ff9ec068580 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0705a0 tx=0x7ff9e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235e3cd87260c603 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9ea7fc700 1 -- 172.21.15.84:0/276720026 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400b860 con 0x7ff9ec1596a0 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9ea7fc700 1 -- 172.21.15.84:0/276720026 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e400b9c0 con 0x7ff9ec1596a0 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9ea7fc700 1 -- 172.21.15.84:0/276720026 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400bd60 con 0x7ff9ec1596a0 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9f1ade700 1 -- 172.21.15.84:0/276720026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec1596a0 msgr2=0x7ff9ec068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.627+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/276720026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec1596a0 0x7ff9ec068580 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0705a0 tx=0x7ff9e4009250 comp rx=0 tx=0).stop 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.628+0000 7ff9f1ade700 1 -- 172.21.15.84:0/276720026 shutdown_connections 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.628+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/276720026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec1596a0 0x7ff9ec068580 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.628+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/276720026 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b2620 0x7ff9ec0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.628+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/276720026 >> v2:172.21.15.131:3300/0 conn(0x7ff9ec0b29f0 0x7ff9ec159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.628+0000 7ff9f1ade700 1 -- 172.21.15.84:0/276720026 >> 172.21.15.84:0/276720026 conn(0x7ff9ec06ed20 msgr2=0x7ff9ec06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.628+0000 7ff9f1ade700 1 -- 172.21.15.84:0/276720026 shutdown_connections 2023-10-06T02:58:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.628+0000 7ff9f1ade700 1 -- 172.21.15.84:0/276720026 wait complete. 2023-10-06T02:58:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.629+0000 7ff9f1ade700 1 Processor -- start 2023-10-06T02:58:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.629+0000 7ff9f1ade700 1 -- start start 2023-10-06T02:58:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9f1ade700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec0b2620 0x7ff9ec0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9f1ade700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b29f0 0x7ff9ec15e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9f1ade700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9ec1596a0 0x7ff9ec15e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9f1ade700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec15f7b0 con 0x7ff9ec0b2620 2023-10-06T02:58:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9f1ade700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec15b3f0 con 0x7ff9ec1596a0 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9f1ade700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec15a870 con 0x7ff9ec0b29f0 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec0b2620 0x7ff9ec0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec0b2620 0x7ff9ec0c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36796/0 (socket says 172.21.15.84:36796) 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eb7fe700 1 -- 172.21.15.84:0/989928257 learned_addr learned my addr 172.21.15.84:0/989928257 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9ebfff700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9ec1596a0 0x7ff9ec15e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eaffd700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b29f0 0x7ff9ec15e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eb7fe700 1 -- 172.21.15.84:0/989928257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b29f0 msgr2=0x7ff9ec15e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eb7fe700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b29f0 0x7ff9ec15e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eb7fe700 1 -- 172.21.15.84:0/989928257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9ec1596a0 msgr2=0x7ff9ec15e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eb7fe700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9ec1596a0 0x7ff9ec15e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eb7fe700 1 -- 172.21.15.84:0/989928257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e40094f0 con 0x7ff9ec0b2620 2023-10-06T02:58:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eaffd700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b29f0 0x7ff9ec15e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9eb7fe700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec0b2620 0x7ff9ec0c9d50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00a320 tx=0x7ff9dc007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9d37fe700 1 -- 172.21.15.84:0/989928257 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc00e450 con 0x7ff9ec0b2620 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9d37fe700 1 -- 172.21.15.84:0/989928257 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc00e5b0 con 0x7ff9ec0b2620 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9d37fe700 1 -- 172.21.15.84:0/989928257 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc00e950 con 0x7ff9ec0b2620 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec15ab50 con 0x7ff9ec0b2620 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.630+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec15b110 con 0x7ff9ec0b2620 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.631+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec16b000 con 0x7ff9ec0b2620 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.632+0000 7ff9d37fe700 1 -- 172.21.15.84:0/989928257 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9dc003020 con 0x7ff9ec0b2620 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.632+0000 7ff9d37fe700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff9d8066f30 0x7ff9d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.632+0000 7ff9eaffd700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff9d8066f30 0x7ff9d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.632+0000 7ff9d37fe700 1 -- 172.21.15.84:0/989928257 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff9dc012070 con 0x7ff9ec0b2620 2023-10-06T02:58:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.632+0000 7ff9eaffd700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff9d8066f30 0x7ff9d80693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec16cfd0 tx=0x7ff9e0006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.636+0000 7ff9d37fe700 1 -- 172.21.15.84:0/989928257 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9dc052850 con 0x7ff9ec0b2620 2023-10-06T02:58:38.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.823+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9ec064ad0 con 0x7ff9ec0b2620 2023-10-06T02:58:38.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.824+0000 7ff9d37fe700 1 -- 172.21.15.84:0/989928257 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+17074 (secure 0 0 0) 0x7ff9dc055e70 con 0x7ff9ec0b2620 2023-10-06T02:58:38.826 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:38.826 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":68,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:58:35.732978+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:58:31.743689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:58:33.068884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:58:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff9d8066f30 msgr2=0x7ff9d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff9d8066f30 0x7ff9d80693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec16cfd0 tx=0x7ff9e0006f90 comp rx=0 tx=0).stop 2023-10-06T02:58:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec0b2620 msgr2=0x7ff9ec0c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec0b2620 0x7ff9ec0c9d50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00a320 tx=0x7ff9dc007900 comp rx=0 tx=0).stop 2023-10-06T02:58:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 shutdown_connections 2023-10-06T02:58:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff9d8066f30 0x7ff9d80693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9ec1596a0 0x7ff9ec15e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9ec0b2620 0x7ff9ec0c9d50 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 --2- 172.21.15.84:0/989928257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9ec0b29f0 0x7ff9ec15e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 >> 172.21.15.84:0/989928257 conn(0x7ff9ec06ed20 msgr2=0x7ff9ec1571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 shutdown_connections 2023-10-06T02:58:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.826+0000 7ff9f1ade700 1 -- 172.21.15.84:0/989928257 wait complete. 2023-10-06T02:58:38.840 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T02:58:38.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.953+0000 7f7d7704d700 1 Processor -- start 2023-10-06T02:58:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.953+0000 7f7d7704d700 1 -- start start 2023-10-06T02:58:38.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7704d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d700cbc70 0x7f7d700cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7704d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 0x7f7d700b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7704d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d700cb7e0 con 0x7f7d70159480 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7704d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d700b08a0 con 0x7f7d700cbc70 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7704d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700cb190 con 0x7f7d700b2140 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7584a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d700cbc70 0x7f7d700cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7584a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d700cbc70 0x7f7d700cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36810/0 (socket says 172.21.15.84:36810) 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7584a700 1 -- 172.21.15.84:0/1262998248 learned_addr learned my addr 172.21.15.84:0/1262998248 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7684c700 1 --2- 172.21.15.84:0/1262998248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 0x7f7d700b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7584a700 1 -- 172.21.15.84:0/1262998248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 msgr2=0x7f7d700b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7584a700 1 --2- 172.21.15.84:0/1262998248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 0x7f7d700b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7584a700 1 -- 172.21.15.84:0/1262998248 >> v1:172.21.15.131:6789/0 conn(0x7f7d70159480 legacy=0x7f7d700b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7584a700 1 -- 172.21.15.84:0/1262998248 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d700cb470 con 0x7f7d700cbc70 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d7584a700 1 --2- 172.21.15.84:0/1262998248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d700cbc70 0x7f7d700cc0c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7d600099b0 tx=0x7f7d60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5059fcb746564c90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.954+0000 7f7d75049700 1 -- 172.21.15.84:0/1262998248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000b860 con 0x7f7d700cbc70 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d75049700 1 -- 172.21.15.84:0/1262998248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000b9c0 con 0x7f7d700cbc70 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d75049700 1 -- 172.21.15.84:0/1262998248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000bd60 con 0x7f7d700cbc70 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d7704d700 1 -- 172.21.15.84:0/1262998248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d700cbc70 msgr2=0x7f7d700cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d7704d700 1 --2- 172.21.15.84:0/1262998248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d700cbc70 0x7f7d700cc0c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7d600099b0 tx=0x7f7d60009250 comp rx=0 tx=0).stop 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d7704d700 1 -- 172.21.15.84:0/1262998248 shutdown_connections 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d7704d700 1 --2- 172.21.15.84:0/1262998248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 0x7f7d700b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d7704d700 1 --2- 172.21.15.84:0/1262998248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d700cbc70 0x7f7d700cc0c0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d7704d700 1 -- 172.21.15.84:0/1262998248 >> 172.21.15.84:0/1262998248 conn(0x7f7d7006ed20 msgr2=0x7f7d7006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:38.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d7704d700 1 -- 172.21.15.84:0/1262998248 shutdown_connections 2023-10-06T02:58:38.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.955+0000 7f7d7704d700 1 -- 172.21.15.84:0/1262998248 wait complete. 2023-10-06T02:58:38.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.956+0000 7f7d7704d700 1 Processor -- start 2023-10-06T02:58:38.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.956+0000 7f7d7704d700 1 -- start start 2023-10-06T02:58:38.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7704d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 0x7f7d701532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7704d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbc70 0x7f7d700c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7704d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159480 0x7f7d70158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7704d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700b05e0 con 0x7f7d70159480 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7704d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700ce480 con 0x7f7d700cbc70 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7704d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700c5d50 con 0x7f7d700b2140 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7684c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159480 0x7f7d70158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7684c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159480 0x7f7d70158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36816/0 (socket says 172.21.15.84:36816) 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7684c700 1 -- 172.21.15.84:0/2912411226 learned_addr learned my addr 172.21.15.84:0/2912411226 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7604b700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 0x7f7d701532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7584a700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbc70 0x7f7d700c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7684c700 1 -- 172.21.15.84:0/2912411226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 msgr2=0x7f7d701532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7684c700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 0x7f7d701532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7684c700 1 -- 172.21.15.84:0/2912411226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbc70 msgr2=0x7f7d700c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7684c700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbc70 0x7f7d700c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.957+0000 7f7d7684c700 1 -- 172.21.15.84:0/2912411226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d600094f0 con 0x7f7d70159480 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.958+0000 7f7d7684c700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159480 0x7f7d70158050 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800d8c0 tx=0x7f7d68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.958+0000 7f7d667fc700 1 -- 172.21.15.84:0/2912411226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680125f0 con 0x7f7d70159480 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.958+0000 7f7d667fc700 1 -- 172.21.15.84:0/2912411226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d68012770 con 0x7f7d70159480 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.958+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d700c6030 con 0x7f7d70159480 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.958+0000 7f7d667fc700 1 -- 172.21.15.84:0/2912411226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68012b30 con 0x7f7d70159480 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.958+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d700ce110 con 0x7f7d70159480 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.959+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d700ce610 con 0x7f7d70159480 2023-10-06T02:58:38.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.959+0000 7f7d667fc700 1 -- 172.21.15.84:0/2912411226 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d6801e460 con 0x7f7d70159480 2023-10-06T02:58:38.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.959+0000 7f7d667fc700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d54066f30 0x7f7d540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:38.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.960+0000 7f7d667fc700 1 -- 172.21.15.84:0/2912411226 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7d68084cf0 con 0x7f7d70159480 2023-10-06T02:58:38.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.960+0000 7f7d7604b700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d54066f30 0x7f7d540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:38.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.960+0000 7f7d7604b700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d54066f30 0x7f7d540693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c007fd0 tx=0x7f7d6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:38.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:38.964+0000 7f7d667fc700 1 -- 172.21.15.84:0/2912411226 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d68089070 con 0x7f7d70159480 2023-10-06T02:58:39.022 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T02:58:39.021+0000 7f2503fec700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T02:58:39.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.145+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d7005f270 con 0x7f7d54066f30 2023-10-06T02:58:39.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.153+0000 7f7d667fc700 1 -- 172.21.15.84:0/2912411226 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308570 (secure 0 0 0) 0x7f7d7005f270 con 0x7f7d54066f30 2023-10-06T02:58:39.158 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.156+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d54066f30 msgr2=0x7f7d540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.156+0000 7f7d7704d700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d54066f30 0x7f7d540693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c007fd0 tx=0x7f7d6c009040 comp rx=0 tx=0).stop 2023-10-06T02:58:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.156+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159480 msgr2=0x7f7d70158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.156+0000 7f7d7704d700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159480 0x7f7d70158050 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800d8c0 tx=0x7f7d68008040 comp rx=0 tx=0).stop 2023-10-06T02:58:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.156+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 shutdown_connections 2023-10-06T02:58:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.156+0000 7f7d7704d700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d54066f30 0x7f7d540693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.157+0000 7f7d7704d700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d70159480 0x7f7d70158050 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.157+0000 7f7d7704d700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d700b2140 0x7f7d701532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.157+0000 7f7d7704d700 1 --2- 172.21.15.84:0/2912411226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d700cbc70 0x7f7d700c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.157+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 >> 172.21.15.84:0/2912411226 conn(0x7f7d7006ed20 msgr2=0x7f7d701549e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.157+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 shutdown_connections 2023-10-06T02:58:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.157+0000 7f7d7704d700 1 -- 172.21.15.84:0/2912411226 wait complete. 2023-10-06T02:58:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:58:39.170 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2023-10-06T02:58:37.847669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385608,"kb_used_data":7304,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589112,"statfs":{"total":773094113280,"available":770651250688,"internally_reserved":0,"allocated":7479296,"data_stored":4113911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.133178"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.730955+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:49.111285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.722955+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:12.873779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727501+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:16.482180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.739638+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:12.873779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727760+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:23.315217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727084+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:07.239624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.729341+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:30.446996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725462+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:53.600520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727629+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:00.633403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725795+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.623378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.735539+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:25.003429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.738765+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:08.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723535+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.730172+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:14.824360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723441+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724238+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728497+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:51.571318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.737594+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:46.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725065+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723098+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723796+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725585+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:32.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.735699+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:44.834919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.730615+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:27.700059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724994+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.729433+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:11.365588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725816+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:48.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723634+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.726171+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:00.743751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.726660+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:07.588359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728371+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:28.270552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724727+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:10.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.734167+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:30.446996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.745475+0000","last_change":"2023-10-06T02:58:33.745475+0000","last_active":"2023-10-06T02:58:33.745475+0000","last_peered":"2023-10-06T02:58:33.745475+0000","last_clean":"2023-10-06T02:58:33.745475+0000","last_became_active":"2023-10-06T02:58:33.745233+0000","last_became_peered":"2023-10-06T02:58:33.745233+0000","last_unstale":"2023-10-06T02:58:33.745475+0000","last_undegraded":"2023-10-06T02:58:33.745475+0000","last_fullsized":"2023-10-06T02:58:33.745475+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728052+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:26.923964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.732849+0000","last_change":"2023-10-06T02:58:33.732849+0000","last_active":"2023-10-06T02:58:33.732849+0000","last_peered":"2023-10-06T02:58:33.732849+0000","last_clean":"2023-10-06T02:58:33.732849+0000","last_became_active":"2023-10-06T02:58:33.732239+0000","last_became_peered":"2023-10-06T02:58:33.732239+0000","last_unstale":"2023-10-06T02:58:33.732849+0000","last_undegraded":"2023-10-06T02:58:33.732849+0000","last_fullsized":"2023-10-06T02:58:33.732849+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725173+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:02.311802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.733506+0000","last_change":"2023-10-06T02:58:33.733506+0000","last_active":"2023-10-06T02:58:33.733506+0000","last_peered":"2023-10-06T02:58:33.733506+0000","last_clean":"2023-10-06T02:58:33.733506+0000","last_became_active":"2023-10-06T02:58:33.733249+0000","last_became_peered":"2023-10-06T02:58:33.733249+0000","last_unstale":"2023-10-06T02:58:33.733506+0000","last_undegraded":"2023-10-06T02:58:33.733506+0000","last_fullsized":"2023-10-06T02:58:33.733506+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.734672+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:16.237630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.743169+0000","last_change":"2023-10-06T02:58:33.743169+0000","last_active":"2023-10-06T02:58:33.743169+0000","last_peered":"2023-10-06T02:58:33.743169+0000","last_clean":"2023-10-06T02:58:33.743169+0000","last_became_active":"2023-10-06T02:58:33.742892+0000","last_became_peered":"2023-10-06T02:58:33.742892+0000","last_unstale":"2023-10-06T02:58:33.743169+0000","last_undegraded":"2023-10-06T02:58:33.743169+0000","last_fullsized":"2023-10-06T02:58:33.743169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:07.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728789+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:02.013607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734217+0000","last_change":"2023-10-06T02:58:33.734217+0000","last_active":"2023-10-06T02:58:33.734217+0000","last_peered":"2023-10-06T02:58:33.734217+0000","last_clean":"2023-10-06T02:58:33.734217+0000","last_became_active":"2023-10-06T02:58:33.733894+0000","last_became_peered":"2023-10-06T02:58:33.733894+0000","last_unstale":"2023-10-06T02:58:33.734217+0000","last_undegraded":"2023-10-06T02:58:33.734217+0000","last_fullsized":"2023-10-06T02:58:33.734217+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:31.585062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723295+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:44.834919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.736095+0000","last_change":"2023-10-06T02:58:33.736095+0000","last_active":"2023-10-06T02:58:33.736095+0000","last_peered":"2023-10-06T02:58:33.736095+0000","last_clean":"2023-10-06T02:58:33.736095+0000","last_became_active":"2023-10-06T02:58:33.735839+0000","last_became_peered":"2023-10-06T02:58:33.735839+0000","last_unstale":"2023-10-06T02:58:33.736095+0000","last_undegraded":"2023-10-06T02:58:33.736095+0000","last_fullsized":"2023-10-06T02:58:33.736095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727106+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:06.140937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742149+0000","last_change":"2023-10-06T02:58:33.742149+0000","last_active":"2023-10-06T02:58:33.742149+0000","last_peered":"2023-10-06T02:58:33.742149+0000","last_clean":"2023-10-06T02:58:33.742149+0000","last_became_active":"2023-10-06T02:58:33.741911+0000","last_became_peered":"2023-10-06T02:58:33.741911+0000","last_unstale":"2023-10-06T02:58:33.742149+0000","last_undegraded":"2023-10-06T02:58:33.742149+0000","last_fullsized":"2023-10-06T02:58:33.742149+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.722984+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:44.834919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.743119+0000","last_change":"2023-10-06T02:58:33.743119+0000","last_active":"2023-10-06T02:58:33.743119+0000","last_peered":"2023-10-06T02:58:33.743119+0000","last_clean":"2023-10-06T02:58:33.743119+0000","last_became_active":"2023-10-06T02:58:33.742849+0000","last_became_peered":"2023-10-06T02:58:33.742849+0000","last_unstale":"2023-10-06T02:58:33.743119+0000","last_undegraded":"2023-10-06T02:58:33.743119+0000","last_fullsized":"2023-10-06T02:58:33.743119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:10.552745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728506+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:34.860551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734599+0000","last_change":"2023-10-06T02:58:33.734599+0000","last_active":"2023-10-06T02:58:33.734599+0000","last_peered":"2023-10-06T02:58:33.734599+0000","last_clean":"2023-10-06T02:58:33.734599+0000","last_became_active":"2023-10-06T02:58:33.734161+0000","last_became_peered":"2023-10-06T02:58:33.734161+0000","last_unstale":"2023-10-06T02:58:33.734599+0000","last_undegraded":"2023-10-06T02:58:33.734599+0000","last_fullsized":"2023-10-06T02:58:33.734599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:10.358630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.731880+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:28.270552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.733304+0000","last_change":"2023-10-06T02:58:33.733304+0000","last_active":"2023-10-06T02:58:33.733304+0000","last_peered":"2023-10-06T02:58:33.733304+0000","last_clean":"2023-10-06T02:58:33.733304+0000","last_became_active":"2023-10-06T02:58:33.733025+0000","last_became_peered":"2023-10-06T02:58:33.733025+0000","last_unstale":"2023-10-06T02:58:33.733304+0000","last_undegraded":"2023-10-06T02:58:33.733304+0000","last_fullsized":"2023-10-06T02:58:33.733304+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724464+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:21.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734221+0000","last_change":"2023-10-06T02:58:33.734221+0000","last_active":"2023-10-06T02:58:33.734221+0000","last_peered":"2023-10-06T02:58:33.734221+0000","last_clean":"2023-10-06T02:58:33.734221+0000","last_became_active":"2023-10-06T02:58:33.733961+0000","last_became_peered":"2023-10-06T02:58:33.733961+0000","last_unstale":"2023-10-06T02:58:33.734221+0000","last_undegraded":"2023-10-06T02:58:33.734221+0000","last_fullsized":"2023-10-06T02:58:33.734221+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:02.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727579+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:10.190304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742820+0000","last_change":"2023-10-06T02:58:33.742820+0000","last_active":"2023-10-06T02:58:33.742820+0000","last_peered":"2023-10-06T02:58:33.742820+0000","last_clean":"2023-10-06T02:58:33.742820+0000","last_became_active":"2023-10-06T02:58:33.742572+0000","last_became_peered":"2023-10-06T02:58:33.742572+0000","last_unstale":"2023-10-06T02:58:33.742820+0000","last_undegraded":"2023-10-06T02:58:33.742820+0000","last_fullsized":"2023-10-06T02:58:33.742820+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.735960+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:34.860551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742960+0000","last_change":"2023-10-06T02:58:33.742960+0000","last_active":"2023-10-06T02:58:33.742960+0000","last_peered":"2023-10-06T02:58:33.742960+0000","last_clean":"2023-10-06T02:58:33.742960+0000","last_became_active":"2023-10-06T02:58:33.742690+0000","last_became_peered":"2023-10-06T02:58:33.742690+0000","last_unstale":"2023-10-06T02:58:33.742960+0000","last_undegraded":"2023-10-06T02:58:33.742960+0000","last_fullsized":"2023-10-06T02:58:33.742960+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727056+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:18.404602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734770+0000","last_change":"2023-10-06T02:58:33.734770+0000","last_active":"2023-10-06T02:58:33.734770+0000","last_peered":"2023-10-06T02:58:33.734770+0000","last_clean":"2023-10-06T02:58:33.734770+0000","last_became_active":"2023-10-06T02:58:33.734351+0000","last_became_peered":"2023-10-06T02:58:33.734351+0000","last_unstale":"2023-10-06T02:58:33.734770+0000","last_undegraded":"2023-10-06T02:58:33.734770+0000","last_fullsized":"2023-10-06T02:58:33.734770+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:59.626445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.722715+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:25.003429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.736152+0000","last_change":"2023-10-06T02:58:33.736152+0000","last_active":"2023-10-06T02:58:33.736152+0000","last_peered":"2023-10-06T02:58:33.736152+0000","last_clean":"2023-10-06T02:58:33.736152+0000","last_became_active":"2023-10-06T02:58:33.735725+0000","last_became_peered":"2023-10-06T02:58:33.735725+0000","last_unstale":"2023-10-06T02:58:33.736152+0000","last_undegraded":"2023-10-06T02:58:33.736152+0000","last_fullsized":"2023-10-06T02:58:33.736152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.949148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.726081+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:28.303150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734055+0000","last_change":"2023-10-06T02:58:33.734055+0000","last_active":"2023-10-06T02:58:33.734055+0000","last_peered":"2023-10-06T02:58:33.734055+0000","last_clean":"2023-10-06T02:58:33.734055+0000","last_became_active":"2023-10-06T02:58:33.733756+0000","last_became_peered":"2023-10-06T02:58:33.733756+0000","last_unstale":"2023-10-06T02:58:33.734055+0000","last_undegraded":"2023-10-06T02:58:33.734055+0000","last_fullsized":"2023-10-06T02:58:33.734055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:27.263593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724756+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735367+0000","last_change":"2023-10-06T02:58:33.735367+0000","last_active":"2023-10-06T02:58:33.735367+0000","last_peered":"2023-10-06T02:58:33.735367+0000","last_clean":"2023-10-06T02:58:33.735367+0000","last_became_active":"2023-10-06T02:58:33.734942+0000","last_became_peered":"2023-10-06T02:58:33.734942+0000","last_unstale":"2023-10-06T02:58:33.735367+0000","last_undegraded":"2023-10-06T02:58:33.735367+0000","last_fullsized":"2023-10-06T02:58:33.735367+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727062+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:49.111285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.736226+0000","last_change":"2023-10-06T02:58:33.736226+0000","last_active":"2023-10-06T02:58:33.736226+0000","last_peered":"2023-10-06T02:58:33.736226+0000","last_clean":"2023-10-06T02:58:33.736226+0000","last_became_active":"2023-10-06T02:58:33.735569+0000","last_became_peered":"2023-10-06T02:58:33.735569+0000","last_unstale":"2023-10-06T02:58:33.736226+0000","last_undegraded":"2023-10-06T02:58:33.736226+0000","last_fullsized":"2023-10-06T02:58:33.736226+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.729882+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:13.853088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735368+0000","last_change":"2023-10-06T02:58:33.735368+0000","last_active":"2023-10-06T02:58:33.735368+0000","last_peered":"2023-10-06T02:58:33.735368+0000","last_clean":"2023-10-06T02:58:33.735368+0000","last_became_active":"2023-10-06T02:58:33.735110+0000","last_became_peered":"2023-10-06T02:58:33.735110+0000","last_unstale":"2023-10-06T02:58:33.735368+0000","last_undegraded":"2023-10-06T02:58:33.735368+0000","last_fullsized":"2023-10-06T02:58:33.735368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:24.789985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.735097+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:11.365588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.727028+0000","last_change":"2023-10-06T02:58:33.727028+0000","last_active":"2023-10-06T02:58:33.727028+0000","last_peered":"2023-10-06T02:58:33.727028+0000","last_clean":"2023-10-06T02:58:33.727028+0000","last_became_active":"2023-10-06T02:58:33.726742+0000","last_became_peered":"2023-10-06T02:58:33.726742+0000","last_unstale":"2023-10-06T02:58:33.727028+0000","last_undegraded":"2023-10-06T02:58:33.727028+0000","last_fullsized":"2023-10-06T02:58:33.727028+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.729802+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:30.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.733340+0000","last_change":"2023-10-06T02:58:33.733340+0000","last_active":"2023-10-06T02:58:33.733340+0000","last_peered":"2023-10-06T02:58:33.733340+0000","last_clean":"2023-10-06T02:58:33.733340+0000","last_became_active":"2023-10-06T02:58:33.733080+0000","last_became_peered":"2023-10-06T02:58:33.733080+0000","last_unstale":"2023-10-06T02:58:33.733340+0000","last_undegraded":"2023-10-06T02:58:33.733340+0000","last_fullsized":"2023-10-06T02:58:33.733340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:32.544670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724326+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:02.147902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742848+0000","last_change":"2023-10-06T02:58:33.742848+0000","last_active":"2023-10-06T02:58:33.742848+0000","last_peered":"2023-10-06T02:58:33.742848+0000","last_clean":"2023-10-06T02:58:33.742848+0000","last_became_active":"2023-10-06T02:58:33.742585+0000","last_became_peered":"2023-10-06T02:58:33.742585+0000","last_unstale":"2023-10-06T02:58:33.742848+0000","last_undegraded":"2023-10-06T02:58:33.742848+0000","last_fullsized":"2023-10-06T02:58:33.742848+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.740282+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:02.147902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.740591+0000","last_change":"2023-10-06T02:58:33.740591+0000","last_active":"2023-10-06T02:58:33.740591+0000","last_peered":"2023-10-06T02:58:33.740591+0000","last_clean":"2023-10-06T02:58:33.740591+0000","last_became_active":"2023-10-06T02:58:33.740329+0000","last_became_peered":"2023-10-06T02:58:33.740329+0000","last_unstale":"2023-10-06T02:58:33.740591+0000","last_undegraded":"2023-10-06T02:58:33.740591+0000","last_fullsized":"2023-10-06T02:58:33.740591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723132+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:50.170481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.745606+0000","last_change":"2023-10-06T02:58:33.745606+0000","last_active":"2023-10-06T02:58:33.745606+0000","last_peered":"2023-10-06T02:58:33.745606+0000","last_clean":"2023-10-06T02:58:33.745606+0000","last_became_active":"2023-10-06T02:58:33.745246+0000","last_became_peered":"2023-10-06T02:58:33.745246+0000","last_unstale":"2023-10-06T02:58:33.745606+0000","last_undegraded":"2023-10-06T02:58:33.745606+0000","last_fullsized":"2023-10-06T02:58:33.745606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:45.339807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727133+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:35.025250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742273+0000","last_change":"2023-10-06T02:58:33.742273+0000","last_active":"2023-10-06T02:58:33.742273+0000","last_peered":"2023-10-06T02:58:33.742273+0000","last_clean":"2023-10-06T02:58:33.742273+0000","last_became_active":"2023-10-06T02:58:33.741934+0000","last_became_peered":"2023-10-06T02:58:33.741934+0000","last_unstale":"2023-10-06T02:58:33.742273+0000","last_undegraded":"2023-10-06T02:58:33.742273+0000","last_fullsized":"2023-10-06T02:58:33.742273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:15.613100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.728733+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:58:32.728733+0000","last_peered":"2023-10-06T02:58:32.728733+0000","last_clean":"2023-10-06T02:58:32.728733+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:58:32.728733+0000","last_undegraded":"2023-10-06T02:58:32.728733+0000","last_fullsized":"2023-10-06T02:58:32.728733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725483+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:13.097392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.732697+0000","last_change":"2023-10-06T02:58:33.732697+0000","last_active":"2023-10-06T02:58:33.732697+0000","last_peered":"2023-10-06T02:58:33.732697+0000","last_clean":"2023-10-06T02:58:33.732697+0000","last_became_active":"2023-10-06T02:58:33.732421+0000","last_became_peered":"2023-10-06T02:58:33.732421+0000","last_unstale":"2023-10-06T02:58:33.732697+0000","last_undegraded":"2023-10-06T02:58:33.732697+0000","last_fullsized":"2023-10-06T02:58:33.732697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.722191+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:58:32.722191+0000","last_peered":"2023-10-06T02:58:32.722191+0000","last_clean":"2023-10-06T02:58:32.722191+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:58:32.722191+0000","last_undegraded":"2023-10-06T02:58:32.722191+0000","last_fullsized":"2023-10-06T02:58:32.722191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725512+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:55.617522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735296+0000","last_change":"2023-10-06T02:58:33.735296+0000","last_active":"2023-10-06T02:58:33.735296+0000","last_peered":"2023-10-06T02:58:33.735296+0000","last_clean":"2023-10-06T02:58:33.735296+0000","last_became_active":"2023-10-06T02:58:33.735041+0000","last_became_peered":"2023-10-06T02:58:33.735041+0000","last_unstale":"2023-10-06T02:58:33.735296+0000","last_undegraded":"2023-10-06T02:58:33.735296+0000","last_fullsized":"2023-10-06T02:58:33.735296+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:12.846129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.719286+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:58:32.719286+0000","last_peered":"2023-10-06T02:58:32.719286+0000","last_clean":"2023-10-06T02:58:32.719286+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:58:32.719286+0000","last_undegraded":"2023-10-06T02:58:32.719286+0000","last_fullsized":"2023-10-06T02:58:32.719286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725453+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:41.077463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.743225+0000","last_change":"2023-10-06T02:58:33.743225+0000","last_active":"2023-10-06T02:58:33.743225+0000","last_peered":"2023-10-06T02:58:33.743225+0000","last_clean":"2023-10-06T02:58:33.743225+0000","last_became_active":"2023-10-06T02:58:33.742937+0000","last_became_peered":"2023-10-06T02:58:33.742937+0000","last_unstale":"2023-10-06T02:58:33.743225+0000","last_undegraded":"2023-10-06T02:58:33.743225+0000","last_fullsized":"2023-10-06T02:58:33.743225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:13.817402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.721545+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:58:32.721545+0000","last_peered":"2023-10-06T02:58:32.721545+0000","last_clean":"2023-10-06T02:58:32.721545+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:58:32.721545+0000","last_undegraded":"2023-10-06T02:58:32.721545+0000","last_fullsized":"2023-10-06T02:58:32.721545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.724318+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:58:32.724318+0000","last_peered":"2023-10-06T02:58:32.724318+0000","last_clean":"2023-10-06T02:58:32.724318+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:58:32.724318+0000","last_undegraded":"2023-10-06T02:58:32.724318+0000","last_fullsized":"2023-10-06T02:58:32.724318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725039+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.732458+0000","last_change":"2023-10-06T02:58:33.732458+0000","last_active":"2023-10-06T02:58:33.732458+0000","last_peered":"2023-10-06T02:58:33.732458+0000","last_clean":"2023-10-06T02:58:33.732458+0000","last_became_active":"2023-10-06T02:58:33.732203+0000","last_became_peered":"2023-10-06T02:58:33.732203+0000","last_unstale":"2023-10-06T02:58:33.732458+0000","last_undegraded":"2023-10-06T02:58:33.732458+0000","last_fullsized":"2023-10-06T02:58:33.732458+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.724347+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:58:32.724347+0000","last_peered":"2023-10-06T02:58:32.724347+0000","last_clean":"2023-10-06T02:58:32.724347+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:58:32.724347+0000","last_undegraded":"2023-10-06T02:58:32.724347+0000","last_fullsized":"2023-10-06T02:58:32.724347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.739200+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.419076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735525+0000","last_change":"2023-10-06T02:58:33.735525+0000","last_active":"2023-10-06T02:58:33.735525+0000","last_peered":"2023-10-06T02:58:33.735525+0000","last_clean":"2023-10-06T02:58:33.735525+0000","last_became_active":"2023-10-06T02:58:33.735068+0000","last_became_peered":"2023-10-06T02:58:33.735068+0000","last_unstale":"2023-10-06T02:58:33.735525+0000","last_undegraded":"2023-10-06T02:58:33.735525+0000","last_fullsized":"2023-10-06T02:58:33.735525+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:27.296192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.724311+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:58:32.724311+0000","last_peered":"2023-10-06T02:58:32.724311+0000","last_clean":"2023-10-06T02:58:32.724311+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:58:32.724311+0000","last_undegraded":"2023-10-06T02:58:32.724311+0000","last_fullsized":"2023-10-06T02:58:32.724311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.731415+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:18.404602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.736569+0000","last_change":"2023-10-06T02:58:33.736569+0000","last_active":"2023-10-06T02:58:33.736569+0000","last_peered":"2023-10-06T02:58:33.736569+0000","last_clean":"2023-10-06T02:58:33.736569+0000","last_became_active":"2023-10-06T02:58:33.736326+0000","last_became_peered":"2023-10-06T02:58:33.736326+0000","last_unstale":"2023-10-06T02:58:33.736569+0000","last_undegraded":"2023-10-06T02:58:33.736569+0000","last_fullsized":"2023-10-06T02:58:33.736569+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.728768+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:58:32.728768+0000","last_peered":"2023-10-06T02:58:32.728768+0000","last_clean":"2023-10-06T02:58:32.728768+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:58:32.728768+0000","last_undegraded":"2023-10-06T02:58:32.728768+0000","last_fullsized":"2023-10-06T02:58:32.728768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725274+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735199+0000","last_change":"2023-10-06T02:58:33.735199+0000","last_active":"2023-10-06T02:58:33.735199+0000","last_peered":"2023-10-06T02:58:33.735199+0000","last_clean":"2023-10-06T02:58:33.735199+0000","last_became_active":"2023-10-06T02:58:33.734599+0000","last_became_peered":"2023-10-06T02:58:33.734599+0000","last_unstale":"2023-10-06T02:58:33.735199+0000","last_undegraded":"2023-10-06T02:58:33.735199+0000","last_fullsized":"2023-10-06T02:58:33.735199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:05.133979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.725625+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:58:32.725625+0000","last_peered":"2023-10-06T02:58:32.725625+0000","last_clean":"2023-10-06T02:58:32.725625+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:58:32.725625+0000","last_undegraded":"2023-10-06T02:58:32.725625+0000","last_fullsized":"2023-10-06T02:58:32.725625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":956527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.754},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.502},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66400000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58899999999999997,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81599999999999995,"5min":3.415,"15min":3.415},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":1.546,"15min":1.546},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.31}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.74,"15min":1.74},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.67900000000000005,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69299999999999995,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":3.577,"15min":3.577},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.51100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.73699999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.432}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80300000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.496},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.502}]},{"osd":7,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":365148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.377,"15min":0.40100000000000002},"min":{"1min":0.23000000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.45300000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.41699999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.99099999999999999,"15min":1.2769999999999999},"min":{"1min":0.255,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44500000000000001,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.495},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.433,"15min":0.443},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":1.181,"15min":1.181},"last":0.60299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.42699999999999999,"15min":0.443},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48099999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.626,"15min":0.626},"last":0.47999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70299999999999996,"5min":1.02,"15min":1.02},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":1.228,"15min":1.5},"min":{"1min":0.42299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79700000000000004,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.54000000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.2130000000000001,"15min":1.4830000000000001},"min":{"1min":0.46800000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73399999999999999,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81000000000000005,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.48399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.242,"15min":1.52},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82499999999999996,"5min":21.166,"15min":21.166},"last":0.624}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78600000000000003,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84199999999999997,"5min":0.997,"15min":0.997},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298632,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073208,"statfs":{"total":96636764160,"available":96330964992,"internally_reserved":0,"allocated":1376256,"data_stored":955516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.505},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.33200000000000002,"15min":0.32800000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.373,"15min":0.372},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26500000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40000000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.875,"5min":0.879,"15min":0.879},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.746}]},{"osd":7,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.315,"15min":0.307},"min":{"1min":0.23200000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32000000000000001},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.51200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.26400000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.58399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53700000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.307}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.32900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.33200000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.38700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.872,"5min":1.077,"15min":1.077},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.434},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79600000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":365148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.45500000000000002},"min":{"1min":0.249,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.60899999999999999,"5min":2.569,"15min":2.569},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42899999999999999,"15min":0.45400000000000001},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.47399999999999998,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41699999999999998,"15min":0.442},"min":{"1min":0.22600000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.51200000000000001,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.44800000000000001,"15min":0.47999999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56999999999999995,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47199999999999998,"15min":0.498},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54400000000000004,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.65000000000000002,"15min":0.68000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.66200000000000003,"15min":0.69399999999999995},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80000000000000004,"5min":2.532,"15min":2.532},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.625},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.753}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.71799999999999997,"5min":2.496,"15min":2.496},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84799999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":373095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.91500000000000004,"15min":1.0409999999999999},"min":{"1min":0.46300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.871,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64200000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69399999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.62},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.504,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":1.167,"15min":1.167},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.57399999999999995},"min":{"1min":0.38700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.625,"5min":1.117,"15min":1.117},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.504}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68500000000000005,"5min":1.2,"15min":1.2},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":1.135,"15min":1.135},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67100000000000004,"5min":1.208,"15min":1.208},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66400000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.62},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73199999999999998,"5min":0.87,"15min":0.87},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56100000000000005,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":1.054,"15min":1.054},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.56999999999999995,"15min":0.58899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71899999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76000000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78200000000000003,"5min":1.008,"15min":1.008},"last":0.41399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:58:39.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:39.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.323+0000 7f88e01f1700 1 Processor -- start 2023-10-06T02:58:39.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.323+0000 7f88e01f1700 1 -- start start 2023-10-06T02:58:39.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.324+0000 7f88e01f1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f88d80b49e0 0x7f88d80aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.324+0000 7f88e01f1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b07a0 0x7f88d80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.324+0000 7f88e01f1700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d80b0ca0 con 0x7f88d81595a0 2023-10-06T02:58:39.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.324+0000 7f88e01f1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d80b0f80 con 0x7f88d80b49e0 2023-10-06T02:58:39.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.324+0000 7f88e01f1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80b1260 con 0x7f88d80b07a0 2023-10-06T02:58:39.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.324+0000 7f88dd78c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f88d80b49e0 0x7f88d80aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.324+0000 7f88dd78c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f88d80b49e0 0x7f88d80aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36824/0 (socket says 172.21.15.84:36824) 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.324+0000 7f88dd78c700 1 -- 172.21.15.84:0/1532998387 learned_addr learned my addr 172.21.15.84:0/1532998387 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88de78e700 1 --2- 172.21.15.84:0/1532998387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b07a0 0x7f88d80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88dd78c700 1 -- 172.21.15.84:0/1532998387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b07a0 msgr2=0x7f88d80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88dd78c700 1 --2- 172.21.15.84:0/1532998387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b07a0 0x7f88d80b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88dd78c700 1 -- 172.21.15.84:0/1532998387 >> v1:172.21.15.131:6789/0 conn(0x7f88d81595a0 legacy=0x7f88d80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88dd78c700 1 -- 172.21.15.84:0/1532998387 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d80b1540 con 0x7f88d80b49e0 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88de78e700 1 --2- 172.21.15.84:0/1532998387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b07a0 0x7f88d80b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88dd78c700 1 --2- 172.21.15.84:0/1532998387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d80b49e0 0x7f88d80aac80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f88c80099e0 tx=0x7f88c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf8b59564d3d356 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:39.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88dcf8b700 1 -- 172.21.15.84:0/1532998387 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c800b7e0 con 0x7f88d80b49e0 2023-10-06T02:58:39.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88dcf8b700 1 -- 172.21.15.84:0/1532998387 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c800b940 con 0x7f88d80b49e0 2023-10-06T02:58:39.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88dcf8b700 1 -- 172.21.15.84:0/1532998387 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c800bce0 con 0x7f88d80b49e0 2023-10-06T02:58:39.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88e01f1700 1 -- 172.21.15.84:0/1532998387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d80b49e0 msgr2=0x7f88d80aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88e01f1700 1 --2- 172.21.15.84:0/1532998387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d80b49e0 0x7f88d80aac80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f88c80099e0 tx=0x7f88c8009250 comp rx=0 tx=0).stop 2023-10-06T02:58:39.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88e01f1700 1 -- 172.21.15.84:0/1532998387 shutdown_connections 2023-10-06T02:58:39.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88e01f1700 1 --2- 172.21.15.84:0/1532998387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b07a0 0x7f88d80b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88e01f1700 1 --2- 172.21.15.84:0/1532998387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d80b49e0 0x7f88d80aac80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88e01f1700 1 -- 172.21.15.84:0/1532998387 >> 172.21.15.84:0/1532998387 conn(0x7f88d8099830 msgr2=0x7f88d806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:39.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.325+0000 7f88e01f1700 1 -- 172.21.15.84:0/1532998387 shutdown_connections 2023-10-06T02:58:39.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.326+0000 7f88e01f1700 1 -- 172.21.15.84:0/1532998387 wait complete. 2023-10-06T02:58:39.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88e01f1700 1 Processor -- start 2023-10-06T02:58:39.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88e01f1700 1 -- start start 2023-10-06T02:58:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88e01f1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88d80b07a0 0x7f88d8157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88e01f1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b49e0 0x7f88d815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88e01f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d81595a0 0x7f88d815c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88e01f1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80aad00 con 0x7f88d81595a0 2023-10-06T02:58:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88e01f1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80acfe0 con 0x7f88d80b07a0 2023-10-06T02:58:39.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88e01f1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80ad2c0 con 0x7f88d80b49e0 2023-10-06T02:58:39.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88de78e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d81595a0 0x7f88d815c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88de78e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d81595a0 0x7f88d815c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36836/0 (socket says 172.21.15.84:36836) 2023-10-06T02:58:39.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88de78e700 1 -- 172.21.15.84:0/2149630623 learned_addr learned my addr 172.21.15.84:0/2149630623 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:39.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88ddf8d700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88d80b07a0 0x7f88d8157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.327+0000 7f88dd78c700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b49e0 0x7f88d815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88de78e700 1 -- 172.21.15.84:0/2149630623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b49e0 msgr2=0x7f88d815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88de78e700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b49e0 0x7f88d815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88de78e700 1 -- 172.21.15.84:0/2149630623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88d80b07a0 msgr2=0x7f88d8157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88de78e700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88d80b07a0 0x7f88d8157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88de78e700 1 -- 172.21.15.84:0/2149630623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80094f0 con 0x7f88d81595a0 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88dd78c700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b49e0 0x7f88d815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88de78e700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d81595a0 0x7f88d815c000 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f88d000a380 tx=0x7f88d00078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88cdffb700 1 -- 172.21.15.84:0/2149630623 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0015440 con 0x7f88d81595a0 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88cdffb700 1 -- 172.21.15.84:0/2149630623 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d00155a0 con 0x7f88d81595a0 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88cdffb700 1 -- 172.21.15.84:0/2149630623 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0015960 con 0x7f88d81595a0 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d809d580 con 0x7f88d81595a0 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.328+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d809db40 con 0x7f88d81595a0 2023-10-06T02:58:39.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.329+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d8064ad0 con 0x7f88d81595a0 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.329+0000 7f88cdffb700 1 -- 172.21.15.84:0/2149630623 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88d0015d50 con 0x7f88d81595a0 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.330+0000 7f88cdffb700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f88bc066f30 0x7f88bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.330+0000 7f88cdffb700 1 -- 172.21.15.84:0/2149630623 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f88d00850b0 con 0x7f88d81595a0 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.330+0000 7f88ddf8d700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f88bc066f30 0x7f88bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.330+0000 7f88ddf8d700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f88bc066f30 0x7f88bc0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88d4006fd0 tx=0x7f88d4009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:39.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.334+0000 7f88cdffb700 1 -- 172.21.15.84:0/2149630623 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88d0052080 con 0x7f88d81595a0 2023-10-06T02:58:39.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.514+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88d80ad400 con 0x7f88bc066f30 2023-10-06T02:58:39.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.522+0000 7f88cdffb700 1 -- 172.21.15.84:0/2149630623 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308570 (secure 0 0 0) 0x7f88d80ad400 con 0x7f88bc066f30 2023-10-06T02:58:39.527 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f88bc066f30 msgr2=0x7f88bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f88bc066f30 0x7f88bc0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88d4006fd0 tx=0x7f88d4009060 comp rx=0 tx=0).stop 2023-10-06T02:58:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d81595a0 msgr2=0x7f88d815c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d81595a0 0x7f88d815c000 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f88d000a380 tx=0x7f88d00078d0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 shutdown_connections 2023-10-06T02:58:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f88bc066f30 0x7f88bc0693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88d80b07a0 0x7f88d8157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d81595a0 0x7f88d815c000 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 --2- 172.21.15.84:0/2149630623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88d80b49e0 0x7f88d815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 >> 172.21.15.84:0/2149630623 conn(0x7f88d8099830 msgr2=0x7f88d815cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 shutdown_connections 2023-10-06T02:58:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.526+0000 7f88e01f1700 1 -- 172.21.15.84:0/2149630623 wait complete. 2023-10-06T02:58:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:58:39.539 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2023-10-06T02:58:37.847669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385608,"kb_used_data":7304,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589112,"statfs":{"total":773094113280,"available":770651250688,"internally_reserved":0,"allocated":7479296,"data_stored":4113911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.133178"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.730955+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:49.111285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.722955+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:12.873779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727501+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:16.482180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.739638+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:12.873779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727760+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:23.315217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727084+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:07.239624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.729341+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:30.446996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725462+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:53.600520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727629+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:00.633403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725795+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.623378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.735539+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:25.003429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.738765+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:08.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723535+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.730172+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:14.824360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723441+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724238+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728497+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:51.571318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.737594+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:46.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725065+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723098+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723796+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725585+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:32.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.735699+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:44.834919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.730615+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:27.700059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724994+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.729433+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:11.365588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725816+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:48.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723634+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.726171+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:00.743751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.726660+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:07.588359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728371+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:28.270552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724727+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:10.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.734167+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:30.446996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.745475+0000","last_change":"2023-10-06T02:58:33.745475+0000","last_active":"2023-10-06T02:58:33.745475+0000","last_peered":"2023-10-06T02:58:33.745475+0000","last_clean":"2023-10-06T02:58:33.745475+0000","last_became_active":"2023-10-06T02:58:33.745233+0000","last_became_peered":"2023-10-06T02:58:33.745233+0000","last_unstale":"2023-10-06T02:58:33.745475+0000","last_undegraded":"2023-10-06T02:58:33.745475+0000","last_fullsized":"2023-10-06T02:58:33.745475+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728052+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:26.923964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.732849+0000","last_change":"2023-10-06T02:58:33.732849+0000","last_active":"2023-10-06T02:58:33.732849+0000","last_peered":"2023-10-06T02:58:33.732849+0000","last_clean":"2023-10-06T02:58:33.732849+0000","last_became_active":"2023-10-06T02:58:33.732239+0000","last_became_peered":"2023-10-06T02:58:33.732239+0000","last_unstale":"2023-10-06T02:58:33.732849+0000","last_undegraded":"2023-10-06T02:58:33.732849+0000","last_fullsized":"2023-10-06T02:58:33.732849+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725173+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:30:02.311802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.733506+0000","last_change":"2023-10-06T02:58:33.733506+0000","last_active":"2023-10-06T02:58:33.733506+0000","last_peered":"2023-10-06T02:58:33.733506+0000","last_clean":"2023-10-06T02:58:33.733506+0000","last_became_active":"2023-10-06T02:58:33.733249+0000","last_became_peered":"2023-10-06T02:58:33.733249+0000","last_unstale":"2023-10-06T02:58:33.733506+0000","last_undegraded":"2023-10-06T02:58:33.733506+0000","last_fullsized":"2023-10-06T02:58:33.733506+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.734672+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:16.237630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.743169+0000","last_change":"2023-10-06T02:58:33.743169+0000","last_active":"2023-10-06T02:58:33.743169+0000","last_peered":"2023-10-06T02:58:33.743169+0000","last_clean":"2023-10-06T02:58:33.743169+0000","last_became_active":"2023-10-06T02:58:33.742892+0000","last_became_peered":"2023-10-06T02:58:33.742892+0000","last_unstale":"2023-10-06T02:58:33.743169+0000","last_undegraded":"2023-10-06T02:58:33.743169+0000","last_fullsized":"2023-10-06T02:58:33.743169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:07.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728789+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:02.013607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734217+0000","last_change":"2023-10-06T02:58:33.734217+0000","last_active":"2023-10-06T02:58:33.734217+0000","last_peered":"2023-10-06T02:58:33.734217+0000","last_clean":"2023-10-06T02:58:33.734217+0000","last_became_active":"2023-10-06T02:58:33.733894+0000","last_became_peered":"2023-10-06T02:58:33.733894+0000","last_unstale":"2023-10-06T02:58:33.734217+0000","last_undegraded":"2023-10-06T02:58:33.734217+0000","last_fullsized":"2023-10-06T02:58:33.734217+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:31.585062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723295+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:44.834919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.736095+0000","last_change":"2023-10-06T02:58:33.736095+0000","last_active":"2023-10-06T02:58:33.736095+0000","last_peered":"2023-10-06T02:58:33.736095+0000","last_clean":"2023-10-06T02:58:33.736095+0000","last_became_active":"2023-10-06T02:58:33.735839+0000","last_became_peered":"2023-10-06T02:58:33.735839+0000","last_unstale":"2023-10-06T02:58:33.736095+0000","last_undegraded":"2023-10-06T02:58:33.736095+0000","last_fullsized":"2023-10-06T02:58:33.736095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727106+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:06.140937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742149+0000","last_change":"2023-10-06T02:58:33.742149+0000","last_active":"2023-10-06T02:58:33.742149+0000","last_peered":"2023-10-06T02:58:33.742149+0000","last_clean":"2023-10-06T02:58:33.742149+0000","last_became_active":"2023-10-06T02:58:33.741911+0000","last_became_peered":"2023-10-06T02:58:33.741911+0000","last_unstale":"2023-10-06T02:58:33.742149+0000","last_undegraded":"2023-10-06T02:58:33.742149+0000","last_fullsized":"2023-10-06T02:58:33.742149+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.722984+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:44.834919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.743119+0000","last_change":"2023-10-06T02:58:33.743119+0000","last_active":"2023-10-06T02:58:33.743119+0000","last_peered":"2023-10-06T02:58:33.743119+0000","last_clean":"2023-10-06T02:58:33.743119+0000","last_became_active":"2023-10-06T02:58:33.742849+0000","last_became_peered":"2023-10-06T02:58:33.742849+0000","last_unstale":"2023-10-06T02:58:33.743119+0000","last_undegraded":"2023-10-06T02:58:33.743119+0000","last_fullsized":"2023-10-06T02:58:33.743119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:10.552745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.728506+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:34.860551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734599+0000","last_change":"2023-10-06T02:58:33.734599+0000","last_active":"2023-10-06T02:58:33.734599+0000","last_peered":"2023-10-06T02:58:33.734599+0000","last_clean":"2023-10-06T02:58:33.734599+0000","last_became_active":"2023-10-06T02:58:33.734161+0000","last_became_peered":"2023-10-06T02:58:33.734161+0000","last_unstale":"2023-10-06T02:58:33.734599+0000","last_undegraded":"2023-10-06T02:58:33.734599+0000","last_fullsized":"2023-10-06T02:58:33.734599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:10.358630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.731880+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:28.270552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.733304+0000","last_change":"2023-10-06T02:58:33.733304+0000","last_active":"2023-10-06T02:58:33.733304+0000","last_peered":"2023-10-06T02:58:33.733304+0000","last_clean":"2023-10-06T02:58:33.733304+0000","last_became_active":"2023-10-06T02:58:33.733025+0000","last_became_peered":"2023-10-06T02:58:33.733025+0000","last_unstale":"2023-10-06T02:58:33.733304+0000","last_undegraded":"2023-10-06T02:58:33.733304+0000","last_fullsized":"2023-10-06T02:58:33.733304+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724464+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:21.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734221+0000","last_change":"2023-10-06T02:58:33.734221+0000","last_active":"2023-10-06T02:58:33.734221+0000","last_peered":"2023-10-06T02:58:33.734221+0000","last_clean":"2023-10-06T02:58:33.734221+0000","last_became_active":"2023-10-06T02:58:33.733961+0000","last_became_peered":"2023-10-06T02:58:33.733961+0000","last_unstale":"2023-10-06T02:58:33.734221+0000","last_undegraded":"2023-10-06T02:58:33.734221+0000","last_fullsized":"2023-10-06T02:58:33.734221+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:02.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727579+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:10.190304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742820+0000","last_change":"2023-10-06T02:58:33.742820+0000","last_active":"2023-10-06T02:58:33.742820+0000","last_peered":"2023-10-06T02:58:33.742820+0000","last_clean":"2023-10-06T02:58:33.742820+0000","last_became_active":"2023-10-06T02:58:33.742572+0000","last_became_peered":"2023-10-06T02:58:33.742572+0000","last_unstale":"2023-10-06T02:58:33.742820+0000","last_undegraded":"2023-10-06T02:58:33.742820+0000","last_fullsized":"2023-10-06T02:58:33.742820+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.735960+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:34.860551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742960+0000","last_change":"2023-10-06T02:58:33.742960+0000","last_active":"2023-10-06T02:58:33.742960+0000","last_peered":"2023-10-06T02:58:33.742960+0000","last_clean":"2023-10-06T02:58:33.742960+0000","last_became_active":"2023-10-06T02:58:33.742690+0000","last_became_peered":"2023-10-06T02:58:33.742690+0000","last_unstale":"2023-10-06T02:58:33.742960+0000","last_undegraded":"2023-10-06T02:58:33.742960+0000","last_fullsized":"2023-10-06T02:58:33.742960+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727056+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:18.404602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734770+0000","last_change":"2023-10-06T02:58:33.734770+0000","last_active":"2023-10-06T02:58:33.734770+0000","last_peered":"2023-10-06T02:58:33.734770+0000","last_clean":"2023-10-06T02:58:33.734770+0000","last_became_active":"2023-10-06T02:58:33.734351+0000","last_became_peered":"2023-10-06T02:58:33.734351+0000","last_unstale":"2023-10-06T02:58:33.734770+0000","last_undegraded":"2023-10-06T02:58:33.734770+0000","last_fullsized":"2023-10-06T02:58:33.734770+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:59.626445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.722715+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:25.003429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.736152+0000","last_change":"2023-10-06T02:58:33.736152+0000","last_active":"2023-10-06T02:58:33.736152+0000","last_peered":"2023-10-06T02:58:33.736152+0000","last_clean":"2023-10-06T02:58:33.736152+0000","last_became_active":"2023-10-06T02:58:33.735725+0000","last_became_peered":"2023-10-06T02:58:33.735725+0000","last_unstale":"2023-10-06T02:58:33.736152+0000","last_undegraded":"2023-10-06T02:58:33.736152+0000","last_fullsized":"2023-10-06T02:58:33.736152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.949148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.726081+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:28.303150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.734055+0000","last_change":"2023-10-06T02:58:33.734055+0000","last_active":"2023-10-06T02:58:33.734055+0000","last_peered":"2023-10-06T02:58:33.734055+0000","last_clean":"2023-10-06T02:58:33.734055+0000","last_became_active":"2023-10-06T02:58:33.733756+0000","last_became_peered":"2023-10-06T02:58:33.733756+0000","last_unstale":"2023-10-06T02:58:33.734055+0000","last_undegraded":"2023-10-06T02:58:33.734055+0000","last_fullsized":"2023-10-06T02:58:33.734055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:27.263593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724756+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735367+0000","last_change":"2023-10-06T02:58:33.735367+0000","last_active":"2023-10-06T02:58:33.735367+0000","last_peered":"2023-10-06T02:58:33.735367+0000","last_clean":"2023-10-06T02:58:33.735367+0000","last_became_active":"2023-10-06T02:58:33.734942+0000","last_became_peered":"2023-10-06T02:58:33.734942+0000","last_unstale":"2023-10-06T02:58:33.735367+0000","last_undegraded":"2023-10-06T02:58:33.735367+0000","last_fullsized":"2023-10-06T02:58:33.735367+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727062+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:49.111285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.736226+0000","last_change":"2023-10-06T02:58:33.736226+0000","last_active":"2023-10-06T02:58:33.736226+0000","last_peered":"2023-10-06T02:58:33.736226+0000","last_clean":"2023-10-06T02:58:33.736226+0000","last_became_active":"2023-10-06T02:58:33.735569+0000","last_became_peered":"2023-10-06T02:58:33.735569+0000","last_unstale":"2023-10-06T02:58:33.736226+0000","last_undegraded":"2023-10-06T02:58:33.736226+0000","last_fullsized":"2023-10-06T02:58:33.736226+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.729882+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:13.853088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735368+0000","last_change":"2023-10-06T02:58:33.735368+0000","last_active":"2023-10-06T02:58:33.735368+0000","last_peered":"2023-10-06T02:58:33.735368+0000","last_clean":"2023-10-06T02:58:33.735368+0000","last_became_active":"2023-10-06T02:58:33.735110+0000","last_became_peered":"2023-10-06T02:58:33.735110+0000","last_unstale":"2023-10-06T02:58:33.735368+0000","last_undegraded":"2023-10-06T02:58:33.735368+0000","last_fullsized":"2023-10-06T02:58:33.735368+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:24.789985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.735097+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:11.365588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.727028+0000","last_change":"2023-10-06T02:58:33.727028+0000","last_active":"2023-10-06T02:58:33.727028+0000","last_peered":"2023-10-06T02:58:33.727028+0000","last_clean":"2023-10-06T02:58:33.727028+0000","last_became_active":"2023-10-06T02:58:33.726742+0000","last_became_peered":"2023-10-06T02:58:33.726742+0000","last_unstale":"2023-10-06T02:58:33.727028+0000","last_undegraded":"2023-10-06T02:58:33.727028+0000","last_fullsized":"2023-10-06T02:58:33.727028+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.729802+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:30.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.733340+0000","last_change":"2023-10-06T02:58:33.733340+0000","last_active":"2023-10-06T02:58:33.733340+0000","last_peered":"2023-10-06T02:58:33.733340+0000","last_clean":"2023-10-06T02:58:33.733340+0000","last_became_active":"2023-10-06T02:58:33.733080+0000","last_became_peered":"2023-10-06T02:58:33.733080+0000","last_unstale":"2023-10-06T02:58:33.733340+0000","last_undegraded":"2023-10-06T02:58:33.733340+0000","last_fullsized":"2023-10-06T02:58:33.733340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:32.544670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.724326+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:02.147902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742848+0000","last_change":"2023-10-06T02:58:33.742848+0000","last_active":"2023-10-06T02:58:33.742848+0000","last_peered":"2023-10-06T02:58:33.742848+0000","last_clean":"2023-10-06T02:58:33.742848+0000","last_became_active":"2023-10-06T02:58:33.742585+0000","last_became_peered":"2023-10-06T02:58:33.742585+0000","last_unstale":"2023-10-06T02:58:33.742848+0000","last_undegraded":"2023-10-06T02:58:33.742848+0000","last_fullsized":"2023-10-06T02:58:33.742848+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.740282+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:02.147902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.740591+0000","last_change":"2023-10-06T02:58:33.740591+0000","last_active":"2023-10-06T02:58:33.740591+0000","last_peered":"2023-10-06T02:58:33.740591+0000","last_clean":"2023-10-06T02:58:33.740591+0000","last_became_active":"2023-10-06T02:58:33.740329+0000","last_became_peered":"2023-10-06T02:58:33.740329+0000","last_unstale":"2023-10-06T02:58:33.740591+0000","last_undegraded":"2023-10-06T02:58:33.740591+0000","last_fullsized":"2023-10-06T02:58:33.740591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.723132+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:50.170481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.745606+0000","last_change":"2023-10-06T02:58:33.745606+0000","last_active":"2023-10-06T02:58:33.745606+0000","last_peered":"2023-10-06T02:58:33.745606+0000","last_clean":"2023-10-06T02:58:33.745606+0000","last_became_active":"2023-10-06T02:58:33.745246+0000","last_became_peered":"2023-10-06T02:58:33.745246+0000","last_unstale":"2023-10-06T02:58:33.745606+0000","last_undegraded":"2023-10-06T02:58:33.745606+0000","last_fullsized":"2023-10-06T02:58:33.745606+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:45.339807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.727133+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:35.025250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.742273+0000","last_change":"2023-10-06T02:58:33.742273+0000","last_active":"2023-10-06T02:58:33.742273+0000","last_peered":"2023-10-06T02:58:33.742273+0000","last_clean":"2023-10-06T02:58:33.742273+0000","last_became_active":"2023-10-06T02:58:33.741934+0000","last_became_peered":"2023-10-06T02:58:33.741934+0000","last_unstale":"2023-10-06T02:58:33.742273+0000","last_undegraded":"2023-10-06T02:58:33.742273+0000","last_fullsized":"2023-10-06T02:58:33.742273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:15.613100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.728733+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:58:32.728733+0000","last_peered":"2023-10-06T02:58:32.728733+0000","last_clean":"2023-10-06T02:58:32.728733+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:58:32.728733+0000","last_undegraded":"2023-10-06T02:58:32.728733+0000","last_fullsized":"2023-10-06T02:58:32.728733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725483+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:13.097392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.732697+0000","last_change":"2023-10-06T02:58:33.732697+0000","last_active":"2023-10-06T02:58:33.732697+0000","last_peered":"2023-10-06T02:58:33.732697+0000","last_clean":"2023-10-06T02:58:33.732697+0000","last_became_active":"2023-10-06T02:58:33.732421+0000","last_became_peered":"2023-10-06T02:58:33.732421+0000","last_unstale":"2023-10-06T02:58:33.732697+0000","last_undegraded":"2023-10-06T02:58:33.732697+0000","last_fullsized":"2023-10-06T02:58:33.732697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.722191+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:58:32.722191+0000","last_peered":"2023-10-06T02:58:32.722191+0000","last_clean":"2023-10-06T02:58:32.722191+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:58:32.722191+0000","last_undegraded":"2023-10-06T02:58:32.722191+0000","last_fullsized":"2023-10-06T02:58:32.722191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725512+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:55.617522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735296+0000","last_change":"2023-10-06T02:58:33.735296+0000","last_active":"2023-10-06T02:58:33.735296+0000","last_peered":"2023-10-06T02:58:33.735296+0000","last_clean":"2023-10-06T02:58:33.735296+0000","last_became_active":"2023-10-06T02:58:33.735041+0000","last_became_peered":"2023-10-06T02:58:33.735041+0000","last_unstale":"2023-10-06T02:58:33.735296+0000","last_undegraded":"2023-10-06T02:58:33.735296+0000","last_fullsized":"2023-10-06T02:58:33.735296+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:12.846129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.719286+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:58:32.719286+0000","last_peered":"2023-10-06T02:58:32.719286+0000","last_clean":"2023-10-06T02:58:32.719286+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:58:32.719286+0000","last_undegraded":"2023-10-06T02:58:32.719286+0000","last_fullsized":"2023-10-06T02:58:32.719286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725453+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:41.077463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.743225+0000","last_change":"2023-10-06T02:58:33.743225+0000","last_active":"2023-10-06T02:58:33.743225+0000","last_peered":"2023-10-06T02:58:33.743225+0000","last_clean":"2023-10-06T02:58:33.743225+0000","last_became_active":"2023-10-06T02:58:33.742937+0000","last_became_peered":"2023-10-06T02:58:33.742937+0000","last_unstale":"2023-10-06T02:58:33.743225+0000","last_undegraded":"2023-10-06T02:58:33.743225+0000","last_fullsized":"2023-10-06T02:58:33.743225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:13.817402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.721545+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:58:32.721545+0000","last_peered":"2023-10-06T02:58:32.721545+0000","last_clean":"2023-10-06T02:58:32.721545+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:58:32.721545+0000","last_undegraded":"2023-10-06T02:58:32.721545+0000","last_fullsized":"2023-10-06T02:58:32.721545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":202,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.724318+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:58:32.724318+0000","last_peered":"2023-10-06T02:58:32.724318+0000","last_clean":"2023-10-06T02:58:32.724318+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:58:32.724318+0000","last_undegraded":"2023-10-06T02:58:32.724318+0000","last_fullsized":"2023-10-06T02:58:32.724318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725039+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.732458+0000","last_change":"2023-10-06T02:58:33.732458+0000","last_active":"2023-10-06T02:58:33.732458+0000","last_peered":"2023-10-06T02:58:33.732458+0000","last_clean":"2023-10-06T02:58:33.732458+0000","last_became_active":"2023-10-06T02:58:33.732203+0000","last_became_peered":"2023-10-06T02:58:33.732203+0000","last_unstale":"2023-10-06T02:58:33.732458+0000","last_undegraded":"2023-10-06T02:58:33.732458+0000","last_fullsized":"2023-10-06T02:58:33.732458+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.724347+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:58:32.724347+0000","last_peered":"2023-10-06T02:58:32.724347+0000","last_clean":"2023-10-06T02:58:32.724347+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:58:32.724347+0000","last_undegraded":"2023-10-06T02:58:32.724347+0000","last_fullsized":"2023-10-06T02:58:32.724347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.739200+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.419076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735525+0000","last_change":"2023-10-06T02:58:33.735525+0000","last_active":"2023-10-06T02:58:33.735525+0000","last_peered":"2023-10-06T02:58:33.735525+0000","last_clean":"2023-10-06T02:58:33.735525+0000","last_became_active":"2023-10-06T02:58:33.735068+0000","last_became_peered":"2023-10-06T02:58:33.735068+0000","last_unstale":"2023-10-06T02:58:33.735525+0000","last_undegraded":"2023-10-06T02:58:33.735525+0000","last_fullsized":"2023-10-06T02:58:33.735525+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:27.296192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.724311+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:58:32.724311+0000","last_peered":"2023-10-06T02:58:32.724311+0000","last_clean":"2023-10-06T02:58:32.724311+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:58:32.724311+0000","last_undegraded":"2023-10-06T02:58:32.724311+0000","last_fullsized":"2023-10-06T02:58:32.724311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.731415+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:18.404602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.736569+0000","last_change":"2023-10-06T02:58:33.736569+0000","last_active":"2023-10-06T02:58:33.736569+0000","last_peered":"2023-10-06T02:58:33.736569+0000","last_clean":"2023-10-06T02:58:33.736569+0000","last_became_active":"2023-10-06T02:58:33.736326+0000","last_became_peered":"2023-10-06T02:58:33.736326+0000","last_unstale":"2023-10-06T02:58:33.736569+0000","last_undegraded":"2023-10-06T02:58:33.736569+0000","last_fullsized":"2023-10-06T02:58:33.736569+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.728768+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:58:32.728768+0000","last_peered":"2023-10-06T02:58:32.728768+0000","last_clean":"2023-10-06T02:58:32.728768+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:58:32.728768+0000","last_undegraded":"2023-10-06T02:58:32.728768+0000","last_fullsized":"2023-10-06T02:58:32.728768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T02:58:33.714513+0000","last_change":"2023-10-06T02:58:33.725274+0000","last_active":"2023-10-06T02:58:33.714513+0000","last_peered":"2023-10-06T02:58:33.714513+0000","last_clean":"2023-10-06T02:58:33.714513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T02:58:33.714513+0000","last_undegraded":"2023-10-06T02:58:33.714513+0000","last_fullsized":"2023-10-06T02:58:33.714513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-06T02:58:33.735199+0000","last_change":"2023-10-06T02:58:33.735199+0000","last_active":"2023-10-06T02:58:33.735199+0000","last_peered":"2023-10-06T02:58:33.735199+0000","last_clean":"2023-10-06T02:58:33.735199+0000","last_became_active":"2023-10-06T02:58:33.734599+0000","last_became_peered":"2023-10-06T02:58:33.734599+0000","last_unstale":"2023-10-06T02:58:33.735199+0000","last_undegraded":"2023-10-06T02:58:33.735199+0000","last_fullsized":"2023-10-06T02:58:33.735199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:05.133979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-06T02:58:32.725625+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:58:32.725625+0000","last_peered":"2023-10-06T02:58:32.725625+0000","last_clean":"2023-10-06T02:58:32.725625+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:58:32.725625+0000","last_undegraded":"2023-10-06T02:58:32.725625+0000","last_fullsized":"2023-10-06T02:58:32.725625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":956527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.754},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.502},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66400000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58899999999999997,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81599999999999995,"5min":3.415,"15min":3.415},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":1.546,"15min":1.546},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.31}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.74,"15min":1.74},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.67900000000000005,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69299999999999995,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":3.577,"15min":3.577},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.51100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.73699999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.432}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80300000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.496},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.502}]},{"osd":7,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":365148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.377,"15min":0.40100000000000002},"min":{"1min":0.23000000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.45300000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.41699999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.99099999999999999,"15min":1.2769999999999999},"min":{"1min":0.255,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44500000000000001,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.495},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.433,"15min":0.443},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":1.181,"15min":1.181},"last":0.60299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.42699999999999999,"15min":0.443},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48099999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.626,"15min":0.626},"last":0.47999999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70299999999999996,"5min":1.02,"15min":1.02},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":1.228,"15min":1.5},"min":{"1min":0.42299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79700000000000004,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.54000000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.2130000000000001,"15min":1.4830000000000001},"min":{"1min":0.46800000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73399999999999999,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81000000000000005,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.48399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.242,"15min":1.52},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82499999999999996,"5min":21.166,"15min":21.166},"last":0.624}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78600000000000003,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84199999999999997,"5min":0.997,"15min":0.997},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298632,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073208,"statfs":{"total":96636764160,"available":96330964992,"internally_reserved":0,"allocated":1376256,"data_stored":955516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.505},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.33200000000000002,"15min":0.32800000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.373,"15min":0.372},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26500000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40000000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.875,"5min":0.879,"15min":0.879},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.746}]},{"osd":7,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.315,"15min":0.307},"min":{"1min":0.23200000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32000000000000001},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.51200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.26400000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.58399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53700000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.307}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.32900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.33200000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.38700000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40999999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.872,"5min":1.077,"15min":1.077},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.434},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79600000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":365148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.45500000000000002},"min":{"1min":0.249,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.60899999999999999,"5min":2.569,"15min":2.569},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42899999999999999,"15min":0.45400000000000001},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.47399999999999998,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41699999999999998,"15min":0.442},"min":{"1min":0.22600000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.51200000000000001,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.44800000000000001,"15min":0.47999999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56999999999999995,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47199999999999998,"15min":0.498},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54400000000000004,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.65000000000000002,"15min":0.68000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.66200000000000003,"15min":0.69399999999999995},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80000000000000004,"5min":2.532,"15min":2.532},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.625},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.753}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.71799999999999997,"5min":2.496,"15min":2.496},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84799999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":373095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.91500000000000004,"15min":1.0409999999999999},"min":{"1min":0.46300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.871,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64200000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69399999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.62},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":366159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.504,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":1.167,"15min":1.167},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.57399999999999995},"min":{"1min":0.38700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.625,"5min":1.117,"15min":1.117},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.504}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68500000000000005,"5min":1.2,"15min":1.2},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":1.135,"15min":1.135},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67100000000000004,"5min":1.208,"15min":1.208},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66400000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.62},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73199999999999998,"5min":0.87,"15min":0.87},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56100000000000005,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":1.054,"15min":1.054},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.56999999999999995,"15min":0.58899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71899999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76000000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78200000000000003,"5min":1.008,"15min":1.008},"last":0.41399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:58:39.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:39.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.692+0000 7f690cecc700 1 Processor -- start 2023-10-06T02:58:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.692+0000 7f690cecc700 1 -- start start 2023-10-06T02:58:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f690cecc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f69081595a0 0x7f69080aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f690cecc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69080b49e0 0x7f69080aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f690cecc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69080b0ca0 con 0x7f69080b07a0 2023-10-06T02:58:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f690cecc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69080b0f80 con 0x7f69081595a0 2023-10-06T02:58:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f690cecc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69080b1260 con 0x7f69080b49e0 2023-10-06T02:58:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f690659c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f69081595a0 0x7f69080aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f6905d9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69080b49e0 0x7f69080aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f6906d9d700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f69080b07a0 0x7f69080b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:47600/0 (socket says 172.21.15.84:47600) 2023-10-06T02:58:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f6906d9d700 1 -- 172.21.15.84:0/1801175715 learned_addr learned my addr 172.21.15.84:0/1801175715 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f6905d9b700 1 --2- 172.21.15.84:0/1801175715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69080b49e0 0x7f69080aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:50056/0 (socket says 172.21.15.84:50056) 2023-10-06T02:58:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f6905d9b700 1 -- 172.21.15.84:0/1801175715 >> v2:172.21.15.131:3300/0 conn(0x7f69081595a0 msgr2=0x7f69080aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f6905d9b700 1 --2- 172.21.15.84:0/1801175715 >> v2:172.21.15.131:3300/0 conn(0x7f69081595a0 0x7f69080aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f6905d9b700 1 -- 172.21.15.84:0/1801175715 >> v1:172.21.15.131:6789/0 conn(0x7f69080b07a0 legacy=0x7f69080b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f690559a700 1 -- 172.21.15.84:0/1801175715 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033005300 0 0) 0x7f69080b0ca0 con 0x7f69080b07a0 2023-10-06T02:58:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f6905d9b700 1 -- 172.21.15.84:0/1801175715 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69080b1540 con 0x7f69080b49e0 2023-10-06T02:58:39.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.693+0000 7f690659c700 1 --2- 172.21.15.84:0/1801175715 >> v2:172.21.15.131:3300/0 conn(0x7f69081595a0 0x7f69080aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:39.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f6905d9b700 1 --2- 172.21.15.84:0/1801175715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69080b49e0 0x7f69080aaab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68f00098e0 tx=0x7f68f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b88b3896964a6bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:39.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690559a700 1 -- 172.21.15.84:0/1801175715 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000b640 con 0x7f69080b49e0 2023-10-06T02:58:39.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690559a700 1 -- 172.21.15.84:0/1801175715 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f000b7a0 con 0x7f69080b49e0 2023-10-06T02:58:39.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690559a700 1 -- 172.21.15.84:0/1801175715 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000bb40 con 0x7f69080b49e0 2023-10-06T02:58:39.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690cecc700 1 -- 172.21.15.84:0/1801175715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69080b49e0 msgr2=0x7f69080aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690cecc700 1 --2- 172.21.15.84:0/1801175715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69080b49e0 0x7f69080aaab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68f00098e0 tx=0x7f68f00091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690cecc700 1 -- 172.21.15.84:0/1801175715 shutdown_connections 2023-10-06T02:58:39.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690cecc700 1 --2- 172.21.15.84:0/1801175715 >> v2:172.21.15.131:3300/0 conn(0x7f69081595a0 0x7f69080aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690cecc700 1 --2- 172.21.15.84:0/1801175715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69080b49e0 0x7f69080aaab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690cecc700 1 -- 172.21.15.84:0/1801175715 >> 172.21.15.84:0/1801175715 conn(0x7f6908099830 msgr2=0x7f690806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:39.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690cecc700 1 -- 172.21.15.84:0/1801175715 shutdown_connections 2023-10-06T02:58:39.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.694+0000 7f690cecc700 1 -- 172.21.15.84:0/1801175715 wait complete. 2023-10-06T02:58:39.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.695+0000 7f690cecc700 1 Processor -- start 2023-10-06T02:58:39.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.695+0000 7f690cecc700 1 -- start start 2023-10-06T02:58:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f690cecc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69080b07a0 0x7f69080af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f690cecc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69080b49e0 0x7f690815b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f690cecc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69081595a0 0x7f690815e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f690cecc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69080af5f0 con 0x7f69080b49e0 2023-10-06T02:58:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f690cecc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690815c810 con 0x7f69080b07a0 2023-10-06T02:58:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f690cecc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690815bc00 con 0x7f69081595a0 2023-10-06T02:58:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f6905d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69080b49e0 0x7f690815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f6905d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69080b49e0 0x7f690815b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36844/0 (socket says 172.21.15.84:36844) 2023-10-06T02:58:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f6905d9b700 1 -- 172.21.15.84:0/371959392 learned_addr learned my addr 172.21.15.84:0/371959392 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f690659c700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69080b07a0 0x7f69080af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.696+0000 7f6906d9d700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69081595a0 0x7f690815e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f6905d9b700 1 -- 172.21.15.84:0/371959392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69081595a0 msgr2=0x7f690815e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f6905d9b700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69081595a0 0x7f690815e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f6905d9b700 1 -- 172.21.15.84:0/371959392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69080b07a0 msgr2=0x7f69080af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f6905d9b700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69080b07a0 0x7f69080af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f6905d9b700 1 -- 172.21.15.84:0/371959392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6900009a20 con 0x7f69080b49e0 2023-10-06T02:58:39.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f6905d9b700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69080b49e0 0x7f690815b300 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009f80 tx=0x7f68f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:39.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f68fe7fc700 1 -- 172.21.15.84:0/371959392 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000b910 con 0x7f69080b49e0 2023-10-06T02:58:39.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f68fe7fc700 1 -- 172.21.15.84:0/371959392 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f000ba70 con 0x7f69080b49e0 2023-10-06T02:58:39.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f0009420 con 0x7f69080b49e0 2023-10-06T02:58:39.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f68fe7fc700 1 -- 172.21.15.84:0/371959392 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0024670 con 0x7f69080b49e0 2023-10-06T02:58:39.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.697+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690815c1c0 con 0x7f69080b49e0 2023-10-06T02:58:39.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.698+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690815c9c0 con 0x7f69080b49e0 2023-10-06T02:58:39.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.698+0000 7f68fe7fc700 1 -- 172.21.15.84:0/371959392 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68f0011420 con 0x7f69080b49e0 2023-10-06T02:58:39.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.699+0000 7f68fe7fc700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68e8066f30 0x7f68e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:39.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.699+0000 7f68fe7fc700 1 -- 172.21.15.84:0/371959392 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f68f00862e0 con 0x7f69080b49e0 2023-10-06T02:58:39.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.699+0000 7f690659c700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68e8066f30 0x7f68e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:39.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.699+0000 7f690659c700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68e8066f30 0x7f68e80693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6908089cb0 tx=0x7f690000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:39.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.703+0000 7f68fe7fc700 1 -- 172.21.15.84:0/371959392 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f690815c9c0 con 0x7f69080b49e0 2023-10-06T02:58:39.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.882+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f690815c980 con 0x7f68e8066f30 2023-10-06T02:58:39.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.891+0000 7f68fe7fc700 1 -- 172.21.15.84:0/371959392 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311440 (secure 0 0 0) 0x7f690815c980 con 0x7f68e8066f30 2023-10-06T02:58:39.895 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68e8066f30 msgr2=0x7f68e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68e8066f30 0x7f68e80693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6908089cb0 tx=0x7f690000b040 comp rx=0 tx=0).stop 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69080b49e0 msgr2=0x7f690815b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69080b49e0 0x7f690815b300 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009f80 tx=0x7f68f0017000 comp rx=0 tx=0).stop 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 shutdown_connections 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f68e8066f30 0x7f68e80693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69080b07a0 0x7f69080af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69081595a0 0x7f690815e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 --2- 172.21.15.84:0/371959392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69080b49e0 0x7f690815b300 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:39.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 >> 172.21.15.84:0/371959392 conn(0x7f6908099830 msgr2=0x7f69080d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:39.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 shutdown_connections 2023-10-06T02:58:39.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:39.894+0000 7f690cecc700 1 -- 172.21.15.84:0/371959392 wait complete. 2023-10-06T02:58:39.899 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:58:39.907 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2023-10-06T02:58:39.847955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385948,"kb_used_data":7644,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588772,"statfs":{"total":773094113280,"available":770650902528,"internally_reserved":0,"allocated":7827456,"data_stored":4282251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.127832"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756678+0000","last_change":"2023-10-06T02:58:34.745441+0000","last_active":"2023-10-06T02:58:34.756678+0000","last_peered":"2023-10-06T02:58:34.756678+0000","last_clean":"2023-10-06T02:58:34.756678+0000","last_became_active":"2023-10-06T02:58:34.744423+0000","last_became_peered":"2023-10-06T02:58:34.744423+0000","last_unstale":"2023-10-06T02:58:34.756678+0000","last_undegraded":"2023-10-06T02:58:34.756678+0000","last_fullsized":"2023-10-06T02:58:34.756678+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753156+0000","last_change":"2023-10-06T02:58:34.746050+0000","last_active":"2023-10-06T02:58:34.753156+0000","last_peered":"2023-10-06T02:58:34.753156+0000","last_clean":"2023-10-06T02:58:34.753156+0000","last_became_active":"2023-10-06T02:58:34.745029+0000","last_became_peered":"2023-10-06T02:58:34.745029+0000","last_unstale":"2023-10-06T02:58:34.753156+0000","last_undegraded":"2023-10-06T02:58:34.753156+0000","last_fullsized":"2023-10-06T02:58:34.753156+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:17.269257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.745016+0000","last_change":"2023-10-06T02:58:34.739633+0000","last_active":"2023-10-06T02:58:34.745016+0000","last_peered":"2023-10-06T02:58:34.745016+0000","last_clean":"2023-10-06T02:58:34.745016+0000","last_became_active":"2023-10-06T02:58:34.739319+0000","last_became_peered":"2023-10-06T02:58:34.739319+0000","last_unstale":"2023-10-06T02:58:34.745016+0000","last_undegraded":"2023-10-06T02:58:34.745016+0000","last_fullsized":"2023-10-06T02:58:34.745016+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:11.966504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752755+0000","last_change":"2023-10-06T02:58:34.744903+0000","last_active":"2023-10-06T02:58:34.752755+0000","last_peered":"2023-10-06T02:58:34.752755+0000","last_clean":"2023-10-06T02:58:34.752755+0000","last_became_active":"2023-10-06T02:58:34.744608+0000","last_became_peered":"2023-10-06T02:58:34.744608+0000","last_unstale":"2023-10-06T02:58:34.752755+0000","last_undegraded":"2023-10-06T02:58:34.752755+0000","last_fullsized":"2023-10-06T02:58:34.752755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:21.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.739267+0000","last_change":"2023-10-06T02:58:34.738101+0000","last_active":"2023-10-06T02:58:34.739267+0000","last_peered":"2023-10-06T02:58:34.739267+0000","last_clean":"2023-10-06T02:58:34.739267+0000","last_became_active":"2023-10-06T02:58:34.737739+0000","last_became_peered":"2023-10-06T02:58:34.737739+0000","last_unstale":"2023-10-06T02:58:34.739267+0000","last_undegraded":"2023-10-06T02:58:34.739267+0000","last_fullsized":"2023-10-06T02:58:34.739267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:50.170481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753162+0000","last_change":"2023-10-06T02:58:34.745244+0000","last_active":"2023-10-06T02:58:34.753162+0000","last_peered":"2023-10-06T02:58:34.753162+0000","last_clean":"2023-10-06T02:58:34.753162+0000","last_became_active":"2023-10-06T02:58:34.744972+0000","last_became_peered":"2023-10-06T02:58:34.744972+0000","last_unstale":"2023-10-06T02:58:34.753162+0000","last_undegraded":"2023-10-06T02:58:34.753162+0000","last_fullsized":"2023-10-06T02:58:34.753162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:44.471161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749309+0000","last_change":"2023-10-06T02:58:34.740643+0000","last_active":"2023-10-06T02:58:34.749309+0000","last_peered":"2023-10-06T02:58:34.749309+0000","last_clean":"2023-10-06T02:58:34.749309+0000","last_became_active":"2023-10-06T02:58:34.740384+0000","last_became_peered":"2023-10-06T02:58:34.740384+0000","last_unstale":"2023-10-06T02:58:34.749309+0000","last_undegraded":"2023-10-06T02:58:34.749309+0000","last_fullsized":"2023-10-06T02:58:34.749309+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752924+0000","last_change":"2023-10-06T02:58:34.737215+0000","last_active":"2023-10-06T02:58:34.752924+0000","last_peered":"2023-10-06T02:58:34.752924+0000","last_clean":"2023-10-06T02:58:34.752924+0000","last_became_active":"2023-10-06T02:58:34.736946+0000","last_became_peered":"2023-10-06T02:58:34.736946+0000","last_unstale":"2023-10-06T02:58:34.752924+0000","last_undegraded":"2023-10-06T02:58:34.752924+0000","last_fullsized":"2023-10-06T02:58:34.752924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:16.904989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.738346+0000","last_change":"2023-10-06T02:58:34.733468+0000","last_active":"2023-10-06T02:58:34.738346+0000","last_peered":"2023-10-06T02:58:34.738346+0000","last_clean":"2023-10-06T02:58:34.738346+0000","last_became_active":"2023-10-06T02:58:34.733055+0000","last_became_peered":"2023-10-06T02:58:34.733055+0000","last_unstale":"2023-10-06T02:58:34.738346+0000","last_undegraded":"2023-10-06T02:58:34.738346+0000","last_fullsized":"2023-10-06T02:58:34.738346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:46.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.748273+0000","last_change":"2023-10-06T02:58:34.734981+0000","last_active":"2023-10-06T02:58:34.748273+0000","last_peered":"2023-10-06T02:58:34.748273+0000","last_clean":"2023-10-06T02:58:34.748273+0000","last_became_active":"2023-10-06T02:58:34.734605+0000","last_became_peered":"2023-10-06T02:58:34.734605+0000","last_unstale":"2023-10-06T02:58:34.748273+0000","last_undegraded":"2023-10-06T02:58:34.748273+0000","last_fullsized":"2023-10-06T02:58:34.748273+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:55.617522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756598+0000","last_change":"2023-10-06T02:58:34.750376+0000","last_active":"2023-10-06T02:58:34.756598+0000","last_peered":"2023-10-06T02:58:34.756598+0000","last_clean":"2023-10-06T02:58:34.756598+0000","last_became_active":"2023-10-06T02:58:34.745915+0000","last_became_peered":"2023-10-06T02:58:34.745915+0000","last_unstale":"2023-10-06T02:58:34.756598+0000","last_undegraded":"2023-10-06T02:58:34.756598+0000","last_fullsized":"2023-10-06T02:58:34.756598+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:57.887007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752706+0000","last_change":"2023-10-06T02:58:34.744552+0000","last_active":"2023-10-06T02:58:34.752706+0000","last_peered":"2023-10-06T02:58:34.752706+0000","last_clean":"2023-10-06T02:58:34.752706+0000","last_became_active":"2023-10-06T02:58:34.741740+0000","last_became_peered":"2023-10-06T02:58:34.741740+0000","last_unstale":"2023-10-06T02:58:34.752706+0000","last_undegraded":"2023-10-06T02:58:34.752706+0000","last_fullsized":"2023-10-06T02:58:34.752706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:50.170481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.743297+0000","last_change":"2023-10-06T02:58:34.738921+0000","last_active":"2023-10-06T02:58:34.743297+0000","last_peered":"2023-10-06T02:58:34.743297+0000","last_clean":"2023-10-06T02:58:34.743297+0000","last_became_active":"2023-10-06T02:58:34.738667+0000","last_became_peered":"2023-10-06T02:58:34.738667+0000","last_unstale":"2023-10-06T02:58:34.743297+0000","last_undegraded":"2023-10-06T02:58:34.743297+0000","last_fullsized":"2023-10-06T02:58:34.743297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749836+0000","last_change":"2023-10-06T02:58:34.744162+0000","last_active":"2023-10-06T02:58:34.749836+0000","last_peered":"2023-10-06T02:58:34.749836+0000","last_clean":"2023-10-06T02:58:34.749836+0000","last_became_active":"2023-10-06T02:58:34.743827+0000","last_became_peered":"2023-10-06T02:58:34.743827+0000","last_unstale":"2023-10-06T02:58:34.749836+0000","last_undegraded":"2023-10-06T02:58:34.749836+0000","last_fullsized":"2023-10-06T02:58:34.749836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:08.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.745360+0000","last_change":"2023-10-06T02:58:34.739723+0000","last_active":"2023-10-06T02:58:34.745360+0000","last_peered":"2023-10-06T02:58:34.745360+0000","last_clean":"2023-10-06T02:58:34.745360+0000","last_became_active":"2023-10-06T02:58:34.739467+0000","last_became_peered":"2023-10-06T02:58:34.739467+0000","last_unstale":"2023-10-06T02:58:34.745360+0000","last_undegraded":"2023-10-06T02:58:34.745360+0000","last_fullsized":"2023-10-06T02:58:34.745360+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:57.887007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749395+0000","last_change":"2023-10-06T02:58:34.739025+0000","last_active":"2023-10-06T02:58:34.749395+0000","last_peered":"2023-10-06T02:58:34.749395+0000","last_clean":"2023-10-06T02:58:34.749395+0000","last_became_active":"2023-10-06T02:58:34.738726+0000","last_became_peered":"2023-10-06T02:58:34.738726+0000","last_unstale":"2023-10-06T02:58:34.749395+0000","last_undegraded":"2023-10-06T02:58:34.749395+0000","last_fullsized":"2023-10-06T02:58:34.749395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.739001+0000","last_change":"2023-10-06T02:58:34.736953+0000","last_active":"2023-10-06T02:58:34.739001+0000","last_peered":"2023-10-06T02:58:34.739001+0000","last_clean":"2023-10-06T02:58:34.739001+0000","last_became_active":"2023-10-06T02:58:34.736650+0000","last_became_peered":"2023-10-06T02:58:34.736650+0000","last_unstale":"2023-10-06T02:58:34.739001+0000","last_undegraded":"2023-10-06T02:58:34.739001+0000","last_fullsized":"2023-10-06T02:58:34.739001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:28.139760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749685+0000","last_change":"2023-10-06T02:58:34.742034+0000","last_active":"2023-10-06T02:58:34.749685+0000","last_peered":"2023-10-06T02:58:34.749685+0000","last_clean":"2023-10-06T02:58:34.749685+0000","last_became_active":"2023-10-06T02:58:34.741753+0000","last_became_peered":"2023-10-06T02:58:34.741753+0000","last_unstale":"2023-10-06T02:58:34.749685+0000","last_undegraded":"2023-10-06T02:58:34.749685+0000","last_fullsized":"2023-10-06T02:58:34.749685+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:28.139760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.751607+0000","last_change":"2023-10-06T02:58:34.734021+0000","last_active":"2023-10-06T02:58:34.751607+0000","last_peered":"2023-10-06T02:58:34.751607+0000","last_clean":"2023-10-06T02:58:34.751607+0000","last_became_active":"2023-10-06T02:58:34.733740+0000","last_became_peered":"2023-10-06T02:58:34.733740+0000","last_unstale":"2023-10-06T02:58:34.751607+0000","last_undegraded":"2023-10-06T02:58:34.751607+0000","last_fullsized":"2023-10-06T02:58:34.751607+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:25.708657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.745204+0000","last_change":"2023-10-06T02:58:34.744198+0000","last_active":"2023-10-06T02:58:34.745204+0000","last_peered":"2023-10-06T02:58:34.745204+0000","last_clean":"2023-10-06T02:58:34.745204+0000","last_became_active":"2023-10-06T02:58:34.743907+0000","last_became_peered":"2023-10-06T02:58:34.743907+0000","last_unstale":"2023-10-06T02:58:34.745204+0000","last_undegraded":"2023-10-06T02:58:34.745204+0000","last_fullsized":"2023-10-06T02:58:34.745204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:32.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749353+0000","last_change":"2023-10-06T02:58:34.738261+0000","last_active":"2023-10-06T02:58:34.749353+0000","last_peered":"2023-10-06T02:58:34.749353+0000","last_clean":"2023-10-06T02:58:34.749353+0000","last_became_active":"2023-10-06T02:58:34.737885+0000","last_became_peered":"2023-10-06T02:58:34.737885+0000","last_unstale":"2023-10-06T02:58:34.749353+0000","last_undegraded":"2023-10-06T02:58:34.749353+0000","last_fullsized":"2023-10-06T02:58:34.749353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:57.887007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.748219+0000","last_change":"2023-10-06T02:58:34.735289+0000","last_active":"2023-10-06T02:58:34.748219+0000","last_peered":"2023-10-06T02:58:34.748219+0000","last_clean":"2023-10-06T02:58:34.748219+0000","last_became_active":"2023-10-06T02:58:34.734523+0000","last_became_peered":"2023-10-06T02:58:34.734523+0000","last_unstale":"2023-10-06T02:58:34.748219+0000","last_undegraded":"2023-10-06T02:58:34.748219+0000","last_fullsized":"2023-10-06T02:58:34.748219+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:41.077463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752051+0000","last_change":"2023-10-06T02:58:34.746217+0000","last_active":"2023-10-06T02:58:34.752051+0000","last_peered":"2023-10-06T02:58:34.752051+0000","last_clean":"2023-10-06T02:58:34.752051+0000","last_became_active":"2023-10-06T02:58:34.745908+0000","last_became_peered":"2023-10-06T02:58:34.745908+0000","last_unstale":"2023-10-06T02:58:34.752051+0000","last_undegraded":"2023-10-06T02:58:34.752051+0000","last_fullsized":"2023-10-06T02:58:34.752051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761568+0000","last_change":"2023-10-06T02:58:34.758007+0000","last_active":"2023-10-06T02:58:34.761568+0000","last_peered":"2023-10-06T02:58:34.761568+0000","last_clean":"2023-10-06T02:58:34.761568+0000","last_became_active":"2023-10-06T02:58:34.756411+0000","last_became_peered":"2023-10-06T02:58:34.756411+0000","last_unstale":"2023-10-06T02:58:34.761568+0000","last_undegraded":"2023-10-06T02:58:34.761568+0000","last_fullsized":"2023-10-06T02:58:34.761568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:02.013607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749371+0000","last_change":"2023-10-06T02:58:34.737235+0000","last_active":"2023-10-06T02:58:34.749371+0000","last_peered":"2023-10-06T02:58:34.749371+0000","last_clean":"2023-10-06T02:58:34.749371+0000","last_became_active":"2023-10-06T02:58:34.736946+0000","last_became_peered":"2023-10-06T02:58:34.736946+0000","last_unstale":"2023-10-06T02:58:34.749371+0000","last_undegraded":"2023-10-06T02:58:34.749371+0000","last_fullsized":"2023-10-06T02:58:34.749371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:00.743751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754484+0000","last_change":"2023-10-06T02:58:34.752722+0000","last_active":"2023-10-06T02:58:34.754484+0000","last_peered":"2023-10-06T02:58:34.754484+0000","last_clean":"2023-10-06T02:58:34.754484+0000","last_became_active":"2023-10-06T02:58:34.752438+0000","last_became_peered":"2023-10-06T02:58:34.752438+0000","last_unstale":"2023-10-06T02:58:34.754484+0000","last_undegraded":"2023-10-06T02:58:34.754484+0000","last_fullsized":"2023-10-06T02:58:34.754484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753272+0000","last_change":"2023-10-06T02:58:34.751410+0000","last_active":"2023-10-06T02:58:34.753272+0000","last_peered":"2023-10-06T02:58:34.753272+0000","last_clean":"2023-10-06T02:58:34.753272+0000","last_became_active":"2023-10-06T02:58:34.751060+0000","last_became_peered":"2023-10-06T02:58:34.751060+0000","last_unstale":"2023-10-06T02:58:34.753272+0000","last_undegraded":"2023-10-06T02:58:34.753272+0000","last_fullsized":"2023-10-06T02:58:34.753272+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:11.597600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.748248+0000","last_change":"2023-10-06T02:58:34.734580+0000","last_active":"2023-10-06T02:58:34.748248+0000","last_peered":"2023-10-06T02:58:34.748248+0000","last_clean":"2023-10-06T02:58:34.748248+0000","last_became_active":"2023-10-06T02:58:34.734269+0000","last_became_peered":"2023-10-06T02:58:34.734269+0000","last_unstale":"2023-10-06T02:58:34.748248+0000","last_undegraded":"2023-10-06T02:58:34.748248+0000","last_fullsized":"2023-10-06T02:58:34.748248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:13.097392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749771+0000","last_change":"2023-10-06T02:58:34.746233+0000","last_active":"2023-10-06T02:58:34.749771+0000","last_peered":"2023-10-06T02:58:34.749771+0000","last_clean":"2023-10-06T02:58:34.749771+0000","last_became_active":"2023-10-06T02:58:34.746061+0000","last_became_peered":"2023-10-06T02:58:34.746061+0000","last_unstale":"2023-10-06T02:58:34.749771+0000","last_undegraded":"2023-10-06T02:58:34.749771+0000","last_fullsized":"2023-10-06T02:58:34.749771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:37.723774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754488+0000","last_change":"2023-10-06T02:58:34.752612+0000","last_active":"2023-10-06T02:58:34.754488+0000","last_peered":"2023-10-06T02:58:34.754488+0000","last_clean":"2023-10-06T02:58:34.754488+0000","last_became_active":"2023-10-06T02:58:34.752358+0000","last_became_peered":"2023-10-06T02:58:34.752358+0000","last_unstale":"2023-10-06T02:58:34.754488+0000","last_undegraded":"2023-10-06T02:58:34.754488+0000","last_fullsized":"2023-10-06T02:58:34.754488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:25.003429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749331+0000","last_change":"2023-10-06T02:58:34.741091+0000","last_active":"2023-10-06T02:58:34.749331+0000","last_peered":"2023-10-06T02:58:34.749331+0000","last_clean":"2023-10-06T02:58:34.749331+0000","last_became_active":"2023-10-06T02:58:34.740843+0000","last_became_peered":"2023-10-06T02:58:34.740843+0000","last_unstale":"2023-10-06T02:58:34.749331+0000","last_undegraded":"2023-10-06T02:58:34.749331+0000","last_fullsized":"2023-10-06T02:58:34.749331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:44.834919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752945+0000","last_change":"2023-10-06T02:58:34.743358+0000","last_active":"2023-10-06T02:58:34.752945+0000","last_peered":"2023-10-06T02:58:34.752945+0000","last_clean":"2023-10-06T02:58:34.752945+0000","last_became_active":"2023-10-06T02:58:34.736611+0000","last_became_peered":"2023-10-06T02:58:34.736611+0000","last_unstale":"2023-10-06T02:58:34.752945+0000","last_undegraded":"2023-10-06T02:58:34.752945+0000","last_fullsized":"2023-10-06T02:58:34.752945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:37.753986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761459+0000","last_change":"2023-10-06T02:58:34.757003+0000","last_active":"2023-10-06T02:58:34.761459+0000","last_peered":"2023-10-06T02:58:34.761459+0000","last_clean":"2023-10-06T02:58:34.761459+0000","last_became_active":"2023-10-06T02:58:34.756723+0000","last_became_peered":"2023-10-06T02:58:34.756723+0000","last_unstale":"2023-10-06T02:58:34.761459+0000","last_undegraded":"2023-10-06T02:58:34.761459+0000","last_fullsized":"2023-10-06T02:58:34.761459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761658+0000","last_change":"2023-10-06T02:58:33.745475+0000","last_active":"2023-10-06T02:58:34.761658+0000","last_peered":"2023-10-06T02:58:34.761658+0000","last_clean":"2023-10-06T02:58:34.761658+0000","last_became_active":"2023-10-06T02:58:33.745233+0000","last_became_peered":"2023-10-06T02:58:33.745233+0000","last_unstale":"2023-10-06T02:58:34.761658+0000","last_undegraded":"2023-10-06T02:58:34.761658+0000","last_fullsized":"2023-10-06T02:58:34.761658+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.739313+0000","last_change":"2023-10-06T02:58:34.737294+0000","last_active":"2023-10-06T02:58:34.739313+0000","last_peered":"2023-10-06T02:58:34.739313+0000","last_clean":"2023-10-06T02:58:34.739313+0000","last_became_active":"2023-10-06T02:58:34.736954+0000","last_became_peered":"2023-10-06T02:58:34.736954+0000","last_unstale":"2023-10-06T02:58:34.739313+0000","last_undegraded":"2023-10-06T02:58:34.739313+0000","last_fullsized":"2023-10-06T02:58:34.739313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.419076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.759886+0000","last_change":"2023-10-06T02:58:33.732849+0000","last_active":"2023-10-06T02:58:34.759886+0000","last_peered":"2023-10-06T02:58:34.759886+0000","last_clean":"2023-10-06T02:58:34.759886+0000","last_became_active":"2023-10-06T02:58:33.732239+0000","last_became_peered":"2023-10-06T02:58:33.732239+0000","last_unstale":"2023-10-06T02:58:34.759886+0000","last_undegraded":"2023-10-06T02:58:34.759886+0000","last_fullsized":"2023-10-06T02:58:34.759886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752942+0000","last_change":"2023-10-06T02:58:34.741688+0000","last_active":"2023-10-06T02:58:34.752942+0000","last_peered":"2023-10-06T02:58:34.752942+0000","last_clean":"2023-10-06T02:58:34.752942+0000","last_became_active":"2023-10-06T02:58:34.741401+0000","last_became_peered":"2023-10-06T02:58:34.741401+0000","last_unstale":"2023-10-06T02:58:34.752942+0000","last_undegraded":"2023-10-06T02:58:34.752942+0000","last_fullsized":"2023-10-06T02:58:34.752942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:15.941629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.758675+0000","last_change":"2023-10-06T02:58:33.733506+0000","last_active":"2023-10-06T02:58:34.758675+0000","last_peered":"2023-10-06T02:58:34.758675+0000","last_clean":"2023-10-06T02:58:34.758675+0000","last_became_active":"2023-10-06T02:58:33.733249+0000","last_became_peered":"2023-10-06T02:58:33.733249+0000","last_unstale":"2023-10-06T02:58:34.758675+0000","last_undegraded":"2023-10-06T02:58:34.758675+0000","last_fullsized":"2023-10-06T02:58:34.758675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756140+0000","last_change":"2023-10-06T02:58:34.750170+0000","last_active":"2023-10-06T02:58:34.756140+0000","last_peered":"2023-10-06T02:58:34.756140+0000","last_clean":"2023-10-06T02:58:34.756140+0000","last_became_active":"2023-10-06T02:58:34.745489+0000","last_became_peered":"2023-10-06T02:58:34.745489+0000","last_unstale":"2023-10-06T02:58:34.756140+0000","last_undegraded":"2023-10-06T02:58:34.756140+0000","last_fullsized":"2023-10-06T02:58:34.756140+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:32.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755285+0000","last_change":"2023-10-06T02:58:33.743169+0000","last_active":"2023-10-06T02:58:34.755285+0000","last_peered":"2023-10-06T02:58:34.755285+0000","last_clean":"2023-10-06T02:58:34.755285+0000","last_became_active":"2023-10-06T02:58:33.742892+0000","last_became_peered":"2023-10-06T02:58:33.742892+0000","last_unstale":"2023-10-06T02:58:34.755285+0000","last_undegraded":"2023-10-06T02:58:34.755285+0000","last_fullsized":"2023-10-06T02:58:34.755285+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:07.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.750117+0000","last_change":"2023-10-06T02:58:34.742428+0000","last_active":"2023-10-06T02:58:34.750117+0000","last_peered":"2023-10-06T02:58:34.750117+0000","last_clean":"2023-10-06T02:58:34.750117+0000","last_became_active":"2023-10-06T02:58:34.742186+0000","last_became_peered":"2023-10-06T02:58:34.742186+0000","last_unstale":"2023-10-06T02:58:34.750117+0000","last_undegraded":"2023-10-06T02:58:34.750117+0000","last_fullsized":"2023-10-06T02:58:34.750117+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749895+0000","last_change":"2023-10-06T02:58:33.734217+0000","last_active":"2023-10-06T02:58:34.749895+0000","last_peered":"2023-10-06T02:58:34.749895+0000","last_clean":"2023-10-06T02:58:34.749895+0000","last_became_active":"2023-10-06T02:58:33.733894+0000","last_became_peered":"2023-10-06T02:58:33.733894+0000","last_unstale":"2023-10-06T02:58:34.749895+0000","last_undegraded":"2023-10-06T02:58:34.749895+0000","last_fullsized":"2023-10-06T02:58:34.749895+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:31.585062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749332+0000","last_change":"2023-10-06T02:58:34.738102+0000","last_active":"2023-10-06T02:58:34.749332+0000","last_peered":"2023-10-06T02:58:34.749332+0000","last_clean":"2023-10-06T02:58:34.749332+0000","last_became_active":"2023-10-06T02:58:34.737593+0000","last_became_peered":"2023-10-06T02:58:34.737593+0000","last_unstale":"2023-10-06T02:58:34.749332+0000","last_undegraded":"2023-10-06T02:58:34.749332+0000","last_fullsized":"2023-10-06T02:58:34.749332+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:48.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.760012+0000","last_change":"2023-10-06T02:58:33.736095+0000","last_active":"2023-10-06T02:58:34.760012+0000","last_peered":"2023-10-06T02:58:34.760012+0000","last_clean":"2023-10-06T02:58:34.760012+0000","last_became_active":"2023-10-06T02:58:33.735839+0000","last_became_peered":"2023-10-06T02:58:33.735839+0000","last_unstale":"2023-10-06T02:58:34.760012+0000","last_undegraded":"2023-10-06T02:58:34.760012+0000","last_fullsized":"2023-10-06T02:58:34.760012+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.738009+0000","last_change":"2023-10-06T02:58:34.734656+0000","last_active":"2023-10-06T02:58:34.738009+0000","last_peered":"2023-10-06T02:58:34.738009+0000","last_clean":"2023-10-06T02:58:34.738009+0000","last_became_active":"2023-10-06T02:58:34.734402+0000","last_became_peered":"2023-10-06T02:58:34.734402+0000","last_unstale":"2023-10-06T02:58:34.738009+0000","last_undegraded":"2023-10-06T02:58:34.738009+0000","last_fullsized":"2023-10-06T02:58:34.738009+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:02.147902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.730067+0000","last_change":"2023-10-06T02:58:33.742149+0000","last_active":"2023-10-06T02:58:34.730067+0000","last_peered":"2023-10-06T02:58:34.730067+0000","last_clean":"2023-10-06T02:58:34.730067+0000","last_became_active":"2023-10-06T02:58:33.741911+0000","last_became_peered":"2023-10-06T02:58:33.741911+0000","last_unstale":"2023-10-06T02:58:34.730067+0000","last_undegraded":"2023-10-06T02:58:34.730067+0000","last_fullsized":"2023-10-06T02:58:34.730067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.744132+0000","last_change":"2023-10-06T02:58:34.738974+0000","last_active":"2023-10-06T02:58:34.744132+0000","last_peered":"2023-10-06T02:58:34.744132+0000","last_clean":"2023-10-06T02:58:34.744132+0000","last_became_active":"2023-10-06T02:58:34.738726+0000","last_became_peered":"2023-10-06T02:58:34.738726+0000","last_unstale":"2023-10-06T02:58:34.744132+0000","last_undegraded":"2023-10-06T02:58:34.744132+0000","last_fullsized":"2023-10-06T02:58:34.744132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:55.617522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725040+0000","last_change":"2023-10-06T02:58:33.743119+0000","last_active":"2023-10-06T02:58:34.725040+0000","last_peered":"2023-10-06T02:58:34.725040+0000","last_clean":"2023-10-06T02:58:34.725040+0000","last_became_active":"2023-10-06T02:58:33.742849+0000","last_became_peered":"2023-10-06T02:58:33.742849+0000","last_unstale":"2023-10-06T02:58:34.725040+0000","last_undegraded":"2023-10-06T02:58:34.725040+0000","last_fullsized":"2023-10-06T02:58:34.725040+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:10.552745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749600+0000","last_change":"2023-10-06T02:58:34.748065+0000","last_active":"2023-10-06T02:58:34.749600+0000","last_peered":"2023-10-06T02:58:34.749600+0000","last_clean":"2023-10-06T02:58:34.749600+0000","last_became_active":"2023-10-06T02:58:34.747759+0000","last_became_peered":"2023-10-06T02:58:34.747759+0000","last_unstale":"2023-10-06T02:58:34.749600+0000","last_undegraded":"2023-10-06T02:58:34.749600+0000","last_fullsized":"2023-10-06T02:58:34.749600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725794+0000","last_change":"2023-10-06T02:58:33.734599+0000","last_active":"2023-10-06T02:58:34.725794+0000","last_peered":"2023-10-06T02:58:34.725794+0000","last_clean":"2023-10-06T02:58:34.725794+0000","last_became_active":"2023-10-06T02:58:33.734161+0000","last_became_peered":"2023-10-06T02:58:33.734161+0000","last_unstale":"2023-10-06T02:58:34.725794+0000","last_undegraded":"2023-10-06T02:58:34.725794+0000","last_fullsized":"2023-10-06T02:58:34.725794+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:10.358630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761525+0000","last_change":"2023-10-06T02:58:34.757856+0000","last_active":"2023-10-06T02:58:34.761525+0000","last_peered":"2023-10-06T02:58:34.761525+0000","last_clean":"2023-10-06T02:58:34.761525+0000","last_became_active":"2023-10-06T02:58:34.757568+0000","last_became_peered":"2023-10-06T02:58:34.757568+0000","last_unstale":"2023-10-06T02:58:34.761525+0000","last_undegraded":"2023-10-06T02:58:34.761525+0000","last_fullsized":"2023-10-06T02:58:34.761525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.623378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.726946+0000","last_change":"2023-10-06T02:58:33.733304+0000","last_active":"2023-10-06T02:58:34.726946+0000","last_peered":"2023-10-06T02:58:34.726946+0000","last_clean":"2023-10-06T02:58:34.726946+0000","last_became_active":"2023-10-06T02:58:33.733025+0000","last_became_peered":"2023-10-06T02:58:33.733025+0000","last_unstale":"2023-10-06T02:58:34.726946+0000","last_undegraded":"2023-10-06T02:58:34.726946+0000","last_fullsized":"2023-10-06T02:58:34.726946+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753271+0000","last_change":"2023-10-06T02:58:34.745510+0000","last_active":"2023-10-06T02:58:34.753271+0000","last_peered":"2023-10-06T02:58:34.753271+0000","last_clean":"2023-10-06T02:58:34.753271+0000","last_became_active":"2023-10-06T02:58:34.745251+0000","last_became_peered":"2023-10-06T02:58:34.745251+0000","last_unstale":"2023-10-06T02:58:34.753271+0000","last_undegraded":"2023-10-06T02:58:34.753271+0000","last_fullsized":"2023-10-06T02:58:34.753271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:23.859199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"67'3","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754555+0000","last_change":"2023-10-06T02:58:33.734221+0000","last_active":"2023-10-06T02:58:34.754555+0000","last_peered":"2023-10-06T02:58:34.754555+0000","last_clean":"2023-10-06T02:58:34.754555+0000","last_became_active":"2023-10-06T02:58:33.733961+0000","last_became_peered":"2023-10-06T02:58:33.733961+0000","last_unstale":"2023-10-06T02:58:34.754555+0000","last_undegraded":"2023-10-06T02:58:34.754555+0000","last_fullsized":"2023-10-06T02:58:34.754555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:02.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.737983+0000","last_change":"2023-10-06T02:58:34.734389+0000","last_active":"2023-10-06T02:58:34.737983+0000","last_peered":"2023-10-06T02:58:34.737983+0000","last_clean":"2023-10-06T02:58:34.737983+0000","last_became_active":"2023-10-06T02:58:34.734119+0000","last_became_peered":"2023-10-06T02:58:34.734119+0000","last_unstale":"2023-10-06T02:58:34.737983+0000","last_undegraded":"2023-10-06T02:58:34.737983+0000","last_fullsized":"2023-10-06T02:58:34.737983+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"67'6","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755314+0000","last_change":"2023-10-06T02:58:33.742820+0000","last_active":"2023-10-06T02:58:34.755314+0000","last_peered":"2023-10-06T02:58:34.755314+0000","last_clean":"2023-10-06T02:58:34.755314+0000","last_became_active":"2023-10-06T02:58:33.742572+0000","last_became_peered":"2023-10-06T02:58:33.742572+0000","last_unstale":"2023-10-06T02:58:34.755314+0000","last_undegraded":"2023-10-06T02:58:34.755314+0000","last_fullsized":"2023-10-06T02:58:34.755314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.744526+0000","last_change":"2023-10-06T02:58:34.738685+0000","last_active":"2023-10-06T02:58:34.744526+0000","last_peered":"2023-10-06T02:58:34.744526+0000","last_clean":"2023-10-06T02:58:34.744526+0000","last_became_active":"2023-10-06T02:58:34.738392+0000","last_became_peered":"2023-10-06T02:58:34.738392+0000","last_unstale":"2023-10-06T02:58:34.744526+0000","last_undegraded":"2023-10-06T02:58:34.744526+0000","last_fullsized":"2023-10-06T02:58:34.744526+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.759813+0000","last_change":"2023-10-06T02:58:33.742960+0000","last_active":"2023-10-06T02:58:34.759813+0000","last_peered":"2023-10-06T02:58:34.759813+0000","last_clean":"2023-10-06T02:58:34.759813+0000","last_became_active":"2023-10-06T02:58:33.742690+0000","last_became_peered":"2023-10-06T02:58:33.742690+0000","last_unstale":"2023-10-06T02:58:34.759813+0000","last_undegraded":"2023-10-06T02:58:34.759813+0000","last_fullsized":"2023-10-06T02:58:34.759813+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749990+0000","last_change":"2023-10-06T02:58:34.748805+0000","last_active":"2023-10-06T02:58:34.749990+0000","last_peered":"2023-10-06T02:58:34.749990+0000","last_clean":"2023-10-06T02:58:34.749990+0000","last_became_active":"2023-10-06T02:58:34.748562+0000","last_became_peered":"2023-10-06T02:58:34.748562+0000","last_unstale":"2023-10-06T02:58:34.749990+0000","last_undegraded":"2023-10-06T02:58:34.749990+0000","last_fullsized":"2023-10-06T02:58:34.749990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:16.237630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.727478+0000","last_change":"2023-10-06T02:58:33.734770+0000","last_active":"2023-10-06T02:58:34.727478+0000","last_peered":"2023-10-06T02:58:34.727478+0000","last_clean":"2023-10-06T02:58:34.727478+0000","last_became_active":"2023-10-06T02:58:33.734351+0000","last_became_peered":"2023-10-06T02:58:33.734351+0000","last_unstale":"2023-10-06T02:58:34.727478+0000","last_undegraded":"2023-10-06T02:58:34.727478+0000","last_fullsized":"2023-10-06T02:58:34.727478+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:59.626445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.759550+0000","last_change":"2023-10-06T02:58:34.746122+0000","last_active":"2023-10-06T02:58:34.759550+0000","last_peered":"2023-10-06T02:58:34.759550+0000","last_clean":"2023-10-06T02:58:34.759550+0000","last_became_active":"2023-10-06T02:58:34.745854+0000","last_became_peered":"2023-10-06T02:58:34.745854+0000","last_unstale":"2023-10-06T02:58:34.759550+0000","last_undegraded":"2023-10-06T02:58:34.759550+0000","last_fullsized":"2023-10-06T02:58:34.759550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.623378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735737+0000","last_change":"2023-10-06T02:58:33.736152+0000","last_active":"2023-10-06T02:58:34.735737+0000","last_peered":"2023-10-06T02:58:34.735737+0000","last_clean":"2023-10-06T02:58:34.735737+0000","last_became_active":"2023-10-06T02:58:33.735725+0000","last_became_peered":"2023-10-06T02:58:33.735725+0000","last_unstale":"2023-10-06T02:58:34.735737+0000","last_undegraded":"2023-10-06T02:58:34.735737+0000","last_fullsized":"2023-10-06T02:58:34.735737+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.949148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.738379+0000","last_change":"2023-10-06T02:58:34.736184+0000","last_active":"2023-10-06T02:58:34.738379+0000","last_peered":"2023-10-06T02:58:34.738379+0000","last_clean":"2023-10-06T02:58:34.738379+0000","last_became_active":"2023-10-06T02:58:34.735934+0000","last_became_peered":"2023-10-06T02:58:34.735934+0000","last_unstale":"2023-10-06T02:58:34.738379+0000","last_undegraded":"2023-10-06T02:58:34.738379+0000","last_fullsized":"2023-10-06T02:58:34.738379+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:10.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"67'8","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.762438+0000","last_change":"2023-10-06T02:58:33.734055+0000","last_active":"2023-10-06T02:58:34.762438+0000","last_peered":"2023-10-06T02:58:34.762438+0000","last_clean":"2023-10-06T02:58:34.762438+0000","last_became_active":"2023-10-06T02:58:33.733756+0000","last_became_peered":"2023-10-06T02:58:33.733756+0000","last_unstale":"2023-10-06T02:58:34.762438+0000","last_undegraded":"2023-10-06T02:58:34.762438+0000","last_fullsized":"2023-10-06T02:58:34.762438+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:27.263593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.741625+0000","last_change":"2023-10-06T02:58:34.738603+0000","last_active":"2023-10-06T02:58:34.741625+0000","last_peered":"2023-10-06T02:58:34.741625+0000","last_clean":"2023-10-06T02:58:34.741625+0000","last_became_active":"2023-10-06T02:58:34.738326+0000","last_became_peered":"2023-10-06T02:58:34.738326+0000","last_unstale":"2023-10-06T02:58:34.741625+0000","last_undegraded":"2023-10-06T02:58:34.741625+0000","last_fullsized":"2023-10-06T02:58:34.741625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754140+0000","last_change":"2023-10-06T02:58:33.735367+0000","last_active":"2023-10-06T02:58:34.754140+0000","last_peered":"2023-10-06T02:58:34.754140+0000","last_clean":"2023-10-06T02:58:34.754140+0000","last_became_active":"2023-10-06T02:58:33.734942+0000","last_became_peered":"2023-10-06T02:58:33.734942+0000","last_unstale":"2023-10-06T02:58:34.754140+0000","last_undegraded":"2023-10-06T02:58:34.754140+0000","last_fullsized":"2023-10-06T02:58:34.754140+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.750081+0000","last_change":"2023-10-06T02:58:34.740751+0000","last_active":"2023-10-06T02:58:34.750081+0000","last_peered":"2023-10-06T02:58:34.750081+0000","last_clean":"2023-10-06T02:58:34.750081+0000","last_became_active":"2023-10-06T02:58:34.740501+0000","last_became_peered":"2023-10-06T02:58:34.740501+0000","last_unstale":"2023-10-06T02:58:34.750081+0000","last_undegraded":"2023-10-06T02:58:34.750081+0000","last_fullsized":"2023-10-06T02:58:34.750081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"68'1","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-06T02:58:36.308798+0000","last_change":"2023-10-06T02:58:33.736226+0000","last_active":"2023-10-06T02:58:36.308798+0000","last_peered":"2023-10-06T02:58:36.308798+0000","last_clean":"2023-10-06T02:58:36.308798+0000","last_became_active":"2023-10-06T02:58:33.735569+0000","last_became_peered":"2023-10-06T02:58:33.735569+0000","last_unstale":"2023-10-06T02:58:36.308798+0000","last_undegraded":"2023-10-06T02:58:36.308798+0000","last_fullsized":"2023-10-06T02:58:36.308798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761483+0000","last_change":"2023-10-06T02:58:34.757525+0000","last_active":"2023-10-06T02:58:34.761483+0000","last_peered":"2023-10-06T02:58:34.761483+0000","last_clean":"2023-10-06T02:58:34.761483+0000","last_became_active":"2023-10-06T02:58:34.756383+0000","last_became_peered":"2023-10-06T02:58:34.756383+0000","last_unstale":"2023-10-06T02:58:34.761483+0000","last_undegraded":"2023-10-06T02:58:34.761483+0000","last_fullsized":"2023-10-06T02:58:34.761483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:07.588359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.726144+0000","last_change":"2023-10-06T02:58:33.735368+0000","last_active":"2023-10-06T02:58:34.726144+0000","last_peered":"2023-10-06T02:58:34.726144+0000","last_clean":"2023-10-06T02:58:34.726144+0000","last_became_active":"2023-10-06T02:58:33.735110+0000","last_became_peered":"2023-10-06T02:58:33.735110+0000","last_unstale":"2023-10-06T02:58:34.726144+0000","last_undegraded":"2023-10-06T02:58:34.726144+0000","last_fullsized":"2023-10-06T02:58:34.726144+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:24.789985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756627+0000","last_change":"2023-10-06T02:58:34.750506+0000","last_active":"2023-10-06T02:58:34.756627+0000","last_peered":"2023-10-06T02:58:34.756627+0000","last_clean":"2023-10-06T02:58:34.756627+0000","last_became_active":"2023-10-06T02:58:34.750158+0000","last_became_peered":"2023-10-06T02:58:34.750158+0000","last_unstale":"2023-10-06T02:58:34.756627+0000","last_undegraded":"2023-10-06T02:58:34.756627+0000","last_fullsized":"2023-10-06T02:58:34.756627+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.730138+0000","last_change":"2023-10-06T02:58:33.727028+0000","last_active":"2023-10-06T02:58:34.730138+0000","last_peered":"2023-10-06T02:58:34.730138+0000","last_clean":"2023-10-06T02:58:34.730138+0000","last_became_active":"2023-10-06T02:58:33.726742+0000","last_became_peered":"2023-10-06T02:58:33.726742+0000","last_unstale":"2023-10-06T02:58:34.730138+0000","last_undegraded":"2023-10-06T02:58:34.730138+0000","last_fullsized":"2023-10-06T02:58:34.730138+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.737825+0000","last_change":"2023-10-06T02:58:34.733654+0000","last_active":"2023-10-06T02:58:34.737825+0000","last_peered":"2023-10-06T02:58:34.737825+0000","last_clean":"2023-10-06T02:58:34.737825+0000","last_became_active":"2023-10-06T02:58:34.733031+0000","last_became_peered":"2023-10-06T02:58:34.733031+0000","last_unstale":"2023-10-06T02:58:34.737825+0000","last_undegraded":"2023-10-06T02:58:34.737825+0000","last_fullsized":"2023-10-06T02:58:34.737825+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:12.873779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725392+0000","last_change":"2023-10-06T02:58:33.733340+0000","last_active":"2023-10-06T02:58:34.725392+0000","last_peered":"2023-10-06T02:58:34.725392+0000","last_clean":"2023-10-06T02:58:34.725392+0000","last_became_active":"2023-10-06T02:58:33.733080+0000","last_became_peered":"2023-10-06T02:58:33.733080+0000","last_unstale":"2023-10-06T02:58:34.725392+0000","last_undegraded":"2023-10-06T02:58:34.725392+0000","last_fullsized":"2023-10-06T02:58:34.725392+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:32.544670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752836+0000","last_change":"2023-10-06T02:58:34.741338+0000","last_active":"2023-10-06T02:58:34.752836+0000","last_peered":"2023-10-06T02:58:34.752836+0000","last_clean":"2023-10-06T02:58:34.752836+0000","last_became_active":"2023-10-06T02:58:34.739399+0000","last_became_peered":"2023-10-06T02:58:34.739399+0000","last_unstale":"2023-10-06T02:58:34.752836+0000","last_undegraded":"2023-10-06T02:58:34.752836+0000","last_fullsized":"2023-10-06T02:58:34.752836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:37.916870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.730173+0000","last_change":"2023-10-06T02:58:33.742848+0000","last_active":"2023-10-06T02:58:34.730173+0000","last_peered":"2023-10-06T02:58:34.730173+0000","last_clean":"2023-10-06T02:58:34.730173+0000","last_became_active":"2023-10-06T02:58:33.742585+0000","last_became_peered":"2023-10-06T02:58:33.742585+0000","last_unstale":"2023-10-06T02:58:34.730173+0000","last_undegraded":"2023-10-06T02:58:34.730173+0000","last_fullsized":"2023-10-06T02:58:34.730173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.742027+0000","last_change":"2023-10-06T02:58:34.738583+0000","last_active":"2023-10-06T02:58:34.742027+0000","last_peered":"2023-10-06T02:58:34.742027+0000","last_clean":"2023-10-06T02:58:34.742027+0000","last_became_active":"2023-10-06T02:58:34.738385+0000","last_became_peered":"2023-10-06T02:58:34.738385+0000","last_unstale":"2023-10-06T02:58:34.742027+0000","last_undegraded":"2023-10-06T02:58:34.742027+0000","last_fullsized":"2023-10-06T02:58:34.742027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:10.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.726187+0000","last_change":"2023-10-06T02:58:33.740591+0000","last_active":"2023-10-06T02:58:34.726187+0000","last_peered":"2023-10-06T02:58:34.726187+0000","last_clean":"2023-10-06T02:58:34.726187+0000","last_became_active":"2023-10-06T02:58:33.740329+0000","last_became_peered":"2023-10-06T02:58:33.740329+0000","last_unstale":"2023-10-06T02:58:34.726187+0000","last_undegraded":"2023-10-06T02:58:34.726187+0000","last_fullsized":"2023-10-06T02:58:34.726187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.751587+0000","last_change":"2023-10-06T02:58:34.734191+0000","last_active":"2023-10-06T02:58:34.751587+0000","last_peered":"2023-10-06T02:58:34.751587+0000","last_clean":"2023-10-06T02:58:34.751587+0000","last_became_active":"2023-10-06T02:58:34.733879+0000","last_became_peered":"2023-10-06T02:58:34.733879+0000","last_unstale":"2023-10-06T02:58:34.751587+0000","last_undegraded":"2023-10-06T02:58:34.751587+0000","last_fullsized":"2023-10-06T02:58:34.751587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:22.316351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725270+0000","last_change":"2023-10-06T02:58:33.745606+0000","last_active":"2023-10-06T02:58:34.725270+0000","last_peered":"2023-10-06T02:58:34.725270+0000","last_clean":"2023-10-06T02:58:34.725270+0000","last_became_active":"2023-10-06T02:58:33.745246+0000","last_became_peered":"2023-10-06T02:58:33.745246+0000","last_unstale":"2023-10-06T02:58:34.725270+0000","last_undegraded":"2023-10-06T02:58:34.725270+0000","last_fullsized":"2023-10-06T02:58:34.725270+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:45.339807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.747263+0000","last_change":"2023-10-06T02:58:34.743038+0000","last_active":"2023-10-06T02:58:34.747263+0000","last_peered":"2023-10-06T02:58:34.747263+0000","last_clean":"2023-10-06T02:58:34.747263+0000","last_became_active":"2023-10-06T02:58:34.742788+0000","last_became_peered":"2023-10-06T02:58:34.742788+0000","last_unstale":"2023-10-06T02:58:34.747263+0000","last_undegraded":"2023-10-06T02:58:34.747263+0000","last_fullsized":"2023-10-06T02:58:34.747263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:21.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.733402+0000","last_change":"2023-10-06T02:58:33.742273+0000","last_active":"2023-10-06T02:58:34.733402+0000","last_peered":"2023-10-06T02:58:34.733402+0000","last_clean":"2023-10-06T02:58:34.733402+0000","last_became_active":"2023-10-06T02:58:33.741934+0000","last_became_peered":"2023-10-06T02:58:33.741934+0000","last_unstale":"2023-10-06T02:58:34.733402+0000","last_undegraded":"2023-10-06T02:58:34.733402+0000","last_fullsized":"2023-10-06T02:58:34.733402+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:15.613100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.731116+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:58:34.731116+0000","last_peered":"2023-10-06T02:58:34.731116+0000","last_clean":"2023-10-06T02:58:34.731116+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:58:34.731116+0000","last_undegraded":"2023-10-06T02:58:34.731116+0000","last_fullsized":"2023-10-06T02:58:34.731116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.741445+0000","last_change":"2023-10-06T02:58:34.737742+0000","last_active":"2023-10-06T02:58:34.741445+0000","last_peered":"2023-10-06T02:58:34.741445+0000","last_clean":"2023-10-06T02:58:34.741445+0000","last_became_active":"2023-10-06T02:58:34.737502+0000","last_became_peered":"2023-10-06T02:58:34.737502+0000","last_unstale":"2023-10-06T02:58:34.741445+0000","last_undegraded":"2023-10-06T02:58:34.741445+0000","last_fullsized":"2023-10-06T02:58:34.741445+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:27.363276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.727585+0000","last_change":"2023-10-06T02:58:33.732697+0000","last_active":"2023-10-06T02:58:34.727585+0000","last_peered":"2023-10-06T02:58:34.727585+0000","last_clean":"2023-10-06T02:58:34.727585+0000","last_became_active":"2023-10-06T02:58:33.732421+0000","last_became_peered":"2023-10-06T02:58:33.732421+0000","last_unstale":"2023-10-06T02:58:34.727585+0000","last_undegraded":"2023-10-06T02:58:34.727585+0000","last_fullsized":"2023-10-06T02:58:34.727585+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735698+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:58:34.735698+0000","last_peered":"2023-10-06T02:58:34.735698+0000","last_clean":"2023-10-06T02:58:34.735698+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:58:34.735698+0000","last_undegraded":"2023-10-06T02:58:34.735698+0000","last_fullsized":"2023-10-06T02:58:34.735698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749715+0000","last_change":"2023-10-06T02:58:34.745739+0000","last_active":"2023-10-06T02:58:34.749715+0000","last_peered":"2023-10-06T02:58:34.749715+0000","last_clean":"2023-10-06T02:58:34.749715+0000","last_became_active":"2023-10-06T02:58:34.745460+0000","last_became_peered":"2023-10-06T02:58:34.745460+0000","last_unstale":"2023-10-06T02:58:34.749715+0000","last_undegraded":"2023-10-06T02:58:34.749715+0000","last_fullsized":"2023-10-06T02:58:34.749715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:07.604975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735812+0000","last_change":"2023-10-06T02:58:33.735296+0000","last_active":"2023-10-06T02:58:34.735812+0000","last_peered":"2023-10-06T02:58:34.735812+0000","last_clean":"2023-10-06T02:58:34.735812+0000","last_became_active":"2023-10-06T02:58:33.735041+0000","last_became_peered":"2023-10-06T02:58:33.735041+0000","last_unstale":"2023-10-06T02:58:34.735812+0000","last_undegraded":"2023-10-06T02:58:34.735812+0000","last_fullsized":"2023-10-06T02:58:34.735812+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:12.846129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725215+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:58:34.725215+0000","last_peered":"2023-10-06T02:58:34.725215+0000","last_clean":"2023-10-06T02:58:34.725215+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:58:34.725215+0000","last_undegraded":"2023-10-06T02:58:34.725215+0000","last_fullsized":"2023-10-06T02:58:34.725215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753200+0000","last_change":"2023-10-06T02:58:34.752352+0000","last_active":"2023-10-06T02:58:34.753200+0000","last_peered":"2023-10-06T02:58:34.753200+0000","last_clean":"2023-10-06T02:58:34.753200+0000","last_became_active":"2023-10-06T02:58:34.752080+0000","last_became_peered":"2023-10-06T02:58:34.752080+0000","last_unstale":"2023-10-06T02:58:34.753200+0000","last_undegraded":"2023-10-06T02:58:34.753200+0000","last_fullsized":"2023-10-06T02:58:34.753200+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:13.619429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755867+0000","last_change":"2023-10-06T02:58:33.743225+0000","last_active":"2023-10-06T02:58:34.755867+0000","last_peered":"2023-10-06T02:58:34.755867+0000","last_clean":"2023-10-06T02:58:34.755867+0000","last_became_active":"2023-10-06T02:58:33.742937+0000","last_became_peered":"2023-10-06T02:58:33.742937+0000","last_unstale":"2023-10-06T02:58:34.755867+0000","last_undegraded":"2023-10-06T02:58:34.755867+0000","last_fullsized":"2023-10-06T02:58:34.755867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:13.817402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735827+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:58:34.735827+0000","last_peered":"2023-10-06T02:58:34.735827+0000","last_clean":"2023-10-06T02:58:34.735827+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:58:34.735827+0000","last_undegraded":"2023-10-06T02:58:34.735827+0000","last_fullsized":"2023-10-06T02:58:34.735827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":204,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.732877+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:58:34.732877+0000","last_peered":"2023-10-06T02:58:34.732877+0000","last_clean":"2023-10-06T02:58:34.732877+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:58:34.732877+0000","last_undegraded":"2023-10-06T02:58:34.732877+0000","last_fullsized":"2023-10-06T02:58:34.732877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755115+0000","last_change":"2023-10-06T02:58:34.752436+0000","last_active":"2023-10-06T02:58:34.755115+0000","last_peered":"2023-10-06T02:58:34.755115+0000","last_clean":"2023-10-06T02:58:34.755115+0000","last_became_active":"2023-10-06T02:58:34.752129+0000","last_became_peered":"2023-10-06T02:58:34.752129+0000","last_unstale":"2023-10-06T02:58:34.755115+0000","last_undegraded":"2023-10-06T02:58:34.755115+0000","last_fullsized":"2023-10-06T02:58:34.755115+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:31.827949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.729347+0000","last_change":"2023-10-06T02:58:33.732458+0000","last_active":"2023-10-06T02:58:34.729347+0000","last_peered":"2023-10-06T02:58:34.729347+0000","last_clean":"2023-10-06T02:58:34.729347+0000","last_became_active":"2023-10-06T02:58:33.732203+0000","last_became_peered":"2023-10-06T02:58:33.732203+0000","last_unstale":"2023-10-06T02:58:34.729347+0000","last_undegraded":"2023-10-06T02:58:34.729347+0000","last_fullsized":"2023-10-06T02:58:34.729347+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.732958+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:58:34.732958+0000","last_peered":"2023-10-06T02:58:34.732958+0000","last_clean":"2023-10-06T02:58:34.732958+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:58:34.732958+0000","last_undegraded":"2023-10-06T02:58:34.732958+0000","last_fullsized":"2023-10-06T02:58:34.732958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752733+0000","last_change":"2023-10-06T02:58:34.744738+0000","last_active":"2023-10-06T02:58:34.752733+0000","last_peered":"2023-10-06T02:58:34.752733+0000","last_clean":"2023-10-06T02:58:34.752733+0000","last_became_active":"2023-10-06T02:58:34.741841+0000","last_became_peered":"2023-10-06T02:58:34.741841+0000","last_unstale":"2023-10-06T02:58:34.752733+0000","last_undegraded":"2023-10-06T02:58:34.752733+0000","last_fullsized":"2023-10-06T02:58:34.752733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755220+0000","last_change":"2023-10-06T02:58:33.735525+0000","last_active":"2023-10-06T02:58:34.755220+0000","last_peered":"2023-10-06T02:58:34.755220+0000","last_clean":"2023-10-06T02:58:34.755220+0000","last_became_active":"2023-10-06T02:58:33.735068+0000","last_became_peered":"2023-10-06T02:58:33.735068+0000","last_unstale":"2023-10-06T02:58:34.755220+0000","last_undegraded":"2023-10-06T02:58:34.755220+0000","last_fullsized":"2023-10-06T02:58:34.755220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:27.296192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.733225+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:58:34.733225+0000","last_peered":"2023-10-06T02:58:34.733225+0000","last_clean":"2023-10-06T02:58:34.733225+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:58:34.733225+0000","last_undegraded":"2023-10-06T02:58:34.733225+0000","last_fullsized":"2023-10-06T02:58:34.733225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.757425+0000","last_change":"2023-10-06T02:58:34.750920+0000","last_active":"2023-10-06T02:58:34.757425+0000","last_peered":"2023-10-06T02:58:34.757425+0000","last_clean":"2023-10-06T02:58:34.757425+0000","last_became_active":"2023-10-06T02:58:34.745651+0000","last_became_peered":"2023-10-06T02:58:34.745651+0000","last_unstale":"2023-10-06T02:58:34.757425+0000","last_undegraded":"2023-10-06T02:58:34.757425+0000","last_fullsized":"2023-10-06T02:58:34.757425+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.758787+0000","last_change":"2023-10-06T02:58:33.736569+0000","last_active":"2023-10-06T02:58:34.758787+0000","last_peered":"2023-10-06T02:58:34.758787+0000","last_clean":"2023-10-06T02:58:34.758787+0000","last_became_active":"2023-10-06T02:58:33.736326+0000","last_became_peered":"2023-10-06T02:58:33.736326+0000","last_unstale":"2023-10-06T02:58:34.758787+0000","last_undegraded":"2023-10-06T02:58:34.758787+0000","last_fullsized":"2023-10-06T02:58:34.758787+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.731923+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:58:34.731923+0000","last_peered":"2023-10-06T02:58:34.731923+0000","last_clean":"2023-10-06T02:58:34.731923+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:58:34.731923+0000","last_undegraded":"2023-10-06T02:58:34.731923+0000","last_fullsized":"2023-10-06T02:58:34.731923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749649+0000","last_change":"2023-10-06T02:58:34.740370+0000","last_active":"2023-10-06T02:58:34.749649+0000","last_peered":"2023-10-06T02:58:34.749649+0000","last_clean":"2023-10-06T02:58:34.749649+0000","last_became_active":"2023-10-06T02:58:34.740130+0000","last_became_peered":"2023-10-06T02:58:34.740130+0000","last_unstale":"2023-10-06T02:58:34.749649+0000","last_undegraded":"2023-10-06T02:58:34.749649+0000","last_fullsized":"2023-10-06T02:58:34.749649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:16.482180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754208+0000","last_change":"2023-10-06T02:58:33.735199+0000","last_active":"2023-10-06T02:58:34.754208+0000","last_peered":"2023-10-06T02:58:34.754208+0000","last_clean":"2023-10-06T02:58:34.754208+0000","last_became_active":"2023-10-06T02:58:33.734599+0000","last_became_peered":"2023-10-06T02:58:33.734599+0000","last_unstale":"2023-10-06T02:58:34.754208+0000","last_undegraded":"2023-10-06T02:58:34.754208+0000","last_fullsized":"2023-10-06T02:58:34.754208+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:05.133979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725624+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:58:34.725624+0000","last_peered":"2023-10-06T02:58:34.725624+0000","last_clean":"2023-10-06T02:58:34.725624+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:58:34.725624+0000","last_undegraded":"2023-10-06T02:58:34.725624+0000","last_fullsized":"2023-10-06T02:58:34.725624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298680,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073160,"statfs":{"total":96636764160,"available":96330915840,"internally_reserved":0,"allocated":1425408,"data_stored":978448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.435}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.502},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.377}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66400000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.41599999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.498},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":831488,"data_stored":387584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58899999999999997,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81599999999999995,"5min":3.415,"15min":3.415},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":1.546,"15min":1.546},"last":0.38},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.74,"15min":1.74},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.67900000000000005,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69299999999999995,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":3.577,"15min":3.577},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.51100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.73699999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.437}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80300000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.41899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":388605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.377,"15min":0.40100000000000002},"min":{"1min":0.23000000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.45300000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.41699999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.99099999999999999,"15min":1.2769999999999999},"min":{"1min":0.255,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44500000000000001,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.433,"15min":0.443},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":1.181,"15min":1.181},"last":0.378}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.42699999999999999,"15min":0.443},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48099999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.311},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.626,"15min":0.626},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70299999999999996,"5min":1.02,"15min":1.02},"last":0.505},{"interface":"front","average":{"1min":0.60299999999999998,"5min":1.228,"15min":1.5},"min":{"1min":0.42299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79700000000000004,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.2130000000000001,"15min":1.4830000000000001},"min":{"1min":0.46800000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73399999999999999,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81000000000000005,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.44}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.48399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.242,"15min":1.52},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82499999999999996,"5min":21.166,"15min":21.166},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78600000000000003,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84199999999999997,"5min":0.997,"15min":0.997},"last":0.48799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298668,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073172,"statfs":{"total":96636764160,"available":96330928128,"internally_reserved":0,"allocated":1413120,"data_stored":976849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.33200000000000002,"15min":0.32800000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.373,"15min":0.372},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.379},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26500000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.313},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40000000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.754},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.875,"5min":0.879,"15min":0.879},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298104,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073736,"statfs":{"total":96636764160,"available":96331505664,"internally_reserved":0,"allocated":835584,"data_stored":389028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.315,"15min":0.307},"min":{"1min":0.23200000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32000000000000001},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.51200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.375}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.58399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53700000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.32900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.872,"5min":1.077,"15min":1.077},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79600000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":386593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.45500000000000002},"min":{"1min":0.249,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.60899999999999999,"5min":2.569,"15min":2.569},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42899999999999999,"15min":0.45400000000000001},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.47399999999999998,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41699999999999998,"15min":0.442},"min":{"1min":0.22600000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.51200000000000001,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.44800000000000001,"15min":0.47999999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56999999999999995,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47199999999999998,"15min":0.498},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54400000000000004,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.376}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.497},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.65000000000000002,"15min":0.68000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.66200000000000003,"15min":0.69399999999999995},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80000000000000004,"5min":2.532,"15min":2.532},"last":0.40899999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.41899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.71799999999999997,"5min":2.496,"15min":2.496},"last":0.44},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84799999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.52600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":387562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.62}]},{"osd":2,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.91500000000000004,"15min":1.0409999999999999},"min":{"1min":0.46300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.871,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64200000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69399999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":387582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.504,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":1.167,"15min":1.167},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.57399999999999995},"min":{"1min":0.38700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.625,"5min":1.117,"15min":1.117},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68500000000000005,"5min":1.2,"15min":1.2},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":1.135,"15min":1.135},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67100000000000004,"5min":1.208,"15min":1.208},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66400000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73199999999999998,"5min":0.87,"15min":0.87},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56100000000000005,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":1.054,"15min":1.054},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.56999999999999995,"15min":0.58899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71899999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.42699999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76000000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78200000000000003,"5min":1.008,"15min":1.008},"last":0.496}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:58:39.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T02:58:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.059+0000 7ff6d972c700 1 Processor -- start 2023-10-06T02:58:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.059+0000 7ff6d972c700 1 -- start start 2023-10-06T02:58:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.060+0000 7ff6d972c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6d40cadc0 0x7ff6d4159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.060+0000 7ff6d972c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d4068d50 con 0x7ff6d4159b10 2023-10-06T02:58:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.060+0000 7ff6d972c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d415a6b0 con 0x7ff6d40cb630 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.060+0000 7ff6d972c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d415a4d0 con 0x7ff6d40cadc0 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.060+0000 7ff6d37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6d40cadc0 0x7ff6d4159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.060+0000 7ff6d27fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff6d4159b10 0x7ff6d40ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37270/0 (socket says 172.21.15.84:37270) 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.060+0000 7ff6d27fc700 1 -- 172.21.15.84:0/2375059872 learned_addr learned my addr 172.21.15.84:0/2375059872 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d1ffb700 1 -- 172.21.15.84:0/2375059872 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665644666 0 0) 0x7ff6d4068d50 con 0x7ff6d4159b10 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d1ffb700 1 -- 172.21.15.84:0/2375059872 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c0003570 con 0x7ff6d4159b10 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d37fe700 1 -- 172.21.15.84:0/2375059872 >> v1:172.21.15.131:6789/0 conn(0x7ff6d40cb630 legacy=0x7ff6d40691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d37fe700 1 -- 172.21.15.84:0/2375059872 >> v1:172.21.15.84:6789/0 conn(0x7ff6d4159b10 legacy=0x7ff6d40ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d37fe700 1 -- 172.21.15.84:0/2375059872 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d415a990 con 0x7ff6d40cadc0 2023-10-06T02:58:40.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d37fe700 1 --2- 172.21.15.84:0/2375059872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d40cadc0 0x7ff6d4159f90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009e60 tx=0x7ff6c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc26320a6ea9ab50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d1ffb700 1 -- 172.21.15.84:0/2375059872 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c400e070 con 0x7ff6d40cadc0 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d1ffb700 1 -- 172.21.15.84:0/2375059872 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c400bb20 con 0x7ff6d40cadc0 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d1ffb700 1 -- 172.21.15.84:0/2375059872 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c400bea0 con 0x7ff6d40cadc0 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d972c700 1 -- 172.21.15.84:0/2375059872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d40cadc0 msgr2=0x7ff6d4159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d972c700 1 --2- 172.21.15.84:0/2375059872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d40cadc0 0x7ff6d4159f90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009e60 tx=0x7ff6c4009780 comp rx=0 tx=0).stop 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d972c700 1 -- 172.21.15.84:0/2375059872 shutdown_connections 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d972c700 1 --2- 172.21.15.84:0/2375059872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d40cadc0 0x7ff6d4159f90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d972c700 1 -- 172.21.15.84:0/2375059872 >> 172.21.15.84:0/2375059872 conn(0x7ff6d4070810 msgr2=0x7ff6d4070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.061+0000 7ff6d972c700 1 -- 172.21.15.84:0/2375059872 shutdown_connections 2023-10-06T02:58:40.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.062+0000 7ff6d972c700 1 -- 172.21.15.84:0/2375059872 wait complete. 2023-10-06T02:58:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.063+0000 7ff6d972c700 1 Processor -- start 2023-10-06T02:58:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.063+0000 7ff6d972c700 1 -- start start 2023-10-06T02:58:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.063+0000 7ff6d972c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d40cadc0 0x7ff6d4158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.063+0000 7ff6d972c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d40cb630 0x7ff6d41512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.063+0000 7ff6d972c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d4159b10 0x7ff6d40691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.063+0000 7ff6d972c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4159790 con 0x7ff6d4159b10 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.063+0000 7ff6d972c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40c4500 con 0x7ff6d40cadc0 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.063+0000 7ff6d972c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40c47e0 con 0x7ff6d40cb630 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d4159b10 0x7ff6d40691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d4159b10 0x7ff6d40691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36872/0 (socket says 172.21.15.84:36872) 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d37fe700 1 -- 172.21.15.84:0/652499457 learned_addr learned my addr 172.21.15.84:0/652499457 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d2ffd700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d40cadc0 0x7ff6d4158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d27fc700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d40cb630 0x7ff6d41512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d37fe700 1 -- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d40cb630 msgr2=0x7ff6d41512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d37fe700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d40cb630 0x7ff6d41512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d37fe700 1 -- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d40cadc0 msgr2=0x7ff6d4158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d37fe700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d40cadc0 0x7ff6d4158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d37fe700 1 -- 172.21.15.84:0/652499457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4009a20 con 0x7ff6d4159b10 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d2ffd700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d40cadc0 0x7ff6d4158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d27fc700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d40cb630 0x7ff6d41512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d37fe700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d4159b10 0x7ff6d40691e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009d30 tx=0x7ff6c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6caffd700 1 -- 172.21.15.84:0/652499457 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4026460 con 0x7ff6d4159b10 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6caffd700 1 -- 172.21.15.84:0/652499457 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c40265c0 con 0x7ff6d4159b10 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d40c4ac0 con 0x7ff6d4159b10 2023-10-06T02:58:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6caffd700 1 -- 172.21.15.84:0/652499457 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4026980 con 0x7ff6d4159b10 2023-10-06T02:58:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.064+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d4151830 con 0x7ff6d4159b10 2023-10-06T02:58:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.065+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d4064ad0 con 0x7ff6d4159b10 2023-10-06T02:58:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.065+0000 7ff6caffd700 1 -- 172.21.15.84:0/652499457 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6c401d420 con 0x7ff6d4159b10 2023-10-06T02:58:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.066+0000 7ff6caffd700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6b4066f30 0x7ff6b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.066+0000 7ff6caffd700 1 -- 172.21.15.84:0/652499457 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff6c4086750 con 0x7ff6d4159b10 2023-10-06T02:58:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.066+0000 7ff6d2ffd700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6b4066f30 0x7ff6b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.066+0000 7ff6d2ffd700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6b4066f30 0x7ff6b40693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc006fd0 tx=0x7ff6cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.070+0000 7ff6caffd700 1 -- 172.21.15.84:0/652499457 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6c4053720 con 0x7ff6d4159b10 2023-10-06T02:58:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.329+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff6d404bb80 con 0x7ff6d4159b10 2023-10-06T02:58:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.330+0000 7ff6caffd700 1 -- 172.21.15.84:0/652499457 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1437 (secure 0 0 0) 0x7ff6c4056d40 con 0x7ff6d4159b10 2023-10-06T02:58:40.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:40.332 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":238,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592674,"bytes_used":2443210752,"bytes_avail":770650902528,"bytes_total":773094113280,"write_bytes_sec":2172,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":52,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6528}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-06T02:58:17.844109+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T02:58:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6b4066f30 msgr2=0x7ff6b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6b4066f30 0x7ff6b40693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc006fd0 tx=0x7ff6cc008040 comp rx=0 tx=0).stop 2023-10-06T02:58:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d4159b10 msgr2=0x7ff6d40691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d4159b10 0x7ff6d40691e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009d30 tx=0x7ff6c4018000 comp rx=0 tx=0).stop 2023-10-06T02:58:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 shutdown_connections 2023-10-06T02:58:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff6b4066f30 0x7ff6b40693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d40cadc0 0x7ff6d4158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6d4159b10 0x7ff6d40691e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 --2- 172.21.15.84:0/652499457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d40cb630 0x7ff6d41512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 >> 172.21.15.84:0/652499457 conn(0x7ff6d4070810 msgr2=0x7ff6d40cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 shutdown_connections 2023-10-06T02:58:40.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.332+0000 7ff6d972c700 1 -- 172.21.15.84:0/652499457 wait complete. 2023-10-06T02:58:40.345 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T02:58:40.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:40.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.458+0000 7f66e39d5700 1 Processor -- start 2023-10-06T02:58:40.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.458+0000 7f66e39d5700 1 -- start start 2023-10-06T02:58:40.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.459+0000 7f66e39d5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc1595a0 0x7f66dc0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.459+0000 7f66e39d5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66dc0b07a0 0x7f66dc0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.459+0000 7f66e39d5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc0b0ca0 con 0x7f66dc0b49e0 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.459+0000 7f66e39d5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc0b0f80 con 0x7f66dc0b07a0 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.459+0000 7f66e39d5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0b1260 con 0x7f66dc1595a0 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.459+0000 7f66e1f72700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66dc0b07a0 0x7f66dc0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.459+0000 7f66e0f70700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f66dc0b49e0 0x7f66dc0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37278/0 (socket says 172.21.15.84:37278) 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.459+0000 7f66e0f70700 1 -- 172.21.15.84:0/4068626736 learned_addr learned my addr 172.21.15.84:0/4068626736 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66e1771700 1 --2- 172.21.15.84:0/4068626736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc1595a0 0x7f66dc0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66e1f72700 1 -- 172.21.15.84:0/4068626736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc1595a0 msgr2=0x7f66dc0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66e1f72700 1 --2- 172.21.15.84:0/4068626736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc1595a0 0x7f66dc0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66e1f72700 1 -- 172.21.15.84:0/4068626736 >> v1:172.21.15.84:6789/0 conn(0x7f66dc0b49e0 legacy=0x7f66dc0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66e1f72700 1 -- 172.21.15.84:0/4068626736 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0b1540 con 0x7f66dc0b07a0 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66d3fff700 1 -- 172.21.15.84:0/4068626736 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441683528 0 0) 0x7f66dc0b0ca0 con 0x7f66dc0b49e0 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66e1f72700 1 --2- 172.21.15.84:0/4068626736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc0b07a0 0x7f66dc0b1c00 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009e60 tx=0x7f66d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58342b44316bf1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66d3fff700 1 -- 172.21.15.84:0/4068626736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d400e070 con 0x7f66dc0b07a0 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66d3fff700 1 -- 172.21.15.84:0/4068626736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d400bc30 con 0x7f66dc0b07a0 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.460+0000 7f66d3fff700 1 -- 172.21.15.84:0/4068626736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4012430 con 0x7f66dc0b07a0 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.461+0000 7f66e39d5700 1 -- 172.21.15.84:0/4068626736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc0b07a0 msgr2=0x7f66dc0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.461+0000 7f66e39d5700 1 --2- 172.21.15.84:0/4068626736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc0b07a0 0x7f66dc0b1c00 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009e60 tx=0x7f66d4009780 comp rx=0 tx=0).stop 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.461+0000 7f66e39d5700 1 -- 172.21.15.84:0/4068626736 shutdown_connections 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.461+0000 7f66e39d5700 1 --2- 172.21.15.84:0/4068626736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc0b07a0 0x7f66dc0b1c00 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.461+0000 7f66e39d5700 1 --2- 172.21.15.84:0/4068626736 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc1595a0 0x7f66dc0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.461+0000 7f66e39d5700 1 -- 172.21.15.84:0/4068626736 >> 172.21.15.84:0/4068626736 conn(0x7f66dc099830 msgr2=0x7f66dc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:40.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.461+0000 7f66e39d5700 1 -- 172.21.15.84:0/4068626736 shutdown_connections 2023-10-06T02:58:40.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.461+0000 7f66e39d5700 1 -- 172.21.15.84:0/4068626736 wait complete. 2023-10-06T02:58:40.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.462+0000 7f66e39d5700 1 Processor -- start 2023-10-06T02:58:40.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.462+0000 7f66e39d5700 1 -- start start 2023-10-06T02:58:40.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e39d5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc0b07a0 0x7f66dc0699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e39d5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc0b49e0 0x7f66dc169520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e39d5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc1595a0 0x7f66dc169a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e39d5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0aed70 con 0x7f66dc1595a0 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e39d5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc169fa0 con 0x7f66dc0b07a0 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e39d5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc16a4a0 con 0x7f66dc0b49e0 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1f72700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc1595a0 0x7f66dc169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1f72700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc1595a0 0x7f66dc169a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36884/0 (socket says 172.21.15.84:36884) 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1f72700 1 -- 172.21.15.84:0/3033377706 learned_addr learned my addr 172.21.15.84:0/3033377706 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1771700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc0b07a0 0x7f66dc0699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1f72700 1 -- 172.21.15.84:0/3033377706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc0b49e0 msgr2=0x7f66dc169520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1f72700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc0b49e0 0x7f66dc169520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1f72700 1 -- 172.21.15.84:0/3033377706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc0b07a0 msgr2=0x7f66dc0699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1f72700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc0b07a0 0x7f66dc0699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1f72700 1 -- 172.21.15.84:0/3033377706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d4009a20 con 0x7f66dc1595a0 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e1f72700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc1595a0 0x7f66dc169a60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f66dc067c60 tx=0x7f66d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66d17fa700 1 -- 172.21.15.84:0/3033377706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4012ea0 con 0x7f66dc1595a0 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66d17fa700 1 -- 172.21.15.84:0/3033377706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d401e630 con 0x7f66dc1595a0 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc16a1c0 con 0x7f66dc1595a0 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66d17fa700 1 -- 172.21.15.84:0/3033377706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d401e9d0 con 0x7f66dc1595a0 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.463+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc16cf10 con 0x7f66dc1595a0 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.464+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc064ad0 con 0x7f66dc1595a0 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.465+0000 7f66d17fa700 1 -- 172.21.15.84:0/3033377706 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66d4024070 con 0x7f66dc1595a0 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.465+0000 7f66d17fa700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66c0066f30 0x7f66c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.465+0000 7f66d17fa700 1 -- 172.21.15.84:0/3033377706 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f66d4087060 con 0x7f66dc1595a0 2023-10-06T02:58:40.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.465+0000 7f66e1771700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66c0066f30 0x7f66c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:40.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.465+0000 7f66e1771700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66c0066f30 0x7f66c00693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f66d8006fd0 tx=0x7f66d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:40.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.469+0000 7f66d17fa700 1 -- 172.21.15.84:0/3033377706 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66d4054030 con 0x7f66dc1595a0 2023-10-06T02:58:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.647+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66dc0b1820 con 0x7f66c0066f30 2023-10-06T02:58:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.655+0000 7f66d17fa700 1 -- 172.21.15.84:0/3033377706 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311440 (secure 0 0 0) 0x7f66dc0b1820 con 0x7f66c0066f30 2023-10-06T02:58:40.660 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:40.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66c0066f30 msgr2=0x7f66c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66c0066f30 0x7f66c00693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f66d8006fd0 tx=0x7f66d8008040 comp rx=0 tx=0).stop 2023-10-06T02:58:40.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc1595a0 msgr2=0x7f66dc169a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:40.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc1595a0 0x7f66dc169a60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f66dc067c60 tx=0x7f66d4019000 comp rx=0 tx=0).stop 2023-10-06T02:58:40.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 shutdown_connections 2023-10-06T02:58:40.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66c0066f30 0x7f66c00693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66dc0b07a0 0x7f66dc0699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66dc1595a0 0x7f66dc169a60 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 --2- 172.21.15.84:0/3033377706 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66dc0b49e0 0x7f66dc169520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 >> 172.21.15.84:0/3033377706 conn(0x7f66dc099830 msgr2=0x7f66dc0cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 shutdown_connections 2023-10-06T02:58:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:40.658+0000 7f66e39d5700 1 -- 172.21.15.84:0/3033377706 wait complete. 2023-10-06T02:58:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:58:40.671 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2023-10-06T02:58:39.847955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385948,"kb_used_data":7644,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588772,"statfs":{"total":773094113280,"available":770650902528,"internally_reserved":0,"allocated":7827456,"data_stored":4282251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.127832"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756678+0000","last_change":"2023-10-06T02:58:34.745441+0000","last_active":"2023-10-06T02:58:34.756678+0000","last_peered":"2023-10-06T02:58:34.756678+0000","last_clean":"2023-10-06T02:58:34.756678+0000","last_became_active":"2023-10-06T02:58:34.744423+0000","last_became_peered":"2023-10-06T02:58:34.744423+0000","last_unstale":"2023-10-06T02:58:34.756678+0000","last_undegraded":"2023-10-06T02:58:34.756678+0000","last_fullsized":"2023-10-06T02:58:34.756678+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753156+0000","last_change":"2023-10-06T02:58:34.746050+0000","last_active":"2023-10-06T02:58:34.753156+0000","last_peered":"2023-10-06T02:58:34.753156+0000","last_clean":"2023-10-06T02:58:34.753156+0000","last_became_active":"2023-10-06T02:58:34.745029+0000","last_became_peered":"2023-10-06T02:58:34.745029+0000","last_unstale":"2023-10-06T02:58:34.753156+0000","last_undegraded":"2023-10-06T02:58:34.753156+0000","last_fullsized":"2023-10-06T02:58:34.753156+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:17.269257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.745016+0000","last_change":"2023-10-06T02:58:34.739633+0000","last_active":"2023-10-06T02:58:34.745016+0000","last_peered":"2023-10-06T02:58:34.745016+0000","last_clean":"2023-10-06T02:58:34.745016+0000","last_became_active":"2023-10-06T02:58:34.739319+0000","last_became_peered":"2023-10-06T02:58:34.739319+0000","last_unstale":"2023-10-06T02:58:34.745016+0000","last_undegraded":"2023-10-06T02:58:34.745016+0000","last_fullsized":"2023-10-06T02:58:34.745016+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:11.966504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752755+0000","last_change":"2023-10-06T02:58:34.744903+0000","last_active":"2023-10-06T02:58:34.752755+0000","last_peered":"2023-10-06T02:58:34.752755+0000","last_clean":"2023-10-06T02:58:34.752755+0000","last_became_active":"2023-10-06T02:58:34.744608+0000","last_became_peered":"2023-10-06T02:58:34.744608+0000","last_unstale":"2023-10-06T02:58:34.752755+0000","last_undegraded":"2023-10-06T02:58:34.752755+0000","last_fullsized":"2023-10-06T02:58:34.752755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:21.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.739267+0000","last_change":"2023-10-06T02:58:34.738101+0000","last_active":"2023-10-06T02:58:34.739267+0000","last_peered":"2023-10-06T02:58:34.739267+0000","last_clean":"2023-10-06T02:58:34.739267+0000","last_became_active":"2023-10-06T02:58:34.737739+0000","last_became_peered":"2023-10-06T02:58:34.737739+0000","last_unstale":"2023-10-06T02:58:34.739267+0000","last_undegraded":"2023-10-06T02:58:34.739267+0000","last_fullsized":"2023-10-06T02:58:34.739267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:50.170481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753162+0000","last_change":"2023-10-06T02:58:34.745244+0000","last_active":"2023-10-06T02:58:34.753162+0000","last_peered":"2023-10-06T02:58:34.753162+0000","last_clean":"2023-10-06T02:58:34.753162+0000","last_became_active":"2023-10-06T02:58:34.744972+0000","last_became_peered":"2023-10-06T02:58:34.744972+0000","last_unstale":"2023-10-06T02:58:34.753162+0000","last_undegraded":"2023-10-06T02:58:34.753162+0000","last_fullsized":"2023-10-06T02:58:34.753162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:44.471161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749309+0000","last_change":"2023-10-06T02:58:34.740643+0000","last_active":"2023-10-06T02:58:34.749309+0000","last_peered":"2023-10-06T02:58:34.749309+0000","last_clean":"2023-10-06T02:58:34.749309+0000","last_became_active":"2023-10-06T02:58:34.740384+0000","last_became_peered":"2023-10-06T02:58:34.740384+0000","last_unstale":"2023-10-06T02:58:34.749309+0000","last_undegraded":"2023-10-06T02:58:34.749309+0000","last_fullsized":"2023-10-06T02:58:34.749309+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752924+0000","last_change":"2023-10-06T02:58:34.737215+0000","last_active":"2023-10-06T02:58:34.752924+0000","last_peered":"2023-10-06T02:58:34.752924+0000","last_clean":"2023-10-06T02:58:34.752924+0000","last_became_active":"2023-10-06T02:58:34.736946+0000","last_became_peered":"2023-10-06T02:58:34.736946+0000","last_unstale":"2023-10-06T02:58:34.752924+0000","last_undegraded":"2023-10-06T02:58:34.752924+0000","last_fullsized":"2023-10-06T02:58:34.752924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:16.904989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.738346+0000","last_change":"2023-10-06T02:58:34.733468+0000","last_active":"2023-10-06T02:58:34.738346+0000","last_peered":"2023-10-06T02:58:34.738346+0000","last_clean":"2023-10-06T02:58:34.738346+0000","last_became_active":"2023-10-06T02:58:34.733055+0000","last_became_peered":"2023-10-06T02:58:34.733055+0000","last_unstale":"2023-10-06T02:58:34.738346+0000","last_undegraded":"2023-10-06T02:58:34.738346+0000","last_fullsized":"2023-10-06T02:58:34.738346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:46.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.748273+0000","last_change":"2023-10-06T02:58:34.734981+0000","last_active":"2023-10-06T02:58:34.748273+0000","last_peered":"2023-10-06T02:58:34.748273+0000","last_clean":"2023-10-06T02:58:34.748273+0000","last_became_active":"2023-10-06T02:58:34.734605+0000","last_became_peered":"2023-10-06T02:58:34.734605+0000","last_unstale":"2023-10-06T02:58:34.748273+0000","last_undegraded":"2023-10-06T02:58:34.748273+0000","last_fullsized":"2023-10-06T02:58:34.748273+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:55.617522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756598+0000","last_change":"2023-10-06T02:58:34.750376+0000","last_active":"2023-10-06T02:58:34.756598+0000","last_peered":"2023-10-06T02:58:34.756598+0000","last_clean":"2023-10-06T02:58:34.756598+0000","last_became_active":"2023-10-06T02:58:34.745915+0000","last_became_peered":"2023-10-06T02:58:34.745915+0000","last_unstale":"2023-10-06T02:58:34.756598+0000","last_undegraded":"2023-10-06T02:58:34.756598+0000","last_fullsized":"2023-10-06T02:58:34.756598+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:57.887007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752706+0000","last_change":"2023-10-06T02:58:34.744552+0000","last_active":"2023-10-06T02:58:34.752706+0000","last_peered":"2023-10-06T02:58:34.752706+0000","last_clean":"2023-10-06T02:58:34.752706+0000","last_became_active":"2023-10-06T02:58:34.741740+0000","last_became_peered":"2023-10-06T02:58:34.741740+0000","last_unstale":"2023-10-06T02:58:34.752706+0000","last_undegraded":"2023-10-06T02:58:34.752706+0000","last_fullsized":"2023-10-06T02:58:34.752706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:50.170481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.743297+0000","last_change":"2023-10-06T02:58:34.738921+0000","last_active":"2023-10-06T02:58:34.743297+0000","last_peered":"2023-10-06T02:58:34.743297+0000","last_clean":"2023-10-06T02:58:34.743297+0000","last_became_active":"2023-10-06T02:58:34.738667+0000","last_became_peered":"2023-10-06T02:58:34.738667+0000","last_unstale":"2023-10-06T02:58:34.743297+0000","last_undegraded":"2023-10-06T02:58:34.743297+0000","last_fullsized":"2023-10-06T02:58:34.743297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749836+0000","last_change":"2023-10-06T02:58:34.744162+0000","last_active":"2023-10-06T02:58:34.749836+0000","last_peered":"2023-10-06T02:58:34.749836+0000","last_clean":"2023-10-06T02:58:34.749836+0000","last_became_active":"2023-10-06T02:58:34.743827+0000","last_became_peered":"2023-10-06T02:58:34.743827+0000","last_unstale":"2023-10-06T02:58:34.749836+0000","last_undegraded":"2023-10-06T02:58:34.749836+0000","last_fullsized":"2023-10-06T02:58:34.749836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:08.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.745360+0000","last_change":"2023-10-06T02:58:34.739723+0000","last_active":"2023-10-06T02:58:34.745360+0000","last_peered":"2023-10-06T02:58:34.745360+0000","last_clean":"2023-10-06T02:58:34.745360+0000","last_became_active":"2023-10-06T02:58:34.739467+0000","last_became_peered":"2023-10-06T02:58:34.739467+0000","last_unstale":"2023-10-06T02:58:34.745360+0000","last_undegraded":"2023-10-06T02:58:34.745360+0000","last_fullsized":"2023-10-06T02:58:34.745360+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:57.887007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749395+0000","last_change":"2023-10-06T02:58:34.739025+0000","last_active":"2023-10-06T02:58:34.749395+0000","last_peered":"2023-10-06T02:58:34.749395+0000","last_clean":"2023-10-06T02:58:34.749395+0000","last_became_active":"2023-10-06T02:58:34.738726+0000","last_became_peered":"2023-10-06T02:58:34.738726+0000","last_unstale":"2023-10-06T02:58:34.749395+0000","last_undegraded":"2023-10-06T02:58:34.749395+0000","last_fullsized":"2023-10-06T02:58:34.749395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.739001+0000","last_change":"2023-10-06T02:58:34.736953+0000","last_active":"2023-10-06T02:58:34.739001+0000","last_peered":"2023-10-06T02:58:34.739001+0000","last_clean":"2023-10-06T02:58:34.739001+0000","last_became_active":"2023-10-06T02:58:34.736650+0000","last_became_peered":"2023-10-06T02:58:34.736650+0000","last_unstale":"2023-10-06T02:58:34.739001+0000","last_undegraded":"2023-10-06T02:58:34.739001+0000","last_fullsized":"2023-10-06T02:58:34.739001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:28.139760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749685+0000","last_change":"2023-10-06T02:58:34.742034+0000","last_active":"2023-10-06T02:58:34.749685+0000","last_peered":"2023-10-06T02:58:34.749685+0000","last_clean":"2023-10-06T02:58:34.749685+0000","last_became_active":"2023-10-06T02:58:34.741753+0000","last_became_peered":"2023-10-06T02:58:34.741753+0000","last_unstale":"2023-10-06T02:58:34.749685+0000","last_undegraded":"2023-10-06T02:58:34.749685+0000","last_fullsized":"2023-10-06T02:58:34.749685+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:28.139760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.751607+0000","last_change":"2023-10-06T02:58:34.734021+0000","last_active":"2023-10-06T02:58:34.751607+0000","last_peered":"2023-10-06T02:58:34.751607+0000","last_clean":"2023-10-06T02:58:34.751607+0000","last_became_active":"2023-10-06T02:58:34.733740+0000","last_became_peered":"2023-10-06T02:58:34.733740+0000","last_unstale":"2023-10-06T02:58:34.751607+0000","last_undegraded":"2023-10-06T02:58:34.751607+0000","last_fullsized":"2023-10-06T02:58:34.751607+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:25.708657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.745204+0000","last_change":"2023-10-06T02:58:34.744198+0000","last_active":"2023-10-06T02:58:34.745204+0000","last_peered":"2023-10-06T02:58:34.745204+0000","last_clean":"2023-10-06T02:58:34.745204+0000","last_became_active":"2023-10-06T02:58:34.743907+0000","last_became_peered":"2023-10-06T02:58:34.743907+0000","last_unstale":"2023-10-06T02:58:34.745204+0000","last_undegraded":"2023-10-06T02:58:34.745204+0000","last_fullsized":"2023-10-06T02:58:34.745204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:32.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749353+0000","last_change":"2023-10-06T02:58:34.738261+0000","last_active":"2023-10-06T02:58:34.749353+0000","last_peered":"2023-10-06T02:58:34.749353+0000","last_clean":"2023-10-06T02:58:34.749353+0000","last_became_active":"2023-10-06T02:58:34.737885+0000","last_became_peered":"2023-10-06T02:58:34.737885+0000","last_unstale":"2023-10-06T02:58:34.749353+0000","last_undegraded":"2023-10-06T02:58:34.749353+0000","last_fullsized":"2023-10-06T02:58:34.749353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:57.887007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.748219+0000","last_change":"2023-10-06T02:58:34.735289+0000","last_active":"2023-10-06T02:58:34.748219+0000","last_peered":"2023-10-06T02:58:34.748219+0000","last_clean":"2023-10-06T02:58:34.748219+0000","last_became_active":"2023-10-06T02:58:34.734523+0000","last_became_peered":"2023-10-06T02:58:34.734523+0000","last_unstale":"2023-10-06T02:58:34.748219+0000","last_undegraded":"2023-10-06T02:58:34.748219+0000","last_fullsized":"2023-10-06T02:58:34.748219+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:41.077463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752051+0000","last_change":"2023-10-06T02:58:34.746217+0000","last_active":"2023-10-06T02:58:34.752051+0000","last_peered":"2023-10-06T02:58:34.752051+0000","last_clean":"2023-10-06T02:58:34.752051+0000","last_became_active":"2023-10-06T02:58:34.745908+0000","last_became_peered":"2023-10-06T02:58:34.745908+0000","last_unstale":"2023-10-06T02:58:34.752051+0000","last_undegraded":"2023-10-06T02:58:34.752051+0000","last_fullsized":"2023-10-06T02:58:34.752051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761568+0000","last_change":"2023-10-06T02:58:34.758007+0000","last_active":"2023-10-06T02:58:34.761568+0000","last_peered":"2023-10-06T02:58:34.761568+0000","last_clean":"2023-10-06T02:58:34.761568+0000","last_became_active":"2023-10-06T02:58:34.756411+0000","last_became_peered":"2023-10-06T02:58:34.756411+0000","last_unstale":"2023-10-06T02:58:34.761568+0000","last_undegraded":"2023-10-06T02:58:34.761568+0000","last_fullsized":"2023-10-06T02:58:34.761568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:02.013607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749371+0000","last_change":"2023-10-06T02:58:34.737235+0000","last_active":"2023-10-06T02:58:34.749371+0000","last_peered":"2023-10-06T02:58:34.749371+0000","last_clean":"2023-10-06T02:58:34.749371+0000","last_became_active":"2023-10-06T02:58:34.736946+0000","last_became_peered":"2023-10-06T02:58:34.736946+0000","last_unstale":"2023-10-06T02:58:34.749371+0000","last_undegraded":"2023-10-06T02:58:34.749371+0000","last_fullsized":"2023-10-06T02:58:34.749371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:00.743751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754484+0000","last_change":"2023-10-06T02:58:34.752722+0000","last_active":"2023-10-06T02:58:34.754484+0000","last_peered":"2023-10-06T02:58:34.754484+0000","last_clean":"2023-10-06T02:58:34.754484+0000","last_became_active":"2023-10-06T02:58:34.752438+0000","last_became_peered":"2023-10-06T02:58:34.752438+0000","last_unstale":"2023-10-06T02:58:34.754484+0000","last_undegraded":"2023-10-06T02:58:34.754484+0000","last_fullsized":"2023-10-06T02:58:34.754484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753272+0000","last_change":"2023-10-06T02:58:34.751410+0000","last_active":"2023-10-06T02:58:34.753272+0000","last_peered":"2023-10-06T02:58:34.753272+0000","last_clean":"2023-10-06T02:58:34.753272+0000","last_became_active":"2023-10-06T02:58:34.751060+0000","last_became_peered":"2023-10-06T02:58:34.751060+0000","last_unstale":"2023-10-06T02:58:34.753272+0000","last_undegraded":"2023-10-06T02:58:34.753272+0000","last_fullsized":"2023-10-06T02:58:34.753272+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:11.597600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.748248+0000","last_change":"2023-10-06T02:58:34.734580+0000","last_active":"2023-10-06T02:58:34.748248+0000","last_peered":"2023-10-06T02:58:34.748248+0000","last_clean":"2023-10-06T02:58:34.748248+0000","last_became_active":"2023-10-06T02:58:34.734269+0000","last_became_peered":"2023-10-06T02:58:34.734269+0000","last_unstale":"2023-10-06T02:58:34.748248+0000","last_undegraded":"2023-10-06T02:58:34.748248+0000","last_fullsized":"2023-10-06T02:58:34.748248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:13.097392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749771+0000","last_change":"2023-10-06T02:58:34.746233+0000","last_active":"2023-10-06T02:58:34.749771+0000","last_peered":"2023-10-06T02:58:34.749771+0000","last_clean":"2023-10-06T02:58:34.749771+0000","last_became_active":"2023-10-06T02:58:34.746061+0000","last_became_peered":"2023-10-06T02:58:34.746061+0000","last_unstale":"2023-10-06T02:58:34.749771+0000","last_undegraded":"2023-10-06T02:58:34.749771+0000","last_fullsized":"2023-10-06T02:58:34.749771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:37.723774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754488+0000","last_change":"2023-10-06T02:58:34.752612+0000","last_active":"2023-10-06T02:58:34.754488+0000","last_peered":"2023-10-06T02:58:34.754488+0000","last_clean":"2023-10-06T02:58:34.754488+0000","last_became_active":"2023-10-06T02:58:34.752358+0000","last_became_peered":"2023-10-06T02:58:34.752358+0000","last_unstale":"2023-10-06T02:58:34.754488+0000","last_undegraded":"2023-10-06T02:58:34.754488+0000","last_fullsized":"2023-10-06T02:58:34.754488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:25.003429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749331+0000","last_change":"2023-10-06T02:58:34.741091+0000","last_active":"2023-10-06T02:58:34.749331+0000","last_peered":"2023-10-06T02:58:34.749331+0000","last_clean":"2023-10-06T02:58:34.749331+0000","last_became_active":"2023-10-06T02:58:34.740843+0000","last_became_peered":"2023-10-06T02:58:34.740843+0000","last_unstale":"2023-10-06T02:58:34.749331+0000","last_undegraded":"2023-10-06T02:58:34.749331+0000","last_fullsized":"2023-10-06T02:58:34.749331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:44.834919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752945+0000","last_change":"2023-10-06T02:58:34.743358+0000","last_active":"2023-10-06T02:58:34.752945+0000","last_peered":"2023-10-06T02:58:34.752945+0000","last_clean":"2023-10-06T02:58:34.752945+0000","last_became_active":"2023-10-06T02:58:34.736611+0000","last_became_peered":"2023-10-06T02:58:34.736611+0000","last_unstale":"2023-10-06T02:58:34.752945+0000","last_undegraded":"2023-10-06T02:58:34.752945+0000","last_fullsized":"2023-10-06T02:58:34.752945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:37.753986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761459+0000","last_change":"2023-10-06T02:58:34.757003+0000","last_active":"2023-10-06T02:58:34.761459+0000","last_peered":"2023-10-06T02:58:34.761459+0000","last_clean":"2023-10-06T02:58:34.761459+0000","last_became_active":"2023-10-06T02:58:34.756723+0000","last_became_peered":"2023-10-06T02:58:34.756723+0000","last_unstale":"2023-10-06T02:58:34.761459+0000","last_undegraded":"2023-10-06T02:58:34.761459+0000","last_fullsized":"2023-10-06T02:58:34.761459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761658+0000","last_change":"2023-10-06T02:58:33.745475+0000","last_active":"2023-10-06T02:58:34.761658+0000","last_peered":"2023-10-06T02:58:34.761658+0000","last_clean":"2023-10-06T02:58:34.761658+0000","last_became_active":"2023-10-06T02:58:33.745233+0000","last_became_peered":"2023-10-06T02:58:33.745233+0000","last_unstale":"2023-10-06T02:58:34.761658+0000","last_undegraded":"2023-10-06T02:58:34.761658+0000","last_fullsized":"2023-10-06T02:58:34.761658+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.739313+0000","last_change":"2023-10-06T02:58:34.737294+0000","last_active":"2023-10-06T02:58:34.739313+0000","last_peered":"2023-10-06T02:58:34.739313+0000","last_clean":"2023-10-06T02:58:34.739313+0000","last_became_active":"2023-10-06T02:58:34.736954+0000","last_became_peered":"2023-10-06T02:58:34.736954+0000","last_unstale":"2023-10-06T02:58:34.739313+0000","last_undegraded":"2023-10-06T02:58:34.739313+0000","last_fullsized":"2023-10-06T02:58:34.739313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.419076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.759886+0000","last_change":"2023-10-06T02:58:33.732849+0000","last_active":"2023-10-06T02:58:34.759886+0000","last_peered":"2023-10-06T02:58:34.759886+0000","last_clean":"2023-10-06T02:58:34.759886+0000","last_became_active":"2023-10-06T02:58:33.732239+0000","last_became_peered":"2023-10-06T02:58:33.732239+0000","last_unstale":"2023-10-06T02:58:34.759886+0000","last_undegraded":"2023-10-06T02:58:34.759886+0000","last_fullsized":"2023-10-06T02:58:34.759886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752942+0000","last_change":"2023-10-06T02:58:34.741688+0000","last_active":"2023-10-06T02:58:34.752942+0000","last_peered":"2023-10-06T02:58:34.752942+0000","last_clean":"2023-10-06T02:58:34.752942+0000","last_became_active":"2023-10-06T02:58:34.741401+0000","last_became_peered":"2023-10-06T02:58:34.741401+0000","last_unstale":"2023-10-06T02:58:34.752942+0000","last_undegraded":"2023-10-06T02:58:34.752942+0000","last_fullsized":"2023-10-06T02:58:34.752942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:15.941629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.758675+0000","last_change":"2023-10-06T02:58:33.733506+0000","last_active":"2023-10-06T02:58:34.758675+0000","last_peered":"2023-10-06T02:58:34.758675+0000","last_clean":"2023-10-06T02:58:34.758675+0000","last_became_active":"2023-10-06T02:58:33.733249+0000","last_became_peered":"2023-10-06T02:58:33.733249+0000","last_unstale":"2023-10-06T02:58:34.758675+0000","last_undegraded":"2023-10-06T02:58:34.758675+0000","last_fullsized":"2023-10-06T02:58:34.758675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756140+0000","last_change":"2023-10-06T02:58:34.750170+0000","last_active":"2023-10-06T02:58:34.756140+0000","last_peered":"2023-10-06T02:58:34.756140+0000","last_clean":"2023-10-06T02:58:34.756140+0000","last_became_active":"2023-10-06T02:58:34.745489+0000","last_became_peered":"2023-10-06T02:58:34.745489+0000","last_unstale":"2023-10-06T02:58:34.756140+0000","last_undegraded":"2023-10-06T02:58:34.756140+0000","last_fullsized":"2023-10-06T02:58:34.756140+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:32.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755285+0000","last_change":"2023-10-06T02:58:33.743169+0000","last_active":"2023-10-06T02:58:34.755285+0000","last_peered":"2023-10-06T02:58:34.755285+0000","last_clean":"2023-10-06T02:58:34.755285+0000","last_became_active":"2023-10-06T02:58:33.742892+0000","last_became_peered":"2023-10-06T02:58:33.742892+0000","last_unstale":"2023-10-06T02:58:34.755285+0000","last_undegraded":"2023-10-06T02:58:34.755285+0000","last_fullsized":"2023-10-06T02:58:34.755285+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:07.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.750117+0000","last_change":"2023-10-06T02:58:34.742428+0000","last_active":"2023-10-06T02:58:34.750117+0000","last_peered":"2023-10-06T02:58:34.750117+0000","last_clean":"2023-10-06T02:58:34.750117+0000","last_became_active":"2023-10-06T02:58:34.742186+0000","last_became_peered":"2023-10-06T02:58:34.742186+0000","last_unstale":"2023-10-06T02:58:34.750117+0000","last_undegraded":"2023-10-06T02:58:34.750117+0000","last_fullsized":"2023-10-06T02:58:34.750117+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749895+0000","last_change":"2023-10-06T02:58:33.734217+0000","last_active":"2023-10-06T02:58:34.749895+0000","last_peered":"2023-10-06T02:58:34.749895+0000","last_clean":"2023-10-06T02:58:34.749895+0000","last_became_active":"2023-10-06T02:58:33.733894+0000","last_became_peered":"2023-10-06T02:58:33.733894+0000","last_unstale":"2023-10-06T02:58:34.749895+0000","last_undegraded":"2023-10-06T02:58:34.749895+0000","last_fullsized":"2023-10-06T02:58:34.749895+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:31.585062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749332+0000","last_change":"2023-10-06T02:58:34.738102+0000","last_active":"2023-10-06T02:58:34.749332+0000","last_peered":"2023-10-06T02:58:34.749332+0000","last_clean":"2023-10-06T02:58:34.749332+0000","last_became_active":"2023-10-06T02:58:34.737593+0000","last_became_peered":"2023-10-06T02:58:34.737593+0000","last_unstale":"2023-10-06T02:58:34.749332+0000","last_undegraded":"2023-10-06T02:58:34.749332+0000","last_fullsized":"2023-10-06T02:58:34.749332+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:48.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.760012+0000","last_change":"2023-10-06T02:58:33.736095+0000","last_active":"2023-10-06T02:58:34.760012+0000","last_peered":"2023-10-06T02:58:34.760012+0000","last_clean":"2023-10-06T02:58:34.760012+0000","last_became_active":"2023-10-06T02:58:33.735839+0000","last_became_peered":"2023-10-06T02:58:33.735839+0000","last_unstale":"2023-10-06T02:58:34.760012+0000","last_undegraded":"2023-10-06T02:58:34.760012+0000","last_fullsized":"2023-10-06T02:58:34.760012+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.738009+0000","last_change":"2023-10-06T02:58:34.734656+0000","last_active":"2023-10-06T02:58:34.738009+0000","last_peered":"2023-10-06T02:58:34.738009+0000","last_clean":"2023-10-06T02:58:34.738009+0000","last_became_active":"2023-10-06T02:58:34.734402+0000","last_became_peered":"2023-10-06T02:58:34.734402+0000","last_unstale":"2023-10-06T02:58:34.738009+0000","last_undegraded":"2023-10-06T02:58:34.738009+0000","last_fullsized":"2023-10-06T02:58:34.738009+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:02.147902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.730067+0000","last_change":"2023-10-06T02:58:33.742149+0000","last_active":"2023-10-06T02:58:34.730067+0000","last_peered":"2023-10-06T02:58:34.730067+0000","last_clean":"2023-10-06T02:58:34.730067+0000","last_became_active":"2023-10-06T02:58:33.741911+0000","last_became_peered":"2023-10-06T02:58:33.741911+0000","last_unstale":"2023-10-06T02:58:34.730067+0000","last_undegraded":"2023-10-06T02:58:34.730067+0000","last_fullsized":"2023-10-06T02:58:34.730067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.744132+0000","last_change":"2023-10-06T02:58:34.738974+0000","last_active":"2023-10-06T02:58:34.744132+0000","last_peered":"2023-10-06T02:58:34.744132+0000","last_clean":"2023-10-06T02:58:34.744132+0000","last_became_active":"2023-10-06T02:58:34.738726+0000","last_became_peered":"2023-10-06T02:58:34.738726+0000","last_unstale":"2023-10-06T02:58:34.744132+0000","last_undegraded":"2023-10-06T02:58:34.744132+0000","last_fullsized":"2023-10-06T02:58:34.744132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:55.617522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725040+0000","last_change":"2023-10-06T02:58:33.743119+0000","last_active":"2023-10-06T02:58:34.725040+0000","last_peered":"2023-10-06T02:58:34.725040+0000","last_clean":"2023-10-06T02:58:34.725040+0000","last_became_active":"2023-10-06T02:58:33.742849+0000","last_became_peered":"2023-10-06T02:58:33.742849+0000","last_unstale":"2023-10-06T02:58:34.725040+0000","last_undegraded":"2023-10-06T02:58:34.725040+0000","last_fullsized":"2023-10-06T02:58:34.725040+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:10.552745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749600+0000","last_change":"2023-10-06T02:58:34.748065+0000","last_active":"2023-10-06T02:58:34.749600+0000","last_peered":"2023-10-06T02:58:34.749600+0000","last_clean":"2023-10-06T02:58:34.749600+0000","last_became_active":"2023-10-06T02:58:34.747759+0000","last_became_peered":"2023-10-06T02:58:34.747759+0000","last_unstale":"2023-10-06T02:58:34.749600+0000","last_undegraded":"2023-10-06T02:58:34.749600+0000","last_fullsized":"2023-10-06T02:58:34.749600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725794+0000","last_change":"2023-10-06T02:58:33.734599+0000","last_active":"2023-10-06T02:58:34.725794+0000","last_peered":"2023-10-06T02:58:34.725794+0000","last_clean":"2023-10-06T02:58:34.725794+0000","last_became_active":"2023-10-06T02:58:33.734161+0000","last_became_peered":"2023-10-06T02:58:33.734161+0000","last_unstale":"2023-10-06T02:58:34.725794+0000","last_undegraded":"2023-10-06T02:58:34.725794+0000","last_fullsized":"2023-10-06T02:58:34.725794+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:10.358630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761525+0000","last_change":"2023-10-06T02:58:34.757856+0000","last_active":"2023-10-06T02:58:34.761525+0000","last_peered":"2023-10-06T02:58:34.761525+0000","last_clean":"2023-10-06T02:58:34.761525+0000","last_became_active":"2023-10-06T02:58:34.757568+0000","last_became_peered":"2023-10-06T02:58:34.757568+0000","last_unstale":"2023-10-06T02:58:34.761525+0000","last_undegraded":"2023-10-06T02:58:34.761525+0000","last_fullsized":"2023-10-06T02:58:34.761525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.623378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.726946+0000","last_change":"2023-10-06T02:58:33.733304+0000","last_active":"2023-10-06T02:58:34.726946+0000","last_peered":"2023-10-06T02:58:34.726946+0000","last_clean":"2023-10-06T02:58:34.726946+0000","last_became_active":"2023-10-06T02:58:33.733025+0000","last_became_peered":"2023-10-06T02:58:33.733025+0000","last_unstale":"2023-10-06T02:58:34.726946+0000","last_undegraded":"2023-10-06T02:58:34.726946+0000","last_fullsized":"2023-10-06T02:58:34.726946+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753271+0000","last_change":"2023-10-06T02:58:34.745510+0000","last_active":"2023-10-06T02:58:34.753271+0000","last_peered":"2023-10-06T02:58:34.753271+0000","last_clean":"2023-10-06T02:58:34.753271+0000","last_became_active":"2023-10-06T02:58:34.745251+0000","last_became_peered":"2023-10-06T02:58:34.745251+0000","last_unstale":"2023-10-06T02:58:34.753271+0000","last_undegraded":"2023-10-06T02:58:34.753271+0000","last_fullsized":"2023-10-06T02:58:34.753271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:23.859199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"67'3","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754555+0000","last_change":"2023-10-06T02:58:33.734221+0000","last_active":"2023-10-06T02:58:34.754555+0000","last_peered":"2023-10-06T02:58:34.754555+0000","last_clean":"2023-10-06T02:58:34.754555+0000","last_became_active":"2023-10-06T02:58:33.733961+0000","last_became_peered":"2023-10-06T02:58:33.733961+0000","last_unstale":"2023-10-06T02:58:34.754555+0000","last_undegraded":"2023-10-06T02:58:34.754555+0000","last_fullsized":"2023-10-06T02:58:34.754555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:02.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.737983+0000","last_change":"2023-10-06T02:58:34.734389+0000","last_active":"2023-10-06T02:58:34.737983+0000","last_peered":"2023-10-06T02:58:34.737983+0000","last_clean":"2023-10-06T02:58:34.737983+0000","last_became_active":"2023-10-06T02:58:34.734119+0000","last_became_peered":"2023-10-06T02:58:34.734119+0000","last_unstale":"2023-10-06T02:58:34.737983+0000","last_undegraded":"2023-10-06T02:58:34.737983+0000","last_fullsized":"2023-10-06T02:58:34.737983+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"67'6","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755314+0000","last_change":"2023-10-06T02:58:33.742820+0000","last_active":"2023-10-06T02:58:34.755314+0000","last_peered":"2023-10-06T02:58:34.755314+0000","last_clean":"2023-10-06T02:58:34.755314+0000","last_became_active":"2023-10-06T02:58:33.742572+0000","last_became_peered":"2023-10-06T02:58:33.742572+0000","last_unstale":"2023-10-06T02:58:34.755314+0000","last_undegraded":"2023-10-06T02:58:34.755314+0000","last_fullsized":"2023-10-06T02:58:34.755314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.744526+0000","last_change":"2023-10-06T02:58:34.738685+0000","last_active":"2023-10-06T02:58:34.744526+0000","last_peered":"2023-10-06T02:58:34.744526+0000","last_clean":"2023-10-06T02:58:34.744526+0000","last_became_active":"2023-10-06T02:58:34.738392+0000","last_became_peered":"2023-10-06T02:58:34.738392+0000","last_unstale":"2023-10-06T02:58:34.744526+0000","last_undegraded":"2023-10-06T02:58:34.744526+0000","last_fullsized":"2023-10-06T02:58:34.744526+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.759813+0000","last_change":"2023-10-06T02:58:33.742960+0000","last_active":"2023-10-06T02:58:34.759813+0000","last_peered":"2023-10-06T02:58:34.759813+0000","last_clean":"2023-10-06T02:58:34.759813+0000","last_became_active":"2023-10-06T02:58:33.742690+0000","last_became_peered":"2023-10-06T02:58:33.742690+0000","last_unstale":"2023-10-06T02:58:34.759813+0000","last_undegraded":"2023-10-06T02:58:34.759813+0000","last_fullsized":"2023-10-06T02:58:34.759813+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749990+0000","last_change":"2023-10-06T02:58:34.748805+0000","last_active":"2023-10-06T02:58:34.749990+0000","last_peered":"2023-10-06T02:58:34.749990+0000","last_clean":"2023-10-06T02:58:34.749990+0000","last_became_active":"2023-10-06T02:58:34.748562+0000","last_became_peered":"2023-10-06T02:58:34.748562+0000","last_unstale":"2023-10-06T02:58:34.749990+0000","last_undegraded":"2023-10-06T02:58:34.749990+0000","last_fullsized":"2023-10-06T02:58:34.749990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:16.237630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.727478+0000","last_change":"2023-10-06T02:58:33.734770+0000","last_active":"2023-10-06T02:58:34.727478+0000","last_peered":"2023-10-06T02:58:34.727478+0000","last_clean":"2023-10-06T02:58:34.727478+0000","last_became_active":"2023-10-06T02:58:33.734351+0000","last_became_peered":"2023-10-06T02:58:33.734351+0000","last_unstale":"2023-10-06T02:58:34.727478+0000","last_undegraded":"2023-10-06T02:58:34.727478+0000","last_fullsized":"2023-10-06T02:58:34.727478+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:59.626445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.759550+0000","last_change":"2023-10-06T02:58:34.746122+0000","last_active":"2023-10-06T02:58:34.759550+0000","last_peered":"2023-10-06T02:58:34.759550+0000","last_clean":"2023-10-06T02:58:34.759550+0000","last_became_active":"2023-10-06T02:58:34.745854+0000","last_became_peered":"2023-10-06T02:58:34.745854+0000","last_unstale":"2023-10-06T02:58:34.759550+0000","last_undegraded":"2023-10-06T02:58:34.759550+0000","last_fullsized":"2023-10-06T02:58:34.759550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.623378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735737+0000","last_change":"2023-10-06T02:58:33.736152+0000","last_active":"2023-10-06T02:58:34.735737+0000","last_peered":"2023-10-06T02:58:34.735737+0000","last_clean":"2023-10-06T02:58:34.735737+0000","last_became_active":"2023-10-06T02:58:33.735725+0000","last_became_peered":"2023-10-06T02:58:33.735725+0000","last_unstale":"2023-10-06T02:58:34.735737+0000","last_undegraded":"2023-10-06T02:58:34.735737+0000","last_fullsized":"2023-10-06T02:58:34.735737+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.949148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.738379+0000","last_change":"2023-10-06T02:58:34.736184+0000","last_active":"2023-10-06T02:58:34.738379+0000","last_peered":"2023-10-06T02:58:34.738379+0000","last_clean":"2023-10-06T02:58:34.738379+0000","last_became_active":"2023-10-06T02:58:34.735934+0000","last_became_peered":"2023-10-06T02:58:34.735934+0000","last_unstale":"2023-10-06T02:58:34.738379+0000","last_undegraded":"2023-10-06T02:58:34.738379+0000","last_fullsized":"2023-10-06T02:58:34.738379+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:10.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"67'8","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.762438+0000","last_change":"2023-10-06T02:58:33.734055+0000","last_active":"2023-10-06T02:58:34.762438+0000","last_peered":"2023-10-06T02:58:34.762438+0000","last_clean":"2023-10-06T02:58:34.762438+0000","last_became_active":"2023-10-06T02:58:33.733756+0000","last_became_peered":"2023-10-06T02:58:33.733756+0000","last_unstale":"2023-10-06T02:58:34.762438+0000","last_undegraded":"2023-10-06T02:58:34.762438+0000","last_fullsized":"2023-10-06T02:58:34.762438+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:27.263593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.741625+0000","last_change":"2023-10-06T02:58:34.738603+0000","last_active":"2023-10-06T02:58:34.741625+0000","last_peered":"2023-10-06T02:58:34.741625+0000","last_clean":"2023-10-06T02:58:34.741625+0000","last_became_active":"2023-10-06T02:58:34.738326+0000","last_became_peered":"2023-10-06T02:58:34.738326+0000","last_unstale":"2023-10-06T02:58:34.741625+0000","last_undegraded":"2023-10-06T02:58:34.741625+0000","last_fullsized":"2023-10-06T02:58:34.741625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754140+0000","last_change":"2023-10-06T02:58:33.735367+0000","last_active":"2023-10-06T02:58:34.754140+0000","last_peered":"2023-10-06T02:58:34.754140+0000","last_clean":"2023-10-06T02:58:34.754140+0000","last_became_active":"2023-10-06T02:58:33.734942+0000","last_became_peered":"2023-10-06T02:58:33.734942+0000","last_unstale":"2023-10-06T02:58:34.754140+0000","last_undegraded":"2023-10-06T02:58:34.754140+0000","last_fullsized":"2023-10-06T02:58:34.754140+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.750081+0000","last_change":"2023-10-06T02:58:34.740751+0000","last_active":"2023-10-06T02:58:34.750081+0000","last_peered":"2023-10-06T02:58:34.750081+0000","last_clean":"2023-10-06T02:58:34.750081+0000","last_became_active":"2023-10-06T02:58:34.740501+0000","last_became_peered":"2023-10-06T02:58:34.740501+0000","last_unstale":"2023-10-06T02:58:34.750081+0000","last_undegraded":"2023-10-06T02:58:34.750081+0000","last_fullsized":"2023-10-06T02:58:34.750081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"68'1","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-06T02:58:36.308798+0000","last_change":"2023-10-06T02:58:33.736226+0000","last_active":"2023-10-06T02:58:36.308798+0000","last_peered":"2023-10-06T02:58:36.308798+0000","last_clean":"2023-10-06T02:58:36.308798+0000","last_became_active":"2023-10-06T02:58:33.735569+0000","last_became_peered":"2023-10-06T02:58:33.735569+0000","last_unstale":"2023-10-06T02:58:36.308798+0000","last_undegraded":"2023-10-06T02:58:36.308798+0000","last_fullsized":"2023-10-06T02:58:36.308798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761483+0000","last_change":"2023-10-06T02:58:34.757525+0000","last_active":"2023-10-06T02:58:34.761483+0000","last_peered":"2023-10-06T02:58:34.761483+0000","last_clean":"2023-10-06T02:58:34.761483+0000","last_became_active":"2023-10-06T02:58:34.756383+0000","last_became_peered":"2023-10-06T02:58:34.756383+0000","last_unstale":"2023-10-06T02:58:34.761483+0000","last_undegraded":"2023-10-06T02:58:34.761483+0000","last_fullsized":"2023-10-06T02:58:34.761483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:07.588359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.726144+0000","last_change":"2023-10-06T02:58:33.735368+0000","last_active":"2023-10-06T02:58:34.726144+0000","last_peered":"2023-10-06T02:58:34.726144+0000","last_clean":"2023-10-06T02:58:34.726144+0000","last_became_active":"2023-10-06T02:58:33.735110+0000","last_became_peered":"2023-10-06T02:58:33.735110+0000","last_unstale":"2023-10-06T02:58:34.726144+0000","last_undegraded":"2023-10-06T02:58:34.726144+0000","last_fullsized":"2023-10-06T02:58:34.726144+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:24.789985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756627+0000","last_change":"2023-10-06T02:58:34.750506+0000","last_active":"2023-10-06T02:58:34.756627+0000","last_peered":"2023-10-06T02:58:34.756627+0000","last_clean":"2023-10-06T02:58:34.756627+0000","last_became_active":"2023-10-06T02:58:34.750158+0000","last_became_peered":"2023-10-06T02:58:34.750158+0000","last_unstale":"2023-10-06T02:58:34.756627+0000","last_undegraded":"2023-10-06T02:58:34.756627+0000","last_fullsized":"2023-10-06T02:58:34.756627+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.730138+0000","last_change":"2023-10-06T02:58:33.727028+0000","last_active":"2023-10-06T02:58:34.730138+0000","last_peered":"2023-10-06T02:58:34.730138+0000","last_clean":"2023-10-06T02:58:34.730138+0000","last_became_active":"2023-10-06T02:58:33.726742+0000","last_became_peered":"2023-10-06T02:58:33.726742+0000","last_unstale":"2023-10-06T02:58:34.730138+0000","last_undegraded":"2023-10-06T02:58:34.730138+0000","last_fullsized":"2023-10-06T02:58:34.730138+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.737825+0000","last_change":"2023-10-06T02:58:34.733654+0000","last_active":"2023-10-06T02:58:34.737825+0000","last_peered":"2023-10-06T02:58:34.737825+0000","last_clean":"2023-10-06T02:58:34.737825+0000","last_became_active":"2023-10-06T02:58:34.733031+0000","last_became_peered":"2023-10-06T02:58:34.733031+0000","last_unstale":"2023-10-06T02:58:34.737825+0000","last_undegraded":"2023-10-06T02:58:34.737825+0000","last_fullsized":"2023-10-06T02:58:34.737825+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:12.873779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725392+0000","last_change":"2023-10-06T02:58:33.733340+0000","last_active":"2023-10-06T02:58:34.725392+0000","last_peered":"2023-10-06T02:58:34.725392+0000","last_clean":"2023-10-06T02:58:34.725392+0000","last_became_active":"2023-10-06T02:58:33.733080+0000","last_became_peered":"2023-10-06T02:58:33.733080+0000","last_unstale":"2023-10-06T02:58:34.725392+0000","last_undegraded":"2023-10-06T02:58:34.725392+0000","last_fullsized":"2023-10-06T02:58:34.725392+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:32.544670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752836+0000","last_change":"2023-10-06T02:58:34.741338+0000","last_active":"2023-10-06T02:58:34.752836+0000","last_peered":"2023-10-06T02:58:34.752836+0000","last_clean":"2023-10-06T02:58:34.752836+0000","last_became_active":"2023-10-06T02:58:34.739399+0000","last_became_peered":"2023-10-06T02:58:34.739399+0000","last_unstale":"2023-10-06T02:58:34.752836+0000","last_undegraded":"2023-10-06T02:58:34.752836+0000","last_fullsized":"2023-10-06T02:58:34.752836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:37.916870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.730173+0000","last_change":"2023-10-06T02:58:33.742848+0000","last_active":"2023-10-06T02:58:34.730173+0000","last_peered":"2023-10-06T02:58:34.730173+0000","last_clean":"2023-10-06T02:58:34.730173+0000","last_became_active":"2023-10-06T02:58:33.742585+0000","last_became_peered":"2023-10-06T02:58:33.742585+0000","last_unstale":"2023-10-06T02:58:34.730173+0000","last_undegraded":"2023-10-06T02:58:34.730173+0000","last_fullsized":"2023-10-06T02:58:34.730173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.742027+0000","last_change":"2023-10-06T02:58:34.738583+0000","last_active":"2023-10-06T02:58:34.742027+0000","last_peered":"2023-10-06T02:58:34.742027+0000","last_clean":"2023-10-06T02:58:34.742027+0000","last_became_active":"2023-10-06T02:58:34.738385+0000","last_became_peered":"2023-10-06T02:58:34.738385+0000","last_unstale":"2023-10-06T02:58:34.742027+0000","last_undegraded":"2023-10-06T02:58:34.742027+0000","last_fullsized":"2023-10-06T02:58:34.742027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:10.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.726187+0000","last_change":"2023-10-06T02:58:33.740591+0000","last_active":"2023-10-06T02:58:34.726187+0000","last_peered":"2023-10-06T02:58:34.726187+0000","last_clean":"2023-10-06T02:58:34.726187+0000","last_became_active":"2023-10-06T02:58:33.740329+0000","last_became_peered":"2023-10-06T02:58:33.740329+0000","last_unstale":"2023-10-06T02:58:34.726187+0000","last_undegraded":"2023-10-06T02:58:34.726187+0000","last_fullsized":"2023-10-06T02:58:34.726187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.751587+0000","last_change":"2023-10-06T02:58:34.734191+0000","last_active":"2023-10-06T02:58:34.751587+0000","last_peered":"2023-10-06T02:58:34.751587+0000","last_clean":"2023-10-06T02:58:34.751587+0000","last_became_active":"2023-10-06T02:58:34.733879+0000","last_became_peered":"2023-10-06T02:58:34.733879+0000","last_unstale":"2023-10-06T02:58:34.751587+0000","last_undegraded":"2023-10-06T02:58:34.751587+0000","last_fullsized":"2023-10-06T02:58:34.751587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:22.316351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725270+0000","last_change":"2023-10-06T02:58:33.745606+0000","last_active":"2023-10-06T02:58:34.725270+0000","last_peered":"2023-10-06T02:58:34.725270+0000","last_clean":"2023-10-06T02:58:34.725270+0000","last_became_active":"2023-10-06T02:58:33.745246+0000","last_became_peered":"2023-10-06T02:58:33.745246+0000","last_unstale":"2023-10-06T02:58:34.725270+0000","last_undegraded":"2023-10-06T02:58:34.725270+0000","last_fullsized":"2023-10-06T02:58:34.725270+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:45.339807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.747263+0000","last_change":"2023-10-06T02:58:34.743038+0000","last_active":"2023-10-06T02:58:34.747263+0000","last_peered":"2023-10-06T02:58:34.747263+0000","last_clean":"2023-10-06T02:58:34.747263+0000","last_became_active":"2023-10-06T02:58:34.742788+0000","last_became_peered":"2023-10-06T02:58:34.742788+0000","last_unstale":"2023-10-06T02:58:34.747263+0000","last_undegraded":"2023-10-06T02:58:34.747263+0000","last_fullsized":"2023-10-06T02:58:34.747263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:21.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.733402+0000","last_change":"2023-10-06T02:58:33.742273+0000","last_active":"2023-10-06T02:58:34.733402+0000","last_peered":"2023-10-06T02:58:34.733402+0000","last_clean":"2023-10-06T02:58:34.733402+0000","last_became_active":"2023-10-06T02:58:33.741934+0000","last_became_peered":"2023-10-06T02:58:33.741934+0000","last_unstale":"2023-10-06T02:58:34.733402+0000","last_undegraded":"2023-10-06T02:58:34.733402+0000","last_fullsized":"2023-10-06T02:58:34.733402+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:15.613100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.731116+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:58:34.731116+0000","last_peered":"2023-10-06T02:58:34.731116+0000","last_clean":"2023-10-06T02:58:34.731116+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:58:34.731116+0000","last_undegraded":"2023-10-06T02:58:34.731116+0000","last_fullsized":"2023-10-06T02:58:34.731116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.741445+0000","last_change":"2023-10-06T02:58:34.737742+0000","last_active":"2023-10-06T02:58:34.741445+0000","last_peered":"2023-10-06T02:58:34.741445+0000","last_clean":"2023-10-06T02:58:34.741445+0000","last_became_active":"2023-10-06T02:58:34.737502+0000","last_became_peered":"2023-10-06T02:58:34.737502+0000","last_unstale":"2023-10-06T02:58:34.741445+0000","last_undegraded":"2023-10-06T02:58:34.741445+0000","last_fullsized":"2023-10-06T02:58:34.741445+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:27.363276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.727585+0000","last_change":"2023-10-06T02:58:33.732697+0000","last_active":"2023-10-06T02:58:34.727585+0000","last_peered":"2023-10-06T02:58:34.727585+0000","last_clean":"2023-10-06T02:58:34.727585+0000","last_became_active":"2023-10-06T02:58:33.732421+0000","last_became_peered":"2023-10-06T02:58:33.732421+0000","last_unstale":"2023-10-06T02:58:34.727585+0000","last_undegraded":"2023-10-06T02:58:34.727585+0000","last_fullsized":"2023-10-06T02:58:34.727585+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735698+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:58:34.735698+0000","last_peered":"2023-10-06T02:58:34.735698+0000","last_clean":"2023-10-06T02:58:34.735698+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:58:34.735698+0000","last_undegraded":"2023-10-06T02:58:34.735698+0000","last_fullsized":"2023-10-06T02:58:34.735698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749715+0000","last_change":"2023-10-06T02:58:34.745739+0000","last_active":"2023-10-06T02:58:34.749715+0000","last_peered":"2023-10-06T02:58:34.749715+0000","last_clean":"2023-10-06T02:58:34.749715+0000","last_became_active":"2023-10-06T02:58:34.745460+0000","last_became_peered":"2023-10-06T02:58:34.745460+0000","last_unstale":"2023-10-06T02:58:34.749715+0000","last_undegraded":"2023-10-06T02:58:34.749715+0000","last_fullsized":"2023-10-06T02:58:34.749715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:07.604975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735812+0000","last_change":"2023-10-06T02:58:33.735296+0000","last_active":"2023-10-06T02:58:34.735812+0000","last_peered":"2023-10-06T02:58:34.735812+0000","last_clean":"2023-10-06T02:58:34.735812+0000","last_became_active":"2023-10-06T02:58:33.735041+0000","last_became_peered":"2023-10-06T02:58:33.735041+0000","last_unstale":"2023-10-06T02:58:34.735812+0000","last_undegraded":"2023-10-06T02:58:34.735812+0000","last_fullsized":"2023-10-06T02:58:34.735812+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:12.846129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725215+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:58:34.725215+0000","last_peered":"2023-10-06T02:58:34.725215+0000","last_clean":"2023-10-06T02:58:34.725215+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:58:34.725215+0000","last_undegraded":"2023-10-06T02:58:34.725215+0000","last_fullsized":"2023-10-06T02:58:34.725215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753200+0000","last_change":"2023-10-06T02:58:34.752352+0000","last_active":"2023-10-06T02:58:34.753200+0000","last_peered":"2023-10-06T02:58:34.753200+0000","last_clean":"2023-10-06T02:58:34.753200+0000","last_became_active":"2023-10-06T02:58:34.752080+0000","last_became_peered":"2023-10-06T02:58:34.752080+0000","last_unstale":"2023-10-06T02:58:34.753200+0000","last_undegraded":"2023-10-06T02:58:34.753200+0000","last_fullsized":"2023-10-06T02:58:34.753200+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:13.619429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755867+0000","last_change":"2023-10-06T02:58:33.743225+0000","last_active":"2023-10-06T02:58:34.755867+0000","last_peered":"2023-10-06T02:58:34.755867+0000","last_clean":"2023-10-06T02:58:34.755867+0000","last_became_active":"2023-10-06T02:58:33.742937+0000","last_became_peered":"2023-10-06T02:58:33.742937+0000","last_unstale":"2023-10-06T02:58:34.755867+0000","last_undegraded":"2023-10-06T02:58:34.755867+0000","last_fullsized":"2023-10-06T02:58:34.755867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:13.817402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735827+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:58:34.735827+0000","last_peered":"2023-10-06T02:58:34.735827+0000","last_clean":"2023-10-06T02:58:34.735827+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:58:34.735827+0000","last_undegraded":"2023-10-06T02:58:34.735827+0000","last_fullsized":"2023-10-06T02:58:34.735827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":204,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.732877+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:58:34.732877+0000","last_peered":"2023-10-06T02:58:34.732877+0000","last_clean":"2023-10-06T02:58:34.732877+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:58:34.732877+0000","last_undegraded":"2023-10-06T02:58:34.732877+0000","last_fullsized":"2023-10-06T02:58:34.732877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755115+0000","last_change":"2023-10-06T02:58:34.752436+0000","last_active":"2023-10-06T02:58:34.755115+0000","last_peered":"2023-10-06T02:58:34.755115+0000","last_clean":"2023-10-06T02:58:34.755115+0000","last_became_active":"2023-10-06T02:58:34.752129+0000","last_became_peered":"2023-10-06T02:58:34.752129+0000","last_unstale":"2023-10-06T02:58:34.755115+0000","last_undegraded":"2023-10-06T02:58:34.755115+0000","last_fullsized":"2023-10-06T02:58:34.755115+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:31.827949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.729347+0000","last_change":"2023-10-06T02:58:33.732458+0000","last_active":"2023-10-06T02:58:34.729347+0000","last_peered":"2023-10-06T02:58:34.729347+0000","last_clean":"2023-10-06T02:58:34.729347+0000","last_became_active":"2023-10-06T02:58:33.732203+0000","last_became_peered":"2023-10-06T02:58:33.732203+0000","last_unstale":"2023-10-06T02:58:34.729347+0000","last_undegraded":"2023-10-06T02:58:34.729347+0000","last_fullsized":"2023-10-06T02:58:34.729347+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.732958+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:58:34.732958+0000","last_peered":"2023-10-06T02:58:34.732958+0000","last_clean":"2023-10-06T02:58:34.732958+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:58:34.732958+0000","last_undegraded":"2023-10-06T02:58:34.732958+0000","last_fullsized":"2023-10-06T02:58:34.732958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752733+0000","last_change":"2023-10-06T02:58:34.744738+0000","last_active":"2023-10-06T02:58:34.752733+0000","last_peered":"2023-10-06T02:58:34.752733+0000","last_clean":"2023-10-06T02:58:34.752733+0000","last_became_active":"2023-10-06T02:58:34.741841+0000","last_became_peered":"2023-10-06T02:58:34.741841+0000","last_unstale":"2023-10-06T02:58:34.752733+0000","last_undegraded":"2023-10-06T02:58:34.752733+0000","last_fullsized":"2023-10-06T02:58:34.752733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755220+0000","last_change":"2023-10-06T02:58:33.735525+0000","last_active":"2023-10-06T02:58:34.755220+0000","last_peered":"2023-10-06T02:58:34.755220+0000","last_clean":"2023-10-06T02:58:34.755220+0000","last_became_active":"2023-10-06T02:58:33.735068+0000","last_became_peered":"2023-10-06T02:58:33.735068+0000","last_unstale":"2023-10-06T02:58:34.755220+0000","last_undegraded":"2023-10-06T02:58:34.755220+0000","last_fullsized":"2023-10-06T02:58:34.755220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:27.296192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.733225+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:58:34.733225+0000","last_peered":"2023-10-06T02:58:34.733225+0000","last_clean":"2023-10-06T02:58:34.733225+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:58:34.733225+0000","last_undegraded":"2023-10-06T02:58:34.733225+0000","last_fullsized":"2023-10-06T02:58:34.733225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.757425+0000","last_change":"2023-10-06T02:58:34.750920+0000","last_active":"2023-10-06T02:58:34.757425+0000","last_peered":"2023-10-06T02:58:34.757425+0000","last_clean":"2023-10-06T02:58:34.757425+0000","last_became_active":"2023-10-06T02:58:34.745651+0000","last_became_peered":"2023-10-06T02:58:34.745651+0000","last_unstale":"2023-10-06T02:58:34.757425+0000","last_undegraded":"2023-10-06T02:58:34.757425+0000","last_fullsized":"2023-10-06T02:58:34.757425+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.758787+0000","last_change":"2023-10-06T02:58:33.736569+0000","last_active":"2023-10-06T02:58:34.758787+0000","last_peered":"2023-10-06T02:58:34.758787+0000","last_clean":"2023-10-06T02:58:34.758787+0000","last_became_active":"2023-10-06T02:58:33.736326+0000","last_became_peered":"2023-10-06T02:58:33.736326+0000","last_unstale":"2023-10-06T02:58:34.758787+0000","last_undegraded":"2023-10-06T02:58:34.758787+0000","last_fullsized":"2023-10-06T02:58:34.758787+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.731923+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:58:34.731923+0000","last_peered":"2023-10-06T02:58:34.731923+0000","last_clean":"2023-10-06T02:58:34.731923+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:58:34.731923+0000","last_undegraded":"2023-10-06T02:58:34.731923+0000","last_fullsized":"2023-10-06T02:58:34.731923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749649+0000","last_change":"2023-10-06T02:58:34.740370+0000","last_active":"2023-10-06T02:58:34.749649+0000","last_peered":"2023-10-06T02:58:34.749649+0000","last_clean":"2023-10-06T02:58:34.749649+0000","last_became_active":"2023-10-06T02:58:34.740130+0000","last_became_peered":"2023-10-06T02:58:34.740130+0000","last_unstale":"2023-10-06T02:58:34.749649+0000","last_undegraded":"2023-10-06T02:58:34.749649+0000","last_fullsized":"2023-10-06T02:58:34.749649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:16.482180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754208+0000","last_change":"2023-10-06T02:58:33.735199+0000","last_active":"2023-10-06T02:58:34.754208+0000","last_peered":"2023-10-06T02:58:34.754208+0000","last_clean":"2023-10-06T02:58:34.754208+0000","last_became_active":"2023-10-06T02:58:33.734599+0000","last_became_peered":"2023-10-06T02:58:33.734599+0000","last_unstale":"2023-10-06T02:58:34.754208+0000","last_undegraded":"2023-10-06T02:58:34.754208+0000","last_fullsized":"2023-10-06T02:58:34.754208+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:05.133979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725624+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:58:34.725624+0000","last_peered":"2023-10-06T02:58:34.725624+0000","last_clean":"2023-10-06T02:58:34.725624+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:58:34.725624+0000","last_undegraded":"2023-10-06T02:58:34.725624+0000","last_fullsized":"2023-10-06T02:58:34.725624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298680,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073160,"statfs":{"total":96636764160,"available":96330915840,"internally_reserved":0,"allocated":1425408,"data_stored":978448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.435}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.502},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.377}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66400000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.41599999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.498},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":831488,"data_stored":387584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58899999999999997,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81599999999999995,"5min":3.415,"15min":3.415},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":1.546,"15min":1.546},"last":0.38},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.74,"15min":1.74},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.67900000000000005,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69299999999999995,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.505}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":3.577,"15min":3.577},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.51100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.73699999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.437}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80300000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.41899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":388605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.377,"15min":0.40100000000000002},"min":{"1min":0.23000000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.45300000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.41699999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.99099999999999999,"15min":1.2769999999999999},"min":{"1min":0.255,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44500000000000001,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.433,"15min":0.443},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":1.181,"15min":1.181},"last":0.378}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.42699999999999999,"15min":0.443},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48099999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.311},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.626,"15min":0.626},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70299999999999996,"5min":1.02,"15min":1.02},"last":0.505},{"interface":"front","average":{"1min":0.60299999999999998,"5min":1.228,"15min":1.5},"min":{"1min":0.42299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79700000000000004,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.2130000000000001,"15min":1.4830000000000001},"min":{"1min":0.46800000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73399999999999999,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81000000000000005,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.44}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.48399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.242,"15min":1.52},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82499999999999996,"5min":21.166,"15min":21.166},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78600000000000003,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84199999999999997,"5min":0.997,"15min":0.997},"last":0.48799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298668,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073172,"statfs":{"total":96636764160,"available":96330928128,"internally_reserved":0,"allocated":1413120,"data_stored":976849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.33200000000000002,"15min":0.32800000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.373,"15min":0.372},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.379},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26500000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.313},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40000000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.40500000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.754},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.875,"5min":0.879,"15min":0.879},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298104,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073736,"statfs":{"total":96636764160,"available":96331505664,"internally_reserved":0,"allocated":835584,"data_stored":389028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.315,"15min":0.307},"min":{"1min":0.23200000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32000000000000001},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.51200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.375}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.58399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53700000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.32900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45000000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51000000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.872,"5min":1.077,"15min":1.077},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79600000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":386593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.45500000000000002},"min":{"1min":0.249,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.60899999999999999,"5min":2.569,"15min":2.569},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42899999999999999,"15min":0.45400000000000001},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.47399999999999998,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41699999999999998,"15min":0.442},"min":{"1min":0.22600000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.51200000000000001,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.44800000000000001,"15min":0.47999999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56999999999999995,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47199999999999998,"15min":0.498},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54400000000000004,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.376}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.497},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.65000000000000002,"15min":0.68000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.66200000000000003,"15min":0.69399999999999995},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80000000000000004,"5min":2.532,"15min":2.532},"last":0.40899999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.41899999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.71799999999999997,"5min":2.496,"15min":2.496},"last":0.44},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84799999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.52600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":387562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.62}]},{"osd":2,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.91500000000000004,"15min":1.0409999999999999},"min":{"1min":0.46300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.871,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64200000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69399999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":387582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.504,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":1.167,"15min":1.167},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.57399999999999995},"min":{"1min":0.38700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.625,"5min":1.117,"15min":1.117},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68500000000000005,"5min":1.2,"15min":1.2},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":1.135,"15min":1.135},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67100000000000004,"5min":1.208,"15min":1.208},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66400000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73199999999999998,"5min":0.87,"15min":0.87},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56100000000000005,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":1.054,"15min":1.054},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.56999999999999995,"15min":0.58899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71899999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.42699999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76000000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78200000000000003,"5min":1.008,"15min":1.008},"last":0.496}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:58:43.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T02:58:43.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.804+0000 7f4b5d715700 1 Processor -- start 2023-10-06T02:58:43.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.804+0000 7f4b5d715700 1 -- start start 2023-10-06T02:58:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b5d715700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b581594b0 0x7f4b580ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b5d715700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b580cd1a0 0x7f4b580ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b5d715700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b580cd610 con 0x7f4b580cef00 2023-10-06T02:58:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b5d715700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b580cc840 con 0x7f4b581594b0 2023-10-06T02:58:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b5d715700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b580cbc70 con 0x7f4b580cd1a0 2023-10-06T02:58:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b57fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b581594b0 0x7f4b580ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b57fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b581594b0 0x7f4b580ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42672/0 (socket says 172.21.15.84:42672) 2023-10-06T02:58:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b57fff700 1 -- 172.21.15.84:0/3538748440 learned_addr learned my addr 172.21.15.84:0/3538748440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b57fff700 1 -- 172.21.15.84:0/3538748440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b580cd1a0 msgr2=0x7f4b580ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b57fff700 1 --2- 172.21.15.84:0/3538748440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b580cd1a0 0x7f4b580ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b57fff700 1 -- 172.21.15.84:0/3538748440 >> v1:172.21.15.131:6789/0 conn(0x7f4b580cef00 legacy=0x7f4b580c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b57fff700 1 -- 172.21.15.84:0/3538748440 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580cbf10 con 0x7f4b581594b0 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.805+0000 7f4b57fff700 1 --2- 172.21.15.84:0/3538748440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b581594b0 0x7f4b580ccc60 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009990 tx=0x7f4b48009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889990aa916d6872 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b56ffd700 1 -- 172.21.15.84:0/3538748440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48005c10 con 0x7f4b581594b0 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b56ffd700 1 -- 172.21.15.84:0/3538748440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48005d70 con 0x7f4b581594b0 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b56ffd700 1 -- 172.21.15.84:0/3538748440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800b860 con 0x7f4b581594b0 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b5d715700 1 -- 172.21.15.84:0/3538748440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b581594b0 msgr2=0x7f4b580ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b5d715700 1 --2- 172.21.15.84:0/3538748440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b581594b0 0x7f4b580ccc60 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009990 tx=0x7f4b48009220 comp rx=0 tx=0).stop 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b5d715700 1 -- 172.21.15.84:0/3538748440 shutdown_connections 2023-10-06T02:58:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b5d715700 1 --2- 172.21.15.84:0/3538748440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b581594b0 0x7f4b580ccc60 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:43.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b5d715700 1 --2- 172.21.15.84:0/3538748440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b580cd1a0 0x7f4b580ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:43.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b5d715700 1 -- 172.21.15.84:0/3538748440 >> 172.21.15.84:0/3538748440 conn(0x7f4b58099600 msgr2=0x7f4b5806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:43.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b5d715700 1 -- 172.21.15.84:0/3538748440 shutdown_connections 2023-10-06T02:58:43.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.806+0000 7f4b5d715700 1 -- 172.21.15.84:0/3538748440 wait complete. 2023-10-06T02:58:43.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.807+0000 7f4b5d715700 1 Processor -- start 2023-10-06T02:58:43.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b5d715700 1 -- start start 2023-10-06T02:58:43.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b5d715700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b580cd1a0 0x7f4b58156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:43.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b5d715700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b580cef00 0x7f4b58159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:43.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b5d715700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b581594b0 0x7f4b580b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b5d715700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b581698d0 con 0x7f4b580cd1a0 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b5d715700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58099f70 con 0x7f4b580cef00 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b5d715700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58156fa0 con 0x7f4b581594b0 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b57fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b580cd1a0 0x7f4b58156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b57fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b580cd1a0 0x7f4b58156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42678/0 (socket says 172.21.15.84:42678) 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b57fff700 1 -- 172.21.15.84:0/2757186278 learned_addr learned my addr 172.21.15.84:0/2757186278 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b5cf14700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b581594b0 0x7f4b580b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.808+0000 7f4b577fe700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b580cef00 0x7f4b58159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b57fff700 1 -- 172.21.15.84:0/2757186278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b581594b0 msgr2=0x7f4b580b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b57fff700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b581594b0 0x7f4b580b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b57fff700 1 -- 172.21.15.84:0/2757186278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b580cef00 msgr2=0x7f4b58159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b57fff700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b580cef00 0x7f4b58159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b57fff700 1 -- 172.21.15.84:0/2757186278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48009480 con 0x7f4b580cd1a0 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b5cf14700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b581594b0 0x7f4b580b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b57fff700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b580cd1a0 0x7f4b58156a60 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4b48003080 tx=0x7f4b48015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b3ffff700 1 -- 172.21.15.84:0/2757186278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b480119d0 con 0x7f4b580cd1a0 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b3ffff700 1 -- 172.21.15.84:0/2757186278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48011b50 con 0x7f4b580cd1a0 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b3ffff700 1 -- 172.21.15.84:0/2757186278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4801d430 con 0x7f4b580cd1a0 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b58169ac0 con 0x7f4b580cd1a0 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.809+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5815a110 con 0x7f4b580cd1a0 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.810+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b58169ce0 con 0x7f4b580cd1a0 2023-10-06T02:58:43.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.810+0000 7f4b3ffff700 1 -- 172.21.15.84:0/2757186278 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b4801d820 con 0x7f4b580cd1a0 2023-10-06T02:58:43.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.811+0000 7f4b3ffff700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b44066f30 0x7f4b440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:43.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.811+0000 7f4b3ffff700 1 -- 172.21.15.84:0/2757186278 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4b48086840 con 0x7f4b580cd1a0 2023-10-06T02:58:43.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.811+0000 7f4b577fe700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b44066f30 0x7f4b440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:43.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.811+0000 7f4b577fe700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b44066f30 0x7f4b440693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c006fd0 tx=0x7f4b4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.815+0000 7f4b3ffff700 1 -- 172.21.15.84:0/2757186278 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b58169ce0 con 0x7f4b580cd1a0 2023-10-06T02:58:43.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:43.995+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b580cdb00 con 0x7f4b44066f30 2023-10-06T02:58:44.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.003+0000 7f4b3ffff700 1 -- 172.21.15.84:0/2757186278 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311268 (secure 0 0 0) 0x7f4b580cdb00 con 0x7f4b44066f30 2023-10-06T02:58:44.008 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b44066f30 msgr2=0x7f4b440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b44066f30 0x7f4b440693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c006fd0 tx=0x7f4b4c008040 comp rx=0 tx=0).stop 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b580cd1a0 msgr2=0x7f4b58156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b580cd1a0 0x7f4b58156a60 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4b48003080 tx=0x7f4b48015000 comp rx=0 tx=0).stop 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 shutdown_connections 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b44066f30 0x7f4b440693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b581594b0 0x7f4b580b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b580cd1a0 0x7f4b58156a60 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 --2- 172.21.15.84:0/2757186278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b580cef00 0x7f4b58159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 >> 172.21.15.84:0/2757186278 conn(0x7f4b58099600 msgr2=0x7f4b580691f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 shutdown_connections 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.006+0000 7f4b5d715700 1 -- 172.21.15.84:0/2757186278 wait complete. 2023-10-06T02:58:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T02:58:44.020 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-10-06T02:58:43.849033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385948,"kb_used_data":7644,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752588772,"statfs":{"total":773094113280,"available":770650902528,"internally_reserved":0,"allocated":7827456,"data_stored":4282251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.125183"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756678+0000","last_change":"2023-10-06T02:58:34.745441+0000","last_active":"2023-10-06T02:58:34.756678+0000","last_peered":"2023-10-06T02:58:34.756678+0000","last_clean":"2023-10-06T02:58:34.756678+0000","last_became_active":"2023-10-06T02:58:34.744423+0000","last_became_peered":"2023-10-06T02:58:34.744423+0000","last_unstale":"2023-10-06T02:58:34.756678+0000","last_undegraded":"2023-10-06T02:58:34.756678+0000","last_fullsized":"2023-10-06T02:58:34.756678+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753156+0000","last_change":"2023-10-06T02:58:34.746050+0000","last_active":"2023-10-06T02:58:34.753156+0000","last_peered":"2023-10-06T02:58:34.753156+0000","last_clean":"2023-10-06T02:58:34.753156+0000","last_became_active":"2023-10-06T02:58:34.745029+0000","last_became_peered":"2023-10-06T02:58:34.745029+0000","last_unstale":"2023-10-06T02:58:34.753156+0000","last_undegraded":"2023-10-06T02:58:34.753156+0000","last_fullsized":"2023-10-06T02:58:34.753156+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:17.269257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.745016+0000","last_change":"2023-10-06T02:58:34.739633+0000","last_active":"2023-10-06T02:58:34.745016+0000","last_peered":"2023-10-06T02:58:34.745016+0000","last_clean":"2023-10-06T02:58:34.745016+0000","last_became_active":"2023-10-06T02:58:34.739319+0000","last_became_peered":"2023-10-06T02:58:34.739319+0000","last_unstale":"2023-10-06T02:58:34.745016+0000","last_undegraded":"2023-10-06T02:58:34.745016+0000","last_fullsized":"2023-10-06T02:58:34.745016+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:11.966504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752755+0000","last_change":"2023-10-06T02:58:34.744903+0000","last_active":"2023-10-06T02:58:34.752755+0000","last_peered":"2023-10-06T02:58:34.752755+0000","last_clean":"2023-10-06T02:58:34.752755+0000","last_became_active":"2023-10-06T02:58:34.744608+0000","last_became_peered":"2023-10-06T02:58:34.744608+0000","last_unstale":"2023-10-06T02:58:34.752755+0000","last_undegraded":"2023-10-06T02:58:34.752755+0000","last_fullsized":"2023-10-06T02:58:34.752755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:21.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.739267+0000","last_change":"2023-10-06T02:58:34.738101+0000","last_active":"2023-10-06T02:58:34.739267+0000","last_peered":"2023-10-06T02:58:34.739267+0000","last_clean":"2023-10-06T02:58:34.739267+0000","last_became_active":"2023-10-06T02:58:34.737739+0000","last_became_peered":"2023-10-06T02:58:34.737739+0000","last_unstale":"2023-10-06T02:58:34.739267+0000","last_undegraded":"2023-10-06T02:58:34.739267+0000","last_fullsized":"2023-10-06T02:58:34.739267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:50.170481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753162+0000","last_change":"2023-10-06T02:58:34.745244+0000","last_active":"2023-10-06T02:58:34.753162+0000","last_peered":"2023-10-06T02:58:34.753162+0000","last_clean":"2023-10-06T02:58:34.753162+0000","last_became_active":"2023-10-06T02:58:34.744972+0000","last_became_peered":"2023-10-06T02:58:34.744972+0000","last_unstale":"2023-10-06T02:58:34.753162+0000","last_undegraded":"2023-10-06T02:58:34.753162+0000","last_fullsized":"2023-10-06T02:58:34.753162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:44.471161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749309+0000","last_change":"2023-10-06T02:58:34.740643+0000","last_active":"2023-10-06T02:58:34.749309+0000","last_peered":"2023-10-06T02:58:34.749309+0000","last_clean":"2023-10-06T02:58:34.749309+0000","last_became_active":"2023-10-06T02:58:34.740384+0000","last_became_peered":"2023-10-06T02:58:34.740384+0000","last_unstale":"2023-10-06T02:58:34.749309+0000","last_undegraded":"2023-10-06T02:58:34.749309+0000","last_fullsized":"2023-10-06T02:58:34.749309+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752924+0000","last_change":"2023-10-06T02:58:34.737215+0000","last_active":"2023-10-06T02:58:34.752924+0000","last_peered":"2023-10-06T02:58:34.752924+0000","last_clean":"2023-10-06T02:58:34.752924+0000","last_became_active":"2023-10-06T02:58:34.736946+0000","last_became_peered":"2023-10-06T02:58:34.736946+0000","last_unstale":"2023-10-06T02:58:34.752924+0000","last_undegraded":"2023-10-06T02:58:34.752924+0000","last_fullsized":"2023-10-06T02:58:34.752924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:16.904989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.738346+0000","last_change":"2023-10-06T02:58:34.733468+0000","last_active":"2023-10-06T02:58:34.738346+0000","last_peered":"2023-10-06T02:58:34.738346+0000","last_clean":"2023-10-06T02:58:34.738346+0000","last_became_active":"2023-10-06T02:58:34.733055+0000","last_became_peered":"2023-10-06T02:58:34.733055+0000","last_unstale":"2023-10-06T02:58:34.738346+0000","last_undegraded":"2023-10-06T02:58:34.738346+0000","last_fullsized":"2023-10-06T02:58:34.738346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:46.346766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.748273+0000","last_change":"2023-10-06T02:58:34.734981+0000","last_active":"2023-10-06T02:58:34.748273+0000","last_peered":"2023-10-06T02:58:34.748273+0000","last_clean":"2023-10-06T02:58:34.748273+0000","last_became_active":"2023-10-06T02:58:34.734605+0000","last_became_peered":"2023-10-06T02:58:34.734605+0000","last_unstale":"2023-10-06T02:58:34.748273+0000","last_undegraded":"2023-10-06T02:58:34.748273+0000","last_fullsized":"2023-10-06T02:58:34.748273+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:55.617522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756598+0000","last_change":"2023-10-06T02:58:34.750376+0000","last_active":"2023-10-06T02:58:34.756598+0000","last_peered":"2023-10-06T02:58:34.756598+0000","last_clean":"2023-10-06T02:58:34.756598+0000","last_became_active":"2023-10-06T02:58:34.745915+0000","last_became_peered":"2023-10-06T02:58:34.745915+0000","last_unstale":"2023-10-06T02:58:34.756598+0000","last_undegraded":"2023-10-06T02:58:34.756598+0000","last_fullsized":"2023-10-06T02:58:34.756598+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:57.887007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752706+0000","last_change":"2023-10-06T02:58:34.744552+0000","last_active":"2023-10-06T02:58:34.752706+0000","last_peered":"2023-10-06T02:58:34.752706+0000","last_clean":"2023-10-06T02:58:34.752706+0000","last_became_active":"2023-10-06T02:58:34.741740+0000","last_became_peered":"2023-10-06T02:58:34.741740+0000","last_unstale":"2023-10-06T02:58:34.752706+0000","last_undegraded":"2023-10-06T02:58:34.752706+0000","last_fullsized":"2023-10-06T02:58:34.752706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:50.170481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.743297+0000","last_change":"2023-10-06T02:58:34.738921+0000","last_active":"2023-10-06T02:58:34.743297+0000","last_peered":"2023-10-06T02:58:34.743297+0000","last_clean":"2023-10-06T02:58:34.743297+0000","last_became_active":"2023-10-06T02:58:34.738667+0000","last_became_peered":"2023-10-06T02:58:34.738667+0000","last_unstale":"2023-10-06T02:58:34.743297+0000","last_undegraded":"2023-10-06T02:58:34.743297+0000","last_fullsized":"2023-10-06T02:58:34.743297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749836+0000","last_change":"2023-10-06T02:58:34.744162+0000","last_active":"2023-10-06T02:58:34.749836+0000","last_peered":"2023-10-06T02:58:34.749836+0000","last_clean":"2023-10-06T02:58:34.749836+0000","last_became_active":"2023-10-06T02:58:34.743827+0000","last_became_peered":"2023-10-06T02:58:34.743827+0000","last_unstale":"2023-10-06T02:58:34.749836+0000","last_undegraded":"2023-10-06T02:58:34.749836+0000","last_fullsized":"2023-10-06T02:58:34.749836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:08.972710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.745360+0000","last_change":"2023-10-06T02:58:34.739723+0000","last_active":"2023-10-06T02:58:34.745360+0000","last_peered":"2023-10-06T02:58:34.745360+0000","last_clean":"2023-10-06T02:58:34.745360+0000","last_became_active":"2023-10-06T02:58:34.739467+0000","last_became_peered":"2023-10-06T02:58:34.739467+0000","last_unstale":"2023-10-06T02:58:34.745360+0000","last_undegraded":"2023-10-06T02:58:34.745360+0000","last_fullsized":"2023-10-06T02:58:34.745360+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:57.887007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749395+0000","last_change":"2023-10-06T02:58:34.739025+0000","last_active":"2023-10-06T02:58:34.749395+0000","last_peered":"2023-10-06T02:58:34.749395+0000","last_clean":"2023-10-06T02:58:34.749395+0000","last_became_active":"2023-10-06T02:58:34.738726+0000","last_became_peered":"2023-10-06T02:58:34.738726+0000","last_unstale":"2023-10-06T02:58:34.749395+0000","last_undegraded":"2023-10-06T02:58:34.749395+0000","last_fullsized":"2023-10-06T02:58:34.749395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.739001+0000","last_change":"2023-10-06T02:58:34.736953+0000","last_active":"2023-10-06T02:58:34.739001+0000","last_peered":"2023-10-06T02:58:34.739001+0000","last_clean":"2023-10-06T02:58:34.739001+0000","last_became_active":"2023-10-06T02:58:34.736650+0000","last_became_peered":"2023-10-06T02:58:34.736650+0000","last_unstale":"2023-10-06T02:58:34.739001+0000","last_undegraded":"2023-10-06T02:58:34.739001+0000","last_fullsized":"2023-10-06T02:58:34.739001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:28.139760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749685+0000","last_change":"2023-10-06T02:58:34.742034+0000","last_active":"2023-10-06T02:58:34.749685+0000","last_peered":"2023-10-06T02:58:34.749685+0000","last_clean":"2023-10-06T02:58:34.749685+0000","last_became_active":"2023-10-06T02:58:34.741753+0000","last_became_peered":"2023-10-06T02:58:34.741753+0000","last_unstale":"2023-10-06T02:58:34.749685+0000","last_undegraded":"2023-10-06T02:58:34.749685+0000","last_fullsized":"2023-10-06T02:58:34.749685+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:43:28.139760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.751607+0000","last_change":"2023-10-06T02:58:34.734021+0000","last_active":"2023-10-06T02:58:34.751607+0000","last_peered":"2023-10-06T02:58:34.751607+0000","last_clean":"2023-10-06T02:58:34.751607+0000","last_became_active":"2023-10-06T02:58:34.733740+0000","last_became_peered":"2023-10-06T02:58:34.733740+0000","last_unstale":"2023-10-06T02:58:34.751607+0000","last_undegraded":"2023-10-06T02:58:34.751607+0000","last_fullsized":"2023-10-06T02:58:34.751607+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:25.708657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.745204+0000","last_change":"2023-10-06T02:58:34.744198+0000","last_active":"2023-10-06T02:58:34.745204+0000","last_peered":"2023-10-06T02:58:34.745204+0000","last_clean":"2023-10-06T02:58:34.745204+0000","last_became_active":"2023-10-06T02:58:34.743907+0000","last_became_peered":"2023-10-06T02:58:34.743907+0000","last_unstale":"2023-10-06T02:58:34.745204+0000","last_undegraded":"2023-10-06T02:58:34.745204+0000","last_fullsized":"2023-10-06T02:58:34.745204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:32.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749353+0000","last_change":"2023-10-06T02:58:34.738261+0000","last_active":"2023-10-06T02:58:34.749353+0000","last_peered":"2023-10-06T02:58:34.749353+0000","last_clean":"2023-10-06T02:58:34.749353+0000","last_became_active":"2023-10-06T02:58:34.737885+0000","last_became_peered":"2023-10-06T02:58:34.737885+0000","last_unstale":"2023-10-06T02:58:34.749353+0000","last_undegraded":"2023-10-06T02:58:34.749353+0000","last_fullsized":"2023-10-06T02:58:34.749353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:57.887007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.748219+0000","last_change":"2023-10-06T02:58:34.735289+0000","last_active":"2023-10-06T02:58:34.748219+0000","last_peered":"2023-10-06T02:58:34.748219+0000","last_clean":"2023-10-06T02:58:34.748219+0000","last_became_active":"2023-10-06T02:58:34.734523+0000","last_became_peered":"2023-10-06T02:58:34.734523+0000","last_unstale":"2023-10-06T02:58:34.748219+0000","last_undegraded":"2023-10-06T02:58:34.748219+0000","last_fullsized":"2023-10-06T02:58:34.748219+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:41.077463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752051+0000","last_change":"2023-10-06T02:58:34.746217+0000","last_active":"2023-10-06T02:58:34.752051+0000","last_peered":"2023-10-06T02:58:34.752051+0000","last_clean":"2023-10-06T02:58:34.752051+0000","last_became_active":"2023-10-06T02:58:34.745908+0000","last_became_peered":"2023-10-06T02:58:34.745908+0000","last_unstale":"2023-10-06T02:58:34.752051+0000","last_undegraded":"2023-10-06T02:58:34.752051+0000","last_fullsized":"2023-10-06T02:58:34.752051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761568+0000","last_change":"2023-10-06T02:58:34.758007+0000","last_active":"2023-10-06T02:58:34.761568+0000","last_peered":"2023-10-06T02:58:34.761568+0000","last_clean":"2023-10-06T02:58:34.761568+0000","last_became_active":"2023-10-06T02:58:34.756411+0000","last_became_peered":"2023-10-06T02:58:34.756411+0000","last_unstale":"2023-10-06T02:58:34.761568+0000","last_undegraded":"2023-10-06T02:58:34.761568+0000","last_fullsized":"2023-10-06T02:58:34.761568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:02.013607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749371+0000","last_change":"2023-10-06T02:58:34.737235+0000","last_active":"2023-10-06T02:58:34.749371+0000","last_peered":"2023-10-06T02:58:34.749371+0000","last_clean":"2023-10-06T02:58:34.749371+0000","last_became_active":"2023-10-06T02:58:34.736946+0000","last_became_peered":"2023-10-06T02:58:34.736946+0000","last_unstale":"2023-10-06T02:58:34.749371+0000","last_undegraded":"2023-10-06T02:58:34.749371+0000","last_fullsized":"2023-10-06T02:58:34.749371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:00.743751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754484+0000","last_change":"2023-10-06T02:58:34.752722+0000","last_active":"2023-10-06T02:58:34.754484+0000","last_peered":"2023-10-06T02:58:34.754484+0000","last_clean":"2023-10-06T02:58:34.754484+0000","last_became_active":"2023-10-06T02:58:34.752438+0000","last_became_peered":"2023-10-06T02:58:34.752438+0000","last_unstale":"2023-10-06T02:58:34.754484+0000","last_undegraded":"2023-10-06T02:58:34.754484+0000","last_fullsized":"2023-10-06T02:58:34.754484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:58.528540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753272+0000","last_change":"2023-10-06T02:58:34.751410+0000","last_active":"2023-10-06T02:58:34.753272+0000","last_peered":"2023-10-06T02:58:34.753272+0000","last_clean":"2023-10-06T02:58:34.753272+0000","last_became_active":"2023-10-06T02:58:34.751060+0000","last_became_peered":"2023-10-06T02:58:34.751060+0000","last_unstale":"2023-10-06T02:58:34.753272+0000","last_undegraded":"2023-10-06T02:58:34.753272+0000","last_fullsized":"2023-10-06T02:58:34.753272+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:11.597600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.748248+0000","last_change":"2023-10-06T02:58:34.734580+0000","last_active":"2023-10-06T02:58:34.748248+0000","last_peered":"2023-10-06T02:58:34.748248+0000","last_clean":"2023-10-06T02:58:34.748248+0000","last_became_active":"2023-10-06T02:58:34.734269+0000","last_became_peered":"2023-10-06T02:58:34.734269+0000","last_unstale":"2023-10-06T02:58:34.748248+0000","last_undegraded":"2023-10-06T02:58:34.748248+0000","last_fullsized":"2023-10-06T02:58:34.748248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:13.097392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749771+0000","last_change":"2023-10-06T02:58:34.746233+0000","last_active":"2023-10-06T02:58:34.749771+0000","last_peered":"2023-10-06T02:58:34.749771+0000","last_clean":"2023-10-06T02:58:34.749771+0000","last_became_active":"2023-10-06T02:58:34.746061+0000","last_became_peered":"2023-10-06T02:58:34.746061+0000","last_unstale":"2023-10-06T02:58:34.749771+0000","last_undegraded":"2023-10-06T02:58:34.749771+0000","last_fullsized":"2023-10-06T02:58:34.749771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:37.723774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754488+0000","last_change":"2023-10-06T02:58:34.752612+0000","last_active":"2023-10-06T02:58:34.754488+0000","last_peered":"2023-10-06T02:58:34.754488+0000","last_clean":"2023-10-06T02:58:34.754488+0000","last_became_active":"2023-10-06T02:58:34.752358+0000","last_became_peered":"2023-10-06T02:58:34.752358+0000","last_unstale":"2023-10-06T02:58:34.754488+0000","last_undegraded":"2023-10-06T02:58:34.754488+0000","last_fullsized":"2023-10-06T02:58:34.754488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:25.003429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749331+0000","last_change":"2023-10-06T02:58:34.741091+0000","last_active":"2023-10-06T02:58:34.749331+0000","last_peered":"2023-10-06T02:58:34.749331+0000","last_clean":"2023-10-06T02:58:34.749331+0000","last_became_active":"2023-10-06T02:58:34.740843+0000","last_became_peered":"2023-10-06T02:58:34.740843+0000","last_unstale":"2023-10-06T02:58:34.749331+0000","last_undegraded":"2023-10-06T02:58:34.749331+0000","last_fullsized":"2023-10-06T02:58:34.749331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:44.834919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752945+0000","last_change":"2023-10-06T02:58:34.743358+0000","last_active":"2023-10-06T02:58:34.752945+0000","last_peered":"2023-10-06T02:58:34.752945+0000","last_clean":"2023-10-06T02:58:34.752945+0000","last_became_active":"2023-10-06T02:58:34.736611+0000","last_became_peered":"2023-10-06T02:58:34.736611+0000","last_unstale":"2023-10-06T02:58:34.752945+0000","last_undegraded":"2023-10-06T02:58:34.752945+0000","last_fullsized":"2023-10-06T02:58:34.752945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:37.753986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761459+0000","last_change":"2023-10-06T02:58:34.757003+0000","last_active":"2023-10-06T02:58:34.761459+0000","last_peered":"2023-10-06T02:58:34.761459+0000","last_clean":"2023-10-06T02:58:34.761459+0000","last_became_active":"2023-10-06T02:58:34.756723+0000","last_became_peered":"2023-10-06T02:58:34.756723+0000","last_unstale":"2023-10-06T02:58:34.761459+0000","last_undegraded":"2023-10-06T02:58:34.761459+0000","last_fullsized":"2023-10-06T02:58:34.761459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:09.285188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761658+0000","last_change":"2023-10-06T02:58:33.745475+0000","last_active":"2023-10-06T02:58:34.761658+0000","last_peered":"2023-10-06T02:58:34.761658+0000","last_clean":"2023-10-06T02:58:34.761658+0000","last_became_active":"2023-10-06T02:58:33.745233+0000","last_became_peered":"2023-10-06T02:58:33.745233+0000","last_unstale":"2023-10-06T02:58:34.761658+0000","last_undegraded":"2023-10-06T02:58:34.761658+0000","last_fullsized":"2023-10-06T02:58:34.761658+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.739313+0000","last_change":"2023-10-06T02:58:34.737294+0000","last_active":"2023-10-06T02:58:34.739313+0000","last_peered":"2023-10-06T02:58:34.739313+0000","last_clean":"2023-10-06T02:58:34.739313+0000","last_became_active":"2023-10-06T02:58:34.736954+0000","last_became_peered":"2023-10-06T02:58:34.736954+0000","last_unstale":"2023-10-06T02:58:34.739313+0000","last_undegraded":"2023-10-06T02:58:34.739313+0000","last_fullsized":"2023-10-06T02:58:34.739313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.419076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.759886+0000","last_change":"2023-10-06T02:58:33.732849+0000","last_active":"2023-10-06T02:58:34.759886+0000","last_peered":"2023-10-06T02:58:34.759886+0000","last_clean":"2023-10-06T02:58:34.759886+0000","last_became_active":"2023-10-06T02:58:33.732239+0000","last_became_peered":"2023-10-06T02:58:33.732239+0000","last_unstale":"2023-10-06T02:58:34.759886+0000","last_undegraded":"2023-10-06T02:58:34.759886+0000","last_fullsized":"2023-10-06T02:58:34.759886+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752942+0000","last_change":"2023-10-06T02:58:34.741688+0000","last_active":"2023-10-06T02:58:34.752942+0000","last_peered":"2023-10-06T02:58:34.752942+0000","last_clean":"2023-10-06T02:58:34.752942+0000","last_became_active":"2023-10-06T02:58:34.741401+0000","last_became_peered":"2023-10-06T02:58:34.741401+0000","last_unstale":"2023-10-06T02:58:34.752942+0000","last_undegraded":"2023-10-06T02:58:34.752942+0000","last_fullsized":"2023-10-06T02:58:34.752942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:15.941629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.758675+0000","last_change":"2023-10-06T02:58:33.733506+0000","last_active":"2023-10-06T02:58:34.758675+0000","last_peered":"2023-10-06T02:58:34.758675+0000","last_clean":"2023-10-06T02:58:34.758675+0000","last_became_active":"2023-10-06T02:58:33.733249+0000","last_became_peered":"2023-10-06T02:58:33.733249+0000","last_unstale":"2023-10-06T02:58:34.758675+0000","last_undegraded":"2023-10-06T02:58:34.758675+0000","last_fullsized":"2023-10-06T02:58:34.758675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756140+0000","last_change":"2023-10-06T02:58:34.750170+0000","last_active":"2023-10-06T02:58:34.756140+0000","last_peered":"2023-10-06T02:58:34.756140+0000","last_clean":"2023-10-06T02:58:34.756140+0000","last_became_active":"2023-10-06T02:58:34.745489+0000","last_became_peered":"2023-10-06T02:58:34.745489+0000","last_unstale":"2023-10-06T02:58:34.756140+0000","last_undegraded":"2023-10-06T02:58:34.756140+0000","last_fullsized":"2023-10-06T02:58:34.756140+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:32.592020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755285+0000","last_change":"2023-10-06T02:58:33.743169+0000","last_active":"2023-10-06T02:58:34.755285+0000","last_peered":"2023-10-06T02:58:34.755285+0000","last_clean":"2023-10-06T02:58:34.755285+0000","last_became_active":"2023-10-06T02:58:33.742892+0000","last_became_peered":"2023-10-06T02:58:33.742892+0000","last_unstale":"2023-10-06T02:58:34.755285+0000","last_undegraded":"2023-10-06T02:58:34.755285+0000","last_fullsized":"2023-10-06T02:58:34.755285+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:07.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.750117+0000","last_change":"2023-10-06T02:58:34.742428+0000","last_active":"2023-10-06T02:58:34.750117+0000","last_peered":"2023-10-06T02:58:34.750117+0000","last_clean":"2023-10-06T02:58:34.750117+0000","last_became_active":"2023-10-06T02:58:34.742186+0000","last_became_peered":"2023-10-06T02:58:34.742186+0000","last_unstale":"2023-10-06T02:58:34.750117+0000","last_undegraded":"2023-10-06T02:58:34.750117+0000","last_fullsized":"2023-10-06T02:58:34.750117+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749895+0000","last_change":"2023-10-06T02:58:33.734217+0000","last_active":"2023-10-06T02:58:34.749895+0000","last_peered":"2023-10-06T02:58:34.749895+0000","last_clean":"2023-10-06T02:58:34.749895+0000","last_became_active":"2023-10-06T02:58:33.733894+0000","last_became_peered":"2023-10-06T02:58:33.733894+0000","last_unstale":"2023-10-06T02:58:34.749895+0000","last_undegraded":"2023-10-06T02:58:34.749895+0000","last_fullsized":"2023-10-06T02:58:34.749895+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:31.585062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749332+0000","last_change":"2023-10-06T02:58:34.738102+0000","last_active":"2023-10-06T02:58:34.749332+0000","last_peered":"2023-10-06T02:58:34.749332+0000","last_clean":"2023-10-06T02:58:34.749332+0000","last_became_active":"2023-10-06T02:58:34.737593+0000","last_became_peered":"2023-10-06T02:58:34.737593+0000","last_unstale":"2023-10-06T02:58:34.749332+0000","last_undegraded":"2023-10-06T02:58:34.749332+0000","last_fullsized":"2023-10-06T02:58:34.749332+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:48.922383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.760012+0000","last_change":"2023-10-06T02:58:33.736095+0000","last_active":"2023-10-06T02:58:34.760012+0000","last_peered":"2023-10-06T02:58:34.760012+0000","last_clean":"2023-10-06T02:58:34.760012+0000","last_became_active":"2023-10-06T02:58:33.735839+0000","last_became_peered":"2023-10-06T02:58:33.735839+0000","last_unstale":"2023-10-06T02:58:34.760012+0000","last_undegraded":"2023-10-06T02:58:34.760012+0000","last_fullsized":"2023-10-06T02:58:34.760012+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.738009+0000","last_change":"2023-10-06T02:58:34.734656+0000","last_active":"2023-10-06T02:58:34.738009+0000","last_peered":"2023-10-06T02:58:34.738009+0000","last_clean":"2023-10-06T02:58:34.738009+0000","last_became_active":"2023-10-06T02:58:34.734402+0000","last_became_peered":"2023-10-06T02:58:34.734402+0000","last_unstale":"2023-10-06T02:58:34.738009+0000","last_undegraded":"2023-10-06T02:58:34.738009+0000","last_fullsized":"2023-10-06T02:58:34.738009+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:07:02.147902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.730067+0000","last_change":"2023-10-06T02:58:33.742149+0000","last_active":"2023-10-06T02:58:34.730067+0000","last_peered":"2023-10-06T02:58:34.730067+0000","last_clean":"2023-10-06T02:58:34.730067+0000","last_became_active":"2023-10-06T02:58:33.741911+0000","last_became_peered":"2023-10-06T02:58:33.741911+0000","last_unstale":"2023-10-06T02:58:34.730067+0000","last_undegraded":"2023-10-06T02:58:34.730067+0000","last_fullsized":"2023-10-06T02:58:34.730067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.744132+0000","last_change":"2023-10-06T02:58:34.738974+0000","last_active":"2023-10-06T02:58:34.744132+0000","last_peered":"2023-10-06T02:58:34.744132+0000","last_clean":"2023-10-06T02:58:34.744132+0000","last_became_active":"2023-10-06T02:58:34.738726+0000","last_became_peered":"2023-10-06T02:58:34.738726+0000","last_unstale":"2023-10-06T02:58:34.744132+0000","last_undegraded":"2023-10-06T02:58:34.744132+0000","last_fullsized":"2023-10-06T02:58:34.744132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:55.617522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725040+0000","last_change":"2023-10-06T02:58:33.743119+0000","last_active":"2023-10-06T02:58:34.725040+0000","last_peered":"2023-10-06T02:58:34.725040+0000","last_clean":"2023-10-06T02:58:34.725040+0000","last_became_active":"2023-10-06T02:58:33.742849+0000","last_became_peered":"2023-10-06T02:58:33.742849+0000","last_unstale":"2023-10-06T02:58:34.725040+0000","last_undegraded":"2023-10-06T02:58:34.725040+0000","last_fullsized":"2023-10-06T02:58:34.725040+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:10.552745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749600+0000","last_change":"2023-10-06T02:58:34.748065+0000","last_active":"2023-10-06T02:58:34.749600+0000","last_peered":"2023-10-06T02:58:34.749600+0000","last_clean":"2023-10-06T02:58:34.749600+0000","last_became_active":"2023-10-06T02:58:34.747759+0000","last_became_peered":"2023-10-06T02:58:34.747759+0000","last_unstale":"2023-10-06T02:58:34.749600+0000","last_undegraded":"2023-10-06T02:58:34.749600+0000","last_fullsized":"2023-10-06T02:58:34.749600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:21:28.389683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725794+0000","last_change":"2023-10-06T02:58:33.734599+0000","last_active":"2023-10-06T02:58:34.725794+0000","last_peered":"2023-10-06T02:58:34.725794+0000","last_clean":"2023-10-06T02:58:34.725794+0000","last_became_active":"2023-10-06T02:58:33.734161+0000","last_became_peered":"2023-10-06T02:58:33.734161+0000","last_unstale":"2023-10-06T02:58:34.725794+0000","last_undegraded":"2023-10-06T02:58:34.725794+0000","last_fullsized":"2023-10-06T02:58:34.725794+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:10.358630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761525+0000","last_change":"2023-10-06T02:58:34.757856+0000","last_active":"2023-10-06T02:58:34.761525+0000","last_peered":"2023-10-06T02:58:34.761525+0000","last_clean":"2023-10-06T02:58:34.761525+0000","last_became_active":"2023-10-06T02:58:34.757568+0000","last_became_peered":"2023-10-06T02:58:34.757568+0000","last_unstale":"2023-10-06T02:58:34.761525+0000","last_undegraded":"2023-10-06T02:58:34.761525+0000","last_fullsized":"2023-10-06T02:58:34.761525+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.623378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.726946+0000","last_change":"2023-10-06T02:58:33.733304+0000","last_active":"2023-10-06T02:58:34.726946+0000","last_peered":"2023-10-06T02:58:34.726946+0000","last_clean":"2023-10-06T02:58:34.726946+0000","last_became_active":"2023-10-06T02:58:33.733025+0000","last_became_peered":"2023-10-06T02:58:33.733025+0000","last_unstale":"2023-10-06T02:58:34.726946+0000","last_undegraded":"2023-10-06T02:58:34.726946+0000","last_fullsized":"2023-10-06T02:58:34.726946+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753271+0000","last_change":"2023-10-06T02:58:34.745510+0000","last_active":"2023-10-06T02:58:34.753271+0000","last_peered":"2023-10-06T02:58:34.753271+0000","last_clean":"2023-10-06T02:58:34.753271+0000","last_became_active":"2023-10-06T02:58:34.745251+0000","last_became_peered":"2023-10-06T02:58:34.745251+0000","last_unstale":"2023-10-06T02:58:34.753271+0000","last_undegraded":"2023-10-06T02:58:34.753271+0000","last_fullsized":"2023-10-06T02:58:34.753271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:23.859199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"67'3","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754555+0000","last_change":"2023-10-06T02:58:33.734221+0000","last_active":"2023-10-06T02:58:34.754555+0000","last_peered":"2023-10-06T02:58:34.754555+0000","last_clean":"2023-10-06T02:58:34.754555+0000","last_became_active":"2023-10-06T02:58:33.733961+0000","last_became_peered":"2023-10-06T02:58:33.733961+0000","last_unstale":"2023-10-06T02:58:34.754555+0000","last_undegraded":"2023-10-06T02:58:34.754555+0000","last_fullsized":"2023-10-06T02:58:34.754555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:02.616419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.737983+0000","last_change":"2023-10-06T02:58:34.734389+0000","last_active":"2023-10-06T02:58:34.737983+0000","last_peered":"2023-10-06T02:58:34.737983+0000","last_clean":"2023-10-06T02:58:34.737983+0000","last_became_active":"2023-10-06T02:58:34.734119+0000","last_became_peered":"2023-10-06T02:58:34.734119+0000","last_unstale":"2023-10-06T02:58:34.737983+0000","last_undegraded":"2023-10-06T02:58:34.737983+0000","last_fullsized":"2023-10-06T02:58:34.737983+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"67'6","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755314+0000","last_change":"2023-10-06T02:58:33.742820+0000","last_active":"2023-10-06T02:58:34.755314+0000","last_peered":"2023-10-06T02:58:34.755314+0000","last_clean":"2023-10-06T02:58:34.755314+0000","last_became_active":"2023-10-06T02:58:33.742572+0000","last_became_peered":"2023-10-06T02:58:33.742572+0000","last_unstale":"2023-10-06T02:58:34.755314+0000","last_undegraded":"2023-10-06T02:58:34.755314+0000","last_fullsized":"2023-10-06T02:58:34.755314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.744526+0000","last_change":"2023-10-06T02:58:34.738685+0000","last_active":"2023-10-06T02:58:34.744526+0000","last_peered":"2023-10-06T02:58:34.744526+0000","last_clean":"2023-10-06T02:58:34.744526+0000","last_became_active":"2023-10-06T02:58:34.738392+0000","last_became_peered":"2023-10-06T02:58:34.738392+0000","last_unstale":"2023-10-06T02:58:34.744526+0000","last_undegraded":"2023-10-06T02:58:34.744526+0000","last_fullsized":"2023-10-06T02:58:34.744526+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.759813+0000","last_change":"2023-10-06T02:58:33.742960+0000","last_active":"2023-10-06T02:58:34.759813+0000","last_peered":"2023-10-06T02:58:34.759813+0000","last_clean":"2023-10-06T02:58:34.759813+0000","last_became_active":"2023-10-06T02:58:33.742690+0000","last_became_peered":"2023-10-06T02:58:33.742690+0000","last_unstale":"2023-10-06T02:58:34.759813+0000","last_undegraded":"2023-10-06T02:58:34.759813+0000","last_fullsized":"2023-10-06T02:58:34.759813+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:25.917006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749990+0000","last_change":"2023-10-06T02:58:34.748805+0000","last_active":"2023-10-06T02:58:34.749990+0000","last_peered":"2023-10-06T02:58:34.749990+0000","last_clean":"2023-10-06T02:58:34.749990+0000","last_became_active":"2023-10-06T02:58:34.748562+0000","last_became_peered":"2023-10-06T02:58:34.748562+0000","last_unstale":"2023-10-06T02:58:34.749990+0000","last_undegraded":"2023-10-06T02:58:34.749990+0000","last_fullsized":"2023-10-06T02:58:34.749990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:16.237630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.727478+0000","last_change":"2023-10-06T02:58:33.734770+0000","last_active":"2023-10-06T02:58:34.727478+0000","last_peered":"2023-10-06T02:58:34.727478+0000","last_clean":"2023-10-06T02:58:34.727478+0000","last_became_active":"2023-10-06T02:58:33.734351+0000","last_became_peered":"2023-10-06T02:58:33.734351+0000","last_unstale":"2023-10-06T02:58:34.727478+0000","last_undegraded":"2023-10-06T02:58:34.727478+0000","last_fullsized":"2023-10-06T02:58:34.727478+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:59.626445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.759550+0000","last_change":"2023-10-06T02:58:34.746122+0000","last_active":"2023-10-06T02:58:34.759550+0000","last_peered":"2023-10-06T02:58:34.759550+0000","last_clean":"2023-10-06T02:58:34.759550+0000","last_became_active":"2023-10-06T02:58:34.745854+0000","last_became_peered":"2023-10-06T02:58:34.745854+0000","last_unstale":"2023-10-06T02:58:34.759550+0000","last_undegraded":"2023-10-06T02:58:34.759550+0000","last_fullsized":"2023-10-06T02:58:34.759550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:03.623378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735737+0000","last_change":"2023-10-06T02:58:33.736152+0000","last_active":"2023-10-06T02:58:34.735737+0000","last_peered":"2023-10-06T02:58:34.735737+0000","last_clean":"2023-10-06T02:58:34.735737+0000","last_became_active":"2023-10-06T02:58:33.735725+0000","last_became_peered":"2023-10-06T02:58:33.735725+0000","last_unstale":"2023-10-06T02:58:34.735737+0000","last_undegraded":"2023-10-06T02:58:34.735737+0000","last_fullsized":"2023-10-06T02:58:34.735737+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:53.949148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.738379+0000","last_change":"2023-10-06T02:58:34.736184+0000","last_active":"2023-10-06T02:58:34.738379+0000","last_peered":"2023-10-06T02:58:34.738379+0000","last_clean":"2023-10-06T02:58:34.738379+0000","last_became_active":"2023-10-06T02:58:34.735934+0000","last_became_peered":"2023-10-06T02:58:34.735934+0000","last_unstale":"2023-10-06T02:58:34.738379+0000","last_undegraded":"2023-10-06T02:58:34.738379+0000","last_fullsized":"2023-10-06T02:58:34.738379+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:10.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"67'8","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.762438+0000","last_change":"2023-10-06T02:58:33.734055+0000","last_active":"2023-10-06T02:58:34.762438+0000","last_peered":"2023-10-06T02:58:34.762438+0000","last_clean":"2023-10-06T02:58:34.762438+0000","last_became_active":"2023-10-06T02:58:33.733756+0000","last_became_peered":"2023-10-06T02:58:33.733756+0000","last_unstale":"2023-10-06T02:58:34.762438+0000","last_undegraded":"2023-10-06T02:58:34.762438+0000","last_fullsized":"2023-10-06T02:58:34.762438+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:27.263593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.741625+0000","last_change":"2023-10-06T02:58:34.738603+0000","last_active":"2023-10-06T02:58:34.741625+0000","last_peered":"2023-10-06T02:58:34.741625+0000","last_clean":"2023-10-06T02:58:34.741625+0000","last_became_active":"2023-10-06T02:58:34.738326+0000","last_became_peered":"2023-10-06T02:58:34.738326+0000","last_unstale":"2023-10-06T02:58:34.741625+0000","last_undegraded":"2023-10-06T02:58:34.741625+0000","last_fullsized":"2023-10-06T02:58:34.741625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754140+0000","last_change":"2023-10-06T02:58:33.735367+0000","last_active":"2023-10-06T02:58:34.754140+0000","last_peered":"2023-10-06T02:58:34.754140+0000","last_clean":"2023-10-06T02:58:34.754140+0000","last_became_active":"2023-10-06T02:58:33.734942+0000","last_became_peered":"2023-10-06T02:58:33.734942+0000","last_unstale":"2023-10-06T02:58:34.754140+0000","last_undegraded":"2023-10-06T02:58:34.754140+0000","last_fullsized":"2023-10-06T02:58:34.754140+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.308259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.750081+0000","last_change":"2023-10-06T02:58:34.740751+0000","last_active":"2023-10-06T02:58:34.750081+0000","last_peered":"2023-10-06T02:58:34.750081+0000","last_clean":"2023-10-06T02:58:34.750081+0000","last_became_active":"2023-10-06T02:58:34.740501+0000","last_became_peered":"2023-10-06T02:58:34.740501+0000","last_unstale":"2023-10-06T02:58:34.750081+0000","last_undegraded":"2023-10-06T02:58:34.750081+0000","last_fullsized":"2023-10-06T02:58:34.750081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:21.396281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"68'1","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-06T02:58:36.308798+0000","last_change":"2023-10-06T02:58:33.736226+0000","last_active":"2023-10-06T02:58:36.308798+0000","last_peered":"2023-10-06T02:58:36.308798+0000","last_clean":"2023-10-06T02:58:36.308798+0000","last_became_active":"2023-10-06T02:58:33.735569+0000","last_became_peered":"2023-10-06T02:58:33.735569+0000","last_unstale":"2023-10-06T02:58:36.308798+0000","last_undegraded":"2023-10-06T02:58:36.308798+0000","last_fullsized":"2023-10-06T02:58:36.308798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:45.583253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.761483+0000","last_change":"2023-10-06T02:58:34.757525+0000","last_active":"2023-10-06T02:58:34.761483+0000","last_peered":"2023-10-06T02:58:34.761483+0000","last_clean":"2023-10-06T02:58:34.761483+0000","last_became_active":"2023-10-06T02:58:34.756383+0000","last_became_peered":"2023-10-06T02:58:34.756383+0000","last_unstale":"2023-10-06T02:58:34.761483+0000","last_undegraded":"2023-10-06T02:58:34.761483+0000","last_fullsized":"2023-10-06T02:58:34.761483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:07.588359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.726144+0000","last_change":"2023-10-06T02:58:33.735368+0000","last_active":"2023-10-06T02:58:34.726144+0000","last_peered":"2023-10-06T02:58:34.726144+0000","last_clean":"2023-10-06T02:58:34.726144+0000","last_became_active":"2023-10-06T02:58:33.735110+0000","last_became_peered":"2023-10-06T02:58:33.735110+0000","last_unstale":"2023-10-06T02:58:34.726144+0000","last_undegraded":"2023-10-06T02:58:34.726144+0000","last_fullsized":"2023-10-06T02:58:34.726144+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:24.789985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.756627+0000","last_change":"2023-10-06T02:58:34.750506+0000","last_active":"2023-10-06T02:58:34.756627+0000","last_peered":"2023-10-06T02:58:34.756627+0000","last_clean":"2023-10-06T02:58:34.756627+0000","last_became_active":"2023-10-06T02:58:34.750158+0000","last_became_peered":"2023-10-06T02:58:34.750158+0000","last_unstale":"2023-10-06T02:58:34.756627+0000","last_undegraded":"2023-10-06T02:58:34.756627+0000","last_fullsized":"2023-10-06T02:58:34.756627+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:31.251615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.730138+0000","last_change":"2023-10-06T02:58:33.727028+0000","last_active":"2023-10-06T02:58:34.730138+0000","last_peered":"2023-10-06T02:58:34.730138+0000","last_clean":"2023-10-06T02:58:34.730138+0000","last_became_active":"2023-10-06T02:58:33.726742+0000","last_became_peered":"2023-10-06T02:58:33.726742+0000","last_unstale":"2023-10-06T02:58:34.730138+0000","last_undegraded":"2023-10-06T02:58:34.730138+0000","last_fullsized":"2023-10-06T02:58:34.730138+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:15.230672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.737825+0000","last_change":"2023-10-06T02:58:34.733654+0000","last_active":"2023-10-06T02:58:34.737825+0000","last_peered":"2023-10-06T02:58:34.737825+0000","last_clean":"2023-10-06T02:58:34.737825+0000","last_became_active":"2023-10-06T02:58:34.733031+0000","last_became_peered":"2023-10-06T02:58:34.733031+0000","last_unstale":"2023-10-06T02:58:34.737825+0000","last_undegraded":"2023-10-06T02:58:34.737825+0000","last_fullsized":"2023-10-06T02:58:34.737825+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:47:12.873779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725392+0000","last_change":"2023-10-06T02:58:33.733340+0000","last_active":"2023-10-06T02:58:34.725392+0000","last_peered":"2023-10-06T02:58:34.725392+0000","last_clean":"2023-10-06T02:58:34.725392+0000","last_became_active":"2023-10-06T02:58:33.733080+0000","last_became_peered":"2023-10-06T02:58:33.733080+0000","last_unstale":"2023-10-06T02:58:34.725392+0000","last_undegraded":"2023-10-06T02:58:34.725392+0000","last_fullsized":"2023-10-06T02:58:34.725392+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:32.544670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752836+0000","last_change":"2023-10-06T02:58:34.741338+0000","last_active":"2023-10-06T02:58:34.752836+0000","last_peered":"2023-10-06T02:58:34.752836+0000","last_clean":"2023-10-06T02:58:34.752836+0000","last_became_active":"2023-10-06T02:58:34.739399+0000","last_became_peered":"2023-10-06T02:58:34.739399+0000","last_unstale":"2023-10-06T02:58:34.752836+0000","last_undegraded":"2023-10-06T02:58:34.752836+0000","last_fullsized":"2023-10-06T02:58:34.752836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:37.916870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.730173+0000","last_change":"2023-10-06T02:58:33.742848+0000","last_active":"2023-10-06T02:58:34.730173+0000","last_peered":"2023-10-06T02:58:34.730173+0000","last_clean":"2023-10-06T02:58:34.730173+0000","last_became_active":"2023-10-06T02:58:33.742585+0000","last_became_peered":"2023-10-06T02:58:33.742585+0000","last_unstale":"2023-10-06T02:58:34.730173+0000","last_undegraded":"2023-10-06T02:58:34.730173+0000","last_fullsized":"2023-10-06T02:58:34.730173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:29.940584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.742027+0000","last_change":"2023-10-06T02:58:34.738583+0000","last_active":"2023-10-06T02:58:34.742027+0000","last_peered":"2023-10-06T02:58:34.742027+0000","last_clean":"2023-10-06T02:58:34.742027+0000","last_became_active":"2023-10-06T02:58:34.738385+0000","last_became_peered":"2023-10-06T02:58:34.738385+0000","last_unstale":"2023-10-06T02:58:34.742027+0000","last_undegraded":"2023-10-06T02:58:34.742027+0000","last_fullsized":"2023-10-06T02:58:34.742027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:10.219550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.726187+0000","last_change":"2023-10-06T02:58:33.740591+0000","last_active":"2023-10-06T02:58:34.726187+0000","last_peered":"2023-10-06T02:58:34.726187+0000","last_clean":"2023-10-06T02:58:34.726187+0000","last_became_active":"2023-10-06T02:58:33.740329+0000","last_became_peered":"2023-10-06T02:58:33.740329+0000","last_unstale":"2023-10-06T02:58:34.726187+0000","last_undegraded":"2023-10-06T02:58:34.726187+0000","last_fullsized":"2023-10-06T02:58:34.726187+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:29.440038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.751587+0000","last_change":"2023-10-06T02:58:34.734191+0000","last_active":"2023-10-06T02:58:34.751587+0000","last_peered":"2023-10-06T02:58:34.751587+0000","last_clean":"2023-10-06T02:58:34.751587+0000","last_became_active":"2023-10-06T02:58:34.733879+0000","last_became_peered":"2023-10-06T02:58:34.733879+0000","last_unstale":"2023-10-06T02:58:34.751587+0000","last_undegraded":"2023-10-06T02:58:34.751587+0000","last_fullsized":"2023-10-06T02:58:34.751587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:22.316351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725270+0000","last_change":"2023-10-06T02:58:33.745606+0000","last_active":"2023-10-06T02:58:34.725270+0000","last_peered":"2023-10-06T02:58:34.725270+0000","last_clean":"2023-10-06T02:58:34.725270+0000","last_became_active":"2023-10-06T02:58:33.745246+0000","last_became_peered":"2023-10-06T02:58:33.745246+0000","last_unstale":"2023-10-06T02:58:34.725270+0000","last_undegraded":"2023-10-06T02:58:34.725270+0000","last_fullsized":"2023-10-06T02:58:34.725270+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:45.339807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.747263+0000","last_change":"2023-10-06T02:58:34.743038+0000","last_active":"2023-10-06T02:58:34.747263+0000","last_peered":"2023-10-06T02:58:34.747263+0000","last_clean":"2023-10-06T02:58:34.747263+0000","last_became_active":"2023-10-06T02:58:34.742788+0000","last_became_peered":"2023-10-06T02:58:34.742788+0000","last_unstale":"2023-10-06T02:58:34.747263+0000","last_undegraded":"2023-10-06T02:58:34.747263+0000","last_fullsized":"2023-10-06T02:58:34.747263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:21.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.733402+0000","last_change":"2023-10-06T02:58:33.742273+0000","last_active":"2023-10-06T02:58:34.733402+0000","last_peered":"2023-10-06T02:58:34.733402+0000","last_clean":"2023-10-06T02:58:34.733402+0000","last_became_active":"2023-10-06T02:58:33.741934+0000","last_became_peered":"2023-10-06T02:58:33.741934+0000","last_unstale":"2023-10-06T02:58:34.733402+0000","last_undegraded":"2023-10-06T02:58:34.733402+0000","last_fullsized":"2023-10-06T02:58:34.733402+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:15.613100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.731116+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:58:34.731116+0000","last_peered":"2023-10-06T02:58:34.731116+0000","last_clean":"2023-10-06T02:58:34.731116+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:58:34.731116+0000","last_undegraded":"2023-10-06T02:58:34.731116+0000","last_fullsized":"2023-10-06T02:58:34.731116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.741445+0000","last_change":"2023-10-06T02:58:34.737742+0000","last_active":"2023-10-06T02:58:34.741445+0000","last_peered":"2023-10-06T02:58:34.741445+0000","last_clean":"2023-10-06T02:58:34.741445+0000","last_became_active":"2023-10-06T02:58:34.737502+0000","last_became_peered":"2023-10-06T02:58:34.737502+0000","last_unstale":"2023-10-06T02:58:34.741445+0000","last_undegraded":"2023-10-06T02:58:34.741445+0000","last_fullsized":"2023-10-06T02:58:34.741445+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:27.363276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.727585+0000","last_change":"2023-10-06T02:58:33.732697+0000","last_active":"2023-10-06T02:58:34.727585+0000","last_peered":"2023-10-06T02:58:34.727585+0000","last_clean":"2023-10-06T02:58:34.727585+0000","last_became_active":"2023-10-06T02:58:33.732421+0000","last_became_peered":"2023-10-06T02:58:33.732421+0000","last_unstale":"2023-10-06T02:58:34.727585+0000","last_undegraded":"2023-10-06T02:58:34.727585+0000","last_fullsized":"2023-10-06T02:58:34.727585+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:21:50.564360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735698+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:58:34.735698+0000","last_peered":"2023-10-06T02:58:34.735698+0000","last_clean":"2023-10-06T02:58:34.735698+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:58:34.735698+0000","last_undegraded":"2023-10-06T02:58:34.735698+0000","last_fullsized":"2023-10-06T02:58:34.735698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749715+0000","last_change":"2023-10-06T02:58:34.745739+0000","last_active":"2023-10-06T02:58:34.749715+0000","last_peered":"2023-10-06T02:58:34.749715+0000","last_clean":"2023-10-06T02:58:34.749715+0000","last_became_active":"2023-10-06T02:58:34.745460+0000","last_became_peered":"2023-10-06T02:58:34.745460+0000","last_unstale":"2023-10-06T02:58:34.749715+0000","last_undegraded":"2023-10-06T02:58:34.749715+0000","last_fullsized":"2023-10-06T02:58:34.749715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:07.604975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735812+0000","last_change":"2023-10-06T02:58:33.735296+0000","last_active":"2023-10-06T02:58:34.735812+0000","last_peered":"2023-10-06T02:58:34.735812+0000","last_clean":"2023-10-06T02:58:34.735812+0000","last_became_active":"2023-10-06T02:58:33.735041+0000","last_became_peered":"2023-10-06T02:58:33.735041+0000","last_unstale":"2023-10-06T02:58:34.735812+0000","last_undegraded":"2023-10-06T02:58:34.735812+0000","last_fullsized":"2023-10-06T02:58:34.735812+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:12.846129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725215+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:58:34.725215+0000","last_peered":"2023-10-06T02:58:34.725215+0000","last_clean":"2023-10-06T02:58:34.725215+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:58:34.725215+0000","last_undegraded":"2023-10-06T02:58:34.725215+0000","last_fullsized":"2023-10-06T02:58:34.725215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.753200+0000","last_change":"2023-10-06T02:58:34.752352+0000","last_active":"2023-10-06T02:58:34.753200+0000","last_peered":"2023-10-06T02:58:34.753200+0000","last_clean":"2023-10-06T02:58:34.753200+0000","last_became_active":"2023-10-06T02:58:34.752080+0000","last_became_peered":"2023-10-06T02:58:34.752080+0000","last_unstale":"2023-10-06T02:58:34.753200+0000","last_undegraded":"2023-10-06T02:58:34.753200+0000","last_fullsized":"2023-10-06T02:58:34.753200+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:13.619429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755867+0000","last_change":"2023-10-06T02:58:33.743225+0000","last_active":"2023-10-06T02:58:34.755867+0000","last_peered":"2023-10-06T02:58:34.755867+0000","last_clean":"2023-10-06T02:58:34.755867+0000","last_became_active":"2023-10-06T02:58:33.742937+0000","last_became_peered":"2023-10-06T02:58:33.742937+0000","last_unstale":"2023-10-06T02:58:34.755867+0000","last_undegraded":"2023-10-06T02:58:34.755867+0000","last_fullsized":"2023-10-06T02:58:34.755867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:13.817402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.735827+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:58:34.735827+0000","last_peered":"2023-10-06T02:58:34.735827+0000","last_clean":"2023-10-06T02:58:34.735827+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:58:34.735827+0000","last_undegraded":"2023-10-06T02:58:34.735827+0000","last_fullsized":"2023-10-06T02:58:34.735827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":204,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.732877+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:58:34.732877+0000","last_peered":"2023-10-06T02:58:34.732877+0000","last_clean":"2023-10-06T02:58:34.732877+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:58:34.732877+0000","last_undegraded":"2023-10-06T02:58:34.732877+0000","last_fullsized":"2023-10-06T02:58:34.732877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755115+0000","last_change":"2023-10-06T02:58:34.752436+0000","last_active":"2023-10-06T02:58:34.755115+0000","last_peered":"2023-10-06T02:58:34.755115+0000","last_clean":"2023-10-06T02:58:34.755115+0000","last_became_active":"2023-10-06T02:58:34.752129+0000","last_became_peered":"2023-10-06T02:58:34.752129+0000","last_unstale":"2023-10-06T02:58:34.755115+0000","last_undegraded":"2023-10-06T02:58:34.755115+0000","last_fullsized":"2023-10-06T02:58:34.755115+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:31.827949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.729347+0000","last_change":"2023-10-06T02:58:33.732458+0000","last_active":"2023-10-06T02:58:34.729347+0000","last_peered":"2023-10-06T02:58:34.729347+0000","last_clean":"2023-10-06T02:58:34.729347+0000","last_became_active":"2023-10-06T02:58:33.732203+0000","last_became_peered":"2023-10-06T02:58:33.732203+0000","last_unstale":"2023-10-06T02:58:34.729347+0000","last_undegraded":"2023-10-06T02:58:34.729347+0000","last_fullsized":"2023-10-06T02:58:34.729347+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.732958+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:58:34.732958+0000","last_peered":"2023-10-06T02:58:34.732958+0000","last_clean":"2023-10-06T02:58:34.732958+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:58:34.732958+0000","last_undegraded":"2023-10-06T02:58:34.732958+0000","last_fullsized":"2023-10-06T02:58:34.732958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.752733+0000","last_change":"2023-10-06T02:58:34.744738+0000","last_active":"2023-10-06T02:58:34.752733+0000","last_peered":"2023-10-06T02:58:34.752733+0000","last_clean":"2023-10-06T02:58:34.752733+0000","last_became_active":"2023-10-06T02:58:34.741841+0000","last_became_peered":"2023-10-06T02:58:34.741841+0000","last_unstale":"2023-10-06T02:58:34.752733+0000","last_undegraded":"2023-10-06T02:58:34.752733+0000","last_fullsized":"2023-10-06T02:58:34.752733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:28.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.755220+0000","last_change":"2023-10-06T02:58:33.735525+0000","last_active":"2023-10-06T02:58:34.755220+0000","last_peered":"2023-10-06T02:58:34.755220+0000","last_clean":"2023-10-06T02:58:34.755220+0000","last_became_active":"2023-10-06T02:58:33.735068+0000","last_became_peered":"2023-10-06T02:58:33.735068+0000","last_unstale":"2023-10-06T02:58:34.755220+0000","last_undegraded":"2023-10-06T02:58:34.755220+0000","last_fullsized":"2023-10-06T02:58:34.755220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:45:27.296192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.733225+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:58:34.733225+0000","last_peered":"2023-10-06T02:58:34.733225+0000","last_clean":"2023-10-06T02:58:34.733225+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:58:34.733225+0000","last_undegraded":"2023-10-06T02:58:34.733225+0000","last_fullsized":"2023-10-06T02:58:34.733225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.757425+0000","last_change":"2023-10-06T02:58:34.750920+0000","last_active":"2023-10-06T02:58:34.757425+0000","last_peered":"2023-10-06T02:58:34.757425+0000","last_clean":"2023-10-06T02:58:34.757425+0000","last_became_active":"2023-10-06T02:58:34.745651+0000","last_became_peered":"2023-10-06T02:58:34.745651+0000","last_unstale":"2023-10-06T02:58:34.757425+0000","last_undegraded":"2023-10-06T02:58:34.757425+0000","last_fullsized":"2023-10-06T02:58:34.757425+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:16:36.631494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.758787+0000","last_change":"2023-10-06T02:58:33.736569+0000","last_active":"2023-10-06T02:58:34.758787+0000","last_peered":"2023-10-06T02:58:34.758787+0000","last_clean":"2023-10-06T02:58:34.758787+0000","last_became_active":"2023-10-06T02:58:33.736326+0000","last_became_peered":"2023-10-06T02:58:33.736326+0000","last_unstale":"2023-10-06T02:58:34.758787+0000","last_undegraded":"2023-10-06T02:58:34.758787+0000","last_fullsized":"2023-10-06T02:58:34.758787+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.853592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.731923+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:58:34.731923+0000","last_peered":"2023-10-06T02:58:34.731923+0000","last_clean":"2023-10-06T02:58:34.731923+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:58:34.731923+0000","last_undegraded":"2023-10-06T02:58:34.731923+0000","last_fullsized":"2023-10-06T02:58:34.731923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.749649+0000","last_change":"2023-10-06T02:58:34.740370+0000","last_active":"2023-10-06T02:58:34.749649+0000","last_peered":"2023-10-06T02:58:34.749649+0000","last_clean":"2023-10-06T02:58:34.749649+0000","last_became_active":"2023-10-06T02:58:34.740130+0000","last_became_peered":"2023-10-06T02:58:34.740130+0000","last_unstale":"2023-10-06T02:58:34.749649+0000","last_undegraded":"2023-10-06T02:58:34.749649+0000","last_fullsized":"2023-10-06T02:58:34.749649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:33.714513+0000","last_clean_scrub_stamp":"2023-10-06T02:58:33.714513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:14:16.482180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.754208+0000","last_change":"2023-10-06T02:58:33.735199+0000","last_active":"2023-10-06T02:58:34.754208+0000","last_peered":"2023-10-06T02:58:34.754208+0000","last_clean":"2023-10-06T02:58:34.754208+0000","last_became_active":"2023-10-06T02:58:33.734599+0000","last_became_peered":"2023-10-06T02:58:33.734599+0000","last_unstale":"2023-10-06T02:58:34.754208+0000","last_undegraded":"2023-10-06T02:58:34.754208+0000","last_fullsized":"2023-10-06T02:58:34.754208+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:58:32.707554+0000","last_clean_scrub_stamp":"2023-10-06T02:58:32.707554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:05.133979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-06T02:58:34.725624+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:58:34.725624+0000","last_peered":"2023-10-06T02:58:34.725624+0000","last_clean":"2023-10-06T02:58:34.725624+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:58:34.725624+0000","last_undegraded":"2023-10-06T02:58:34.725624+0000","last_fullsized":"2023-10-06T02:58:34.725624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298680,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073160,"statfs":{"total":96636764160,"available":96330915840,"internally_reserved":0,"allocated":1425408,"data_stored":978448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72499999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70799999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.39500000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69999999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55600000000000005,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.622}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.47799999999999998,"15min":0.502},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60799999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.379}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51800000000000002,"15min":0.53000000000000003},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66400000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.53600000000000003,"15min":0.55900000000000005},"min":{"1min":0.38300000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":831488,"data_stored":387584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58899999999999997,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81599999999999995,"5min":3.415,"15min":3.415},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":1.546,"15min":1.546},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78000000000000003,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.74,"15min":1.74},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.67900000000000005,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69299999999999995,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.68200000000000005,"15min":0.72699999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69699999999999995,"5min":3.577,"15min":3.577},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64900000000000002,"15min":0.68300000000000005},"min":{"1min":0.51100000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.73699999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.34999999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.37},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.499}]},{"osd":5,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80300000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.439}]},{"osd":7,"last update":"Fri Oct 6 02:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55300000000000005,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.434,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298108,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073732,"statfs":{"total":96636764160,"available":96331501568,"internally_reserved":0,"allocated":839680,"data_stored":388605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.377,"15min":0.40100000000000002},"min":{"1min":0.23000000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.45300000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.41699999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.99099999999999999,"15min":1.2769999999999999},"min":{"1min":0.255,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44500000000000001,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.433,"15min":0.443},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.44400000000000001,"5min":1.181,"15min":1.181},"last":0.378}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.42699999999999999,"15min":0.443},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48099999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.311},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39000000000000001,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.626,"15min":0.626},"last":0.34899999999999998}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.47799999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70299999999999996,"5min":1.02,"15min":1.02},"last":0.505},{"interface":"front","average":{"1min":0.60299999999999998,"5min":1.228,"15min":1.5},"min":{"1min":0.42299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79700000000000004,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.2130000000000001,"15min":1.4830000000000001},"min":{"1min":0.46800000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73399999999999999,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81000000000000005,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.44}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.48399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.79400000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.242,"15min":1.52},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82499999999999996,"5min":21.166,"15min":21.166},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78600000000000003,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84199999999999997,"5min":0.997,"15min":0.997},"last":0.48799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298668,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073172,"statfs":{"total":96636764160,"available":96330928128,"internally_reserved":0,"allocated":1413120,"data_stored":976849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32800000000000001,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.33200000000000002,"15min":0.32800000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.25}]},{"osd":2,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.373,"15min":0.372},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26500000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51300000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.27900000000000003}]},{"osd":3,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40000000000000002,"15min":0.40699999999999997},"min":{"1min":0.27400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48299999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72299999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50800000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.875,"5min":0.879,"15min":0.879},"last":0.66600000000000004}]},{"osd":6,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60899999999999999,"15min":0.622},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88500000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63200000000000001},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.629}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298104,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073736,"statfs":{"total":96636764160,"available":96331505664,"internally_reserved":0,"allocated":835584,"data_stored":389028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.315,"15min":0.307},"min":{"1min":0.23200000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32000000000000001},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.51200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.27300000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.58399999999999996,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.316},{"interface":"front","average":{"1min":0.378,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53700000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40500000000000003,"15min":0.39900000000000002},"min":{"1min":0.32900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56499999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.45900000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79400000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.872,"5min":1.077,"15min":1.077},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79600000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":386593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.45500000000000002},"min":{"1min":0.249,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.60899999999999999,"5min":2.569,"15min":2.569},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42899999999999999,"15min":0.45400000000000001},"min":{"1min":0.27100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.47399999999999998,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.254}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.41699999999999998,"15min":0.442},"min":{"1min":0.22600000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.51200000000000001,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.308},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.44800000000000001,"15min":0.47999999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.44900000000000001,"15min":0.46899999999999997},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56999999999999995,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.217},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.47199999999999998,"15min":0.498},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54400000000000004,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.316}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.65200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78200000000000003,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.497},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.64400000000000002,"15min":0.67200000000000004},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.59799999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.65000000000000002,"15min":0.68000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.66200000000000003,"15min":0.69399999999999995},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80000000000000004,"5min":2.532,"15min":2.532},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63400000000000001,"15min":0.65400000000000003},"min":{"1min":0.40000000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82699999999999996,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.71799999999999997,"5min":2.496,"15min":2.496},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84799999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.52600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":387562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.438}]},{"osd":3,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.91500000000000004,"15min":1.0409999999999999},"min":{"1min":0.46300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.871,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.375}]},{"osd":5,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.55900000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.60799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64200000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69399999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60699999999999998,"15min":0.621},"min":{"1min":0.437,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.47299999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.753,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":387582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.504,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.66600000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.626},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33800000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":1.167,"15min":1.167},"last":0.57099999999999995}]},{"osd":1,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.57399999999999995},"min":{"1min":0.38700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.625,"5min":1.117,"15min":1.117},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.51200000000000001,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66600000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68500000000000005,"5min":1.2,"15min":1.2},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68300000000000005,"5min":1.135,"15min":1.135},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.67100000000000004,"5min":1.208,"15min":1.208},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.49099999999999999,"15min":0.503},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66400000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.41299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73199999999999998,"5min":0.87,"15min":0.87},"last":0.432}]},{"osd":6,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56100000000000005,"15min":0.58299999999999996},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":1.054,"15min":1.054},"last":0.441},{"interface":"front","average":{"1min":0.498,"5min":0.56999999999999995,"15min":0.58899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71899999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76000000000000001,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78200000000000003,"5min":1.008,"15min":1.008},"last":0.53800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T02:58:44.027 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T02:58:44.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T02:58:44.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.182+0000 7f57b594c700 1 Processor -- start 2023-10-06T02:58:44.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.182+0000 7f57b594c700 1 -- start start 2023-10-06T02:58:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.182+0000 7f57b594c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f57b0067c10 0x7f57b00cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.182+0000 7f57b594c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57b015dd30 0x7f57b00cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.182+0000 7f57b594c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b015d8a0 con 0x7f57b0159b20 2023-10-06T02:58:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.182+0000 7f57b594c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b015ab10 con 0x7f57b015dd30 2023-10-06T02:58:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.182+0000 7f57b594c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b015a630 con 0x7f57b0067c10 2023-10-06T02:58:44.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57a7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57b015dd30 0x7f57b00cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57af7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f57b0159b20 0x7f57b0159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51088/0 (socket says 172.21.15.84:51088) 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57af7fe700 1 -- 172.21.15.84:0/1416939586 learned_addr learned my addr 172.21.15.84:0/1416939586 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57aeffd700 1 --2- 172.21.15.84:0/1416939586 >> v2:172.21.15.131:3300/0 conn(0x7f57b0067c10 0x7f57b00cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57ae7fc700 1 -- 172.21.15.84:0/1416939586 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683623495 0 0) 0x7f57b015d8a0 con 0x7f57b0159b20 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57ae7fc700 1 -- 172.21.15.84:0/1416939586 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f579c003570 con 0x7f57b0159b20 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57a7fff700 1 -- 172.21.15.84:0/1416939586 >> v2:172.21.15.131:3300/0 conn(0x7f57b0067c10 msgr2=0x7f57b00cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57a7fff700 1 --2- 172.21.15.84:0/1416939586 >> v2:172.21.15.131:3300/0 conn(0x7f57b0067c10 0x7f57b00cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57a7fff700 1 -- 172.21.15.84:0/1416939586 >> v1:172.21.15.84:6789/0 conn(0x7f57b0159b20 legacy=0x7f57b0159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57a7fff700 1 -- 172.21.15.84:0/1416939586 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b015a830 con 0x7f57b015dd30 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57a7fff700 1 --2- 172.21.15.84:0/1416939586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b015dd30 0x7f57b00cb2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f57b006dc20 tx=0x7f57980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dfe9b69557350 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:44.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57ae7fc700 1 -- 172.21.15.84:0/1416939586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798011630 con 0x7f57b015dd30 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57ae7fc700 1 -- 172.21.15.84:0/1416939586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798011790 con 0x7f57b015dd30 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.183+0000 7f57ae7fc700 1 -- 172.21.15.84:0/1416939586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798011b30 con 0x7f57b015dd30 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.184+0000 7f57b594c700 1 -- 172.21.15.84:0/1416939586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b015dd30 msgr2=0x7f57b00cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.184+0000 7f57b594c700 1 --2- 172.21.15.84:0/1416939586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b015dd30 0x7f57b00cb2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f57b006dc20 tx=0x7f57980091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.184+0000 7f57b594c700 1 -- 172.21.15.84:0/1416939586 shutdown_connections 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.184+0000 7f57b594c700 1 --2- 172.21.15.84:0/1416939586 >> v2:172.21.15.131:3300/0 conn(0x7f57b0067c10 0x7f57b00cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.184+0000 7f57b594c700 1 --2- 172.21.15.84:0/1416939586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b015dd30 0x7f57b00cb2f0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.184+0000 7f57b594c700 1 -- 172.21.15.84:0/1416939586 >> 172.21.15.84:0/1416939586 conn(0x7f57b00cd1e0 msgr2=0x7f57b00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.184+0000 7f57b594c700 1 -- 172.21.15.84:0/1416939586 shutdown_connections 2023-10-06T02:58:44.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.184+0000 7f57b594c700 1 -- 172.21.15.84:0/1416939586 wait complete. 2023-10-06T02:58:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.185+0000 7f57b594c700 1 Processor -- start 2023-10-06T02:58:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.185+0000 7f57b594c700 1 -- start start 2023-10-06T02:58:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57b594c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b0067c10 0x7f57b00c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57b594c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57b0159b20 0x7f57b0150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57b594c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57b015dd30 0x7f57b0158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57b594c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00c8b20 con 0x7f57b0067c10 2023-10-06T02:58:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57b594c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00c9420 con 0x7f57b0159b20 2023-10-06T02:58:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57b594c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00c4da0 con 0x7f57b015dd30 2023-10-06T02:58:44.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57aeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b0067c10 0x7f57b00c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57aeffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b0067c10 0x7f57b00c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42700/0 (socket says 172.21.15.84:42700) 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57aeffd700 1 -- 172.21.15.84:0/2311437925 learned_addr learned my addr 172.21.15.84:0/2311437925 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57aeffd700 1 -- 172.21.15.84:0/2311437925 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57b015dd30 msgr2=0x7f57b0158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57aeffd700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57b015dd30 0x7f57b0158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57aeffd700 1 -- 172.21.15.84:0/2311437925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57b0159b20 msgr2=0x7f57b0150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57aeffd700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57b0159b20 0x7f57b0150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57aeffd700 1 -- 172.21.15.84:0/2311437925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798009420 con 0x7f57b0067c10 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57aeffd700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b0067c10 0x7f57b00c8ee0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f57a000d860 tx=0x7f57a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57a6ffd700 1 -- 172.21.15.84:0/2311437925 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00125f0 con 0x7f57b0067c10 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57a6ffd700 1 -- 172.21.15.84:0/2311437925 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0012750 con 0x7f57b0067c10 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b0157c20 con 0x7f57b0067c10 2023-10-06T02:58:44.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57a6ffd700 1 -- 172.21.15.84:0/2311437925 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0012af0 con 0x7f57b0067c10 2023-10-06T02:58:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.186+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b01581e0 con 0x7f57b0067c10 2023-10-06T02:58:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.187+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b0064ad0 con 0x7f57b0067c10 2023-10-06T02:58:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.188+0000 7f57a6ffd700 1 -- 172.21.15.84:0/2311437925 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57a001e460 con 0x7f57b0067c10 2023-10-06T02:58:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.188+0000 7f57a6ffd700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5790066f30 0x7f57900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.188+0000 7f57a6ffd700 1 -- 172.21.15.84:0/2311437925 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f57a0084e90 con 0x7f57b0067c10 2023-10-06T02:58:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.188+0000 7f57a7fff700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5790066f30 0x7f57900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.189+0000 7f57a7fff700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5790066f30 0x7f57900693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f57b00afc90 tx=0x7f5798017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.192+0000 7f57a6ffd700 1 -- 172.21.15.84:0/2311437925 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57a0055850 con 0x7f57b0067c10 2023-10-06T02:58:44.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.449+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f57b004bb80 con 0x7f57b0067c10 2023-10-06T02:58:44.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.453+0000 7f57a6ffd700 1 -- 172.21.15.84:0/2311437925 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f57a0086070 con 0x7f57b0067c10 2023-10-06T02:58:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5790066f30 msgr2=0x7f57900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5790066f30 0x7f57900693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f57b00afc90 tx=0x7f5798017000 comp rx=0 tx=0).stop 2023-10-06T02:58:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b0067c10 msgr2=0x7f57b00c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b0067c10 0x7f57b00c8ee0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f57a000d860 tx=0x7f57a0008040 comp rx=0 tx=0).stop 2023-10-06T02:58:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 shutdown_connections 2023-10-06T02:58:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5790066f30 0x7f57900693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f57b015dd30 0x7f57b0158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57b0067c10 0x7f57b00c8ee0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 --2- 172.21.15.84:0/2311437925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57b0159b20 0x7f57b0150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 >> 172.21.15.84:0/2311437925 conn(0x7f57b00cd1e0 msgr2=0x7f57b015b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 shutdown_connections 2023-10-06T02:58:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.455+0000 7f57b594c700 1 -- 172.21.15.84:0/2311437925 wait complete. 2023-10-06T02:58:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T02:58:44.468 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:44.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.581+0000 7f3bf4cba700 1 Processor -- start 2023-10-06T02:58:44.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.581+0000 7f3bf4cba700 1 -- start start 2023-10-06T02:58:44.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bf4cba700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf01595a0 0x7f3bf00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bf4cba700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf00b0ca0 con 0x7f3bf00b49e0 2023-10-06T02:58:44.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bf4cba700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf00b0f80 con 0x7f3bf00b07a0 2023-10-06T02:58:44.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bf4cba700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00b1260 con 0x7f3bf01595a0 2023-10-06T02:58:44.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bedd9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3bf00b49e0 0x7f3bf00aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51096/0 (socket says 172.21.15.84:51096) 2023-10-06T02:58:44.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bedd9b700 1 -- 172.21.15.84:0/2248087828 learned_addr learned my addr 172.21.15.84:0/2248087828 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:44.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bee59c700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf01595a0 0x7f3bf00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759833635 0 0) 0x7f3bf00b0ca0 con 0x7f3bf00b49e0 2023-10-06T02:58:44.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bdc003570 con 0x7f3bf00b49e0 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1205095065 0 0) 0x7f3bdc003570 con 0x7f3bf00b49e0 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf01595a0 msgr2=0x7f3bf00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf01595a0 0x7f3bf00aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 >> v1:172.21.15.131:6789/0 conn(0x7f3bf00b07a0 legacy=0x7f3bf00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00b1540 con 0x7f3bf00b49e0 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f3bd80017f0 con 0x7f3bf00b49e0 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 >> v1:172.21.15.84:6789/0 conn(0x7f3bf00b49e0 legacy=0x7f3bf00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bdc003a90 0x7f3bdc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.582+0000 7f3bed59a700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bdc004810 0x7f3bdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bed59a700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf01595a0 0x7f3bdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00b1260 con 0x7f3bdc004810 2023-10-06T02:58:44.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc00bb10 con 0x7f3bdc003a90 2023-10-06T02:58:44.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc00bcd0 con 0x7f3bf01595a0 2023-10-06T02:58:44.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bedd9b700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bdc004810 0x7f3bdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bee59c700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bdc003a90 0x7f3bdc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3beed9d700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf01595a0 0x7f3bdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bedd9b700 1 -- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf01595a0 msgr2=0x7f3bdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:44.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bedd9b700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf01595a0 0x7f3bdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bedd9b700 1 -- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bdc003a90 msgr2=0x7f3bdc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bedd9b700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bdc003a90 0x7f3bdc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bedd9b700 1 -- 172.21.15.84:0/2248087828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc003570 con 0x7f3bdc004810 2023-10-06T02:58:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bedd9b700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bdc004810 0x7f3bdc004c80 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800a920 tx=0x7f3bd80021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc24684503e4411f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80070d0 con 0x7f3bdc004810 2023-10-06T02:58:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd8007230 con 0x7f3bdc004810 2023-10-06T02:58:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.583+0000 7f3bed59a700 1 -- 172.21.15.84:0/2248087828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80075f0 con 0x7f3bdc004810 2023-10-06T02:58:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.584+0000 7f3bf4cba700 1 -- 172.21.15.84:0/2248087828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bdc004810 msgr2=0x7f3bdc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.584+0000 7f3bf4cba700 1 --2- 172.21.15.84:0/2248087828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bdc004810 0x7f3bdc004c80 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800a920 tx=0x7f3bd80021f0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.584+0000 7f3beed9d700 1 -- 172.21.15.84:0/2248087828 reap_dead start 2023-10-06T02:58:44.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.584+0000 7f3bf4cba700 1 -- 172.21.15.84:0/2248087828 shutdown_connections 2023-10-06T02:58:44.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.584+0000 7f3bf4cba700 1 -- 172.21.15.84:0/2248087828 >> 172.21.15.84:0/2248087828 conn(0x7f3bf0099830 msgr2=0x7f3bf006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:44.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.584+0000 7f3bf4cba700 1 -- 172.21.15.84:0/2248087828 shutdown_connections 2023-10-06T02:58:44.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.584+0000 7f3bf4cba700 1 -- 172.21.15.84:0/2248087828 wait complete. 2023-10-06T02:58:44.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.585+0000 7f3bf4cba700 1 Processor -- start 2023-10-06T02:58:44.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.585+0000 7f3bf4cba700 1 -- start start 2023-10-06T02:58:44.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bf4cba700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bdc004810 0x7f3bf0157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bf4cba700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf0157ba0 0x7f3bf009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bf4cba700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf01699f0 0x7f3bf00693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bf4cba700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf016cff0 con 0x7f3bf0157ba0 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bf4cba700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf009b930 con 0x7f3bf01699f0 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bf4cba700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf009bc10 con 0x7f3bdc004810 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bedd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf0157ba0 0x7f3bf009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bedd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf0157ba0 0x7f3bf009d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42716/0 (socket says 172.21.15.84:42716) 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bedd9b700 1 -- 172.21.15.84:0/139673438 learned_addr learned my addr 172.21.15.84:0/139673438 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bee59c700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bdc004810 0x7f3bf0157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3beed9d700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf01699f0 0x7f3bf00693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bedd9b700 1 -- 172.21.15.84:0/139673438 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bdc004810 msgr2=0x7f3bf0157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bedd9b700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bdc004810 0x7f3bf0157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bedd9b700 1 -- 172.21.15.84:0/139673438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf01699f0 msgr2=0x7f3bf00693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bedd9b700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf01699f0 0x7f3bf00693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bedd9b700 1 -- 172.21.15.84:0/139673438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf009bef0 con 0x7f3bf0157ba0 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3beed9d700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf01699f0 0x7f3bf00693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bedd9b700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf0157ba0 0x7f3bf009d890 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc004770 tx=0x7f3bd8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3be67fc700 1 -- 172.21.15.84:0/139673438 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8001250 con 0x7f3bf0157ba0 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3be67fc700 1 -- 172.21.15.84:0/139673438 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd8007960 con 0x7f3bf0157ba0 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf009c1d0 con 0x7f3bf0157ba0 2023-10-06T02:58:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.586+0000 7f3be67fc700 1 -- 172.21.15.84:0/139673438 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8007b10 con 0x7f3bf0157ba0 2023-10-06T02:58:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.587+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf009ddd0 con 0x7f3bf0157ba0 2023-10-06T02:58:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.587+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0064ad0 con 0x7f3bf0157ba0 2023-10-06T02:58:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.588+0000 7f3be67fc700 1 -- 172.21.15.84:0/139673438 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bd8024020 con 0x7f3bf0157ba0 2023-10-06T02:58:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.588+0000 7f3be67fc700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd0066f30 0x7f3bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.588+0000 7f3be67fc700 1 -- 172.21.15.84:0/139673438 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3bd8086740 con 0x7f3bf0157ba0 2023-10-06T02:58:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.588+0000 7f3bee59c700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd0066f30 0x7f3bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.589+0000 7f3bee59c700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd0066f30 0x7f3bd00693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3be8006ea0 tx=0x7f3be8009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.592+0000 7f3be67fc700 1 -- 172.21.15.84:0/139673438 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bd8053710 con 0x7f3bf0157ba0 2023-10-06T02:58:44.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.818+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bf00b1820 con 0x7f3bf0157ba0 2023-10-06T02:58:44.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.818+0000 7f3be67fc700 1 -- 172.21.15.84:0/139673438 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f3bd80075b0 con 0x7f3bf0157ba0 2023-10-06T02:58:44.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:44.820 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":52,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5567,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4032170839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4032170839},{"type":"v1","addr":"172.21.15.131:6835","nonce":4032170839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6525,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1455824046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1455824046},{"type":"v1","addr":"172.21.15.84:6836","nonce":1455824046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:58:34.102008+0000","modified":"2023-10-06T02:58:38.129434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3591915780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3591915780},{"type":"v1","addr":"172.21.15.84:6837","nonce":3591915780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:58:44.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd0066f30 msgr2=0x7f3bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd0066f30 0x7f3bd00693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3be8006ea0 tx=0x7f3be8009120 comp rx=0 tx=0).stop 2023-10-06T02:58:44.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf0157ba0 msgr2=0x7f3bf009d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:44.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf0157ba0 0x7f3bf009d890 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc004770 tx=0x7f3bd8015000 comp rx=0 tx=0).stop 2023-10-06T02:58:44.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 shutdown_connections 2023-10-06T02:58:44.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd0066f30 0x7f3bd00693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf01699f0 0x7f3bf00693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bdc004810 0x7f3bf0157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 --2- 172.21.15.84:0/139673438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf0157ba0 0x7f3bf009d890 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:44.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 >> 172.21.15.84:0/139673438 conn(0x7f3bf0099830 msgr2=0x7f3bf00cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:44.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 shutdown_connections 2023-10-06T02:58:44.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:44.820+0000 7f3bf4cba700 1 -- 172.21.15.84:0/139673438 wait complete. 2023-10-06T02:58:44.823 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 52 2023-10-06T02:58:45.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:58:34.102008+0000', 'modified': '2023-10-06T02:58:38.129434+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6528}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6528': {'gid': 6528, 'name': 'a', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/3591915780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 3591915780}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 3591915780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:58:45.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T02:58:45.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:58:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.353+0000 7ffb5b514700 1 Processor -- start 2023-10-06T02:58:45.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.353+0000 7ffb5b514700 1 -- start start 2023-10-06T02:58:45.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5b514700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb54159480 0x7ffb540b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5b514700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540b3610 0x7ffb540cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5b514700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffb540cc1b0 0x7ffb540b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5b514700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540cb7e0 con 0x7ffb54159480 2023-10-06T02:58:45.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5b514700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540b08a0 con 0x7ffb540cc1b0 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5b514700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540cb190 con 0x7ffb540b3610 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5a512700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb54159480 0x7ffb540b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5a512700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb54159480 0x7ffb540b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42722/0 (socket says 172.21.15.84:42722) 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5a512700 1 -- 172.21.15.84:0/1001977227 learned_addr learned my addr 172.21.15.84:0/1001977227 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5a512700 1 -- 172.21.15.84:0/1001977227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540b3610 msgr2=0x7ffb540cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5a512700 1 --2- 172.21.15.84:0/1001977227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540b3610 0x7ffb540cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/1001977227 >> v2:172.21.15.131:3300/0 conn(0x7ffb540cc1b0 0x7ffb540b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5a512700 1 -- 172.21.15.84:0/1001977227 >> v2:172.21.15.131:3300/0 conn(0x7ffb540cc1b0 msgr2=0x7ffb540b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5a512700 1 --2- 172.21.15.84:0/1001977227 >> v2:172.21.15.131:3300/0 conn(0x7ffb540cc1b0 0x7ffb540b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5a512700 1 -- 172.21.15.84:0/1001977227 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540cb470 con 0x7ffb54159480 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/1001977227 >> v2:172.21.15.131:3300/0 conn(0x7ffb540cc1b0 0x7ffb540b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:45.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb5a512700 1 --2- 172.21.15.84:0/1001977227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54159480 0x7ffb540b30d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ffb5415cf30 tx=0x7ffb4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb24b7a7829b2dc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb59510700 1 -- 172.21.15.84:0/1001977227 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00b860 con 0x7ffb54159480 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb59510700 1 -- 172.21.15.84:0/1001977227 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c00b9c0 con 0x7ffb54159480 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.354+0000 7ffb59510700 1 -- 172.21.15.84:0/1001977227 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00bd60 con 0x7ffb54159480 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.355+0000 7ffb5b514700 1 -- 172.21.15.84:0/1001977227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54159480 msgr2=0x7ffb540b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.355+0000 7ffb5b514700 1 --2- 172.21.15.84:0/1001977227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54159480 0x7ffb540b30d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ffb5415cf30 tx=0x7ffb4c009250 comp rx=0 tx=0).stop 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.355+0000 7ffb5b514700 1 -- 172.21.15.84:0/1001977227 shutdown_connections 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.355+0000 7ffb5b514700 1 --2- 172.21.15.84:0/1001977227 >> v2:172.21.15.131:3300/0 conn(0x7ffb540cc1b0 0x7ffb540b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.355+0000 7ffb5b514700 1 --2- 172.21.15.84:0/1001977227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb54159480 0x7ffb540b30d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.355+0000 7ffb5b514700 1 --2- 172.21.15.84:0/1001977227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540b3610 0x7ffb540cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.355+0000 7ffb5b514700 1 -- 172.21.15.84:0/1001977227 >> 172.21.15.84:0/1001977227 conn(0x7ffb5406ed20 msgr2=0x7ffb5406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:45.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.355+0000 7ffb5b514700 1 -- 172.21.15.84:0/1001977227 shutdown_connections 2023-10-06T02:58:45.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.355+0000 7ffb5b514700 1 -- 172.21.15.84:0/1001977227 wait complete. 2023-10-06T02:58:45.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.356+0000 7ffb5b514700 1 Processor -- start 2023-10-06T02:58:45.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.356+0000 7ffb5b514700 1 -- start start 2023-10-06T02:58:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5b514700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540b3610 0x7ffb540c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5b514700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540cc1b0 0x7ffb540c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5b514700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb54159480 0x7ffb540c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5b514700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c4540 con 0x7ffb540b3610 2023-10-06T02:58:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5b514700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c3590 con 0x7ffb54159480 2023-10-06T02:58:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5b514700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c88f0 con 0x7ffb540cc1b0 2023-10-06T02:58:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5a512700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540b3610 0x7ffb540c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5a512700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540b3610 0x7ffb540c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42730/0 (socket says 172.21.15.84:42730) 2023-10-06T02:58:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5a512700 1 -- 172.21.15.84:0/2830933991 learned_addr learned my addr 172.21.15.84:0/2830933991 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb59d11700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540cc1b0 0x7ffb540c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb54159480 0x7ffb540c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5a512700 1 -- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540cc1b0 msgr2=0x7ffb540c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5a512700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540cc1b0 0x7ffb540c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5a512700 1 -- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb54159480 msgr2=0x7ffb540c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5a512700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb54159480 0x7ffb540c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5a512700 1 -- 172.21.15.84:0/2830933991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c0094f0 con 0x7ffb540b3610 2023-10-06T02:58:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb59d11700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540cc1b0 0x7ffb540c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb54159480 0x7ffb540c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.357+0000 7ffb5a512700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540b3610 0x7ffb540c7700 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0090b0 tx=0x7ffb4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.358+0000 7ffb527fc700 1 -- 172.21.15.84:0/2830933991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c026480 con 0x7ffb540b3610 2023-10-06T02:58:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.358+0000 7ffb527fc700 1 -- 172.21.15.84:0/2830933991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c01f070 con 0x7ffb540b3610 2023-10-06T02:58:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.358+0000 7ffb5b514700 1 -- 172.21.15.84:0/2830933991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb540c7ce0 con 0x7ffb540b3610 2023-10-06T02:58:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.358+0000 7ffb527fc700 1 -- 172.21.15.84:0/2830933991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c026830 con 0x7ffb540b3610 2023-10-06T02:58:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.358+0000 7ffb5b514700 1 -- 172.21.15.84:0/2830933991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb540c82a0 con 0x7ffb540b3610 2023-10-06T02:58:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.359+0000 7ffb527fc700 1 -- 172.21.15.84:0/2830933991 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb4c026ba0 con 0x7ffb540b3610 2023-10-06T02:58:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.359+0000 7ffb527fc700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffb40066f30 0x7ffb400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.359+0000 7ffb527fc700 1 -- 172.21.15.84:0/2830933991 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffb4c021070 con 0x7ffb540b3610 2023-10-06T02:58:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.359+0000 7ffb59d11700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffb40066f30 0x7ffb400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.360+0000 7ffb59d11700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffb40066f30 0x7ffb400693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffb48006fd0 tx=0x7ffb48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.361+0000 7ffb65a6eb80 1 Processor -- start 2023-10-06T02:58:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.361+0000 7ffb65a6eb80 1 -- start start 2023-10-06T02:58:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a908e50 0x55a10a8e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a8e92c0 0x55a10a8e4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a8e4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10a83ea70 con 0x55a10a8eaa10 2023-10-06T02:58:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10a83c270 con 0x55a10a908e50 2023-10-06T02:58:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a10a838060 con 0x55a10a8e92c0 2023-10-06T02:58:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb5ad13700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a8e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb5ad13700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a8e4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42736/0 (socket says 172.21.15.84:42736) 2023-10-06T02:58:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb5ad13700 1 -- 172.21.15.84:0/3964021060 learned_addr learned my addr 172.21.15.84:0/3964021060 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb5ad13700 1 -- 172.21.15.84:0/3964021060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a8e92c0 msgr2=0x55a10a8e4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/3964021060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a8e92c0 0x55a10a8e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb5ad13700 1 -- 172.21.15.84:0/3964021060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a908e50 msgr2=0x55a10a8e3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/3964021060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a908e50 0x55a10a8e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.362+0000 7ffb5ad13700 1 -- 172.21.15.84:0/3964021060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a10a6d2270 con 0x55a10a8eaa10 2023-10-06T02:58:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/3964021060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a8e4740 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400d4f0 tx=0x7ffb44007a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2b6d1d736703eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb3b7fe700 1 -- 172.21.15.84:0/3964021060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400a610 con 0x55a10a8eaa10 2023-10-06T02:58:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb3b7fe700 1 -- 172.21.15.84:0/3964021060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4400a770 con 0x55a10a8eaa10 2023-10-06T02:58:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb3b7fe700 1 -- 172.21.15.84:0/3964021060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400ab30 con 0x55a10a8eaa10 2023-10-06T02:58:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3964021060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 msgr2=0x55a10a8e4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3964021060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a8e4740 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400d4f0 tx=0x7ffb44007a70 comp rx=0 tx=0).stop 2023-10-06T02:58:45.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3964021060 shutdown_connections 2023-10-06T02:58:45.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3964021060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a908e50 0x55a10a8e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3964021060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a8e4740 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3964021060 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a8e92c0 0x55a10a8e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3964021060 >> 172.21.15.84:0/3964021060 conn(0x55a10a8e8e80 msgr2=0x55a10a8e96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:45.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3964021060 shutdown_connections 2023-10-06T02:58:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.363+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3964021060 wait complete. 2023-10-06T02:58:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.364+0000 7ffb65a6eb80 1 -- start start 2023-10-06T02:58:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.364+0000 7ffb65a6eb80 1 Processor -- start 2023-10-06T02:58:45.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8e92c0 0x55a10a906e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a931c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a909460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10a7e3890 con 0x55a10a8eaa10 2023-10-06T02:58:45.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10a7feea0 con 0x55a10a8e92c0 2023-10-06T02:58:45.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a10a6bae30 con 0x55a10a908e50 2023-10-06T02:58:45.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb65a6eb80 10 client.0 _ll_register_callbacks cb 0x55a10a8ab020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:45.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb59d11700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a931c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb59d11700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a931c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42744/0 (socket says 172.21.15.84:42744) 2023-10-06T02:58:45.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb59d11700 1 -- 172.21.15.84:0/2543382061 learned_addr learned my addr 172.21.15.84:0/2543382061 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a909460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb5a512700 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8e92c0 0x55a10a906e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb59d11700 1 -- 172.21.15.84:0/2543382061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 msgr2=0x55a10a909460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb59d11700 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a909460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb59d11700 1 -- 172.21.15.84:0/2543382061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8e92c0 msgr2=0x55a10a906e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb59d11700 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8e92c0 0x55a10a906e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb59d11700 1 -- 172.21.15.84:0/2543382061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb44007d50 con 0x55a10a8eaa10 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.365+0000 7ffb5a512700 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8e92c0 0x55a10a906e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb59d11700 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a931c70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7ffb5414c2a0 tx=0x7ffb48011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404c63df2d314403 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb38ff9700 1 -- 172.21.15.84:0/2543382061 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48007ec0 con 0x55a10a8eaa10 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb38ff9700 1 -- 172.21.15.84:0/2543382061 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffb4801f450 con 0x55a10a8eaa10 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/2543382061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a10a8dc940 con 0x55a10a8eaa10 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb38ff9700 1 -- 172.21.15.84:0/2543382061 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb4801f820 con 0x55a10a8eaa10 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb65a6eb80 10 client.6705 fetch_fsmap learned FSMap version 52 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/2543382061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x55a10a674fe0 con 0x55a10a8eaa10 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb38ff9700 1 -- 172.21.15.84:0/2543382061 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a10a8dc940 con 0x55a10a8eaa10 2023-10-06T02:58:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb38ff9700 1 -- 172.21.15.84:0/2543382061 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffb4801f980 con 0x55a10a8eaa10 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb65a6eb80 10 client.6705 fetch_fsmap finished waiting for FSMap version 52 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb65a6eb80 10 client.6705 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb65a6eb80 20 client.6705 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55a10a92f930 0x55a10a92fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb65a6eb80 4 client.6705 mds_command: new command op to 6528 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/2543382061 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a10a8b9870 con 0x55a10a92f930 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.366+0000 7ffb5a512700 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55a10a92f930 0x55a10a92fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb38ff9700 10 client.6705 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb5a512700 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55a10a92f930 0x55a10a92fd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e319f8956fb9d527 server_cookie=b233294630eb8436 in_seq=0 out_seq=0 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb38ff9700 1 -- 172.21.15.84:0/2543382061 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a10a8b9870 con 0x55a10a92f930 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb38ff9700 10 client.6705 handle_command_reply: tid=0 2023-10-06T02:58:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb65a6eb80 1 client.6705 shutdown 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/2543382061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 msgr2=0x55a10a931c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a931c70 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7ffb5414c2a0 tx=0x7ffb48011000 comp rx=0 tx=0).stop 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/2543382061 shutdown_connections 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55a10a92f930 0x55a10a92fd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8e92c0 0x55a10a906e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a909460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb38ff9700 0 client.6705 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/2543382061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8eaa10 0x55a10a931c70 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.367+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/2543382061 >> 172.21.15.84:0/2543382061 conn(0x55a10a8e8e80 msgr2=0x55a10a8e9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.368+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/2543382061 shutdown_connections 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.368+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/2543382061 wait complete. 2023-10-06T02:58:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.368+0000 7ffb65a6eb80 20 client.6705 trim_cache size 0 max 16384 2023-10-06T02:58:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.384+0000 7ffb65a6eb80 1 Processor -- start 2023-10-06T02:58:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb65a6eb80 1 -- start start 2023-10-06T02:58:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a8ea050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 0x55a10a941040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a917050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10a92ec10 con 0x55a10a8e92c0 2023-10-06T02:58:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10a8e9690 con 0x55a10a8eaa10 2023-10-06T02:58:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a10a8e9e20 con 0x55a10a908e50 2023-10-06T02:58:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb5a512700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a8ea050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb5a512700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a8ea050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42748/0 (socket says 172.21.15.84:42748) 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.385+0000 7ffb5a512700 1 -- 172.21.15.84:0/286347017 learned_addr learned my addr 172.21.15.84:0/286347017 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb59d11700 1 --2- 172.21.15.84:0/286347017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 0x55a10a941040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/286347017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a917050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb5a512700 1 -- 172.21.15.84:0/286347017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 msgr2=0x55a10a917050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb5a512700 1 --2- 172.21.15.84:0/286347017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a917050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb5a512700 1 -- 172.21.15.84:0/286347017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 msgr2=0x55a10a941040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb5a512700 1 --2- 172.21.15.84:0/286347017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 0x55a10a941040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb5a512700 1 -- 172.21.15.84:0/286347017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a10a806780 con 0x55a10a8e92c0 2023-10-06T02:58:45.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb5a512700 1 --2- 172.21.15.84:0/286347017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a8ea050 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c084990 tx=0x7ffb4c01d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e269045d300c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb3bfff700 1 -- 172.21.15.84:0/286347017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c057310 con 0x55a10a8e92c0 2023-10-06T02:58:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb3bfff700 1 -- 172.21.15.84:0/286347017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c05a560 con 0x55a10a8e92c0 2023-10-06T02:58:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb3bfff700 1 -- 172.21.15.84:0/286347017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c05e2b0 con 0x55a10a8e92c0 2023-10-06T02:58:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/286347017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 msgr2=0x55a10a8ea050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/286347017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a8ea050 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c084990 tx=0x7ffb4c01d040 comp rx=0 tx=0).stop 2023-10-06T02:58:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/286347017 shutdown_connections 2023-10-06T02:58:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/286347017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a917050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/286347017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a8ea050 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/286347017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 0x55a10a941040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/286347017 >> 172.21.15.84:0/286347017 conn(0x55a10a8e8e80 msgr2=0x55a10a8de400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/286347017 shutdown_connections 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.386+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/286347017 wait complete. 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.387+0000 7ffb65a6eb80 1 -- start start 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.387+0000 7ffb65a6eb80 1 Processor -- start 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a905660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 0x55a10a905ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb65a6eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a93c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10a943920 con 0x55a10a8e92c0 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a10a944df0 con 0x55a10a8eaa10 2023-10-06T02:58:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb65a6eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a10a946580 con 0x55a10a908e50 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb65a6eb80 10 client.0 _ll_register_callbacks cb 0x55a10a8ab020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5a512700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a905660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5a512700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a905660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42760/0 (socket says 172.21.15.84:42760) 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5a512700 1 -- 172.21.15.84:0/3555241255 learned_addr learned my addr 172.21.15.84:0/3555241255 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5ad13700 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a93c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb59d11700 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 0x55a10a905ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5a512700 1 -- 172.21.15.84:0/3555241255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 msgr2=0x55a10a93c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5a512700 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a93c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5a512700 1 -- 172.21.15.84:0/3555241255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 msgr2=0x55a10a905ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5a512700 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 0x55a10a905ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5a512700 1 -- 172.21.15.84:0/3555241255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb540c82a0 con 0x55a10a8e92c0 2023-10-06T02:58:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb5a512700 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a905660 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0572a0 tx=0x7ffb4c06e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a197b265567a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.388+0000 7ffb38ff9700 1 -- 172.21.15.84:0/3555241255 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0849e0 con 0x55a10a8e92c0 2023-10-06T02:58:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb38ff9700 1 -- 172.21.15.84:0/3555241255 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffb4c0556b0 con 0x55a10a8e92c0 2023-10-06T02:58:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3555241255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb4400a770 con 0x55a10a8e92c0 2023-10-06T02:58:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb38ff9700 1 -- 172.21.15.84:0/3555241255 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb4c057780 con 0x55a10a8e92c0 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 10 client.6711 fetch_fsmap learned FSMap version 52 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3555241255 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x55a10a7ed470 con 0x55a10a8e92c0 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb38ff9700 1 -- 172.21.15.84:0/3555241255 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4400a770 con 0x55a10a8e92c0 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb38ff9700 1 -- 172.21.15.84:0/3555241255 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffb4c056800 con 0x55a10a8e92c0 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 10 client.6711 fetch_fsmap finished waiting for FSMap version 52 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 10 client.6711 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 20 client.6711 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55a10a98d0a0 0x55a10a93cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 4 client.6711 mds_command: new command op to 6528 tid=0[{"prefix": "status"}] 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3555241255 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a10a7dae00 con 0x55a10a98d0a0 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb59d11700 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55a10a98d0a0 0x55a10a93cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb38ff9700 10 client.6711 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb59d11700 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55a10a98d0a0 0x55a10a93cca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca4864a6047169f7 server_cookie=77a7cc76f423c261 in_seq=0 out_seq=0 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb38ff9700 1 -- 172.21.15.84:0/3555241255 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x7ffb48017150 con 0x55a10a98d0a0 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb38ff9700 10 client.6711 handle_command_reply: tid=0 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.389+0000 7ffb65a6eb80 1 client.6711 shutdown 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3555241255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 msgr2=0x55a10a905660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a905660 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0572a0 tx=0x7ffb4c06e000 comp rx=0 tx=0).stop 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3555241255 shutdown_connections 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55a10a98d0a0 0x55a10a93cca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a10a908e50 0x55a10a93c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a10a8e92c0 0x55a10a905660 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb38ff9700 0 client.6711 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:58:45.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 --2- 172.21.15.84:0/3555241255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a10a8eaa10 0x55a10a905ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3555241255 >> 172.21.15.84:0/3555241255 conn(0x55a10a8e8e80 msgr2=0x55a10a913b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:45.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3555241255 shutdown_connections 2023-10-06T02:58:45.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 1 -- 172.21.15.84:0/3555241255 wait complete. 2023-10-06T02:58:45.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb65a6eb80 20 client.6711 trim_cache size 0 max 16384 2023-10-06T02:58:45.401 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:45.401 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:58:45.401 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6528, 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 10.656780952, 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 52, 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 68, 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 68, 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.78241955 2023-10-06T02:58:45.402 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 -- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffb40066f30 msgr2=0x7ffb400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffb40066f30 0x7ffb400693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffb48006fd0 tx=0x7ffb48008040 comp rx=0 tx=0).stop 2023-10-06T02:58:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 -- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540b3610 msgr2=0x7ffb540c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540b3610 0x7ffb540c7700 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0090b0 tx=0x7ffb4c017000 comp rx=0 tx=0).stop 2023-10-06T02:58:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 -- 172.21.15.84:0/2830933991 shutdown_connections 2023-10-06T02:58:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffb40066f30 0x7ffb400693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb54159480 0x7ffb540c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb540b3610 0x7ffb540c7700 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 --2- 172.21.15.84:0/2830933991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffb540cc1b0 0x7ffb540c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 -- 172.21.15.84:0/2830933991 >> 172.21.15.84:0/2830933991 conn(0x7ffb5406ed20 msgr2=0x7ffb540b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 -- 172.21.15.84:0/2830933991 shutdown_connections 2023-10-06T02:58:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.390+0000 7ffb5b514700 1 -- 172.21.15.84:0/2830933991 wait complete. 2023-10-06T02:58:45.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T02:58:45.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.518+0000 7f98df3a4700 1 Processor -- start 2023-10-06T02:58:45.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.519+0000 7f98df3a4700 1 -- start start 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.519+0000 7f98df3a4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98d80cadc0 0x7f98d8159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.519+0000 7f98df3a4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d8068d50 con 0x7f98d8159b10 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.519+0000 7f98df3a4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d815a6b0 con 0x7f98d80cb630 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.519+0000 7f98df3a4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d815a4d0 con 0x7f98d80cadc0 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98dd941700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f98d80cadc0 0x7f98d8159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98dc93f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f98d8159b10 0x7f98d80ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51100/0 (socket says 172.21.15.84:51100) 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98dc93f700 1 -- 172.21.15.84:0/3167798011 learned_addr learned my addr 172.21.15.84:0/3167798011 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98dd941700 1 -- 172.21.15.84:0/3167798011 >> v1:172.21.15.131:6789/0 conn(0x7f98d80cb630 legacy=0x7f98d80691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98dd941700 1 -- 172.21.15.84:0/3167798011 >> v1:172.21.15.84:6789/0 conn(0x7f98d8159b10 legacy=0x7f98d80ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98dd941700 1 -- 172.21.15.84:0/3167798011 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d815a990 con 0x7f98d80cadc0 2023-10-06T02:58:45.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98cffff700 1 -- 172.21.15.84:0/3167798011 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553855307 0 0) 0x7f98d8068d50 con 0x7f98d8159b10 2023-10-06T02:58:45.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98dd941700 1 --2- 172.21.15.84:0/3167798011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d80cadc0 0x7f98d8159f90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009e60 tx=0x7f98d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf057aa90573d56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98cffff700 1 -- 172.21.15.84:0/3167798011 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000e070 con 0x7f98d80cadc0 2023-10-06T02:58:45.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98cffff700 1 -- 172.21.15.84:0/3167798011 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000bc30 con 0x7f98d80cadc0 2023-10-06T02:58:45.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.520+0000 7f98cffff700 1 -- 172.21.15.84:0/3167798011 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0012430 con 0x7f98d80cadc0 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.521+0000 7f98df3a4700 1 -- 172.21.15.84:0/3167798011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d80cadc0 msgr2=0x7f98d8159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.521+0000 7f98df3a4700 1 --2- 172.21.15.84:0/3167798011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d80cadc0 0x7f98d8159f90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009e60 tx=0x7f98d0009780 comp rx=0 tx=0).stop 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.521+0000 7f98df3a4700 1 -- 172.21.15.84:0/3167798011 shutdown_connections 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.521+0000 7f98df3a4700 1 --2- 172.21.15.84:0/3167798011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d80cadc0 0x7f98d8159f90 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.521+0000 7f98df3a4700 1 -- 172.21.15.84:0/3167798011 >> 172.21.15.84:0/3167798011 conn(0x7f98d8070810 msgr2=0x7f98d8070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.521+0000 7f98df3a4700 1 -- 172.21.15.84:0/3167798011 shutdown_connections 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.521+0000 7f98df3a4700 1 -- 172.21.15.84:0/3167798011 wait complete. 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.522+0000 7f98df3a4700 1 Processor -- start 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.522+0000 7f98df3a4700 1 -- start start 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98df3a4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d80cadc0 0x7f98d816dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98df3a4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98d80cb630 0x7f98d80c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98df3a4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d8159b10 0x7f98d80b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98df3a4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c5b00 con 0x7f98d8159b10 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98df3a4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c6f20 con 0x7f98d80cadc0 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98df3a4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c5860 con 0x7f98d80cb630 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd941700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d8159b10 0x7f98d80b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd941700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d8159b10 0x7f98d80b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42782/0 (socket says 172.21.15.84:42782) 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd941700 1 -- 172.21.15.84:0/3089760539 learned_addr learned my addr 172.21.15.84:0/3089760539 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dc93f700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98d80cb630 0x7f98d80c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd140700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d80cadc0 0x7f98d816dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd941700 1 -- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98d80cb630 msgr2=0x7f98d80c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd941700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98d80cb630 0x7f98d80c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd941700 1 -- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d80cadc0 msgr2=0x7f98d816dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd941700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d80cadc0 0x7f98d816dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd941700 1 -- 172.21.15.84:0/3089760539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0009a20 con 0x7f98d8159b10 2023-10-06T02:58:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dc93f700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98d80cb630 0x7f98d80c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd140700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d80cadc0 0x7f98d816dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98dd941700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d8159b10 0x7f98d80b3660 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f98d80cdfe0 tx=0x7f98d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98cd7fa700 1 -- 172.21.15.84:0/3089760539 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d001b630 con 0x7f98d8159b10 2023-10-06T02:58:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98cd7fa700 1 -- 172.21.15.84:0/3089760539 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d001b790 con 0x7f98d8159b10 2023-10-06T02:58:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d80c7180 con 0x7f98d8159b10 2023-10-06T02:58:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.523+0000 7f98cd7fa700 1 -- 172.21.15.84:0/3089760539 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d001bb50 con 0x7f98d8159b10 2023-10-06T02:58:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.524+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d80c77c0 con 0x7f98d8159b10 2023-10-06T02:58:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.524+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d8064ad0 con 0x7f98d8159b10 2023-10-06T02:58:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.525+0000 7f98cd7fa700 1 -- 172.21.15.84:0/3089760539 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98d001c400 con 0x7f98d8159b10 2023-10-06T02:58:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.525+0000 7f98cd7fa700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f98bc066f30 0x7f98bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.525+0000 7f98cd7fa700 1 -- 172.21.15.84:0/3089760539 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f98d0086670 con 0x7f98d8159b10 2023-10-06T02:58:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.525+0000 7f98dd140700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f98bc066f30 0x7f98bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.526+0000 7f98dd140700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f98bc066f30 0x7f98bc0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f98d4001840 tx=0x7f98d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.529+0000 7f98cd7fa700 1 -- 172.21.15.84:0/3089760539 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98d0053640 con 0x7f98d8159b10 2023-10-06T02:58:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.753+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f98d815cbf0 con 0x7f98d8159b10 2023-10-06T02:58:45.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.753+0000 7f98cd7fa700 1 -- 172.21.15.84:0/3089760539 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f98d0056c60 con 0x7f98d8159b10 2023-10-06T02:58:45.755 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T02:58:45.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f98bc066f30 msgr2=0x7f98bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f98bc066f30 0x7f98bc0693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f98d4001840 tx=0x7f98d4009040 comp rx=0 tx=0).stop 2023-10-06T02:58:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d8159b10 msgr2=0x7f98d80b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d8159b10 0x7f98d80b3660 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f98d80cdfe0 tx=0x7f98d0019000 comp rx=0 tx=0).stop 2023-10-06T02:58:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 shutdown_connections 2023-10-06T02:58:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f98bc066f30 0x7f98bc0693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98d80cadc0 0x7f98d816dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98d8159b10 0x7f98d80b3660 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 --2- 172.21.15.84:0/3089760539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f98d80cb630 0x7f98d80c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 >> 172.21.15.84:0/3089760539 conn(0x7f98d8070810 msgr2=0x7f98d8151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 shutdown_connections 2023-10-06T02:58:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:45.756+0000 7f98df3a4700 1 -- 172.21.15.84:0/3089760539 wait complete. 2023-10-06T02:58:45.769 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T02:58:45.769 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T02:58:45.769 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T02:58:45.770 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T02:58:45.770 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T02:58:45.770 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T02:58:45.770 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T02:58:45.770 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T02:58:45.770 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:58:45.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:45.770 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T02:58:45.785 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T02:58:45.785 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T02:58:45.786 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42283sec preferred_lft 42283sec 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:58:45.787 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c4d3:64ff:fe4d:ee22/64 scope link 2023-10-06T02:58:45.788 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:58:45.788 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:58:45.788 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T02:58:45.788 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::41f:f5ff:fe77:615a/64 scope link 2023-10-06T02:58:45.788 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:58:45.788 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T02:58:45.788 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 66:ce:03:f1:65:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T02:58:45.788 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::64ce:3ff:fef1:6538/64 scope link 2023-10-06T02:58:45.788 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T02:58:45.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:45.789 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T02:58:45.848 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T02:58:45.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:45.850 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T02:58:45.906 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T02:58:45.906 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T02:58:45.906 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T02:58:45.907 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T02:58:45.907 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T02:58:45.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:45.907 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T02:58:45.907 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T02:58:45.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T02:58:45.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T02:58:45.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T02:58:45.907 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T02:58:46.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:46.006 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T02:58:46.021 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T02:58:46.021 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T02:58:46.021 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:58:46.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:46.021 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T02:58:46.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:58:46.086 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T02:58:46.141 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T02:58:46.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T02:58:46.141 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:58:46.195 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T02:58:46.195 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T02:58:46.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:58:46.274 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:58:46.275 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:58:46.275 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:58:46.283 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:58:46.283 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:58:46.283 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:58:46.283 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:58:46.283 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:58:46.305 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T02:58:46.305 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T02:58:46.305 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T02:58:46.305 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T02:58:46.305 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T02:58:46.305 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T02:58:46.305 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T02:58:46.305 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T02:58:46.307 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T02:58:46.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:58:46.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T02:58:46.372 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-10-06T02:58:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.527+0000 7f493f266700 1 Processor -- start 2023-10-06T02:58:46.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.527+0000 7f493f266700 1 -- start start 2023-10-06T02:58:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.528+0000 7f493f266700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f49381598e0 0x7f49380ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.528+0000 7f493f266700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49380cf610 con 0x7f4938159510 2023-10-06T02:58:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.528+0000 7f493f266700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49380cf8f0 con 0x7f49380cbcb0 2023-10-06T02:58:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.528+0000 7f493f266700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49380cfbd0 con 0x7f49381598e0 2023-10-06T02:58:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.528+0000 7f493d002700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4938159510 0x7f49380cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51102/0 (socket says 172.21.15.84:51102) 2023-10-06T02:58:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.528+0000 7f493d002700 1 -- 172.21.15.84:0/2161770165 learned_addr learned my addr 172.21.15.84:0/2161770165 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f493c801700 1 --2- 172.21.15.84:0/2161770165 >> v2:172.21.15.131:3300/0 conn(0x7f49381598e0 0x7f49380ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f492ffff700 1 -- 172.21.15.84:0/2161770165 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052630116 0 0) 0x7f49380cf610 con 0x7f4938159510 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f492ffff700 1 -- 172.21.15.84:0/2161770165 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4924003570 con 0x7f4938159510 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f492ffff700 1 -- 172.21.15.84:0/2161770165 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556601999 0 0) 0x7f49380cf8f0 con 0x7f49380cbcb0 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f492ffff700 1 -- 172.21.15.84:0/2161770165 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49380cf610 con 0x7f49380cbcb0 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f492ffff700 1 -- 172.21.15.84:0/2161770165 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1277069025 0 0) 0x7f4924003570 con 0x7f4938159510 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f493c801700 1 -- 172.21.15.84:0/2161770165 >> v1:172.21.15.131:6789/0 conn(0x7f49380cbcb0 legacy=0x7f49380ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f493c801700 1 -- 172.21.15.84:0/2161770165 >> v1:172.21.15.84:6789/0 conn(0x7f4938159510 legacy=0x7f49380cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f493c801700 1 -- 172.21.15.84:0/2161770165 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380cfeb0 con 0x7f49381598e0 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f493c801700 1 --2- 172.21.15.84:0/2161770165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 0x7f49380ce820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f49280098e0 tx=0x7f49280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6203bf884053d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f492ffff700 1 -- 172.21.15.84:0/2161770165 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934001470 con 0x7f49381598e0 2023-10-06T02:58:46.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f492ffff700 1 -- 172.21.15.84:0/2161770165 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4928011420 con 0x7f49381598e0 2023-10-06T02:58:46.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.529+0000 7f492ffff700 1 -- 172.21.15.84:0/2161770165 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49280117c0 con 0x7f49381598e0 2023-10-06T02:58:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.530+0000 7f493f266700 1 -- 172.21.15.84:0/2161770165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 msgr2=0x7f49380ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.530+0000 7f493f266700 1 --2- 172.21.15.84:0/2161770165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 0x7f49380ce820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f49280098e0 tx=0x7f49280091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.530+0000 7f493f266700 1 -- 172.21.15.84:0/2161770165 shutdown_connections 2023-10-06T02:58:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.530+0000 7f493f266700 1 --2- 172.21.15.84:0/2161770165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 0x7f49380ce820 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.530+0000 7f493f266700 1 -- 172.21.15.84:0/2161770165 >> 172.21.15.84:0/2161770165 conn(0x7f4938089e90 msgr2=0x7f49380997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:46.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.530+0000 7f493f266700 1 -- 172.21.15.84:0/2161770165 shutdown_connections 2023-10-06T02:58:46.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.530+0000 7f493f266700 1 -- 172.21.15.84:0/2161770165 wait complete. 2023-10-06T02:58:46.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.531+0000 7f493f266700 1 Processor -- start 2023-10-06T02:58:46.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.531+0000 7f493f266700 1 -- start start 2023-10-06T02:58:46.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.532+0000 7f493f266700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380cbcb0 0x7f49380b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:46.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.532+0000 7f493f266700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159510 0x7f4938157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:46.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.532+0000 7f493f266700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 0x7f49380b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:46.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.532+0000 7f493f266700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493816d2d0 con 0x7f4938159510 2023-10-06T02:58:46.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.532+0000 7f493f266700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49381549e0 con 0x7f49381598e0 2023-10-06T02:58:46.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.532+0000 7f493f266700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4938154cc0 con 0x7f49380cbcb0 2023-10-06T02:58:46.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.532+0000 7f493c801700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159510 0x7f4938157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:46.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.532+0000 7f493c801700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159510 0x7f4938157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42796/0 (socket says 172.21.15.84:42796) 2023-10-06T02:58:46.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.532+0000 7f493c801700 1 -- 172.21.15.84:0/1508296546 learned_addr learned my addr 172.21.15.84:0/1508296546 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:46.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493d803700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 0x7f49380b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:46.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493d002700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380cbcb0 0x7f49380b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:46.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493c801700 1 -- 172.21.15.84:0/1508296546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380cbcb0 msgr2=0x7f49380b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493c801700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380cbcb0 0x7f49380b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493c801700 1 -- 172.21.15.84:0/1508296546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 msgr2=0x7f49380b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493c801700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 0x7f49380b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493c801700 1 -- 172.21.15.84:0/1508296546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928009420 con 0x7f4938159510 2023-10-06T02:58:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493d803700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 0x7f49380b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493c801700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159510 0x7f4938157e20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4928002000 tx=0x7f4928016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f492d7fa700 1 -- 172.21.15.84:0/1508296546 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492801cc90 con 0x7f4938159510 2023-10-06T02:58:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f492d7fa700 1 -- 172.21.15.84:0/1508296546 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492801cdf0 con 0x7f4938159510 2023-10-06T02:58:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f492d7fa700 1 -- 172.21.15.84:0/1508296546 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492801a6a0 con 0x7f4938159510 2023-10-06T02:58:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4938154fa0 con 0x7f4938159510 2023-10-06T02:58:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.533+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4938158360 con 0x7f4938159510 2023-10-06T02:58:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.534+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4938064ad0 con 0x7f4938159510 2023-10-06T02:58:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.534+0000 7f492d7fa700 1 -- 172.21.15.84:0/1508296546 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f492801aa50 con 0x7f4938159510 2023-10-06T02:58:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.535+0000 7f492d7fa700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f491c066f30 0x7f491c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.535+0000 7f492d7fa700 1 -- 172.21.15.84:0/1508296546 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4928085df0 con 0x7f4938159510 2023-10-06T02:58:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.535+0000 7f493d002700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f491c066f30 0x7f491c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.535+0000 7f493d002700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f491c066f30 0x7f491c0693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f49340015a0 tx=0x7f4934000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.539+0000 7f492d7fa700 1 -- 172.21.15.84:0/1508296546 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4928052dc0 con 0x7f4938159510 2023-10-06T02:58:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:46.763+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f49380c66e0 con 0x7f4938159510 2023-10-06T02:58:47.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.132+0000 7f492d7fa700 1 -- 172.21.15.84:0/1508296546 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v53) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4928029020 con 0x7f4938159510 2023-10-06T02:58:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f491c066f30 msgr2=0x7f491c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f491c066f30 0x7f491c0693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f49340015a0 tx=0x7f4934000bc0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159510 msgr2=0x7f4938157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159510 0x7f4938157e20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4928002000 tx=0x7f4928016000 comp rx=0 tx=0).stop 2023-10-06T02:58:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 shutdown_connections 2023-10-06T02:58:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f491c066f30 0x7f491c0693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49381598e0 0x7f49380b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f49380cbcb0 0x7f49380b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 --2- 172.21.15.84:0/1508296546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4938159510 0x7f4938157e20 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.137+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 >> 172.21.15.84:0/1508296546 conn(0x7f4938089e90 msgr2=0x7f49380d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:47.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.138+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 shutdown_connections 2023-10-06T02:58:47.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.138+0000 7f493f266700 1 -- 172.21.15.84:0/1508296546 wait complete. 2023-10-06T02:58:47.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:47.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.264+0000 7ff878a4f700 1 Processor -- start 2023-10-06T02:58:47.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.264+0000 7ff878a4f700 1 -- start start 2023-10-06T02:58:47.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.265+0000 7ff878a4f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff874157460 0x7ff8740ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:47.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.265+0000 7ff878a4f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff874157830 0x7ff8740cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:47.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.265+0000 7ff878a4f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740cae60 con 0x7ff8740ac480 2023-10-06T02:58:47.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.265+0000 7ff878a4f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8740aeed0 con 0x7ff874157460 2023-10-06T02:58:47.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.265+0000 7ff878a4f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8740af1b0 con 0x7ff874157830 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.265+0000 7ff87259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff874157460 0x7ff8740ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.265+0000 7ff87259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff874157460 0x7ff8740ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42810/0 (socket says 172.21.15.84:42810) 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.265+0000 7ff87259c700 1 -- 172.21.15.84:0/2858373285 learned_addr learned my addr 172.21.15.84:0/2858373285 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff871d9b700 1 --2- 172.21.15.84:0/2858373285 >> v2:172.21.15.131:3300/0 conn(0x7ff874157830 0x7ff8740cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff87259c700 1 -- 172.21.15.84:0/2858373285 >> v2:172.21.15.131:3300/0 conn(0x7ff874157830 msgr2=0x7ff8740cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff87259c700 1 --2- 172.21.15.84:0/2858373285 >> v2:172.21.15.131:3300/0 conn(0x7ff874157830 0x7ff8740cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff87259c700 1 -- 172.21.15.84:0/2858373285 >> v1:172.21.15.131:6789/0 conn(0x7ff8740ac480 legacy=0x7ff874068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff87259c700 1 -- 172.21.15.84:0/2858373285 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740af490 con 0x7ff874157460 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff87259c700 1 --2- 172.21.15.84:0/2858373285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 0x7ff8740ae8f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff8740cadd0 tx=0x7ff864009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd90db7dec3dfe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff87159a700 1 -- 172.21.15.84:0/2858373285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864005c10 con 0x7ff874157460 2023-10-06T02:58:47.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff87159a700 1 -- 172.21.15.84:0/2858373285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff864005d70 con 0x7ff874157460 2023-10-06T02:58:47.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff87159a700 1 -- 172.21.15.84:0/2858373285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86400b840 con 0x7ff874157460 2023-10-06T02:58:47.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff878a4f700 1 -- 172.21.15.84:0/2858373285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 msgr2=0x7ff8740ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:47.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff878a4f700 1 --2- 172.21.15.84:0/2858373285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 0x7ff8740ae8f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff8740cadd0 tx=0x7ff864009220 comp rx=0 tx=0).stop 2023-10-06T02:58:47.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.266+0000 7ff878a4f700 1 -- 172.21.15.84:0/2858373285 shutdown_connections 2023-10-06T02:58:47.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.267+0000 7ff878a4f700 1 --2- 172.21.15.84:0/2858373285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 0x7ff8740ae8f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.267+0000 7ff878a4f700 1 --2- 172.21.15.84:0/2858373285 >> v2:172.21.15.131:3300/0 conn(0x7ff874157830 0x7ff8740cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.267+0000 7ff878a4f700 1 -- 172.21.15.84:0/2858373285 >> 172.21.15.84:0/2858373285 conn(0x7ff87406de80 msgr2=0x7ff87406e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:47.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.267+0000 7ff878a4f700 1 -- 172.21.15.84:0/2858373285 shutdown_connections 2023-10-06T02:58:47.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.267+0000 7ff878a4f700 1 -- 172.21.15.84:0/2858373285 wait complete. 2023-10-06T02:58:47.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff878a4f700 1 Processor -- start 2023-10-06T02:58:47.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff878a4f700 1 -- start start 2023-10-06T02:58:47.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff878a4f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740ac480 0x7ff87416bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:47.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff878a4f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 0x7ff87415a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff878a4f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff874157830 0x7ff874167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff878a4f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff874168870 con 0x7ff874157460 2023-10-06T02:58:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff878a4f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff874168b50 con 0x7ff874157830 2023-10-06T02:58:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff878a4f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87416b2d0 con 0x7ff8740ac480 2023-10-06T02:58:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff871d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 0x7ff87415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff871d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 0x7ff87415a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42820/0 (socket says 172.21.15.84:42820) 2023-10-06T02:58:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.268+0000 7ff871d9b700 1 -- 172.21.15.84:0/2979904202 learned_addr learned my addr 172.21.15.84:0/2979904202 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff87259c700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740ac480 0x7ff87416bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:47.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff872d9d700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff874157830 0x7ff874167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff871d9b700 1 -- 172.21.15.84:0/2979904202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740ac480 msgr2=0x7ff87416bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff871d9b700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740ac480 0x7ff87416bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff871d9b700 1 -- 172.21.15.84:0/2979904202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff874157830 msgr2=0x7ff874167ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff871d9b700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff874157830 0x7ff874167ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff871d9b700 1 -- 172.21.15.84:0/2979904202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864009480 con 0x7ff874157460 2023-10-06T02:58:47.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff872d9d700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff874157830 0x7ff874167ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff871d9b700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 0x7ff87415a470 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff86800d860 tx=0x7ff868008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff8627fc700 1 -- 172.21.15.84:0/2979904202 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8680125f0 con 0x7ff874157460 2023-10-06T02:58:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff8627fc700 1 -- 172.21.15.84:0/2979904202 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868012750 con 0x7ff874157460 2023-10-06T02:58:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87416b5b0 con 0x7ff874157460 2023-10-06T02:58:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff8627fc700 1 -- 172.21.15.84:0/2979904202 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868012af0 con 0x7ff874157460 2023-10-06T02:58:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.269+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff874155b80 con 0x7ff874157460 2023-10-06T02:58:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.270+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff874064ad0 con 0x7ff874157460 2023-10-06T02:58:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.270+0000 7ff8627fc700 1 -- 172.21.15.84:0/2979904202 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff86801e460 con 0x7ff874157460 2023-10-06T02:58:47.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.271+0000 7ff8627fc700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.271+0000 7ff8627fc700 1 -- 172.21.15.84:0/2979904202 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff868084e60 con 0x7ff874157460 2023-10-06T02:58:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.271+0000 7ff87259c700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.271+0000 7ff87259c700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff8640030c0 tx=0x7ff864015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:47.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.275+0000 7ff8627fc700 1 -- 172.21.15.84:0/2979904202 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff868055820 con 0x7ff874157460 2023-10-06T02:58:47.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.499+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8740c99d0 con 0x7ff874157460 2023-10-06T02:58:47.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.499+0000 7ff8627fc700 1 -- 172.21.15.84:0/2979904202 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4618 (secure 0 0 0) 0x7ff8680553b0 con 0x7ff874157460 2023-10-06T02:58:47.501 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:47.501 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":53,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5567,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4032170839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4032170839},{"type":"v1","addr":"172.21.15.131:6835","nonce":4032170839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:58:34.102008+0000","modified":"2023-10-06T02:58:47.129800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6528,"mds_1":6525},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6525":{"gid":6525,"name":"c","rank":1,"incarnation":53,"state":"up:creating","state_seq":1,"addr":"172.21.15.84:6836/1455824046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1455824046},{"type":"v1","addr":"172.21.15.84:6836","nonce":1455824046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6528":{"gid":6528,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3591915780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3591915780},{"type":"v1","addr":"172.21.15.84:6837","nonce":3591915780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:58:47.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 msgr2=0x7ff8540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:47.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff8640030c0 tx=0x7ff864015000 comp rx=0 tx=0).stop 2023-10-06T02:58:47.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 msgr2=0x7ff87415a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:47.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 0x7ff87415a470 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff86800d860 tx=0x7ff868008040 comp rx=0 tx=0).stop 2023-10-06T02:58:47.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 shutdown_connections 2023-10-06T02:58:47.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff854066f30 0x7ff8540693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff874157830 0x7ff874167ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff8740ac480 0x7ff87416bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 --2- 172.21.15.84:0/2979904202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff874157460 0x7ff87415a470 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:47.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 >> 172.21.15.84:0/2979904202 conn(0x7ff87406de80 msgr2=0x7ff8740c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:47.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 shutdown_connections 2023-10-06T02:58:47.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:47.501+0000 7ff878a4f700 1 -- 172.21.15.84:0/2979904202 wait complete. 2023-10-06T02:58:47.504 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 53 2023-10-06T02:58:47.917 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:58:34.102008+0000', 'modified': '2023-10-06T02:58:47.129800+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6528, 'mds_1': 6525}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6525': {'gid': 6525, 'name': 'c', 'rank': 1, 'incarnation': 53, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.84:6836/1455824046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1455824046}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 1455824046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6528': {'gid': 6528, 'name': 'a', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/3591915780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 3591915780}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 3591915780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:58:47.917 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6525:up:creating 2023-10-06T02:58:48.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:49.022 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T02:58:49.021+0000 7f2503fec700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-06T02:58:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.043+0000 7f8fd5855700 1 Processor -- start 2023-10-06T02:58:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.043+0000 7f8fd5855700 1 -- start start 2023-10-06T02:58:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fd5855700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fd00b49e0 0x7f8fd00aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fd5855700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8fd00b07a0 0x7f8fd00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fd5855700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd00b0ca0 con 0x7f8fd01595a0 2023-10-06T02:58:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fd5855700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd00b0f80 con 0x7f8fd00b49e0 2023-10-06T02:58:49.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fd5855700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd00b1260 con 0x7f8fd00b07a0 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fc67fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fd00b49e0 0x7f8fd00aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fceffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8fd01595a0 0x7f8fd00aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51112/0 (socket says 172.21.15.84:51112) 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fceffd700 1 -- 172.21.15.84:0/2178820984 learned_addr learned my addr 172.21.15.84:0/2178820984 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fcf7fe700 1 --2- 172.21.15.84:0/2178820984 >> v2:172.21.15.131:3300/0 conn(0x7f8fd00b07a0 0x7f8fd00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fc67fc700 1 -- 172.21.15.84:0/2178820984 >> v2:172.21.15.131:3300/0 conn(0x7f8fd00b07a0 msgr2=0x7f8fd00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fc67fc700 1 --2- 172.21.15.84:0/2178820984 >> v2:172.21.15.131:3300/0 conn(0x7f8fd00b07a0 0x7f8fd00b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fc67fc700 1 -- 172.21.15.84:0/2178820984 >> v1:172.21.15.84:6789/0 conn(0x7f8fd01595a0 legacy=0x7f8fd00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.044+0000 7f8fce7fc700 1 -- 172.21.15.84:0/2178820984 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307448161 0 0) 0x7f8fd00b0ca0 con 0x7f8fd01595a0 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fc67fc700 1 -- 172.21.15.84:0/2178820984 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00b1540 con 0x7f8fd00b49e0 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fc67fc700 1 --2- 172.21.15.84:0/2178820984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b49e0 0x7f8fd00aac80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80098e0 tx=0x7f8fb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf591125e3b246d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fce7fc700 1 -- 172.21.15.84:0/2178820984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8009e80 con 0x7f8fd00b49e0 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fce7fc700 1 -- 172.21.15.84:0/2178820984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb800b820 con 0x7f8fd00b49e0 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fce7fc700 1 -- 172.21.15.84:0/2178820984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800bba0 con 0x7f8fd00b49e0 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fd5855700 1 -- 172.21.15.84:0/2178820984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b49e0 msgr2=0x7f8fd00aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fd5855700 1 --2- 172.21.15.84:0/2178820984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b49e0 0x7f8fd00aac80 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80098e0 tx=0x7f8fb80091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fd5855700 1 -- 172.21.15.84:0/2178820984 shutdown_connections 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fd5855700 1 --2- 172.21.15.84:0/2178820984 >> v2:172.21.15.131:3300/0 conn(0x7f8fd00b07a0 0x7f8fd00b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fd5855700 1 --2- 172.21.15.84:0/2178820984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b49e0 0x7f8fd00aac80 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fd5855700 1 -- 172.21.15.84:0/2178820984 >> 172.21.15.84:0/2178820984 conn(0x7f8fd0099830 msgr2=0x7f8fd006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fd5855700 1 -- 172.21.15.84:0/2178820984 shutdown_connections 2023-10-06T02:58:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.045+0000 7f8fd5855700 1 -- 172.21.15.84:0/2178820984 wait complete. 2023-10-06T02:58:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.047+0000 7f8fd5855700 1 Processor -- start 2023-10-06T02:58:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.047+0000 7f8fd5855700 1 -- start start 2023-10-06T02:58:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.047+0000 7f8fd5855700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b07a0 0x7f8fd00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.047+0000 7f8fd5855700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8fd00b49e0 0x7f8fd009be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.047+0000 7f8fd5855700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fd01595a0 0x7f8fd009c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.047+0000 7f8fd5855700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd0157f90 con 0x7f8fd00b07a0 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.047+0000 7f8fd5855700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd009ca50 con 0x7f8fd01595a0 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.047+0000 7f8fd5855700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd016d980 con 0x7f8fd00b49e0 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b07a0 0x7f8fd00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b07a0 0x7f8fd00b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42834/0 (socket says 172.21.15.84:42834) 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fceffd700 1 -- 172.21.15.84:0/663488250 learned_addr learned my addr 172.21.15.84:0/663488250 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fcf7fe700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fd01595a0 0x7f8fd009c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fc67fc700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8fd00b49e0 0x7f8fd009be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fceffd700 1 -- 172.21.15.84:0/663488250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8fd00b49e0 msgr2=0x7f8fd009be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fceffd700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8fd00b49e0 0x7f8fd009be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fceffd700 1 -- 172.21.15.84:0/663488250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fd01595a0 msgr2=0x7f8fd009c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fceffd700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fd01595a0 0x7f8fd009c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fceffd700 1 -- 172.21.15.84:0/663488250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb8009420 con 0x7f8fd00b07a0 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fceffd700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b07a0 0x7f8fd00b34c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000c5e0 tx=0x7f8fc0007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fc77fe700 1 -- 172.21.15.84:0/663488250 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc00072e0 con 0x7f8fd00b07a0 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fc77fe700 1 -- 172.21.15.84:0/663488250 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc0007460 con 0x7f8fd00b07a0 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd016de10 con 0x7f8fd00b07a0 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fc77fe700 1 -- 172.21.15.84:0/663488250 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc00057f0 con 0x7f8fd00b07a0 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.048+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd016d330 con 0x7f8fd00b07a0 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.049+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd016dc60 con 0x7f8fd00b07a0 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.050+0000 7f8fc77fe700 1 -- 172.21.15.84:0/663488250 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fc0005c00 con 0x7f8fd00b07a0 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.050+0000 7f8fc77fe700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8fb0066f30 0x7f8fb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.050+0000 7f8fc77fe700 1 -- 172.21.15.84:0/663488250 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8fc0083c50 con 0x7f8fd00b07a0 2023-10-06T02:58:49.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.050+0000 7f8fc67fc700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8fb0066f30 0x7f8fb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.051+0000 7f8fc67fc700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8fb0066f30 0x7f8fb00693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80098e0 tx=0x7f8fb8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.054+0000 7f8fc77fe700 1 -- 172.21.15.84:0/663488250 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fc0089020 con 0x7f8fd00b07a0 2023-10-06T02:58:49.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.286+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fd0064ad0 con 0x7f8fd00b07a0 2023-10-06T02:58:49.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.286+0000 7f8fc77fe700 1 -- 172.21.15.84:0/663488250 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4630 (secure 0 0 0) 0x7f8fc0017070 con 0x7f8fd00b07a0 2023-10-06T02:58:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:49.289 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:58:34.102008+0000","modified":"2023-10-06T02:58:49.154921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6528,"mds_1":6525,"mds_2":5567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5567":{"gid":5567,"name":"d","rank":2,"incarnation":55,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6835/4032170839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4032170839},{"type":"v1","addr":"172.21.15.131:6835","nonce":4032170839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6525":{"gid":6525,"name":"c","rank":1,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6836/1455824046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1455824046},{"type":"v1","addr":"172.21.15.84:6836","nonce":1455824046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6528":{"gid":6528,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3591915780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3591915780},{"type":"v1","addr":"172.21.15.84:6837","nonce":3591915780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:58:49.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8fb0066f30 msgr2=0x7f8fb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8fb0066f30 0x7f8fb00693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80098e0 tx=0x7f8fb8017000 comp rx=0 tx=0).stop 2023-10-06T02:58:49.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b07a0 msgr2=0x7f8fd00b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b07a0 0x7f8fd00b34c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000c5e0 tx=0x7f8fc0007e80 comp rx=0 tx=0).stop 2023-10-06T02:58:49.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 shutdown_connections 2023-10-06T02:58:49.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8fb0066f30 0x7f8fb00693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fd01595a0 0x7f8fd009c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd00b07a0 0x7f8fd00b34c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 --2- 172.21.15.84:0/663488250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8fd00b49e0 0x7f8fd009be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 >> 172.21.15.84:0/663488250 conn(0x7f8fd0099830 msgr2=0x7f8fd00699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:49.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 shutdown_connections 2023-10-06T02:58:49.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.288+0000 7f8fd5855700 1 -- 172.21.15.84:0/663488250 wait complete. 2023-10-06T02:58:49.292 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 56 2023-10-06T02:58:49.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:58:34.102008+0000', 'modified': '2023-10-06T02:58:49.154921+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6528, 'mds_1': 6525, 'mds_2': 5567}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5567': {'gid': 5567, 'name': 'd', 'rank': 2, 'incarnation': 55, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.131:6835/4032170839', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 4032170839}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 4032170839}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6525': {'gid': 6525, 'name': 'c', 'rank': 1, 'incarnation': 53, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.84:6836/1455824046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1455824046}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 1455824046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6528': {'gid': 6528, 'name': 'a', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/3591915780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 3591915780}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 3591915780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T02:58:49.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-06T02:58:49.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T02:58:49.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.820+0000 7f3f694fb700 1 Processor -- start 2023-10-06T02:58:49.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.820+0000 7f3f694fb700 1 -- start start 2023-10-06T02:58:49.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f694fb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640cd370 0x7f3f640ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f694fb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3f640c6260 0x7f3f640cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f694fb700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f640cc840 con 0x7f3f641594b0 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f694fb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f640cbc70 con 0x7f3f640c6260 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f694fb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640cf440 con 0x7f3f640cd370 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f68cfa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3f640c6260 0x7f3f640cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f637fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640cd370 0x7f3f640ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f68cfa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3f640c6260 0x7f3f640cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:49774/0 (socket says 172.21.15.84:49774) 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f68cfa700 1 -- 172.21.15.84:0/2204008731 learned_addr learned my addr 172.21.15.84:0/2204008731 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.821+0000 7f3f63fff700 1 --1- 172.21.15.84:0/2204008731 >> v1:172.21.15.131:6789/0 conn(0x7f3f641594b0 0x7f3f640ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:54226/0 (socket says 172.21.15.84:54226) 2023-10-06T02:58:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.822+0000 7f3f637fe700 1 -- 172.21.15.84:0/2204008731 >> v2:172.21.15.131:3300/0 conn(0x7f3f640c6260 msgr2=0x7f3f640cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.822+0000 7f3f637fe700 1 --2- 172.21.15.84:0/2204008731 >> v2:172.21.15.131:3300/0 conn(0x7f3f640c6260 0x7f3f640cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.822+0000 7f3f637fe700 1 -- 172.21.15.84:0/2204008731 >> v1:172.21.15.131:6789/0 conn(0x7f3f641594b0 legacy=0x7f3f640ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.822+0000 7f3f637fe700 1 -- 172.21.15.84:0/2204008731 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f640cbf10 con 0x7f3f640cd370 2023-10-06T02:58:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.822+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/2204008731 >> v2:172.21.15.131:3300/0 conn(0x7f3f640c6260 0x7f3f640cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:58:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.822+0000 7f3f637fe700 1 --2- 172.21.15.84:0/2204008731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640cd370 0x7f3f640ce9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3f580098d0 tx=0x7f3f58009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de8dda82ebd5a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.822+0000 7f3f62ffd700 1 -- 172.21.15.84:0/2204008731 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58005c10 con 0x7f3f640cd370 2023-10-06T02:58:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.822+0000 7f3f62ffd700 1 -- 172.21.15.84:0/2204008731 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58005d70 con 0x7f3f640cd370 2023-10-06T02:58:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.822+0000 7f3f62ffd700 1 -- 172.21.15.84:0/2204008731 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58006260 con 0x7f3f640cd370 2023-10-06T02:58:49.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.823+0000 7f3f694fb700 1 -- 172.21.15.84:0/2204008731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640cd370 msgr2=0x7f3f640ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.823+0000 7f3f694fb700 1 --2- 172.21.15.84:0/2204008731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640cd370 0x7f3f640ce9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3f580098d0 tx=0x7f3f58009120 comp rx=0 tx=0).stop 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.823+0000 7f3f694fb700 1 -- 172.21.15.84:0/2204008731 shutdown_connections 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.823+0000 7f3f694fb700 1 --2- 172.21.15.84:0/2204008731 >> v2:172.21.15.131:3300/0 conn(0x7f3f640c6260 0x7f3f640cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.823+0000 7f3f694fb700 1 --2- 172.21.15.84:0/2204008731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640cd370 0x7f3f640ce9c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.823+0000 7f3f694fb700 1 -- 172.21.15.84:0/2204008731 >> 172.21.15.84:0/2204008731 conn(0x7f3f64099600 msgr2=0x7f3f6406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.823+0000 7f3f694fb700 1 -- 172.21.15.84:0/2204008731 shutdown_connections 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.823+0000 7f3f694fb700 1 -- 172.21.15.84:0/2204008731 wait complete. 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.824+0000 7f3f694fb700 1 Processor -- start 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.824+0000 7f3f694fb700 1 -- start start 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f694fb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640c6260 0x7f3f6415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f694fb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f640cd370 0x7f3f6415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f694fb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f641594b0 0x7f3f641478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f694fb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6415bf30 con 0x7f3f640cd370 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f694fb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6415e500 con 0x7f3f641594b0 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f694fb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6415e7e0 con 0x7f3f640c6260 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f640cd370 0x7f3f6415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f640cd370 0x7f3f6415c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42850/0 (socket says 172.21.15.84:42850) 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f637fe700 1 -- 172.21.15.84:0/3858406800 learned_addr learned my addr 172.21.15.84:0/3858406800 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f63fff700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640c6260 0x7f3f6415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f641594b0 0x7f3f641478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f637fe700 1 -- 172.21.15.84:0/3858406800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640c6260 msgr2=0x7f3f6415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f637fe700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640c6260 0x7f3f6415d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f637fe700 1 -- 172.21.15.84:0/3858406800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f641594b0 msgr2=0x7f3f641478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f637fe700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f641594b0 0x7f3f641478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f637fe700 1 -- 172.21.15.84:0/3858406800 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c009ae0 con 0x7f3f640cd370 2023-10-06T02:58:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f637fe700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f640cd370 0x7f3f6415c3c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3f58005d40 tx=0x7f3f58016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.825+0000 7f3f4bfff700 1 -- 172.21.15.84:0/3858406800 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58002f90 con 0x7f3f640cd370 2023-10-06T02:58:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.826+0000 7f3f4bfff700 1 -- 172.21.15.84:0/3858406800 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5801b690 con 0x7f3f640cd370 2023-10-06T02:58:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.826+0000 7f3f694fb700 1 -- 172.21.15.84:0/3858406800 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f580093c0 con 0x7f3f640cd370 2023-10-06T02:58:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.826+0000 7f3f4bfff700 1 -- 172.21.15.84:0/3858406800 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5801ba70 con 0x7f3f640cd370 2023-10-06T02:58:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.826+0000 7f3f694fb700 1 -- 172.21.15.84:0/3858406800 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6415bbc0 con 0x7f3f640cd370 2023-10-06T02:58:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.827+0000 7f3f4bfff700 1 -- 172.21.15.84:0/3858406800 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f5802f440 con 0x7f3f640cd370 2023-10-06T02:58:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.827+0000 7f3f4bfff700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3f50066f30 0x7f3f500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.827+0000 7f3f4bfff700 1 -- 172.21.15.84:0/3858406800 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3f580866b0 con 0x7f3f640cd370 2023-10-06T02:58:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.827+0000 7f3f63fff700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3f50066f30 0x7f3f500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.828+0000 7f3f63fff700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3f50066f30 0x7f3f500693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f54000c00 tx=0x7f3f54007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.829+0000 7f3f73a55b80 1 Processor -- start 2023-10-06T02:58:49.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.829+0000 7f3f73a55b80 1 -- start start 2023-10-06T02:58:49.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf285cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf286200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 0x563fcf286740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcf1e0a70 con 0x563fcf2aae50 2023-10-06T02:58:49.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcf1de270 con 0x563fcf28ca10 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fcf1da060 con 0x563fcf28b2c0 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf285cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf285cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42862/0 (socket says 172.21.15.84:42862) 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f63fff700 1 -- 172.21.15.84:0/705668786 learned_addr learned my addr 172.21.15.84:0/705668786 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 0x563fcf286740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f637fe700 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf286200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f63fff700 1 -- 172.21.15.84:0/705668786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 msgr2=0x563fcf286200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f63fff700 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf286200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f63fff700 1 -- 172.21.15.84:0/705668786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 msgr2=0x563fcf286740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f63fff700 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 0x563fcf286740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f63fff700 1 -- 172.21.15.84:0/705668786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fcf074270 con 0x563fcf2aae50 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 0x563fcf286740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.830+0000 7f3f63fff700 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf285cc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3f54013650 tx=0x7f3f54014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4d499e8506d6ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f497fa700 1 -- 172.21.15.84:0/705668786 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f54013e80 con 0x563fcf2aae50 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f497fa700 1 -- 172.21.15.84:0/705668786 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f540012d0 con 0x563fcf2aae50 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f497fa700 1 -- 172.21.15.84:0/705668786 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f54001650 con 0x563fcf2aae50 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f73a55b80 1 -- 172.21.15.84:0/705668786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 msgr2=0x563fcf285cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf285cc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3f54013650 tx=0x7f3f54014000 comp rx=0 tx=0).stop 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f73a55b80 1 -- 172.21.15.84:0/705668786 shutdown_connections 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 0x563fcf286740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf285cc0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/705668786 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf286200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f73a55b80 1 -- 172.21.15.84:0/705668786 >> 172.21.15.84:0/705668786 conn(0x563fcf28ae80 msgr2=0x563fcf28b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f73a55b80 1 -- 172.21.15.84:0/705668786 shutdown_connections 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.831+0000 7f3f73a55b80 1 -- 172.21.15.84:0/705668786 wait complete. 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.832+0000 7f3f73a55b80 1 -- start start 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.832+0000 7f3f73a55b80 1 Processor -- start 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28b2c0 0x563fcf2d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28ca10 0x563fcf2b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2ab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcf185890 con 0x563fcf2aae50 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcf1a0ea0 con 0x563fcf28b2c0 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fcf05ce30 con 0x563fcf28ca10 2023-10-06T02:58:49.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f73a55b80 10 client.0 _ll_register_callbacks cb 0x563fcf24d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f68cfa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f68cfa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2ab500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42870/0 (socket says 172.21.15.84:42870) 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f68cfa700 1 -- 172.21.15.84:0/1353948377 learned_addr learned my addr 172.21.15.84:0/1353948377 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f637fe700 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28ca10 0x563fcf2b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f63fff700 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28b2c0 0x563fcf2d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f68cfa700 1 -- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28ca10 msgr2=0x563fcf2b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28ca10 0x563fcf2b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f68cfa700 1 -- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28b2c0 msgr2=0x563fcf2d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28b2c0 0x563fcf2d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f68cfa700 1 -- 172.21.15.84:0/1353948377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f640cc840 con 0x563fcf2aae50 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2ab500 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c007eb0 tx=0x7f3f5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df7ca887644c559 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f427fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f427fc700 1 -- 172.21.15.84:0/1353948377 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00e040 con 0x563fcf2aae50 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f427fc700 1 -- 172.21.15.84:0/1353948377 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3f5c0139b0 con 0x563fcf2aae50 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.833+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1353948377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fcf27e940 con 0x563fcf2aae50 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f427fc700 1 -- 172.21.15.84:0/1353948377 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f5c0090c0 con 0x563fcf2aae50 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f73a55b80 10 client.6750 fetch_fsmap learned FSMap version 56 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1353948377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x563fcf016fe0 con 0x563fcf2aae50 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f427fc700 1 -- 172.21.15.84:0/1353948377 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563fcf27e940 con 0x563fcf2aae50 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f427fc700 1 -- 172.21.15.84:0/1353948377 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 56) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f3f5c016430 con 0x563fcf2aae50 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f73a55b80 10 client.6750 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f73a55b80 10 client.6750 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f73a55b80 20 client.6750 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:49.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x563fcf2d43d0 0x563fcf2d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f73a55b80 4 client.6750 mds_command: new command op to 5567 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1353948377 --> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fcf25b870 con 0x563fcf2d43d0 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.834+0000 7f3f63fff700 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x563fcf2d43d0 0x563fcf2d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f427fc700 10 client.6750 ms_handle_connect on v2:172.21.15.131:6833/4032170839 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f63fff700 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x563fcf2d43d0 0x563fcf2d47a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd15c97b0e69e378 server_cookie=5a11830dff216f08 in_seq=0 out_seq=0 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f427fc700 1 -- 172.21.15.84:0/1353948377 <== mds.2 v2:172.21.15.131:6833/4032170839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563fcf25b870 con 0x563fcf2d43d0 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f427fc700 10 client.6750 handle_command_reply: tid=0 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 client.6750 shutdown 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1353948377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 msgr2=0x563fcf2ab500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2ab500 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c007eb0 tx=0x7f3f5c00b040 comp rx=0 tx=0).stop 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1353948377 shutdown_connections 2023-10-06T02:58:49.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x563fcf2d43d0 0x563fcf2d47a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28b2c0 0x563fcf2d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2ab500 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1353948377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28ca10 0x563fcf2b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f427fc700 0 client.6750 ms_handle_reset on v2:172.21.15.131:6833/4032170839 2023-10-06T02:58:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1353948377 >> 172.21.15.84:0/1353948377 conn(0x563fcf28ae80 msgr2=0x563fcf28bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.835+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1353948377 shutdown_connections 2023-10-06T02:58:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.836+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1353948377 wait complete. 2023-10-06T02:58:49.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.836+0000 7f3f73a55b80 20 client.6750 trim_cache size 0 max 16384 2023-10-06T02:58:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.852+0000 7f3f73a55b80 1 Processor -- start 2023-10-06T02:58:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.852+0000 7f3f73a55b80 1 -- start start 2023-10-06T02:58:49.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf285ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf28ca10 0x563fcf2b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf2aae50 0x563fcf2b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcf286ac0 con 0x563fcf28ca10 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcf2692e0 con 0x563fcf2aae50 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fcf2621e0 con 0x563fcf28b2c0 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf28ca10 0x563fcf2b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf28ca10 0x563fcf2b5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42882/0 (socket says 172.21.15.84:42882) 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f637fe700 1 -- 172.21.15.84:0/2372744772 learned_addr learned my addr 172.21.15.84:0/2372744772 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f637fe700 1 -- 172.21.15.84:0/2372744772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 msgr2=0x563fcf285ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f637fe700 1 --2- 172.21.15.84:0/2372744772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf285ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f637fe700 1 -- 172.21.15.84:0/2372744772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf2aae50 msgr2=0x563fcf2b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f637fe700 1 --2- 172.21.15.84:0/2372744772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf2aae50 0x563fcf2b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f637fe700 1 -- 172.21.15.84:0/2372744772 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fcf1a8780 con 0x563fcf28ca10 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.853+0000 7f3f637fe700 1 --2- 172.21.15.84:0/2372744772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf28ca10 0x563fcf2b5b90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3f58057230 tx=0x7f3f58086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d830417aaf784ccd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f49ffb700 1 -- 172.21.15.84:0/2372744772 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58071070 con 0x563fcf28ca10 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f49ffb700 1 -- 172.21.15.84:0/2372744772 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580572a0 con 0x563fcf28ca10 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f49ffb700 1 -- 172.21.15.84:0/2372744772 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5805a4f0 con 0x563fcf28ca10 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f73a55b80 1 -- 172.21.15.84:0/2372744772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf28ca10 msgr2=0x563fcf2b5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/2372744772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf28ca10 0x563fcf2b5b90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3f58057230 tx=0x7f3f58086040 comp rx=0 tx=0).stop 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f73a55b80 1 -- 172.21.15.84:0/2372744772 shutdown_connections 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/2372744772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf2aae50 0x563fcf2b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/2372744772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf285ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/2372744772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf28ca10 0x563fcf2b5b90 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f73a55b80 1 -- 172.21.15.84:0/2372744772 >> 172.21.15.84:0/2372744772 conn(0x563fcf28ae80 msgr2=0x563fcf2d19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f73a55b80 1 -- 172.21.15.84:0/2372744772 shutdown_connections 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.854+0000 7f3f73a55b80 1 -- 172.21.15.84:0/2372744772 wait complete. 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.855+0000 7f3f73a55b80 1 -- start start 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.855+0000 7f3f73a55b80 1 Processor -- start 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf285f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 0x563fcf2b8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcf2afc20 con 0x563fcf2aae50 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcf2b9150 con 0x563fcf28ca10 2023-10-06T02:58:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fcf286470 con 0x563fcf28b2c0 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 10 client.0 _ll_register_callbacks cb 0x563fcf24d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f68cfa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f68cfa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2d0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42886/0 (socket says 172.21.15.84:42886) 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f68cfa700 1 -- 172.21.15.84:0/1383845768 learned_addr learned my addr 172.21.15.84:0/1383845768 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f637fe700 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 0x563fcf2b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f63fff700 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf285f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f68cfa700 1 -- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 msgr2=0x563fcf285f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf285f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f68cfa700 1 -- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 msgr2=0x563fcf2b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 0x563fcf2b8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f68cfa700 1 -- 172.21.15.84:0/1383845768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6415bbc0 con 0x563fcf2aae50 2023-10-06T02:58:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f63fff700 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf285f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f68cfa700 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2d0560 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c007e80 tx=0x7f3f5c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dee0a1fd63a63e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f427fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f427fc700 1 -- 172.21.15.84:0/1383845768 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00e040 con 0x563fcf2aae50 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f427fc700 1 -- 172.21.15.84:0/1383845768 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3f5c020d70 con 0x563fcf2aae50 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1383845768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fcf289380 con 0x563fcf2aae50 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f427fc700 1 -- 172.21.15.84:0/1383845768 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f5c016bd0 con 0x563fcf2aae50 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 10 client.6756 fetch_fsmap learned FSMap version 56 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.856+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1383845768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x563fcf18f470 con 0x563fcf2aae50 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.857+0000 7f3f427fc700 1 -- 172.21.15.84:0/1383845768 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563fcf289380 con 0x563fcf2aae50 2023-10-06T02:58:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.857+0000 7f3f427fc700 1 -- 172.21.15.84:0/1383845768 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 56) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f3f5c01f410 con 0x563fcf2aae50 2023-10-06T02:58:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.857+0000 7f3f73a55b80 10 client.6756 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T02:58:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.857+0000 7f3f73a55b80 10 client.6756 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T02:58:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.857+0000 7f3f73a55b80 20 client.6756 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.857+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x563fcf339690 0x563fcf339a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.857+0000 7f3f73a55b80 4 client.6756 mds_command: new command op to 5567 tid=0[{"prefix": "status"}] 2023-10-06T02:58:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.857+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1383845768 --> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f3f540012d0 con 0x563fcf339690 2023-10-06T02:58:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.857+0000 7f3f63fff700 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x563fcf339690 0x563fcf339a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f427fc700 10 client.6756 ms_handle_connect on v2:172.21.15.131:6833/4032170839 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f63fff700 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x563fcf339690 0x563fcf339a60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ecc33ab8d77f6979 server_cookie=9165398153b2449e in_seq=0 out_seq=0 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f427fc700 1 -- 172.21.15.84:0/1383845768 <== mds.2 v2:172.21.15.131:6833/4032170839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x7f3f540012d0 con 0x563fcf339690 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f427fc700 10 client.6756 handle_command_reply: tid=0 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 client.6756 shutdown 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1383845768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 msgr2=0x563fcf2d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2d0560 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c007e80 tx=0x7f3f5c019000 comp rx=0 tx=0).stop 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1383845768 shutdown_connections 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x563fcf339690 0x563fcf339a60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563fcf2aae50 0x563fcf2d0560 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f427fc700 0 client.6756 ms_handle_reset on v2:172.21.15.131:6833/4032170839 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563fcf28b2c0 0x563fcf285f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 --2- 172.21.15.84:0/1383845768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563fcf28ca10 0x563fcf2b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1383845768 >> 172.21.15.84:0/1383845768 conn(0x563fcf28ae80 msgr2=0x563fcf2e8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1383845768 shutdown_connections 2023-10-06T02:58:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 1 -- 172.21.15.84:0/1383845768 wait complete. 2023-10-06T02:58:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f73a55b80 20 client.6756 trim_cache size 0 max 16384 2023-10-06T02:58:49.870 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:49.870 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:58:49.870 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2023-10-06T02:58:49.870 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5567, 2023-10-06T02:58:49.870 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:58:49.870 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:58:49.870 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:58:49.871 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 1.718550222, 2023-10-06T02:58:49.871 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 56, 2023-10-06T02:58:49.871 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 68, 2023-10-06T02:58:49.871 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 68, 2023-10-06T02:58:49.871 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 21.238729655 2023-10-06T02:58:49.871 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:49.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f694fb700 1 -- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3f50066f30 msgr2=0x7f3f500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f694fb700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3f50066f30 0x7f3f500693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f54000c00 tx=0x7f3f54007ec0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f694fb700 1 -- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f640cd370 msgr2=0x7f3f6415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.858+0000 7f3f694fb700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f640cd370 0x7f3f6415c3c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3f58005d40 tx=0x7f3f58016000 comp rx=0 tx=0).stop 2023-10-06T02:58:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.859+0000 7f3f694fb700 1 -- 172.21.15.84:0/3858406800 shutdown_connections 2023-10-06T02:58:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.859+0000 7f3f694fb700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3f50066f30 0x7f3f500693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.859+0000 7f3f694fb700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f641594b0 0x7f3f641478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.859+0000 7f3f694fb700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3f640c6260 0x7f3f6415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.859+0000 7f3f694fb700 1 --2- 172.21.15.84:0/3858406800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f640cd370 0x7f3f6415c3c0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.859+0000 7f3f694fb700 1 -- 172.21.15.84:0/3858406800 >> 172.21.15.84:0/3858406800 conn(0x7f3f64099600 msgr2=0x7f3f641584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:49.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.859+0000 7f3f694fb700 1 -- 172.21.15.84:0/3858406800 shutdown_connections 2023-10-06T02:58:49.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.859+0000 7f3f694fb700 1 -- 172.21.15.84:0/3858406800 wait complete. 2023-10-06T02:58:49.875 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T02:58:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.989+0000 7fecfe49c700 1 Processor -- start 2023-10-06T02:58:49.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.989+0000 7fecfe49c700 1 -- start start 2023-10-06T02:58:49.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecfe49c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fecf81595a0 0x7fecf80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecfe49c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf80b49e0 0x7fecf80aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecfe49c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf80b0ca0 con 0x7fecf80b07a0 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecfe49c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf80b0f80 con 0x7fecf81595a0 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecfe49c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80b1260 con 0x7fecf80b49e0 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecfca39700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fecf80b07a0 0x7fecf80b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51124/0 (socket says 172.21.15.84:51124) 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecfca39700 1 -- 172.21.15.84:0/2007906804 learned_addr learned my addr 172.21.15.84:0/2007906804 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293884221 0 0) 0x7fecf80b0ca0 con 0x7fecf80b07a0 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecf7fff700 1 --2- 172.21.15.84:0/2007906804 >> v2:172.21.15.131:3300/0 conn(0x7fecf81595a0 0x7fecf80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fece0003570 con 0x7fecf80b07a0 2023-10-06T02:58:49.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.990+0000 7fecf77fe700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf80b49e0 0x7fecf80aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 403916845 0 0) 0x7fece0003570 con 0x7fecf80b07a0 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf80b49e0 msgr2=0x7fecf80aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf80b49e0 0x7fecf80aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 >> v2:172.21.15.131:3300/0 conn(0x7fecf81595a0 msgr2=0x7fecf80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 --2- 172.21.15.84:0/2007906804 >> v2:172.21.15.131:3300/0 conn(0x7fecf81595a0 0x7fecf80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf80b1540 con 0x7fecf80b07a0 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fecf00017f0 con 0x7fecf80b07a0 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 >> v1:172.21.15.84:6789/0 conn(0x7fecf80b07a0 legacy=0x7fecf80b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fece0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf80b49e0 0x7fece0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece0004d50 0x7fece00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80b0f80 con 0x7fece0003a60 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf80b1260 con 0x7fece0004d50 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece000ba60 con 0x7fecf80b49e0 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf7fff700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fece0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf77fe700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf80b49e0 0x7fece0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecfca39700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece0004d50 0x7fece00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf7fff700 1 -- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf80b49e0 msgr2=0x7fece0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf7fff700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf80b49e0 0x7fece0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf7fff700 1 -- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece0004d50 msgr2=0x7fece00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf7fff700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece0004d50 0x7fece00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf7fff700 1 -- 172.21.15.84:0/2007906804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0003570 con 0x7fece0003a60 2023-10-06T02:58:49.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecfca39700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece0004d50 0x7fece00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf7fff700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fece0003e70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fece8009bf0 tx=0x7fece8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382e5518f2f12127 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8005a00 con 0x7fece0003a60 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.991+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8005b60 con 0x7fece0003a60 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.992+0000 7fecf6ffd700 1 -- 172.21.15.84:0/2007906804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece800e6b0 con 0x7fece0003a60 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.992+0000 7fecfe49c700 1 -- 172.21.15.84:0/2007906804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 msgr2=0x7fece0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.992+0000 7fecfe49c700 1 --2- 172.21.15.84:0/2007906804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fece0003e70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fece8009bf0 tx=0x7fece8009120 comp rx=0 tx=0).stop 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.992+0000 7fecfca39700 1 -- 172.21.15.84:0/2007906804 reap_dead start 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.992+0000 7fecfe49c700 1 -- 172.21.15.84:0/2007906804 shutdown_connections 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.992+0000 7fecfe49c700 1 -- 172.21.15.84:0/2007906804 >> 172.21.15.84:0/2007906804 conn(0x7fecf8099830 msgr2=0x7fecf806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.992+0000 7fecfe49c700 1 -- 172.21.15.84:0/2007906804 shutdown_connections 2023-10-06T02:58:50.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.992+0000 7fecfe49c700 1 -- 172.21.15.84:0/2007906804 wait complete. 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.993+0000 7fecfe49c700 1 Processor -- start 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.993+0000 7fecfe49c700 1 -- start start 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecfe49c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fecf8152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecfe49c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf809aaa0 0x7fecf815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecfe49c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf809ba10 0x7fecf809beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecfe49c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf809c3f0 con 0x7fece0003a60 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecfe49c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf815d670 con 0x7fecf809ba10 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecfe49c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf815fbf0 con 0x7fecf809aaa0 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecf7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fecf8152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecf7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fecf8152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42906/0 (socket says 172.21.15.84:42906) 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecf7fff700 1 -- 172.21.15.84:0/2137916440 learned_addr learned my addr 172.21.15.84:0/2137916440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecfca39700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf809ba10 0x7fecf809beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecf77fe700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf809aaa0 0x7fecf815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecf7fff700 1 -- 172.21.15.84:0/2137916440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf809aaa0 msgr2=0x7fecf815f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecf7fff700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf809aaa0 0x7fecf815f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecf7fff700 1 -- 172.21.15.84:0/2137916440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf809ba10 msgr2=0x7fecf809beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecf7fff700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf809ba10 0x7fecf809beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.994+0000 7fecf7fff700 1 -- 172.21.15.84:0/2137916440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf809b010 con 0x7fece0003a60 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.995+0000 7fecf7fff700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fecf8152f60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fece8000e10 tx=0x7fece8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.995+0000 7fecdffff700 1 -- 172.21.15.84:0/2137916440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8006240 con 0x7fece0003a60 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.995+0000 7fecdffff700 1 -- 172.21.15.84:0/2137916440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece80063e0 con 0x7fece0003a60 2023-10-06T02:58:50.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.995+0000 7fecfe49c700 1 -- 172.21.15.84:0/2137916440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf809b2f0 con 0x7fece0003a60 2023-10-06T02:58:50.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.995+0000 7fecdffff700 1 -- 172.21.15.84:0/2137916440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece80067a0 con 0x7fece0003a60 2023-10-06T02:58:50.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.995+0000 7fecfe49c700 1 -- 172.21.15.84:0/2137916440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf815d300 con 0x7fece0003a60 2023-10-06T02:58:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.996+0000 7fecdffff700 1 -- 172.21.15.84:0/2137916440 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fece8013680 con 0x7fece0003a60 2023-10-06T02:58:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.996+0000 7fecdffff700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fece4066f30 0x7fece40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.996+0000 7fecdffff700 1 -- 172.21.15.84:0/2137916440 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fece8085e50 con 0x7fece0003a60 2023-10-06T02:58:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.996+0000 7fecf77fe700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fece4066f30 0x7fece40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.997+0000 7fecf77fe700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fece4066f30 0x7fece40693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fecec0093f0 tx=0x7fecec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.998+0000 7fed07794b80 1 Processor -- start 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.998+0000 7fed07794b80 1 -- start start 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.999+0000 7fed07794b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2109840 0x55cea2109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.999+0000 7fed07794b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea210acc0 0x55cea21596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.999+0000 7fed07794b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea215a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.999+0000 7fed07794b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea2060a70 con 0x55cea2109840 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.999+0000 7fed07794b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea205e270 con 0x55cea210acc0 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.999+0000 7fed07794b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cea205a060 con 0x55cea2159c00 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.999+0000 7fecf7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2109840 0x55cea2109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.999+0000 7fecf7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2109840 0x55cea2109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42922/0 (socket says 172.21.15.84:42922) 2023-10-06T02:58:50.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:49.999+0000 7fecf7fff700 1 -- 172.21.15.84:0/1067035548 learned_addr learned my addr 172.21.15.84:0/1067035548 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecf7fff700 1 -- 172.21.15.84:0/1067035548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 msgr2=0x55cea215a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecf7fff700 1 --2- 172.21.15.84:0/1067035548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea215a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecf77fe700 1 --2- 172.21.15.84:0/1067035548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea210acc0 0x55cea21596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecf7fff700 1 -- 172.21.15.84:0/1067035548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea210acc0 msgr2=0x55cea21596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecf7fff700 1 --2- 172.21.15.84:0/1067035548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea210acc0 0x55cea21596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecf7fff700 1 -- 172.21.15.84:0/1067035548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cea1ef4270 con 0x55cea2109840 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecf7fff700 1 --2- 172.21.15.84:0/1067035548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2109840 0x55cea2109c10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fece80840d0 tx=0x7fece8084030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd19eeca2ef0e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecdd7fa700 1 -- 172.21.15.84:0/1067035548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece80571e0 con 0x55cea2109840 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecdd7fa700 1 -- 172.21.15.84:0/1067035548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8056ae0 con 0x55cea2109840 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fecdd7fa700 1 -- 172.21.15.84:0/1067035548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8059d30 con 0x55cea2109840 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fed07794b80 1 -- 172.21.15.84:0/1067035548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2109840 msgr2=0x55cea2109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.000+0000 7fed07794b80 1 --2- 172.21.15.84:0/1067035548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2109840 0x55cea2109c10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fece80840d0 tx=0x7fece8084030 comp rx=0 tx=0).stop 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.001+0000 7fed07794b80 1 -- 172.21.15.84:0/1067035548 shutdown_connections 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.001+0000 7fed07794b80 1 --2- 172.21.15.84:0/1067035548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea215a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.001+0000 7fed07794b80 1 --2- 172.21.15.84:0/1067035548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2109840 0x55cea2109c10 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.001+0000 7fed07794b80 1 --2- 172.21.15.84:0/1067035548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea210acc0 0x55cea21596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.001+0000 7fed07794b80 1 -- 172.21.15.84:0/1067035548 >> 172.21.15.84:0/1067035548 conn(0x55cea210b160 msgr2=0x55cea210b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.001+0000 7fed07794b80 1 -- 172.21.15.84:0/1067035548 shutdown_connections 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.001+0000 7fed07794b80 1 -- 172.21.15.84:0/1067035548 wait complete. 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.001+0000 7fed07794b80 1 -- start start 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.001+0000 7fed07794b80 1 Processor -- start 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fed07794b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea214a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fed07794b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2130270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fed07794b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea2104a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fed07794b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea2005890 con 0x55cea210acc0 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fed07794b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea2020ea0 con 0x55cea2109840 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fed07794b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cea1edce30 con 0x55cea2159c00 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fed07794b80 10 client.0 _ll_register_callbacks cb 0x55cea20cce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2130270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2130270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42936/0 (socket says 172.21.15.84:42936) 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecf77fe700 1 -- 172.21.15.84:0/3250348734 learned_addr learned my addr 172.21.15.84:0/3250348734 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecf7fff700 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea214a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecfca39700 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea2104a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecf77fe700 1 -- 172.21.15.84:0/3250348734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 msgr2=0x55cea2104a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecf77fe700 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea2104a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecf77fe700 1 -- 172.21.15.84:0/3250348734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 msgr2=0x55cea214a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecf77fe700 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea214a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.002+0000 7fecf77fe700 1 -- 172.21.15.84:0/3250348734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf815d300 con 0x55cea210acc0 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fecf77fe700 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2130270 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fecec016810 tx=0x7fecec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c574b0cbcc0e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fecd67fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fecd67fc700 1 -- 172.21.15.84:0/3250348734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0155d0 con 0x55cea210acc0 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fecd67fc700 1 -- 172.21.15.84:0/3250348734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fecec015730 con 0x55cea210acc0 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fed07794b80 1 -- 172.21.15.84:0/3250348734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cea20fe940 con 0x55cea210acc0 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fecd67fc700 1 -- 172.21.15.84:0/3250348734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecec015b00 con 0x55cea210acc0 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fed07794b80 10 client.6768 fetch_fsmap learned FSMap version 56 2023-10-06T02:58:50.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fed07794b80 1 -- 172.21.15.84:0/3250348734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55cea1e96fe0 con 0x55cea210acc0 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fecd67fc700 1 -- 172.21.15.84:0/3250348734 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cea20fe940 con 0x55cea210acc0 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fecd67fc700 1 -- 172.21.15.84:0/3250348734 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 56) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fecec015c60 con 0x55cea210acc0 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fed07794b80 10 client.6768 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fed07794b80 10 client.6768 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fed07794b80 20 client.6768 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fed07794b80 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55cea214c980 0x55cea2151500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fed07794b80 4 client.6768 mds_command: new command op to 6525 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fed07794b80 1 -- 172.21.15.84:0/3250348734 --> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cea20db870 con 0x55cea214c980 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.003+0000 7fecf7fff700 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55cea214c980 0x55cea2151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fecf7fff700 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55cea214c980 0x55cea2151500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c9d9934caf57bdc server_cookie=a56e441dbebd7fe8 in_seq=0 out_seq=0 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fecd67fc700 10 client.6768 ms_handle_connect on v2:172.21.15.84:6834/1455824046 2023-10-06T02:58:50.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fecd67fc700 1 -- 172.21.15.84:0/3250348734 <== mds.1 v2:172.21.15.84:6834/1455824046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55cea20db870 con 0x55cea214c980 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fecd67fc700 10 client.6768 handle_command_reply: tid=0 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 client.6768 shutdown 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 -- 172.21.15.84:0/3250348734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 msgr2=0x55cea2130270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2130270 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fecec016810 tx=0x7fecec018000 comp rx=0 tx=0).stop 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 -- 172.21.15.84:0/3250348734 shutdown_connections 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55cea214c980 0x55cea2151500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea214a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fecd67fc700 0 client.6768 ms_handle_reset on v2:172.21.15.84:6834/1455824046 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea2104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 --2- 172.21.15.84:0/3250348734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2130270 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 -- 172.21.15.84:0/3250348734 >> 172.21.15.84:0/3250348734 conn(0x55cea210b160 msgr2=0x55cea2132970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 -- 172.21.15.84:0/3250348734 shutdown_connections 2023-10-06T02:58:50.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 1 -- 172.21.15.84:0/3250348734 wait complete. 2023-10-06T02:58:50.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.004+0000 7fed07794b80 20 client.6768 trim_cache size 0 max 16384 2023-10-06T02:58:50.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.021+0000 7fed07794b80 1 Processor -- start 2023-10-06T02:58:50.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.021+0000 7fed07794b80 1 -- start start 2023-10-06T02:58:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fed07794b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea214cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fed07794b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea210acc0 0x55cea214d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fed07794b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2159c00 0x55cea2168f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fed07794b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea2159a70 con 0x55cea2159c00 2023-10-06T02:58:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fed07794b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea214fe50 con 0x55cea2109840 2023-10-06T02:58:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fed07794b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cea21512c0 con 0x55cea210acc0 2023-10-06T02:58:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecfca39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2159c00 0x55cea2168f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecfca39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2159c00 0x55cea2168f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42938/0 (socket says 172.21.15.84:42938) 2023-10-06T02:58:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecfca39700 1 -- 172.21.15.84:0/1909279843 learned_addr learned my addr 172.21.15.84:0/1909279843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecfca39700 1 -- 172.21.15.84:0/1909279843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea210acc0 msgr2=0x55cea214d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecfca39700 1 --2- 172.21.15.84:0/1909279843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea210acc0 0x55cea214d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecfca39700 1 -- 172.21.15.84:0/1909279843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 msgr2=0x55cea214cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecf7fff700 1 --2- 172.21.15.84:0/1909279843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea214cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecfca39700 1 --2- 172.21.15.84:0/1909279843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea214cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecfca39700 1 -- 172.21.15.84:0/1909279843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cea2028780 con 0x55cea2159c00 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecfca39700 1 --2- 172.21.15.84:0/1909279843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2159c00 0x55cea2168f20 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fecf0000f80 tx=0x7fecf0001840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cf717f3d0c807d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecddffb700 1 -- 172.21.15.84:0/1909279843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf000d070 con 0x55cea2159c00 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecddffb700 1 -- 172.21.15.84:0/1909279843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0007830 con 0x55cea2159c00 2023-10-06T02:58:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.022+0000 7fecddffb700 1 -- 172.21.15.84:0/1909279843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0014400 con 0x55cea2159c00 2023-10-06T02:58:50.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.023+0000 7fed07794b80 1 -- 172.21.15.84:0/1909279843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2159c00 msgr2=0x55cea2168f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.023+0000 7fed07794b80 1 --2- 172.21.15.84:0/1909279843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2159c00 0x55cea2168f20 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fecf0000f80 tx=0x7fecf0001840 comp rx=0 tx=0).stop 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.023+0000 7fed07794b80 1 -- 172.21.15.84:0/1909279843 shutdown_connections 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.023+0000 7fed07794b80 1 --2- 172.21.15.84:0/1909279843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea214cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.023+0000 7fed07794b80 1 --2- 172.21.15.84:0/1909279843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea2159c00 0x55cea2168f20 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.023+0000 7fed07794b80 1 --2- 172.21.15.84:0/1909279843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea210acc0 0x55cea214d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.023+0000 7fed07794b80 1 -- 172.21.15.84:0/1909279843 >> 172.21.15.84:0/1909279843 conn(0x55cea210b160 msgr2=0x55cea2102280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.023+0000 7fed07794b80 1 -- 172.21.15.84:0/1909279843 shutdown_connections 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.023+0000 7fed07794b80 1 -- 172.21.15.84:0/1909279843 wait complete. 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.024+0000 7fed07794b80 1 -- start start 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.024+0000 7fed07794b80 1 Processor -- start 2023-10-06T02:58:50.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.024+0000 7fed07794b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea21b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.024+0000 7fed07794b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.024+0000 7fed07794b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea2153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.024+0000 7fed07794b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea214d5e0 con 0x55cea210acc0 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.024+0000 7fed07794b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cea21b9550 con 0x55cea2109840 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.024+0000 7fed07794b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cea21592b0 con 0x55cea2159c00 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.024+0000 7fed07794b80 10 client.0 _ll_register_callbacks cb 0x55cea20cce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42952/0 (socket says 172.21.15.84:42952) 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf77fe700 1 -- 172.21.15.84:0/3524579444 learned_addr learned my addr 172.21.15.84:0/3524579444 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecfca39700 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea2153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf7fff700 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea21b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf77fe700 1 -- 172.21.15.84:0/3524579444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 msgr2=0x55cea2153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf77fe700 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea2153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf77fe700 1 -- 172.21.15.84:0/3524579444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 msgr2=0x55cea21b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf77fe700 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea21b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf77fe700 1 -- 172.21.15.84:0/3524579444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf000f040 con 0x55cea210acc0 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecfca39700 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea2153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecf77fe700 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2152ac0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fecec008010 tx=0x7fecec01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddb36602e322e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecd67fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecd67fc700 1 -- 172.21.15.84:0/3524579444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec015b00 con 0x55cea210acc0 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fed07794b80 1 -- 172.21.15.84:0/3524579444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fece8056ae0 con 0x55cea210acc0 2023-10-06T02:58:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecd67fc700 1 -- 172.21.15.84:0/3524579444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fecec03fda0 con 0x55cea210acc0 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecd67fc700 1 -- 172.21.15.84:0/3524579444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecec02c470 con 0x55cea210acc0 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fed07794b80 10 client.6774 fetch_fsmap learned FSMap version 56 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fed07794b80 1 -- 172.21.15.84:0/3524579444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55cea200f470 con 0x55cea210acc0 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecd67fc700 1 -- 172.21.15.84:0/3524579444 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8056ae0 con 0x55cea210acc0 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fecd67fc700 1 -- 172.21.15.84:0/3524579444 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 56) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fecec02c5d0 con 0x55cea210acc0 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fed07794b80 10 client.6774 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fed07794b80 10 client.6774 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fed07794b80 20 client.6774 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fed07794b80 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55cea2161ca0 0x55cea2162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fed07794b80 4 client.6774 mds_command: new command op to 6525 tid=0[{"prefix": "status"}] 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.025+0000 7fed07794b80 1 -- 172.21.15.84:0/3524579444 --> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cea1ffce00 con 0x55cea2161ca0 2023-10-06T02:58:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fecf7fff700 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55cea2161ca0 0x55cea2162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fecd67fc700 10 client.6774 ms_handle_connect on v2:172.21.15.84:6834/1455824046 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fecf7fff700 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55cea2161ca0 0x55cea2162070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=846120ddf7e76d81 server_cookie=9130d884f6ed05eb in_seq=0 out_seq=0 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fecd67fc700 1 -- 172.21.15.84:0/3524579444 <== mds.1 v2:172.21.15.84:6834/1455824046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55cea1ffce00 con 0x55cea2161ca0 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fecd67fc700 10 client.6774 handle_command_reply: tid=0 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 client.6774 shutdown 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 -- 172.21.15.84:0/3524579444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 msgr2=0x55cea2152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2152ac0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fecec008010 tx=0x7fecec01e000 comp rx=0 tx=0).stop 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 -- 172.21.15.84:0/3524579444 shutdown_connections 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55cea2161ca0 0x55cea2162070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cea2109840 0x55cea21b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fecd67fc700 0 client.6774 ms_handle_reset on v2:172.21.15.84:6834/1455824046 2023-10-06T02:58:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cea2159c00 0x55cea2153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 --2- 172.21.15.84:0/3524579444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cea210acc0 0x55cea2152ac0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 -- 172.21.15.84:0/3524579444 >> 172.21.15.84:0/3524579444 conn(0x55cea210b160 msgr2=0x55cea214f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 -- 172.21.15.84:0/3524579444 shutdown_connections 2023-10-06T02:58:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 1 -- 172.21.15.84:0/3524579444 wait complete. 2023-10-06T02:58:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.026+0000 7fed07794b80 20 client.6774 trim_cache size 0 max 16384 2023-10-06T02:58:50.037 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:50.037 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:58:50.037 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6525, 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 2.896278696, 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 56, 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 68, 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 68, 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 21.419249624999999 2023-10-06T02:58:50.038 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 -- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fece4066f30 msgr2=0x7fece40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fece4066f30 0x7fece40693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fecec0093f0 tx=0x7fecec008040 comp rx=0 tx=0).stop 2023-10-06T02:58:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 -- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 msgr2=0x7fecf8152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fecf8152f60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fece8000e10 tx=0x7fece8019000 comp rx=0 tx=0).stop 2023-10-06T02:58:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 -- 172.21.15.84:0/2137916440 shutdown_connections 2023-10-06T02:58:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fece4066f30 0x7fece40693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf809ba10 0x7fecf809beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fece0003a60 0x7fecf8152f60 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 --2- 172.21.15.84:0/2137916440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fecf809aaa0 0x7fecf815f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 -- 172.21.15.84:0/2137916440 >> 172.21.15.84:0/2137916440 conn(0x7fecf8099830 msgr2=0x7fecf80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 -- 172.21.15.84:0/2137916440 shutdown_connections 2023-10-06T02:58:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.027+0000 7fecfe49c700 1 -- 172.21.15.84:0/2137916440 wait complete. 2023-10-06T02:58:50.041 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T02:58:50.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.155+0000 7f1dd5f55700 1 Processor -- start 2023-10-06T02:58:50.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.155+0000 7f1dd5f55700 1 -- start start 2023-10-06T02:58:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dd5f55700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1dd00b49e0 0x7f1dd00aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dd5f55700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00b0ca0 con 0x7f1dd00b07a0 2023-10-06T02:58:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dd5f55700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00b0f80 con 0x7f1dd01595a0 2023-10-06T02:58:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dd5f55700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00b1260 con 0x7f1dd00b49e0 2023-10-06T02:58:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dceffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1dd00b49e0 0x7f1dd00aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dcffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1dd00b07a0 0x7f1dd00b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51138/0 (socket says 172.21.15.84:51138) 2023-10-06T02:58:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dcffff700 1 -- 172.21.15.84:0/1989620147 learned_addr learned my addr 172.21.15.84:0/1989620147 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dceffd700 1 -- 172.21.15.84:0/1989620147 >> v1:172.21.15.131:6789/0 conn(0x7f1dd01595a0 legacy=0x7f1dd00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dceffd700 1 -- 172.21.15.84:0/1989620147 >> v1:172.21.15.84:6789/0 conn(0x7f1dd00b07a0 legacy=0x7f1dd00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dceffd700 1 -- 172.21.15.84:0/1989620147 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00b1540 con 0x7f1dd00b49e0 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dce7fc700 1 -- 172.21.15.84:0/1989620147 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352842869 0 0) 0x7f1dd00b0ca0 con 0x7f1dd00b07a0 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dceffd700 1 --2- 172.21.15.84:0/1989620147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd00b49e0 0x7f1dd00aac80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009910 tx=0x7f1dc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825e86800e28b245 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dce7fc700 1 -- 172.21.15.84:0/1989620147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000b7e0 con 0x7f1dd00b49e0 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dce7fc700 1 -- 172.21.15.84:0/1989620147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc000b940 con 0x7f1dd00b49e0 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.156+0000 7f1dce7fc700 1 -- 172.21.15.84:0/1989620147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000bce0 con 0x7f1dd00b49e0 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.157+0000 7f1dd5f55700 1 -- 172.21.15.84:0/1989620147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd00b49e0 msgr2=0x7f1dd00aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.157+0000 7f1dd5f55700 1 --2- 172.21.15.84:0/1989620147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd00b49e0 0x7f1dd00aac80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009910 tx=0x7f1dc00091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.157+0000 7f1dd5f55700 1 -- 172.21.15.84:0/1989620147 shutdown_connections 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.157+0000 7f1dd5f55700 1 --2- 172.21.15.84:0/1989620147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd00b49e0 0x7f1dd00aac80 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.157+0000 7f1dd5f55700 1 -- 172.21.15.84:0/1989620147 >> 172.21.15.84:0/1989620147 conn(0x7f1dd0099830 msgr2=0x7f1dd006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.157+0000 7f1dd5f55700 1 -- 172.21.15.84:0/1989620147 shutdown_connections 2023-10-06T02:58:50.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.157+0000 7f1dd5f55700 1 -- 172.21.15.84:0/1989620147 wait complete. 2023-10-06T02:58:50.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.158+0000 7f1dd5f55700 1 Processor -- start 2023-10-06T02:58:50.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.158+0000 7f1dd5f55700 1 -- start start 2023-10-06T02:58:50.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dd5f55700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00b07a0 0x7f1dd0156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dd5f55700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b49e0 0x7f1dd015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dd5f55700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd01595a0 0x7f1dd009b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dd5f55700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd015a940 con 0x7f1dd01595a0 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dd5f55700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd015c0a0 con 0x7f1dd00b07a0 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dd5f55700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0159d30 con 0x7f1dd00b49e0 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dcffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd01595a0 0x7f1dd009b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dcffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd01595a0 0x7f1dd009b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42974/0 (socket says 172.21.15.84:42974) 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dcffff700 1 -- 172.21.15.84:0/4097411329 learned_addr learned my addr 172.21.15.84:0/4097411329 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00b07a0 0x7f1dd0156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dceffd700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b49e0 0x7f1dd015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dcffff700 1 -- 172.21.15.84:0/4097411329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b49e0 msgr2=0x7f1dd015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dcffff700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b49e0 0x7f1dd015add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dcffff700 1 -- 172.21.15.84:0/4097411329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00b07a0 msgr2=0x7f1dd0156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dcffff700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00b07a0 0x7f1dd0156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dcffff700 1 -- 172.21.15.84:0/4097411329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0009420 con 0x7f1dd01595a0 2023-10-06T02:58:50.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.159+0000 7f1dceffd700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b49e0 0x7f1dd015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:50.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.160+0000 7f1dcffff700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd01595a0 0x7f1dd009b960 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800cc90 tx=0x7f1dc8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.161+0000 7f1db77fe700 1 -- 172.21.15.84:0/4097411329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800a960 con 0x7f1dd01595a0 2023-10-06T02:58:50.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.161+0000 7f1db77fe700 1 -- 172.21.15.84:0/4097411329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800aac0 con 0x7f1dd01595a0 2023-10-06T02:58:50.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.161+0000 7f1dd5f55700 1 -- 172.21.15.84:0/4097411329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd015a010 con 0x7f1dd01595a0 2023-10-06T02:58:50.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.161+0000 7f1db77fe700 1 -- 172.21.15.84:0/4097411329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800ae80 con 0x7f1dd01595a0 2023-10-06T02:58:50.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.161+0000 7f1dd5f55700 1 -- 172.21.15.84:0/4097411329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd015a5d0 con 0x7f1dd01595a0 2023-10-06T02:58:50.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.165+0000 7f1ddf24db80 1 Processor -- start 2023-10-06T02:58:50.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.165+0000 7f1db77fe700 1 -- 172.21.15.84:0/4097411329 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1dc8007300 con 0x7f1dd01595a0 2023-10-06T02:58:50.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.166+0000 7f1ddf24db80 1 -- start start 2023-10-06T02:58:50.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.166+0000 7f1db77fe700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1dbc066f30 0x7f1dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.166+0000 7f1db77fe700 1 -- 172.21.15.84:0/4097411329 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1dc8084d30 con 0x7f1dd01595a0 2023-10-06T02:58:50.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.166+0000 7f1dceffd700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1dbc066f30 0x7f1dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 0x564844a35c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a36cc0 0x564844a856c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a85c00 0x564844a86050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484498ca70 con 0x564844a85c00 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484498a270 con 0x564844a36cc0 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564844986060 con 0x564844a35840 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dceffd700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1dbc066f30 0x7f1dbc0693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009910 tx=0x7f1dc0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a85c00 0x564844a86050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a85c00 0x564844a86050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42984/0 (socket says 172.21.15.84:42984) 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcffff700 1 -- 172.21.15.84:0/707762257 learned_addr learned my addr 172.21.15.84:0/707762257 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/707762257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 0x564844a35c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcffff700 1 -- 172.21.15.84:0/707762257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 msgr2=0x564844a35c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcffff700 1 --2- 172.21.15.84:0/707762257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 0x564844a35c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcffff700 1 -- 172.21.15.84:0/707762257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a36cc0 msgr2=0x564844a856c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcffff700 1 --2- 172.21.15.84:0/707762257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a36cc0 0x564844a856c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcffff700 1 -- 172.21.15.84:0/707762257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564844820270 con 0x564844a85c00 2023-10-06T02:58:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1dcffff700 1 --2- 172.21.15.84:0/707762257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a85c00 0x564844a86050 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8001330 tx=0x7f1dc8082e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c35ca8fae59480 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1db4ff9700 1 -- 172.21.15.84:0/707762257 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8058bf0 con 0x564844a85c00 2023-10-06T02:58:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1db4ff9700 1 -- 172.21.15.84:0/707762257 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc805c8c0 con 0x564844a85c00 2023-10-06T02:58:50.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.167+0000 7f1db4ff9700 1 -- 172.21.15.84:0/707762257 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8083020 con 0x564844a85c00 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.168+0000 7f1ddf24db80 1 -- 172.21.15.84:0/707762257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a85c00 msgr2=0x564844a86050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.168+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/707762257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a85c00 0x564844a86050 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8001330 tx=0x7f1dc8082e70 comp rx=0 tx=0).stop 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.168+0000 7f1ddf24db80 1 -- 172.21.15.84:0/707762257 shutdown_connections 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.168+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/707762257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a85c00 0x564844a86050 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.168+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/707762257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 0x564844a35c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.168+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/707762257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a36cc0 0x564844a856c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.168+0000 7f1ddf24db80 1 -- 172.21.15.84:0/707762257 >> 172.21.15.84:0/707762257 conn(0x564844a37160 msgr2=0x564844a37530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.168+0000 7f1ddf24db80 1 -- 172.21.15.84:0/707762257 shutdown_connections 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.168+0000 7f1ddf24db80 1 -- 172.21.15.84:0/707762257 wait complete. 2023-10-06T02:58:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.169+0000 7f1ddf24db80 1 -- start start 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.169+0000 7f1ddf24db80 1 Processor -- start 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 0x564844a5b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a30a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a85c00 0x564844a61730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564844931890 con 0x564844a36cc0 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484494cea0 con 0x564844a85c00 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564844808e30 con 0x564844a35840 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1ddf24db80 10 client.0 _ll_register_callbacks cb 0x5648449f8e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1dceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a30a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1dceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a30a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42996/0 (socket says 172.21.15.84:42996) 2023-10-06T02:58:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1dceffd700 1 -- 172.21.15.84:0/3183351568 learned_addr learned my addr 172.21.15.84:0/3183351568 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 0x564844a5b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1dcffff700 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a85c00 0x564844a61730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.170+0000 7f1dceffd700 1 -- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 msgr2=0x564844a5b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dceffd700 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 0x564844a5b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dceffd700 1 -- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a85c00 msgr2=0x564844a61730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dceffd700 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a85c00 0x564844a61730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dceffd700 1 -- 172.21.15.84:0/3183351568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd015a5d0 con 0x564844a36cc0 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 0x564844a5b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dcffff700 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a85c00 0x564844a61730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dceffd700 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a30a10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0002000 tx=0x7f1dc001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a65f9dc5089741 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dadffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dadffb700 1 -- 172.21.15.84:0/3183351568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc001d670 con 0x564844a36cc0 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dadffb700 1 -- 172.21.15.84:0/3183351568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1dc001d7d0 con 0x564844a36cc0 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3183351568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564844a2a940 con 0x564844a36cc0 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dadffb700 1 -- 172.21.15.84:0/3183351568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dc001dba0 con 0x564844a36cc0 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1ddf24db80 10 client.6789 fetch_fsmap learned FSMap version 56 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3183351568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x5648447c2fe0 con 0x564844a36cc0 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dadffb700 1 -- 172.21.15.84:0/3183351568 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564844a2a940 con 0x564844a36cc0 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1dadffb700 1 -- 172.21.15.84:0/3183351568 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 56) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f1dc001dd00 con 0x564844a36cc0 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1ddf24db80 10 client.6789 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1ddf24db80 10 client.6789 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:58:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1ddf24db80 20 client.6789 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x564844a8f920 0x564844a8fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1ddf24db80 4 client.6789 mds_command: new command op to 6528 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.171+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3183351568 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564844a07870 con 0x564844a8f920 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.172+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x564844a8f920 0x564844a8fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.172+0000 7f1dadffb700 10 client.6789 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.172+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x564844a8f920 0x564844a8fcf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7927ff317d27dd54 server_cookie=5f61ce989eff6baa in_seq=0 out_seq=0 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.172+0000 7f1dadffb700 1 -- 172.21.15.84:0/3183351568 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564844a07870 con 0x564844a8f920 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.172+0000 7f1dadffb700 10 client.6789 handle_command_reply: tid=0 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.172+0000 7f1ddf24db80 1 client.6789 shutdown 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.172+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3183351568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 msgr2=0x564844a30a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.172+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a30a10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0002000 tx=0x7f1dc001f040 comp rx=0 tx=0).stop 2023-10-06T02:58:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3183351568 shutdown_connections 2023-10-06T02:58:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x564844a8f920 0x564844a8fcf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a85c00 0x564844a61730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a35840 0x564844a5b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3183351568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a30a10 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3183351568 >> 172.21.15.84:0/3183351568 conn(0x564844a37160 msgr2=0x564844a79540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1dadffb700 0 client.6789 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:58:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3183351568 shutdown_connections 2023-10-06T02:58:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3183351568 wait complete. 2023-10-06T02:58:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.173+0000 7f1ddf24db80 20 client.6789 trim_cache size 0 max 16384 2023-10-06T02:58:50.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.189+0000 7f1ddf24db80 1 Processor -- start 2023-10-06T02:58:50.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.189+0000 7f1ddf24db80 1 -- start start 2023-10-06T02:58:50.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a35840 0x564844a73570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a36cc0 0x564844a95950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a85c00 0x564844a95e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564844a361b0 con 0x564844a35840 2023-10-06T02:58:50.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564844a85ff0 con 0x564844a36cc0 2023-10-06T02:58:50.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564844a807a0 con 0x564844a85c00 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1dcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a35840 0x564844a73570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1dcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a35840 0x564844a73570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43004/0 (socket says 172.21.15.84:43004) 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1dcf7fe700 1 -- 172.21.15.84:0/1476381229 learned_addr learned my addr 172.21.15.84:0/1476381229 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1dcf7fe700 1 -- 172.21.15.84:0/1476381229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a85c00 msgr2=0x564844a95e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/1476381229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a85c00 0x564844a95e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1dcf7fe700 1 -- 172.21.15.84:0/1476381229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a36cc0 msgr2=0x564844a95950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/1476381229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a36cc0 0x564844a95950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1dcf7fe700 1 -- 172.21.15.84:0/1476381229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564844954780 con 0x564844a35840 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/1476381229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a35840 0x564844a73570 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4000ef0 tx=0x7f1dc401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c50e56754c70796 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1db57fa700 1 -- 172.21.15.84:0/1476381229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc401a0d0 con 0x564844a35840 2023-10-06T02:58:50.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1db57fa700 1 -- 172.21.15.84:0/1476381229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc401ae40 con 0x564844a35840 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.190+0000 7f1db57fa700 1 -- 172.21.15.84:0/1476381229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4016460 con 0x564844a35840 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.191+0000 7f1ddf24db80 1 -- 172.21.15.84:0/1476381229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a35840 msgr2=0x564844a73570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.191+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/1476381229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a35840 0x564844a73570 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4000ef0 tx=0x7f1dc401c040 comp rx=0 tx=0).stop 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.191+0000 7f1ddf24db80 1 -- 172.21.15.84:0/1476381229 shutdown_connections 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.191+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/1476381229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a85c00 0x564844a95e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.191+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/1476381229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a35840 0x564844a73570 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.191+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/1476381229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a36cc0 0x564844a95950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.191+0000 7f1ddf24db80 1 -- 172.21.15.84:0/1476381229 >> 172.21.15.84:0/1476381229 conn(0x564844a37160 msgr2=0x564844a2e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.191+0000 7f1ddf24db80 1 -- 172.21.15.84:0/1476381229 shutdown_connections 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.191+0000 7f1ddf24db80 1 -- 172.21.15.84:0/1476381229 wait complete. 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.192+0000 7f1ddf24db80 1 -- start start 2023-10-06T02:58:50.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.192+0000 7f1ddf24db80 1 Processor -- start 2023-10-06T02:58:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.192+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a35840 0x564844a88fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.192+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a37a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.192+0000 7f1ddf24db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a85c00 0x564844ae4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.192+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564844a895f0 con 0x564844a36cc0 2023-10-06T02:58:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.192+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564844ae53a0 con 0x564844a35840 2023-10-06T02:58:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.192+0000 7f1ddf24db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564844a82e40 con 0x564844a85c00 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.192+0000 7f1ddf24db80 10 client.0 _ll_register_callbacks cb 0x5648449f8e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a37a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a37a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43008/0 (socket says 172.21.15.84:43008) 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dceffd700 1 -- 172.21.15.84:0/3624119615 learned_addr learned my addr 172.21.15.84:0/3624119615 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a35840 0x564844a88fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dcffff700 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a85c00 0x564844ae4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dceffd700 1 -- 172.21.15.84:0/3624119615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a85c00 msgr2=0x564844ae4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dceffd700 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a85c00 0x564844ae4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dceffd700 1 -- 172.21.15.84:0/3624119615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a35840 msgr2=0x564844a88fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dceffd700 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a35840 0x564844a88fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dceffd700 1 -- 172.21.15.84:0/3624119615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc4009a40 con 0x564844a36cc0 2023-10-06T02:58:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dceffd700 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a37a00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00091e0 tx=0x7f1dc002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df98d115d531bf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dadffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dadffb700 1 -- 172.21.15.84:0/3624119615 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0009210 con 0x564844a36cc0 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3624119615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1dc805c8c0 con 0x564844a36cc0 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dadffb700 1 -- 172.21.15.84:0/3624119615 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1dc002ad30 con 0x564844a36cc0 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dadffb700 1 -- 172.21.15.84:0/3624119615 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dc0011da0 con 0x564844a36cc0 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1ddf24db80 10 client.6795 fetch_fsmap learned FSMap version 56 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3624119615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x56484493b470 con 0x564844a36cc0 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.193+0000 7f1dadffb700 1 -- 172.21.15.84:0/3624119615 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc805c8c0 con 0x564844a36cc0 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1dadffb700 1 -- 172.21.15.84:0/3624119615 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 56) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f1dc0011630 con 0x564844a36cc0 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 10 client.6795 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T02:58:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 10 client.6795 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 20 client.6795 populate_metadata read hostname 'smithi084' 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x564844a95950 0x564844a95d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 4 client.6795 mds_command: new command op to 6528 tid=0[{"prefix": "status"}] 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3624119615 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564844928e00 con 0x564844a95950 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x564844a95950 0x564844a95d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1dadffb700 10 client.6795 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1dcf7fe700 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x564844a95950 0x564844a95d20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e3623b4efec51f6 server_cookie=a9977ef50bc4ccf8 in_seq=0 out_seq=0 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1dadffb700 1 -- 172.21.15.84:0/3624119615 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564844928e00 con 0x564844a95950 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1dadffb700 10 client.6795 handle_command_reply: tid=0 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 client.6795 shutdown 2023-10-06T02:58:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3624119615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 msgr2=0x564844a37a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a37a00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00091e0 tx=0x7f1dc002c070 comp rx=0 tx=0).stop 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3624119615 shutdown_connections 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x564844a95950 0x564844a95d20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564844a35840 0x564844a88fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1dadffb700 0 client.6795 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564844a85c00 0x564844ae4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 --2- 172.21.15.84:0/3624119615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564844a36cc0 0x564844a37a00 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3624119615 >> 172.21.15.84:0/3624119615 conn(0x564844a37160 msgr2=0x564844a65750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3624119615 shutdown_connections 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.194+0000 7f1ddf24db80 1 -- 172.21.15.84:0/3624119615 wait complete. 2023-10-06T02:58:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1ddf24db80 20 client.6795 trim_cache size 0 max 16384 2023-10-06T02:58:50.204 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:58:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T02:58:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T02:58:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6528, 2023-10-06T02:58:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T02:58:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T02:58:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T02:58:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 15.461457594000001, 2023-10-06T02:58:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 56, 2023-10-06T02:58:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 69, 2023-10-06T02:58:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 68, 2023-10-06T02:58:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 21.587094844999999 2023-10-06T02:58:50.205 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:58:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 -- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1dbc066f30 msgr2=0x7f1dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1dbc066f30 0x7f1dbc0693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009910 tx=0x7f1dc0016000 comp rx=0 tx=0).stop 2023-10-06T02:58:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 -- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd01595a0 msgr2=0x7f1dd009b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd01595a0 0x7f1dd009b960 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800cc90 tx=0x7f1dc8001a80 comp rx=0 tx=0).stop 2023-10-06T02:58:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 -- 172.21.15.84:0/4097411329 shutdown_connections 2023-10-06T02:58:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1dbc066f30 0x7f1dbc0693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dd00b07a0 0x7f1dd0156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dd01595a0 0x7f1dd009b960 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 --2- 172.21.15.84:0/4097411329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dd00b49e0 0x7f1dd015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 -- 172.21.15.84:0/4097411329 >> 172.21.15.84:0/4097411329 conn(0x7f1dd0099830 msgr2=0x7f1dd0158a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 -- 172.21.15.84:0/4097411329 shutdown_connections 2023-10-06T02:58:50.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.195+0000 7f1dd5f55700 1 -- 172.21.15.84:0/4097411329 wait complete. 2023-10-06T02:58:50.208 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:58:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.323+0000 7fa8cf515700 1 Processor -- start 2023-10-06T02:58:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.323+0000 7fa8cf515700 1 -- start start 2023-10-06T02:58:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.324+0000 7fa8cf515700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8c80b49e0 0x7fa8c80aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.324+0000 7fa8cf515700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c80b07a0 0x7fa8c80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.324+0000 7fa8cf515700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c80b0ca0 con 0x7fa8c81595a0 2023-10-06T02:58:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.324+0000 7fa8cf515700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c80b0f80 con 0x7fa8c80b49e0 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.324+0000 7fa8cf515700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80b1260 con 0x7fa8c80b07a0 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.324+0000 7fa8ccab0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8c80b49e0 0x7fa8c80aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.324+0000 7fa8cd2b1700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa8c81595a0 0x7fa8c80aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51146/0 (socket says 172.21.15.84:51146) 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.324+0000 7fa8cd2b1700 1 -- 172.21.15.84:0/3800139303 learned_addr learned my addr 172.21.15.84:0/3800139303 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.324+0000 7fa8cdab2700 1 --2- 172.21.15.84:0/3800139303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c80b07a0 0x7fa8c80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8ccab0700 1 -- 172.21.15.84:0/3800139303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c80b07a0 msgr2=0x7fa8c80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8ccab0700 1 --2- 172.21.15.84:0/3800139303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c80b07a0 0x7fa8c80b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8ccab0700 1 -- 172.21.15.84:0/3800139303 >> v1:172.21.15.84:6789/0 conn(0x7fa8c81595a0 legacy=0x7fa8c80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8ccab0700 1 -- 172.21.15.84:0/3800139303 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c80b1540 con 0x7fa8c80b49e0 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8bffff700 1 -- 172.21.15.84:0/3800139303 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145840060 0 0) 0x7fa8c80b0ca0 con 0x7fa8c81595a0 2023-10-06T02:58:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8cdab2700 1 --2- 172.21.15.84:0/3800139303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c80b07a0 0x7fa8c80b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8ccab0700 1 --2- 172.21.15.84:0/3800139303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 0x7fa8c80aac80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009910 tx=0x7fa8b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7975d2c0687086 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8bffff700 1 -- 172.21.15.84:0/3800139303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800b820 con 0x7fa8c80b49e0 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8bffff700 1 -- 172.21.15.84:0/3800139303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b800b980 con 0x7fa8c80b49e0 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8bffff700 1 -- 172.21.15.84:0/3800139303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800bd20 con 0x7fa8c80b49e0 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8cf515700 1 -- 172.21.15.84:0/3800139303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 msgr2=0x7fa8c80aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8cf515700 1 --2- 172.21.15.84:0/3800139303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 0x7fa8c80aac80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009910 tx=0x7fa8b80091a0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8cf515700 1 -- 172.21.15.84:0/3800139303 shutdown_connections 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8cf515700 1 --2- 172.21.15.84:0/3800139303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c80b07a0 0x7fa8c80b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8cf515700 1 --2- 172.21.15.84:0/3800139303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 0x7fa8c80aac80 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8cf515700 1 -- 172.21.15.84:0/3800139303 >> 172.21.15.84:0/3800139303 conn(0x7fa8c8099830 msgr2=0x7fa8c806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.325+0000 7fa8cf515700 1 -- 172.21.15.84:0/3800139303 shutdown_connections 2023-10-06T02:58:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.326+0000 7fa8cf515700 1 -- 172.21.15.84:0/3800139303 wait complete. 2023-10-06T02:58:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.327+0000 7fa8cf515700 1 Processor -- start 2023-10-06T02:58:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.327+0000 7fa8cf515700 1 -- start start 2023-10-06T02:58:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.327+0000 7fa8cf515700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8c80b07a0 0x7fa8c815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.327+0000 7fa8cf515700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 0x7fa8c815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.327+0000 7fa8cf515700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c81595a0 0x7fa8c80ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.327+0000 7fa8cf515700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c815d0a0 con 0x7fa8c80b49e0 2023-10-06T02:58:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.327+0000 7fa8cf515700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c816d0d0 con 0x7fa8c80b07a0 2023-10-06T02:58:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.327+0000 7fa8cf515700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c816a040 con 0x7fa8c81595a0 2023-10-06T02:58:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8ccab0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 0x7fa8c815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8ccab0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 0x7fa8c815ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43036/0 (socket says 172.21.15.84:43036) 2023-10-06T02:58:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8ccab0700 1 -- 172.21.15.84:0/2964121546 learned_addr learned my addr 172.21.15.84:0/2964121546 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8cd2b1700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8c80b07a0 0x7fa8c815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8cdab2700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c81595a0 0x7fa8c80ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8ccab0700 1 -- 172.21.15.84:0/2964121546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c81595a0 msgr2=0x7fa8c80ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8ccab0700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c81595a0 0x7fa8c80ac360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8ccab0700 1 -- 172.21.15.84:0/2964121546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8c80b07a0 msgr2=0x7fa8c815cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8ccab0700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8c80b07a0 0x7fa8c815cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8ccab0700 1 -- 172.21.15.84:0/2964121546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8009420 con 0x7fa8c80b49e0 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8ccab0700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 0x7fa8c815ba40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8067c60 tx=0x7fa8b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8bd7fa700 1 -- 172.21.15.84:0/2964121546 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800b820 con 0x7fa8c80b49e0 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8bd7fa700 1 -- 172.21.15.84:0/2964121546 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b8024440 con 0x7fa8c80b49e0 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c816a320 con 0x7fa8c80b49e0 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8bd7fa700 1 -- 172.21.15.84:0/2964121546 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8024800 con 0x7fa8c80b49e0 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.328+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c816a8e0 con 0x7fa8c80b49e0 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.329+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c816d290 con 0x7fa8c80b49e0 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.329+0000 7fa8bd7fa700 1 -- 172.21.15.84:0/2964121546 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8b801a420 con 0x7fa8c80b49e0 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.330+0000 7fa8bd7fa700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa8ac066f30 0x7fa8ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.330+0000 7fa8bd7fa700 1 -- 172.21.15.84:0/2964121546 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fa8b80867a0 con 0x7fa8c80b49e0 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.330+0000 7fa8cd2b1700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa8ac066f30 0x7fa8ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:58:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.330+0000 7fa8cd2b1700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa8ac066f30 0x7fa8ac0693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4001730 tx=0x7fa8c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:58:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.334+0000 7fa8bd7fa700 1 -- 172.21.15.84:0/2964121546 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8b8053730 con 0x7fa8c80b49e0 2023-10-06T02:58:50.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.560+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8c8064ad0 con 0x7fa8c80b49e0 2023-10-06T02:58:50.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.560+0000 7fa8bd7fa700 1 -- 172.21.15.84:0/2964121546 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4630 (secure 0 0 0) 0x7fa8b8056d50 con 0x7fa8c80b49e0 2023-10-06T02:58:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:58:50.562 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:58:34.102008+0000","modified":"2023-10-06T02:58:49.154921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6528,"mds_1":6525,"mds_2":5567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5567":{"gid":5567,"name":"d","rank":2,"incarnation":55,"state":"up:active","state_seq":6,"addr":"172.21.15.131:6835/4032170839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4032170839},{"type":"v1","addr":"172.21.15.131:6835","nonce":4032170839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6525":{"gid":6525,"name":"c","rank":1,"incarnation":53,"state":"up:active","state_seq":6,"addr":"172.21.15.84:6836/1455824046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1455824046},{"type":"v1","addr":"172.21.15.84:6836","nonce":1455824046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6528":{"gid":6528,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/3591915780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3591915780},{"type":"v1","addr":"172.21.15.84:6837","nonce":3591915780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:58:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa8ac066f30 msgr2=0x7fa8ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa8ac066f30 0x7fa8ac0693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4001730 tx=0x7fa8c4009040 comp rx=0 tx=0).stop 2023-10-06T02:58:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 msgr2=0x7fa8c815ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:58:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 0x7fa8c815ba40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8067c60 tx=0x7fa8b8017000 comp rx=0 tx=0).stop 2023-10-06T02:58:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 shutdown_connections 2023-10-06T02:58:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa8ac066f30 0x7fa8ac0693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8c80b07a0 0x7fa8c815cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8c81595a0 0x7fa8c80ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 --2- 172.21.15.84:0/2964121546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8c80b49e0 0x7fa8c815ba40 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:58:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 >> 172.21.15.84:0/2964121546 conn(0x7fa8c8099830 msgr2=0x7fa8c81588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:58:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 shutdown_connections 2023-10-06T02:58:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:58:50.562+0000 7fa8cf515700 1 -- 172.21.15.84:0/2964121546 wait complete. 2023-10-06T02:58:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 56 2023-10-06T02:58:50.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:58:50.576 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T02:58:50.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:58:50.602 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T02:58:50.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:58:50.664 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-10-06T02:58:50.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:58:50.720 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-10-06T02:58:50.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:58:50.776 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-10-06T02:58:50.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:58:51.002 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:58:51.003 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:58:51.003 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:58:53.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:58:53.147 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:58:53.147 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:58:53.147 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:58:55.149 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:58:55.293 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:58:55.293 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:58:55.294 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:58:57.294 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:58:57.436 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T02:58:57.437 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T02:58:57.437 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:58:59.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T02:58:59.581 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-10-06T02:58:59.582 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:58:59.582 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T02:58:59.582 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:58:59.712 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T02:58:59.712 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:58:59.712 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:59:01.713 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:59:01.856 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T02:59:01.857 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:59:01.857 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:59:03.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:59:04.002 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T02:59:04.002 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:59:04.003 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:59:06.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T02:59:06.158 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-10-06T02:59:06.159 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:59:06.159 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:59:06.160 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-10-06T02:59:06.314 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T02:59:06.315 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T02:59:06.315 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T02:59:06.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2023-10-06T02:59:06.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.430+0000 7f09da116700 1 Processor -- start 2023-10-06T02:59:06.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.430+0000 7f09da116700 1 -- start start 2023-10-06T02:59:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09da116700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09d40b2660 0x7f09d40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09da116700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f09d40b2a30 0x7f09d40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09da116700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d40cc9b0 con 0x7f09d40ceae0 2023-10-06T02:59:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09da116700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d40cbda0 con 0x7f09d40b2660 2023-10-06T02:59:06.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09da116700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d40cc080 con 0x7f09d40b2a30 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09d9114700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09d40b2660 0x7f09d40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09d9915700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f09d40ceae0 0x7f09d40cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48340/0 (socket says 172.21.15.84:48340) 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09d9915700 1 -- 172.21.15.84:0/4148582833 learned_addr learned my addr 172.21.15.84:0/4148582833 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09d8913700 1 --2- 172.21.15.84:0/4148582833 >> v2:172.21.15.131:3300/0 conn(0x7f09d40b2a30 0x7f09d40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09d9114700 1 -- 172.21.15.84:0/4148582833 >> v2:172.21.15.131:3300/0 conn(0x7f09d40b2a30 msgr2=0x7f09d40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09d9114700 1 --2- 172.21.15.84:0/4148582833 >> v2:172.21.15.131:3300/0 conn(0x7f09d40b2a30 0x7f09d40cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09d9114700 1 -- 172.21.15.84:0/4148582833 >> v1:172.21.15.84:6789/0 conn(0x7f09d40ceae0 legacy=0x7f09d40cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09cbfff700 1 -- 172.21.15.84:0/4148582833 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109576392 0 0) 0x7f09d40cc9b0 con 0x7f09d40ceae0 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09d9114700 1 -- 172.21.15.84:0/4148582833 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d40cc360 con 0x7f09d40b2660 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.431+0000 7f09d9114700 1 --2- 172.21.15.84:0/4148582833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 0x7f09d40cccf0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f09d40b6310 tx=0x7f09d0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886f75d07986248 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09cbfff700 1 -- 172.21.15.84:0/4148582833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0005c10 con 0x7f09d40b2660 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09cbfff700 1 -- 172.21.15.84:0/4148582833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d0005d70 con 0x7f09d40b2660 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09cbfff700 1 -- 172.21.15.84:0/4148582833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0006260 con 0x7f09d40b2660 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09da116700 1 -- 172.21.15.84:0/4148582833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 msgr2=0x7f09d40cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09da116700 1 --2- 172.21.15.84:0/4148582833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 0x7f09d40cccf0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f09d40b6310 tx=0x7f09d0009120 comp rx=0 tx=0).stop 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09da116700 1 -- 172.21.15.84:0/4148582833 shutdown_connections 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09da116700 1 --2- 172.21.15.84:0/4148582833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 0x7f09d40cccf0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09da116700 1 --2- 172.21.15.84:0/4148582833 >> v2:172.21.15.131:3300/0 conn(0x7f09d40b2a30 0x7f09d40cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09da116700 1 -- 172.21.15.84:0/4148582833 >> 172.21.15.84:0/4148582833 conn(0x7f09d4099560 msgr2=0x7f09d406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09da116700 1 -- 172.21.15.84:0/4148582833 shutdown_connections 2023-10-06T02:59:06.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.432+0000 7f09da116700 1 -- 172.21.15.84:0/4148582833 wait complete. 2023-10-06T02:59:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.433+0000 7f09da116700 1 Processor -- start 2023-10-06T02:59:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.433+0000 7f09da116700 1 -- start start 2023-10-06T02:59:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09da116700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 0x7f09d40c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09da116700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09d40b2a30 0x7f09d4147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09da116700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09d40ceae0 0x7f09d40b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09da116700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40c7fd0 con 0x7f09d40b2660 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09da116700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40c73c0 con 0x7f09d40b2a30 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09da116700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40c76a0 con 0x7f09d40ceae0 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09d9114700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 0x7f09d40c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09d9114700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 0x7f09d40c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48632/0 (socket says 172.21.15.84:48632) 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09d9114700 1 -- 172.21.15.84:0/3943067017 learned_addr learned my addr 172.21.15.84:0/3943067017 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09d9915700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09d40ceae0 0x7f09d40b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.434+0000 7f09d8913700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09d40b2a30 0x7f09d4147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09d9114700 1 -- 172.21.15.84:0/3943067017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09d40ceae0 msgr2=0x7f09d40b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09d9114700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09d40ceae0 0x7f09d40b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09d9114700 1 -- 172.21.15.84:0/3943067017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09d40b2a30 msgr2=0x7f09d4147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09d9114700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09d40b2a30 0x7f09d4147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09d9114700 1 -- 172.21.15.84:0/3943067017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00093c0 con 0x7f09d40b2660 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09d8913700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09d40b2a30 0x7f09d4147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09d9114700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 0x7f09d40c8460 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f09d000b0e0 tx=0x7f09d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09c97fa700 1 -- 172.21.15.84:0/3943067017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000bd00 con 0x7f09d40b2660 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09c97fa700 1 -- 172.21.15.84:0/3943067017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d000be60 con 0x7f09d40b2660 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09c97fa700 1 -- 172.21.15.84:0/3943067017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0026660 con 0x7f09d40b2660 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09da116700 1 -- 172.21.15.84:0/3943067017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d40c7980 con 0x7f09d40b2660 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.435+0000 7f09da116700 1 -- 172.21.15.84:0/3943067017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d41481b0 con 0x7f09d40b2660 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.436+0000 7f09c97fa700 1 -- 172.21.15.84:0/3943067017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09d001a420 con 0x7f09d40b2660 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.437+0000 7f09c97fa700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f09b8066f30 0x7f09b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.437+0000 7f09c97fa700 1 -- 172.21.15.84:0/3943067017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f09d0086310 con 0x7f09d40b2660 2023-10-06T02:59:06.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.437+0000 7f09d8913700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f09b8066f30 0x7f09b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.437+0000 7f09d8913700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f09b8066f30 0x7f09b80693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f09d40c8c20 tx=0x7f09c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.438+0000 7f09e4670b80 1 Processor -- start 2023-10-06T02:59:06.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09e4670b80 1 -- start start 2023-10-06T02:59:06.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 0x560dc294dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc294e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09e4670b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc28a8ac0 con 0x560dc2953310 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09e4670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc28a62c0 con 0x560dc2954a60 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09e4670b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dc28a20b0 con 0x560dc2972ea0 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09d8913700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc294e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09d8913700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc294e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48638/0 (socket says 172.21.15.84:48638) 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09d8913700 1 -- 172.21.15.84:0/1853216018 learned_addr learned my addr 172.21.15.84:0/1853216018 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09d9114700 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 0x560dc294dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.439+0000 7f09d9915700 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09d8913700 1 -- 172.21.15.84:0/1853216018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 msgr2=0x560dc294dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09d8913700 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 0x560dc294dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09d8913700 1 -- 172.21.15.84:0/1853216018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 msgr2=0x560dc294e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09d8913700 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09d8913700 1 -- 172.21.15.84:0/1853216018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dc273c2c0 con 0x560dc2953310 2023-10-06T02:59:06.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09d9915700 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:06.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09d8913700 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc294e250 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f09c400fa70 tx=0x7f09c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dff7ee369f303c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09be7fc700 1 -- 172.21.15.84:0/1853216018 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c400fe90 con 0x560dc2953310 2023-10-06T02:59:06.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09be7fc700 1 -- 172.21.15.84:0/1853216018 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c4019070 con 0x560dc2953310 2023-10-06T02:59:06.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09be7fc700 1 -- 172.21.15.84:0/1853216018 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4014b00 con 0x560dc2953310 2023-10-06T02:59:06.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09e4670b80 1 -- 172.21.15.84:0/1853216018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 msgr2=0x560dc294e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.440+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc294e250 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f09c400fa70 tx=0x7f09c4016000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.441+0000 7f09e4670b80 1 -- 172.21.15.84:0/1853216018 shutdown_connections 2023-10-06T02:59:06.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.441+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.441+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 0x560dc294dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.441+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1853216018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc294e250 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.441+0000 7f09e4670b80 1 -- 172.21.15.84:0/1853216018 >> 172.21.15.84:0/1853216018 conn(0x560dc2952ed0 msgr2=0x560dc2953700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.441+0000 7f09e4670b80 1 -- 172.21.15.84:0/1853216018 shutdown_connections 2023-10-06T02:59:06.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.441+0000 7f09e4670b80 1 -- 172.21.15.84:0/1853216018 wait complete. 2023-10-06T02:59:06.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.441+0000 7f09e4670b80 1 -- start start 2023-10-06T02:59:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.441+0000 7f09e4670b80 1 Processor -- start 2023-10-06T02:59:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2953310 0x560dc29a7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2954a60 0x560dc299a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 0x560dc29991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09e4670b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc284d8e0 con 0x560dc2954a60 2023-10-06T02:59:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09e4670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc2868ef0 con 0x560dc2953310 2023-10-06T02:59:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09e4670b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dc2724e80 con 0x560dc2972ea0 2023-10-06T02:59:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09e4670b80 10 client.0 _ll_register_callbacks cb 0x560dc2915070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d8913700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2954a60 0x560dc299a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d8913700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2954a60 0x560dc299a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48648/0 (socket says 172.21.15.84:48648) 2023-10-06T02:59:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d8913700 1 -- 172.21.15.84:0/1945505654 learned_addr learned my addr 172.21.15.84:0/1945505654 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d9915700 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 0x560dc29991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d9114700 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2953310 0x560dc29a7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d8913700 1 -- 172.21.15.84:0/1945505654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 msgr2=0x560dc29991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d8913700 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 0x560dc29991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d8913700 1 -- 172.21.15.84:0/1945505654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2953310 msgr2=0x560dc29a7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d8913700 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2953310 0x560dc29a7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.442+0000 7f09d8913700 1 -- 172.21.15.84:0/1945505654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c400e040 con 0x560dc2954a60 2023-10-06T02:59:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09d8913700 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2954a60 0x560dc299a4c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f09c4007010 tx=0x7f09c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bbf6a2818d3b1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09b37fe700 1 -- 172.21.15.84:0/1945505654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4020b00 con 0x560dc2954a60 2023-10-06T02:59:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09b37fe700 1 -- 172.21.15.84:0/1945505654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f09c4033da0 con 0x560dc2954a60 2023-10-06T02:59:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09e4670b80 1 -- 172.21.15.84:0/1945505654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560dc2946990 con 0x560dc2954a60 2023-10-06T02:59:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09b37fe700 1 -- 172.21.15.84:0/1945505654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09c4020e70 con 0x560dc2954a60 2023-10-06T02:59:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09e4670b80 10 client.6819 fetch_fsmap learned FSMap version 58 2023-10-06T02:59:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09e4670b80 1 -- 172.21.15.84:0/1945505654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x560dc26df030 con 0x560dc2954a60 2023-10-06T02:59:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09b37fe700 1 -- 172.21.15.84:0/1945505654 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560dc2946990 con 0x560dc2954a60 2023-10-06T02:59:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09b37fe700 1 -- 172.21.15.84:0/1945505654 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 58) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f09c4030020 con 0x560dc2954a60 2023-10-06T02:59:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09e4670b80 10 client.6819 fetch_fsmap finished waiting for FSMap version 58 2023-10-06T02:59:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09e4670b80 10 client.6819 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09e4670b80 20 client.6819 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560dc2999730 0x560dc2971400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09e4670b80 4 client.6819 mds_command: new command op to 6528 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:59:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09e4670b80 1 -- 172.21.15.84:0/1945505654 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560dc29238c0 con 0x560dc2999730 2023-10-06T02:59:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.443+0000 7f09d9114700 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560dc2999730 0x560dc2971400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09b37fe700 10 client.6819 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09d9114700 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560dc2999730 0x560dc2971400 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e80d54c1e63dc7f server_cookie=2edde7e619d06ddb in_seq=0 out_seq=0 2023-10-06T02:59:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09b37fe700 1 -- 172.21.15.84:0/1945505654 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560dc29238c0 con 0x560dc2999730 2023-10-06T02:59:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09b37fe700 10 client.6819 handle_command_reply: tid=0 2023-10-06T02:59:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 client.6819 shutdown 2023-10-06T02:59:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 -- 172.21.15.84:0/1945505654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2954a60 msgr2=0x560dc299a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2954a60 0x560dc299a4c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f09c4007010 tx=0x7f09c4019000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 -- 172.21.15.84:0/1945505654 shutdown_connections 2023-10-06T02:59:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560dc2999730 0x560dc2971400 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2953310 0x560dc29a7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09b37fe700 0 client.6819 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2972ea0 0x560dc29991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 --2- 172.21.15.84:0/1945505654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2954a60 0x560dc299a4c0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 -- 172.21.15.84:0/1945505654 >> 172.21.15.84:0/1945505654 conn(0x560dc2952ed0 msgr2=0x560dc2951db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 -- 172.21.15.84:0/1945505654 shutdown_connections 2023-10-06T02:59:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.444+0000 7f09e4670b80 1 -- 172.21.15.84:0/1945505654 wait complete. 2023-10-06T02:59:06.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.445+0000 7f09e4670b80 20 client.6819 trim_cache size 0 max 16384 2023-10-06T02:59:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.458+0000 7f09e4670b80 1 Processor -- start 2023-10-06T02:59:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.458+0000 7f09e4670b80 1 -- start start 2023-10-06T02:59:06.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2953310 0x560dc2953b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2972ea0 0x560dc2973440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09e4670b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc29b9770 con 0x560dc2972ea0 2023-10-06T02:59:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09e4670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc2974860 con 0x560dc2954a60 2023-10-06T02:59:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09e4670b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dc2946750 con 0x560dc2953310 2023-10-06T02:59:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9915700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2972ea0 0x560dc2973440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9915700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2972ea0 0x560dc2973440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48654/0 (socket says 172.21.15.84:48654) 2023-10-06T02:59:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9915700 1 -- 172.21.15.84:0/3638715600 learned_addr learned my addr 172.21.15.84:0/3638715600 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9114700 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2953310 0x560dc2953b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d8913700 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9915700 1 -- 172.21.15.84:0/3638715600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2953310 msgr2=0x560dc2953b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9915700 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2953310 0x560dc2953b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9915700 1 -- 172.21.15.84:0/3638715600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 msgr2=0x560dc294ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9915700 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9915700 1 -- 172.21.15.84:0/3638715600 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dc28707d0 con 0x560dc2972ea0 2023-10-06T02:59:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d8913700 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09d9915700 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2972ea0 0x560dc2973440 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0020f0 tx=0x7f09cc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160e4e83325054ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09beffd700 1 -- 172.21.15.84:0/3638715600 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc007a60 con 0x560dc2972ea0 2023-10-06T02:59:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09beffd700 1 -- 172.21.15.84:0/3638715600 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc016420 con 0x560dc2972ea0 2023-10-06T02:59:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.459+0000 7f09beffd700 1 -- 172.21.15.84:0/3638715600 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0167c0 con 0x560dc2972ea0 2023-10-06T02:59:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.460+0000 7f09e4670b80 1 -- 172.21.15.84:0/3638715600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2972ea0 msgr2=0x560dc2973440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.460+0000 7f09e4670b80 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2972ea0 0x560dc2973440 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0020f0 tx=0x7f09cc009040 comp rx=0 tx=0).stop 2023-10-06T02:59:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.460+0000 7f09e4670b80 1 -- 172.21.15.84:0/3638715600 shutdown_connections 2023-10-06T02:59:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.460+0000 7f09e4670b80 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2972ea0 0x560dc2973440 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.460+0000 7f09e4670b80 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2953310 0x560dc2953b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.460+0000 7f09e4670b80 1 --2- 172.21.15.84:0/3638715600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2954a60 0x560dc294ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.460+0000 7f09e4670b80 1 -- 172.21.15.84:0/3638715600 >> 172.21.15.84:0/3638715600 conn(0x560dc2952ed0 msgr2=0x560dc2948450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.460+0000 7f09e4670b80 1 -- 172.21.15.84:0/3638715600 shutdown_connections 2023-10-06T02:59:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.460+0000 7f09e4670b80 1 -- 172.21.15.84:0/3638715600 wait complete. 2023-10-06T02:59:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.461+0000 7f09e4670b80 1 -- start start 2023-10-06T02:59:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.461+0000 7f09e4670b80 1 Processor -- start 2023-10-06T02:59:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.461+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc29dc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.461+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2954a60 0x560dc29f0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.461+0000 7f09e4670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2972ea0 0x560dc294ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.461+0000 7f09e4670b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc296d710 con 0x560dc2953310 2023-10-06T02:59:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.461+0000 7f09e4670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dc296f430 con 0x560dc2972ea0 2023-10-06T02:59:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.461+0000 7f09e4670b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dc29f1920 con 0x560dc2954a60 2023-10-06T02:59:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09e4670b80 10 client.0 _ll_register_callbacks cb 0x560dc2915070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9114700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc29dc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9114700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc29dc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48656/0 (socket says 172.21.15.84:48656) 2023-10-06T02:59:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9114700 1 -- 172.21.15.84:0/5229356 learned_addr learned my addr 172.21.15.84:0/5229356 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d8913700 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2954a60 0x560dc29f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9915700 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2972ea0 0x560dc294ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9114700 1 -- 172.21.15.84:0/5229356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2954a60 msgr2=0x560dc29f0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9114700 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2954a60 0x560dc29f0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9114700 1 -- 172.21.15.84:0/5229356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2972ea0 msgr2=0x560dc294ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9114700 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2972ea0 0x560dc294ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9114700 1 -- 172.21.15.84:0/5229356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc001df0 con 0x560dc2953310 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d8913700 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2954a60 0x560dc29f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09d9114700 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc29dc870 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f09d0053460 tx=0x7f09d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c6f27d419aba0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09b37fe700 1 -- 172.21.15.84:0/5229356 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d005a1b0 con 0x560dc2953310 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09b37fe700 1 -- 172.21.15.84:0/5229356 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f09d0071070 con 0x560dc2953310 2023-10-06T02:59:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09e4670b80 1 -- 172.21.15.84:0/5229356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09c4019070 con 0x560dc2953310 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09b37fe700 1 -- 172.21.15.84:0/5229356 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09d005df00 con 0x560dc2953310 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09e4670b80 10 client.6825 fetch_fsmap learned FSMap version 58 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09e4670b80 1 -- 172.21.15.84:0/5229356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x560dc28574c0 con 0x560dc2953310 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09b37fe700 1 -- 172.21.15.84:0/5229356 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c4019070 con 0x560dc2953310 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.462+0000 7f09b37fe700 1 -- 172.21.15.84:0/5229356 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 58) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f09d006d150 con 0x560dc2953310 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.463+0000 7f09e4670b80 10 client.6825 fetch_fsmap finished waiting for FSMap version 58 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.463+0000 7f09e4670b80 10 client.6825 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.463+0000 7f09e4670b80 20 client.6825 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.463+0000 7f09e4670b80 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560dc29f07b0 0x560dc294f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.463+0000 7f09e4670b80 4 client.6825 mds_command: new command op to 6528 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.463+0000 7f09e4670b80 1 -- 172.21.15.84:0/5229356 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560dc2844e50 con 0x560dc29f07b0 2023-10-06T02:59:06.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.463+0000 7f09d8913700 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560dc29f07b0 0x560dc294f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.463+0000 7f09b37fe700 10 client.6825 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:06.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.463+0000 7f09d8913700 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560dc29f07b0 0x560dc294f110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f82857ef60acca6a server_cookie=55953cbc9b39625f in_seq=0 out_seq=0 2023-10-06T02:59:06.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09b37fe700 1 -- 172.21.15.84:0/5229356 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560dc2844e50 con 0x560dc29f07b0 2023-10-06T02:59:06.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09b37fe700 10 client.6825 handle_command_reply: tid=0 2023-10-06T02:59:06.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 client.6825 shutdown 2023-10-06T02:59:06.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 -- 172.21.15.84:0/5229356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 msgr2=0x560dc29dc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc29dc870 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f09d0053460 tx=0x7f09d0008040 comp rx=0 tx=0).stop 2023-10-06T02:59:06.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 -- 172.21.15.84:0/5229356 shutdown_connections 2023-10-06T02:59:06.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560dc29f07b0 0x560dc294f110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560dc2972ea0 0x560dc294ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09b37fe700 0 client.6825 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:06.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560dc2953310 0x560dc29dc870 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 --2- 172.21.15.84:0/5229356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560dc2954a60 0x560dc29f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 -- 172.21.15.84:0/5229356 >> 172.21.15.84:0/5229356 conn(0x560dc2952ed0 msgr2=0x560dc2973b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 -- 172.21.15.84:0/5229356 shutdown_connections 2023-10-06T02:59:06.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 1 -- 172.21.15.84:0/5229356 wait complete. 2023-10-06T02:59:06.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.484+0000 7f09e4670b80 20 client.6825 trim_cache size 0 max 16384 2023-10-06T02:59:06.488 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:59:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T02:59:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:59:06.489 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:59:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 -- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f09b8066f30 msgr2=0x7f09b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f09b8066f30 0x7f09b80693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f09d40c8c20 tx=0x7f09c4008040 comp rx=0 tx=0).stop 2023-10-06T02:59:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 -- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 msgr2=0x7f09d40c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 0x7f09d40c8460 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f09d000b0e0 tx=0x7f09d0016000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 -- 172.21.15.84:0/3943067017 shutdown_connections 2023-10-06T02:59:06.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f09b8066f30 0x7f09b80693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f09d40ceae0 0x7f09d40b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09d40b2660 0x7f09d40c8460 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 --2- 172.21.15.84:0/3943067017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09d40b2a30 0x7f09d4147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 -- 172.21.15.84:0/3943067017 >> 172.21.15.84:0/3943067017 conn(0x7f09d4099560 msgr2=0x7f09d40cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 -- 172.21.15.84:0/3943067017 shutdown_connections 2023-10-06T02:59:06.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.485+0000 7f09da116700 1 -- 172.21.15.84:0/3943067017 wait complete. 2023-10-06T02:59:06.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 flush journal 2023-10-06T02:59:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.612+0000 7f54e72e6700 1 Processor -- start 2023-10-06T02:59:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.612+0000 7f54e72e6700 1 -- start start 2023-10-06T02:59:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e72e6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f54e00b2a30 0x7f54e0164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e72e6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e00cc9b0 con 0x7f54e00b2660 2023-10-06T02:59:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e72e6700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e00cbda0 con 0x7f54e00cd400 2023-10-06T02:59:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e72e6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e00cc080 con 0x7f54e00b2a30 2023-10-06T02:59:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e62e4700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f54e00b2660 0x7f54e00cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48352/0 (socket says 172.21.15.84:48352) 2023-10-06T02:59:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e62e4700 1 -- 172.21.15.84:0/2474737963 learned_addr learned my addr 172.21.15.84:0/2474737963 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/2474737963 >> v2:172.21.15.131:3300/0 conn(0x7f54e00b2a30 0x7f54e0164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551954046 0 0) 0x7f54e00cc9b0 con 0x7f54e00b2660 2023-10-06T02:59:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54cc003570 con 0x7f54e00b2660 2023-10-06T02:59:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660277207 0 0) 0x7f54cc003570 con 0x7f54e00b2660 2023-10-06T02:59:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 >> v2:172.21.15.131:3300/0 conn(0x7f54e00b2a30 msgr2=0x7f54e0164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 --2- 172.21.15.84:0/2474737963 >> v2:172.21.15.131:3300/0 conn(0x7f54e00b2a30 0x7f54e0164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 >> v1:172.21.15.131:6789/0 conn(0x7f54e00cd400 legacy=0x7f54e00ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e00cc360 con 0x7f54e00b2660 2023-10-06T02:59:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f54dc0015f0 con 0x7f54e00b2660 2023-10-06T02:59:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 >> v1:172.21.15.84:6789/0 conn(0x7f54e00b2660 legacy=0x7f54e00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54cc004810 0x7f54cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.613+0000 7f54e52e2700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54cc0051c0 0x7f54cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00cc080 con 0x7f54cc003a60 2023-10-06T02:59:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc00c0d0 con 0x7f54cc0051c0 2023-10-06T02:59:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc00c290 con 0x7f54cc004810 2023-10-06T02:59:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e62e4700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e5ae3700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54cc004810 0x7f54cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54cc0051c0 0x7f54cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e62e4700 1 -- 172.21.15.84:0/2474737963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54cc004810 msgr2=0x7f54cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e62e4700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54cc004810 0x7f54cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e62e4700 1 -- 172.21.15.84:0/2474737963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54cc0051c0 msgr2=0x7f54cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e62e4700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54cc0051c0 0x7f54cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e62e4700 1 -- 172.21.15.84:0/2474737963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc003570 con 0x7f54cc003a60 2023-10-06T02:59:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54cc0051c0 0x7f54cc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e6ae5700 1 -- 172.21.15.84:0/2474737963 reap_dead start 2023-10-06T02:59:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e62e4700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54cc003e70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00c3c0 tx=0x7f54dc007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566fd892b82932c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00cc90 con 0x7f54cc003a60 2023-10-06T02:59:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc00ce10 con 0x7f54cc003a60 2023-10-06T02:59:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.614+0000 7f54e52e2700 1 -- 172.21.15.84:0/2474737963 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc007320 con 0x7f54cc003a60 2023-10-06T02:59:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.615+0000 7f54e72e6700 1 -- 172.21.15.84:0/2474737963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 msgr2=0x7f54cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.615+0000 7f54e72e6700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54cc003e70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00c3c0 tx=0x7f54dc007920 comp rx=0 tx=0).stop 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.615+0000 7f54e72e6700 1 -- 172.21.15.84:0/2474737963 shutdown_connections 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.615+0000 7f54e72e6700 1 --2- 172.21.15.84:0/2474737963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54cc003e70 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.615+0000 7f54e72e6700 1 -- 172.21.15.84:0/2474737963 >> 172.21.15.84:0/2474737963 conn(0x7f54e0099560 msgr2=0x7f54e006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.615+0000 7f54e72e6700 1 -- 172.21.15.84:0/2474737963 shutdown_connections 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.615+0000 7f54e72e6700 1 -- 172.21.15.84:0/2474737963 wait complete. 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.616+0000 7f54e72e6700 1 Processor -- start 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.616+0000 7f54e72e6700 1 -- start start 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e72e6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54e00b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e72e6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54e00c85b0 0x7f54e01552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e72e6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54e00c8a20 0x7f54e0152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e72e6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00c9aa0 con 0x7f54cc003a60 2023-10-06T02:59:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e72e6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00c8e90 con 0x7f54e00c8a20 2023-10-06T02:59:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e72e6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e00c9170 con 0x7f54e00c85b0 2023-10-06T02:59:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e62e4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54e00b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e62e4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54e00b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48664/0 (socket says 172.21.15.84:48664) 2023-10-06T02:59:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e62e4700 1 -- 172.21.15.84:0/1747260031 learned_addr learned my addr 172.21.15.84:0/1747260031 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e5ae3700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54e00c85b0 0x7f54e01552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54e00c8a20 0x7f54e0152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e62e4700 1 -- 172.21.15.84:0/1747260031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54e00c85b0 msgr2=0x7f54e01552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e62e4700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54e00c85b0 0x7f54e01552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e62e4700 1 -- 172.21.15.84:0/1747260031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54e00c8a20 msgr2=0x7f54e0152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e62e4700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54e00c8a20 0x7f54e0152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e62e4700 1 -- 172.21.15.84:0/1747260031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e00c9450 con 0x7f54cc003a60 2023-10-06T02:59:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e62e4700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54e00b4060 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00c9b0 tx=0x7f54dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54d67fc700 1 -- 172.21.15.84:0/1747260031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc022070 con 0x7f54cc003a60 2023-10-06T02:59:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54d67fc700 1 -- 172.21.15.84:0/1747260031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc007690 con 0x7f54cc003a60 2023-10-06T02:59:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e72e6700 1 -- 172.21.15.84:0/1747260031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e00c9730 con 0x7f54cc003a60 2023-10-06T02:59:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54d67fc700 1 -- 172.21.15.84:0/1747260031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc005c50 con 0x7f54cc003a60 2023-10-06T02:59:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.617+0000 7f54e72e6700 1 -- 172.21.15.84:0/1747260031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e0153400 con 0x7f54cc003a60 2023-10-06T02:59:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.619+0000 7f54d67fc700 1 -- 172.21.15.84:0/1747260031 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54dc01e430 con 0x7f54cc003a60 2023-10-06T02:59:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.619+0000 7f54d67fc700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f54c4066f30 0x7f54c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.619+0000 7f54d67fc700 1 -- 172.21.15.84:0/1747260031 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f54dc085280 con 0x7f54cc003a60 2023-10-06T02:59:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.619+0000 7f54e5ae3700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f54c4066f30 0x7f54c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.620+0000 7f54e5ae3700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f54c4066f30 0x7f54c40693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f54e009e1b0 tx=0x7f54d0007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.621+0000 7f54f1840b80 1 Processor -- start 2023-10-06T02:59:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.621+0000 7f54f1840b80 1 -- start start 2023-10-06T02:59:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7ebea0 0x55700b7c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7cc310 0x55700b7c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b7c7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54f1840b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700b721ac0 con 0x55700b7cc310 2023-10-06T02:59:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54f1840b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700b71f2c0 con 0x55700b7ebea0 2023-10-06T02:59:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54f1840b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55700b71b0b0 con 0x55700b7cda60 2023-10-06T02:59:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e5ae3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7cc310 0x55700b7c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e5ae3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7cc310 0x55700b7c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48666/0 (socket says 172.21.15.84:48666) 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e5ae3700 1 -- 172.21.15.84:0/3926620831 learned_addr learned my addr 172.21.15.84:0/3926620831 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/3926620831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b7c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e62e4700 1 --2- 172.21.15.84:0/3926620831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7ebea0 0x55700b7c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e5ae3700 1 -- 172.21.15.84:0/3926620831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 msgr2=0x55700b7c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e5ae3700 1 --2- 172.21.15.84:0/3926620831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b7c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e5ae3700 1 -- 172.21.15.84:0/3926620831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7ebea0 msgr2=0x55700b7c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e5ae3700 1 --2- 172.21.15.84:0/3926620831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7ebea0 0x55700b7c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.622+0000 7f54e5ae3700 1 -- 172.21.15.84:0/3926620831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55700b5b52c0 con 0x55700b7cc310 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54e5ae3700 1 --2- 172.21.15.84:0/3926620831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7cc310 0x55700b7c7250 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f54d0012a70 tx=0x7f54d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ad07b202f708a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54c37fe700 1 -- 172.21.15.84:0/3926620831 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d001a040 con 0x55700b7cc310 2023-10-06T02:59:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54c37fe700 1 -- 172.21.15.84:0/3926620831 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d00158d0 con 0x55700b7cc310 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54c37fe700 1 -- 172.21.15.84:0/3926620831 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0015c50 con 0x55700b7cc310 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54f1840b80 1 -- 172.21.15.84:0/3926620831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7cc310 msgr2=0x55700b7c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54f1840b80 1 --2- 172.21.15.84:0/3926620831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7cc310 0x55700b7c7250 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f54d0012a70 tx=0x7f54d0017000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54f1840b80 1 -- 172.21.15.84:0/3926620831 shutdown_connections 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54f1840b80 1 --2- 172.21.15.84:0/3926620831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7ebea0 0x55700b7c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54f1840b80 1 --2- 172.21.15.84:0/3926620831 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b7c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54f1840b80 1 --2- 172.21.15.84:0/3926620831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7cc310 0x55700b7c7250 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54f1840b80 1 -- 172.21.15.84:0/3926620831 >> 172.21.15.84:0/3926620831 conn(0x55700b7cbed0 msgr2=0x55700b7cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54f1840b80 1 -- 172.21.15.84:0/3926620831 shutdown_connections 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.623+0000 7f54f1840b80 1 -- 172.21.15.84:0/3926620831 wait complete. 2023-10-06T02:59:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.624+0000 7f54f1840b80 1 -- start start 2023-10-06T02:59:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.624+0000 7f54f1840b80 1 Processor -- start 2023-10-06T02:59:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 0x55700b7ddb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b813300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54f1840b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700b6c68e0 con 0x55700b7ebea0 2023-10-06T02:59:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54f1840b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700b6e1ef0 con 0x55700b7cc310 2023-10-06T02:59:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54f1840b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55700b59de80 con 0x55700b7cda60 2023-10-06T02:59:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54f1840b80 10 client.0 _ll_register_callbacks cb 0x55700b78e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e6ae5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e6ae5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48674/0 (socket says 172.21.15.84:48674) 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e6ae5700 1 -- 172.21.15.84:0/264275416 learned_addr learned my addr 172.21.15.84:0/264275416 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e5ae3700 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b813300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e62e4700 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 0x55700b7ddb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e6ae5700 1 -- 172.21.15.84:0/264275416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 msgr2=0x55700b813300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b813300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e6ae5700 1 -- 172.21.15.84:0/264275416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 msgr2=0x55700b7ddb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 0x55700b7ddb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e6ae5700 1 -- 172.21.15.84:0/264275416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e00cbda0 con 0x55700b7ebea0 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7c6f30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f54e00b2e50 tx=0x7f54d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4395baba27d673b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.625+0000 7f54c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54c0ff9700 1 -- 172.21.15.84:0/264275416 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d800e030 con 0x55700b7ebea0 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54c0ff9700 1 -- 172.21.15.84:0/264275416 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f54d8014a20 con 0x55700b7ebea0 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54f1840b80 1 -- 172.21.15.84:0/264275416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55700b7bf990 con 0x55700b7ebea0 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54c0ff9700 1 -- 172.21.15.84:0/264275416 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54d8014df0 con 0x55700b7ebea0 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54f1840b80 10 client.6837 fetch_fsmap learned FSMap version 58 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54f1840b80 1 -- 172.21.15.84:0/264275416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55700b558030 con 0x55700b7ebea0 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54c0ff9700 1 -- 172.21.15.84:0/264275416 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55700b7bf990 con 0x55700b7ebea0 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54c0ff9700 1 -- 172.21.15.84:0/264275416 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 58) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f54d8020470 con 0x55700b7ebea0 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54f1840b80 10 client.6837 fetch_fsmap finished waiting for FSMap version 58 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54f1840b80 10 client.6837 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2023-10-06T02:59:06.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54f1840b80 20 client.6837 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54f1840b80 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55700b7ecb40 0x55700b815030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54f1840b80 4 client.6837 mds_command: new command op to 6525 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54f1840b80 1 -- 172.21.15.84:0/264275416 --> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55700b79c8c0 con 0x55700b7ecb40 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54e62e4700 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55700b7ecb40 0x55700b815030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54c0ff9700 10 client.6837 ms_handle_connect on v2:172.21.15.84:6834/1455824046 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.626+0000 7f54e62e4700 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55700b7ecb40 0x55700b815030 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32ddac28232cf309 server_cookie=e78add6efd778eba in_seq=0 out_seq=0 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54c0ff9700 1 -- 172.21.15.84:0/264275416 <== mds.1 v2:172.21.15.84:6834/1455824046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55700b79c8c0 con 0x55700b7ecb40 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54c0ff9700 10 client.6837 handle_command_reply: tid=0 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 client.6837 shutdown 2023-10-06T02:59:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 -- 172.21.15.84:0/264275416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 msgr2=0x55700b7c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7c6f30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f54e00b2e50 tx=0x7f54d800b040 comp rx=0 tx=0).stop 2023-10-06T02:59:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 -- 172.21.15.84:0/264275416 shutdown_connections 2023-10-06T02:59:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55700b7ecb40 0x55700b815030 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 0x55700b7ddb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7c6f30 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 --2- 172.21.15.84:0/264275416 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b813300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54c0ff9700 0 client.6837 ms_handle_reset on v2:172.21.15.84:6834/1455824046 2023-10-06T02:59:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 -- 172.21.15.84:0/264275416 >> 172.21.15.84:0/264275416 conn(0x55700b7cbed0 msgr2=0x55700b7cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 -- 172.21.15.84:0/264275416 shutdown_connections 2023-10-06T02:59:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 1 -- 172.21.15.84:0/264275416 wait complete. 2023-10-06T02:59:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.627+0000 7f54f1840b80 20 client.6837 trim_cache size 0 max 16384 2023-10-06T02:59:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.641+0000 7f54f1840b80 1 Processor -- start 2023-10-06T02:59:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.641+0000 7f54f1840b80 1 -- start start 2023-10-06T02:59:06.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 0x55700b7c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b7c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7dc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54f1840b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700b7ebb90 con 0x55700b7ebea0 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54f1840b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700b7c7a70 con 0x55700b7cc310 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54f1840b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55700b7c1450 con 0x55700b7cda60 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e6ae5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7dc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e6ae5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7dc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48686/0 (socket says 172.21.15.84:48686) 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e6ae5700 1 -- 172.21.15.84:0/2789266059 learned_addr learned my addr 172.21.15.84:0/2789266059 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e5ae3700 1 --2- 172.21.15.84:0/2789266059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b7c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e62e4700 1 --2- 172.21.15.84:0/2789266059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 0x55700b7c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e6ae5700 1 -- 172.21.15.84:0/2789266059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 msgr2=0x55700b7c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/2789266059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b7c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e6ae5700 1 -- 172.21.15.84:0/2789266059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 msgr2=0x55700b7c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/2789266059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 0x55700b7c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e6ae5700 1 -- 172.21.15.84:0/2789266059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55700b6e97d0 con 0x55700b7ebea0 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/2789266059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7dc0b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f54d801e3f0 tx=0x7f54d801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd325a3c14be2c50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54c3fff700 1 -- 172.21.15.84:0/2789266059 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d800e040 con 0x55700b7ebea0 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54c3fff700 1 -- 172.21.15.84:0/2789266059 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d800f040 con 0x55700b7ebea0 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.642+0000 7f54c3fff700 1 -- 172.21.15.84:0/2789266059 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8014a20 con 0x55700b7ebea0 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 -- 172.21.15.84:0/2789266059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 msgr2=0x55700b7dc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 --2- 172.21.15.84:0/2789266059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7dc0b0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f54d801e3f0 tx=0x7f54d801d000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 -- 172.21.15.84:0/2789266059 shutdown_connections 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 --2- 172.21.15.84:0/2789266059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cc310 0x55700b7c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 --2- 172.21.15.84:0/2789266059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b7dc0b0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 --2- 172.21.15.84:0/2789266059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cda60 0x55700b7c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 -- 172.21.15.84:0/2789266059 >> 172.21.15.84:0/2789266059 conn(0x55700b7cbed0 msgr2=0x55700b7fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 -- 172.21.15.84:0/2789266059 shutdown_connections 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 -- 172.21.15.84:0/2789266059 wait complete. 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.643+0000 7f54f1840b80 1 -- start start 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.644+0000 7f54f1840b80 1 Processor -- start 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.644+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cc310 0x55700b830720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.644+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cda60 0x55700b82e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.644+0000 7f54f1840b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b82ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.644+0000 7f54f1840b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700b833850 con 0x55700b7ebea0 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.644+0000 7f54f1840b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700b830fb0 con 0x55700b7cda60 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.644+0000 7f54f1840b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55700b7fadd0 con 0x55700b7cc310 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.644+0000 7f54f1840b80 10 client.0 _ll_register_callbacks cb 0x55700b78e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e6ae5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b82ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e62e4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cc310 0x55700b830720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e6ae5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b82ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48700/0 (socket says 172.21.15.84:48700) 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e6ae5700 1 -- 172.21.15.84:0/4003523121 learned_addr learned my addr 172.21.15.84:0/4003523121 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e5ae3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cda60 0x55700b82e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e6ae5700 1 -- 172.21.15.84:0/4003523121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cc310 msgr2=0x55700b830720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cc310 0x55700b830720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e6ae5700 1 -- 172.21.15.84:0/4003523121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cda60 msgr2=0x55700b82e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cda60 0x55700b82e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e6ae5700 1 -- 172.21.15.84:0/4003523121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55700b558030 con 0x55700b7ebea0 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54e6ae5700 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b82ed40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f54d8016430 tx=0x7f54d802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a5dd966c597dab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54c0ff9700 1 -- 172.21.15.84:0/4003523121 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8020470 con 0x55700b7ebea0 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54f1840b80 1 -- 172.21.15.84:0/4003523121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54d00158d0 con 0x55700b7ebea0 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54c0ff9700 1 -- 172.21.15.84:0/4003523121 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f54d8020bc0 con 0x55700b7ebea0 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54c0ff9700 1 -- 172.21.15.84:0/4003523121 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54d80205d0 con 0x55700b7ebea0 2023-10-06T02:59:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54f1840b80 10 client.6843 fetch_fsmap learned FSMap version 58 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54f1840b80 1 -- 172.21.15.84:0/4003523121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55700b6d04c0 con 0x55700b7ebea0 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.645+0000 7f54c0ff9700 1 -- 172.21.15.84:0/4003523121 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d00158d0 con 0x55700b7ebea0 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54c0ff9700 1 -- 172.21.15.84:0/4003523121 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 58) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f54d8036020 con 0x55700b7ebea0 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54f1840b80 10 client.6843 fetch_fsmap finished waiting for FSMap version 58 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54f1840b80 10 client.6843 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54f1840b80 20 client.6843 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54f1840b80 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55700b86e240 0x55700b86e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54f1840b80 4 client.6843 mds_command: new command op to 6525 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54f1840b80 1 -- 172.21.15.84:0/4003523121 --> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55700b6bde50 con 0x55700b86e240 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54e62e4700 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55700b86e240 0x55700b86e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54c0ff9700 10 client.6843 ms_handle_connect on v2:172.21.15.84:6834/1455824046 2023-10-06T02:59:06.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.646+0000 7f54e62e4700 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55700b86e240 0x55700b86e610 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d67e976548142059 server_cookie=a97af166e71437cf in_seq=0 out_seq=0 2023-10-06T02:59:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54c0ff9700 1 -- 172.21.15.84:0/4003523121 <== mds.1 v2:172.21.15.84:6834/1455824046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55700b6bde50 con 0x55700b86e240 2023-10-06T02:59:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54c0ff9700 10 client.6843 handle_command_reply: tid=0 2023-10-06T02:59:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 client.6843 shutdown 2023-10-06T02:59:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 -- 172.21.15.84:0/4003523121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 msgr2=0x55700b82ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b82ed40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f54d8016430 tx=0x7f54d802e000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 -- 172.21.15.84:0/4003523121 shutdown_connections 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x55700b86e240 0x55700b86e610 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55700b7ebea0 0x55700b82ed40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55700b7cc310 0x55700b830720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54c0ff9700 0 client.6843 ms_handle_reset on v2:172.21.15.84:6834/1455824046 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 --2- 172.21.15.84:0/4003523121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55700b7cda60 0x55700b82e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 -- 172.21.15.84:0/4003523121 >> 172.21.15.84:0/4003523121 conn(0x55700b7cbed0 msgr2=0x55700b7c7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 -- 172.21.15.84:0/4003523121 shutdown_connections 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 1 -- 172.21.15.84:0/4003523121 wait complete. 2023-10-06T02:59:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.657+0000 7f54f1840b80 20 client.6843 trim_cache size 0 max 16384 2023-10-06T02:59:06.661 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:59:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T02:59:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:59:06.661 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:59:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 -- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f54c4066f30 msgr2=0x7f54c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f54c4066f30 0x7f54c40693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f54e009e1b0 tx=0x7f54d0007d30 comp rx=0 tx=0).stop 2023-10-06T02:59:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 -- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 msgr2=0x7f54e00b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54e00b4060 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00c9b0 tx=0x7f54dc015000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 -- 172.21.15.84:0/1747260031 shutdown_connections 2023-10-06T02:59:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f54c4066f30 0x7f54c40693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54e00c8a20 0x7f54e0152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54cc003a60 0x7f54e00b4060 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 --2- 172.21.15.84:0/1747260031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54e00c85b0 0x7f54e01552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 -- 172.21.15.84:0/1747260031 >> 172.21.15.84:0/1747260031 conn(0x7f54e0099560 msgr2=0x7f54e0069700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 -- 172.21.15.84:0/1747260031 shutdown_connections 2023-10-06T02:59:06.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.658+0000 7f54e72e6700 1 -- 172.21.15.84:0/1747260031 wait complete. 2023-10-06T02:59:06.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:06.666 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:06.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 flush journal 2023-10-06T02:59:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.828+0000 7f848505a700 1 Processor -- start 2023-10-06T02:59:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.828+0000 7f848505a700 1 -- start start 2023-10-06T02:59:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f848505a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f848006d6b0 0x7f848015db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f848505a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f848006ce50 0x7f8480159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f848505a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848015ab90 con 0x7f848006da80 2023-10-06T02:59:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f848505a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848015d690 con 0x7f848006d6b0 2023-10-06T02:59:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f848505a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848015a5d0 con 0x7f848006ce50 2023-10-06T02:59:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f847ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f848006d6b0 0x7f848015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f847ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f848006d6b0 0x7f848015db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48702/0 (socket says 172.21.15.84:48702) 2023-10-06T02:59:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f847ed9d700 1 -- 172.21.15.84:0/1271133162 learned_addr learned my addr 172.21.15.84:0/1271133162 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f847659c700 1 --2- 172.21.15.84:0/1271133162 >> v2:172.21.15.131:3300/0 conn(0x7f848006ce50 0x7f8480159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f847ed9d700 1 -- 172.21.15.84:0/1271133162 >> v2:172.21.15.131:3300/0 conn(0x7f848006ce50 msgr2=0x7f8480159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f847ed9d700 1 --2- 172.21.15.84:0/1271133162 >> v2:172.21.15.131:3300/0 conn(0x7f848006ce50 0x7f8480159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f847ed9d700 1 -- 172.21.15.84:0/1271133162 >> v1:172.21.15.131:6789/0 conn(0x7f848006da80 legacy=0x7f84800b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f847ed9d700 1 -- 172.21.15.84:0/1271133162 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848015a8b0 con 0x7f848006d6b0 2023-10-06T02:59:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.829+0000 7f847ed9d700 1 --2- 172.21.15.84:0/1271133162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 0x7f848015db20 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8470009990 tx=0x7f8470009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd42eed095c9c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f847e59c700 1 -- 172.21.15.84:0/1271133162 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470005c10 con 0x7f848006d6b0 2023-10-06T02:59:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f847e59c700 1 -- 172.21.15.84:0/1271133162 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8470005d70 con 0x7f848006d6b0 2023-10-06T02:59:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f847e59c700 1 -- 172.21.15.84:0/1271133162 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847000b800 con 0x7f848006d6b0 2023-10-06T02:59:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f848505a700 1 -- 172.21.15.84:0/1271133162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 msgr2=0x7f848015db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f848505a700 1 --2- 172.21.15.84:0/1271133162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 0x7f848015db20 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8470009990 tx=0x7f8470009220 comp rx=0 tx=0).stop 2023-10-06T02:59:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f848505a700 1 -- 172.21.15.84:0/1271133162 shutdown_connections 2023-10-06T02:59:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f848505a700 1 --2- 172.21.15.84:0/1271133162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 0x7f848015db20 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f848505a700 1 --2- 172.21.15.84:0/1271133162 >> v2:172.21.15.131:3300/0 conn(0x7f848006ce50 0x7f8480159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f848505a700 1 -- 172.21.15.84:0/1271133162 >> 172.21.15.84:0/1271133162 conn(0x7f848006b640 msgr2=0x7f848006ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f848505a700 1 -- 172.21.15.84:0/1271133162 shutdown_connections 2023-10-06T02:59:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.830+0000 7f848505a700 1 -- 172.21.15.84:0/1271133162 wait complete. 2023-10-06T02:59:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.831+0000 7f848505a700 1 Processor -- start 2023-10-06T02:59:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.831+0000 7f848505a700 1 -- start start 2023-10-06T02:59:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f848505a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 0x7f8480169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f848505a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f848006da80 0x7f8480156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f848505a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8480156330 0x7f84800b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f848505a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848016a140 con 0x7f848006d6b0 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f848505a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8480157550 con 0x7f848006da80 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f848505a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8480157830 con 0x7f8480156330 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 0x7f8480169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 0x7f8480169c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48710/0 (socket says 172.21.15.84:48710) 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847ed9d700 1 -- 172.21.15.84:0/1439235056 learned_addr learned my addr 172.21.15.84:0/1439235056 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847f59e700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8480156330 0x7f84800b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847659c700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f848006da80 0x7f8480156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847ed9d700 1 -- 172.21.15.84:0/1439235056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8480156330 msgr2=0x7f84800b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847ed9d700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8480156330 0x7f84800b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847ed9d700 1 -- 172.21.15.84:0/1439235056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f848006da80 msgr2=0x7f8480156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847ed9d700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f848006da80 0x7f8480156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847ed9d700 1 -- 172.21.15.84:0/1439235056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470009480 con 0x7f848006d6b0 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.832+0000 7f847659c700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f848006da80 0x7f8480156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.833+0000 7f847ed9d700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 0x7f8480169c00 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8470003080 tx=0x7f8470015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.833+0000 7f84777fe700 1 -- 172.21.15.84:0/1439235056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470011cc0 con 0x7f848006d6b0 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.833+0000 7f84777fe700 1 -- 172.21.15.84:0/1439235056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8470011e40 con 0x7f848006d6b0 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.833+0000 7f848505a700 1 -- 172.21.15.84:0/1439235056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8480157b10 con 0x7f848006d6b0 2023-10-06T02:59:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.833+0000 7f84777fe700 1 -- 172.21.15.84:0/1439235056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847001d680 con 0x7f848006d6b0 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.833+0000 7f848505a700 1 -- 172.21.15.84:0/1439235056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8480157190 con 0x7f848006d6b0 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.834+0000 7f84777fe700 1 -- 172.21.15.84:0/1439235056 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f847001dab0 con 0x7f848006d6b0 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.835+0000 7f84777fe700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8460066f30 0x7f84600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.835+0000 7f84777fe700 1 -- 172.21.15.84:0/1439235056 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f84700864c0 con 0x7f848006d6b0 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.835+0000 7f847659c700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8460066f30 0x7f84600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.835+0000 7f847659c700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8460066f30 0x7f84600693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8468006fd0 tx=0x7f8468008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.837+0000 7f848e352b80 1 Processor -- start 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.837+0000 7f848e352b80 1 -- start start 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.837+0000 7f848e352b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c53dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.837+0000 7f848e352b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 0x564a8c58d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.837+0000 7f848e352b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c58e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.837+0000 7f848e352b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c494ac0 con 0x564a8c53d890 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.837+0000 7f848e352b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c4922c0 con 0x564a8c53ed10 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.837+0000 7f848e352b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a8c48e0b0 con 0x564a8c58dc50 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c53dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c53dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48724/0 (socket says 172.21.15.84:48724) 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847ed9d700 1 -- 172.21.15.84:0/2940342248 learned_addr learned my addr 172.21.15.84:0/2940342248 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847f59e700 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c58e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847659c700 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 0x564a8c58d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847ed9d700 1 -- 172.21.15.84:0/2940342248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 msgr2=0x564a8c58e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847ed9d700 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c58e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847ed9d700 1 -- 172.21.15.84:0/2940342248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 msgr2=0x564a8c58d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847ed9d700 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 0x564a8c58d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847ed9d700 1 -- 172.21.15.84:0/2940342248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a8c3282c0 con 0x564a8c53d890 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847659c700 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 0x564a8c58d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f847ed9d700 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c53dc60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8470006be0 tx=0x7f8470084660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1836d0c60cae05b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f845ffff700 1 -- 172.21.15.84:0/2940342248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470056a70 con 0x564a8c53d890 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f845ffff700 1 -- 172.21.15.84:0/2940342248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8470057810 con 0x564a8c53d890 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.838+0000 7f845ffff700 1 -- 172.21.15.84:0/2940342248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470057110 con 0x564a8c53d890 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 -- 172.21.15.84:0/2940342248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 msgr2=0x564a8c53dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c53dc60 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8470006be0 tx=0x7f8470084660 comp rx=0 tx=0).stop 2023-10-06T02:59:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 -- 172.21.15.84:0/2940342248 shutdown_connections 2023-10-06T02:59:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c58e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c53dc60 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 --2- 172.21.15.84:0/2940342248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 0x564a8c58d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 -- 172.21.15.84:0/2940342248 >> 172.21.15.84:0/2940342248 conn(0x564a8c53f1b0 msgr2=0x564a8c53f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 -- 172.21.15.84:0/2940342248 shutdown_connections 2023-10-06T02:59:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 -- 172.21.15.84:0/2940342248 wait complete. 2023-10-06T02:59:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.839+0000 7f848e352b80 1 -- start start 2023-10-06T02:59:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.840+0000 7f848e352b80 1 Processor -- start 2023-10-06T02:59:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.840+0000 7f848e352b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c53d890 0x564a8c567df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.840+0000 7f848e352b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c588530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.840+0000 7f848e352b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c58dc50 0x564a8c588a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.840+0000 7f848e352b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c4398e0 con 0x564a8c53ed10 2023-10-06T02:59:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.840+0000 7f848e352b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c454ef0 con 0x564a8c58dc50 2023-10-06T02:59:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f848e352b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a8c310e80 con 0x564a8c53d890 2023-10-06T02:59:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f848e352b80 10 client.0 _ll_register_callbacks cb 0x564a8c500ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c588530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c588530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48738/0 (socket says 172.21.15.84:48738) 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847659c700 1 -- 172.21.15.84:0/852319791 learned_addr learned my addr 172.21.15.84:0/852319791 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847ed9d700 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c53d890 0x564a8c567df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847f59e700 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c58dc50 0x564a8c588a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847659c700 1 -- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c53d890 msgr2=0x564a8c567df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847659c700 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c53d890 0x564a8c567df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847659c700 1 -- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c58dc50 msgr2=0x564a8c588a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847659c700 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c58dc50 0x564a8c588a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847659c700 1 -- 172.21.15.84:0/852319791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8480157190 con 0x564a8c53ed10 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f847659c700 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c588530 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f84680127f0 tx=0x7f8468016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a712d198ecb72a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f845d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f845d7fa700 1 -- 172.21.15.84:0/852319791 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800b050 con 0x564a8c53ed10 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f845d7fa700 1 -- 172.21.15.84:0/852319791 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f846801f630 con 0x564a8c53ed10 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f848e352b80 1 -- 172.21.15.84:0/852319791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a8c532990 con 0x564a8c53ed10 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f845d7fa700 1 -- 172.21.15.84:0/852319791 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f846801fa00 con 0x564a8c53ed10 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f848e352b80 10 client.6855 fetch_fsmap learned FSMap version 58 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f848e352b80 1 -- 172.21.15.84:0/852319791 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x564a8c2cb030 con 0x564a8c53ed10 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.841+0000 7f845d7fa700 1 -- 172.21.15.84:0/852319791 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564a8c532990 con 0x564a8c53ed10 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f845d7fa700 1 -- 172.21.15.84:0/852319791 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 58) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f846801fb60 con 0x564a8c53ed10 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f848e352b80 10 client.6855 fetch_fsmap finished waiting for FSMap version 58 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f848e352b80 10 client.6855 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.d 2023-10-06T02:59:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f848e352b80 20 client.6855 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f848e352b80 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x564a8c564590 0x564a8c5863a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f848e352b80 4 client.6855 mds_command: new command op to 5567 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f848e352b80 1 -- 172.21.15.84:0/852319791 --> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a8c50f8c0 con 0x564a8c564590 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f847ed9d700 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x564a8c564590 0x564a8c5863a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f845d7fa700 10 client.6855 ms_handle_connect on v2:172.21.15.131:6833/4032170839 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.842+0000 7f847ed9d700 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x564a8c564590 0x564a8c5863a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=74bac7aa522bb6c4 server_cookie=2504282d53c34d46 in_seq=0 out_seq=0 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f845d7fa700 1 -- 172.21.15.84:0/852319791 <== mds.2 v2:172.21.15.131:6833/4032170839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564a8c50f8c0 con 0x564a8c564590 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f845d7fa700 10 client.6855 handle_command_reply: tid=0 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 client.6855 shutdown 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 -- 172.21.15.84:0/852319791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 msgr2=0x564a8c588530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c588530 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f84680127f0 tx=0x7f8468016040 comp rx=0 tx=0).stop 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 -- 172.21.15.84:0/852319791 shutdown_connections 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x564a8c564590 0x564a8c5863a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c58dc50 0x564a8c588a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c53d890 0x564a8c567df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 --2- 172.21.15.84:0/852319791 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c588530 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f845d7fa700 0 client.6855 ms_handle_reset on v2:172.21.15.131:6833/4032170839 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 -- 172.21.15.84:0/852319791 >> 172.21.15.84:0/852319791 conn(0x564a8c53f1b0 msgr2=0x564a8c540cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 -- 172.21.15.84:0/852319791 shutdown_connections 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 1 -- 172.21.15.84:0/852319791 wait complete. 2023-10-06T02:59:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.843+0000 7f848e352b80 20 client.6855 trim_cache size 0 max 16384 2023-10-06T02:59:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.857+0000 7f848e352b80 1 Processor -- start 2023-10-06T02:59:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.857+0000 7f848e352b80 1 -- start start 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.857+0000 7f848e352b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53d890 0x564a8c58d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f848e352b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c540cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f848e352b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c5883f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f848e352b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c569570 con 0x564a8c53ed10 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f848e352b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c5829b0 con 0x564a8c53d890 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f848e352b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a8c51d330 con 0x564a8c58dc50 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c540cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c540cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48748/0 (socket says 172.21.15.84:48748) 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847659c700 1 -- 172.21.15.84:0/1055081226 learned_addr learned my addr 172.21.15.84:0/1055081226 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847f59e700 1 --2- 172.21.15.84:0/1055081226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c5883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847659c700 1 -- 172.21.15.84:0/1055081226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 msgr2=0x564a8c5883f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847659c700 1 --2- 172.21.15.84:0/1055081226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c5883f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847659c700 1 -- 172.21.15.84:0/1055081226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53d890 msgr2=0x564a8c58d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847ed9d700 1 --2- 172.21.15.84:0/1055081226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53d890 0x564a8c58d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847659c700 1 --2- 172.21.15.84:0/1055081226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53d890 0x564a8c58d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847659c700 1 -- 172.21.15.84:0/1055081226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a8c45c7d0 con 0x564a8c53ed10 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f847659c700 1 --2- 172.21.15.84:0/1055081226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c540cf0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8468008280 tx=0x7f846801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5398ca6559fa94e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f8474d99700 1 -- 172.21.15.84:0/1055081226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800b040 con 0x564a8c53ed10 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f8474d99700 1 -- 172.21.15.84:0/1055081226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800c040 con 0x564a8c53ed10 2023-10-06T02:59:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.858+0000 7f8474d99700 1 -- 172.21.15.84:0/1055081226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468000c30 con 0x564a8c53ed10 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 -- 172.21.15.84:0/1055081226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 msgr2=0x564a8c540cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 --2- 172.21.15.84:0/1055081226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c540cf0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8468008280 tx=0x7f846801f000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 -- 172.21.15.84:0/1055081226 shutdown_connections 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 --2- 172.21.15.84:0/1055081226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53d890 0x564a8c58d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 --2- 172.21.15.84:0/1055081226 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c5883f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 --2- 172.21.15.84:0/1055081226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53ed10 0x564a8c540cf0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 -- 172.21.15.84:0/1055081226 >> 172.21.15.84:0/1055081226 conn(0x564a8c53f1b0 msgr2=0x564a8c5876e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 -- 172.21.15.84:0/1055081226 shutdown_connections 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 -- 172.21.15.84:0/1055081226 wait complete. 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 -- start start 2023-10-06T02:59:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.859+0000 7f848e352b80 1 Processor -- start 2023-10-06T02:59:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f848e352b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c5883f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f848e352b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 0x564a8c588930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f848e352b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c586680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f848e352b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c580780 con 0x564a8c53d890 2023-10-06T02:59:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f848e352b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c5e99e0 con 0x564a8c53ed10 2023-10-06T02:59:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f848e352b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a8c5ea840 con 0x564a8c58dc50 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f848e352b80 10 client.0 _ll_register_callbacks cb 0x564a8c500ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f847ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c5883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f847ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c5883f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48752/0 (socket says 172.21.15.84:48752) 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f847ed9d700 1 -- 172.21.15.84:0/4204891852 learned_addr learned my addr 172.21.15.84:0/4204891852 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f847f59e700 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c586680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.860+0000 7f847659c700 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 0x564a8c588930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f847ed9d700 1 -- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 msgr2=0x564a8c586680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f847ed9d700 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c586680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f847ed9d700 1 -- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 msgr2=0x564a8c588930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f847ed9d700 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 0x564a8c588930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f847ed9d700 1 -- 172.21.15.84:0/4204891852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a8c2cb030 con 0x564a8c53d890 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f847ed9d700 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c5883f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f84700847e0 tx=0x7f847006b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73e73562d1607c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f845d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f845d7fa700 1 -- 172.21.15.84:0/4204891852 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470056a70 con 0x564a8c53d890 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f845d7fa700 1 -- 172.21.15.84:0/4204891852 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f847007ee40 con 0x564a8c53d890 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f848e352b80 1 -- 172.21.15.84:0/4204891852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8470057810 con 0x564a8c53d890 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f845d7fa700 1 -- 172.21.15.84:0/4204891852 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f847005a360 con 0x564a8c53d890 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f848e352b80 10 client.6861 fetch_fsmap learned FSMap version 58 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f848e352b80 1 -- 172.21.15.84:0/4204891852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x564a8c4434c0 con 0x564a8c53d890 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f845d7fa700 1 -- 172.21.15.84:0/4204891852 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8470057810 con 0x564a8c53d890 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f845d7fa700 1 -- 172.21.15.84:0/4204891852 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 58) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f8470057370 con 0x564a8c53d890 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f848e352b80 10 client.6861 fetch_fsmap finished waiting for FSMap version 58 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f848e352b80 10 client.6861 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.d 2023-10-06T02:59:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f848e352b80 20 client.6861 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f848e352b80 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x564a8c5cf9a0 0x564a8c586bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f848e352b80 4 client.6861 mds_command: new command op to 5567 tid=0[{"prefix": "flush journal"}] 2023-10-06T02:59:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f848e352b80 1 -- 172.21.15.84:0/4204891852 --> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a8c430e50 con 0x564a8c5cf9a0 2023-10-06T02:59:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.861+0000 7f847659c700 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x564a8c5cf9a0 0x564a8c586bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.862+0000 7f845d7fa700 10 client.6861 ms_handle_connect on v2:172.21.15.131:6833/4032170839 2023-10-06T02:59:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.862+0000 7f847659c700 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x564a8c5cf9a0 0x564a8c586bc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=287a16fcad0e874e server_cookie=5f330e52a52e14 in_seq=0 out_seq=0 2023-10-06T02:59:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f845d7fa700 1 -- 172.21.15.84:0/4204891852 <== mds.2 v2:172.21.15.131:6833/4032170839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a8c430e50 con 0x564a8c5cf9a0 2023-10-06T02:59:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f845d7fa700 10 client.6861 handle_command_reply: tid=0 2023-10-06T02:59:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 client.6861 shutdown 2023-10-06T02:59:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 -- 172.21.15.84:0/4204891852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 msgr2=0x564a8c5883f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c5883f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f84700847e0 tx=0x7f847006b000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 -- 172.21.15.84:0/4204891852 shutdown_connections 2023-10-06T02:59:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x564a8c5cf9a0 0x564a8c586bc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a8c58dc50 0x564a8c586680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f845d7fa700 0 client.6861 ms_handle_reset on v2:172.21.15.131:6833/4032170839 2023-10-06T02:59:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a8c53d890 0x564a8c5883f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 --2- 172.21.15.84:0/4204891852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a8c53ed10 0x564a8c588930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 -- 172.21.15.84:0/4204891852 >> 172.21.15.84:0/4204891852 conn(0x564a8c53f1b0 msgr2=0x564a8c5674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 -- 172.21.15.84:0/4204891852 shutdown_connections 2023-10-06T02:59:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 1 -- 172.21.15.84:0/4204891852 wait complete. 2023-10-06T02:59:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.873+0000 7f848e352b80 20 client.6861 trim_cache size 0 max 16384 2023-10-06T02:59:06.876 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:59:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T02:59:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T02:59:06.877 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:59:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 -- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8460066f30 msgr2=0x7f84600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8460066f30 0x7f84600693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8468006fd0 tx=0x7f8468008040 comp rx=0 tx=0).stop 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 -- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 msgr2=0x7f8480169c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 0x7f8480169c00 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8470003080 tx=0x7f8470015000 comp rx=0 tx=0).stop 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 -- 172.21.15.84:0/1439235056 shutdown_connections 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8460066f30 0x7f84600693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8480156330 0x7f84800b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f848006d6b0 0x7f8480169c00 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 --2- 172.21.15.84:0/1439235056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f848006da80 0x7f8480156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 -- 172.21.15.84:0/1439235056 >> 172.21.15.84:0/1439235056 conn(0x7f848006b640 msgr2=0x7f84800adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 -- 172.21.15.84:0/1439235056 shutdown_connections 2023-10-06T02:59:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:06.874+0000 7f848505a700 1 -- 172.21.15.84:0/1439235056 wait complete. 2023-10-06T02:59:06.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:59:06.887 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-10-06T02:59:06.907 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/ 2023-10-06T02:59:06.907 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4 2023-10-06T02:59:06.907 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5 2023-10-06T02:59:06.908 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6 2023-10-06T02:59:06.908 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7 2023-10-06T02:59:06.908 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-10-06T02:59:06.908 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:59:06.908 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:59:06.908 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:59:06.908 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:59:06.908 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-10-06T02:59:06.908 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:59:07.011 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627778 2023-10-06T02:59:07.199 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:59:07.200 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:59:07.200 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:59:07.200 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:59:07.200 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-10-06T02:59:07.200 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:59:07.303 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627779 2023-10-06T02:59:07.493 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:59:07.493 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:59:07.493 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:59:07.493 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:59:07.493 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-10-06T02:59:07.493 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:59:07.596 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627780 2023-10-06T02:59:07.785 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:59:07.785 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:59:07.785 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:59:07.785 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:59:07.785 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-10-06T02:59:07.785 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:59:07.888 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627781 2023-10-06T02:59:08.077 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:59:08.077 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:59:08.078 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:59:08.078 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:59:08.078 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-10-06T02:59:08.078 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:59:08.181 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627782 2023-10-06T02:59:08.370 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T02:59:08.370 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T02:59:08.370 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T02:59:08.371 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T02:59:08.371 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-10-06T02:59:08.371 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T02:59:08.473 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627783 2023-10-06T02:59:08.663 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2023-10-06T02:59:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.740+0000 7fc971c5c000 1 Processor -- start 2023-10-06T02:59:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.740+0000 7fc971c5c000 1 -- start start 2023-10-06T02:59:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc971c5c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f7dab0 0x564a37fa0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc971c5c000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f06370 0x564a37fa0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc971c5c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f961f0 0x564a37fa1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc971c5c000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a37e0a980 con 0x564a37f06370 2023-10-06T02:59:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc971c5c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a37e0a620 con 0x564a37f7dab0 2023-10-06T02:59:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc971c5c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a37e01400 con 0x564a37f961f0 2023-10-06T02:59:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96a696700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f06370 0x564a37fa0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96a696700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f06370 0x564a37fa0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48772/0 (socket says 172.21.15.84:48772) 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96a696700 1 -- 172.21.15.84:0/3183988975 learned_addr learned my addr 172.21.15.84:0/3183988975 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96b698700 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f961f0 0x564a37fa1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96ae97700 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f7dab0 0x564a37fa0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96a696700 1 -- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f961f0 msgr2=0x564a37fa1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96a696700 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f961f0 0x564a37fa1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96a696700 1 -- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f7dab0 msgr2=0x564a37fa0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96a696700 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f7dab0 0x564a37fa0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96a696700 1 -- 172.21.15.84:0/3183988975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a37e193d0 con 0x564a37f06370 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96b698700 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f961f0 0x564a37fa1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96ae97700 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f7dab0 0x564a37fa0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.741+0000 7fc96a696700 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f06370 0x564a37fa0fd0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc9600097d0 tx=0x7fc960005b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacd0821aa7130c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc969694700 1 -- 172.21.15.84:0/3183988975 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960019070 con 0x564a37f06370 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc969694700 1 -- 172.21.15.84:0/3183988975 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960010040 con 0x564a37f06370 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc969694700 1 -- 172.21.15.84:0/3183988975 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96000f050 con 0x564a37f06370 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc971c5c000 1 -- 172.21.15.84:0/3183988975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f06370 msgr2=0x564a37fa0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc971c5c000 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f06370 0x564a37fa0fd0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc9600097d0 tx=0x7fc960005b30 comp rx=0 tx=0).stop 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc971c5c000 1 -- 172.21.15.84:0/3183988975 shutdown_connections 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc971c5c000 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f7dab0 0x564a37fa0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc971c5c000 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f961f0 0x564a37fa1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc971c5c000 1 --2- 172.21.15.84:0/3183988975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f06370 0x564a37fa0fd0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc971c5c000 1 -- 172.21.15.84:0/3183988975 >> 172.21.15.84:0/3183988975 conn(0x564a37ec05d0 msgr2=0x564a37eea7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc971c5c000 1 -- 172.21.15.84:0/3183988975 shutdown_connections 2023-10-06T02:59:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.742+0000 7fc971c5c000 1 -- 172.21.15.84:0/3183988975 wait complete. 2023-10-06T02:59:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc971c5c000 1 Processor -- start 2023-10-06T02:59:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc971c5c000 1 -- start start 2023-10-06T02:59:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc971c5c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f06370 0x564a37f7af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc971c5c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f7dab0 0x564a37f93110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc971c5c000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f961f0 0x564a37f01e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc971c5c000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a37f03fc0 con 0x564a37f961f0 2023-10-06T02:59:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc971c5c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a37f04260 con 0x564a37f06370 2023-10-06T02:59:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc971c5c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a37f04500 con 0x564a37f7dab0 2023-10-06T02:59:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc96b698700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f961f0 0x564a37f01e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc96b698700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f961f0 0x564a37f01e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48782/0 (socket says 172.21.15.84:48782) 2023-10-06T02:59:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.743+0000 7fc96b698700 1 -- 172.21.15.84:0/2214208856 learned_addr learned my addr 172.21.15.84:0/2214208856 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc96ae97700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f06370 0x564a37f7af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc96a696700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f7dab0 0x564a37f93110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc96b698700 1 -- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f7dab0 msgr2=0x564a37f93110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc96b698700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564a37f7dab0 0x564a37f93110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc96b698700 1 -- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f06370 msgr2=0x564a37f7af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc96b698700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564a37f06370 0x564a37f7af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc96b698700 1 -- 172.21.15.84:0/2214208856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9600094b0 con 0x564a37f961f0 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc96b698700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f961f0 0x564a37f01e40 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc964001220 tx=0x7fc964014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc95b7fe700 1 -- 172.21.15.84:0/2214208856 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640060d0 con 0x564a37f961f0 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc95b7fe700 1 -- 172.21.15.84:0/2214208856 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc964001360 con 0x564a37f961f0 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a37e0cae0 con 0x564a37f961f0 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc95b7fe700 1 -- 172.21.15.84:0/2214208856 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964003950 con 0x564a37f961f0 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.744+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a37e0c540 con 0x564a37f961f0 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.745+0000 7fc95b7fe700 1 -- 172.21.15.84:0/2214208856 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc964018070 con 0x564a37f961f0 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.746+0000 7fc95b7fe700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc950065890 0x7fc950067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.746+0000 7fc95b7fe700 1 -- 172.21.15.84:0/2214208856 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc964083fa0 con 0x564a37f961f0 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.746+0000 7fc96ae97700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc950065890 0x7fc950067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.746+0000 7fc971c5c000 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564a37f8f020 0x564a37f053f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.746+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- osd_op(unknown.0.0:1 10.12 10:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) v8 -- 0x564a37f05930 con 0x564a37f8f020 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.746+0000 7fc96a696700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564a37f8f020 0x564a37f053f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.746+0000 7fc96ae97700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc950065890 0x7fc950067d40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc95c005750 tx=0x7fc95c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.746+0000 7fc96a696700 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564a37f8f020 0x564a37f053f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc96a696700 1 -- 172.21.15.84:0/2214208856 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v70'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fc96001b070 con 0x564a37f8f020 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564a37f8f020 msgr2=0x564a37f053f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564a37f8f020 0x564a37f053f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc950065890 msgr2=0x7fc950067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc950065890 0x7fc950067d40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc95c005750 tx=0x7fc95c00c040 comp rx=0 tx=0).stop 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f961f0 msgr2=0x564a37f01e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 --2- 172.21.15.84:0/2214208856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564a37f961f0 0x564a37f01e40 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc964001220 tx=0x7fc964014000 comp rx=0 tx=0).stop 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc96b698700 1 -- 172.21.15.84:0/2214208856 reap_dead start 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 shutdown_connections 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 >> 172.21.15.84:0/2214208856 conn(0x564a37ec05d0 msgr2=0x564a37ebd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 shutdown_connections 2023-10-06T02:59:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.748+0000 7fc971c5c000 1 -- 172.21.15.84:0/2214208856 wait complete. 2023-10-06T02:59:08.756 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2023-10-06T02:59:08.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.828+0000 7f2211a40000 1 Processor -- start 2023-10-06T02:59:08.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.828+0000 7f2211a40000 1 -- start start 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f2211a40000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564361a532f0 0x564361b1ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f2211a40000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23580 0x564361b0efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f2211a40000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564361b23950 0x564361b0f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f2211a40000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643619f7320 con 0x564361b23580 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f2211a40000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56436199b980 con 0x564361a532f0 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f2211a40000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56436199b620 con 0x564361b23950 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f220a47a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23580 0x564361b0efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f220a47a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23580 0x564361b0efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48802/0 (socket says 172.21.15.84:48802) 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f220a47a700 1 -- 172.21.15.84:0/3152916168 learned_addr learned my addr 172.21.15.84:0/3152916168 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f220a47a700 1 -- 172.21.15.84:0/3152916168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564361b23950 msgr2=0x564361b0f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f220a47a700 1 --2- 172.21.15.84:0/3152916168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564361b23950 0x564361b0f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f220a47a700 1 -- 172.21.15.84:0/3152916168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564361a532f0 msgr2=0x564361b1ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f220a47a700 1 --2- 172.21.15.84:0/3152916168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564361a532f0 0x564361b1ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f220a47a700 1 -- 172.21.15.84:0/3152916168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2204005cf0 con 0x564361b23580 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f220a47a700 1 --2- 172.21.15.84:0/3152916168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23580 0x564361b0efc0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f21f4006eb0 tx=0x7f21f4006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179966b7d1e8330c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f2209478700 1 -- 172.21.15.84:0/3152916168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f400bc70 con 0x564361b23580 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f2209478700 1 -- 172.21.15.84:0/3152916168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f400bdf0 con 0x564361b23580 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.829+0000 7f2209478700 1 -- 172.21.15.84:0/3152916168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f400e6c0 con 0x564361b23580 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.830+0000 7f2211a40000 1 -- 172.21.15.84:0/3152916168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23580 msgr2=0x564361b0efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.830+0000 7f2211a40000 1 --2- 172.21.15.84:0/3152916168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23580 0x564361b0efc0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f21f4006eb0 tx=0x7f21f4006900 comp rx=0 tx=0).stop 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.830+0000 7f2211a40000 1 -- 172.21.15.84:0/3152916168 shutdown_connections 2023-10-06T02:59:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.830+0000 7f2211a40000 1 --2- 172.21.15.84:0/3152916168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564361a532f0 0x564361b1ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.830+0000 7f2211a40000 1 --2- 172.21.15.84:0/3152916168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564361b23950 0x564361b0f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.830+0000 7f2211a40000 1 --2- 172.21.15.84:0/3152916168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23580 0x564361b0efc0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.830+0000 7f2211a40000 1 -- 172.21.15.84:0/3152916168 >> 172.21.15.84:0/3152916168 conn(0x564361a517d0 msgr2=0x564361a978f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:08.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.830+0000 7f2211a40000 1 -- 172.21.15.84:0/3152916168 shutdown_connections 2023-10-06T02:59:08.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.830+0000 7f2211a40000 1 -- 172.21.15.84:0/3152916168 wait complete. 2023-10-06T02:59:08.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f2211a40000 1 Processor -- start 2023-10-06T02:59:08.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f2211a40000 1 -- start start 2023-10-06T02:59:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f2211a40000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564361a532f0 0x564361a7eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f2211a40000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564361b23580 0x564361b0ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f2211a40000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23950 0x564361a929f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f2211a40000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564361992400 con 0x564361b23950 2023-10-06T02:59:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f2211a40000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564361a7f080 con 0x564361b23580 2023-10-06T02:59:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f2211a40000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564361a94750 con 0x564361a532f0 2023-10-06T02:59:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f220b47c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23950 0x564361a929f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f220b47c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23950 0x564361a929f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48810/0 (socket says 172.21.15.84:48810) 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.831+0000 7f220b47c700 1 -- 172.21.15.84:0/2629198528 learned_addr learned my addr 172.21.15.84:0/2629198528 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f220ac7b700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564361a532f0 0x564361a7eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f220a47a700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564361b23580 0x564361b0ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f220b47c700 1 -- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564361a532f0 msgr2=0x564361a7eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f220b47c700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564361a532f0 0x564361a7eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f220b47c700 1 -- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564361b23580 msgr2=0x564361b0ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f220b47c700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564361b23580 0x564361b0ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f220b47c700 1 -- 172.21.15.84:0/2629198528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56436199d750 con 0x564361b23950 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f220a47a700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564361b23580 0x564361b0ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f220b47c700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23950 0x564361a929f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f2204005730 tx=0x7f2204016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f22037fe700 1 -- 172.21.15.84:0/2629198528 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204008be0 con 0x564361b23950 2023-10-06T02:59:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f22037fe700 1 -- 172.21.15.84:0/2629198528 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220401d420 con 0x564361b23950 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56436199dae0 con 0x564361b23950 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f22037fe700 1 -- 172.21.15.84:0/2629198528 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220401d7e0 con 0x564361b23950 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.832+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56436199d540 con 0x564361b23950 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.833+0000 7f22037fe700 1 -- 172.21.15.84:0/2629198528 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f220401db50 con 0x564361b23950 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.834+0000 7f22037fe700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21ec065890 0x7f21ec067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.834+0000 7f22037fe700 1 -- 172.21.15.84:0/2629198528 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f2204085810 con 0x564361b23950 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.834+0000 7f220ac7b700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21ec065890 0x7f21ec067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.834+0000 7f2211a40000 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564361b0f4d0 0x564361b33be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.834+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- osd_op(unknown.0.0:1 10.12 10:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) v8 -- 0x564361a95670 con 0x564361b0f4d0 2023-10-06T02:59:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.834+0000 7f220ac7b700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21ec065890 0x7f21ec067d40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0029d0 tx=0x7f21fc006a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.834+0000 7f220a47a700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564361b0f4d0 0x564361b33be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.835+0000 7f220a47a700 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564361b0f4d0 0x564361b33be0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f220a47a700 1 -- 172.21.15.84:0/2629198528 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v70'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f21f400eab0 con 0x564361b0f4d0 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564361b0f4d0 msgr2=0x564361b33be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x564361b0f4d0 0x564361b33be0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21ec065890 msgr2=0x7f21ec067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f21ec065890 0x7f21ec067d40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0029d0 tx=0x7f21fc006a60 comp rx=0 tx=0).stop 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23950 msgr2=0x564361a929f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 --2- 172.21.15.84:0/2629198528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564361b23950 0x564361a929f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f2204005730 tx=0x7f2204016000 comp rx=0 tx=0).stop 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f220b47c700 1 -- 172.21.15.84:0/2629198528 reap_dead start 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 shutdown_connections 2023-10-06T02:59:08.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 >> 172.21.15.84:0/2629198528 conn(0x564361a517d0 msgr2=0x564361a978f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:08.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 shutdown_connections 2023-10-06T02:59:08.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.836+0000 7f2211a40000 1 -- 172.21.15.84:0/2629198528 wait complete. 2023-10-06T02:59:08.844 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2023-10-06T02:59:08.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.917+0000 7f569dbc2000 1 Processor -- start 2023-10-06T02:59:08.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.917+0000 7f569dbc2000 1 -- start start 2023-10-06T02:59:08.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.917+0000 7f569dbc2000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826dcc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.917+0000 7f569dbc2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561826d47510 0x561826dd3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.917+0000 7f569dbc2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826dd0f50 0x561826dd4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.917+0000 7f569dbc2000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561826c48620 con 0x561826d44b10 2023-10-06T02:59:08.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.917+0000 7f569dbc2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561826c3f400 con 0x561826dd0f50 2023-10-06T02:59:08.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.917+0000 7f569dbc2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561826d27d30 con 0x561826d47510 2023-10-06T02:59:08.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f5696dfd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826dcc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f5696dfd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826dcc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48826/0 (socket says 172.21.15.84:48826) 2023-10-06T02:59:08.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f5696dfd700 1 -- 172.21.15.84:0/1355940727 learned_addr learned my addr 172.21.15.84:0/1355940727 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:08.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f56975fe700 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826dd0f50 0x561826dd4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f56965fc700 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561826d47510 0x561826dd3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f5696dfd700 1 -- 172.21.15.84:0/1355940727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561826d47510 msgr2=0x561826dd3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:08.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f5696dfd700 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561826d47510 0x561826dd3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f5696dfd700 1 -- 172.21.15.84:0/1355940727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826dd0f50 msgr2=0x561826dd4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:08.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f5696dfd700 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826dd0f50 0x561826dd4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f5696dfd700 1 -- 172.21.15.84:0/1355940727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690005db0 con 0x561826d44b10 2023-10-06T02:59:08.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f56975fe700 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826dd0f50 0x561826dd4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:08.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f5696dfd700 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826dcc3d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f568800a840 tx=0x7f5688007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0910e6f4457528 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f56955fa700 1 -- 172.21.15.84:0/1355940727 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688012660 con 0x561826d44b10 2023-10-06T02:59:08.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f56955fa700 1 -- 172.21.15.84:0/1355940727 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56880127c0 con 0x561826d44b10 2023-10-06T02:59:08.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.918+0000 7f56955fa700 1 -- 172.21.15.84:0/1355940727 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688012b60 con 0x561826d44b10 2023-10-06T02:59:08.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 -- 172.21.15.84:0/1355940727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 msgr2=0x561826dcc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826dcc3d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f568800a840 tx=0x7f5688007040 comp rx=0 tx=0).stop 2023-10-06T02:59:08.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 -- 172.21.15.84:0/1355940727 shutdown_connections 2023-10-06T02:59:08.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826dd0f50 0x561826dd4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826dcc3d0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 --2- 172.21.15.84:0/1355940727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561826d47510 0x561826dd3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 -- 172.21.15.84:0/1355940727 >> 172.21.15.84:0/1355940727 conn(0x561826cfe5d0 msgr2=0x561826d009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:08.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 -- 172.21.15.84:0/1355940727 shutdown_connections 2023-10-06T02:59:08.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 -- 172.21.15.84:0/1355940727 wait complete. 2023-10-06T02:59:08.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 Processor -- start 2023-10-06T02:59:08.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.919+0000 7f569dbc2000 1 -- start start 2023-10-06T02:59:08.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f569dbc2000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826d3f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f569dbc2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826d47510 0x561826dc90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f569dbc2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561826dd0f50 0x561826d2d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f569dbc2000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561826dd4140 con 0x561826d44b10 2023-10-06T02:59:08.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f569dbc2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561826dc9620 con 0x561826d47510 2023-10-06T02:59:08.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f569dbc2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561826d3fb50 con 0x561826dd0f50 2023-10-06T02:59:08.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f5696dfd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826d3f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f5696dfd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826d3f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48828/0 (socket says 172.21.15.84:48828) 2023-10-06T02:59:08.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f5696dfd700 1 -- 172.21.15.84:0/2842684413 learned_addr learned my addr 172.21.15.84:0/2842684413 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:08.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f56975fe700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561826dd0f50 0x561826d2d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f56965fc700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826d47510 0x561826dc90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f5696dfd700 1 -- 172.21.15.84:0/2842684413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561826dd0f50 msgr2=0x561826d2d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f5696dfd700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561826dd0f50 0x561826d2d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f5696dfd700 1 -- 172.21.15.84:0/2842684413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826d47510 msgr2=0x561826dc90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f5696dfd700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826d47510 0x561826dc90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f5696dfd700 1 -- 172.21.15.84:0/2842684413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568800a440 con 0x561826d44b10 2023-10-06T02:59:08.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f56965fc700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561826d47510 0x561826dc90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:08.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.920+0000 7f5696dfd700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826d3f4b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5688001190 tx=0x7f5688016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.921+0000 7f56877fe700 1 -- 172.21.15.84:0/2842684413 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800de40 con 0x561826d44b10 2023-10-06T02:59:08.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.921+0000 7f56877fe700 1 -- 172.21.15.84:0/2842684413 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688021070 con 0x561826d44b10 2023-10-06T02:59:08.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.921+0000 7f56877fe700 1 -- 172.21.15.84:0/2842684413 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568801c450 con 0x561826d44b10 2023-10-06T02:59:08.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.921+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561826c711c0 con 0x561826d44b10 2023-10-06T02:59:08.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.921+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561826c573d0 con 0x561826d44b10 2023-10-06T02:59:08.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.922+0000 7f56877fe700 1 -- 172.21.15.84:0/2842684413 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5688023030 con 0x561826d44b10 2023-10-06T02:59:08.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.922+0000 7f56877fe700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f567c065890 0x7f567c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.922+0000 7f56877fe700 1 -- 172.21.15.84:0/2842684413 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f56880857f0 con 0x561826d44b10 2023-10-06T02:59:08.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.922+0000 7f56965fc700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f567c065890 0x7f567c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.923+0000 7f569dbc2000 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x561826dce470 0x561826d42390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:08.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.923+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 --> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] -- osd_op(unknown.0.0:1 10.5 10:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) v8 -- 0x561826d428d0 con 0x561826dce470 2023-10-06T02:59:08.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.923+0000 7f56975fe700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x561826dce470 0x561826d42390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:08.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.923+0000 7f56965fc700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f567c065890 0x7f567c067d40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f568c009b90 tx=0x7f568c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.923+0000 7f56975fe700 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x561826dce470 0x561826d42390 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f56975fe700 1 -- 172.21.15.84:0/2842684413 <== osd.2 v2:172.21.15.84:6800/90631 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v70'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5690008a80 con 0x561826dce470 2023-10-06T02:59:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x561826dce470 msgr2=0x561826d42390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x561826dce470 0x561826d42390 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f567c065890 msgr2=0x7f567c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f567c065890 0x7f567c067d40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f568c009b90 tx=0x7f568c00c040 comp rx=0 tx=0).stop 2023-10-06T02:59:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 msgr2=0x561826d3f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 --2- 172.21.15.84:0/2842684413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561826d44b10 0x561826d3f4b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5688001190 tx=0x7f5688016000 comp rx=0 tx=0).stop 2023-10-06T02:59:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f56975fe700 1 -- 172.21.15.84:0/2842684413 reap_dead start 2023-10-06T02:59:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 shutdown_connections 2023-10-06T02:59:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 >> 172.21.15.84:0/2842684413 conn(0x561826cfe5d0 msgr2=0x561826d009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 shutdown_connections 2023-10-06T02:59:08.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:08.924+0000 7f569dbc2000 1 -- 172.21.15.84:0/2842684413 wait complete. 2023-10-06T02:59:08.939 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2023-10-06T02:59:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.014+0000 7f659e643000 1 Processor -- start 2023-10-06T02:59:09.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.014+0000 7f659e643000 1 -- start start 2023-10-06T02:59:09.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659e643000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a9655b70 0x55d7a9654600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659e643000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 0x55d7a9726fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659e643000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a97261d0 0x55d7a9727500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659e643000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7a959d980 con 0x55d7a97261d0 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659e643000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7a959d620 con 0x55d7a9725e00 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659e643000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7a9594400 con 0x55d7a9655b70 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659807f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a97261d0 0x55d7a9727500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659807f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a97261d0 0x55d7a9727500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48838/0 (socket says 172.21.15.84:48838) 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659807f700 1 -- 172.21.15.84:0/895335260 learned_addr learned my addr 172.21.15.84:0/895335260 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659787e700 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a9655b70 0x55d7a9654600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659707d700 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 0x55d7a9726fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659807f700 1 -- 172.21.15.84:0/895335260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a9655b70 msgr2=0x55d7a9654600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659807f700 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a9655b70 0x55d7a9654600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659807f700 1 -- 172.21.15.84:0/895335260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 msgr2=0x55d7a9726fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659807f700 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 0x55d7a9726fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659807f700 1 -- 172.21.15.84:0/895335260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658800a0e0 con 0x55d7a97261d0 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659787e700 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a9655b70 0x55d7a9654600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659807f700 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a97261d0 0x55d7a9727500 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6590009920 tx=0x7f659000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7c6514b9b06bec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659607b700 1 -- 172.21.15.84:0/895335260 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659000f040 con 0x55d7a97261d0 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659607b700 1 -- 172.21.15.84:0/895335260 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6590008ac0 con 0x55d7a97261d0 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.015+0000 7f659607b700 1 -- 172.21.15.84:0/895335260 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590008e80 con 0x55d7a97261d0 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.016+0000 7f659e643000 1 -- 172.21.15.84:0/895335260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a97261d0 msgr2=0x55d7a9727500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.016+0000 7f659e643000 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a97261d0 0x55d7a9727500 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6590009920 tx=0x7f659000c040 comp rx=0 tx=0).stop 2023-10-06T02:59:09.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.016+0000 7f659e643000 1 -- 172.21.15.84:0/895335260 shutdown_connections 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.016+0000 7f659e643000 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a97261d0 0x55d7a9727500 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.016+0000 7f659e643000 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a9655b70 0x55d7a9654600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.016+0000 7f659e643000 1 --2- 172.21.15.84:0/895335260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 0x55d7a9726fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.016+0000 7f659e643000 1 -- 172.21.15.84:0/895335260 >> 172.21.15.84:0/895335260 conn(0x55d7a9654050 msgr2=0x55d7a9650540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.016+0000 7f659e643000 1 -- 172.21.15.84:0/895335260 shutdown_connections 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.016+0000 7f659e643000 1 -- 172.21.15.84:0/895335260 wait complete. 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659e643000 1 Processor -- start 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659e643000 1 -- start start 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659e643000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a9655b70 0x55d7a96989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659e643000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 0x55d7a9730670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659e643000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a97261d0 0x55d7a971ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659e643000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7a972fa60 con 0x55d7a9655b70 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659e643000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7a9698f10 con 0x55d7a9725e00 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659e643000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7a9730bb0 con 0x55d7a97261d0 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659787e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a9655b70 0x55d7a96989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659787e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a9655b70 0x55d7a96989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48848/0 (socket says 172.21.15.84:48848) 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659787e700 1 -- 172.21.15.84:0/2300474499 learned_addr learned my addr 172.21.15.84:0/2300474499 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659807f700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a97261d0 0x55d7a971ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.017+0000 7f659707d700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 0x55d7a9730670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f659787e700 1 -- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a97261d0 msgr2=0x55d7a971ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f659787e700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d7a97261d0 0x55d7a971ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f659787e700 1 -- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 msgr2=0x55d7a9730670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f659787e700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 0x55d7a9730670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f659787e700 1 -- 172.21.15.84:0/2300474499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900095a0 con 0x55d7a9655b70 2023-10-06T02:59:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f659707d700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7a9725e00 0x55d7a9730670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f659787e700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a9655b70 0x55d7a96989d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f6588003000 tx=0x7f6588014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f6594878700 1 -- 172.21.15.84:0/2300474499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880056f0 con 0x55d7a9655b70 2023-10-06T02:59:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f6594878700 1 -- 172.21.15.84:0/2300474499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658801b660 con 0x55d7a9655b70 2023-10-06T02:59:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f6594878700 1 -- 172.21.15.84:0/2300474499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658801ba00 con 0x55d7a9655b70 2023-10-06T02:59:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d7a95ac3d0 con 0x55d7a9655b70 2023-10-06T02:59:09.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.018+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7a959fae0 con 0x55d7a9655b70 2023-10-06T02:59:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.019+0000 7f6594878700 1 -- 172.21.15.84:0/2300474499 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6588026480 con 0x55d7a9655b70 2023-10-06T02:59:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.020+0000 7f6594878700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6584065890 0x7f6584067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.020+0000 7f6594878700 1 -- 172.21.15.84:0/2300474499 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f6588085500 con 0x55d7a9655b70 2023-10-06T02:59:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.020+0000 7f659707d700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6584065890 0x7f6584067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.020+0000 7f659e643000 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55d7a9654b10 0x55d7a9693d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.020+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 --> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] -- osd_op(unknown.0.0:1 10.9 10:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) v8 -- 0x55d7a9694290 con 0x55d7a9654b10 2023-10-06T02:59:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.020+0000 7f659707d700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6584065890 0x7f6584067d40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f658c001620 tx=0x7f658c001a90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.020+0000 7f659807f700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55d7a9654b10 0x55d7a9693d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.021+0000 7f659807f700 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55d7a9654b10 0x55d7a9693d50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659807f700 1 -- 172.21.15.84:0/2300474499 <== osd.5 v2:172.21.15.131:6808/90923 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v70'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f659001b040 con 0x55d7a9654b10 2023-10-06T02:59:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55d7a9654b10 msgr2=0x55d7a9693d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55d7a9654b10 0x55d7a9693d50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6584065890 msgr2=0x7f6584067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6584065890 0x7f6584067d40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f658c001620 tx=0x7f658c001a90 comp rx=0 tx=0).stop 2023-10-06T02:59:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a9655b70 msgr2=0x55d7a96989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 --2- 172.21.15.84:0/2300474499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7a9655b70 0x55d7a96989d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f6588003000 tx=0x7f6588014000 comp rx=0 tx=0).stop 2023-10-06T02:59:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659807f700 1 -- 172.21.15.84:0/2300474499 reap_dead start 2023-10-06T02:59:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 shutdown_connections 2023-10-06T02:59:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 >> 172.21.15.84:0/2300474499 conn(0x55d7a9654050 msgr2=0x55d7a9650540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 shutdown_connections 2023-10-06T02:59:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.022+0000 7f659e643000 1 -- 172.21.15.84:0/2300474499 wait complete. 2023-10-06T02:59:09.032 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2023-10-06T02:59:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.108+0000 7feb4ccf1000 1 Processor -- start 2023-10-06T02:59:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.108+0000 7feb4ccf1000 1 -- start start 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4ccf1000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 0x55678fa2eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4ccf1000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678f95dbe0 0x55678f9878d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4ccf1000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678fa294a0 0x55678f9a3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4ccf1000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678f8a6620 con 0x55678fa294a0 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4ccf1000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678f89d400 con 0x55678f95dbe0 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4ccf1000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55678f98aad0 con 0x55678f9498e0 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4672d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678fa294a0 0x55678f9a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4672d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678fa294a0 0x55678f9a3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48876/0 (socket says 172.21.15.84:48876) 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4672d700 1 -- 172.21.15.84:0/2215718385 learned_addr learned my addr 172.21.15.84:0/2215718385 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb45f2c700 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 0x55678fa2eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4572b700 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678f95dbe0 0x55678f9878d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4672d700 1 -- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 msgr2=0x55678fa2eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4672d700 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 0x55678fa2eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4672d700 1 -- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678f95dbe0 msgr2=0x55678f9878d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4672d700 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678f95dbe0 0x55678f9878d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4672d700 1 -- 172.21.15.84:0/2215718385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40005db0 con 0x55678fa294a0 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb45f2c700 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 0x55678fa2eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.109+0000 7feb4572b700 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678f95dbe0 0x55678f9878d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4672d700 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678fa294a0 0x55678f9a3450 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x55678f988090 tx=0x7feb40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b48783f3890434 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb37fff700 1 -- 172.21.15.84:0/2215718385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40005510 con 0x55678fa294a0 2023-10-06T02:59:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb37fff700 1 -- 172.21.15.84:0/2215718385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40008970 con 0x55678fa294a0 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb37fff700 1 -- 172.21.15.84:0/2215718385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40026460 con 0x55678fa294a0 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4ccf1000 1 -- 172.21.15.84:0/2215718385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678fa294a0 msgr2=0x55678f9a3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4ccf1000 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678fa294a0 0x55678f9a3450 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x55678f988090 tx=0x7feb40016000 comp rx=0 tx=0).stop 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4ccf1000 1 -- 172.21.15.84:0/2215718385 shutdown_connections 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4ccf1000 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678fa294a0 0x55678f9a3450 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4ccf1000 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 0x55678fa2eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4ccf1000 1 --2- 172.21.15.84:0/2215718385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678f95dbe0 0x55678f9878d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4ccf1000 1 -- 172.21.15.84:0/2215718385 >> 172.21.15.84:0/2215718385 conn(0x55678f95c7d0 msgr2=0x55678fa308a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4ccf1000 1 -- 172.21.15.84:0/2215718385 shutdown_connections 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.110+0000 7feb4ccf1000 1 -- 172.21.15.84:0/2215718385 wait complete. 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 Processor -- start 2023-10-06T02:59:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 -- start start 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 0x55678fa2a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678f95dbe0 0x55678f989d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678fa294a0 0x55678fa21470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678f98a6e0 con 0x55678f95dbe0 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678fa29c00 con 0x55678fa294a0 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55678fa29ea0 con 0x55678f9498e0 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4572b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678f95dbe0 0x55678f989d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4572b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678f95dbe0 0x55678f989d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48886/0 (socket says 172.21.15.84:48886) 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4572b700 1 -- 172.21.15.84:0/4084828342 learned_addr learned my addr 172.21.15.84:0/4084828342 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb45f2c700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 0x55678fa2a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4672d700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678fa294a0 0x55678fa21470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4572b700 1 -- 172.21.15.84:0/4084828342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 msgr2=0x55678fa2a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4572b700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55678f9498e0 0x55678fa2a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4572b700 1 -- 172.21.15.84:0/4084828342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678fa294a0 msgr2=0x55678fa21470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4572b700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55678fa294a0 0x55678fa21470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4572b700 1 -- 172.21.15.84:0/4084828342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55678f8a8750 con 0x55678f95dbe0 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4572b700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678f95dbe0 0x55678f989d60 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7feb3c008b50 tx=0x7feb3c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb367fc700 1 -- 172.21.15.84:0/4084828342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c019070 con 0x55678f95dbe0 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb367fc700 1 -- 172.21.15.84:0/4084828342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c010040 con 0x55678f95dbe0 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55678f8cf1c0 con 0x55678f95dbe0 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb367fc700 1 -- 172.21.15.84:0/4084828342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c00f050 con 0x55678f95dbe0 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.112+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55678f8b53d0 con 0x55678f95dbe0 2023-10-06T02:59:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.114+0000 7feb367fc700 1 -- 172.21.15.84:0/4084828342 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb3c015460 con 0x55678f95dbe0 2023-10-06T02:59:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.115+0000 7feb367fc700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb28065890 0x7feb28067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.115+0000 7feb367fc700 1 -- 172.21.15.84:0/4084828342 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7feb3c083a00 con 0x55678f95dbe0 2023-10-06T02:59:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.115+0000 7feb45f2c700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb28065890 0x7feb28067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.115+0000 7feb4ccf1000 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55678fa27350 0x55678fa23910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.115+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 --> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] -- osd_op(unknown.0.0:1 10.5 10:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) v8 -- 0x55678fa23e50 con 0x55678fa27350 2023-10-06T02:59:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.115+0000 7feb4672d700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55678fa27350 0x55678fa23910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.115+0000 7feb45f2c700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb28065890 0x7feb28067d40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feb3800dc10 tx=0x7feb38007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.115+0000 7feb4672d700 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55678fa27350 0x55678fa23910 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4672d700 1 -- 172.21.15.84:0/4084828342 <== osd.2 v2:172.21.15.84:6800/90631 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v70'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7feb4001d420 con 0x55678fa27350 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55678fa27350 msgr2=0x55678fa23910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55678fa27350 0x55678fa23910 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb28065890 msgr2=0x7feb28067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb28065890 0x7feb28067d40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feb3800dc10 tx=0x7feb38007040 comp rx=0 tx=0).stop 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678f95dbe0 msgr2=0x55678f989d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 --2- 172.21.15.84:0/4084828342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55678f95dbe0 0x55678f989d60 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7feb3c008b50 tx=0x7feb3c00c040 comp rx=0 tx=0).stop 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4672d700 1 -- 172.21.15.84:0/4084828342 reap_dead start 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 shutdown_connections 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 >> 172.21.15.84:0/4084828342 conn(0x55678f95c7d0 msgr2=0x55678fa31c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 shutdown_connections 2023-10-06T02:59:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.117+0000 7feb4ccf1000 1 -- 172.21.15.84:0/4084828342 wait complete. 2023-10-06T02:59:09.124 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2023-10-06T02:59:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.199+0000 7f10b265f000 1 Processor -- start 2023-10-06T02:59:09.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.199+0000 7f10b265f000 1 -- start start 2023-10-06T02:59:09.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10b265f000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfcf7c8e0 0x55ecfd057ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10b265f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecfcf90be0 0x55ecfd058010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10b265f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecfd05c4a0 0x55ecfcfbd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10b265f000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecfced9980 con 0x55ecfcf7c8e0 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10b265f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecfced9620 con 0x55ecfd05c4a0 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10b265f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ecfced0400 con 0x55ecfcf90be0 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ab89a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfcf7c8e0 0x55ecfd057ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ab89a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfcf7c8e0 0x55ecfd057ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48888/0 (socket says 172.21.15.84:48888) 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ab89a700 1 -- 172.21.15.84:0/4266135463 learned_addr learned my addr 172.21.15.84:0/4266135463 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ab099700 1 --2- 172.21.15.84:0/4266135463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecfcf90be0 0x55ecfd058010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ac09b700 1 --2- 172.21.15.84:0/4266135463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecfd05c4a0 0x55ecfcfbd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ab89a700 1 -- 172.21.15.84:0/4266135463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecfcf90be0 msgr2=0x55ecfd058010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ab89a700 1 --2- 172.21.15.84:0/4266135463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecfcf90be0 0x55ecfd058010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ab89a700 1 -- 172.21.15.84:0/4266135463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecfd05c4a0 msgr2=0x55ecfcfbd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ab89a700 1 --2- 172.21.15.84:0/4266135463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecfd05c4a0 0x55ecfcfbd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.200+0000 7f10ab89a700 1 -- 172.21.15.84:0/4266135463 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0005db0 con 0x55ecfcf7c8e0 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10ab89a700 1 --2- 172.21.15.84:0/4266135463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfcf7c8e0 0x55ecfd057ad0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f109c0088e0 tx=0x7f109c005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95345c356c546c8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10aa097700 1 -- 172.21.15.84:0/4266135463 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00f6a0 con 0x55ecfcf7c8e0 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10aa097700 1 -- 172.21.15.84:0/4266135463 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c00f800 con 0x55ecfcf7c8e0 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10aa097700 1 -- 172.21.15.84:0/4266135463 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00fba0 con 0x55ecfcf7c8e0 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10b265f000 1 -- 172.21.15.84:0/4266135463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfcf7c8e0 msgr2=0x55ecfd057ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10b265f000 1 --2- 172.21.15.84:0/4266135463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfcf7c8e0 0x55ecfd057ad0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f109c0088e0 tx=0x7f109c005d40 comp rx=0 tx=0).stop 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10b265f000 1 -- 172.21.15.84:0/4266135463 shutdown_connections 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10b265f000 1 --2- 172.21.15.84:0/4266135463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecfd05c4a0 0x55ecfcfbd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10b265f000 1 --2- 172.21.15.84:0/4266135463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfcf7c8e0 0x55ecfd057ad0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10b265f000 1 --2- 172.21.15.84:0/4266135463 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecfcf90be0 0x55ecfd058010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10b265f000 1 -- 172.21.15.84:0/4266135463 >> 172.21.15.84:0/4266135463 conn(0x55ecfcf8f7d0 msgr2=0x55ecfd0592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10b265f000 1 -- 172.21.15.84:0/4266135463 shutdown_connections 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.201+0000 7f10b265f000 1 -- 172.21.15.84:0/4266135463 wait complete. 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.202+0000 7f10b265f000 1 Processor -- start 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.202+0000 7f10b265f000 1 -- start start 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10b265f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecfcf7c8e0 0x55ecfd0512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10b265f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecfcf90be0 0x55ecfcfb87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10b265f000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfd05c4a0 0x55ecfcfbbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10b265f000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecfcfb9950 con 0x55ecfd05c4a0 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10b265f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecfd052ae0 con 0x55ecfcf7c8e0 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10b265f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ecfd051800 con 0x55ecfcf90be0 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ac09b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfd05c4a0 0x55ecfcfbbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ac09b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfd05c4a0 0x55ecfcfbbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48904/0 (socket says 172.21.15.84:48904) 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ac09b700 1 -- 172.21.15.84:0/1677090869 learned_addr learned my addr 172.21.15.84:0/1677090869 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ab89a700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecfcf7c8e0 0x55ecfd0512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ab099700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecfcf90be0 0x55ecfcfb87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ac09b700 1 -- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecfcf90be0 msgr2=0x55ecfcfb87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ac09b700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ecfcf90be0 0x55ecfcfb87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ac09b700 1 -- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecfcf7c8e0 msgr2=0x55ecfd0512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ac09b700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ecfcf7c8e0 0x55ecfd0512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ac09b700 1 -- 172.21.15.84:0/1677090869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c008510 con 0x55ecfd05c4a0 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10ac09b700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfd05c4a0 0x55ecfcfbbbe0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f10a4002e80 tx=0x7f10a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10a8894700 1 -- 172.21.15.84:0/1677090869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a400cd50 con 0x55ecfd05c4a0 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10a8894700 1 -- 172.21.15.84:0/1677090869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a4008030 con 0x55ecfd05c4a0 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ecfcee83d0 con 0x55ecfd05c4a0 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10a8894700 1 -- 172.21.15.84:0/1677090869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40116a0 con 0x55ecfd05c4a0 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.203+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ecfcedbae0 con 0x55ecfd05c4a0 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.204+0000 7f10a8894700 1 -- 172.21.15.84:0/1677090869 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10a4011a10 con 0x55ecfd05c4a0 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.205+0000 7f10a8894700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10980658c0 0x7f1098067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.205+0000 7f10a8894700 1 -- 172.21.15.84:0/1677090869 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f10a40836f0 con 0x55ecfd05c4a0 2023-10-06T02:59:09.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.205+0000 7f10ab89a700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10980658c0 0x7f1098067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.205+0000 7f10b265f000 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x55ecfd0536f0 0x55ecfd053af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.205+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 --> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] -- osd_op(unknown.0.0:1 10.1d 10:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) v8 -- 0x55ecfd054030 con 0x55ecfd0536f0 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.205+0000 7f10ab099700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x55ecfd0536f0 0x55ecfd053af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.205+0000 7f10ab89a700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10980658c0 0x7f1098067d70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f109c005d80 tx=0x7f109c01c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.206+0000 7f10ab099700 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x55ecfd0536f0 0x55ecfd053af0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10ab099700 1 -- 172.21.15.84:0/1677090869 <== osd.4 v2:172.21.15.131:6800/90922 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v70'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f10a00089d0 con 0x55ecfd0536f0 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x55ecfd0536f0 msgr2=0x55ecfd053af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x55ecfd0536f0 0x55ecfd053af0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10980658c0 msgr2=0x7f1098067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f10980658c0 0x7f1098067d70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f109c005d80 tx=0x7f109c01c000 comp rx=0 tx=0).stop 2023-10-06T02:59:09.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfd05c4a0 msgr2=0x55ecfcfbbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 --2- 172.21.15.84:0/1677090869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfd05c4a0 0x55ecfcfbbbe0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f10a4002e80 tx=0x7f10a4000bc0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10ac09b700 1 -- 172.21.15.84:0/1677090869 reap_dead start 2023-10-06T02:59:09.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 shutdown_connections 2023-10-06T02:59:09.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 >> 172.21.15.84:0/1677090869 conn(0x55ecfcf8f7d0 msgr2=0x55ecfd0592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 shutdown_connections 2023-10-06T02:59:09.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.207+0000 7f10b265f000 1 -- 172.21.15.84:0/1677090869 wait complete. 2023-10-06T02:59:09.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start /d1/d2/d3 recursive,force 2023-10-06T02:59:09.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.374+0000 7f30bf59e700 1 Processor -- start 2023-10-06T02:59:09.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.374+0000 7f30bf59e700 1 -- start start 2023-10-06T02:59:09.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bf59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f30c01539d0 0x7f30c015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bf59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00ccab0 0x7f30c00d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bf59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c00d0c90 con 0x7f30c00d0830 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bf59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c00cdc30 con 0x7f30c01539d0 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bf59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00cb500 con 0x7f30c00ccab0 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f30c00d0830 0x7f30c015cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48388/0 (socket says 172.21.15.84:48388) 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bed9d700 1 -- 172.21.15.84:0/759132453 learned_addr learned my addr 172.21.15.84:0/759132453 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702175945 0 0) 0x7f30b8001490 con 0x7f30c00d0830 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30a8003570 con 0x7f30c00d0830 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00ccab0 0x7f30c00d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.375+0000 7f30be59c700 1 --2- 172.21.15.84:0/759132453 >> v2:172.21.15.131:3300/0 conn(0x7f30c01539d0 0x7f30c015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3965039846 0 0) 0x7f30a8003570 con 0x7f30c00d0830 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00ccab0 msgr2=0x7f30c00d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00ccab0 0x7f30c00d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 >> v2:172.21.15.131:3300/0 conn(0x7f30c01539d0 msgr2=0x7f30c015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 --2- 172.21.15.84:0/759132453 >> v2:172.21.15.131:3300/0 conn(0x7f30c01539d0 0x7f30c015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c015a8f0 con 0x7f30c00d0830 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f30b8001980 con 0x7f30c00d0830 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 >> v1:172.21.15.84:6789/0 conn(0x7f30c00d0830 legacy=0x7f30c015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00ccab0 0x7f30a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30a8004d50 0x7f30a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00cdc30 con 0x7f30a8003a60 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00cb500 con 0x7f30a8004d50 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a800bae0 con 0x7f30c00ccab0 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30be59c700 1 --2- 172.21.15.84:0/759132453 >> v2:172.21.15.131:3300/0 conn(0x7f30c01539d0 0x7f30c015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30be59c700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bed9d700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30a8004d50 0x7f30a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00ccab0 0x7f30a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30be59c700 1 -- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00ccab0 msgr2=0x7f30a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30be59c700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00ccab0 0x7f30a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30be59c700 1 -- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30a8004d50 msgr2=0x7f30a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30be59c700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30a8004d50 0x7f30a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30be59c700 1 -- 172.21.15.84:0/759132453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a8003570 con 0x7f30a8003a60 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30be59c700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30a8003e70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009ba0 tx=0x7f30b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95f8b5039ebe63b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000c070 con 0x7f30a8003a60 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b000e5e0 con 0x7f30a8003a60 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.376+0000 7f30bd59a700 1 -- 172.21.15.84:0/759132453 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000e790 con 0x7f30a8003a60 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.377+0000 7f30bf59e700 1 -- 172.21.15.84:0/759132453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 msgr2=0x7f30a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.377+0000 7f30bf59e700 1 --2- 172.21.15.84:0/759132453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30a8003e70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009ba0 tx=0x7f30b0008040 comp rx=0 tx=0).stop 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.377+0000 7f30bed9d700 1 -- 172.21.15.84:0/759132453 reap_dead start 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.377+0000 7f30bf59e700 1 -- 172.21.15.84:0/759132453 shutdown_connections 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.377+0000 7f30bf59e700 1 -- 172.21.15.84:0/759132453 >> 172.21.15.84:0/759132453 conn(0x7f30c0068100 msgr2=0x7f30c00684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.377+0000 7f30bf59e700 1 -- 172.21.15.84:0/759132453 shutdown_connections 2023-10-06T02:59:09.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.377+0000 7f30bf59e700 1 -- 172.21.15.84:0/759132453 wait complete. 2023-10-06T02:59:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.378+0000 7f30bf59e700 1 Processor -- start 2023-10-06T02:59:09.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.378+0000 7f30bf59e700 1 -- start start 2023-10-06T02:59:09.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bf59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30c0150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bf59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00b3100 0x7f30c00b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bf59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c015de30 0x7f30c015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bf59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c015d9a0 con 0x7f30a8003a60 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bf59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c015cd90 con 0x7f30c015de30 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bf59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c015d070 con 0x7f30c00b3100 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30c0150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30c0150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48916/0 (socket says 172.21.15.84:48916) 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30be59c700 1 -- 172.21.15.84:0/4112220165 learned_addr learned my addr 172.21.15.84:0/4112220165 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00b3100 0x7f30c00b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bed9d700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c015de30 0x7f30c015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30be59c700 1 -- 172.21.15.84:0/4112220165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00b3100 msgr2=0x7f30c00b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30be59c700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00b3100 0x7f30c00b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30be59c700 1 -- 172.21.15.84:0/4112220165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c015de30 msgr2=0x7f30c015e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30be59c700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c015de30 0x7f30c015e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30be59c700 1 -- 172.21.15.84:0/4112220165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c015d350 con 0x7f30a8003a60 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00b3100 0x7f30c00b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30be59c700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30c0150f90 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f30b0013ac0 tx=0x7f30b001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30ae7fc700 1 -- 172.21.15.84:0/4112220165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000e750 con 0x7f30a8003a60 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30ae7fc700 1 -- 172.21.15.84:0/4112220165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0013e00 con 0x7f30a8003a60 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30bf59e700 1 -- 172.21.15.84:0/4112220165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c015d630 con 0x7f30a8003a60 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.379+0000 7f30ae7fc700 1 -- 172.21.15.84:0/4112220165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b001c8a0 con 0x7f30a8003a60 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.380+0000 7f30bf59e700 1 -- 172.21.15.84:0/4112220165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c00b5580 con 0x7f30a8003a60 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.381+0000 7f30ae7fc700 1 -- 172.21.15.84:0/4112220165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30b001ccd0 con 0x7f30a8003a60 2023-10-06T02:59:09.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.381+0000 7f30ae7fc700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f30a0066f30 0x7f30a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.382+0000 7f30ae7fc700 1 -- 172.21.15.84:0/4112220165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f30b0086500 con 0x7f30a8003a60 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.382+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f30a0066f30 0x7f30a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.382+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f30a0066f30 0x7f30a00693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f30b4006f00 tx=0x7f30b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30cdb90b80 1 Processor -- start 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30cdb90b80 1 -- start start 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968e84da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 0x563968e852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 0x563968e85820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563968ddfb50 con 0x563968ea9f30 2023-10-06T02:59:09.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563968ddd350 con 0x563968e8baf0 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563968dd9140 con 0x563968e8a3a0 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968e84da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968e84da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48922/0 (socket says 172.21.15.84:48922) 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.384+0000 7f30be59c700 1 -- 172.21.15.84:0/1515479004 learned_addr learned my addr 172.21.15.84:0/1515479004 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 0x563968e852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30bed9d700 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 0x563968e85820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30be59c700 1 -- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 msgr2=0x563968e852e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30be59c700 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 0x563968e852e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30be59c700 1 -- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 msgr2=0x563968e85820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30be59c700 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 0x563968e85820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30be59c700 1 -- 172.21.15.84:0/1515479004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563968c73350 con 0x563968ea9f30 2023-10-06T02:59:09.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 0x563968e852e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30bed9d700 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 0x563968e85820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f30be59c700 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968e84da0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f30b0053650 tx=0x7f30b00846a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ab71a33eb951e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f309f7fe700 1 -- 172.21.15.84:0/1515479004 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000c040 con 0x563968ea9f30 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f309f7fe700 1 -- 172.21.15.84:0/1515479004 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0057850 con 0x563968ea9f30 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.385+0000 7f309f7fe700 1 -- 172.21.15.84:0/1515479004 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0057150 con 0x563968ea9f30 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1515479004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 msgr2=0x563968e84da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968e84da0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f30b0053650 tx=0x7f30b00846a0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1515479004 shutdown_connections 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 0x563968e85820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968e84da0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1515479004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 0x563968e852e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1515479004 >> 172.21.15.84:0/1515479004 conn(0x563968e89f60 msgr2=0x563968e8a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1515479004 shutdown_connections 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1515479004 wait complete. 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 -- start start 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.386+0000 7f30cdb90b80 1 Processor -- start 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 0x563968ed2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 0x563968eb7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563968d84970 con 0x563968ea9f30 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563968d9ff80 con 0x563968e8baf0 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563968c5bf10 con 0x563968e8a3a0 2023-10-06T02:59:09.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30cdb90b80 10 client.0 _ll_register_callbacks cb 0x563968e4c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30bed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30bed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48926/0 (socket says 172.21.15.84:48926) 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30bed9d700 1 -- 172.21.15.84:0/1162164102 learned_addr learned my addr 172.21.15.84:0/1162164102 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30be59c700 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 0x563968ed2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.387+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 0x563968eb7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30bed9d700 1 -- 172.21.15.84:0/1162164102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 msgr2=0x563968ed2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30bed9d700 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 0x563968ed2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30bed9d700 1 -- 172.21.15.84:0/1162164102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 msgr2=0x563968eb7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30bed9d700 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 0x563968eb7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30bed9d700 1 -- 172.21.15.84:0/1162164102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c00b5580 con 0x563968ea9f30 2023-10-06T02:59:09.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30bed9d700 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb78b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000f80 tx=0x7f30b8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4550f406f6476cb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f309cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f309cff9700 1 -- 172.21.15.84:0/1162164102 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b80073a0 con 0x563968ea9f30 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f309cff9700 1 -- 172.21.15.84:0/1162164102 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f30b8007500 con 0x563968ea9f30 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1162164102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563968e7da20 con 0x563968ea9f30 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f309cff9700 1 -- 172.21.15.84:0/1162164102 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30b80078d0 con 0x563968ea9f30 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30cdb90b80 10 client.6927 fetch_fsmap learned FSMap version 59 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1162164102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x563968c160c0 con 0x563968ea9f30 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f309cff9700 1 -- 172.21.15.84:0/1162164102 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563968e7da20 con 0x563968ea9f30 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f309cff9700 1 -- 172.21.15.84:0/1162164102 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 59) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f30b801e350 con 0x563968ea9f30 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30cdb90b80 10 client.6927 fetch_fsmap finished waiting for FSMap version 59 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30cdb90b80 10 client.6927 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:09.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30cdb90b80 20 client.6927 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x563968ed2840 0x563968e989b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30cdb90b80 4 client.6927 mds_command: new command op to 6528 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1162164102 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563968e5a950 con 0x563968ed2840 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.388+0000 7f30be59c700 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x563968ed2840 0x563968e989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f309cff9700 10 client.6927 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30be59c700 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x563968ed2840 0x563968e989b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a00d7eeeabdd6dce server_cookie=ad28b7f2e3e9440d in_seq=0 out_seq=0 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f309cff9700 1 -- 172.21.15.84:0/1162164102 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563968e5a950 con 0x563968ed2840 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f309cff9700 10 client.6927 handle_command_reply: tid=0 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 client.6927 shutdown 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1162164102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 msgr2=0x563968eb78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb78b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000f80 tx=0x7f30b8009040 comp rx=0 tx=0).stop 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1162164102 shutdown_connections 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x563968ed2840 0x563968e989b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb78b0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8a3a0 0x563968ed2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/1162164102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8baf0 0x563968eb7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f309cff9700 0 client.6927 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1162164102 >> 172.21.15.84:0/1162164102 conn(0x563968e89f60 msgr2=0x563968e8ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1162164102 shutdown_connections 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.389+0000 7f30cdb90b80 1 -- 172.21.15.84:0/1162164102 wait complete. 2023-10-06T02:59:09.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.390+0000 7f30cdb90b80 20 client.6927 trim_cache size 0 max 16384 2023-10-06T02:59:09.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.405+0000 7f30cdb90b80 1 Processor -- start 2023-10-06T02:59:09.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30cdb90b80 1 -- start start 2023-10-06T02:59:09.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968e8a3a0 0x563968ee1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8baf0 0x563968eab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968ea9f30 0x563968eb1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563968eb6410 con 0x563968e8a3a0 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563968e89a70 con 0x563968ea9f30 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563968e87990 con 0x563968e8baf0 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968e8a3a0 0x563968ee1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30be59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968e8a3a0 0x563968ee1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48942/0 (socket says 172.21.15.84:48942) 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.406+0000 7f30be59c700 1 -- 172.21.15.84:0/909572973 learned_addr learned my addr 172.21.15.84:0/909572973 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30be59c700 1 -- 172.21.15.84:0/909572973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8baf0 msgr2=0x563968eab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30be59c700 1 --2- 172.21.15.84:0/909572973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8baf0 0x563968eab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30be59c700 1 -- 172.21.15.84:0/909572973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968ea9f30 msgr2=0x563968eb1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30bed9d700 1 --2- 172.21.15.84:0/909572973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968ea9f30 0x563968eb1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30be59c700 1 --2- 172.21.15.84:0/909572973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968ea9f30 0x563968eb1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30be59c700 1 -- 172.21.15.84:0/909572973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563968da7860 con 0x563968e8a3a0 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30be59c700 1 --2- 172.21.15.84:0/909572973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968e8a3a0 0x563968ee1850 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f30b0084820 tx=0x7f30b0086000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7e9ba0c63d20e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f309ffff700 1 -- 172.21.15.84:0/909572973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000c040 con 0x563968e8a3a0 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f309ffff700 1 -- 172.21.15.84:0/909572973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0006df0 con 0x563968e8a3a0 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f309ffff700 1 -- 172.21.15.84:0/909572973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b005a3a0 con 0x563968e8a3a0 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30cdb90b80 1 -- 172.21.15.84:0/909572973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968e8a3a0 msgr2=0x563968ee1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/909572973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968e8a3a0 0x563968ee1850 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f30b0084820 tx=0x7f30b0086000 comp rx=0 tx=0).stop 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30cdb90b80 1 -- 172.21.15.84:0/909572973 shutdown_connections 2023-10-06T02:59:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/909572973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968ea9f30 0x563968eb1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/909572973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968e8a3a0 0x563968ee1850 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/909572973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8baf0 0x563968eab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30cdb90b80 1 -- 172.21.15.84:0/909572973 >> 172.21.15.84:0/909572973 conn(0x563968e89f60 msgr2=0x563968eb8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30cdb90b80 1 -- 172.21.15.84:0/909572973 shutdown_connections 2023-10-06T02:59:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.407+0000 7f30cdb90b80 1 -- 172.21.15.84:0/909572973 wait complete. 2023-10-06T02:59:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.408+0000 7f30cdb90b80 1 -- start start 2023-10-06T02:59:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.408+0000 7f30cdb90b80 1 Processor -- start 2023-10-06T02:59:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8a3a0 0x563968e9ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8baf0 0x563968f2bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30cdb90b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563968e85320 con 0x563968ea9f30 2023-10-06T02:59:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563968e89900 con 0x563968e8a3a0 2023-10-06T02:59:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30cdb90b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563968eb4c70 con 0x563968e8baf0 2023-10-06T02:59:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30cdb90b80 10 client.0 _ll_register_callbacks cb 0x563968e4c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48956/0 (socket says 172.21.15.84:48956) 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bed9d700 1 -- 172.21.15.84:0/3747540973 learned_addr learned my addr 172.21.15.84:0/3747540973 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30be59c700 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8a3a0 0x563968e9ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bdd9b700 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8baf0 0x563968f2bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bed9d700 1 -- 172.21.15.84:0/3747540973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8baf0 msgr2=0x563968f2bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bed9d700 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8baf0 0x563968f2bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bed9d700 1 -- 172.21.15.84:0/3747540973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8a3a0 msgr2=0x563968e9ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bed9d700 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8a3a0 0x563968e9ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bed9d700 1 -- 172.21.15.84:0/3747540973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563968c73350 con 0x563968ea9f30 2023-10-06T02:59:09.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30be59c700 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8a3a0 0x563968e9ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f30bed9d700 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb5100 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000f80 tx=0x7f30b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a71bcacd86e7461 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f309cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.409+0000 7f309cff9700 1 -- 172.21.15.84:0/3747540973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b801eaa0 con 0x563968ea9f30 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f309cff9700 1 -- 172.21.15.84:0/3747540973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f30b80078d0 con 0x563968ea9f30 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30cdb90b80 1 -- 172.21.15.84:0/3747540973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30b0057850 con 0x563968ea9f30 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f309cff9700 1 -- 172.21.15.84:0/3747540973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30b8007ad0 con 0x563968ea9f30 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30cdb90b80 10 client.6933 fetch_fsmap learned FSMap version 59 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30cdb90b80 1 -- 172.21.15.84:0/3747540973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x563968d8e550 con 0x563968ea9f30 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f309cff9700 1 -- 172.21.15.84:0/3747540973 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0057850 con 0x563968ea9f30 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f309cff9700 1 -- 172.21.15.84:0/3747540973 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 59) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f30b8001940 con 0x563968ea9f30 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30cdb90b80 10 client.6933 fetch_fsmap finished waiting for FSMap version 59 2023-10-06T02:59:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30cdb90b80 10 client.6933 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30cdb90b80 20 client.6933 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x563968e84c00 0x563968eb5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30cdb90b80 4 client.6933 mds_command: new command op to 6528 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30cdb90b80 1 -- 172.21.15.84:0/3747540973 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x563968d7bee0 con 0x563968e84c00 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30be59c700 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x563968e84c00 0x563968eb5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f309cff9700 10 client.6933 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.410+0000 7f30be59c700 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x563968e84c00 0x563968eb5640 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=866687bad11a00d0 server_cookie=785e86432a0a246 in_seq=0 out_seq=0 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f309cff9700 1 -- 172.21.15.84:0/3747540973 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563968d7bee0 con 0x563968e84c00 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f309cff9700 10 client.6933 handle_command_reply: tid=0 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 client.6933 shutdown 2023-10-06T02:59:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 -- 172.21.15.84:0/3747540973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 msgr2=0x563968eb5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb5100 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f30b8000f80 tx=0x7f30b8016000 comp rx=0 tx=0).stop 2023-10-06T02:59:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 -- 172.21.15.84:0/3747540973 shutdown_connections 2023-10-06T02:59:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x563968e84c00 0x563968eb5640 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563968e8a3a0 0x563968e9ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f309cff9700 0 client.6933 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563968ea9f30 0x563968eb5100 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 --2- 172.21.15.84:0/3747540973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x563968e8baf0 0x563968f2bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 -- 172.21.15.84:0/3747540973 >> 172.21.15.84:0/3747540973 conn(0x563968e89f60 msgr2=0x563968ed1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.419 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f25007e5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-10-06T02:58:50.596549+0000 1=0+1) n(v3 rc2023-10-06T02:58:50.829546+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={5651=pAsLsXsFsx/pAsLsXsFsx@5},l=5651 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55b539d72100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.596549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.829546+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.596549+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-10-06T02:58:50.829546+0000 6=0+6)","error_str":""},"return_code":-61} 2023-10-06T02:59:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 -- 172.21.15.84:0/3747540973 shutdown_connections 2023-10-06T02:59:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.411+0000 7f30cdb90b80 1 -- 172.21.15.84:0/3747540973 wait complete. 2023-10-06T02:59:09.420 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f594611e700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1) n(v2 rc2023-10-06T02:58:50.829546+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={5651=pAsLsXsFsx/pAsLsXsFsx@4},l=5651 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55c3c1ce0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.829546+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-10-06T02:58:50.829546+0000 4=0+4)","error_str":""},"return_code":-61} 2023-10-06T02:59:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30cdb90b80 20 client.6933 trim_cache size 0 max 16384 2023-10-06T02:59:09.421 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:59:09.421 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2023-10-06T02:59:09.421 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "a080558a-fc87-4f41-9ec5-4620a548a48a", 2023-10-06T02:59:09.421 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2023-10-06T02:59:09.421 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 -- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f30a0066f30 msgr2=0x7f30a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f30a0066f30 0x7f30a00693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f30b4006f00 tx=0x7f30b4008040 comp rx=0 tx=0).stop 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 -- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 msgr2=0x7f30c0150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30c0150f90 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f30b0013ac0 tx=0x7f30b001a000 comp rx=0 tx=0).stop 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 -- 172.21.15.84:0/4112220165 shutdown_connections 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f30a0066f30 0x7f30a00693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c015de30 0x7f30c015e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30a8003a60 0x7f30c0150f90 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 --2- 172.21.15.84:0/4112220165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c00b3100 0x7f30c00b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 -- 172.21.15.84:0/4112220165 >> 172.21.15.84:0/4112220165 conn(0x7f30c0068100 msgr2=0x7f30c015bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 -- 172.21.15.84:0/4112220165 shutdown_connections 2023-10-06T02:59:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.412+0000 7f30bf59e700 1 -- 172.21.15.84:0/4112220165 wait complete. 2023-10-06T02:59:09.424 INFO:tasks.ceph.mds.d.smithi131.stderr:2023-10-06T02:59:09.411+0000 7f553f8fa700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-10-06T02:58:50.599549+0000 1=0+1) n(v0 rc2023-10-06T02:58:50.599549+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={5651=pAsLsXsFsx/pAsLsXsFsx@4},l=5651 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55c301f8b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.599549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.599549+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.599549+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-10-06T02:58:50.599549+0000 2=0+2)","error_str":""},"return_code":-61} 2023-10-06T02:59:09.424 INFO:tasks.ceph.mds.d.smithi131.stderr:2023-10-06T02:59:09.412+0000 7f553f8fa700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={5651=pAsLsXsFsx/AsLsXsFsx@2},l=5651 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55c301ffa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-10-06T02:59:09.424 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T02:59:09.413+0000 7f25067f1700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-10-06T02:58:50.597549+0000 1=0+1) n(v4 rc2023-10-06T02:58:50.829546+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={5651=pAsLsXsFs/pAsLsXsFsx@9} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55b539df8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.597549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.829546+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.597549+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-10-06T02:58:50.829546+0000 5=0+5)","error_str":""},"return_code":-61} 2023-10-06T02:59:09.425 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T02:59:09.413+0000 7f594c12a700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1) n(v1 rc2023-10-06T02:58:50.829546+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={5651=pAsLsXsFs/pAsLsXsFsx@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55c3c1ce0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.599549+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-06T02:58:50.829546+0000 3=0+3)","error_str":""},"return_code":-61} 2023-10-06T02:59:09.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T02:59:09.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.541+0000 7ff246266700 1 Processor -- start 2023-10-06T02:59:09.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.541+0000 7ff246266700 1 -- start start 2023-10-06T02:59:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff246266700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff240157240 0x7ff2400b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff246266700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24006ae00 con 0x7ff240069d50 2023-10-06T02:59:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff246266700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2400c9e00 con 0x7ff2400aff00 2023-10-06T02:59:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff246266700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2400b27c0 con 0x7ff240157240 2023-10-06T02:59:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff23ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff240157240 0x7ff2400b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff23f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff240069d50 0x7ff2400af7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48398/0 (socket says 172.21.15.84:48398) 2023-10-06T02:59:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff23f7fe700 1 -- 172.21.15.84:0/600381893 learned_addr learned my addr 172.21.15.84:0/600381893 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff23effd700 1 -- 172.21.15.84:0/600381893 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541546213 0 0) 0x7ff24006ae00 con 0x7ff240069d50 2023-10-06T02:59:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff23effd700 1 -- 172.21.15.84:0/600381893 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff22c003570 con 0x7ff240069d50 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff23ffff700 1 -- 172.21.15.84:0/600381893 >> v1:172.21.15.131:6789/0 conn(0x7ff2400aff00 legacy=0x7ff2400677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff23ffff700 1 -- 172.21.15.84:0/600381893 >> v1:172.21.15.84:6789/0 conn(0x7ff240069d50 legacy=0x7ff2400af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff23ffff700 1 -- 172.21.15.84:0/600381893 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24006a1f0 con 0x7ff240157240 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.542+0000 7ff23ffff700 1 --2- 172.21.15.84:0/600381893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 0x7ff2400b2280 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7ff2300098e0 tx=0x7ff2300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25505f1869e56e82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff23effd700 1 -- 172.21.15.84:0/600381893 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000b640 con 0x7ff240157240 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff23effd700 1 -- 172.21.15.84:0/600381893 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23000b7a0 con 0x7ff240157240 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff23effd700 1 -- 172.21.15.84:0/600381893 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000bb40 con 0x7ff240157240 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff246266700 1 -- 172.21.15.84:0/600381893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 msgr2=0x7ff2400b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff246266700 1 --2- 172.21.15.84:0/600381893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 0x7ff2400b2280 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7ff2300098e0 tx=0x7ff2300091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff246266700 1 -- 172.21.15.84:0/600381893 shutdown_connections 2023-10-06T02:59:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff246266700 1 --2- 172.21.15.84:0/600381893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 0x7ff2400b2280 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff246266700 1 -- 172.21.15.84:0/600381893 >> 172.21.15.84:0/600381893 conn(0x7ff2400cd430 msgr2=0x7ff2400c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff246266700 1 -- 172.21.15.84:0/600381893 shutdown_connections 2023-10-06T02:59:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.543+0000 7ff246266700 1 -- 172.21.15.84:0/600381893 wait complete. 2023-10-06T02:59:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.544+0000 7ff246266700 1 Processor -- start 2023-10-06T02:59:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.544+0000 7ff246266700 1 -- start start 2023-10-06T02:59:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff246266700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff240069d50 0x7ff24015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff246266700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2400aff00 0x7ff240155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff246266700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 0x7ff240151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff246266700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400c3090 con 0x7ff240157240 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff246266700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24015bb50 con 0x7ff240069d50 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff246266700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400c8da0 con 0x7ff2400aff00 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff244803700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 0x7ff240151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff244803700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 0x7ff240151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48980/0 (socket says 172.21.15.84:48980) 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff244803700 1 -- 172.21.15.84:0/1168196572 learned_addr learned my addr 172.21.15.84:0/1168196572 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff23ffff700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff240069d50 0x7ff24015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.545+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2400aff00 0x7ff240155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff244803700 1 -- 172.21.15.84:0/1168196572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2400aff00 msgr2=0x7ff240155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff244803700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2400aff00 0x7ff240155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff244803700 1 -- 172.21.15.84:0/1168196572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff240069d50 msgr2=0x7ff24015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff244803700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff240069d50 0x7ff24015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff244803700 1 -- 172.21.15.84:0/1168196572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff230009420 con 0x7ff240157240 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff23ffff700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff240069d50 0x7ff24015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff244803700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 0x7ff240151ae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c910 tx=0x7ff238001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff237fff700 1 -- 172.21.15.84:0/1168196572 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23800a7a0 con 0x7ff240157240 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff237fff700 1 -- 172.21.15.84:0/1168196572 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23800a900 con 0x7ff240157240 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff246266700 1 -- 172.21.15.84:0/1168196572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2400c27f0 con 0x7ff240157240 2023-10-06T02:59:09.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff237fff700 1 -- 172.21.15.84:0/1168196572 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23800acc0 con 0x7ff240157240 2023-10-06T02:59:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.546+0000 7ff246266700 1 -- 172.21.15.84:0/1168196572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2400c2db0 con 0x7ff240157240 2023-10-06T02:59:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.547+0000 7ff237fff700 1 -- 172.21.15.84:0/1168196572 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff238012630 con 0x7ff240157240 2023-10-06T02:59:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.548+0000 7ff237fff700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff220066f30 0x7ff2200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.548+0000 7ff237fff700 1 -- 172.21.15.84:0/1168196572 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff238084b30 con 0x7ff240157240 2023-10-06T02:59:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.548+0000 7ff23ffff700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff220066f30 0x7ff2200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.548+0000 7ff23ffff700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff220066f30 0x7ff2200693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff2300093f0 tx=0x7ff230017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.550+0000 7ff24f55eb80 1 Processor -- start 2023-10-06T02:59:09.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.550+0000 7ff24f55eb80 1 -- start start 2023-10-06T02:59:09.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5cd7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d27710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5d280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe5c2eac0 con 0x560fe5cd8d10 2023-10-06T02:59:09.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe5c2c2c0 con 0x560fe5cd7890 2023-10-06T02:59:09.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560fe5c280b0 con 0x560fe5d27c50 2023-10-06T02:59:09.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d27710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d27710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48992/0 (socket says 172.21.15.84:48992) 2023-10-06T02:59:09.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23f7fe700 1 -- 172.21.15.84:0/4037937320 learned_addr learned my addr 172.21.15.84:0/4037937320 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23ffff700 1 --2- 172.21.15.84:0/4037937320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5cd7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff244803700 1 --2- 172.21.15.84:0/4037937320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5d280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23f7fe700 1 -- 172.21.15.84:0/4037937320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 msgr2=0x560fe5d280a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/4037937320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5d280a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23f7fe700 1 -- 172.21.15.84:0/4037937320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 msgr2=0x560fe5cd7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/4037937320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5cd7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23f7fe700 1 -- 172.21.15.84:0/4037937320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fe5ac22c0 con 0x560fe5cd8d10 2023-10-06T02:59:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/4037937320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d27710 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff2280016e0 tx=0x7ff228009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29b5bdf20ee6fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff2357fa700 1 -- 172.21.15.84:0/4037937320 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228005b10 con 0x560fe5cd8d10 2023-10-06T02:59:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff2357fa700 1 -- 172.21.15.84:0/4037937320 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff228005c70 con 0x560fe5cd8d10 2023-10-06T02:59:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.551+0000 7ff2357fa700 1 -- 172.21.15.84:0/4037937320 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228007110 con 0x560fe5cd8d10 2023-10-06T02:59:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.552+0000 7ff24f55eb80 1 -- 172.21.15.84:0/4037937320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 msgr2=0x560fe5d27710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.552+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/4037937320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d27710 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff2280016e0 tx=0x7ff228009040 comp rx=0 tx=0).stop 2023-10-06T02:59:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.552+0000 7ff24f55eb80 1 -- 172.21.15.84:0/4037937320 shutdown_connections 2023-10-06T02:59:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.552+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/4037937320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5cd7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.552+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/4037937320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5d280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.552+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/4037937320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d27710 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.552+0000 7ff24f55eb80 1 -- 172.21.15.84:0/4037937320 >> 172.21.15.84:0/4037937320 conn(0x560fe5cd91b0 msgr2=0x560fe5cd9580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.552+0000 7ff24f55eb80 1 -- 172.21.15.84:0/4037937320 shutdown_connections 2023-10-06T02:59:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.552+0000 7ff24f55eb80 1 -- 172.21.15.84:0/4037937320 wait complete. 2023-10-06T02:59:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.553+0000 7ff24f55eb80 1 -- start start 2023-10-06T02:59:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.553+0000 7ff24f55eb80 1 Processor -- start 2023-10-06T02:59:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.553+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd7890 0x560fe5d317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.553+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5cd8d10 0x560fe5d31d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.553+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5d27c50 0x560fe5d15f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.553+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe5bd38e0 con 0x560fe5cd7890 2023-10-06T02:59:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.553+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe5beeef0 con 0x560fe5d27c50 2023-10-06T02:59:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.553+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560fe5aaae80 con 0x560fe5cd8d10 2023-10-06T02:59:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd7890 0x560fe5d317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff24f55eb80 10 client.0 _ll_register_callbacks cb 0x560fe5c9aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd7890 0x560fe5d317d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49000/0 (socket says 172.21.15.84:49000) 2023-10-06T02:59:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23ffff700 1 -- 172.21.15.84:0/1271876896 learned_addr learned my addr 172.21.15.84:0/1271876896 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5cd8d10 0x560fe5d31d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff244803700 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5d27c50 0x560fe5d15f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23ffff700 1 -- 172.21.15.84:0/1271876896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5cd8d10 msgr2=0x560fe5d31d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23ffff700 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5cd8d10 0x560fe5d31d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23ffff700 1 -- 172.21.15.84:0/1271876896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5d27c50 msgr2=0x560fe5d15f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23ffff700 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5d27c50 0x560fe5d15f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23ffff700 1 -- 172.21.15.84:0/1271876896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22800f040 con 0x560fe5cd7890 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff244803700 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5d27c50 0x560fe5d15f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff23ffff700 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd7890 0x560fe5d317d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff2400c9330 tx=0x7ff230020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9925ec52ad19332 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff21e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff21e7fc700 1 -- 172.21.15.84:0/1271876896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23002f070 con 0x560fe5cd7890 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff21e7fc700 1 -- 172.21.15.84:0/1271876896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff230026640 con 0x560fe5cd7890 2023-10-06T02:59:09.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff24f55eb80 1 -- 172.21.15.84:0/1271876896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560fe5ccc990 con 0x560fe5cd7890 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff21e7fc700 1 -- 172.21.15.84:0/1271876896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff230020070 con 0x560fe5cd7890 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff24f55eb80 10 client.6948 fetch_fsmap learned FSMap version 59 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff24f55eb80 1 -- 172.21.15.84:0/1271876896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x560fe5a65030 con 0x560fe5cd7890 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff21e7fc700 1 -- 172.21.15.84:0/1271876896 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560fe5ccc990 con 0x560fe5cd7890 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff21e7fc700 1 -- 172.21.15.84:0/1271876896 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 59) v1 ==== 3140+0+0 (secure 0 0 0) 0x7ff230026a10 con 0x560fe5cd7890 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff24f55eb80 10 client.6948 fetch_fsmap finished waiting for FSMap version 59 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.554+0000 7ff24f55eb80 10 client.6948 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff24f55eb80 20 client.6948 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560fe5d00a00 0x560fe5d16480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff24f55eb80 4 client.6948 mds_command: new command op to 6528 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:59:09.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff24f55eb80 1 -- 172.21.15.84:0/1271876896 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560fe5ca98c0 con 0x560fe5d00a00 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560fe5d00a00 0x560fe5d16480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff21e7fc700 10 client.6948 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560fe5d00a00 0x560fe5d16480 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=380ca4002b946670 server_cookie=bc5e6a04c38e02db in_seq=0 out_seq=0 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff21e7fc700 1 -- 172.21.15.84:0/1271876896 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560fe5ca98c0 con 0x560fe5d00a00 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff21e7fc700 10 client.6948 handle_command_reply: tid=0 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.555+0000 7ff24f55eb80 1 client.6948 shutdown 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 -- 172.21.15.84:0/1271876896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd7890 msgr2=0x560fe5d317d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd7890 0x560fe5d317d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff2400c9330 tx=0x7ff230020000 comp rx=0 tx=0).stop 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 -- 172.21.15.84:0/1271876896 shutdown_connections 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560fe5d00a00 0x560fe5d16480 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5d27c50 0x560fe5d15f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd7890 0x560fe5d317d0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff21e7fc700 0 client.6948 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/1271876896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5cd8d10 0x560fe5d31d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 -- 172.21.15.84:0/1271876896 >> 172.21.15.84:0/1271876896 conn(0x560fe5cd91b0 msgr2=0x560fe5cd8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 -- 172.21.15.84:0/1271876896 shutdown_connections 2023-10-06T02:59:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 1 -- 172.21.15.84:0/1271876896 wait complete. 2023-10-06T02:59:09.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.556+0000 7ff24f55eb80 20 client.6948 trim_cache size 0 max 16384 2023-10-06T02:59:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.572+0000 7ff24f55eb80 1 Processor -- start 2023-10-06T02:59:09.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.572+0000 7ff24f55eb80 1 -- start start 2023-10-06T02:59:09.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.572+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d25840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.572+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5cd5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5d1b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe5d321c0 con 0x560fe5cd8d10 2023-10-06T02:59:09.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe5cd23c0 con 0x560fe5cd7890 2023-10-06T02:59:09.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560fe5d23ad0 con 0x560fe5d27c50 2023-10-06T02:59:09.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5cd5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5cd5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49002/0 (socket says 172.21.15.84:49002) 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23f7fe700 1 -- 172.21.15.84:0/651241682 learned_addr learned my addr 172.21.15.84:0/651241682 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23ffff700 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d25840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff244803700 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5d1b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23f7fe700 1 -- 172.21.15.84:0/651241682 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 msgr2=0x560fe5d1b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5d1b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23f7fe700 1 -- 172.21.15.84:0/651241682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 msgr2=0x560fe5d25840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d25840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23f7fe700 1 -- 172.21.15.84:0/651241682 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fe5bf67d0 con 0x560fe5cd8d10 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23ffff700 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d25840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5cd5a60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff2280058d0 tx=0x7ff228029250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd82c6a2b3ac848 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff235ffb700 1 -- 172.21.15.84:0/651241682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228026070 con 0x560fe5cd8d10 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff235ffb700 1 -- 172.21.15.84:0/651241682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff228007a80 con 0x560fe5cd8d10 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.573+0000 7ff235ffb700 1 -- 172.21.15.84:0/651241682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228007480 con 0x560fe5cd8d10 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.574+0000 7ff24f55eb80 1 -- 172.21.15.84:0/651241682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 msgr2=0x560fe5cd5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.574+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5cd5a60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff2280058d0 tx=0x7ff228029250 comp rx=0 tx=0).stop 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.574+0000 7ff24f55eb80 1 -- 172.21.15.84:0/651241682 shutdown_connections 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.574+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d25840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.574+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5d1b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.574+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/651241682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5cd5a60 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.574+0000 7ff24f55eb80 1 -- 172.21.15.84:0/651241682 >> 172.21.15.84:0/651241682 conn(0x560fe5cd91b0 msgr2=0x560fe5cd02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.574+0000 7ff24f55eb80 1 -- 172.21.15.84:0/651241682 shutdown_connections 2023-10-06T02:59:09.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.574+0000 7ff24f55eb80 1 -- 172.21.15.84:0/651241682 wait complete. 2023-10-06T02:59:09.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff24f55eb80 1 -- start start 2023-10-06T02:59:09.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff24f55eb80 1 Processor -- start 2023-10-06T02:59:09.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d26880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d83730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff24f55eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5cfca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe5d83c70 con 0x560fe5cd8d10 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe5d85320 con 0x560fe5cd7890 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff24f55eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x560fe5d26ed0 con 0x560fe5d27c50 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff24f55eb80 10 client.0 _ll_register_callbacks cb 0x560fe5c9aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff23f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d83730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff23f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d83730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49006/0 (socket says 172.21.15.84:49006) 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.575+0000 7ff23f7fe700 1 -- 172.21.15.84:0/3003024282 learned_addr learned my addr 172.21.15.84:0/3003024282 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff23ffff700 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d26880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff244803700 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5cfca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff23f7fe700 1 -- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 msgr2=0x560fe5cfca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5cfca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff23f7fe700 1 -- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 msgr2=0x560fe5d26880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:09.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d26880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff23f7fe700 1 -- 172.21.15.84:0/3003024282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fe5ac22c0 con 0x560fe5cd8d10 2023-10-06T02:59:09.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff23ffff700 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d26880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff244803700 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5cfca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:09.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff23f7fe700 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d83730 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff228012000 tx=0x7ff228026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379b9ba4b3a22fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:09.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff21e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:09.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff21e7fc700 1 -- 172.21.15.84:0/3003024282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280074f0 con 0x560fe5cd8d10 2023-10-06T02:59:09.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff21e7fc700 1 -- 172.21.15.84:0/3003024282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff228014450 con 0x560fe5cd8d10 2023-10-06T02:59:09.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff24f55eb80 1 -- 172.21.15.84:0/3003024282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff228005c70 con 0x560fe5cd8d10 2023-10-06T02:59:09.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff21e7fc700 1 -- 172.21.15.84:0/3003024282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff228014820 con 0x560fe5cd8d10 2023-10-06T02:59:09.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff24f55eb80 10 client.6954 fetch_fsmap learned FSMap version 59 2023-10-06T02:59:09.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff24f55eb80 1 -- 172.21.15.84:0/3003024282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x560fe5bdd4c0 con 0x560fe5cd8d10 2023-10-06T02:59:09.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff21e7fc700 1 -- 172.21.15.84:0/3003024282 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff228005c70 con 0x560fe5cd8d10 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff21e7fc700 1 -- 172.21.15.84:0/3003024282 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 59) v1 ==== 3140+0+0 (secure 0 0 0) 0x7ff228001710 con 0x560fe5cd8d10 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff24f55eb80 10 client.6954 fetch_fsmap finished waiting for FSMap version 59 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff24f55eb80 10 client.6954 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff24f55eb80 20 client.6954 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560fe5d21610 0x560fe5cfcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff24f55eb80 4 client.6954 mds_command: new command op to 6528 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.576+0000 7ff24f55eb80 1 -- 172.21.15.84:0/3003024282 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560fe5bcae50 con 0x560fe5d21610 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff23ffff700 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560fe5d21610 0x560fe5cfcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff21e7fc700 10 client.6954 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff23ffff700 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560fe5d21610 0x560fe5cfcfa0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f7717c3e998895c server_cookie=160a0a820247e7d6 in_seq=0 out_seq=0 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff21e7fc700 1 -- 172.21.15.84:0/3003024282 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x560fe5bcae50 con 0x560fe5d21610 2023-10-06T02:59:09.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff21e7fc700 10 client.6954 handle_command_reply: tid=0 2023-10-06T02:59:09.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 client.6954 shutdown 2023-10-06T02:59:09.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 -- 172.21.15.84:0/3003024282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 msgr2=0x560fe5d83730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d83730 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff228012000 tx=0x7ff228026000 comp rx=0 tx=0).stop 2023-10-06T02:59:09.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 -- 172.21.15.84:0/3003024282 shutdown_connections 2023-10-06T02:59:09.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x560fe5d21610 0x560fe5cfcfa0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fe5cd7890 0x560fe5d26880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x560fe5d27c50 0x560fe5cfca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 --2- 172.21.15.84:0/3003024282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fe5cd8d10 0x560fe5d83730 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 -- 172.21.15.84:0/3003024282 >> 172.21.15.84:0/3003024282 conn(0x560fe5cd91b0 msgr2=0x560fe5cd8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff21e7fc700 0 client.6954 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:09.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 -- 172.21.15.84:0/3003024282 shutdown_connections 2023-10-06T02:59:09.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 1 -- 172.21.15.84:0/3003024282 wait complete. 2023-10-06T02:59:09.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.577+0000 7ff24f55eb80 20 client.6954 trim_cache size 0 max 16384 2023-10-06T02:59:09.587 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:59:09.587 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T02:59:09.587 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T02:59:09.587 INFO:teuthology.orchestra.run.smithi084.stdout: "a080558a-fc87-4f41-9ec5-4620a548a48a": { 2023-10-06T02:59:09.587 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T02:59:09.588 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "a080558a-fc87-4f41-9ec5-4620a548a48a", 2023-10-06T02:59:09.588 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T02:59:09.588 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:09.588 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:09.588 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:59:09.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 -- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff220066f30 msgr2=0x7ff2200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff220066f30 0x7ff2200693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff2300093f0 tx=0x7ff230017000 comp rx=0 tx=0).stop 2023-10-06T02:59:09.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 -- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 msgr2=0x7ff240151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:09.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 0x7ff240151ae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c910 tx=0x7ff238001710 comp rx=0 tx=0).stop 2023-10-06T02:59:09.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 -- 172.21.15.84:0/1168196572 shutdown_connections 2023-10-06T02:59:09.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff220066f30 0x7ff2200693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff240069d50 0x7ff24015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff240157240 0x7ff240151ae0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 --2- 172.21.15.84:0/1168196572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff2400aff00 0x7ff240155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:09.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 -- 172.21.15.84:0/1168196572 >> 172.21.15.84:0/1168196572 conn(0x7ff2400cd430 msgr2=0x7ff2400677a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:09.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 -- 172.21.15.84:0/1168196572 shutdown_connections 2023-10-06T02:59:09.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:09.578+0000 7ff246266700 1 -- 172.21.15.84:0/1168196572 wait complete. 2023-10-06T02:59:09.593 INFO:tasks.cephfs.filesystem:scrub status for tag:a080558a-fc87-4f41-9ec5-4620a548a48a - {'path': '/d1/d2/d3', 'tag': 'a080558a-fc87-4f41-9ec5-4620a548a48a', 'options': 'recursive,force'} 2023-10-06T02:59:15.231 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T02:59:15.231+0000 7fedc1127700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T02:59:22.136 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T02:59:22.135+0000 7fedc1127700 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T02:59:36.723 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:36.727 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:39.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-10-06T02:59:39.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.721+0000 7fe15d6f3700 1 Processor -- start 2023-10-06T02:59:39.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.721+0000 7fe15d6f3700 1 -- start start 2023-10-06T02:59:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe15d6f3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2660 0x7fe1580cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe15d6f3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe1580b2a30 0x7fe1580cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe15d6f3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe1580ceae0 0x7fe1580cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe15d6f3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1580cc9b0 con 0x7fe1580b2a30 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe15d6f3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1580cf4c0 con 0x7fe1580ceae0 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe15d6f3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580cbda0 con 0x7fe1580b2660 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe1577fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe1580b2a30 0x7fe1580cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe1577fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe1580b2a30 0x7fe1580cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53608/0 (socket says 172.21.15.84:53608) 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe1577fe700 1 -- 172.21.15.84:0/1899436382 learned_addr learned my addr 172.21.15.84:0/1899436382 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe15cef2700 1 --2- 172.21.15.84:0/1899436382 >> v2:172.21.15.131:3300/0 conn(0x7fe1580ceae0 0x7fe1580cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe157fff700 1 --2- 172.21.15.84:0/1899436382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2660 0x7fe1580cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe1577fe700 1 -- 172.21.15.84:0/1899436382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2660 msgr2=0x7fe1580cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe1577fe700 1 --2- 172.21.15.84:0/1899436382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2660 0x7fe1580cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe1577fe700 1 -- 172.21.15.84:0/1899436382 >> v2:172.21.15.131:3300/0 conn(0x7fe1580ceae0 msgr2=0x7fe1580cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe1577fe700 1 --2- 172.21.15.84:0/1899436382 >> v2:172.21.15.131:3300/0 conn(0x7fe1580ceae0 0x7fe1580cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.722+0000 7fe1577fe700 1 -- 172.21.15.84:0/1899436382 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580cc080 con 0x7fe1580b2a30 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe157fff700 1 --2- 172.21.15.84:0/1899436382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2660 0x7fe1580cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe1577fe700 1 --2- 172.21.15.84:0/1899436382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2a30 0x7fe1580cd230 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe158089690 tx=0x7fe14c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64525760a285528b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe156ffd700 1 -- 172.21.15.84:0/1899436382 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00b860 con 0x7fe1580b2a30 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe156ffd700 1 -- 172.21.15.84:0/1899436382 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c00b9c0 con 0x7fe1580b2a30 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe156ffd700 1 -- 172.21.15.84:0/1899436382 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00bd60 con 0x7fe1580b2a30 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe15d6f3700 1 -- 172.21.15.84:0/1899436382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2a30 msgr2=0x7fe1580cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/1899436382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2a30 0x7fe1580cd230 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe158089690 tx=0x7fe14c009250 comp rx=0 tx=0).stop 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe15d6f3700 1 -- 172.21.15.84:0/1899436382 shutdown_connections 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/1899436382 >> v2:172.21.15.131:3300/0 conn(0x7fe1580ceae0 0x7fe1580cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/1899436382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2660 0x7fe1580cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/1899436382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2a30 0x7fe1580cd230 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe15d6f3700 1 -- 172.21.15.84:0/1899436382 >> 172.21.15.84:0/1899436382 conn(0x7fe158099560 msgr2=0x7fe15806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe15d6f3700 1 -- 172.21.15.84:0/1899436382 shutdown_connections 2023-10-06T02:59:39.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.723+0000 7fe15d6f3700 1 -- 172.21.15.84:0/1899436382 wait complete. 2023-10-06T02:59:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.724+0000 7fe15d6f3700 1 Processor -- start 2023-10-06T02:59:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.725+0000 7fe15d6f3700 1 -- start start 2023-10-06T02:59:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.725+0000 7fe15d6f3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2660 0x7fe1580c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.725+0000 7fe15d6f3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2a30 0x7fe1581521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.725+0000 7fe15d6f3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1580ceae0 0x7fe1580c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.725+0000 7fe15d6f3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580ca640 con 0x7fe1580b2660 2023-10-06T02:59:39.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.725+0000 7fe15d6f3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580ca360 con 0x7fe1580ceae0 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.725+0000 7fe15d6f3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b4210 con 0x7fe1580b2a30 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe157fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2660 0x7fe1580c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe157fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2660 0x7fe1580c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53618/0 (socket says 172.21.15.84:53618) 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe157fff700 1 -- 172.21.15.84:0/3933339002 learned_addr learned my addr 172.21.15.84:0/3933339002 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe1577fe700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2a30 0x7fe1581521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe15cef2700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1580ceae0 0x7fe1580c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe157fff700 1 -- 172.21.15.84:0/3933339002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2a30 msgr2=0x7fe1581521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe157fff700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2a30 0x7fe1581521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe157fff700 1 -- 172.21.15.84:0/3933339002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1580ceae0 msgr2=0x7fe1580c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe157fff700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1580ceae0 0x7fe1580c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe157fff700 1 -- 172.21.15.84:0/3933339002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0094f0 con 0x7fe1580b2660 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe157fff700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2660 0x7fe1580c9d10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c880 tx=0x7fe148008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe13ffff700 1 -- 172.21.15.84:0/3933339002 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148005a00 con 0x7fe1580b2660 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe13ffff700 1 -- 172.21.15.84:0/3933339002 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe148005b60 con 0x7fe1580b2660 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe15d6f3700 1 -- 172.21.15.84:0/3933339002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1580b44f0 con 0x7fe1580b2660 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe13ffff700 1 -- 172.21.15.84:0/3933339002 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148011600 con 0x7fe1580b2660 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.726+0000 7fe15d6f3700 1 -- 172.21.15.84:0/3933339002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158169a20 con 0x7fe1580b2660 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.727+0000 7fe13ffff700 1 -- 172.21.15.84:0/3933339002 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1480119f0 con 0x7fe1580b2660 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.728+0000 7fe13ffff700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe144066f30 0x7fe1440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.728+0000 7fe13ffff700 1 -- 172.21.15.84:0/3933339002 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe1480844f0 con 0x7fe1580b2660 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.728+0000 7fe1577fe700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe144066f30 0x7fe1440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.728+0000 7fe1577fe700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe144066f30 0x7fe1440693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe158089690 tx=0x7fe14c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.730+0000 7fe167c4db80 1 Processor -- start 2023-10-06T02:59:39.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.730+0000 7fe167c4db80 1 -- start start 2023-10-06T02:59:39.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6399afea0 0x55f63998ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f639990310 0x55f63998b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639991a60 0x55f63998b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe167c4db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6398e5ac0 con 0x55f6399afea0 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe167c4db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6398e32c0 con 0x55f639991a60 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe167c4db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6398df0b0 con 0x55f639990310 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe157fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6399afea0 0x55f63998ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe157fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6399afea0 0x55f63998ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53630/0 (socket says 172.21.15.84:53630) 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe157fff700 1 -- 172.21.15.84:0/4043754976 learned_addr learned my addr 172.21.15.84:0/4043754976 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe157fff700 1 -- 172.21.15.84:0/4043754976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f639990310 msgr2=0x55f63998b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe157fff700 1 --2- 172.21.15.84:0/4043754976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f639990310 0x55f63998b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe157fff700 1 -- 172.21.15.84:0/4043754976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639991a60 msgr2=0x55f63998b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe157fff700 1 --2- 172.21.15.84:0/4043754976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639991a60 0x55f63998b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe157fff700 1 -- 172.21.15.84:0/4043754976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6397792c0 con 0x55f6399afea0 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe157fff700 1 --2- 172.21.15.84:0/4043754976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6399afea0 0x55f63998ad10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe148082760 tx=0x7fe148082690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f522a8279aa6a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.731+0000 7fe13d7fa700 1 -- 172.21.15.84:0/4043754976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14805c0e0 con 0x55f6399afea0 2023-10-06T02:59:39.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe13d7fa700 1 -- 172.21.15.84:0/4043754976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe148053280 con 0x55f6399afea0 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe13d7fa700 1 -- 172.21.15.84:0/4043754976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148054630 con 0x55f6399afea0 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe167c4db80 1 -- 172.21.15.84:0/4043754976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6399afea0 msgr2=0x55f63998ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe167c4db80 1 --2- 172.21.15.84:0/4043754976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6399afea0 0x55f63998ad10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe148082760 tx=0x7fe148082690 comp rx=0 tx=0).stop 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe167c4db80 1 -- 172.21.15.84:0/4043754976 shutdown_connections 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe167c4db80 1 --2- 172.21.15.84:0/4043754976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639991a60 0x55f63998b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe167c4db80 1 --2- 172.21.15.84:0/4043754976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6399afea0 0x55f63998ad10 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe167c4db80 1 --2- 172.21.15.84:0/4043754976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f639990310 0x55f63998b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe167c4db80 1 -- 172.21.15.84:0/4043754976 >> 172.21.15.84:0/4043754976 conn(0x55f63998fed0 msgr2=0x55f639990700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe167c4db80 1 -- 172.21.15.84:0/4043754976 shutdown_connections 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.732+0000 7fe167c4db80 1 -- 172.21.15.84:0/4043754976 wait complete. 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.733+0000 7fe167c4db80 1 -- start start 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.733+0000 7fe167c4db80 1 Processor -- start 2023-10-06T02:59:39.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 0x55f6399e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 0x55f6399ae920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe167c4db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f63988a8e0 con 0x55f639991a60 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe167c4db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6398a5ef0 con 0x55f639990310 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe167c4db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f639761e80 con 0x55f6399afea0 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe167c4db80 10 client.0 _ll_register_callbacks cb 0x55f639952070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1577fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1577fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53636/0 (socket says 172.21.15.84:53636) 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1577fe700 1 -- 172.21.15.84:0/443649315 learned_addr learned my addr 172.21.15.84:0/443649315 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe15cef2700 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 0x55f6399ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe157fff700 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 0x55f6399e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1577fe700 1 -- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 msgr2=0x55f6399ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1577fe700 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 0x55f6399ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1577fe700 1 -- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 msgr2=0x55f6399e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1577fe700 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 0x55f6399e4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1577fe700 1 -- 172.21.15.84:0/443649315 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158169a20 con 0x55f639991a60 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe15cef2700 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 0x55f6399ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe157fff700 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 0x55f6399e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1577fe700 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399b7ba0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe15806fd00 tx=0x7fe14c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b6f7f7c5c9fde1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1367fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1367fc700 1 -- 172.21.15.84:0/443649315 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c021070 con 0x55f639991a60 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe1367fc700 1 -- 172.21.15.84:0/443649315 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe14c011e20 con 0x55f639991a60 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.734+0000 7fe167c4db80 1 -- 172.21.15.84:0/443649315 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f639983990 con 0x55f639991a60 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe1367fc700 1 -- 172.21.15.84:0/443649315 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe14c029840 con 0x55f639991a60 2023-10-06T02:59:39.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe167c4db80 10 client.6966 fetch_fsmap learned FSMap version 61 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe167c4db80 1 -- 172.21.15.84:0/443649315 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x55f63971c030 con 0x55f639991a60 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe1367fc700 1 -- 172.21.15.84:0/443649315 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f639983990 con 0x55f639991a60 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe1367fc700 1 -- 172.21.15.84:0/443649315 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 61) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fe14c0299a0 con 0x55f639991a60 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe167c4db80 10 client.6966 fetch_fsmap finished waiting for FSMap version 61 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe167c4db80 10 client.6966 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe167c4db80 20 client.6966 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe167c4db80 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f6399d62f0 0x55f6399bd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe167c4db80 4 client.6966 mds_command: new command op to 6528 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe167c4db80 1 -- 172.21.15.84:0/443649315 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6399608c0 con 0x55f6399d62f0 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe157fff700 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f6399d62f0 0x55f6399bd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe1367fc700 10 client.6966 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.735+0000 7fe157fff700 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f6399d62f0 0x55f6399bd830 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579d4acf50c12ef3 server_cookie=975504c640075ba7 in_seq=0 out_seq=0 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe1367fc700 1 -- 172.21.15.84:0/443649315 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f6399608c0 con 0x55f6399d62f0 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe1367fc700 10 client.6966 handle_command_reply: tid=0 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 client.6966 shutdown 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 -- 172.21.15.84:0/443649315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 msgr2=0x55f6399b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399b7ba0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe15806fd00 tx=0x7fe14c021000 comp rx=0 tx=0).stop 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 -- 172.21.15.84:0/443649315 shutdown_connections 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f6399d62f0 0x55f6399bd830 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 0x55f6399e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe1367fc700 0 client.6966 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 0x55f6399ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 --2- 172.21.15.84:0/443649315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399b7ba0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 -- 172.21.15.84:0/443649315 >> 172.21.15.84:0/443649315 conn(0x55f63998fed0 msgr2=0x55f639985450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 -- 172.21.15.84:0/443649315 shutdown_connections 2023-10-06T02:59:39.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 1 -- 172.21.15.84:0/443649315 wait complete. 2023-10-06T02:59:39.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.736+0000 7fe167c4db80 20 client.6966 trim_cache size 0 max 16384 2023-10-06T02:59:39.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.752+0000 7fe167c4db80 1 Processor -- start 2023-10-06T02:59:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.752+0000 7fe167c4db80 1 -- start start 2023-10-06T02:59:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639990310 0x55f6399bd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f639991a60 0x55f6399ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6399afea0 0x55f6399ad340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe167c4db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6399b1c50 con 0x55f639990310 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe167c4db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6399af490 con 0x55f6399afea0 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe167c4db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6399d76a0 con 0x55f639991a60 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe157fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639990310 0x55f6399bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe157fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639990310 0x55f6399bd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53650/0 (socket says 172.21.15.84:53650) 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe157fff700 1 -- 172.21.15.84:0/3965490627 learned_addr learned my addr 172.21.15.84:0/3965490627 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe157fff700 1 -- 172.21.15.84:0/3965490627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f639991a60 msgr2=0x55f6399ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe157fff700 1 --2- 172.21.15.84:0/3965490627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f639991a60 0x55f6399ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe157fff700 1 -- 172.21.15.84:0/3965490627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6399afea0 msgr2=0x55f6399ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe157fff700 1 --2- 172.21.15.84:0/3965490627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6399afea0 0x55f6399ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe157fff700 1 -- 172.21.15.84:0/3965490627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6398ad7d0 con 0x55f639990310 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.753+0000 7fe157fff700 1 --2- 172.21.15.84:0/3965490627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639990310 0x55f6399bd880 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe1480550d0 tx=0x7fe148080040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b0f427141835c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe13dffb700 1 -- 172.21.15.84:0/3965490627 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148065070 con 0x55f639990310 2023-10-06T02:59:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe13dffb700 1 -- 172.21.15.84:0/3965490627 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14805c0e0 con 0x55f639990310 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe13dffb700 1 -- 172.21.15.84:0/3965490627 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148054630 con 0x55f639990310 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe167c4db80 1 -- 172.21.15.84:0/3965490627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639990310 msgr2=0x55f6399bd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3965490627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639990310 0x55f6399bd880 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe1480550d0 tx=0x7fe148080040 comp rx=0 tx=0).stop 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe167c4db80 1 -- 172.21.15.84:0/3965490627 shutdown_connections 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3965490627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6399afea0 0x55f6399ad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3965490627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639990310 0x55f6399bd880 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3965490627 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f639991a60 0x55f6399ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe167c4db80 1 -- 172.21.15.84:0/3965490627 >> 172.21.15.84:0/3965490627 conn(0x55f63998fed0 msgr2=0x55f6399e4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe167c4db80 1 -- 172.21.15.84:0/3965490627 shutdown_connections 2023-10-06T02:59:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.754+0000 7fe167c4db80 1 -- 172.21.15.84:0/3965490627 wait complete. 2023-10-06T02:59:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.755+0000 7fe167c4db80 1 -- start start 2023-10-06T02:59:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.755+0000 7fe167c4db80 1 Processor -- start 2023-10-06T02:59:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 0x55f6399acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399ad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 0x55f639a3a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6399bacc0 con 0x55f639991a60 2023-10-06T02:59:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6399e56a0 con 0x55f639990310 2023-10-06T02:59:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f6399d7b50 con 0x55f6399afea0 2023-10-06T02:59:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 10 client.0 _ll_register_callbacks cb 0x55f639952070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:39.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1577fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1577fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53666/0 (socket says 172.21.15.84:53666) 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1577fe700 1 -- 172.21.15.84:0/3883628547 learned_addr learned my addr 172.21.15.84:0/3883628547 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1577fe700 1 -- 172.21.15.84:0/3883628547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 msgr2=0x55f639a3a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1577fe700 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 0x55f639a3a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1577fe700 1 -- 172.21.15.84:0/3883628547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 msgr2=0x55f6399acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1577fe700 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 0x55f6399acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1577fe700 1 -- 172.21.15.84:0/3883628547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6397792c0 con 0x55f639991a60 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1577fe700 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399ad110 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0094c0 tx=0x7fe14c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1731b4e72427786 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1367fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1367fc700 1 -- 172.21.15.84:0/3883628547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c021070 con 0x55f639991a60 2023-10-06T02:59:39.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1367fc700 1 -- 172.21.15.84:0/3883628547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe14c0337a0 con 0x55f639991a60 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 1 -- 172.21.15.84:0/3883628547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe148053280 con 0x55f639991a60 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe1367fc700 1 -- 172.21.15.84:0/3883628547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe14c029b20 con 0x55f639991a60 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 10 client.6972 fetch_fsmap learned FSMap version 61 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.756+0000 7fe167c4db80 1 -- 172.21.15.84:0/3883628547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x55f6398944c0 con 0x55f639991a60 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe1367fc700 1 -- 172.21.15.84:0/3883628547 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe148053280 con 0x55f639991a60 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe1367fc700 1 -- 172.21.15.84:0/3883628547 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 61) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fe14c033b70 con 0x55f639991a60 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 10 client.6972 fetch_fsmap finished waiting for FSMap version 61 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 10 client.6972 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 20 client.6972 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f6399ba880 0x55f639a3abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 4 client.6972 mds_command: new command op to 6528 tid=0[{"prefix": "scrub status"}] 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 -- 172.21.15.84:0/3883628547 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f639881e50 con 0x55f6399ba880 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe157fff700 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f6399ba880 0x55f639a3abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe1367fc700 10 client.6972 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe157fff700 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f6399ba880 0x55f639a3abb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2eb7e7d79d0319e server_cookie=c507b2b3e4aedcfa in_seq=0 out_seq=0 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe1367fc700 1 -- 172.21.15.84:0/3883628547 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f639881e50 con 0x55f6399ba880 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe1367fc700 10 client.6972 handle_command_reply: tid=0 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 client.6972 shutdown 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 -- 172.21.15.84:0/3883628547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 msgr2=0x55f6399ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399ad110 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0094c0 tx=0x7fe14c02c040 comp rx=0 tx=0).stop 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 -- 172.21.15.84:0/3883628547 shutdown_connections 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f6399ba880 0x55f639a3abb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f639990310 0x55f6399acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f6399afea0 0x55f639a3a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe1367fc700 0 client.6972 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:39.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 --2- 172.21.15.84:0/3883628547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f639991a60 0x55f6399ad110 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 -- 172.21.15.84:0/3883628547 >> 172.21.15.84:0/3883628547 conn(0x55f63998fed0 msgr2=0x55f6399e4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.757+0000 7fe167c4db80 1 -- 172.21.15.84:0/3883628547 shutdown_connections 2023-10-06T02:59:39.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe167c4db80 1 -- 172.21.15.84:0/3883628547 wait complete. 2023-10-06T02:59:39.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe167c4db80 20 client.6972 trim_cache size 0 max 16384 2023-10-06T02:59:39.766 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:59:39.766 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2023-10-06T02:59:39.767 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {} 2023-10-06T02:59:39.767 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:59:39.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 -- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe144066f30 msgr2=0x7fe1440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe144066f30 0x7fe1440693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe158089690 tx=0x7fe14c017000 comp rx=0 tx=0).stop 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 -- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2660 msgr2=0x7fe1580c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2660 0x7fe1580c9d10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c880 tx=0x7fe148008040 comp rx=0 tx=0).stop 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 -- 172.21.15.84:0/3933339002 shutdown_connections 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe144066f30 0x7fe1440693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1580ceae0 0x7fe1580c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1580b2660 0x7fe1580c9d10 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 --2- 172.21.15.84:0/3933339002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1580b2a30 0x7fe1581521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 -- 172.21.15.84:0/3933339002 >> 172.21.15.84:0/3933339002 conn(0x7fe158099560 msgr2=0x7fe158156530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 -- 172.21.15.84:0/3933339002 shutdown_connections 2023-10-06T02:59:39.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.758+0000 7fe15d6f3700 1 -- 172.21.15.84:0/3933339002 wait complete. 2023-10-06T02:59:39.771 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T02:59:39.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 damage ls 2023-10-06T02:59:39.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.885+0000 7f8db22b8700 1 Processor -- start 2023-10-06T02:59:39.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.885+0000 7f8db22b8700 1 -- start start 2023-10-06T02:59:39.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.886+0000 7f8db22b8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dac155780 0x7f8dac0c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.886+0000 7f8db22b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac0c9c40 0x7f8dac0675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.886+0000 7f8db22b8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac0c6ff0 con 0x7f8dac069a10 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.886+0000 7f8db22b8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dac0c7590 con 0x7f8dac155780 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.886+0000 7f8db22b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0caeb0 con 0x7f8dac0c9c40 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.886+0000 7f8db12b6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dac155780 0x7f8dac0c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.886+0000 7f8db12b6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8dac155780 0x7f8dac0c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53674/0 (socket says 172.21.15.84:53674) 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.886+0000 7f8db12b6700 1 -- 172.21.15.84:0/2790671970 learned_addr learned my addr 172.21.15.84:0/2790671970 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db12b6700 1 -- 172.21.15.84:0/2790671970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac0c9c40 msgr2=0x7f8dac0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/2790671970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac0c9c40 0x7f8dac0675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db12b6700 1 --2- 172.21.15.84:0/2790671970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac0c9c40 0x7f8dac0675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db12b6700 1 -- 172.21.15.84:0/2790671970 >> v1:172.21.15.131:6789/0 conn(0x7f8dac069a10 legacy=0x7f8dac0c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db12b6700 1 -- 172.21.15.84:0/2790671970 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac0cb190 con 0x7f8dac155780 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/2790671970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac0c9c40 0x7f8dac0675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db12b6700 1 --2- 172.21.15.84:0/2790671970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac155780 0x7f8dac0c8990 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8da800c0d0 tx=0x7f8da800a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e108ac2e8045b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8da3fff700 1 -- 172.21.15.84:0/2790671970 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800f070 con 0x7f8dac155780 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8da3fff700 1 -- 172.21.15.84:0/2790671970 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da800a2e0 con 0x7f8dac155780 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8da3fff700 1 -- 172.21.15.84:0/2790671970 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800cdf0 con 0x7f8dac155780 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db22b8700 1 -- 172.21.15.84:0/2790671970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac155780 msgr2=0x7f8dac0c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db22b8700 1 --2- 172.21.15.84:0/2790671970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac155780 0x7f8dac0c8990 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8da800c0d0 tx=0x7f8da800a950 comp rx=0 tx=0).stop 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db22b8700 1 -- 172.21.15.84:0/2790671970 shutdown_connections 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db22b8700 1 --2- 172.21.15.84:0/2790671970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac155780 0x7f8dac0c8990 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db22b8700 1 --2- 172.21.15.84:0/2790671970 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac0c9c40 0x7f8dac0675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.887+0000 7f8db22b8700 1 -- 172.21.15.84:0/2790671970 >> 172.21.15.84:0/2790671970 conn(0x7f8dac0cd220 msgr2=0x7f8dac0c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.888+0000 7f8db22b8700 1 -- 172.21.15.84:0/2790671970 shutdown_connections 2023-10-06T02:59:39.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.888+0000 7f8db22b8700 1 -- 172.21.15.84:0/2790671970 wait complete. 2023-10-06T02:59:39.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.889+0000 7f8db22b8700 1 Processor -- start 2023-10-06T02:59:39.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.889+0000 7f8db22b8700 1 -- start start 2023-10-06T02:59:39.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.889+0000 7f8db22b8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac069a10 0x7f8dac150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.889+0000 7f8db22b8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dac0c9c40 0x7f8dac168a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.889+0000 7f8db22b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac155780 0x7f8dac168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.889+0000 7f8db22b8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac169800 con 0x7f8dac069a10 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db22b8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac169ae0 con 0x7f8dac0c9c40 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db22b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac169dc0 con 0x7f8dac155780 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db12b6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac069a10 0x7f8dac150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db12b6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac069a10 0x7f8dac150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53686/0 (socket says 172.21.15.84:53686) 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db12b6700 1 -- 172.21.15.84:0/4220308383 learned_addr learned my addr 172.21.15.84:0/4220308383 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dac0c9c40 0x7f8dac168a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db1ab7700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac155780 0x7f8dac168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db12b6700 1 -- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac155780 msgr2=0x7f8dac168fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db12b6700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac155780 0x7f8dac168fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db12b6700 1 -- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dac0c9c40 msgr2=0x7f8dac168a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db12b6700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dac0c9c40 0x7f8dac168a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db12b6700 1 -- 172.21.15.84:0/4220308383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da800abf0 con 0x7f8dac069a10 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dac0c9c40 0x7f8dac168a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db1ab7700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac155780 0x7f8dac168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db12b6700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac069a10 0x7f8dac150090 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f8dac069590 tx=0x7f8da8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8da17fa700 1 -- 172.21.15.84:0/4220308383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8009b10 con 0x7f8dac069a10 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8da17fa700 1 -- 172.21.15.84:0/4220308383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8009c90 con 0x7f8dac069a10 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8da17fa700 1 -- 172.21.15.84:0/4220308383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8013680 con 0x7f8dac069a10 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db22b8700 1 -- 172.21.15.84:0/4220308383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac16a0a0 con 0x7f8dac069a10 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.890+0000 7f8db22b8700 1 -- 172.21.15.84:0/4220308383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac169510 con 0x7f8dac069a10 2023-10-06T02:59:39.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.892+0000 7f8da17fa700 1 -- 172.21.15.84:0/4220308383 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8da801a070 con 0x7f8dac069a10 2023-10-06T02:59:39.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.892+0000 7f8da17fa700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d90066f30 0x7f8d900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.892+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d90066f30 0x7f8d900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.892+0000 7f8da17fa700 1 -- 172.21.15.84:0/4220308383 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f8da8085d30 con 0x7f8dac069a10 2023-10-06T02:59:39.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.893+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d90066f30 0x7f8d900693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8dac067940 tx=0x7f8d9c006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.894+0000 7f8dbc812b80 1 Processor -- start 2023-10-06T02:59:39.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.894+0000 7f8dbc812b80 1 -- start start 2023-10-06T02:59:39.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd4fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd222a0 0x55f8dfd1d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd503a0 0x55f8dfd6c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfc77ac0 con 0x55f8dfd1cee0 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfc752c0 con 0x55f8dfd222a0 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfc710b0 con 0x55f8dfd503a0 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8db12b6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd4fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8db12b6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd4fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53698/0 (socket says 172.21.15.84:53698) 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8db12b6700 1 -- 172.21.15.84:0/2665359811 learned_addr learned my addr 172.21.15.84:0/2665359811 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8db12b6700 1 -- 172.21.15.84:0/2665359811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd503a0 msgr2=0x55f8dfd6c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8db12b6700 1 --2- 172.21.15.84:0/2665359811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd503a0 0x55f8dfd6c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8db12b6700 1 -- 172.21.15.84:0/2665359811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd222a0 msgr2=0x55f8dfd1d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8db12b6700 1 --2- 172.21.15.84:0/2665359811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd222a0 0x55f8dfd1d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8db12b6700 1 -- 172.21.15.84:0/2665359811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8dfb0b2c0 con 0x55f8dfd1cee0 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8db12b6700 1 --2- 172.21.15.84:0/2665359811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd4fe60 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8da8013830 tx=0x7f8da8083ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc74a1cde886a22b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8d967fc700 1 -- 172.21.15.84:0/2665359811 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800f070 con 0x55f8dfd1cee0 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8d967fc700 1 -- 172.21.15.84:0/2665359811 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8056a00 con 0x55f8dfd1cee0 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.895+0000 7f8d967fc700 1 -- 172.21.15.84:0/2665359811 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8059bd0 con 0x55f8dfd1cee0 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2665359811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd1cee0 msgr2=0x55f8dfd4fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/2665359811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd4fe60 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8da8013830 tx=0x7f8da8083ed0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2665359811 shutdown_connections 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/2665359811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd503a0 0x55f8dfd6c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/2665359811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd4fe60 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/2665359811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd222a0 0x55f8dfd1d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2665359811 >> 172.21.15.84:0/2665359811 conn(0x55f8dfd21ed0 msgr2=0x55f8dfd22700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2665359811 shutdown_connections 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2665359811 wait complete. 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.896+0000 7f8dbc812b80 1 -- start start 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.897+0000 7f8dbc812b80 1 Processor -- start 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.897+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.897+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 0x55f8dfd3b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.897+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfd3bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.897+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfc1c8e0 con 0x55f8dfd503a0 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.897+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfc37ef0 con 0x55f8dfd1cee0 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.897+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfaf3e80 con 0x55f8dfd222a0 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.897+0000 7f8dbc812b80 10 client.0 _ll_register_callbacks cb 0x55f8dfce4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:39.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db1ab7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfd3bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db1ab7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfd3bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53706/0 (socket says 172.21.15.84:53706) 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db1ab7700 1 -- 172.21.15.84:0/906813705 learned_addr learned my addr 172.21.15.84:0/906813705 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db12b6700 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 0x55f8dfd3b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db1ab7700 1 -- 172.21.15.84:0/906813705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 msgr2=0x55f8dfd3b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db1ab7700 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 0x55f8dfd3b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db1ab7700 1 -- 172.21.15.84:0/906813705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 msgr2=0x55f8dfd424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db1ab7700 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db1ab7700 1 -- 172.21.15.84:0/906813705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac169510 con 0x55f8dfd503a0 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8db1ab7700 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfd3bfa0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8da400e290 tx=0x7f8da4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d690752171b56cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8d8b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/906813705 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4018070 con 0x55f8dfd503a0 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/906813705 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f8da400edd0 con 0x55f8dfd503a0 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8dbc812b80 1 -- 172.21.15.84:0/906813705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8dfd15990 con 0x55f8dfd503a0 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/906813705 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8da40021d0 con 0x55f8dfd503a0 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8dbc812b80 10 client.6984 fetch_fsmap learned FSMap version 61 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8dbc812b80 1 -- 172.21.15.84:0/906813705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x55f8dfaae030 con 0x55f8dfd503a0 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/906813705 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f8dfd15990 con 0x55f8dfd503a0 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.898+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/906813705 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 61) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f8da401b020 con 0x55f8dfd503a0 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8dbc812b80 10 client.6984 fetch_fsmap finished waiting for FSMap version 61 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8dbc812b80 10 client.6984 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8dbc812b80 20 client.6984 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:39.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f8dfd3dfc0 0x55f8dfd20780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8dbc812b80 4 client.6984 mds_command: new command op to 6528 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8dbc812b80 1 -- 172.21.15.84:0/906813705 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8dfcf28c0 con 0x55f8dfd3dfc0 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8db12b6700 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f8dfd3dfc0 0x55f8dfd20780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8d8b7fe700 10 client.6984 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8db12b6700 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f8dfd3dfc0 0x55f8dfd20780 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c236c8242c58a55 server_cookie=365e75808d6f73b6 in_seq=0 out_seq=0 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/906813705 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f8dfcf28c0 con 0x55f8dfd3dfc0 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8d8b7fe700 10 client.6984 handle_command_reply: tid=0 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.899+0000 7f8dbc812b80 1 client.6984 shutdown 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 -- 172.21.15.84:0/906813705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 msgr2=0x55f8dfd3bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfd3bfa0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8da400e290 tx=0x7f8da4009040 comp rx=0 tx=0).stop 2023-10-06T02:59:39.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 -- 172.21.15.84:0/906813705 shutdown_connections 2023-10-06T02:59:39.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f8dfd3dfc0 0x55f8dfd20780 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfd3bfa0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/906813705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 0x55f8dfd3b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8d8b7fe700 0 client.6984 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:39.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 -- 172.21.15.84:0/906813705 >> 172.21.15.84:0/906813705 conn(0x55f8dfd21ed0 msgr2=0x55f8dfd47540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 -- 172.21.15.84:0/906813705 shutdown_connections 2023-10-06T02:59:39.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 1 -- 172.21.15.84:0/906813705 wait complete. 2023-10-06T02:59:39.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.900+0000 7f8dbc812b80 20 client.6984 trim_cache size 0 max 16384 2023-10-06T02:59:39.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.912+0000 7f8dbc812b80 1 Processor -- start 2023-10-06T02:59:39.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.912+0000 7f8dbc812b80 1 -- start start 2023-10-06T02:59:39.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd21060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd222a0 0x55f8dfd44ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd503a0 0x55f8dfd44ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfd7eab0 con 0x55f8dfd222a0 2023-10-06T02:59:39.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfd4fab0 con 0x55f8dfd1cee0 2023-10-06T02:59:39.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfd3d790 con 0x55f8dfd503a0 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8db0ab5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd222a0 0x55f8dfd44ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8db0ab5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd222a0 0x55f8dfd44ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53722/0 (socket says 172.21.15.84:53722) 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8db0ab5700 1 -- 172.21.15.84:0/2713861765 learned_addr learned my addr 172.21.15.84:0/2713861765 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8db0ab5700 1 -- 172.21.15.84:0/2713861765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd503a0 msgr2=0x55f8dfd44ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/2713861765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd503a0 0x55f8dfd44ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8db0ab5700 1 -- 172.21.15.84:0/2713861765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 msgr2=0x55f8dfd21060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/2713861765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd21060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8db0ab5700 1 -- 172.21.15.84:0/2713861765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8dfc3f7d0 con 0x55f8dfd222a0 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/2713861765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd222a0 0x55f8dfd44ab0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x55f8dfc2a970 tx=0x7f8d9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b711cbe307904d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8d96ffd700 1 -- 172.21.15.84:0/2713861765 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c0148c0 con 0x55f8dfd222a0 2023-10-06T02:59:39.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8d96ffd700 1 -- 172.21.15.84:0/2713861765 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9c014a20 con 0x55f8dfd222a0 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.913+0000 7f8d96ffd700 1 -- 172.21.15.84:0/2713861765 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c014da0 con 0x55f8dfd222a0 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2713861765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd222a0 msgr2=0x55f8dfd44ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/2713861765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd222a0 0x55f8dfd44ab0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x55f8dfc2a970 tx=0x7f8d9c016000 comp rx=0 tx=0).stop 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2713861765 shutdown_connections 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/2713861765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd21060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/2713861765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd503a0 0x55f8dfd44ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/2713861765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd222a0 0x55f8dfd44ab0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2713861765 >> 172.21.15.84:0/2713861765 conn(0x55f8dfd21ed0 msgr2=0x55f8dfd1eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2713861765 shutdown_connections 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 -- 172.21.15.84:0/2713861765 wait complete. 2023-10-06T02:59:39.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.914+0000 7f8dbc812b80 1 -- start start 2023-10-06T02:59:39.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8dbc812b80 1 Processor -- start 2023-10-06T02:59:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd73a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 0x55f8dfd73f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8dbc812b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfdd2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfdd1d30 con 0x55f8dfd503a0 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfd8be50 con 0x55f8dfd1cee0 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8dbc812b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8dfd3c120 con 0x55f8dfd222a0 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8dbc812b80 10 client.0 _ll_register_callbacks cb 0x55f8dfce4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8db1ab7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfdd2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8db1ab7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfdd2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53734/0 (socket says 172.21.15.84:53734) 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.915+0000 7f8db1ab7700 1 -- 172.21.15.84:0/51427949 learned_addr learned my addr 172.21.15.84:0/51427949 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 0x55f8dfd73f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8db12b6700 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd73a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8db1ab7700 1 -- 172.21.15.84:0/51427949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 msgr2=0x55f8dfd73f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8db1ab7700 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 0x55f8dfd73f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8db1ab7700 1 -- 172.21.15.84:0/51427949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 msgr2=0x55f8dfd73a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8db1ab7700 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd73a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8db1ab7700 1 -- 172.21.15.84:0/51427949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c00e040 con 0x55f8dfd503a0 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8db0ab5700 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 0x55f8dfd73f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8db1ab7700 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfdd2150 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8da400ea00 tx=0x7f8da401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48806635296bfb49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8d8b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/51427949 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da401b720 con 0x55f8dfd503a0 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/51427949 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f8da402dd90 con 0x55f8dfd503a0 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8dbc812b80 1 -- 172.21.15.84:0/51427949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8da8056a00 con 0x55f8dfd503a0 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/51427949 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8da401ba90 con 0x55f8dfd503a0 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8dbc812b80 10 client.6990 fetch_fsmap learned FSMap version 61 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8dbc812b80 1 -- 172.21.15.84:0/51427949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x55f8dfc264c0 con 0x55f8dfd503a0 2023-10-06T02:59:39.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/51427949 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8056a00 con 0x55f8dfd503a0 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/51427949 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 61) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f8da4006820 con 0x55f8dfd503a0 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8dbc812b80 10 client.6990 fetch_fsmap finished waiting for FSMap version 61 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8dbc812b80 10 client.6990 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8dbc812b80 20 client.6990 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f8dfd17b30 0x55f8dfdd2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8dbc812b80 4 client.6990 mds_command: new command op to 6528 tid=0[{"prefix": "damage ls"}] 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.916+0000 7f8dbc812b80 1 -- 172.21.15.84:0/51427949 --> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f8dfc13e50 con 0x55f8dfd17b30 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8db12b6700 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f8dfd17b30 0x55f8dfdd2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8d8b7fe700 10 client.6990 ms_handle_connect on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8db12b6700 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f8dfd17b30 0x55f8dfdd2690 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f464ac222949c76 server_cookie=c5abf957a451350b in_seq=0 out_seq=0 2023-10-06T02:59:39.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8d8b7fe700 1 -- 172.21.15.84:0/51427949 <== mds.0 v2:172.21.15.84:6835/3591915780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+271 (crc 0 0 0) 0x55f8dfc13e50 con 0x55f8dfd17b30 2023-10-06T02:59:39.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8d8b7fe700 10 client.6990 handle_command_reply: tid=0 2023-10-06T02:59:39.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 client.6990 shutdown 2023-10-06T02:59:39.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 -- 172.21.15.84:0/51427949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 msgr2=0x55f8dfdd2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfdd2150 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8da400ea00 tx=0x7f8da401e000 comp rx=0 tx=0).stop 2023-10-06T02:59:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 -- 172.21.15.84:0/51427949 shutdown_connections 2023-10-06T02:59:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.84:6835/3591915780,v1:172.21.15.84:6837/3591915780] conn(0x55f8dfd17b30 0x55f8dfdd2690 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f8dfd1cee0 0x55f8dfd73a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f8dfd503a0 0x55f8dfdd2150 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 --2- 172.21.15.84:0/51427949 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f8dfd222a0 0x55f8dfd73f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8d8b7fe700 0 client.6990 ms_handle_reset on v2:172.21.15.84:6835/3591915780 2023-10-06T02:59:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 -- 172.21.15.84:0/51427949 >> 172.21.15.84:0/51427949 conn(0x55f8dfd21ed0 msgr2=0x55f8dfd21060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 -- 172.21.15.84:0/51427949 shutdown_connections 2023-10-06T02:59:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 1 -- 172.21.15.84:0/51427949 wait complete. 2023-10-06T02:59:39.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.917+0000 7f8dbc812b80 20 client.6990 trim_cache size 0 max 16384 2023-10-06T02:59:39.929 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T02:59:39.929 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:39.929 INFO:teuthology.orchestra.run.smithi084.stdout: "damage_type": "backtrace", 2023-10-06T02:59:39.929 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 623342075, 2023-10-06T02:59:39.929 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 1099511627778, 2023-10-06T02:59:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3" 2023-10-06T02:59:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: "damage_type": "backtrace", 2023-10-06T02:59:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 2105888509, 2023-10-06T02:59:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 1099511627779, 2023-10-06T02:59:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3/d4" 2023-10-06T02:59:39.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:39.930 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 -- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d90066f30 msgr2=0x7f8d900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d90066f30 0x7f8d900693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8dac067940 tx=0x7f8d9c006f90 comp rx=0 tx=0).stop 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 -- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac069a10 msgr2=0x7f8dac150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac069a10 0x7f8dac150090 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f8dac069590 tx=0x7f8da8018000 comp rx=0 tx=0).stop 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 -- 172.21.15.84:0/4220308383 shutdown_connections 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8d90066f30 0x7f8d900693e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8dac155780 0x7f8dac168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8dac069a10 0x7f8dac150090 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 --2- 172.21.15.84:0/4220308383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8dac0c9c40 0x7f8dac168a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:39.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 -- 172.21.15.84:0/4220308383 >> 172.21.15.84:0/4220308383 conn(0x7f8dac0cd220 msgr2=0x7f8dac0c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:39.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 -- 172.21.15.84:0/4220308383 shutdown_connections 2023-10-06T02:59:39.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:39.918+0000 7f8db22b8700 1 -- 172.21.15.84:0/4220308383 wait complete. 2023-10-06T02:59:39.933 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 damage ls 2023-10-06T02:59:40.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.047+0000 7faf42db1700 1 Processor -- start 2023-10-06T02:59:40.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.047+0000 7faf42db1700 1 -- start start 2023-10-06T02:59:40.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf42db1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf3c0b2660 0x7faf3c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf42db1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0cc9b0 con 0x7faf3c0cf1f0 2023-10-06T02:59:40.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf42db1700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0cbda0 con 0x7faf3c0b2a30 2023-10-06T02:59:40.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf42db1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c0cc080 con 0x7faf3c0b2660 2023-10-06T02:59:40.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf41daf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf3c0b2660 0x7faf3c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf425b0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faf3c0cf1f0 0x7faf3c0c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36958/0 (socket says 172.21.15.84:36958) 2023-10-06T02:59:40.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf425b0700 1 -- 172.21.15.84:0/4219615130 learned_addr learned my addr 172.21.15.84:0/4219615130 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:40.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf41daf700 1 -- 172.21.15.84:0/4219615130 >> v1:172.21.15.131:6789/0 conn(0x7faf3c0b2a30 legacy=0x7faf3c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf41daf700 1 -- 172.21.15.84:0/4219615130 >> v1:172.21.15.84:6789/0 conn(0x7faf3c0cf1f0 legacy=0x7faf3c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf41daf700 1 -- 172.21.15.84:0/4219615130 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0cc360 con 0x7faf3c0b2660 2023-10-06T02:59:40.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf40dad700 1 -- 172.21.15.84:0/4219615130 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900943112 0 0) 0x7faf3c0cc9b0 con 0x7faf3c0cf1f0 2023-10-06T02:59:40.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.048+0000 7faf41daf700 1 --2- 172.21.15.84:0/4219615130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2660 0x7faf3c0cccf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7faf340098d0 tx=0x7faf34009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fa01287cddc21b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf40dad700 1 -- 172.21.15.84:0/4219615130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34009e70 con 0x7faf3c0b2660 2023-10-06T02:59:40.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf40dad700 1 -- 172.21.15.84:0/4219615130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf34005c10 con 0x7faf3c0b2660 2023-10-06T02:59:40.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf40dad700 1 -- 172.21.15.84:0/4219615130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3400b650 con 0x7faf3c0b2660 2023-10-06T02:59:40.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf42db1700 1 -- 172.21.15.84:0/4219615130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2660 msgr2=0x7faf3c0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf42db1700 1 --2- 172.21.15.84:0/4219615130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2660 0x7faf3c0cccf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7faf340098d0 tx=0x7faf34009120 comp rx=0 tx=0).stop 2023-10-06T02:59:40.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf42db1700 1 -- 172.21.15.84:0/4219615130 shutdown_connections 2023-10-06T02:59:40.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf42db1700 1 --2- 172.21.15.84:0/4219615130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2660 0x7faf3c0cccf0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf42db1700 1 -- 172.21.15.84:0/4219615130 >> 172.21.15.84:0/4219615130 conn(0x7faf3c099560 msgr2=0x7faf3c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf42db1700 1 -- 172.21.15.84:0/4219615130 shutdown_connections 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.049+0000 7faf42db1700 1 -- 172.21.15.84:0/4219615130 wait complete. 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.050+0000 7faf42db1700 1 Processor -- start 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.050+0000 7faf42db1700 1 -- start start 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf42db1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf3c0b2660 0x7faf3c15d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf42db1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2a30 0x7faf3c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf42db1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf3c0cf1f0 0x7faf3c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf42db1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c15c1d0 con 0x7faf3c0b2a30 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf42db1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c15b340 con 0x7faf3c0b2660 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf42db1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c15b5c0 con 0x7faf3c0cf1f0 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf415ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2a30 0x7faf3c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf415ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2a30 0x7faf3c15ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53752/0 (socket says 172.21.15.84:53752) 2023-10-06T02:59:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf415ae700 1 -- 172.21.15.84:0/1236673672 learned_addr learned my addr 172.21.15.84:0/1236673672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf425b0700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf3c0cf1f0 0x7faf3c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf41daf700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf3c0b2660 0x7faf3c15d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf415ae700 1 -- 172.21.15.84:0/1236673672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf3c0cf1f0 msgr2=0x7faf3c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf415ae700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf3c0cf1f0 0x7faf3c15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf415ae700 1 -- 172.21.15.84:0/1236673672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf3c0b2660 msgr2=0x7faf3c15d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf415ae700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf3c0b2660 0x7faf3c15d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf415ae700 1 -- 172.21.15.84:0/1236673672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340093c0 con 0x7faf3c0b2a30 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.051+0000 7faf41daf700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf3c0b2660 0x7faf3c15d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.052+0000 7faf415ae700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2a30 0x7faf3c15ae00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c7f0 tx=0x7faf2c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.052+0000 7faf31ffb700 1 -- 172.21.15.84:0/1236673672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c011590 con 0x7faf3c0b2a30 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.052+0000 7faf31ffb700 1 -- 172.21.15.84:0/1236673672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0116f0 con 0x7faf3c0b2a30 2023-10-06T02:59:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.052+0000 7faf42db1700 1 -- 172.21.15.84:0/1236673672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c15b8a0 con 0x7faf3c0b2a30 2023-10-06T02:59:40.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.052+0000 7faf31ffb700 1 -- 172.21.15.84:0/1236673672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c011ab0 con 0x7faf3c0b2a30 2023-10-06T02:59:40.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.052+0000 7faf42db1700 1 -- 172.21.15.84:0/1236673672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c15be60 con 0x7faf3c0b2a30 2023-10-06T02:59:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.053+0000 7faf31ffb700 1 -- 172.21.15.84:0/1236673672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf2c01b3b0 con 0x7faf3c0b2a30 2023-10-06T02:59:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.054+0000 7faf31ffb700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf20066f30 0x7faf200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.054+0000 7faf31ffb700 1 -- 172.21.15.84:0/1236673672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7faf2c083d60 con 0x7faf3c0b2a30 2023-10-06T02:59:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.054+0000 7faf41daf700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf20066f30 0x7faf200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.054+0000 7faf41daf700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf20066f30 0x7faf200693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faf34009340 tx=0x7faf34016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf4d30bb80 1 Processor -- start 2023-10-06T02:59:40.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf4d30bb80 1 -- start start 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9214d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921a310 0x5609d9215250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921ba60 0x5609d9215790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d916fac0 con 0x5609d9239ea0 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d916d2c0 con 0x5609d921a310 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609d91690b0 con 0x5609d921ba60 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf41daf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9214d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf41daf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9214d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53766/0 (socket says 172.21.15.84:53766) 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.056+0000 7faf41daf700 1 -- 172.21.15.84:0/2731140963 learned_addr learned my addr 172.21.15.84:0/2731140963 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf425b0700 1 --2- 172.21.15.84:0/2731140963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921ba60 0x5609d9215790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf41daf700 1 -- 172.21.15.84:0/2731140963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921ba60 msgr2=0x5609d9215790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf415ae700 1 --2- 172.21.15.84:0/2731140963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921a310 0x5609d9215250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf41daf700 1 --2- 172.21.15.84:0/2731140963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921ba60 0x5609d9215790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf41daf700 1 -- 172.21.15.84:0/2731140963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921a310 msgr2=0x5609d9215250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf41daf700 1 --2- 172.21.15.84:0/2731140963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921a310 0x5609d9215250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf41daf700 1 -- 172.21.15.84:0/2731140963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609d90032c0 con 0x5609d9239ea0 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf41daf700 1 --2- 172.21.15.84:0/2731140963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9214d10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7faf3c06fd00 tx=0x7faf34021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf2aecf239dd686 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf26ffd700 1 -- 172.21.15.84:0/2731140963 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34021070 con 0x5609d9239ea0 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf26ffd700 1 -- 172.21.15.84:0/2731140963 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf340061d0 con 0x5609d9239ea0 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.057+0000 7faf26ffd700 1 -- 172.21.15.84:0/2731140963 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34006340 con 0x5609d9239ea0 2023-10-06T02:59:40.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 -- 172.21.15.84:0/2731140963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 msgr2=0x5609d9214d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/2731140963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9214d10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7faf3c06fd00 tx=0x7faf34021000 comp rx=0 tx=0).stop 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 -- 172.21.15.84:0/2731140963 shutdown_connections 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/2731140963 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921ba60 0x5609d9215790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/2731140963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9214d10 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/2731140963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921a310 0x5609d9215250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 -- 172.21.15.84:0/2731140963 >> 172.21.15.84:0/2731140963 conn(0x5609d9219ed0 msgr2=0x5609d921a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 -- 172.21.15.84:0/2731140963 shutdown_connections 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 -- 172.21.15.84:0/2731140963 wait complete. 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 -- start start 2023-10-06T02:59:40.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.058+0000 7faf4d30bb80 1 Processor -- start 2023-10-06T02:59:40.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d921a310 0x5609d9241920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9260350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d9239ea0 0x5609d92383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d91148e0 con 0x5609d921a310 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d912fef0 con 0x5609d921ba60 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609d8febe80 con 0x5609d9239ea0 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf4d30bb80 10 client.0 _ll_register_callbacks cb 0x5609d91dc070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf41daf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d921a310 0x5609d9241920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf41daf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d921a310 0x5609d9241920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53774/0 (socket says 172.21.15.84:53774) 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.059+0000 7faf41daf700 1 -- 172.21.15.84:0/1565931800 learned_addr learned my addr 172.21.15.84:0/1565931800 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf425b0700 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d9239ea0 0x5609d92383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf415ae700 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9260350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf41daf700 1 -- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d9239ea0 msgr2=0x5609d92383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf41daf700 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d9239ea0 0x5609d92383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf41daf700 1 -- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 msgr2=0x5609d9260350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf41daf700 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9260350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf41daf700 1 -- 172.21.15.84:0/1565931800 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c0cc360 con 0x5609d921a310 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf425b0700 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d9239ea0 0x5609d92383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf415ae700 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9260350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf41daf700 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d921a310 0x5609d9241920 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7faf34003080 tx=0x7faf3402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8906e7e3a4aaca5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf1bfff700 1 -- 172.21.15.84:0/1565931800 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34021040 con 0x5609d921a310 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf1bfff700 1 -- 172.21.15.84:0/1565931800 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7faf34033af0 con 0x5609d921a310 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1565931800 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609d920d990 con 0x5609d921a310 2023-10-06T02:59:40.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf1bfff700 1 -- 172.21.15.84:0/1565931800 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf34011420 con 0x5609d921a310 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf4d30bb80 10 client.7005 fetch_fsmap learned FSMap version 61 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1565931800 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x5609d8fa6030 con 0x5609d921a310 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf1bfff700 1 -- 172.21.15.84:0/1565931800 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5609d920d990 con 0x5609d921a310 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf1bfff700 1 -- 172.21.15.84:0/1565931800 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 61) v1 ==== 3140+0+0 (secure 0 0 0) 0x7faf34011580 con 0x5609d921a310 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf4d30bb80 10 client.7005 fetch_fsmap finished waiting for FSMap version 61 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf4d30bb80 10 client.7005 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf4d30bb80 20 client.7005 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x5609d9261a70 0x5609d9272560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf4d30bb80 4 client.7005 mds_command: new command op to 6525 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.060+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1565931800 --> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609d91ea8c0 con 0x5609d9261a70 2023-10-06T02:59:40.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf415ae700 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x5609d9261a70 0x5609d9272560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf1bfff700 10 client.7005 ms_handle_connect on v2:172.21.15.84:6834/1455824046 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf415ae700 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x5609d9261a70 0x5609d9272560 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f687caf0c023b1a server_cookie=6ec8399e7b5e7d32 in_seq=0 out_seq=0 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf1bfff700 1 -- 172.21.15.84:0/1565931800 <== mds.1 v2:172.21.15.84:6834/1455824046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5609d91ea8c0 con 0x5609d9261a70 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf1bfff700 10 client.7005 handle_command_reply: tid=0 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf4d30bb80 1 client.7005 shutdown 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1565931800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d921a310 msgr2=0x5609d9241920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d921a310 0x5609d9241920 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7faf34003080 tx=0x7faf3402c040 comp rx=0 tx=0).stop 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1565931800 shutdown_connections 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x5609d9261a70 0x5609d9272560 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d9239ea0 0x5609d92383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf1bfff700 0 client.7005 ms_handle_reset on v2:172.21.15.84:6834/1455824046 2023-10-06T02:59:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d921a310 0x5609d9241920 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1565931800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9260350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.061+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1565931800 >> 172.21.15.84:0/1565931800 conn(0x5609d9219ed0 msgr2=0x5609d9218db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.062+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1565931800 shutdown_connections 2023-10-06T02:59:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.062+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1565931800 wait complete. 2023-10-06T02:59:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.062+0000 7faf4d30bb80 20 client.7005 trim_cache size 0 max 16384 2023-10-06T02:59:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.074+0000 7faf4d30bb80 1 Processor -- start 2023-10-06T02:59:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.074+0000 7faf4d30bb80 1 -- start start 2023-10-06T02:59:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.074+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 0x5609d9215cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.074+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9216210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.074+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9247310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.074+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d921b0b0 con 0x5609d9239ea0 2023-10-06T02:59:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.074+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d9246f90 con 0x5609d921ba60 2023-10-06T02:59:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.074+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609d9238790 con 0x5609d921a310 2023-10-06T02:59:40.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf425b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9247310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf425b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9247310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53776/0 (socket says 172.21.15.84:53776) 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf425b0700 1 -- 172.21.15.84:0/151090363 learned_addr learned my addr 172.21.15.84:0/151090363 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf41daf700 1 --2- 172.21.15.84:0/151090363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 0x5609d9215cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf415ae700 1 --2- 172.21.15.84:0/151090363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9216210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf425b0700 1 -- 172.21.15.84:0/151090363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 msgr2=0x5609d9215cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf425b0700 1 --2- 172.21.15.84:0/151090363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 0x5609d9215cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf425b0700 1 -- 172.21.15.84:0/151090363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 msgr2=0x5609d9216210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf425b0700 1 --2- 172.21.15.84:0/151090363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9216210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf425b0700 1 -- 172.21.15.84:0/151090363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609d91377d0 con 0x5609d9239ea0 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf425b0700 1 --2- 172.21.15.84:0/151090363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9247310 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7faf380070f0 tx=0x7faf38009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72944d4d026e7d08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf277fe700 1 -- 172.21.15.84:0/151090363 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38007ac0 con 0x5609d9239ea0 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf277fe700 1 -- 172.21.15.84:0/151090363 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3800d070 con 0x5609d9239ea0 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.075+0000 7faf277fe700 1 -- 172.21.15.84:0/151090363 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38015620 con 0x5609d9239ea0 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 -- 172.21.15.84:0/151090363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 msgr2=0x5609d9247310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/151090363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9247310 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7faf380070f0 tx=0x7faf38009040 comp rx=0 tx=0).stop 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 -- 172.21.15.84:0/151090363 shutdown_connections 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/151090363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9247310 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/151090363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 0x5609d9215cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/151090363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9216210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 -- 172.21.15.84:0/151090363 >> 172.21.15.84:0/151090363 conn(0x5609d9219ed0 msgr2=0x5609d9263b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 -- 172.21.15.84:0/151090363 shutdown_connections 2023-10-06T02:59:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 -- 172.21.15.84:0/151090363 wait complete. 2023-10-06T02:59:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 -- start start 2023-10-06T02:59:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.076+0000 7faf4d30bb80 1 Processor -- start 2023-10-06T02:59:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 0x5609d92c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9270fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf4d30bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9271520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d921b3a0 con 0x5609d9239ea0 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d921b5b0 con 0x5609d921ba60 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf4d30bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609d923f470 con 0x5609d921a310 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf4d30bb80 10 client.0 _ll_register_callbacks cb 0x5609d9239c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf425b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9271520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf425b0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9271520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53788/0 (socket says 172.21.15.84:53788) 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf41daf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 0x5609d92c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf425b0700 1 -- 172.21.15.84:0/1844959694 learned_addr learned my addr 172.21.15.84:0/1844959694 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.077+0000 7faf415ae700 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9270fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf425b0700 1 -- 172.21.15.84:0/1844959694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 msgr2=0x5609d92c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf425b0700 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 0x5609d92c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf425b0700 1 -- 172.21.15.84:0/1844959694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 msgr2=0x5609d9270fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf425b0700 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9270fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf425b0700 1 -- 172.21.15.84:0/1844959694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf38001ff0 con 0x5609d9239ea0 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf415ae700 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9270fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf425b0700 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9271520 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7faf38016000 tx=0x7faf3801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a5accb8752cf81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf1bfff700 1 -- 172.21.15.84:0/1844959694 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38015d60 con 0x5609d9239ea0 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf1bfff700 1 -- 172.21.15.84:0/1844959694 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7faf38020dd0 con 0x5609d9239ea0 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1844959694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf340061d0 con 0x5609d9239ea0 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf1bfff700 1 -- 172.21.15.84:0/1844959694 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf38004dc0 con 0x5609d9239ea0 2023-10-06T02:59:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf4d30bb80 10 client.7011 fetch_fsmap learned FSMap version 61 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1844959694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x5609d911e4c0 con 0x5609d9239ea0 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf1bfff700 1 -- 172.21.15.84:0/1844959694 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38030020 con 0x5609d9239ea0 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf1bfff700 1 -- 172.21.15.84:0/1844959694 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 61) v1 ==== 3140+0+0 (secure 0 0 0) 0x7faf38006080 con 0x5609d9239ea0 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf4d30bb80 10 client.7011 fetch_fsmap finished waiting for FSMap version 61 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf4d30bb80 10 client.7011 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf4d30bb80 20 client.7011 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x5609d923e440 0x5609d923e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf4d30bb80 4 client.7011 mds_command: new command op to 6525 tid=0[{"prefix": "damage ls"}] 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1844959694 --> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5609d910be50 con 0x5609d923e440 2023-10-06T02:59:40.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.078+0000 7faf41daf700 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x5609d923e440 0x5609d923e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf1bfff700 10 client.7011 ms_handle_connect on v2:172.21.15.84:6834/1455824046 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf41daf700 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x5609d923e440 0x5609d923e840 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=404abbb953ab3705 server_cookie=d43d2887256e3637 in_seq=0 out_seq=0 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf1bfff700 1 -- 172.21.15.84:0/1844959694 <== mds.1 v2:172.21.15.84:6834/1455824046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+284 (crc 0 0 0) 0x5609d910be50 con 0x5609d923e440 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf1bfff700 10 client.7011 handle_command_reply: tid=0 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 client.7011 shutdown 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1844959694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 msgr2=0x5609d9271520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9271520 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7faf38016000 tx=0x7faf3801c000 comp rx=0 tx=0).stop 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1844959694 shutdown_connections 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.84:6834/1455824046,v1:172.21.15.84:6836/1455824046] conn(0x5609d923e440 0x5609d923e840 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5609d9239ea0 0x5609d9271520 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5609d921a310 0x5609d92c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf1bfff700 0 client.7011 ms_handle_reset on v2:172.21.15.84:6834/1455824046 2023-10-06T02:59:40.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 --2- 172.21.15.84:0/1844959694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609d921ba60 0x5609d9270fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1844959694 >> 172.21.15.84:0/1844959694 conn(0x5609d9219ed0 msgr2=0x5609d925fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1844959694 shutdown_connections 2023-10-06T02:59:40.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 1 -- 172.21.15.84:0/1844959694 wait complete. 2023-10-06T02:59:40.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.079+0000 7faf4d30bb80 20 client.7011 trim_cache size 0 max 16384 2023-10-06T02:59:40.089 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T02:59:40.089 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:40.089 INFO:teuthology.orchestra.run.smithi084.stdout: "damage_type": "backtrace", 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 1907654252, 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 1099511627781, 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3/d4/d5/d6" 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: "damage_type": "backtrace", 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 3817817533, 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 1099511627780, 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3/d4/d5" 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:40.090 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T02:59:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 -- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf20066f30 msgr2=0x7faf200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf20066f30 0x7faf200693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faf34009340 tx=0x7faf34016000 comp rx=0 tx=0).stop 2023-10-06T02:59:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 -- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2a30 msgr2=0x7faf3c15ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2a30 0x7faf3c15ae00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c7f0 tx=0x7faf2c007f50 comp rx=0 tx=0).stop 2023-10-06T02:59:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 -- 172.21.15.84:0/1236673672 shutdown_connections 2023-10-06T02:59:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf20066f30 0x7faf200693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf3c0b2660 0x7faf3c15d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf3c0cf1f0 0x7faf3c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 --2- 172.21.15.84:0/1236673672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf3c0b2a30 0x7faf3c15ae00 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 -- 172.21.15.84:0/1236673672 >> 172.21.15.84:0/1236673672 conn(0x7faf3c099560 msgr2=0x7faf3c158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 -- 172.21.15.84:0/1236673672 shutdown_connections 2023-10-06T02:59:40.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.080+0000 7faf42db1700 1 -- 172.21.15.84:0/1236673672 wait complete. 2023-10-06T02:59:40.093 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 damage ls 2023-10-06T02:59:40.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.207+0000 7f7b0accf700 1 Processor -- start 2023-10-06T02:59:40.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.207+0000 7f7b0accf700 1 -- start start 2023-10-06T02:59:40.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b0accf700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7b040c6610 0x7f7b040cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b0accf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040b2e60 con 0x7f7b040b2a90 2023-10-06T02:59:40.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b0accf700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040cf5d0 con 0x7f7b040cbb50 2023-10-06T02:59:40.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b0accf700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040cf8b0 con 0x7f7b040c6610 2023-10-06T02:59:40.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b08a6b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7b040b2a90 0x7f7b040cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36960/0 (socket says 172.21.15.84:36960) 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b08a6b700 1 -- 172.21.15.84:0/587351119 learned_addr learned my addr 172.21.15.84:0/587351119 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b0926c700 1 --2- 172.21.15.84:0/587351119 >> v2:172.21.15.131:3300/0 conn(0x7f7b040c6610 0x7f7b040cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b037fe700 1 -- 172.21.15.84:0/587351119 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758626227 0 0) 0x7f7b040b2e60 con 0x7f7b040b2a90 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b037fe700 1 -- 172.21.15.84:0/587351119 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af0003570 con 0x7f7b040b2a90 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b0926c700 1 -- 172.21.15.84:0/587351119 >> v1:172.21.15.131:6789/0 conn(0x7f7b040cbb50 legacy=0x7f7b040ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b037fe700 1 -- 172.21.15.84:0/587351119 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2125439802 0 0) 0x7f7af0003570 con 0x7f7b040b2a90 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b0926c700 1 -- 172.21.15.84:0/587351119 >> v1:172.21.15.84:6789/0 conn(0x7f7b040b2a90 legacy=0x7f7b040cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.208+0000 7f7b0926c700 1 -- 172.21.15.84:0/587351119 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040cfb90 con 0x7f7b040c6610 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b0926c700 1 --2- 172.21.15.84:0/587351119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b040c6610 0x7f7b040cef60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0098e0 tx=0x7f7aec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ab010d0ef807e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b037fe700 1 -- 172.21.15.84:0/587351119 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc0015f0 con 0x7f7b040c6610 2023-10-06T02:59:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b037fe700 1 -- 172.21.15.84:0/587351119 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec011420 con 0x7f7b040c6610 2023-10-06T02:59:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b037fe700 1 -- 172.21.15.84:0/587351119 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec0117a0 con 0x7f7b040c6610 2023-10-06T02:59:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b0accf700 1 -- 172.21.15.84:0/587351119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b040c6610 msgr2=0x7f7b040cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b0accf700 1 --2- 172.21.15.84:0/587351119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b040c6610 0x7f7b040cef60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0098e0 tx=0x7f7aec0091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b0accf700 1 -- 172.21.15.84:0/587351119 shutdown_connections 2023-10-06T02:59:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b0accf700 1 --2- 172.21.15.84:0/587351119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b040c6610 0x7f7b040cef60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b0accf700 1 -- 172.21.15.84:0/587351119 >> 172.21.15.84:0/587351119 conn(0x7f7b04099740 msgr2=0x7f7b0406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b0accf700 1 -- 172.21.15.84:0/587351119 shutdown_connections 2023-10-06T02:59:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.209+0000 7f7b0accf700 1 -- 172.21.15.84:0/587351119 wait complete. 2023-10-06T02:59:40.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.210+0000 7f7b0accf700 1 Processor -- start 2023-10-06T02:59:40.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.211+0000 7f7b0accf700 1 -- start start 2023-10-06T02:59:40.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.211+0000 7f7b0accf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b040b2a90 0x7f7b0416d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.211+0000 7f7b0accf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b040c6610 0x7f7b0415e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.211+0000 7f7b0accf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b040cbb50 0x7f7b040b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.211+0000 7f7b0accf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040b5450 con 0x7f7b040cbb50 2023-10-06T02:59:40.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.211+0000 7f7b0accf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040b4fc0 con 0x7f7b040b2a90 2023-10-06T02:59:40.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.211+0000 7f7b0accf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040b43b0 con 0x7f7b040c6610 2023-10-06T02:59:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0926c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b040cbb50 0x7f7b040b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0926c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b040cbb50 0x7f7b040b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53790/0 (socket says 172.21.15.84:53790) 2023-10-06T02:59:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0926c700 1 -- 172.21.15.84:0/4155668187 learned_addr learned my addr 172.21.15.84:0/4155668187 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b040b2a90 0x7f7b0416d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b03fff700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b040c6610 0x7f7b0415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0926c700 1 -- 172.21.15.84:0/4155668187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b040c6610 msgr2=0x7f7b0415e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0926c700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b040c6610 0x7f7b0415e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0926c700 1 -- 172.21.15.84:0/4155668187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b040b2a90 msgr2=0x7f7b0416d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0926c700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b040b2a90 0x7f7b0416d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0926c700 1 -- 172.21.15.84:0/4155668187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec009420 con 0x7f7b040cbb50 2023-10-06T02:59:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b03fff700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b040c6610 0x7f7b0415e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0926c700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b040cbb50 0x7f7b040b3ab0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009f80 tx=0x7f7aec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b00ff9700 1 -- 172.21.15.84:0/4155668187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec01ccc0 con 0x7f7b040cbb50 2023-10-06T02:59:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b00ff9700 1 -- 172.21.15.84:0/4155668187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec01ce40 con 0x7f7b040cbb50 2023-10-06T02:59:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b00ff9700 1 -- 172.21.15.84:0/4155668187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec01a6a0 con 0x7f7b040cbb50 2023-10-06T02:59:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0accf700 1 -- 172.21.15.84:0/4155668187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b040b4690 con 0x7f7b040cbb50 2023-10-06T02:59:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.212+0000 7f7b0accf700 1 -- 172.21.15.84:0/4155668187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b040b4c50 con 0x7f7b040cbb50 2023-10-06T02:59:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.214+0000 7f7b00ff9700 1 -- 172.21.15.84:0/4155668187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7aec01aad0 con 0x7f7b040cbb50 2023-10-06T02:59:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.214+0000 7f7b00ff9700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7ae4066f30 0x7f7ae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.214+0000 7f7b00ff9700 1 -- 172.21.15.84:0/4155668187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7aec086320 con 0x7f7b040cbb50 2023-10-06T02:59:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.214+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7ae4066f30 0x7f7ae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.214+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7ae4066f30 0x7f7ae40693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7afc000c00 tx=0x7f7afc0016e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.216+0000 7f7b13fc7b80 1 Processor -- start 2023-10-06T02:59:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.216+0000 7f7b13fc7b80 1 -- start start 2023-10-06T02:59:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.216+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db624c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.216+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db674710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.216+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db6750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.216+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626db57bac0 con 0x5626db624890 2023-10-06T02:59:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.216+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626db5792c0 con 0x5626db625d10 2023-10-06T02:59:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.216+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626db5750b0 con 0x5626db674c50 2023-10-06T02:59:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b08a6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db624c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b08a6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db624c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53802/0 (socket says 172.21.15.84:53802) 2023-10-06T02:59:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b08a6b700 1 -- 172.21.15.84:0/2233805672 learned_addr learned my addr 172.21.15.84:0/2233805672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b0926c700 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db6750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b03fff700 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db674710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b08a6b700 1 -- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 msgr2=0x5626db6750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db6750a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b08a6b700 1 -- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 msgr2=0x5626db674710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db674710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b08a6b700 1 -- 172.21.15.84:0/2233805672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626db40f2c0 con 0x5626db624890 2023-10-06T02:59:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b0926c700 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db6750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b03fff700 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db674710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db624c60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00fd10 tx=0x7f7afc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43d71cceb0246dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7af9ffb700 1 -- 172.21.15.84:0/2233805672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc00fea0 con 0x5626db624890 2023-10-06T02:59:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7af9ffb700 1 -- 172.21.15.84:0/2233805672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc014af0 con 0x5626db624890 2023-10-06T02:59:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.217+0000 7f7af9ffb700 1 -- 172.21.15.84:0/2233805672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc014e90 con 0x5626db624890 2023-10-06T02:59:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2233805672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 msgr2=0x5626db624c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db624c60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00fd10 tx=0x7f7afc015000 comp rx=0 tx=0).stop 2023-10-06T02:59:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2233805672 shutdown_connections 2023-10-06T02:59:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db6750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db624c60 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2233805672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db674710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2233805672 >> 172.21.15.84:0/2233805672 conn(0x5626db6261b0 msgr2=0x5626db626580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2233805672 shutdown_connections 2023-10-06T02:59:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2233805672 wait complete. 2023-10-06T02:59:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.218+0000 7f7b13fc7b80 1 -- start start 2023-10-06T02:59:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b13fc7b80 1 Processor -- start 2023-10-06T02:59:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db624890 0x5626db663470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db666e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db674c50 0x5626db6673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626db5208e0 con 0x5626db674c50 2023-10-06T02:59:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626db53bef0 con 0x5626db625d10 2023-10-06T02:59:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626db3f7e80 con 0x5626db624890 2023-10-06T02:59:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b13fc7b80 10 client.0 _ll_register_callbacks cb 0x5626db5e7ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b0926c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db674c50 0x5626db6673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.219+0000 7f7b0926c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db674c50 0x5626db6673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53816/0 (socket says 172.21.15.84:53816) 2023-10-06T02:59:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b0926c700 1 -- 172.21.15.84:0/2530965995 learned_addr learned my addr 172.21.15.84:0/2530965995 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db624890 0x5626db663470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b03fff700 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db666e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b0926c700 1 -- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db624890 msgr2=0x5626db663470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b0926c700 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db624890 0x5626db663470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b0926c700 1 -- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 msgr2=0x5626db666e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b0926c700 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db666e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b0926c700 1 -- 172.21.15.84:0/2530965995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc00f9b0 con 0x5626db674c50 2023-10-06T02:59:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db624890 0x5626db663470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b03fff700 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db666e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b0926c700 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db674c50 0x5626db6673b0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f7aec01c830 tx=0x7f7aec003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f805a45494c0a8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7ae2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2530965995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec01ad80 con 0x5626db674c50 2023-10-06T02:59:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2530965995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7aec055310 con 0x5626db674c50 2023-10-06T02:59:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2530965995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626db619990 con 0x5626db674c50 2023-10-06T02:59:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2530965995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aec056d40 con 0x5626db674c50 2023-10-06T02:59:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b13fc7b80 10 client.7023 fetch_fsmap learned FSMap version 61 2023-10-06T02:59:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2530965995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x5626db3b2030 con 0x5626db674c50 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2530965995 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626db619990 con 0x5626db674c50 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2530965995 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 61) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f7aec053680 con 0x5626db674c50 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b13fc7b80 10 client.7023 fetch_fsmap finished waiting for FSMap version 61 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b13fc7b80 10 client.7023 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.d 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b13fc7b80 20 client.7023 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x5626db6647f0 0x5626db664bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b13fc7b80 4 client.7023 mds_command: new command op to 5567 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.220+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2530965995 --> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626db5f68c0 con 0x5626db6647f0 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.221+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x5626db6647f0 0x5626db664bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.221+0000 7f7ae2ffd700 10 client.7023 ms_handle_connect on v2:172.21.15.131:6833/4032170839 2023-10-06T02:59:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.221+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x5626db6647f0 0x5626db664bf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca222c686a9daf89 server_cookie=36a5742f76489f95 in_seq=0 out_seq=0 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2530965995 <== mds.2 v2:172.21.15.131:6833/4032170839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5626db5f68c0 con 0x5626db6647f0 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7ae2ffd700 10 client.7023 handle_command_reply: tid=0 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 client.7023 shutdown 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2530965995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db674c50 msgr2=0x5626db6673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db674c50 0x5626db6673b0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f7aec01c830 tx=0x7f7aec003040 comp rx=0 tx=0).stop 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2530965995 shutdown_connections 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x5626db6647f0 0x5626db664bf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db674c50 0x5626db6673b0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db624890 0x5626db663470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7ae2ffd700 0 client.7023 ms_handle_reset on v2:172.21.15.131:6833/4032170839 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2530965995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db666e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2530965995 >> 172.21.15.84:0/2530965995 conn(0x5626db6261b0 msgr2=0x5626db621a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2530965995 shutdown_connections 2023-10-06T02:59:40.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2530965995 wait complete. 2023-10-06T02:59:40.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.222+0000 7f7b13fc7b80 20 client.7023 trim_cache size 0 max 16384 2023-10-06T02:59:40.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.234+0000 7f7b13fc7b80 1 Processor -- start 2023-10-06T02:59:40.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.234+0000 7f7b13fc7b80 1 -- start start 2023-10-06T02:59:40.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db625660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db649bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db626750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626db68c9d0 con 0x5626db624890 2023-10-06T02:59:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626db6699b0 con 0x5626db625d10 2023-10-06T02:59:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626db669f70 con 0x5626db674c50 2023-10-06T02:59:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b08a6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db625660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b08a6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db625660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53830/0 (socket says 172.21.15.84:53830) 2023-10-06T02:59:40.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b08a6b700 1 -- 172.21.15.84:0/154200666 learned_addr learned my addr 172.21.15.84:0/154200666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b08a6b700 1 -- 172.21.15.84:0/154200666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 msgr2=0x5626db626750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/154200666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db626750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b08a6b700 1 -- 172.21.15.84:0/154200666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 msgr2=0x5626db649bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/154200666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db649bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b08a6b700 1 -- 172.21.15.84:0/154200666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626db5437d0 con 0x5626db624890 2023-10-06T02:59:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.235+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/154200666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db625660 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00fce0 tx=0x7f7afc033250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755b41591ed32f59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7afa7fc700 1 -- 172.21.15.84:0/154200666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc033070 con 0x5626db624890 2023-10-06T02:59:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7afa7fc700 1 -- 172.21.15.84:0/154200666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc006b10 con 0x5626db624890 2023-10-06T02:59:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7afa7fc700 1 -- 172.21.15.84:0/154200666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc001b90 con 0x5626db624890 2023-10-06T02:59:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/154200666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 msgr2=0x5626db625660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/154200666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db625660 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00fce0 tx=0x7f7afc033250 comp rx=0 tx=0).stop 2023-10-06T02:59:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/154200666 shutdown_connections 2023-10-06T02:59:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/154200666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db626750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/154200666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db624890 0x5626db625660 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/154200666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db625d10 0x5626db649bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/154200666 >> 172.21.15.84:0/154200666 conn(0x5626db6261b0 msgr2=0x5626db61d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/154200666 shutdown_connections 2023-10-06T02:59:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.236+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/154200666 wait complete. 2023-10-06T02:59:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.237+0000 7f7b13fc7b80 1 -- start start 2023-10-06T02:59:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.237+0000 7f7b13fc7b80 1 Processor -- start 2023-10-06T02:59:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db624890 0x5626db6b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db625d10 0x5626db6250d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db625610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626db64bd70 con 0x5626db625d10 2023-10-06T02:59:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626db672400 con 0x5626db624890 2023-10-06T02:59:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626db6d3df0 con 0x5626db674c50 2023-10-06T02:59:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 10 client.0 _ll_register_callbacks cb 0x5626db5e7ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T02:59:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b03fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db625d10 0x5626db6250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b03fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db625d10 0x5626db6250d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53836/0 (socket says 172.21.15.84:53836) 2023-10-06T02:59:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b03fff700 1 -- 172.21.15.84:0/2442960434 learned_addr learned my addr 172.21.15.84:0/2442960434 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b0926c700 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db625610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db624890 0x5626db6b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b03fff700 1 -- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 msgr2=0x5626db625610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b03fff700 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db625610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b03fff700 1 -- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db624890 msgr2=0x5626db6b9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b03fff700 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db624890 0x5626db6b9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b03fff700 1 -- 172.21.15.84:0/2442960434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626db40f2c0 con 0x5626db625d10 2023-10-06T02:59:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b03fff700 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db625d10 0x5626db6250d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7b040cd240 tx=0x7f7af4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee05923ca7750146 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7ae2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T02:59:40.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2442960434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4015460 con 0x5626db625d10 2023-10-06T02:59:40.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2442960434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7afc014af0 con 0x5626db625d10 2023-10-06T02:59:40.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2442960434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7af40155c0 con 0x5626db625d10 2023-10-06T02:59:40.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2442960434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7af4015990 con 0x5626db625d10 2023-10-06T02:59:40.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 10 client.7029 fetch_fsmap learned FSMap version 61 2023-10-06T02:59:40.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.238+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2442960434 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x5626db52a4c0 con 0x5626db625d10 2023-10-06T02:59:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2442960434 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc014af0 con 0x5626db625d10 2023-10-06T02:59:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2442960434 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 61) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f7af4015af0 con 0x5626db625d10 2023-10-06T02:59:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7b13fc7b80 10 client.7029 fetch_fsmap finished waiting for FSMap version 61 2023-10-06T02:59:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7b13fc7b80 10 client.7029 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.d 2023-10-06T02:59:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7b13fc7b80 20 client.7029 populate_metadata read hostname 'smithi084' 2023-10-06T02:59:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x5626db64d160 0x5626db664bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7b13fc7b80 4 client.7029 mds_command: new command op to 5567 tid=0[{"prefix": "damage ls"}] 2023-10-06T02:59:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2442960434 --> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5626db517e50 con 0x5626db64d160 2023-10-06T02:59:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x5626db64d160 0x5626db664bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7ae2ffd700 10 client.7029 ms_handle_connect on v2:172.21.15.131:6833/4032170839 2023-10-06T02:59:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7b08a6b700 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x5626db64d160 0x5626db664bc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=88ca39a185f4a50a server_cookie=a446149358cbe12f in_seq=0 out_seq=0 2023-10-06T02:59:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7ae2ffd700 1 -- 172.21.15.84:0/2442960434 <== mds.2 v2:172.21.15.131:6833/4032170839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+296 (crc 0 0 0) 0x5626db517e50 con 0x5626db64d160 2023-10-06T02:59:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.239+0000 7f7ae2ffd700 10 client.7029 handle_command_reply: tid=0 2023-10-06T02:59:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 client.7029 shutdown 2023-10-06T02:59:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2442960434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db625d10 msgr2=0x5626db6250d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db625d10 0x5626db6250d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7b040cd240 tx=0x7f7af4009040 comp rx=0 tx=0).stop 2023-10-06T02:59:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2442960434 shutdown_connections 2023-10-06T02:59:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:6833/4032170839,v1:172.21.15.131:6835/4032170839] conn(0x5626db64d160 0x5626db664bc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626db624890 0x5626db6b9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7ae2ffd700 0 client.7029 ms_handle_reset on v2:172.21.15.131:6833/4032170839 2023-10-06T02:59:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626db674c50 0x5626db625610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 --2- 172.21.15.84:0/2442960434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626db625d10 0x5626db6250d0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2442960434 >> 172.21.15.84:0/2442960434 conn(0x5626db6261b0 msgr2=0x5626db67a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2442960434 shutdown_connections 2023-10-06T02:59:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 1 -- 172.21.15.84:0/2442960434 wait complete. 2023-10-06T02:59:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b13fc7b80 20 client.7029 trim_cache size 0 max 16384 2023-10-06T02:59:40.262 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T02:59:40.262 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:40.262 INFO:teuthology.orchestra.run.smithi084.stdout: "damage_type": "backtrace", 2023-10-06T02:59:40.262 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 3138056073, 2023-10-06T02:59:40.262 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 1099511627783, 2023-10-06T02:59:40.262 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7/d8" 2023-10-06T02:59:40.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:40.263 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:40.263 INFO:teuthology.orchestra.run.smithi084.stdout: "damage_type": "backtrace", 2023-10-06T02:59:40.263 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 3197056155, 2023-10-06T02:59:40.263 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 1099511627782, 2023-10-06T02:59:40.263 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7" 2023-10-06T02:59:40.263 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:40.263 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T02:59:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 -- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7ae4066f30 msgr2=0x7f7ae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7ae4066f30 0x7f7ae40693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7afc000c00 tx=0x7f7afc0016e0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 -- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b040cbb50 msgr2=0x7f7b040b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b040cbb50 0x7f7b040b3ab0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009f80 tx=0x7f7aec016000 comp rx=0 tx=0).stop 2023-10-06T02:59:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 -- 172.21.15.84:0/4155668187 shutdown_connections 2023-10-06T02:59:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7ae4066f30 0x7f7ae40693e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b040b2a90 0x7f7b0416d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b040cbb50 0x7f7b040b3ab0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 --2- 172.21.15.84:0/4155668187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b040c6610 0x7f7b0415e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 -- 172.21.15.84:0/4155668187 >> 172.21.15.84:0/4155668187 conn(0x7f7b04099740 msgr2=0x7f7b04063450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 -- 172.21.15.84:0/4155668187 shutdown_connections 2023-10-06T02:59:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.240+0000 7f7b0accf700 1 -- 172.21.15.84:0/4155668187 wait complete. 2023-10-06T02:59:40.267 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:59:40.267 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:59:40.307 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:59:40.349 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:59:40.349 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T02:59:40.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T02:59:40.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T02:59:40.386 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T02:59:40.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T02:59:40.387 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T02:59:40.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:59:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.596+0000 7f78a1051700 1 Processor -- start 2023-10-06T02:59:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.596+0000 7f78a1051700 1 -- start start 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.597+0000 7f78a1051700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f789c0696d0 0x7f789c069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.597+0000 7f78a1051700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0b1200 0x7f789c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.597+0000 7f78a1051700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789c159fa0 con 0x7f789c15a430 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.597+0000 7f78a1051700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789c0b1b80 con 0x7f789c0696d0 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.597+0000 7f78a1051700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c1599c0 con 0x7f789c0b1200 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.597+0000 7f789bfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f789c0696d0 0x7f789c069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.597+0000 7f78a0850700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0b1200 0x7f789c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.597+0000 7f789b7fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f789c15a430 0x7f789c06cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:53454/0 (socket says 172.21.15.84:53454) 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.597+0000 7f789b7fe700 1 -- 172.21.15.84:0/1783475392 learned_addr learned my addr 172.21.15.84:0/1783475392 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.598+0000 7f78a0850700 1 -- 172.21.15.84:0/1783475392 >> v2:172.21.15.131:3300/0 conn(0x7f789c0696d0 msgr2=0x7f789c069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.598+0000 7f78a0850700 1 --2- 172.21.15.84:0/1783475392 >> v2:172.21.15.131:3300/0 conn(0x7f789c0696d0 0x7f789c069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.598+0000 7f78a0850700 1 -- 172.21.15.84:0/1783475392 >> v1:172.21.15.131:6789/0 conn(0x7f789c15a430 legacy=0x7f789c06cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.598+0000 7f78a0850700 1 -- 172.21.15.84:0/1783475392 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c06d650 con 0x7f789c0b1200 2023-10-06T02:59:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.598+0000 7f789bfff700 1 --2- 172.21.15.84:0/1783475392 >> v2:172.21.15.131:3300/0 conn(0x7f789c0696d0 0x7f789c069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.598+0000 7f78a0850700 1 --2- 172.21.15.84:0/1783475392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0b1200 0x7f789c0b1640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7894009e60 tx=0x7f7894009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a696315702bf7a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.598+0000 7f789affd700 1 -- 172.21.15.84:0/1783475392 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789400e070 con 0x7f789c0b1200 2023-10-06T02:59:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.598+0000 7f789affd700 1 -- 172.21.15.84:0/1783475392 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789400bb60 con 0x7f789c0b1200 2023-10-06T02:59:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.598+0000 7f789affd700 1 -- 172.21.15.84:0/1783475392 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894012430 con 0x7f789c0b1200 2023-10-06T02:59:40.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.599+0000 7f78a1051700 1 -- 172.21.15.84:0/1783475392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0b1200 msgr2=0x7f789c0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.599+0000 7f78a1051700 1 --2- 172.21.15.84:0/1783475392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0b1200 0x7f789c0b1640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7894009e60 tx=0x7f7894009780 comp rx=0 tx=0).stop 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.599+0000 7f78a1051700 1 -- 172.21.15.84:0/1783475392 shutdown_connections 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.599+0000 7f78a1051700 1 --2- 172.21.15.84:0/1783475392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0b1200 0x7f789c0b1640 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.599+0000 7f78a1051700 1 --2- 172.21.15.84:0/1783475392 >> v2:172.21.15.131:3300/0 conn(0x7f789c0696d0 0x7f789c069aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.599+0000 7f78a1051700 1 -- 172.21.15.84:0/1783475392 >> 172.21.15.84:0/1783475392 conn(0x7f789c06b540 msgr2=0x7f789c06b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.599+0000 7f78a1051700 1 -- 172.21.15.84:0/1783475392 shutdown_connections 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.599+0000 7f78a1051700 1 -- 172.21.15.84:0/1783475392 wait complete. 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.600+0000 7f78a1051700 1 Processor -- start 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.600+0000 7f78a1051700 1 -- start start 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a1051700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0696d0 0x7f789c0acc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a1051700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789c0b1200 0x7f789c15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a1051700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f789c15a430 0x7f789c15cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a1051700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c145f50 con 0x7f789c15a430 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a1051700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c146230 con 0x7f789c0b1200 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a1051700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c146510 con 0x7f789c0696d0 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a0850700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f789c15a430 0x7f789c15cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a0850700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f789c15a430 0x7f789c15cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53848/0 (socket says 172.21.15.84:53848) 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a0850700 1 -- 172.21.15.84:0/2002007146 learned_addr learned my addr 172.21.15.84:0/2002007146 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f789bfff700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0696d0 0x7f789c0acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f789b7fe700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789c0b1200 0x7f789c15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a0850700 1 -- 172.21.15.84:0/2002007146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0696d0 msgr2=0x7f789c0acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a0850700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0696d0 0x7f789c0acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a0850700 1 -- 172.21.15.84:0/2002007146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789c0b1200 msgr2=0x7f789c15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a0850700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789c0b1200 0x7f789c15cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a0850700 1 -- 172.21.15.84:0/2002007146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c009420 con 0x7f789c15a430 2023-10-06T02:59:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.601+0000 7f78a0850700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f789c15a430 0x7f789c15cff0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f789c0ced20 tx=0x7f7894019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.602+0000 7f7883fff700 1 -- 172.21.15.84:0/2002007146 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894027470 con 0x7f789c15a430 2023-10-06T02:59:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.602+0000 7f7883fff700 1 -- 172.21.15.84:0/2002007146 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78940275f0 con 0x7f789c15a430 2023-10-06T02:59:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.602+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7894009a20 con 0x7f789c15a430 2023-10-06T02:59:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.602+0000 7f7883fff700 1 -- 172.21.15.84:0/2002007146 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78940279b0 con 0x7f789c15a430 2023-10-06T02:59:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.602+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789c146ad0 con 0x7f789c15a430 2023-10-06T02:59:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.602+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789c15a870 con 0x7f789c15a430 2023-10-06T02:59:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.603+0000 7f7883fff700 1 -- 172.21.15.84:0/2002007146 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7894024070 con 0x7f789c15a430 2023-10-06T02:59:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.603+0000 7f7883fff700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7888066f30 0x7f78880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.603+0000 7f7883fff700 1 -- 172.21.15.84:0/2002007146 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7894087370 con 0x7f789c15a430 2023-10-06T02:59:40.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.603+0000 7f789bfff700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7888066f30 0x7f78880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.604+0000 7f789bfff700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7888066f30 0x7f78880693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f788c009ea0 tx=0x7f788c0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.608+0000 7f7883fff700 1 -- 172.21.15.84:0/2002007146 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78940542e0 con 0x7f789c15a430 2023-10-06T02:59:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.834+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f789c071440 con 0x7f789c15a430 2023-10-06T02:59:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.834+0000 7f7883fff700 1 -- 172.21.15.84:0/2002007146 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4639 (secure 0 0 0) 0x7f7894057900 con 0x7f789c15a430 2023-10-06T02:59:40.836 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:40.836 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:58:34.102008+0000","modified":"2023-10-06T02:59:16.239051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6528,"mds_1":6525,"mds_2":5567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5567":{"gid":5567,"name":"d","rank":2,"incarnation":55,"state":"up:active","state_seq":13,"addr":"172.21.15.131:6835/4032170839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4032170839},{"type":"v1","addr":"172.21.15.131:6835","nonce":4032170839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6525":{"gid":6525,"name":"c","rank":1,"incarnation":53,"state":"up:active","state_seq":13,"addr":"172.21.15.84:6836/1455824046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1455824046},{"type":"v1","addr":"172.21.15.84:6836","nonce":1455824046}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6528":{"gid":6528,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":13,"addr":"172.21.15.84:6837/3591915780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3591915780},{"type":"v1","addr":"172.21.15.84:6837","nonce":3591915780}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:59:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7888066f30 msgr2=0x7f78880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7888066f30 0x7f78880693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f788c009ea0 tx=0x7f788c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f789c15a430 msgr2=0x7f789c15cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f789c15a430 0x7f789c15cff0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f789c0ced20 tx=0x7f7894019000 comp rx=0 tx=0).stop 2023-10-06T02:59:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 shutdown_connections 2023-10-06T02:59:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7888066f30 0x7f78880693e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f789c15a430 0x7f789c15cff0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f789c0696d0 0x7f789c0acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 --2- 172.21.15.84:0/2002007146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f789c0b1200 0x7f789c15cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 >> 172.21.15.84:0/2002007146 conn(0x7f789c06b540 msgr2=0x7f789c1565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 shutdown_connections 2023-10-06T02:59:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.836+0000 7f78a1051700 1 -- 172.21.15.84:0/2002007146 wait complete. 2023-10-06T02:59:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 61 2023-10-06T02:59:40.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:40.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.962+0000 7f24addee700 1 Processor -- start 2023-10-06T02:59:40.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.962+0000 7f24addee700 1 -- start start 2023-10-06T02:59:40.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24addee700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b49e0 0x7f24a80aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24addee700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f24a80b07a0 0x7f24a80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24addee700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a80b0ca0 con 0x7f24a81595a0 2023-10-06T02:59:40.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24addee700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80b0f80 con 0x7f24a80b07a0 2023-10-06T02:59:40.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24addee700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80b1260 con 0x7f24a80b49e0 2023-10-06T02:59:40.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f24a80b07a0 0x7f24a80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f24a80b07a0 0x7f24a80b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53858/0 (socket says 172.21.15.84:53858) 2023-10-06T02:59:40.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a7fff700 1 -- 172.21.15.84:0/1829636180 learned_addr learned my addr 172.21.15.84:0/1829636180 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a6ffd700 1 --2- 172.21.15.84:0/1829636180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b49e0 0x7f24a80aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a7fff700 1 -- 172.21.15.84:0/1829636180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b49e0 msgr2=0x7f24a80aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a7fff700 1 --2- 172.21.15.84:0/1829636180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b49e0 0x7f24a80aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a7fff700 1 -- 172.21.15.84:0/1829636180 >> v1:172.21.15.131:6789/0 conn(0x7f24a81595a0 legacy=0x7f24a80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:40.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a7fff700 1 -- 172.21.15.84:0/1829636180 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80b1540 con 0x7f24a80b07a0 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a6ffd700 1 --2- 172.21.15.84:0/1829636180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b49e0 0x7f24a80aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a7fff700 1 --2- 172.21.15.84:0/1829636180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b07a0 0x7f24a80b1c00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009f20 tx=0x7f24a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26543f07b09bb948 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.963+0000 7f24a67fc700 1 -- 172.21.15.84:0/1829636180 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000e070 con 0x7f24a80b07a0 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24a67fc700 1 -- 172.21.15.84:0/1829636180 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000ba40 con 0x7f24a80b07a0 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24a67fc700 1 -- 172.21.15.84:0/1829636180 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a00092e0 con 0x7f24a80b07a0 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24addee700 1 -- 172.21.15.84:0/1829636180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b07a0 msgr2=0x7f24a80b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24addee700 1 --2- 172.21.15.84:0/1829636180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b07a0 0x7f24a80b1c00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009f20 tx=0x7f24a0009840 comp rx=0 tx=0).stop 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24addee700 1 -- 172.21.15.84:0/1829636180 shutdown_connections 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24addee700 1 --2- 172.21.15.84:0/1829636180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b07a0 0x7f24a80b1c00 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24addee700 1 --2- 172.21.15.84:0/1829636180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b49e0 0x7f24a80aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24addee700 1 -- 172.21.15.84:0/1829636180 >> 172.21.15.84:0/1829636180 conn(0x7f24a8099830 msgr2=0x7f24a806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:40.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24addee700 1 -- 172.21.15.84:0/1829636180 shutdown_connections 2023-10-06T02:59:40.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.964+0000 7f24addee700 1 -- 172.21.15.84:0/1829636180 wait complete. 2023-10-06T02:59:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.965+0000 7f24addee700 1 Processor -- start 2023-10-06T02:59:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.965+0000 7f24addee700 1 -- start start 2023-10-06T02:59:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24addee700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b07a0 0x7f24a815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24addee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b49e0 0x7f24a80acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24addee700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a81595a0 0x7f24a8158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24addee700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a815e610 con 0x7f24a80b49e0 2023-10-06T02:59:40.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24addee700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a815e8f0 con 0x7f24a81595a0 2023-10-06T02:59:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24addee700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a815ebd0 con 0x7f24a80b07a0 2023-10-06T02:59:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24a6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b49e0 0x7f24a80acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24a6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b49e0 0x7f24a80acf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53862/0 (socket says 172.21.15.84:53862) 2023-10-06T02:59:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24a6ffd700 1 -- 172.21.15.84:0/3720593995 learned_addr learned my addr 172.21.15.84:0/3720593995 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24a77fe700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b07a0 0x7f24a815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24a7fff700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a81595a0 0x7f24a8158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24a6ffd700 1 -- 172.21.15.84:0/3720593995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b07a0 msgr2=0x7f24a815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.966+0000 7f24a6ffd700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b07a0 0x7f24a815dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.967+0000 7f24a6ffd700 1 -- 172.21.15.84:0/3720593995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a81595a0 msgr2=0x7f24a8158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.967+0000 7f24a6ffd700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a81595a0 0x7f24a8158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.967+0000 7f24a6ffd700 1 -- 172.21.15.84:0/3720593995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0009ae0 con 0x7f24a80b49e0 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.967+0000 7f24a6ffd700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b49e0 0x7f24a80acf80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c830 tx=0x7f249c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.967+0000 7f248f7fe700 1 -- 172.21.15.84:0/3720593995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c011600 con 0x7f24a80b49e0 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.967+0000 7f248f7fe700 1 -- 172.21.15.84:0/3720593995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c011760 con 0x7f24a80b49e0 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.967+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a815eeb0 con 0x7f24a80b49e0 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.967+0000 7f248f7fe700 1 -- 172.21.15.84:0/3720593995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c011b20 con 0x7f24a80b49e0 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.967+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a815e210 con 0x7f24a80b49e0 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.968+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a8064ad0 con 0x7f24a80b49e0 2023-10-06T02:59:40.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.968+0000 7f248f7fe700 1 -- 172.21.15.84:0/3720593995 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f249c018360 con 0x7f24a80b49e0 2023-10-06T02:59:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.969+0000 7f248f7fe700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2494066f30 0x7f24940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.969+0000 7f24a77fe700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2494066f30 0x7f24940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.969+0000 7f248f7fe700 1 -- 172.21.15.84:0/3720593995 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f249c0847a0 con 0x7f24a80b49e0 2023-10-06T02:59:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.969+0000 7f24a77fe700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2494066f30 0x7f24940693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2498006fd0 tx=0x7f2498009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:40.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:40.973+0000 7f248f7fe700 1 -- 172.21.15.84:0/3720593995 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f249c051730 con 0x7f24a80b49e0 2023-10-06T02:59:41.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.156+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24a80b1820 con 0x7f24a80b49e0 2023-10-06T02:59:41.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.157+0000 7f248f7fe700 1 -- 172.21.15.84:0/3720593995 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17171 (secure 0 0 0) 0x7f249c054d50 con 0x7f24a80b49e0 2023-10-06T02:59:41.159 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:41.159 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:58:51.164308+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:58:31.743689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:58:33.068884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:41.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.159+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2494066f30 msgr2=0x7f24940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.159+0000 7f24addee700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2494066f30 0x7f24940693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2498006fd0 tx=0x7f2498009060 comp rx=0 tx=0).stop 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.159+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b49e0 msgr2=0x7f24a80acf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.159+0000 7f24addee700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b49e0 0x7f24a80acf80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c830 tx=0x7f249c008040 comp rx=0 tx=0).stop 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.160+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 shutdown_connections 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.160+0000 7f24addee700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2494066f30 0x7f24940693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.160+0000 7f24addee700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24a81595a0 0x7f24a8158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.160+0000 7f24addee700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24a80b07a0 0x7f24a815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.160+0000 7f24addee700 1 --2- 172.21.15.84:0/3720593995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a80b49e0 0x7f24a80acf80 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.160+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 >> 172.21.15.84:0/3720593995 conn(0x7f24a8099830 msgr2=0x7f24a80ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.160+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 shutdown_connections 2023-10-06T02:59:41.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.160+0000 7f24addee700 1 -- 172.21.15.84:0/3720593995 wait complete. 2023-10-06T02:59:41.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:58:31.743689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:58:33.068884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T02:59:41.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:59:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.289+0000 7fd632446700 1 Processor -- start 2023-10-06T02:59:41.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.289+0000 7fd632446700 1 -- start start 2023-10-06T02:59:41.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.290+0000 7fd632446700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140ab0 0x7fd62c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.290+0000 7fd632446700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd62c0caf80 0x7fd62c0ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.290+0000 7fd632446700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0cc680 con 0x7fd62c140e80 2023-10-06T02:59:41.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.290+0000 7fd632446700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0c9e30 con 0x7fd62c0caf80 2023-10-06T02:59:41.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.290+0000 7fd632446700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c06daf0 con 0x7fd62c140ab0 2023-10-06T02:59:41.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.290+0000 7fd630c43700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd62c140e80 0x7fd62c0ca870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36974/0 (socket says 172.21.15.84:36974) 2023-10-06T02:59:41.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.290+0000 7fd630c43700 1 -- 172.21.15.84:0/1357368111 learned_addr learned my addr 172.21.15.84:0/1357368111 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.290+0000 7fd631c45700 1 --2- 172.21.15.84:0/1357368111 >> v2:172.21.15.84:3300/0 conn(0x7fd62c0caf80 0x7fd62c0ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.291+0000 7fd631444700 1 --2- 172.21.15.84:0/1357368111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140ab0 0x7fd62c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.291+0000 7fd631c45700 1 -- 172.21.15.84:0/1357368111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140ab0 msgr2=0x7fd62c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.291+0000 7fd631c45700 1 --2- 172.21.15.84:0/1357368111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140ab0 0x7fd62c0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.291+0000 7fd631c45700 1 -- 172.21.15.84:0/1357368111 >> v1:172.21.15.84:6789/0 conn(0x7fd62c140e80 legacy=0x7fd62c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.291+0000 7fd631c45700 1 -- 172.21.15.84:0/1357368111 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0ccc20 con 0x7fd62c0caf80 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.291+0000 7fd631c45700 1 --2- 172.21.15.84:0/1357368111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c0caf80 0x7fd62c0ad760 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd624009e60 tx=0x7fd624009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6adc43fb9cd235 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.291+0000 7fd623fff700 1 -- 172.21.15.84:0/1357368111 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400e070 con 0x7fd62c0caf80 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.291+0000 7fd623fff700 1 -- 172.21.15.84:0/1357368111 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400bb60 con 0x7fd62c0caf80 2023-10-06T02:59:41.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.291+0000 7fd623fff700 1 -- 172.21.15.84:0/1357368111 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624012430 con 0x7fd62c0caf80 2023-10-06T02:59:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.292+0000 7fd632446700 1 -- 172.21.15.84:0/1357368111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c0caf80 msgr2=0x7fd62c0ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.292+0000 7fd632446700 1 --2- 172.21.15.84:0/1357368111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c0caf80 0x7fd62c0ad760 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd624009e60 tx=0x7fd624009780 comp rx=0 tx=0).stop 2023-10-06T02:59:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.292+0000 7fd632446700 1 -- 172.21.15.84:0/1357368111 shutdown_connections 2023-10-06T02:59:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.292+0000 7fd632446700 1 --2- 172.21.15.84:0/1357368111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c0caf80 0x7fd62c0ad760 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.292+0000 7fd632446700 1 --2- 172.21.15.84:0/1357368111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140ab0 0x7fd62c0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.292+0000 7fd632446700 1 -- 172.21.15.84:0/1357368111 >> 172.21.15.84:0/1357368111 conn(0x7fd62c06b370 msgr2=0x7fd62c06b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.292+0000 7fd632446700 1 -- 172.21.15.84:0/1357368111 shutdown_connections 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.292+0000 7fd632446700 1 -- 172.21.15.84:0/1357368111 wait complete. 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.293+0000 7fd632446700 1 Processor -- start 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.293+0000 7fd632446700 1 -- start start 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd632446700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62c0caf80 0x7fd62c13e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd632446700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c140ab0 0x7fd62c158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd632446700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140e80 0x7fd62c158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd632446700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c13ef30 con 0x7fd62c140ab0 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd632446700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c5e50 con 0x7fd62c0caf80 2023-10-06T02:59:41.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd632446700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c5240 con 0x7fd62c140e80 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd630c43700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c140ab0 0x7fd62c158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd630c43700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c140ab0 0x7fd62c158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53876/0 (socket says 172.21.15.84:53876) 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd630c43700 1 -- 172.21.15.84:0/3398613340 learned_addr learned my addr 172.21.15.84:0/3398613340 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd631c45700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140e80 0x7fd62c158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.294+0000 7fd631444700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62c0caf80 0x7fd62c13e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd630c43700 1 -- 172.21.15.84:0/3398613340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140e80 msgr2=0x7fd62c158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd630c43700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140e80 0x7fd62c158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd630c43700 1 -- 172.21.15.84:0/3398613340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62c0caf80 msgr2=0x7fd62c13e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd630c43700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62c0caf80 0x7fd62c13e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd630c43700 1 -- 172.21.15.84:0/3398613340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624009a20 con 0x7fd62c140ab0 2023-10-06T02:59:41.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd630c43700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c140ab0 0x7fd62c158430 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00c560 tx=0x7fd61c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:41.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd6217fa700 1 -- 172.21.15.84:0/3398613340 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c005b30 con 0x7fd62c140ab0 2023-10-06T02:59:41.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd6217fa700 1 -- 172.21.15.84:0/3398613340 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c005c90 con 0x7fd62c140ab0 2023-10-06T02:59:41.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd6217fa700 1 -- 172.21.15.84:0/3398613340 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c007320 con 0x7fd62c140ab0 2023-10-06T02:59:41.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c0c5520 con 0x7fd62c140ab0 2023-10-06T02:59:41.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.295+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c0c5ae0 con 0x7fd62c140ab0 2023-10-06T02:59:41.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.296+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c05f270 con 0x7fd62c140ab0 2023-10-06T02:59:41.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.296+0000 7fd6217fa700 1 -- 172.21.15.84:0/3398613340 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd61c01b3b0 con 0x7fd62c140ab0 2023-10-06T02:59:41.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.296+0000 7fd6217fa700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd610066f60 0x7fd610069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.297+0000 7fd6217fa700 1 -- 172.21.15.84:0/3398613340 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fd61c083bb0 con 0x7fd62c140ab0 2023-10-06T02:59:41.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.297+0000 7fd631444700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd610066f60 0x7fd610069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.297+0000 7fd631444700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd610066f60 0x7fd610069410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd628009db0 tx=0x7fd6280091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:41.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.301+0000 7fd6217fa700 1 -- 172.21.15.84:0/3398613340 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd61c050b40 con 0x7fd62c140ab0 2023-10-06T02:59:41.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.482+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd62c0c5f90 con 0x7fd62c140ab0 2023-10-06T02:59:41.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.483+0000 7fd6217fa700 1 -- 172.21.15.84:0/3398613340 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd61c0170a0 con 0x7fd62c140ab0 2023-10-06T02:59:41.484 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd610066f60 msgr2=0x7fd610069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd610066f60 0x7fd610069410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd628009db0 tx=0x7fd6280091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c140ab0 msgr2=0x7fd62c158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c140ab0 0x7fd62c158430 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00c560 tx=0x7fd61c001020 comp rx=0 tx=0).stop 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 shutdown_connections 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd610066f60 0x7fd610069410 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd62c0caf80 0x7fd62c13e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd62c140e80 0x7fd62c158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 --2- 172.21.15.84:0/3398613340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd62c140ab0 0x7fd62c158430 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 >> 172.21.15.84:0/3398613340 conn(0x7fd62c06b370 msgr2=0x7fd62c13f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:41.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 shutdown_connections 2023-10-06T02:59:41.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.485+0000 7fd632446700 1 -- 172.21.15.84:0/3398613340 wait complete. 2023-10-06T02:59:41.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:59:41.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.613+0000 7fcdf32a0700 1 Processor -- start 2023-10-06T02:59:41.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.614+0000 7fcdf32a0700 1 -- start start 2023-10-06T02:59:41.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.614+0000 7fcdf32a0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcdec159c10 0x7fcdec0d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.614+0000 7fcdf32a0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcdec0d0850 0x7fcdec163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.614+0000 7fcdf32a0700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdec0b5f30 con 0x7fcdec0cd980 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.614+0000 7fcdf32a0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdec0b3640 con 0x7fcdec0d0850 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.614+0000 7fcdf32a0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdec0d0c60 con 0x7fcdec159c10 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.614+0000 7fcdf183d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcdec0d0850 0x7fcdec163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcdf183d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcdec0d0850 0x7fcdec163240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53878/0 (socket says 172.21.15.84:53878) 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcdf183d700 1 -- 172.21.15.84:0/2945802115 learned_addr learned my addr 172.21.15.84:0/2945802115 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcdf083b700 1 --2- 172.21.15.84:0/2945802115 >> v2:172.21.15.131:3300/0 conn(0x7fcdec159c10 0x7fcdec0d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcdf183d700 1 -- 172.21.15.84:0/2945802115 >> v2:172.21.15.131:3300/0 conn(0x7fcdec159c10 msgr2=0x7fcdec0d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcdf183d700 1 --2- 172.21.15.84:0/2945802115 >> v2:172.21.15.131:3300/0 conn(0x7fcdec159c10 0x7fcdec0d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcdf183d700 1 -- 172.21.15.84:0/2945802115 >> v1:172.21.15.131:6789/0 conn(0x7fcdec0cd980 legacy=0x7fcdec0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcdf183d700 1 -- 172.21.15.84:0/2945802115 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec0b63c0 con 0x7fcdec0d0850 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcdf083b700 1 --2- 172.21.15.84:0/2945802115 >> v2:172.21.15.131:3300/0 conn(0x7fcdec159c10 0x7fcdec0d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcdf183d700 1 --2- 172.21.15.84:0/2945802115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec0d0850 0x7fcdec163240 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0af180 tx=0x7fcde4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f70c6fecc7071cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcde3fff700 1 -- 172.21.15.84:0/2945802115 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde400e070 con 0x7fcdec0d0850 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcde3fff700 1 -- 172.21.15.84:0/2945802115 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde400ba10 con 0x7fcdec0d0850 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.615+0000 7fcde3fff700 1 -- 172.21.15.84:0/2945802115 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde40092e0 con 0x7fcdec0d0850 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.616+0000 7fcdf32a0700 1 -- 172.21.15.84:0/2945802115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec0d0850 msgr2=0x7fcdec163240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.616+0000 7fcdf32a0700 1 --2- 172.21.15.84:0/2945802115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec0d0850 0x7fcdec163240 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fcdec0af180 tx=0x7fcde4009840 comp rx=0 tx=0).stop 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.616+0000 7fcdf32a0700 1 -- 172.21.15.84:0/2945802115 shutdown_connections 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.616+0000 7fcdf32a0700 1 --2- 172.21.15.84:0/2945802115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec0d0850 0x7fcdec163240 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.616+0000 7fcdf32a0700 1 --2- 172.21.15.84:0/2945802115 >> v2:172.21.15.131:3300/0 conn(0x7fcdec159c10 0x7fcdec0d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.616+0000 7fcdf32a0700 1 -- 172.21.15.84:0/2945802115 >> 172.21.15.84:0/2945802115 conn(0x7fcdec06ed20 msgr2=0x7fcdec06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:41.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.616+0000 7fcdf32a0700 1 -- 172.21.15.84:0/2945802115 shutdown_connections 2023-10-06T02:59:41.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.616+0000 7fcdf32a0700 1 -- 172.21.15.84:0/2945802115 wait complete. 2023-10-06T02:59:41.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.617+0000 7fcdf32a0700 1 Processor -- start 2023-10-06T02:59:41.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.617+0000 7fcdf32a0700 1 -- start start 2023-10-06T02:59:41.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf32a0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0cd980 0x7fcdec16ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf32a0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcdec0d0850 0x7fcdec0cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf32a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec159c10 0x7fcdec15de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf32a0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0cecd0 con 0x7fcdec159c10 2023-10-06T02:59:41.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf32a0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0ce0c0 con 0x7fcdec0cd980 2023-10-06T02:59:41.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf32a0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0ce3a0 con 0x7fcdec0d0850 2023-10-06T02:59:41.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf183d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec159c10 0x7fcdec15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf183d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec159c10 0x7fcdec15de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53892/0 (socket says 172.21.15.84:53892) 2023-10-06T02:59:41.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf183d700 1 -- 172.21.15.84:0/3541009020 learned_addr learned my addr 172.21.15.84:0/3541009020 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:41.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf103c700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0cd980 0x7fcdec16ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf183d700 1 -- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcdec0d0850 msgr2=0x7fcdec0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf083b700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcdec0d0850 0x7fcdec0cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf183d700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcdec0d0850 0x7fcdec0cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf183d700 1 -- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0cd980 msgr2=0x7fcdec16ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf183d700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0cd980 0x7fcdec16ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf183d700 1 -- 172.21.15.84:0/3541009020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde4009ae0 con 0x7fcdec159c10 2023-10-06T02:59:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf103c700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0cd980 0x7fcdec16ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf083b700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcdec0d0850 0x7fcdec0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf183d700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec159c10 0x7fcdec15de80 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fcdec089150 tx=0x7fcde4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcde17fa700 1 -- 172.21.15.84:0/3541009020 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde40032f0 con 0x7fcdec159c10 2023-10-06T02:59:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcde17fa700 1 -- 172.21.15.84:0/3541009020 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde4012e60 con 0x7fcdec159c10 2023-10-06T02:59:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.618+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec0ce680 con 0x7fcdec159c10 2023-10-06T02:59:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.619+0000 7fcde17fa700 1 -- 172.21.15.84:0/3541009020 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde401d670 con 0x7fcdec159c10 2023-10-06T02:59:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.619+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdec0cdd50 con 0x7fcdec159c10 2023-10-06T02:59:41.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.619+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdec064ad0 con 0x7fcdec159c10 2023-10-06T02:59:41.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.620+0000 7fcde17fa700 1 -- 172.21.15.84:0/3541009020 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcde401daa0 con 0x7fcdec159c10 2023-10-06T02:59:41.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.620+0000 7fcde17fa700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcdd0066f30 0x7fcdd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.620+0000 7fcde17fa700 1 -- 172.21.15.84:0/3541009020 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fcde4086230 con 0x7fcdec159c10 2023-10-06T02:59:41.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.620+0000 7fcdf103c700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcdd0066f30 0x7fcdd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.621+0000 7fcdf103c700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcdd0066f30 0x7fcdd00693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcde8006fd0 tx=0x7fcde8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:41.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.625+0000 7fcde17fa700 1 -- 172.21.15.84:0/3541009020 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcde4053120 con 0x7fcdec159c10 2023-10-06T02:59:41.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.806+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcdec0cee10 con 0x7fcdec159c10 2023-10-06T02:59:41.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.807+0000 7fcde17fa700 1 -- 172.21.15.84:0/3541009020 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcde4009420 con 0x7fcdec159c10 2023-10-06T02:59:41.808 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:59:41.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.808+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcdd0066f30 msgr2=0x7fcdd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.808+0000 7fcdf32a0700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcdd0066f30 0x7fcdd00693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcde8006fd0 tx=0x7fcde8008040 comp rx=0 tx=0).stop 2023-10-06T02:59:41.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.808+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec159c10 msgr2=0x7fcdec15de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.808+0000 7fcdf32a0700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec159c10 0x7fcdec15de80 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fcdec089150 tx=0x7fcde4017000 comp rx=0 tx=0).stop 2023-10-06T02:59:41.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.809+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 shutdown_connections 2023-10-06T02:59:41.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.809+0000 7fcdf32a0700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcdd0066f30 0x7fcdd00693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.809+0000 7fcdf32a0700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0cd980 0x7fcdec16ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.809+0000 7fcdf32a0700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec159c10 0x7fcdec15de80 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.809+0000 7fcdf32a0700 1 --2- 172.21.15.84:0/3541009020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcdec0d0850 0x7fcdec0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.809+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 >> 172.21.15.84:0/3541009020 conn(0x7fcdec06ed20 msgr2=0x7fcdec150090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:41.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.809+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 shutdown_connections 2023-10-06T02:59:41.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.809+0000 7fcdf32a0700 1 -- 172.21.15.84:0/3541009020 wait complete. 2023-10-06T02:59:41.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T02:59:41.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.938+0000 7f9d013a2700 1 Processor -- start 2023-10-06T02:59:41.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.938+0000 7f9d013a2700 1 -- start start 2023-10-06T02:59:41.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.939+0000 7f9d013a2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9cfc0b0800 0x7f9cfc156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.939+0000 7f9d013a2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc15a640 con 0x7f9cfc1539b0 2023-10-06T02:59:41.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.939+0000 7f9d013a2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0b0d10 con 0x7f9cfc0b1870 2023-10-06T02:59:41.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.939+0000 7f9d013a2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc159d10 con 0x7f9cfc0b0800 2023-10-06T02:59:41.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.939+0000 7f9d00ba1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9cfc0b0800 0x7f9cfc156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.939+0000 7f9cfbfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9cfc1539b0 0x7f9cfc0b1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36980/0 (socket says 172.21.15.84:36980) 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.939+0000 7f9cfbfff700 1 -- 172.21.15.84:0/981300260 learned_addr learned my addr 172.21.15.84:0/981300260 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d00ba1700 1 -- 172.21.15.84:0/981300260 >> v1:172.21.15.131:6789/0 conn(0x7f9cfc0b1870 legacy=0x7f9cfc156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d00ba1700 1 -- 172.21.15.84:0/981300260 >> v1:172.21.15.84:6789/0 conn(0x7f9cfc1539b0 legacy=0x7f9cfc0b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d00ba1700 1 -- 172.21.15.84:0/981300260 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc159ff0 con 0x7f9cfc0b0800 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9cfaffd700 1 -- 172.21.15.84:0/981300260 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923643284 0 0) 0x7f9cfc15a640 con 0x7f9cfc1539b0 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d00ba1700 1 --2- 172.21.15.84:0/981300260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc0b0800 0x7f9cfc156d40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009e60 tx=0x7f9cf4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686685c7241933db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9cfaffd700 1 -- 172.21.15.84:0/981300260 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400e070 con 0x7f9cfc0b0800 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9cfaffd700 1 -- 172.21.15.84:0/981300260 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400bbf0 con 0x7f9cfc0b0800 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9cfaffd700 1 -- 172.21.15.84:0/981300260 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4012430 con 0x7f9cfc0b0800 2023-10-06T02:59:41.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d013a2700 1 -- 172.21.15.84:0/981300260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc0b0800 msgr2=0x7f9cfc156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d013a2700 1 --2- 172.21.15.84:0/981300260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc0b0800 0x7f9cfc156d40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009e60 tx=0x7f9cf4009780 comp rx=0 tx=0).stop 2023-10-06T02:59:41.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d013a2700 1 -- 172.21.15.84:0/981300260 shutdown_connections 2023-10-06T02:59:41.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d013a2700 1 --2- 172.21.15.84:0/981300260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc0b0800 0x7f9cfc156d40 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d013a2700 1 -- 172.21.15.84:0/981300260 >> 172.21.15.84:0/981300260 conn(0x7f9cfc069180 msgr2=0x7f9cfc0aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:41.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.940+0000 7f9d013a2700 1 -- 172.21.15.84:0/981300260 shutdown_connections 2023-10-06T02:59:41.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.941+0000 7f9d013a2700 1 -- 172.21.15.84:0/981300260 wait complete. 2023-10-06T02:59:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.942+0000 7f9d013a2700 1 Processor -- start 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.942+0000 7f9d013a2700 1 -- start start 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.942+0000 7f9d013a2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cfc0b0800 0x7f9cfc14b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.942+0000 7f9d013a2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cfc0b1870 0x7f9cfc150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.942+0000 7f9d013a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc1539b0 0x7f9cfc150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.942+0000 7f9d013a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc14bd50 con 0x7f9cfc1539b0 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.942+0000 7f9d013a2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0cd830 con 0x7f9cfc0b1870 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.942+0000 7f9d013a2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0ccc20 con 0x7f9cfc0b0800 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d00ba1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc1539b0 0x7f9cfc150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d00ba1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc1539b0 0x7f9cfc150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53920/0 (socket says 172.21.15.84:53920) 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d00ba1700 1 -- 172.21.15.84:0/3947359760 learned_addr learned my addr 172.21.15.84:0/3947359760 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:41.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9cfbfff700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cfc0b0800 0x7f9cfc14b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9cfb7fe700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cfc0b1870 0x7f9cfc150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d00ba1700 1 -- 172.21.15.84:0/3947359760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cfc0b0800 msgr2=0x7f9cfc14b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d00ba1700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cfc0b0800 0x7f9cfc14b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d00ba1700 1 -- 172.21.15.84:0/3947359760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cfc0b1870 msgr2=0x7f9cfc150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d00ba1700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cfc0b1870 0x7f9cfc150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d00ba1700 1 -- 172.21.15.84:0/3947359760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4009a20 con 0x7f9cfc1539b0 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9cfb7fe700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cfc0b1870 0x7f9cfc150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d00ba1700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc1539b0 0x7f9cfc150550 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400b6c0 tx=0x7f9cf4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9ce3fff700 1 -- 172.21.15.84:0/3947359760 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf401d710 con 0x7f9cfc1539b0 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9ce3fff700 1 -- 172.21.15.84:0/3947359760 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf401d870 con 0x7f9cfc1539b0 2023-10-06T02:59:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc0ccf00 con 0x7f9cfc1539b0 2023-10-06T02:59:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9ce3fff700 1 -- 172.21.15.84:0/3947359760 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf401dc30 con 0x7f9cfc1539b0 2023-10-06T02:59:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.943+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc0cd4c0 con 0x7f9cfc1539b0 2023-10-06T02:59:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.944+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc05f270 con 0x7f9cfc1539b0 2023-10-06T02:59:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.944+0000 7f9ce3fff700 1 -- 172.21.15.84:0/3947359760 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cf4024070 con 0x7f9cfc1539b0 2023-10-06T02:59:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.945+0000 7f9ce3fff700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce8066f30 0x7f9ce80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.945+0000 7f9ce3fff700 1 -- 172.21.15.84:0/3947359760 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f9cf4087380 con 0x7f9cfc1539b0 2023-10-06T02:59:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.945+0000 7f9cfbfff700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce8066f30 0x7f9ce80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.945+0000 7f9cfbfff700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce8066f30 0x7f9ce80693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc1691d0 tx=0x7f9cec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:41.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:41.949+0000 7f9ce3fff700 1 -- 172.21.15.84:0/3947359760 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cf40543c0 con 0x7f9cfc1539b0 2023-10-06T02:59:42.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.131+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9cfc15a2d0 con 0x7f9cfc1539b0 2023-10-06T02:59:42.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.131+0000 7f9ce3fff700 1 -- 172.21.15.84:0/3947359760 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cf40579e0 con 0x7f9cfc1539b0 2023-10-06T02:59:42.133 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T02:59:42.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce8066f30 msgr2=0x7f9ce80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce8066f30 0x7f9ce80693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc1691d0 tx=0x7f9cec009040 comp rx=0 tx=0).stop 2023-10-06T02:59:42.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc1539b0 msgr2=0x7f9cfc150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc1539b0 0x7f9cfc150550 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400b6c0 tx=0x7f9cf4018000 comp rx=0 tx=0).stop 2023-10-06T02:59:42.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 shutdown_connections 2023-10-06T02:59:42.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce8066f30 0x7f9ce80693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cfc1539b0 0x7f9cfc150550 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cfc0b0800 0x7f9cfc14b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 --2- 172.21.15.84:0/3947359760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cfc0b1870 0x7f9cfc150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 >> 172.21.15.84:0/3947359760 conn(0x7f9cfc069180 msgr2=0x7f9cfc14cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:42.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 shutdown_connections 2023-10-06T02:59:42.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.133+0000 7f9d013a2700 1 -- 172.21.15.84:0/3947359760 wait complete. 2023-10-06T02:59:42.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T02:59:42.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.262+0000 7fef88c2a700 1 Processor -- start 2023-10-06T02:59:42.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.262+0000 7fef88c2a700 1 -- start start 2023-10-06T02:59:42.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef88c2a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fef84159510 0x7fef840cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef88c2a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef840cbae0 0x7fef840cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef88c2a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef840cbef0 con 0x7fef841598e0 2023-10-06T02:59:42.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef88c2a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef840cf610 con 0x7fef84159510 2023-10-06T02:59:42.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef88c2a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef840cf8f0 con 0x7fef840cbae0 2023-10-06T02:59:42.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef81d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fef841598e0 0x7fef840ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36990/0 (socket says 172.21.15.84:36990) 2023-10-06T02:59:42.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef81d9b700 1 -- 172.21.15.84:0/876333303 learned_addr learned my addr 172.21.15.84:0/876333303 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:42.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8259c700 1 --2- 172.21.15.84:0/876333303 >> v2:172.21.15.131:3300/0 conn(0x7fef84159510 0x7fef840cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef82d9d700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef840cbae0 0x7fef840cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291220466 0 0) 0x7fef840cbef0 con 0x7fef841598e0 2023-10-06T02:59:42.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef6c003570 con 0x7fef841598e0 2023-10-06T02:59:42.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3340714983 0 0) 0x7fef6c003570 con 0x7fef841598e0 2023-10-06T02:59:42.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef840cbae0 msgr2=0x7fef840cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:42.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef840cbae0 0x7fef840cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 >> v2:172.21.15.131:3300/0 conn(0x7fef84159510 msgr2=0x7fef840cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:42.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 --2- 172.21.15.84:0/876333303 >> v2:172.21.15.131:3300/0 conn(0x7fef84159510 0x7fef840cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef840cfbd0 con 0x7fef841598e0 2023-10-06T02:59:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fef78001470 con 0x7fef841598e0 2023-10-06T02:59:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 >> v1:172.21.15.84:6789/0 conn(0x7fef841598e0 legacy=0x7fef840ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef6c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c004810 0x7fef6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef840cbae0 0x7fef6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef840cf610 con 0x7fef6c003a60 2023-10-06T02:59:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef840cf8f0 con 0x7fef6c004810 2023-10-06T02:59:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c00ba60 con 0x7fef840cbae0 2023-10-06T02:59:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.263+0000 7fef8259c700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef6c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef81d9b700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c004810 0x7fef6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef82d9d700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef840cbae0 0x7fef6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef8259c700 1 -- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef840cbae0 msgr2=0x7fef6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef8259c700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef840cbae0 0x7fef6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef8259c700 1 -- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c004810 msgr2=0x7fef6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef8259c700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c004810 0x7fef6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef8259c700 1 -- 172.21.15.84:0/876333303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c003570 con 0x7fef6c003a60 2023-10-06T02:59:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef8259c700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef6c003e70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fef7400e240 tx=0x7fef7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ec992c06c8540 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7400eaf0 con 0x7fef6c003a60 2023-10-06T02:59:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7400f040 con 0x7fef6c003a60 2023-10-06T02:59:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef8159a700 1 -- 172.21.15.84:0/876333303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7400eea0 con 0x7fef6c003a60 2023-10-06T02:59:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef88c2a700 1 -- 172.21.15.84:0/876333303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 msgr2=0x7fef6c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.264+0000 7fef88c2a700 1 --2- 172.21.15.84:0/876333303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef6c003e70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fef7400e240 tx=0x7fef7400b040 comp rx=0 tx=0).stop 2023-10-06T02:59:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.265+0000 7fef82d9d700 1 -- 172.21.15.84:0/876333303 reap_dead start 2023-10-06T02:59:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.265+0000 7fef88c2a700 1 -- 172.21.15.84:0/876333303 shutdown_connections 2023-10-06T02:59:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.265+0000 7fef88c2a700 1 -- 172.21.15.84:0/876333303 >> 172.21.15.84:0/876333303 conn(0x7fef84089e90 msgr2=0x7fef840997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.265+0000 7fef88c2a700 1 -- 172.21.15.84:0/876333303 shutdown_connections 2023-10-06T02:59:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.265+0000 7fef88c2a700 1 -- 172.21.15.84:0/876333303 wait complete. 2023-10-06T02:59:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.266+0000 7fef88c2a700 1 Processor -- start 2023-10-06T02:59:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.266+0000 7fef88c2a700 1 -- start start 2023-10-06T02:59:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.266+0000 7fef88c2a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef8415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.266+0000 7fef88c2a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef84149970 0x7fef840c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.266+0000 7fef88c2a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8415af20 0x7fef840c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.266+0000 7fef88c2a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef84169fb0 con 0x7fef6c003a60 2023-10-06T02:59:42.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.266+0000 7fef88c2a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8415c100 con 0x7fef8415af20 2023-10-06T02:59:42.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.266+0000 7fef88c2a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8415c3e0 con 0x7fef84149970 2023-10-06T02:59:42.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef8259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef8415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef8259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef8415b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53934/0 (socket says 172.21.15.84:53934) 2023-10-06T02:59:42.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef8259c700 1 -- 172.21.15.84:0/3608599100 learned_addr learned my addr 172.21.15.84:0/3608599100 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:42.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef82d9d700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8415af20 0x7fef840c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef81d9b700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef84149970 0x7fef840c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef8259c700 1 -- 172.21.15.84:0/3608599100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef84149970 msgr2=0x7fef840c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef8259c700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef84149970 0x7fef840c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef8259c700 1 -- 172.21.15.84:0/3608599100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8415af20 msgr2=0x7fef840c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef8259c700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8415af20 0x7fef840c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef8259c700 1 -- 172.21.15.84:0/3608599100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8415c6c0 con 0x7fef6c003a60 2023-10-06T02:59:42.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef8259c700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef8415b8b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fef74009c30 tx=0x7fef7401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:42.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef727fc700 1 -- 172.21.15.84:0/3608599100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74014ea0 con 0x7fef6c003a60 2023-10-06T02:59:42.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef727fc700 1 -- 172.21.15.84:0/3608599100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7401d420 con 0x7fef6c003a60 2023-10-06T02:59:42.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8415c9a0 con 0x7fef6c003a60 2023-10-06T02:59:42.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef727fc700 1 -- 172.21.15.84:0/3608599100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7401d7c0 con 0x7fef6c003a60 2023-10-06T02:59:42.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.267+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef84159ce0 con 0x7fef6c003a60 2023-10-06T02:59:42.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.268+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8415cb60 con 0x7fef6c003a60 2023-10-06T02:59:42.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.268+0000 7fef727fc700 1 -- 172.21.15.84:0/3608599100 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef74003040 con 0x7fef6c003a60 2023-10-06T02:59:42.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.269+0000 7fef727fc700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef64066f30 0x7fef640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.269+0000 7fef727fc700 1 -- 172.21.15.84:0/3608599100 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fef74086670 con 0x7fef6c003a60 2023-10-06T02:59:42.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.269+0000 7fef81d9b700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef64066f30 0x7fef640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.269+0000 7fef81d9b700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef64066f30 0x7fef640693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fef84158e80 tx=0x7fef78007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:42.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.273+0000 7fef727fc700 1 -- 172.21.15.84:0/3608599100 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef74053600 con 0x7fef6c003a60 2023-10-06T02:59:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.457+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef84064ad0 con 0x7fef6c003a60 2023-10-06T02:59:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.458+0000 7fef727fc700 1 -- 172.21.15.84:0/3608599100 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef740180a0 con 0x7fef6c003a60 2023-10-06T02:59:42.460 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T02:59:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef64066f30 msgr2=0x7fef640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef64066f30 0x7fef640693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fef84158e80 tx=0x7fef78007940 comp rx=0 tx=0).stop 2023-10-06T02:59:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 msgr2=0x7fef8415b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef8415b8b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fef74009c30 tx=0x7fef7401a000 comp rx=0 tx=0).stop 2023-10-06T02:59:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 shutdown_connections 2023-10-06T02:59:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fef64066f30 0x7fef640693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef8415af20 0x7fef840c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef6c003a60 0x7fef8415b8b0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 --2- 172.21.15.84:0/3608599100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fef84149970 0x7fef840c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 >> 172.21.15.84:0/3608599100 conn(0x7fef84089e90 msgr2=0x7fef840684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 shutdown_connections 2023-10-06T02:59:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.460+0000 7fef88c2a700 1 -- 172.21.15.84:0/3608599100 wait complete. 2023-10-06T02:59:42.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:59:42.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.585+0000 7f6692a46700 1 Processor -- start 2023-10-06T02:59:42.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.585+0000 7f6692a46700 1 -- start start 2023-10-06T02:59:42.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6692a46700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f668c159480 0x7f668c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6692a46700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668c0cb7e0 con 0x7f668c0b2140 2023-10-06T02:59:42.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6692a46700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668c0b08a0 con 0x7f668c0b3610 2023-10-06T02:59:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6692a46700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c0cb190 con 0x7f668c159480 2023-10-06T02:59:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6691a44700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f668c159480 0x7f668c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6692245700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f668c0b2140 0x7f668c0b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56514/0 (socket says 172.21.15.84:56514) 2023-10-06T02:59:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6692245700 1 -- 172.21.15.84:0/1698340970 learned_addr learned my addr 172.21.15.84:0/1698340970 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6691a44700 1 -- 172.21.15.84:0/1698340970 >> v1:172.21.15.131:6789/0 conn(0x7f668c0b3610 legacy=0x7f668c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6691a44700 1 -- 172.21.15.84:0/1698340970 >> v1:172.21.15.84:6789/0 conn(0x7f668c0b2140 legacy=0x7f668c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6691a44700 1 -- 172.21.15.84:0/1698340970 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0cb470 con 0x7f668c159480 2023-10-06T02:59:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.586+0000 7f6690a42700 1 -- 172.21.15.84:0/1698340970 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71548957 0 0) 0x7f668c0cb7e0 con 0x7f668c0b2140 2023-10-06T02:59:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6691a44700 1 --2- 172.21.15.84:0/1698340970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 0x7f668c0b30d0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f66880098e0 tx=0x7f66880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0992e038ed66d8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6690a42700 1 -- 172.21.15.84:0/1698340970 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688009e80 con 0x7f668c159480 2023-10-06T02:59:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6690a42700 1 -- 172.21.15.84:0/1698340970 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668800b860 con 0x7f668c159480 2023-10-06T02:59:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6690a42700 1 -- 172.21.15.84:0/1698340970 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800bbe0 con 0x7f668c159480 2023-10-06T02:59:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6692a46700 1 -- 172.21.15.84:0/1698340970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 msgr2=0x7f668c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6692a46700 1 --2- 172.21.15.84:0/1698340970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 0x7f668c0b30d0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f66880098e0 tx=0x7f66880091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6692a46700 1 -- 172.21.15.84:0/1698340970 shutdown_connections 2023-10-06T02:59:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6692a46700 1 --2- 172.21.15.84:0/1698340970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 0x7f668c0b30d0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6692a46700 1 -- 172.21.15.84:0/1698340970 >> 172.21.15.84:0/1698340970 conn(0x7f668c06ed20 msgr2=0x7f668c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6692a46700 1 -- 172.21.15.84:0/1698340970 shutdown_connections 2023-10-06T02:59:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.587+0000 7f6692a46700 1 -- 172.21.15.84:0/1698340970 wait complete. 2023-10-06T02:59:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.588+0000 7f6692a46700 1 Processor -- start 2023-10-06T02:59:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.588+0000 7f6692a46700 1 -- start start 2023-10-06T02:59:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.589+0000 7f6692a46700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f668c0b2140 0x7f668c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.589+0000 7f6692a46700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f668c0b3610 0x7f668c15f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.589+0000 7f6692a46700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 0x7f668c15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.589+0000 7f6692a46700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0c3b00 con 0x7f668c159480 2023-10-06T02:59:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.589+0000 7f6692a46700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0c4680 con 0x7f668c0b2140 2023-10-06T02:59:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.589+0000 7f6692a46700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c15ffd0 con 0x7f668c0b3610 2023-10-06T02:59:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.589+0000 7f6692245700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 0x7f668c15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.589+0000 7f6692245700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 0x7f668c15fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57504/0 (socket says 172.21.15.84:57504) 2023-10-06T02:59:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.589+0000 7f6692245700 1 -- 172.21.15.84:0/2744101941 learned_addr learned my addr 172.21.15.84:0/2744101941 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6691a44700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f668c0b2140 0x7f668c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6692245700 1 -- 172.21.15.84:0/2744101941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f668c0b3610 msgr2=0x7f668c15f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6691243700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f668c0b3610 0x7f668c15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6692245700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f668c0b3610 0x7f668c15f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6692245700 1 -- 172.21.15.84:0/2744101941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f668c0b2140 msgr2=0x7f668c154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6692245700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f668c0b2140 0x7f668c154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6692245700 1 -- 172.21.15.84:0/2744101941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6688009420 con 0x7f668c159480 2023-10-06T02:59:42.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6691a44700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f668c0b2140 0x7f668c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:42.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6692245700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 0x7f668c15fa90 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f668400ccf0 tx=0x7f6684001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:42.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6681ffb700 1 -- 172.21.15.84:0/2744101941 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400aaf0 con 0x7f668c159480 2023-10-06T02:59:42.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6681ffb700 1 -- 172.21.15.84:0/2744101941 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668400ac50 con 0x7f668c159480 2023-10-06T02:59:42.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668c0c3d50 con 0x7f668c159480 2023-10-06T02:59:42.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6681ffb700 1 -- 172.21.15.84:0/2744101941 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66840070f0 con 0x7f668c159480 2023-10-06T02:59:42.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.590+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668c0c4310 con 0x7f668c159480 2023-10-06T02:59:42.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.591+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668c05f270 con 0x7f668c159480 2023-10-06T02:59:42.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.591+0000 7f6681ffb700 1 -- 172.21.15.84:0/2744101941 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6684007480 con 0x7f668c159480 2023-10-06T02:59:42.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.592+0000 7f6681ffb700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6670066f30 0x7f66700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.592+0000 7f6681ffb700 1 -- 172.21.15.84:0/2744101941 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f6684084d50 con 0x7f668c159480 2023-10-06T02:59:42.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.592+0000 7f6691a44700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6670066f30 0x7f66700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.592+0000 7f6691a44700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6670066f30 0x7f66700693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f668800c010 tx=0x7f6688016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:42.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.596+0000 7f6681ffb700 1 -- 172.21.15.84:0/2744101941 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6684088030 con 0x7f668c159480 2023-10-06T02:59:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.822+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f668c0c47c0 con 0x7f668c159480 2023-10-06T02:59:42.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.822+0000 7f6681ffb700 1 -- 172.21.15.84:0/2744101941 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4639 (secure 0 0 0) 0x7f6684051cd0 con 0x7f668c159480 2023-10-06T02:59:42.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:42.824 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:58:34.102008+0000","modified":"2023-10-06T02:59:16.239051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6528,"mds_1":6525,"mds_2":5567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5567":{"gid":5567,"name":"d","rank":2,"incarnation":55,"state":"up:active","state_seq":13,"addr":"172.21.15.131:6835/4032170839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4032170839},{"type":"v1","addr":"172.21.15.131:6835","nonce":4032170839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6525":{"gid":6525,"name":"c","rank":1,"incarnation":53,"state":"up:active","state_seq":13,"addr":"172.21.15.84:6836/1455824046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1455824046},{"type":"v1","addr":"172.21.15.84:6836","nonce":1455824046}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6528":{"gid":6528,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":13,"addr":"172.21.15.84:6837/3591915780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3591915780},{"type":"v1","addr":"172.21.15.84:6837","nonce":3591915780}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:59:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6670066f30 msgr2=0x7f66700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6670066f30 0x7f66700693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f668800c010 tx=0x7f6688016000 comp rx=0 tx=0).stop 2023-10-06T02:59:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 msgr2=0x7f668c15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 0x7f668c15fa90 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f668400ccf0 tx=0x7f6684001a20 comp rx=0 tx=0).stop 2023-10-06T02:59:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 shutdown_connections 2023-10-06T02:59:42.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6670066f30 0x7f66700693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f668c0b2140 0x7f668c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f668c159480 0x7f668c15fa90 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 --2- 172.21.15.84:0/2744101941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f668c0b3610 0x7f668c15f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 >> 172.21.15.84:0/2744101941 conn(0x7f668c06ed20 msgr2=0x7f668c06f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 shutdown_connections 2023-10-06T02:59:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.824+0000 7f6692a46700 1 -- 172.21.15.84:0/2744101941 wait complete. 2023-10-06T02:59:42.827 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 61 2023-10-06T02:59:42.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:42.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.950+0000 7fb6ae00c700 1 Processor -- start 2023-10-06T02:59:42.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.950+0000 7fb6ae00c700 1 -- start start 2023-10-06T02:59:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6ae00c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb6a81595a0 0x7fb6a80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6ae00c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a80b07a0 0x7fb6a80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6ae00c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a80b0ca0 con 0x7fb6a80b49e0 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6ae00c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a80b0f80 con 0x7fb6a81595a0 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6ae00c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80b1260 con 0x7fb6a80b07a0 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb6a80b49e0 0x7fb6a80aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56518/0 (socket says 172.21.15.84:56518) 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a6ffd700 1 -- 172.21.15.84:0/1553241701 learned_addr learned my addr 172.21.15.84:0/1553241701 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958379476 0 0) 0x7fb6a80b0ca0 con 0x7fb6a80b49e0 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb690003570 con 0x7fb6a80b49e0 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a77fe700 1 --2- 172.21.15.84:0/1553241701 >> v2:172.21.15.131:3300/0 conn(0x7fb6a81595a0 0x7fb6a80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a7fff700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a80b07a0 0x7fb6a80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 531025156 0 0) 0x7fb690003570 con 0x7fb6a80b49e0 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a80b07a0 msgr2=0x7fb6a80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a80b07a0 0x7fb6a80b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 >> v2:172.21.15.131:3300/0 conn(0x7fb6a81595a0 msgr2=0x7fb6a80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 --2- 172.21.15.84:0/1553241701 >> v2:172.21.15.131:3300/0 conn(0x7fb6a81595a0 0x7fb6a80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a80b1540 con 0x7fb6a80b49e0 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fb69c001470 con 0x7fb6a80b49e0 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 >> v1:172.21.15.84:6789/0 conn(0x7fb6a80b49e0 legacy=0x7fb6a80aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a80b07a0 0x7fb690003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.951+0000 7fb6a67fc700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb690004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a67fc700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb690004d50 0x7fb6900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80b0f80 con 0x7fb690003fe0 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80b1260 con 0x7fb690004d50 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69000ba90 con 0x7fb6a80b07a0 2023-10-06T02:59:42.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a6ffd700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb690004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a77fe700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a80b07a0 0x7fb690003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a7fff700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb690004d50 0x7fb6900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a6ffd700 1 -- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a80b07a0 msgr2=0x7fb690003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a6ffd700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a80b07a0 0x7fb690003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a6ffd700 1 -- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb690004d50 msgr2=0x7fb6900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a6ffd700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb690004d50 0x7fb6900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a6ffd700 1 -- 172.21.15.84:0/1553241701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690003570 con 0x7fb690003fe0 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a6ffd700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb690004810 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8088e20 tx=0x7fb69c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fb546dd6ddcbb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00cbd0 con 0x7fb690003fe0 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c00cd30 con 0x7fb690003fe0 2023-10-06T02:59:42.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.952+0000 7fb6a67fc700 1 -- 172.21.15.84:0/1553241701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c00cea0 con 0x7fb690003fe0 2023-10-06T02:59:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.953+0000 7fb6ae00c700 1 -- 172.21.15.84:0/1553241701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 msgr2=0x7fb690004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.953+0000 7fb6ae00c700 1 --2- 172.21.15.84:0/1553241701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb690004810 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8088e20 tx=0x7fb69c001e50 comp rx=0 tx=0).stop 2023-10-06T02:59:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.953+0000 7fb6a7fff700 1 -- 172.21.15.84:0/1553241701 reap_dead start 2023-10-06T02:59:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.953+0000 7fb6ae00c700 1 -- 172.21.15.84:0/1553241701 shutdown_connections 2023-10-06T02:59:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.953+0000 7fb6ae00c700 1 -- 172.21.15.84:0/1553241701 >> 172.21.15.84:0/1553241701 conn(0x7fb6a8099830 msgr2=0x7fb6a806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.953+0000 7fb6ae00c700 1 -- 172.21.15.84:0/1553241701 shutdown_connections 2023-10-06T02:59:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.953+0000 7fb6ae00c700 1 -- 172.21.15.84:0/1553241701 wait complete. 2023-10-06T02:59:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.954+0000 7fb6ae00c700 1 Processor -- start 2023-10-06T02:59:42.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.954+0000 7fb6ae00c700 1 -- start start 2023-10-06T02:59:42.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6ae00c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb6a8151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6ae00c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a8150e40 0x7fb6a8154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6ae00c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a815af50 0x7fb6a8151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6ae00c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8154860 con 0x7fb690003fe0 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6ae00c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a81554f0 con 0x7fb6a815af50 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6ae00c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a81545d0 con 0x7fb6a8150e40 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb6a8151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb6a8151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57520/0 (socket says 172.21.15.84:57520) 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a77fe700 1 -- 172.21.15.84:0/742552391 learned_addr learned my addr 172.21.15.84:0/742552391 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a7fff700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a815af50 0x7fb6a8151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a6ffd700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a8150e40 0x7fb6a8154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a77fe700 1 -- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a8150e40 msgr2=0x7fb6a8154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a77fe700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a8150e40 0x7fb6a8154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a77fe700 1 -- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a815af50 msgr2=0x7fb6a8151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a77fe700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a815af50 0x7fb6a8151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a77fe700 1 -- 172.21.15.84:0/742552391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a81512b0 con 0x7fb690003fe0 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a6ffd700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a8150e40 0x7fb6a8154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a7fff700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a815af50 0x7fb6a8151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6a77fe700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb6a8151850 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb69800f1b0 tx=0x7fb69800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb68f7fe700 1 -- 172.21.15.84:0/742552391 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800e040 con 0x7fb690003fe0 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb68f7fe700 1 -- 172.21.15.84:0/742552391 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69800f040 con 0x7fb690003fe0 2023-10-06T02:59:42.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a8154bc0 con 0x7fb690003fe0 2023-10-06T02:59:42.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.955+0000 7fb68f7fe700 1 -- 172.21.15.84:0/742552391 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698015430 con 0x7fb690003fe0 2023-10-06T02:59:42.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.956+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a8155180 con 0x7fb690003fe0 2023-10-06T02:59:42.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.956+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a8064ad0 con 0x7fb690003fe0 2023-10-06T02:59:42.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.957+0000 7fb68f7fe700 1 -- 172.21.15.84:0/742552391 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6980157e0 con 0x7fb690003fe0 2023-10-06T02:59:42.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.957+0000 7fb68f7fe700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb694066f30 0x7fb6940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:42.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.957+0000 7fb68f7fe700 1 -- 172.21.15.84:0/742552391 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fb698085600 con 0x7fb690003fe0 2023-10-06T02:59:42.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.957+0000 7fb6a6ffd700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb694066f30 0x7fb6940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:42.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.958+0000 7fb6a6ffd700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb694066f30 0x7fb6940693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8156e40 tx=0x7fb69c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:42.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:42.962+0000 7fb68f7fe700 1 -- 172.21.15.84:0/742552391 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb698055f80 con 0x7fb690003fe0 2023-10-06T02:59:43.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.147+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6a80b1820 con 0x7fb690003fe0 2023-10-06T02:59:43.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.147+0000 7fb68f7fe700 1 -- 172.21.15.84:0/742552391 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17171 (secure 0 0 0) 0x7fb698055b10 con 0x7fb690003fe0 2023-10-06T02:59:43.149 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:43.149 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:58:51.164308+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:58:31.743689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:58:33.068884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:43.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb694066f30 msgr2=0x7fb6940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb694066f30 0x7fb6940693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8156e40 tx=0x7fb69c015000 comp rx=0 tx=0).stop 2023-10-06T02:59:43.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 msgr2=0x7fb6a8151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb6a8151850 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb69800f1b0 tx=0x7fb69800b040 comp rx=0 tx=0).stop 2023-10-06T02:59:43.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 shutdown_connections 2023-10-06T02:59:43.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb694066f30 0x7fb6940693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6a815af50 0x7fb6a8151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb690003fe0 0x7fb6a8151850 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 --2- 172.21.15.84:0/742552391 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb6a8150e40 0x7fb6a8154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 >> 172.21.15.84:0/742552391 conn(0x7fb6a8099830 msgr2=0x7fb6a80cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:43.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 shutdown_connections 2023-10-06T02:59:43.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.149+0000 7fb6ae00c700 1 -- 172.21.15.84:0/742552391 wait complete. 2023-10-06T02:59:43.163 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T02:59:43.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:59:43.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.274+0000 7f5114f52700 1 Processor -- start 2023-10-06T02:59:43.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.274+0000 7f5114f52700 1 -- start start 2023-10-06T02:59:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.275+0000 7f5114f52700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100adba0 0x7f51100ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.275+0000 7f5114f52700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51100ceb70 con 0x7f51100ce710 2023-10-06T02:59:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.275+0000 7f5114f52700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5110157e20 con 0x7f51100ca3b0 2023-10-06T02:59:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.275+0000 7f5114f52700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100cbbd0 con 0x7f51100adba0 2023-10-06T02:59:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.275+0000 7f510ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f51100ce710 0x7f511015af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56532/0 (socket says 172.21.15.84:56532) 2023-10-06T02:59:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.275+0000 7f510ed9d700 1 -- 172.21.15.84:0/1725182632 learned_addr learned my addr 172.21.15.84:0/1725182632 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510dd9b700 1 --2- 172.21.15.84:0/1725182632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100adba0 0x7f51100ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510d59a700 1 -- 172.21.15.84:0/1725182632 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443752931 0 0) 0x7f5108001110 con 0x7f51100ce710 2023-10-06T02:59:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510d59a700 1 -- 172.21.15.84:0/1725182632 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f8003570 con 0x7f51100ce710 2023-10-06T02:59:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510dd9b700 1 -- 172.21.15.84:0/1725182632 >> v1:172.21.15.131:6789/0 conn(0x7f51100ca3b0 legacy=0x7f51101582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510d59a700 1 -- 172.21.15.84:0/1725182632 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372237738 0 0) 0x7f5110157e20 con 0x7f51100ca3b0 2023-10-06T02:59:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510dd9b700 1 -- 172.21.15.84:0/1725182632 >> v1:172.21.15.84:6789/0 conn(0x7f51100ce710 legacy=0x7f511015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510dd9b700 1 -- 172.21.15.84:0/1725182632 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100cb610 con 0x7f51100adba0 2023-10-06T02:59:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510dd9b700 1 --2- 172.21.15.84:0/1725182632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100adba0 0x7f51100ce1d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5104009910 tx=0x7f51040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a084d06add0d7020 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510d59a700 1 -- 172.21.15.84:0/1725182632 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400b680 con 0x7f51100adba0 2023-10-06T02:59:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510d59a700 1 -- 172.21.15.84:0/1725182632 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510400b7e0 con 0x7f51100adba0 2023-10-06T02:59:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.276+0000 7f510d59a700 1 -- 172.21.15.84:0/1725182632 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400bba0 con 0x7f51100adba0 2023-10-06T02:59:43.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.277+0000 7f5114f52700 1 -- 172.21.15.84:0/1725182632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100adba0 msgr2=0x7f51100ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.277+0000 7f5114f52700 1 --2- 172.21.15.84:0/1725182632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100adba0 0x7f51100ce1d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5104009910 tx=0x7f51040091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.277+0000 7f5114f52700 1 -- 172.21.15.84:0/1725182632 shutdown_connections 2023-10-06T02:59:43.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.277+0000 7f5114f52700 1 --2- 172.21.15.84:0/1725182632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100adba0 0x7f51100ce1d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.277+0000 7f5114f52700 1 -- 172.21.15.84:0/1725182632 >> 172.21.15.84:0/1725182632 conn(0x7f5110070810 msgr2=0x7f5110070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:43.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.277+0000 7f5114f52700 1 -- 172.21.15.84:0/1725182632 shutdown_connections 2023-10-06T02:59:43.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.277+0000 7f5114f52700 1 -- 172.21.15.84:0/1725182632 wait complete. 2023-10-06T02:59:43.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.278+0000 7f5114f52700 1 Processor -- start 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.278+0000 7f5114f52700 1 -- start start 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f5114f52700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100adba0 0x7f51100c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f5114f52700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51100ca3b0 0x7f51101533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f5114f52700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100ce710 0x7f5110153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f5114f52700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100695f0 con 0x7f51100adba0 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f5114f52700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5110068700 con 0x7f51100ca3b0 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f5114f52700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100689e0 con 0x7f51100ce710 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100adba0 0x7f51100c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100adba0 0x7f51100c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57528/0 (socket says 172.21.15.84:57528) 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510e59c700 1 -- 172.21.15.84:0/2070181781 learned_addr learned my addr 172.21.15.84:0/2070181781 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510ed9d700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100ce710 0x7f5110153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510dd9b700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51100ca3b0 0x7f51101533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510e59c700 1 -- 172.21.15.84:0/2070181781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100ce710 msgr2=0x7f5110153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510e59c700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100ce710 0x7f5110153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510e59c700 1 -- 172.21.15.84:0/2070181781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51100ca3b0 msgr2=0x7f51101533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510e59c700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51100ca3b0 0x7f51101533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510e59c700 1 -- 172.21.15.84:0/2070181781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104009420 con 0x7f51100adba0 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510dd9b700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51100ca3b0 0x7f51101533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f510e59c700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100adba0 0x7f51100c9980 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f510000cb40 tx=0x7f51000017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.279+0000 7f50fe7fc700 1 -- 172.21.15.84:0/2070181781 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000a7e0 con 0x7f51100adba0 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.280+0000 7f50fe7fc700 1 -- 172.21.15.84:0/2070181781 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510000a960 con 0x7f51100adba0 2023-10-06T02:59:43.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.280+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5110068cc0 con 0x7f51100adba0 2023-10-06T02:59:43.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.280+0000 7f50fe7fc700 1 -- 172.21.15.84:0/2070181781 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000ad20 con 0x7f51100adba0 2023-10-06T02:59:43.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.280+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5110069280 con 0x7f51100adba0 2023-10-06T02:59:43.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.280+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5110064ad0 con 0x7f51100adba0 2023-10-06T02:59:43.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.281+0000 7f50fe7fc700 1 -- 172.21.15.84:0/2070181781 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5100003030 con 0x7f51100adba0 2023-10-06T02:59:43.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.281+0000 7f50fe7fc700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f50f0066fb0 0x7f50f0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.281+0000 7f50fe7fc700 1 -- 172.21.15.84:0/2070181781 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f5100084a10 con 0x7f51100adba0 2023-10-06T02:59:43.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.281+0000 7f510dd9b700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f50f0066fb0 0x7f50f0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.282+0000 7f510dd9b700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f50f0066fb0 0x7f50f0069460 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5104009860 tx=0x7f5104017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:43.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.285+0000 7f50fe7fc700 1 -- 172.21.15.84:0/2070181781 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5100051900 con 0x7f51100adba0 2023-10-06T02:59:43.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.510+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51100cb8f0 con 0x7f51100adba0 2023-10-06T02:59:43.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.510+0000 7f50fe7fc700 1 -- 172.21.15.84:0/2070181781 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4639 (secure 0 0 0) 0x7f5100054f20 con 0x7f51100adba0 2023-10-06T02:59:43.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:43.513 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:58:34.102008+0000","modified":"2023-10-06T02:59:16.239051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6528,"mds_1":6525,"mds_2":5567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5567":{"gid":5567,"name":"d","rank":2,"incarnation":55,"state":"up:active","state_seq":13,"addr":"172.21.15.131:6835/4032170839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4032170839},{"type":"v1","addr":"172.21.15.131:6835","nonce":4032170839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6525":{"gid":6525,"name":"c","rank":1,"incarnation":53,"state":"up:active","state_seq":13,"addr":"172.21.15.84:6836/1455824046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1455824046},{"type":"v1","addr":"172.21.15.84:6836","nonce":1455824046}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6528":{"gid":6528,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":13,"addr":"172.21.15.84:6837/3591915780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3591915780},{"type":"v1","addr":"172.21.15.84:6837","nonce":3591915780}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:59:43.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f50f0066fb0 msgr2=0x7f50f0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f50f0066fb0 0x7f50f0069460 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5104009860 tx=0x7f5104017000 comp rx=0 tx=0).stop 2023-10-06T02:59:43.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100adba0 msgr2=0x7f51100c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100adba0 0x7f51100c9980 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f510000cb40 tx=0x7f51000017b0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 shutdown_connections 2023-10-06T02:59:43.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f50f0066fb0 0x7f50f0069460 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51100ce710 0x7f5110153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51100adba0 0x7f51100c9980 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 --2- 172.21.15.84:0/2070181781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51100ca3b0 0x7f51101533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 >> 172.21.15.84:0/2070181781 conn(0x7f5110070810 msgr2=0x7f5110158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:43.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 shutdown_connections 2023-10-06T02:59:43.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.512+0000 7f5114f52700 1 -- 172.21.15.84:0/2070181781 wait complete. 2023-10-06T02:59:43.515 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 61 2023-10-06T02:59:43.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:59:43.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.638+0000 7efe0452b700 1 Processor -- start 2023-10-06T02:59:43.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.638+0000 7efe0452b700 1 -- start start 2023-10-06T02:59:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.639+0000 7efe0452b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efdfc0ca3b0 0x7efdfc1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.639+0000 7efe0452b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efdfc0ce8e0 0x7efdfc15af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.639+0000 7efe0452b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc157e20 con 0x7efdfc0adba0 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.639+0000 7efe0452b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0cbbd0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.639+0000 7efe0452b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0cb610 con 0x7efdfc0ce8e0 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe022c7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efdfc0ca3b0 0x7efdfc1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe022c7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efdfc0ca3b0 0x7efdfc1582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57530/0 (socket says 172.21.15.84:57530) 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe022c7700 1 -- 172.21.15.84:0/4251097658 learned_addr learned my addr 172.21.15.84:0/4251097658 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe02ac8700 1 --2- 172.21.15.84:0/4251097658 >> v2:172.21.15.131:3300/0 conn(0x7efdfc0ce8e0 0x7efdfc15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe022c7700 1 -- 172.21.15.84:0/4251097658 >> v2:172.21.15.131:3300/0 conn(0x7efdfc0ce8e0 msgr2=0x7efdfc15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe022c7700 1 --2- 172.21.15.84:0/4251097658 >> v2:172.21.15.131:3300/0 conn(0x7efdfc0ce8e0 0x7efdfc15af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe022c7700 1 -- 172.21.15.84:0/4251097658 >> v1:172.21.15.131:6789/0 conn(0x7efdfc0adba0 legacy=0x7efdfc0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe022c7700 1 -- 172.21.15.84:0/4251097658 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0cb8f0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe02ac8700 1 --2- 172.21.15.84:0/4251097658 >> v2:172.21.15.131:3300/0 conn(0x7efdfc0ce8e0 0x7efdfc15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe022c7700 1 --2- 172.21.15.84:0/4251097658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 0x7efdfc1582b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7efdfc155500 tx=0x7efdf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7449842d3be53d2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe012c5700 1 -- 172.21.15.84:0/4251097658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800b820 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe012c5700 1 -- 172.21.15.84:0/4251097658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf800b980 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.640+0000 7efe012c5700 1 -- 172.21.15.84:0/4251097658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800bd20 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.641+0000 7efe0452b700 1 -- 172.21.15.84:0/4251097658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 msgr2=0x7efdfc1582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.641+0000 7efe0452b700 1 --2- 172.21.15.84:0/4251097658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 0x7efdfc1582b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7efdfc155500 tx=0x7efdf8009250 comp rx=0 tx=0).stop 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.641+0000 7efe0452b700 1 -- 172.21.15.84:0/4251097658 shutdown_connections 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.641+0000 7efe0452b700 1 --2- 172.21.15.84:0/4251097658 >> v2:172.21.15.131:3300/0 conn(0x7efdfc0ce8e0 0x7efdfc15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.641+0000 7efe0452b700 1 --2- 172.21.15.84:0/4251097658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 0x7efdfc1582b0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.641+0000 7efe0452b700 1 -- 172.21.15.84:0/4251097658 >> 172.21.15.84:0/4251097658 conn(0x7efdfc070810 msgr2=0x7efdfc070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.641+0000 7efe0452b700 1 -- 172.21.15.84:0/4251097658 shutdown_connections 2023-10-06T02:59:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.641+0000 7efe0452b700 1 -- 172.21.15.84:0/4251097658 wait complete. 2023-10-06T02:59:43.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.642+0000 7efe0452b700 1 Processor -- start 2023-10-06T02:59:43.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.642+0000 7efe0452b700 1 -- start start 2023-10-06T02:59:43.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe0452b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdfc0adba0 0x7efdfc16aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe0452b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 0x7efdfc0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe0452b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdfc0ce8e0 0x7efdfc0b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe0452b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0c3b30 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe0452b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0c2cd0 con 0x7efdfc0adba0 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe0452b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc16afc0 con 0x7efdfc0ce8e0 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe01ac6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 0x7efdfc0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe01ac6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 0x7efdfc0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57544/0 (socket says 172.21.15.84:57544) 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe01ac6700 1 -- 172.21.15.84:0/3927308879 learned_addr learned my addr 172.21.15.84:0/3927308879 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe022c7700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdfc0adba0 0x7efdfc16aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe02ac8700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdfc0ce8e0 0x7efdfc0b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe01ac6700 1 -- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdfc0ce8e0 msgr2=0x7efdfc0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe01ac6700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdfc0ce8e0 0x7efdfc0b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe01ac6700 1 -- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdfc0adba0 msgr2=0x7efdfc16aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe01ac6700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdfc0adba0 0x7efdfc16aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe01ac6700 1 -- 172.21.15.84:0/3927308879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80094f0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe022c7700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdfc0adba0 0x7efdfc16aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe02ac8700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdfc0ce8e0 0x7efdfc0b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe01ac6700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 0x7efdfc0b30d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7efdec00b610 tx=0x7efdec0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efdf27fc700 1 -- 172.21.15.84:0/3927308879 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00f510 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efdf27fc700 1 -- 172.21.15.84:0/3927308879 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00f6b0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc0c2f20 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efdf27fc700 1 -- 172.21.15.84:0/3927308879 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00fa70 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.643+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc0c34e0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.644+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc0c3ce0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.645+0000 7efdf27fc700 1 -- 172.21.15.84:0/3927308879 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdec01a400 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.645+0000 7efdf27fc700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efde0066f30 0x7efde00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.645+0000 7efdf27fc700 1 -- 172.21.15.84:0/3927308879 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7efdec0842f0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.645+0000 7efe022c7700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efde0066f30 0x7efde00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.646+0000 7efe022c7700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efde0066f30 0x7efde00693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efdfc155500 tx=0x7efdf8016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.649+0000 7efdf27fc700 1 -- 172.21.15.84:0/3927308879 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdfc0c3ce0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.876+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdfc0c3ce0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.876+0000 7efdf27fc700 1 -- 172.21.15.84:0/3927308879 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4639 (secure 0 0 0) 0x7efdfc0c3ce0 con 0x7efdfc0ca3b0 2023-10-06T02:59:43.878 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:43.878 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:58:34.102008+0000","modified":"2023-10-06T02:59:16.239051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6528,"mds_1":6525,"mds_2":5567},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5567":{"gid":5567,"name":"d","rank":2,"incarnation":55,"state":"up:active","state_seq":13,"addr":"172.21.15.131:6835/4032170839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4032170839},{"type":"v1","addr":"172.21.15.131:6835","nonce":4032170839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6525":{"gid":6525,"name":"c","rank":1,"incarnation":53,"state":"up:active","state_seq":13,"addr":"172.21.15.84:6836/1455824046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1455824046},{"type":"v1","addr":"172.21.15.84:6836","nonce":1455824046}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6528":{"gid":6528,"name":"a","rank":0,"incarnation":48,"state":"up:active","state_seq":13,"addr":"172.21.15.84:6837/3591915780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3591915780},{"type":"v1","addr":"172.21.15.84:6837","nonce":3591915780}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T02:59:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efde0066f30 msgr2=0x7efde00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efde0066f30 0x7efde00693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efdfc155500 tx=0x7efdf8016000 comp rx=0 tx=0).stop 2023-10-06T02:59:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 msgr2=0x7efdfc0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 0x7efdfc0b30d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7efdec00b610 tx=0x7efdec0090f0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 shutdown_connections 2023-10-06T02:59:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efde0066f30 0x7efde00693e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdfc0adba0 0x7efdfc16aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efdfc0ce8e0 0x7efdfc0b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 --2- 172.21.15.84:0/3927308879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdfc0ca3b0 0x7efdfc0b30d0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.878+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 >> 172.21.15.84:0/3927308879 conn(0x7efdfc070810 msgr2=0x7efdfc154540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.879+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 shutdown_connections 2023-10-06T02:59:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:43.879+0000 7efe0452b700 1 -- 172.21.15.84:0/3927308879 wait complete. 2023-10-06T02:59:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 61 2023-10-06T02:59:43.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.004+0000 7fb53aa55700 1 Processor -- start 2023-10-06T02:59:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.004+0000 7fb53aa55700 1 -- start start 2023-10-06T02:59:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb53aa55700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb5340b49e0 0x7fb5340aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb53aa55700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb5340b07a0 0x7fb5340b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb53aa55700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5340b0ca0 con 0x7fb5341595a0 2023-10-06T02:59:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb53aa55700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5340b0f80 con 0x7fb5340b07a0 2023-10-06T02:59:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb53aa55700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5340b1260 con 0x7fb5340b49e0 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb533fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb5341595a0 0x7fb5340aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56542/0 (socket says 172.21.15.84:56542) 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb533fff700 1 -- 172.21.15.84:0/2419815259 learned_addr learned my addr 172.21.15.84:0/2419815259 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb538ff2700 1 --2- 172.21.15.84:0/2419815259 >> v2:172.21.15.84:3300/0 conn(0x7fb5340b07a0 0x7fb5340b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb532ffd700 1 -- 172.21.15.84:0/2419815259 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415954730 0 0) 0x7fb5340b0ca0 con 0x7fb5341595a0 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb532ffd700 1 -- 172.21.15.84:0/2419815259 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb51c003570 con 0x7fb5341595a0 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.005+0000 7fb5337fe700 1 --2- 172.21.15.84:0/2419815259 >> v2:172.21.15.131:3300/0 conn(0x7fb5340b49e0 0x7fb5340aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb538ff2700 1 -- 172.21.15.84:0/2419815259 >> v2:172.21.15.131:3300/0 conn(0x7fb5340b49e0 msgr2=0x7fb5340aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb538ff2700 1 --2- 172.21.15.84:0/2419815259 >> v2:172.21.15.131:3300/0 conn(0x7fb5340b49e0 0x7fb5340aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb538ff2700 1 -- 172.21.15.84:0/2419815259 >> v1:172.21.15.84:6789/0 conn(0x7fb5341595a0 legacy=0x7fb5340aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb538ff2700 1 -- 172.21.15.84:0/2419815259 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5340b1540 con 0x7fb5340b07a0 2023-10-06T02:59:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb538ff2700 1 --2- 172.21.15.84:0/2419815259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5340b07a0 0x7fb5340b1c00 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009e60 tx=0x7fb52c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f9d27f7cf06a46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb532ffd700 1 -- 172.21.15.84:0/2419815259 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c00e070 con 0x7fb5340b07a0 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb532ffd700 1 -- 172.21.15.84:0/2419815259 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c00bb20 con 0x7fb5340b07a0 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb532ffd700 1 -- 172.21.15.84:0/2419815259 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c012430 con 0x7fb5340b07a0 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb53aa55700 1 -- 172.21.15.84:0/2419815259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5340b07a0 msgr2=0x7fb5340b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb53aa55700 1 --2- 172.21.15.84:0/2419815259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5340b07a0 0x7fb5340b1c00 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009e60 tx=0x7fb52c009780 comp rx=0 tx=0).stop 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb53aa55700 1 -- 172.21.15.84:0/2419815259 shutdown_connections 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb53aa55700 1 --2- 172.21.15.84:0/2419815259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5340b07a0 0x7fb5340b1c00 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb53aa55700 1 --2- 172.21.15.84:0/2419815259 >> v2:172.21.15.131:3300/0 conn(0x7fb5340b49e0 0x7fb5340aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb53aa55700 1 -- 172.21.15.84:0/2419815259 >> 172.21.15.84:0/2419815259 conn(0x7fb534099830 msgr2=0x7fb53406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb53aa55700 1 -- 172.21.15.84:0/2419815259 shutdown_connections 2023-10-06T02:59:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.006+0000 7fb53aa55700 1 -- 172.21.15.84:0/2419815259 wait complete. 2023-10-06T02:59:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.008+0000 7fb53aa55700 1 Processor -- start 2023-10-06T02:59:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.008+0000 7fb53aa55700 1 -- start start 2023-10-06T02:59:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.008+0000 7fb53aa55700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5340b07a0 0x7fb5340ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.008+0000 7fb53aa55700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5340b49e0 0x7fb53415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.008+0000 7fb53aa55700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5341595a0 0x7fb534158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.008+0000 7fb53aa55700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340aed90 con 0x7fb5341595a0 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.008+0000 7fb53aa55700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53415d130 con 0x7fb5340b07a0 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.008+0000 7fb53aa55700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340aefa0 con 0x7fb5340b49e0 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb538ff2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5341595a0 0x7fb534158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb538ff2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5341595a0 0x7fb534158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57560/0 (socket says 172.21.15.84:57560) 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb538ff2700 1 -- 172.21.15.84:0/1826817675 learned_addr learned my addr 172.21.15.84:0/1826817675 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb5337fe700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5340b49e0 0x7fb53415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb533fff700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5340b07a0 0x7fb5340ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb538ff2700 1 -- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5340b49e0 msgr2=0x7fb53415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb538ff2700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5340b49e0 0x7fb53415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb538ff2700 1 -- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5340b07a0 msgr2=0x7fb5340ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb538ff2700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5340b07a0 0x7fb5340ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb538ff2700 1 -- 172.21.15.84:0/1826817675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c009a20 con 0x7fb5341595a0 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb5337fe700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5340b49e0 0x7fb53415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb533fff700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5340b07a0 0x7fb5340ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb538ff2700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5341595a0 0x7fb534158900 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00b6c0 tx=0x7fb52c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb51bfff700 1 -- 172.21.15.84:0/1826817675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c012e00 con 0x7fb5341595a0 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb51bfff700 1 -- 172.21.15.84:0/1826817675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c01d630 con 0x7fb5341595a0 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5340ab240 con 0x7fb5341595a0 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb51bfff700 1 -- 172.21.15.84:0/1826817675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c01d9f0 con 0x7fb5341595a0 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.009+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5340ab800 con 0x7fb5341595a0 2023-10-06T02:59:44.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.010+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb534064ad0 con 0x7fb5341595a0 2023-10-06T02:59:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.010+0000 7fb51bfff700 1 -- 172.21.15.84:0/1826817675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb52c024070 con 0x7fb5341595a0 2023-10-06T02:59:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.011+0000 7fb51bfff700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb520066f30 0x7fb5200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.011+0000 7fb533fff700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb520066f30 0x7fb5200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.011+0000 7fb51bfff700 1 -- 172.21.15.84:0/1826817675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fb52c086fd0 con 0x7fb5341595a0 2023-10-06T02:59:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.011+0000 7fb533fff700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb520066f30 0x7fb5200693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb524001360 tx=0x7fb524009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:44.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.015+0000 7fb51bfff700 1 -- 172.21.15.84:0/1826817675 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb52c054010 con 0x7fb5341595a0 2023-10-06T02:59:44.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.197+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5340b1820 con 0x7fb5341595a0 2023-10-06T02:59:44.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.198+0000 7fb51bfff700 1 -- 172.21.15.84:0/1826817675 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+17171 (secure 0 0 0) 0x7fb52c057630 con 0x7fb5341595a0 2023-10-06T02:59:44.199 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:44.200 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:58:51.164308+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:58:31.743689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-06T02:58:33.068884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.28","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb520066f30 msgr2=0x7fb5200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb520066f30 0x7fb5200693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb524001360 tx=0x7fb524009040 comp rx=0 tx=0).stop 2023-10-06T02:59:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5341595a0 msgr2=0x7fb534158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5341595a0 0x7fb534158900 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00b6c0 tx=0x7fb52c019000 comp rx=0 tx=0).stop 2023-10-06T02:59:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 shutdown_connections 2023-10-06T02:59:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb520066f30 0x7fb5200693e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5340b07a0 0x7fb5340ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5341595a0 0x7fb534158900 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 --2- 172.21.15.84:0/1826817675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb5340b49e0 0x7fb53415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 >> 172.21.15.84:0/1826817675 conn(0x7fb534099830 msgr2=0x7fb534069950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 shutdown_connections 2023-10-06T02:59:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.200+0000 7fb53aa55700 1 -- 172.21.15.84:0/1826817675 wait complete. 2023-10-06T02:59:44.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T02:59:44.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.329+0000 7fc91dd20700 1 Processor -- start 2023-10-06T02:59:44.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.329+0000 7fc91dd20700 1 -- start start 2023-10-06T02:59:44.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.329+0000 7fc91dd20700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad250 0x7fc9180cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.329+0000 7fc91dd20700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc91815db50 0x7fc9180ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc91dd20700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9180ca640 con 0x7fc9180ad620 2023-10-06T02:59:44.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc91dd20700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9180ced30 con 0x7fc91815db50 2023-10-06T02:59:44.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc91dd20700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180cf010 con 0x7fc9180ad250 2023-10-06T02:59:44.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc917fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc91815db50 0x7fc9180ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc917fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc91815db50 0x7fc9180ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57576/0 (socket says 172.21.15.84:57576) 2023-10-06T02:59:44.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc917fff700 1 -- 172.21.15.84:0/1277971056 learned_addr learned my addr 172.21.15.84:0/1277971056 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc917fff700 1 -- 172.21.15.84:0/1277971056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad250 msgr2=0x7fc9180cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc9177fe700 1 --2- 172.21.15.84:0/1277971056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad250 0x7fc9180cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc917fff700 1 --2- 172.21.15.84:0/1277971056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad250 0x7fc9180cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc917fff700 1 -- 172.21.15.84:0/1277971056 >> v1:172.21.15.131:6789/0 conn(0x7fc9180ad620 legacy=0x7fc91815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc917fff700 1 -- 172.21.15.84:0/1277971056 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9180ccad0 con 0x7fc91815db50 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc9177fe700 1 --2- 172.21.15.84:0/1277971056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad250 0x7fc9180cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc917fff700 1 --2- 172.21.15.84:0/1277971056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91815db50 0x7fc9180ca100 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc910009f20 tx=0x7fc910009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaa627659a8cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc9167fc700 1 -- 172.21.15.84:0/1277971056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000e070 con 0x7fc91815db50 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc9167fc700 1 -- 172.21.15.84:0/1277971056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91000ba40 con 0x7fc91815db50 2023-10-06T02:59:44.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.330+0000 7fc9167fc700 1 -- 172.21.15.84:0/1277971056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9100092e0 con 0x7fc91815db50 2023-10-06T02:59:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.331+0000 7fc91dd20700 1 -- 172.21.15.84:0/1277971056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91815db50 msgr2=0x7fc9180ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.331+0000 7fc91dd20700 1 --2- 172.21.15.84:0/1277971056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91815db50 0x7fc9180ca100 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc910009f20 tx=0x7fc910009840 comp rx=0 tx=0).stop 2023-10-06T02:59:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.331+0000 7fc91dd20700 1 -- 172.21.15.84:0/1277971056 shutdown_connections 2023-10-06T02:59:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.331+0000 7fc91dd20700 1 --2- 172.21.15.84:0/1277971056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc91815db50 0x7fc9180ca100 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.331+0000 7fc91dd20700 1 --2- 172.21.15.84:0/1277971056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad250 0x7fc9180cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.331+0000 7fc91dd20700 1 -- 172.21.15.84:0/1277971056 >> 172.21.15.84:0/1277971056 conn(0x7fc918067dd0 msgr2=0x7fc9180ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.331+0000 7fc91dd20700 1 -- 172.21.15.84:0/1277971056 shutdown_connections 2023-10-06T02:59:44.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.331+0000 7fc91dd20700 1 -- 172.21.15.84:0/1277971056 wait complete. 2023-10-06T02:59:44.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.332+0000 7fc91dd20700 1 Processor -- start 2023-10-06T02:59:44.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.332+0000 7fc91dd20700 1 -- start start 2023-10-06T02:59:44.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc91dd20700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9180ad250 0x7fc9180c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc91dd20700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad620 0x7fc91815a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc91dd20700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91815db50 0x7fc91815ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc91dd20700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91815b2e0 con 0x7fc9180ad250 2023-10-06T02:59:44.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc91dd20700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91816d8b0 con 0x7fc91815db50 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc91dd20700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91816db50 con 0x7fc9180ad620 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc9177fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9180ad250 0x7fc9180c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc9177fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9180ad250 0x7fc9180c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57582/0 (socket says 172.21.15.84:57582) 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc9177fe700 1 -- 172.21.15.84:0/3751182012 learned_addr learned my addr 172.21.15.84:0/3751182012 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc917fff700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91815db50 0x7fc91815ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc916ffd700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad620 0x7fc91815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc9177fe700 1 -- 172.21.15.84:0/3751182012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad620 msgr2=0x7fc91815a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc9177fe700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad620 0x7fc91815a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc9177fe700 1 -- 172.21.15.84:0/3751182012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91815db50 msgr2=0x7fc91815ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc9177fe700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91815db50 0x7fc91815ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc9177fe700 1 -- 172.21.15.84:0/3751182012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910009ae0 con 0x7fc9180ad250 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc9177fe700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9180ad250 0x7fc9180c7660 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c830 tx=0x7fc908008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.333+0000 7fc8ff7fe700 1 -- 172.21.15.84:0/3751182012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908005a00 con 0x7fc9180ad250 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.334+0000 7fc8ff7fe700 1 -- 172.21.15.84:0/3751182012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908005b60 con 0x7fc9180ad250 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.334+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91816de30 con 0x7fc9180ad250 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.334+0000 7fc8ff7fe700 1 -- 172.21.15.84:0/3751182012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908011600 con 0x7fc9180ad250 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.334+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91816e3f0 con 0x7fc9180ad250 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.334+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91816e610 con 0x7fc9180ad250 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.335+0000 7fc8ff7fe700 1 -- 172.21.15.84:0/3751182012 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9080119f0 con 0x7fc9180ad250 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.335+0000 7fc8ff7fe700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc904066f30 0x7fc9040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.335+0000 7fc8ff7fe700 1 -- 172.21.15.84:0/3751182012 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc908084740 con 0x7fc9180ad250 2023-10-06T02:59:44.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.335+0000 7fc916ffd700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc904066f30 0x7fc9040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.336+0000 7fc916ffd700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc904066f30 0x7fc9040693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc90c003870 tx=0x7fc90c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:44.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.339+0000 7fc8ff7fe700 1 -- 172.21.15.84:0/3751182012 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc908055160 con 0x7fc9180ad250 2023-10-06T02:59:44.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.566+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc918064ad0 con 0x7fc9180ad250 2023-10-06T02:59:44.567 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T02:59:44.566+0000 7fedbe922700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T02:59:44.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.573+0000 7fc8ff7fe700 1 -- 172.21.15.84:0/3751182012 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc908054cf0 con 0x7fc9180ad250 2023-10-06T02:59:44.577 INFO:tasks.ceph.mds.d.smithi131.stderr: -1187> 2023-10-06T02:59:09.411+0000 7f553f8fa700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-10-06T02:58:50.599549+0000 1=0+1) n(v0 rc2023-10-06T02:58:50.599549+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={5651=pAsLsXsFsx/pAsLsXsFsx@4},l=5651 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55c301f8b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.599549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.599549+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.599549+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-10-06T02:58:50.599549+0000 2=0+2)","error_str":""},"return_code":-61} 2023-10-06T02:59:44.577 INFO:tasks.ceph.mds.d.smithi131.stderr: -1173> 2023-10-06T02:59:09.412+0000 7f553f8fa700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={5651=pAsLsXsFsx/AsLsXsFsx@2},l=5651 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55c301ffa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-10-06T02:59:44.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc904066f30 msgr2=0x7fc9040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc904066f30 0x7fc9040693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc90c003870 tx=0x7fc90c009040 comp rx=0 tx=0).stop 2023-10-06T02:59:44.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9180ad250 msgr2=0x7fc9180c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9180ad250 0x7fc9180c7660 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c830 tx=0x7fc908008040 comp rx=0 tx=0).stop 2023-10-06T02:59:44.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 shutdown_connections 2023-10-06T02:59:44.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc904066f30 0x7fc9040693e0 secure :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc90c003870 tx=0x7fc90c009040 comp rx=0 tx=0).stop 2023-10-06T02:59:44.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc91815db50 0x7fc91815ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9180ad250 0x7fc9180c7660 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 --2- 172.21.15.84:0/3751182012 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc9180ad620 0x7fc91815a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 >> 172.21.15.84:0/3751182012 conn(0x7fc918067dd0 msgr2=0x7fc91815bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:44.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 shutdown_connections 2023-10-06T02:59:44.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.576+0000 7fc91dd20700 1 -- 172.21.15.84:0/3751182012 wait complete. 2023-10-06T02:59:44.579 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T02:59:44.580 INFO:tasks.ceph.mds.c.smithi084.stderr: -1289> 2023-10-06T02:59:09.412+0000 7f594611e700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1) n(v2 rc2023-10-06T02:58:50.829546+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={5651=pAsLsXsFsx/pAsLsXsFsx@4},l=5651 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55c3c1ce0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.829546+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-10-06T02:58:50.829546+0000 4=0+4)","error_str":""},"return_code":-61} 2023-10-06T02:59:44.580 INFO:tasks.ceph.mds.c.smithi084.stderr: -1167> 2023-10-06T02:59:09.413+0000 7f594c12a700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1) n(v1 rc2023-10-06T02:58:50.829546+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={5651=pAsLsXsFs/pAsLsXsFsx@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55c3c1ce0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.599549+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.598549+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-06T02:58:50.829546+0000 3=0+3)","error_str":""},"return_code":-61} 2023-10-06T02:59:44.582 INFO:tasks.ceph.mds.a.smithi084.stderr: -3165> 2023-10-06T02:59:09.411+0000 7f25007e5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-10-06T02:58:50.596549+0000 1=0+1) n(v3 rc2023-10-06T02:58:50.829546+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={5651=pAsLsXsFsx/pAsLsXsFsx@5},l=5651 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55b539d72100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.596549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.829546+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.596549+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-10-06T02:58:50.829546+0000 6=0+6)","error_str":""},"return_code":-61} 2023-10-06T02:59:44.582 INFO:tasks.ceph.mds.a.smithi084.stderr: -3064> 2023-10-06T02:59:09.413+0000 7f25067f1700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-10-06T02:58:50.597549+0000 1=0+1) n(v4 rc2023-10-06T02:58:50.829546+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={5651=pAsLsXsFs/pAsLsXsFsx@9} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55b539df8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T02:58:50.597549+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T02:58:50.829546+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-10-06T02:58:50.597549+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-10-06T02:58:50.829546+0000 5=0+5)","error_str":""},"return_code":-61} 2023-10-06T02:59:44.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T02:59:44.600 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T02:59:44.603 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T02:59:44.607 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T02:59:44.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.709+0000 7fc5cde17700 1 Processor -- start 2023-10-06T02:59:44.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.710+0000 7fc5cde17700 1 -- start start 2023-10-06T02:59:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.710+0000 7fc5cde17700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 0x7fc5c806b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.710+0000 7fc5cde17700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c815d170 con 0x7fc5c815a5f0 2023-10-06T02:59:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.710+0000 7fc5cde17700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c815d3c0 con 0x7fc5c806a460 2023-10-06T02:59:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.710+0000 7fc5cde17700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c815d6a0 con 0x7fc5c806a090 2023-10-06T02:59:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.710+0000 7fc5c7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc5c815a5f0 0x7fc5c8068700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56576/0 (socket says 172.21.15.84:56576) 2023-10-06T02:59:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.710+0000 7fc5c7fff700 1 -- 172.21.15.84:0/1910777188 learned_addr learned my addr 172.21.15.84:0/1910777188 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c77fe700 1 --2- 172.21.15.84:0/1910777188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 0x7fc5c806b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c67fc700 1 -- 172.21.15.84:0/1910777188 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533084932 0 0) 0x7fc5c815d170 con 0x7fc5c815a5f0 2023-10-06T02:59:44.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c67fc700 1 -- 172.21.15.84:0/1910777188 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5b0003570 con 0x7fc5c815a5f0 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c67fc700 1 -- 172.21.15.84:0/1910777188 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636686051 0 0) 0x7fc5c815d3c0 con 0x7fc5c806a460 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c67fc700 1 -- 172.21.15.84:0/1910777188 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c815d170 con 0x7fc5c806a460 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c77fe700 1 -- 172.21.15.84:0/1910777188 >> v1:172.21.15.131:6789/0 conn(0x7fc5c806a460 legacy=0x7fc5c8159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c77fe700 1 -- 172.21.15.84:0/1910777188 >> v1:172.21.15.84:6789/0 conn(0x7fc5c815a5f0 legacy=0x7fc5c8068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c77fe700 1 -- 172.21.15.84:0/1910777188 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c815d980 con 0x7fc5c806a090 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c77fe700 1 --2- 172.21.15.84:0/1910777188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 0x7fc5c806b8e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009e90 tx=0x7fc5b8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a72450bde5d3498f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c67fc700 1 -- 172.21.15.84:0/1910777188 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b800e070 con 0x7fc5c806a090 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c67fc700 1 -- 172.21.15.84:0/1910777188 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b800bb80 con 0x7fc5c806a090 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.711+0000 7fc5c67fc700 1 -- 172.21.15.84:0/1910777188 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8012430 con 0x7fc5c806a090 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.712+0000 7fc5cde17700 1 -- 172.21.15.84:0/1910777188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 msgr2=0x7fc5c806b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.712+0000 7fc5cde17700 1 --2- 172.21.15.84:0/1910777188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 0x7fc5c806b8e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009e90 tx=0x7fc5b8009780 comp rx=0 tx=0).stop 2023-10-06T02:59:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.712+0000 7fc5cde17700 1 -- 172.21.15.84:0/1910777188 shutdown_connections 2023-10-06T02:59:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.712+0000 7fc5cde17700 1 --2- 172.21.15.84:0/1910777188 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 0x7fc5c806b8e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.712+0000 7fc5cde17700 1 -- 172.21.15.84:0/1910777188 >> 172.21.15.84:0/1910777188 conn(0x7fc5c80ce330 msgr2=0x7fc5c80ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.712+0000 7fc5cde17700 1 -- 172.21.15.84:0/1910777188 shutdown_connections 2023-10-06T02:59:44.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.712+0000 7fc5cde17700 1 -- 172.21.15.84:0/1910777188 wait complete. 2023-10-06T02:59:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.713+0000 7fc5cde17700 1 Processor -- start 2023-10-06T02:59:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.713+0000 7fc5cde17700 1 -- start start 2023-10-06T02:59:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5cde17700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 0x7fc5c8155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5cde17700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c806a460 0x7fc5c80c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5cde17700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c815a5f0 0x7fc5c80afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5cde17700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c8155900 con 0x7fc5c806a460 2023-10-06T02:59:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5cde17700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80b0a20 con 0x7fc5c815a5f0 2023-10-06T02:59:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5cde17700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80b19b0 con 0x7fc5c806a090 2023-10-06T02:59:44.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c806a460 0x7fc5c80c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c806a460 0x7fc5c80c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57612/0 (socket says 172.21.15.84:57612) 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c6ffd700 1 -- 172.21.15.84:0/3108653841 learned_addr learned my addr 172.21.15.84:0/3108653841 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c77fe700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 0x7fc5c8155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c7fff700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c815a5f0 0x7fc5c80afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c6ffd700 1 -- 172.21.15.84:0/3108653841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 msgr2=0x7fc5c8155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c6ffd700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 0x7fc5c8155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c6ffd700 1 -- 172.21.15.84:0/3108653841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c815a5f0 msgr2=0x7fc5c80afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c6ffd700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c815a5f0 0x7fc5c80afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c6ffd700 1 -- 172.21.15.84:0/3108653841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b8009a20 con 0x7fc5c806a460 2023-10-06T02:59:44.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.714+0000 7fc5c6ffd700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c806a460 0x7fc5c80c78e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00c7c0 tx=0x7fc5bc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.715+0000 7fc5af7fe700 1 -- 172.21.15.84:0/3108653841 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc010510 con 0x7fc5c806a460 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.715+0000 7fc5af7fe700 1 -- 172.21.15.84:0/3108653841 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc010670 con 0x7fc5c806a460 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.715+0000 7fc5af7fe700 1 -- 172.21.15.84:0/3108653841 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc010a10 con 0x7fc5c806a460 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.715+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c80b0740 con 0x7fc5c806a460 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.715+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c8155590 con 0x7fc5c806a460 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.715+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c8155ab0 con 0x7fc5c806a460 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.716+0000 7fc5af7fe700 1 -- 172.21.15.84:0/3108653841 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5bc01b3b0 con 0x7fc5c806a460 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.716+0000 7fc5af7fe700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5b4066f30 0x7fc5b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.716+0000 7fc5af7fe700 1 -- 172.21.15.84:0/3108653841 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6694+0+0 (secure 0 0 0) 0x7fc5bc084140 con 0x7fc5c806a460 2023-10-06T02:59:44.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.717+0000 7fc5c77fe700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5b4066f30 0x7fc5b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.717+0000 7fc5c77fe700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5b4066f30 0x7fc5b40693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009de0 tx=0x7fc5b8019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:44.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.721+0000 7fc5af7fe700 1 -- 172.21.15.84:0/3108653841 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5c8155ab0 con 0x7fc5c806a460 2023-10-06T02:59:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:44.944+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5c8155ab0 con 0x7fc5c806a460 2023-10-06T02:59:45.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.573+0000 7fc5af7fe700 1 -- 172.21.15.84:0/3108653841 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc5c8155ab0 con 0x7fc5c806a460 2023-10-06T02:59:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5b4066f30 msgr2=0x7fc5b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:45.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5b4066f30 0x7fc5b40693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009de0 tx=0x7fc5b8019000 comp rx=0 tx=0).stop 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c806a460 msgr2=0x7fc5c80c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c806a460 0x7fc5c80c78e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00c7c0 tx=0x7fc5bc007e10 comp rx=0 tx=0).stop 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 shutdown_connections 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5b4066f30 0x7fc5b40693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c815a5f0 0x7fc5c80afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c806a090 0x7fc5c8155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 --2- 172.21.15.84:0/3108653841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c806a460 0x7fc5c80c78e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 >> 172.21.15.84:0/3108653841 conn(0x7fc5c80ce330 msgr2=0x7fc5c8068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 shutdown_connections 2023-10-06T02:59:45.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.576+0000 7fc5cde17700 1 -- 172.21.15.84:0/3108653841 wait complete. 2023-10-06T02:59:45.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T02:59:45.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.754+0000 7f66f2748700 1 Processor -- start 2023-10-06T02:59:45.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.754+0000 7f66f2748700 1 -- start start 2023-10-06T02:59:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.754+0000 7f66f2748700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec159370 0x7f66ec15d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.754+0000 7f66f2748700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66ec0cd5c0 0x7f66ec15a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.754+0000 7f66f2748700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec0cb480 con 0x7f66ec159740 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.754+0000 7f66f2748700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec15ab50 con 0x7f66ec0cd5c0 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.754+0000 7f66f2748700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec15e060 con 0x7f66ec159370 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66ebfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec159370 0x7f66ec15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66f0ce5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66ec0cd5c0 0x7f66ec15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66eb7fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f66ec159740 0x7f66ec0cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:33702/0 (socket says 172.21.15.84:33702) 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66f0ce5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66ec0cd5c0 0x7f66ec15a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:53146/0 (socket says 172.21.15.84:53146) 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66ebfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec159370 0x7f66ec15d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:52868/0 (socket says 172.21.15.84:52868) 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66eb7fe700 1 -- 172.21.15.84:0/400331150 learned_addr learned my addr 172.21.15.84:0/400331150 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66f0ce5700 1 -- 172.21.15.84:0/400331150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec159370 msgr2=0x7f66ec15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66f0ce5700 1 --2- 172.21.15.84:0/400331150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec159370 0x7f66ec15d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66f0ce5700 1 -- 172.21.15.84:0/400331150 >> v1:172.21.15.131:6789/0 conn(0x7f66ec159740 legacy=0x7f66ec0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66eaffd700 1 -- 172.21.15.84:0/400331150 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486504220 0 0) 0x7f66ec0cb480 con 0x7f66ec159740 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66f0ce5700 1 -- 172.21.15.84:0/400331150 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec15d7c0 con 0x7f66ec0cd5c0 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66ebfff700 1 --2- 172.21.15.84:0/400331150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec159370 0x7f66ec15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.755+0000 7f66f0ce5700 1 --2- 172.21.15.84:0/400331150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66ec0cd5c0 0x7f66ec15a610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009e60 tx=0x7f66e4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edc007b67d786443 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66eaffd700 1 -- 172.21.15.84:0/400331150 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400e070 con 0x7f66ec0cd5c0 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66eaffd700 1 -- 172.21.15.84:0/400331150 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e400bb60 con 0x7f66ec0cd5c0 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66eaffd700 1 -- 172.21.15.84:0/400331150 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4012430 con 0x7f66ec0cd5c0 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66f2748700 1 -- 172.21.15.84:0/400331150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66ec0cd5c0 msgr2=0x7f66ec15a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:45.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66f2748700 1 --2- 172.21.15.84:0/400331150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66ec0cd5c0 0x7f66ec15a610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009e60 tx=0x7f66e4009780 comp rx=0 tx=0).stop 2023-10-06T02:59:45.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66f2748700 1 -- 172.21.15.84:0/400331150 shutdown_connections 2023-10-06T02:59:45.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66f2748700 1 --2- 172.21.15.84:0/400331150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66ec0cd5c0 0x7f66ec15a610 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:45.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66f2748700 1 --2- 172.21.15.84:0/400331150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec159370 0x7f66ec15d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:45.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66f2748700 1 -- 172.21.15.84:0/400331150 >> 172.21.15.84:0/400331150 conn(0x7f66ec068350 msgr2=0x7f66ec068750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:45.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66f2748700 1 -- 172.21.15.84:0/400331150 shutdown_connections 2023-10-06T02:59:45.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.756+0000 7f66f2748700 1 -- 172.21.15.84:0/400331150 wait complete. 2023-10-06T02:59:45.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.757+0000 7f66f2748700 1 Processor -- start 2023-10-06T02:59:45.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.757+0000 7f66f2748700 1 -- start start 2023-10-06T02:59:45.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66f2748700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec0cd5c0 0x7f66ec151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:45.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66f2748700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66ec159370 0x7f66ec0b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66f2748700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66ec159740 0x7f66ec0c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66f2748700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec16d2d0 con 0x7f66ec159740 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66f2748700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec16a1f0 con 0x7f66ec159370 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66f2748700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec16a4d0 con 0x7f66ec0cd5c0 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66f0ce5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66ec159740 0x7f66ec0c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66f0ce5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66ec159740 0x7f66ec0c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57624/0 (socket says 172.21.15.84:57624) 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66f0ce5700 1 -- 172.21.15.84:0/2151743538 learned_addr learned my addr 172.21.15.84:0/2151743538 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66eb7fe700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66ec159370 0x7f66ec0b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.758+0000 7f66ebfff700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec0cd5c0 0x7f66ec151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66f0ce5700 1 -- 172.21.15.84:0/2151743538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec0cd5c0 msgr2=0x7f66ec151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66f0ce5700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec0cd5c0 0x7f66ec151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66f0ce5700 1 -- 172.21.15.84:0/2151743538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66ec159370 msgr2=0x7f66ec0b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66f0ce5700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66ec159370 0x7f66ec0b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66f0ce5700 1 -- 172.21.15.84:0/2151743538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc009420 con 0x7f66ec159740 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66f0ce5700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66ec159740 0x7f66ec0c8460 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f66e400b6c0 tx=0x7f66e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66d3fff700 1 -- 172.21.15.84:0/2151743538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4012e90 con 0x7f66ec159740 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66d3fff700 1 -- 172.21.15.84:0/2151743538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4009420 con 0x7f66ec159740 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e4009a20 con 0x7f66ec159740 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66d3fff700 1 -- 172.21.15.84:0/2151743538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40276c0 con 0x7f66ec159740 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.759+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec16aa90 con 0x7f66ec159740 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.760+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec16d480 con 0x7f66ec159740 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.760+0000 7f66d3fff700 1 -- 172.21.15.84:0/2151743538 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66e4024070 con 0x7f66ec159740 2023-10-06T02:59:45.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.761+0000 7f66d3fff700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66d8066f30 0x7f66d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:45.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.761+0000 7f66d3fff700 1 -- 172.21.15.84:0/2151743538 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f66e4086f10 con 0x7f66ec159740 2023-10-06T02:59:45.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.761+0000 7f66ebfff700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66d8066f30 0x7f66d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:45.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.761+0000 7f66ebfff700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66d8066f30 0x7f66d80693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009f40 tx=0x7f66dc0091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:45.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.765+0000 7f66d3fff700 1 -- 172.21.15.84:0/2151743538 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66ec16d480 con 0x7f66ec159740 2023-10-06T02:59:45.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:45.947+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f66ec16d480 con 0x7f66ec159740 2023-10-06T02:59:46.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.579+0000 7f66d3fff700 1 -- 172.21.15.84:0/2151743538 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) v1 ==== 181+0+0 (secure 0 0 0) 0x7f66ec16d480 con 0x7f66ec159740 2023-10-06T02:59:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66d8066f30 msgr2=0x7f66d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66d8066f30 0x7f66d80693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009f40 tx=0x7f66dc0091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66ec159740 msgr2=0x7f66ec0c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66ec159740 0x7f66ec0c8460 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f66e400b6c0 tx=0x7f66e4019000 comp rx=0 tx=0).stop 2023-10-06T02:59:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 shutdown_connections 2023-10-06T02:59:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f66d8066f30 0x7f66d80693e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66ec159740 0x7f66ec0c8460 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66ec0cd5c0 0x7f66ec151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 --2- 172.21.15.84:0/2151743538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66ec159370 0x7f66ec0b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 >> 172.21.15.84:0/2151743538 conn(0x7f66ec068350 msgr2=0x7f66ec152c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 shutdown_connections 2023-10-06T02:59:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.582+0000 7f66f2748700 1 -- 172.21.15.84:0/2151743538 wait complete. 2023-10-06T02:59:46.585 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T02:59:46.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T02:59:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.713+0000 7f121802c700 1 Processor -- start 2023-10-06T02:59:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.714+0000 7f121802c700 1 -- start start 2023-10-06T02:59:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.714+0000 7f121802c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f121006ed20 0x7f12100b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.714+0000 7f121802c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f121006f0f0 0x7f12100b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.714+0000 7f121802c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12100b2d20 con 0x7f12100aee20 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.714+0000 7f121802c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121006fb80 con 0x7f121006f0f0 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.714+0000 7f121802c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12100b0450 con 0x7f121006ed20 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.714+0000 7f12165c9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f12100aee20 0x7f12100af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56586/0 (socket says 172.21.15.84:56586) 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12165c9700 1 -- 172.21.15.84:0/3249320840 learned_addr learned my addr 172.21.15.84:0/3249320840 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503343207 0 0) 0x7f12100b2d20 con 0x7f12100aee20 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11fc003570 con 0x7f12100aee20 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12155c7700 1 --2- 172.21.15.84:0/3249320840 >> v2:172.21.15.131:3300/0 conn(0x7f121006f0f0 0x7f12100b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1215dc8700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f121006ed20 0x7f12100b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4289221670 0 0) 0x7f11fc003570 con 0x7f12100aee20 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f121006ed20 msgr2=0x7f12100b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f121006ed20 0x7f12100b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 >> v2:172.21.15.131:3300/0 conn(0x7f121006f0f0 msgr2=0x7f12100b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 --2- 172.21.15.84:0/3249320840 >> v2:172.21.15.131:3300/0 conn(0x7f121006f0f0 0x7f12100b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100b2a40 con 0x7f12100aee20 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f12080017f0 con 0x7f12100aee20 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 >> v1:172.21.15.84:6789/0 conn(0x7f12100aee20 legacy=0x7f12100af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11fc003a60 0x7f11fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f121006ed20 0x7f11fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11fc004d50 0x7f11fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100b0450 con 0x7f11fc004d50 2023-10-06T02:59:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc00bb10 con 0x7f11fc003a60 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc00bcd0 con 0x7f121006ed20 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12165c9700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11fc004d50 0x7f11fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12155c7700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f121006ed20 0x7f11fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f1215dc8700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11fc003a60 0x7f11fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12165c9700 1 -- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f121006ed20 msgr2=0x7f11fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12165c9700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f121006ed20 0x7f11fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12165c9700 1 -- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11fc003a60 msgr2=0x7f11fc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12165c9700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11fc003a60 0x7f11fc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12165c9700 1 -- 172.21.15.84:0/3249320840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc003570 con 0x7f11fc004d50 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.715+0000 7f12155c7700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f121006ed20 0x7f11fc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f12165c9700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11fc004d50 0x7f11fc0051c0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f120800a930 tx=0x7f12080021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5abacc9bd0ecc77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12080070d0 con 0x7f11fc004d50 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1208007270 con 0x7f11fc004d50 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f1214dc6700 1 -- 172.21.15.84:0/3249320840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208007630 con 0x7f11fc004d50 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f121802c700 1 -- 172.21.15.84:0/3249320840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11fc004d50 msgr2=0x7f11fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f121802c700 1 --2- 172.21.15.84:0/3249320840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11fc004d50 0x7f11fc0051c0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f120800a930 tx=0x7f12080021d0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f12165c9700 1 -- 172.21.15.84:0/3249320840 reap_dead start 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f121802c700 1 -- 172.21.15.84:0/3249320840 shutdown_connections 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f121802c700 1 -- 172.21.15.84:0/3249320840 >> 172.21.15.84:0/3249320840 conn(0x7f1210068330 msgr2=0x7f1210068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f121802c700 1 -- 172.21.15.84:0/3249320840 shutdown_connections 2023-10-06T02:59:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.716+0000 7f121802c700 1 -- 172.21.15.84:0/3249320840 wait complete. 2023-10-06T02:59:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f121802c700 1 Processor -- start 2023-10-06T02:59:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f121802c700 1 -- start start 2023-10-06T02:59:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f121802c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1210156720 0x7f12100ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f121802c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12100ae900 0x7f121016cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f121802c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12100a9df0 0x7f121016d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f121802c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100ac6d0 con 0x7f1210156720 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f121802c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100ac9b0 con 0x7f12100a9df0 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f121802c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12100acc90 con 0x7f12100ae900 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f1215dc8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1210156720 0x7f12100ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f1215dc8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1210156720 0x7f12100ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57634/0 (socket says 172.21.15.84:57634) 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f1215dc8700 1 -- 172.21.15.84:0/1864688669 learned_addr learned my addr 172.21.15.84:0/1864688669 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f12155c7700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12100ae900 0x7f121016cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.718+0000 7f12165c9700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12100a9df0 0x7f121016d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f1215dc8700 1 -- 172.21.15.84:0/1864688669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12100ae900 msgr2=0x7f121016cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f1215dc8700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12100ae900 0x7f121016cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f1215dc8700 1 -- 172.21.15.84:0/1864688669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12100a9df0 msgr2=0x7f121016d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f1215dc8700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12100a9df0 0x7f121016d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f1215dc8700 1 -- 172.21.15.84:0/1864688669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100ac3a0 con 0x7f1210156720 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f1215dc8700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1210156720 0x7f12100ae3c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f120c010aa0 tx=0x7f120c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f1205ffb700 1 -- 172.21.15.84:0/1864688669 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c010ee0 con 0x7f1210156720 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f1205ffb700 1 -- 172.21.15.84:0/1864688669 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c00e8d0 con 0x7f1210156720 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1210156af0 con 0x7f1210156720 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f1205ffb700 1 -- 172.21.15.84:0/1864688669 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00ec70 con 0x7f1210156720 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.719+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12100aa460 con 0x7f1210156720 2023-10-06T02:59:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.720+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1210064ad0 con 0x7f1210156720 2023-10-06T02:59:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.720+0000 7f1205ffb700 1 -- 172.21.15.84:0/1864688669 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f120c014640 con 0x7f1210156720 2023-10-06T02:59:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.721+0000 7f1205ffb700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f11f4066f30 0x7f11f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.721+0000 7f1205ffb700 1 -- 172.21.15.84:0/1864688669 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6256+0+0 (secure 0 0 0) 0x7f120c084e10 con 0x7f1210156720 2023-10-06T02:59:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.721+0000 7f12155c7700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f11f4066f30 0x7f11f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.721+0000 7f12155c7700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f11f4066f30 0x7f11f40693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f12100aecf0 tx=0x7f1200008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.725+0000 7f1205ffb700 1 -- 172.21.15.84:0/1864688669 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f120c051e60 con 0x7f1210156720 2023-10-06T02:59:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:46.911+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f12100ac810 con 0x7f1210156720 2023-10-06T02:59:47.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.580+0000 7f1205ffb700 1 -- 172.21.15.84:0/1864688669 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) v1 ==== 169+0+0 (secure 0 0 0) 0x7f12100ac810 con 0x7f1210156720 2023-10-06T02:59:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f11f4066f30 msgr2=0x7f11f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f11f4066f30 0x7f11f40693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f12100aecf0 tx=0x7f1200008040 comp rx=0 tx=0).stop 2023-10-06T02:59:47.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1210156720 msgr2=0x7f12100ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1210156720 0x7f12100ae3c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f120c010aa0 tx=0x7f120c008040 comp rx=0 tx=0).stop 2023-10-06T02:59:47.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 shutdown_connections 2023-10-06T02:59:47.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f11f4066f30 0x7f11f40693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12100a9df0 0x7f121016d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1210156720 0x7f12100ae3c0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 --2- 172.21.15.84:0/1864688669 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12100ae900 0x7f121016cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 >> 172.21.15.84:0/1864688669 conn(0x7f1210068330 msgr2=0x7f1210068830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:47.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 shutdown_connections 2023-10-06T02:59:47.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.583+0000 7f121802c700 1 -- 172.21.15.84:0/1864688669 wait complete. 2023-10-06T02:59:47.588 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T02:59:47.598 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T02:59:47.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.715+0000 7f82949bd700 1 Processor -- start 2023-10-06T02:59:47.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.715+0000 7f82949bd700 1 -- start start 2023-10-06T02:59:47.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.716+0000 7f82949bd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82900c6610 0x7f82900cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.716+0000 7f82949bd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82900b2e60 con 0x7f82900cbb50 2023-10-06T02:59:47.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.716+0000 7f82949bd700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82900cf5d0 con 0x7f82900b2a90 2023-10-06T02:59:47.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.716+0000 7f82949bd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900cf8b0 con 0x7f82900c6610 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.716+0000 7f828ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82900c6610 0x7f82900cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.716+0000 7f828dd9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f82900cbb50 0x7f82900ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56598/0 (socket says 172.21.15.84:56598) 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.716+0000 7f828dd9b700 1 -- 172.21.15.84:0/3589560060 learned_addr learned my addr 172.21.15.84:0/3589560060 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f828ed9d700 1 -- 172.21.15.84:0/3589560060 >> v1:172.21.15.131:6789/0 conn(0x7f82900b2a90 legacy=0x7f82900cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f828ed9d700 1 -- 172.21.15.84:0/3589560060 >> v1:172.21.15.84:6789/0 conn(0x7f82900cbb50 legacy=0x7f82900ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f828d59a700 1 -- 172.21.15.84:0/3589560060 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845972413 0 0) 0x7f82900b2e60 con 0x7f82900cbb50 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f828ed9d700 1 -- 172.21.15.84:0/3589560060 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900cfb90 con 0x7f82900c6610 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f828ed9d700 1 --2- 172.21.15.84:0/3589560060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900c6610 0x7f82900cef60 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8288009e60 tx=0x7f8288009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f56b341ad06568 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f828d59a700 1 -- 172.21.15.84:0/3589560060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800e070 con 0x7f82900c6610 2023-10-06T02:59:47.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f828d59a700 1 -- 172.21.15.84:0/3589560060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828800bbf0 con 0x7f82900c6610 2023-10-06T02:59:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f828d59a700 1 -- 172.21.15.84:0/3589560060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288012430 con 0x7f82900c6610 2023-10-06T02:59:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f82949bd700 1 -- 172.21.15.84:0/3589560060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900c6610 msgr2=0x7f82900cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.717+0000 7f82949bd700 1 --2- 172.21.15.84:0/3589560060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900c6610 0x7f82900cef60 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8288009e60 tx=0x7f8288009780 comp rx=0 tx=0).stop 2023-10-06T02:59:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.718+0000 7f82949bd700 1 -- 172.21.15.84:0/3589560060 shutdown_connections 2023-10-06T02:59:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.718+0000 7f82949bd700 1 --2- 172.21.15.84:0/3589560060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900c6610 0x7f82900cef60 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.718+0000 7f82949bd700 1 -- 172.21.15.84:0/3589560060 >> 172.21.15.84:0/3589560060 conn(0x7f8290099740 msgr2=0x7f829006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.718+0000 7f82949bd700 1 -- 172.21.15.84:0/3589560060 shutdown_connections 2023-10-06T02:59:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.718+0000 7f82949bd700 1 -- 172.21.15.84:0/3589560060 wait complete. 2023-10-06T02:59:47.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.719+0000 7f82949bd700 1 Processor -- start 2023-10-06T02:59:47.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.719+0000 7f82949bd700 1 -- start start 2023-10-06T02:59:47.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.719+0000 7f82949bd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82900b2a90 0x7f8290169660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.719+0000 7f82949bd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82900c6610 0x7f829009cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.719+0000 7f82949bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cbb50 0x7f829009d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.719+0000 7f82949bd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829009aea0 con 0x7f82900cbb50 2023-10-06T02:59:47.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.719+0000 7f82949bd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290169ba0 con 0x7f82900c6610 2023-10-06T02:59:47.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.719+0000 7f82949bd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829009a290 con 0x7f82900b2a90 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cbb50 0x7f829009d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cbb50 0x7f829009d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57650/0 (socket says 172.21.15.84:57650) 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828ed9d700 1 -- 172.21.15.84:0/1400806843 learned_addr learned my addr 172.21.15.84:0/1400806843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828e59c700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82900b2a90 0x7f8290169660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828dd9b700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82900c6610 0x7f829009cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828ed9d700 1 -- 172.21.15.84:0/1400806843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82900b2a90 msgr2=0x7f8290169660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828ed9d700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82900b2a90 0x7f8290169660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828ed9d700 1 -- 172.21.15.84:0/1400806843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82900c6610 msgr2=0x7f829009cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828ed9d700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82900c6610 0x7f829009cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828ed9d700 1 -- 172.21.15.84:0/1400806843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288009a20 con 0x7f82900cbb50 2023-10-06T02:59:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828dd9b700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82900c6610 0x7f829009cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f828ed9d700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cbb50 0x7f829009d080 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8290088fe0 tx=0x7f8288018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f827e7fc700 1 -- 172.21.15.84:0/1400806843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288007000 con 0x7f82900cbb50 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f827e7fc700 1 -- 172.21.15.84:0/1400806843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288021070 con 0x7f82900cbb50 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829009a570 con 0x7f82900cbb50 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f827e7fc700 1 -- 172.21.15.84:0/1400806843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288026680 con 0x7f82900cbb50 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.720+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829009ab30 con 0x7f82900cbb50 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.721+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8290064ad0 con 0x7f82900cbb50 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.721+0000 7f827e7fc700 1 -- 172.21.15.84:0/1400806843 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8288023030 con 0x7f82900cbb50 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.722+0000 7f827e7fc700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8270066f30 0x7f82700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.722+0000 7f827e7fc700 1 -- 172.21.15.84:0/1400806843 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f8288086a40 con 0x7f82900cbb50 2023-10-06T02:59:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.722+0000 7f828e59c700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8270066f30 0x7f82700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.722+0000 7f828e59c700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8270066f30 0x7f82700693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f829016cb40 tx=0x7f8280009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.726+0000 7f827e7fc700 1 -- 172.21.15.84:0/1400806843 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8288088e60 con 0x7f82900cbb50 2023-10-06T02:59:47.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.911+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f829009afe0 con 0x7f82900cbb50 2023-10-06T02:59:47.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.914+0000 7f827e7fc700 1 -- 172.21.15.84:0/1400806843 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8288053c60 con 0x7f82900cbb50 2023-10-06T02:59:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8270066f30 msgr2=0x7f82700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8270066f30 0x7f82700693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f829016cb40 tx=0x7f8280009040 comp rx=0 tx=0).stop 2023-10-06T02:59:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cbb50 msgr2=0x7f829009d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cbb50 0x7f829009d080 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8290088fe0 tx=0x7f8288018000 comp rx=0 tx=0).stop 2023-10-06T02:59:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 shutdown_connections 2023-10-06T02:59:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8270066f30 0x7f82700693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82900cbb50 0x7f829009d080 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f82900b2a90 0x7f8290169660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 --2- 172.21.15.84:0/1400806843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82900c6610 0x7f829009cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 >> 172.21.15.84:0/1400806843 conn(0x7f8290099740 msgr2=0x7f82900b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 shutdown_connections 2023-10-06T02:59:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:47.916+0000 7f82949bd700 1 -- 172.21.15.84:0/1400806843 wait complete. 2023-10-06T02:59:47.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2023-10-06T02:59:48.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.045+0000 7f704b4dd700 1 Processor -- start 2023-10-06T02:59:48.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.045+0000 7f704b4dd700 1 -- start start 2023-10-06T02:59:48.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.046+0000 7f704b4dd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f70441562c0 0x7f704415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.046+0000 7f704b4dd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f70440abb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.046+0000 7f704b4dd700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70440c9740 con 0x7f7044156690 2023-10-06T02:59:48.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.046+0000 7f704b4dd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704415b040 con 0x7f70441562c0 2023-10-06T02:59:48.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.046+0000 7f704b4dd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440ad850 con 0x7f7044068d10 2023-10-06T02:59:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.046+0000 7f7049a7a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f70440abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.046+0000 7f7049279700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f70441562c0 0x7f704415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7049279700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f70441562c0 0x7f704415a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:53218/0 (socket says 172.21.15.84:53218) 2023-10-06T02:59:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7049a7a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f70440abb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:52930/0 (socket says 172.21.15.84:52930) 2023-10-06T02:59:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7049279700 1 -- 172.21.15.84:0/2110696869 learned_addr learned my addr 172.21.15.84:0/2110696869 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7048a78700 1 --1- 172.21.15.84:0/2110696869 >> v1:172.21.15.131:6789/0 conn(0x7f7044156690 0x7f7044068600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:33710/0 (socket says 172.21.15.84:33710) 2023-10-06T02:59:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7049279700 1 -- 172.21.15.84:0/2110696869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 msgr2=0x7f70440abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7049279700 1 --2- 172.21.15.84:0/2110696869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f70440abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7049279700 1 -- 172.21.15.84:0/2110696869 >> v1:172.21.15.131:6789/0 conn(0x7f7044156690 legacy=0x7f7044068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7049279700 1 -- 172.21.15.84:0/2110696869 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704415a7a0 con 0x7f70441562c0 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f703bfff700 1 -- 172.21.15.84:0/2110696869 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630328754 0 0) 0x7f70440c9740 con 0x7f7044156690 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7049a7a700 1 --2- 172.21.15.84:0/2110696869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f70440abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f7049279700 1 --2- 172.21.15.84:0/2110696869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70441562c0 0x7f704415a0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7040009f70 tx=0x7f7040009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23cd51716a0705af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f703bfff700 1 -- 172.21.15.84:0/2110696869 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000e070 con 0x7f70441562c0 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f703bfff700 1 -- 172.21.15.84:0/2110696869 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704000ba20 con 0x7f70441562c0 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.047+0000 7f703bfff700 1 -- 172.21.15.84:0/2110696869 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400092e0 con 0x7f70441562c0 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.048+0000 7f704b4dd700 1 -- 172.21.15.84:0/2110696869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70441562c0 msgr2=0x7f704415a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.048+0000 7f704b4dd700 1 --2- 172.21.15.84:0/2110696869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70441562c0 0x7f704415a0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7040009f70 tx=0x7f7040009840 comp rx=0 tx=0).stop 2023-10-06T02:59:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.048+0000 7f704b4dd700 1 -- 172.21.15.84:0/2110696869 shutdown_connections 2023-10-06T02:59:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.048+0000 7f704b4dd700 1 --2- 172.21.15.84:0/2110696869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f70440abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.048+0000 7f704b4dd700 1 --2- 172.21.15.84:0/2110696869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70441562c0 0x7f704415a0a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.048+0000 7f704b4dd700 1 -- 172.21.15.84:0/2110696869 >> 172.21.15.84:0/2110696869 conn(0x7f704406de80 msgr2=0x7f704406e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.048+0000 7f704b4dd700 1 -- 172.21.15.84:0/2110696869 shutdown_connections 2023-10-06T02:59:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.048+0000 7f704b4dd700 1 -- 172.21.15.84:0/2110696869 wait complete. 2023-10-06T02:59:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.049+0000 7f704b4dd700 1 Processor -- start 2023-10-06T02:59:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.049+0000 7f704b4dd700 1 -- start start 2023-10-06T02:59:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f704b4dd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f7044152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f704b4dd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70441562c0 0x7f7044148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f704b4dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044156690 0x7f7044149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f704b4dd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044153610 con 0x7f7044156690 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f704b4dd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044153050 con 0x7f70441562c0 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f704b4dd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7044153330 con 0x7f7044068d10 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049a7a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044156690 0x7f7044149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049a7a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044156690 0x7f7044149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57664/0 (socket says 172.21.15.84:57664) 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049a7a700 1 -- 172.21.15.84:0/3103402270 learned_addr learned my addr 172.21.15.84:0/3103402270 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7048a78700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70441562c0 0x7f7044148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049279700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f7044152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049a7a700 1 -- 172.21.15.84:0/3103402270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 msgr2=0x7f7044152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049a7a700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f7044152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049a7a700 1 -- 172.21.15.84:0/3103402270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70441562c0 msgr2=0x7f7044148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049a7a700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70441562c0 0x7f7044148730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049a7a700 1 -- 172.21.15.84:0/3103402270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c009420 con 0x7f7044156690 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.050+0000 7f7049279700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f7044152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.051+0000 7f7049a7a700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044156690 0x7f7044149b40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f703c00ea70 tx=0x7f703c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.051+0000 7f70397fa700 1 -- 172.21.15.84:0/3103402270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00c920 con 0x7f7044156690 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.051+0000 7f70397fa700 1 -- 172.21.15.84:0/3103402270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c00caa0 con 0x7f7044156690 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.051+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040009ae0 con 0x7f7044156690 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.051+0000 7f70397fa700 1 -- 172.21.15.84:0/3103402270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00ce60 con 0x7f7044156690 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.051+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704414bc00 con 0x7f7044156690 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.052+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70440cabe0 con 0x7f7044156690 2023-10-06T02:59:48.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.052+0000 7f70397fa700 1 -- 172.21.15.84:0/3103402270 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f703c013680 con 0x7f7044156690 2023-10-06T02:59:48.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.052+0000 7f70397fa700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7028066f30 0x7f70280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.052+0000 7f70397fa700 1 -- 172.21.15.84:0/3103402270 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f703c084990 con 0x7f7044156690 2023-10-06T02:59:48.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.053+0000 7f7049279700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7028066f30 0x7f70280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.053+0000 7f7049279700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7028066f30 0x7f70280693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7040009880 tx=0x7f7040018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:48.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.057+0000 7f70397fa700 1 -- 172.21.15.84:0/3103402270 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f703c051bb0 con 0x7f7044156690 2023-10-06T02:59:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.312+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) v1 -- 0x7f7044064ad0 con 0x7f7044156690 2023-10-06T02:59:48.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.584+0000 7f70397fa700 1 -- 172.21.15.84:0/3103402270 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v244) v1 ==== 142+0+0 (secure 0 0 0) 0x7f703c0170d0 con 0x7f7044156690 2023-10-06T02:59:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7028066f30 msgr2=0x7f70280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7028066f30 0x7f70280693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7040009880 tx=0x7f7040018000 comp rx=0 tx=0).stop 2023-10-06T02:59:48.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044156690 msgr2=0x7f7044149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044156690 0x7f7044149b40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f703c00ea70 tx=0x7f703c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 shutdown_connections 2023-10-06T02:59:48.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7028066f30 0x7f70280693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044156690 0x7f7044149b40 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044068d10 0x7f7044152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 --2- 172.21.15.84:0/3103402270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70441562c0 0x7f7044148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 >> 172.21.15.84:0/3103402270 conn(0x7f704406de80 msgr2=0x7f70440675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 shutdown_connections 2023-10-06T02:59:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.586+0000 7f704b4dd700 1 -- 172.21.15.84:0/3103402270 wait complete. 2023-10-06T02:59:48.599 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-10-06T02:59:48.599 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-10-06T02:59:48.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2023-10-06T02:59:48.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.712+0000 7f460d143700 1 Processor -- start 2023-10-06T02:59:48.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.712+0000 7f460d143700 1 -- start start 2023-10-06T02:59:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.713+0000 7f460d143700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46080b49e0 0x7f46080aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.713+0000 7f460d143700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46080b0ca0 con 0x7f46080b07a0 2023-10-06T02:59:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.713+0000 7f460d143700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46080b0f80 con 0x7f46081595a0 2023-10-06T02:59:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.713+0000 7f460d143700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46080b1260 con 0x7f46080b49e0 2023-10-06T02:59:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.713+0000 7f460759e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f46080b07a0 0x7f46080b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56600/0 (socket says 172.21.15.84:56600) 2023-10-06T02:59:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.713+0000 7f460759e700 1 -- 172.21.15.84:0/2772424895 learned_addr learned my addr 172.21.15.84:0/2772424895 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.713+0000 7f45fe59c700 1 --2- 172.21.15.84:0/2772424895 >> v2:172.21.15.131:3300/0 conn(0x7f46080b49e0 0x7f46080aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.713+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127814566 0 0) 0x7f46080b0ca0 con 0x7f46080b07a0 2023-10-06T02:59:48.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.713+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f4003570 con 0x7f46080b07a0 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 574571033 0 0) 0x7f45f4003570 con 0x7f46080b07a0 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 >> v2:172.21.15.131:3300/0 conn(0x7f46080b49e0 msgr2=0x7f46080aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 --2- 172.21.15.84:0/2772424895 >> v2:172.21.15.131:3300/0 conn(0x7f46080b49e0 0x7f46080aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 >> v1:172.21.15.131:6789/0 conn(0x7f46081595a0 legacy=0x7f46080aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080b1540 con 0x7f46080b07a0 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f46000017f0 con 0x7f46080b07a0 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 >> v1:172.21.15.84:6789/0 conn(0x7f46080b07a0 legacy=0x7f46080b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45f4003a90 0x7f45f4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f4004810 0x7f45f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f4005210 0x7f45f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b1260 con 0x7f45f4005210 2023-10-06T02:59:48.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f400c130 con 0x7f45f4003a90 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f400c2c0 con 0x7f45f4004810 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460759e700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f4005210 0x7f45f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f4606d9d700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45f4003a90 0x7f45f4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f45fe59c700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f4004810 0x7f45f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460759e700 1 -- 172.21.15.84:0/2772424895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f4004810 msgr2=0x7f45f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460759e700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f4004810 0x7f45f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460759e700 1 -- 172.21.15.84:0/2772424895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45f4003a90 msgr2=0x7f45f4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460759e700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45f4003a90 0x7f45f4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460759e700 1 -- 172.21.15.84:0/2772424895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4003570 con 0x7f45f4005210 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f45fe59c700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f4004810 0x7f45f4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:48.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460759e700 1 -- 172.21.15.84:0/2772424895 reap_dead start 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460759e700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f4005210 0x7f45f400ba60 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f460000a960 tx=0x7f46000021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d347bc36cad9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000070d0 con 0x7f45f4005210 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600007230 con 0x7f45f4005210 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.714+0000 7f460659c700 1 -- 172.21.15.84:0/2772424895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000075d0 con 0x7f45f4005210 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.715+0000 7f460d143700 1 -- 172.21.15.84:0/2772424895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f4005210 msgr2=0x7f45f400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.715+0000 7f460d143700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f4005210 0x7f45f400ba60 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f460000a960 tx=0x7f46000021d0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.715+0000 7f460d143700 1 -- 172.21.15.84:0/2772424895 shutdown_connections 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.715+0000 7f460d143700 1 --2- 172.21.15.84:0/2772424895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45f4005210 0x7f45f400ba60 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.715+0000 7f460d143700 1 -- 172.21.15.84:0/2772424895 >> 172.21.15.84:0/2772424895 conn(0x7f4608099830 msgr2=0x7f460806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.715+0000 7f460d143700 1 -- 172.21.15.84:0/2772424895 shutdown_connections 2023-10-06T02:59:48.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.715+0000 7f460d143700 1 -- 172.21.15.84:0/2772424895 wait complete. 2023-10-06T02:59:48.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.716+0000 7f460d143700 1 Processor -- start 2023-10-06T02:59:48.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.716+0000 7f460d143700 1 -- start start 2023-10-06T02:59:48.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f460d143700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f4005210 0x7f46081599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f460d143700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4608159f30 0x7f460815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f460d143700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f460815c2e0 0x7f460815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f460d143700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080af760 con 0x7f4608159f30 2023-10-06T02:59:48.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f460d143700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46081569d0 con 0x7f460815c2e0 2023-10-06T02:59:48.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f460d143700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460815b2d0 con 0x7f45f4005210 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45fe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4608159f30 0x7f460815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45fe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4608159f30 0x7f460815bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57688/0 (socket says 172.21.15.84:57688) 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45fe59c700 1 -- 172.21.15.84:0/3248074742 learned_addr learned my addr 172.21.15.84:0/3248074742 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f460759e700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f460815c2e0 0x7f460815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45fe59c700 1 -- 172.21.15.84:0/3248074742 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f4005210 msgr2=0x7f46081599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45fe59c700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f4005210 0x7f46081599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45fe59c700 1 -- 172.21.15.84:0/3248074742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f460815c2e0 msgr2=0x7f460815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45fe59c700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f460815c2e0 0x7f460815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45fe59c700 1 -- 172.21.15.84:0/3248074742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460815a6c0 con 0x7f4608159f30 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f460759e700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f460815c2e0 0x7f460815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:48.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45fe59c700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4608159f30 0x7f460815bda0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f45f0011760 tx=0x7f45f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45ff7fe700 1 -- 172.21.15.84:0/3248074742 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0015740 con 0x7f4608159f30 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.717+0000 7f45ff7fe700 1 -- 172.21.15.84:0/3248074742 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f00158a0 con 0x7f4608159f30 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.718+0000 7f45ff7fe700 1 -- 172.21.15.84:0/3248074742 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0015c40 con 0x7f4608159f30 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.718+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460815a9a0 con 0x7f4608159f30 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.718+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460815af60 con 0x7f4608159f30 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.718+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4608064ad0 con 0x7f4608159f30 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.719+0000 7f45ff7fe700 1 -- 172.21.15.84:0/3248074742 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45f0013620 con 0x7f4608159f30 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.719+0000 7f45ff7fe700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f45e8066f30 0x7f45e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.719+0000 7f45ff7fe700 1 -- 172.21.15.84:0/3248074742 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f45f0084c50 con 0x7f4608159f30 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.719+0000 7f4606d9d700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f45e8066f30 0x7f45e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:48.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.720+0000 7f4606d9d700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f45e8066f30 0x7f45e80693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f45f8007e90 tx=0x7f45f8007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:48.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.723+0000 7f45ff7fe700 1 -- 172.21.15.84:0/3248074742 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45f008a020 con 0x7f4608159f30 2023-10-06T02:59:48.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:48.981+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) v1 -- 0x7f46080b1820 con 0x7f4608159f30 2023-10-06T02:59:49.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.585+0000 7f45ff7fe700 1 -- 172.21.15.84:0/3248074742 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v245) v1 ==== 144+0+0 (secure 0 0 0) 0x7f45f0051e70 con 0x7f4608159f30 2023-10-06T02:59:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f45e8066f30 msgr2=0x7f45e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f45e8066f30 0x7f45e80693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f45f8007e90 tx=0x7f45f8007d80 comp rx=0 tx=0).stop 2023-10-06T02:59:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4608159f30 msgr2=0x7f460815bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4608159f30 0x7f460815bda0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f45f0011760 tx=0x7f45f0008040 comp rx=0 tx=0).stop 2023-10-06T02:59:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 shutdown_connections 2023-10-06T02:59:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f45e8066f30 0x7f45e80693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f460815c2e0 0x7f460815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f45f4005210 0x7f46081599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 --2- 172.21.15.84:0/3248074742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4608159f30 0x7f460815bda0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 >> 172.21.15.84:0/3248074742 conn(0x7f4608099830 msgr2=0x7f4608069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:49.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 shutdown_connections 2023-10-06T02:59:49.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.588+0000 7f460d143700 1 -- 172.21.15.84:0/3248074742 wait complete. 2023-10-06T02:59:49.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T02:59:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.718+0000 7f2ede94a700 1 Processor -- start 2023-10-06T02:59:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.718+0000 7f2ede94a700 1 -- start start 2023-10-06T02:59:49.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.719+0000 7f2ede94a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2ed80b0680 0x7f2ed80ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.719+0000 7f2ede94a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed80cc630 0x7f2ed80c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.719+0000 7f2ede94a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80ccad0 con 0x7f2ed80b0a50 2023-10-06T02:59:49.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.719+0000 7f2ede94a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed80ca7d0 con 0x7f2ed80b0680 2023-10-06T02:59:49.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.719+0000 7f2ede94a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80c5400 con 0x7f2ed80cc630 2023-10-06T02:59:49.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.719+0000 7f2ed77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2ed80b0a50 0x7f2ed80cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56612/0 (socket says 172.21.15.84:56612) 2023-10-06T02:59:49.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.719+0000 7f2ed77fe700 1 -- 172.21.15.84:0/1296308850 learned_addr learned my addr 172.21.15.84:0/1296308850 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:49.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.719+0000 7f2ed7fff700 1 --2- 172.21.15.84:0/1296308850 >> v2:172.21.15.131:3300/0 conn(0x7f2ed80b0680 0x7f2ed80ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2edcee7700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed80cc630 0x7f2ed80c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193153101 0 0) 0x7f2ed80ccad0 con 0x7f2ed80b0a50 2023-10-06T02:59:49.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec0003570 con 0x7f2ed80b0a50 2023-10-06T02:59:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2516862895 0 0) 0x7f2ec0003570 con 0x7f2ed80b0a50 2023-10-06T02:59:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed80cc630 msgr2=0x7f2ed80c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed80cc630 0x7f2ed80c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 >> v2:172.21.15.131:3300/0 conn(0x7f2ed80b0680 msgr2=0x7f2ed80ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 --2- 172.21.15.84:0/1296308850 >> v2:172.21.15.131:3300/0 conn(0x7f2ed80b0680 0x7f2ed80ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80ccd40 con 0x7f2ed80b0a50 2023-10-06T02:59:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f2ecc001470 con 0x7f2ed80b0a50 2023-10-06T02:59:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 >> v1:172.21.15.84:6789/0 conn(0x7f2ed80b0a50 legacy=0x7f2ed80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0003a60 0x7f2ec0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed80cc630 0x7f2ec0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec0004d50 0x7f2ec00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80ca7d0 con 0x7f2ec0004d50 2023-10-06T02:59:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80c5400 con 0x7f2ec0003a60 2023-10-06T02:59:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec000ba60 con 0x7f2ed80cc630 2023-10-06T02:59:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2edcee7700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec0004d50 0x7f2ec00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed7fff700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0003a60 0x7f2ec0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed77fe700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed80cc630 0x7f2ec0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2edcee7700 1 -- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed80cc630 msgr2=0x7f2ec0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2edcee7700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed80cc630 0x7f2ec0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2edcee7700 1 -- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0003a60 msgr2=0x7f2ec0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2edcee7700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ec0003a60 0x7f2ec0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2edcee7700 1 -- 172.21.15.84:0/1296308850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0003570 con 0x7f2ec0004d50 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2ed77fe700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed80cc630 0x7f2ec0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.720+0000 7f2edcee7700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec0004d50 0x7f2ec00051c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000e210 tx=0x7f2ed000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76e312f4909041c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000ea60 con 0x7f2ec0004d50 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed000f040 con 0x7f2ec0004d50 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2ed6ffd700 1 -- 172.21.15.84:0/1296308850 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000ee10 con 0x7f2ec0004d50 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2ede94a700 1 -- 172.21.15.84:0/1296308850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec0004d50 msgr2=0x7f2ec00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2ede94a700 1 --2- 172.21.15.84:0/1296308850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec0004d50 0x7f2ec00051c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000e210 tx=0x7f2ed000b040 comp rx=0 tx=0).stop 2023-10-06T02:59:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2edcee7700 1 -- 172.21.15.84:0/1296308850 reap_dead start 2023-10-06T02:59:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2ede94a700 1 -- 172.21.15.84:0/1296308850 shutdown_connections 2023-10-06T02:59:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2ede94a700 1 -- 172.21.15.84:0/1296308850 >> 172.21.15.84:0/1296308850 conn(0x7f2ed8088000 msgr2=0x7f2ed80ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2ede94a700 1 -- 172.21.15.84:0/1296308850 shutdown_connections 2023-10-06T02:59:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.721+0000 7f2ede94a700 1 -- 172.21.15.84:0/1296308850 wait complete. 2023-10-06T02:59:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.722+0000 7f2ede94a700 1 Processor -- start 2023-10-06T02:59:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.722+0000 7f2ede94a700 1 -- start start 2023-10-06T02:59:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ede94a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed814ad00 0x7f2ed8069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ede94a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed814b0d0 0x7f2ed815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ede94a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed815c9f0 0x7f2ed80af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ede94a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80694e0 con 0x7f2ed814b0d0 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ede94a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80697c0 con 0x7f2ed814ad00 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ede94a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed815a830 con 0x7f2ed815c9f0 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed814b0d0 0x7f2ed815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed814b0d0 0x7f2ed815c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57710/0 (socket says 172.21.15.84:57710) 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ed77fe700 1 -- 172.21.15.84:0/3263689145 learned_addr learned my addr 172.21.15.84:0/3263689145 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2ed7fff700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed814ad00 0x7f2ed8069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.723+0000 7f2edcee7700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed815c9f0 0x7f2ed80af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ed77fe700 1 -- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed815c9f0 msgr2=0x7f2ed80af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ed77fe700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed815c9f0 0x7f2ed80af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ed77fe700 1 -- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed814ad00 msgr2=0x7f2ed8069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ed77fe700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed814ad00 0x7f2ed8069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ed77fe700 1 -- 172.21.15.84:0/3263689145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed815ab10 con 0x7f2ed814b0d0 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2edcee7700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed815c9f0 0x7f2ed80af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ed7fff700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed814ad00 0x7f2ed8069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ed77fe700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed814b0d0 0x7f2ed815c4b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc001ed0 tx=0x7f2ecc001110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ebffff700 1 -- 172.21.15.84:0/3263689145 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00a760 con 0x7f2ed814b0d0 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ebffff700 1 -- 172.21.15.84:0/3263689145 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc010040 con 0x7f2ed814b0d0 2023-10-06T02:59:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed815adf0 con 0x7f2ed814b0d0 2023-10-06T02:59:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ebffff700 1 -- 172.21.15.84:0/3263689145 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00ab10 con 0x7f2ed814b0d0 2023-10-06T02:59:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.724+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed80af7f0 con 0x7f2ed814b0d0 2023-10-06T02:59:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.725+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8064ad0 con 0x7f2ed814b0d0 2023-10-06T02:59:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.725+0000 7f2ebffff700 1 -- 172.21.15.84:0/3263689145 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ecc0143f0 con 0x7f2ed814b0d0 2023-10-06T02:59:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.726+0000 7f2ebffff700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2ec4066f30 0x7f2ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.726+0000 7f2ebffff700 1 -- 172.21.15.84:0/3263689145 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f2ecc083af0 con 0x7f2ed814b0d0 2023-10-06T02:59:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.726+0000 7f2ed7fff700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2ec4066f30 0x7f2ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.726+0000 7f2ed7fff700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2ec4066f30 0x7f2ec40693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8006ea0 tx=0x7f2ec8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.730+0000 7f2ebffff700 1 -- 172.21.15.84:0/3263689145 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ecc04d5a0 con 0x7f2ed814b0d0 2023-10-06T02:59:49.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.912+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2ed8069900 con 0x7f2ed814b0d0 2023-10-06T02:59:49.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.915+0000 7f2ebffff700 1 -- 172.21.15.84:0/3263689145 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2ecc019070 con 0x7f2ed814b0d0 2023-10-06T02:59:49.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.917+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2ec4066f30 msgr2=0x7f2ec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.917+0000 7f2ede94a700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2ec4066f30 0x7f2ec40693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8006ea0 tx=0x7f2ec8008040 comp rx=0 tx=0).stop 2023-10-06T02:59:49.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.917+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed814b0d0 msgr2=0x7f2ed815c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:49.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.917+0000 7f2ede94a700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed814b0d0 0x7f2ed815c4b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc001ed0 tx=0x7f2ecc001110 comp rx=0 tx=0).stop 2023-10-06T02:59:49.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.917+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 shutdown_connections 2023-10-06T02:59:49.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.917+0000 7f2ede94a700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2ec4066f30 0x7f2ec40693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.917+0000 7f2ede94a700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ed814ad00 0x7f2ed8069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.917+0000 7f2ede94a700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ed815c9f0 0x7f2ed80af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.917+0000 7f2ede94a700 1 --2- 172.21.15.84:0/3263689145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ed814b0d0 0x7f2ed815c4b0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:49.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.918+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 >> 172.21.15.84:0/3263689145 conn(0x7f2ed8088000 msgr2=0x7f2ed8156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:49.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.918+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 shutdown_connections 2023-10-06T02:59:49.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:49.918+0000 7f2ede94a700 1 -- 172.21.15.84:0/3263689145 wait complete. 2023-10-06T02:59:49.931 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T02:59:49.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:59:49.972 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T02:59:50.021 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T02:59:50.021 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T02:59:50.021 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:59:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.133+0000 7f5a12aeb700 1 Processor -- start 2023-10-06T02:59:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.133+0000 7f5a12aeb700 1 -- start start 2023-10-06T02:59:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a12aeb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5a0c0ad730 0x7f5a0c068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a12aeb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a0c068b40 0x7f5a0c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a12aeb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0c0ac980 con 0x7f5a0c0ad360 2023-10-06T02:59:50.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a12aeb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0c068f80 con 0x7f5a0c068b40 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a12aeb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0c159f80 con 0x7f5a0c0ad730 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a11088700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a0c068b40 0x7f5a0c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a10887700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5a0c0ad360 0x7f5a0c0ac270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56622/0 (socket says 172.21.15.84:56622) 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a10887700 1 -- 172.21.15.84:0/2195679901 learned_addr learned my addr 172.21.15.84:0/2195679901 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a03fff700 1 --2- 172.21.15.84:0/2195679901 >> v2:172.21.15.131:3300/0 conn(0x7f5a0c0ad730 0x7f5a0c068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a11088700 1 -- 172.21.15.84:0/2195679901 >> v2:172.21.15.131:3300/0 conn(0x7f5a0c0ad730 msgr2=0x7f5a0c068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a11088700 1 --2- 172.21.15.84:0/2195679901 >> v2:172.21.15.131:3300/0 conn(0x7f5a0c0ad730 0x7f5a0c068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a11088700 1 -- 172.21.15.84:0/2195679901 >> v1:172.21.15.84:6789/0 conn(0x7f5a0c0ad360 legacy=0x7f5a0c0ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a037fe700 1 -- 172.21.15.84:0/2195679901 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054806668 0 0) 0x7f5a0c0ac980 con 0x7f5a0c0ad360 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.134+0000 7f5a11088700 1 -- 172.21.15.84:0/2195679901 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c15a260 con 0x7f5a0c068b40 2023-10-06T02:59:50.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a03fff700 1 --2- 172.21.15.84:0/2195679901 >> v2:172.21.15.131:3300/0 conn(0x7f5a0c0ad730 0x7f5a0c068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a11088700 1 --2- 172.21.15.84:0/2195679901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 0x7f5a0c15b090 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c06e980 tx=0x7f5a040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e99dfaf95f219eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a037fe700 1 -- 172.21.15.84:0/2195679901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400b6b0 con 0x7f5a0c068b40 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a037fe700 1 -- 172.21.15.84:0/2195679901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0400b810 con 0x7f5a0c068b40 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a037fe700 1 -- 172.21.15.84:0/2195679901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400bbb0 con 0x7f5a0c068b40 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a12aeb700 1 -- 172.21.15.84:0/2195679901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 msgr2=0x7f5a0c15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a12aeb700 1 --2- 172.21.15.84:0/2195679901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 0x7f5a0c15b090 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c06e980 tx=0x7f5a040091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a12aeb700 1 -- 172.21.15.84:0/2195679901 shutdown_connections 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a12aeb700 1 --2- 172.21.15.84:0/2195679901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 0x7f5a0c15b090 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a12aeb700 1 --2- 172.21.15.84:0/2195679901 >> v2:172.21.15.131:3300/0 conn(0x7f5a0c0ad730 0x7f5a0c068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a12aeb700 1 -- 172.21.15.84:0/2195679901 >> 172.21.15.84:0/2195679901 conn(0x7f5a0c06dd10 msgr2=0x7f5a0c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a12aeb700 1 -- 172.21.15.84:0/2195679901 shutdown_connections 2023-10-06T02:59:50.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.135+0000 7f5a12aeb700 1 -- 172.21.15.84:0/2195679901 wait complete. 2023-10-06T02:59:50.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.136+0000 7f5a12aeb700 1 Processor -- start 2023-10-06T02:59:50.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.137+0000 7f5a12aeb700 1 -- start start 2023-10-06T02:59:50.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.137+0000 7f5a12aeb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 0x7f5a0c141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.137+0000 7f5a12aeb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a0c0ad360 0x7f5a0c153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.137+0000 7f5a12aeb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a0c0ad730 0x7f5a0c153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.137+0000 7f5a12aeb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c141960 con 0x7f5a0c068b40 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.137+0000 7f5a12aeb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0c9bc0 con 0x7f5a0c0ad730 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.137+0000 7f5a12aeb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0c8b20 con 0x7f5a0c0ad360 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.137+0000 7f5a10887700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 0x7f5a0c141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a10887700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 0x7f5a0c141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57728/0 (socket says 172.21.15.84:57728) 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a10887700 1 -- 172.21.15.84:0/3791270052 learned_addr learned my addr 172.21.15.84:0/3791270052 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a11088700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a0c0ad730 0x7f5a0c153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a03fff700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a0c0ad360 0x7f5a0c153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a10887700 1 -- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a0c0ad360 msgr2=0x7f5a0c153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a10887700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a0c0ad360 0x7f5a0c153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a10887700 1 -- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a0c0ad730 msgr2=0x7f5a0c153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a10887700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a0c0ad730 0x7f5a0c153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a10887700 1 -- 172.21.15.84:0/3791270052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04009420 con 0x7f5a0c068b40 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a03fff700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a0c0ad360 0x7f5a0c153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a11088700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a0c0ad730 0x7f5a0c153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a10887700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 0x7f5a0c141420 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800cd80 tx=0x7f5a08001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a00ff9700 1 -- 172.21.15.84:0/3791270052 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0800ab10 con 0x7f5a0c068b40 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a00ff9700 1 -- 172.21.15.84:0/3791270052 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0800ac70 con 0x7f5a0c068b40 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0c0c8e00 con 0x7f5a0c068b40 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a00ff9700 1 -- 172.21.15.84:0/3791270052 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a080070f0 con 0x7f5a0c068b40 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.138+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0c0c93c0 con 0x7f5a0c068b40 2023-10-06T02:59:50.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.139+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0c064ad0 con 0x7f5a0c068b40 2023-10-06T02:59:50.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.139+0000 7f5a00ff9700 1 -- 172.21.15.84:0/3791270052 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a080074e0 con 0x7f5a0c068b40 2023-10-06T02:59:50.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.140+0000 7f5a00ff9700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f59f8066f30 0x7f59f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.140+0000 7f5a00ff9700 1 -- 172.21.15.84:0/3791270052 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f5a08084ad0 con 0x7f5a0c068b40 2023-10-06T02:59:50.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.140+0000 7f5a03fff700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f59f8066f30 0x7f59f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.140+0000 7f5a03fff700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f59f8066f30 0x7f59f80693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f59fc006fd0 tx=0x7f59fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.144+0000 7f5a00ff9700 1 -- 172.21.15.84:0/3791270052 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a08051d70 con 0x7f5a0c068b40 2023-10-06T02:59:50.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.369+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a0c04bb80 con 0x7f5a0c068b40 2023-10-06T02:59:50.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.370+0000 7f5a00ff9700 1 -- 172.21.15.84:0/3791270052 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f5a08055390 con 0x7f5a0c068b40 2023-10-06T02:59:50.372 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:50.372 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5564,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/156975736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":156975736},{"type":"v1","addr":"172.21.15.131:6834","nonce":156975736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/4208675692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":4208675692},{"type":"v1","addr":"172.21.15.131:6835","nonce":4208675692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3594181673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3594181673},{"type":"v1","addr":"172.21.15.84:6835","nonce":3594181673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7128,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/248830153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":248830153},{"type":"v1","addr":"172.21.15.84:6837","nonce":248830153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[]} 2023-10-06T02:59:50.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f59f8066f30 msgr2=0x7f59f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f59f8066f30 0x7f59f80693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f59fc006fd0 tx=0x7f59fc008040 comp rx=0 tx=0).stop 2023-10-06T02:59:50.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 msgr2=0x7f5a0c141420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 0x7f5a0c141420 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800cd80 tx=0x7f5a08001ae0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 shutdown_connections 2023-10-06T02:59:50.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f59f8066f30 0x7f59f80693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a0c0ad730 0x7f5a0c153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a0c068b40 0x7f5a0c141420 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 --2- 172.21.15.84:0/3791270052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a0c0ad360 0x7f5a0c153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 >> 172.21.15.84:0/3791270052 conn(0x7f5a0c06dd10 msgr2=0x7f5a0c0a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 shutdown_connections 2023-10-06T02:59:50.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.372+0000 7f5a12aeb700 1 -- 172.21.15.84:0/3791270052 wait complete. 2023-10-06T02:59:50.376 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 63 2023-10-06T02:59:50.386 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T02:59:50.386 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T02:59:50.386 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T02:59:50.386 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:59:50.387 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T02:59:50.387 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T02:59:50.387 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T02:59:50.387 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:59:50.387 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T02:59:50.387 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T02:59:50.388 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T02:59:50.388 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:59:50.388 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T02:59:50.388 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T02:59:50.388 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T02:59:50.388 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T02:59:50.395 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T02:59:50.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T02:59:50.396 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T02:59:50.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T02:59:50.399 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T02:59:50.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T02:59:50.400 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T02:59:50.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T02:59:50.438 INFO:tasks.ceph.mds.a:Started 2023-10-06T02:59:50.439 DEBUG:teuthology.parallel:result is None 2023-10-06T02:59:50.439 INFO:tasks.ceph.mds.c:Started 2023-10-06T02:59:50.440 DEBUG:teuthology.parallel:result is None 2023-10-06T02:59:50.442 INFO:tasks.ceph.mds.b:Started 2023-10-06T02:59:50.442 DEBUG:teuthology.parallel:result is None 2023-10-06T02:59:50.443 INFO:tasks.ceph.mds.d:Started 2023-10-06T02:59:50.443 DEBUG:teuthology.parallel:result is None 2023-10-06T02:59:50.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T02:59:50.510 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T02:59:50.510 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T02:59:50.521 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T02:59:50.521 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T02:59:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.562+0000 7ff9670e2700 1 Processor -- start 2023-10-06T02:59:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.562+0000 7ff9670e2700 1 -- start start 2023-10-06T02:59:50.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.563+0000 7ff9670e2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9600ca3b0 0x7ff9601582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.563+0000 7ff9670e2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ce8e0 0x7ff96015af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.563+0000 7ff9670e2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff960157e20 con 0x7ff9600adba0 2023-10-06T02:59:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.563+0000 7ff9670e2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9600cbbd0 con 0x7ff9600ca3b0 2023-10-06T02:59:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.563+0000 7ff9670e2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600cb610 con 0x7ff9600ce8e0 2023-10-06T02:59:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.563+0000 7ff964e7e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9600ca3b0 0x7ff9601582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.563+0000 7ff957fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff9600adba0 0x7ff9600ce1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:56626/0 (socket says 172.21.15.84:56626) 2023-10-06T02:59:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.563+0000 7ff957fff700 1 -- 172.21.15.84:0/534020139 learned_addr learned my addr 172.21.15.84:0/534020139 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff96567f700 1 --2- 172.21.15.84:0/534020139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ce8e0 0x7ff96015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff964e7e700 1 -- 172.21.15.84:0/534020139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ce8e0 msgr2=0x7ff96015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff964e7e700 1 --2- 172.21.15.84:0/534020139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ce8e0 0x7ff96015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff964e7e700 1 -- 172.21.15.84:0/534020139 >> v1:172.21.15.84:6789/0 conn(0x7ff9600adba0 legacy=0x7ff9600ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff9577fe700 1 -- 172.21.15.84:0/534020139 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228529128 0 0) 0x7ff960157e20 con 0x7ff9600adba0 2023-10-06T02:59:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff964e7e700 1 -- 172.21.15.84:0/534020139 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600cb8f0 con 0x7ff9600ca3b0 2023-10-06T02:59:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff964e7e700 1 --2- 172.21.15.84:0/534020139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600ca3b0 0x7ff9601582b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0098e0 tx=0x7ff95c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97972596a9ef89b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff9577fe700 1 -- 172.21.15.84:0/534020139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c009e80 con 0x7ff9600ca3b0 2023-10-06T02:59:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff9577fe700 1 -- 172.21.15.84:0/534020139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c00b860 con 0x7ff9600ca3b0 2023-10-06T02:59:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff9577fe700 1 -- 172.21.15.84:0/534020139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00bbe0 con 0x7ff9600ca3b0 2023-10-06T02:59:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff9670e2700 1 -- 172.21.15.84:0/534020139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600ca3b0 msgr2=0x7ff9601582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.564+0000 7ff9670e2700 1 --2- 172.21.15.84:0/534020139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600ca3b0 0x7ff9601582b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0098e0 tx=0x7ff95c0091a0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.565+0000 7ff9670e2700 1 -- 172.21.15.84:0/534020139 shutdown_connections 2023-10-06T02:59:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.565+0000 7ff9670e2700 1 --2- 172.21.15.84:0/534020139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ce8e0 0x7ff96015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.565+0000 7ff9670e2700 1 --2- 172.21.15.84:0/534020139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600ca3b0 0x7ff9601582b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.565+0000 7ff9670e2700 1 -- 172.21.15.84:0/534020139 >> 172.21.15.84:0/534020139 conn(0x7ff960070810 msgr2=0x7ff960070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.565+0000 7ff9670e2700 1 -- 172.21.15.84:0/534020139 shutdown_connections 2023-10-06T02:59:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.565+0000 7ff9670e2700 1 -- 172.21.15.84:0/534020139 wait complete. 2023-10-06T02:59:50.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.566+0000 7ff9670e2700 1 Processor -- start 2023-10-06T02:59:50.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.566+0000 7ff9670e2700 1 -- start start 2023-10-06T02:59:50.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.566+0000 7ff9670e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600adba0 0x7ff960153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff9670e2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ca3b0 0x7ff9601542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff9670e2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9600ce8e0 0x7ff9601520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff9670e2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600c2d70 con 0x7ff9600adba0 2023-10-06T02:59:50.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff9670e2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600cdb60 con 0x7ff9600ce8e0 2023-10-06T02:59:50.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff964e7e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600adba0 0x7ff960153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff9670e2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600c2560 con 0x7ff9600ca3b0 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff964e7e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600adba0 0x7ff960153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57760/0 (socket says 172.21.15.84:57760) 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff964e7e700 1 -- 172.21.15.84:0/783535701 learned_addr learned my addr 172.21.15.84:0/783535701 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff957fff700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ca3b0 0x7ff9601542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff96567f700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9600ce8e0 0x7ff9601520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff964e7e700 1 -- 172.21.15.84:0/783535701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ca3b0 msgr2=0x7ff9601542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff964e7e700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ca3b0 0x7ff9601542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff964e7e700 1 -- 172.21.15.84:0/783535701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9600ce8e0 msgr2=0x7ff9601520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff964e7e700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9600ce8e0 0x7ff9601520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff964e7e700 1 -- 172.21.15.84:0/783535701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009420 con 0x7ff9600adba0 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff96567f700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9600ce8e0 0x7ff9601520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff964e7e700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600adba0 0x7ff960153d80 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00b3c0 tx=0x7ff95c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff954ff9700 1 -- 172.21.15.84:0/783535701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00b9d0 con 0x7ff9600adba0 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff954ff9700 1 -- 172.21.15.84:0/783535701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c00bb50 con 0x7ff9600adba0 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9600b1560 con 0x7ff9600adba0 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff954ff9700 1 -- 172.21.15.84:0/783535701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c025670 con 0x7ff9600adba0 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.567+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9600c2a90 con 0x7ff9600adba0 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.568+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff960064ad0 con 0x7ff9600adba0 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.569+0000 7ff954ff9700 1 -- 172.21.15.84:0/783535701 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff95c023070 con 0x7ff9600adba0 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.569+0000 7ff954ff9700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff94c066f30 0x7ff94c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.569+0000 7ff957fff700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff94c066f30 0x7ff94c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.569+0000 7ff954ff9700 1 -- 172.21.15.84:0/783535701 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5784+0+0 (secure 0 0 0) 0x7ff95c085b40 con 0x7ff9600adba0 2023-10-06T02:59:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.569+0000 7ff957fff700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff94c066f30 0x7ff94c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff960153120 tx=0x7ff950007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:50.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.573+0000 7ff954ff9700 1 -- 172.21.15.84:0/783535701 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff95c052d60 con 0x7ff9600adba0 2023-10-06T02:59:50.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-06T02:59:50.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-06T02:59:50.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T02:59:50.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-06T02:59:50.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:50.778+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff960157ab0 con 0x7ff9600adba0 2023-10-06T02:59:51.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.602+0000 7ff954ff9700 1 -- 172.21.15.84:0/783535701 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v78) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff95c015080 con 0x7ff9600adba0 2023-10-06T02:59:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff94c066f30 msgr2=0x7ff94c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff94c066f30 0x7ff94c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff960153120 tx=0x7ff950007f50 comp rx=0 tx=0).stop 2023-10-06T02:59:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600adba0 msgr2=0x7ff960153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600adba0 0x7ff960153d80 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00b3c0 tx=0x7ff95c017000 comp rx=0 tx=0).stop 2023-10-06T02:59:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 shutdown_connections 2023-10-06T02:59:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff94c066f30 0x7ff94c0693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9600ce8e0 0x7ff9601520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9600adba0 0x7ff960153d80 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 --2- 172.21.15.84:0/783535701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9600ca3b0 0x7ff9601542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 >> 172.21.15.84:0/783535701 conn(0x7ff960070810 msgr2=0x7ff9601534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 shutdown_connections 2023-10-06T02:59:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.604+0000 7ff9670e2700 1 -- 172.21.15.84:0/783535701 wait complete. 2023-10-06T02:59:51.607 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T02:59:51.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.732+0000 7fd12f99a700 1 Processor -- start 2023-10-06T02:59:51.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.732+0000 7fd12f99a700 1 -- start start 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12f99a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd1281595a0 0x7fd1280aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12f99a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1280b49e0 0x7fd1280aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12f99a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1280b0ca0 con 0x7fd1280b07a0 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12f99a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280b0f80 con 0x7fd1281595a0 2023-10-06T02:59:51.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12f99a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280b1260 con 0x7fd1280b49e0 2023-10-06T02:59:51.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12cf35700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1280b49e0 0x7fd1280aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12d736700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd1281595a0 0x7fd1280aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12cf35700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1280b49e0 0x7fd1280aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:53066/0 (socket says 172.21.15.84:53066) 2023-10-06T02:59:51.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12cf35700 1 -- 172.21.15.84:0/24422180 learned_addr learned my addr 172.21.15.84:0/24422180 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:51.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12cf35700 1 -- 172.21.15.84:0/24422180 >> v2:172.21.15.131:3300/0 conn(0x7fd1281595a0 msgr2=0x7fd1280aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:51.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12cf35700 1 --2- 172.21.15.84:0/24422180 >> v2:172.21.15.131:3300/0 conn(0x7fd1281595a0 0x7fd1280aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12cf35700 1 -- 172.21.15.84:0/24422180 >> v1:172.21.15.131:6789/0 conn(0x7fd1280b07a0 legacy=0x7fd1280b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.733+0000 7fd12cf35700 1 -- 172.21.15.84:0/24422180 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280b1540 con 0x7fd1280b49e0 2023-10-06T02:59:51.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd12cf35700 1 --2- 172.21.15.84:0/24422180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1280b49e0 0x7fd1280aaab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0099b0 tx=0x7fd11c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dfd00d1428de1e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd127fff700 1 -- 172.21.15.84:0/24422180 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c009ea0 con 0x7fd1280b49e0 2023-10-06T02:59:51.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd127fff700 1 -- 172.21.15.84:0/24422180 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c00b860 con 0x7fd1280b49e0 2023-10-06T02:59:51.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd127fff700 1 -- 172.21.15.84:0/24422180 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00bc00 con 0x7fd1280b49e0 2023-10-06T02:59:51.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd12f99a700 1 -- 172.21.15.84:0/24422180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1280b49e0 msgr2=0x7fd1280aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd12f99a700 1 --2- 172.21.15.84:0/24422180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1280b49e0 0x7fd1280aaab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0099b0 tx=0x7fd11c009250 comp rx=0 tx=0).stop 2023-10-06T02:59:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd12f99a700 1 -- 172.21.15.84:0/24422180 shutdown_connections 2023-10-06T02:59:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd12f99a700 1 --2- 172.21.15.84:0/24422180 >> v2:172.21.15.131:3300/0 conn(0x7fd1281595a0 0x7fd1280aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd12f99a700 1 --2- 172.21.15.84:0/24422180 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1280b49e0 0x7fd1280aaab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd12f99a700 1 -- 172.21.15.84:0/24422180 >> 172.21.15.84:0/24422180 conn(0x7fd128099830 msgr2=0x7fd12806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd12f99a700 1 -- 172.21.15.84:0/24422180 shutdown_connections 2023-10-06T02:59:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.734+0000 7fd12f99a700 1 -- 172.21.15.84:0/24422180 wait complete. 2023-10-06T02:59:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.736+0000 7fd12f99a700 1 Processor -- start 2023-10-06T02:59:51.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.736+0000 7fd12f99a700 1 -- start start 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.736+0000 7fd12f99a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1280b07a0 0x7fd12814cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.736+0000 7fd12f99a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1280b49e0 0x7fd128153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.736+0000 7fd12f99a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1281595a0 0x7fd128152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.736+0000 7fd12f99a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128154be0 con 0x7fd1280b49e0 2023-10-06T02:59:51.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.736+0000 7fd12f99a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12814d7e0 con 0x7fd1280b07a0 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.736+0000 7fd12f99a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd128152890 con 0x7fd1281595a0 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12cf35700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1280b49e0 0x7fd128153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12cf35700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1280b49e0 0x7fd128153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57774/0 (socket says 172.21.15.84:57774) 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12cf35700 1 -- 172.21.15.84:0/896356221 learned_addr learned my addr 172.21.15.84:0/896356221 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12d736700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1280b07a0 0x7fd12814cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12df37700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1281595a0 0x7fd128152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12cf35700 1 -- 172.21.15.84:0/896356221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1281595a0 msgr2=0x7fd128152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12cf35700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1281595a0 0x7fd128152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12cf35700 1 -- 172.21.15.84:0/896356221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1280b07a0 msgr2=0x7fd12814cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:51.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12cf35700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1280b07a0 0x7fd12814cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12cf35700 1 -- 172.21.15.84:0/896356221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c0094f0 con 0x7fd1280b49e0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12cf35700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1280b49e0 0x7fd128153cb0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fd11c006fd0 tx=0x7fd11c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd1257fa700 1 -- 172.21.15.84:0/896356221 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c000d10 con 0x7fd1280b49e0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd1257fa700 1 -- 172.21.15.84:0/896356221 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c00bbe0 con 0x7fd1280b49e0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd1257fa700 1 -- 172.21.15.84:0/896356221 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c011670 con 0x7fd1280b49e0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd128154340 con 0x7fd1280b49e0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.737+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd128154900 con 0x7fd1280b49e0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.738+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12814d5b0 con 0x7fd1280b49e0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.739+0000 7fd1257fa700 1 -- 172.21.15.84:0/896356221 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd11c011a60 con 0x7fd1280b49e0 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.739+0000 7fd1257fa700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd114066f30 0x7fd1140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:51.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.739+0000 7fd1257fa700 1 -- 172.21.15.84:0/896356221 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd11c085cc0 con 0x7fd1280b49e0 2023-10-06T02:59:51.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.739+0000 7fd12d736700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd114066f30 0x7fd1140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:51.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.739+0000 7fd12d736700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd114066f30 0x7fd1140693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd12000f510 tx=0x7fd12000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:51.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.743+0000 7fd1257fa700 1 -- 172.21.15.84:0/896356221 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd12814d5b0 con 0x7fd1280b49e0 2023-10-06T02:59:51.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.996+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd12814d5b0 con 0x7fd1280b49e0 2023-10-06T02:59:51.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.996+0000 7fd1257fa700 1 -- 172.21.15.84:0/896356221 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd12814d5b0 con 0x7fd1280b49e0 2023-10-06T02:59:51.998 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:51.998 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T02:59:51.998 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lFrNmJBAAeVhw9betN9snqLPgSK9efw==", 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:51.999 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lbi6hLxAAICzxeAsbJ5rhbyMBkPcrAQ==", 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T02:59:52.000 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lSCo1KxAAuETY4PeWDJS3bGzqTpHLpQ==", 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lvPxyNhAAKlqBTG/Fr8/2Rf+lcGQxIg==", 2023-10-06T02:59:52.001 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDUdh9lV3sRIRAAoUtG7F6EMyew6CX3NaNufw==", 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDXdh9ls5OxHhAAanGTRmjW75UAwrqzL0CIdw==", 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:59:52.003 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDadh9lQeJTHhAAFeayQY1F10UDCck78/ja4w==", 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDddh9l+cx8HhAAeAcoLzCUiCC+9O+WZYYTsA==", 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDjdh9lA4upJxAAdFHhR2/rMyG2NbQEu7JpLw==", 2023-10-06T02:59:52.005 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDmdh9lOGETJRAA7nLtgcumxqfum8cirnbaRA==", 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:59:52.006 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDpdh9lSbDhJBAAnMWhjKSKYcLaZeRk9drdgA==", 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDsdh9lImOeIhAAPUO3jy2/cPZW+eKukBywcw==", 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.008 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lRRw/OhAAwavsq3e0HeVF3/G4SX0v+A==", 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lftv/BhAAo8sb1EG96nHv77bn3af/dg==", 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.009 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lxOX6AxAAWDpHCodRcEc2/YF5yqnkQg==", 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:59:52.010 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lheJnDBAAqAQeFxMQ9Qv108TLz65mVw==", 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T02:59:52.011 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9l8qZuCBAArPoeoGgydlQPFp7XYwI9KQ==", 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9ly2pdIRAAX7YmT9B/MzoD8xJH347ruQ==", 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:52.013 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T02:59:52.014 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lW/KSHBAAEvgj/BAe20tCp8uwBEIVbA==", 2023-10-06T02:59:52.014 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T02:59:52.014 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T02:59:52.014 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T02:59:52.014 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T02:59:52.014 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.014 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:52.014 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T02:59:52.014 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T02:59:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd114066f30 msgr2=0x7fd1140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd114066f30 0x7fd1140693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd12000f510 tx=0x7fd12000b040 comp rx=0 tx=0).stop 2023-10-06T02:59:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1280b49e0 msgr2=0x7fd128153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1280b49e0 0x7fd128153cb0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fd11c006fd0 tx=0x7fd11c017000 comp rx=0 tx=0).stop 2023-10-06T02:59:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 shutdown_connections 2023-10-06T02:59:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd114066f30 0x7fd1140693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1280b07a0 0x7fd12814cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1281595a0 0x7fd128152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 --2- 172.21.15.84:0/896356221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1280b49e0 0x7fd128153cb0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 >> 172.21.15.84:0/896356221 conn(0x7fd128099830 msgr2=0x7fd128069060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:52.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 shutdown_connections 2023-10-06T02:59:52.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:51.998+0000 7fd12f99a700 1 -- 172.21.15.84:0/896356221 wait complete. 2023-10-06T02:59:52.017 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.129+0000 7f4f85a59700 1 Processor -- start 2023-10-06T02:59:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.129+0000 7f4f85a59700 1 -- start start 2023-10-06T02:59:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f85a59700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4f800afc60 0x7f4f800b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f85a59700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f800ce000 0x7f4f800cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f85a59700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800cc230 0x7f4f80156e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f85a59700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f800cd300 con 0x7f4f800ce000 2023-10-06T02:59:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f85a59700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f800cc6f0 con 0x7f4f800afc60 2023-10-06T02:59:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f85a59700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800cc9d0 con 0x7f4f800cc230 2023-10-06T02:59:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f7ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f800ce000 0x7f4f800cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f7ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f800ce000 0x7f4f800cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57786/0 (socket says 172.21.15.84:57786) 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f7ffff700 1 -- 172.21.15.84:0/3693709849 learned_addr learned my addr 172.21.15.84:0/3693709849 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f85258700 1 --2- 172.21.15.84:0/3693709849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800cc230 0x7f4f80156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f84a57700 1 --2- 172.21.15.84:0/3693709849 >> v2:172.21.15.131:3300/0 conn(0x7f4f800afc60 0x7f4f800b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f7ffff700 1 -- 172.21.15.84:0/3693709849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800cc230 msgr2=0x7f4f80156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f7ffff700 1 --2- 172.21.15.84:0/3693709849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800cc230 0x7f4f80156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f7ffff700 1 -- 172.21.15.84:0/3693709849 >> v2:172.21.15.131:3300/0 conn(0x7f4f800afc60 msgr2=0x7f4f800b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f7ffff700 1 --2- 172.21.15.84:0/3693709849 >> v2:172.21.15.131:3300/0 conn(0x7f4f800afc60 0x7f4f800b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f7ffff700 1 -- 172.21.15.84:0/3693709849 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800cccb0 con 0x7f4f800ce000 2023-10-06T02:59:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.130+0000 7f4f7ffff700 1 --2- 172.21.15.84:0/3693709849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800ce000 0x7f4f800cbcf0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f4f800715e0 tx=0x7f4f6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1c18392087efcd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f7f7fe700 1 -- 172.21.15.84:0/3693709849 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00b860 con 0x7f4f800ce000 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f7f7fe700 1 -- 172.21.15.84:0/3693709849 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c00b9c0 con 0x7f4f800ce000 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f7f7fe700 1 -- 172.21.15.84:0/3693709849 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00bd60 con 0x7f4f800ce000 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f85a59700 1 -- 172.21.15.84:0/3693709849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800ce000 msgr2=0x7f4f800cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f85a59700 1 --2- 172.21.15.84:0/3693709849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800ce000 0x7f4f800cbcf0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f4f800715e0 tx=0x7f4f6c009250 comp rx=0 tx=0).stop 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f85a59700 1 -- 172.21.15.84:0/3693709849 shutdown_connections 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f85a59700 1 --2- 172.21.15.84:0/3693709849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800cc230 0x7f4f80156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f85a59700 1 --2- 172.21.15.84:0/3693709849 >> v2:172.21.15.131:3300/0 conn(0x7f4f800afc60 0x7f4f800b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f85a59700 1 --2- 172.21.15.84:0/3693709849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800ce000 0x7f4f800cbcf0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f85a59700 1 -- 172.21.15.84:0/3693709849 >> 172.21.15.84:0/3693709849 conn(0x7f4f800675f0 msgr2=0x7f4f800679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f85a59700 1 -- 172.21.15.84:0/3693709849 shutdown_connections 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.131+0000 7f4f85a59700 1 -- 172.21.15.84:0/3693709849 wait complete. 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.132+0000 7f4f85a59700 1 Processor -- start 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f85a59700 1 -- start start 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f85a59700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f800afc60 0x7f4f80153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f85a59700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800cc230 0x7f4f80147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f85a59700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800ce000 0x7f4f800ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f85a59700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800af830 con 0x7f4f800cc230 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f85a59700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80167d00 con 0x7f4f800afc60 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f85a59700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800af270 con 0x7f4f800ce000 2023-10-06T02:59:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800cc230 0x7f4f80147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800cc230 0x7f4f80147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57802/0 (socket says 172.21.15.84:57802) 2023-10-06T02:59:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f7ffff700 1 -- 172.21.15.84:0/1081837738 learned_addr learned my addr 172.21.15.84:0/1081837738 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f84a57700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f800afc60 0x7f4f80153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.133+0000 7f4f85258700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800ce000 0x7f4f800ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f7ffff700 1 -- 172.21.15.84:0/1081837738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800ce000 msgr2=0x7f4f800ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f7ffff700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800ce000 0x7f4f800ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f7ffff700 1 -- 172.21.15.84:0/1081837738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f800afc60 msgr2=0x7f4f80153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f7ffff700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f800afc60 0x7f4f80153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f7ffff700 1 -- 172.21.15.84:0/1081837738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0094f0 con 0x7f4f800cc230 2023-10-06T02:59:52.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f85258700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800ce000 0x7f4f800ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:52.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f7ffff700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800cc230 0x7f4f80147d20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4f8006dfd0 tx=0x7f4f6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f7cff9700 1 -- 172.21.15.84:0/1081837738 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c011e70 con 0x7f4f800cc230 2023-10-06T02:59:52.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f7cff9700 1 -- 172.21.15.84:0/1081837738 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c024440 con 0x7f4f800cc230 2023-10-06T02:59:52.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f7cff9700 1 -- 172.21.15.84:0/1081837738 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c024800 con 0x7f4f800cc230 2023-10-06T02:59:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f800af550 con 0x7f4f800cc230 2023-10-06T02:59:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.134+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f80167990 con 0x7f4f800cc230 2023-10-06T02:59:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.135+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f80167b20 con 0x7f4f800cc230 2023-10-06T02:59:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.135+0000 7f4f7cff9700 1 -- 172.21.15.84:0/1081837738 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f6c01a420 con 0x7f4f800cc230 2023-10-06T02:59:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.136+0000 7f4f7cff9700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f64066f30 0x7f4f640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.136+0000 7f4f7cff9700 1 -- 172.21.15.84:0/1081837738 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4f6c086370 con 0x7f4f800cc230 2023-10-06T02:59:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.136+0000 7f4f84a57700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f64066f30 0x7f4f640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.136+0000 7f4f84a57700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f64066f30 0x7f4f640693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f74006fd0 tx=0x7f4f74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.140+0000 7f4f7cff9700 1 -- 172.21.15.84:0/1081837738 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f6c053710 con 0x7f4f800cc230 2023-10-06T02:59:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.322+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f8005f270 con 0x7f4f800cc230 2023-10-06T02:59:52.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.323+0000 7f4f7cff9700 1 -- 172.21.15.84:0/1081837738 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+13856 (secure 0 0 0) 0x7f4f6c056d30 con 0x7f4f800cc230 2023-10-06T02:59:52.325 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:52.325 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":78,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:59:51.598224+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:52.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f64066f30 msgr2=0x7f4f640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f64066f30 0x7f4f640693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f74006fd0 tx=0x7f4f74008040 comp rx=0 tx=0).stop 2023-10-06T02:59:52.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800cc230 msgr2=0x7f4f80147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800cc230 0x7f4f80147d20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4f8006dfd0 tx=0x7f4f6c017000 comp rx=0 tx=0).stop 2023-10-06T02:59:52.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 shutdown_connections 2023-10-06T02:59:52.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f64066f30 0x7f4f640693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f800afc60 0x7f4f80153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f800ce000 0x7f4f800ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 --2- 172.21.15.84:0/1081837738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f800cc230 0x7f4f80147d20 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 >> 172.21.15.84:0/1081837738 conn(0x7f4f800675f0 msgr2=0x7f4f80153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:52.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 shutdown_connections 2023-10-06T02:59:52.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.325+0000 7f4f85a59700 1 -- 172.21.15.84:0/1081837738 wait complete. 2023-10-06T02:59:52.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T02:59:52.340 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T02:59:52.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.455+0000 7fd302512700 1 Processor -- start 2023-10-06T02:59:52.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.455+0000 7fd302512700 1 -- start start 2023-10-06T02:59:52.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.456+0000 7fd302512700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd2fc0cc630 0x7fd2fc162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.456+0000 7fd302512700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc0ccab0 con 0x7fd2fc0b0a50 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.456+0000 7fd302512700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc0c5400 con 0x7fd2fc0b0680 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.456+0000 7fd302512700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc0ca7d0 con 0x7fd2fc0cc630 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.456+0000 7fd2fb7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd2fc0b0a50 0x7fd2fc0cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41370/0 (socket says 172.21.15.84:41370) 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.456+0000 7fd2fb7fe700 1 -- 172.21.15.84:0/3218158926 learned_addr learned my addr 172.21.15.84:0/3218158926 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.456+0000 7fd300aaf700 1 --2- 172.21.15.84:0/3218158926 >> v2:172.21.15.131:3300/0 conn(0x7fd2fc0cc630 0x7fd2fc162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.456+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19263951 0 0) 0x7fd2fc0ccab0 con 0x7fd2fc0b0a50 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.456+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e4003570 con 0x7fd2fc0b0a50 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2569695527 0 0) 0x7fd2e4003570 con 0x7fd2fc0b0a50 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 >> v2:172.21.15.131:3300/0 conn(0x7fd2fc0cc630 msgr2=0x7fd2fc162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 --2- 172.21.15.84:0/3218158926 >> v2:172.21.15.131:3300/0 conn(0x7fd2fc0cc630 0x7fd2fc162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 >> v1:172.21.15.131:6789/0 conn(0x7fd2fc0b0680 legacy=0x7fd2fc0ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc0ccd40 con 0x7fd2fc0b0a50 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fd2f0001470 con 0x7fd2fc0b0a50 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 >> v1:172.21.15.84:6789/0 conn(0x7fd2fc0b0a50 legacy=0x7fd2fc0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2e4003a60 0x7fd2e4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2e4004810 0x7fd2e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e40051c0 0x7fd2e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0ca7d0 con 0x7fd2e4004810 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e400c0e0 con 0x7fd2e4003a60 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e400c2a0 con 0x7fd2e40051c0 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2fb7fe700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2e4004810 0x7fd2e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2fbfff700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2e4003a60 0x7fd2e4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd300aaf700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e40051c0 0x7fd2e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2fb7fe700 1 -- 172.21.15.84:0/3218158926 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e40051c0 msgr2=0x7fd2e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2fb7fe700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e40051c0 0x7fd2e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2fb7fe700 1 -- 172.21.15.84:0/3218158926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2e4003a60 msgr2=0x7fd2e4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2fb7fe700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2e4003a60 0x7fd2e4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2fb7fe700 1 -- 172.21.15.84:0/3218158926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4003570 con 0x7fd2e4004810 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd300aaf700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e40051c0 0x7fd2e400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd300aaf700 1 -- 172.21.15.84:0/3218158926 reap_dead start 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2fb7fe700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2e4004810 0x7fd2e4004c80 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000c3c0 tx=0x7fd2f0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1872288d7bf8e6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000cc90 con 0x7fd2e4004810 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f000cdf0 con 0x7fd2e4004810 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.457+0000 7fd2faffd700 1 -- 172.21.15.84:0/3218158926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0005b70 con 0x7fd2e4004810 2023-10-06T02:59:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.458+0000 7fd302512700 1 -- 172.21.15.84:0/3218158926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2e4004810 msgr2=0x7fd2e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.458+0000 7fd302512700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2e4004810 0x7fd2e4004c80 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd2f000c3c0 tx=0x7fd2f0001e70 comp rx=0 tx=0).stop 2023-10-06T02:59:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.458+0000 7fd302512700 1 -- 172.21.15.84:0/3218158926 shutdown_connections 2023-10-06T02:59:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.458+0000 7fd302512700 1 --2- 172.21.15.84:0/3218158926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2e4004810 0x7fd2e4004c80 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.458+0000 7fd302512700 1 -- 172.21.15.84:0/3218158926 >> 172.21.15.84:0/3218158926 conn(0x7fd2fc088000 msgr2=0x7fd2fc0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.458+0000 7fd302512700 1 -- 172.21.15.84:0/3218158926 shutdown_connections 2023-10-06T02:59:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.458+0000 7fd302512700 1 -- 172.21.15.84:0/3218158926 wait complete. 2023-10-06T02:59:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.459+0000 7fd302512700 1 Processor -- start 2023-10-06T02:59:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.459+0000 7fd302512700 1 -- start start 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd302512700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4004810 0x7fd2fc16ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd302512700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2fc168f50 0x7fd2fc168950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd302512700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2fc159670 0x7fd2fc15c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd302512700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0b1190 con 0x7fd2fc168f50 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd302512700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc159af0 con 0x7fd2fc159670 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd302512700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0b1430 con 0x7fd2e4004810 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2fc168f50 0x7fd2fc168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2fc168f50 0x7fd2fc168950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58228/0 (socket says 172.21.15.84:58228) 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fb7fe700 1 -- 172.21.15.84:0/2287858084 learned_addr learned my addr 172.21.15.84:0/2287858084 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fbfff700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4004810 0x7fd2fc16ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd300aaf700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2fc159670 0x7fd2fc15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fb7fe700 1 -- 172.21.15.84:0/2287858084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4004810 msgr2=0x7fd2fc16ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fb7fe700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4004810 0x7fd2fc16ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fb7fe700 1 -- 172.21.15.84:0/2287858084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2fc159670 msgr2=0x7fd2fc15c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fb7fe700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2fc159670 0x7fd2fc15c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fb7fe700 1 -- 172.21.15.84:0/2287858084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc0b1710 con 0x7fd2fc168f50 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fbfff700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4004810 0x7fd2fc16ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.460+0000 7fd2fb7fe700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2fc168f50 0x7fd2fc168950 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400c0b0 tx=0x7fd2f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.461+0000 7fd2e3fff700 1 -- 172.21.15.84:0/2287858084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0022070 con 0x7fd2fc168f50 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.461+0000 7fd2e3fff700 1 -- 172.21.15.84:0/2287858084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f0000fe0 con 0x7fd2fc168f50 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.461+0000 7fd2e3fff700 1 -- 172.21.15.84:0/2287858084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f000cc90 con 0x7fd2fc168f50 2023-10-06T02:59:52.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.461+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc0b19f0 con 0x7fd2fc168f50 2023-10-06T02:59:52.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.461+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc15c690 con 0x7fd2fc168f50 2023-10-06T02:59:52.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.461+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc0b1b80 con 0x7fd2fc168f50 2023-10-06T02:59:52.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.462+0000 7fd2e3fff700 1 -- 172.21.15.84:0/2287858084 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2f00075b0 con 0x7fd2fc168f50 2023-10-06T02:59:52.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.462+0000 7fd2e3fff700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd2e8066f30 0x7fd2e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.462+0000 7fd2e3fff700 1 -- 172.21.15.84:0/2287858084 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd2f0085500 con 0x7fd2fc168f50 2023-10-06T02:59:52.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.462+0000 7fd2fbfff700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd2e8066f30 0x7fd2e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.463+0000 7fd2fbfff700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd2e8066f30 0x7fd2e80693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc159050 tx=0x7fd2ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.467+0000 7fd2e3fff700 1 -- 172.21.15.84:0/2287858084 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2f0052820 con 0x7fd2fc168f50 2023-10-06T02:59:52.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.647+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2fc156130 con 0x7fd2fc168f50 2023-10-06T02:59:52.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.647+0000 7fd2e3fff700 1 -- 172.21.15.84:0/2287858084 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2f0055e40 con 0x7fd2fc168f50 2023-10-06T02:59:52.649 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T02:59:52.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd2e8066f30 msgr2=0x7fd2e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd2e8066f30 0x7fd2e80693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc159050 tx=0x7fd2ec009040 comp rx=0 tx=0).stop 2023-10-06T02:59:52.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2fc168f50 msgr2=0x7fd2fc168950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2fc168f50 0x7fd2fc168950 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400c0b0 tx=0x7fd2f0015000 comp rx=0 tx=0).stop 2023-10-06T02:59:52.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 shutdown_connections 2023-10-06T02:59:52.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd2e8066f30 0x7fd2e80693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2fc159670 0x7fd2fc15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2e4004810 0x7fd2fc16ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 --2- 172.21.15.84:0/2287858084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2fc168f50 0x7fd2fc168950 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 >> 172.21.15.84:0/2287858084 conn(0x7fd2fc088000 msgr2=0x7fd2fc0c7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:52.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 shutdown_connections 2023-10-06T02:59:52.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.649+0000 7fd302512700 1 -- 172.21.15.84:0/2287858084 wait complete. 2023-10-06T02:59:52.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T02:59:52.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.777+0000 7fccccc7a700 1 Processor -- start 2023-10-06T02:59:52.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.777+0000 7fccccc7a700 1 -- start start 2023-10-06T02:59:52.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccccc7a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fccc80b2660 0x7fccc80cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccccc7a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80cf1f0 0x7fccc80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccccc7a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc80cc9b0 con 0x7fccc80b2a30 2023-10-06T02:59:52.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccccc7a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc80cbda0 con 0x7fccc80b2660 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccccc7a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80cc080 con 0x7fccc80cf1f0 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccc7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80cf1f0 0x7fccc80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccc77fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fccc80b2660 0x7fccc80cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccc6ffd700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fccc80b2a30 0x7fccc80ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:58816/0 (socket says 172.21.15.84:58816) 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccc6ffd700 1 -- 172.21.15.84:0/2942847286 learned_addr learned my addr 172.21.15.84:0/2942847286 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccc67fc700 1 -- 172.21.15.84:0/2942847286 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551579424 0 0) 0x7fccc80cc9b0 con 0x7fccc80b2a30 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.778+0000 7fccc67fc700 1 -- 172.21.15.84:0/2942847286 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb0003570 con 0x7fccc80b2a30 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccc7fff700 1 -- 172.21.15.84:0/2942847286 >> v2:172.21.15.131:3300/0 conn(0x7fccc80b2660 msgr2=0x7fccc80cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccc7fff700 1 --2- 172.21.15.84:0/2942847286 >> v2:172.21.15.131:3300/0 conn(0x7fccc80b2660 0x7fccc80cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccc7fff700 1 -- 172.21.15.84:0/2942847286 >> v1:172.21.15.131:6789/0 conn(0x7fccc80b2a30 legacy=0x7fccc80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccc7fff700 1 -- 172.21.15.84:0/2942847286 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc80cc360 con 0x7fccc80cf1f0 2023-10-06T02:59:52.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccc77fe700 1 --2- 172.21.15.84:0/2942847286 >> v2:172.21.15.131:3300/0 conn(0x7fccc80b2660 0x7fccc80cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccc7fff700 1 --2- 172.21.15.84:0/2942847286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80cf1f0 0x7fccc80cd230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009e60 tx=0x7fccc0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee7c2560770d1dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccc67fc700 1 -- 172.21.15.84:0/2942847286 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc000e070 con 0x7fccc80cf1f0 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccc67fc700 1 -- 172.21.15.84:0/2942847286 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc000bab0 con 0x7fccc80cf1f0 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccc67fc700 1 -- 172.21.15.84:0/2942847286 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc000be70 con 0x7fccc80cf1f0 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccccc7a700 1 -- 172.21.15.84:0/2942847286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80cf1f0 msgr2=0x7fccc80cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccccc7a700 1 --2- 172.21.15.84:0/2942847286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80cf1f0 0x7fccc80cd230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009e60 tx=0x7fccc0009780 comp rx=0 tx=0).stop 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccccc7a700 1 -- 172.21.15.84:0/2942847286 shutdown_connections 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccccc7a700 1 --2- 172.21.15.84:0/2942847286 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80cf1f0 0x7fccc80cd230 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccccc7a700 1 --2- 172.21.15.84:0/2942847286 >> v2:172.21.15.131:3300/0 conn(0x7fccc80b2660 0x7fccc80cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccccc7a700 1 -- 172.21.15.84:0/2942847286 >> 172.21.15.84:0/2942847286 conn(0x7fccc8099560 msgr2=0x7fccc806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:52.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccccc7a700 1 -- 172.21.15.84:0/2942847286 shutdown_connections 2023-10-06T02:59:52.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.779+0000 7fccccc7a700 1 -- 172.21.15.84:0/2942847286 wait complete. 2023-10-06T02:59:52.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.781+0000 7fccccc7a700 1 Processor -- start 2023-10-06T02:59:52.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.781+0000 7fccccc7a700 1 -- start start 2023-10-06T02:59:52.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.781+0000 7fccccc7a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc80b2660 0x7fccc80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.781+0000 7fccccc7a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80b2a30 0x7fccc8169890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.781+0000 7fccccc7a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc80cf1f0 0x7fccc80c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.781+0000 7fccccc7a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80b4be0 con 0x7fccc80b2660 2023-10-06T02:59:52.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.781+0000 7fccccc7a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80b4ec0 con 0x7fccc80cf1f0 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.781+0000 7fccccc7a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80b51a0 con 0x7fccc80b2a30 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc80b2660 0x7fccc80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc80b2660 0x7fccc80b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58236/0 (socket says 172.21.15.84:58236) 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc77fe700 1 -- 172.21.15.84:0/1425857245 learned_addr learned my addr 172.21.15.84:0/1425857245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc7fff700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc80cf1f0 0x7fccc80c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc6ffd700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80b2a30 0x7fccc8169890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc77fe700 1 -- 172.21.15.84:0/1425857245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80b2a30 msgr2=0x7fccc8169890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc77fe700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80b2a30 0x7fccc8169890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc77fe700 1 -- 172.21.15.84:0/1425857245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc80cf1f0 msgr2=0x7fccc80c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc77fe700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc80cf1f0 0x7fccc80c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc77fe700 1 -- 172.21.15.84:0/1425857245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb80093c0 con 0x7fccc80b2660 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccc77fe700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc80b2660 0x7fccc80b59a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fccb800ec80 tx=0x7fccb8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccaf7fe700 1 -- 172.21.15.84:0/1425857245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8005a00 con 0x7fccc80b2660 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccaf7fe700 1 -- 172.21.15.84:0/1425857245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb8005b60 con 0x7fccc80b2660 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc0009a20 con 0x7fccc80b2660 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccaf7fe700 1 -- 172.21.15.84:0/1425857245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800c850 con 0x7fccc80b2660 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.782+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc80b5ee0 con 0x7fccc80b2660 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.783+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc80b5640 con 0x7fccc80b2660 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.784+0000 7fccaf7fe700 1 -- 172.21.15.84:0/1425857245 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccb800cbc0 con 0x7fccc80b2660 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.784+0000 7fccaf7fe700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccb4066f30 0x7fccb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.784+0000 7fccaf7fe700 1 -- 172.21.15.84:0/1425857245 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fccb8084850 con 0x7fccc80b2660 2023-10-06T02:59:52.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.784+0000 7fccc6ffd700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccb4066f30 0x7fccb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:52.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.785+0000 7fccc6ffd700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccb4066f30 0x7fccb40693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fccc816c640 tx=0x7fccbc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:52.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.788+0000 7fccaf7fe700 1 -- 172.21.15.84:0/1425857245 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccb8051b70 con 0x7fccc80b2660 2023-10-06T02:59:52.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.970+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fccc80b57f0 con 0x7fccc80b2660 2023-10-06T02:59:52.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.971+0000 7fccaf7fe700 1 -- 172.21.15.84:0/1425857245 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7fccb8055190 con 0x7fccc80b2660 2023-10-06T02:59:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T02:59:52.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccb4066f30 msgr2=0x7fccb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccb4066f30 0x7fccb40693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fccc816c640 tx=0x7fccbc009040 comp rx=0 tx=0).stop 2023-10-06T02:59:52.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc80b2660 msgr2=0x7fccc80b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:52.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc80b2660 0x7fccc80b59a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fccb800ec80 tx=0x7fccb8009120 comp rx=0 tx=0).stop 2023-10-06T02:59:52.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 shutdown_connections 2023-10-06T02:59:52.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fccb4066f30 0x7fccb40693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fccc80cf1f0 0x7fccc80c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc80b2660 0x7fccc80b59a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 --2- 172.21.15.84:0/1425857245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fccc80b2a30 0x7fccc8169890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:52.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 >> 172.21.15.84:0/1425857245 conn(0x7fccc8099560 msgr2=0x7fccc8068640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:52.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 shutdown_connections 2023-10-06T02:59:52.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:52.973+0000 7fccccc7a700 1 -- 172.21.15.84:0/1425857245 wait complete. 2023-10-06T02:59:52.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T02:59:53.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.099+0000 7f695759e700 1 Processor -- start 2023-10-06T02:59:53.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.099+0000 7f695759e700 1 -- start start 2023-10-06T02:59:53.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6958159480 0x7f69580b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695759e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f69580b3610 0x7f69580cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 0x7f69580b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69580cb7e0 con 0x7f6958159480 2023-10-06T02:59:53.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695759e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69580b08a0 con 0x7f69580b3610 2023-10-06T02:59:53.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69580cb190 con 0x7f69580cc1b0 2023-10-06T02:59:53.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6958159480 0x7f69580b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6958159480 0x7f69580b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58250/0 (socket says 172.21.15.84:58250) 2023-10-06T02:59:53.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695659c700 1 -- 172.21.15.84:0/4219417004 learned_addr learned my addr 172.21.15.84:0/4219417004 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f6956d9d700 1 --2- 172.21.15.84:0/4219417004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 0x7f69580b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f694dd9b700 1 --2- 172.21.15.84:0/4219417004 >> v2:172.21.15.131:3300/0 conn(0x7f69580b3610 0x7f69580cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695659c700 1 -- 172.21.15.84:0/4219417004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 msgr2=0x7f69580b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695659c700 1 --2- 172.21.15.84:0/4219417004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 0x7f69580b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695659c700 1 -- 172.21.15.84:0/4219417004 >> v2:172.21.15.131:3300/0 conn(0x7f69580b3610 msgr2=0x7f69580cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695659c700 1 --2- 172.21.15.84:0/4219417004 >> v2:172.21.15.131:3300/0 conn(0x7f69580b3610 0x7f69580cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695659c700 1 -- 172.21.15.84:0/4219417004 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580cb470 con 0x7f6958159480 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f695659c700 1 --2- 172.21.15.84:0/4219417004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 0x7f69580b30d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f69580d0260 tx=0x7f6948009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645c0b921c88bd64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.100+0000 7f6955d9b700 1 -- 172.21.15.84:0/4219417004 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800b860 con 0x7f6958159480 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f6955d9b700 1 -- 172.21.15.84:0/4219417004 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694800b9c0 con 0x7f6958159480 2023-10-06T02:59:53.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f6955d9b700 1 -- 172.21.15.84:0/4219417004 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800bd60 con 0x7f6958159480 2023-10-06T02:59:53.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f695759e700 1 -- 172.21.15.84:0/4219417004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 msgr2=0x7f69580b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f695759e700 1 --2- 172.21.15.84:0/4219417004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 0x7f69580b30d0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f69580d0260 tx=0x7f6948009250 comp rx=0 tx=0).stop 2023-10-06T02:59:53.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f695759e700 1 -- 172.21.15.84:0/4219417004 shutdown_connections 2023-10-06T02:59:53.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f695759e700 1 --2- 172.21.15.84:0/4219417004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 0x7f69580b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f695759e700 1 --2- 172.21.15.84:0/4219417004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 0x7f69580b30d0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f695759e700 1 --2- 172.21.15.84:0/4219417004 >> v2:172.21.15.131:3300/0 conn(0x7f69580b3610 0x7f69580cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f695759e700 1 -- 172.21.15.84:0/4219417004 >> 172.21.15.84:0/4219417004 conn(0x7f695806ed20 msgr2=0x7f695806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:53.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f695759e700 1 -- 172.21.15.84:0/4219417004 shutdown_connections 2023-10-06T02:59:53.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.101+0000 7f695759e700 1 -- 172.21.15.84:0/4219417004 wait complete. 2023-10-06T02:59:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.102+0000 7f695759e700 1 Processor -- start 2023-10-06T02:59:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.102+0000 7f695759e700 1 -- start start 2023-10-06T02:59:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f695759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69580b3610 0x7f69580c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f695759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 0x7f6958154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f695759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 0x7f695816ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f695759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580c3f90 con 0x7f6958159480 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f695759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695816d630 con 0x7f69580b3610 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f695759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695816d910 con 0x7f69580cc1b0 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f6956d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 0x7f695816ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f6956d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 0x7f695816ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58256/0 (socket says 172.21.15.84:58256) 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f6956d9d700 1 -- 172.21.15.84:0/1826589807 learned_addr learned my addr 172.21.15.84:0/1826589807 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f695659c700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69580b3610 0x7f69580c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f694dd9b700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 0x7f6958154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f6956d9d700 1 -- 172.21.15.84:0/1826589807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 msgr2=0x7f6958154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f6956d9d700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 0x7f6958154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f6956d9d700 1 -- 172.21.15.84:0/1826589807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69580b3610 msgr2=0x7f69580c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f6956d9d700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69580b3610 0x7f69580c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f6956d9d700 1 -- 172.21.15.84:0/1826589807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480094f0 con 0x7f6958159480 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.103+0000 7f694dd9b700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 0x7f6958154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.104+0000 7f6956d9d700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 0x7f695816ca50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f6950009fa0 tx=0x7f6950009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.104+0000 7f694effd700 1 -- 172.21.15.84:0/1826589807 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000ec70 con 0x7f6958159480 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.104+0000 7f694effd700 1 -- 172.21.15.84:0/1826589807 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695000edd0 con 0x7f6958159480 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.104+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695815b220 con 0x7f6958159480 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.104+0000 7f694effd700 1 -- 172.21.15.84:0/1826589807 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950014670 con 0x7f6958159480 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.104+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695815b7e0 con 0x7f6958159480 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.105+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695815b080 con 0x7f6958159480 2023-10-06T02:59:53.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.105+0000 7f694effd700 1 -- 172.21.15.84:0/1826589807 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69500149e0 con 0x7f6958159480 2023-10-06T02:59:53.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.105+0000 7f694effd700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6938066f30 0x7f69380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.105+0000 7f694effd700 1 -- 172.21.15.84:0/1826589807 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6950084ad0 con 0x7f6958159480 2023-10-06T02:59:53.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.105+0000 7f695659c700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6938066f30 0x7f69380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.106+0000 7f695659c700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6938066f30 0x7f69380693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f69580d0260 tx=0x7f6948017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:53.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.109+0000 7f694effd700 1 -- 172.21.15.84:0/1826589807 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f695815b080 con 0x7f6958159480 2023-10-06T02:59:53.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.294+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f695815b080 con 0x7f6958159480 2023-10-06T02:59:53.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.295+0000 7f694effd700 1 -- 172.21.15.84:0/1826589807 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+126 (secure 0 0 0) 0x7f695815b080 con 0x7f6958159480 2023-10-06T02:59:53.296 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T02:59:53.297 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6938066f30 msgr2=0x7f69380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6938066f30 0x7f69380693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f69580d0260 tx=0x7f6948017000 comp rx=0 tx=0).stop 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 msgr2=0x7f695816ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 0x7f695816ca50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f6950009fa0 tx=0x7f6950009900 comp rx=0 tx=0).stop 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 shutdown_connections 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6938066f30 0x7f69380693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69580b3610 0x7f69580c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6958159480 0x7f695816ca50 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 --2- 172.21.15.84:0/1826589807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69580cc1b0 0x7f6958154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 >> 172.21.15.84:0/1826589807 conn(0x7f695806ed20 msgr2=0x7f6958156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:53.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 shutdown_connections 2023-10-06T02:59:53.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.297+0000 7f695759e700 1 -- 172.21.15.84:0/1826589807 wait complete. 2023-10-06T02:59:53.310 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T02:59:53.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T02:59:53.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.428+0000 7fc07759e700 1 Processor -- start 2023-10-06T02:59:53.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.428+0000 7fc07759e700 1 -- start start 2023-10-06T02:59:53.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc07759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078069980 0x7fc07815d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc07759e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc078069d50 0x7fc0780cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc07759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07815aaf0 con 0x7fc0780cb2d0 2023-10-06T02:59:53.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc07759e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780cbb50 con 0x7fc078069d50 2023-10-06T02:59:53.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc07759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07815de70 con 0x7fc078069980 2023-10-06T02:59:53.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc06ffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc0780cb2d0 0x7fc0780cead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41386/0 (socket says 172.21.15.84:41386) 2023-10-06T02:59:53.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc06ffff700 1 -- 172.21.15.84:0/3857111305 learned_addr learned my addr 172.21.15.84:0/3857111305 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:53.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc076d9d700 1 --2- 172.21.15.84:0/3857111305 >> v2:172.21.15.131:3300/0 conn(0x7fc078069d50 0x7fc0780cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc07659c700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078069980 0x7fc07815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750795004 0 0) 0x7fc07815aaf0 con 0x7fc0780cb2d0 2023-10-06T02:59:53.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc064003570 con 0x7fc0780cb2d0 2023-10-06T02:59:53.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1218101656 0 0) 0x7fc064003570 con 0x7fc0780cb2d0 2023-10-06T02:59:53.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078069980 msgr2=0x7fc07815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:53.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078069980 0x7fc07815d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 >> v2:172.21.15.131:3300/0 conn(0x7fc078069d50 msgr2=0x7fc0780cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:53.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 --2- 172.21.15.84:0/3857111305 >> v2:172.21.15.131:3300/0 conn(0x7fc078069d50 0x7fc0780cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780cb870 con 0x7fc0780cb2d0 2023-10-06T02:59:53.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fc060001470 con 0x7fc0780cb2d0 2023-10-06T02:59:53.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc07659c700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078069980 0x7fc07815d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:53.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 >> v1:172.21.15.84:6789/0 conn(0x7fc0780cb2d0 legacy=0x7fc0780cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc064003a60 0x7fc064003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078069980 0x7fc064004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc064004d50 0x7fc0640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780cbb50 con 0x7fc064004d50 2023-10-06T02:59:53.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07815de70 con 0x7fc064003a60 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.429+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06400bab0 con 0x7fc078069980 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc076d9d700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc064004d50 0x7fc0640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc06ffff700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078069980 0x7fc064004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc07659c700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc064003a60 0x7fc064003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc076d9d700 1 -- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078069980 msgr2=0x7fc064004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc076d9d700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078069980 0x7fc064004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc076d9d700 1 -- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc064003a60 msgr2=0x7fc064003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc076d9d700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc064003a60 0x7fc064003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc076d9d700 1 -- 172.21.15.84:0/3857111305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064003570 con 0x7fc064004d50 2023-10-06T02:59:53.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc076d9d700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc064004d50 0x7fc0640051c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc07000e210 tx=0x7fc07000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1882777fda9324 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:53.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000eac0 con 0x7fc064004d50 2023-10-06T02:59:53.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000f040 con 0x7fc064004d50 2023-10-06T02:59:53.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.430+0000 7fc075d9b700 1 -- 172.21.15.84:0/3857111305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000ee70 con 0x7fc064004d50 2023-10-06T02:59:53.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.431+0000 7fc07759e700 1 -- 172.21.15.84:0/3857111305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc064004d50 msgr2=0x7fc0640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.431+0000 7fc07759e700 1 --2- 172.21.15.84:0/3857111305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc064004d50 0x7fc0640051c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc07000e210 tx=0x7fc07000b040 comp rx=0 tx=0).stop 2023-10-06T02:59:53.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.431+0000 7fc076d9d700 1 -- 172.21.15.84:0/3857111305 reap_dead start 2023-10-06T02:59:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.431+0000 7fc07759e700 1 -- 172.21.15.84:0/3857111305 shutdown_connections 2023-10-06T02:59:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.431+0000 7fc07759e700 1 -- 172.21.15.84:0/3857111305 >> 172.21.15.84:0/3857111305 conn(0x7fc078068a70 msgr2=0x7fc0780d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.431+0000 7fc07759e700 1 -- 172.21.15.84:0/3857111305 shutdown_connections 2023-10-06T02:59:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.431+0000 7fc07759e700 1 -- 172.21.15.84:0/3857111305 wait complete. 2023-10-06T02:59:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.432+0000 7fc07759e700 1 Processor -- start 2023-10-06T02:59:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.432+0000 7fc07759e700 1 -- start start 2023-10-06T02:59:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.432+0000 7fc07759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078148d30 0x7fc078169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.432+0000 7fc07759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc078153cf0 0x7fc0780b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.432+0000 7fc07759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc078159a10 0x7fc078159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.432+0000 7fc07759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07815a3f0 con 0x7fc078153cf0 2023-10-06T02:59:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.432+0000 7fc07759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc078169980 con 0x7fc078159a10 2023-10-06T02:59:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.432+0000 7fc07759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc078169370 con 0x7fc078148d30 2023-10-06T02:59:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc078153cf0 0x7fc0780b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc078153cf0 0x7fc0780b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58280/0 (socket says 172.21.15.84:58280) 2023-10-06T02:59:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06ffff700 1 -- 172.21.15.84:0/144724981 learned_addr learned my addr 172.21.15.84:0/144724981 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc07659c700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078148d30 0x7fc078169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc076d9d700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc078159a10 0x7fc078159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06ffff700 1 -- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078148d30 msgr2=0x7fc078169e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06ffff700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078148d30 0x7fc078169e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06ffff700 1 -- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc078159a10 msgr2=0x7fc078159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06ffff700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc078159a10 0x7fc078159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06ffff700 1 -- 172.21.15.84:0/144724981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780b5bb0 con 0x7fc078153cf0 2023-10-06T02:59:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc07659c700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078148d30 0x7fc078169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc076d9d700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc078159a10 0x7fc078159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06ffff700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc078153cf0 0x7fc0780b52b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc060004890 tx=0x7fc060001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:53.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06e7fc700 1 -- 172.21.15.84:0/144724981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060018030 con 0x7fc078153cf0 2023-10-06T02:59:53.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06e7fc700 1 -- 172.21.15.84:0/144724981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06000f9a0 con 0x7fc078153cf0 2023-10-06T02:59:53.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc078169610 con 0x7fc078153cf0 2023-10-06T02:59:53.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc06e7fc700 1 -- 172.21.15.84:0/144724981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06000fd40 con 0x7fc078153cf0 2023-10-06T02:59:53.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.433+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0780b57f0 con 0x7fc078153cf0 2023-10-06T02:59:53.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.434+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc078169b30 con 0x7fc078153cf0 2023-10-06T02:59:53.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.434+0000 7fc06e7fc700 1 -- 172.21.15.84:0/144724981 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc06001b070 con 0x7fc078153cf0 2023-10-06T02:59:53.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.435+0000 7fc06e7fc700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc058066f30 0x7fc0580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:53.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.435+0000 7fc06e7fc700 1 -- 172.21.15.84:0/144724981 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc060019070 con 0x7fc078153cf0 2023-10-06T02:59:53.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.435+0000 7fc07659c700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc058066f30 0x7fc0580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:53.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.435+0000 7fc07659c700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc058066f30 0x7fc0580693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc068009310 tx=0x7fc068008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:53.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.439+0000 7fc06e7fc700 1 -- 172.21.15.84:0/144724981 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc078169b30 con 0x7fc078153cf0 2023-10-06T02:59:53.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:53.622+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc078169af0 con 0x7fc078153cf0 2023-10-06T02:59:54.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.617+0000 7fc06e7fc700 1 -- 172.21.15.84:0/144724981 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc0600553a0 con 0x7fc078153cf0 2023-10-06T02:59:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.621+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc058066f30 msgr2=0x7fc0580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.621+0000 7fc07759e700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc058066f30 0x7fc0580693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc068009310 tx=0x7fc068008040 comp rx=0 tx=0).stop 2023-10-06T02:59:54.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.621+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc078153cf0 msgr2=0x7fc0780b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.621+0000 7fc07759e700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc078153cf0 0x7fc0780b52b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc060004890 tx=0x7fc060001e90 comp rx=0 tx=0).stop 2023-10-06T02:59:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.622+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 shutdown_connections 2023-10-06T02:59:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.622+0000 7fc07759e700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc058066f30 0x7fc0580693e0 secure :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc068009310 tx=0x7fc068008040 comp rx=0 tx=0).stop 2023-10-06T02:59:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.622+0000 7fc07759e700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc078159a10 0x7fc078159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.622+0000 7fc07759e700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc078148d30 0x7fc078169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.622+0000 7fc07759e700 1 --2- 172.21.15.84:0/144724981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc078153cf0 0x7fc0780b52b0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.622+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 >> 172.21.15.84:0/144724981 conn(0x7fc078068a70 msgr2=0x7fc0780cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:54.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.624+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 shutdown_connections 2023-10-06T02:59:54.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.624+0000 7fc07759e700 1 -- 172.21.15.84:0/144724981 wait complete. 2023-10-06T02:59:54.627 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T02:59:54.640 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T02:59:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.765+0000 7f0bef626700 1 Processor -- start 2023-10-06T02:59:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.765+0000 7f0bef626700 1 -- start start 2023-10-06T02:59:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.766+0000 7f0bef626700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153a00 0x7f0be8069590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.766+0000 7f0bef626700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0be8153dd0 0x7f0be80cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.766+0000 7f0bef626700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be815dbd0 con 0x7f0be8069ad0 2023-10-06T02:59:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.766+0000 7f0bef626700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be815abb0 con 0x7f0be8153dd0 2023-10-06T02:59:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.766+0000 7f0bef626700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be815deb0 con 0x7f0be8153a00 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.766+0000 7f0bedbc3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0be8153dd0 0x7f0be80cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.766+0000 7f0bedbc3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0be8153dd0 0x7f0be80cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58286/0 (socket says 172.21.15.84:58286) 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.766+0000 7f0bedbc3700 1 -- 172.21.15.84:0/23174433 learned_addr learned my addr 172.21.15.84:0/23174433 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bed3c2700 1 --2- 172.21.15.84:0/23174433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153a00 0x7f0be8069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bedbc3700 1 -- 172.21.15.84:0/23174433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153a00 msgr2=0x7f0be8069590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bedbc3700 1 --2- 172.21.15.84:0/23174433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153a00 0x7f0be8069590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bedbc3700 1 -- 172.21.15.84:0/23174433 >> v1:172.21.15.131:6789/0 conn(0x7f0be8069ad0 legacy=0x7f0be815d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bedbc3700 1 -- 172.21.15.84:0/23174433 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8068d90 con 0x7f0be8153dd0 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bedbc3700 1 --2- 172.21.15.84:0/23174433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8153dd0 0x7f0be80cbeb0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0be00099b0 tx=0x7f0be0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d65bd9defa89ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bdffff700 1 -- 172.21.15.84:0/23174433 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be000b820 con 0x7f0be8153dd0 2023-10-06T02:59:54.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bdffff700 1 -- 172.21.15.84:0/23174433 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be000b980 con 0x7f0be8153dd0 2023-10-06T02:59:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bdffff700 1 -- 172.21.15.84:0/23174433 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be000bd20 con 0x7f0be8153dd0 2023-10-06T02:59:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bef626700 1 -- 172.21.15.84:0/23174433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8153dd0 msgr2=0x7f0be80cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.767+0000 7f0bef626700 1 --2- 172.21.15.84:0/23174433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8153dd0 0x7f0be80cbeb0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0be00099b0 tx=0x7f0be0009250 comp rx=0 tx=0).stop 2023-10-06T02:59:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.768+0000 7f0bef626700 1 -- 172.21.15.84:0/23174433 shutdown_connections 2023-10-06T02:59:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.768+0000 7f0bef626700 1 --2- 172.21.15.84:0/23174433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8153dd0 0x7f0be80cbeb0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.768+0000 7f0bef626700 1 --2- 172.21.15.84:0/23174433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153a00 0x7f0be8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.768+0000 7f0bef626700 1 -- 172.21.15.84:0/23174433 >> 172.21.15.84:0/23174433 conn(0x7f0be806b650 msgr2=0x7f0be806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.768+0000 7f0bef626700 1 -- 172.21.15.84:0/23174433 shutdown_connections 2023-10-06T02:59:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.768+0000 7f0bef626700 1 -- 172.21.15.84:0/23174433 wait complete. 2023-10-06T02:59:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.769+0000 7f0bef626700 1 Processor -- start 2023-10-06T02:59:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.769+0000 7f0bef626700 1 -- start start 2023-10-06T02:59:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.769+0000 7f0bef626700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8069ad0 0x7f0be8145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.769+0000 7f0bef626700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be8153a00 0x7f0be8158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bef626700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153dd0 0x7f0be80c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bef626700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8146350 con 0x7f0be8069ad0 2023-10-06T02:59:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bef626700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8157f60 con 0x7f0be8153a00 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bef626700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8157350 con 0x7f0be8153dd0 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bed3c2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8069ad0 0x7f0be8145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bed3c2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8069ad0 0x7f0be8145e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58298/0 (socket says 172.21.15.84:58298) 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bed3c2700 1 -- 172.21.15.84:0/2867272287 learned_addr learned my addr 172.21.15.84:0/2867272287 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0becbc1700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be8153a00 0x7f0be8158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bedbc3700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153dd0 0x7f0be80c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bed3c2700 1 -- 172.21.15.84:0/2867272287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153dd0 msgr2=0x7f0be80c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bed3c2700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153dd0 0x7f0be80c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bed3c2700 1 -- 172.21.15.84:0/2867272287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be8153a00 msgr2=0x7f0be8158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bed3c2700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be8153a00 0x7f0be8158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bed3c2700 1 -- 172.21.15.84:0/2867272287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be00094f0 con 0x7f0be8069ad0 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bed3c2700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8069ad0 0x7f0be8145e10 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f0be400e190 tx=0x7f0be4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bdd7fa700 1 -- 172.21.15.84:0/2867272287 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400ecd0 con 0x7f0be8069ad0 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bdd7fa700 1 -- 172.21.15.84:0/2867272287 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400ee30 con 0x7f0be8069ad0 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bdd7fa700 1 -- 172.21.15.84:0/2867272287 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4014670 con 0x7f0be8069ad0 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be8157630 con 0x7f0be8069ad0 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.770+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be8157bf0 con 0x7f0be8069ad0 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.771+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8158240 con 0x7f0be8069ad0 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.772+0000 7f0bdd7fa700 1 -- 172.21.15.84:0/2867272287 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0be4014a20 con 0x7f0be8069ad0 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.772+0000 7f0bdd7fa700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bcc066f30 0x7f0bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:54.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.772+0000 7f0bdd7fa700 1 -- 172.21.15.84:0/2867272287 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f0be4084c80 con 0x7f0be8069ad0 2023-10-06T02:59:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.772+0000 7f0becbc1700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bcc066f30 0x7f0bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:54.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.772+0000 7f0becbc1700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bcc066f30 0x7f0bcc0693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0be8156360 tx=0x7f0bd8009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:54.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.776+0000 7f0bdd7fa700 1 -- 172.21.15.84:0/2867272287 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0be4051e30 con 0x7f0be8069ad0 2023-10-06T02:59:54.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:54.959+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0be8064ad0 con 0x7f0be8069ad0 2023-10-06T02:59:55.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.622+0000 7f0bdd7fa700 1 -- 172.21.15.84:0/2867272287 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0be4009a60 con 0x7f0be8069ad0 2023-10-06T02:59:55.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.626+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bcc066f30 msgr2=0x7f0bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.627+0000 7f0bef626700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bcc066f30 0x7f0bcc0693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0be8156360 tx=0x7f0bd8009060 comp rx=0 tx=0).stop 2023-10-06T02:59:55.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.627+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8069ad0 msgr2=0x7f0be8145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.627+0000 7f0bef626700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8069ad0 0x7f0be8145e10 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f0be400e190 tx=0x7f0be4009920 comp rx=0 tx=0).stop 2023-10-06T02:59:55.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.628+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 shutdown_connections 2023-10-06T02:59:55.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.628+0000 7f0bef626700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bcc066f30 0x7f0bcc0693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.628+0000 7f0bef626700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0be8153dd0 0x7f0be80c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.628+0000 7f0bef626700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0be8069ad0 0x7f0be8145e10 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.628+0000 7f0bef626700 1 --2- 172.21.15.84:0/2867272287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be8153a00 0x7f0be8158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.628+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 >> 172.21.15.84:0/2867272287 conn(0x7f0be806b650 msgr2=0x7f0be8151fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:55.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.629+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 shutdown_connections 2023-10-06T02:59:55.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.630+0000 7f0bef626700 1 -- 172.21.15.84:0/2867272287 wait complete. 2023-10-06T02:59:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T02:59:55.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T02:59:55.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.774+0000 7f7587869700 1 Processor -- start 2023-10-06T02:59:55.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.774+0000 7f7587869700 1 -- start start 2023-10-06T02:59:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7587869700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75801598e0 0x7f75800ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7587869700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75800cf610 con 0x7f75800cbcb0 2023-10-06T02:59:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7587869700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75800cf8f0 con 0x7f7580159510 2023-10-06T02:59:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7587869700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75800cfbd0 con 0x7f75801598e0 2023-10-06T02:59:55.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7585e06700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f75800cbcb0 0x7f75800ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41390/0 (socket says 172.21.15.84:41390) 2023-10-06T02:59:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7585e06700 1 -- 172.21.15.84:0/4143176804 learned_addr learned my addr 172.21.15.84:0/4143176804 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7584e04700 1 --2- 172.21.15.84:0/4143176804 >> v2:172.21.15.84:3300/0 conn(0x7f75801598e0 0x7f75800ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f757ffff700 1 -- 172.21.15.84:0/4143176804 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172810255 0 0) 0x7f75800cf610 con 0x7f75800cbcb0 2023-10-06T02:59:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f757ffff700 1 -- 172.21.15.84:0/4143176804 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7568003570 con 0x7f75800cbcb0 2023-10-06T02:59:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f757ffff700 1 -- 172.21.15.84:0/4143176804 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273149679 0 0) 0x7f75800cf8f0 con 0x7f7580159510 2023-10-06T02:59:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7584e04700 1 -- 172.21.15.84:0/4143176804 >> v1:172.21.15.131:6789/0 conn(0x7f7580159510 legacy=0x7f75800cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7584e04700 1 -- 172.21.15.84:0/4143176804 >> v1:172.21.15.84:6789/0 conn(0x7f75800cbcb0 legacy=0x7f75800ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7584e04700 1 -- 172.21.15.84:0/4143176804 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75800cfeb0 con 0x7f75801598e0 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.775+0000 7f7584e04700 1 --2- 172.21.15.84:0/4143176804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 0x7f75800ce820 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7574009e60 tx=0x7f7574009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cf29f39c5c0da2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f757ffff700 1 -- 172.21.15.84:0/4143176804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400e070 con 0x7f75801598e0 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f757ffff700 1 -- 172.21.15.84:0/4143176804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400bb60 con 0x7f75801598e0 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f757ffff700 1 -- 172.21.15.84:0/4143176804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574012430 con 0x7f75801598e0 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f7587869700 1 -- 172.21.15.84:0/4143176804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 msgr2=0x7f75800ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f7587869700 1 --2- 172.21.15.84:0/4143176804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 0x7f75800ce820 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7574009e60 tx=0x7f7574009780 comp rx=0 tx=0).stop 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f7587869700 1 -- 172.21.15.84:0/4143176804 shutdown_connections 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f7587869700 1 --2- 172.21.15.84:0/4143176804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 0x7f75800ce820 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f7587869700 1 -- 172.21.15.84:0/4143176804 >> 172.21.15.84:0/4143176804 conn(0x7f7580089e90 msgr2=0x7f75800997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:55.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f7587869700 1 -- 172.21.15.84:0/4143176804 shutdown_connections 2023-10-06T02:59:55.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.776+0000 7f7587869700 1 -- 172.21.15.84:0/4143176804 wait complete. 2023-10-06T02:59:55.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.777+0000 7f7587869700 1 Processor -- start 2023-10-06T02:59:55.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.777+0000 7f7587869700 1 -- start start 2023-10-06T02:59:55.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7587869700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75800cbcb0 0x7f75800b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7587869700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7580159510 0x7f758015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7587869700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 0x7f758015be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7587869700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75800c8f40 con 0x7f75801598e0 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7587869700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75800c8330 con 0x7f75800cbcb0 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7587869700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75800c8610 con 0x7f7580159510 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7585e06700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 0x7f758015be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7585e06700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 0x7f758015be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58316/0 (socket says 172.21.15.84:58316) 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7585e06700 1 -- 172.21.15.84:0/1300866190 learned_addr learned my addr 172.21.15.84:0/1300866190 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7585605700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75800cbcb0 0x7f75800b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.778+0000 7f7584e04700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7580159510 0x7f758015b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f7585e06700 1 -- 172.21.15.84:0/1300866190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7580159510 msgr2=0x7f758015b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f7585e06700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7580159510 0x7f758015b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f7585e06700 1 -- 172.21.15.84:0/1300866190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75800cbcb0 msgr2=0x7f75800b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f7585e06700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75800cbcb0 0x7f75800b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f7585e06700 1 -- 172.21.15.84:0/1300866190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574009a20 con 0x7f75801598e0 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f7584e04700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7580159510 0x7f758015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f7585e06700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 0x7f758015be10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f757000c560 tx=0x7f7570007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f757d7fa700 1 -- 172.21.15.84:0/1300866190 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570005b30 con 0x7f75801598e0 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f757d7fa700 1 -- 172.21.15.84:0/1300866190 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7570005c90 con 0x7f75801598e0 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75800c88f0 con 0x7f75801598e0 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f757d7fa700 1 -- 172.21.15.84:0/1300866190 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570007320 con 0x7f75801598e0 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.779+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75800c7600 con 0x7f75801598e0 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.780+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7580064ad0 con 0x7f75801598e0 2023-10-06T02:59:55.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.780+0000 7f757d7fa700 1 -- 172.21.15.84:0/1300866190 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f757001b3b0 con 0x7f75801598e0 2023-10-06T02:59:55.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.781+0000 7f757d7fa700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f756c066f30 0x7f756c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:55.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.781+0000 7f757d7fa700 1 -- 172.21.15.84:0/1300866190 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f7570083b80 con 0x7f75801598e0 2023-10-06T02:59:55.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.781+0000 7f7585605700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f756c066f30 0x7f756c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:55.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.781+0000 7f7585605700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f756c066f30 0x7f756c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7578007fd0 tx=0x7f7578007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:55.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:55.785+0000 7f757d7fa700 1 -- 172.21.15.84:0/1300866190 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7570050bb0 con 0x7f75801598e0 2023-10-06T02:59:56.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.009+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f75800c66e0 con 0x7f75801598e0 2023-10-06T02:59:56.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.656+0000 7f757d7fa700 1 -- 172.21.15.84:0/1300866190 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v65) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7570017020 con 0x7f75801598e0 2023-10-06T02:59:56.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f756c066f30 msgr2=0x7f756c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f756c066f30 0x7f756c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7578007fd0 tx=0x7f7578007d30 comp rx=0 tx=0).stop 2023-10-06T02:59:56.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 msgr2=0x7f758015be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 0x7f758015be10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f757000c560 tx=0x7f7570007cf0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 shutdown_connections 2023-10-06T02:59:56.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f756c066f30 0x7f756c0693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75800cbcb0 0x7f75800b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75801598e0 0x7f758015be10 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 --2- 172.21.15.84:0/1300866190 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7580159510 0x7f758015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 >> 172.21.15.84:0/1300866190 conn(0x7f7580089e90 msgr2=0x7f7580149e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:56.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.667+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 shutdown_connections 2023-10-06T02:59:56.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.668+0000 7f7587869700 1 -- 172.21.15.84:0/1300866190 wait complete. 2023-10-06T02:59:56.671 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 12 and data pool 13 2023-10-06T02:59:56.684 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:56.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.795+0000 7f15a3a7b700 1 Processor -- start 2023-10-06T02:59:56.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.796+0000 7f15a3a7b700 1 -- start start 2023-10-06T02:59:56.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.796+0000 7f15a3a7b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f159c0b2620 0x7f159c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.796+0000 7f15a3a7b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c0cbfe0 con 0x7f159c0b29f0 2023-10-06T02:59:56.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.796+0000 7f15a3a7b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c0cb3d0 con 0x7f159c159870 2023-10-06T02:59:56.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.796+0000 7f15a3a7b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c0cb6b0 con 0x7f159c0b2620 2023-10-06T02:59:56.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.796+0000 7f15a1817700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f159c0b2620 0x7f159c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.796+0000 7f15a1016700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f159c0b29f0 0x7f159c159160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41400/0 (socket says 172.21.15.84:41400) 2023-10-06T02:59:56.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.796+0000 7f15a1016700 1 -- 172.21.15.84:0/2531800231 learned_addr learned my addr 172.21.15.84:0/2531800231 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T02:59:56.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.797+0000 7f15a1817700 1 -- 172.21.15.84:0/2531800231 >> v1:172.21.15.131:6789/0 conn(0x7f159c159870 legacy=0x7f159c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.797+0000 7f15a1817700 1 -- 172.21.15.84:0/2531800231 >> v1:172.21.15.84:6789/0 conn(0x7f159c0b29f0 legacy=0x7f159c159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.797+0000 7f15a1817700 1 -- 172.21.15.84:0/2531800231 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0cb990 con 0x7f159c0b2620 2023-10-06T02:59:56.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.797+0000 7f15a0815700 1 -- 172.21.15.84:0/2531800231 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504666782 0 0) 0x7f159c0cbfe0 con 0x7f159c0b29f0 2023-10-06T02:59:56.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.797+0000 7f15a1817700 1 --2- 172.21.15.84:0/2531800231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b2620 0x7f159c0b06d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1598009eb0 tx=0x7f1598009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347900a0164cc75f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:56.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.797+0000 7f15a0815700 1 -- 172.21.15.84:0/2531800231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159800e070 con 0x7f159c0b2620 2023-10-06T02:59:56.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.797+0000 7f15a0815700 1 -- 172.21.15.84:0/2531800231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159800bc30 con 0x7f159c0b2620 2023-10-06T02:59:56.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.797+0000 7f15a0815700 1 -- 172.21.15.84:0/2531800231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598012430 con 0x7f159c0b2620 2023-10-06T02:59:56.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.798+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2531800231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b2620 msgr2=0x7f159c0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.798+0000 7f15a3a7b700 1 --2- 172.21.15.84:0/2531800231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b2620 0x7f159c0b06d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1598009eb0 tx=0x7f1598009780 comp rx=0 tx=0).stop 2023-10-06T02:59:56.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.798+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2531800231 shutdown_connections 2023-10-06T02:59:56.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.798+0000 7f15a3a7b700 1 --2- 172.21.15.84:0/2531800231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b2620 0x7f159c0b06d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.798+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2531800231 >> 172.21.15.84:0/2531800231 conn(0x7f159c06ed20 msgr2=0x7f159c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:56.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.798+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2531800231 shutdown_connections 2023-10-06T02:59:56.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.798+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2531800231 wait complete. 2023-10-06T02:59:56.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.799+0000 7f15a3a7b700 1 Processor -- start 2023-10-06T02:59:56.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.799+0000 7f15a3a7b700 1 -- start start 2023-10-06T02:59:56.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.799+0000 7f15a3a7b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f159c0b2620 0x7f159c153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.799+0000 7f15a3a7b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b29f0 0x7f159c0c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.799+0000 7f15a3a7b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f159c159870 0x7f159c15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a3a7b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0ca0e0 con 0x7f159c0b29f0 2023-10-06T02:59:56.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a3a7b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0cf8a0 con 0x7f159c159870 2023-10-06T02:59:56.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a3a7b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0ce9e0 con 0x7f159c0b2620 2023-10-06T02:59:56.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1016700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b29f0 0x7f159c0c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1016700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b29f0 0x7f159c0c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58332/0 (socket says 172.21.15.84:58332) 2023-10-06T02:59:56.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1016700 1 -- 172.21.15.84:0/2075663230 learned_addr learned my addr 172.21.15.84:0/2075663230 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:56.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a2018700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f159c159870 0x7f159c15bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1817700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f159c0b2620 0x7f159c153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1016700 1 -- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f159c0b2620 msgr2=0x7f159c153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1016700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f159c0b2620 0x7f159c153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1016700 1 -- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f159c159870 msgr2=0x7f159c15bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1016700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f159c159870 0x7f159c15bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1016700 1 -- 172.21.15.84:0/2075663230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1598009a20 con 0x7f159c0b29f0 2023-10-06T02:59:56.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1817700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f159c0b2620 0x7f159c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:56.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a2018700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f159c159870 0x7f159c15bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:56.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a1016700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b29f0 0x7f159c0c8d80 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f158c00c810 tx=0x7f158c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:56.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f1591ffb700 1 -- 172.21.15.84:0/2075663230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c005c00 con 0x7f159c0b29f0 2023-10-06T02:59:56.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f1591ffb700 1 -- 172.21.15.84:0/2075663230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c005d60 con 0x7f159c0b29f0 2023-10-06T02:59:56.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c0cec90 con 0x7f159c0b29f0 2023-10-06T02:59:56.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f1591ffb700 1 -- 172.21.15.84:0/2075663230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c007340 con 0x7f159c0b29f0 2023-10-06T02:59:56.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.800+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c0cf250 con 0x7f159c0b29f0 2023-10-06T02:59:56.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.801+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c0cfa50 con 0x7f159c0b29f0 2023-10-06T02:59:56.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.802+0000 7f1591ffb700 1 -- 172.21.15.84:0/2075663230 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f158c01b400 con 0x7f159c0b29f0 2023-10-06T02:59:56.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.802+0000 7f1591ffb700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1580066f30 0x7f15800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:56.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.802+0000 7f1591ffb700 1 -- 172.21.15.84:0/2075663230 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f158c084290 con 0x7f159c0b29f0 2023-10-06T02:59:56.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.802+0000 7f15a1817700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1580066f30 0x7f15800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:56.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.802+0000 7f15a1817700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1580066f30 0x7f15800693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1598009eb0 tx=0x7f1598017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:56.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.806+0000 7f1591ffb700 1 -- 172.21.15.84:0/2075663230 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f159c0cfa50 con 0x7f159c0b29f0 2023-10-06T02:59:56.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.988+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f159c0cfa10 con 0x7f159c0b29f0 2023-10-06T02:59:56.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.989+0000 7f1591ffb700 1 -- 172.21.15.84:0/2075663230 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f158c0512e0 con 0x7f159c0b29f0 2023-10-06T02:59:56.991 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:56.991 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":81,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:59:56.011007+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:53.640511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:54.978352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1580066f30 msgr2=0x7f15800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1580066f30 0x7f15800693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1598009eb0 tx=0x7f1598017000 comp rx=0 tx=0).stop 2023-10-06T02:59:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b29f0 msgr2=0x7f159c0c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b29f0 0x7f159c0c8d80 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f158c00c810 tx=0x7f158c007d90 comp rx=0 tx=0).stop 2023-10-06T02:59:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 shutdown_connections 2023-10-06T02:59:56.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1580066f30 0x7f15800693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f159c159870 0x7f159c15bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f159c0b2620 0x7f159c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 --2- 172.21.15.84:0/2075663230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f159c0b29f0 0x7f159c0c8d80 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:56.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 >> 172.21.15.84:0/2075663230 conn(0x7f159c06ed20 msgr2=0x7f159c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:56.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 shutdown_connections 2023-10-06T02:59:56.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:56.991+0000 7f15a3a7b700 1 -- 172.21.15.84:0/2075663230 wait complete. 2023-10-06T02:59:57.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T02:59:57.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.118+0000 7f0a9b347700 1 Processor -- start 2023-10-06T02:59:57.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.119+0000 7f0a9b347700 1 -- start start 2023-10-06T02:59:57.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.119+0000 7f0a9b347700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a940b2620 0x7f0a940b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.119+0000 7f0a9b347700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a940b29f0 0x7f0a94159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.119+0000 7f0a9b347700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a940cbfe0 con 0x7f0a941596a0 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.119+0000 7f0a9b347700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a940cb3d0 con 0x7f0a940b29f0 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.119+0000 7f0a9b347700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a940cb6b0 con 0x7f0a940b2620 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a988e2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a940b29f0 0x7f0a94159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a988e2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a940b29f0 0x7f0a94159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58336/0 (socket says 172.21.15.84:58336) 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a988e2700 1 -- 172.21.15.84:0/930579548 learned_addr learned my addr 172.21.15.84:0/930579548 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a990e3700 1 --2- 172.21.15.84:0/930579548 >> v2:172.21.15.131:3300/0 conn(0x7f0a940b2620 0x7f0a940b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a988e2700 1 -- 172.21.15.84:0/930579548 >> v2:172.21.15.131:3300/0 conn(0x7f0a940b2620 msgr2=0x7f0a940b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:57.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a988e2700 1 --2- 172.21.15.84:0/930579548 >> v2:172.21.15.131:3300/0 conn(0x7f0a940b2620 0x7f0a940b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a988e2700 1 -- 172.21.15.84:0/930579548 >> v1:172.21.15.131:6789/0 conn(0x7f0a941596a0 legacy=0x7f0a94068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:57.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a988e2700 1 -- 172.21.15.84:0/930579548 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940cb990 con 0x7f0a940b29f0 2023-10-06T02:59:57.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a988e2700 1 --2- 172.21.15.84:0/930579548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a940b29f0 0x7f0a94159160 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f0a940d0460 tx=0x7f0a84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8218f397dfdf4148 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a8bfff700 1 -- 172.21.15.84:0/930579548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400b820 con 0x7f0a940b29f0 2023-10-06T02:59:57.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a8bfff700 1 -- 172.21.15.84:0/930579548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8400b980 con 0x7f0a940b29f0 2023-10-06T02:59:57.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.120+0000 7f0a8bfff700 1 -- 172.21.15.84:0/930579548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400bd20 con 0x7f0a940b29f0 2023-10-06T02:59:57.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.121+0000 7f0a9b347700 1 -- 172.21.15.84:0/930579548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a940b29f0 msgr2=0x7f0a94159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.121+0000 7f0a9b347700 1 --2- 172.21.15.84:0/930579548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a940b29f0 0x7f0a94159160 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f0a940d0460 tx=0x7f0a84009250 comp rx=0 tx=0).stop 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.121+0000 7f0a9b347700 1 -- 172.21.15.84:0/930579548 shutdown_connections 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.121+0000 7f0a9b347700 1 --2- 172.21.15.84:0/930579548 >> v2:172.21.15.131:3300/0 conn(0x7f0a940b2620 0x7f0a940b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.121+0000 7f0a9b347700 1 --2- 172.21.15.84:0/930579548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a940b29f0 0x7f0a94159160 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.121+0000 7f0a9b347700 1 -- 172.21.15.84:0/930579548 >> 172.21.15.84:0/930579548 conn(0x7f0a9406ed20 msgr2=0x7f0a9406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.121+0000 7f0a9b347700 1 -- 172.21.15.84:0/930579548 shutdown_connections 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.121+0000 7f0a9b347700 1 -- 172.21.15.84:0/930579548 wait complete. 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.122+0000 7f0a9b347700 1 Processor -- start 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.122+0000 7f0a9b347700 1 -- start start 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a9b347700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a940b2620 0x7f0a9416a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a9b347700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a940b29f0 0x7f0a94147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a9b347700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a941596a0 0x7f0a9415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a9b347700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940ca080 con 0x7f0a941596a0 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a9b347700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9416ade0 con 0x7f0a940b2620 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a9b347700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940c6df0 con 0x7f0a940b29f0 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a998e4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a941596a0 0x7f0a9415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a998e4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a941596a0 0x7f0a9415e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58342/0 (socket says 172.21.15.84:58342) 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a998e4700 1 -- 172.21.15.84:0/1323223332 learned_addr learned my addr 172.21.15.84:0/1323223332 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a990e3700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a940b2620 0x7f0a9416a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a988e2700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a940b29f0 0x7f0a94147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a998e4700 1 -- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a940b29f0 msgr2=0x7f0a94147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a998e4700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a940b29f0 0x7f0a94147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a998e4700 1 -- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a940b2620 msgr2=0x7f0a9416a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a998e4700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a940b2620 0x7f0a9416a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a998e4700 1 -- 172.21.15.84:0/1323223332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840094f0 con 0x7f0a941596a0 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a990e3700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a940b2620 0x7f0a9416a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a988e2700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a940b29f0 0x7f0a94147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a998e4700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a941596a0 0x7f0a9415e3b0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00bc30 tx=0x7f0a8c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a897fa700 1 -- 172.21.15.84:0/1323223332 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00c9b0 con 0x7f0a941596a0 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a897fa700 1 -- 172.21.15.84:0/1323223332 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00cb30 con 0x7f0a941596a0 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a897fa700 1 -- 172.21.15.84:0/1323223332 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c014410 con 0x7f0a941596a0 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.123+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a940ca510 con 0x7f0a941596a0 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.124+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a940c9750 con 0x7f0a941596a0 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.124+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a940ca1f0 con 0x7f0a941596a0 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.125+0000 7f0a897fa700 1 -- 172.21.15.84:0/1323223332 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a8c014840 con 0x7f0a941596a0 2023-10-06T02:59:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.125+0000 7f0a897fa700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a78066f30 0x7f0a780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.125+0000 7f0a897fa700 1 -- 172.21.15.84:0/1323223332 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0a8c084890 con 0x7f0a941596a0 2023-10-06T02:59:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.125+0000 7f0a990e3700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a78066f30 0x7f0a780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.126+0000 7f0a990e3700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a78066f30 0x7f0a780693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0a90006fd0 tx=0x7f0a90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.129+0000 7f0a897fa700 1 -- 172.21.15.84:0/1323223332 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a8c04c5a0 con 0x7f0a941596a0 2023-10-06T02:59:57.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.314+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a94064ad0 con 0x7f0a941596a0 2023-10-06T02:59:57.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.315+0000 7f0a897fa700 1 -- 172.21.15.84:0/1323223332 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f0a8c051860 con 0x7f0a941596a0 2023-10-06T02:59:57.317 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T02:59:57.317 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":81,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:59:56.011007+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:53.640511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:54.978352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T02:59:57.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a78066f30 msgr2=0x7f0a780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a78066f30 0x7f0a780693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0a90006fd0 tx=0x7f0a90008040 comp rx=0 tx=0).stop 2023-10-06T02:59:57.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a941596a0 msgr2=0x7f0a9415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a941596a0 0x7f0a9415e3b0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00bc30 tx=0x7f0a8c009820 comp rx=0 tx=0).stop 2023-10-06T02:59:57.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 shutdown_connections 2023-10-06T02:59:57.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a78066f30 0x7f0a780693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a940b2620 0x7f0a9416a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a941596a0 0x7f0a9415e3b0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 --2- 172.21.15.84:0/1323223332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0a940b29f0 0x7f0a94147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 >> 172.21.15.84:0/1323223332 conn(0x7f0a9406ed20 msgr2=0x7f0a940d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 shutdown_connections 2023-10-06T02:59:57.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.317+0000 7f0a9b347700 1 -- 172.21.15.84:0/1323223332 wait complete. 2023-10-06T02:59:57.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-06T02:59:57.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-06T02:59:57.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T02:59:57.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-06T02:59:57.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T02:59:57.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.445+0000 7f4f9612f700 1 Processor -- start 2023-10-06T02:59:57.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.445+0000 7f4f9612f700 1 -- start start 2023-10-06T02:59:57.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.446+0000 7f4f9612f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f90159510 0x7f4f900cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.446+0000 7f4f9612f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4f900cbae0 0x7f4f900cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.446+0000 7f4f9612f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f900cbf20 con 0x7f4f901598e0 2023-10-06T02:59:57.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.446+0000 7f4f9612f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f900cf610 con 0x7f4f90159510 2023-10-06T02:59:57.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.446+0000 7f4f9612f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f900cf8f0 con 0x7f4f900cbae0 2023-10-06T02:59:57.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.446+0000 7f4f8f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f90159510 0x7f4f900cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.446+0000 7f4f8f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f90159510 0x7f4f900cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58344/0 (socket says 172.21.15.84:58344) 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.446+0000 7f4f8f7fe700 1 -- 172.21.15.84:0/388248705 learned_addr learned my addr 172.21.15.84:0/388248705 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8ffff700 1 --2- 172.21.15.84:0/388248705 >> v2:172.21.15.131:3300/0 conn(0x7f4f900cbae0 0x7f4f900cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8f7fe700 1 -- 172.21.15.84:0/388248705 >> v2:172.21.15.131:3300/0 conn(0x7f4f900cbae0 msgr2=0x7f4f900cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8f7fe700 1 --2- 172.21.15.84:0/388248705 >> v2:172.21.15.131:3300/0 conn(0x7f4f900cbae0 0x7f4f900cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8f7fe700 1 -- 172.21.15.84:0/388248705 >> v1:172.21.15.131:6789/0 conn(0x7f4f901598e0 legacy=0x7f4f900ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8f7fe700 1 -- 172.21.15.84:0/388248705 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900cfbd0 con 0x7f4f90159510 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8ffff700 1 --2- 172.21.15.84:0/388248705 >> v2:172.21.15.131:3300/0 conn(0x7f4f900cbae0 0x7f4f900cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8f7fe700 1 --2- 172.21.15.84:0/388248705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 0x7f4f900cb5a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f4f9006f990 tx=0x7f4f80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34c6434cb5e895e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8e7fc700 1 -- 172.21.15.84:0/388248705 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000e070 con 0x7f4f90159510 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8e7fc700 1 -- 172.21.15.84:0/388248705 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000ba10 con 0x7f4f90159510 2023-10-06T02:59:57.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f8e7fc700 1 -- 172.21.15.84:0/388248705 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800092e0 con 0x7f4f90159510 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f9612f700 1 -- 172.21.15.84:0/388248705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 msgr2=0x7f4f900cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f9612f700 1 --2- 172.21.15.84:0/388248705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 0x7f4f900cb5a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f4f9006f990 tx=0x7f4f80009840 comp rx=0 tx=0).stop 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f9612f700 1 -- 172.21.15.84:0/388248705 shutdown_connections 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f9612f700 1 --2- 172.21.15.84:0/388248705 >> v2:172.21.15.131:3300/0 conn(0x7f4f900cbae0 0x7f4f900cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f9612f700 1 --2- 172.21.15.84:0/388248705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 0x7f4f900cb5a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.447+0000 7f4f9612f700 1 -- 172.21.15.84:0/388248705 >> 172.21.15.84:0/388248705 conn(0x7f4f90089e90 msgr2=0x7f4f900997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.448+0000 7f4f9612f700 1 -- 172.21.15.84:0/388248705 shutdown_connections 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.448+0000 7f4f9612f700 1 -- 172.21.15.84:0/388248705 wait complete. 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.449+0000 7f4f9612f700 1 Processor -- start 2023-10-06T02:59:57.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.449+0000 7f4f9612f700 1 -- start start 2023-10-06T02:59:57.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.449+0000 7f4f9612f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f900cbae0 0x7f4f9014c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.449+0000 7f4f9612f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 0x7f4f9016b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.449+0000 7f4f9612f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f901598e0 0x7f4f9014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f9612f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9014cef0 con 0x7f4f90159510 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f9612f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c77a0 con 0x7f4f901598e0 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f9612f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c7a80 con 0x7f4f900cbae0 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 0x7f4f9016b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 0x7f4f9016b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58352/0 (socket says 172.21.15.84:58352) 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8effd700 1 -- 172.21.15.84:0/70612503 learned_addr learned my addr 172.21.15.84:0/70612503 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8f7fe700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f900cbae0 0x7f4f9014c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8ffff700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f901598e0 0x7f4f9014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8effd700 1 -- 172.21.15.84:0/70612503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f900cbae0 msgr2=0x7f4f9014c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8effd700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f900cbae0 0x7f4f9014c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8effd700 1 -- 172.21.15.84:0/70612503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f901598e0 msgr2=0x7f4f9014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8effd700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f901598e0 0x7f4f9014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8effd700 1 -- 172.21.15.84:0/70612503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009ae0 con 0x7f4f90159510 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f8effd700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 0x7f4f9016b050 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400b510 tx=0x7f4f840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f777fe700 1 -- 172.21.15.84:0/70612503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400f510 con 0x7f4f90159510 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f777fe700 1 -- 172.21.15.84:0/70612503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400f670 con 0x7f4f90159510 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f900c7d60 con 0x7f4f90159510 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f777fe700 1 -- 172.21.15.84:0/70612503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400fa30 con 0x7f4f90159510 2023-10-06T02:59:57.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.450+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900c8320 con 0x7f4f90159510 2023-10-06T02:59:57.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.451+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f900ca7b0 con 0x7f4f90159510 2023-10-06T02:59:57.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.452+0000 7f4f777fe700 1 -- 172.21.15.84:0/70612503 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f8401a400 con 0x7f4f90159510 2023-10-06T02:59:57.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.452+0000 7f4f777fe700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f7c066f30 0x7f4f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:57.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.452+0000 7f4f777fe700 1 -- 172.21.15.84:0/70612503 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4f84084110 con 0x7f4f90159510 2023-10-06T02:59:57.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.452+0000 7f4f8f7fe700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f7c066f30 0x7f4f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:57.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.452+0000 7f4f8f7fe700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f7c066f30 0x7f4f7c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009880 tx=0x7f4f80017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:57.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.456+0000 7f4f777fe700 1 -- 172.21.15.84:0/70612503 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f84051160 con 0x7f4f90159510 2023-10-06T02:59:57.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:57.687+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4f90064ad0 con 0x7f4f90159510 2023-10-06T02:59:58.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.660+0000 7f4f777fe700 1 -- 172.21.15.84:0/70612503 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4f84054780 con 0x7f4f90159510 2023-10-06T02:59:58.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.662+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f7c066f30 msgr2=0x7f4f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.662+0000 7f4f9612f700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f7c066f30 0x7f4f7c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009880 tx=0x7f4f80017000 comp rx=0 tx=0).stop 2023-10-06T02:59:58.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.662+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 msgr2=0x7f4f9016b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.662+0000 7f4f9612f700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 0x7f4f9016b050 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400b510 tx=0x7f4f840090f0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.663+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 shutdown_connections 2023-10-06T02:59:58.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.663+0000 7f4f9612f700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4f7c066f30 0x7f4f7c0693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.663+0000 7f4f9612f700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f901598e0 0x7f4f9014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.663+0000 7f4f9612f700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f900cbae0 0x7f4f9014c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.663+0000 7f4f9612f700 1 --2- 172.21.15.84:0/70612503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f90159510 0x7f4f9016b050 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.663+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 >> 172.21.15.84:0/70612503 conn(0x7f4f90089e90 msgr2=0x7f4f900683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.663+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 shutdown_connections 2023-10-06T02:59:58.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.663+0000 7f4f9612f700 1 -- 172.21.15.84:0/70612503 wait complete. 2023-10-06T02:59:58.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T02:59:58.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.800+0000 7f5e0d1f0700 1 Processor -- start 2023-10-06T02:59:58.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.800+0000 7f5e0d1f0700 1 -- start start 2023-10-06T02:59:58.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e0d1f0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e08159510 0x7f5e080cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e0d1f0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 0x7f5e080cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e0d1f0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5e080ce820 0x7f5e080cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e0d1f0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e080cf610 con 0x7f5e08159510 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e0d1f0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e080cf8f0 con 0x7f5e080ce820 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e0d1f0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080cfbd0 con 0x7f5e081598e0 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e06d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e08159510 0x7f5e080cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e06d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e08159510 0x7f5e080cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58354/0 (socket says 172.21.15.84:58354) 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e06d9d700 1 -- 172.21.15.84:0/2959330833 learned_addr learned my addr 172.21.15.84:0/2959330833 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e0759e700 1 --2- 172.21.15.84:0/2959330833 >> v2:172.21.15.131:3300/0 conn(0x7f5e080ce820 0x7f5e080cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5dfe59c700 1 --2- 172.21.15.84:0/2959330833 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 0x7f5e080cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e06d9d700 1 -- 172.21.15.84:0/2959330833 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 msgr2=0x7f5e080cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/2959330833 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 0x7f5e080cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e06d9d700 1 -- 172.21.15.84:0/2959330833 >> v2:172.21.15.131:3300/0 conn(0x7f5e080ce820 msgr2=0x7f5e080cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/2959330833 >> v2:172.21.15.131:3300/0 conn(0x7f5e080ce820 0x7f5e080cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e06d9d700 1 -- 172.21.15.84:0/2959330833 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080cfeb0 con 0x7f5e08159510 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.801+0000 7f5e0759e700 1 --2- 172.21.15.84:0/2959330833 >> v2:172.21.15.131:3300/0 conn(0x7f5e080ce820 0x7f5e080cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/2959330833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 0x7f5e080cb5a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f5e0808acb0 tx=0x7f5df8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadc29db0d11e6c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0659c700 1 -- 172.21.15.84:0/2959330833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df800b860 con 0x7f5e08159510 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0659c700 1 -- 172.21.15.84:0/2959330833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df800b9c0 con 0x7f5e08159510 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0659c700 1 -- 172.21.15.84:0/2959330833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df800bd60 con 0x7f5e08159510 2023-10-06T02:59:58.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/2959330833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 msgr2=0x7f5e080cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/2959330833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 0x7f5e080cb5a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f5e0808acb0 tx=0x7f5df8009250 comp rx=0 tx=0).stop 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/2959330833 shutdown_connections 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/2959330833 >> v2:172.21.15.131:3300/0 conn(0x7f5e080ce820 0x7f5e080cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/2959330833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 0x7f5e080cb5a0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/2959330833 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 0x7f5e080cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/2959330833 >> 172.21.15.84:0/2959330833 conn(0x7f5e08089e90 msgr2=0x7f5e080997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/2959330833 shutdown_connections 2023-10-06T02:59:58.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.802+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/2959330833 wait complete. 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.804+0000 7f5e0d1f0700 1 Processor -- start 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.804+0000 7f5e0d1f0700 1 -- start start 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.804+0000 7f5e0d1f0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080ce820 0x7f5e08142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.804+0000 7f5e0d1f0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 0x7f5e080b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.804+0000 7f5e0d1f0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 0x7f5e080c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.804+0000 7f5e0d1f0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080b3c00 con 0x7f5e08159510 2023-10-06T02:59:58.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.804+0000 7f5e0d1f0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080b32f0 con 0x7f5e080ce820 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.804+0000 7f5e0d1f0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0815c0f0 con 0x7f5e081598e0 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dfe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 0x7f5e080b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dfe59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 0x7f5e080b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58358/0 (socket says 172.21.15.84:58358) 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dfe59c700 1 -- 172.21.15.84:0/3137421886 learned_addr learned my addr 172.21.15.84:0/3137421886 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080ce820 0x7f5e08142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5e0759e700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 0x7f5e080c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dfe59c700 1 -- 172.21.15.84:0/3137421886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 msgr2=0x7f5e080c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dfe59c700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 0x7f5e080c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dfe59c700 1 -- 172.21.15.84:0/3137421886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080ce820 msgr2=0x7f5e08142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dfe59c700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080ce820 0x7f5e08142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dfe59c700 1 -- 172.21.15.84:0/3137421886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80094f0 con 0x7f5e08159510 2023-10-06T02:59:58.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dfe59c700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 0x7f5e080b4090 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f5df000d860 tx=0x7f5df0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dff7fe700 1 -- 172.21.15.84:0/3137421886 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00125f0 con 0x7f5e08159510 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dff7fe700 1 -- 172.21.15.84:0/3137421886 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0012750 con 0x7f5e08159510 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e080b35b0 con 0x7f5e08159510 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5dff7fe700 1 -- 172.21.15.84:0/3137421886 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0012af0 con 0x7f5e08159510 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.805+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0814e440 con 0x7f5e08159510 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.806+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e08064ad0 con 0x7f5e08159510 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.806+0000 7f5dff7fe700 1 -- 172.21.15.84:0/3137421886 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5df0013480 con 0x7f5e08159510 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.807+0000 7f5dff7fe700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5de8066f30 0x7f5de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.807+0000 7f5dff7fe700 1 -- 172.21.15.84:0/3137421886 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5df0084b30 con 0x7f5e08159510 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.807+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5de8066f30 0x7f5de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:58.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.807+0000 7f5e06d9d700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5de8066f30 0x7f5de80693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5e0808acb0 tx=0x7f5df8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:58.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:58.811+0000 7f5dff7fe700 1 -- 172.21.15.84:0/3137421886 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5df0055590 con 0x7f5e08159510 2023-10-06T02:59:59.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.037+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5e080cf180 con 0x7f5e08159510 2023-10-06T02:59:59.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.664+0000 7f5dff7fe700 1 -- 172.21.15.84:0/3137421886 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5df0055120 con 0x7f5e08159510 2023-10-06T02:59:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5de8066f30 msgr2=0x7f5de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5de8066f30 0x7f5de80693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5e0808acb0 tx=0x7f5df8017000 comp rx=0 tx=0).stop 2023-10-06T02:59:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 msgr2=0x7f5e080b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 0x7f5e080b4090 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f5df000d860 tx=0x7f5df0008040 comp rx=0 tx=0).stop 2023-10-06T02:59:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 shutdown_connections 2023-10-06T02:59:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5de8066f30 0x7f5de80693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e080ce820 0x7f5e08142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5e081598e0 0x7f5e080c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 --2- 172.21.15.84:0/3137421886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e08159510 0x7f5e080b4090 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 >> 172.21.15.84:0/3137421886 conn(0x7f5e08089e90 msgr2=0x7f5e08069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 shutdown_connections 2023-10-06T02:59:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.666+0000 7f5e0d1f0700 1 -- 172.21.15.84:0/3137421886 wait complete. 2023-10-06T02:59:59.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T02:59:59.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.794+0000 7fd44b1ac700 1 Processor -- start 2023-10-06T02:59:59.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.794+0000 7fd44b1ac700 1 -- start start 2023-10-06T02:59:59.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.795+0000 7fd44b1ac700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd44415db50 0x7fd4440cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.795+0000 7fd44b1ac700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd4440ad620 0x7fd4440ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.795+0000 7fd44b1ac700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4440ca640 con 0x7fd4440ad250 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.795+0000 7fd44b1ac700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440ced30 con 0x7fd44415db50 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.795+0000 7fd44b1ac700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440cf010 con 0x7fd4440ad620 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.795+0000 7fd43bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd44415db50 0x7fd4440cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.795+0000 7fd43bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd44415db50 0x7fd4440cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58368/0 (socket says 172.21.15.84:58368) 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.795+0000 7fd43bfff700 1 -- 172.21.15.84:0/1831089667 learned_addr learned my addr 172.21.15.84:0/1831089667 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.796+0000 7fd449749700 1 --2- 172.21.15.84:0/1831089667 >> v2:172.21.15.131:3300/0 conn(0x7fd4440ad620 0x7fd4440ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.796+0000 7fd43bfff700 1 -- 172.21.15.84:0/1831089667 >> v2:172.21.15.131:3300/0 conn(0x7fd4440ad620 msgr2=0x7fd4440ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.796+0000 7fd43bfff700 1 --2- 172.21.15.84:0/1831089667 >> v2:172.21.15.131:3300/0 conn(0x7fd4440ad620 0x7fd4440ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.796+0000 7fd43bfff700 1 -- 172.21.15.84:0/1831089667 >> v1:172.21.15.131:6789/0 conn(0x7fd4440ad250 legacy=0x7fd44415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T02:59:59.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.796+0000 7fd43bfff700 1 -- 172.21.15.84:0/1831089667 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4440ccad0 con 0x7fd44415db50 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.796+0000 7fd43bfff700 1 --2- 172.21.15.84:0/1831089667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 0x7fd4440cd2d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd44406a3e0 tx=0x7fd434009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20daa6f762a54d65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.796+0000 7fd43b7fe700 1 -- 172.21.15.84:0/1831089667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400b820 con 0x7fd44415db50 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.796+0000 7fd43b7fe700 1 -- 172.21.15.84:0/1831089667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400b980 con 0x7fd44415db50 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.796+0000 7fd43b7fe700 1 -- 172.21.15.84:0/1831089667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400bd20 con 0x7fd44415db50 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.797+0000 7fd44b1ac700 1 -- 172.21.15.84:0/1831089667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 msgr2=0x7fd4440cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.797+0000 7fd44b1ac700 1 --2- 172.21.15.84:0/1831089667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 0x7fd4440cd2d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd44406a3e0 tx=0x7fd434009250 comp rx=0 tx=0).stop 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.797+0000 7fd44b1ac700 1 -- 172.21.15.84:0/1831089667 shutdown_connections 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.797+0000 7fd44b1ac700 1 --2- 172.21.15.84:0/1831089667 >> v2:172.21.15.131:3300/0 conn(0x7fd4440ad620 0x7fd4440ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.797+0000 7fd44b1ac700 1 --2- 172.21.15.84:0/1831089667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 0x7fd4440cd2d0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.797+0000 7fd44b1ac700 1 -- 172.21.15.84:0/1831089667 >> 172.21.15.84:0/1831089667 conn(0x7fd444067dd0 msgr2=0x7fd4440ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T02:59:59.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.797+0000 7fd44b1ac700 1 -- 172.21.15.84:0/1831089667 shutdown_connections 2023-10-06T02:59:59.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.797+0000 7fd44b1ac700 1 -- 172.21.15.84:0/1831089667 wait complete. 2023-10-06T02:59:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.798+0000 7fd44b1ac700 1 Processor -- start 2023-10-06T02:59:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.798+0000 7fd44b1ac700 1 -- start start 2023-10-06T02:59:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd44b1ac700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4440ad250 0x7fd4440addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd44b1ac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4440ad620 0x7fd4440c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd44b1ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 0x7fd4440b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd44b1ac700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440b2df0 con 0x7fd44415db50 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd44b1ac700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440b21e0 con 0x7fd4440ad620 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd44b1ac700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440b24c0 con 0x7fd4440ad250 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd449749700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 0x7fd4440b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd449749700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 0x7fd4440b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58378/0 (socket says 172.21.15.84:58378) 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd449749700 1 -- 172.21.15.84:0/527159733 learned_addr learned my addr 172.21.15.84:0/527159733 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd448f48700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4440ad250 0x7fd4440addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd43bfff700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4440ad620 0x7fd4440c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd449749700 1 -- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4440ad250 msgr2=0x7fd4440addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd449749700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4440ad250 0x7fd4440addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd449749700 1 -- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4440ad620 msgr2=0x7fd4440c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd449749700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4440ad620 0x7fd4440c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd449749700 1 -- 172.21.15.84:0/527159733 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340094f0 con 0x7fd44415db50 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd448f48700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4440ad250 0x7fd4440addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd43bfff700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4440ad620 0x7fd4440c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd449749700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 0x7fd4440b3280 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00c880 tx=0x7fd43c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd438ff9700 1 -- 172.21.15.84:0/527159733 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c011600 con 0x7fd44415db50 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd438ff9700 1 -- 172.21.15.84:0/527159733 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c011760 con 0x7fd44415db50 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4440b27a0 con 0x7fd44415db50 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd438ff9700 1 -- 172.21.15.84:0/527159733 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c011ae0 con 0x7fd44415db50 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.799+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4440b0930 con 0x7fd44415db50 2023-10-06T02:59:59.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.800+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd444064ad0 con 0x7fd44415db50 2023-10-06T02:59:59.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.801+0000 7fd438ff9700 1 -- 172.21.15.84:0/527159733 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd43c0193f0 con 0x7fd44415db50 2023-10-06T02:59:59.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.801+0000 7fd438ff9700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd430066f30 0x7fd4300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T02:59:59.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.801+0000 7fd438ff9700 1 -- 172.21.15.84:0/527159733 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd43c084cc0 con 0x7fd44415db50 2023-10-06T02:59:59.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.801+0000 7fd448f48700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd430066f30 0x7fd4300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T02:59:59.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.802+0000 7fd448f48700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd430066f30 0x7fd4300693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd44000d220 tx=0x7fd440009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T02:59:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T02:59:59.805+0000 7fd438ff9700 1 -- 172.21.15.84:0/527159733 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd43c08b080 con 0x7fd44415db50 2023-10-06T03:00:00.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.030+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4440b2f30 con 0x7fd44415db50 2023-10-06T03:00:00.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.031+0000 7fd438ff9700 1 -- 172.21.15.84:0/527159733 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fd43c055680 con 0x7fd44415db50 2023-10-06T03:00:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:00.033 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":68,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T02:59:59.659608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:00.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd430066f30 msgr2=0x7fd4300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd430066f30 0x7fd4300693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd44000d220 tx=0x7fd440009040 comp rx=0 tx=0).stop 2023-10-06T03:00:00.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 msgr2=0x7fd4440b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 0x7fd4440b3280 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00c880 tx=0x7fd43c008040 comp rx=0 tx=0).stop 2023-10-06T03:00:00.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 shutdown_connections 2023-10-06T03:00:00.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd430066f30 0x7fd4300693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd44415db50 0x7fd4440b3280 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4440ad250 0x7fd4440addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 --2- 172.21.15.84:0/527159733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4440ad620 0x7fd4440c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 >> 172.21.15.84:0/527159733 conn(0x7fd444067dd0 msgr2=0x7fd44406b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 shutdown_connections 2023-10-06T03:00:00.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.033+0000 7fd44b1ac700 1 -- 172.21.15.84:0/527159733 wait complete. 2023-10-06T03:00:00.037 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 68 2023-10-06T03:00:00.046 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:00.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.161+0000 7f08a7132700 1 Processor -- start 2023-10-06T03:00:00.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.161+0000 7f08a7132700 1 -- start start 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a7132700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f08a0156540 0x7f08a00c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a7132700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08a006eda0 0x7f08a00ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a7132700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a00acd60 con 0x7f08a00c75b0 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a7132700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a006f470 con 0x7f08a006eda0 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a7132700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a0156910 con 0x7f08a0156540 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a56cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08a006eda0 0x7f08a00ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a56cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08a006eda0 0x7f08a00ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58380/0 (socket says 172.21.15.84:58380) 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a56cf700 1 -- 172.21.15.84:0/3023028286 learned_addr learned my addr 172.21.15.84:0/3023028286 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a4ece700 1 --2- 172.21.15.84:0/3023028286 >> v2:172.21.15.131:3300/0 conn(0x7f08a0156540 0x7f08a00c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a56cf700 1 -- 172.21.15.84:0/3023028286 >> v2:172.21.15.131:3300/0 conn(0x7f08a0156540 msgr2=0x7f08a00c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a56cf700 1 --2- 172.21.15.84:0/3023028286 >> v2:172.21.15.131:3300/0 conn(0x7f08a0156540 0x7f08a00c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a56cf700 1 -- 172.21.15.84:0/3023028286 >> v1:172.21.15.131:6789/0 conn(0x7f08a00c75b0 legacy=0x7f08a006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a56cf700 1 -- 172.21.15.84:0/3023028286 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00c7b70 con 0x7f08a006eda0 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f08a56cf700 1 --2- 172.21.15.84:0/3023028286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a006eda0 0x7f08a00ad1f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f08a006fd80 tx=0x7f0890009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94057b5797f0cc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.162+0000 7f089f7fe700 1 -- 172.21.15.84:0/3023028286 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000b860 con 0x7f08a006eda0 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f089f7fe700 1 -- 172.21.15.84:0/3023028286 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089000b9c0 con 0x7f08a006eda0 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f089f7fe700 1 -- 172.21.15.84:0/3023028286 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000bd60 con 0x7f08a006eda0 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f08a7132700 1 -- 172.21.15.84:0/3023028286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a006eda0 msgr2=0x7f08a00ad1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f08a7132700 1 --2- 172.21.15.84:0/3023028286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a006eda0 0x7f08a00ad1f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f08a006fd80 tx=0x7f0890009250 comp rx=0 tx=0).stop 2023-10-06T03:00:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f08a7132700 1 -- 172.21.15.84:0/3023028286 shutdown_connections 2023-10-06T03:00:00.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f08a7132700 1 --2- 172.21.15.84:0/3023028286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a006eda0 0x7f08a00ad1f0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f08a7132700 1 --2- 172.21.15.84:0/3023028286 >> v2:172.21.15.131:3300/0 conn(0x7f08a0156540 0x7f08a00c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f08a7132700 1 -- 172.21.15.84:0/3023028286 >> 172.21.15.84:0/3023028286 conn(0x7f08a00680c0 msgr2=0x7f08a00cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f08a7132700 1 -- 172.21.15.84:0/3023028286 shutdown_connections 2023-10-06T03:00:00.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.163+0000 7f08a7132700 1 -- 172.21.15.84:0/3023028286 wait complete. 2023-10-06T03:00:00.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.164+0000 7f08a7132700 1 Processor -- start 2023-10-06T03:00:00.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.164+0000 7f08a7132700 1 -- start start 2023-10-06T03:00:00.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a7132700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08a006eda0 0x7f08a0159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a7132700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08a00c75b0 0x7f08a01535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a7132700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a0156540 0x7f08a015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a7132700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a015a360 con 0x7f08a0156540 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a7132700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a015a740 con 0x7f08a00c75b0 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a7132700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a015a9e0 con 0x7f08a006eda0 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a56cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a0156540 0x7f08a015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a56cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a0156540 0x7f08a015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58384/0 (socket says 172.21.15.84:58384) 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a56cf700 1 -- 172.21.15.84:0/1201638300 learned_addr learned my addr 172.21.15.84:0/1201638300 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a4ece700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08a006eda0 0x7f08a0159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f089ffff700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08a00c75b0 0x7f08a01535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a56cf700 1 -- 172.21.15.84:0/1201638300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08a006eda0 msgr2=0x7f08a0159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a56cf700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08a006eda0 0x7f08a0159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a56cf700 1 -- 172.21.15.84:0/1201638300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08a00c75b0 msgr2=0x7f08a01535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a56cf700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08a00c75b0 0x7f08a01535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.165+0000 7f08a56cf700 1 -- 172.21.15.84:0/1201638300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08900094f0 con 0x7f08a0156540 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.166+0000 7f08a56cf700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a0156540 0x7f08a015ae70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0890009290 tx=0x7f0890017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.166+0000 7f089cff9700 1 -- 172.21.15.84:0/1201638300 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089001a700 con 0x7f08a0156540 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.166+0000 7f089cff9700 1 -- 172.21.15.84:0/1201638300 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089001a860 con 0x7f08a0156540 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.166+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a00c6740 con 0x7f08a0156540 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.166+0000 7f089cff9700 1 -- 172.21.15.84:0/1201638300 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089001ac20 con 0x7f08a0156540 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.166+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a0159ff0 con 0x7f08a0156540 2023-10-06T03:00:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.167+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a0064ad0 con 0x7f08a0156540 2023-10-06T03:00:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.167+0000 7f089cff9700 1 -- 172.21.15.84:0/1201638300 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0890024440 con 0x7f08a0156540 2023-10-06T03:00:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.167+0000 7f089cff9700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f088c066f30 0x7f088c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.168+0000 7f089cff9700 1 -- 172.21.15.84:0/1201638300 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0890086710 con 0x7f08a0156540 2023-10-06T03:00:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.168+0000 7f08a4ece700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f088c066f30 0x7f088c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.168+0000 7f08a4ece700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f088c066f30 0x7f088c0693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0898007460 tx=0x7f089800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.172+0000 7f089cff9700 1 -- 172.21.15.84:0/1201638300 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08900536e0 con 0x7f08a0156540 2023-10-06T03:00:00.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.356+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08a015ab20 con 0x7f08a0156540 2023-10-06T03:00:00.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.357+0000 7f089cff9700 1 -- 172.21.15.84:0/1201638300 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f0890056d00 con 0x7f08a0156540 2023-10-06T03:00:00.359 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:00.359 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":82,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:59:57.647692+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:53.640511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:54.978352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:00.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f088c066f30 msgr2=0x7f088c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f088c066f30 0x7f088c0693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0898007460 tx=0x7f089800b040 comp rx=0 tx=0).stop 2023-10-06T03:00:00.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a0156540 msgr2=0x7f08a015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a0156540 0x7f08a015ae70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0890009290 tx=0x7f0890017000 comp rx=0 tx=0).stop 2023-10-06T03:00:00.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 shutdown_connections 2023-10-06T03:00:00.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f088c066f30 0x7f088c0693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f08a0156540 0x7f08a015ae70 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08a006eda0 0x7f08a0159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 --2- 172.21.15.84:0/1201638300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08a00c75b0 0x7f08a01535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 >> 172.21.15.84:0/1201638300 conn(0x7f08a00680c0 msgr2=0x7f08a0154000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 shutdown_connections 2023-10-06T03:00:00.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.359+0000 7f08a7132700 1 -- 172.21.15.84:0/1201638300 wait complete. 2023-10-06T03:00:00.373 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:00:00.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:00:00.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.486+0000 7ff210a06700 1 Processor -- start 2023-10-06T03:00:00.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.487+0000 7ff210a06700 1 -- start start 2023-10-06T03:00:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.487+0000 7ff210a06700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c0cbc70 0x7ff20c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.487+0000 7ff210a06700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff20c0b2140 0x7ff20c0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.487+0000 7ff210a06700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c0cb7e0 con 0x7ff20c159480 2023-10-06T03:00:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.487+0000 7ff210a06700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20c0b08a0 con 0x7ff20c0b2140 2023-10-06T03:00:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.487+0000 7ff210a06700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0cb190 con 0x7ff20c0cbc70 2023-10-06T03:00:00.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20a59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c0cbc70 0x7ff20c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20b59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff20c0b2140 0x7ff20c0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20a59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c0cbc70 0x7ff20c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:48234/0 (socket says 172.21.15.84:48234) 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20b59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff20c0b2140 0x7ff20c0b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:44856/0 (socket says 172.21.15.84:44856) 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20a59c700 1 -- 172.21.15.84:0/2105421374 learned_addr learned my addr 172.21.15.84:0/2105421374 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20ad9d700 1 --1- 172.21.15.84:0/2105421374 >> v1:172.21.15.131:6789/0 conn(0x7ff20c159480 0x7ff20c0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:58888/0 (socket says 172.21.15.84:58888) 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20a59c700 1 -- 172.21.15.84:0/2105421374 >> v2:172.21.15.131:3300/0 conn(0x7ff20c0b2140 msgr2=0x7ff20c0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20a59c700 1 --2- 172.21.15.84:0/2105421374 >> v2:172.21.15.131:3300/0 conn(0x7ff20c0b2140 0x7ff20c0b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20a59c700 1 -- 172.21.15.84:0/2105421374 >> v1:172.21.15.131:6789/0 conn(0x7ff20c159480 legacy=0x7ff20c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20a59c700 1 -- 172.21.15.84:0/2105421374 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0cb470 con 0x7ff20c0cbc70 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff209d9b700 1 -- 172.21.15.84:0/2105421374 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825749014 0 0) 0x7ff20c0cb7e0 con 0x7ff20c159480 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20b59e700 1 --2- 172.21.15.84:0/2105421374 >> v2:172.21.15.131:3300/0 conn(0x7ff20c0b2140 0x7ff20c0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:00.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff20a59c700 1 --2- 172.21.15.84:0/2105421374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c0cbc70 0x7ff20c0cc0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2000099b0 tx=0x7ff200009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec0e42e18862224 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff209d9b700 1 -- 172.21.15.84:0/2105421374 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200009ea0 con 0x7ff20c0cbc70 2023-10-06T03:00:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff209d9b700 1 -- 172.21.15.84:0/2105421374 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20000b860 con 0x7ff20c0cbc70 2023-10-06T03:00:00.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.488+0000 7ff209d9b700 1 -- 172.21.15.84:0/2105421374 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20000bc00 con 0x7ff20c0cbc70 2023-10-06T03:00:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.489+0000 7ff210a06700 1 -- 172.21.15.84:0/2105421374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c0cbc70 msgr2=0x7ff20c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.489+0000 7ff210a06700 1 --2- 172.21.15.84:0/2105421374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c0cbc70 0x7ff20c0cc0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2000099b0 tx=0x7ff200009250 comp rx=0 tx=0).stop 2023-10-06T03:00:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.489+0000 7ff210a06700 1 -- 172.21.15.84:0/2105421374 shutdown_connections 2023-10-06T03:00:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.489+0000 7ff210a06700 1 --2- 172.21.15.84:0/2105421374 >> v2:172.21.15.131:3300/0 conn(0x7ff20c0b2140 0x7ff20c0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.489+0000 7ff210a06700 1 --2- 172.21.15.84:0/2105421374 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c0cbc70 0x7ff20c0cc0c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.489+0000 7ff210a06700 1 -- 172.21.15.84:0/2105421374 >> 172.21.15.84:0/2105421374 conn(0x7ff20c06ed20 msgr2=0x7ff20c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.489+0000 7ff210a06700 1 -- 172.21.15.84:0/2105421374 shutdown_connections 2023-10-06T03:00:00.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.489+0000 7ff210a06700 1 -- 172.21.15.84:0/2105421374 wait complete. 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.490+0000 7ff210a06700 1 Processor -- start 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.490+0000 7ff210a06700 1 -- start start 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff210a06700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20c0b2140 0x7ff20c16a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff210a06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff20c0cbc70 0x7ff20c0af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff210a06700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c159480 0x7ff20c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff210a06700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c169e70 con 0x7ff20c0b2140 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff210a06700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c8740 con 0x7ff20c0cbc70 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff210a06700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c0c8a20 con 0x7ff20c159480 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20c0b2140 0x7ff20c16a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20c0b2140 0x7ff20c16a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58394/0 (socket says 172.21.15.84:58394) 2023-10-06T03:00:00.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20ad9d700 1 -- 172.21.15.84:0/2037916997 learned_addr learned my addr 172.21.15.84:0/2037916997 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20a59c700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff20c0cbc70 0x7ff20c0af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20b59e700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c159480 0x7ff20c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20ad9d700 1 -- 172.21.15.84:0/2037916997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c159480 msgr2=0x7ff20c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20ad9d700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c159480 0x7ff20c0ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20ad9d700 1 -- 172.21.15.84:0/2037916997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff20c0cbc70 msgr2=0x7ff20c0af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20ad9d700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff20c0cbc70 0x7ff20c0af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20ad9d700 1 -- 172.21.15.84:0/2037916997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204009a20 con 0x7ff20c0b2140 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.491+0000 7ff20a59c700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff20c0cbc70 0x7ff20c0af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.492+0000 7ff20ad9d700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20c0b2140 0x7ff20c16a300 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00c5b0 tx=0x7ff1fc001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.492+0000 7ff1f2ffd700 1 -- 172.21.15.84:0/2037916997 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc005a70 con 0x7ff20c0b2140 2023-10-06T03:00:00.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.492+0000 7ff1f2ffd700 1 -- 172.21.15.84:0/2037916997 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc005bd0 con 0x7ff20c0b2140 2023-10-06T03:00:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.492+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2000094f0 con 0x7ff20c0b2140 2023-10-06T03:00:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.492+0000 7ff1f2ffd700 1 -- 172.21.15.84:0/2037916997 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0070d0 con 0x7ff20c0b2140 2023-10-06T03:00:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.492+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c169b00 con 0x7ff20c0b2140 2023-10-06T03:00:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.493+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c05f270 con 0x7ff20c0b2140 2023-10-06T03:00:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.493+0000 7ff1f2ffd700 1 -- 172.21.15.84:0/2037916997 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1fc007480 con 0x7ff20c0b2140 2023-10-06T03:00:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.493+0000 7ff1f2ffd700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff1f8066f30 0x7ff1f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.493+0000 7ff1f2ffd700 1 -- 172.21.15.84:0/2037916997 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff1fc083cf0 con 0x7ff20c0b2140 2023-10-06T03:00:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.493+0000 7ff20a59c700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff1f8066f30 0x7ff1f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.494+0000 7ff20a59c700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff1f8066f30 0x7ff1f80693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff2000099b0 tx=0x7ff200017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.497+0000 7ff1f2ffd700 1 -- 172.21.15.84:0/2037916997 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1fc088070 con 0x7ff20c0b2140 2023-10-06T03:00:00.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.679+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff20c169fb0 con 0x7ff1f8066f30 2023-10-06T03:00:00.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.687+0000 7ff1f2ffd700 1 -- 172.21.15.84:0/2037916997 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311604 (secure 0 0 0) 0x7ff20000b9d0 con 0x7ff1f8066f30 2023-10-06T03:00:00.692 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff1f8066f30 msgr2=0x7ff1f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff1f8066f30 0x7ff1f80693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff2000099b0 tx=0x7ff200017000 comp rx=0 tx=0).stop 2023-10-06T03:00:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20c0b2140 msgr2=0x7ff20c16a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20c0b2140 0x7ff20c16a300 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00c5b0 tx=0x7ff1fc001040 comp rx=0 tx=0).stop 2023-10-06T03:00:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 shutdown_connections 2023-10-06T03:00:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff1f8066f30 0x7ff1f80693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff20c159480 0x7ff20c0ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20c0b2140 0x7ff20c16a300 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 --2- 172.21.15.84:0/2037916997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff20c0cbc70 0x7ff20c0af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 >> 172.21.15.84:0/2037916997 conn(0x7ff20c06ed20 msgr2=0x7ff20c1558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 shutdown_connections 2023-10-06T03:00:00.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.690+0000 7ff210a06700 1 -- 172.21.15.84:0/2037916997 wait complete. 2023-10-06T03:00:00.696 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:00:00.704 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2023-10-06T02:59:59.866797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387356,"kb_used_data":9052,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752587364,"statfs":{"total":773094113280,"available":770649460736,"internally_reserved":0,"allocated":9269248,"data_stored":5013795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.249237"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665690+0000","last_change":"2023-10-06T02:59:56.661485+0000","last_active":"2023-10-06T02:59:56.665690+0000","last_peered":"2023-10-06T02:59:56.665690+0000","last_clean":"2023-10-06T02:59:56.665690+0000","last_became_active":"2023-10-06T02:59:56.661288+0000","last_became_peered":"2023-10-06T02:59:56.661288+0000","last_unstale":"2023-10-06T02:59:56.665690+0000","last_undegraded":"2023-10-06T02:59:56.665690+0000","last_fullsized":"2023-10-06T02:59:56.665690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:43.075027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670720+0000","last_change":"2023-10-06T02:59:56.666187+0000","last_active":"2023-10-06T02:59:56.670720+0000","last_peered":"2023-10-06T02:59:56.670720+0000","last_clean":"2023-10-06T02:59:56.670720+0000","last_became_active":"2023-10-06T02:59:56.665910+0000","last_became_peered":"2023-10-06T02:59:56.665910+0000","last_unstale":"2023-10-06T02:59:56.670720+0000","last_undegraded":"2023-10-06T02:59:56.670720+0000","last_fullsized":"2023-10-06T02:59:56.670720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:29.377466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662693+0000","last_change":"2023-10-06T02:59:56.656568+0000","last_active":"2023-10-06T02:59:56.662693+0000","last_peered":"2023-10-06T02:59:56.662693+0000","last_clean":"2023-10-06T02:59:56.662693+0000","last_became_active":"2023-10-06T02:59:56.656278+0000","last_became_peered":"2023-10-06T02:59:56.656278+0000","last_unstale":"2023-10-06T02:59:56.662693+0000","last_undegraded":"2023-10-06T02:59:56.662693+0000","last_fullsized":"2023-10-06T02:59:56.662693+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:35.596056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659303+0000","last_change":"2023-10-06T02:59:56.657843+0000","last_active":"2023-10-06T02:59:56.659303+0000","last_peered":"2023-10-06T02:59:56.659303+0000","last_clean":"2023-10-06T02:59:56.659303+0000","last_became_active":"2023-10-06T02:59:56.657563+0000","last_became_peered":"2023-10-06T02:59:56.657563+0000","last_unstale":"2023-10-06T02:59:56.659303+0000","last_undegraded":"2023-10-06T02:59:56.659303+0000","last_fullsized":"2023-10-06T02:59:56.659303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:25.633106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666582+0000","last_change":"2023-10-06T02:59:56.658697+0000","last_active":"2023-10-06T02:59:56.666582+0000","last_peered":"2023-10-06T02:59:56.666582+0000","last_clean":"2023-10-06T02:59:56.666582+0000","last_became_active":"2023-10-06T02:59:56.658062+0000","last_became_peered":"2023-10-06T02:59:56.658062+0000","last_unstale":"2023-10-06T02:59:56.666582+0000","last_undegraded":"2023-10-06T02:59:56.666582+0000","last_fullsized":"2023-10-06T02:59:56.666582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:31.919923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658017+0000","last_change":"2023-10-06T02:59:56.654939+0000","last_active":"2023-10-06T02:59:56.658017+0000","last_peered":"2023-10-06T02:59:56.658017+0000","last_clean":"2023-10-06T02:59:56.658017+0000","last_became_active":"2023-10-06T02:59:56.654308+0000","last_became_peered":"2023-10-06T02:59:56.654308+0000","last_unstale":"2023-10-06T02:59:56.658017+0000","last_undegraded":"2023-10-06T02:59:56.658017+0000","last_fullsized":"2023-10-06T02:59:56.658017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:10.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659356+0000","last_change":"2023-10-06T02:59:56.656584+0000","last_active":"2023-10-06T02:59:56.659356+0000","last_peered":"2023-10-06T02:59:56.659356+0000","last_clean":"2023-10-06T02:59:56.659356+0000","last_became_active":"2023-10-06T02:59:56.656344+0000","last_became_peered":"2023-10-06T02:59:56.656344+0000","last_unstale":"2023-10-06T02:59:56.659356+0000","last_undegraded":"2023-10-06T02:59:56.659356+0000","last_fullsized":"2023-10-06T02:59:56.659356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:12.031313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.657920+0000","last_change":"2023-10-06T02:59:56.655169+0000","last_active":"2023-10-06T02:59:56.657920+0000","last_peered":"2023-10-06T02:59:56.657920+0000","last_clean":"2023-10-06T02:59:56.657920+0000","last_became_active":"2023-10-06T02:59:56.654914+0000","last_became_peered":"2023-10-06T02:59:56.654914+0000","last_unstale":"2023-10-06T02:59:56.657920+0000","last_undegraded":"2023-10-06T02:59:56.657920+0000","last_fullsized":"2023-10-06T02:59:56.657920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:36.314580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.657447+0000","last_change":"2023-10-06T02:59:56.653495+0000","last_active":"2023-10-06T02:59:56.657447+0000","last_peered":"2023-10-06T02:59:56.657447+0000","last_clean":"2023-10-06T02:59:56.657447+0000","last_became_active":"2023-10-06T02:59:56.653246+0000","last_became_peered":"2023-10-06T02:59:56.653246+0000","last_unstale":"2023-10-06T02:59:56.657447+0000","last_undegraded":"2023-10-06T02:59:56.657447+0000","last_fullsized":"2023-10-06T02:59:56.657447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:06.399442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665719+0000","last_change":"2023-10-06T02:59:56.661183+0000","last_active":"2023-10-06T02:59:56.665719+0000","last_peered":"2023-10-06T02:59:56.665719+0000","last_clean":"2023-10-06T02:59:56.665719+0000","last_became_active":"2023-10-06T02:59:56.660988+0000","last_became_peered":"2023-10-06T02:59:56.660988+0000","last_unstale":"2023-10-06T02:59:56.665719+0000","last_undegraded":"2023-10-06T02:59:56.665719+0000","last_fullsized":"2023-10-06T02:59:56.665719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:35.208092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666095+0000","last_change":"2023-10-06T02:59:56.660285+0000","last_active":"2023-10-06T02:59:56.666095+0000","last_peered":"2023-10-06T02:59:56.666095+0000","last_clean":"2023-10-06T02:59:56.666095+0000","last_became_active":"2023-10-06T02:59:56.660053+0000","last_became_peered":"2023-10-06T02:59:56.660053+0000","last_unstale":"2023-10-06T02:59:56.666095+0000","last_undegraded":"2023-10-06T02:59:56.666095+0000","last_fullsized":"2023-10-06T02:59:56.666095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:32.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662891+0000","last_change":"2023-10-06T02:59:56.654842+0000","last_active":"2023-10-06T02:59:56.662891+0000","last_peered":"2023-10-06T02:59:56.662891+0000","last_clean":"2023-10-06T02:59:56.662891+0000","last_became_active":"2023-10-06T02:59:56.654489+0000","last_became_peered":"2023-10-06T02:59:56.654489+0000","last_unstale":"2023-10-06T02:59:56.662891+0000","last_undegraded":"2023-10-06T02:59:56.662891+0000","last_fullsized":"2023-10-06T02:59:56.662891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:48.042666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666369+0000","last_change":"2023-10-06T02:59:56.659176+0000","last_active":"2023-10-06T02:59:56.666369+0000","last_peered":"2023-10-06T02:59:56.666369+0000","last_clean":"2023-10-06T02:59:56.666369+0000","last_became_active":"2023-10-06T02:59:56.658895+0000","last_became_peered":"2023-10-06T02:59:56.658895+0000","last_unstale":"2023-10-06T02:59:56.666369+0000","last_undegraded":"2023-10-06T02:59:56.666369+0000","last_fullsized":"2023-10-06T02:59:56.666369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:32.920598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659517+0000","last_change":"2023-10-06T02:59:56.656063+0000","last_active":"2023-10-06T02:59:56.659517+0000","last_peered":"2023-10-06T02:59:56.659517+0000","last_clean":"2023-10-06T02:59:56.659517+0000","last_became_active":"2023-10-06T02:59:56.655482+0000","last_became_peered":"2023-10-06T02:59:56.655482+0000","last_unstale":"2023-10-06T02:59:56.659517+0000","last_undegraded":"2023-10-06T02:59:56.659517+0000","last_fullsized":"2023-10-06T02:59:56.659517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.821733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658409+0000","last_change":"2023-10-06T02:59:56.650361+0000","last_active":"2023-10-06T02:59:56.658409+0000","last_peered":"2023-10-06T02:59:56.658409+0000","last_clean":"2023-10-06T02:59:56.658409+0000","last_became_active":"2023-10-06T02:59:56.650083+0000","last_became_peered":"2023-10-06T02:59:56.650083+0000","last_unstale":"2023-10-06T02:59:56.658409+0000","last_undegraded":"2023-10-06T02:59:56.658409+0000","last_fullsized":"2023-10-06T02:59:56.658409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:54.006924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673217+0000","last_change":"2023-10-06T02:59:56.667057+0000","last_active":"2023-10-06T02:59:56.673217+0000","last_peered":"2023-10-06T02:59:56.673217+0000","last_clean":"2023-10-06T02:59:56.673217+0000","last_became_active":"2023-10-06T02:59:56.666795+0000","last_became_peered":"2023-10-06T02:59:56.666795+0000","last_unstale":"2023-10-06T02:59:56.673217+0000","last_undegraded":"2023-10-06T02:59:56.673217+0000","last_fullsized":"2023-10-06T02:59:56.673217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:22.069667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670634+0000","last_change":"2023-10-06T02:59:56.660089+0000","last_active":"2023-10-06T02:59:56.670634+0000","last_peered":"2023-10-06T02:59:56.670634+0000","last_clean":"2023-10-06T02:59:56.670634+0000","last_became_active":"2023-10-06T02:59:56.659671+0000","last_became_peered":"2023-10-06T02:59:56.659671+0000","last_unstale":"2023-10-06T02:59:56.670634+0000","last_undegraded":"2023-10-06T02:59:56.670634+0000","last_fullsized":"2023-10-06T02:59:56.670634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:26.258422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659331+0000","last_change":"2023-10-06T02:59:56.656638+0000","last_active":"2023-10-06T02:59:56.659331+0000","last_peered":"2023-10-06T02:59:56.659331+0000","last_clean":"2023-10-06T02:59:56.659331+0000","last_became_active":"2023-10-06T02:59:56.656407+0000","last_became_peered":"2023-10-06T02:59:56.656407+0000","last_unstale":"2023-10-06T02:59:56.659331+0000","last_undegraded":"2023-10-06T02:59:56.659331+0000","last_fullsized":"2023-10-06T02:59:56.659331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.468260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.664557+0000","last_change":"2023-10-06T02:59:56.652294+0000","last_active":"2023-10-06T02:59:56.664557+0000","last_peered":"2023-10-06T02:59:56.664557+0000","last_clean":"2023-10-06T02:59:56.664557+0000","last_became_active":"2023-10-06T02:59:56.652044+0000","last_became_peered":"2023-10-06T02:59:56.652044+0000","last_unstale":"2023-10-06T02:59:56.664557+0000","last_undegraded":"2023-10-06T02:59:56.664557+0000","last_fullsized":"2023-10-06T02:59:56.664557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:38.800621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.648922+0000","last_change":"2023-10-06T02:59:56.646557+0000","last_active":"2023-10-06T02:59:56.648922+0000","last_peered":"2023-10-06T02:59:56.648922+0000","last_clean":"2023-10-06T02:59:56.648922+0000","last_became_active":"2023-10-06T02:59:56.646319+0000","last_became_peered":"2023-10-06T02:59:56.646319+0000","last_unstale":"2023-10-06T02:59:56.648922+0000","last_undegraded":"2023-10-06T02:59:56.648922+0000","last_fullsized":"2023-10-06T02:59:56.648922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:11.278752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658353+0000","last_change":"2023-10-06T02:59:56.649886+0000","last_active":"2023-10-06T02:59:56.658353+0000","last_peered":"2023-10-06T02:59:56.658353+0000","last_clean":"2023-10-06T02:59:56.658353+0000","last_became_active":"2023-10-06T02:59:56.649691+0000","last_became_peered":"2023-10-06T02:59:56.649691+0000","last_unstale":"2023-10-06T02:59:56.658353+0000","last_undegraded":"2023-10-06T02:59:56.658353+0000","last_fullsized":"2023-10-06T02:59:56.658353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:51.279379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666119+0000","last_change":"2023-10-06T02:59:56.663324+0000","last_active":"2023-10-06T02:59:56.666119+0000","last_peered":"2023-10-06T02:59:56.666119+0000","last_clean":"2023-10-06T02:59:56.666119+0000","last_became_active":"2023-10-06T02:59:56.663051+0000","last_became_peered":"2023-10-06T02:59:56.663051+0000","last_unstale":"2023-10-06T02:59:56.666119+0000","last_undegraded":"2023-10-06T02:59:56.666119+0000","last_fullsized":"2023-10-06T02:59:56.666119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:41.619380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.655926+0000","last_change":"2023-10-06T02:59:56.652402+0000","last_active":"2023-10-06T02:59:56.655926+0000","last_peered":"2023-10-06T02:59:56.655926+0000","last_clean":"2023-10-06T02:59:56.655926+0000","last_became_active":"2023-10-06T02:59:56.652163+0000","last_became_peered":"2023-10-06T02:59:56.652163+0000","last_unstale":"2023-10-06T02:59:56.655926+0000","last_undegraded":"2023-10-06T02:59:56.655926+0000","last_fullsized":"2023-10-06T02:59:56.655926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:58.373420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658491+0000","last_change":"2023-10-06T02:59:56.649622+0000","last_active":"2023-10-06T02:59:56.658491+0000","last_peered":"2023-10-06T02:59:56.658491+0000","last_clean":"2023-10-06T02:59:56.658491+0000","last_became_active":"2023-10-06T02:59:56.649355+0000","last_became_peered":"2023-10-06T02:59:56.649355+0000","last_unstale":"2023-10-06T02:59:56.658491+0000","last_undegraded":"2023-10-06T02:59:56.658491+0000","last_fullsized":"2023-10-06T02:59:56.658491+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:12.927685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668022+0000","last_change":"2023-10-06T02:59:56.664888+0000","last_active":"2023-10-06T02:59:56.668022+0000","last_peered":"2023-10-06T02:59:56.668022+0000","last_clean":"2023-10-06T02:59:56.668022+0000","last_became_active":"2023-10-06T02:59:56.664648+0000","last_became_peered":"2023-10-06T02:59:56.664648+0000","last_unstale":"2023-10-06T02:59:56.668022+0000","last_undegraded":"2023-10-06T02:59:56.668022+0000","last_fullsized":"2023-10-06T02:59:56.668022+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.036915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668451+0000","last_change":"2023-10-06T02:59:56.664480+0000","last_active":"2023-10-06T02:59:56.668451+0000","last_peered":"2023-10-06T02:59:56.668451+0000","last_clean":"2023-10-06T02:59:56.668451+0000","last_became_active":"2023-10-06T02:59:56.664148+0000","last_became_peered":"2023-10-06T02:59:56.664148+0000","last_unstale":"2023-10-06T02:59:56.668451+0000","last_undegraded":"2023-10-06T02:59:56.668451+0000","last_fullsized":"2023-10-06T02:59:56.668451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:25.698974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673143+0000","last_change":"2023-10-06T02:59:56.665876+0000","last_active":"2023-10-06T02:59:56.673143+0000","last_peered":"2023-10-06T02:59:56.673143+0000","last_clean":"2023-10-06T02:59:56.673143+0000","last_became_active":"2023-10-06T02:59:56.664856+0000","last_became_peered":"2023-10-06T02:59:56.664856+0000","last_unstale":"2023-10-06T02:59:56.673143+0000","last_undegraded":"2023-10-06T02:59:56.673143+0000","last_fullsized":"2023-10-06T02:59:56.673143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:30.130330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665618+0000","last_change":"2023-10-06T02:59:56.660820+0000","last_active":"2023-10-06T02:59:56.665618+0000","last_peered":"2023-10-06T02:59:56.665618+0000","last_clean":"2023-10-06T02:59:56.665618+0000","last_became_active":"2023-10-06T02:59:56.660541+0000","last_became_peered":"2023-10-06T02:59:56.660541+0000","last_unstale":"2023-10-06T02:59:56.665618+0000","last_undegraded":"2023-10-06T02:59:56.665618+0000","last_fullsized":"2023-10-06T02:59:56.665618+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:30.732207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670748+0000","last_change":"2023-10-06T02:59:56.666626+0000","last_active":"2023-10-06T02:59:56.670748+0000","last_peered":"2023-10-06T02:59:56.670748+0000","last_clean":"2023-10-06T02:59:56.670748+0000","last_became_active":"2023-10-06T02:59:56.666387+0000","last_became_peered":"2023-10-06T02:59:56.666387+0000","last_unstale":"2023-10-06T02:59:56.670748+0000","last_undegraded":"2023-10-06T02:59:56.670748+0000","last_fullsized":"2023-10-06T02:59:56.670748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:43.892640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.667962+0000","last_change":"2023-10-06T02:59:56.664402+0000","last_active":"2023-10-06T02:59:56.667962+0000","last_peered":"2023-10-06T02:59:56.667962+0000","last_clean":"2023-10-06T02:59:56.667962+0000","last_became_active":"2023-10-06T02:59:56.664140+0000","last_became_peered":"2023-10-06T02:59:56.664140+0000","last_unstale":"2023-10-06T02:59:56.667962+0000","last_undegraded":"2023-10-06T02:59:56.667962+0000","last_fullsized":"2023-10-06T02:59:56.667962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:36.940585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673083+0000","last_change":"2023-10-06T02:59:56.665009+0000","last_active":"2023-10-06T02:59:56.673083+0000","last_peered":"2023-10-06T02:59:56.673083+0000","last_clean":"2023-10-06T02:59:56.673083+0000","last_became_active":"2023-10-06T02:59:56.664623+0000","last_became_peered":"2023-10-06T02:59:56.664623+0000","last_unstale":"2023-10-06T02:59:56.673083+0000","last_undegraded":"2023-10-06T02:59:56.673083+0000","last_fullsized":"2023-10-06T02:59:56.673083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:38.800621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666147+0000","last_change":"2023-10-06T02:59:56.662117+0000","last_active":"2023-10-06T02:59:56.666147+0000","last_peered":"2023-10-06T02:59:56.666147+0000","last_clean":"2023-10-06T02:59:56.666147+0000","last_became_active":"2023-10-06T02:59:56.660614+0000","last_became_peered":"2023-10-06T02:59:56.660614+0000","last_unstale":"2023-10-06T02:59:56.666147+0000","last_undegraded":"2023-10-06T02:59:56.666147+0000","last_fullsized":"2023-10-06T02:59:56.666147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:05.223973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670509+0000","last_change":"2023-10-06T02:59:56.663942+0000","last_active":"2023-10-06T02:59:56.670509+0000","last_peered":"2023-10-06T02:59:56.670509+0000","last_clean":"2023-10-06T02:59:56.670509+0000","last_became_active":"2023-10-06T02:59:56.663665+0000","last_became_peered":"2023-10-06T02:59:56.663665+0000","last_unstale":"2023-10-06T02:59:56.670509+0000","last_undegraded":"2023-10-06T02:59:56.670509+0000","last_fullsized":"2023-10-06T02:59:56.670509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:32.631059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"81'4","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.672270+0000","last_change":"2023-10-06T02:59:55.637735+0000","last_active":"2023-10-06T02:59:56.672270+0000","last_peered":"2023-10-06T02:59:56.672270+0000","last_clean":"2023-10-06T02:59:56.672270+0000","last_became_active":"2023-10-06T02:59:55.637191+0000","last_became_peered":"2023-10-06T02:59:55.637191+0000","last_unstale":"2023-10-06T02:59:56.672270+0000","last_undegraded":"2023-10-06T02:59:56.672270+0000","last_fullsized":"2023-10-06T02:59:56.672270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:05.335315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.655893+0000","last_change":"2023-10-06T02:59:56.652804+0000","last_active":"2023-10-06T02:59:56.655893+0000","last_peered":"2023-10-06T02:59:56.655893+0000","last_clean":"2023-10-06T02:59:56.655893+0000","last_became_active":"2023-10-06T02:59:56.652501+0000","last_became_peered":"2023-10-06T02:59:56.652501+0000","last_unstale":"2023-10-06T02:59:56.655893+0000","last_undegraded":"2023-10-06T02:59:56.655893+0000","last_fullsized":"2023-10-06T02:59:56.655893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.845214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673114+0000","last_change":"2023-10-06T02:59:55.639800+0000","last_active":"2023-10-06T02:59:56.673114+0000","last_peered":"2023-10-06T02:59:56.673114+0000","last_clean":"2023-10-06T02:59:56.673114+0000","last_became_active":"2023-10-06T02:59:55.639600+0000","last_became_peered":"2023-10-06T02:59:55.639600+0000","last_unstale":"2023-10-06T02:59:56.673114+0000","last_undegraded":"2023-10-06T02:59:56.673114+0000","last_fullsized":"2023-10-06T02:59:56.673114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:09.958622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662973+0000","last_change":"2023-10-06T02:59:56.655989+0000","last_active":"2023-10-06T02:59:56.662973+0000","last_peered":"2023-10-06T02:59:56.662973+0000","last_clean":"2023-10-06T02:59:56.662973+0000","last_became_active":"2023-10-06T02:59:56.655139+0000","last_became_peered":"2023-10-06T02:59:56.655139+0000","last_unstale":"2023-10-06T02:59:56.662973+0000","last_undegraded":"2023-10-06T02:59:56.662973+0000","last_fullsized":"2023-10-06T02:59:56.662973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:02.711247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.669624+0000","last_change":"2023-10-06T02:59:55.636721+0000","last_active":"2023-10-06T02:59:56.669624+0000","last_peered":"2023-10-06T02:59:56.669624+0000","last_clean":"2023-10-06T02:59:56.669624+0000","last_became_active":"2023-10-06T02:59:55.636460+0000","last_became_peered":"2023-10-06T02:59:55.636460+0000","last_unstale":"2023-10-06T02:59:56.669624+0000","last_undegraded":"2023-10-06T02:59:56.669624+0000","last_fullsized":"2023-10-06T02:59:56.669624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:31.911032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665978+0000","last_change":"2023-10-06T02:59:56.659468+0000","last_active":"2023-10-06T02:59:56.665978+0000","last_peered":"2023-10-06T02:59:56.665978+0000","last_clean":"2023-10-06T02:59:56.665978+0000","last_became_active":"2023-10-06T02:59:56.659192+0000","last_became_peered":"2023-10-06T02:59:56.659192+0000","last_unstale":"2023-10-06T02:59:56.665978+0000","last_undegraded":"2023-10-06T02:59:56.665978+0000","last_fullsized":"2023-10-06T02:59:56.665978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:26.466442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.669010+0000","last_change":"2023-10-06T02:59:55.641777+0000","last_active":"2023-10-06T02:59:56.669010+0000","last_peered":"2023-10-06T02:59:56.669010+0000","last_clean":"2023-10-06T02:59:56.669010+0000","last_became_active":"2023-10-06T02:59:55.641517+0000","last_became_peered":"2023-10-06T02:59:55.641517+0000","last_unstale":"2023-10-06T02:59:56.669010+0000","last_undegraded":"2023-10-06T02:59:56.669010+0000","last_fullsized":"2023-10-06T02:59:56.669010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:13.255613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670782+0000","last_change":"2023-10-06T02:59:56.666015+0000","last_active":"2023-10-06T02:59:56.670782+0000","last_peered":"2023-10-06T02:59:56.670782+0000","last_clean":"2023-10-06T02:59:56.670782+0000","last_became_active":"2023-10-06T02:59:56.665698+0000","last_became_peered":"2023-10-06T02:59:56.665698+0000","last_unstale":"2023-10-06T02:59:56.670782+0000","last_undegraded":"2023-10-06T02:59:56.670782+0000","last_fullsized":"2023-10-06T02:59:56.670782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:06.344880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673264+0000","last_change":"2023-10-06T02:59:55.633418+0000","last_active":"2023-10-06T02:59:56.673264+0000","last_peered":"2023-10-06T02:59:56.673264+0000","last_clean":"2023-10-06T02:59:56.673264+0000","last_became_active":"2023-10-06T02:59:55.633078+0000","last_became_peered":"2023-10-06T02:59:55.633078+0000","last_unstale":"2023-10-06T02:59:56.673264+0000","last_undegraded":"2023-10-06T02:59:56.673264+0000","last_fullsized":"2023-10-06T02:59:56.673264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:09.065254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670503+0000","last_change":"2023-10-06T02:59:56.660071+0000","last_active":"2023-10-06T02:59:56.670503+0000","last_peered":"2023-10-06T02:59:56.670503+0000","last_clean":"2023-10-06T02:59:56.670503+0000","last_became_active":"2023-10-06T02:59:56.659776+0000","last_became_peered":"2023-10-06T02:59:56.659776+0000","last_unstale":"2023-10-06T02:59:56.670503+0000","last_undegraded":"2023-10-06T02:59:56.670503+0000","last_fullsized":"2023-10-06T02:59:56.670503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:29.271660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673106+0000","last_change":"2023-10-06T02:59:55.635392+0000","last_active":"2023-10-06T02:59:56.673106+0000","last_peered":"2023-10-06T02:59:56.673106+0000","last_clean":"2023-10-06T02:59:56.673106+0000","last_became_active":"2023-10-06T02:59:55.635106+0000","last_became_peered":"2023-10-06T02:59:55.635106+0000","last_unstale":"2023-10-06T02:59:56.673106+0000","last_undegraded":"2023-10-06T02:59:56.673106+0000","last_fullsized":"2023-10-06T02:59:56.673106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:15.161292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673471+0000","last_change":"2023-10-06T02:59:56.669446+0000","last_active":"2023-10-06T02:59:56.673471+0000","last_peered":"2023-10-06T02:59:56.673471+0000","last_clean":"2023-10-06T02:59:56.673471+0000","last_became_active":"2023-10-06T02:59:56.669234+0000","last_became_peered":"2023-10-06T02:59:56.669234+0000","last_unstale":"2023-10-06T02:59:56.673471+0000","last_undegraded":"2023-10-06T02:59:56.673471+0000","last_fullsized":"2023-10-06T02:59:56.673471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:18.024863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644550+0000","last_change":"2023-10-06T02:59:55.633504+0000","last_active":"2023-10-06T02:59:56.644550+0000","last_peered":"2023-10-06T02:59:56.644550+0000","last_clean":"2023-10-06T02:59:56.644550+0000","last_became_active":"2023-10-06T02:59:55.633209+0000","last_became_peered":"2023-10-06T02:59:55.633209+0000","last_unstale":"2023-10-06T02:59:56.644550+0000","last_undegraded":"2023-10-06T02:59:56.644550+0000","last_fullsized":"2023-10-06T02:59:56.644550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:00.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658390+0000","last_change":"2023-10-06T02:59:56.649950+0000","last_active":"2023-10-06T02:59:56.658390+0000","last_peered":"2023-10-06T02:59:56.658390+0000","last_clean":"2023-10-06T02:59:56.658390+0000","last_became_active":"2023-10-06T02:59:56.649733+0000","last_became_peered":"2023-10-06T02:59:56.649733+0000","last_unstale":"2023-10-06T02:59:56.658390+0000","last_undegraded":"2023-10-06T02:59:56.658390+0000","last_fullsized":"2023-10-06T02:59:56.658390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:29.193834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.650790+0000","last_change":"2023-10-06T02:59:55.640720+0000","last_active":"2023-10-06T02:59:56.650790+0000","last_peered":"2023-10-06T02:59:56.650790+0000","last_clean":"2023-10-06T02:59:56.650790+0000","last_became_active":"2023-10-06T02:59:55.640473+0000","last_became_peered":"2023-10-06T02:59:55.640473+0000","last_unstale":"2023-10-06T02:59:56.650790+0000","last_undegraded":"2023-10-06T02:59:56.650790+0000","last_fullsized":"2023-10-06T02:59:56.650790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:22.962186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.660342+0000","last_change":"2023-10-06T02:59:56.655193+0000","last_active":"2023-10-06T02:59:56.660342+0000","last_peered":"2023-10-06T02:59:56.660342+0000","last_clean":"2023-10-06T02:59:56.660342+0000","last_became_active":"2023-10-06T02:59:56.654888+0000","last_became_peered":"2023-10-06T02:59:56.654888+0000","last_unstale":"2023-10-06T02:59:56.660342+0000","last_undegraded":"2023-10-06T02:59:56.660342+0000","last_fullsized":"2023-10-06T02:59:56.660342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:22.069667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645254+0000","last_change":"2023-10-06T02:59:55.637889+0000","last_active":"2023-10-06T02:59:56.645254+0000","last_peered":"2023-10-06T02:59:56.645254+0000","last_clean":"2023-10-06T02:59:56.645254+0000","last_became_active":"2023-10-06T02:59:55.637575+0000","last_became_peered":"2023-10-06T02:59:55.637575+0000","last_unstale":"2023-10-06T02:59:56.645254+0000","last_undegraded":"2023-10-06T02:59:56.645254+0000","last_fullsized":"2023-10-06T02:59:56.645254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:42.883074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.657428+0000","last_change":"2023-10-06T02:59:56.651050+0000","last_active":"2023-10-06T02:59:56.657428+0000","last_peered":"2023-10-06T02:59:56.657428+0000","last_clean":"2023-10-06T02:59:56.657428+0000","last_became_active":"2023-10-06T02:59:56.650805+0000","last_became_peered":"2023-10-06T02:59:56.650805+0000","last_unstale":"2023-10-06T02:59:56.657428+0000","last_undegraded":"2023-10-06T02:59:56.657428+0000","last_fullsized":"2023-10-06T02:59:56.657428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:25.698974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645902+0000","last_change":"2023-10-06T02:59:55.635033+0000","last_active":"2023-10-06T02:59:56.645902+0000","last_peered":"2023-10-06T02:59:56.645902+0000","last_clean":"2023-10-06T02:59:56.645902+0000","last_became_active":"2023-10-06T02:59:55.634743+0000","last_became_peered":"2023-10-06T02:59:55.634743+0000","last_unstale":"2023-10-06T02:59:56.645902+0000","last_undegraded":"2023-10-06T02:59:56.645902+0000","last_fullsized":"2023-10-06T02:59:56.645902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:11.021747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668868+0000","last_change":"2023-10-06T02:59:56.657779+0000","last_active":"2023-10-06T02:59:56.668868+0000","last_peered":"2023-10-06T02:59:56.668868+0000","last_clean":"2023-10-06T02:59:56.668868+0000","last_became_active":"2023-10-06T02:59:56.657586+0000","last_became_peered":"2023-10-06T02:59:56.657586+0000","last_unstale":"2023-10-06T02:59:56.668868+0000","last_undegraded":"2023-10-06T02:59:56.668868+0000","last_fullsized":"2023-10-06T02:59:56.668868+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:22.069667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"81'3","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.671541+0000","last_change":"2023-10-06T02:59:55.642560+0000","last_active":"2023-10-06T02:59:56.671541+0000","last_peered":"2023-10-06T02:59:56.671541+0000","last_clean":"2023-10-06T02:59:56.671541+0000","last_became_active":"2023-10-06T02:59:55.642297+0000","last_became_peered":"2023-10-06T02:59:55.642297+0000","last_unstale":"2023-10-06T02:59:56.671541+0000","last_undegraded":"2023-10-06T02:59:56.671541+0000","last_fullsized":"2023-10-06T02:59:56.671541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:03.027349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673213+0000","last_change":"2023-10-06T02:59:56.666812+0000","last_active":"2023-10-06T02:59:56.673213+0000","last_peered":"2023-10-06T02:59:56.673213+0000","last_clean":"2023-10-06T02:59:56.673213+0000","last_became_active":"2023-10-06T02:59:56.665367+0000","last_became_peered":"2023-10-06T02:59:56.665367+0000","last_unstale":"2023-10-06T02:59:56.673213+0000","last_undegraded":"2023-10-06T02:59:56.673213+0000","last_fullsized":"2023-10-06T02:59:56.673213+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:15.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"81'6","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.674662+0000","last_change":"2023-10-06T02:59:55.639984+0000","last_active":"2023-10-06T02:59:56.674662+0000","last_peered":"2023-10-06T02:59:56.674662+0000","last_clean":"2023-10-06T02:59:56.674662+0000","last_became_active":"2023-10-06T02:59:55.639673+0000","last_became_peered":"2023-10-06T02:59:55.639673+0000","last_unstale":"2023-10-06T02:59:56.674662+0000","last_undegraded":"2023-10-06T02:59:56.674662+0000","last_fullsized":"2023-10-06T02:59:56.674662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.033101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668274+0000","last_change":"2023-10-06T02:59:56.658938+0000","last_active":"2023-10-06T02:59:56.668274+0000","last_peered":"2023-10-06T02:59:56.668274+0000","last_clean":"2023-10-06T02:59:56.668274+0000","last_became_active":"2023-10-06T02:59:56.658673+0000","last_became_peered":"2023-10-06T02:59:56.658673+0000","last_unstale":"2023-10-06T02:59:56.668274+0000","last_undegraded":"2023-10-06T02:59:56.668274+0000","last_fullsized":"2023-10-06T02:59:56.668274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:29.271660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673006+0000","last_change":"2023-10-06T02:59:55.634145+0000","last_active":"2023-10-06T02:59:56.673006+0000","last_peered":"2023-10-06T02:59:56.673006+0000","last_clean":"2023-10-06T02:59:56.673006+0000","last_became_active":"2023-10-06T02:59:55.633840+0000","last_became_peered":"2023-10-06T02:59:55.633840+0000","last_unstale":"2023-10-06T02:59:56.673006+0000","last_undegraded":"2023-10-06T02:59:56.673006+0000","last_fullsized":"2023-10-06T02:59:56.673006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:31.912012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668475+0000","last_change":"2023-10-06T02:59:56.663315+0000","last_active":"2023-10-06T02:59:56.668475+0000","last_peered":"2023-10-06T02:59:56.668475+0000","last_clean":"2023-10-06T02:59:56.668475+0000","last_became_active":"2023-10-06T02:59:56.663014+0000","last_became_peered":"2023-10-06T02:59:56.663014+0000","last_unstale":"2023-10-06T02:59:56.668475+0000","last_undegraded":"2023-10-06T02:59:56.668475+0000","last_fullsized":"2023-10-06T02:59:56.668475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:01.713614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644735+0000","last_change":"2023-10-06T02:59:55.639753+0000","last_active":"2023-10-06T02:59:56.644735+0000","last_peered":"2023-10-06T02:59:56.644735+0000","last_clean":"2023-10-06T02:59:56.644735+0000","last_became_active":"2023-10-06T02:59:55.639531+0000","last_became_peered":"2023-10-06T02:59:55.639531+0000","last_unstale":"2023-10-06T02:59:56.644735+0000","last_undegraded":"2023-10-06T02:59:56.644735+0000","last_fullsized":"2023-10-06T02:59:56.644735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:25.456877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668067+0000","last_change":"2023-10-06T02:59:56.665199+0000","last_active":"2023-10-06T02:59:56.668067+0000","last_peered":"2023-10-06T02:59:56.668067+0000","last_clean":"2023-10-06T02:59:56.668067+0000","last_became_active":"2023-10-06T02:59:56.664762+0000","last_became_peered":"2023-10-06T02:59:56.664762+0000","last_unstale":"2023-10-06T02:59:56.668067+0000","last_undegraded":"2023-10-06T02:59:56.668067+0000","last_fullsized":"2023-10-06T02:59:56.668067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:51.279379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644576+0000","last_change":"2023-10-06T02:59:55.638758+0000","last_active":"2023-10-06T02:59:56.644576+0000","last_peered":"2023-10-06T02:59:56.644576+0000","last_clean":"2023-10-06T02:59:56.644576+0000","last_became_active":"2023-10-06T02:59:55.638478+0000","last_became_peered":"2023-10-06T02:59:55.638478+0000","last_unstale":"2023-10-06T02:59:56.644576+0000","last_undegraded":"2023-10-06T02:59:56.644576+0000","last_fullsized":"2023-10-06T02:59:56.644576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:34.198527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.667884+0000","last_change":"2023-10-06T02:59:56.664500+0000","last_active":"2023-10-06T02:59:56.667884+0000","last_peered":"2023-10-06T02:59:56.667884+0000","last_clean":"2023-10-06T02:59:56.667884+0000","last_became_active":"2023-10-06T02:59:56.664230+0000","last_became_peered":"2023-10-06T02:59:56.664230+0000","last_unstale":"2023-10-06T02:59:56.667884+0000","last_undegraded":"2023-10-06T02:59:56.667884+0000","last_fullsized":"2023-10-06T02:59:56.667884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:40.886440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"81'8","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673768+0000","last_change":"2023-10-06T02:59:55.637936+0000","last_active":"2023-10-06T02:59:56.673768+0000","last_peered":"2023-10-06T02:59:56.673768+0000","last_clean":"2023-10-06T02:59:56.673768+0000","last_became_active":"2023-10-06T02:59:55.637671+0000","last_became_peered":"2023-10-06T02:59:55.637671+0000","last_unstale":"2023-10-06T02:59:56.673768+0000","last_undegraded":"2023-10-06T02:59:56.673768+0000","last_fullsized":"2023-10-06T02:59:56.673768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:19.388026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665617+0000","last_change":"2023-10-06T02:59:56.658420+0000","last_active":"2023-10-06T02:59:56.665617+0000","last_peered":"2023-10-06T02:59:56.665617+0000","last_clean":"2023-10-06T02:59:56.665617+0000","last_became_active":"2023-10-06T02:59:56.658066+0000","last_became_peered":"2023-10-06T02:59:56.658066+0000","last_unstale":"2023-10-06T02:59:56.665617+0000","last_undegraded":"2023-10-06T02:59:56.665617+0000","last_fullsized":"2023-10-06T02:59:56.665617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:29.163729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673635+0000","last_change":"2023-10-06T02:59:55.635553+0000","last_active":"2023-10-06T02:59:56.673635+0000","last_peered":"2023-10-06T02:59:56.673635+0000","last_clean":"2023-10-06T02:59:56.673635+0000","last_became_active":"2023-10-06T02:59:55.635307+0000","last_became_peered":"2023-10-06T02:59:55.635307+0000","last_unstale":"2023-10-06T02:59:56.673635+0000","last_undegraded":"2023-10-06T02:59:56.673635+0000","last_fullsized":"2023-10-06T02:59:56.673635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:23.430636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662629+0000","last_change":"2023-10-06T02:59:56.656838+0000","last_active":"2023-10-06T02:59:56.662629+0000","last_peered":"2023-10-06T02:59:56.662629+0000","last_clean":"2023-10-06T02:59:56.662629+0000","last_became_active":"2023-10-06T02:59:56.656553+0000","last_became_peered":"2023-10-06T02:59:56.656553+0000","last_unstale":"2023-10-06T02:59:56.662629+0000","last_undegraded":"2023-10-06T02:59:56.662629+0000","last_fullsized":"2023-10-06T02:59:56.662629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:20.397591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.652946+0000","last_change":"2023-10-06T02:59:55.636391+0000","last_active":"2023-10-06T02:59:56.652946+0000","last_peered":"2023-10-06T02:59:56.652946+0000","last_clean":"2023-10-06T02:59:56.652946+0000","last_became_active":"2023-10-06T02:59:55.636118+0000","last_became_peered":"2023-10-06T02:59:55.636118+0000","last_unstale":"2023-10-06T02:59:56.652946+0000","last_undegraded":"2023-10-06T02:59:56.652946+0000","last_fullsized":"2023-10-06T02:59:56.652946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:51.281866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.656783+0000","last_change":"2023-10-06T02:59:56.649441+0000","last_active":"2023-10-06T02:59:56.656783+0000","last_peered":"2023-10-06T02:59:56.656783+0000","last_clean":"2023-10-06T02:59:56.656783+0000","last_became_active":"2023-10-06T02:59:56.648978+0000","last_became_peered":"2023-10-06T02:59:56.648978+0000","last_unstale":"2023-10-06T02:59:56.656783+0000","last_undegraded":"2023-10-06T02:59:56.656783+0000","last_fullsized":"2023-10-06T02:59:56.656783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:30.881942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.643678+0000","last_change":"2023-10-06T02:59:55.635507+0000","last_active":"2023-10-06T02:59:56.643678+0000","last_peered":"2023-10-06T02:59:56.643678+0000","last_clean":"2023-10-06T02:59:56.643678+0000","last_became_active":"2023-10-06T02:59:55.635254+0000","last_became_peered":"2023-10-06T02:59:55.635254+0000","last_unstale":"2023-10-06T02:59:56.643678+0000","last_undegraded":"2023-10-06T02:59:56.643678+0000","last_fullsized":"2023-10-06T02:59:56.643678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:28.367900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673164+0000","last_change":"2023-10-06T02:59:56.666079+0000","last_active":"2023-10-06T02:59:56.673164+0000","last_peered":"2023-10-06T02:59:56.673164+0000","last_clean":"2023-10-06T02:59:56.673164+0000","last_became_active":"2023-10-06T02:59:56.665645+0000","last_became_peered":"2023-10-06T02:59:56.665645+0000","last_unstale":"2023-10-06T02:59:56.673164+0000","last_undegraded":"2023-10-06T02:59:56.673164+0000","last_fullsized":"2023-10-06T02:59:56.673164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:29.193834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644909+0000","last_change":"2023-10-06T02:59:55.637247+0000","last_active":"2023-10-06T02:59:56.644909+0000","last_peered":"2023-10-06T02:59:56.644909+0000","last_clean":"2023-10-06T02:59:56.644909+0000","last_became_active":"2023-10-06T02:59:55.636524+0000","last_became_peered":"2023-10-06T02:59:55.636524+0000","last_unstale":"2023-10-06T02:59:56.644909+0000","last_undegraded":"2023-10-06T02:59:56.644909+0000","last_fullsized":"2023-10-06T02:59:56.644909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:40.609815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658034+0000","last_change":"2023-10-06T02:59:56.655132+0000","last_active":"2023-10-06T02:59:56.658034+0000","last_peered":"2023-10-06T02:59:56.658034+0000","last_clean":"2023-10-06T02:59:56.658034+0000","last_became_active":"2023-10-06T02:59:56.654653+0000","last_became_peered":"2023-10-06T02:59:56.654653+0000","last_unstale":"2023-10-06T02:59:56.658034+0000","last_undegraded":"2023-10-06T02:59:56.658034+0000","last_fullsized":"2023-10-06T02:59:56.658034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:59.489114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645421+0000","last_change":"2023-10-06T02:59:55.637982+0000","last_active":"2023-10-06T02:59:56.645421+0000","last_peered":"2023-10-06T02:59:56.645421+0000","last_clean":"2023-10-06T02:59:56.645421+0000","last_became_active":"2023-10-06T02:59:55.637689+0000","last_became_peered":"2023-10-06T02:59:55.637689+0000","last_unstale":"2023-10-06T02:59:56.645421+0000","last_undegraded":"2023-10-06T02:59:56.645421+0000","last_fullsized":"2023-10-06T02:59:56.645421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:25.456877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.669207+0000","last_change":"2023-10-06T02:59:56.659092+0000","last_active":"2023-10-06T02:59:56.669207+0000","last_peered":"2023-10-06T02:59:56.669207+0000","last_clean":"2023-10-06T02:59:56.669207+0000","last_became_active":"2023-10-06T02:59:56.658878+0000","last_became_peered":"2023-10-06T02:59:56.658878+0000","last_unstale":"2023-10-06T02:59:56.669207+0000","last_undegraded":"2023-10-06T02:59:56.669207+0000","last_fullsized":"2023-10-06T02:59:56.669207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:29.163729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.653514+0000","last_change":"2023-10-06T02:59:55.635642+0000","last_active":"2023-10-06T02:59:56.653514+0000","last_peered":"2023-10-06T02:59:56.653514+0000","last_clean":"2023-10-06T02:59:56.653514+0000","last_became_active":"2023-10-06T02:59:55.635071+0000","last_became_peered":"2023-10-06T02:59:55.635071+0000","last_unstale":"2023-10-06T02:59:56.653514+0000","last_undegraded":"2023-10-06T02:59:56.653514+0000","last_fullsized":"2023-10-06T02:59:56.653514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:05.389877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662661+0000","last_change":"2023-10-06T02:59:56.656682+0000","last_active":"2023-10-06T02:59:56.662661+0000","last_peered":"2023-10-06T02:59:56.662661+0000","last_clean":"2023-10-06T02:59:56.662661+0000","last_became_active":"2023-10-06T02:59:56.656360+0000","last_became_peered":"2023-10-06T02:59:56.656360+0000","last_unstale":"2023-10-06T02:59:56.662661+0000","last_undegraded":"2023-10-06T02:59:56.662661+0000","last_fullsized":"2023-10-06T02:59:56.662661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:14.265178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.643636+0000","last_change":"2023-10-06T02:59:55.635735+0000","last_active":"2023-10-06T02:59:56.643636+0000","last_peered":"2023-10-06T02:59:56.643636+0000","last_clean":"2023-10-06T02:59:56.643636+0000","last_became_active":"2023-10-06T02:59:55.635480+0000","last_became_peered":"2023-10-06T02:59:55.635480+0000","last_unstale":"2023-10-06T02:59:56.643636+0000","last_undegraded":"2023-10-06T02:59:56.643636+0000","last_fullsized":"2023-10-06T02:59:56.643636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:31.433086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.655907+0000","last_change":"2023-10-06T02:59:56.647141+0000","last_active":"2023-10-06T02:59:56.655907+0000","last_peered":"2023-10-06T02:59:56.655907+0000","last_clean":"2023-10-06T02:59:56.655907+0000","last_became_active":"2023-10-06T02:59:56.646979+0000","last_became_peered":"2023-10-06T02:59:56.646979+0000","last_unstale":"2023-10-06T02:59:56.655907+0000","last_undegraded":"2023-10-06T02:59:56.655907+0000","last_fullsized":"2023-10-06T02:59:56.655907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:58.506740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.654484+0000","last_change":"2023-10-06T02:59:55.641019+0000","last_active":"2023-10-06T02:59:56.654484+0000","last_peered":"2023-10-06T02:59:56.654484+0000","last_clean":"2023-10-06T02:59:56.654484+0000","last_became_active":"2023-10-06T02:59:55.640374+0000","last_became_peered":"2023-10-06T02:59:55.640374+0000","last_unstale":"2023-10-06T02:59:56.654484+0000","last_undegraded":"2023-10-06T02:59:56.654484+0000","last_fullsized":"2023-10-06T02:59:56.654484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:24.689409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665149+0000","last_change":"2023-10-06T02:59:56.661031+0000","last_active":"2023-10-06T02:59:56.665149+0000","last_peered":"2023-10-06T02:59:56.665149+0000","last_clean":"2023-10-06T02:59:56.665149+0000","last_became_active":"2023-10-06T02:59:56.660765+0000","last_became_peered":"2023-10-06T02:59:56.660765+0000","last_unstale":"2023-10-06T02:59:56.665149+0000","last_undegraded":"2023-10-06T02:59:56.665149+0000","last_fullsized":"2023-10-06T02:59:56.665149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:39.696799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.642114+0000","last_change":"2023-10-06T02:59:55.636904+0000","last_active":"2023-10-06T02:59:56.642114+0000","last_peered":"2023-10-06T02:59:56.642114+0000","last_clean":"2023-10-06T02:59:56.642114+0000","last_became_active":"2023-10-06T02:59:55.636650+0000","last_became_peered":"2023-10-06T02:59:55.636650+0000","last_unstale":"2023-10-06T02:59:56.642114+0000","last_undegraded":"2023-10-06T02:59:56.642114+0000","last_fullsized":"2023-10-06T02:59:56.642114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:05.261363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.652531+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:59:56.652531+0000","last_peered":"2023-10-06T02:59:56.652531+0000","last_clean":"2023-10-06T02:59:56.652531+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:59:56.652531+0000","last_undegraded":"2023-10-06T02:59:56.652531+0000","last_fullsized":"2023-10-06T02:59:56.652531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673188+0000","last_change":"2023-10-06T02:59:56.666615+0000","last_active":"2023-10-06T02:59:56.673188+0000","last_peered":"2023-10-06T02:59:56.673188+0000","last_clean":"2023-10-06T02:59:56.673188+0000","last_became_active":"2023-10-06T02:59:56.666339+0000","last_became_peered":"2023-10-06T02:59:56.666339+0000","last_unstale":"2023-10-06T02:59:56.673188+0000","last_undegraded":"2023-10-06T02:59:56.673188+0000","last_fullsized":"2023-10-06T02:59:56.673188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:46.718133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645765+0000","last_change":"2023-10-06T02:59:55.635432+0000","last_active":"2023-10-06T02:59:56.645765+0000","last_peered":"2023-10-06T02:59:56.645765+0000","last_clean":"2023-10-06T02:59:56.645765+0000","last_became_active":"2023-10-06T02:59:55.635144+0000","last_became_peered":"2023-10-06T02:59:55.635144+0000","last_unstale":"2023-10-06T02:59:56.645765+0000","last_undegraded":"2023-10-06T02:59:56.645765+0000","last_fullsized":"2023-10-06T02:59:56.645765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:17.015298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645367+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:59:56.645367+0000","last_peered":"2023-10-06T02:59:56.645367+0000","last_clean":"2023-10-06T02:59:56.645367+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:59:56.645367+0000","last_undegraded":"2023-10-06T02:59:56.645367+0000","last_fullsized":"2023-10-06T02:59:56.645367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666105+0000","last_change":"2023-10-06T02:59:56.658598+0000","last_active":"2023-10-06T02:59:56.666105+0000","last_peered":"2023-10-06T02:59:56.666105+0000","last_clean":"2023-10-06T02:59:56.666105+0000","last_became_active":"2023-10-06T02:59:56.658335+0000","last_became_peered":"2023-10-06T02:59:56.658335+0000","last_unstale":"2023-10-06T02:59:56.666105+0000","last_undegraded":"2023-10-06T02:59:56.666105+0000","last_fullsized":"2023-10-06T02:59:56.666105+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:10.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673465+0000","last_change":"2023-10-06T02:59:55.637836+0000","last_active":"2023-10-06T02:59:56.673465+0000","last_peered":"2023-10-06T02:59:56.673465+0000","last_clean":"2023-10-06T02:59:56.673465+0000","last_became_active":"2023-10-06T02:59:55.637395+0000","last_became_peered":"2023-10-06T02:59:55.637395+0000","last_unstale":"2023-10-06T02:59:56.673465+0000","last_undegraded":"2023-10-06T02:59:56.673465+0000","last_fullsized":"2023-10-06T02:59:56.673465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:35.931020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.641612+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:59:56.641612+0000","last_peered":"2023-10-06T02:59:56.641612+0000","last_clean":"2023-10-06T02:59:56.641612+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:59:56.641612+0000","last_undegraded":"2023-10-06T02:59:56.641612+0000","last_fullsized":"2023-10-06T02:59:56.641612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666131+0000","last_change":"2023-10-06T02:59:56.659788+0000","last_active":"2023-10-06T02:59:56.666131+0000","last_peered":"2023-10-06T02:59:56.666131+0000","last_clean":"2023-10-06T02:59:56.666131+0000","last_became_active":"2023-10-06T02:59:56.659545+0000","last_became_peered":"2023-10-06T02:59:56.659545+0000","last_unstale":"2023-10-06T02:59:56.666131+0000","last_undegraded":"2023-10-06T02:59:56.666131+0000","last_fullsized":"2023-10-06T02:59:56.666131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:01.713244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673278+0000","last_change":"2023-10-06T02:59:55.642783+0000","last_active":"2023-10-06T02:59:56.673278+0000","last_peered":"2023-10-06T02:59:56.673278+0000","last_clean":"2023-10-06T02:59:56.673278+0000","last_became_active":"2023-10-06T02:59:55.642464+0000","last_became_peered":"2023-10-06T02:59:55.642464+0000","last_unstale":"2023-10-06T02:59:56.673278+0000","last_undegraded":"2023-10-06T02:59:56.673278+0000","last_fullsized":"2023-10-06T02:59:56.673278+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:57.967039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645671+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:59:56.645671+0000","last_peered":"2023-10-06T02:59:56.645671+0000","last_clean":"2023-10-06T02:59:56.645671+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:59:56.645671+0000","last_undegraded":"2023-10-06T02:59:56.645671+0000","last_fullsized":"2023-10-06T02:59:56.645671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":216,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.648419+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:59:56.648419+0000","last_peered":"2023-10-06T02:59:56.648419+0000","last_clean":"2023-10-06T02:59:56.648419+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:59:56.648419+0000","last_undegraded":"2023-10-06T02:59:56.648419+0000","last_fullsized":"2023-10-06T02:59:56.648419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.655870+0000","last_change":"2023-10-06T02:59:56.650817+0000","last_active":"2023-10-06T02:59:56.655870+0000","last_peered":"2023-10-06T02:59:56.655870+0000","last_clean":"2023-10-06T02:59:56.655870+0000","last_became_active":"2023-10-06T02:59:56.650558+0000","last_became_peered":"2023-10-06T02:59:56.650558+0000","last_unstale":"2023-10-06T02:59:56.655870+0000","last_undegraded":"2023-10-06T02:59:56.655870+0000","last_fullsized":"2023-10-06T02:59:56.655870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:58.976605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.672295+0000","last_change":"2023-10-06T02:59:55.642325+0000","last_active":"2023-10-06T02:59:56.672295+0000","last_peered":"2023-10-06T02:59:56.672295+0000","last_clean":"2023-10-06T02:59:56.672295+0000","last_became_active":"2023-10-06T02:59:55.642100+0000","last_became_peered":"2023-10-06T02:59:55.642100+0000","last_unstale":"2023-10-06T02:59:56.672295+0000","last_undegraded":"2023-10-06T02:59:56.672295+0000","last_fullsized":"2023-10-06T02:59:56.672295+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:34.586491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.648514+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:59:56.648514+0000","last_peered":"2023-10-06T02:59:56.648514+0000","last_clean":"2023-10-06T02:59:56.648514+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:59:56.648514+0000","last_undegraded":"2023-10-06T02:59:56.648514+0000","last_fullsized":"2023-10-06T02:59:56.648514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659535+0000","last_change":"2023-10-06T02:59:56.656100+0000","last_active":"2023-10-06T02:59:56.659535+0000","last_peered":"2023-10-06T02:59:56.659535+0000","last_clean":"2023-10-06T02:59:56.659535+0000","last_became_active":"2023-10-06T02:59:56.655827+0000","last_became_peered":"2023-10-06T02:59:56.655827+0000","last_unstale":"2023-10-06T02:59:56.659535+0000","last_undegraded":"2023-10-06T02:59:56.659535+0000","last_fullsized":"2023-10-06T02:59:56.659535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:38.456482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665254+0000","last_change":"2023-10-06T02:59:55.636499+0000","last_active":"2023-10-06T02:59:56.665254+0000","last_peered":"2023-10-06T02:59:56.665254+0000","last_clean":"2023-10-06T02:59:56.665254+0000","last_became_active":"2023-10-06T02:59:55.636233+0000","last_became_peered":"2023-10-06T02:59:55.636233+0000","last_unstale":"2023-10-06T02:59:56.665254+0000","last_undegraded":"2023-10-06T02:59:56.665254+0000","last_fullsized":"2023-10-06T02:59:56.665254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:19.388026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.648597+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:59:56.648597+0000","last_peered":"2023-10-06T02:59:56.648597+0000","last_clean":"2023-10-06T02:59:56.648597+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:59:56.648597+0000","last_undegraded":"2023-10-06T02:59:56.648597+0000","last_fullsized":"2023-10-06T02:59:56.648597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.657563+0000","last_change":"2023-10-06T02:59:56.654024+0000","last_active":"2023-10-06T02:59:56.657563+0000","last_peered":"2023-10-06T02:59:56.657563+0000","last_clean":"2023-10-06T02:59:56.657563+0000","last_became_active":"2023-10-06T02:59:56.653760+0000","last_became_peered":"2023-10-06T02:59:56.653760+0000","last_unstale":"2023-10-06T02:59:56.657563+0000","last_undegraded":"2023-10-06T02:59:56.657563+0000","last_fullsized":"2023-10-06T02:59:56.657563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:57.979733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644187+0000","last_change":"2023-10-06T02:59:55.637126+0000","last_active":"2023-10-06T02:59:56.644187+0000","last_peered":"2023-10-06T02:59:56.644187+0000","last_clean":"2023-10-06T02:59:56.644187+0000","last_became_active":"2023-10-06T02:59:55.636882+0000","last_became_peered":"2023-10-06T02:59:55.636882+0000","last_unstale":"2023-10-06T02:59:56.644187+0000","last_undegraded":"2023-10-06T02:59:56.644187+0000","last_fullsized":"2023-10-06T02:59:56.644187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:17.015298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.653020+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:59:56.653020+0000","last_peered":"2023-10-06T02:59:56.653020+0000","last_clean":"2023-10-06T02:59:56.653020+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:59:56.653020+0000","last_undegraded":"2023-10-06T02:59:56.653020+0000","last_fullsized":"2023-10-06T02:59:56.653020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658511+0000","last_change":"2023-10-06T02:59:56.651111+0000","last_active":"2023-10-06T02:59:56.658511+0000","last_peered":"2023-10-06T02:59:56.658511+0000","last_clean":"2023-10-06T02:59:56.658511+0000","last_became_active":"2023-10-06T02:59:56.650817+0000","last_became_peered":"2023-10-06T02:59:56.650817+0000","last_unstale":"2023-10-06T02:59:56.658511+0000","last_undegraded":"2023-10-06T02:59:56.658511+0000","last_fullsized":"2023-10-06T02:59:56.658511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:23.711869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.641527+0000","last_change":"2023-10-06T02:59:55.638786+0000","last_active":"2023-10-06T02:59:56.641527+0000","last_peered":"2023-10-06T02:59:56.641527+0000","last_clean":"2023-10-06T02:59:56.641527+0000","last_became_active":"2023-10-06T02:59:55.638521+0000","last_became_peered":"2023-10-06T02:59:55.638521+0000","last_unstale":"2023-10-06T02:59:56.641527+0000","last_undegraded":"2023-10-06T02:59:56.641527+0000","last_fullsized":"2023-10-06T02:59:56.641527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:35:12.635417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645129+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:59:56.645129+0000","last_peered":"2023-10-06T02:59:56.645129+0000","last_clean":"2023-10-06T02:59:56.645129+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:59:56.645129+0000","last_undegraded":"2023-10-06T02:59:56.645129+0000","last_fullsized":"2023-10-06T02:59:56.645129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298852,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072988,"statfs":{"total":96636764160,"available":96330739712,"internally_reserved":0,"allocated":1601536,"data_stored":1069373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70299999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.39900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.45400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66400000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35399999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67300000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73499999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69299999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.31,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46500000000000002,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.32800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68300000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74099999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.52300000000000002,"15min":0.55500000000000005},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.35099999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.59499999999999997},"min":{"1min":0.35299999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298280,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073560,"statfs":{"total":96636764160,"available":96331325440,"internally_reserved":0,"allocated":1015808,"data_stored":479601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.60799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74399999999999999,"5min":3.415,"15min":3.415},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55600000000000005,"15min":0.58999999999999997},"min":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66100000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76500000000000001,"5min":1.546,"15min":1.546},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57399999999999995,"15min":0.58799999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71699999999999997,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.62}]},{"osd":2,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":1.74,"15min":1.74},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.71999999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71899999999999997,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64900000000000002,"15min":0.71599999999999997},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":3.577,"15min":3.577},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.627,"15min":0.67600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79700000000000004,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.78200000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.32400000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.748}]},{"osd":5,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53500000000000003,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70599999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":0.87,"15min":0.87},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70699999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73499999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.83899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298276,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073564,"statfs":{"total":96636764160,"available":96331329536,"internally_reserved":0,"allocated":1011712,"data_stored":478118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36299999999999999,"15min":0.39700000000000002},"min":{"1min":0.20100000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.55200000000000005,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.22800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.78300000000000003,"15min":1.208},"min":{"1min":0.28599999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.58099999999999996,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60299999999999998,"5min":1.181,"15min":1.181},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41899999999999998,"15min":0.44},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.628,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.372},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.248,"15min":0.248},"max":{"1min":0.61599999999999999,"5min":0.626,"15min":0.626},"last":0.255}]},{"osd":4,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85799999999999998,"5min":1.02,"15min":1.02},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":1.0069999999999999,"15min":1.4259999999999999},"min":{"1min":0.308,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.998,"15min":1.4119999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83999999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84799999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.02,"15min":1.446},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":21.166,"15min":21.166},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.876,"5min":0.997,"15min":0.997},"last":0.67900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298848,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072992,"statfs":{"total":96636764160,"available":96330743808,"internally_reserved":0,"allocated":1597440,"data_stored":1068326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.315}]},{"osd":2,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.371,"15min":0.371},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.22600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.29199999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53700000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.58499999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.433}]},{"osd":5,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59699999999999998,"15min":0.61299999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.76800000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86399999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":479489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.318,"15min":0.308},"min":{"1min":0.24099999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48299999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.32200000000000001},"min":{"1min":0.23000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.42499999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.379,"15min":0.371},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.502,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35299999999999998},"min":{"1min":0.26800000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.46899999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40400000000000003,"15min":0.39900000000000002},"min":{"1min":0.33200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.47999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.498},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.55500000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.55900000000000005},"min":{"1min":0.46000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.57099999999999995},"min":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80600000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.504},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":1.077,"15min":1.077},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78000000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80800000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298276,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073564,"statfs":{"total":96636764160,"available":96331329536,"internally_reserved":0,"allocated":1011712,"data_stored":479460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.40699999999999997,"15min":0.44700000000000001},"min":{"1min":0.22900000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.51800000000000002,"5min":2.569,"15min":2.569},"last":0.252},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.40899999999999997,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.248,"15min":0.248},"max":{"1min":0.57499999999999996,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39500000000000002,"15min":0.435},"min":{"1min":0.23599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.58199999999999996,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.42499999999999999,"15min":0.47299999999999998},"min":{"1min":0.23799999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64100000000000001,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42999999999999999,"15min":0.46300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.55700000000000005,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.45100000000000001,"15min":0.49099999999999999},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60599999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61299999999999999,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.623,"15min":0.66500000000000004},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.81899999999999995,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.63800000000000001,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82999999999999996,"5min":2.532,"15min":2.532},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.622,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65900000000000003,"15min":0.69799999999999995},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.67000000000000004,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.90600000000000003,"5min":2.496,"15min":2.496},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.66100000000000003},"min":{"1min":0.38500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79800000000000004,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.75700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298268,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073572,"statfs":{"total":96636764160,"available":96331337728,"internally_reserved":0,"allocated":1003520,"data_stored":478935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68600000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70199999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69999999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.68300000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.81200000000000006,"15min":1.006},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.55400000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71599999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57599999999999996,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.44700000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.752,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83599999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":480493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.49299999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68799999999999994,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71799999999999997,"5min":1.167,"15min":1.167},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71499999999999997,"5min":1.117,"15min":1.117},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.437,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66600000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":1.2,"15min":1.2},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.39800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74399999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73399999999999999,"5min":1.135,"15min":1.135},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69699999999999995,"5min":1.208,"15min":1.208},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77500000000000002,"5min":0.87,"15min":0.87},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.57799999999999996},"min":{"1min":0.33700000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.58499999999999996},"min":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.36199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80700000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60199999999999998,"15min":0.63500000000000001},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77800000000000002,"5min":1.008,"15min":1.008},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:00:00.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:00:00.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.857+0000 7f340fb5d700 1 Processor -- start 2023-10-06T03:00:00.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.857+0000 7f340fb5d700 1 -- start start 2023-10-06T03:00:00.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340fb5d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34080b49e0 0x7f34080aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340fb5d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f34080b07a0 0x7f34080b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340fb5d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080b0ca0 con 0x7f34081595a0 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340fb5d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34080b0f80 con 0x7f34080b07a0 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340fb5d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34080b1260 con 0x7f34080b49e0 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340e0fa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f34080b07a0 0x7f34080b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340d0f8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34080b49e0 0x7f34080aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340d8f9700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f34081595a0 0x7f34080aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:58900/0 (socket says 172.21.15.84:58900) 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340e0fa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f34080b07a0 0x7f34080b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:44862/0 (socket says 172.21.15.84:44862) 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340d0f8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34080b49e0 0x7f34080aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:48248/0 (socket says 172.21.15.84:48248) 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340d8f9700 1 -- 172.21.15.84:0/3966004839 learned_addr learned my addr 172.21.15.84:0/3966004839 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340d0f8700 1 -- 172.21.15.84:0/3966004839 >> v2:172.21.15.131:3300/0 conn(0x7f34080b07a0 msgr2=0x7f34080b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340d0f8700 1 --2- 172.21.15.84:0/3966004839 >> v2:172.21.15.131:3300/0 conn(0x7f34080b07a0 0x7f34080b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340d0f8700 1 -- 172.21.15.84:0/3966004839 >> v1:172.21.15.131:6789/0 conn(0x7f34081595a0 legacy=0x7f34080aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340d0f8700 1 -- 172.21.15.84:0/3966004839 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080b1540 con 0x7f34080b49e0 2023-10-06T03:00:00.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.858+0000 7f340e0fa700 1 --2- 172.21.15.84:0/3966004839 >> v2:172.21.15.131:3300/0 conn(0x7f34080b07a0 0x7f34080b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:00.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340d0f8700 1 --2- 172.21.15.84:0/3966004839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34080b49e0 0x7f34080aac80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0098e0 tx=0x7f33fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=823885a690bd26bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340c8f7700 1 -- 172.21.15.84:0/3966004839 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc00b640 con 0x7f34080b49e0 2023-10-06T03:00:00.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340c8f7700 1 -- 172.21.15.84:0/3966004839 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc00b7a0 con 0x7f34080b49e0 2023-10-06T03:00:00.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340c8f7700 1 -- 172.21.15.84:0/3966004839 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc00bb40 con 0x7f34080b49e0 2023-10-06T03:00:00.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340fb5d700 1 -- 172.21.15.84:0/3966004839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34080b49e0 msgr2=0x7f34080aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340fb5d700 1 --2- 172.21.15.84:0/3966004839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34080b49e0 0x7f34080aac80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0098e0 tx=0x7f33fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340fb5d700 1 -- 172.21.15.84:0/3966004839 shutdown_connections 2023-10-06T03:00:00.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340fb5d700 1 --2- 172.21.15.84:0/3966004839 >> v2:172.21.15.131:3300/0 conn(0x7f34080b07a0 0x7f34080b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340fb5d700 1 --2- 172.21.15.84:0/3966004839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34080b49e0 0x7f34080aac80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340fb5d700 1 -- 172.21.15.84:0/3966004839 >> 172.21.15.84:0/3966004839 conn(0x7f3408099830 msgr2=0x7f340806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:00.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340fb5d700 1 -- 172.21.15.84:0/3966004839 shutdown_connections 2023-10-06T03:00:00.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.859+0000 7f340fb5d700 1 -- 172.21.15.84:0/3966004839 wait complete. 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.860+0000 7f340fb5d700 1 Processor -- start 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340fb5d700 1 -- start start 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340fb5d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34080b07a0 0x7f34080aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340fb5d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34080b49e0 0x7f3408158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340fb5d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34081595a0 0x7f34080aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340fb5d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34080aaef0 con 0x7f34080b07a0 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340fb5d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3408160570 con 0x7f34080b49e0 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340fb5d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34081591e0 con 0x7f34081595a0 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340d8f9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34080b07a0 0x7f34080aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340d8f9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34080b07a0 0x7f34080aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58402/0 (socket says 172.21.15.84:58402) 2023-10-06T03:00:00.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340d8f9700 1 -- 172.21.15.84:0/4006294066 learned_addr learned my addr 172.21.15.84:0/4006294066 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340d0f8700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34080b49e0 0x7f3408158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.861+0000 7f340e0fa700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34081595a0 0x7f34080aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f340d8f9700 1 -- 172.21.15.84:0/4006294066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34081595a0 msgr2=0x7f34080aa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f340d8f9700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34081595a0 0x7f34080aa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f340d8f9700 1 -- 172.21.15.84:0/4006294066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34080b49e0 msgr2=0x7f3408158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f340d8f9700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34080b49e0 0x7f3408158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f340d8f9700 1 -- 172.21.15.84:0/4006294066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009420 con 0x7f34080b07a0 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f340d8f9700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34080b07a0 0x7f34080aea70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f340000cbc0 tx=0x7f3400001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f3405ffb700 1 -- 172.21.15.84:0/4006294066 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000a890 con 0x7f34080b07a0 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f3405ffb700 1 -- 172.21.15.84:0/4006294066 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000a9f0 con 0x7f34080b07a0 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc009420 con 0x7f34080b07a0 2023-10-06T03:00:00.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f3405ffb700 1 -- 172.21.15.84:0/4006294066 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000adb0 con 0x7f34080b07a0 2023-10-06T03:00:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.862+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340816a700 con 0x7f34080b07a0 2023-10-06T03:00:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.863+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340816b160 con 0x7f34080b07a0 2023-10-06T03:00:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.863+0000 7f3405ffb700 1 -- 172.21.15.84:0/4006294066 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3400007300 con 0x7f34080b07a0 2023-10-06T03:00:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.864+0000 7f3405ffb700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33f4066f30 0x7f33f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.864+0000 7f340d0f8700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33f4066f30 0x7f33f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:00.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.864+0000 7f3405ffb700 1 -- 172.21.15.84:0/4006294066 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f34000847a0 con 0x7f34080b07a0 2023-10-06T03:00:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.864+0000 7f340d0f8700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33f4066f30 0x7f33f40693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0093f0 tx=0x7f33fc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:00.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:00.868+0000 7f3405ffb700 1 -- 172.21.15.84:0/4006294066 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34000518b0 con 0x7f34080b07a0 2023-10-06T03:00:00.922 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T03:00:00.921+0000 7f5c998ca700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:00:01.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.051+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34080b1820 con 0x7f33f4066f30 2023-10-06T03:00:01.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.060+0000 7f3405ffb700 1 -- 172.21.15.84:0/4006294066 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311604 (secure 0 0 0) 0x7f34080b1820 con 0x7f33f4066f30 2023-10-06T03:00:01.065 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:01.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33f4066f30 msgr2=0x7f33f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33f4066f30 0x7f33f40693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0093f0 tx=0x7f33fc017000 comp rx=0 tx=0).stop 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34080b07a0 msgr2=0x7f34080aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34080b07a0 0x7f34080aea70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f340000cbc0 tx=0x7f3400001a20 comp rx=0 tx=0).stop 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 shutdown_connections 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f33f4066f30 0x7f33f40693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34081595a0 0x7f34080aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34080b07a0 0x7f34080aea70 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 --2- 172.21.15.84:0/4006294066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34080b49e0 0x7f3408158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 >> 172.21.15.84:0/4006294066 conn(0x7f3408099830 msgr2=0x7f340815cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 shutdown_connections 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.063+0000 7f340fb5d700 1 -- 172.21.15.84:0/4006294066 wait complete. 2023-10-06T03:00:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:00:01.077 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2023-10-06T02:59:59.866797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387356,"kb_used_data":9052,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752587364,"statfs":{"total":773094113280,"available":770649460736,"internally_reserved":0,"allocated":9269248,"data_stored":5013795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.249237"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665690+0000","last_change":"2023-10-06T02:59:56.661485+0000","last_active":"2023-10-06T02:59:56.665690+0000","last_peered":"2023-10-06T02:59:56.665690+0000","last_clean":"2023-10-06T02:59:56.665690+0000","last_became_active":"2023-10-06T02:59:56.661288+0000","last_became_peered":"2023-10-06T02:59:56.661288+0000","last_unstale":"2023-10-06T02:59:56.665690+0000","last_undegraded":"2023-10-06T02:59:56.665690+0000","last_fullsized":"2023-10-06T02:59:56.665690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:43.075027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670720+0000","last_change":"2023-10-06T02:59:56.666187+0000","last_active":"2023-10-06T02:59:56.670720+0000","last_peered":"2023-10-06T02:59:56.670720+0000","last_clean":"2023-10-06T02:59:56.670720+0000","last_became_active":"2023-10-06T02:59:56.665910+0000","last_became_peered":"2023-10-06T02:59:56.665910+0000","last_unstale":"2023-10-06T02:59:56.670720+0000","last_undegraded":"2023-10-06T02:59:56.670720+0000","last_fullsized":"2023-10-06T02:59:56.670720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:29.377466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662693+0000","last_change":"2023-10-06T02:59:56.656568+0000","last_active":"2023-10-06T02:59:56.662693+0000","last_peered":"2023-10-06T02:59:56.662693+0000","last_clean":"2023-10-06T02:59:56.662693+0000","last_became_active":"2023-10-06T02:59:56.656278+0000","last_became_peered":"2023-10-06T02:59:56.656278+0000","last_unstale":"2023-10-06T02:59:56.662693+0000","last_undegraded":"2023-10-06T02:59:56.662693+0000","last_fullsized":"2023-10-06T02:59:56.662693+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:35.596056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659303+0000","last_change":"2023-10-06T02:59:56.657843+0000","last_active":"2023-10-06T02:59:56.659303+0000","last_peered":"2023-10-06T02:59:56.659303+0000","last_clean":"2023-10-06T02:59:56.659303+0000","last_became_active":"2023-10-06T02:59:56.657563+0000","last_became_peered":"2023-10-06T02:59:56.657563+0000","last_unstale":"2023-10-06T02:59:56.659303+0000","last_undegraded":"2023-10-06T02:59:56.659303+0000","last_fullsized":"2023-10-06T02:59:56.659303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:25.633106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666582+0000","last_change":"2023-10-06T02:59:56.658697+0000","last_active":"2023-10-06T02:59:56.666582+0000","last_peered":"2023-10-06T02:59:56.666582+0000","last_clean":"2023-10-06T02:59:56.666582+0000","last_became_active":"2023-10-06T02:59:56.658062+0000","last_became_peered":"2023-10-06T02:59:56.658062+0000","last_unstale":"2023-10-06T02:59:56.666582+0000","last_undegraded":"2023-10-06T02:59:56.666582+0000","last_fullsized":"2023-10-06T02:59:56.666582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:42:31.919923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658017+0000","last_change":"2023-10-06T02:59:56.654939+0000","last_active":"2023-10-06T02:59:56.658017+0000","last_peered":"2023-10-06T02:59:56.658017+0000","last_clean":"2023-10-06T02:59:56.658017+0000","last_became_active":"2023-10-06T02:59:56.654308+0000","last_became_peered":"2023-10-06T02:59:56.654308+0000","last_unstale":"2023-10-06T02:59:56.658017+0000","last_undegraded":"2023-10-06T02:59:56.658017+0000","last_fullsized":"2023-10-06T02:59:56.658017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:10.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659356+0000","last_change":"2023-10-06T02:59:56.656584+0000","last_active":"2023-10-06T02:59:56.659356+0000","last_peered":"2023-10-06T02:59:56.659356+0000","last_clean":"2023-10-06T02:59:56.659356+0000","last_became_active":"2023-10-06T02:59:56.656344+0000","last_became_peered":"2023-10-06T02:59:56.656344+0000","last_unstale":"2023-10-06T02:59:56.659356+0000","last_undegraded":"2023-10-06T02:59:56.659356+0000","last_fullsized":"2023-10-06T02:59:56.659356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:12.031313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.657920+0000","last_change":"2023-10-06T02:59:56.655169+0000","last_active":"2023-10-06T02:59:56.657920+0000","last_peered":"2023-10-06T02:59:56.657920+0000","last_clean":"2023-10-06T02:59:56.657920+0000","last_became_active":"2023-10-06T02:59:56.654914+0000","last_became_peered":"2023-10-06T02:59:56.654914+0000","last_unstale":"2023-10-06T02:59:56.657920+0000","last_undegraded":"2023-10-06T02:59:56.657920+0000","last_fullsized":"2023-10-06T02:59:56.657920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:36.314580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.657447+0000","last_change":"2023-10-06T02:59:56.653495+0000","last_active":"2023-10-06T02:59:56.657447+0000","last_peered":"2023-10-06T02:59:56.657447+0000","last_clean":"2023-10-06T02:59:56.657447+0000","last_became_active":"2023-10-06T02:59:56.653246+0000","last_became_peered":"2023-10-06T02:59:56.653246+0000","last_unstale":"2023-10-06T02:59:56.657447+0000","last_undegraded":"2023-10-06T02:59:56.657447+0000","last_fullsized":"2023-10-06T02:59:56.657447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:06.399442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665719+0000","last_change":"2023-10-06T02:59:56.661183+0000","last_active":"2023-10-06T02:59:56.665719+0000","last_peered":"2023-10-06T02:59:56.665719+0000","last_clean":"2023-10-06T02:59:56.665719+0000","last_became_active":"2023-10-06T02:59:56.660988+0000","last_became_peered":"2023-10-06T02:59:56.660988+0000","last_unstale":"2023-10-06T02:59:56.665719+0000","last_undegraded":"2023-10-06T02:59:56.665719+0000","last_fullsized":"2023-10-06T02:59:56.665719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:35.208092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666095+0000","last_change":"2023-10-06T02:59:56.660285+0000","last_active":"2023-10-06T02:59:56.666095+0000","last_peered":"2023-10-06T02:59:56.666095+0000","last_clean":"2023-10-06T02:59:56.666095+0000","last_became_active":"2023-10-06T02:59:56.660053+0000","last_became_peered":"2023-10-06T02:59:56.660053+0000","last_unstale":"2023-10-06T02:59:56.666095+0000","last_undegraded":"2023-10-06T02:59:56.666095+0000","last_fullsized":"2023-10-06T02:59:56.666095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:32.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662891+0000","last_change":"2023-10-06T02:59:56.654842+0000","last_active":"2023-10-06T02:59:56.662891+0000","last_peered":"2023-10-06T02:59:56.662891+0000","last_clean":"2023-10-06T02:59:56.662891+0000","last_became_active":"2023-10-06T02:59:56.654489+0000","last_became_peered":"2023-10-06T02:59:56.654489+0000","last_unstale":"2023-10-06T02:59:56.662891+0000","last_undegraded":"2023-10-06T02:59:56.662891+0000","last_fullsized":"2023-10-06T02:59:56.662891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:48.042666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666369+0000","last_change":"2023-10-06T02:59:56.659176+0000","last_active":"2023-10-06T02:59:56.666369+0000","last_peered":"2023-10-06T02:59:56.666369+0000","last_clean":"2023-10-06T02:59:56.666369+0000","last_became_active":"2023-10-06T02:59:56.658895+0000","last_became_peered":"2023-10-06T02:59:56.658895+0000","last_unstale":"2023-10-06T02:59:56.666369+0000","last_undegraded":"2023-10-06T02:59:56.666369+0000","last_fullsized":"2023-10-06T02:59:56.666369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:32.920598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659517+0000","last_change":"2023-10-06T02:59:56.656063+0000","last_active":"2023-10-06T02:59:56.659517+0000","last_peered":"2023-10-06T02:59:56.659517+0000","last_clean":"2023-10-06T02:59:56.659517+0000","last_became_active":"2023-10-06T02:59:56.655482+0000","last_became_peered":"2023-10-06T02:59:56.655482+0000","last_unstale":"2023-10-06T02:59:56.659517+0000","last_undegraded":"2023-10-06T02:59:56.659517+0000","last_fullsized":"2023-10-06T02:59:56.659517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:59.821733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658409+0000","last_change":"2023-10-06T02:59:56.650361+0000","last_active":"2023-10-06T02:59:56.658409+0000","last_peered":"2023-10-06T02:59:56.658409+0000","last_clean":"2023-10-06T02:59:56.658409+0000","last_became_active":"2023-10-06T02:59:56.650083+0000","last_became_peered":"2023-10-06T02:59:56.650083+0000","last_unstale":"2023-10-06T02:59:56.658409+0000","last_undegraded":"2023-10-06T02:59:56.658409+0000","last_fullsized":"2023-10-06T02:59:56.658409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:54.006924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673217+0000","last_change":"2023-10-06T02:59:56.667057+0000","last_active":"2023-10-06T02:59:56.673217+0000","last_peered":"2023-10-06T02:59:56.673217+0000","last_clean":"2023-10-06T02:59:56.673217+0000","last_became_active":"2023-10-06T02:59:56.666795+0000","last_became_peered":"2023-10-06T02:59:56.666795+0000","last_unstale":"2023-10-06T02:59:56.673217+0000","last_undegraded":"2023-10-06T02:59:56.673217+0000","last_fullsized":"2023-10-06T02:59:56.673217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:22.069667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670634+0000","last_change":"2023-10-06T02:59:56.660089+0000","last_active":"2023-10-06T02:59:56.670634+0000","last_peered":"2023-10-06T02:59:56.670634+0000","last_clean":"2023-10-06T02:59:56.670634+0000","last_became_active":"2023-10-06T02:59:56.659671+0000","last_became_peered":"2023-10-06T02:59:56.659671+0000","last_unstale":"2023-10-06T02:59:56.670634+0000","last_undegraded":"2023-10-06T02:59:56.670634+0000","last_fullsized":"2023-10-06T02:59:56.670634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:26.258422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659331+0000","last_change":"2023-10-06T02:59:56.656638+0000","last_active":"2023-10-06T02:59:56.659331+0000","last_peered":"2023-10-06T02:59:56.659331+0000","last_clean":"2023-10-06T02:59:56.659331+0000","last_became_active":"2023-10-06T02:59:56.656407+0000","last_became_peered":"2023-10-06T02:59:56.656407+0000","last_unstale":"2023-10-06T02:59:56.659331+0000","last_undegraded":"2023-10-06T02:59:56.659331+0000","last_fullsized":"2023-10-06T02:59:56.659331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.468260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.664557+0000","last_change":"2023-10-06T02:59:56.652294+0000","last_active":"2023-10-06T02:59:56.664557+0000","last_peered":"2023-10-06T02:59:56.664557+0000","last_clean":"2023-10-06T02:59:56.664557+0000","last_became_active":"2023-10-06T02:59:56.652044+0000","last_became_peered":"2023-10-06T02:59:56.652044+0000","last_unstale":"2023-10-06T02:59:56.664557+0000","last_undegraded":"2023-10-06T02:59:56.664557+0000","last_fullsized":"2023-10-06T02:59:56.664557+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:38.800621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.648922+0000","last_change":"2023-10-06T02:59:56.646557+0000","last_active":"2023-10-06T02:59:56.648922+0000","last_peered":"2023-10-06T02:59:56.648922+0000","last_clean":"2023-10-06T02:59:56.648922+0000","last_became_active":"2023-10-06T02:59:56.646319+0000","last_became_peered":"2023-10-06T02:59:56.646319+0000","last_unstale":"2023-10-06T02:59:56.648922+0000","last_undegraded":"2023-10-06T02:59:56.648922+0000","last_fullsized":"2023-10-06T02:59:56.648922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:11.278752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658353+0000","last_change":"2023-10-06T02:59:56.649886+0000","last_active":"2023-10-06T02:59:56.658353+0000","last_peered":"2023-10-06T02:59:56.658353+0000","last_clean":"2023-10-06T02:59:56.658353+0000","last_became_active":"2023-10-06T02:59:56.649691+0000","last_became_peered":"2023-10-06T02:59:56.649691+0000","last_unstale":"2023-10-06T02:59:56.658353+0000","last_undegraded":"2023-10-06T02:59:56.658353+0000","last_fullsized":"2023-10-06T02:59:56.658353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:51.279379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666119+0000","last_change":"2023-10-06T02:59:56.663324+0000","last_active":"2023-10-06T02:59:56.666119+0000","last_peered":"2023-10-06T02:59:56.666119+0000","last_clean":"2023-10-06T02:59:56.666119+0000","last_became_active":"2023-10-06T02:59:56.663051+0000","last_became_peered":"2023-10-06T02:59:56.663051+0000","last_unstale":"2023-10-06T02:59:56.666119+0000","last_undegraded":"2023-10-06T02:59:56.666119+0000","last_fullsized":"2023-10-06T02:59:56.666119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:41.619380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.655926+0000","last_change":"2023-10-06T02:59:56.652402+0000","last_active":"2023-10-06T02:59:56.655926+0000","last_peered":"2023-10-06T02:59:56.655926+0000","last_clean":"2023-10-06T02:59:56.655926+0000","last_became_active":"2023-10-06T02:59:56.652163+0000","last_became_peered":"2023-10-06T02:59:56.652163+0000","last_unstale":"2023-10-06T02:59:56.655926+0000","last_undegraded":"2023-10-06T02:59:56.655926+0000","last_fullsized":"2023-10-06T02:59:56.655926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:18:58.373420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658491+0000","last_change":"2023-10-06T02:59:56.649622+0000","last_active":"2023-10-06T02:59:56.658491+0000","last_peered":"2023-10-06T02:59:56.658491+0000","last_clean":"2023-10-06T02:59:56.658491+0000","last_became_active":"2023-10-06T02:59:56.649355+0000","last_became_peered":"2023-10-06T02:59:56.649355+0000","last_unstale":"2023-10-06T02:59:56.658491+0000","last_undegraded":"2023-10-06T02:59:56.658491+0000","last_fullsized":"2023-10-06T02:59:56.658491+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:12.927685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668022+0000","last_change":"2023-10-06T02:59:56.664888+0000","last_active":"2023-10-06T02:59:56.668022+0000","last_peered":"2023-10-06T02:59:56.668022+0000","last_clean":"2023-10-06T02:59:56.668022+0000","last_became_active":"2023-10-06T02:59:56.664648+0000","last_became_peered":"2023-10-06T02:59:56.664648+0000","last_unstale":"2023-10-06T02:59:56.668022+0000","last_undegraded":"2023-10-06T02:59:56.668022+0000","last_fullsized":"2023-10-06T02:59:56.668022+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:04.036915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668451+0000","last_change":"2023-10-06T02:59:56.664480+0000","last_active":"2023-10-06T02:59:56.668451+0000","last_peered":"2023-10-06T02:59:56.668451+0000","last_clean":"2023-10-06T02:59:56.668451+0000","last_became_active":"2023-10-06T02:59:56.664148+0000","last_became_peered":"2023-10-06T02:59:56.664148+0000","last_unstale":"2023-10-06T02:59:56.668451+0000","last_undegraded":"2023-10-06T02:59:56.668451+0000","last_fullsized":"2023-10-06T02:59:56.668451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:25.698974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673143+0000","last_change":"2023-10-06T02:59:56.665876+0000","last_active":"2023-10-06T02:59:56.673143+0000","last_peered":"2023-10-06T02:59:56.673143+0000","last_clean":"2023-10-06T02:59:56.673143+0000","last_became_active":"2023-10-06T02:59:56.664856+0000","last_became_peered":"2023-10-06T02:59:56.664856+0000","last_unstale":"2023-10-06T02:59:56.673143+0000","last_undegraded":"2023-10-06T02:59:56.673143+0000","last_fullsized":"2023-10-06T02:59:56.673143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:20:30.130330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665618+0000","last_change":"2023-10-06T02:59:56.660820+0000","last_active":"2023-10-06T02:59:56.665618+0000","last_peered":"2023-10-06T02:59:56.665618+0000","last_clean":"2023-10-06T02:59:56.665618+0000","last_became_active":"2023-10-06T02:59:56.660541+0000","last_became_peered":"2023-10-06T02:59:56.660541+0000","last_unstale":"2023-10-06T02:59:56.665618+0000","last_undegraded":"2023-10-06T02:59:56.665618+0000","last_fullsized":"2023-10-06T02:59:56.665618+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:30.732207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670748+0000","last_change":"2023-10-06T02:59:56.666626+0000","last_active":"2023-10-06T02:59:56.670748+0000","last_peered":"2023-10-06T02:59:56.670748+0000","last_clean":"2023-10-06T02:59:56.670748+0000","last_became_active":"2023-10-06T02:59:56.666387+0000","last_became_peered":"2023-10-06T02:59:56.666387+0000","last_unstale":"2023-10-06T02:59:56.670748+0000","last_undegraded":"2023-10-06T02:59:56.670748+0000","last_fullsized":"2023-10-06T02:59:56.670748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:43.892640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.667962+0000","last_change":"2023-10-06T02:59:56.664402+0000","last_active":"2023-10-06T02:59:56.667962+0000","last_peered":"2023-10-06T02:59:56.667962+0000","last_clean":"2023-10-06T02:59:56.667962+0000","last_became_active":"2023-10-06T02:59:56.664140+0000","last_became_peered":"2023-10-06T02:59:56.664140+0000","last_unstale":"2023-10-06T02:59:56.667962+0000","last_undegraded":"2023-10-06T02:59:56.667962+0000","last_fullsized":"2023-10-06T02:59:56.667962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:36.940585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673083+0000","last_change":"2023-10-06T02:59:56.665009+0000","last_active":"2023-10-06T02:59:56.673083+0000","last_peered":"2023-10-06T02:59:56.673083+0000","last_clean":"2023-10-06T02:59:56.673083+0000","last_became_active":"2023-10-06T02:59:56.664623+0000","last_became_peered":"2023-10-06T02:59:56.664623+0000","last_unstale":"2023-10-06T02:59:56.673083+0000","last_undegraded":"2023-10-06T02:59:56.673083+0000","last_fullsized":"2023-10-06T02:59:56.673083+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:38.800621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666147+0000","last_change":"2023-10-06T02:59:56.662117+0000","last_active":"2023-10-06T02:59:56.666147+0000","last_peered":"2023-10-06T02:59:56.666147+0000","last_clean":"2023-10-06T02:59:56.666147+0000","last_became_active":"2023-10-06T02:59:56.660614+0000","last_became_peered":"2023-10-06T02:59:56.660614+0000","last_unstale":"2023-10-06T02:59:56.666147+0000","last_undegraded":"2023-10-06T02:59:56.666147+0000","last_fullsized":"2023-10-06T02:59:56.666147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:03:05.223973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670509+0000","last_change":"2023-10-06T02:59:56.663942+0000","last_active":"2023-10-06T02:59:56.670509+0000","last_peered":"2023-10-06T02:59:56.670509+0000","last_clean":"2023-10-06T02:59:56.670509+0000","last_became_active":"2023-10-06T02:59:56.663665+0000","last_became_peered":"2023-10-06T02:59:56.663665+0000","last_unstale":"2023-10-06T02:59:56.670509+0000","last_undegraded":"2023-10-06T02:59:56.670509+0000","last_fullsized":"2023-10-06T02:59:56.670509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:32.631059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"81'4","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.672270+0000","last_change":"2023-10-06T02:59:55.637735+0000","last_active":"2023-10-06T02:59:56.672270+0000","last_peered":"2023-10-06T02:59:56.672270+0000","last_clean":"2023-10-06T02:59:56.672270+0000","last_became_active":"2023-10-06T02:59:55.637191+0000","last_became_peered":"2023-10-06T02:59:55.637191+0000","last_unstale":"2023-10-06T02:59:56.672270+0000","last_undegraded":"2023-10-06T02:59:56.672270+0000","last_fullsized":"2023-10-06T02:59:56.672270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:05.335315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.655893+0000","last_change":"2023-10-06T02:59:56.652804+0000","last_active":"2023-10-06T02:59:56.655893+0000","last_peered":"2023-10-06T02:59:56.655893+0000","last_clean":"2023-10-06T02:59:56.655893+0000","last_became_active":"2023-10-06T02:59:56.652501+0000","last_became_peered":"2023-10-06T02:59:56.652501+0000","last_unstale":"2023-10-06T02:59:56.655893+0000","last_undegraded":"2023-10-06T02:59:56.655893+0000","last_fullsized":"2023-10-06T02:59:56.655893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.845214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673114+0000","last_change":"2023-10-06T02:59:55.639800+0000","last_active":"2023-10-06T02:59:56.673114+0000","last_peered":"2023-10-06T02:59:56.673114+0000","last_clean":"2023-10-06T02:59:56.673114+0000","last_became_active":"2023-10-06T02:59:55.639600+0000","last_became_peered":"2023-10-06T02:59:55.639600+0000","last_unstale":"2023-10-06T02:59:56.673114+0000","last_undegraded":"2023-10-06T02:59:56.673114+0000","last_fullsized":"2023-10-06T02:59:56.673114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:09.958622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662973+0000","last_change":"2023-10-06T02:59:56.655989+0000","last_active":"2023-10-06T02:59:56.662973+0000","last_peered":"2023-10-06T02:59:56.662973+0000","last_clean":"2023-10-06T02:59:56.662973+0000","last_became_active":"2023-10-06T02:59:56.655139+0000","last_became_peered":"2023-10-06T02:59:56.655139+0000","last_unstale":"2023-10-06T02:59:56.662973+0000","last_undegraded":"2023-10-06T02:59:56.662973+0000","last_fullsized":"2023-10-06T02:59:56.662973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:02.711247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.669624+0000","last_change":"2023-10-06T02:59:55.636721+0000","last_active":"2023-10-06T02:59:56.669624+0000","last_peered":"2023-10-06T02:59:56.669624+0000","last_clean":"2023-10-06T02:59:56.669624+0000","last_became_active":"2023-10-06T02:59:55.636460+0000","last_became_peered":"2023-10-06T02:59:55.636460+0000","last_unstale":"2023-10-06T02:59:56.669624+0000","last_undegraded":"2023-10-06T02:59:56.669624+0000","last_fullsized":"2023-10-06T02:59:56.669624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:34:31.911032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665978+0000","last_change":"2023-10-06T02:59:56.659468+0000","last_active":"2023-10-06T02:59:56.665978+0000","last_peered":"2023-10-06T02:59:56.665978+0000","last_clean":"2023-10-06T02:59:56.665978+0000","last_became_active":"2023-10-06T02:59:56.659192+0000","last_became_peered":"2023-10-06T02:59:56.659192+0000","last_unstale":"2023-10-06T02:59:56.665978+0000","last_undegraded":"2023-10-06T02:59:56.665978+0000","last_fullsized":"2023-10-06T02:59:56.665978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:26.466442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.669010+0000","last_change":"2023-10-06T02:59:55.641777+0000","last_active":"2023-10-06T02:59:56.669010+0000","last_peered":"2023-10-06T02:59:56.669010+0000","last_clean":"2023-10-06T02:59:56.669010+0000","last_became_active":"2023-10-06T02:59:55.641517+0000","last_became_peered":"2023-10-06T02:59:55.641517+0000","last_unstale":"2023-10-06T02:59:56.669010+0000","last_undegraded":"2023-10-06T02:59:56.669010+0000","last_fullsized":"2023-10-06T02:59:56.669010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:13.255613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670782+0000","last_change":"2023-10-06T02:59:56.666015+0000","last_active":"2023-10-06T02:59:56.670782+0000","last_peered":"2023-10-06T02:59:56.670782+0000","last_clean":"2023-10-06T02:59:56.670782+0000","last_became_active":"2023-10-06T02:59:56.665698+0000","last_became_peered":"2023-10-06T02:59:56.665698+0000","last_unstale":"2023-10-06T02:59:56.670782+0000","last_undegraded":"2023-10-06T02:59:56.670782+0000","last_fullsized":"2023-10-06T02:59:56.670782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:06.344880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673264+0000","last_change":"2023-10-06T02:59:55.633418+0000","last_active":"2023-10-06T02:59:56.673264+0000","last_peered":"2023-10-06T02:59:56.673264+0000","last_clean":"2023-10-06T02:59:56.673264+0000","last_became_active":"2023-10-06T02:59:55.633078+0000","last_became_peered":"2023-10-06T02:59:55.633078+0000","last_unstale":"2023-10-06T02:59:56.673264+0000","last_undegraded":"2023-10-06T02:59:56.673264+0000","last_fullsized":"2023-10-06T02:59:56.673264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:09.065254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.670503+0000","last_change":"2023-10-06T02:59:56.660071+0000","last_active":"2023-10-06T02:59:56.670503+0000","last_peered":"2023-10-06T02:59:56.670503+0000","last_clean":"2023-10-06T02:59:56.670503+0000","last_became_active":"2023-10-06T02:59:56.659776+0000","last_became_peered":"2023-10-06T02:59:56.659776+0000","last_unstale":"2023-10-06T02:59:56.670503+0000","last_undegraded":"2023-10-06T02:59:56.670503+0000","last_fullsized":"2023-10-06T02:59:56.670503+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:29.271660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673106+0000","last_change":"2023-10-06T02:59:55.635392+0000","last_active":"2023-10-06T02:59:56.673106+0000","last_peered":"2023-10-06T02:59:56.673106+0000","last_clean":"2023-10-06T02:59:56.673106+0000","last_became_active":"2023-10-06T02:59:55.635106+0000","last_became_peered":"2023-10-06T02:59:55.635106+0000","last_unstale":"2023-10-06T02:59:56.673106+0000","last_undegraded":"2023-10-06T02:59:56.673106+0000","last_fullsized":"2023-10-06T02:59:56.673106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:15.161292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673471+0000","last_change":"2023-10-06T02:59:56.669446+0000","last_active":"2023-10-06T02:59:56.673471+0000","last_peered":"2023-10-06T02:59:56.673471+0000","last_clean":"2023-10-06T02:59:56.673471+0000","last_became_active":"2023-10-06T02:59:56.669234+0000","last_became_peered":"2023-10-06T02:59:56.669234+0000","last_unstale":"2023-10-06T02:59:56.673471+0000","last_undegraded":"2023-10-06T02:59:56.673471+0000","last_fullsized":"2023-10-06T02:59:56.673471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:18.024863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644550+0000","last_change":"2023-10-06T02:59:55.633504+0000","last_active":"2023-10-06T02:59:56.644550+0000","last_peered":"2023-10-06T02:59:56.644550+0000","last_clean":"2023-10-06T02:59:56.644550+0000","last_became_active":"2023-10-06T02:59:55.633209+0000","last_became_peered":"2023-10-06T02:59:55.633209+0000","last_unstale":"2023-10-06T02:59:56.644550+0000","last_undegraded":"2023-10-06T02:59:56.644550+0000","last_fullsized":"2023-10-06T02:59:56.644550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:00.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658390+0000","last_change":"2023-10-06T02:59:56.649950+0000","last_active":"2023-10-06T02:59:56.658390+0000","last_peered":"2023-10-06T02:59:56.658390+0000","last_clean":"2023-10-06T02:59:56.658390+0000","last_became_active":"2023-10-06T02:59:56.649733+0000","last_became_peered":"2023-10-06T02:59:56.649733+0000","last_unstale":"2023-10-06T02:59:56.658390+0000","last_undegraded":"2023-10-06T02:59:56.658390+0000","last_fullsized":"2023-10-06T02:59:56.658390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:29.193834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.650790+0000","last_change":"2023-10-06T02:59:55.640720+0000","last_active":"2023-10-06T02:59:56.650790+0000","last_peered":"2023-10-06T02:59:56.650790+0000","last_clean":"2023-10-06T02:59:56.650790+0000","last_became_active":"2023-10-06T02:59:55.640473+0000","last_became_peered":"2023-10-06T02:59:55.640473+0000","last_unstale":"2023-10-06T02:59:56.650790+0000","last_undegraded":"2023-10-06T02:59:56.650790+0000","last_fullsized":"2023-10-06T02:59:56.650790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:22.962186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.660342+0000","last_change":"2023-10-06T02:59:56.655193+0000","last_active":"2023-10-06T02:59:56.660342+0000","last_peered":"2023-10-06T02:59:56.660342+0000","last_clean":"2023-10-06T02:59:56.660342+0000","last_became_active":"2023-10-06T02:59:56.654888+0000","last_became_peered":"2023-10-06T02:59:56.654888+0000","last_unstale":"2023-10-06T02:59:56.660342+0000","last_undegraded":"2023-10-06T02:59:56.660342+0000","last_fullsized":"2023-10-06T02:59:56.660342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:22.069667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645254+0000","last_change":"2023-10-06T02:59:55.637889+0000","last_active":"2023-10-06T02:59:56.645254+0000","last_peered":"2023-10-06T02:59:56.645254+0000","last_clean":"2023-10-06T02:59:56.645254+0000","last_became_active":"2023-10-06T02:59:55.637575+0000","last_became_peered":"2023-10-06T02:59:55.637575+0000","last_unstale":"2023-10-06T02:59:56.645254+0000","last_undegraded":"2023-10-06T02:59:56.645254+0000","last_fullsized":"2023-10-06T02:59:56.645254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:42.883074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.657428+0000","last_change":"2023-10-06T02:59:56.651050+0000","last_active":"2023-10-06T02:59:56.657428+0000","last_peered":"2023-10-06T02:59:56.657428+0000","last_clean":"2023-10-06T02:59:56.657428+0000","last_became_active":"2023-10-06T02:59:56.650805+0000","last_became_peered":"2023-10-06T02:59:56.650805+0000","last_unstale":"2023-10-06T02:59:56.657428+0000","last_undegraded":"2023-10-06T02:59:56.657428+0000","last_fullsized":"2023-10-06T02:59:56.657428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:25.698974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645902+0000","last_change":"2023-10-06T02:59:55.635033+0000","last_active":"2023-10-06T02:59:56.645902+0000","last_peered":"2023-10-06T02:59:56.645902+0000","last_clean":"2023-10-06T02:59:56.645902+0000","last_became_active":"2023-10-06T02:59:55.634743+0000","last_became_peered":"2023-10-06T02:59:55.634743+0000","last_unstale":"2023-10-06T02:59:56.645902+0000","last_undegraded":"2023-10-06T02:59:56.645902+0000","last_fullsized":"2023-10-06T02:59:56.645902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:11.021747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668868+0000","last_change":"2023-10-06T02:59:56.657779+0000","last_active":"2023-10-06T02:59:56.668868+0000","last_peered":"2023-10-06T02:59:56.668868+0000","last_clean":"2023-10-06T02:59:56.668868+0000","last_became_active":"2023-10-06T02:59:56.657586+0000","last_became_peered":"2023-10-06T02:59:56.657586+0000","last_unstale":"2023-10-06T02:59:56.668868+0000","last_undegraded":"2023-10-06T02:59:56.668868+0000","last_fullsized":"2023-10-06T02:59:56.668868+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:22.069667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"81'3","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.671541+0000","last_change":"2023-10-06T02:59:55.642560+0000","last_active":"2023-10-06T02:59:56.671541+0000","last_peered":"2023-10-06T02:59:56.671541+0000","last_clean":"2023-10-06T02:59:56.671541+0000","last_became_active":"2023-10-06T02:59:55.642297+0000","last_became_peered":"2023-10-06T02:59:55.642297+0000","last_unstale":"2023-10-06T02:59:56.671541+0000","last_undegraded":"2023-10-06T02:59:56.671541+0000","last_fullsized":"2023-10-06T02:59:56.671541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:03.027349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673213+0000","last_change":"2023-10-06T02:59:56.666812+0000","last_active":"2023-10-06T02:59:56.673213+0000","last_peered":"2023-10-06T02:59:56.673213+0000","last_clean":"2023-10-06T02:59:56.673213+0000","last_became_active":"2023-10-06T02:59:56.665367+0000","last_became_peered":"2023-10-06T02:59:56.665367+0000","last_unstale":"2023-10-06T02:59:56.673213+0000","last_undegraded":"2023-10-06T02:59:56.673213+0000","last_fullsized":"2023-10-06T02:59:56.673213+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:15.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"81'6","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.674662+0000","last_change":"2023-10-06T02:59:55.639984+0000","last_active":"2023-10-06T02:59:56.674662+0000","last_peered":"2023-10-06T02:59:56.674662+0000","last_clean":"2023-10-06T02:59:56.674662+0000","last_became_active":"2023-10-06T02:59:55.639673+0000","last_became_peered":"2023-10-06T02:59:55.639673+0000","last_unstale":"2023-10-06T02:59:56.674662+0000","last_undegraded":"2023-10-06T02:59:56.674662+0000","last_fullsized":"2023-10-06T02:59:56.674662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.033101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668274+0000","last_change":"2023-10-06T02:59:56.658938+0000","last_active":"2023-10-06T02:59:56.668274+0000","last_peered":"2023-10-06T02:59:56.668274+0000","last_clean":"2023-10-06T02:59:56.668274+0000","last_became_active":"2023-10-06T02:59:56.658673+0000","last_became_peered":"2023-10-06T02:59:56.658673+0000","last_unstale":"2023-10-06T02:59:56.668274+0000","last_undegraded":"2023-10-06T02:59:56.668274+0000","last_fullsized":"2023-10-06T02:59:56.668274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:29.271660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673006+0000","last_change":"2023-10-06T02:59:55.634145+0000","last_active":"2023-10-06T02:59:56.673006+0000","last_peered":"2023-10-06T02:59:56.673006+0000","last_clean":"2023-10-06T02:59:56.673006+0000","last_became_active":"2023-10-06T02:59:55.633840+0000","last_became_peered":"2023-10-06T02:59:55.633840+0000","last_unstale":"2023-10-06T02:59:56.673006+0000","last_undegraded":"2023-10-06T02:59:56.673006+0000","last_fullsized":"2023-10-06T02:59:56.673006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:31.912012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668475+0000","last_change":"2023-10-06T02:59:56.663315+0000","last_active":"2023-10-06T02:59:56.668475+0000","last_peered":"2023-10-06T02:59:56.668475+0000","last_clean":"2023-10-06T02:59:56.668475+0000","last_became_active":"2023-10-06T02:59:56.663014+0000","last_became_peered":"2023-10-06T02:59:56.663014+0000","last_unstale":"2023-10-06T02:59:56.668475+0000","last_undegraded":"2023-10-06T02:59:56.668475+0000","last_fullsized":"2023-10-06T02:59:56.668475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:01.713614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644735+0000","last_change":"2023-10-06T02:59:55.639753+0000","last_active":"2023-10-06T02:59:56.644735+0000","last_peered":"2023-10-06T02:59:56.644735+0000","last_clean":"2023-10-06T02:59:56.644735+0000","last_became_active":"2023-10-06T02:59:55.639531+0000","last_became_peered":"2023-10-06T02:59:55.639531+0000","last_unstale":"2023-10-06T02:59:56.644735+0000","last_undegraded":"2023-10-06T02:59:56.644735+0000","last_fullsized":"2023-10-06T02:59:56.644735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:25.456877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.668067+0000","last_change":"2023-10-06T02:59:56.665199+0000","last_active":"2023-10-06T02:59:56.668067+0000","last_peered":"2023-10-06T02:59:56.668067+0000","last_clean":"2023-10-06T02:59:56.668067+0000","last_became_active":"2023-10-06T02:59:56.664762+0000","last_became_peered":"2023-10-06T02:59:56.664762+0000","last_unstale":"2023-10-06T02:59:56.668067+0000","last_undegraded":"2023-10-06T02:59:56.668067+0000","last_fullsized":"2023-10-06T02:59:56.668067+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:51.279379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644576+0000","last_change":"2023-10-06T02:59:55.638758+0000","last_active":"2023-10-06T02:59:56.644576+0000","last_peered":"2023-10-06T02:59:56.644576+0000","last_clean":"2023-10-06T02:59:56.644576+0000","last_became_active":"2023-10-06T02:59:55.638478+0000","last_became_peered":"2023-10-06T02:59:55.638478+0000","last_unstale":"2023-10-06T02:59:56.644576+0000","last_undegraded":"2023-10-06T02:59:56.644576+0000","last_fullsized":"2023-10-06T02:59:56.644576+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:34.198527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.667884+0000","last_change":"2023-10-06T02:59:56.664500+0000","last_active":"2023-10-06T02:59:56.667884+0000","last_peered":"2023-10-06T02:59:56.667884+0000","last_clean":"2023-10-06T02:59:56.667884+0000","last_became_active":"2023-10-06T02:59:56.664230+0000","last_became_peered":"2023-10-06T02:59:56.664230+0000","last_unstale":"2023-10-06T02:59:56.667884+0000","last_undegraded":"2023-10-06T02:59:56.667884+0000","last_fullsized":"2023-10-06T02:59:56.667884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:40.886440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"81'8","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673768+0000","last_change":"2023-10-06T02:59:55.637936+0000","last_active":"2023-10-06T02:59:56.673768+0000","last_peered":"2023-10-06T02:59:56.673768+0000","last_clean":"2023-10-06T02:59:56.673768+0000","last_became_active":"2023-10-06T02:59:55.637671+0000","last_became_peered":"2023-10-06T02:59:55.637671+0000","last_unstale":"2023-10-06T02:59:56.673768+0000","last_undegraded":"2023-10-06T02:59:56.673768+0000","last_fullsized":"2023-10-06T02:59:56.673768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:19.388026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665617+0000","last_change":"2023-10-06T02:59:56.658420+0000","last_active":"2023-10-06T02:59:56.665617+0000","last_peered":"2023-10-06T02:59:56.665617+0000","last_clean":"2023-10-06T02:59:56.665617+0000","last_became_active":"2023-10-06T02:59:56.658066+0000","last_became_peered":"2023-10-06T02:59:56.658066+0000","last_unstale":"2023-10-06T02:59:56.665617+0000","last_undegraded":"2023-10-06T02:59:56.665617+0000","last_fullsized":"2023-10-06T02:59:56.665617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:29.163729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673635+0000","last_change":"2023-10-06T02:59:55.635553+0000","last_active":"2023-10-06T02:59:56.673635+0000","last_peered":"2023-10-06T02:59:56.673635+0000","last_clean":"2023-10-06T02:59:56.673635+0000","last_became_active":"2023-10-06T02:59:55.635307+0000","last_became_peered":"2023-10-06T02:59:55.635307+0000","last_unstale":"2023-10-06T02:59:56.673635+0000","last_undegraded":"2023-10-06T02:59:56.673635+0000","last_fullsized":"2023-10-06T02:59:56.673635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:03:23.430636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662629+0000","last_change":"2023-10-06T02:59:56.656838+0000","last_active":"2023-10-06T02:59:56.662629+0000","last_peered":"2023-10-06T02:59:56.662629+0000","last_clean":"2023-10-06T02:59:56.662629+0000","last_became_active":"2023-10-06T02:59:56.656553+0000","last_became_peered":"2023-10-06T02:59:56.656553+0000","last_unstale":"2023-10-06T02:59:56.662629+0000","last_undegraded":"2023-10-06T02:59:56.662629+0000","last_fullsized":"2023-10-06T02:59:56.662629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:20.397591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.652946+0000","last_change":"2023-10-06T02:59:55.636391+0000","last_active":"2023-10-06T02:59:56.652946+0000","last_peered":"2023-10-06T02:59:56.652946+0000","last_clean":"2023-10-06T02:59:56.652946+0000","last_became_active":"2023-10-06T02:59:55.636118+0000","last_became_peered":"2023-10-06T02:59:55.636118+0000","last_unstale":"2023-10-06T02:59:56.652946+0000","last_undegraded":"2023-10-06T02:59:56.652946+0000","last_fullsized":"2023-10-06T02:59:56.652946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:51.281866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.656783+0000","last_change":"2023-10-06T02:59:56.649441+0000","last_active":"2023-10-06T02:59:56.656783+0000","last_peered":"2023-10-06T02:59:56.656783+0000","last_clean":"2023-10-06T02:59:56.656783+0000","last_became_active":"2023-10-06T02:59:56.648978+0000","last_became_peered":"2023-10-06T02:59:56.648978+0000","last_unstale":"2023-10-06T02:59:56.656783+0000","last_undegraded":"2023-10-06T02:59:56.656783+0000","last_fullsized":"2023-10-06T02:59:56.656783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:30.881942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.643678+0000","last_change":"2023-10-06T02:59:55.635507+0000","last_active":"2023-10-06T02:59:56.643678+0000","last_peered":"2023-10-06T02:59:56.643678+0000","last_clean":"2023-10-06T02:59:56.643678+0000","last_became_active":"2023-10-06T02:59:55.635254+0000","last_became_peered":"2023-10-06T02:59:55.635254+0000","last_unstale":"2023-10-06T02:59:56.643678+0000","last_undegraded":"2023-10-06T02:59:56.643678+0000","last_fullsized":"2023-10-06T02:59:56.643678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:28.367900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673164+0000","last_change":"2023-10-06T02:59:56.666079+0000","last_active":"2023-10-06T02:59:56.673164+0000","last_peered":"2023-10-06T02:59:56.673164+0000","last_clean":"2023-10-06T02:59:56.673164+0000","last_became_active":"2023-10-06T02:59:56.665645+0000","last_became_peered":"2023-10-06T02:59:56.665645+0000","last_unstale":"2023-10-06T02:59:56.673164+0000","last_undegraded":"2023-10-06T02:59:56.673164+0000","last_fullsized":"2023-10-06T02:59:56.673164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:29.193834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644909+0000","last_change":"2023-10-06T02:59:55.637247+0000","last_active":"2023-10-06T02:59:56.644909+0000","last_peered":"2023-10-06T02:59:56.644909+0000","last_clean":"2023-10-06T02:59:56.644909+0000","last_became_active":"2023-10-06T02:59:55.636524+0000","last_became_peered":"2023-10-06T02:59:55.636524+0000","last_unstale":"2023-10-06T02:59:56.644909+0000","last_undegraded":"2023-10-06T02:59:56.644909+0000","last_fullsized":"2023-10-06T02:59:56.644909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:34:40.609815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658034+0000","last_change":"2023-10-06T02:59:56.655132+0000","last_active":"2023-10-06T02:59:56.658034+0000","last_peered":"2023-10-06T02:59:56.658034+0000","last_clean":"2023-10-06T02:59:56.658034+0000","last_became_active":"2023-10-06T02:59:56.654653+0000","last_became_peered":"2023-10-06T02:59:56.654653+0000","last_unstale":"2023-10-06T02:59:56.658034+0000","last_undegraded":"2023-10-06T02:59:56.658034+0000","last_fullsized":"2023-10-06T02:59:56.658034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:59.489114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645421+0000","last_change":"2023-10-06T02:59:55.637982+0000","last_active":"2023-10-06T02:59:56.645421+0000","last_peered":"2023-10-06T02:59:56.645421+0000","last_clean":"2023-10-06T02:59:56.645421+0000","last_became_active":"2023-10-06T02:59:55.637689+0000","last_became_peered":"2023-10-06T02:59:55.637689+0000","last_unstale":"2023-10-06T02:59:56.645421+0000","last_undegraded":"2023-10-06T02:59:56.645421+0000","last_fullsized":"2023-10-06T02:59:56.645421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:25.456877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.669207+0000","last_change":"2023-10-06T02:59:56.659092+0000","last_active":"2023-10-06T02:59:56.669207+0000","last_peered":"2023-10-06T02:59:56.669207+0000","last_clean":"2023-10-06T02:59:56.669207+0000","last_became_active":"2023-10-06T02:59:56.658878+0000","last_became_peered":"2023-10-06T02:59:56.658878+0000","last_unstale":"2023-10-06T02:59:56.669207+0000","last_undegraded":"2023-10-06T02:59:56.669207+0000","last_fullsized":"2023-10-06T02:59:56.669207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:29.163729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.653514+0000","last_change":"2023-10-06T02:59:55.635642+0000","last_active":"2023-10-06T02:59:56.653514+0000","last_peered":"2023-10-06T02:59:56.653514+0000","last_clean":"2023-10-06T02:59:56.653514+0000","last_became_active":"2023-10-06T02:59:55.635071+0000","last_became_peered":"2023-10-06T02:59:55.635071+0000","last_unstale":"2023-10-06T02:59:56.653514+0000","last_undegraded":"2023-10-06T02:59:56.653514+0000","last_fullsized":"2023-10-06T02:59:56.653514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:05.389877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.662661+0000","last_change":"2023-10-06T02:59:56.656682+0000","last_active":"2023-10-06T02:59:56.662661+0000","last_peered":"2023-10-06T02:59:56.662661+0000","last_clean":"2023-10-06T02:59:56.662661+0000","last_became_active":"2023-10-06T02:59:56.656360+0000","last_became_peered":"2023-10-06T02:59:56.656360+0000","last_unstale":"2023-10-06T02:59:56.662661+0000","last_undegraded":"2023-10-06T02:59:56.662661+0000","last_fullsized":"2023-10-06T02:59:56.662661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:26:14.265178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.643636+0000","last_change":"2023-10-06T02:59:55.635735+0000","last_active":"2023-10-06T02:59:56.643636+0000","last_peered":"2023-10-06T02:59:56.643636+0000","last_clean":"2023-10-06T02:59:56.643636+0000","last_became_active":"2023-10-06T02:59:55.635480+0000","last_became_peered":"2023-10-06T02:59:55.635480+0000","last_unstale":"2023-10-06T02:59:56.643636+0000","last_undegraded":"2023-10-06T02:59:56.643636+0000","last_fullsized":"2023-10-06T02:59:56.643636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:17:31.433086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.655907+0000","last_change":"2023-10-06T02:59:56.647141+0000","last_active":"2023-10-06T02:59:56.655907+0000","last_peered":"2023-10-06T02:59:56.655907+0000","last_clean":"2023-10-06T02:59:56.655907+0000","last_became_active":"2023-10-06T02:59:56.646979+0000","last_became_peered":"2023-10-06T02:59:56.646979+0000","last_unstale":"2023-10-06T02:59:56.655907+0000","last_undegraded":"2023-10-06T02:59:56.655907+0000","last_fullsized":"2023-10-06T02:59:56.655907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:58.506740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.654484+0000","last_change":"2023-10-06T02:59:55.641019+0000","last_active":"2023-10-06T02:59:56.654484+0000","last_peered":"2023-10-06T02:59:56.654484+0000","last_clean":"2023-10-06T02:59:56.654484+0000","last_became_active":"2023-10-06T02:59:55.640374+0000","last_became_peered":"2023-10-06T02:59:55.640374+0000","last_unstale":"2023-10-06T02:59:56.654484+0000","last_undegraded":"2023-10-06T02:59:56.654484+0000","last_fullsized":"2023-10-06T02:59:56.654484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:24.689409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665149+0000","last_change":"2023-10-06T02:59:56.661031+0000","last_active":"2023-10-06T02:59:56.665149+0000","last_peered":"2023-10-06T02:59:56.665149+0000","last_clean":"2023-10-06T02:59:56.665149+0000","last_became_active":"2023-10-06T02:59:56.660765+0000","last_became_peered":"2023-10-06T02:59:56.660765+0000","last_unstale":"2023-10-06T02:59:56.665149+0000","last_undegraded":"2023-10-06T02:59:56.665149+0000","last_fullsized":"2023-10-06T02:59:56.665149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:39.696799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.642114+0000","last_change":"2023-10-06T02:59:55.636904+0000","last_active":"2023-10-06T02:59:56.642114+0000","last_peered":"2023-10-06T02:59:56.642114+0000","last_clean":"2023-10-06T02:59:56.642114+0000","last_became_active":"2023-10-06T02:59:55.636650+0000","last_became_peered":"2023-10-06T02:59:55.636650+0000","last_unstale":"2023-10-06T02:59:56.642114+0000","last_undegraded":"2023-10-06T02:59:56.642114+0000","last_fullsized":"2023-10-06T02:59:56.642114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:05.261363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.652531+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T02:59:56.652531+0000","last_peered":"2023-10-06T02:59:56.652531+0000","last_clean":"2023-10-06T02:59:56.652531+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T02:59:56.652531+0000","last_undegraded":"2023-10-06T02:59:56.652531+0000","last_fullsized":"2023-10-06T02:59:56.652531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673188+0000","last_change":"2023-10-06T02:59:56.666615+0000","last_active":"2023-10-06T02:59:56.673188+0000","last_peered":"2023-10-06T02:59:56.673188+0000","last_clean":"2023-10-06T02:59:56.673188+0000","last_became_active":"2023-10-06T02:59:56.666339+0000","last_became_peered":"2023-10-06T02:59:56.666339+0000","last_unstale":"2023-10-06T02:59:56.673188+0000","last_undegraded":"2023-10-06T02:59:56.673188+0000","last_fullsized":"2023-10-06T02:59:56.673188+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:06:46.718133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645765+0000","last_change":"2023-10-06T02:59:55.635432+0000","last_active":"2023-10-06T02:59:56.645765+0000","last_peered":"2023-10-06T02:59:56.645765+0000","last_clean":"2023-10-06T02:59:56.645765+0000","last_became_active":"2023-10-06T02:59:55.635144+0000","last_became_peered":"2023-10-06T02:59:55.635144+0000","last_unstale":"2023-10-06T02:59:56.645765+0000","last_undegraded":"2023-10-06T02:59:56.645765+0000","last_fullsized":"2023-10-06T02:59:56.645765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:17.015298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645367+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T02:59:56.645367+0000","last_peered":"2023-10-06T02:59:56.645367+0000","last_clean":"2023-10-06T02:59:56.645367+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T02:59:56.645367+0000","last_undegraded":"2023-10-06T02:59:56.645367+0000","last_fullsized":"2023-10-06T02:59:56.645367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666105+0000","last_change":"2023-10-06T02:59:56.658598+0000","last_active":"2023-10-06T02:59:56.666105+0000","last_peered":"2023-10-06T02:59:56.666105+0000","last_clean":"2023-10-06T02:59:56.666105+0000","last_became_active":"2023-10-06T02:59:56.658335+0000","last_became_peered":"2023-10-06T02:59:56.658335+0000","last_unstale":"2023-10-06T02:59:56.666105+0000","last_undegraded":"2023-10-06T02:59:56.666105+0000","last_fullsized":"2023-10-06T02:59:56.666105+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:10.074820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673465+0000","last_change":"2023-10-06T02:59:55.637836+0000","last_active":"2023-10-06T02:59:56.673465+0000","last_peered":"2023-10-06T02:59:56.673465+0000","last_clean":"2023-10-06T02:59:56.673465+0000","last_became_active":"2023-10-06T02:59:55.637395+0000","last_became_peered":"2023-10-06T02:59:55.637395+0000","last_unstale":"2023-10-06T02:59:56.673465+0000","last_undegraded":"2023-10-06T02:59:56.673465+0000","last_fullsized":"2023-10-06T02:59:56.673465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:35.931020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.641612+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T02:59:56.641612+0000","last_peered":"2023-10-06T02:59:56.641612+0000","last_clean":"2023-10-06T02:59:56.641612+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T02:59:56.641612+0000","last_undegraded":"2023-10-06T02:59:56.641612+0000","last_fullsized":"2023-10-06T02:59:56.641612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.666131+0000","last_change":"2023-10-06T02:59:56.659788+0000","last_active":"2023-10-06T02:59:56.666131+0000","last_peered":"2023-10-06T02:59:56.666131+0000","last_clean":"2023-10-06T02:59:56.666131+0000","last_became_active":"2023-10-06T02:59:56.659545+0000","last_became_peered":"2023-10-06T02:59:56.659545+0000","last_unstale":"2023-10-06T02:59:56.666131+0000","last_undegraded":"2023-10-06T02:59:56.666131+0000","last_fullsized":"2023-10-06T02:59:56.666131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:49:01.713244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"81'1","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.673278+0000","last_change":"2023-10-06T02:59:55.642783+0000","last_active":"2023-10-06T02:59:56.673278+0000","last_peered":"2023-10-06T02:59:56.673278+0000","last_clean":"2023-10-06T02:59:56.673278+0000","last_became_active":"2023-10-06T02:59:55.642464+0000","last_became_peered":"2023-10-06T02:59:55.642464+0000","last_unstale":"2023-10-06T02:59:56.673278+0000","last_undegraded":"2023-10-06T02:59:56.673278+0000","last_fullsized":"2023-10-06T02:59:56.673278+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:57.967039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645671+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T02:59:56.645671+0000","last_peered":"2023-10-06T02:59:56.645671+0000","last_clean":"2023-10-06T02:59:56.645671+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T02:59:56.645671+0000","last_undegraded":"2023-10-06T02:59:56.645671+0000","last_fullsized":"2023-10-06T02:59:56.645671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":216,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.648419+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T02:59:56.648419+0000","last_peered":"2023-10-06T02:59:56.648419+0000","last_clean":"2023-10-06T02:59:56.648419+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T02:59:56.648419+0000","last_undegraded":"2023-10-06T02:59:56.648419+0000","last_fullsized":"2023-10-06T02:59:56.648419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.655870+0000","last_change":"2023-10-06T02:59:56.650817+0000","last_active":"2023-10-06T02:59:56.655870+0000","last_peered":"2023-10-06T02:59:56.655870+0000","last_clean":"2023-10-06T02:59:56.655870+0000","last_became_active":"2023-10-06T02:59:56.650558+0000","last_became_peered":"2023-10-06T02:59:56.650558+0000","last_unstale":"2023-10-06T02:59:56.655870+0000","last_undegraded":"2023-10-06T02:59:56.655870+0000","last_fullsized":"2023-10-06T02:59:56.655870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:58.976605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.672295+0000","last_change":"2023-10-06T02:59:55.642325+0000","last_active":"2023-10-06T02:59:56.672295+0000","last_peered":"2023-10-06T02:59:56.672295+0000","last_clean":"2023-10-06T02:59:56.672295+0000","last_became_active":"2023-10-06T02:59:55.642100+0000","last_became_peered":"2023-10-06T02:59:55.642100+0000","last_unstale":"2023-10-06T02:59:56.672295+0000","last_undegraded":"2023-10-06T02:59:56.672295+0000","last_fullsized":"2023-10-06T02:59:56.672295+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:59:34.586491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.648514+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T02:59:56.648514+0000","last_peered":"2023-10-06T02:59:56.648514+0000","last_clean":"2023-10-06T02:59:56.648514+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T02:59:56.648514+0000","last_undegraded":"2023-10-06T02:59:56.648514+0000","last_fullsized":"2023-10-06T02:59:56.648514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.659535+0000","last_change":"2023-10-06T02:59:56.656100+0000","last_active":"2023-10-06T02:59:56.659535+0000","last_peered":"2023-10-06T02:59:56.659535+0000","last_clean":"2023-10-06T02:59:56.659535+0000","last_became_active":"2023-10-06T02:59:56.655827+0000","last_became_peered":"2023-10-06T02:59:56.655827+0000","last_unstale":"2023-10-06T02:59:56.659535+0000","last_undegraded":"2023-10-06T02:59:56.659535+0000","last_fullsized":"2023-10-06T02:59:56.659535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:38.456482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"81'2","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.665254+0000","last_change":"2023-10-06T02:59:55.636499+0000","last_active":"2023-10-06T02:59:56.665254+0000","last_peered":"2023-10-06T02:59:56.665254+0000","last_clean":"2023-10-06T02:59:56.665254+0000","last_became_active":"2023-10-06T02:59:55.636233+0000","last_became_peered":"2023-10-06T02:59:55.636233+0000","last_unstale":"2023-10-06T02:59:56.665254+0000","last_undegraded":"2023-10-06T02:59:56.665254+0000","last_fullsized":"2023-10-06T02:59:56.665254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:19.388026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.648597+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T02:59:56.648597+0000","last_peered":"2023-10-06T02:59:56.648597+0000","last_clean":"2023-10-06T02:59:56.648597+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T02:59:56.648597+0000","last_undegraded":"2023-10-06T02:59:56.648597+0000","last_fullsized":"2023-10-06T02:59:56.648597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.657563+0000","last_change":"2023-10-06T02:59:56.654024+0000","last_active":"2023-10-06T02:59:56.657563+0000","last_peered":"2023-10-06T02:59:56.657563+0000","last_clean":"2023-10-06T02:59:56.657563+0000","last_became_active":"2023-10-06T02:59:56.653760+0000","last_became_peered":"2023-10-06T02:59:56.653760+0000","last_unstale":"2023-10-06T02:59:56.657563+0000","last_undegraded":"2023-10-06T02:59:56.657563+0000","last_fullsized":"2023-10-06T02:59:56.657563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:57.979733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.644187+0000","last_change":"2023-10-06T02:59:55.637126+0000","last_active":"2023-10-06T02:59:56.644187+0000","last_peered":"2023-10-06T02:59:56.644187+0000","last_clean":"2023-10-06T02:59:56.644187+0000","last_became_active":"2023-10-06T02:59:55.636882+0000","last_became_peered":"2023-10-06T02:59:55.636882+0000","last_unstale":"2023-10-06T02:59:56.644187+0000","last_undegraded":"2023-10-06T02:59:56.644187+0000","last_fullsized":"2023-10-06T02:59:56.644187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:17.015298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.653020+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T02:59:56.653020+0000","last_peered":"2023-10-06T02:59:56.653020+0000","last_clean":"2023-10-06T02:59:56.653020+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T02:59:56.653020+0000","last_undegraded":"2023-10-06T02:59:56.653020+0000","last_fullsized":"2023-10-06T02:59:56.653020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.658511+0000","last_change":"2023-10-06T02:59:56.651111+0000","last_active":"2023-10-06T02:59:56.658511+0000","last_peered":"2023-10-06T02:59:56.658511+0000","last_clean":"2023-10-06T02:59:56.658511+0000","last_became_active":"2023-10-06T02:59:56.650817+0000","last_became_peered":"2023-10-06T02:59:56.650817+0000","last_unstale":"2023-10-06T02:59:56.658511+0000","last_undegraded":"2023-10-06T02:59:56.658511+0000","last_fullsized":"2023-10-06T02:59:56.658511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:55.617206+0000","last_clean_scrub_stamp":"2023-10-06T02:59:55.617206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:23.711869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.641527+0000","last_change":"2023-10-06T02:59:55.638786+0000","last_active":"2023-10-06T02:59:56.641527+0000","last_peered":"2023-10-06T02:59:56.641527+0000","last_clean":"2023-10-06T02:59:56.641527+0000","last_became_active":"2023-10-06T02:59:55.638521+0000","last_became_peered":"2023-10-06T02:59:55.638521+0000","last_unstale":"2023-10-06T02:59:56.641527+0000","last_undegraded":"2023-10-06T02:59:56.641527+0000","last_fullsized":"2023-10-06T02:59:56.641527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:59:54.607640+0000","last_clean_scrub_stamp":"2023-10-06T02:59:54.607640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:35:12.635417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-06T02:59:56.645129+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T02:59:56.645129+0000","last_peered":"2023-10-06T02:59:56.645129+0000","last_clean":"2023-10-06T02:59:56.645129+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T02:59:56.645129+0000","last_undegraded":"2023-10-06T02:59:56.645129+0000","last_fullsized":"2023-10-06T02:59:56.645129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298852,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072988,"statfs":{"total":96636764160,"available":96330739712,"internally_reserved":0,"allocated":1601536,"data_stored":1069373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52300000000000002,"15min":0.53400000000000003},"min":{"1min":0.39200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.64900000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70299999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.39900000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.45400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66400000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.35399999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67300000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.42399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73499999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69299999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.31,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46500000000000002,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.32800000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68300000000000005,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74099999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.52300000000000002,"15min":0.55500000000000005},"min":{"1min":0.34799999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.63100000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.35099999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.59499999999999997},"min":{"1min":0.35299999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71399999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298280,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073560,"statfs":{"total":96636764160,"available":96331325440,"internally_reserved":0,"allocated":1015808,"data_stored":479601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.60799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74399999999999999,"5min":3.415,"15min":3.415},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55600000000000005,"15min":0.58999999999999997},"min":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66100000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54200000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76500000000000001,"5min":1.546,"15min":1.546},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57399999999999995,"15min":0.58799999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71699999999999997,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.62}]},{"osd":2,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":1.74,"15min":1.74},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.64100000000000001,"15min":0.71999999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71899999999999997,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64900000000000002,"15min":0.71599999999999997},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":3.577,"15min":3.577},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.627,"15min":0.67600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79700000000000004,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.78200000000000003}]},{"osd":4,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.32400000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70799999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.748}]},{"osd":5,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53500000000000003,"15min":0.56200000000000006},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70599999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":0.87,"15min":0.87},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.33800000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70699999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.41299999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73499999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.83899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298276,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073564,"statfs":{"total":96636764160,"available":96331329536,"internally_reserved":0,"allocated":1011712,"data_stored":478118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36299999999999999,"15min":0.39700000000000002},"min":{"1min":0.20100000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.55200000000000005,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52700000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.22800000000000001}]},{"osd":2,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.78300000000000003,"15min":1.208},"min":{"1min":0.28599999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.58099999999999996,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.442},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60299999999999998,"5min":1.181,"15min":1.181},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41899999999999998,"15min":0.44},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.628,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.372},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.248,"15min":0.248},"max":{"1min":0.61599999999999999,"5min":0.626,"15min":0.626},"last":0.255}]},{"osd":4,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85799999999999998,"5min":1.02,"15min":1.02},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":1.0069999999999999,"15min":1.4259999999999999},"min":{"1min":0.308,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.998,"15min":1.4119999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83999999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.84799999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":1.02,"15min":1.446},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":21.166,"15min":21.166},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.876,"5min":0.997,"15min":0.997},"last":0.67900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298848,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072992,"statfs":{"total":96636764160,"available":96330743808,"internally_reserved":0,"allocated":1597440,"data_stored":1068326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.315}]},{"osd":2,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.371,"15min":0.371},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.22600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.52200000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47799999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.39500000000000002,"15min":0.40500000000000003},"min":{"1min":0.29199999999999998,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53700000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.58499999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79700000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.433}]},{"osd":5,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.36099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59699999999999998,"15min":0.61299999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.39300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.76800000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86399999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":479489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.318,"15min":0.308},"min":{"1min":0.24099999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48299999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.32200000000000001},"min":{"1min":0.23000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35399999999999998}]},{"osd":1,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.42499999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.379,"15min":0.371},"min":{"1min":0.26900000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.502,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35299999999999998},"min":{"1min":0.26800000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.46899999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40400000000000003,"15min":0.39900000000000002},"min":{"1min":0.33200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.47999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.498},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.55500000000000005},"min":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.55900000000000005},"min":{"1min":0.46000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.58199999999999996,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.57099999999999995},"min":{"1min":0.42099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80600000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.504},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.44900000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":1.077,"15min":1.077},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.56599999999999995},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78000000000000003,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80800000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298276,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073564,"statfs":{"total":96636764160,"available":96331329536,"internally_reserved":0,"allocated":1011712,"data_stored":479460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.40699999999999997,"15min":0.44700000000000001},"min":{"1min":0.22900000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.51800000000000002,"5min":2.569,"15min":2.569},"last":0.252},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.40899999999999997,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.248,"15min":0.248},"max":{"1min":0.57499999999999996,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39500000000000002,"15min":0.435},"min":{"1min":0.23599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.58199999999999996,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.42499999999999999,"15min":0.47299999999999998},"min":{"1min":0.23799999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.64100000000000001,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.42999999999999999,"15min":0.46300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.55700000000000005,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.45100000000000001,"15min":0.49099999999999999},"min":{"1min":0.26900000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60599999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61299999999999999,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.623,"15min":0.66500000000000004},"min":{"1min":0.375,"5min":0.374,"15min":0.374},"max":{"1min":0.81899999999999995,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.67500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.63800000000000001,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82999999999999996,"5min":2.532,"15min":2.532},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.622,"15min":0.65000000000000002},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.65900000000000003,"15min":0.69799999999999995},"min":{"1min":0.41899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Oct 6 02:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.67000000000000004,"15min":0.72599999999999998},"min":{"1min":0.44,"5min":0.434,"15min":0.434},"max":{"1min":0.90600000000000003,"5min":2.496,"15min":2.496},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.628,"15min":0.66100000000000003},"min":{"1min":0.38500000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79800000000000004,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.75700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298268,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073572,"statfs":{"total":96636764160,"available":96331337728,"internally_reserved":0,"allocated":1003520,"data_stored":478935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68600000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70199999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69999999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.68300000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.81200000000000006,"15min":1.006},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.75,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.55400000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72499999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.71599999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57599999999999996,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78100000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.61899999999999999},"min":{"1min":0.443,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76900000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Oct 6 02:59:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.44700000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.752,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83599999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":1019904,"data_stored":480493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.49299999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68799999999999994,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71799999999999997,"5min":1.167,"15min":1.167},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71499999999999997,"5min":1.117,"15min":1.117},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.437,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66600000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76700000000000002,"5min":1.2,"15min":1.2},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.39800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74399999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73399999999999999,"5min":1.135,"15min":1.135},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69699999999999995,"5min":1.208,"15min":1.208},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48399999999999999,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68600000000000005,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77500000000000002,"5min":0.87,"15min":0.87},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.57799999999999996},"min":{"1min":0.33700000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78900000000000003,"5min":1.054,"15min":1.054},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.58499999999999996},"min":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71499999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 02:59:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.36199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80700000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60199999999999998,"15min":0.63500000000000001},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77800000000000002,"5min":1.008,"15min":1.008},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:00:01.088 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:00:01.088 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:00:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.237+0000 7fd6d0679700 1 Processor -- start 2023-10-06T03:00:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.237+0000 7fd6d0679700 1 -- start start 2023-10-06T03:00:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.238+0000 7fd6d0679700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6c8159510 0x7fd6c80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.238+0000 7fd6d0679700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd6c81598e0 0x7fd6c80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.238+0000 7fd6d0679700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6c80ce820 0x7fd6c80cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.238+0000 7fd6d0679700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80cf610 con 0x7fd6c81598e0 2023-10-06T03:00:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.238+0000 7fd6d0679700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c80cf8f0 con 0x7fd6c80ce820 2023-10-06T03:00:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.238+0000 7fd6d0679700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c80cfbd0 con 0x7fd6c8159510 2023-10-06T03:00:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.238+0000 7fd6cdc14700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd6c81598e0 0x7fd6c80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.238+0000 7fd6cdc14700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd6c81598e0 0x7fd6c80cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58404/0 (socket says 172.21.15.84:58404) 2023-10-06T03:00:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.238+0000 7fd6cdc14700 1 -- 172.21.15.84:0/1828169976 learned_addr learned my addr 172.21.15.84:0/1828169976 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cdc14700 1 -- 172.21.15.84:0/1828169976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6c8159510 msgr2=0x7fd6c80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cdc14700 1 --2- 172.21.15.84:0/1828169976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6c8159510 0x7fd6c80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cec16700 1 --2- 172.21.15.84:0/1828169976 >> v2:172.21.15.131:3300/0 conn(0x7fd6c80ce820 0x7fd6c80cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cdc14700 1 -- 172.21.15.84:0/1828169976 >> v2:172.21.15.131:3300/0 conn(0x7fd6c80ce820 msgr2=0x7fd6c80cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cdc14700 1 --2- 172.21.15.84:0/1828169976 >> v2:172.21.15.131:3300/0 conn(0x7fd6c80ce820 0x7fd6c80cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cdc14700 1 -- 172.21.15.84:0/1828169976 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c80cfeb0 con 0x7fd6c81598e0 2023-10-06T03:00:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cdc14700 1 --2- 172.21.15.84:0/1828169976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c81598e0 0x7fd6c80cbae0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd6c808acb0 tx=0x7fd6b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43ea4ed2884c02d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cd413700 1 -- 172.21.15.84:0/1828169976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800b860 con 0x7fd6c81598e0 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cd413700 1 -- 172.21.15.84:0/1828169976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b800b9c0 con 0x7fd6c81598e0 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6cd413700 1 -- 172.21.15.84:0/1828169976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800bd60 con 0x7fd6c81598e0 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6d0679700 1 -- 172.21.15.84:0/1828169976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c81598e0 msgr2=0x7fd6c80cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1828169976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c81598e0 0x7fd6c80cbae0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd6c808acb0 tx=0x7fd6b8009250 comp rx=0 tx=0).stop 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6d0679700 1 -- 172.21.15.84:0/1828169976 shutdown_connections 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1828169976 >> v2:172.21.15.131:3300/0 conn(0x7fd6c80ce820 0x7fd6c80cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1828169976 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6c8159510 0x7fd6c80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1828169976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c81598e0 0x7fd6c80cbae0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.239+0000 7fd6d0679700 1 -- 172.21.15.84:0/1828169976 >> 172.21.15.84:0/1828169976 conn(0x7fd6c8089e90 msgr2=0x7fd6c80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.240+0000 7fd6d0679700 1 -- 172.21.15.84:0/1828169976 shutdown_connections 2023-10-06T03:00:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.240+0000 7fd6d0679700 1 -- 172.21.15.84:0/1828169976 wait complete. 2023-10-06T03:00:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6d0679700 1 Processor -- start 2023-10-06T03:00:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6d0679700 1 -- start start 2023-10-06T03:00:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6d0679700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6c80ce820 0x7fd6c814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6d0679700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c8159510 0x7fd6c8068f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6d0679700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6c81598e0 0x7fd6c80694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6d0679700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c814d440 con 0x7fd6c8159510 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6d0679700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c815ba50 con 0x7fd6c80ce820 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6d0679700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c815ae40 con 0x7fd6c81598e0 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6cdc14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c8159510 0x7fd6c8068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6cdc14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c8159510 0x7fd6c8068f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58420/0 (socket says 172.21.15.84:58420) 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.241+0000 7fd6cdc14700 1 -- 172.21.15.84:0/1378433563 learned_addr learned my addr 172.21.15.84:0/1378433563 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6ce415700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6c80ce820 0x7fd6c814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6cec16700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6c81598e0 0x7fd6c80694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6cdc14700 1 -- 172.21.15.84:0/1378433563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6c81598e0 msgr2=0x7fd6c80694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6cdc14700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6c81598e0 0x7fd6c80694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6cdc14700 1 -- 172.21.15.84:0/1378433563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6c80ce820 msgr2=0x7fd6c814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6cdc14700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6c80ce820 0x7fd6c814cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6cdc14700 1 -- 172.21.15.84:0/1378433563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b80094f0 con 0x7fd6c8159510 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6ce415700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6c80ce820 0x7fd6c814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6cdc14700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c8159510 0x7fd6c8068f80 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009290 tx=0x7fd6b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6be7fc700 1 -- 172.21.15.84:0/1378433563 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8026480 con 0x7fd6c8159510 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6be7fc700 1 -- 172.21.15.84:0/1378433563 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b801f070 con 0x7fd6c8159510 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6be7fc700 1 -- 172.21.15.84:0/1378433563 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8026830 con 0x7fd6c8159510 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c815b120 con 0x7fd6c8159510 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.242+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c815b6e0 con 0x7fd6c8159510 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.243+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c815bbc0 con 0x7fd6c8159510 2023-10-06T03:00:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.243+0000 7fd6be7fc700 1 -- 172.21.15.84:0/1378433563 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6b8026ba0 con 0x7fd6c8159510 2023-10-06T03:00:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.244+0000 7fd6be7fc700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.244+0000 7fd6be7fc700 1 -- 172.21.15.84:0/1378433563 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd6b8021070 con 0x7fd6c8159510 2023-10-06T03:00:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.244+0000 7fd6ce415700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.244+0000 7fd6ce415700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6ac066f30 0x7fd6ac0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009b10 tx=0x7fd6c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.248+0000 7fd6be7fc700 1 -- 172.21.15.84:0/1378433563 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6b8053660 con 0x7fd6c8159510 2023-10-06T03:00:01.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.504+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd6c8064ad0 con 0x7fd6c8159510 2023-10-06T03:00:01.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.507+0000 7fd6be7fc700 1 -- 172.21.15.84:0/1378433563 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd6b8056c80 con 0x7fd6c8159510 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6ac066f30 msgr2=0x7fd6ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6ac066f30 0x7fd6ac0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009b10 tx=0x7fd6c4008040 comp rx=0 tx=0).stop 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c8159510 msgr2=0x7fd6c8068f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c8159510 0x7fd6c8068f80 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009290 tx=0x7fd6b8017000 comp rx=0 tx=0).stop 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 shutdown_connections 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6c80ce820 0x7fd6c814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6c81598e0 0x7fd6c80694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 --2- 172.21.15.84:0/1378433563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6c8159510 0x7fd6c8068f80 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 >> 172.21.15.84:0/1378433563 conn(0x7fd6c8089e90 msgr2=0x7fd6c80c6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 shutdown_connections 2023-10-06T03:00:01.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.510+0000 7fd6d0679700 1 -- 172.21.15.84:0/1378433563 wait complete. 2023-10-06T03:00:01.513 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T03:00:01.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:01.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.636+0000 7fd228d17700 1 Processor -- start 2023-10-06T03:00:01.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.637+0000 7fd228d17700 1 -- start start 2023-10-06T03:00:01.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.637+0000 7fd228d17700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2240ac040 0x7fd224069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.637+0000 7fd228d17700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd224069aa0 0x7fd2240c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.637+0000 7fd228d17700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd224069f00 con 0x7fd2240adf60 2023-10-06T03:00:01.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.637+0000 7fd228d17700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd224156150 con 0x7fd2240ac040 2023-10-06T03:00:01.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.637+0000 7fd228d17700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2240c7370 con 0x7fd224069aa0 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.637+0000 7fd219d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd2240ac040 0x7fd224069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.637+0000 7fd22259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd2240adf60 0x7fd22406e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41416/0 (socket says 172.21.15.84:41416) 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.637+0000 7fd22259c700 1 -- 172.21.15.84:0/487907820 learned_addr learned my addr 172.21.15.84:0/487907820 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd222d9d700 1 --2- 172.21.15.84:0/487907820 >> v2:172.21.15.131:3300/0 conn(0x7fd224069aa0 0x7fd2240c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd219d9b700 1 -- 172.21.15.84:0/487907820 >> v2:172.21.15.131:3300/0 conn(0x7fd224069aa0 msgr2=0x7fd2240c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd219d9b700 1 --2- 172.21.15.84:0/487907820 >> v2:172.21.15.131:3300/0 conn(0x7fd224069aa0 0x7fd2240c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd219d9b700 1 -- 172.21.15.84:0/487907820 >> v1:172.21.15.84:6789/0 conn(0x7fd2240adf60 legacy=0x7fd22406e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd221d9b700 1 -- 172.21.15.84:0/487907820 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818534444 0 0) 0x7fd214001110 con 0x7fd2240adf60 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd219d9b700 1 -- 172.21.15.84:0/487907820 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2240c6760 con 0x7fd2240ac040 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd222d9d700 1 --2- 172.21.15.84:0/487907820 >> v2:172.21.15.131:3300/0 conn(0x7fd224069aa0 0x7fd2240c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:01.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd219d9b700 1 --2- 172.21.15.84:0/487907820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 0x7fd224069560 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd2240abe10 tx=0x7fd20c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c36d60fb76575d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd221d9b700 1 -- 172.21.15.84:0/487907820 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00b6b0 con 0x7fd2240ac040 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd221d9b700 1 -- 172.21.15.84:0/487907820 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c00b810 con 0x7fd2240ac040 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd221d9b700 1 -- 172.21.15.84:0/487907820 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00bbb0 con 0x7fd2240ac040 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.638+0000 7fd228d17700 1 -- 172.21.15.84:0/487907820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 msgr2=0x7fd224069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.639+0000 7fd228d17700 1 --2- 172.21.15.84:0/487907820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 0x7fd224069560 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd2240abe10 tx=0x7fd20c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.639+0000 7fd228d17700 1 -- 172.21.15.84:0/487907820 shutdown_connections 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.639+0000 7fd228d17700 1 --2- 172.21.15.84:0/487907820 >> v2:172.21.15.131:3300/0 conn(0x7fd224069aa0 0x7fd2240c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.639+0000 7fd228d17700 1 --2- 172.21.15.84:0/487907820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 0x7fd224069560 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.639+0000 7fd228d17700 1 -- 172.21.15.84:0/487907820 >> 172.21.15.84:0/487907820 conn(0x7fd2240680c0 msgr2=0x7fd2240cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.639+0000 7fd228d17700 1 -- 172.21.15.84:0/487907820 shutdown_connections 2023-10-06T03:00:01.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.639+0000 7fd228d17700 1 -- 172.21.15.84:0/487907820 wait complete. 2023-10-06T03:00:01.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.640+0000 7fd228d17700 1 Processor -- start 2023-10-06T03:00:01.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.640+0000 7fd228d17700 1 -- start start 2023-10-06T03:00:01.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd228d17700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd224069aa0 0x7fd224152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd228d17700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 0x7fd2240cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd228d17700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2240adf60 0x7fd2240cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd228d17700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd224150540 con 0x7fd2240ac040 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd228d17700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd224150820 con 0x7fd224069aa0 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd228d17700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd224150b00 con 0x7fd2240adf60 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd219d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 0x7fd2240cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd219d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 0x7fd2240cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58426/0 (socket says 172.21.15.84:58426) 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd219d9b700 1 -- 172.21.15.84:0/2193366003 learned_addr learned my addr 172.21.15.84:0/2193366003 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd222d9d700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2240adf60 0x7fd2240cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd22259c700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd224069aa0 0x7fd224152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd219d9b700 1 -- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2240adf60 msgr2=0x7fd2240cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd219d9b700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2240adf60 0x7fd2240cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd219d9b700 1 -- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd224069aa0 msgr2=0x7fd224152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd219d9b700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd224069aa0 0x7fd224152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd219d9b700 1 -- 172.21.15.84:0/2193366003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c009420 con 0x7fd2240ac040 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd222d9d700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2240adf60 0x7fd2240cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd22259c700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd224069aa0 0x7fd224152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd219d9b700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 0x7fd2240cb070 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd2240cd110 tx=0x7fd20c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd21affd700 1 -- 172.21.15.84:0/2193366003 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c011420 con 0x7fd2240ac040 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd21affd700 1 -- 172.21.15.84:0/2193366003 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c011580 con 0x7fd2240ac040 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd224150de0 con 0x7fd2240ac040 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd21affd700 1 -- 172.21.15.84:0/2193366003 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c011920 con 0x7fd2240ac040 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.641+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2240c2d60 con 0x7fd2240ac040 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.642+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd224064ad0 con 0x7fd2240ac040 2023-10-06T03:00:01.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.643+0000 7fd21affd700 1 -- 172.21.15.84:0/2193366003 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd20c011d10 con 0x7fd2240ac040 2023-10-06T03:00:01.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.643+0000 7fd21affd700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd204066f30 0x7fd2040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:01.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.643+0000 7fd21affd700 1 -- 172.21.15.84:0/2193366003 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd20c086240 con 0x7fd2240ac040 2023-10-06T03:00:01.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.643+0000 7fd22259c700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd204066f30 0x7fd2040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:01.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.643+0000 7fd22259c700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd204066f30 0x7fd2040693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd22406f790 tx=0x7fd214009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:01.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.647+0000 7fd21affd700 1 -- 172.21.15.84:0/2193366003 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd20c053290 con 0x7fd2240ac040 2023-10-06T03:00:01.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.874+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2240c6a40 con 0x7fd2240ac040 2023-10-06T03:00:01.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.874+0000 7fd21affd700 1 -- 172.21.15.84:0/2193366003 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fd20c0568b0 con 0x7fd2240ac040 2023-10-06T03:00:01.876 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:01.876 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":68,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T02:59:59.659608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7185},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:01.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd204066f30 msgr2=0x7fd2040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd204066f30 0x7fd2040693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd22406f790 tx=0x7fd214009040 comp rx=0 tx=0).stop 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 msgr2=0x7fd2240cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 0x7fd2240cb070 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd2240cd110 tx=0x7fd20c017000 comp rx=0 tx=0).stop 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 shutdown_connections 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd204066f30 0x7fd2040693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd224069aa0 0x7fd224152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd2240adf60 0x7fd2240cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 --2- 172.21.15.84:0/2193366003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2240ac040 0x7fd2240cb070 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.876+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 >> 172.21.15.84:0/2193366003 conn(0x7fd2240680c0 msgr2=0x7fd2240b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.877+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 shutdown_connections 2023-10-06T03:00:01.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:01.877+0000 7fd228d17700 1 -- 172.21.15.84:0/2193366003 wait complete. 2023-10-06T03:00:01.880 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 68 2023-10-06T03:00:02.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:59:56.011330+0000', 'modified': '2023-10-06T02:59:59.659608+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7185}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7185': {'gid': 7185, 'name': 'c', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/2418120362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 2418120362}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 2418120362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:00:02.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:00:02.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:00:02.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.408+0000 7f1776b61700 1 Processor -- start 2023-10-06T03:00:02.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.408+0000 7f1776b61700 1 -- start start 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1776b61700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1770159480 0x7f17700b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1776b61700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f17700b2140 0x7f17700b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1776b61700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17700cb7e0 con 0x7f17700b3610 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1776b61700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700b08a0 con 0x7f1770159480 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1776b61700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700cb190 con 0x7f17700b2140 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1775b5f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1770159480 0x7f17700b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1775b5f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1770159480 0x7f17700b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33244/0 (socket says 172.21.15.84:33244) 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1775b5f700 1 -- 172.21.15.84:0/3057948127 learned_addr learned my addr 172.21.15.84:0/3057948127 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1776360700 1 --2- 172.21.15.84:0/3057948127 >> v2:172.21.15.131:3300/0 conn(0x7f17700b2140 0x7f17700b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1775b5f700 1 -- 172.21.15.84:0/3057948127 >> v2:172.21.15.131:3300/0 conn(0x7f17700b2140 msgr2=0x7f17700b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1775b5f700 1 --2- 172.21.15.84:0/3057948127 >> v2:172.21.15.131:3300/0 conn(0x7f17700b2140 0x7f17700b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1775b5f700 1 -- 172.21.15.84:0/3057948127 >> v1:172.21.15.131:6789/0 conn(0x7f17700b3610 legacy=0x7f17700cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.409+0000 7f1775b5f700 1 -- 172.21.15.84:0/3057948127 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700cb470 con 0x7f1770159480 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1775b5f700 1 --2- 172.21.15.84:0/3057948127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1770159480 0x7f17700b30d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f17700ca830 tx=0x7f176c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74c9881ce31b6da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1774b5d700 1 -- 172.21.15.84:0/3057948127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c00b820 con 0x7f1770159480 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1774b5d700 1 -- 172.21.15.84:0/3057948127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c00b980 con 0x7f1770159480 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1774b5d700 1 -- 172.21.15.84:0/3057948127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c00bd20 con 0x7f1770159480 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1776b61700 1 -- 172.21.15.84:0/3057948127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1770159480 msgr2=0x7f17700b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1776b61700 1 --2- 172.21.15.84:0/3057948127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1770159480 0x7f17700b30d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f17700ca830 tx=0x7f176c009250 comp rx=0 tx=0).stop 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1776b61700 1 -- 172.21.15.84:0/3057948127 shutdown_connections 2023-10-06T03:00:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1776b61700 1 --2- 172.21.15.84:0/3057948127 >> v2:172.21.15.131:3300/0 conn(0x7f17700b2140 0x7f17700b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1776b61700 1 --2- 172.21.15.84:0/3057948127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1770159480 0x7f17700b30d0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1776b61700 1 -- 172.21.15.84:0/3057948127 >> 172.21.15.84:0/3057948127 conn(0x7f177006ed20 msgr2=0x7f177006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1776b61700 1 -- 172.21.15.84:0/3057948127 shutdown_connections 2023-10-06T03:00:02.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.410+0000 7f1776b61700 1 -- 172.21.15.84:0/3057948127 wait complete. 2023-10-06T03:00:02.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.411+0000 7f1776b61700 1 Processor -- start 2023-10-06T03:00:02.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f1776b61700 1 -- start start 2023-10-06T03:00:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f1776b61700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17700b2140 0x7f177015e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f1776b61700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17700b3610 0x7f177016cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f1776b61700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1770159480 0x7f17701531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f1776b61700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17700c3b00 con 0x7f17700b3610 2023-10-06T03:00:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f1776b61700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17700c9710 con 0x7f17700b2140 2023-10-06T03:00:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f1776b61700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17700c99f0 con 0x7f1770159480 2023-10-06T03:00:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f177535e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17700b3610 0x7f177016cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f177535e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17700b3610 0x7f177016cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33250/0 (socket says 172.21.15.84:33250) 2023-10-06T03:00:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f177535e700 1 -- 172.21.15.84:0/3153141944 learned_addr learned my addr 172.21.15.84:0/3153141944 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:02.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f1775b5f700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17700b2140 0x7f177015e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.412+0000 7f1776360700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1770159480 0x7f17701531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f177535e700 1 -- 172.21.15.84:0/3153141944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1770159480 msgr2=0x7f17701531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f177535e700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1770159480 0x7f17701531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f177535e700 1 -- 172.21.15.84:0/3153141944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17700b2140 msgr2=0x7f177015e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f177535e700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17700b2140 0x7f177015e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f177535e700 1 -- 172.21.15.84:0/3153141944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0094f0 con 0x7f17700b3610 2023-10-06T03:00:02.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f177535e700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17700b3610 0x7f177016cf80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f176000c5d0 tx=0x7f1760007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f1765ffb700 1 -- 172.21.15.84:0/3153141944 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760011590 con 0x7f17700b3610 2023-10-06T03:00:02.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f1765ffb700 1 -- 172.21.15.84:0/3153141944 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1760011710 con 0x7f17700b3610 2023-10-06T03:00:02.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f1776b61700 1 -- 172.21.15.84:0/3153141944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17700c9cd0 con 0x7f17700b3610 2023-10-06T03:00:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f1765ffb700 1 -- 172.21.15.84:0/3153141944 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760011ad0 con 0x7f17700b3610 2023-10-06T03:00:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.413+0000 7f1776b61700 1 -- 172.21.15.84:0/3153141944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177015e7f0 con 0x7f17700b3610 2023-10-06T03:00:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.415+0000 7f1765ffb700 1 -- 172.21.15.84:0/3153141944 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f176001c460 con 0x7f17700b3610 2023-10-06T03:00:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.415+0000 7f1765ffb700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1754066f30 0x7f17540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.415+0000 7f1765ffb700 1 -- 172.21.15.84:0/3153141944 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1760084490 con 0x7f17700b3610 2023-10-06T03:00:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.415+0000 7f1775b5f700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1754066f30 0x7f17540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.416+0000 7f1775b5f700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1754066f30 0x7f17540693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f17700ca830 tx=0x7f176c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.417+0000 7f17810bbb80 1 Processor -- start 2023-10-06T03:00:02.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.417+0000 7f17810bbb80 1 -- start start 2023-10-06T03:00:02.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 0x55b933883200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b933883740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f17810bbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9337dda70 con 0x55b9338a7e50 2023-10-06T03:00:02.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f17810bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9337db270 con 0x55b9338882c0 2023-10-06T03:00:02.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f17810bbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9337d7060 con 0x55b933889a10 2023-10-06T03:00:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1775b5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1775b5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33260/0 (socket says 172.21.15.84:33260) 2023-10-06T03:00:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1775b5f700 1 -- 172.21.15.84:0/439018541 learned_addr learned my addr 172.21.15.84:0/439018541 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1776360700 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b933883740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f177535e700 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 0x55b933883200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1775b5f700 1 -- 172.21.15.84:0/439018541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 msgr2=0x55b933883740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1775b5f700 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b933883740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1775b5f700 1 -- 172.21.15.84:0/439018541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 msgr2=0x55b933883200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1775b5f700 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 0x55b933883200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1775b5f700 1 -- 172.21.15.84:0/439018541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b933671270 con 0x55b9338a7e50 2023-10-06T03:00:02.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f177535e700 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 0x55b933883200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:02.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f1775b5f700 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882cc0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f176c006fd0 tx=0x7f176c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8e9ba786e107fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.418+0000 7f175affd700 1 -- 172.21.15.84:0/439018541 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c021070 con 0x55b9338a7e50 2023-10-06T03:00:02.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f175affd700 1 -- 172.21.15.84:0/439018541 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c00bd20 con 0x55b9338a7e50 2023-10-06T03:00:02.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f175affd700 1 -- 172.21.15.84:0/439018541 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c011a90 con 0x55b9338a7e50 2023-10-06T03:00:02.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f17810bbb80 1 -- 172.21.15.84:0/439018541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 msgr2=0x55b933882cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f17810bbb80 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882cc0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f176c006fd0 tx=0x7f176c021000 comp rx=0 tx=0).stop 2023-10-06T03:00:02.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f17810bbb80 1 -- 172.21.15.84:0/439018541 shutdown_connections 2023-10-06T03:00:02.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f17810bbb80 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b933883740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f17810bbb80 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882cc0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f17810bbb80 1 --2- 172.21.15.84:0/439018541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 0x55b933883200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f17810bbb80 1 -- 172.21.15.84:0/439018541 >> 172.21.15.84:0/439018541 conn(0x55b933887e80 msgr2=0x55b9338886b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f17810bbb80 1 -- 172.21.15.84:0/439018541 shutdown_connections 2023-10-06T03:00:02.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.419+0000 7f17810bbb80 1 -- 172.21.15.84:0/439018541 wait complete. 2023-10-06T03:00:02.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.420+0000 7f17810bbb80 1 -- start start 2023-10-06T03:00:02.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.420+0000 7f17810bbb80 1 Processor -- start 2023-10-06T03:00:02.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 0x55b9338af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b9338a8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b933782890 con 0x55b9338a7e50 2023-10-06T03:00:02.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b93379dea0 con 0x55b9338882c0 2023-10-06T03:00:02.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b933659e30 con 0x55b933889a10 2023-10-06T03:00:02.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 10 client.0 _ll_register_callbacks cb 0x55b93384a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:02.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1776360700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1776360700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33264/0 (socket says 172.21.15.84:33264) 2023-10-06T03:00:02.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1776360700 1 -- 172.21.15.84:0/2837793357 learned_addr learned my addr 172.21.15.84:0/2837793357 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:02.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f177535e700 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b9338a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1775b5f700 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 0x55b9338af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1776360700 1 -- 172.21.15.84:0/2837793357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 msgr2=0x55b9338a8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1776360700 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b9338a8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1776360700 1 -- 172.21.15.84:0/2837793357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 msgr2=0x55b9338af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1776360700 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 0x55b9338af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1776360700 1 -- 172.21.15.84:0/2837793357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17700cb470 con 0x55b9338a7e50 2023-10-06T03:00:02.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f1776360700 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882f00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f1768002b70 tx=0x7f1768009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101a0fa77d8b8f16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f174ffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:02.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f174ffff700 1 -- 172.21.15.84:0/2837793357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768007a30 con 0x55b9338a7e50 2023-10-06T03:00:02.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f174ffff700 1 -- 172.21.15.84:0/2837793357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1768007b90 con 0x55b9338a7e50 2023-10-06T03:00:02.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 1 -- 172.21.15.84:0/2837793357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b93387b940 con 0x55b9338a7e50 2023-10-06T03:00:02.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f174ffff700 1 -- 172.21.15.84:0/2837793357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1768016400 con 0x55b9338a7e50 2023-10-06T03:00:02.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 10 client.7323 fetch_fsmap learned FSMap version 68 2023-10-06T03:00:02.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.421+0000 7f17810bbb80 1 -- 172.21.15.84:0/2837793357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55b933613fe0 con 0x55b9338a7e50 2023-10-06T03:00:02.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f174ffff700 1 -- 172.21.15.84:0/2837793357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b93387b940 con 0x55b9338a7e50 2023-10-06T03:00:02.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f174ffff700 1 -- 172.21.15.84:0/2837793357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f176801f3f0 con 0x55b9338a7e50 2023-10-06T03:00:02.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f17810bbb80 10 client.7323 fetch_fsmap finished waiting for FSMap version 68 2023-10-06T03:00:02.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f17810bbb80 10 client.7323 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:00:02.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f17810bbb80 20 client.7323 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:02.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f17810bbb80 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55b9338cde40 0x55b9338ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f17810bbb80 4 client.7323 mds_command: new command op to 7185 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:02.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f17810bbb80 1 -- 172.21.15.84:0/2837793357 --> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b933858870 con 0x55b9338cde40 2023-10-06T03:00:02.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f1775b5f700 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55b9338cde40 0x55b9338ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f174ffff700 10 client.7323 ms_handle_connect on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:02.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.422+0000 7f1775b5f700 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55b9338cde40 0x55b9338ce210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11f845fcbd950638 server_cookie=dfabed41a21ed100 in_seq=0 out_seq=0 2023-10-06T03:00:02.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f174ffff700 1 -- 172.21.15.84:0/2837793357 <== mds.0 v2:172.21.15.84:6835/2418120362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b933858870 con 0x55b9338cde40 2023-10-06T03:00:02.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f174ffff700 10 client.7323 handle_command_reply: tid=0 2023-10-06T03:00:02.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 client.7323 shutdown 2023-10-06T03:00:02.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 -- 172.21.15.84:0/2837793357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 msgr2=0x55b933882f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882f00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f1768002b70 tx=0x7f1768009850 comp rx=0 tx=0).stop 2023-10-06T03:00:02.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 -- 172.21.15.84:0/2837793357 shutdown_connections 2023-10-06T03:00:02.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55b9338cde40 0x55b9338ce210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9338882c0 0x55b9338af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338a7e50 0x55b933882f00 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 --2- 172.21.15.84:0/2837793357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b9338a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f174ffff700 0 client.7323 ms_handle_reset on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:02.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 -- 172.21.15.84:0/2837793357 >> 172.21.15.84:0/2837793357 conn(0x55b933887e80 msgr2=0x55b933888d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 -- 172.21.15.84:0/2837793357 shutdown_connections 2023-10-06T03:00:02.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 1 -- 172.21.15.84:0/2837793357 wait complete. 2023-10-06T03:00:02.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.423+0000 7f17810bbb80 20 client.7323 trim_cache size 0 max 16384 2023-10-06T03:00:02.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.440+0000 7f17810bbb80 1 Processor -- start 2023-10-06T03:00:02.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.440+0000 7f17810bbb80 1 -- start start 2023-10-06T03:00:02.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933887e80 0x55b9338da320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933889a10 0x55b9338af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f17810bbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9338a8290 con 0x55b9338882c0 2023-10-06T03:00:02.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f17810bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b93388a010 con 0x55b933889a10 2023-10-06T03:00:02.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f17810bbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9338a7b30 con 0x55b933887e80 2023-10-06T03:00:02.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f177535e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f177535e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33280/0 (socket says 172.21.15.84:33280) 2023-10-06T03:00:02.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f177535e700 1 -- 172.21.15.84:0/915096521 learned_addr learned my addr 172.21.15.84:0/915096521 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:02.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f1775b5f700 1 --2- 172.21.15.84:0/915096521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933887e80 0x55b9338da320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f1776360700 1 --2- 172.21.15.84:0/915096521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933889a10 0x55b9338af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f177535e700 1 -- 172.21.15.84:0/915096521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933887e80 msgr2=0x55b9338da320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f177535e700 1 --2- 172.21.15.84:0/915096521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933887e80 0x55b9338da320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f177535e700 1 -- 172.21.15.84:0/915096521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933889a10 msgr2=0x55b9338af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f177535e700 1 --2- 172.21.15.84:0/915096521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933889a10 0x55b9338af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f177535e700 1 -- 172.21.15.84:0/915096521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9337a5780 con 0x55b9338882c0 2023-10-06T03:00:02.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f177535e700 1 --2- 172.21.15.84:0/915096521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b34e0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f1760054e20 tx=0x7f1760084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f36185e3452eaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f175b7fe700 1 -- 172.21.15.84:0/915096521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176006f070 con 0x55b9338882c0 2023-10-06T03:00:02.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f175b7fe700 1 -- 172.21.15.84:0/915096521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1760055820 con 0x55b9338882c0 2023-10-06T03:00:02.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.441+0000 7f175b7fe700 1 -- 172.21.15.84:0/915096521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760057040 con 0x55b9338882c0 2023-10-06T03:00:02.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.442+0000 7f17810bbb80 1 -- 172.21.15.84:0/915096521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 msgr2=0x55b9338b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.442+0000 7f17810bbb80 1 --2- 172.21.15.84:0/915096521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b34e0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f1760054e20 tx=0x7f1760084040 comp rx=0 tx=0).stop 2023-10-06T03:00:02.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.442+0000 7f17810bbb80 1 -- 172.21.15.84:0/915096521 shutdown_connections 2023-10-06T03:00:02.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.442+0000 7f17810bbb80 1 --2- 172.21.15.84:0/915096521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933889a10 0x55b9338af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.442+0000 7f17810bbb80 1 --2- 172.21.15.84:0/915096521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933887e80 0x55b9338da320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.442+0000 7f17810bbb80 1 --2- 172.21.15.84:0/915096521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b34e0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.442+0000 7f17810bbb80 1 -- 172.21.15.84:0/915096521 >> 172.21.15.84:0/915096521 conn(0x55b9338b6d00 msgr2=0x55b933884ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.442+0000 7f17810bbb80 1 -- 172.21.15.84:0/915096521 shutdown_connections 2023-10-06T03:00:02.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.442+0000 7f17810bbb80 1 -- 172.21.15.84:0/915096521 wait complete. 2023-10-06T03:00:02.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.443+0000 7f17810bbb80 1 -- start start 2023-10-06T03:00:02.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.443+0000 7f17810bbb80 1 Processor -- start 2023-10-06T03:00:02.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.443+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933887e80 0x55b933922eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.443+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.443+0000 7f17810bbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b9338b5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.443+0000 7f17810bbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b93393bee0 con 0x55b9338882c0 2023-10-06T03:00:02.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.443+0000 7f17810bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9339233f0 con 0x55b933887e80 2023-10-06T03:00:02.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.443+0000 7f17810bbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b933884190 con 0x55b933889a10 2023-10-06T03:00:02.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f17810bbb80 10 client.0 _ll_register_callbacks cb 0x55b93384a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:02.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f177535e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f177535e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33282/0 (socket says 172.21.15.84:33282) 2023-10-06T03:00:02.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f177535e700 1 -- 172.21.15.84:0/168681288 learned_addr learned my addr 172.21.15.84:0/168681288 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:02.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f1775b5f700 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933887e80 0x55b933922eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f1776360700 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b9338b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f177535e700 1 -- 172.21.15.84:0/168681288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 msgr2=0x55b9338b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f177535e700 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b9338b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f177535e700 1 -- 172.21.15.84:0/168681288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933887e80 msgr2=0x55b933922eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f177535e700 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933887e80 0x55b933922eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f177535e700 1 -- 172.21.15.84:0/168681288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177015e7f0 con 0x55b9338882c0 2023-10-06T03:00:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f1776360700 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b9338b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f177535e700 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b5310 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1760054e20 tx=0x7f176006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34f4501a53d202c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f174ffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f174ffff700 1 -- 172.21.15.84:0/168681288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760057070 con 0x55b9338882c0 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f174ffff700 1 -- 172.21.15.84:0/168681288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f176005c0c0 con 0x55b9338882c0 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f17810bbb80 1 -- 172.21.15.84:0/168681288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f176c00bd20 con 0x55b9338882c0 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f174ffff700 1 -- 172.21.15.84:0/168681288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f176006f070 con 0x55b9338882c0 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f17810bbb80 10 client.7329 fetch_fsmap learned FSMap version 68 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f17810bbb80 1 -- 172.21.15.84:0/168681288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55b93378c470 con 0x55b9338882c0 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f174ffff700 1 -- 172.21.15.84:0/168681288 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c00bd20 con 0x55b9338882c0 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f174ffff700 1 -- 172.21.15.84:0/168681288 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1760055380 con 0x55b9338882c0 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f17810bbb80 10 client.7329 fetch_fsmap finished waiting for FSMap version 68 2023-10-06T03:00:02.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f17810bbb80 10 client.7329 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:00:02.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f17810bbb80 20 client.7329 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:02.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.444+0000 7f17810bbb80 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55b9338a7e50 0x55b93393f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 4 client.7329 mds_command: new command op to 7185 tid=0[{"prefix": "status"}] 2023-10-06T03:00:02.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 -- 172.21.15.84:0/168681288 --> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b933779e00 con 0x55b9338a7e50 2023-10-06T03:00:02.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f1775b5f700 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55b9338a7e50 0x55b93393f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f174ffff700 10 client.7329 ms_handle_connect on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:02.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f1775b5f700 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55b9338a7e50 0x55b93393f730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9770d2b1026fe10c server_cookie=c2eabcf676901b2e in_seq=0 out_seq=0 2023-10-06T03:00:02.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f174ffff700 1 -- 172.21.15.84:0/168681288 <== mds.0 v2:172.21.15.84:6835/2418120362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b933779e00 con 0x55b9338a7e50 2023-10-06T03:00:02.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f174ffff700 10 client.7329 handle_command_reply: tid=0 2023-10-06T03:00:02.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 client.7329 shutdown 2023-10-06T03:00:02.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 -- 172.21.15.84:0/168681288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 msgr2=0x55b9338b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b5310 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1760054e20 tx=0x7f176006d000 comp rx=0 tx=0).stop 2023-10-06T03:00:02.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 -- 172.21.15.84:0/168681288 shutdown_connections 2023-10-06T03:00:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55b9338a7e50 0x55b93393f730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b933887e80 0x55b933922eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b933889a10 0x55b9338b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 --2- 172.21.15.84:0/168681288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b9338882c0 0x55b9338b5310 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f174ffff700 0 client.7329 ms_handle_reset on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 -- 172.21.15.84:0/168681288 >> 172.21.15.84:0/168681288 conn(0x55b9338b6d00 msgr2=0x55b93387d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 -- 172.21.15.84:0/168681288 shutdown_connections 2023-10-06T03:00:02.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 1 -- 172.21.15.84:0/168681288 wait complete. 2023-10-06T03:00:02.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.445+0000 7f17810bbb80 20 client.7329 trim_cache size 0 max 16384 2023-10-06T03:00:02.463 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:00:02.463 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:00:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7185, 2023-10-06T03:00:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:00:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:00:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:00:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 5.7983474680000002, 2023-10-06T03:00:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 68, 2023-10-06T03:00:02.464 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 82, 2023-10-06T03:00:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 82, 2023-10-06T03:00:02.465 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 11.934577104000001 2023-10-06T03:00:02.465 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:02.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 -- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1754066f30 msgr2=0x7f17540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1754066f30 0x7f17540693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f17700ca830 tx=0x7f176c016000 comp rx=0 tx=0).stop 2023-10-06T03:00:02.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 -- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17700b3610 msgr2=0x7f177016cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17700b3610 0x7f177016cf80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f176000c5d0 tx=0x7f1760007f60 comp rx=0 tx=0).stop 2023-10-06T03:00:02.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 -- 172.21.15.84:0/3153141944 shutdown_connections 2023-10-06T03:00:02.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1754066f30 0x7f17540693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17700b2140 0x7f177015e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1770159480 0x7f17701531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 --2- 172.21.15.84:0/3153141944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17700b3610 0x7f177016cf80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 -- 172.21.15.84:0/3153141944 >> 172.21.15.84:0/3153141944 conn(0x7f177006ed20 msgr2=0x7f17701574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 -- 172.21.15.84:0/3153141944 shutdown_connections 2023-10-06T03:00:02.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.446+0000 7f1776b61700 1 -- 172.21.15.84:0/3153141944 wait complete. 2023-10-06T03:00:02.468 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:00:02.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.580+0000 7fc8644e9700 1 Processor -- start 2023-10-06T03:00:02.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.580+0000 7fc8644e9700 1 -- start start 2023-10-06T03:00:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.581+0000 7fc8644e9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 0x7fc85c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.581+0000 7fc8644e9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc85c0b07a0 0x7fc85c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.581+0000 7fc8644e9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c0b0ca0 con 0x7fc85c0b49e0 2023-10-06T03:00:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.581+0000 7fc8644e9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c0b0f80 con 0x7fc85c0b07a0 2023-10-06T03:00:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.581+0000 7fc8644e9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0b1260 con 0x7fc85c1595a0 2023-10-06T03:00:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc862a86700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc85c0b07a0 0x7fc85c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc861a84700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc85c0b49e0 0x7fc85c0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59894/0 (socket says 172.21.15.84:59894) 2023-10-06T03:00:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc861a84700 1 -- 172.21.15.84:0/1183049539 learned_addr learned my addr 172.21.15.84:0/1183049539 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc862285700 1 --2- 172.21.15.84:0/1183049539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 0x7fc85c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc862a86700 1 -- 172.21.15.84:0/1183049539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 msgr2=0x7fc85c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc862a86700 1 --2- 172.21.15.84:0/1183049539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 0x7fc85c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc862a86700 1 -- 172.21.15.84:0/1183049539 >> v1:172.21.15.84:6789/0 conn(0x7fc85c0b49e0 legacy=0x7fc85c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc862a86700 1 -- 172.21.15.84:0/1183049539 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0b1540 con 0x7fc85c0b07a0 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc861283700 1 -- 172.21.15.84:0/1183049539 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022577873 0 0) 0x7fc85c0b0ca0 con 0x7fc85c0b49e0 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc862a86700 1 --2- 172.21.15.84:0/1183049539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b07a0 0x7fc85c0b1c00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc8540098e0 tx=0x7fc8540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684c39eca7ae7717 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc861283700 1 -- 172.21.15.84:0/1183049539 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854009e80 con 0x7fc85c0b07a0 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc861283700 1 -- 172.21.15.84:0/1183049539 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400b860 con 0x7fc85c0b07a0 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.582+0000 7fc861283700 1 -- 172.21.15.84:0/1183049539 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400bbe0 con 0x7fc85c0b07a0 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.583+0000 7fc8644e9700 1 -- 172.21.15.84:0/1183049539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b07a0 msgr2=0x7fc85c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.583+0000 7fc8644e9700 1 --2- 172.21.15.84:0/1183049539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b07a0 0x7fc85c0b1c00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc8540098e0 tx=0x7fc8540091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.583+0000 7fc8644e9700 1 -- 172.21.15.84:0/1183049539 shutdown_connections 2023-10-06T03:00:02.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.583+0000 7fc8644e9700 1 --2- 172.21.15.84:0/1183049539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b07a0 0x7fc85c0b1c00 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.583+0000 7fc8644e9700 1 --2- 172.21.15.84:0/1183049539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 0x7fc85c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.583+0000 7fc8644e9700 1 -- 172.21.15.84:0/1183049539 >> 172.21.15.84:0/1183049539 conn(0x7fc85c099830 msgr2=0x7fc85c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.583+0000 7fc8644e9700 1 -- 172.21.15.84:0/1183049539 shutdown_connections 2023-10-06T03:00:02.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.583+0000 7fc8644e9700 1 -- 172.21.15.84:0/1183049539 wait complete. 2023-10-06T03:00:02.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.584+0000 7fc8644e9700 1 Processor -- start 2023-10-06T03:00:02.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.584+0000 7fc8644e9700 1 -- start start 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.584+0000 7fc8644e9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc85c0b07a0 0x7fc85c0aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.584+0000 7fc8644e9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b49e0 0x7fc85c09a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.584+0000 7fc8644e9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 0x7fc85c1698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc8644e9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c09b4f0 con 0x7fc85c0b49e0 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc8644e9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c09a8e0 con 0x7fc85c0b07a0 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc8644e9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c09abc0 con 0x7fc85c1595a0 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc861a84700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b49e0 0x7fc85c09a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc861a84700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b49e0 0x7fc85c09a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33296/0 (socket says 172.21.15.84:33296) 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc861a84700 1 -- 172.21.15.84:0/3291506830 learned_addr learned my addr 172.21.15.84:0/3291506830 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc862285700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc85c0b07a0 0x7fc85c0aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc862a86700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 0x7fc85c1698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc861a84700 1 -- 172.21.15.84:0/3291506830 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 msgr2=0x7fc85c1698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc861a84700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 0x7fc85c1698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc861a84700 1 -- 172.21.15.84:0/3291506830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc85c0b07a0 msgr2=0x7fc85c0aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc861a84700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc85c0b07a0 0x7fc85c0aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc861a84700 1 -- 172.21.15.84:0/3291506830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854009420 con 0x7fc85c0b49e0 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc862285700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc85c0b07a0 0x7fc85c0aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc861a84700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b49e0 0x7fc85c09a090 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc85000c810 tx=0x7fc850007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc85a7fc700 1 -- 172.21.15.84:0/3291506830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850005c00 con 0x7fc85c0b49e0 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc85a7fc700 1 -- 172.21.15.84:0/3291506830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc850005d60 con 0x7fc85c0b49e0 2023-10-06T03:00:02.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c09aea0 con 0x7fc85c0b49e0 2023-10-06T03:00:02.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc85a7fc700 1 -- 172.21.15.84:0/3291506830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850007320 con 0x7fc85c0b49e0 2023-10-06T03:00:02.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.585+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c09a5d0 con 0x7fc85c0b49e0 2023-10-06T03:00:02.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.586+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c064ad0 con 0x7fc85c0b49e0 2023-10-06T03:00:02.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.586+0000 7fc85a7fc700 1 -- 172.21.15.84:0/3291506830 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc85001b400 con 0x7fc85c0b49e0 2023-10-06T03:00:02.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.587+0000 7fc85a7fc700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc848066f30 0x7fc8480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:02.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.587+0000 7fc85a7fc700 1 -- 172.21.15.84:0/3291506830 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc8500842f0 con 0x7fc85c0b49e0 2023-10-06T03:00:02.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.587+0000 7fc862285700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc848066f30 0x7fc8480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:02.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.587+0000 7fc862285700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc848066f30 0x7fc8480693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc84c007540 tx=0x7fc84c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:02.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.591+0000 7fc85a7fc700 1 -- 172.21.15.84:0/3291506830 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc850051340 con 0x7fc85c0b49e0 2023-10-06T03:00:02.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.819+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc85c09b630 con 0x7fc85c0b49e0 2023-10-06T03:00:02.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.819+0000 7fc85a7fc700 1 -- 172.21.15.84:0/3291506830 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc850054960 con 0x7fc85c0b49e0 2023-10-06T03:00:02.821 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:00:02.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc848066f30 msgr2=0x7fc8480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc848066f30 0x7fc8480693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc84c007540 tx=0x7fc84c00b040 comp rx=0 tx=0).stop 2023-10-06T03:00:02.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b49e0 msgr2=0x7fc85c09a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b49e0 0x7fc85c09a090 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc85000c810 tx=0x7fc850007db0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 shutdown_connections 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc848066f30 0x7fc8480693e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc85c0b07a0 0x7fc85c0aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc85c1595a0 0x7fc85c1698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 --2- 172.21.15.84:0/3291506830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc85c0b49e0 0x7fc85c09a090 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 >> 172.21.15.84:0/3291506830 conn(0x7fc85c099830 msgr2=0x7fc85c158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 shutdown_connections 2023-10-06T03:00:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:02.821+0000 7fc8644e9700 1 -- 172.21.15.84:0/3291506830 wait complete. 2023-10-06T03:00:02.835 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:00:02.835 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:00:02.835 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:00:02.835 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:00:02.835 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:02.835 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:00:02.835 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:00:02.835 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:00:02.835 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:00:02.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:02.836 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:00:02.850 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:00:02.850 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:00:02.851 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:02.852 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:00:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c4d3:64ff:fe4d:ee22/64 scope link 2023-10-06T03:00:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:02.853 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:00:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:00:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::41f:f5ff:fe77:615a/64 scope link 2023-10-06T03:00:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:02.853 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:00:02.853 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 66:ce:03:f1:65:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:00:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::64ce:3ff:fef1:6538/64 scope link 2023-10-06T03:00:02.854 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:02.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:02.854 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:00:02.914 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:00:02.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:02.916 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:00:02.972 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:00:02.973 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:00:02.973 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:00:02.973 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:00:02.973 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:00:02.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:02.973 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:00:02.974 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:00:02.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:00:02.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:00:02.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:00:02.974 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:00:03.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:03.073 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:00:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:00:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:00:03.087 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:00:03.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:03.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:00:03.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:03.152 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:03.207 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:00:03.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:03.207 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:03.261 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:00:03.261 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:00:03.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:00:03.341 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:00:03.342 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:00:03.342 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T03:00:03.350 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:00:03.350 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:00:03.350 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T03:00:03.350 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:00:03.350 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:00:03.372 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:00:03.373 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:00:03.373 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T03:00:03.373 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:00:03.373 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:00:03.373 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:00:03.373 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:00:03.373 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T03:00:03.375 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:00:03.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:03.375 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:03.440 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-10-06T03:00:03.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.595+0000 7f19e6bee700 1 Processor -- start 2023-10-06T03:00:03.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.595+0000 7f19e6bee700 1 -- start start 2023-10-06T03:00:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.596+0000 7f19e6bee700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19e00cc630 0x7f19e0162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.596+0000 7f19e6bee700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00ccab0 con 0x7f19e00b0680 2023-10-06T03:00:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.596+0000 7f19e6bee700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00c5400 con 0x7f19e00b0a50 2023-10-06T03:00:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.596+0000 7f19e6bee700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e00ca7d0 con 0x7f19e00cc630 2023-10-06T03:00:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.596+0000 7f19e518b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19e00cc630 0x7f19e0162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.596+0000 7f19e498a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f19e00b0680 0x7f19e00ced10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59900/0 (socket says 172.21.15.84:59900) 2023-10-06T03:00:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.596+0000 7f19e498a700 1 -- 172.21.15.84:0/2247576494 learned_addr learned my addr 172.21.15.84:0/2247576494 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e518b700 1 -- 172.21.15.84:0/2247576494 >> v1:172.21.15.131:6789/0 conn(0x7f19e00b0a50 legacy=0x7f19e00cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e518b700 1 -- 172.21.15.84:0/2247576494 >> v1:172.21.15.84:6789/0 conn(0x7f19e00b0680 legacy=0x7f19e00ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19d77fe700 1 -- 172.21.15.84:0/2247576494 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258978790 0 0) 0x7f19e00ccab0 con 0x7f19e00b0680 2023-10-06T03:00:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e518b700 1 -- 172.21.15.84:0/2247576494 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e00ccd40 con 0x7f19e00cc630 2023-10-06T03:00:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e518b700 1 --2- 172.21.15.84:0/2247576494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00cc630 0x7f19e0162230 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f19d80098e0 tx=0x7f19d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3de3b7356b07d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19d77fe700 1 -- 172.21.15.84:0/2247576494 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8009e80 con 0x7f19e00cc630 2023-10-06T03:00:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19d77fe700 1 -- 172.21.15.84:0/2247576494 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d800b860 con 0x7f19e00cc630 2023-10-06T03:00:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19d77fe700 1 -- 172.21.15.84:0/2247576494 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800bbe0 con 0x7f19e00cc630 2023-10-06T03:00:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e6bee700 1 -- 172.21.15.84:0/2247576494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00cc630 msgr2=0x7f19e0162230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e6bee700 1 --2- 172.21.15.84:0/2247576494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00cc630 0x7f19e0162230 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f19d80098e0 tx=0x7f19d80091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e6bee700 1 -- 172.21.15.84:0/2247576494 shutdown_connections 2023-10-06T03:00:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e6bee700 1 --2- 172.21.15.84:0/2247576494 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00cc630 0x7f19e0162230 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e6bee700 1 -- 172.21.15.84:0/2247576494 >> 172.21.15.84:0/2247576494 conn(0x7f19e0088000 msgr2=0x7f19e00ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e6bee700 1 -- 172.21.15.84:0/2247576494 shutdown_connections 2023-10-06T03:00:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.597+0000 7f19e6bee700 1 -- 172.21.15.84:0/2247576494 wait complete. 2023-10-06T03:00:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.599+0000 7f19e6bee700 1 Processor -- start 2023-10-06T03:00:03.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.599+0000 7f19e6bee700 1 -- start start 2023-10-06T03:00:03.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.599+0000 7f19e6bee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00b0680 0x7f19e015a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.599+0000 7f19e6bee700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e00b0a50 0x7f19e0158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.599+0000 7f19e6bee700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e00cc630 0x7f19e0148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.599+0000 7f19e6bee700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e015a5c0 con 0x7f19e00b0680 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.599+0000 7f19e6bee700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00b1190 con 0x7f19e00cc630 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.599+0000 7f19e6bee700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00b1470 con 0x7f19e00b0a50 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.599+0000 7f19e498a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00b0680 0x7f19e015a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e498a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00b0680 0x7f19e015a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33318/0 (socket says 172.21.15.84:33318) 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e498a700 1 -- 172.21.15.84:0/3425654373 learned_addr learned my addr 172.21.15.84:0/3425654373 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e518b700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e00cc630 0x7f19e0148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19d7fff700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e00b0a50 0x7f19e0158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e498a700 1 -- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e00b0a50 msgr2=0x7f19e0158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e498a700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e00b0a50 0x7f19e0158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e498a700 1 -- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e00cc630 msgr2=0x7f19e0148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e498a700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e00cc630 0x7f19e0148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e498a700 1 -- 172.21.15.84:0/3425654373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8009420 con 0x7f19e00b0680 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e518b700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e00cc630 0x7f19e0148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19d7fff700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e00b0a50 0x7f19e0158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e498a700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00b0680 0x7f19e015a080 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00c8e0 tx=0x7f19dc0016a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19d4ff9700 1 -- 172.21.15.84:0/3425654373 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00ce80 con 0x7f19e00b0680 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19d4ff9700 1 -- 172.21.15.84:0/3425654373 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc005d80 con 0x7f19e00b0680 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e00b1750 con 0x7f19e00b0680 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19d4ff9700 1 -- 172.21.15.84:0/3425654373 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00a800 con 0x7f19e00b0680 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.600+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e00b1d10 con 0x7f19e00b0680 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.601+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e00888f0 con 0x7f19e00b0680 2023-10-06T03:00:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.601+0000 7f19d4ff9700 1 -- 172.21.15.84:0/3425654373 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19dc00ac30 con 0x7f19e00b0680 2023-10-06T03:00:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.602+0000 7f19d4ff9700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19cc066f30 0x7f19cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.602+0000 7f19d4ff9700 1 -- 172.21.15.84:0/3425654373 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f19dc084650 con 0x7f19e00b0680 2023-10-06T03:00:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.602+0000 7f19d7fff700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19cc066f30 0x7f19cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.602+0000 7f19d7fff700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19cc066f30 0x7f19cc0693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f19d0007fd0 tx=0x7f19d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.606+0000 7f19d4ff9700 1 -- 172.21.15.84:0/3425654373 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19dc051620 con 0x7f19e00b0680 2023-10-06T03:00:03.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:03.836+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f19e00b1f30 con 0x7f19e00b0680 2023-10-06T03:00:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.684+0000 7f19d4ff9700 1 -- 172.21.15.84:0/3425654373 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v69) v1 ==== 105+0+0 (secure 0 0 0) 0x7f19dc054c40 con 0x7f19e00b0680 2023-10-06T03:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19cc066f30 msgr2=0x7f19cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19cc066f30 0x7f19cc0693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f19d0007fd0 tx=0x7f19d0009040 comp rx=0 tx=0).stop 2023-10-06T03:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00b0680 msgr2=0x7f19e015a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00b0680 0x7f19e015a080 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00c8e0 tx=0x7f19dc0016a0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 shutdown_connections 2023-10-06T03:00:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19cc066f30 0x7f19cc0693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19e00cc630 0x7f19e0148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19e00b0680 0x7f19e015a080 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 --2- 172.21.15.84:0/3425654373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19e00b0a50 0x7f19e0158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 >> 172.21.15.84:0/3425654373 conn(0x7f19e0088000 msgr2=0x7f19e00c3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 shutdown_connections 2023-10-06T03:00:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.686+0000 7f19e6bee700 1 -- 172.21.15.84:0/3425654373 wait complete. 2023-10-06T03:00:04.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:04.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.820+0000 7ff323250700 1 Processor -- start 2023-10-06T03:00:04.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.820+0000 7ff323250700 1 -- start start 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.821+0000 7ff323250700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c067d00 0x7ff31c06e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.821+0000 7ff323250700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff31c0ca980 0x7ff31c0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.821+0000 7ff323250700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c06bd00 con 0x7ff31c157640 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.821+0000 7ff323250700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c0b0720 con 0x7ff31c0ca980 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.821+0000 7ff323250700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0ca730 con 0x7ff31c067d00 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff313fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c067d00 0x7ff31c06e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff3217ed700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff31c0ca980 0x7ff31c0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff320fec700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff31c157640 0x7ff31c0675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:57598/0 (socket says 172.21.15.84:57598) 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff320fec700 1 -- 172.21.15.84:0/3882085164 learned_addr learned my addr 172.21.15.84:0/3882085164 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff3137fe700 1 -- 172.21.15.84:0/3882085164 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555406188 0 0) 0x7ff31c06bd00 con 0x7ff31c157640 2023-10-06T03:00:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff3137fe700 1 -- 172.21.15.84:0/3882085164 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff304003570 con 0x7ff31c157640 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff313fff700 1 -- 172.21.15.84:0/3882085164 >> v2:172.21.15.131:3300/0 conn(0x7ff31c0ca980 msgr2=0x7ff31c0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff313fff700 1 --2- 172.21.15.84:0/3882085164 >> v2:172.21.15.131:3300/0 conn(0x7ff31c0ca980 0x7ff31c0b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff313fff700 1 -- 172.21.15.84:0/3882085164 >> v1:172.21.15.131:6789/0 conn(0x7ff31c157640 legacy=0x7ff31c0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff313fff700 1 -- 172.21.15.84:0/3882085164 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c06ed10 con 0x7ff31c067d00 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff3217ed700 1 --2- 172.21.15.84:0/3882085164 >> v2:172.21.15.131:3300/0 conn(0x7ff31c0ca980 0x7ff31c0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff313fff700 1 --2- 172.21.15.84:0/3882085164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c067d00 0x7ff31c06e6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0098e0 tx=0x7ff30c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fed6e3e7a0c1709a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff3137fe700 1 -- 172.21.15.84:0/3882085164 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c011630 con 0x7ff31c067d00 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff3137fe700 1 -- 172.21.15.84:0/3882085164 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c011790 con 0x7ff31c067d00 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.822+0000 7ff3137fe700 1 -- 172.21.15.84:0/3882085164 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c011b10 con 0x7ff31c067d00 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.823+0000 7ff323250700 1 -- 172.21.15.84:0/3882085164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c067d00 msgr2=0x7ff31c06e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.823+0000 7ff323250700 1 --2- 172.21.15.84:0/3882085164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c067d00 0x7ff31c06e6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0098e0 tx=0x7ff30c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.823+0000 7ff323250700 1 -- 172.21.15.84:0/3882085164 shutdown_connections 2023-10-06T03:00:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.823+0000 7ff323250700 1 --2- 172.21.15.84:0/3882085164 >> v2:172.21.15.131:3300/0 conn(0x7ff31c0ca980 0x7ff31c0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.823+0000 7ff323250700 1 --2- 172.21.15.84:0/3882085164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c067d00 0x7ff31c06e6c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.823+0000 7ff323250700 1 -- 172.21.15.84:0/3882085164 >> 172.21.15.84:0/3882085164 conn(0x7ff31c0cdef0 msgr2=0x7ff31c0c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.823+0000 7ff323250700 1 -- 172.21.15.84:0/3882085164 shutdown_connections 2023-10-06T03:00:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.823+0000 7ff323250700 1 -- 172.21.15.84:0/3882085164 wait complete. 2023-10-06T03:00:04.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.824+0000 7ff323250700 1 Processor -- start 2023-10-06T03:00:04.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.824+0000 7ff323250700 1 -- start start 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff323250700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff31c067d00 0x7ff31c0caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff323250700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c0ca980 0x7ff31c1400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff323250700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff31c157640 0x7ff31c153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff323250700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0cc430 con 0x7ff31c067d00 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff323250700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0cc8c0 con 0x7ff31c157640 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff323250700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0cb820 con 0x7ff31c0ca980 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff320fec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff31c067d00 0x7ff31c0caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff320fec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff31c067d00 0x7ff31c0caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33324/0 (socket says 172.21.15.84:33324) 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff320fec700 1 -- 172.21.15.84:0/289565959 learned_addr learned my addr 172.21.15.84:0/289565959 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff3217ed700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff31c157640 0x7ff31c153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.825+0000 7ff313fff700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c0ca980 0x7ff31c1400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff320fec700 1 -- 172.21.15.84:0/289565959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c0ca980 msgr2=0x7ff31c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff320fec700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c0ca980 0x7ff31c1400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff320fec700 1 -- 172.21.15.84:0/289565959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff31c157640 msgr2=0x7ff31c153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff320fec700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff31c157640 0x7ff31c153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff320fec700 1 -- 172.21.15.84:0/289565959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314009a20 con 0x7ff31c067d00 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff320fec700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff31c067d00 0x7ff31c0caff0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff3180011e0 tx=0x7ff318007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff310ff9700 1 -- 172.21.15.84:0/289565959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318005b30 con 0x7ff31c067d00 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff310ff9700 1 -- 172.21.15.84:0/289565959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff318005c90 con 0x7ff31c067d00 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff310ff9700 1 -- 172.21.15.84:0/289565959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318007320 con 0x7ff31c067d00 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30c009420 con 0x7ff31c067d00 2023-10-06T03:00:04.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.826+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c0cbde0 con 0x7ff31c067d00 2023-10-06T03:00:04.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.827+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c0cc710 con 0x7ff31c067d00 2023-10-06T03:00:04.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.827+0000 7ff310ff9700 1 -- 172.21.15.84:0/289565959 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff318007690 con 0x7ff31c067d00 2023-10-06T03:00:04.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.827+0000 7ff310ff9700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff308066f30 0x7ff3080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:04.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.828+0000 7ff310ff9700 1 -- 172.21.15.84:0/289565959 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff318083b60 con 0x7ff31c067d00 2023-10-06T03:00:04.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.828+0000 7ff313fff700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff308066f30 0x7ff3080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:04.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.828+0000 7ff313fff700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff308066f30 0x7ff3080693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff31c068100 tx=0x7ff30c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:04.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:04.832+0000 7ff310ff9700 1 -- 172.21.15.84:0/289565959 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff318050bf0 con 0x7ff31c067d00 2023-10-06T03:00:05.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.059+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff31c064ad0 con 0x7ff31c067d00 2023-10-06T03:00:05.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.059+0000 7ff310ff9700 1 -- 172.21.15.84:0/289565959 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4621 (secure 0 0 0) 0x7ff318017020 con 0x7ff31c067d00 2023-10-06T03:00:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:05.061 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6382,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T03:00:04.685540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":7185,"mds_1":7182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7182":{"gid":7182,"name":"a","rank":1,"incarnation":70,"state":"up:creating","state_seq":1,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:05.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.061+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff308066f30 msgr2=0x7ff3080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.061+0000 7ff323250700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff308066f30 0x7ff3080693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff31c068100 tx=0x7ff30c017000 comp rx=0 tx=0).stop 2023-10-06T03:00:05.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff31c067d00 msgr2=0x7ff31c0caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:05.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff31c067d00 0x7ff31c0caff0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff3180011e0 tx=0x7ff318007df0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 shutdown_connections 2023-10-06T03:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff308066f30 0x7ff3080693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff31c157640 0x7ff31c153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff31c067d00 0x7ff31c0caff0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 --2- 172.21.15.84:0/289565959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff31c0ca980 0x7ff31c1400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 >> 172.21.15.84:0/289565959 conn(0x7ff31c0cdef0 msgr2=0x7ff31c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 shutdown_connections 2023-10-06T03:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:05.062+0000 7ff323250700 1 -- 172.21.15.84:0/289565959 wait complete. 2023-10-06T03:00:05.064 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 70 2023-10-06T03:00:05.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:59:56.011330+0000', 'modified': '2023-10-06T03:00:04.685540+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 7185, 'mds_1': 7182}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7182': {'gid': 7182, 'name': 'a', 'rank': 1, 'incarnation': 70, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.84:6836/2917413983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 2917413983}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 2917413983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7185': {'gid': 7185, 'name': 'c', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/2418120362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 2418120362}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 2418120362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:00:05.478 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7182:up:creating 2023-10-06T03:00:05.922 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T03:00:05.921+0000 7f5c998ca700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-06T03:00:06.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.604+0000 7fc21d4fb700 1 Processor -- start 2023-10-06T03:00:06.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.604+0000 7fc21d4fb700 1 -- start start 2023-10-06T03:00:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.604+0000 7fc21d4fb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2180b49e0 0x7fc2180aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.604+0000 7fc21d4fb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc2180b07a0 0x7fc2180b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.604+0000 7fc21d4fb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2180b0ca0 con 0x7fc2181595a0 2023-10-06T03:00:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.604+0000 7fc21d4fb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2180b0f80 con 0x7fc2180b07a0 2023-10-06T03:00:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.604+0000 7fc21d4fb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180b1260 con 0x7fc2180b49e0 2023-10-06T03:00:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc216ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc2181595a0 0x7fc2180aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59914/0 (socket says 172.21.15.84:59914) 2023-10-06T03:00:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc216ffd700 1 -- 172.21.15.84:0/4024723886 learned_addr learned my addr 172.21.15.84:0/4024723886 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:06.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc2177fe700 1 --2- 172.21.15.84:0/4024723886 >> v2:172.21.15.131:3300/0 conn(0x7fc2180b07a0 0x7fc2180b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc2167fc700 1 --2- 172.21.15.84:0/4024723886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2180b49e0 0x7fc2180aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc215ffb700 1 -- 172.21.15.84:0/4024723886 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956475803 0 0) 0x7fc2180b0ca0 con 0x7fc2181595a0 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc215ffb700 1 -- 172.21.15.84:0/4024723886 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc204003570 con 0x7fc2181595a0 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc2177fe700 1 -- 172.21.15.84:0/4024723886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2180b49e0 msgr2=0x7fc2180aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc2177fe700 1 --2- 172.21.15.84:0/4024723886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2180b49e0 0x7fc2180aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc2177fe700 1 -- 172.21.15.84:0/4024723886 >> v1:172.21.15.84:6789/0 conn(0x7fc2181595a0 legacy=0x7fc2180aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc2177fe700 1 -- 172.21.15.84:0/4024723886 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180b1540 con 0x7fc2180b07a0 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc2167fc700 1 --2- 172.21.15.84:0/4024723886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2180b49e0 0x7fc2180aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc2177fe700 1 --2- 172.21.15.84:0/4024723886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2180b07a0 0x7fc2180b1c00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc2080098e0 tx=0x7fc2080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dca4f0d42eedcdbe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.605+0000 7fc215ffb700 1 -- 172.21.15.84:0/4024723886 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208011630 con 0x7fc2180b07a0 2023-10-06T03:00:06.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc215ffb700 1 -- 172.21.15.84:0/4024723886 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc208011790 con 0x7fc2180b07a0 2023-10-06T03:00:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc215ffb700 1 -- 172.21.15.84:0/4024723886 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208011b30 con 0x7fc2180b07a0 2023-10-06T03:00:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc21d4fb700 1 -- 172.21.15.84:0/4024723886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2180b07a0 msgr2=0x7fc2180b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc21d4fb700 1 --2- 172.21.15.84:0/4024723886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2180b07a0 0x7fc2180b1c00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc2080098e0 tx=0x7fc2080091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc21d4fb700 1 -- 172.21.15.84:0/4024723886 shutdown_connections 2023-10-06T03:00:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc21d4fb700 1 --2- 172.21.15.84:0/4024723886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2180b07a0 0x7fc2180b1c00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc21d4fb700 1 --2- 172.21.15.84:0/4024723886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2180b49e0 0x7fc2180aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc21d4fb700 1 -- 172.21.15.84:0/4024723886 >> 172.21.15.84:0/4024723886 conn(0x7fc218099830 msgr2=0x7fc21806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc21d4fb700 1 -- 172.21.15.84:0/4024723886 shutdown_connections 2023-10-06T03:00:06.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.606+0000 7fc21d4fb700 1 -- 172.21.15.84:0/4024723886 wait complete. 2023-10-06T03:00:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.607+0000 7fc21d4fb700 1 Processor -- start 2023-10-06T03:00:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.607+0000 7fc21d4fb700 1 -- start start 2023-10-06T03:00:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc21d4fb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2180b07a0 0x7fc218144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc21d4fb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2180b49e0 0x7fc21815add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc21d4fb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2181595a0 0x7fc21815c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc21d4fb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc218144e80 con 0x7fc2180b49e0 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc21d4fb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21815a940 con 0x7fc2180b07a0 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc21d4fb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21815b310 con 0x7fc2181595a0 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc2167fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2180b49e0 0x7fc21815add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc2167fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2180b49e0 0x7fc21815add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33336/0 (socket says 172.21.15.84:33336) 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc2167fc700 1 -- 172.21.15.84:0/2921136578 learned_addr learned my addr 172.21.15.84:0/2921136578 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc216ffd700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2180b07a0 0x7fc218144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc2177fe700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2181595a0 0x7fc21815c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc2167fc700 1 -- 172.21.15.84:0/2921136578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2181595a0 msgr2=0x7fc21815c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc2167fc700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2181595a0 0x7fc21815c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc2167fc700 1 -- 172.21.15.84:0/2921136578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2180b07a0 msgr2=0x7fc218144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc2167fc700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2180b07a0 0x7fc218144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.608+0000 7fc2167fc700 1 -- 172.21.15.84:0/2921136578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200009420 con 0x7fc2180b49e0 2023-10-06T03:00:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.609+0000 7fc2167fc700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2180b49e0 0x7fc21815add0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc20000ec80 tx=0x7fc2000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.609+0000 7fc20effd700 1 -- 172.21.15.84:0/2921136578 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000c920 con 0x7fc2180b49e0 2023-10-06T03:00:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.609+0000 7fc20effd700 1 -- 172.21.15.84:0/2921136578 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20000ca80 con 0x7fc2180b49e0 2023-10-06T03:00:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.609+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc208009420 con 0x7fc2180b49e0 2023-10-06T03:00:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.609+0000 7fc20effd700 1 -- 172.21.15.84:0/2921136578 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000ce00 con 0x7fc2180b49e0 2023-10-06T03:00:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.609+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21815a010 con 0x7fc2180b49e0 2023-10-06T03:00:06.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.610+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21815aad0 con 0x7fc2180b49e0 2023-10-06T03:00:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.610+0000 7fc20effd700 1 -- 172.21.15.84:0/2921136578 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc200013680 con 0x7fc2180b49e0 2023-10-06T03:00:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.611+0000 7fc20effd700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc1f8066f30 0x7fc1f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.611+0000 7fc216ffd700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc1f8066f30 0x7fc1f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.611+0000 7fc20effd700 1 -- 172.21.15.84:0/2921136578 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc200084bb0 con 0x7fc2180b49e0 2023-10-06T03:00:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.611+0000 7fc216ffd700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc1f8066f30 0x7fc1f80693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc210007fd0 tx=0x7fc210009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:06.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.615+0000 7fc20effd700 1 -- 172.21.15.84:0/2921136578 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc200051b80 con 0x7fc2180b49e0 2023-10-06T03:00:06.792 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:06.795 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.848+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc218064ad0 con 0x7fc2180b49e0 2023-10-06T03:00:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.849+0000 7fc20effd700 1 -- 172.21.15.84:0/2921136578 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4633 (secure 0 0 0) 0x7fc2000551a0 con 0x7fc2180b49e0 2023-10-06T03:00:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:06.850 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":73,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T03:00:06.696609+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7185,"mds_1":7182,"mds_2":6382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6382":{"gid":6382,"name":"d","rank":2,"incarnation":72,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7182":{"gid":7182,"name":"a","rank":1,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc1f8066f30 msgr2=0x7fc1f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc1f8066f30 0x7fc1f80693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc210007fd0 tx=0x7fc210009040 comp rx=0 tx=0).stop 2023-10-06T03:00:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2180b49e0 msgr2=0x7fc21815add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2180b49e0 0x7fc21815add0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc20000ec80 tx=0x7fc2000091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 shutdown_connections 2023-10-06T03:00:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc1f8066f30 0x7fc1f80693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2180b07a0 0x7fc218144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2181595a0 0x7fc21815c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 --2- 172.21.15.84:0/2921136578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2180b49e0 0x7fc21815add0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 >> 172.21.15.84:0/2921136578 conn(0x7fc218099830 msgr2=0x7fc2180cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 shutdown_connections 2023-10-06T03:00:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:06.851+0000 7fc21d4fb700 1 -- 172.21.15.84:0/2921136578 wait complete. 2023-10-06T03:00:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 73 2023-10-06T03:00:07.267 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T02:59:56.011330+0000', 'modified': '2023-10-06T03:00:06.696609+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 7185, 'mds_1': 7182, 'mds_2': 6382}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6382': {'gid': 6382, 'name': 'd', 'rank': 2, 'incarnation': 72, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.131:6835/1887986838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 1887986838}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 1887986838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7182': {'gid': 7182, 'name': 'a', 'rank': 1, 'incarnation': 70, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6836/2917413983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 2917413983}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 2917413983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7185': {'gid': 7185, 'name': 'c', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/2418120362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 2418120362}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 2418120362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:00:07.267 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-06T03:00:07.267 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T03:00:07.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.383+0000 7f70629f3700 1 Processor -- start 2023-10-06T03:00:07.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.383+0000 7f70629f3700 1 -- start start 2023-10-06T03:00:07.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f70629f3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f705c0b07a0 0x7f705c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f70629f3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c0b0ca0 con 0x7f705c1595a0 2023-10-06T03:00:07.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f70629f3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705c0b0f80 con 0x7f705c0b49e0 2023-10-06T03:00:07.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f70629f3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c0ab390 con 0x7f705c0b07a0 2023-10-06T03:00:07.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f705c1595a0 0x7f705c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59918/0 (socket says 172.21.15.84:59918) 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705bfff700 1 -- 172.21.15.84:0/1053258147 learned_addr learned my addr 172.21.15.84:0/1053258147 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026772226 0 0) 0x7f705c0b0ca0 con 0x7f705c1595a0 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7044003570 con 0x7f705c1595a0 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f7060f90700 1 --2- 172.21.15.84:0/1053258147 >> v2:172.21.15.131:3300/0 conn(0x7f705c0b07a0 0x7f705c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2550837616 0 0) 0x7f7044003570 con 0x7f705c1595a0 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 >> v2:172.21.15.131:3300/0 conn(0x7f705c0b07a0 msgr2=0x7f705c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705affd700 1 --2- 172.21.15.84:0/1053258147 >> v2:172.21.15.131:3300/0 conn(0x7f705c0b07a0 0x7f705c0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 >> v1:172.21.15.131:6789/0 conn(0x7f705c0b49e0 legacy=0x7f705c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0b1260 con 0x7f705c1595a0 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.384+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f704c0015f0 con 0x7f705c1595a0 2023-10-06T03:00:07.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 >> v1:172.21.15.84:6789/0 conn(0x7f705c1595a0 legacy=0x7f705c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7044003ab0 0x7f7044003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044004810 0x7f7044004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70440052e0 0x7f704400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c0ab390 con 0x7f7044004810 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704400c1e0 con 0x7f7044003ab0 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704400c3a0 con 0x7f70440052e0 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705b7fe700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044004810 0x7f7044004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705bfff700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7044003ab0 0x7f7044003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f7060f90700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70440052e0 0x7f704400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705b7fe700 1 -- 172.21.15.84:0/1053258147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70440052e0 msgr2=0x7f704400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705b7fe700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f70440052e0 0x7f704400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705b7fe700 1 -- 172.21.15.84:0/1053258147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7044003ab0 msgr2=0x7f7044003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705b7fe700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7044003ab0 0x7f7044003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705b7fe700 1 -- 172.21.15.84:0/1053258147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7044003570 con 0x7f7044004810 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f7060f90700 1 -- 172.21.15.84:0/1053258147 reap_dead start 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705b7fe700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044004810 0x7f7044004c80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f705c088e20 tx=0x7f7050007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8231e98b2cf1f445 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050012420 con 0x7f7044004810 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70500125a0 con 0x7f7044004810 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.385+0000 7f705affd700 1 -- 172.21.15.84:0/1053258147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050012960 con 0x7f7044004810 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.386+0000 7f70629f3700 1 -- 172.21.15.84:0/1053258147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044004810 msgr2=0x7f7044004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.386+0000 7f70629f3700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044004810 0x7f7044004c80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f705c088e20 tx=0x7f7050007d30 comp rx=0 tx=0).stop 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.386+0000 7f70629f3700 1 -- 172.21.15.84:0/1053258147 shutdown_connections 2023-10-06T03:00:07.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.386+0000 7f70629f3700 1 --2- 172.21.15.84:0/1053258147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7044004810 0x7f7044004c80 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.386+0000 7f70629f3700 1 -- 172.21.15.84:0/1053258147 >> 172.21.15.84:0/1053258147 conn(0x7f705c099830 msgr2=0x7f705c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.386+0000 7f70629f3700 1 -- 172.21.15.84:0/1053258147 shutdown_connections 2023-10-06T03:00:07.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.386+0000 7f70629f3700 1 -- 172.21.15.84:0/1053258147 wait complete. 2023-10-06T03:00:07.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.387+0000 7f70629f3700 1 Processor -- start 2023-10-06T03:00:07.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.387+0000 7f70629f3700 1 -- start start 2023-10-06T03:00:07.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f70629f3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044004810 0x7f705c158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f70629f3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c15dd10 0x7f705c15f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f70629f3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c09bc40 0x7f705c09c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f70629f3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c169d30 con 0x7f705c09bc40 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f70629f3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c09c620 con 0x7f705c15dd10 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f70629f3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c1591b0 con 0x7f7044004810 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7060f90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c09bc40 0x7f705c09c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7060f90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c09bc40 0x7f705c09c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33366/0 (socket says 172.21.15.84:33366) 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7060f90700 1 -- 172.21.15.84:0/2639775837 learned_addr learned my addr 172.21.15.84:0/2639775837 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f705b7fe700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c15dd10 0x7f705c15f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7060f90700 1 -- 172.21.15.84:0/2639775837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044004810 msgr2=0x7f705c158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7060f90700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044004810 0x7f705c158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7060f90700 1 -- 172.21.15.84:0/2639775837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c15dd10 msgr2=0x7f705c15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7060f90700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c15dd10 0x7f705c15f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7060f90700 1 -- 172.21.15.84:0/2639775837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c15ed90 con 0x7f705c09bc40 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f705b7fe700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c15dd10 0x7f705c15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7060f90700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c09bc40 0x7f705c09c0e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f705c0b2f50 tx=0x7f7054009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7043fff700 1 -- 172.21.15.84:0/2639775837 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054002ce0 con 0x7f705c09bc40 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7043fff700 1 -- 172.21.15.84:0/2639775837 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400f050 con 0x7f705c09bc40 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f70629f3700 1 -- 172.21.15.84:0/2639775837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c15e210 con 0x7f705c09bc40 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f7043fff700 1 -- 172.21.15.84:0/2639775837 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054014660 con 0x7f705c09bc40 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.388+0000 7f70629f3700 1 -- 172.21.15.84:0/2639775837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c15e7d0 con 0x7f705c09bc40 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.390+0000 7f7043fff700 1 -- 172.21.15.84:0/2639775837 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7054003040 con 0x7f705c09bc40 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.390+0000 7f7043fff700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7048066f30 0x7f70480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.390+0000 7f705bfff700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7048066f30 0x7f70480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.390+0000 7f7043fff700 1 -- 172.21.15.84:0/2639775837 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7054084b50 con 0x7f705c09bc40 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.391+0000 7f705bfff700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7048066f30 0x7f70480693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f704c0011d0 tx=0x7f704c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.392+0000 7f706bcebb80 1 Processor -- start 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.392+0000 7f706bcebb80 1 -- start start 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76d840 0x557a6d76dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d7bdc00 0x557a6d7be050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f706bcebb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a6d6c4a70 con 0x557a6d76ecc0 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f706bcebb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a6d6c2270 con 0x557a6d7bdc00 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f706bcebb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a6d6be060 con 0x557a6d76d840 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f705b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f705b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7bd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33380/0 (socket says 172.21.15.84:33380) 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f705b7fe700 1 -- 172.21.15.84:0/385866984 learned_addr learned my addr 172.21.15.84:0/385866984 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f7060f90700 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d7bdc00 0x557a6d7be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f705bfff700 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76d840 0x557a6d76dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f705b7fe700 1 -- 172.21.15.84:0/385866984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76d840 msgr2=0x557a6d76dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f705b7fe700 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76d840 0x557a6d76dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f705b7fe700 1 -- 172.21.15.84:0/385866984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d7bdc00 msgr2=0x557a6d7be050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f705b7fe700 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d7bdc00 0x557a6d7be050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f705b7fe700 1 -- 172.21.15.84:0/385866984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a6d558270 con 0x557a6d76ecc0 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.393+0000 7f7060f90700 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d7bdc00 0x557a6d7be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.394+0000 7f705b7fe700 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7bd6c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f704400c1b0 tx=0x7f7050015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bab445de3a61b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.394+0000 7f70417fa700 1 -- 172.21.15.84:0/385866984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050012420 con 0x557a6d76ecc0 2023-10-06T03:00:07.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.394+0000 7f70417fa700 1 -- 172.21.15.84:0/385866984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050000bc0 con 0x557a6d76ecc0 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.394+0000 7f70417fa700 1 -- 172.21.15.84:0/385866984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050012940 con 0x557a6d76ecc0 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.394+0000 7f706bcebb80 1 -- 172.21.15.84:0/385866984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 msgr2=0x557a6d7bd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.394+0000 7f706bcebb80 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7bd6c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f704400c1b0 tx=0x7f7050015000 comp rx=0 tx=0).stop 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.395+0000 7f706bcebb80 1 -- 172.21.15.84:0/385866984 shutdown_connections 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.395+0000 7f706bcebb80 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d7bdc00 0x557a6d7be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.395+0000 7f706bcebb80 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76d840 0x557a6d76dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.395+0000 7f706bcebb80 1 --2- 172.21.15.84:0/385866984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7bd6c0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.395+0000 7f706bcebb80 1 -- 172.21.15.84:0/385866984 >> 172.21.15.84:0/385866984 conn(0x557a6d76f160 msgr2=0x557a6d76f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.395+0000 7f706bcebb80 1 -- 172.21.15.84:0/385866984 shutdown_connections 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.395+0000 7f706bcebb80 1 -- 172.21.15.84:0/385866984 wait complete. 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.395+0000 7f706bcebb80 1 -- start start 2023-10-06T03:00:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.395+0000 7f706bcebb80 1 Processor -- start 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 0x557a6d7ba560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76ecc0 0x557a6d7acc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d7bdc00 0x557a6d7ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f706bcebb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a6d669890 con 0x557a6d7bdc00 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f706bcebb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a6d684ea0 con 0x557a6d76d840 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f706bcebb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a6d540e30 con 0x557a6d76ecc0 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f706bcebb80 10 client.0 _ll_register_callbacks cb 0x557a6d730e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f7060f90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d7bdc00 0x557a6d7ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f7060f90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d7bdc00 0x557a6d7ad1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33392/0 (socket says 172.21.15.84:33392) 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f7060f90700 1 -- 172.21.15.84:0/2033401902 learned_addr learned my addr 172.21.15.84:0/2033401902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f705bfff700 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 0x557a6d7ba560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f705b7fe700 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76ecc0 0x557a6d7acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f7060f90700 1 -- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76ecc0 msgr2=0x557a6d7acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f7060f90700 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76ecc0 0x557a6d7acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f7060f90700 1 -- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 msgr2=0x557a6d7ba560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f7060f90700 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 0x557a6d7ba560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f7060f90700 1 -- 172.21.15.84:0/2033401902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7044003570 con 0x557a6d7bdc00 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.396+0000 7f705b7fe700 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76ecc0 0x557a6d7acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f7060f90700 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d7bdc00 0x557a6d7ad1d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7054002230 tx=0x7f7054082d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24329a765babb089 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f703a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f703a7fc700 1 -- 172.21.15.84:0/2033401902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054055840 con 0x557a6d7bdc00 2023-10-06T03:00:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f703a7fc700 1 -- 172.21.15.84:0/2033401902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7054058a10 con 0x557a6d7bdc00 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f706bcebb80 1 -- 172.21.15.84:0/2033401902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a6d762940 con 0x557a6d7bdc00 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f703a7fc700 1 -- 172.21.15.84:0/2033401902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f705405c760 con 0x557a6d7bdc00 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f706bcebb80 10 client.7368 fetch_fsmap learned FSMap version 73 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f706bcebb80 1 -- 172.21.15.84:0/2033401902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x557a6d4fafe0 con 0x557a6d7bdc00 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f703a7fc700 1 -- 172.21.15.84:0/2033401902 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557a6d762940 con 0x557a6d7bdc00 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f703a7fc700 1 -- 172.21.15.84:0/2033401902 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 73) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f7054071250 con 0x557a6d7bdc00 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f706bcebb80 10 client.7368 fetch_fsmap finished waiting for FSMap version 73 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f706bcebb80 10 client.7368 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f706bcebb80 20 client.7368 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f706bcebb80 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x557a6d7bc450 0x557a6d7bc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f706bcebb80 4 client.7368 mds_command: new command op to 6382 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f706bcebb80 1 -- 172.21.15.84:0/2033401902 --> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a6d73f870 con 0x557a6d7bc450 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.397+0000 7f705bfff700 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x557a6d7bc450 0x557a6d7bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.398+0000 7f705bfff700 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x557a6d7bc450 0x557a6d7bc820 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84ab867e1f69ae0d server_cookie=85fba81581c3ebb1 in_seq=0 out_seq=0 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.398+0000 7f703a7fc700 10 client.7368 ms_handle_connect on v2:172.21.15.131:6833/1887986838 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.398+0000 7f703a7fc700 1 -- 172.21.15.84:0/2033401902 <== mds.2 v2:172.21.15.131:6833/1887986838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557a6d73f870 con 0x557a6d7bc450 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.398+0000 7f703a7fc700 10 client.7368 handle_command_reply: tid=0 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 client.7368 shutdown 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 -- 172.21.15.84:0/2033401902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d7bdc00 msgr2=0x557a6d7ad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d7bdc00 0x557a6d7ad1d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7054002230 tx=0x7f7054082d10 comp rx=0 tx=0).stop 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 -- 172.21.15.84:0/2033401902 shutdown_connections 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x557a6d7bc450 0x557a6d7bc820 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 0x557a6d7ba560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f703a7fc700 0 client.7368 ms_handle_reset on v2:172.21.15.131:6833/1887986838 2023-10-06T03:00:07.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d7bdc00 0x557a6d7ad1d0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 --2- 172.21.15.84:0/2033401902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d76ecc0 0x557a6d7acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 -- 172.21.15.84:0/2033401902 >> 172.21.15.84:0/2033401902 conn(0x557a6d76f160 msgr2=0x557a6d7b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 -- 172.21.15.84:0/2033401902 shutdown_connections 2023-10-06T03:00:07.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 1 -- 172.21.15.84:0/2033401902 wait complete. 2023-10-06T03:00:07.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.399+0000 7f706bcebb80 20 client.7368 trim_cache size 0 max 16384 2023-10-06T03:00:07.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.415+0000 7f706bcebb80 1 Processor -- start 2023-10-06T03:00:07.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.415+0000 7f706bcebb80 1 -- start start 2023-10-06T03:00:07.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.416+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76d840 0x557a6d7b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.416+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76ecc0 0x557a6d7b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.416+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 0x557a6d7adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.416+0000 7f706bcebb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a6d7b1d90 con 0x557a6d76d840 2023-10-06T03:00:07.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.416+0000 7f706bcebb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a6d768620 con 0x557a6d76ecc0 2023-10-06T03:00:07.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.416+0000 7f706bcebb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a6d746280 con 0x557a6d7bc450 2023-10-06T03:00:07.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.416+0000 7f705bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76d840 0x557a6d7b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.416+0000 7f705bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76d840 0x557a6d7b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33402/0 (socket says 172.21.15.84:33402) 2023-10-06T03:00:07.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.416+0000 7f705bfff700 1 -- 172.21.15.84:0/3375641050 learned_addr learned my addr 172.21.15.84:0/3375641050 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f7060f90700 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 0x557a6d7adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f705b7fe700 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76ecc0 0x557a6d7b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f705bfff700 1 -- 172.21.15.84:0/3375641050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 msgr2=0x557a6d7adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f705bfff700 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 0x557a6d7adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f705bfff700 1 -- 172.21.15.84:0/3375641050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76ecc0 msgr2=0x557a6d7b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f705bfff700 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76ecc0 0x557a6d7b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f705bfff700 1 -- 172.21.15.84:0/3375641050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a6d68c780 con 0x557a6d76d840 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f705b7fe700 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76ecc0 0x557a6d7b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f705bfff700 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76d840 0x557a6d7b0fd0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f704c00fa90 tx=0x7f704c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a0fc5ef7b14d1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f7041ffb700 1 -- 172.21.15.84:0/3375641050 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c028070 con 0x557a6d76d840 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f7041ffb700 1 -- 172.21.15.84:0/3375641050 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c00fdc0 con 0x557a6d76d840 2023-10-06T03:00:07.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f7041ffb700 1 -- 172.21.15.84:0/3375641050 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c0162e0 con 0x557a6d76d840 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f706bcebb80 1 -- 172.21.15.84:0/3375641050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76d840 msgr2=0x557a6d7b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f706bcebb80 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76d840 0x557a6d7b0fd0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f704c00fa90 tx=0x7f704c014000 comp rx=0 tx=0).stop 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f706bcebb80 1 -- 172.21.15.84:0/3375641050 shutdown_connections 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f706bcebb80 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 0x557a6d7adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f706bcebb80 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76d840 0x557a6d7b0fd0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f706bcebb80 1 --2- 172.21.15.84:0/3375641050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76ecc0 0x557a6d7b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.417+0000 7f706bcebb80 1 -- 172.21.15.84:0/3375641050 >> 172.21.15.84:0/3375641050 conn(0x557a6d76f160 msgr2=0x557a6d7b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.418+0000 7f706bcebb80 1 -- 172.21.15.84:0/3375641050 shutdown_connections 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.418+0000 7f706bcebb80 1 -- 172.21.15.84:0/3375641050 wait complete. 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.418+0000 7f706bcebb80 1 -- start start 2023-10-06T03:00:07.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.418+0000 7f706bcebb80 1 Processor -- start 2023-10-06T03:00:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 0x557a6d819b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f706bcebb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 0x557a6d7b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f706bcebb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a6d81a0c0 con 0x557a6d76ecc0 2023-10-06T03:00:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f706bcebb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a6d81a4e0 con 0x557a6d76d840 2023-10-06T03:00:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f706bcebb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a6d7ccfe0 con 0x557a6d7bc450 2023-10-06T03:00:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f706bcebb80 10 client.0 _ll_register_callbacks cb 0x557a6d76b430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33416/0 (socket says 172.21.15.84:33416) 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 0x557a6d819b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705b7fe700 1 -- 172.21.15.84:0/236964326 learned_addr learned my addr 172.21.15.84:0/236964326 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f7060f90700 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 0x557a6d7b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705b7fe700 1 -- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 msgr2=0x557a6d7b84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705b7fe700 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 0x557a6d7b84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705b7fe700 1 -- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 msgr2=0x557a6d819b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705b7fe700 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 0x557a6d819b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705b7fe700 1 -- 172.21.15.84:0/236964326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c019040 con 0x557a6d76ecc0 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f705b7fe700 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7cc850 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7050001370 tx=0x7f7050020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac98c06b0ea11e29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.419+0000 7f703a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f703a7fc700 1 -- 172.21.15.84:0/236964326 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050001550 con 0x557a6d76ecc0 2023-10-06T03:00:07.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f703a7fc700 1 -- 172.21.15.84:0/236964326 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7050014990 con 0x557a6d76ecc0 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f706bcebb80 1 -- 172.21.15.84:0/236964326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7050000bc0 con 0x557a6d76ecc0 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f703a7fc700 1 -- 172.21.15.84:0/236964326 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7050012420 con 0x557a6d76ecc0 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f706bcebb80 10 client.7374 fetch_fsmap learned FSMap version 73 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f706bcebb80 1 -- 172.21.15.84:0/236964326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x557a6d673470 con 0x557a6d76ecc0 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f703a7fc700 1 -- 172.21.15.84:0/236964326 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050000bc0 con 0x557a6d76ecc0 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f703a7fc700 1 -- 172.21.15.84:0/236964326 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 73) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f7050039070 con 0x557a6d76ecc0 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f706bcebb80 10 client.7374 fetch_fsmap finished waiting for FSMap version 73 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f706bcebb80 10 client.7374 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f706bcebb80 20 client.7374 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f706bcebb80 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x557a6d7bdc00 0x557a6d7aa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f706bcebb80 4 client.7374 mds_command: new command op to 6382 tid=0[{"prefix": "status"}] 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f706bcebb80 1 -- 172.21.15.84:0/236964326 --> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557a6d660e00 con 0x557a6d7bdc00 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.420+0000 7f705bfff700 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x557a6d7bdc00 0x557a6d7aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f703a7fc700 10 client.7374 ms_handle_connect on v2:172.21.15.131:6833/1887986838 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f705bfff700 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x557a6d7bdc00 0x557a6d7aa350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf1d3906d2a475f6 server_cookie=165e49fb371d6dcc in_seq=0 out_seq=0 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f703a7fc700 1 -- 172.21.15.84:0/236964326 <== mds.2 v2:172.21.15.131:6833/1887986838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x557a6d660e00 con 0x557a6d7bdc00 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f703a7fc700 10 client.7374 handle_command_reply: tid=0 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 client.7374 shutdown 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 -- 172.21.15.84:0/236964326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 msgr2=0x557a6d7cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7cc850 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7050001370 tx=0x7f7050020070 comp rx=0 tx=0).stop 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 -- 172.21.15.84:0/236964326 shutdown_connections 2023-10-06T03:00:07.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x557a6d7bdc00 0x557a6d7aa350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a6d76d840 0x557a6d819b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a6d7bc450 0x557a6d7b84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f703a7fc700 0 client.7374 ms_handle_reset on v2:172.21.15.131:6833/1887986838 2023-10-06T03:00:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 --2- 172.21.15.84:0/236964326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a6d76ecc0 0x557a6d7cc850 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 -- 172.21.15.84:0/236964326 >> 172.21.15.84:0/236964326 conn(0x557a6d76f160 msgr2=0x557a6d76e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 -- 172.21.15.84:0/236964326 shutdown_connections 2023-10-06T03:00:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 1 -- 172.21.15.84:0/236964326 wait complete. 2023-10-06T03:00:07.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.421+0000 7f706bcebb80 20 client.7374 trim_cache size 0 max 16384 2023-10-06T03:00:07.430 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6382, 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 1.72287054, 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 73, 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 82, 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 82, 2023-10-06T03:00:07.431 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.899674016999999 2023-10-06T03:00:07.432 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:07.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 -- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7048066f30 msgr2=0x7f70480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7048066f30 0x7f70480693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f704c0011d0 tx=0x7f704c009040 comp rx=0 tx=0).stop 2023-10-06T03:00:07.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 -- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c09bc40 msgr2=0x7f705c09c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c09bc40 0x7f705c09c0e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f705c0b2f50 tx=0x7f7054009870 comp rx=0 tx=0).stop 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 -- 172.21.15.84:0/2639775837 shutdown_connections 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7048066f30 0x7f70480693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c09bc40 0x7f705c09c0e0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7044004810 0x7f705c158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 --2- 172.21.15.84:0/2639775837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f705c15dd10 0x7f705c15f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 -- 172.21.15.84:0/2639775837 >> 172.21.15.84:0/2639775837 conn(0x7f705c099830 msgr2=0x7f705c0cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 -- 172.21.15.84:0/2639775837 shutdown_connections 2023-10-06T03:00:07.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.422+0000 7f70629f3700 1 -- 172.21.15.84:0/2639775837 wait complete. 2023-10-06T03:00:07.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:00:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.549+0000 7f42d9455700 1 Processor -- start 2023-10-06T03:00:07.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.549+0000 7f42d9455700 1 -- start start 2023-10-06T03:00:07.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.549+0000 7f42d9455700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b49e0 0x7f42d40aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.549+0000 7f42d9455700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f42d40b07a0 0x7f42d40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.549+0000 7f42d9455700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40b0ca0 con 0x7f42d41595a0 2023-10-06T03:00:07.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.549+0000 7f42d9455700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40b0f80 con 0x7f42d40b07a0 2023-10-06T03:00:07.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.549+0000 7f42d9455700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b1260 con 0x7f42d40b49e0 2023-10-06T03:00:07.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42d2ffd700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f42d41595a0 0x7f42d40aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:57628/0 (socket says 172.21.15.84:57628) 2023-10-06T03:00:07.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42d2ffd700 1 -- 172.21.15.84:0/1127023437 learned_addr learned my addr 172.21.15.84:0/1127023437 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:07.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/1127023437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b49e0 0x7f42d40aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42d37fe700 1 --2- 172.21.15.84:0/1127023437 >> v2:172.21.15.131:3300/0 conn(0x7f42d40b07a0 0x7f42d40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42d27fc700 1 -- 172.21.15.84:0/1127023437 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084609173 0 0) 0x7f42d40b0ca0 con 0x7f42d41595a0 2023-10-06T03:00:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42d27fc700 1 -- 172.21.15.84:0/1127023437 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c0003570 con 0x7f42d41595a0 2023-10-06T03:00:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1127023437 >> v2:172.21.15.131:3300/0 conn(0x7f42d40b07a0 msgr2=0x7f42d40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/1127023437 >> v2:172.21.15.131:3300/0 conn(0x7f42d40b07a0 0x7f42d40b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1127023437 >> v1:172.21.15.131:6789/0 conn(0x7f42d41595a0 legacy=0x7f42d40aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1127023437 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40b1540 con 0x7f42d40b49e0 2023-10-06T03:00:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42d37fe700 1 --2- 172.21.15.84:0/1127023437 >> v2:172.21.15.131:3300/0 conn(0x7f42d40b07a0 0x7f42d40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:07.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/1127023437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b49e0 0x7f42d40aac80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0098e0 tx=0x7f42bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431ced63b3d7d4b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42d27fc700 1 -- 172.21.15.84:0/1127023437 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc011630 con 0x7f42d40b49e0 2023-10-06T03:00:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42d27fc700 1 -- 172.21.15.84:0/1127023437 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc011790 con 0x7f42d40b49e0 2023-10-06T03:00:07.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.550+0000 7f42d27fc700 1 -- 172.21.15.84:0/1127023437 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc011b30 con 0x7f42d40b49e0 2023-10-06T03:00:07.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.551+0000 7f42d9455700 1 -- 172.21.15.84:0/1127023437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b49e0 msgr2=0x7f42d40aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.551+0000 7f42d9455700 1 --2- 172.21.15.84:0/1127023437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b49e0 0x7f42d40aac80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0098e0 tx=0x7f42bc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.551+0000 7f42d9455700 1 -- 172.21.15.84:0/1127023437 shutdown_connections 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.551+0000 7f42d9455700 1 --2- 172.21.15.84:0/1127023437 >> v2:172.21.15.131:3300/0 conn(0x7f42d40b07a0 0x7f42d40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.551+0000 7f42d9455700 1 --2- 172.21.15.84:0/1127023437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b49e0 0x7f42d40aac80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.551+0000 7f42d9455700 1 -- 172.21.15.84:0/1127023437 >> 172.21.15.84:0/1127023437 conn(0x7f42d4099830 msgr2=0x7f42d406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.551+0000 7f42d9455700 1 -- 172.21.15.84:0/1127023437 shutdown_connections 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.551+0000 7f42d9455700 1 -- 172.21.15.84:0/1127023437 wait complete. 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.552+0000 7f42d9455700 1 Processor -- start 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.552+0000 7f42d9455700 1 -- start start 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42d9455700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b07a0 0x7f42d409aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42d9455700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42d40b49e0 0x7f42d409d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42d9455700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d41595a0 0x7f42d409bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42d9455700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d409b080 con 0x7f42d40b49e0 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42d9455700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d415d150 con 0x7f42d41595a0 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42d9455700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4159b10 con 0x7f42d40b07a0 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42ca7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42d40b49e0 0x7f42d409d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42ca7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42d40b49e0 0x7f42d409d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33426/0 (socket says 172.21.15.84:33426) 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1984447106 learned_addr learned my addr 172.21.15.84:0/1984447106 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b07a0 0x7f42d409aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42d37fe700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d41595a0 0x7f42d409bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1984447106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b07a0 msgr2=0x7f42d409aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b07a0 0x7f42d409aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1984447106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d41595a0 msgr2=0x7f42d409bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d41595a0 0x7f42d409bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1984447106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009a20 con 0x7f42d40b49e0 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.553+0000 7f42d37fe700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d41595a0 0x7f42d409bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.554+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42d40b49e0 0x7f42d409d9f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009ed0 tx=0x7f42bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.554+0000 7f42cb7fe700 1 -- 172.21.15.84:0/1984447106 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc011b10 con 0x7f42d40b49e0 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.554+0000 7f42cb7fe700 1 -- 172.21.15.84:0/1984447106 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0253f0 con 0x7f42d40b49e0 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.554+0000 7f42d9455700 1 -- 172.21.15.84:0/1984447106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc009420 con 0x7f42d40b49e0 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.554+0000 7f42cb7fe700 1 -- 172.21.15.84:0/1984447106 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0257b0 con 0x7f42d40b49e0 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.554+0000 7f42d9455700 1 -- 172.21.15.84:0/1984447106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d415ce70 con 0x7f42d40b49e0 2023-10-06T03:00:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.555+0000 7f42cb7fe700 1 -- 172.21.15.84:0/1984447106 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42bc025ba0 con 0x7f42d40b49e0 2023-10-06T03:00:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.555+0000 7f42cb7fe700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42b4066f30 0x7f42b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.556+0000 7f42cb7fe700 1 -- 172.21.15.84:0/1984447106 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f42bc086190 con 0x7f42d40b49e0 2023-10-06T03:00:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.556+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42b4066f30 0x7f42b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.556+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42b4066f30 0x7f42b40693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005920 tx=0x7f42c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.557+0000 7f42e274db80 1 Processor -- start 2023-10-06T03:00:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42e274db80 1 -- start start 2023-10-06T03:00:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42e274db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 0x55c898245c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42e274db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898246cc0 0x55c8982956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42e274db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898295c00 0x55c898296050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42e274db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89819ca70 con 0x55c898246cc0 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42e274db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89819a270 con 0x55c898295c00 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42e274db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c898196060 con 0x55c898245840 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42ca7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898246cc0 0x55c8982956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42ca7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898246cc0 0x55c8982956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33436/0 (socket says 172.21.15.84:33436) 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.558+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1802723008 learned_addr learned my addr 172.21.15.84:0/1802723008 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/1802723008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 0x55c898245c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42d37fe700 1 --2- 172.21.15.84:0/1802723008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898295c00 0x55c898296050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1802723008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 msgr2=0x55c898245c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/1802723008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 0x55c898245c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1802723008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898295c00 msgr2=0x55c898296050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/1802723008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898295c00 0x55c898296050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42ca7fc700 1 -- 172.21.15.84:0/1802723008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c898030270 con 0x55c898246cc0 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/1802723008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898246cc0 0x55c8982956c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f42bc056aa0 tx=0x7f42bc003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b417241a662cc514 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42b3fff700 1 -- 172.21.15.84:0/1802723008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc057520 con 0x55c898246cc0 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42b3fff700 1 -- 172.21.15.84:0/1802723008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc056e20 con 0x55c898246cc0 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.559+0000 7f42b3fff700 1 -- 172.21.15.84:0/1802723008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc05a070 con 0x55c898246cc0 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 -- 172.21.15.84:0/1802723008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898246cc0 msgr2=0x55c8982956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 --2- 172.21.15.84:0/1802723008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898246cc0 0x55c8982956c0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f42bc056aa0 tx=0x7f42bc003040 comp rx=0 tx=0).stop 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 -- 172.21.15.84:0/1802723008 shutdown_connections 2023-10-06T03:00:07.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 --2- 172.21.15.84:0/1802723008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898295c00 0x55c898296050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 --2- 172.21.15.84:0/1802723008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 0x55c898245c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 --2- 172.21.15.84:0/1802723008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898246cc0 0x55c8982956c0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 -- 172.21.15.84:0/1802723008 >> 172.21.15.84:0/1802723008 conn(0x55c898247160 msgr2=0x55c898247530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 -- 172.21.15.84:0/1802723008 shutdown_connections 2023-10-06T03:00:07.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 -- 172.21.15.84:0/1802723008 wait complete. 2023-10-06T03:00:07.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 -- start start 2023-10-06T03:00:07.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.560+0000 7f42e274db80 1 Processor -- start 2023-10-06T03:00:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42e274db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898245840 0x55c89826ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42e274db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898246cc0 0x55c89828c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42e274db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c89828c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42e274db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c898141890 con 0x55c898295c00 2023-10-06T03:00:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42e274db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89815cea0 con 0x55c898245840 2023-10-06T03:00:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42e274db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c898018e30 con 0x55c898246cc0 2023-10-06T03:00:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42e274db80 10 client.0 _ll_register_callbacks cb 0x55c898208e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c89828c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c89828c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33452/0 (socket says 172.21.15.84:33452) 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42d37fe700 1 -- 172.21.15.84:0/414924171 learned_addr learned my addr 172.21.15.84:0/414924171 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898245840 0x55c89826ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.561+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898246cc0 0x55c89828c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42d37fe700 1 -- 172.21.15.84:0/414924171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898246cc0 msgr2=0x55c89828c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42d37fe700 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898246cc0 0x55c89828c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42d37fe700 1 -- 172.21.15.84:0/414924171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898245840 msgr2=0x55c89826ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42d37fe700 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898245840 0x55c89826ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42d37fe700 1 -- 172.21.15.84:0/414924171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d415ce70 con 0x55c898295c00 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42d37fe700 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c89828c720 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f42cc007e90 tx=0x7f42cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a8f2b4f90b7b5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42b17fa700 1 -- 172.21.15.84:0/414924171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00e050 con 0x55c898295c00 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42b17fa700 1 -- 172.21.15.84:0/414924171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f42cc010c70 con 0x55c898295c00 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42e274db80 1 -- 172.21.15.84:0/414924171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c89823a940 con 0x55c898295c00 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42b17fa700 1 -- 172.21.15.84:0/414924171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42cc015440 con 0x55c898295c00 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42e274db80 10 client.7383 fetch_fsmap learned FSMap version 73 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42e274db80 1 -- 172.21.15.84:0/414924171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55c897fd2fe0 con 0x55c898295c00 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42b17fa700 1 -- 172.21.15.84:0/414924171 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c89823a940 con 0x55c898295c00 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42b17fa700 1 -- 172.21.15.84:0/414924171 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 73) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f42cc01f3f0 con 0x55c898295c00 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42e274db80 10 client.7383 fetch_fsmap finished waiting for FSMap version 73 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42e274db80 10 client.7383 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42e274db80 20 client.7383 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42e274db80 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c898285c30 0x55c8982a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42e274db80 4 client.7383 mds_command: new command op to 7182 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42e274db80 1 -- 172.21.15.84:0/414924171 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c898217870 con 0x55c898285c30 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.562+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c898285c30 0x55c8982a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.563+0000 7f42b17fa700 10 client.7383 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.563+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c898285c30 0x55c8982a95a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=653a9a44bfe35561 server_cookie=fb0c546c60c7c083 in_seq=0 out_seq=0 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.563+0000 7f42b17fa700 1 -- 172.21.15.84:0/414924171 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c898217870 con 0x55c898285c30 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.563+0000 7f42b17fa700 10 client.7383 handle_command_reply: tid=0 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.563+0000 7f42e274db80 1 client.7383 shutdown 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.563+0000 7f42e274db80 1 -- 172.21.15.84:0/414924171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 msgr2=0x55c89828c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.563+0000 7f42e274db80 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c89828c720 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f42cc007e90 tx=0x7f42cc00b040 comp rx=0 tx=0).stop 2023-10-06T03:00:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42e274db80 1 -- 172.21.15.84:0/414924171 shutdown_connections 2023-10-06T03:00:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42e274db80 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c898285c30 0x55c8982a95a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42e274db80 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898245840 0x55c89826ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42e274db80 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c89828c720 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42e274db80 1 --2- 172.21.15.84:0/414924171 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898246cc0 0x55c89828c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42b17fa700 0 client.7383 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42e274db80 1 -- 172.21.15.84:0/414924171 >> 172.21.15.84:0/414924171 conn(0x55c898247160 msgr2=0x55c8982894b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42e274db80 1 -- 172.21.15.84:0/414924171 shutdown_connections 2023-10-06T03:00:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42e274db80 1 -- 172.21.15.84:0/414924171 wait complete. 2023-10-06T03:00:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.564+0000 7f42e274db80 20 client.7383 trim_cache size 0 max 16384 2023-10-06T03:00:07.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.580+0000 7f42e274db80 1 Processor -- start 2023-10-06T03:00:07.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.580+0000 7f42e274db80 1 -- start start 2023-10-06T03:00:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42e274db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898245840 0x55c89828c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42e274db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898246cc0 0x55c89828c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42e274db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898295c00 0x55c8982894b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42e274db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c898240ab0 con 0x55c898245840 2023-10-06T03:00:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42e274db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89826e530 con 0x55c898246cc0 2023-10-06T03:00:07.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42e274db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c898292430 con 0x55c898295c00 2023-10-06T03:00:07.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42d2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898245840 0x55c89828c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42d2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898245840 0x55c89828c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33462/0 (socket says 172.21.15.84:33462) 2023-10-06T03:00:07.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42d2ffd700 1 -- 172.21.15.84:0/2363394054 learned_addr learned my addr 172.21.15.84:0/2363394054 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42d2ffd700 1 -- 172.21.15.84:0/2363394054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898295c00 msgr2=0x55c8982894b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/2363394054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898295c00 0x55c8982894b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42d2ffd700 1 -- 172.21.15.84:0/2363394054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898246cc0 msgr2=0x55c89828c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/2363394054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898246cc0 0x55c89828c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.581+0000 7f42d2ffd700 1 -- 172.21.15.84:0/2363394054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c898164780 con 0x55c898245840 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/2363394054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898245840 0x55c89828c3e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f42c4001e80 tx=0x7f42c4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fd3af7666278e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42c8ff9700 1 -- 172.21.15.84:0/2363394054 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4007560 con 0x55c898245840 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42c8ff9700 1 -- 172.21.15.84:0/2363394054 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c401b040 con 0x55c898245840 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42c8ff9700 1 -- 172.21.15.84:0/2363394054 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c40255a0 con 0x55c898245840 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42e274db80 1 -- 172.21.15.84:0/2363394054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898245840 msgr2=0x55c89828c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42e274db80 1 --2- 172.21.15.84:0/2363394054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898245840 0x55c89828c3e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f42c4001e80 tx=0x7f42c4013000 comp rx=0 tx=0).stop 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42e274db80 1 -- 172.21.15.84:0/2363394054 shutdown_connections 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42e274db80 1 --2- 172.21.15.84:0/2363394054 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898295c00 0x55c8982894b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42e274db80 1 --2- 172.21.15.84:0/2363394054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898245840 0x55c89828c3e0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42e274db80 1 --2- 172.21.15.84:0/2363394054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898246cc0 0x55c89828c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42e274db80 1 -- 172.21.15.84:0/2363394054 >> 172.21.15.84:0/2363394054 conn(0x55c898247160 msgr2=0x55c898284360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42e274db80 1 -- 172.21.15.84:0/2363394054 shutdown_connections 2023-10-06T03:00:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.582+0000 7f42e274db80 1 -- 172.21.15.84:0/2363394054 wait complete. 2023-10-06T03:00:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.583+0000 7f42e274db80 1 -- start start 2023-10-06T03:00:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.583+0000 7f42e274db80 1 Processor -- start 2023-10-06T03:00:07.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42e274db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 0x55c8982f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42e274db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898246cc0 0x55c8982eee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42e274db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c8982754c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42e274db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c89828d150 con 0x55c898295c00 2023-10-06T03:00:07.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42e274db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8982a7590 con 0x55c898246cc0 2023-10-06T03:00:07.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42e274db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8982a7ac0 con 0x55c898245840 2023-10-06T03:00:07.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42e274db80 10 client.0 _ll_register_callbacks cb 0x55c898208e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c8982754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c8982754c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33476/0 (socket says 172.21.15.84:33476) 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d37fe700 1 -- 172.21.15.84:0/815356153 learned_addr learned my addr 172.21.15.84:0/815356153 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42ca7fc700 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898246cc0 0x55c8982eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 0x55c8982f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d37fe700 1 -- 172.21.15.84:0/815356153 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 msgr2=0x55c8982f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d37fe700 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 0x55c8982f26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d37fe700 1 -- 172.21.15.84:0/815356153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898246cc0 msgr2=0x55c8982eee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d37fe700 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898246cc0 0x55c8982eee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d37fe700 1 -- 172.21.15.84:0/815356153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c400f040 con 0x55c898295c00 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42d37fe700 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c8982754c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f42cc010a10 tx=0x7f42cc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4812e6958176783e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.584+0000 7f42b17fa700 1 -- 172.21.15.84:0/815356153 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00e050 con 0x55c898295c00 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42e274db80 1 -- 172.21.15.84:0/815356153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42bc056e20 con 0x55c898295c00 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42b17fa700 1 -- 172.21.15.84:0/815356153 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f42cc01fb90 con 0x55c898295c00 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42b17fa700 1 -- 172.21.15.84:0/815356153 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42cc015440 con 0x55c898295c00 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42e274db80 10 client.7389 fetch_fsmap learned FSMap version 73 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42e274db80 1 -- 172.21.15.84:0/815356153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55c89814b470 con 0x55c898295c00 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42b17fa700 1 -- 172.21.15.84:0/815356153 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc056e20 con 0x55c898295c00 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42b17fa700 1 -- 172.21.15.84:0/815356153 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 73) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f42cc0155a0 con 0x55c898295c00 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42e274db80 10 client.7389 fetch_fsmap finished waiting for FSMap version 73 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42e274db80 10 client.7389 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42e274db80 20 client.7389 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42e274db80 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c89828ba30 0x55c8982fd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42e274db80 4 client.7389 mds_command: new command op to 7182 tid=0[{"prefix": "status"}] 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42e274db80 1 -- 172.21.15.84:0/815356153 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c898138e00 con 0x55c89828ba30 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c89828ba30 0x55c8982fd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42b17fa700 10 client.7389 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42d2ffd700 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c89828ba30 0x55c8982fd120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90d21bd9e0fefb1c server_cookie=747f6c96e16bbde in_seq=0 out_seq=0 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42b17fa700 1 -- 172.21.15.84:0/815356153 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c898138e00 con 0x55c89828ba30 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.585+0000 7f42b17fa700 10 client.7389 handle_command_reply: tid=0 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 client.7389 shutdown 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 -- 172.21.15.84:0/815356153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 msgr2=0x55c8982754c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c8982754c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f42cc010a10 tx=0x7f42cc01c000 comp rx=0 tx=0).stop 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 -- 172.21.15.84:0/815356153 shutdown_connections 2023-10-06T03:00:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c89828ba30 0x55c8982fd120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c898295c00 0x55c8982754c0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42b17fa700 0 client.7389 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c898245840 0x55c8982f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 --2- 172.21.15.84:0/815356153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c898246cc0 0x55c8982eee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 -- 172.21.15.84:0/815356153 >> 172.21.15.84:0/815356153 conn(0x55c898247160 msgr2=0x55c89826ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 -- 172.21.15.84:0/815356153 shutdown_connections 2023-10-06T03:00:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 1 -- 172.21.15.84:0/815356153 wait complete. 2023-10-06T03:00:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42e274db80 20 client.7389 trim_cache size 0 max 16384 2023-10-06T03:00:07.596 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7182, 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 2.8970256879999998, 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 73, 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 82, 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 82, 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 17.075337134000002 2023-10-06T03:00:07.597 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:07.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 -- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42b4066f30 msgr2=0x7f42b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42b4066f30 0x7f42b40693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005920 tx=0x7f42c4009040 comp rx=0 tx=0).stop 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 -- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42d40b49e0 msgr2=0x7f42d409d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42d40b49e0 0x7f42d409d9f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009ed0 tx=0x7f42bc017000 comp rx=0 tx=0).stop 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 -- 172.21.15.84:0/1984447106 shutdown_connections 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f42b4066f30 0x7f42b40693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42d41595a0 0x7f42d409bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42d40b07a0 0x7f42d409aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 --2- 172.21.15.84:0/1984447106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f42d40b49e0 0x7f42d409d9f0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 -- 172.21.15.84:0/1984447106 >> 172.21.15.84:0/1984447106 conn(0x7f42d4099830 msgr2=0x7f42d40cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.586+0000 7f42d9455700 1 -- 172.21.15.84:0/1984447106 shutdown_connections 2023-10-06T03:00:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.587+0000 7f42d9455700 1 -- 172.21.15.84:0/1984447106 wait complete. 2023-10-06T03:00:07.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:00:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.714+0000 7f262d14d700 1 Processor -- start 2023-10-06T03:00:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.715+0000 7f262d14d700 1 -- start start 2023-10-06T03:00:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.715+0000 7f262d14d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f262815caf0 0x7f262806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.715+0000 7f262d14d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262806ed10 con 0x7f26280675f0 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.715+0000 7f262d14d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26280cb8b0 con 0x7f26280caad0 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.715+0000 7f262d14d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280cbb90 con 0x7f262815caf0 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.715+0000 7f2626d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f262815caf0 0x7f262806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.715+0000 7f262759e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26280675f0 0x7f26280679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59934/0 (socket says 172.21.15.84:59934) 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.715+0000 7f262759e700 1 -- 172.21.15.84:0/3449942873 learned_addr learned my addr 172.21.15.84:0/3449942873 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f2626d9d700 1 -- 172.21.15.84:0/3449942873 >> v1:172.21.15.131:6789/0 conn(0x7f26280caad0 legacy=0x7f26280caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f2626d9d700 1 -- 172.21.15.84:0/3449942873 >> v1:172.21.15.84:6789/0 conn(0x7f26280675f0 legacy=0x7f26280679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f262659c700 1 -- 172.21.15.84:0/3449942873 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807367377 0 0) 0x7f262806ed10 con 0x7f26280675f0 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f2626d9d700 1 -- 172.21.15.84:0/3449942873 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262806e6c0 con 0x7f262815caf0 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f2626d9d700 1 --2- 172.21.15.84:0/3449942873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 0x7f262806f1a0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f26180098e0 tx=0x7f26180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763b6d7f1637653b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f262659c700 1 -- 172.21.15.84:0/3449942873 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618009e80 con 0x7f262815caf0 2023-10-06T03:00:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f262659c700 1 -- 172.21.15.84:0/3449942873 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800b820 con 0x7f262815caf0 2023-10-06T03:00:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f262659c700 1 -- 172.21.15.84:0/3449942873 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800bba0 con 0x7f262815caf0 2023-10-06T03:00:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f262d14d700 1 -- 172.21.15.84:0/3449942873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 msgr2=0x7f262806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.716+0000 7f262d14d700 1 --2- 172.21.15.84:0/3449942873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 0x7f262806f1a0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f26180098e0 tx=0x7f26180091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.717+0000 7f262d14d700 1 -- 172.21.15.84:0/3449942873 shutdown_connections 2023-10-06T03:00:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.717+0000 7f262d14d700 1 --2- 172.21.15.84:0/3449942873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 0x7f262806f1a0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.717+0000 7f262d14d700 1 -- 172.21.15.84:0/3449942873 >> 172.21.15.84:0/3449942873 conn(0x7f26280cdef0 msgr2=0x7f26280c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.717+0000 7f262d14d700 1 -- 172.21.15.84:0/3449942873 shutdown_connections 2023-10-06T03:00:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.717+0000 7f262d14d700 1 -- 172.21.15.84:0/3449942873 wait complete. 2023-10-06T03:00:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.718+0000 7f262d14d700 1 Processor -- start 2023-10-06T03:00:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.718+0000 7f262d14d700 1 -- start start 2023-10-06T03:00:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262d14d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26280675f0 0x7f26280b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262d14d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26280caad0 0x7f262814de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262d14d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 0x7f26280c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262d14d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280b01c0 con 0x7f262815caf0 2023-10-06T03:00:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262d14d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280c8d20 con 0x7f26280caad0 2023-10-06T03:00:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262d14d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280b03d0 con 0x7f26280675f0 2023-10-06T03:00:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 0x7f26280c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 0x7f26280c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33504/0 (socket says 172.21.15.84:33504) 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262759e700 1 -- 172.21.15.84:0/1070038086 learned_addr learned my addr 172.21.15.84:0/1070038086 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f261e59c700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26280caad0 0x7f262814de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f2626d9d700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26280675f0 0x7f26280b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262759e700 1 -- 172.21.15.84:0/1070038086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26280675f0 msgr2=0x7f26280b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262759e700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26280675f0 0x7f26280b2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262759e700 1 -- 172.21.15.84:0/1070038086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26280caad0 msgr2=0x7f262814de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262759e700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26280caad0 0x7f262814de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262759e700 1 -- 172.21.15.84:0/1070038086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618009420 con 0x7f262815caf0 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262759e700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 0x7f26280c4920 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f262000cc90 tx=0x7f2620001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f261f7fe700 1 -- 172.21.15.84:0/1070038086 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000cea0 con 0x7f262815caf0 2023-10-06T03:00:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f261f7fe700 1 -- 172.21.15.84:0/1070038086 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000ab70 con 0x7f262815caf0 2023-10-06T03:00:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262d14d700 1 -- 172.21.15.84:0/1070038086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26280b06b0 con 0x7f262815caf0 2023-10-06T03:00:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f261f7fe700 1 -- 172.21.15.84:0/1070038086 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200070f0 con 0x7f262815caf0 2023-10-06T03:00:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.719+0000 7f262d14d700 1 -- 172.21.15.84:0/1070038086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280b0c70 con 0x7f262815caf0 2023-10-06T03:00:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.721+0000 7f261f7fe700 1 -- 172.21.15.84:0/1070038086 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26200074a0 con 0x7f262815caf0 2023-10-06T03:00:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.721+0000 7f261f7fe700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2608066f30 0x7f26080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.721+0000 7f261f7fe700 1 -- 172.21.15.84:0/1070038086 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2620084c40 con 0x7f262815caf0 2023-10-06T03:00:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.721+0000 7f2626d9d700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2608066f30 0x7f26080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.722+0000 7f2626d9d700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2608066f30 0x7f26080693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f26280c65a0 tx=0x7f2618016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.723+0000 7f2636445b80 1 Processor -- start 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.723+0000 7f2636445b80 1 -- start start 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f2636445b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 0x55ed11dcfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f2636445b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e1f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f2636445b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11e1fc00 0x55ed11e20050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f2636445b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed11d26a70 con 0x55ed11dd0cc0 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f2636445b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed11d24270 con 0x55ed11dcf840 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f2636445b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed11d20060 con 0x55ed11e1fc00 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f261e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e1f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f261e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e1f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33516/0 (socket says 172.21.15.84:33516) 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f261e59c700 1 -- 172.21.15.84:0/3238728145 learned_addr learned my addr 172.21.15.84:0/3238728145 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f2626d9d700 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 0x55ed11dcfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f262759e700 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11e1fc00 0x55ed11e20050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f261e59c700 1 -- 172.21.15.84:0/3238728145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11e1fc00 msgr2=0x55ed11e20050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f261e59c700 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11e1fc00 0x55ed11e20050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f261e59c700 1 -- 172.21.15.84:0/3238728145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 msgr2=0x55ed11dcfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f261e59c700 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 0x55ed11dcfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f261e59c700 1 -- 172.21.15.84:0/3238728145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed11bba270 con 0x55ed11dd0cc0 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.724+0000 7f2626d9d700 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 0x55ed11dcfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f261e59c700 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e1f6c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f261000b8f0 tx=0x7f2610008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5270360140484e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2607fff700 1 -- 172.21.15.84:0/3238728145 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000be90 con 0x55ed11dd0cc0 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2607fff700 1 -- 172.21.15.84:0/3238728145 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000d800 con 0x55ed11dd0cc0 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2607fff700 1 -- 172.21.15.84:0/3238728145 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000dbc0 con 0x55ed11dd0cc0 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2636445b80 1 -- 172.21.15.84:0/3238728145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 msgr2=0x55ed11e1f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2636445b80 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e1f6c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f261000b8f0 tx=0x7f2610008040 comp rx=0 tx=0).stop 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2636445b80 1 -- 172.21.15.84:0/3238728145 shutdown_connections 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2636445b80 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 0x55ed11dcfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2636445b80 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11e1fc00 0x55ed11e20050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2636445b80 1 --2- 172.21.15.84:0/3238728145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e1f6c0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.725+0000 7f2636445b80 1 -- 172.21.15.84:0/3238728145 >> 172.21.15.84:0/3238728145 conn(0x55ed11dd1160 msgr2=0x55ed11dd1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.726+0000 7f2636445b80 1 -- 172.21.15.84:0/3238728145 shutdown_connections 2023-10-06T03:00:07.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.726+0000 7f2636445b80 1 -- 172.21.15.84:0/3238728145 wait complete. 2023-10-06T03:00:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.726+0000 7f2636445b80 1 -- start start 2023-10-06T03:00:07.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.726+0000 7f2636445b80 1 Processor -- start 2023-10-06T03:00:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f2636445b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dcf840 0x55ed11e0e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f2636445b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e18660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f2636445b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 0x55ed11e18ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f2636445b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed11ccb890 con 0x55ed11dd0cc0 2023-10-06T03:00:07.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f2636445b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed11ce6ea0 con 0x55ed11e1fc00 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f2636445b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed11ba2e30 con 0x55ed11dcf840 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f2636445b80 10 client.0 _ll_register_callbacks cb 0x55ed11d92e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f261e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e18660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f261e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e18660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33532/0 (socket says 172.21.15.84:33532) 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f261e59c700 1 -- 172.21.15.84:0/2133818455 learned_addr learned my addr 172.21.15.84:0/2133818455 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f2626d9d700 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dcf840 0x55ed11e0e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f262759e700 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 0x55ed11e18ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f261e59c700 1 -- 172.21.15.84:0/2133818455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dcf840 msgr2=0x55ed11e0e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f261e59c700 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dcf840 0x55ed11e0e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f261e59c700 1 -- 172.21.15.84:0/2133818455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 msgr2=0x55ed11e18ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f261e59c700 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 0x55ed11e18ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.727+0000 7f261e59c700 1 -- 172.21.15.84:0/2133818455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261000e040 con 0x55ed11dd0cc0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f261e59c700 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e18660 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f261000b8c0 tx=0x7f2610019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e689bcbb1f78259 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f26057fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f26057fa700 1 -- 172.21.15.84:0/2133818455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26100127b0 con 0x55ed11dd0cc0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f26057fa700 1 -- 172.21.15.84:0/2133818455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2610012910 con 0x55ed11dd0cc0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2636445b80 1 -- 172.21.15.84:0/2133818455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed11dc4940 con 0x55ed11dd0cc0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f26057fa700 1 -- 172.21.15.84:0/2133818455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2610012ce0 con 0x55ed11dd0cc0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2636445b80 10 client.7404 fetch_fsmap learned FSMap version 73 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2636445b80 1 -- 172.21.15.84:0/2133818455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55ed11b5cfe0 con 0x55ed11dd0cc0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f26057fa700 1 -- 172.21.15.84:0/2133818455 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed11dc4940 con 0x55ed11dd0cc0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f26057fa700 1 -- 172.21.15.84:0/2133818455 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 73) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f261001d420 con 0x55ed11dd0cc0 2023-10-06T03:00:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2636445b80 10 client.7404 fetch_fsmap finished waiting for FSMap version 73 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2636445b80 10 client.7404 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2636445b80 20 client.7404 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2636445b80 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55ed11e29870 0x55ed11e29c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2636445b80 4 client.7404 mds_command: new command op to 7185 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2636445b80 1 -- 172.21.15.84:0/2133818455 --> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed11da1870 con 0x55ed11e29870 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.728+0000 7f2626d9d700 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55ed11e29870 0x55ed11e29c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f26057fa700 10 client.7404 ms_handle_connect on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2626d9d700 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55ed11e29870 0x55ed11e29c40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e03c2caa1c439f49 server_cookie=ea47a9e3e4aa8a5b in_seq=0 out_seq=0 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f26057fa700 1 -- 172.21.15.84:0/2133818455 <== mds.0 v2:172.21.15.84:6835/2418120362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ed11da1870 con 0x55ed11e29870 2023-10-06T03:00:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f26057fa700 10 client.7404 handle_command_reply: tid=0 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 client.7404 shutdown 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 -- 172.21.15.84:0/2133818455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 msgr2=0x55ed11e18660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e18660 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f261000b8c0 tx=0x7f2610019000 comp rx=0 tx=0).stop 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 -- 172.21.15.84:0/2133818455 shutdown_connections 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55ed11e29870 0x55ed11e29c40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 0x55ed11e18ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dcf840 0x55ed11e0e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f26057fa700 0 client.7404 ms_handle_reset on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 --2- 172.21.15.84:0/2133818455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dd0cc0 0x55ed11e18660 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 -- 172.21.15.84:0/2133818455 >> 172.21.15.84:0/2133818455 conn(0x55ed11dd1160 msgr2=0x55ed11dd01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 -- 172.21.15.84:0/2133818455 shutdown_connections 2023-10-06T03:00:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.729+0000 7f2636445b80 1 -- 172.21.15.84:0/2133818455 wait complete. 2023-10-06T03:00:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.730+0000 7f2636445b80 20 client.7404 trim_cache size 0 max 16384 2023-10-06T03:00:07.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.746+0000 7f2636445b80 1 Processor -- start 2023-10-06T03:00:07.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.746+0000 7f2636445b80 1 -- start start 2023-10-06T03:00:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f2636445b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 0x55ed11e10500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f2636445b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 0x55ed11df8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f2636445b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11e1fc00 0x55ed11e0d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f2636445b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed11da81e0 con 0x55ed11e1fc00 2023-10-06T03:00:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f2636445b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed11dd1dc0 con 0x55ed11dcf840 2023-10-06T03:00:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f2636445b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed11dccfd0 con 0x55ed11dd0cc0 2023-10-06T03:00:07.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f262759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11e1fc00 0x55ed11e0d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f262759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11e1fc00 0x55ed11e0d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33540/0 (socket says 172.21.15.84:33540) 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f262759e700 1 -- 172.21.15.84:0/1995371036 learned_addr learned my addr 172.21.15.84:0/1995371036 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f2626d9d700 1 --2- 172.21.15.84:0/1995371036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 0x55ed11e10500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f261e59c700 1 --2- 172.21.15.84:0/1995371036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 0x55ed11df8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f262759e700 1 -- 172.21.15.84:0/1995371036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 msgr2=0x55ed11df8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f262759e700 1 --2- 172.21.15.84:0/1995371036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 0x55ed11df8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f262759e700 1 -- 172.21.15.84:0/1995371036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 msgr2=0x55ed11e10500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f262759e700 1 --2- 172.21.15.84:0/1995371036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 0x55ed11e10500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f262759e700 1 -- 172.21.15.84:0/1995371036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed11e13140 con 0x55ed11e1fc00 2023-10-06T03:00:07.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f262759e700 1 --2- 172.21.15.84:0/1995371036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11e1fc00 0x55ed11e0d360 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f2620055650 tx=0x7f262001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0ff806a68aaf22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f261cd99700 1 -- 172.21.15.84:0/1995371036 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620056050 con 0x55ed11e1fc00 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f261cd99700 1 -- 172.21.15.84:0/1995371036 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620055950 con 0x55ed11e1fc00 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.747+0000 7f261cd99700 1 -- 172.21.15.84:0/1995371036 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620058ba0 con 0x55ed11e1fc00 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 -- 172.21.15.84:0/1995371036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11e1fc00 msgr2=0x55ed11e0d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 --2- 172.21.15.84:0/1995371036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11e1fc00 0x55ed11e0d360 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f2620055650 tx=0x7f262001d040 comp rx=0 tx=0).stop 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 -- 172.21.15.84:0/1995371036 shutdown_connections 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 --2- 172.21.15.84:0/1995371036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11dcf840 0x55ed11e10500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 --2- 172.21.15.84:0/1995371036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11e1fc00 0x55ed11e0d360 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 --2- 172.21.15.84:0/1995371036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 0x55ed11df8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 -- 172.21.15.84:0/1995371036 >> 172.21.15.84:0/1995371036 conn(0x55ed11dd1160 msgr2=0x55ed11dd01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 -- 172.21.15.84:0/1995371036 shutdown_connections 2023-10-06T03:00:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 -- 172.21.15.84:0/1995371036 wait complete. 2023-10-06T03:00:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.748+0000 7f2636445b80 1 -- start start 2023-10-06T03:00:07.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.749+0000 7f2636445b80 1 Processor -- start 2023-10-06T03:00:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.749+0000 7f2636445b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dcf840 0x55ed11e76480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.749+0000 7f2636445b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 0x55ed11e19350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.749+0000 7f2636445b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 0x55ed11e132d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.749+0000 7f2636445b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed11e7d400 con 0x55ed11dcf840 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.749+0000 7f2636445b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed11e7cdb0 con 0x55ed11e1fc00 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.749+0000 7f2636445b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed11e7d090 con 0x55ed11dd0cc0 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.749+0000 7f2636445b80 10 client.0 _ll_register_callbacks cb 0x55ed11d92e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.749+0000 7f2626d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dcf840 0x55ed11e76480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2626d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dcf840 0x55ed11e76480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33552/0 (socket says 172.21.15.84:33552) 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2626d9d700 1 -- 172.21.15.84:0/46783613 learned_addr learned my addr 172.21.15.84:0/46783613 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f261e59c700 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 0x55ed11e19350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f262759e700 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 0x55ed11e132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2626d9d700 1 -- 172.21.15.84:0/46783613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 msgr2=0x55ed11e19350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2626d9d700 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 0x55ed11e19350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2626d9d700 1 -- 172.21.15.84:0/46783613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 msgr2=0x55ed11e132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2626d9d700 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 0x55ed11e132d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2626d9d700 1 -- 172.21.15.84:0/46783613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26280b0c70 con 0x55ed11dcf840 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f262759e700 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 0x55ed11e132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2626d9d700 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dcf840 0x55ed11e76480 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f2618002000 tx=0x7f2618031250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dcdd78832f7404 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f26057fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f26057fa700 1 -- 172.21.15.84:0/46783613 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261801a440 con 0x55ed11dcf840 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f26057fa700 1 -- 172.21.15.84:0/46783613 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f261801a5a0 con 0x55ed11dcf840 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2636445b80 1 -- 172.21.15.84:0/46783613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f261000d800 con 0x55ed11dcf840 2023-10-06T03:00:07.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f26057fa700 1 -- 172.21.15.84:0/46783613 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f261801a970 con 0x55ed11dcf840 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2636445b80 10 client.7410 fetch_fsmap learned FSMap version 73 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2636445b80 1 -- 172.21.15.84:0/46783613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55ed11cee780 con 0x55ed11dcf840 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f26057fa700 1 -- 172.21.15.84:0/46783613 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000d800 con 0x55ed11dcf840 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f26057fa700 1 -- 172.21.15.84:0/46783613 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 73) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f261801aad0 con 0x55ed11dcf840 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2636445b80 10 client.7410 fetch_fsmap finished waiting for FSMap version 73 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2636445b80 10 client.7410 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.750+0000 7f2636445b80 20 client.7410 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55ed11e0cd10 0x55ed11e0d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 4 client.7410 mds_command: new command op to 7185 tid=0[{"prefix": "status"}] 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 -- 172.21.15.84:0/46783613 --> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ed11cc2e00 con 0x55ed11e0cd10 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f261e59c700 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55ed11e0cd10 0x55ed11e0d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f26057fa700 10 client.7410 ms_handle_connect on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f261e59c700 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55ed11e0cd10 0x55ed11e0d0e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c862cc867b3b506a server_cookie=33d8572eb126f911 in_seq=0 out_seq=0 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f26057fa700 1 -- 172.21.15.84:0/46783613 <== mds.0 v2:172.21.15.84:6835/2418120362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ed11cc2e00 con 0x55ed11e0cd10 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f26057fa700 10 client.7410 handle_command_reply: tid=0 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 client.7410 shutdown 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 -- 172.21.15.84:0/46783613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dcf840 msgr2=0x55ed11e76480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dcf840 0x55ed11e76480 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f2618002000 tx=0x7f2618031250 comp rx=0 tx=0).stop 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 -- 172.21.15.84:0/46783613 shutdown_connections 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55ed11e0cd10 0x55ed11e0d0e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed11e1fc00 0x55ed11e132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ed11dcf840 0x55ed11e76480 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 --2- 172.21.15.84:0/46783613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed11dd0cc0 0x55ed11e19350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f26057fa700 0 client.7410 ms_handle_reset on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 -- 172.21.15.84:0/46783613 >> 172.21.15.84:0/46783613 conn(0x55ed11dd1160 msgr2=0x55ed11df9060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 -- 172.21.15.84:0/46783613 shutdown_connections 2023-10-06T03:00:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.751+0000 7f2636445b80 1 -- 172.21.15.84:0/46783613 wait complete. 2023-10-06T03:00:07.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f2636445b80 20 client.7410 trim_cache size 0 max 16384 2023-10-06T03:00:07.761 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:07.761 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:00:07.761 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:00:07.761 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7185, 2023-10-06T03:00:07.762 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:00:07.762 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:00:07.762 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:00:07.762 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 11.104395759000001, 2023-10-06T03:00:07.762 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 73, 2023-10-06T03:00:07.762 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 82, 2023-10-06T03:00:07.762 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 82, 2023-10-06T03:00:07.762 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 17.240625660999999 2023-10-06T03:00:07.762 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 -- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2608066f30 msgr2=0x7f26080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2608066f30 0x7f26080693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f26280c65a0 tx=0x7f2618016000 comp rx=0 tx=0).stop 2023-10-06T03:00:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 -- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 msgr2=0x7f26280c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 0x7f26280c4920 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f262000cc90 tx=0x7f2620001a80 comp rx=0 tx=0).stop 2023-10-06T03:00:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 -- 172.21.15.84:0/1070038086 shutdown_connections 2023-10-06T03:00:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2608066f30 0x7f26080693e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f262815caf0 0x7f26280c4920 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26280675f0 0x7f26280b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 --2- 172.21.15.84:0/1070038086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26280caad0 0x7f262814de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 -- 172.21.15.84:0/1070038086 >> 172.21.15.84:0/1070038086 conn(0x7f26280cdef0 msgr2=0x7f26280a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 -- 172.21.15.84:0/1070038086 shutdown_connections 2023-10-06T03:00:07.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.752+0000 7f262d14d700 1 -- 172.21.15.84:0/1070038086 wait complete. 2023-10-06T03:00:07.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:07.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.879+0000 7f5be54c0700 1 Processor -- start 2023-10-06T03:00:07.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.879+0000 7f5be54c0700 1 -- start start 2023-10-06T03:00:07.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5be54c0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5be01595a0 0x7f5be00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5be54c0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5be00b07a0 0x7f5be00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5be54c0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be00b0ca0 con 0x7f5be00b49e0 2023-10-06T03:00:07.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5be54c0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be00b0f80 con 0x7f5be01595a0 2023-10-06T03:00:07.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5be54c0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be00b1260 con 0x7f5be00b07a0 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bdeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5be01595a0 0x7f5be00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bd67fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5be00b49e0 0x7f5be00aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:59948/0 (socket says 172.21.15.84:59948) 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bd67fc700 1 -- 172.21.15.84:0/1153258436 learned_addr learned my addr 172.21.15.84:0/1153258436 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bdf7fe700 1 --2- 172.21.15.84:0/1153258436 >> v2:172.21.15.131:3300/0 conn(0x7f5be00b07a0 0x7f5be00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bdeffd700 1 -- 172.21.15.84:0/1153258436 >> v2:172.21.15.131:3300/0 conn(0x7f5be00b07a0 msgr2=0x7f5be00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bdeffd700 1 --2- 172.21.15.84:0/1153258436 >> v2:172.21.15.131:3300/0 conn(0x7f5be00b07a0 0x7f5be00b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bdeffd700 1 -- 172.21.15.84:0/1153258436 >> v1:172.21.15.84:6789/0 conn(0x7f5be00b49e0 legacy=0x7f5be00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bdeffd700 1 -- 172.21.15.84:0/1153258436 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00b1540 con 0x7f5be01595a0 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bde7fc700 1 -- 172.21.15.84:0/1153258436 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336243290 0 0) 0x7f5be00b0ca0 con 0x7f5be00b49e0 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.880+0000 7f5bdeffd700 1 --2- 172.21.15.84:0/1153258436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 0x7f5be00aa570 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00098d0 tx=0x7f5bd0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb8a3de7f3a97e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5bde7fc700 1 -- 172.21.15.84:0/1153258436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0005c10 con 0x7f5be01595a0 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5bde7fc700 1 -- 172.21.15.84:0/1153258436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd0005d70 con 0x7f5be01595a0 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5bde7fc700 1 -- 172.21.15.84:0/1153258436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0006280 con 0x7f5be01595a0 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5be54c0700 1 -- 172.21.15.84:0/1153258436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 msgr2=0x7f5be00aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5be54c0700 1 --2- 172.21.15.84:0/1153258436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 0x7f5be00aa570 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00098d0 tx=0x7f5bd0009120 comp rx=0 tx=0).stop 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5be54c0700 1 -- 172.21.15.84:0/1153258436 shutdown_connections 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5be54c0700 1 --2- 172.21.15.84:0/1153258436 >> v2:172.21.15.131:3300/0 conn(0x7f5be00b07a0 0x7f5be00b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5be54c0700 1 --2- 172.21.15.84:0/1153258436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 0x7f5be00aa570 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5be54c0700 1 -- 172.21.15.84:0/1153258436 >> 172.21.15.84:0/1153258436 conn(0x7f5be0099830 msgr2=0x7f5be006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5be54c0700 1 -- 172.21.15.84:0/1153258436 shutdown_connections 2023-10-06T03:00:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.881+0000 7f5be54c0700 1 -- 172.21.15.84:0/1153258436 wait complete. 2023-10-06T03:00:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.882+0000 7f5be54c0700 1 Processor -- start 2023-10-06T03:00:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.882+0000 7f5be54c0700 1 -- start start 2023-10-06T03:00:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.883+0000 7f5be54c0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5be00b07a0 0x7f5be0157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.883+0000 7f5be54c0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5be00b49e0 0x7f5be009ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.883+0000 7f5be54c0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 0x7f5be0068400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.883+0000 7f5be54c0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0157f90 con 0x7f5be01595a0 2023-10-06T03:00:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.883+0000 7f5be54c0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be009d380 con 0x7f5be00b49e0 2023-10-06T03:00:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.883+0000 7f5be54c0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be009d660 con 0x7f5be00b07a0 2023-10-06T03:00:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.883+0000 7f5bdf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 0x7f5be0068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.883+0000 7f5bdf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 0x7f5be0068400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33568/0 (socket says 172.21.15.84:33568) 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.883+0000 7f5bdf7fe700 1 -- 172.21.15.84:0/235276916 learned_addr learned my addr 172.21.15.84:0/235276916 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bd67fc700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5be00b49e0 0x7f5be009ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bdeffd700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5be00b07a0 0x7f5be0157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bdf7fe700 1 -- 172.21.15.84:0/235276916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5be00b07a0 msgr2=0x7f5be0157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bdf7fe700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5be00b07a0 0x7f5be0157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bdf7fe700 1 -- 172.21.15.84:0/235276916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5be00b49e0 msgr2=0x7f5be009ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bdf7fe700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5be00b49e0 0x7f5be009ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bdf7fe700 1 -- 172.21.15.84:0/235276916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd00093c0 con 0x7f5be01595a0 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bd67fc700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5be00b49e0 0x7f5be009ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bdf7fe700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 0x7f5be0068400 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009e90 tx=0x7f5bd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bd77fe700 1 -- 172.21.15.84:0/235276916 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800cc20 con 0x7f5be01595a0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bd77fe700 1 -- 172.21.15.84:0/235276916 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800f040 con 0x7f5be01595a0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be009d940 con 0x7f5be01595a0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5bd77fe700 1 -- 172.21.15.84:0/235276916 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8014480 con 0x7f5be01595a0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.884+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be009df00 con 0x7f5be01595a0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.885+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be0064ad0 con 0x7f5be01595a0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.885+0000 7f5bd77fe700 1 -- 172.21.15.84:0/235276916 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bd8014830 con 0x7f5be01595a0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.886+0000 7f5bd77fe700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5bc0066f30 0x7f5bc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.886+0000 7f5bd77fe700 1 -- 172.21.15.84:0/235276916 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5bd8085310 con 0x7f5be01595a0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.886+0000 7f5bdeffd700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5bc0066f30 0x7f5bc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.886+0000 7f5bdeffd700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5bc0066f30 0x7f5bc00693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0006d00 tx=0x7f5bd0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:07.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:07.890+0000 7f5bd77fe700 1 -- 172.21.15.84:0/235276916 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bd8055cd0 con 0x7f5be01595a0 2023-10-06T03:00:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.112+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5be00b1820 con 0x7f5be01595a0 2023-10-06T03:00:08.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.112+0000 7f5bd77fe700 1 -- 172.21.15.84:0/235276916 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4633 (secure 0 0 0) 0x7f5bd8055860 con 0x7f5be01595a0 2023-10-06T03:00:08.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:08.114 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":73,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T03:00:06.696609+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7185,"mds_1":7182,"mds_2":6382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6382":{"gid":6382,"name":"d","rank":2,"incarnation":72,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7182":{"gid":7182,"name":"a","rank":1,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5bc0066f30 msgr2=0x7f5bc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5bc0066f30 0x7f5bc00693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0006d00 tx=0x7f5bd0016000 comp rx=0 tx=0).stop 2023-10-06T03:00:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 msgr2=0x7f5be0068400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 0x7f5be0068400 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009e90 tx=0x7f5bd800b040 comp rx=0 tx=0).stop 2023-10-06T03:00:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 shutdown_connections 2023-10-06T03:00:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5bc0066f30 0x7f5bc00693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be01595a0 0x7f5be0068400 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5be00b07a0 0x7f5be0157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 --2- 172.21.15.84:0/235276916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5be00b49e0 0x7f5be009ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 >> 172.21.15.84:0/235276916 conn(0x7f5be0099830 msgr2=0x7f5be00cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 shutdown_connections 2023-10-06T03:00:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:08.114+0000 7f5be54c0700 1 -- 172.21.15.84:0/235276916 wait complete. 2023-10-06T03:00:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 73 2023-10-06T03:00:08.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:08.128 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T03:00:08.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:08.151 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T03:00:08.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:08.210 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-10-06T03:00:08.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:08.265 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-10-06T03:00:08.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:08.320 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-10-06T03:00:08.376 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T03:00:08.547 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:00:08.547 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:08.547 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:10.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T03:00:10.688 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:00:10.689 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:10.689 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:12.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T03:00:12.831 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:00:12.831 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:12.832 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:14.833 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T03:00:14.975 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:00:14.975 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:14.975 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:16.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T03:00:17.119 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-10-06T03:00:17.120 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T03:00:17.120 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:17.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:00:17.251 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T03:00:17.251 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T03:00:17.252 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:00:19.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:00:19.396 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-10-06T03:00:19.397 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T03:00:19.397 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:00:21.399 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:00:21.542 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-10-06T03:00:21.543 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T03:00:21.543 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:00:21.544 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-10-06T03:00:21.687 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T03:00:21.688 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:21.688 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:00:21.688 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2023-10-06T03:00:21.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.805+0000 7f7b6d926700 1 Processor -- start 2023-10-06T03:00:21.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.805+0000 7f7b6d926700 1 -- start start 2023-10-06T03:00:21.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.805+0000 7f7b6d926700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680b2a90 0x7f7b680cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.805+0000 7f7b6d926700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680cbdf0 con 0x7f7b680cb980 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.805+0000 7f7b6d926700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680b2e60 con 0x7f7b680c6610 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.805+0000 7f7b6d926700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680cf5d0 con 0x7f7b680b2a90 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b667fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7b680cb980 0x7f7b680ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44888/0 (socket says 172.21.15.84:44888) 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b667fc700 1 -- 172.21.15.84:0/1558785876 learned_addr learned my addr 172.21.15.84:0/1558785876 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/1558785876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680b2a90 0x7f7b680cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b65ffb700 1 -- 172.21.15.84:0/1558785876 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200300435 0 0) 0x7f7b680cbdf0 con 0x7f7b680cb980 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b65ffb700 1 -- 172.21.15.84:0/1558785876 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b50003570 con 0x7f7b680cb980 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b65ffb700 1 -- 172.21.15.84:0/1558785876 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886377977 0 0) 0x7f7b680b2e60 con 0x7f7b680c6610 2023-10-06T03:00:21.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b65ffb700 1 -- 172.21.15.84:0/1558785876 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b680cbdf0 con 0x7f7b680c6610 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b66ffd700 1 -- 172.21.15.84:0/1558785876 >> v1:172.21.15.131:6789/0 conn(0x7f7b680c6610 legacy=0x7f7b681631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b66ffd700 1 -- 172.21.15.84:0/1558785876 >> v1:172.21.15.84:6789/0 conn(0x7f7b680cb980 legacy=0x7f7b680ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b66ffd700 1 -- 172.21.15.84:0/1558785876 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680cf8b0 con 0x7f7b680b2a90 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/1558785876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680b2a90 0x7f7b680cb440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009900 tx=0x7f7b58009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9310bc949358e2d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b65ffb700 1 -- 172.21.15.84:0/1558785876 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58005c10 con 0x7f7b680b2a90 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b65ffb700 1 -- 172.21.15.84:0/1558785876 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58005d70 con 0x7f7b680b2a90 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.806+0000 7f7b65ffb700 1 -- 172.21.15.84:0/1558785876 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58006260 con 0x7f7b680b2a90 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.807+0000 7f7b6d926700 1 -- 172.21.15.84:0/1558785876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680b2a90 msgr2=0x7f7b680cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.807+0000 7f7b6d926700 1 --2- 172.21.15.84:0/1558785876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680b2a90 0x7f7b680cb440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009900 tx=0x7f7b58009120 comp rx=0 tx=0).stop 2023-10-06T03:00:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.807+0000 7f7b6d926700 1 -- 172.21.15.84:0/1558785876 shutdown_connections 2023-10-06T03:00:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.807+0000 7f7b6d926700 1 --2- 172.21.15.84:0/1558785876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680b2a90 0x7f7b680cb440 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.807+0000 7f7b6d926700 1 -- 172.21.15.84:0/1558785876 >> 172.21.15.84:0/1558785876 conn(0x7f7b68099740 msgr2=0x7f7b6806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.807+0000 7f7b6d926700 1 -- 172.21.15.84:0/1558785876 shutdown_connections 2023-10-06T03:00:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.807+0000 7f7b6d926700 1 -- 172.21.15.84:0/1558785876 wait complete. 2023-10-06T03:00:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.808+0000 7f7b6d926700 1 Processor -- start 2023-10-06T03:00:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.808+0000 7f7b6d926700 1 -- start start 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b6d926700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b680b2a90 0x7f7b68156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b6d926700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b680c6610 0x7f7b680cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b6d926700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680cb980 0x7f7b680cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b6d926700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6815e0f0 con 0x7f7b680c6610 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b6d926700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6816dac0 con 0x7f7b680b2a90 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b6d926700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6809a930 con 0x7f7b680cb980 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b667fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b680c6610 0x7f7b680cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b667fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b680c6610 0x7f7b680cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53144/0 (socket says 172.21.15.84:53144) 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b667fc700 1 -- 172.21.15.84:0/890962735 learned_addr learned my addr 172.21.15.84:0/890962735 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b680b2a90 0x7f7b68156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b677fe700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680cb980 0x7f7b680cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b667fc700 1 -- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680cb980 msgr2=0x7f7b680cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b667fc700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680cb980 0x7f7b680cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b667fc700 1 -- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b680b2a90 msgr2=0x7f7b68156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b667fc700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b680b2a90 0x7f7b68156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b667fc700 1 -- 172.21.15.84:0/890962735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b580093c0 con 0x7f7b680c6610 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b680b2a90 0x7f7b68156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b677fe700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680cb980 0x7f7b680cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.809+0000 7f7b667fc700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b680c6610 0x7f7b680cd190 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c790 tx=0x7f7b5c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.810+0000 7f7b4effd700 1 -- 172.21.15.84:0/890962735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c005b30 con 0x7f7b680c6610 2023-10-06T03:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.810+0000 7f7b4effd700 1 -- 172.21.15.84:0/890962735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c005c90 con 0x7f7b680c6610 2023-10-06T03:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.810+0000 7f7b6d926700 1 -- 172.21.15.84:0/890962735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6816d7e0 con 0x7f7b680c6610 2023-10-06T03:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.810+0000 7f7b4effd700 1 -- 172.21.15.84:0/890962735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0072e0 con 0x7f7b680c6610 2023-10-06T03:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.810+0000 7f7b6d926700 1 -- 172.21.15.84:0/890962735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6809a5c0 con 0x7f7b680c6610 2023-10-06T03:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.811+0000 7f7b4effd700 1 -- 172.21.15.84:0/890962735 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b5c007690 con 0x7f7b680c6610 2023-10-06T03:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.812+0000 7f7b4effd700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7b54066f30 0x7f7b540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.812+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7b54066f30 0x7f7b540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.812+0000 7f7b4effd700 1 -- 172.21.15.84:0/890962735 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7b5c083c60 con 0x7f7b680c6610 2023-10-06T03:00:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.812+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7b54066f30 0x7f7b540693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009850 tx=0x7f7b58016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.813+0000 7f7b76c1eb80 1 Processor -- start 2023-10-06T03:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b76c1eb80 1 -- start start 2023-10-06T03:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 0x55f11b763c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b7b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11b6baac0 con 0x55f11b764d10 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11b6b82c0 con 0x55f11b7b3c50 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f11b6b40b0 con 0x55f11b763890 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b667fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b7b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b667fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b7b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53154/0 (socket says 172.21.15.84:53154) 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.814+0000 7f7b667fc700 1 -- 172.21.15.84:0/1017907023 learned_addr learned my addr 172.21.15.84:0/1017907023 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b677fe700 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 0x55f11b763c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b667fc700 1 -- 172.21.15.84:0/1017907023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 msgr2=0x55f11b763c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b667fc700 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 0x55f11b763c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b667fc700 1 -- 172.21.15.84:0/1017907023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 msgr2=0x55f11b7b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b667fc700 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b667fc700 1 -- 172.21.15.84:0/1017907023 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f11b54e2c0 con 0x55f11b764d10 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b677fe700 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b667fc700 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b7b3710 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c050e40 tx=0x7f7b5c081de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1b70c4c8a6392a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b47fff700 1 -- 172.21.15.84:0/1017907023 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c005e00 con 0x55f11b764d10 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b47fff700 1 -- 172.21.15.84:0/1017907023 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c069070 con 0x55f11b764d10 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.815+0000 7f7b47fff700 1 -- 172.21.15.84:0/1017907023 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c052a80 con 0x55f11b764d10 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1017907023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 msgr2=0x55f11b7b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b7b3710 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c050e40 tx=0x7f7b5c081de0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1017907023 shutdown_connections 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 0x55f11b763c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1017907023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b7b3710 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1017907023 >> 172.21.15.84:0/1017907023 conn(0x55f11b7651b0 msgr2=0x55f11b765580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1017907023 shutdown_connections 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1017907023 wait complete. 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 -- start start 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.816+0000 7f7b76c1eb80 1 Processor -- start 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 0x55f11b7a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b760170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11b65f8e0 con 0x55f11b764d10 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11b67aef0 con 0x55f11b7b3c50 2023-10-06T03:00:21.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f11b536e80 con 0x55f11b763890 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b76c1eb80 10 client.0 _ll_register_callbacks cb 0x55f11b726ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b667fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b760170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b667fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b760170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53164/0 (socket says 172.21.15.84:53164) 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b667fc700 1 -- 172.21.15.84:0/1558462785 learned_addr learned my addr 172.21.15.84:0/1558462785 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b677fe700 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.817+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 0x55f11b7a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b667fc700 1 -- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 msgr2=0x55f11b7a3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b667fc700 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 0x55f11b7a3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b667fc700 1 -- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 msgr2=0x55f11b7606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b667fc700 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b667fc700 1 -- 172.21.15.84:0/1558462785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6809a5c0 con 0x55f11b764d10 2023-10-06T03:00:21.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b677fe700 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 0x55f11b7a3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b667fc700 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b760170 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c054fa0 tx=0x7f7b5c06c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360983a17d1c6be9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b457fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b457fa700 1 -- 172.21.15.84:0/1558462785 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c007440 con 0x55f11b764d10 2023-10-06T03:00:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b457fa700 1 -- 172.21.15.84:0/1558462785 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7b5c05b3a0 con 0x55f11b764d10 2023-10-06T03:00:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1558462785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f11b758990 con 0x55f11b764d10 2023-10-06T03:00:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b457fa700 1 -- 172.21.15.84:0/1558462785 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b5c05b580 con 0x55f11b764d10 2023-10-06T03:00:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b76c1eb80 10 client.7431 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:21.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1558462785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55f11b4f1030 con 0x55f11b764d10 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b457fa700 1 -- 172.21.15.84:0/1558462785 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f11b758990 con 0x55f11b764d10 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b457fa700 1 -- 172.21.15.84:0/1558462785 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f7b5c070240 con 0x55f11b764d10 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b76c1eb80 10 client.7431 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b76c1eb80 10 client.7431 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b76c1eb80 20 client.7431 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55f11b78cd90 0x55f11b78ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b76c1eb80 4 client.7431 mds_command: new command op to 7185 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1558462785 --> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f11b7358c0 con 0x55f11b78cd90 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.818+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55f11b78cd90 0x55f11b78ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b457fa700 10 client.7431 ms_handle_connect on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:21.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55f11b78cd90 0x55f11b78ecd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=649e9bda3f9b4a78 server_cookie=5fea7d68b7f8f4e in_seq=0 out_seq=0 2023-10-06T03:00:21.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b457fa700 1 -- 172.21.15.84:0/1558462785 <== mds.0 v2:172.21.15.84:6835/2418120362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f11b7358c0 con 0x55f11b78cd90 2023-10-06T03:00:21.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b457fa700 10 client.7431 handle_command_reply: tid=0 2023-10-06T03:00:21.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 client.7431 shutdown 2023-10-06T03:00:21.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1558462785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 msgr2=0x55f11b760170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b760170 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c054fa0 tx=0x7f7b5c06c000 comp rx=0 tx=0).stop 2023-10-06T03:00:21.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1558462785 shutdown_connections 2023-10-06T03:00:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55f11b78cd90 0x55f11b78ecd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b7b3c50 0x55f11b7606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b763890 0x55f11b7a3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/1558462785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b764d10 0x55f11b760170 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b457fa700 0 client.7431 ms_handle_reset on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1558462785 >> 172.21.15.84:0/1558462785 conn(0x55f11b7651b0 msgr2=0x55f11b7a7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.819+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1558462785 shutdown_connections 2023-10-06T03:00:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.820+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/1558462785 wait complete. 2023-10-06T03:00:21.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.820+0000 7f7b76c1eb80 20 client.7431 trim_cache size 0 max 16384 2023-10-06T03:00:21.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.833+0000 7f7b76c1eb80 1 Processor -- start 2023-10-06T03:00:21.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.833+0000 7f7b76c1eb80 1 -- start start 2023-10-06T03:00:21.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b763890 0x55f11b7c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b764d10 0x55f11b7c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b7b3c50 0x55f11b75fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11b7a72f0 con 0x55f11b763890 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11b761260 con 0x55f11b764d10 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f11b7a4400 con 0x55f11b7b3c50 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b66ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b763890 0x55f11b7c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b66ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b763890 0x55f11b7c3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53178/0 (socket says 172.21.15.84:53178) 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b66ffd700 1 -- 172.21.15.84:0/3220487905 learned_addr learned my addr 172.21.15.84:0/3220487905 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b677fe700 1 --2- 172.21.15.84:0/3220487905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b7b3c50 0x55f11b75fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b667fc700 1 --2- 172.21.15.84:0/3220487905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b764d10 0x55f11b7c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b66ffd700 1 -- 172.21.15.84:0/3220487905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b7b3c50 msgr2=0x55f11b75fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/3220487905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b7b3c50 0x55f11b75fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b66ffd700 1 -- 172.21.15.84:0/3220487905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b764d10 msgr2=0x55f11b7c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/3220487905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b764d10 0x55f11b7c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b66ffd700 1 -- 172.21.15.84:0/3220487905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f11b6827d0 con 0x55f11b763890 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.834+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/3220487905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b763890 0x55f11b7c3910 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f7b68088fe0 tx=0x7f7b5802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d69ec49749c296 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b4cff9700 1 -- 172.21.15.84:0/3220487905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58021070 con 0x55f11b763890 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b4cff9700 1 -- 172.21.15.84:0/3220487905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58030040 con 0x55f11b763890 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b4cff9700 1 -- 172.21.15.84:0/3220487905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580068f0 con 0x55f11b763890 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3220487905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b763890 msgr2=0x55f11b7c3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3220487905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b763890 0x55f11b7c3910 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f7b68088fe0 tx=0x7f7b5802c040 comp rx=0 tx=0).stop 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3220487905 shutdown_connections 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3220487905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b7b3c50 0x55f11b75fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3220487905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b763890 0x55f11b7c3910 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3220487905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b764d10 0x55f11b7c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3220487905 >> 172.21.15.84:0/3220487905 conn(0x55f11b7651b0 msgr2=0x55f11b766cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:21.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3220487905 shutdown_connections 2023-10-06T03:00:21.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.835+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3220487905 wait complete. 2023-10-06T03:00:21.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.836+0000 7f7b76c1eb80 1 -- start start 2023-10-06T03:00:21.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.836+0000 7f7b76c1eb80 1 Processor -- start 2023-10-06T03:00:21.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b763890 0x55f11b7c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b764d10 0x55f11b7c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b7b3c50 0x55f11b7a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11b7a03a0 con 0x55f11b7b3c50 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f11b810b70 con 0x55f11b763890 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f11b810660 con 0x55f11b764d10 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 10 client.0 _ll_register_callbacks cb 0x55f11b726ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b7b3c50 0x55f11b7a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b7b3c50 0x55f11b7a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53184/0 (socket says 172.21.15.84:53184) 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b677fe700 1 -- 172.21.15.84:0/3851501843 learned_addr learned my addr 172.21.15.84:0/3851501843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:21.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b763890 0x55f11b7c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b667fc700 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b764d10 0x55f11b7c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b677fe700 1 -- 172.21.15.84:0/3851501843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b764d10 msgr2=0x55f11b7c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b677fe700 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b764d10 0x55f11b7c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b677fe700 1 -- 172.21.15.84:0/3851501843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b763890 msgr2=0x55f11b7c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b677fe700 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b763890 0x55f11b7c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b677fe700 1 -- 172.21.15.84:0/3851501843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b680cf8b0 con 0x55f11b7b3c50 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b677fe700 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b7b3c50 0x55f11b7a07f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f7b60013880 tx=0x7f7b60009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f84fce0aa13993 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b457fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b457fa700 1 -- 172.21.15.84:0/3851501843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60015690 con 0x55f11b7b3c50 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b457fa700 1 -- 172.21.15.84:0/3851501843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7b600157f0 con 0x55f11b7b3c50 2023-10-06T03:00:21.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3851501843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b5c069070 con 0x55f11b7b3c50 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b457fa700 1 -- 172.21.15.84:0/3851501843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b60003c30 con 0x55f11b7b3c50 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 10 client.7437 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.837+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3851501843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55f11b6694c0 con 0x55f11b7b3c50 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b457fa700 1 -- 172.21.15.84:0/3851501843 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c069070 con 0x55f11b7b3c50 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b457fa700 1 -- 172.21.15.84:0/3851501843 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f7b60015bc0 con 0x55f11b7b3c50 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b76c1eb80 10 client.7437 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b76c1eb80 10 client.7437 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b76c1eb80 20 client.7437 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55f11b80f490 0x55f11b7a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b76c1eb80 4 client.7437 mds_command: new command op to 7185 tid=0[{"prefix": "flush journal"}] 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3851501843 --> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f11b656e50 con 0x55f11b80f490 2023-10-06T03:00:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55f11b80f490 0x55f11b7a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b457fa700 10 client.7437 ms_handle_connect on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:21.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.838+0000 7f7b66ffd700 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55f11b80f490 0x55f11b7a0d30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e142dfa1d5c80261 server_cookie=4cd95149eb6bb2d1 in_seq=0 out_seq=0 2023-10-06T03:00:21.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.853+0000 7f7b457fa700 1 -- 172.21.15.84:0/3851501843 <== mds.0 v2:172.21.15.84:6835/2418120362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f11b656e50 con 0x55f11b80f490 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.853+0000 7f7b457fa700 10 client.7437 handle_command_reply: tid=0 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.853+0000 7f7b76c1eb80 1 client.7437 shutdown 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.853+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3851501843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b7b3c50 msgr2=0x55f11b7a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.853+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b7b3c50 0x55f11b7a07f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f7b60013880 tx=0x7f7b60009040 comp rx=0 tx=0).stop 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3851501843 shutdown_connections 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.84:6835/2418120362,v1:172.21.15.84:6837/2418120362] conn(0x55f11b80f490 0x55f11b7a0d30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f11b763890 0x55f11b7c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f11b7b3c50 0x55f11b7a07f0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b457fa700 0 client.7437 ms_handle_reset on v2:172.21.15.84:6835/2418120362 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b76c1eb80 1 --2- 172.21.15.84:0/3851501843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f11b764d10 0x55f11b7c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3851501843 >> 172.21.15.84:0/3851501843 conn(0x55f11b7651b0 msgr2=0x55f11b7a9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:21.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3851501843 shutdown_connections 2023-10-06T03:00:21.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b76c1eb80 1 -- 172.21.15.84:0/3851501843 wait complete. 2023-10-06T03:00:21.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b76c1eb80 20 client.7437 trim_cache size 0 max 16384 2023-10-06T03:00:21.856 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T03:00:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:00:21.856 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 -- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7b54066f30 msgr2=0x7f7b540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7b54066f30 0x7f7b540693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009850 tx=0x7f7b58016000 comp rx=0 tx=0).stop 2023-10-06T03:00:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 -- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b680c6610 msgr2=0x7f7b680cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b680c6610 0x7f7b680cd190 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c790 tx=0x7f7b5c007ea0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 -- 172.21.15.84:0/890962735 shutdown_connections 2023-10-06T03:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7b54066f30 0x7f7b540693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b680b2a90 0x7f7b68156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7b680cb980 0x7f7b680cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 --2- 172.21.15.84:0/890962735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b680c6610 0x7f7b680cd190 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 -- 172.21.15.84:0/890962735 >> 172.21.15.84:0/890962735 conn(0x7f7b68099740 msgr2=0x7f7b680b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:21.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 -- 172.21.15.84:0/890962735 shutdown_connections 2023-10-06T03:00:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.854+0000 7f7b6d926700 1 -- 172.21.15.84:0/890962735 wait complete. 2023-10-06T03:00:21.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:1 flush journal 2023-10-06T03:00:21.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.981+0000 7fa191ebd700 1 Processor -- start 2023-10-06T03:00:21.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.981+0000 7fa191ebd700 1 -- start start 2023-10-06T03:00:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.982+0000 7fa191ebd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa18c0c6610 0x7fa18c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.982+0000 7fa191ebd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18c0b2e60 con 0x7fa18c0b2a90 2023-10-06T03:00:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.982+0000 7fa191ebd700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18c0cf5d0 con 0x7fa18c0cbb50 2023-10-06T03:00:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.982+0000 7fa191ebd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c0cf8b0 con 0x7fa18c0c6610 2023-10-06T03:00:21.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.982+0000 7fa18b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa18c0b2a90 0x7fa18c0cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44898/0 (socket says 172.21.15.84:44898) 2023-10-06T03:00:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.982+0000 7fa18b7fe700 1 -- 172.21.15.84:0/4086076176 learned_addr learned my addr 172.21.15.84:0/4086076176 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18bfff700 1 --2- 172.21.15.84:0/4086076176 >> v2:172.21.15.131:3300/0 conn(0x7fa18c0c6610 0x7fa18c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217995503 0 0) 0x7fa18c0b2e60 con 0x7fa18c0b2a90 2023-10-06T03:00:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa174003570 con 0x7fa18c0b2a90 2023-10-06T03:00:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1018757213 0 0) 0x7fa174003570 con 0x7fa18c0b2a90 2023-10-06T03:00:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 >> v2:172.21.15.131:3300/0 conn(0x7fa18c0c6610 msgr2=0x7fa18c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 --2- 172.21.15.84:0/4086076176 >> v2:172.21.15.131:3300/0 conn(0x7fa18c0c6610 0x7fa18c0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 >> v1:172.21.15.131:6789/0 conn(0x7fa18c0cbb50 legacy=0x7fa18c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0cfb90 con 0x7fa18c0b2a90 2023-10-06T03:00:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fa17c001970 con 0x7fa18c0b2a90 2023-10-06T03:00:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 >> v1:172.21.15.84:6789/0 conn(0x7fa18c0b2a90 legacy=0x7fa18c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa174003a60 0x7fa174003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa174004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1740052e0 0x7fa17400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0cf8b0 con 0x7fa174004810 2023-10-06T03:00:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17400c2a0 con 0x7fa174003a60 2023-10-06T03:00:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17400c460 con 0x7fa1740052e0 2023-10-06T03:00:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18affd700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa174004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa174003a60 0x7fa174003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18bfff700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1740052e0 0x7fa17400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18affd700 1 -- 172.21.15.84:0/4086076176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1740052e0 msgr2=0x7fa17400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18affd700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa1740052e0 0x7fa17400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18affd700 1 -- 172.21.15.84:0/4086076176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa174003a60 msgr2=0x7fa174003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18affd700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa174003a60 0x7fa174003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18affd700 1 -- 172.21.15.84:0/4086076176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa174003570 con 0x7fa174004810 2023-10-06T03:00:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18bfff700 1 -- 172.21.15.84:0/4086076176 reap_dead start 2023-10-06T03:00:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa174003a60 0x7fa174003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:21.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.983+0000 7fa18affd700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa174004c80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa1800018b0 tx=0x7fa180007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9c792b6b3fbde8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180012420 con 0x7fa174004810 2023-10-06T03:00:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa180012580 con 0x7fa174004810 2023-10-06T03:00:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa18a7fc700 1 -- 172.21.15.84:0/4086076176 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180012920 con 0x7fa174004810 2023-10-06T03:00:21.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa191ebd700 1 -- 172.21.15.84:0/4086076176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 msgr2=0x7fa174004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa191ebd700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa174004c80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa1800018b0 tx=0x7fa180007d30 comp rx=0 tx=0).stop 2023-10-06T03:00:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa191ebd700 1 -- 172.21.15.84:0/4086076176 shutdown_connections 2023-10-06T03:00:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa191ebd700 1 --2- 172.21.15.84:0/4086076176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa174004c80 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa191ebd700 1 -- 172.21.15.84:0/4086076176 >> 172.21.15.84:0/4086076176 conn(0x7fa18c099740 msgr2=0x7fa18c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa191ebd700 1 -- 172.21.15.84:0/4086076176 shutdown_connections 2023-10-06T03:00:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.984+0000 7fa191ebd700 1 -- 172.21.15.84:0/4086076176 wait complete. 2023-10-06T03:00:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.985+0000 7fa191ebd700 1 Processor -- start 2023-10-06T03:00:21.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.985+0000 7fa191ebd700 1 -- start start 2023-10-06T03:00:22.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa191ebd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa18c144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa191ebd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa18c158310 0x7fa18c169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa191ebd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa18c0c86c0 0x7fa18c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa191ebd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0ca6f0 con 0x7fa174004810 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa191ebd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c16aa40 con 0x7fa18c0c86c0 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa191ebd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0c9070 con 0x7fa18c158310 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa18c144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa18c144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53204/0 (socket says 172.21.15.84:53204) 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18b7fe700 1 -- 172.21.15.84:0/409508052 learned_addr learned my addr 172.21.15.84:0/409508052 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18bfff700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa18c0c86c0 0x7fa18c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18affd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa18c158310 0x7fa18c169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18b7fe700 1 -- 172.21.15.84:0/409508052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa18c158310 msgr2=0x7fa18c169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa18c158310 0x7fa18c169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18b7fe700 1 -- 172.21.15.84:0/409508052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa18c0c86c0 msgr2=0x7fa18c0c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa18c0c86c0 0x7fa18c0c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18b7fe700 1 -- 172.21.15.84:0/409508052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c16d5b0 con 0x7fa174004810 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.986+0000 7fa18affd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa18c158310 0x7fa18c169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.987+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa18c144a00 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa17c001370 tx=0x7fa17c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.987+0000 7fa1737fe700 1 -- 172.21.15.84:0/409508052 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c005d80 con 0x7fa174004810 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.987+0000 7fa1737fe700 1 -- 172.21.15.84:0/409508052 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c00fa50 con 0x7fa174004810 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.987+0000 7fa191ebd700 1 -- 172.21.15.84:0/409508052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c144f40 con 0x7fa174004810 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.987+0000 7fa1737fe700 1 -- 172.21.15.84:0/409508052 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00fe10 con 0x7fa174004810 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.987+0000 7fa191ebd700 1 -- 172.21.15.84:0/409508052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c16a760 con 0x7fa174004810 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.988+0000 7fa1737fe700 1 -- 172.21.15.84:0/409508052 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa17c0072e0 con 0x7fa174004810 2023-10-06T03:00:22.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.988+0000 7fa1737fe700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa178066f30 0x7fa1780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.988+0000 7fa1737fe700 1 -- 172.21.15.84:0/409508052 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa17c084ea0 con 0x7fa174004810 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.989+0000 7fa18affd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa178066f30 0x7fa1780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.989+0000 7fa18affd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa178066f30 0x7fa1780693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa180001010 tx=0x7fa180015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.990+0000 7fa19b1b5b80 1 Processor -- start 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.991+0000 7fa19b1b5b80 1 -- start start 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 0x5633188edc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x56331893d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331893e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563318844ac0 con 0x56331893dc50 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633188422c0 con 0x5633188eed10 2023-10-06T03:00:22.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56331883e0b0 con 0x5633188ed890 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331893e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18b7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 0x5633188edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331893e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53218/0 (socket says 172.21.15.84:53218) 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x56331893d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18bfff700 1 -- 172.21.15.84:0/874691212 learned_addr learned my addr 172.21.15.84:0/874691212 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18bfff700 1 -- 172.21.15.84:0/874691212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 msgr2=0x5633188edc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18bfff700 1 --2- 172.21.15.84:0/874691212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 0x5633188edc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18bfff700 1 -- 172.21.15.84:0/874691212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 msgr2=0x56331893d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18bfff700 1 --2- 172.21.15.84:0/874691212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x56331893d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18bfff700 1 -- 172.21.15.84:0/874691212 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633186d82c0 con 0x56331893dc50 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/874691212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 0x5633188edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18affd700 1 --2- 172.21.15.84:0/874691212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x56331893d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa18bfff700 1 --2- 172.21.15.84:0/874691212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331893e0a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fa184006f00 tx=0x7fa184008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f61c3d539b71bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa170ff9700 1 -- 172.21.15.84:0/874691212 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184014970 con 0x56331893dc50 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa170ff9700 1 -- 172.21.15.84:0/874691212 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184014ad0 con 0x56331893dc50 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.992+0000 7fa170ff9700 1 -- 172.21.15.84:0/874691212 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184014e90 con 0x56331893dc50 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.993+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/874691212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 msgr2=0x56331893e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.993+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/874691212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331893e0a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fa184006f00 tx=0x7fa184008040 comp rx=0 tx=0).stop 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.993+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/874691212 shutdown_connections 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.993+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/874691212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331893e0a0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.993+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/874691212 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 0x5633188edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.993+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/874691212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x56331893d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.993+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/874691212 >> 172.21.15.84:0/874691212 conn(0x5633188ef1b0 msgr2=0x5633188ef580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.993+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/874691212 shutdown_connections 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.993+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/874691212 wait complete. 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.994+0000 7fa19b1b5b80 1 -- start start 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.994+0000 7fa19b1b5b80 1 Processor -- start 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.994+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188ed890 0x5633188e8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188eed10 0x56331892ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56331893dc50 0x56331892cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633187e98e0 con 0x5633188ed890 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563318804ef0 con 0x56331893dc50 2023-10-06T03:00:22.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633186c0e80 con 0x5633188eed10 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa19b1b5b80 10 client.0 _ll_register_callbacks cb 0x5633188b0ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188ed890 0x5633188e8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188ed890 0x5633188e8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53226/0 (socket says 172.21.15.84:53226) 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18b7fe700 1 -- 172.21.15.84:0/2762517607 learned_addr learned my addr 172.21.15.84:0/2762517607 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18affd700 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188eed10 0x56331892ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18bfff700 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56331893dc50 0x56331892cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18b7fe700 1 -- 172.21.15.84:0/2762517607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188eed10 msgr2=0x56331892ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188eed10 0x56331892ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18b7fe700 1 -- 172.21.15.84:0/2762517607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56331893dc50 msgr2=0x56331892cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56331893dc50 0x56331892cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18b7fe700 1 -- 172.21.15.84:0/2762517607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa174003570 con 0x5633188ed890 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18affd700 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188eed10 0x56331892ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188ed890 0x5633188e8ec0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fa17c055ac0 tx=0x7fa17c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ca399a31ef1f9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa169ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa169ffb700 1 -- 172.21.15.84:0/2762517607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c05cad0 con 0x5633188ed890 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa169ffb700 1 -- 172.21.15.84:0/2762517607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa17c055020 con 0x5633188ed890 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2762517607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633188e2990 con 0x5633188ed890 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa169ffb700 1 -- 172.21.15.84:0/2762517607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa17c05c640 con 0x5633188ed890 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa19b1b5b80 10 client.7449 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2762517607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x7fa1840098a0 con 0x5633188ed890 2023-10-06T03:00:22.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.995+0000 7fa169ffb700 1 -- 172.21.15.84:0/2762517607 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c060030 con 0x5633188ed890 2023-10-06T03:00:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa169ffb700 1 -- 172.21.15.84:0/2762517607 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fa17c05cd20 con 0x5633188ed890 2023-10-06T03:00:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa19b1b5b80 10 client.7449 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:22.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa19b1b5b80 10 client.7449 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.a 2023-10-06T03:00:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa19b1b5b80 20 client.7449 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x563318916de0 0x56331892d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa19b1b5b80 4 client.7449 mds_command: new command op to 7182 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2762517607 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633188bf8c0 con 0x563318916de0 2023-10-06T03:00:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa18affd700 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x563318916de0 0x56331892d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa169ffb700 10 client.7449 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa18affd700 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x563318916de0 0x56331892d4b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ea04e95728d6ba54 server_cookie=afa67130720b4ae2 in_seq=0 out_seq=0 2023-10-06T03:00:22.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa169ffb700 1 -- 172.21.15.84:0/2762517607 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5633188bf8c0 con 0x563318916de0 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.996+0000 7fa169ffb700 10 client.7449 handle_command_reply: tid=0 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 client.7449 shutdown 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2762517607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188ed890 msgr2=0x5633188e8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188ed890 0x5633188e8ec0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fa17c055ac0 tx=0x7fa17c005f90 comp rx=0 tx=0).stop 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2762517607 shutdown_connections 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x563318916de0 0x56331892d4b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56331893dc50 0x56331892cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa169ffb700 0 client.7449 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188ed890 0x5633188e8ec0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2762517607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188eed10 0x56331892ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2762517607 >> 172.21.15.84:0/2762517607 conn(0x5633188ef1b0 msgr2=0x5633188ee200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2762517607 shutdown_connections 2023-10-06T03:00:22.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2762517607 wait complete. 2023-10-06T03:00:22.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:21.997+0000 7fa19b1b5b80 20 client.7449 trim_cache size 0 max 16384 2023-10-06T03:00:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.010+0000 7fa19b1b5b80 1 Processor -- start 2023-10-06T03:00:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa19b1b5b80 1 -- start start 2023-10-06T03:00:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 0x5633188e8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x563318937460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331891bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633188f0d90 con 0x56331893dc50 2023-10-06T03:00:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633189318d0 con 0x5633188eed10 2023-10-06T03:00:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56331893e020 con 0x5633188ed890 2023-10-06T03:00:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa18bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331891bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa18bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331891bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53240/0 (socket says 172.21.15.84:53240) 2023-10-06T03:00:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.011+0000 7fa18bfff700 1 -- 172.21.15.84:0/2089620229 learned_addr learned my addr 172.21.15.84:0/2089620229 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa18affd700 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x563318937460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 0x5633188e8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa18bfff700 1 -- 172.21.15.84:0/2089620229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 msgr2=0x5633188e8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa18bfff700 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 0x5633188e8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa18bfff700 1 -- 172.21.15.84:0/2089620229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 msgr2=0x563318937460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa18bfff700 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x563318937460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa18bfff700 1 -- 172.21.15.84:0/2089620229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56331867b030 con 0x56331893dc50 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa18affd700 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x563318937460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa18bfff700 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331891bf30 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fa18401a000 tx=0x7fa18401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef53febd29c9c67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa1717fa700 1 -- 172.21.15.84:0/2089620229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184024050 con 0x56331893dc50 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa1717fa700 1 -- 172.21.15.84:0/2089620229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184025040 con 0x56331893dc50 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa1717fa700 1 -- 172.21.15.84:0/2089620229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184014e50 con 0x56331893dc50 2023-10-06T03:00:22.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2089620229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 msgr2=0x56331891bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331891bf30 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fa18401a000 tx=0x7fa18401e000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2089620229 shutdown_connections 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56331893dc50 0x56331891bf30 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633188ed890 0x5633188e8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/2089620229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188eed10 0x563318937460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2089620229 >> 172.21.15.84:0/2089620229 conn(0x5633188ef1b0 msgr2=0x5633188ee200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2089620229 shutdown_connections 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.012+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/2089620229 wait complete. 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.013+0000 7fa19b1b5b80 1 -- start start 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.013+0000 7fa19b1b5b80 1 Processor -- start 2023-10-06T03:00:22.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188ed890 0x563318999ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188eed10 0x56331899dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa19b1b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56331893dc50 0x56331899e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563318915fe0 con 0x5633188eed10 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331894e6b0 con 0x5633188ed890 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa19b1b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56331899d860 con 0x56331893dc50 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa19b1b5b80 10 client.0 _ll_register_callbacks cb 0x5633188b0ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188eed10 0x56331899dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188eed10 0x56331899dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53246/0 (socket says 172.21.15.84:53246) 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18affd700 1 -- 172.21.15.84:0/100100017 learned_addr learned my addr 172.21.15.84:0/100100017 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188ed890 0x563318999ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18bfff700 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56331893dc50 0x56331899e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18affd700 1 -- 172.21.15.84:0/100100017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56331893dc50 msgr2=0x56331899e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18affd700 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56331893dc50 0x56331899e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18affd700 1 -- 172.21.15.84:0/100100017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188ed890 msgr2=0x563318999ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18affd700 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188ed890 0x563318999ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18affd700 1 -- 172.21.15.84:0/100100017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633186d82c0 con 0x5633188eed10 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa18affd700 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188eed10 0x56331899dcf0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fa180012550 tx=0x7fa180022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf7b08734ef708b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa169ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa169ffb700 1 -- 172.21.15.84:0/100100017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180030040 con 0x5633188eed10 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa169ffb700 1 -- 172.21.15.84:0/100100017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa1800354f0 con 0x5633188eed10 2023-10-06T03:00:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.014+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/100100017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa184014ad0 con 0x5633188eed10 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa169ffb700 1 -- 172.21.15.84:0/100100017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1800358c0 con 0x5633188eed10 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa19b1b5b80 10 client.7455 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/100100017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x56331880c7d0 con 0x5633188eed10 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa169ffb700 1 -- 172.21.15.84:0/100100017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184014ad0 con 0x5633188eed10 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa169ffb700 1 -- 172.21.15.84:0/100100017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fa180035a20 con 0x5633188eed10 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa19b1b5b80 10 client.7455 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa19b1b5b80 10 client.7455 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.a 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa19b1b5b80 20 client.7455 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x5633188e9580 0x56331891bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa19b1b5b80 4 client.7455 mds_command: new command op to 7182 tid=0[{"prefix": "flush journal"}] 2023-10-06T03:00:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/100100017 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5633187e0e50 con 0x5633188e9580 2023-10-06T03:00:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x5633188e9580 0x56331891bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa169ffb700 10 client.7455 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.015+0000 7fa18b7fe700 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x5633188e9580 0x56331891bd60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=192b4f78f0303f72 server_cookie=59659d8d570055b3 in_seq=0 out_seq=0 2023-10-06T03:00:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa169ffb700 1 -- 172.21.15.84:0/100100017 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5633187e0e50 con 0x5633188e9580 2023-10-06T03:00:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa169ffb700 10 client.7455 handle_command_reply: tid=0 2023-10-06T03:00:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 client.7455 shutdown 2023-10-06T03:00:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/100100017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188eed10 msgr2=0x56331899dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188eed10 0x56331899dcf0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fa180012550 tx=0x7fa180022040 comp rx=0 tx=0).stop 2023-10-06T03:00:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/100100017 shutdown_connections 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x5633188e9580 0x56331891bd60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633188ed890 0x563318999ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa169ffb700 0 client.7455 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56331893dc50 0x56331899e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 --2- 172.21.15.84:0/100100017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633188eed10 0x56331899dcf0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/100100017 >> 172.21.15.84:0/100100017 conn(0x5633188ef1b0 msgr2=0x563318937460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/100100017 shutdown_connections 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 1 -- 172.21.15.84:0/100100017 wait complete. 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa19b1b5b80 20 client.7455 trim_cache size 0 max 16384 2023-10-06T03:00:22.031 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T03:00:22.032 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:00:22.032 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa191ebd700 1 -- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa178066f30 msgr2=0x7fa1780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa191ebd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa178066f30 0x7fa1780693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa180001010 tx=0x7fa180015000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa191ebd700 1 -- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 msgr2=0x7fa18c144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.029+0000 7fa191ebd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa18c144a00 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa17c001370 tx=0x7fa17c009040 comp rx=0 tx=0).stop 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.030+0000 7fa191ebd700 1 -- 172.21.15.84:0/409508052 shutdown_connections 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.030+0000 7fa191ebd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa178066f30 0x7fa1780693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.030+0000 7fa191ebd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa18c0c86c0 0x7fa18c0c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.030+0000 7fa191ebd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa174004810 0x7fa18c144a00 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.030+0000 7fa191ebd700 1 --2- 172.21.15.84:0/409508052 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa18c158310 0x7fa18c169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.030+0000 7fa191ebd700 1 -- 172.21.15.84:0/409508052 >> 172.21.15.84:0/409508052 conn(0x7fa18c099740 msgr2=0x7fa18c0d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.030+0000 7fa191ebd700 1 -- 172.21.15.84:0/409508052 shutdown_connections 2023-10-06T03:00:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.030+0000 7fa191ebd700 1 -- 172.21.15.84:0/409508052 wait complete. 2023-10-06T03:00:22.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:2 flush journal 2023-10-06T03:00:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.157+0000 7f26ece89700 1 Processor -- start 2023-10-06T03:00:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.157+0000 7f26ece89700 1 -- start start 2023-10-06T03:00:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.158+0000 7f26ece89700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f26e80cbb50 0x7f26e80ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.158+0000 7f26ece89700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e80b2e60 con 0x7f26e80b2a90 2023-10-06T03:00:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.158+0000 7f26ece89700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e80cf5d0 con 0x7f26e80c6610 2023-10-06T03:00:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.158+0000 7f26ece89700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e80cf8b0 con 0x7f26e80cbb50 2023-10-06T03:00:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.158+0000 7f26e659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26e80b2a90 0x7f26e80cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44902/0 (socket says 172.21.15.84:44902) 2023-10-06T03:00:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.158+0000 7f26e659c700 1 -- 172.21.15.84:0/832029890 learned_addr learned my addr 172.21.15.84:0/832029890 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/832029890 >> v2:172.21.15.131:3300/0 conn(0x7f26e80cbb50 0x7f26e80ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758077634 0 0) 0x7f26e80b2e60 con 0x7f26e80b2a90 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d4003570 con 0x7f26e80b2a90 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324311566 0 0) 0x7f26e80cf5d0 con 0x7f26e80c6610 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e80b2e60 con 0x7f26e80c6610 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3645265964 0 0) 0x7f26d4003570 con 0x7f26e80b2a90 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 >> v2:172.21.15.131:3300/0 conn(0x7f26e80cbb50 msgr2=0x7f26e80ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 --2- 172.21.15.84:0/832029890 >> v2:172.21.15.131:3300/0 conn(0x7f26e80cbb50 0x7f26e80ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 >> v1:172.21.15.131:6789/0 conn(0x7f26e80c6610 legacy=0x7f26e80ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e80cfb90 con 0x7f26e80b2a90 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f26d80015f0 con 0x7f26e80b2a90 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 >> v1:172.21.15.84:6789/0 conn(0x7f26e80b2a90 legacy=0x7f26e80cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d4003c40 0x7f26d4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26d4004810 0x7f26d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d4005280 0x7f26d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80cf8b0 con 0x7f26d4005280 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d400c250 con 0x7f26d4003c40 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d400c410 con 0x7f26d4004810 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d4005280 0x7f26d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e659c700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d4003c40 0x7f26d4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26d4004810 0x7f26d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e6d9d700 1 -- 172.21.15.84:0/832029890 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26d4004810 msgr2=0x7f26d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26d4004810 0x7f26d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e6d9d700 1 -- 172.21.15.84:0/832029890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d4003c40 msgr2=0x7f26d4004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d4003c40 0x7f26d4004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e6d9d700 1 -- 172.21.15.84:0/832029890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d4003570 con 0x7f26d4005280 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.159+0000 7f26e6d9d700 1 -- 172.21.15.84:0/832029890 reap_dead start 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d4005280 0x7f26d400ba60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f26e0002120 tx=0x7f26e00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ff20b7417eb640 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000c980 con 0x7f26d4005280 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e000cae0 con 0x7f26d4005280 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26e5d9b700 1 -- 172.21.15.84:0/832029890 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000ce80 con 0x7f26d4005280 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26ece89700 1 -- 172.21.15.84:0/832029890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d4005280 msgr2=0x7f26d400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26ece89700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d4005280 0x7f26d400ba60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f26e0002120 tx=0x7f26e00017a0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26ece89700 1 -- 172.21.15.84:0/832029890 shutdown_connections 2023-10-06T03:00:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26ece89700 1 --2- 172.21.15.84:0/832029890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26d4005280 0x7f26d400ba60 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26ece89700 1 -- 172.21.15.84:0/832029890 >> 172.21.15.84:0/832029890 conn(0x7f26e8099740 msgr2=0x7f26e806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26ece89700 1 -- 172.21.15.84:0/832029890 shutdown_connections 2023-10-06T03:00:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.160+0000 7f26ece89700 1 -- 172.21.15.84:0/832029890 wait complete. 2023-10-06T03:00:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.161+0000 7f26ece89700 1 Processor -- start 2023-10-06T03:00:22.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26ece89700 1 -- start start 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26ece89700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d4005280 0x7f26e815d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26ece89700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e8158550 0x7f26e80c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26ece89700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80ca120 0x7f26e80ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26ece89700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80caad0 con 0x7f26e80ca120 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26ece89700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e80c9ee0 con 0x7f26d4005280 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26ece89700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e81589c0 con 0x7f26e8158550 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26e6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80ca120 0x7f26e80ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26e6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80ca120 0x7f26e80ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53260/0 (socket says 172.21.15.84:53260) 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26e6d9d700 1 -- 172.21.15.84:0/1664875843 learned_addr learned my addr 172.21.15.84:0/1664875843 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26e659c700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d4005280 0x7f26e815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.162+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e8158550 0x7f26e80c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26e6d9d700 1 -- 172.21.15.84:0/1664875843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e8158550 msgr2=0x7f26e80c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e8158550 0x7f26e80c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26e6d9d700 1 -- 172.21.15.84:0/1664875843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d4005280 msgr2=0x7f26e815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d4005280 0x7f26e815d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26e6d9d700 1 -- 172.21.15.84:0/1664875843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e815dd60 con 0x7f26e80ca120 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80ca120 0x7f26e80ca590 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f26e8088840 tx=0x7f26e0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26deffd700 1 -- 172.21.15.84:0/1664875843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000c980 con 0x7f26e80ca120 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26deffd700 1 -- 172.21.15.84:0/1664875843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e000c6d0 con 0x7f26e80ca120 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26ece89700 1 -- 172.21.15.84:0/1664875843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e815e040 con 0x7f26e80ca120 2023-10-06T03:00:22.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26deffd700 1 -- 172.21.15.84:0/1664875843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e0006df0 con 0x7f26e80ca120 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.163+0000 7f26ece89700 1 -- 172.21.15.84:0/1664875843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e815e600 con 0x7f26e80ca120 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.164+0000 7f26deffd700 1 -- 172.21.15.84:0/1664875843 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26e0019070 con 0x7f26e80ca120 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.165+0000 7f26deffd700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26c8066f30 0x7f26c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.165+0000 7f26deffd700 1 -- 172.21.15.84:0/1664875843 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f26e0085680 con 0x7f26e80ca120 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.165+0000 7f26e659c700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26c8066f30 0x7f26c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.165+0000 7f26e659c700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26c8066f30 0x7f26c80693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f26d8000e50 tx=0x7f26d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.167+0000 7f26f6181b80 1 Processor -- start 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.167+0000 7f26f6181b80 1 -- start start 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.167+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59893c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.167+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 0x564b598943b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.167+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59894d10 0x564b598d9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26f6181b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b597eaac0 con 0x564b59893890 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26f6181b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b597e82c0 con 0x564b598d1570 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26f6181b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b597e40b0 con 0x564b59894d10 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59893c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59893c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53272/0 (socket says 172.21.15.84:53272) 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e659c700 1 -- 172.21.15.84:0/2792203395 learned_addr learned my addr 172.21.15.84:0/2792203395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/2792203395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59894d10 0x564b598d9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/2792203395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 0x564b598943b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e659c700 1 -- 172.21.15.84:0/2792203395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59894d10 msgr2=0x564b598d9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e659c700 1 --2- 172.21.15.84:0/2792203395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59894d10 0x564b598d9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e659c700 1 -- 172.21.15.84:0/2792203395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 msgr2=0x564b598943b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e659c700 1 --2- 172.21.15.84:0/2792203395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 0x564b598943b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e659c700 1 -- 172.21.15.84:0/2792203395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b5967e2c0 con 0x564b59893890 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26e659c700 1 --2- 172.21.15.84:0/2792203395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59893c60 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f26d8012b00 tx=0x7f26d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21aacf05a3504dec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26c77fe700 1 -- 172.21.15.84:0/2792203395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d80126f0 con 0x564b59893890 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26c77fe700 1 -- 172.21.15.84:0/2792203395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8015ae0 con 0x564b59893890 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.168+0000 7f26c77fe700 1 -- 172.21.15.84:0/2792203395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8015e80 con 0x564b59893890 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.169+0000 7f26f6181b80 1 -- 172.21.15.84:0/2792203395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 msgr2=0x564b59893c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.169+0000 7f26f6181b80 1 --2- 172.21.15.84:0/2792203395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59893c60 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f26d8012b00 tx=0x7f26d8018000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.169+0000 7f26f6181b80 1 -- 172.21.15.84:0/2792203395 shutdown_connections 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.169+0000 7f26f6181b80 1 --2- 172.21.15.84:0/2792203395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59894d10 0x564b598d9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.169+0000 7f26f6181b80 1 --2- 172.21.15.84:0/2792203395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59893c60 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.169+0000 7f26f6181b80 1 --2- 172.21.15.84:0/2792203395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 0x564b598943b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.169+0000 7f26f6181b80 1 -- 172.21.15.84:0/2792203395 >> 172.21.15.84:0/2792203395 conn(0x564b598951b0 msgr2=0x564b59895580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.169+0000 7f26f6181b80 1 -- 172.21.15.84:0/2792203395 shutdown_connections 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.169+0000 7f26f6181b80 1 -- 172.21.15.84:0/2792203395 wait complete. 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.170+0000 7f26f6181b80 1 -- start start 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.170+0000 7f26f6181b80 1 Processor -- start 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59893890 0x564b598da970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 0x564b598d5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26f6181b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b5978f8e0 con 0x564b59894d10 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26f6181b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b597aaef0 con 0x564b598d1570 2023-10-06T03:00:22.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26f6181b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b59666e80 con 0x564b59893890 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26f6181b80 10 client.0 _ll_register_callbacks cb 0x564b59856ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26ddd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26ddd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53282/0 (socket says 172.21.15.84:53282) 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26ddd9b700 1 -- 172.21.15.84:0/3410823773 learned_addr learned my addr 172.21.15.84:0/3410823773 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26e659c700 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59893890 0x564b598da970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 0x564b598d5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26ddd9b700 1 -- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59893890 msgr2=0x564b598da970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59893890 0x564b598da970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26ddd9b700 1 -- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 msgr2=0x564b598d5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 0x564b598d5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26ddd9b700 1 -- 172.21.15.84:0/3410823773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e80cfb90 con 0x564b59894d10 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 0x564b598d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d5010 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f26d0017a70 tx=0x7f26d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9ddd5ad9eaeda1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26c4ff9700 1 -- 172.21.15.84:0/3410823773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d00156a0 con 0x564b59894d10 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26c4ff9700 1 -- 172.21.15.84:0/3410823773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f26d0015800 con 0x564b59894d10 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.171+0000 7f26f6181b80 1 -- 172.21.15.84:0/3410823773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b59888990 con 0x564b59894d10 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26c4ff9700 1 -- 172.21.15.84:0/3410823773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26d0015bd0 con 0x564b59894d10 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26f6181b80 10 client.7467 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26f6181b80 1 -- 172.21.15.84:0/3410823773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x564b59621030 con 0x564b59894d10 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26c4ff9700 1 -- 172.21.15.84:0/3410823773 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b59888990 con 0x564b59894d10 2023-10-06T03:00:22.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26c4ff9700 1 -- 172.21.15.84:0/3410823773 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f26d0015d30 con 0x564b59894d10 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26f6181b80 10 client.7467 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26f6181b80 10 client.7467 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.d 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26f6181b80 20 client.7467 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x564b598c0f70 0x564b598d7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26f6181b80 4 client.7467 mds_command: new command op to 6382 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26f6181b80 1 -- 172.21.15.84:0/3410823773 --> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b598658c0 con 0x564b598c0f70 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26e659c700 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x564b598c0f70 0x564b598d7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26c4ff9700 10 client.7467 ms_handle_connect on v2:172.21.15.131:6833/1887986838 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.172+0000 7f26e659c700 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x564b598c0f70 0x564b598d7510 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=994370e5d046bd3d server_cookie=22c7bf1d4489bc5b in_seq=0 out_seq=0 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26c4ff9700 1 -- 172.21.15.84:0/3410823773 <== mds.2 v2:172.21.15.131:6833/1887986838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564b598658c0 con 0x564b598c0f70 2023-10-06T03:00:22.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26c4ff9700 10 client.7467 handle_command_reply: tid=0 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 client.7467 shutdown 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 -- 172.21.15.84:0/3410823773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 msgr2=0x564b598d5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d5010 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f26d0017a70 tx=0x7f26d0008040 comp rx=0 tx=0).stop 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 -- 172.21.15.84:0/3410823773 shutdown_connections 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x564b598c0f70 0x564b598d7510 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b598d1570 0x564b598d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26c4ff9700 0 client.7467 ms_handle_reset on v2:172.21.15.131:6833/1887986838 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b59893890 0x564b598da970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3410823773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d5010 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 -- 172.21.15.84:0/3410823773 >> 172.21.15.84:0/3410823773 conn(0x564b598951b0 msgr2=0x564b598d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 -- 172.21.15.84:0/3410823773 shutdown_connections 2023-10-06T03:00:22.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.173+0000 7f26f6181b80 1 -- 172.21.15.84:0/3410823773 wait complete. 2023-10-06T03:00:22.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.174+0000 7f26f6181b80 20 client.7467 trim_cache size 0 max 16384 2023-10-06T03:00:22.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.187+0000 7f26f6181b80 1 Processor -- start 2023-10-06T03:00:22.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.187+0000 7f26f6181b80 1 -- start start 2023-10-06T03:00:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59895750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59894d10 0x564b598be3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 0x564b598be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26f6181b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b5988e670 con 0x564b59893890 2023-10-06T03:00:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26f6181b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b598927e0 con 0x564b59894d10 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26f6181b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b598f2330 con 0x564b598c0f70 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59895750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59895750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53296/0 (socket says 172.21.15.84:53296) 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e659c700 1 -- 172.21.15.84:0/3610624197 learned_addr learned my addr 172.21.15.84:0/3610624197 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/3610624197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59894d10 0x564b598be3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/3610624197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 0x564b598be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e659c700 1 -- 172.21.15.84:0/3610624197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 msgr2=0x564b598be8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e659c700 1 --2- 172.21.15.84:0/3610624197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 0x564b598be8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e659c700 1 -- 172.21.15.84:0/3610624197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59894d10 msgr2=0x564b598be3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e659c700 1 --2- 172.21.15.84:0/3610624197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59894d10 0x564b598be3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e659c700 1 -- 172.21.15.84:0/3610624197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b597b27d0 con 0x564b59893890 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.188+0000 7f26e659c700 1 --2- 172.21.15.84:0/3610624197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59895750 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f26d8002d40 tx=0x7f26d8034250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cd4ba2e30fa59b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26c7fff700 1 -- 172.21.15.84:0/3610624197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8015d70 con 0x564b59893890 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26c7fff700 1 -- 172.21.15.84:0/3610624197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8033040 con 0x564b59893890 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26c7fff700 1 -- 172.21.15.84:0/3610624197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8001ac0 con 0x564b59893890 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26f6181b80 1 -- 172.21.15.84:0/3610624197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 msgr2=0x564b59895750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3610624197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59895750 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f26d8002d40 tx=0x7f26d8034250 comp rx=0 tx=0).stop 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26f6181b80 1 -- 172.21.15.84:0/3610624197 shutdown_connections 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3610624197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 0x564b598be8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3610624197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59893890 0x564b59895750 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26f6181b80 1 --2- 172.21.15.84:0/3610624197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59894d10 0x564b598be3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26f6181b80 1 -- 172.21.15.84:0/3610624197 >> 172.21.15.84:0/3610624197 conn(0x564b598951b0 msgr2=0x564b5988c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26f6181b80 1 -- 172.21.15.84:0/3610624197 shutdown_connections 2023-10-06T03:00:22.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.189+0000 7f26f6181b80 1 -- 172.21.15.84:0/3610624197 wait complete. 2023-10-06T03:00:22.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.190+0000 7f26f6181b80 1 -- start start 2023-10-06T03:00:22.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.190+0000 7f26f6181b80 1 Processor -- start 2023-10-06T03:00:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59893890 0x564b598d8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26f6181b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 0x564b598f4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26f6181b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b59949060 con 0x564b59894d10 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26f6181b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b598c2780 con 0x564b59893890 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26f6181b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b598c35e0 con 0x564b598c0f70 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26f6181b80 10 client.0 _ll_register_callbacks cb 0x564b59856ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26ddd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26ddd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53302/0 (socket says 172.21.15.84:53302) 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26ddd9b700 1 -- 172.21.15.84:0/832599995 learned_addr learned my addr 172.21.15.84:0/832599995 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26e659c700 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59893890 0x564b598d8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26e6d9d700 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 0x564b598f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26ddd9b700 1 -- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 msgr2=0x564b598f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 0x564b598f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26ddd9b700 1 -- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59893890 msgr2=0x564b598d8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59893890 0x564b598d8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26ddd9b700 1 -- 172.21.15.84:0/832599995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b5967e2c0 con 0x564b59894d10 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26ddd9b700 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d88b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f26d0017e80 tx=0x7f26d001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167615246af422be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26c4ff9700 1 -- 172.21.15.84:0/832599995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0015bd0 con 0x564b59894d10 2023-10-06T03:00:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26c4ff9700 1 -- 172.21.15.84:0/832599995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f26d002fd50 con 0x564b59894d10 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.191+0000 7f26f6181b80 1 -- 172.21.15.84:0/832599995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26d8015ae0 con 0x564b59894d10 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26c4ff9700 1 -- 172.21.15.84:0/832599995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26d0013b70 con 0x564b59894d10 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26f6181b80 10 client.7473 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26f6181b80 1 -- 172.21.15.84:0/832599995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x564b597994c0 con 0x564b59894d10 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26c4ff9700 1 -- 172.21.15.84:0/832599995 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8015ae0 con 0x564b59894d10 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26c4ff9700 1 -- 172.21.15.84:0/832599995 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f26d0013cd0 con 0x564b59894d10 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26f6181b80 10 client.7473 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26f6181b80 10 client.7473 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.d 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26f6181b80 20 client.7473 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26f6181b80 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x564b598d1570 0x564b598f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26f6181b80 4 client.7473 mds_command: new command op to 6382 tid=0[{"prefix": "flush journal"}] 2023-10-06T03:00:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26f6181b80 1 -- 172.21.15.84:0/832599995 --> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564b59786e50 con 0x564b598d1570 2023-10-06T03:00:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26e659c700 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x564b598d1570 0x564b598f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26c4ff9700 10 client.7473 ms_handle_connect on v2:172.21.15.131:6833/1887986838 2023-10-06T03:00:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.192+0000 7f26e659c700 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x564b598d1570 0x564b598f4b60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cefe258fe2b47a6 server_cookie=e872e047f9fd6d62 in_seq=0 out_seq=0 2023-10-06T03:00:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26c4ff9700 1 -- 172.21.15.84:0/832599995 <== mds.2 v2:172.21.15.131:6833/1887986838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564b59786e50 con 0x564b598d1570 2023-10-06T03:00:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26c4ff9700 10 client.7473 handle_command_reply: tid=0 2023-10-06T03:00:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 client.7473 shutdown 2023-10-06T03:00:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 -- 172.21.15.84:0/832599995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 msgr2=0x564b598d88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d88b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f26d0017e80 tx=0x7f26d001d000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 -- 172.21.15.84:0/832599995 shutdown_connections 2023-10-06T03:00:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:6833/1887986838,v1:172.21.15.131:6835/1887986838] conn(0x564b598d1570 0x564b598f4b60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b59893890 0x564b598d8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26c4ff9700 0 client.7473 ms_handle_reset on v2:172.21.15.131:6833/1887986838 2023-10-06T03:00:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564b598c0f70 0x564b598f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 --2- 172.21.15.84:0/832599995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b59894d10 0x564b598d88b0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 -- 172.21.15.84:0/832599995 >> 172.21.15.84:0/832599995 conn(0x564b598951b0 msgr2=0x564b598d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 -- 172.21.15.84:0/832599995 shutdown_connections 2023-10-06T03:00:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 1 -- 172.21.15.84:0/832599995 wait complete. 2023-10-06T03:00:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26f6181b80 20 client.7473 trim_cache size 0 max 16384 2023-10-06T03:00:22.209 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:22.209 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T03:00:22.210 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:00:22.210 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26ece89700 1 -- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26c8066f30 msgr2=0x7f26c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26ece89700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26c8066f30 0x7f26c80693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f26d8000e50 tx=0x7f26d8009040 comp rx=0 tx=0).stop 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26ece89700 1 -- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80ca120 msgr2=0x7f26e80ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26ece89700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80ca120 0x7f26e80ca590 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f26e8088840 tx=0x7f26e0015000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.207+0000 7f26ece89700 1 -- 172.21.15.84:0/1664875843 shutdown_connections 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.208+0000 7f26ece89700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26c8066f30 0x7f26c80693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.208+0000 7f26ece89700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26d4005280 0x7f26e815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.208+0000 7f26ece89700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e80ca120 0x7f26e80ca590 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.208+0000 7f26ece89700 1 --2- 172.21.15.84:0/1664875843 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26e8158550 0x7f26e80c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.208+0000 7f26ece89700 1 -- 172.21.15.84:0/1664875843 >> 172.21.15.84:0/1664875843 conn(0x7f26e8099740 msgr2=0x7f26e8158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.208+0000 7f26ece89700 1 -- 172.21.15.84:0/1664875843 shutdown_connections 2023-10-06T03:00:22.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.208+0000 7f26ece89700 1 -- 172.21.15.84:0/1664875843 wait complete. 2023-10-06T03:00:22.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:22.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.333+0000 7fc2ffa4b700 1 Processor -- start 2023-10-06T03:00:22.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.333+0000 7fc2ffa4b700 1 -- start start 2023-10-06T03:00:22.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2ffa4b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2f8156540 0x7fc2f80c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2ffa4b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc2f806eda0 0x7fc2f80ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2ffa4b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80acd60 con 0x7fc2f80c75b0 2023-10-06T03:00:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2ffa4b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f806f470 con 0x7fc2f8156540 2023-10-06T03:00:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2ffa4b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f8156910 con 0x7fc2f806eda0 2023-10-06T03:00:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2fcfe6700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc2f80c75b0 0x7fc2f806e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42314/0 (socket says 172.21.15.84:42314) 2023-10-06T03:00:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2fcfe6700 1 -- 172.21.15.84:0/614213135 learned_addr learned my addr 172.21.15.84:0/614213135 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2fd7e7700 1 --2- 172.21.15.84:0/614213135 >> v2:172.21.15.84:3300/0 conn(0x7fc2f8156540 0x7fc2f80c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2effff700 1 -- 172.21.15.84:0/614213135 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199668256 0 0) 0x7fc2f80acd60 con 0x7fc2f80c75b0 2023-10-06T03:00:22.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2fdfe8700 1 --2- 172.21.15.84:0/614213135 >> v2:172.21.15.131:3300/0 conn(0x7fc2f806eda0 0x7fc2f80ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.334+0000 7fc2effff700 1 -- 172.21.15.84:0/614213135 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e4003570 con 0x7fc2f80c75b0 2023-10-06T03:00:22.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2fd7e7700 1 -- 172.21.15.84:0/614213135 >> v2:172.21.15.131:3300/0 conn(0x7fc2f806eda0 msgr2=0x7fc2f80ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2fd7e7700 1 --2- 172.21.15.84:0/614213135 >> v2:172.21.15.131:3300/0 conn(0x7fc2f806eda0 0x7fc2f80ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2fd7e7700 1 -- 172.21.15.84:0/614213135 >> v1:172.21.15.84:6789/0 conn(0x7fc2f80c75b0 legacy=0x7fc2f806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2fd7e7700 1 -- 172.21.15.84:0/614213135 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80c7b70 con 0x7fc2f8156540 2023-10-06T03:00:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2fd7e7700 1 --2- 172.21.15.84:0/614213135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 0x7fc2f80c7070 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80c6650 tx=0x7fc2f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f848c7f1041d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2effff700 1 -- 172.21.15.84:0/614213135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400e070 con 0x7fc2f8156540 2023-10-06T03:00:22.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2effff700 1 -- 172.21.15.84:0/614213135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400bb60 con 0x7fc2f8156540 2023-10-06T03:00:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2effff700 1 -- 172.21.15.84:0/614213135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4012430 con 0x7fc2f8156540 2023-10-06T03:00:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/614213135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 msgr2=0x7fc2f80c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2ffa4b700 1 --2- 172.21.15.84:0/614213135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 0x7fc2f80c7070 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80c6650 tx=0x7fc2f4009780 comp rx=0 tx=0).stop 2023-10-06T03:00:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/614213135 shutdown_connections 2023-10-06T03:00:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2ffa4b700 1 --2- 172.21.15.84:0/614213135 >> v2:172.21.15.131:3300/0 conn(0x7fc2f806eda0 0x7fc2f80ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2ffa4b700 1 --2- 172.21.15.84:0/614213135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 0x7fc2f80c7070 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.335+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/614213135 >> 172.21.15.84:0/614213135 conn(0x7fc2f80680c0 msgr2=0x7fc2f80cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.336+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/614213135 shutdown_connections 2023-10-06T03:00:22.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.336+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/614213135 wait complete. 2023-10-06T03:00:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.337+0000 7fc2ffa4b700 1 Processor -- start 2023-10-06T03:00:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.337+0000 7fc2ffa4b700 1 -- start start 2023-10-06T03:00:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ffa4b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f806eda0 0x7fc2f8151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ffa4b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80c75b0 0x7fc2f81668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ffa4b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 0x7fc2f80c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ffa4b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f81677f0 con 0x7fc2f8156540 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ffa4b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80c35d0 con 0x7fc2f806eda0 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ffa4b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8167230 con 0x7fc2f80c75b0 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fdfe8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 0x7fc2f80c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fdfe8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 0x7fc2f80c3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51638/0 (socket says 172.21.15.84:51638) 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fdfe8700 1 -- 172.21.15.84:0/4177343727 learned_addr learned my addr 172.21.15.84:0/4177343727 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fd7e7700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f806eda0 0x7fc2f8151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fcfe6700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80c75b0 0x7fc2f81668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fdfe8700 1 -- 172.21.15.84:0/4177343727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80c75b0 msgr2=0x7fc2f81668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fdfe8700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80c75b0 0x7fc2f81668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fdfe8700 1 -- 172.21.15.84:0/4177343727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f806eda0 msgr2=0x7fc2f8151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fdfe8700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f806eda0 0x7fc2f8151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fdfe8700 1 -- 172.21.15.84:0/4177343727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4009a20 con 0x7fc2f8156540 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2fdfe8700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 0x7fc2f80c3a60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000fc20 tx=0x7fc2f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ed7fa700 1 -- 172.21.15.84:0/4177343727 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f00078f0 con 0x7fc2f8156540 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ed7fa700 1 -- 172.21.15.84:0/4177343727 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f0007a50 con 0x7fc2f8156540 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f8167510 con 0x7fc2f8156540 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ed7fa700 1 -- 172.21.15.84:0/4177343727 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0007e10 con 0x7fc2f8156540 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.338+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f8152120 con 0x7fc2f8156540 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.339+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f8064ad0 con 0x7fc2f8156540 2023-10-06T03:00:22.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.340+0000 7fc2ed7fa700 1 -- 172.21.15.84:0/4177343727 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2f0011660 con 0x7fc2f8156540 2023-10-06T03:00:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.340+0000 7fc2ed7fa700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.340+0000 7fc2ed7fa700 1 -- 172.21.15.84:0/4177343727 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc2f0086eb0 con 0x7fc2f8156540 2023-10-06T03:00:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.340+0000 7fc2fd7e7700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.341+0000 7fc2fd7e7700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40097c0 tx=0x7fc2f4019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.344+0000 7fc2ed7fa700 1 -- 172.21.15.84:0/4177343727 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2f0057910 con 0x7fc2f8156540 2023-10-06T03:00:22.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.567+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2f80c7e50 con 0x7fc2f8156540 2023-10-06T03:00:22.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.568+0000 7fc2ed7fa700 1 -- 172.21.15.84:0/4177343727 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4637 (secure 0 0 0) 0x7fc2f00574a0 con 0x7fc2f8156540 2023-10-06T03:00:22.569 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:22.569 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":75,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T03:00:21.161468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7185,"mds_1":7182,"mds_2":6382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6382":{"gid":6382,"name":"d","rank":2,"incarnation":72,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7182":{"gid":7182,"name":"a","rank":1,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 msgr2=0x7fc2dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40097c0 tx=0x7fc2f4019000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 msgr2=0x7fc2f80c3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 0x7fc2f80c3a60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000fc20 tx=0x7fc2f0008040 comp rx=0 tx=0).stop 2023-10-06T03:00:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 shutdown_connections 2023-10-06T03:00:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f806eda0 0x7fc2f8151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f8156540 0x7fc2f80c3a60 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 --2- 172.21.15.84:0/4177343727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80c75b0 0x7fc2f81668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 >> 172.21.15.84:0/4177343727 conn(0x7fc2f80680c0 msgr2=0x7fc2f8154560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 shutdown_connections 2023-10-06T03:00:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.570+0000 7fc2ffa4b700 1 -- 172.21.15.84:0/4177343727 wait complete. 2023-10-06T03:00:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 75 2023-10-06T03:00:22.582 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub start /d1/d2/d3 2023-10-06T03:00:22.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.700+0000 7ff420303700 1 Processor -- start 2023-10-06T03:00:22.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.700+0000 7ff420303700 1 -- start start 2023-10-06T03:00:22.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff420303700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff418159510 0x7ff4180cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff420303700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4180cbae0 0x7ff4180cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff420303700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4180cbef0 con 0x7ff4181598e0 2023-10-06T03:00:22.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff420303700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4180cf610 con 0x7ff418159510 2023-10-06T03:00:22.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff420303700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180cf8f0 con 0x7ff4180cbae0 2023-10-06T03:00:22.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e09f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff418159510 0x7ff4180cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e09f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff418159510 0x7ff4180cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51644/0 (socket says 172.21.15.84:51644) 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e09f700 1 -- 172.21.15.84:0/3693553361 learned_addr learned my addr 172.21.15.84:0/3693553361 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/3693553361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4180cbae0 0x7ff4180cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e09f700 1 -- 172.21.15.84:0/3693553361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4180cbae0 msgr2=0x7ff4180cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e09f700 1 --2- 172.21.15.84:0/3693553361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4180cbae0 0x7ff4180cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e09f700 1 -- 172.21.15.84:0/3693553361 >> v1:172.21.15.131:6789/0 conn(0x7ff4181598e0 legacy=0x7ff4180ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e09f700 1 -- 172.21.15.84:0/3693553361 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180cfbd0 con 0x7ff418159510 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/3693553361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4180cbae0 0x7ff4180cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41e09f700 1 --2- 172.21.15.84:0/3693553361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff418159510 0x7ff4180cb5a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7ff4140099b0 tx=0x7ff414009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99296a1ef748f29c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41d09d700 1 -- 172.21.15.84:0/3693553361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400b820 con 0x7ff418159510 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41d09d700 1 -- 172.21.15.84:0/3693553361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41400b980 con 0x7ff418159510 2023-10-06T03:00:22.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.701+0000 7ff41d09d700 1 -- 172.21.15.84:0/3693553361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400bd20 con 0x7ff418159510 2023-10-06T03:00:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.702+0000 7ff420303700 1 -- 172.21.15.84:0/3693553361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff418159510 msgr2=0x7ff4180cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.702+0000 7ff420303700 1 --2- 172.21.15.84:0/3693553361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff418159510 0x7ff4180cb5a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7ff4140099b0 tx=0x7ff414009250 comp rx=0 tx=0).stop 2023-10-06T03:00:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.702+0000 7ff420303700 1 -- 172.21.15.84:0/3693553361 shutdown_connections 2023-10-06T03:00:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.702+0000 7ff420303700 1 --2- 172.21.15.84:0/3693553361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4180cbae0 0x7ff4180cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.702+0000 7ff420303700 1 --2- 172.21.15.84:0/3693553361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff418159510 0x7ff4180cb5a0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.702+0000 7ff420303700 1 -- 172.21.15.84:0/3693553361 >> 172.21.15.84:0/3693553361 conn(0x7ff418089e90 msgr2=0x7ff4180997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.702+0000 7ff420303700 1 -- 172.21.15.84:0/3693553361 shutdown_connections 2023-10-06T03:00:22.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.702+0000 7ff420303700 1 -- 172.21.15.84:0/3693553361 wait complete. 2023-10-06T03:00:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.703+0000 7ff420303700 1 Processor -- start 2023-10-06T03:00:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.703+0000 7ff420303700 1 -- start start 2023-10-06T03:00:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff420303700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4180cbae0 0x7ff418146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff420303700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff418159510 0x7ff418068400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff420303700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4181598e0 0x7ff418068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff420303700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180c89a0 con 0x7ff4180cbae0 2023-10-06T03:00:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff420303700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180c8c80 con 0x7ff4181598e0 2023-10-06T03:00:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff420303700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180c8f60 con 0x7ff418159510 2023-10-06T03:00:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e09f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4180cbae0 0x7ff418146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e09f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4180cbae0 0x7ff418146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51650/0 (socket says 172.21.15.84:51650) 2023-10-06T03:00:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e09f700 1 -- 172.21.15.84:0/2348736420 learned_addr learned my addr 172.21.15.84:0/2348736420 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41d89e700 1 --2- 172.21.15.84:0/2348736420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff418159510 0x7ff418068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/2348736420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4181598e0 0x7ff418068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e09f700 1 -- 172.21.15.84:0/2348736420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff418159510 msgr2=0x7ff418068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e09f700 1 --2- 172.21.15.84:0/2348736420 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff418159510 0x7ff418068400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e09f700 1 -- 172.21.15.84:0/2348736420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4181598e0 msgr2=0x7ff418068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e09f700 1 --2- 172.21.15.84:0/2348736420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4181598e0 0x7ff418068940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e09f700 1 -- 172.21.15.84:0/2348736420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140094f0 con 0x7ff4180cbae0 2023-10-06T03:00:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff41e09f700 1 --2- 172.21.15.84:0/2348736420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4180cbae0 0x7ff418146fe0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7ff414009290 tx=0x7ff414016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff40e7fc700 1 -- 172.21.15.84:0/2348736420 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414011d70 con 0x7ff4180cbae0 2023-10-06T03:00:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff40e7fc700 1 -- 172.21.15.84:0/2348736420 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414020070 con 0x7ff4180cbae0 2023-10-06T03:00:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff420303700 1 -- 172.21.15.84:0/2348736420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4180c9240 con 0x7ff4180cbae0 2023-10-06T03:00:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.704+0000 7ff40e7fc700 1 -- 172.21.15.84:0/2348736420 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41401b6a0 con 0x7ff4180cbae0 2023-10-06T03:00:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.705+0000 7ff420303700 1 -- 172.21.15.84:0/2348736420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff418147520 con 0x7ff4180cbae0 2023-10-06T03:00:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.706+0000 7ff40e7fc700 1 -- 172.21.15.84:0/2348736420 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff414022030 con 0x7ff4180cbae0 2023-10-06T03:00:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.706+0000 7ff40e7fc700 1 --2- 172.21.15.84:0/2348736420 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff3fc066fb0 0x7ff3fc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.706+0000 7ff40e7fc700 1 -- 172.21.15.84:0/2348736420 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff4140867c0 con 0x7ff4180cbae0 2023-10-06T03:00:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.706+0000 7ff41d89e700 1 --2- 172.21.15.84:0/2348736420 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff3fc066fb0 0x7ff3fc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.707+0000 7ff41d89e700 1 --2- 172.21.15.84:0/2348736420 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff3fc066fb0 0x7ff3fc069460 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff408006fd0 tx=0x7ff408008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.708+0000 7ff4295fbb80 1 Processor -- start 2023-10-06T03:00:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.708+0000 7ff4295fbb80 1 -- start start 2023-10-06T03:00:22.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e99813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99818fc60 0x55e9981900b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e998096ad0 con 0x55e998140d20 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9980942d0 con 0x55e99818fc60 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9980900c0 con 0x55e99813f8a0 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff41d89e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff41d89e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51656/0 (socket says 172.21.15.84:51656) 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff41d89e700 1 -- 172.21.15.84:0/1432143206 learned_addr learned my addr 172.21.15.84:0/1432143206 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/1432143206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99818fc60 0x55e9981900b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.709+0000 7ff41e09f700 1 --2- 172.21.15.84:0/1432143206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e99813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff41d89e700 1 -- 172.21.15.84:0/1432143206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 msgr2=0x55e99813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff41d89e700 1 --2- 172.21.15.84:0/1432143206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e99813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff41d89e700 1 -- 172.21.15.84:0/1432143206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99818fc60 msgr2=0x55e9981900b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff41d89e700 1 --2- 172.21.15.84:0/1432143206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99818fc60 0x55e9981900b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff41d89e700 1 -- 172.21.15.84:0/1432143206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e997f2a2d0 con 0x55e998140d20 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff41d89e700 1 --2- 172.21.15.84:0/1432143206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818f720 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7ff4080095a0 tx=0x7ff408012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39830206a9e8e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff3fb7fe700 1 -- 172.21.15.84:0/1432143206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408012630 con 0x55e998140d20 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff3fb7fe700 1 -- 172.21.15.84:0/1432143206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff408012790 con 0x55e998140d20 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff3fb7fe700 1 -- 172.21.15.84:0/1432143206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408012b10 con 0x55e998140d20 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1432143206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 msgr2=0x55e99818f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1432143206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818f720 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7ff4080095a0 tx=0x7ff408012000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1432143206 shutdown_connections 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.710+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1432143206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99818fc60 0x55e9981900b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.711+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1432143206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e99813fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.711+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1432143206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818f720 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.711+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1432143206 >> 172.21.15.84:0/1432143206 conn(0x55e9981411c0 msgr2=0x55e998141590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.711+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1432143206 shutdown_connections 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.711+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1432143206 wait complete. 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.711+0000 7ff4295fbb80 1 -- start start 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.711+0000 7ff4295fbb80 1 Processor -- start 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99813f8a0 0x55e998168850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99818fc60 0x55e99813ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99803b8f0 con 0x55e998140d20 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e998056f00 con 0x55e99813f8a0 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e997f12e90 con 0x55e99818fc60 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff4295fbb80 10 client.0 _ll_register_callbacks cb 0x55e998102ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41d89e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41d89e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51672/0 (socket says 172.21.15.84:51672) 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41d89e700 1 -- 172.21.15.84:0/3958784150 learned_addr learned my addr 172.21.15.84:0/3958784150 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41e09f700 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99813f8a0 0x55e998168850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99818fc60 0x55e99813ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41d89e700 1 -- 172.21.15.84:0/3958784150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99818fc60 msgr2=0x55e99813ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41d89e700 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99818fc60 0x55e99813ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41d89e700 1 -- 172.21.15.84:0/3958784150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99813f8a0 msgr2=0x55e998168850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41d89e700 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99813f8a0 0x55e998168850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.712+0000 7ff41d89e700 1 -- 172.21.15.84:0/3958784150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40800e040 con 0x55e998140d20 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff41d89e700 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818d860 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ff40801d000 tx=0x7ff408013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e534139be719fab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff3f8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/3958784150 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408012b10 con 0x55e998140d20 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/3958784150 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff40802c420 con 0x55e998140d20 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff4295fbb80 1 -- 172.21.15.84:0/3958784150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9981349a0 con 0x55e998140d20 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/3958784150 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff40802c7f0 con 0x55e998140d20 2023-10-06T03:00:22.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff4295fbb80 10 client.7494 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff4295fbb80 1 -- 172.21.15.84:0/3958784150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55e997ecd040 con 0x55e998140d20 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/3958784150 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e9981349a0 con 0x55e998140d20 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/3958784150 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7ff40802c950 con 0x55e998140d20 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff4295fbb80 10 client.7494 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff4295fbb80 10 client.7494 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff4295fbb80 20 client.7494 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e998186840 0x55e998186c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff4295fbb80 4 client.7494 mds_command: new command op to 7182 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff4295fbb80 1 -- 172.21.15.84:0/3958784150 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9981118d0 con 0x55e998186840 2023-10-06T03:00:22.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.713+0000 7ff41e09f700 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e998186840 0x55e998186c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff3f8ff9700 10 client.7494 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff41e09f700 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e998186840 0x55e998186c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a34c3515333e910 server_cookie=c21ff6c878894712 in_seq=0 out_seq=0 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/3958784150 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e9981118d0 con 0x55e998186840 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff3f8ff9700 10 client.7494 handle_command_reply: tid=0 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 client.7494 shutdown 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 -- 172.21.15.84:0/3958784150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 msgr2=0x55e99818d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818d860 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ff40801d000 tx=0x7ff408013000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 -- 172.21.15.84:0/3958784150 shutdown_connections 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e998186840 0x55e998186c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e99813f8a0 0x55e998168850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff3f8ff9700 0 client.7494 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99818fc60 0x55e99813ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/3958784150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e998140d20 0x55e99818d860 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 -- 172.21.15.84:0/3958784150 >> 172.21.15.84:0/3958784150 conn(0x55e9981411c0 msgr2=0x55e998189690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.714+0000 7ff4295fbb80 1 -- 172.21.15.84:0/3958784150 shutdown_connections 2023-10-06T03:00:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.715+0000 7ff4295fbb80 1 -- 172.21.15.84:0/3958784150 wait complete. 2023-10-06T03:00:22.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.715+0000 7ff4295fbb80 20 client.7494 trim_cache size 0 max 16384 2023-10-06T03:00:22.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.731+0000 7ff4295fbb80 1 Processor -- start 2023-10-06T03:00:22.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.731+0000 7ff4295fbb80 1 -- start start 2023-10-06T03:00:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.731+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e9981e3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.731+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 0x55e99813c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.731+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e998186c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.731+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99818c9c0 con 0x55e99818fc60 2023-10-06T03:00:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.731+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e998184290 con 0x55e998140d20 2023-10-06T03:00:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.731+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e998167e70 con 0x55e99813f8a0 2023-10-06T03:00:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.731+0000 7ff41e8a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e998186c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41e8a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e998186c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51684/0 (socket says 172.21.15.84:51684) 2023-10-06T03:00:22.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41e8a0700 1 -- 172.21.15.84:0/1872828004 learned_addr learned my addr 172.21.15.84:0/1872828004 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41e09f700 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e9981e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41d89e700 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 0x55e99813c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41e8a0700 1 -- 172.21.15.84:0/1872828004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 msgr2=0x55e9981e3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e9981e3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41e8a0700 1 -- 172.21.15.84:0/1872828004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 msgr2=0x55e99813c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 0x55e99813c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41e8a0700 1 -- 172.21.15.84:0/1872828004 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e99805e7e0 con 0x55e99818fc60 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41d89e700 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 0x55e99813c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e998186c10 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7ff41000d6e0 tx=0x7ff41000f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47742cba1a796ba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff3fbfff700 1 -- 172.21.15.84:0/1872828004 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410013070 con 0x55e99818fc60 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff3fbfff700 1 -- 172.21.15.84:0/1872828004 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410014040 con 0x55e99818fc60 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.732+0000 7ff3fbfff700 1 -- 172.21.15.84:0/1872828004 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000a960 con 0x55e99818fc60 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1872828004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 msgr2=0x55e998186c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e998186c10 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7ff41000d6e0 tx=0x7ff41000f040 comp rx=0 tx=0).stop 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1872828004 shutdown_connections 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e998186c10 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e9981e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1872828004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 0x55e99813c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1872828004 >> 172.21.15.84:0/1872828004 conn(0x55e9981411c0 msgr2=0x55e99817fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1872828004 shutdown_connections 2023-10-06T03:00:22.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1872828004 wait complete. 2023-10-06T03:00:22.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 -- start start 2023-10-06T03:00:22.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.733+0000 7ff4295fbb80 1 Processor -- start 2023-10-06T03:00:22.740 DEBUG:teuthology.orchestra.run:got remote process result: 18 2023-10-06T03:00:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e9981ec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 0x55e9981df570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff4295fbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e99817c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e998183860 con 0x55e99818fc60 2023-10-06T03:00:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e998165f80 con 0x55e998140d20 2023-10-06T03:00:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff4295fbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e998165c10 con 0x55e99813f8a0 2023-10-06T03:00:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff4295fbb80 10 client.0 _ll_register_callbacks cb 0x55e998102ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff41e8a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e99817c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff41e8a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e99817c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51696/0 (socket says 172.21.15.84:51696) 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff41e8a0700 1 -- 172.21.15.84:0/1717614272 learned_addr learned my addr 172.21.15.84:0/1717614272 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff41d89e700 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 0x55e9981df570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff41e09f700 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e9981ec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff41e8a0700 1 -- 172.21.15.84:0/1717614272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 msgr2=0x55e9981ec9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.734+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e9981ec9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff41e8a0700 1 -- 172.21.15.84:0/1717614272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 msgr2=0x55e9981df570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 0x55e9981df570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff41e8a0700 1 -- 172.21.15.84:0/1717614272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41000d440 con 0x55e99818fc60 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff41e8a0700 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e99817c3b0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x55e99813a7f0 tx=0x7ff410018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1784e801cf24705b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff3f8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:22.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/1717614272 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410024430 con 0x55e99818fc60 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/1717614272 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff41000f990 con 0x55e99818fc60 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1717614272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e99818bb60 con 0x55e99818fc60 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/1717614272 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff41000fd60 con 0x55e99818fc60 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff4295fbb80 10 client.7500 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1717614272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55e9980454d0 con 0x55e99818fc60 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/1717614272 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e99818bb60 con 0x55e99818fc60 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/1717614272 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7ff41002c070 con 0x55e99818fc60 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff4295fbb80 10 client.7500 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff4295fbb80 10 client.7500 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff4295fbb80 20 client.7500 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:22.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e998166570 0x55e998166940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff4295fbb80 4 client.7500 mds_command: new command op to 7182 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3"}] 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1717614272 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3"}) v1 -- 0x7ff408012790 con 0x55e998166570 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.735+0000 7ff41e09f700 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e998166570 0x55e998166940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff41e09f700 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e998166570 0x55e998166940 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b287cc8218ea67e5 server_cookie=286a1c82fb43f39f in_seq=0 out_seq=0 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff3f8ff9700 10 client.7500 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff3f8ff9700 1 -- 172.21.15.84:0/1717614272 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x7ff408012790 con 0x55e998166570 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff3f8ff9700 10 client.7500 handle_command_reply: tid=0 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 client.7500 shutdown 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1717614272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 msgr2=0x55e99817c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e99817c3b0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x55e99813a7f0 tx=0x7ff410018000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1717614272 shutdown_connections 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e998166570 0x55e998166940 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e99818fc60 0x55e99817c3b0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e99813f8a0 0x55e9981ec9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff3f8ff9700 0 client.7500 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 --2- 172.21.15.84:0/1717614272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e998140d20 0x55e9981df570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1717614272 >> 172.21.15.84:0/1717614272 conn(0x55e9981411c0 msgr2=0x55e99817feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1717614272 shutdown_connections 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 1 -- 172.21.15.84:0/1717614272 wait complete. 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.736+0000 7ff4295fbb80 20 client.7500 trim_cache size 0 max 16384 2023-10-06T03:00:22.745 INFO:teuthology.orchestra.run.smithi084.stderr:Error EXDEV: Not rank 0 2023-10-06T03:00:22.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub abort 2023-10-06T03:00:22.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.860+0000 7f47aee54700 1 Processor -- start 2023-10-06T03:00:22.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.860+0000 7f47aee54700 1 -- start start 2023-10-06T03:00:22.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47aee54700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f47a815b980 0x7f47a806b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47aee54700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a8158820 con 0x7f47a806be20 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47aee54700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a80afbf0 con 0x7f47a8158420 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47aee54700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a806c2c0 con 0x7f47a815b980 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47acbf0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f47a815b980 0x7f47a806b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47a7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f47a806be20 0x7f47a8157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42322/0 (socket says 172.21.15.84:42322) 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47a7fff700 1 -- 172.21.15.84:0/372059332 learned_addr learned my addr 172.21.15.84:0/372059332 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47ad3f1700 1 --1- 172.21.15.84:0/372059332 >> v1:172.21.15.131:6789/0 conn(0x7f47a8158420 0x7f47a8158aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:48786/0 (socket says 172.21.15.84:48786) 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47acbf0700 1 -- 172.21.15.84:0/372059332 >> v1:172.21.15.131:6789/0 conn(0x7f47a8158420 legacy=0x7f47a8158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47a77fe700 1 -- 172.21.15.84:0/372059332 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193433756 0 0) 0x7f47a8158820 con 0x7f47a806be20 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.861+0000 7f47acbf0700 1 -- 172.21.15.84:0/372059332 >> v1:172.21.15.84:6789/0 conn(0x7f47a806be20 legacy=0x7f47a8157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47acbf0700 1 -- 172.21.15.84:0/372059332 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80afed0 con 0x7f47a815b980 2023-10-06T03:00:22.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47acbf0700 1 --2- 172.21.15.84:0/372059332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a815b980 0x7f47a806b8e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009de0 tx=0x7f47a0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d333daf6960cd7e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47a77fe700 1 -- 172.21.15.84:0/372059332 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a000e070 con 0x7f47a815b980 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47a77fe700 1 -- 172.21.15.84:0/372059332 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a000bbb0 con 0x7f47a815b980 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47a77fe700 1 -- 172.21.15.84:0/372059332 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0012430 con 0x7f47a815b980 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47aee54700 1 -- 172.21.15.84:0/372059332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a815b980 msgr2=0x7f47a806b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47aee54700 1 --2- 172.21.15.84:0/372059332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a815b980 0x7f47a806b8e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009de0 tx=0x7f47a0009780 comp rx=0 tx=0).stop 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47aee54700 1 -- 172.21.15.84:0/372059332 shutdown_connections 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47aee54700 1 --2- 172.21.15.84:0/372059332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a815b980 0x7f47a806b8e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47aee54700 1 -- 172.21.15.84:0/372059332 >> 172.21.15.84:0/372059332 conn(0x7f47a80ce330 msgr2=0x7f47a80ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47aee54700 1 -- 172.21.15.84:0/372059332 shutdown_connections 2023-10-06T03:00:22.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.862+0000 7f47aee54700 1 -- 172.21.15.84:0/372059332 wait complete. 2023-10-06T03:00:22.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.863+0000 7f47aee54700 1 Processor -- start 2023-10-06T03:00:22.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.864+0000 7f47aee54700 1 -- start start 2023-10-06T03:00:22.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.864+0000 7f47aee54700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a806be20 0x7f47a80b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.864+0000 7f47aee54700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47a8158420 0x7f47a8168af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.864+0000 7f47aee54700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47a815b980 0x7f47a814dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.864+0000 7f47aee54700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80b3d00 con 0x7f47a8158420 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.864+0000 7f47aee54700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8169030 con 0x7f47a806be20 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.864+0000 7f47aee54700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80b30f0 con 0x7f47a815b980 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.864+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47a8158420 0x7f47a8168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47a8158420 0x7f47a8168af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51710/0 (socket says 172.21.15.84:51710) 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a7fff700 1 -- 172.21.15.84:0/3979403873 learned_addr learned my addr 172.21.15.84:0/3979403873 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47acbf0700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a806be20 0x7f47a80b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47a815b980 0x7f47a814dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a7fff700 1 -- 172.21.15.84:0/3979403873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47a815b980 msgr2=0x7f47a814dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a7fff700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47a815b980 0x7f47a814dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a7fff700 1 -- 172.21.15.84:0/3979403873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a806be20 msgr2=0x7f47a80b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a7fff700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a806be20 0x7f47a80b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a7fff700 1 -- 172.21.15.84:0/3979403873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a0009a20 con 0x7f47a8158420 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47acbf0700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a806be20 0x7f47a80b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47a815b980 0x7f47a814dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a7fff700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47a8158420 0x7f47a8168af0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f479000c810 tx=0x7f4790007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a4ff9700 1 -- 172.21.15.84:0/3979403873 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790005c00 con 0x7f47a8158420 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a4ff9700 1 -- 172.21.15.84:0/3979403873 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790005d60 con 0x7f47a8158420 2023-10-06T03:00:22.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47aee54700 1 -- 172.21.15.84:0/3979403873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a80b33d0 con 0x7f47a8158420 2023-10-06T03:00:22.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47a4ff9700 1 -- 172.21.15.84:0/3979403873 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790007320 con 0x7f47a8158420 2023-10-06T03:00:22.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.865+0000 7f47aee54700 1 -- 172.21.15.84:0/3979403873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a80b3990 con 0x7f47a8158420 2023-10-06T03:00:22.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.867+0000 7f47a4ff9700 1 -- 172.21.15.84:0/3979403873 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f479001b3b0 con 0x7f47a8158420 2023-10-06T03:00:22.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.867+0000 7f47a4ff9700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4788066f30 0x7f47880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.867+0000 7f47a4ff9700 1 -- 172.21.15.84:0/3979403873 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4790083c20 con 0x7f47a8158420 2023-10-06T03:00:22.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.867+0000 7f47acbf0700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4788066f30 0x7f47880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.868+0000 7f47acbf0700 1 --2- 172.21.15.84:0/3979403873 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4788066f30 0x7f47880693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f47a000b970 tx=0x7f47a0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.869+0000 7f47b814cb80 1 Processor -- start 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.869+0000 7f47b814cb80 1 -- start start 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c00c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c51080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47b814cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c857b57aa0 con 0x55c857c50c30 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47b814cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c857b552a0 con 0x55c857c00870 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47b814cb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c857b51090 con 0x55c857c01cf0 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47ad3f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c51080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47ad3f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c51080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51722/0 (socket says 172.21.15.84:51722) 2023-10-06T03:00:22.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47ad3f1700 1 -- 172.21.15.84:0/2565411415 learned_addr learned my addr 172.21.15.84:0/2565411415 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47acbf0700 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c00c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47a7fff700 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47ad3f1700 1 -- 172.21.15.84:0/2565411415 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 msgr2=0x55c857c506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47ad3f1700 1 -- 172.21.15.84:0/2565411415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 msgr2=0x55c857c00c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c00c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47ad3f1700 1 -- 172.21.15.84:0/2565411415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8579eb2a0 con 0x55c857c50c30 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47a7fff700 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c51080 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4798001740 tx=0x7f4798000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d484dd506bab9540 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f479dffb700 1 -- 172.21.15.84:0/2565411415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798007520 con 0x55c857c50c30 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f479dffb700 1 -- 172.21.15.84:0/2565411415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798007680 con 0x55c857c50c30 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.870+0000 7f479dffb700 1 -- 172.21.15.84:0/2565411415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798014680 con 0x55c857c50c30 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 -- 172.21.15.84:0/2565411415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 msgr2=0x55c857c51080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c51080 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4798001740 tx=0x7f4798000bc0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 -- 172.21.15.84:0/2565411415 shutdown_connections 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c00c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c51080 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2565411415 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 -- 172.21.15.84:0/2565411415 >> 172.21.15.84:0/2565411415 conn(0x55c857c02190 msgr2=0x55c857c02560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 -- 172.21.15.84:0/2565411415 shutdown_connections 2023-10-06T03:00:22.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 -- 172.21.15.84:0/2565411415 wait complete. 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.871+0000 7f47b814cb80 1 -- start start 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.872+0000 7f47b814cb80 1 Processor -- start 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.872+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c44880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.872+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c40320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.872+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c40860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.872+0000 7f47b814cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c857afc8c0 con 0x55c857c50c30 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.872+0000 7f47b814cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c857b17ed0 con 0x55c857c00870 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.872+0000 7f47b814cb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8579d3e60 con 0x55c857c01cf0 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.872+0000 7f47b814cb80 10 client.0 _ll_register_callbacks cb 0x55c857bc3ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:22.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47ad3f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c40860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47ad3f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c40860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51736/0 (socket says 172.21.15.84:51736) 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47ad3f1700 1 -- 172.21.15.84:0/2658236609 learned_addr learned my addr 172.21.15.84:0/2658236609 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47acbf0700 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c44880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47a7fff700 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c40320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47ad3f1700 1 -- 172.21.15.84:0/2658236609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 msgr2=0x55c857c40320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c40320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47ad3f1700 1 -- 172.21.15.84:0/2658236609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 msgr2=0x55c857c44880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c44880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47ad3f1700 1 -- 172.21.15.84:0/2658236609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4798004c10 con 0x55c857c50c30 2023-10-06T03:00:22.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c40860 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4798008fd0 tx=0x7f4798014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d12ba8add1950d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f4786ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f4786ffd700 1 -- 172.21.15.84:0/2658236609 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798015c90 con 0x55c857c50c30 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f4786ffd700 1 -- 172.21.15.84:0/2658236609 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4798015df0 con 0x55c857c50c30 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47b814cb80 1 -- 172.21.15.84:0/2658236609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c857bf5970 con 0x55c857c50c30 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f4786ffd700 1 -- 172.21.15.84:0/2658236609 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f479801f630 con 0x55c857c50c30 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47b814cb80 10 client.7512 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47b814cb80 1 -- 172.21.15.84:0/2658236609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55c85798e010 con 0x55c857c50c30 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f4786ffd700 1 -- 172.21.15.84:0/2658236609 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c857bf5970 con 0x55c857c50c30 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f4786ffd700 1 -- 172.21.15.84:0/2658236609 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f4798012070 con 0x55c857c50c30 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.873+0000 7f47b814cb80 10 client.7512 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f47b814cb80 10 client.7512 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f47b814cb80 20 client.7512 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c857c2ad50 0x55c857c2b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f47b814cb80 4 client.7512 mds_command: new command op to 7182 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f47b814cb80 1 -- 172.21.15.84:0/2658236609 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c857bd28a0 con 0x55c857c2ad50 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f47acbf0700 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c857c2ad50 0x55c857c2b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f4786ffd700 10 client.7512 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f47acbf0700 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c857c2ad50 0x55c857c2b120 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76eb7bd76072d505 server_cookie=ce006f88c5367ac0 in_seq=0 out_seq=0 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f4786ffd700 1 -- 172.21.15.84:0/2658236609 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c857bd28a0 con 0x55c857c2ad50 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.874+0000 7f4786ffd700 10 client.7512 handle_command_reply: tid=0 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 client.7512 shutdown 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 -- 172.21.15.84:0/2658236609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 msgr2=0x55c857c40860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c40860 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4798008fd0 tx=0x7f4798014000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 -- 172.21.15.84:0/2658236609 shutdown_connections 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c857c2ad50 0x55c857c2b120 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c44880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f4786ffd700 0 client.7512 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c40860 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 --2- 172.21.15.84:0/2658236609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c40320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 -- 172.21.15.84:0/2658236609 >> 172.21.15.84:0/2658236609 conn(0x55c857c02190 msgr2=0x55c857c011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 -- 172.21.15.84:0/2658236609 shutdown_connections 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 1 -- 172.21.15.84:0/2658236609 wait complete. 2023-10-06T03:00:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.875+0000 7f47b814cb80 20 client.7512 trim_cache size 0 max 16384 2023-10-06T03:00:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.890+0000 7f47b814cb80 1 Processor -- start 2023-10-06T03:00:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47b814cb80 1 -- start start 2023-10-06T03:00:22.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c00870 0x55c857c404e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c01cf0 0x55c857bfdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c50c30 0x55c857bfe220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47b814cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c857c01b50 con 0x55c857c01cf0 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47b814cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c857bd92b0 con 0x55c857c50c30 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47b814cb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c857c29f20 con 0x55c857c00870 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c01cf0 0x55c857bfdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c01cf0 0x55c857bfdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51740/0 (socket says 172.21.15.84:51740) 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47a7fff700 1 -- 172.21.15.84:0/1794443896 learned_addr learned my addr 172.21.15.84:0/1794443896 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47acbf0700 1 --2- 172.21.15.84:0/1794443896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c00870 0x55c857c404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.891+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/1794443896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c50c30 0x55c857bfe220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47a7fff700 1 -- 172.21.15.84:0/1794443896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c00870 msgr2=0x55c857c404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47a7fff700 1 --2- 172.21.15.84:0/1794443896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c00870 0x55c857c404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47a7fff700 1 -- 172.21.15.84:0/1794443896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c50c30 msgr2=0x55c857bfe220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47a7fff700 1 --2- 172.21.15.84:0/1794443896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c50c30 0x55c857bfe220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47a7fff700 1 -- 172.21.15.84:0/1794443896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c857b1f7b0 con 0x55c857c01cf0 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47a7fff700 1 --2- 172.21.15.84:0/1794443896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c01cf0 0x55c857bfdce0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f47900058f0 tx=0x7f4790081e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c50e28d5357d4c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f479e7fc700 1 -- 172.21.15.84:0/1794443896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790054fb0 con 0x55c857c01cf0 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f479e7fc700 1 -- 172.21.15.84:0/1794443896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47900548b0 con 0x55c857c01cf0 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f479e7fc700 1 -- 172.21.15.84:0/1794443896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790057b00 con 0x55c857c01cf0 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47b814cb80 1 -- 172.21.15.84:0/1794443896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c01cf0 msgr2=0x55c857bfdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47b814cb80 1 --2- 172.21.15.84:0/1794443896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c01cf0 0x55c857bfdce0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f47900058f0 tx=0x7f4790081e00 comp rx=0 tx=0).stop 2023-10-06T03:00:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47b814cb80 1 -- 172.21.15.84:0/1794443896 shutdown_connections 2023-10-06T03:00:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47b814cb80 1 --2- 172.21.15.84:0/1794443896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c50c30 0x55c857bfe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47b814cb80 1 --2- 172.21.15.84:0/1794443896 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c00870 0x55c857c404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47b814cb80 1 --2- 172.21.15.84:0/1794443896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c01cf0 0x55c857bfdce0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47b814cb80 1 -- 172.21.15.84:0/1794443896 >> 172.21.15.84:0/1794443896 conn(0x55c857c02190 msgr2=0x55c857c2b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47b814cb80 1 -- 172.21.15.84:0/1794443896 shutdown_connections 2023-10-06T03:00:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.892+0000 7f47b814cb80 1 -- 172.21.15.84:0/1794443896 wait complete. 2023-10-06T03:00:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.893+0000 7f47b814cb80 1 -- start start 2023-10-06T03:00:22.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.893+0000 7f47b814cb80 1 Processor -- start 2023-10-06T03:00:22.900 DEBUG:teuthology.orchestra.run:got remote process result: 18 2023-10-06T03:00:22.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c02770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c02cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47b814cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c2f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47b814cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c857c3ec90 con 0x55c857c50c30 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47b814cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c857bfcaf0 con 0x55c857c00870 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47b814cb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c857cb0d20 con 0x55c857c01cf0 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47b814cb80 10 client.0 _ll_register_callbacks cb 0x55c857bc3ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47ad3f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c2f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47ad3f1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c2f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51750/0 (socket says 172.21.15.84:51750) 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47ad3f1700 1 -- 172.21.15.84:0/4099016803 learned_addr learned my addr 172.21.15.84:0/4099016803 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47a7fff700 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c02cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47acbf0700 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c02770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47ad3f1700 1 -- 172.21.15.84:0/4099016803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 msgr2=0x55c857c02cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c02cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47ad3f1700 1 -- 172.21.15.84:0/4099016803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 msgr2=0x55c857c02770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c02770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47ad3f1700 1 -- 172.21.15.84:0/4099016803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a80b3990 con 0x55c857c50c30 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47ad3f1700 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c2f650 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f47980275f0 tx=0x7f479801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ca4e651498ff2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f4786ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f4786ffd700 1 -- 172.21.15.84:0/4099016803 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479801f630 con 0x55c857c50c30 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f4786ffd700 1 -- 172.21.15.84:0/4099016803 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f47980273e0 con 0x55c857c50c30 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.894+0000 7f47b814cb80 1 -- 172.21.15.84:0/4099016803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4798007680 con 0x55c857c50c30 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f4786ffd700 1 -- 172.21.15.84:0/4099016803 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4798007af0 con 0x55c857c50c30 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47b814cb80 10 client.7518 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47b814cb80 1 -- 172.21.15.84:0/4099016803 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55c857b064a0 con 0x55c857c50c30 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f4786ffd700 1 -- 172.21.15.84:0/4099016803 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798007680 con 0x55c857c50c30 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f4786ffd700 1 -- 172.21.15.84:0/4099016803 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f479801f8d0 con 0x55c857c50c30 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47b814cb80 10 client.7518 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47b814cb80 10 client.7518 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47b814cb80 20 client.7518 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47b814cb80 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c857c2fb90 0x55c857c2ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47b814cb80 4 client.7518 mds_command: new command op to 7182 tid=0[{"prefix": "scrub abort"}] 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47b814cb80 1 -- 172.21.15.84:0/4099016803 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x55c857af3e30 con 0x55c857c2fb90 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47acbf0700 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c857c2fb90 0x55c857c2ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:22.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f4786ffd700 10 client.7518 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47acbf0700 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c857c2fb90 0x55c857c2ff60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=489647b1e2222082 server_cookie=89cc8b1b00515fb2 in_seq=0 out_seq=0 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f4786ffd700 1 -- 172.21.15.84:0/4099016803 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x55c857af3e30 con 0x55c857c2fb90 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f4786ffd700 10 client.7518 handle_command_reply: tid=0 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.895+0000 7f47b814cb80 1 client.7518 shutdown 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 -- 172.21.15.84:0/4099016803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 msgr2=0x55c857c2f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c2f650 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f47980275f0 tx=0x7f479801f000 comp rx=0 tx=0).stop 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 -- 172.21.15.84:0/4099016803 shutdown_connections 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55c857c2fb90 0x55c857c2ff60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c857c00870 0x55c857c02770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c857c50c30 0x55c857c2f650 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 --2- 172.21.15.84:0/4099016803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c857c01cf0 0x55c857c02cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f4786ffd700 0 client.7518 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 -- 172.21.15.84:0/4099016803 >> 172.21.15.84:0/4099016803 conn(0x55c857c02190 msgr2=0x55c857c03db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 -- 172.21.15.84:0/4099016803 shutdown_connections 2023-10-06T03:00:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 1 -- 172.21.15.84:0/4099016803 wait complete. 2023-10-06T03:00:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:22.896+0000 7f47b814cb80 20 client.7518 trim_cache size 0 max 16384 2023-10-06T03:00:22.905 INFO:teuthology.orchestra.run.smithi084.stderr:Error EXDEV: Not rank 0 2023-10-06T03:00:22.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub pause 2023-10-06T03:00:23.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.020+0000 7fa8bb2b8700 1 Processor -- start 2023-10-06T03:00:23.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.020+0000 7fa8bb2b8700 1 -- start start 2023-10-06T03:00:23.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8bb2b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b40b2a90 0x7fa8b40cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8bb2b8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa8b40c6610 0x7fa8b40cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8bb2b8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b40cbdf0 con 0x7fa8b40cb980 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8bb2b8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40b2e60 con 0x7fa8b40c6610 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8bb2b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40cf5d0 con 0x7fa8b40b2a90 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8b8853700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa8b40cb980 0x7fa8b40ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42324/0 (socket says 172.21.15.84:42324) 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8b8853700 1 -- 172.21.15.84:0/2946790242 learned_addr learned my addr 172.21.15.84:0/2946790242 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8b9855700 1 --2- 172.21.15.84:0/2946790242 >> v2:172.21.15.131:3300/0 conn(0x7fa8b40c6610 0x7fa8b40cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8b9054700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b40b2a90 0x7fa8b40cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.021+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909391171 0 0) 0x7fa8b40cbdf0 con 0x7fa8b40cb980 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a0003570 con 0x7fa8b40cb980 2023-10-06T03:00:23.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3123456630 0 0) 0x7fa8a0003570 con 0x7fa8b40cb980 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b40b2a90 msgr2=0x7fa8b40cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b40b2a90 0x7fa8b40cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 >> v2:172.21.15.131:3300/0 conn(0x7fa8b40c6610 msgr2=0x7fa8b40cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 --2- 172.21.15.84:0/2946790242 >> v2:172.21.15.131:3300/0 conn(0x7fa8b40c6610 0x7fa8b40cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40cf8b0 con 0x7fa8b40cb980 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fa8a4001470 con 0x7fa8b40cb980 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 >> v1:172.21.15.84:6789/0 conn(0x7fa8b40cb980 legacy=0x7fa8b40ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a0003a60 0x7fa8a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b40b2a90 0x7fa8a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0004d50 0x7fa8a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40b2e60 con 0x7fa8a0003a60 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40cf5d0 con 0x7fa8a0004d50 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a000bae0 con 0x7fa8b40b2a90 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b9054700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a0003a60 0x7fa8a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b8853700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b40b2a90 0x7fa8a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b9855700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0004d50 0x7fa8a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b9054700 1 -- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b40b2a90 msgr2=0x7fa8a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b9054700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b40b2a90 0x7fa8a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b9054700 1 -- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0004d50 msgr2=0x7fa8a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b9054700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0004d50 0x7fa8a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b9054700 1 -- 172.21.15.84:0/2946790242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0003570 con 0x7fa8a0003a60 2023-10-06T03:00:23.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b9855700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0004d50 0x7fa8a00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b8853700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b40b2a90 0x7fa8a0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8b9054700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a0003a60 0x7fa8a0003e70 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000e2d0 tx=0x7fa8b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99ecc0fea56fecf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000eb20 con 0x7fa8a0003a60 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b000f040 con 0x7fa8a0003a60 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.022+0000 7fa8abfff700 1 -- 172.21.15.84:0/2946790242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000eed0 con 0x7fa8a0003a60 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.023+0000 7fa8bb2b8700 1 -- 172.21.15.84:0/2946790242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a0003a60 msgr2=0x7fa8a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.023+0000 7fa8bb2b8700 1 --2- 172.21.15.84:0/2946790242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8a0003a60 0x7fa8a0003e70 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000e2d0 tx=0x7fa8b000b040 comp rx=0 tx=0).stop 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.023+0000 7fa8b9855700 1 -- 172.21.15.84:0/2946790242 reap_dead start 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.023+0000 7fa8bb2b8700 1 -- 172.21.15.84:0/2946790242 shutdown_connections 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.023+0000 7fa8bb2b8700 1 -- 172.21.15.84:0/2946790242 >> 172.21.15.84:0/2946790242 conn(0x7fa8b4099740 msgr2=0x7fa8b406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.023+0000 7fa8bb2b8700 1 -- 172.21.15.84:0/2946790242 shutdown_connections 2023-10-06T03:00:23.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.023+0000 7fa8bb2b8700 1 -- 172.21.15.84:0/2946790242 wait complete. 2023-10-06T03:00:23.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.024+0000 7fa8bb2b8700 1 Processor -- start 2023-10-06T03:00:23.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.024+0000 7fa8bb2b8700 1 -- start start 2023-10-06T03:00:23.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8bb2b8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0003a60 0x7fa8b40c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8bb2b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b409d8a0 0x7fa8b40c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8bb2b8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8b4144670 0x7fa8b40ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8bb2b8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40ca020 con 0x7fa8b4144670 2023-10-06T03:00:23.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8bb2b8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40c9650 con 0x7fa8a0003a60 2023-10-06T03:00:23.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8bb2b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40c8a40 con 0x7fa8b409d8a0 2023-10-06T03:00:23.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9855700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8b4144670 0x7fa8b40ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9855700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8b4144670 0x7fa8b40ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51762/0 (socket says 172.21.15.84:51762) 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9855700 1 -- 172.21.15.84:0/339097947 learned_addr learned my addr 172.21.15.84:0/339097947 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9054700 1 --2- 172.21.15.84:0/339097947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0003a60 0x7fa8b40c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b8853700 1 --2- 172.21.15.84:0/339097947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b409d8a0 0x7fa8b40c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9855700 1 -- 172.21.15.84:0/339097947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b409d8a0 msgr2=0x7fa8b40c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9855700 1 --2- 172.21.15.84:0/339097947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8b409d8a0 0x7fa8b40c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9855700 1 -- 172.21.15.84:0/339097947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0003a60 msgr2=0x7fa8b40c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9855700 1 --2- 172.21.15.84:0/339097947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0003a60 0x7fa8b40c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9855700 1 -- 172.21.15.84:0/339097947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40c8d20 con 0x7fa8b4144670 2023-10-06T03:00:23.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.025+0000 7fa8b9054700 1 --2- 172.21.15.84:0/339097947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8a0003a60 0x7fa8b40c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.026+0000 7fa8b9855700 1 --2- 172.21.15.84:0/339097947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8b4144670 0x7fa8b40ca1f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4088840 tx=0x7fa8ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.026+0000 7fa8a97fa700 1 -- 172.21.15.84:0/339097947 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac015670 con 0x7fa8b4144670 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.026+0000 7fa8a97fa700 1 -- 172.21.15.84:0/339097947 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac0157d0 con 0x7fa8b4144670 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.026+0000 7fa8bb2b8700 1 -- 172.21.15.84:0/339097947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b40c9000 con 0x7fa8b4144670 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.026+0000 7fa8a97fa700 1 -- 172.21.15.84:0/339097947 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac015b90 con 0x7fa8b4144670 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.026+0000 7fa8bb2b8700 1 -- 172.21.15.84:0/339097947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b40c8720 con 0x7fa8b4144670 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.027+0000 7fa8a97fa700 1 -- 172.21.15.84:0/339097947 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8ac020460 con 0x7fa8b4144670 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.027+0000 7fa8a97fa700 1 --2- 172.21.15.84:0/339097947 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa898066f30 0x7fa8980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.027+0000 7fa8a97fa700 1 -- 172.21.15.84:0/339097947 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa8ac084a10 con 0x7fa8b4144670 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.028+0000 7fa8b9054700 1 --2- 172.21.15.84:0/339097947 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa898066f30 0x7fa8980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.028+0000 7fa8b9054700 1 --2- 172.21.15.84:0/339097947 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa898066f30 0x7fa8980693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00094a0 tx=0x7fa8b001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.029+0000 7fa8c45b0b80 1 Processor -- start 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.029+0000 7fa8c45b0b80 1 -- start start 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac2d870 0x55e42ac2dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac6b550 0x55e42ac2e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac73e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e42ab84aa0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e42ab822a0 con 0x55e42ac6b550 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e42ab7e090 con 0x55e42ac2d870 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8b9855700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac73e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8b9855700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac73e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51778/0 (socket says 172.21.15.84:51778) 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8b9855700 1 -- 172.21.15.84:0/947346581 learned_addr learned my addr 172.21.15.84:0/947346581 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8b9855700 1 -- 172.21.15.84:0/947346581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac2d870 msgr2=0x55e42ac2dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8b9855700 1 --2- 172.21.15.84:0/947346581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac2d870 0x55e42ac2dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8b9855700 1 -- 172.21.15.84:0/947346581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac6b550 msgr2=0x55e42ac2e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8b9855700 1 --2- 172.21.15.84:0/947346581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac6b550 0x55e42ac2e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.030+0000 7fa8b9855700 1 -- 172.21.15.84:0/947346581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e42aa182a0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8b9855700 1 --2- 172.21.15.84:0/947346581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac73e20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac014040 tx=0x7fa8ac082bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459b9949be6c39be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa89e7fc700 1 -- 172.21.15.84:0/947346581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac055da0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa89e7fc700 1 -- 172.21.15.84:0/947346581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac0556a0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa89e7fc700 1 -- 172.21.15.84:0/947346581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0588f0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/947346581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 msgr2=0x55e42ac73e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/947346581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac73e20 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac014040 tx=0x7fa8ac082bf0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/947346581 shutdown_connections 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/947346581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac73e20 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/947346581 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac2d870 0x55e42ac2dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/947346581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac6b550 0x55e42ac2e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/947346581 >> 172.21.15.84:0/947346581 conn(0x55e42ac2f190 msgr2=0x55e42ac2f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/947346581 shutdown_connections 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.031+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/947346581 wait complete. 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.032+0000 7fa8c45b0b80 1 -- start start 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.032+0000 7fa8c45b0b80 1 Processor -- start 2023-10-06T03:00:23.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac858e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac6f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 0x55e42ac6f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e42ab298c0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e42ab44ed0 con 0x55e42ac2d870 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e42aa00e60 con 0x55e42ac6b550 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8c45b0b80 10 client.0 _ll_register_callbacks cb 0x55e42abf0ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b8853700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac6f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b8853700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac6f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51784/0 (socket says 172.21.15.84:51784) 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b8853700 1 -- 172.21.15.84:0/3745209243 learned_addr learned my addr 172.21.15.84:0/3745209243 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b9054700 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac858e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b9855700 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 0x55e42ac6f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b8853700 1 -- 172.21.15.84:0/3745209243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 msgr2=0x55e42ac6f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b8853700 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 0x55e42ac6f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b8853700 1 -- 172.21.15.84:0/3745209243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 msgr2=0x55e42ac858e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b8853700 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac858e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b8853700 1 -- 172.21.15.84:0/3745209243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b40c8720 con 0x55e42ac2ecf0 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b9054700 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac858e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8b8853700 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac6f110 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4000c00 tx=0x7fa8a4007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b85ce32ad337ab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.033+0000 7fa8937fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8937fe700 1 -- 172.21.15.84:0/3745209243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4005970 con 0x55e42ac2ecf0 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8937fe700 1 -- 172.21.15.84:0/3745209243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa8a400f6f0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/3745209243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e42ac22970 con 0x55e42ac2ecf0 2023-10-06T03:00:23.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8937fe700 1 -- 172.21.15.84:0/3745209243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8a400fac0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8c45b0b80 10 client.7530 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:23.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/3745209243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55e42a9bb010 con 0x55e42ac2ecf0 2023-10-06T03:00:23.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8937fe700 1 -- 172.21.15.84:0/3745209243 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e42ac22970 con 0x55e42ac2ecf0 2023-10-06T03:00:23.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8937fe700 1 -- 172.21.15.84:0/3745209243 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fa8a400fc20 con 0x55e42ac2ecf0 2023-10-06T03:00:23.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8c45b0b80 10 client.7530 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:23.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8c45b0b80 10 client.7530 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:23.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8c45b0b80 20 client.7530 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:23.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e42ac82f20 0x55e42ac8fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8c45b0b80 4 client.7530 mds_command: new command op to 7182 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/3745209243 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e42abff8a0 con 0x55e42ac82f20 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.034+0000 7fa8b9054700 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e42ac82f20 0x55e42ac8fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8937fe700 10 client.7530 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8b9054700 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e42ac82f20 0x55e42ac8fcd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=38b53b65a1c91af4 server_cookie=46c70fb3529471f0 in_seq=0 out_seq=0 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8937fe700 1 -- 172.21.15.84:0/3745209243 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e42abff8a0 con 0x55e42ac82f20 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8937fe700 10 client.7530 handle_command_reply: tid=0 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 client.7530 shutdown 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/3745209243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 msgr2=0x55e42ac6f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac6f110 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4000c00 tx=0x7fa8a4007040 comp rx=0 tx=0).stop 2023-10-06T03:00:23.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/3745209243 shutdown_connections 2023-10-06T03:00:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e42ac82f20 0x55e42ac8fcd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac858e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 0x55e42ac6f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/3745209243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac6f110 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8937fe700 0 client.7530 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/3745209243 >> 172.21.15.84:0/3745209243 conn(0x55e42ac2f190 msgr2=0x55e42ac30cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/3745209243 shutdown_connections 2023-10-06T03:00:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/3745209243 wait complete. 2023-10-06T03:00:23.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.035+0000 7fa8c45b0b80 20 client.7530 trim_cache size 0 max 16384 2023-10-06T03:00:23.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.051+0000 7fa8c45b0b80 1 Processor -- start 2023-10-06T03:00:23.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.051+0000 7fa8c45b0b80 1 -- start start 2023-10-06T03:00:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.051+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac29880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.051+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac29dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.051+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 0x55e42ac59420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.051+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e42ac26720 con 0x55e42ac2ecf0 2023-10-06T03:00:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.051+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e42ac6b200 con 0x55e42ac2d870 2023-10-06T03:00:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.051+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e42ac72230 con 0x55e42ac6b550 2023-10-06T03:00:23.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b8853700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac29dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b8853700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac29dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51794/0 (socket says 172.21.15.84:51794) 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b8853700 1 -- 172.21.15.84:0/1503214751 learned_addr learned my addr 172.21.15.84:0/1503214751 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b9054700 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac29880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b9855700 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 0x55e42ac59420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b8853700 1 -- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 msgr2=0x55e42ac59420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b8853700 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 0x55e42ac59420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b8853700 1 -- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 msgr2=0x55e42ac29880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b8853700 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac29880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b8853700 1 -- 172.21.15.84:0/1503214751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e42ac2df10 con 0x55e42ac2ecf0 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b9855700 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 0x55e42ac59420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:23.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b9054700 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac29880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa8b8853700 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac29dc0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4005a70 tx=0x7fa8a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6f8b4b0c876c90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa89effd700 1 -- 172.21.15.84:0/1503214751 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400f6f0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa89effd700 1 -- 172.21.15.84:0/1503214751 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a4000c30 con 0x55e42ac2ecf0 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.052+0000 7fa89effd700 1 -- 172.21.15.84:0/1503214751 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400fac0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1503214751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 msgr2=0x55e42ac29dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac29dc0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4005a70 tx=0x7fa8a4017000 comp rx=0 tx=0).stop 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1503214751 shutdown_connections 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2d870 0x55e42ac29880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac6b550 0x55e42ac59420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1503214751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac2ecf0 0x55e42ac29dc0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1503214751 >> 172.21.15.84:0/1503214751 conn(0x55e42ac2f190 msgr2=0x55e42ac56e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1503214751 shutdown_connections 2023-10-06T03:00:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1503214751 wait complete. 2023-10-06T03:00:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 -- start start 2023-10-06T03:00:23.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.053+0000 7fa8c45b0b80 1 Processor -- start 2023-10-06T03:00:23.061 DEBUG:teuthology.orchestra.run:got remote process result: 18 2023-10-06T03:00:23.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac2d870 0x55e42acd7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2ecf0 0x55e42ac8e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8c45b0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac6b550 0x55e42ac8ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e42acd83a0 con 0x55e42ac6b550 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e42acd80a0 con 0x55e42ac2ecf0 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8c45b0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e42ace3d10 con 0x55e42ac2d870 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8c45b0b80 10 client.0 _ll_register_callbacks cb 0x55e42abf0ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b9855700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac6b550 0x55e42ac8ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b9855700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac6b550 0x55e42ac8ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51804/0 (socket says 172.21.15.84:51804) 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b9855700 1 -- 172.21.15.84:0/1999067655 learned_addr learned my addr 172.21.15.84:0/1999067655 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b9054700 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac2d870 0x55e42acd7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b8853700 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2ecf0 0x55e42ac8e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b9855700 1 -- 172.21.15.84:0/1999067655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac2d870 msgr2=0x55e42acd7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b9855700 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac2d870 0x55e42acd7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b9855700 1 -- 172.21.15.84:0/1999067655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2ecf0 msgr2=0x55e42ac8e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b9855700 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2ecf0 0x55e42ac8e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.054+0000 7fa8b9855700 1 -- 172.21.15.84:0/1999067655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e42a9bb010 con 0x55e42ac6b550 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8b9855700 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac6b550 0x55e42ac8ec90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac082d70 tx=0x7fa8ac069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1cd1c4f5aecc2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8937fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8937fe700 1 -- 172.21.15.84:0/1999067655 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac055da0 con 0x55e42ac6b550 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8937fe700 1 -- 172.21.15.84:0/1999067655 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa8ac071050 con 0x55e42ac6b550 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1999067655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8ac0556a0 con 0x55e42ac6b550 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8937fe700 1 -- 172.21.15.84:0/1999067655 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8ac0122d0 con 0x55e42ac6b550 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8c45b0b80 10 client.7536 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:23.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1999067655 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55e42ab4c7b0 con 0x55e42ac6b550 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8937fe700 1 -- 172.21.15.84:0/1999067655 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac0556a0 con 0x55e42ac6b550 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8937fe700 1 -- 172.21.15.84:0/1999067655 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fa8ac05c1b0 con 0x55e42ac6b550 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8c45b0b80 10 client.7536 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8c45b0b80 10 client.7536 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8c45b0b80 20 client.7536 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e42ace2f00 0x55e42ace32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8c45b0b80 4 client.7536 mds_command: new command op to 7182 tid=0[{"prefix": "scrub pause"}] 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1999067655 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x55e42ab20e30 con 0x55e42ace2f00 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8b9054700 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e42ace2f00 0x55e42ace32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8937fe700 10 client.7536 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.055+0000 7fa8b9054700 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e42ace2f00 0x55e42ace32d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d700ccdc0f13389f server_cookie=f8aa9ae72e990ea0 in_seq=0 out_seq=0 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8937fe700 1 -- 172.21.15.84:0/1999067655 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x55e42ab20e30 con 0x55e42ace2f00 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8937fe700 10 client.7536 handle_command_reply: tid=0 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 client.7536 shutdown 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1999067655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac6b550 msgr2=0x55e42ac8ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac6b550 0x55e42ac8ec90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac082d70 tx=0x7fa8ac069000 comp rx=0 tx=0).stop 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1999067655 shutdown_connections 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x55e42ace2f00 0x55e42ace32d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e42ac6b550 0x55e42ac8ec90 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e42ac2d870 0x55e42acd7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 --2- 172.21.15.84:0/1999067655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e42ac2ecf0 0x55e42ac8e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8937fe700 0 client.7536 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:23.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1999067655 >> 172.21.15.84:0/1999067655 conn(0x55e42ac2f190 msgr2=0x55e42ac56e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1999067655 shutdown_connections 2023-10-06T03:00:23.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 1 -- 172.21.15.84:0/1999067655 wait complete. 2023-10-06T03:00:23.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.056+0000 7fa8c45b0b80 20 client.7536 trim_cache size 0 max 16384 2023-10-06T03:00:23.066 INFO:teuthology.orchestra.run.smithi084.stderr:Error EXDEV: Not rank 0 2023-10-06T03:00:23.066 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub resume 2023-10-06T03:00:23.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.184+0000 7f3ede5c1700 1 Processor -- start 2023-10-06T03:00:23.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.184+0000 7f3ede5c1700 1 -- start start 2023-10-06T03:00:23.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.184+0000 7f3ede5c1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 0x7f3ed80af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.184+0000 7f3ede5c1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed8069d50 con 0x7f3ed80684b0 2023-10-06T03:00:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.184+0000 7f3ede5c1700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed806a8d0 con 0x7f3ed81595f0 2023-10-06T03:00:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.184+0000 7f3ede5c1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8067930 con 0x7f3ed80c76b0 2023-10-06T03:00:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3edcb5e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3ed80684b0 0x7f3ed8068920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42330/0 (socket says 172.21.15.84:42330) 2023-10-06T03:00:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3edcb5e700 1 -- 172.21.15.84:0/2955800118 learned_addr learned my addr 172.21.15.84:0/2955800118 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/2955800118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 0x7f3ed80af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed6ffd700 1 -- 172.21.15.84:0/2955800118 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274847114 0 0) 0x7f3ed8069d50 con 0x7f3ed80684b0 2023-10-06T03:00:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed6ffd700 1 -- 172.21.15.84:0/2955800118 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec0003570 con 0x7f3ed80684b0 2023-10-06T03:00:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed77fe700 1 -- 172.21.15.84:0/2955800118 >> v1:172.21.15.131:6789/0 conn(0x7f3ed81595f0 legacy=0x7f3ed80c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed6ffd700 1 -- 172.21.15.84:0/2955800118 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047117404 0 0) 0x7f3ed806a8d0 con 0x7f3ed81595f0 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed77fe700 1 -- 172.21.15.84:0/2955800118 >> v1:172.21.15.84:6789/0 conn(0x7f3ed80684b0 legacy=0x7f3ed8068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed77fe700 1 -- 172.21.15.84:0/2955800118 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8069fa0 con 0x7f3ed80c76b0 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/2955800118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 0x7f3ed80af7f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009910 tx=0x7f3ecc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6595484d4127fdb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed6ffd700 1 -- 172.21.15.84:0/2955800118 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00b680 con 0x7f3ed80c76b0 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed6ffd700 1 -- 172.21.15.84:0/2955800118 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc00b7e0 con 0x7f3ed80c76b0 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.185+0000 7f3ed6ffd700 1 -- 172.21.15.84:0/2955800118 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00bba0 con 0x7f3ed80c76b0 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.186+0000 7f3ede5c1700 1 -- 172.21.15.84:0/2955800118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 msgr2=0x7f3ed80af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.186+0000 7f3ede5c1700 1 --2- 172.21.15.84:0/2955800118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 0x7f3ed80af7f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009910 tx=0x7f3ecc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.186+0000 7f3ede5c1700 1 -- 172.21.15.84:0/2955800118 shutdown_connections 2023-10-06T03:00:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.186+0000 7f3ede5c1700 1 --2- 172.21.15.84:0/2955800118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 0x7f3ed80af7f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.186+0000 7f3ede5c1700 1 -- 172.21.15.84:0/2955800118 >> 172.21.15.84:0/2955800118 conn(0x7f3ed80cd430 msgr2=0x7f3ed80c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.186+0000 7f3ede5c1700 1 -- 172.21.15.84:0/2955800118 shutdown_connections 2023-10-06T03:00:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.186+0000 7f3ede5c1700 1 -- 172.21.15.84:0/2955800118 wait complete. 2023-10-06T03:00:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.187+0000 7f3ede5c1700 1 Processor -- start 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.187+0000 7f3ede5c1700 1 -- start start 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ede5c1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80684b0 0x7f3ed80c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ede5c1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 0x7f3ed815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ede5c1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ed81595f0 0x7f3ed8144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ede5c1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed815c190 con 0x7f3ed80684b0 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ede5c1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed815b320 con 0x7f3ed81595f0 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ede5c1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed815b580 con 0x7f3ed80c76b0 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80684b0 0x7f3ed80c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80684b0 0x7f3ed80c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51806/0 (socket says 172.21.15.84:51806) 2023-10-06T03:00:23.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed7fff700 1 -- 172.21.15.84:0/1990787612 learned_addr learned my addr 172.21.15.84:0/1990787612 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3edcb5e700 1 --2- 172.21.15.84:0/1990787612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ed81595f0 0x7f3ed8144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/1990787612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 0x7f3ed815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed7fff700 1 -- 172.21.15.84:0/1990787612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 msgr2=0x7f3ed815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/1990787612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 0x7f3ed815ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed7fff700 1 -- 172.21.15.84:0/1990787612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ed81595f0 msgr2=0x7f3ed8144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/1990787612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ed81595f0 0x7f3ed8144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed7fff700 1 -- 172.21.15.84:0/1990787612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc009420 con 0x7f3ed80684b0 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/1990787612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ed80c76b0 0x7f3ed815ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.188+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/1990787612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ed80684b0 0x7f3ed80c6f40 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c7e0 tx=0x7f3ec8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.189+0000 7f3ebffff700 1 -- 172.21.15.84:0/1990787612 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8011590 con 0x7f3ed80684b0 2023-10-06T03:00:23.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.189+0000 7f3ebffff700 1 -- 172.21.15.84:0/1990787612 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec8011710 con 0x7f3ed80684b0 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.189+0000 7f3ede5c1700 1 -- 172.21.15.84:0/1990787612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed815b860 con 0x7f3ed80684b0 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.189+0000 7f3ebffff700 1 -- 172.21.15.84:0/1990787612 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8011ad0 con 0x7f3ed80684b0 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.189+0000 7f3ede5c1700 1 -- 172.21.15.84:0/1990787612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed815be20 con 0x7f3ed80684b0 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.190+0000 7f3ebffff700 1 -- 172.21.15.84:0/1990787612 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ec801b3b0 con 0x7f3ed80684b0 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.190+0000 7f3ebffff700 1 --2- 172.21.15.84:0/1990787612 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ec4066f30 0x7f3ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.191+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/1990787612 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ec4066f30 0x7f3ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.191+0000 7f3ebffff700 1 -- 172.21.15.84:0/1990787612 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3ec8083d20 con 0x7f3ed80684b0 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.191+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/1990787612 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ec4066f30 0x7f3ec40693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009910 tx=0x7f3ecc017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.192+0000 7f3ee78b9b80 1 Processor -- start 2023-10-06T03:00:23.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.192+0000 7f3ee78b9b80 1 -- start start 2023-10-06T03:00:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.193+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314dde2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.193+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314de32700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.193+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314de33090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.193+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314dd39ab0 con 0x56314dde3d00 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.193+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314dd372b0 con 0x56314dde2880 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.193+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56314dd330a0 con 0x56314de32c40 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.193+0000 7f3ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314de32700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.193+0000 7f3ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314de32700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51816/0 (socket says 172.21.15.84:51816) 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.193+0000 7f3ed77fe700 1 -- 172.21.15.84:0/3549233070 learned_addr learned my addr 172.21.15.84:0/3549233070 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314dde2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3edcb5e700 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314de33090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ed77fe700 1 -- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 msgr2=0x56314de33090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314de33090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ed77fe700 1 -- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 msgr2=0x56314dde2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314dde2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ed77fe700 1 -- 172.21.15.84:0/3549233070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56314dbcd2b0 con 0x56314dde3d00 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314dde2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3edcb5e700 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314de33090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314de32700 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f3ed806d940 tx=0x7f3ecc021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bc1bf4ecb031c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ebd7fa700 1 -- 172.21.15.84:0/3549233070 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc021070 con 0x56314dde3d00 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ebd7fa700 1 -- 172.21.15.84:0/3549233070 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc033480 con 0x56314dde3d00 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.194+0000 7f3ebd7fa700 1 -- 172.21.15.84:0/3549233070 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00b680 con 0x56314dde3d00 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3549233070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 msgr2=0x56314de32700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314de32700 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f3ed806d940 tx=0x7f3ecc021000 comp rx=0 tx=0).stop 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3549233070 shutdown_connections 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314dde2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314de33090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/3549233070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314de32700 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3549233070 >> 172.21.15.84:0/3549233070 conn(0x56314dde41a0 msgr2=0x56314dde4570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3549233070 shutdown_connections 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3549233070 wait complete. 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 -- start start 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.195+0000 7f3ee78b9b80 1 Processor -- start 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314de3cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314dddf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314dddf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314dcde8d0 con 0x56314dde3d00 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314dcf9ee0 con 0x56314dde2880 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56314dbb5e70 con 0x56314de32c40 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ee78b9b80 10 client.0 _ll_register_callbacks cb 0x56314dda5eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314dddf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314dddf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51822/0 (socket says 172.21.15.84:51822) 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed77fe700 1 -- 172.21.15.84:0/720165211 learned_addr learned my addr 172.21.15.84:0/720165211 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3edcb5e700 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314dddf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314de3cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed77fe700 1 -- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 msgr2=0x56314dddf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314dddf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed77fe700 1 -- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 msgr2=0x56314de3cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314de3cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed77fe700 1 -- 172.21.15.84:0/720165211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed8069fa0 con 0x56314dde3d00 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3edcb5e700 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314dddf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.196+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314de3cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314dddf440 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009fb0 tx=0x7f3ecc02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b2e763f220bf78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3eb67fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3eb67fc700 1 -- 172.21.15.84:0/720165211 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc021070 con 0x56314dde3d00 2023-10-06T03:00:23.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3eb67fc700 1 -- 172.21.15.84:0/720165211 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3ecc01b640 con 0x56314dde3d00 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/720165211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56314ddd7980 con 0x56314dde3d00 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3eb67fc700 1 -- 172.21.15.84:0/720165211 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ecc033ea0 con 0x56314dde3d00 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ee78b9b80 10 client.7548 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/720165211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x56314db70020 con 0x56314dde3d00 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3eb67fc700 1 -- 172.21.15.84:0/720165211 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56314ddd7980 con 0x56314dde3d00 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3eb67fc700 1 -- 172.21.15.84:0/720165211 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f3ecc01ba10 con 0x56314dde3d00 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ee78b9b80 10 client.7548 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ee78b9b80 10 client.7548 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ee78b9b80 20 client.7548 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x56314de23190 0x56314de23560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ee78b9b80 4 client.7548 mds_command: new command op to 7182 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:23.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/720165211 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56314ddb48b0 con 0x56314de23190 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.197+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x56314de23190 0x56314de23560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3eb67fc700 10 client.7548 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x56314de23190 0x56314de23560 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7aadf3c57a084dac server_cookie=c40456c661abc0c9 in_seq=0 out_seq=0 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3eb67fc700 1 -- 172.21.15.84:0/720165211 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56314ddb48b0 con 0x56314de23190 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3eb67fc700 10 client.7548 handle_command_reply: tid=0 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 client.7548 shutdown 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/720165211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 msgr2=0x56314dddf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314dddf440 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009fb0 tx=0x7f3ecc02c040 comp rx=0 tx=0).stop 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/720165211 shutdown_connections 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x56314de23190 0x56314de23560 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde2880 0x56314de3cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314de32c40 0x56314dddf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3eb67fc700 0 client.7548 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/720165211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde3d00 0x56314dddf440 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/720165211 >> 172.21.15.84:0/720165211 conn(0x56314dde41a0 msgr2=0x56314de26010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/720165211 shutdown_connections 2023-10-06T03:00:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/720165211 wait complete. 2023-10-06T03:00:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.198+0000 7f3ee78b9b80 20 client.7548 trim_cache size 0 max 16384 2023-10-06T03:00:23.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.214+0000 7f3ee78b9b80 1 Processor -- start 2023-10-06T03:00:23.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.214+0000 7f3ee78b9b80 1 -- start start 2023-10-06T03:00:23.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 0x56314de12340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de25ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 0x56314de26530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314de29f30 con 0x56314dde2880 2023-10-06T03:00:23.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314dde0230 con 0x56314dde3d00 2023-10-06T03:00:23.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56314de2c330 con 0x56314dde41a0 2023-10-06T03:00:23.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de25ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de25ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51832/0 (socket says 172.21.15.84:51832) 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed77fe700 1 -- 172.21.15.84:0/3153450672 learned_addr learned my addr 172.21.15.84:0/3153450672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/3153450672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 0x56314de12340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed77fe700 1 -- 172.21.15.84:0/3153450672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 msgr2=0x56314de12340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/3153450672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 0x56314de12340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3edcb5e700 1 --2- 172.21.15.84:0/3153450672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 0x56314de26530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed77fe700 1 -- 172.21.15.84:0/3153450672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 msgr2=0x56314de26530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/3153450672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 0x56314de26530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed77fe700 1 -- 172.21.15.84:0/3153450672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56314dd017c0 con 0x56314dde2880 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/3153450672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de25ff0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc011e70 tx=0x7f3ecc035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57da5e8e23835fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ebdffb700 1 -- 172.21.15.84:0/3153450672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc021040 con 0x56314dde2880 2023-10-06T03:00:23.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ebdffb700 1 -- 172.21.15.84:0/3153450672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc01b640 con 0x56314dde2880 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.215+0000 7f3ebdffb700 1 -- 172.21.15.84:0/3153450672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc006b30 con 0x56314dde2880 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.216+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3153450672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 msgr2=0x56314de25ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.216+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/3153450672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de25ff0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc011e70 tx=0x7f3ecc035040 comp rx=0 tx=0).stop 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.216+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3153450672 shutdown_connections 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.216+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/3153450672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 0x56314de26530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.216+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/3153450672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 0x56314de12340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.216+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/3153450672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de25ff0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.216+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3153450672 >> 172.21.15.84:0/3153450672 conn(0x56314de12d50 msgr2=0x56314de28e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.216+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3153450672 shutdown_connections 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.216+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/3153450672 wait complete. 2023-10-06T03:00:23.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ee78b9b80 1 -- start start 2023-10-06T03:00:23.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ee78b9b80 1 Processor -- start 2023-10-06T03:00:23.223 DEBUG:teuthology.orchestra.run:got remote process result: 18 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de8ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 0x56314de28e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ee78b9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 0x56314de293d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314de8e830 con 0x56314dde2880 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56314de0b610 con 0x56314dde3d00 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ee78b9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56314de2dc80 con 0x56314dde41a0 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ee78b9b80 10 client.0 _ll_register_callbacks cb 0x56314dda5eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de8ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ed7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de8ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51838/0 (socket says 172.21.15.84:51838) 2023-10-06T03:00:23.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.217+0000 7f3ed7fff700 1 -- 172.21.15.84:0/1666206968 learned_addr learned my addr 172.21.15.84:0/1666206968 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ed7fff700 1 -- 172.21.15.84:0/1666206968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 msgr2=0x56314de293d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 0x56314de28e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3edcb5e700 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 0x56314de293d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 0x56314de293d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ed7fff700 1 -- 172.21.15.84:0/1666206968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 msgr2=0x56314de28e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 0x56314de28e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ed7fff700 1 -- 172.21.15.84:0/1666206968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56314db70020 con 0x56314dde2880 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ed7fff700 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de8ba80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8050eb0 tx=0x7f3ec8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0b6364452aaa23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3eb67fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3eb67fc700 1 -- 172.21.15.84:0/1666206968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8052d50 con 0x56314dde2880 2023-10-06T03:00:23.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3eb67fc700 1 -- 172.21.15.84:0/1666206968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3ec8053ea0 con 0x56314dde2880 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/1666206968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ecc033480 con 0x56314dde2880 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3eb67fc700 1 -- 172.21.15.84:0/1666206968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ec805b4c0 con 0x56314dde2880 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ee78b9b80 10 client.7554 fetch_fsmap learned FSMap version 75 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/1666206968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x56314dce84b0 con 0x56314dde2880 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3eb67fc700 1 -- 172.21.15.84:0/1666206968 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec805f080 con 0x56314dde2880 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3eb67fc700 1 -- 172.21.15.84:0/1666206968 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 75) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f3ec805bba0 con 0x56314dde2880 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ee78b9b80 10 client.7554 fetch_fsmap finished waiting for FSMap version 75 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ee78b9b80 10 client.7554 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ee78b9b80 20 client.7554 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x56314de32c40 0x56314de1f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ee78b9b80 4 client.7554 mds_command: new command op to 7182 tid=0[{"prefix": "scrub resume"}] 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/1666206968 --> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x56314dcd5e40 con 0x56314de32c40 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.218+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x56314de32c40 0x56314de1f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3eb67fc700 10 client.7554 ms_handle_connect on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ed77fe700 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x56314de32c40 0x56314de1f930 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90af4bf8868e7f49 server_cookie=91377e0ddf8dfa8c in_seq=0 out_seq=0 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3eb67fc700 1 -- 172.21.15.84:0/1666206968 <== mds.1 v2:172.21.15.84:6834/2917413983 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x56314dcd5e40 con 0x56314de32c40 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3eb67fc700 10 client.7554 handle_command_reply: tid=0 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 client.7554 shutdown 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/1666206968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 msgr2=0x56314de8ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de8ba80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8050eb0 tx=0x7f3ec8014040 comp rx=0 tx=0).stop 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/1666206968 shutdown_connections 2023-10-06T03:00:23.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.84:6834/2917413983,v1:172.21.15.84:6836/2917413983] conn(0x56314de32c40 0x56314de1f930 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56314dde41a0 0x56314de293d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56314dde2880 0x56314de8ba80 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3eb67fc700 0 client.7554 ms_handle_reset on v2:172.21.15.84:6834/2917413983 2023-10-06T03:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 --2- 172.21.15.84:0/1666206968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56314dde3d00 0x56314de28e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/1666206968 >> 172.21.15.84:0/1666206968 conn(0x56314de12d50 msgr2=0x56314dde31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/1666206968 shutdown_connections 2023-10-06T03:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 1 -- 172.21.15.84:0/1666206968 wait complete. 2023-10-06T03:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.219+0000 7f3ee78b9b80 20 client.7554 trim_cache size 0 max 16384 2023-10-06T03:00:23.228 INFO:teuthology.orchestra.run.smithi084.stderr:Error EXDEV: Not rank 0 2023-10-06T03:00:23.229 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:00:23.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:00:23.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:00:23.309 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:00:23.309 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:00:23.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:23.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:23.349 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:00:23.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:23.349 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:00:23.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:23.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.557+0000 7fe0a206e700 1 Processor -- start 2023-10-06T03:00:23.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.557+0000 7fe0a206e700 1 -- start start 2023-10-06T03:00:23.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe0a206e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe09c1595a0 0x7fe09c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe0a206e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe09c0b07a0 0x7fe09c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe0a206e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c0b0ca0 con 0x7fe09c0b49e0 2023-10-06T03:00:23.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe0a206e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0b0f80 con 0x7fe09c0b07a0 2023-10-06T03:00:23.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe0a206e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0b1260 con 0x7fe09c1595a0 2023-10-06T03:00:23.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe09bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe09c0b07a0 0x7fe09c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe09bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe09c0b07a0 0x7fe09c0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51840/0 (socket says 172.21.15.84:51840) 2023-10-06T03:00:23.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe09bfff700 1 -- 172.21.15.84:0/4283470341 learned_addr learned my addr 172.21.15.84:0/4283470341 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe09b7fe700 1 --2- 172.21.15.84:0/4283470341 >> v2:172.21.15.131:3300/0 conn(0x7fe09c1595a0 0x7fe09c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe09bfff700 1 -- 172.21.15.84:0/4283470341 >> v2:172.21.15.131:3300/0 conn(0x7fe09c1595a0 msgr2=0x7fe09c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.558+0000 7fe09bfff700 1 --2- 172.21.15.84:0/4283470341 >> v2:172.21.15.131:3300/0 conn(0x7fe09c1595a0 0x7fe09c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe09bfff700 1 -- 172.21.15.84:0/4283470341 >> v1:172.21.15.131:6789/0 conn(0x7fe09c0b49e0 legacy=0x7fe09c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:23.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe09bfff700 1 -- 172.21.15.84:0/4283470341 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0b1540 con 0x7fe09c0b07a0 2023-10-06T03:00:23.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe09b7fe700 1 --2- 172.21.15.84:0/4283470341 >> v2:172.21.15.131:3300/0 conn(0x7fe09c1595a0 0x7fe09c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:23.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe09bfff700 1 --2- 172.21.15.84:0/4283470341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b07a0 0x7fe09c0b1c00 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fe094009f20 tx=0x7fe094009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53cca2cdf09ed0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe09a7fc700 1 -- 172.21.15.84:0/4283470341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400e070 con 0x7fe09c0b07a0 2023-10-06T03:00:23.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe09a7fc700 1 -- 172.21.15.84:0/4283470341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09400ba00 con 0x7fe09c0b07a0 2023-10-06T03:00:23.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe09a7fc700 1 -- 172.21.15.84:0/4283470341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940092e0 con 0x7fe09c0b07a0 2023-10-06T03:00:23.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe0a206e700 1 -- 172.21.15.84:0/4283470341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b07a0 msgr2=0x7fe09c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe0a206e700 1 --2- 172.21.15.84:0/4283470341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b07a0 0x7fe09c0b1c00 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fe094009f20 tx=0x7fe094009840 comp rx=0 tx=0).stop 2023-10-06T03:00:23.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe0a206e700 1 -- 172.21.15.84:0/4283470341 shutdown_connections 2023-10-06T03:00:23.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe0a206e700 1 --2- 172.21.15.84:0/4283470341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b07a0 0x7fe09c0b1c00 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe0a206e700 1 --2- 172.21.15.84:0/4283470341 >> v2:172.21.15.131:3300/0 conn(0x7fe09c1595a0 0x7fe09c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe0a206e700 1 -- 172.21.15.84:0/4283470341 >> 172.21.15.84:0/4283470341 conn(0x7fe09c099830 msgr2=0x7fe09c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe0a206e700 1 -- 172.21.15.84:0/4283470341 shutdown_connections 2023-10-06T03:00:23.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.559+0000 7fe0a206e700 1 -- 172.21.15.84:0/4283470341 wait complete. 2023-10-06T03:00:23.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe0a206e700 1 Processor -- start 2023-10-06T03:00:23.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe0a206e700 1 -- start start 2023-10-06T03:00:23.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe0a206e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09c0b07a0 0x7fe09c16a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe0a206e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b49e0 0x7fe09c16c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe0a206e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe09c1595a0 0x7fe09c169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe0a206e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c15a060 con 0x7fe09c0b49e0 2023-10-06T03:00:23.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe0a206e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c16c5c0 con 0x7fe09c1595a0 2023-10-06T03:00:23.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe0a206e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c16a150 con 0x7fe09c0b07a0 2023-10-06T03:00:23.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe09affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b49e0 0x7fe09c16c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe09affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b49e0 0x7fe09c16c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51844/0 (socket says 172.21.15.84:51844) 2023-10-06T03:00:23.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe09affd700 1 -- 172.21.15.84:0/122213254 learned_addr learned my addr 172.21.15.84:0/122213254 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.561+0000 7fe09bfff700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe09c1595a0 0x7fe09c169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe09b7fe700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09c0b07a0 0x7fe09c16a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe09affd700 1 -- 172.21.15.84:0/122213254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09c0b07a0 msgr2=0x7fe09c16a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe09affd700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09c0b07a0 0x7fe09c16a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe09affd700 1 -- 172.21.15.84:0/122213254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe09c1595a0 msgr2=0x7fe09c169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe09affd700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe09c1595a0 0x7fe09c169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe09affd700 1 -- 172.21.15.84:0/122213254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094009ae0 con 0x7fe09c0b49e0 2023-10-06T03:00:23.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe09affd700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b49e0 0x7fe09c16c080 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fe090002ee0 tx=0x7fe090007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe0837fe700 1 -- 172.21.15.84:0/122213254 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090016070 con 0x7fe09c0b49e0 2023-10-06T03:00:23.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe0837fe700 1 -- 172.21.15.84:0/122213254 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090006820 con 0x7fe09c0b49e0 2023-10-06T03:00:23.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c15c2a0 con 0x7fe09c0b49e0 2023-10-06T03:00:23.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe0837fe700 1 -- 172.21.15.84:0/122213254 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090006bc0 con 0x7fe09c0b49e0 2023-10-06T03:00:23.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.562+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c15c860 con 0x7fe09c0b49e0 2023-10-06T03:00:23.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.563+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c15a1f0 con 0x7fe09c0b49e0 2023-10-06T03:00:23.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.563+0000 7fe0837fe700 1 -- 172.21.15.84:0/122213254 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe090007020 con 0x7fe09c0b49e0 2023-10-06T03:00:23.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.564+0000 7fe0837fe700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.564+0000 7fe0837fe700 1 -- 172.21.15.84:0/122213254 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe090083ef0 con 0x7fe09c0b49e0 2023-10-06T03:00:23.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.564+0000 7fe09b7fe700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.564+0000 7fe09b7fe700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00aca0 tx=0x7fe08c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.568+0000 7fe0837fe700 1 -- 172.21.15.84:0/122213254 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe090050ec0 con 0x7fe09c0b49e0 2023-10-06T03:00:23.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.795+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe09c064ad0 con 0x7fe09c0b49e0 2023-10-06T03:00:23.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.795+0000 7fe0837fe700 1 -- 172.21.15.84:0/122213254 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4637 (secure 0 0 0) 0x7fe0900544e0 con 0x7fe09c0b49e0 2023-10-06T03:00:23.796 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:23.796 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":75,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T03:00:21.161468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7185,"mds_1":7182,"mds_2":6382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6382":{"gid":6382,"name":"d","rank":2,"incarnation":72,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7182":{"gid":7182,"name":"a","rank":1,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 msgr2=0x7fe0880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00aca0 tx=0x7fe08c008040 comp rx=0 tx=0).stop 2023-10-06T03:00:23.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b49e0 msgr2=0x7fe09c16c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b49e0 0x7fe09c16c080 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fe090002ee0 tx=0x7fe090007f20 comp rx=0 tx=0).stop 2023-10-06T03:00:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 shutdown_connections 2023-10-06T03:00:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe09c1595a0 0x7fe09c169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09c0b07a0 0x7fe09c16a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 --2- 172.21.15.84:0/122213254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe09c0b49e0 0x7fe09c16c080 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.797+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 >> 172.21.15.84:0/122213254 conn(0x7fe09c099830 msgr2=0x7fe09c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.798+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 shutdown_connections 2023-10-06T03:00:23.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.798+0000 7fe0a206e700 1 -- 172.21.15.84:0/122213254 wait complete. 2023-10-06T03:00:23.800 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 75 2023-10-06T03:00:23.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.925+0000 7fa2b977b700 1 Processor -- start 2023-10-06T03:00:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.925+0000 7fa2b977b700 1 -- start start 2023-10-06T03:00:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b977b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2b40b29f0 0x7fa2b4159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b977b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b40b0de0 con 0x7fa2b40b2620 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b977b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b40cbfe0 con 0x7fa2b41596a0 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b977b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b40cb3d0 con 0x7fa2b40b29f0 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b27fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2b40b29f0 0x7fa2b4159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b2ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa2b40b2620 0x7fa2b40b06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42334/0 (socket says 172.21.15.84:42334) 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b2ffd700 1 -- 172.21.15.84:0/2120181802 learned_addr learned my addr 172.21.15.84:0/2120181802 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b27fc700 1 -- 172.21.15.84:0/2120181802 >> v1:172.21.15.131:6789/0 conn(0x7fa2b41596a0 legacy=0x7fa2b40cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b27fc700 1 -- 172.21.15.84:0/2120181802 >> v1:172.21.15.84:6789/0 conn(0x7fa2b40b2620 legacy=0x7fa2b40b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b27fc700 1 -- 172.21.15.84:0/2120181802 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b40cb6b0 con 0x7fa2b40b29f0 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b27fc700 1 --2- 172.21.15.84:0/2120181802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 0x7fa2b4159160 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80098e0 tx=0x7fa2a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c74ec4f2ede9bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b1ffb700 1 -- 172.21.15.84:0/2120181802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8009e80 con 0x7fa2b40b29f0 2023-10-06T03:00:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b1ffb700 1 -- 172.21.15.84:0/2120181802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a800b860 con 0x7fa2b40b29f0 2023-10-06T03:00:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.926+0000 7fa2b1ffb700 1 -- 172.21.15.84:0/2120181802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a800bbe0 con 0x7fa2b40b29f0 2023-10-06T03:00:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.927+0000 7fa2b977b700 1 -- 172.21.15.84:0/2120181802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 msgr2=0x7fa2b4159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.927+0000 7fa2b977b700 1 --2- 172.21.15.84:0/2120181802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 0x7fa2b4159160 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fa2a80098e0 tx=0x7fa2a80091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.927+0000 7fa2b977b700 1 -- 172.21.15.84:0/2120181802 shutdown_connections 2023-10-06T03:00:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.927+0000 7fa2b977b700 1 --2- 172.21.15.84:0/2120181802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 0x7fa2b4159160 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.927+0000 7fa2b977b700 1 -- 172.21.15.84:0/2120181802 >> 172.21.15.84:0/2120181802 conn(0x7fa2b406ed20 msgr2=0x7fa2b406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.927+0000 7fa2b977b700 1 -- 172.21.15.84:0/2120181802 shutdown_connections 2023-10-06T03:00:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.927+0000 7fa2b977b700 1 -- 172.21.15.84:0/2120181802 wait complete. 2023-10-06T03:00:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.928+0000 7fa2b977b700 1 Processor -- start 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.928+0000 7fa2b977b700 1 -- start start 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b977b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b40b2620 0x7fa2b4157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b977b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 0x7fa2b4158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b977b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b41596a0 0x7fa2b416a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b977b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40c6ab0 con 0x7fa2b40b29f0 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b977b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40c5ea0 con 0x7fa2b40b2620 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b977b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40c6180 con 0x7fa2b41596a0 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 0x7fa2b4158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 0x7fa2b4158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51852/0 (socket says 172.21.15.84:51852) 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b27fc700 1 -- 172.21.15.84:0/2268178508 learned_addr learned my addr 172.21.15.84:0/2268178508 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b37fe700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b41596a0 0x7fa2b416a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b2ffd700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b40b2620 0x7fa2b4157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b27fc700 1 -- 172.21.15.84:0/2268178508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b41596a0 msgr2=0x7fa2b416a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b27fc700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b41596a0 0x7fa2b416a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b27fc700 1 -- 172.21.15.84:0/2268178508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b40b2620 msgr2=0x7fa2b4157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b27fc700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b40b2620 0x7fa2b4157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.929+0000 7fa2b27fc700 1 -- 172.21.15.84:0/2268178508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8009420 con 0x7fa2b40b29f0 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.930+0000 7fa2b27fc700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 0x7fa2b4158440 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40696d0 tx=0x7fa2a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.930+0000 7fa29affd700 1 -- 172.21.15.84:0/2268178508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8011420 con 0x7fa2b40b29f0 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.930+0000 7fa29affd700 1 -- 172.21.15.84:0/2268178508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a8011580 con 0x7fa2b40b29f0 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.930+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b40c6460 con 0x7fa2b40b29f0 2023-10-06T03:00:23.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.930+0000 7fa29affd700 1 -- 172.21.15.84:0/2268178508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8011940 con 0x7fa2b40b29f0 2023-10-06T03:00:23.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.930+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b416a5f0 con 0x7fa2b40b29f0 2023-10-06T03:00:23.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.931+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b416adb0 con 0x7fa2b40b29f0 2023-10-06T03:00:23.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.931+0000 7fa29affd700 1 -- 172.21.15.84:0/2268178508 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2a8011cf0 con 0x7fa2b40b29f0 2023-10-06T03:00:23.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.931+0000 7fa29affd700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2a0066f30 0x7fa2a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:23.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.932+0000 7fa29affd700 1 -- 172.21.15.84:0/2268178508 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa2a8086210 con 0x7fa2b40b29f0 2023-10-06T03:00:23.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.932+0000 7fa2b2ffd700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2a0066f30 0x7fa2a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:23.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.932+0000 7fa2b2ffd700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2a0066f30 0x7fa2a00693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40b0460 tx=0x7fa2a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:23.936+0000 7fa29affd700 1 -- 172.21.15.84:0/2268178508 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2b416adb0 con 0x7fa2b40b29f0 2023-10-06T03:00:24.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.122+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2b416adb0 con 0x7fa2b40b29f0 2023-10-06T03:00:24.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.123+0000 7fa29affd700 1 -- 172.21.15.84:0/2268178508 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fa2b416adb0 con 0x7fa2b40b29f0 2023-10-06T03:00:24.124 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:24.124 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":82,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:59:57.647692+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:53.640511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:54.978352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2a0066f30 msgr2=0x7fa2a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2a0066f30 0x7fa2a00693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40b0460 tx=0x7fa2a4009040 comp rx=0 tx=0).stop 2023-10-06T03:00:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 msgr2=0x7fa2b4158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 0x7fa2b4158440 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40696d0 tx=0x7fa2a8017000 comp rx=0 tx=0).stop 2023-10-06T03:00:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 shutdown_connections 2023-10-06T03:00:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2a0066f30 0x7fa2a00693e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2b40b2620 0x7fa2b4157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa2b41596a0 0x7fa2b416a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 --2- 172.21.15.84:0/2268178508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2b40b29f0 0x7fa2b4158440 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 >> 172.21.15.84:0/2268178508 conn(0x7fa2b406ed20 msgr2=0x7fa2b40b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 shutdown_connections 2023-10-06T03:00:24.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.125+0000 7fa2b977b700 1 -- 172.21.15.84:0/2268178508 wait complete. 2023-10-06T03:00:24.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T02:59:53.640511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T02:59:54.978352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:00:24.138 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:00:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.255+0000 7f16cf47b700 1 Processor -- start 2023-10-06T03:00:24.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.255+0000 7f16cf47b700 1 -- start start 2023-10-06T03:00:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cf47b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 0x7f16c80cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cf47b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16c80b2a30 0x7f16c80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cf47b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c80cc9b0 con 0x7f16c80ceae0 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cf47b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c80cbda0 con 0x7f16c80b2a30 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cf47b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80cc080 con 0x7f16c80b2660 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cdc78700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16c80b2a30 0x7f16c80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cdc78700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16c80b2a30 0x7f16c80cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51866/0 (socket says 172.21.15.84:51866) 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cdc78700 1 -- 172.21.15.84:0/2712427868 learned_addr learned my addr 172.21.15.84:0/2712427868 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16ce479700 1 --2- 172.21.15.84:0/2712427868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 0x7f16c80cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cdc78700 1 -- 172.21.15.84:0/2712427868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 msgr2=0x7f16c80cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cdc78700 1 --2- 172.21.15.84:0/2712427868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 0x7f16c80cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cdc78700 1 -- 172.21.15.84:0/2712427868 >> v1:172.21.15.131:6789/0 conn(0x7f16c80ceae0 legacy=0x7f16c80cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cdc78700 1 -- 172.21.15.84:0/2712427868 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80cc360 con 0x7f16c80b2a30 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cdc78700 1 --2- 172.21.15.84:0/2712427868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 0x7f16c80cd230 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f16b80099b0 tx=0x7f16b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab689896128f18d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cd477700 1 -- 172.21.15.84:0/2712427868 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8009ea0 con 0x7f16c80b2a30 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cd477700 1 -- 172.21.15.84:0/2712427868 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b800b860 con 0x7f16c80b2a30 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.256+0000 7f16cd477700 1 -- 172.21.15.84:0/2712427868 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800bc00 con 0x7f16c80b2a30 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.257+0000 7f16cf47b700 1 -- 172.21.15.84:0/2712427868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 msgr2=0x7f16c80cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.257+0000 7f16cf47b700 1 --2- 172.21.15.84:0/2712427868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 0x7f16c80cd230 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f16b80099b0 tx=0x7f16b8009250 comp rx=0 tx=0).stop 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.257+0000 7f16cf47b700 1 -- 172.21.15.84:0/2712427868 shutdown_connections 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.257+0000 7f16cf47b700 1 --2- 172.21.15.84:0/2712427868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 0x7f16c80cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.257+0000 7f16cf47b700 1 --2- 172.21.15.84:0/2712427868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 0x7f16c80cd230 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.257+0000 7f16cf47b700 1 -- 172.21.15.84:0/2712427868 >> 172.21.15.84:0/2712427868 conn(0x7f16c8099560 msgr2=0x7f16c806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.257+0000 7f16cf47b700 1 -- 172.21.15.84:0/2712427868 shutdown_connections 2023-10-06T03:00:24.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.257+0000 7f16cf47b700 1 -- 172.21.15.84:0/2712427868 wait complete. 2023-10-06T03:00:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.258+0000 7f16cf47b700 1 Processor -- start 2023-10-06T03:00:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.258+0000 7f16cf47b700 1 -- start start 2023-10-06T03:00:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cf47b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 0x7f16c814cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cf47b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 0x7f16c809b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cf47b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c80ceae0 0x7f16c80cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cf47b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c815b050 con 0x7f16c80b2a30 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cf47b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c815b2c0 con 0x7f16c80ceae0 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cf47b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c815b5a0 con 0x7f16c80b2660 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cdc78700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 0x7f16c809b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cdc78700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 0x7f16c809b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51870/0 (socket says 172.21.15.84:51870) 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cdc78700 1 -- 172.21.15.84:0/3478314523 learned_addr learned my addr 172.21.15.84:0/3478314523 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16ce479700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 0x7f16c814cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cec7a700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c80ceae0 0x7f16c80cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cdc78700 1 -- 172.21.15.84:0/3478314523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 msgr2=0x7f16c814cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cdc78700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 0x7f16c814cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cdc78700 1 -- 172.21.15.84:0/3478314523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c80ceae0 msgr2=0x7f16c80cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cdc78700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c80ceae0 0x7f16c80cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cdc78700 1 -- 172.21.15.84:0/3478314523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80094f0 con 0x7f16c80b2a30 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cec7a700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c80ceae0 0x7f16c80cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cdc78700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 0x7f16c809b690 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f16c806fd00 tx=0x7f16b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16be7fc700 1 -- 172.21.15.84:0/3478314523 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800b9d0 con 0x7f16c80b2a30 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16be7fc700 1 -- 172.21.15.84:0/3478314523 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b800bb30 con 0x7f16c80b2a30 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c815b880 con 0x7f16c80b2a30 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.259+0000 7f16be7fc700 1 -- 172.21.15.84:0/3478314523 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8025630 con 0x7f16c80b2a30 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.260+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c809bbd0 con 0x7f16c80b2a30 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.260+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c815bac0 con 0x7f16c80b2a30 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.261+0000 7f16be7fc700 1 -- 172.21.15.84:0/3478314523 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16b8023070 con 0x7f16c80b2a30 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.261+0000 7f16be7fc700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.261+0000 7f16be7fc700 1 -- 172.21.15.84:0/3478314523 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f16b8085cb0 con 0x7f16c80b2a30 2023-10-06T03:00:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.261+0000 7f16ce479700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.262+0000 7f16ce479700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16ac066f30 0x7f16ac0693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f16c80ca5e0 tx=0x7f16c400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:24.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.265+0000 7f16be7fc700 1 -- 172.21.15.84:0/3478314523 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16c815bac0 con 0x7f16c80b2a30 2023-10-06T03:00:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.447+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16c815bac0 con 0x7f16c80b2a30 2023-10-06T03:00:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.448+0000 7f16be7fc700 1 -- 172.21.15.84:0/3478314523 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16c815bac0 con 0x7f16c80b2a30 2023-10-06T03:00:24.449 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16ac066f30 msgr2=0x7f16ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16ac066f30 0x7f16ac0693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f16c80ca5e0 tx=0x7f16c400b040 comp rx=0 tx=0).stop 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 msgr2=0x7f16c809b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 0x7f16c809b690 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f16c806fd00 tx=0x7f16b8017000 comp rx=0 tx=0).stop 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 shutdown_connections 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c80ceae0 0x7f16c80cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16c80b2660 0x7f16c814cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 --2- 172.21.15.84:0/3478314523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16c80b2a30 0x7f16c809b690 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 >> 172.21.15.84:0/3478314523 conn(0x7f16c8099560 msgr2=0x7f16c8068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 shutdown_connections 2023-10-06T03:00:24.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.450+0000 7f16cf47b700 1 -- 172.21.15.84:0/3478314523 wait complete. 2023-10-06T03:00:24.462 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:00:24.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.578+0000 7fe0ae5d2700 1 Processor -- start 2023-10-06T03:00:24.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.578+0000 7fe0ae5d2700 1 -- start start 2023-10-06T03:00:24.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0ae5d2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0a80cbcb0 0x7fe0a80cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0ae5d2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80cf610 con 0x7fe0a81598e0 2023-10-06T03:00:24.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0ae5d2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80cf8f0 con 0x7fe0a8159510 2023-10-06T03:00:24.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0ae5d2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a80cfbd0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0acb6f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0a80cbcb0 0x7fe0a80cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0a77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe0a81598e0 0x7fe0a80ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42338/0 (socket says 172.21.15.84:42338) 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0a77fe700 1 -- 172.21.15.84:0/3710537264 learned_addr learned my addr 172.21.15.84:0/3710537264 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0acb6f700 1 -- 172.21.15.84:0/3710537264 >> v1:172.21.15.131:6789/0 conn(0x7fe0a8159510 legacy=0x7fe0a80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0acb6f700 1 -- 172.21.15.84:0/3710537264 >> v1:172.21.15.84:6789/0 conn(0x7fe0a81598e0 legacy=0x7fe0a80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0acb6f700 1 -- 172.21.15.84:0/3710537264 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80cfeb0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.579+0000 7fe0a6ffd700 1 -- 172.21.15.84:0/3710537264 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656683335 0 0) 0x7fe0a80cf610 con 0x7fe0a81598e0 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0acb6f700 1 --2- 172.21.15.84:0/3710537264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 0x7fe0a80cef30 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009e60 tx=0x7fe0a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f97f6aba530096 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0a6ffd700 1 -- 172.21.15.84:0/3710537264 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000e070 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0a6ffd700 1 -- 172.21.15.84:0/3710537264 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a000bc30 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0a6ffd700 1 -- 172.21.15.84:0/3710537264 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0012430 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3710537264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 msgr2=0x7fe0a80cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0ae5d2700 1 --2- 172.21.15.84:0/3710537264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 0x7fe0a80cef30 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009e60 tx=0x7fe0a0009780 comp rx=0 tx=0).stop 2023-10-06T03:00:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3710537264 shutdown_connections 2023-10-06T03:00:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0ae5d2700 1 --2- 172.21.15.84:0/3710537264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 0x7fe0a80cef30 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3710537264 >> 172.21.15.84:0/3710537264 conn(0x7fe0a8089e90 msgr2=0x7fe0a80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3710537264 shutdown_connections 2023-10-06T03:00:24.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.580+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3710537264 wait complete. 2023-10-06T03:00:24.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.581+0000 7fe0ae5d2700 1 Processor -- start 2023-10-06T03:00:24.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0ae5d2700 1 -- start start 2023-10-06T03:00:24.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0ae5d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 0x7fe0a814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0ae5d2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a8159510 0x7fe0a814a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0ae5d2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a81598e0 0x7fe0a814d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0ae5d2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a814cbf0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0ae5d2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a814f8f0 con 0x7fe0a8159510 2023-10-06T03:00:24.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0ae5d2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a814aec0 con 0x7fe0a81598e0 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 0x7fe0a814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 0x7fe0a814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51892/0 (socket says 172.21.15.84:51892) 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.582+0000 7fe0a7fff700 1 -- 172.21.15.84:0/3419137159 learned_addr learned my addr 172.21.15.84:0/3419137159 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0a77fe700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a8159510 0x7fe0a814a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0acb6f700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a81598e0 0x7fe0a814d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0a7fff700 1 -- 172.21.15.84:0/3419137159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a81598e0 msgr2=0x7fe0a814d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0a7fff700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a81598e0 0x7fe0a814d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0a7fff700 1 -- 172.21.15.84:0/3419137159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a8159510 msgr2=0x7fe0a814a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0a7fff700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a8159510 0x7fe0a814a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0a7fff700 1 -- 172.21.15.84:0/3419137159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0009a20 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0a7fff700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 0x7fe0a814f3b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe09800c590 tx=0x7fe09800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe08ffff700 1 -- 172.21.15.84:0/3419137159 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011590 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe08ffff700 1 -- 172.21.15.84:0/3419137159 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098011710 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe08ffff700 1 -- 172.21.15.84:0/3419137159 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011ad0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a815c980 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.583+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a814d0e0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.584+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a8064ad0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.584+0000 7fe08ffff700 1 -- 172.21.15.84:0/3419137159 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe09801b3b0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.585+0000 7fe08ffff700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe094066f30 0x7fe0940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.585+0000 7fe08ffff700 1 -- 172.21.15.84:0/3419137159 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe098083be0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.585+0000 7fe0a77fe700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe094066f30 0x7fe0940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.585+0000 7fe0a77fe700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe094066f30 0x7fe0940693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe0a814cb10 tx=0x7fe09c007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:24.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.589+0000 7fe08ffff700 1 -- 172.21.15.84:0/3419137159 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe098050bb0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.772+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe0a80c66e0 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.773+0000 7fe08ffff700 1 -- 172.21.15.84:0/3419137159 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v82) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe098017070 con 0x7fe0a80cbcb0 2023-10-06T03:00:24.773 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:00:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe094066f30 msgr2=0x7fe0940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe094066f30 0x7fe0940693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe0a814cb10 tx=0x7fe09c007f50 comp rx=0 tx=0).stop 2023-10-06T03:00:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 msgr2=0x7fe0a814f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 0x7fe0a814f3b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe09800c590 tx=0x7fe09800c8a0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 shutdown_connections 2023-10-06T03:00:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe094066f30 0x7fe0940693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a81598e0 0x7fe0a814d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a80cbcb0 0x7fe0a814f3b0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 --2- 172.21.15.84:0/3419137159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a8159510 0x7fe0a814a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 >> 172.21.15.84:0/3419137159 conn(0x7fe0a8089e90 msgr2=0x7fe0a814bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 shutdown_connections 2023-10-06T03:00:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.775+0000 7fe0ae5d2700 1 -- 172.21.15.84:0/3419137159 wait complete. 2023-10-06T03:00:24.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:00:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.904+0000 7fd6bf231700 1 Processor -- start 2023-10-06T03:00:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.904+0000 7fd6bf231700 1 -- start start 2023-10-06T03:00:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.905+0000 7fd6bf231700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.905+0000 7fd6bf231700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6b80b4a60 0x7fd6b80d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.905+0000 7fd6bf231700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b80b5f30 con 0x7fd6b80d0850 2023-10-06T03:00:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.905+0000 7fd6bf231700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b80b3640 con 0x7fd6b80b4a60 2023-10-06T03:00:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.905+0000 7fd6bf231700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80d0c90 con 0x7fd6b80cd980 2023-10-06T03:00:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6affff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6b80b4a60 0x7fd6b80d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6bcfcd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6bd7ce700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd6b80d0850 0x7fd6b815ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:48844/0 (socket says 172.21.15.84:48844) 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6bcfcd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b8159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:48732/0 (socket says 172.21.15.84:48732) 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6bd7ce700 1 -- 172.21.15.84:0/3719082073 learned_addr learned my addr 172.21.15.84:0/3719082073 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6affff700 1 -- 172.21.15.84:0/3719082073 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 msgr2=0x7fd6b8159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6affff700 1 --2- 172.21.15.84:0/3719082073 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b8159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6affff700 1 -- 172.21.15.84:0/3719082073 >> v1:172.21.15.131:6789/0 conn(0x7fd6b80d0850 legacy=0x7fd6b815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6affff700 1 -- 172.21.15.84:0/3719082073 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b80b63c0 con 0x7fd6b80b4a60 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6bcfcd700 1 --2- 172.21.15.84:0/3719082073 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6affff700 1 --2- 172.21.15.84:0/3719082073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6b80b4a60 0x7fd6b80d0310 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80098e0 tx=0x7fd6a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0637f70c6fc19ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6af7fe700 1 -- 172.21.15.84:0/3719082073 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800b640 con 0x7fd6b80b4a60 2023-10-06T03:00:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6af7fe700 1 -- 172.21.15.84:0/3719082073 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a800b7a0 con 0x7fd6b80b4a60 2023-10-06T03:00:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.906+0000 7fd6af7fe700 1 -- 172.21.15.84:0/3719082073 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800bb40 con 0x7fd6b80b4a60 2023-10-06T03:00:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.907+0000 7fd6bf231700 1 -- 172.21.15.84:0/3719082073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6b80b4a60 msgr2=0x7fd6b80d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.907+0000 7fd6bf231700 1 --2- 172.21.15.84:0/3719082073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6b80b4a60 0x7fd6b80d0310 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80098e0 tx=0x7fd6a80091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.907+0000 7fd6bf231700 1 -- 172.21.15.84:0/3719082073 shutdown_connections 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.907+0000 7fd6bf231700 1 --2- 172.21.15.84:0/3719082073 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.907+0000 7fd6bf231700 1 --2- 172.21.15.84:0/3719082073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6b80b4a60 0x7fd6b80d0310 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.907+0000 7fd6bf231700 1 -- 172.21.15.84:0/3719082073 >> 172.21.15.84:0/3719082073 conn(0x7fd6b806ed20 msgr2=0x7fd6b806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.907+0000 7fd6bf231700 1 -- 172.21.15.84:0/3719082073 shutdown_connections 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.907+0000 7fd6bf231700 1 -- 172.21.15.84:0/3719082073 wait complete. 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bf231700 1 Processor -- start 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bf231700 1 -- start start 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bf231700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b80b4a60 0x7fd6b8169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bf231700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b81498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bf231700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6b80d0850 0x7fd6b81542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bf231700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b816a440 con 0x7fd6b80b4a60 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bf231700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80b0f80 con 0x7fd6b80d0850 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bf231700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8152ca0 con 0x7fd6b80cd980 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bcfcd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b80b4a60 0x7fd6b8169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bcfcd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b80b4a60 0x7fd6b8169f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51906/0 (socket says 172.21.15.84:51906) 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bcfcd700 1 -- 172.21.15.84:0/4234136010 learned_addr learned my addr 172.21.15.84:0/4234136010 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bd7ce700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6b80d0850 0x7fd6b81542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6affff700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b81498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bcfcd700 1 -- 172.21.15.84:0/4234136010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 msgr2=0x7fd6b81498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bcfcd700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b81498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bcfcd700 1 -- 172.21.15.84:0/4234136010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6b80d0850 msgr2=0x7fd6b81542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bcfcd700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6b80d0850 0x7fd6b81542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.908+0000 7fd6bcfcd700 1 -- 172.21.15.84:0/4234136010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009a20 con 0x7fd6b80b4a60 2023-10-06T03:00:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.909+0000 7fd6bcfcd700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b80b4a60 0x7fd6b8169f00 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c170 tx=0x7fd6b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.909+0000 7fd6acff9700 1 -- 172.21.15.84:0/4234136010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400ccb0 con 0x7fd6b80b4a60 2023-10-06T03:00:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.909+0000 7fd6acff9700 1 -- 172.21.15.84:0/4234136010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b400f040 con 0x7fd6b80b4a60 2023-10-06T03:00:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.909+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a8009420 con 0x7fd6b80b4a60 2023-10-06T03:00:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.909+0000 7fd6acff9700 1 -- 172.21.15.84:0/4234136010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4014480 con 0x7fd6b80b4a60 2023-10-06T03:00:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.909+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b8149e80 con 0x7fd6b80b4a60 2023-10-06T03:00:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.910+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b8064ad0 con 0x7fd6b80b4a60 2023-10-06T03:00:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.910+0000 7fd6acff9700 1 -- 172.21.15.84:0/4234136010 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6b40147f0 con 0x7fd6b80b4a60 2023-10-06T03:00:24.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.910+0000 7fd6acff9700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6a4066f30 0x7fd6a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:24.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.911+0000 7fd6acff9700 1 -- 172.21.15.84:0/4234136010 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd6b4085550 con 0x7fd6b80b4a60 2023-10-06T03:00:24.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.911+0000 7fd6affff700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6a4066f30 0x7fd6a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:24.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.911+0000 7fd6affff700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6a4066f30 0x7fd6a40693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80091e0 tx=0x7fd6a8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:24.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:24.915+0000 7fd6acff9700 1 -- 172.21.15.84:0/4234136010 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6b4052520 con 0x7fd6b80b4a60 2023-10-06T03:00:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.092+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6b80b5320 con 0x7fd6b80b4a60 2023-10-06T03:00:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.093+0000 7fd6acff9700 1 -- 172.21.15.84:0/4234136010 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6b405b070 con 0x7fd6b80b4a60 2023-10-06T03:00:25.095 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:00:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6a4066f30 msgr2=0x7fd6a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6a4066f30 0x7fd6a40693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80091e0 tx=0x7fd6a8017000 comp rx=0 tx=0).stop 2023-10-06T03:00:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b80b4a60 msgr2=0x7fd6b8169f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b80b4a60 0x7fd6b8169f00 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c170 tx=0x7fd6b400b040 comp rx=0 tx=0).stop 2023-10-06T03:00:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 shutdown_connections 2023-10-06T03:00:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd6a4066f30 0x7fd6a40693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6b80d0850 0x7fd6b81542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6b80b4a60 0x7fd6b8169f00 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 --2- 172.21.15.84:0/4234136010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6b80cd980 0x7fd6b81498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 >> 172.21.15.84:0/4234136010 conn(0x7fd6b806ed20 msgr2=0x7fd6b815c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 shutdown_connections 2023-10-06T03:00:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.095+0000 7fd6bf231700 1 -- 172.21.15.84:0/4234136010 wait complete. 2023-10-06T03:00:25.108 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:00:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.225+0000 7f47bc9ae700 1 Processor -- start 2023-10-06T03:00:25.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.225+0000 7f47bc9ae700 1 -- start start 2023-10-06T03:00:25.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47bc9ae700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2a30 0x7f47b8164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47bc9ae700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b80cc9b0 con 0x7f47b80cd400 2023-10-06T03:00:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47bc9ae700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b80cbda0 con 0x7f47b80b2660 2023-10-06T03:00:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47bc9ae700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80cc080 con 0x7f47b80b2a30 2023-10-06T03:00:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47b6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f47b80cd400 0x7f47b80ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42354/0 (socket says 172.21.15.84:42354) 2023-10-06T03:00:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47b6ffd700 1 -- 172.21.15.84:0/2658789029 learned_addr learned my addr 172.21.15.84:0/2658789029 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47b7fff700 1 --2- 172.21.15.84:0/2658789029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2a30 0x7f47b8164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47b67fc700 1 -- 172.21.15.84:0/2658789029 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907673792 0 0) 0x7f47b80cc9b0 con 0x7f47b80cd400 2023-10-06T03:00:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47b67fc700 1 -- 172.21.15.84:0/2658789029 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a0003570 con 0x7f47b80cd400 2023-10-06T03:00:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.226+0000 7f47b67fc700 1 -- 172.21.15.84:0/2658789029 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860735015 0 0) 0x7f47b80cbda0 con 0x7f47b80b2660 2023-10-06T03:00:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47b67fc700 1 -- 172.21.15.84:0/2658789029 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b80cc9b0 con 0x7f47b80b2660 2023-10-06T03:00:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47b67fc700 1 -- 172.21.15.84:0/2658789029 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 534477135 0 0) 0x7f47a0003570 con 0x7f47b80cd400 2023-10-06T03:00:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47b7fff700 1 -- 172.21.15.84:0/2658789029 >> v1:172.21.15.131:6789/0 conn(0x7f47b80b2660 legacy=0x7f47b80cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47b7fff700 1 -- 172.21.15.84:0/2658789029 >> v1:172.21.15.84:6789/0 conn(0x7f47b80cd400 legacy=0x7f47b80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47b7fff700 1 -- 172.21.15.84:0/2658789029 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b80cc360 con 0x7f47b80b2a30 2023-10-06T03:00:25.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47b7fff700 1 --2- 172.21.15.84:0/2658789029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2a30 0x7f47b8164360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009910 tx=0x7f47b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fa6c31bbc0c7eaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47b67fc700 1 -- 172.21.15.84:0/2658789029 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac001470 con 0x7f47b80b2a30 2023-10-06T03:00:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47b67fc700 1 -- 172.21.15.84:0/2658789029 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0011420 con 0x7f47b80b2a30 2023-10-06T03:00:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47b67fc700 1 -- 172.21.15.84:0/2658789029 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00117c0 con 0x7f47b80b2a30 2023-10-06T03:00:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47bc9ae700 1 -- 172.21.15.84:0/2658789029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2a30 msgr2=0x7f47b8164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47bc9ae700 1 --2- 172.21.15.84:0/2658789029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2a30 0x7f47b8164360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009910 tx=0x7f47b00091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47bc9ae700 1 -- 172.21.15.84:0/2658789029 shutdown_connections 2023-10-06T03:00:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.227+0000 7f47bc9ae700 1 --2- 172.21.15.84:0/2658789029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2a30 0x7f47b8164360 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.228+0000 7f47bc9ae700 1 -- 172.21.15.84:0/2658789029 >> 172.21.15.84:0/2658789029 conn(0x7f47b8099560 msgr2=0x7f47b806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:25.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.228+0000 7f47bc9ae700 1 -- 172.21.15.84:0/2658789029 shutdown_connections 2023-10-06T03:00:25.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.228+0000 7f47bc9ae700 1 -- 172.21.15.84:0/2658789029 wait complete. 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.229+0000 7f47bc9ae700 1 Processor -- start 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.229+0000 7f47bc9ae700 1 -- start start 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47bc9ae700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2660 0x7f47b80b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47bc9ae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b80b2a30 0x7f47b80c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47bc9ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47b80cd400 0x7f47b80c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47bc9ae700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8140820 con 0x7f47b80cd400 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47bc9ae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c7e80 con 0x7f47b80b2a30 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47bc9ae700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c9bb0 con 0x7f47b80b2660 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47b80cd400 0x7f47b80c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47b80cd400 0x7f47b80c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51916/0 (socket says 172.21.15.84:51916) 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b7fff700 1 -- 172.21.15.84:0/3949009134 learned_addr learned my addr 172.21.15.84:0/3949009134 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b6ffd700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b80b2a30 0x7f47b80c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b77fe700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2660 0x7f47b80b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b7fff700 1 -- 172.21.15.84:0/3949009134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2660 msgr2=0x7f47b80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b7fff700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2660 0x7f47b80b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b7fff700 1 -- 172.21.15.84:0/3949009134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b80b2a30 msgr2=0x7f47b80c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b7fff700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b80b2a30 0x7f47b80c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b7fff700 1 -- 172.21.15.84:0/3949009134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009420 con 0x7f47b80cd400 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47b7fff700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47b80cd400 0x7f47b80c92d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f47b00030c0 tx=0x7f47b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f479f7fe700 1 -- 172.21.15.84:0/3949009134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b001cc50 con 0x7f47b80cd400 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f479f7fe700 1 -- 172.21.15.84:0/3949009134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b001cdb0 con 0x7f47b80cd400 2023-10-06T03:00:25.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f479f7fe700 1 -- 172.21.15.84:0/3949009134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b001a6a0 con 0x7f47b80cd400 2023-10-06T03:00:25.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b80c9e90 con 0x7f47b80cd400 2023-10-06T03:00:25.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.230+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b80ca450 con 0x7f47b80cd400 2023-10-06T03:00:25.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.231+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b805f270 con 0x7f47b80cd400 2023-10-06T03:00:25.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.232+0000 7f479f7fe700 1 -- 172.21.15.84:0/3949009134 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47b001aa90 con 0x7f47b80cd400 2023-10-06T03:00:25.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.232+0000 7f479f7fe700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47a4066f30 0x7f47a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.232+0000 7f479f7fe700 1 -- 172.21.15.84:0/3949009134 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f47b00866e0 con 0x7f47b80cd400 2023-10-06T03:00:25.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.232+0000 7f47b77fe700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47a4066f30 0x7f47a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.232+0000 7f47b77fe700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47a4066f30 0x7f47a40693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f47a80014f0 tx=0x7f47a8002b00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:25.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.236+0000 7f479f7fe700 1 -- 172.21.15.84:0/3949009134 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47b00536b0 con 0x7f47b80cd400 2023-10-06T03:00:25.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.418+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47b80cc640 con 0x7f47b80cd400 2023-10-06T03:00:25.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.419+0000 7f479f7fe700 1 -- 172.21.15.84:0/3949009134 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47b0056cd0 con 0x7f47b80cd400 2023-10-06T03:00:25.420 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:00:25.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47a4066f30 msgr2=0x7f47a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47a4066f30 0x7f47a40693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f47a80014f0 tx=0x7f47a8002b00 comp rx=0 tx=0).stop 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47b80cd400 msgr2=0x7f47b80c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47b80cd400 0x7f47b80c92d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f47b00030c0 tx=0x7f47b0016000 comp rx=0 tx=0).stop 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 shutdown_connections 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f47a4066f30 0x7f47a40693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47b80cd400 0x7f47b80c92d0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b80b2660 0x7f47b80b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 --2- 172.21.15.84:0/3949009134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b80b2a30 0x7f47b80c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 >> 172.21.15.84:0/3949009134 conn(0x7f47b8099560 msgr2=0x7f47b815d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 shutdown_connections 2023-10-06T03:00:25.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.421+0000 7f47bc9ae700 1 -- 172.21.15.84:0/3949009134 wait complete. 2023-10-06T03:00:25.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:25.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.548+0000 7f663165a700 1 Processor -- start 2023-10-06T03:00:25.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.548+0000 7f663165a700 1 -- start start 2023-10-06T03:00:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f663165a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f663165a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f662c0b49e0 0x7f662c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f663165a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f662c0b07a0 0x7f662c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f663165a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662c0b0ca0 con 0x7f662c0b07a0 2023-10-06T03:00:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f663165a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662c0b0f80 con 0x7f662c0b49e0 2023-10-06T03:00:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f663165a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0b1260 con 0x7f662c1595a0 2023-10-06T03:00:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f662c0b07a0 0x7f662c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f662c0b07a0 0x7f662c0b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51928/0 (socket says 172.21.15.84:51928) 2023-10-06T03:00:25.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662b7fe700 1 -- 172.21.15.84:0/2618593904 learned_addr learned my addr 172.21.15.84:0/2618593904 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f6623fff700 1 --2- 172.21.15.84:0/2618593904 >> v2:172.21.15.131:3300/0 conn(0x7f662c0b49e0 0x7f662c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662affd700 1 --2- 172.21.15.84:0/2618593904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662b7fe700 1 -- 172.21.15.84:0/2618593904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 msgr2=0x7f662c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662b7fe700 1 --2- 172.21.15.84:0/2618593904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662b7fe700 1 -- 172.21.15.84:0/2618593904 >> v2:172.21.15.131:3300/0 conn(0x7f662c0b49e0 msgr2=0x7f662c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662b7fe700 1 --2- 172.21.15.84:0/2618593904 >> v2:172.21.15.131:3300/0 conn(0x7f662c0b49e0 0x7f662c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662b7fe700 1 -- 172.21.15.84:0/2618593904 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c0b1540 con 0x7f662c0b07a0 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662affd700 1 --2- 172.21.15.84:0/2618593904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662b7fe700 1 --2- 172.21.15.84:0/2618593904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 0x7f662c0b38d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f662c089060 tx=0x7f6624009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cc5b03c7a72056 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662a7fc700 1 -- 172.21.15.84:0/2618593904 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662400e070 con 0x7f662c0b07a0 2023-10-06T03:00:25.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662a7fc700 1 -- 172.21.15.84:0/2618593904 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662400ba50 con 0x7f662c0b07a0 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.549+0000 7f662a7fc700 1 -- 172.21.15.84:0/2618593904 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240092e0 con 0x7f662c0b07a0 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.550+0000 7f663165a700 1 -- 172.21.15.84:0/2618593904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 msgr2=0x7f662c0b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.550+0000 7f663165a700 1 --2- 172.21.15.84:0/2618593904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 0x7f662c0b38d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f662c089060 tx=0x7f6624009840 comp rx=0 tx=0).stop 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.550+0000 7f663165a700 1 -- 172.21.15.84:0/2618593904 shutdown_connections 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.550+0000 7f663165a700 1 --2- 172.21.15.84:0/2618593904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 0x7f662c0b38d0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.550+0000 7f663165a700 1 --2- 172.21.15.84:0/2618593904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.550+0000 7f663165a700 1 --2- 172.21.15.84:0/2618593904 >> v2:172.21.15.131:3300/0 conn(0x7f662c0b49e0 0x7f662c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.550+0000 7f663165a700 1 -- 172.21.15.84:0/2618593904 >> 172.21.15.84:0/2618593904 conn(0x7f662c099830 msgr2=0x7f662c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.550+0000 7f663165a700 1 -- 172.21.15.84:0/2618593904 shutdown_connections 2023-10-06T03:00:25.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.550+0000 7f663165a700 1 -- 172.21.15.84:0/2618593904 wait complete. 2023-10-06T03:00:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.551+0000 7f663165a700 1 Processor -- start 2023-10-06T03:00:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.551+0000 7f663165a700 1 -- start start 2023-10-06T03:00:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f663165a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 0x7f662c09b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f663165a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f662c0b49e0 0x7f662c068400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f663165a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f663165a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c16e770 con 0x7f662c0b07a0 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f663165a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c16daf0 con 0x7f662c0b49e0 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f663165a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c16ddd0 con 0x7f662c1595a0 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 0x7f662c09b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 0x7f662c09b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51934/0 (socket says 172.21.15.84:51934) 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662affd700 1 -- 172.21.15.84:0/468605345 learned_addr learned my addr 172.21.15.84:0/468605345 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662b7fe700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f6623fff700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f662c0b49e0 0x7f662c068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662affd700 1 -- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 msgr2=0x7f662c068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662affd700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c068940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662affd700 1 -- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f662c0b49e0 msgr2=0x7f662c068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662affd700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f662c0b49e0 0x7f662c068400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662affd700 1 -- 172.21.15.84:0/468605345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624009ae0 con 0x7f662c0b07a0 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f662b7fe700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.552+0000 7f6623fff700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f662c0b49e0 0x7f662c068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.553+0000 7f662affd700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 0x7f662c09b750 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c880 tx=0x7f661c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.553+0000 7f6622ffd700 1 -- 172.21.15.84:0/468605345 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c005a00 con 0x7f662c0b07a0 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.553+0000 7f6622ffd700 1 -- 172.21.15.84:0/468605345 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c005b60 con 0x7f662c0b07a0 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.553+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c16e0b0 con 0x7f662c0b07a0 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.553+0000 7f6622ffd700 1 -- 172.21.15.84:0/468605345 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c011600 con 0x7f662c0b07a0 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.553+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c09bc90 con 0x7f662c0b07a0 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.554+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662c064ad0 con 0x7f662c0b07a0 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.554+0000 7f6622ffd700 1 -- 172.21.15.84:0/468605345 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f661c0119f0 con 0x7f662c0b07a0 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.554+0000 7f6622ffd700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f660c066f30 0x7f660c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.554+0000 7f6622ffd700 1 -- 172.21.15.84:0/468605345 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f661c0846b0 con 0x7f662c0b07a0 2023-10-06T03:00:25.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.554+0000 7f6623fff700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f660c066f30 0x7f660c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.555+0000 7f6623fff700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f660c066f30 0x7f660c0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f662c0af8c0 tx=0x7f6614008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:25.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.558+0000 7f6622ffd700 1 -- 172.21.15.84:0/468605345 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f661c0515e0 con 0x7f662c0b07a0 2023-10-06T03:00:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.784+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f662c0b1820 con 0x7f662c0b07a0 2023-10-06T03:00:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.784+0000 7f6622ffd700 1 -- 172.21.15.84:0/468605345 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4637 (secure 0 0 0) 0x7f661c054c00 con 0x7f662c0b07a0 2023-10-06T03:00:25.786 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:25.786 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":75,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T03:00:21.161468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7185,"mds_1":7182,"mds_2":6382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6382":{"gid":6382,"name":"d","rank":2,"incarnation":72,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7182":{"gid":7182,"name":"a","rank":1,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f660c066f30 msgr2=0x7f660c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f660c066f30 0x7f660c0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f662c0af8c0 tx=0x7f6614008040 comp rx=0 tx=0).stop 2023-10-06T03:00:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 msgr2=0x7f662c09b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 0x7f662c09b750 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c880 tx=0x7f661c008040 comp rx=0 tx=0).stop 2023-10-06T03:00:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 shutdown_connections 2023-10-06T03:00:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f660c066f30 0x7f660c0693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f662c1595a0 0x7f662c068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f662c0b07a0 0x7f662c09b750 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 --2- 172.21.15.84:0/468605345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f662c0b49e0 0x7f662c068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 >> 172.21.15.84:0/468605345 conn(0x7f662c099830 msgr2=0x7f662c158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 shutdown_connections 2023-10-06T03:00:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.786+0000 7f663165a700 1 -- 172.21.15.84:0/468605345 wait complete. 2023-10-06T03:00:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 75 2023-10-06T03:00:25.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:25.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.912+0000 7f65b72b9700 1 Processor -- start 2023-10-06T03:00:25.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.913+0000 7f65b72b9700 1 -- start start 2023-10-06T03:00:25.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.913+0000 7f65b72b9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b00b2620 0x7f65b00b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.913+0000 7f65b72b9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f65b0159870 0x7f65b00cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.913+0000 7f65b72b9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b00cbfe0 con 0x7f65b00b29f0 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.913+0000 7f65b72b9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b00cb3d0 con 0x7f65b0159870 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.913+0000 7f65b72b9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00cb6b0 con 0x7f65b00b2620 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65b4854700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f65b00b29f0 0x7f65b0159160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42360/0 (socket says 172.21.15.84:42360) 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65b4854700 1 -- 172.21.15.84:0/640231542 learned_addr learned my addr 172.21.15.84:0/640231542 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65b5856700 1 --2- 172.21.15.84:0/640231542 >> v2:172.21.15.131:3300/0 conn(0x7f65b0159870 0x7f65b00cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65b5055700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b00b2620 0x7f65b00b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553557961 0 0) 0x7f65b00cbfe0 con 0x7f65b00b29f0 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f659c003570 con 0x7f65b00b29f0 2023-10-06T03:00:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2836382095 0 0) 0x7f659c003570 con 0x7f65b00b29f0 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b00b2620 msgr2=0x7f65b00b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b00b2620 0x7f65b00b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 >> v2:172.21.15.131:3300/0 conn(0x7f65b0159870 msgr2=0x7f65b00cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 --2- 172.21.15.84:0/640231542 >> v2:172.21.15.131:3300/0 conn(0x7f65b0159870 0x7f65b00cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00cb990 con 0x7f65b00b29f0 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f65a0001470 con 0x7f65b00b29f0 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 >> v1:172.21.15.84:6789/0 conn(0x7f65b00b29f0 legacy=0x7f65b0159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b00b2620 0x7f659c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f659c003fe0 0x7f659c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f659c004d50 0x7f659c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00cb3d0 con 0x7f659c004d50 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00cb6b0 con 0x7f659c003fe0 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c00ba90 con 0x7f65b00b2620 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65b5856700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f659c004d50 0x7f659c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65b5055700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b00b2620 0x7f659c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.914+0000 7f65b4854700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f659c003fe0 0x7f659c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b5856700 1 -- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b00b2620 msgr2=0x7f659c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b5856700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b00b2620 0x7f659c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b5856700 1 -- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f659c003fe0 msgr2=0x7f659c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b5856700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f659c003fe0 0x7f659c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b5856700 1 -- 172.21.15.84:0/640231542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c003570 con 0x7f659c004d50 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b5856700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f659c004d50 0x7f659c0051c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f65a800e210 tx=0x7f65a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b0eee5a3678a19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:25.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800ea60 con 0x7f659c004d50 2023-10-06T03:00:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800f040 con 0x7f659c004d50 2023-10-06T03:00:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65a7fff700 1 -- 172.21.15.84:0/640231542 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800ee10 con 0x7f659c004d50 2023-10-06T03:00:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b72b9700 1 -- 172.21.15.84:0/640231542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f659c004d50 msgr2=0x7f659c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b72b9700 1 --2- 172.21.15.84:0/640231542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f659c004d50 0x7f659c0051c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f65a800e210 tx=0x7f65a800b040 comp rx=0 tx=0).stop 2023-10-06T03:00:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b5856700 1 -- 172.21.15.84:0/640231542 reap_dead start 2023-10-06T03:00:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b72b9700 1 -- 172.21.15.84:0/640231542 shutdown_connections 2023-10-06T03:00:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.915+0000 7f65b72b9700 1 -- 172.21.15.84:0/640231542 >> 172.21.15.84:0/640231542 conn(0x7f65b006ed20 msgr2=0x7f65b006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.916+0000 7f65b72b9700 1 -- 172.21.15.84:0/640231542 shutdown_connections 2023-10-06T03:00:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.916+0000 7f65b72b9700 1 -- 172.21.15.84:0/640231542 wait complete. 2023-10-06T03:00:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.917+0000 7f65b72b9700 1 Processor -- start 2023-10-06T03:00:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.917+0000 7f65b72b9700 1 -- start start 2023-10-06T03:00:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b72b9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f659c004d50 0x7f65b014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b72b9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b014b210 0x7f65b014dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b72b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b014cee0 0x7f65b014d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b72b9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b014d890 con 0x7f65b014cee0 2023-10-06T03:00:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b72b9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b00c6270 con 0x7f659c004d50 2023-10-06T03:00:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b72b9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b014b760 con 0x7f65b014b210 2023-10-06T03:00:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5856700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b014cee0 0x7f65b014d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5856700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b014cee0 0x7f65b014d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51942/0 (socket says 172.21.15.84:51942) 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5856700 1 -- 172.21.15.84:0/2730819672 learned_addr learned my addr 172.21.15.84:0/2730819672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5055700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f659c004d50 0x7f65b014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b4854700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b014b210 0x7f65b014dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5856700 1 -- 172.21.15.84:0/2730819672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b014b210 msgr2=0x7f65b014dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5856700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b014b210 0x7f65b014dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5856700 1 -- 172.21.15.84:0/2730819672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f659c004d50 msgr2=0x7f65b014a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5856700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f659c004d50 0x7f65b014a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5856700 1 -- 172.21.15.84:0/2730819672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00c6510 con 0x7f65b014cee0 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b5856700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b014cee0 0x7f65b014d350 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f65a800afd0 tx=0x7f65a801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65a57fa700 1 -- 172.21.15.84:0/2730819672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800eee0 con 0x7f65b014cee0 2023-10-06T03:00:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65a57fa700 1 -- 172.21.15.84:0/2730819672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a8022070 con 0x7f65b014cee0 2023-10-06T03:00:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b00c67f0 con 0x7f65b014cee0 2023-10-06T03:00:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.918+0000 7f65a57fa700 1 -- 172.21.15.84:0/2730819672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a801e890 con 0x7f65b014cee0 2023-10-06T03:00:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.919+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b014e1e0 con 0x7f65b014cee0 2023-10-06T03:00:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.920+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b0064ad0 con 0x7f65b014cee0 2023-10-06T03:00:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.920+0000 7f65a57fa700 1 -- 172.21.15.84:0/2730819672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65a8003040 con 0x7f65b014cee0 2023-10-06T03:00:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.920+0000 7f65a57fa700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6594066f30 0x7f65940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.920+0000 7f65a57fa700 1 -- 172.21.15.84:0/2730819672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f65a8024070 con 0x7f65b014cee0 2023-10-06T03:00:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.920+0000 7f65b5055700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6594066f30 0x7f65940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.921+0000 7f65b5055700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6594066f30 0x7f65940693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f65ac006e50 tx=0x7f65ac009120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:25.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:25.925+0000 7f65a57fa700 1 -- 172.21.15.84:0/2730819672 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65a80539b0 con 0x7f65b014cee0 2023-10-06T03:00:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.107+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65b00cbc70 con 0x7f65b014cee0 2023-10-06T03:00:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.108+0000 7f65a57fa700 1 -- 172.21.15.84:0/2730819672 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f65a8018090 con 0x7f65b014cee0 2023-10-06T03:00:26.110 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:26.110 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":82,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:59:57.647692+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:53.640511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:54.978352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:26.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6594066f30 msgr2=0x7f65940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6594066f30 0x7f65940693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f65ac006e50 tx=0x7f65ac009120 comp rx=0 tx=0).stop 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b014cee0 msgr2=0x7f65b014d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b014cee0 0x7f65b014d350 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f65a800afd0 tx=0x7f65a801a000 comp rx=0 tx=0).stop 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 shutdown_connections 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6594066f30 0x7f65940693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f659c004d50 0x7f65b014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65b014cee0 0x7f65b014d350 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 --2- 172.21.15.84:0/2730819672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65b014b210 0x7f65b014dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 >> 172.21.15.84:0/2730819672 conn(0x7f65b006ed20 msgr2=0x7f65b01538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 shutdown_connections 2023-10-06T03:00:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.110+0000 7f65b72b9700 1 -- 172.21.15.84:0/2730819672 wait complete. 2023-10-06T03:00:26.123 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:00:26.124 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:26.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.237+0000 7f25fe17e700 1 Processor -- start 2023-10-06T03:00:26.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.237+0000 7f25fe17e700 1 -- start start 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.238+0000 7f25fe17e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 0x7f25f8161090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.238+0000 7f25fe17e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f806c9e0 con 0x7f25f80cc920 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.238+0000 7f25fe17e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f8156b60 con 0x7f25f8156390 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.238+0000 7f25fe17e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f806c7d0 con 0x7f25f806c370 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.238+0000 7f25f6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f25f80cc920 0x7f25f806bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42376/0 (socket says 172.21.15.84:42376) 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.238+0000 7f25f6ffd700 1 -- 172.21.15.84:0/908619689 learned_addr learned my addr 172.21.15.84:0/908619689 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f7fff700 1 --2- 172.21.15.84:0/908619689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 0x7f25f8161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f67fc700 1 -- 172.21.15.84:0/908619689 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953843872 0 0) 0x7f25f806c9e0 con 0x7f25f80cc920 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f67fc700 1 -- 172.21.15.84:0/908619689 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e0003570 con 0x7f25f80cc920 2023-10-06T03:00:26.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f67fc700 1 -- 172.21.15.84:0/908619689 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424890811 0 0) 0x7f25f8156b60 con 0x7f25f8156390 2023-10-06T03:00:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f67fc700 1 -- 172.21.15.84:0/908619689 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f806c9e0 con 0x7f25f8156390 2023-10-06T03:00:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f67fc700 1 -- 172.21.15.84:0/908619689 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148103502 0 0) 0x7f25e0003570 con 0x7f25f80cc920 2023-10-06T03:00:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f7fff700 1 -- 172.21.15.84:0/908619689 >> v1:172.21.15.131:6789/0 conn(0x7f25f8156390 legacy=0x7f25f80cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f7fff700 1 -- 172.21.15.84:0/908619689 >> v1:172.21.15.84:6789/0 conn(0x7f25f80cc920 legacy=0x7f25f806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f7fff700 1 -- 172.21.15.84:0/908619689 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8156e40 con 0x7f25f806c370 2023-10-06T03:00:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f7fff700 1 --2- 172.21.15.84:0/908619689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 0x7f25f8161090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009910 tx=0x7f25f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4498ef2a96992ebf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f67fc700 1 -- 172.21.15.84:0/908619689 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec0013f0 con 0x7f25f806c370 2023-10-06T03:00:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f67fc700 1 -- 172.21.15.84:0/908619689 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f0011420 con 0x7f25f806c370 2023-10-06T03:00:26.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.239+0000 7f25f67fc700 1 -- 172.21.15.84:0/908619689 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f00117c0 con 0x7f25f806c370 2023-10-06T03:00:26.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.240+0000 7f25fe17e700 1 -- 172.21.15.84:0/908619689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 msgr2=0x7f25f8161090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.240+0000 7f25fe17e700 1 --2- 172.21.15.84:0/908619689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 0x7f25f8161090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009910 tx=0x7f25f00091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.240+0000 7f25fe17e700 1 -- 172.21.15.84:0/908619689 shutdown_connections 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.240+0000 7f25fe17e700 1 --2- 172.21.15.84:0/908619689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 0x7f25f8161090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.240+0000 7f25fe17e700 1 -- 172.21.15.84:0/908619689 >> 172.21.15.84:0/908619689 conn(0x7f25f80cdef0 msgr2=0x7f25f80c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.240+0000 7f25fe17e700 1 -- 172.21.15.84:0/908619689 shutdown_connections 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.240+0000 7f25fe17e700 1 -- 172.21.15.84:0/908619689 wait complete. 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.241+0000 7f25fe17e700 1 Processor -- start 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.241+0000 7f25fe17e700 1 -- start start 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25fe17e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 0x7f25f8158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25fe17e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25f80cc920 0x7f25f8152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25fe17e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f8156390 0x7f25f815bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25fe17e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f80c7300 con 0x7f25f80cc920 2023-10-06T03:00:26.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25fe17e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f815b890 con 0x7f25f8156390 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25fe17e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f815ac80 con 0x7f25f806c370 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25f80cc920 0x7f25f8152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25f80cc920 0x7f25f8152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51956/0 (socket says 172.21.15.84:51956) 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f6ffd700 1 -- 172.21.15.84:0/2274502996 learned_addr learned my addr 172.21.15.84:0/2274502996 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f7fff700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f8156390 0x7f25f815bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f6ffd700 1 -- 172.21.15.84:0/2274502996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 msgr2=0x7f25f8158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f77fe700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 0x7f25f8158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f6ffd700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 0x7f25f8158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f6ffd700 1 -- 172.21.15.84:0/2274502996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f8156390 msgr2=0x7f25f815bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f6ffd700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f8156390 0x7f25f815bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f6ffd700 1 -- 172.21.15.84:0/2274502996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0009420 con 0x7f25f80cc920 2023-10-06T03:00:26.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f7fff700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f8156390 0x7f25f815bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:26.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.242+0000 7f25f6ffd700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25f80cc920 0x7f25f8152000 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00c810 tx=0x7f25ec001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:26.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.243+0000 7f25df7fe700 1 -- 172.21.15.84:0/2274502996 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec005b30 con 0x7f25f80cc920 2023-10-06T03:00:26.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.243+0000 7f25df7fe700 1 -- 172.21.15.84:0/2274502996 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec005c90 con 0x7f25f80cc920 2023-10-06T03:00:26.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.243+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f815af60 con 0x7f25f80cc920 2023-10-06T03:00:26.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.243+0000 7f25df7fe700 1 -- 172.21.15.84:0/2274502996 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec007340 con 0x7f25f80cc920 2023-10-06T03:00:26.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.243+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f815b520 con 0x7f25f80cc920 2023-10-06T03:00:26.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.244+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f815ba00 con 0x7f25f80cc920 2023-10-06T03:00:26.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.244+0000 7f25df7fe700 1 -- 172.21.15.84:0/2274502996 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25ec01b400 con 0x7f25f80cc920 2023-10-06T03:00:26.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.244+0000 7f25df7fe700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25e4066f30 0x7f25e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.244+0000 7f25df7fe700 1 -- 172.21.15.84:0/2274502996 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f25ec0844d0 con 0x7f25f80cc920 2023-10-06T03:00:26.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.244+0000 7f25f77fe700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25e4066f30 0x7f25e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.245+0000 7f25f77fe700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25e4066f30 0x7f25e40693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f25e8002ec0 tx=0x7f25e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:26.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.249+0000 7f25df7fe700 1 -- 172.21.15.84:0/2274502996 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25ec051520 con 0x7f25f80cc920 2023-10-06T03:00:26.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.474+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25f8064ad0 con 0x7f25f80cc920 2023-10-06T03:00:26.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.474+0000 7f25df7fe700 1 -- 172.21.15.84:0/2274502996 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4639 (secure 0 0 0) 0x7f25ec05a020 con 0x7f25f80cc920 2023-10-06T03:00:26.476 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:26.476 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":76,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T03:00:26.181788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7185,"mds_1":7182,"mds_2":6382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6382":{"gid":6382,"name":"d","rank":2,"incarnation":72,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7182":{"gid":7182,"name":"a","rank":1,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25e4066f30 msgr2=0x7f25e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25e4066f30 0x7f25e40693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f25e8002ec0 tx=0x7f25e8009040 comp rx=0 tx=0).stop 2023-10-06T03:00:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25f80cc920 msgr2=0x7f25f8152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25f80cc920 0x7f25f8152000 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00c810 tx=0x7f25ec001950 comp rx=0 tx=0).stop 2023-10-06T03:00:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 shutdown_connections 2023-10-06T03:00:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25e4066f30 0x7f25e40693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f8156390 0x7f25f815bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f806c370 0x7f25f8158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 --2- 172.21.15.84:0/2274502996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25f80cc920 0x7f25f8152000 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 >> 172.21.15.84:0/2274502996 conn(0x7f25f80cdef0 msgr2=0x7f25f80c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 shutdown_connections 2023-10-06T03:00:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.476+0000 7f25fe17e700 1 -- 172.21.15.84:0/2274502996 wait complete. 2023-10-06T03:00:26.479 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 76 2023-10-06T03:00:26.489 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.601+0000 7f445759e700 1 Processor -- start 2023-10-06T03:00:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.601+0000 7f445759e700 1 -- start start 2023-10-06T03:00:26.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f445759e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f44581538f0 0x7f44580a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f445759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4458153cc0 0x7f4458159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f445759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f445815a010 0x7f44580cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f445759e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445815aae0 con 0x7f4458153cc0 2023-10-06T03:00:26.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f445759e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445806a890 con 0x7f44581538f0 2023-10-06T03:00:26.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f445759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44580a9e20 con 0x7f445815a010 2023-10-06T03:00:26.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4455d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4458153cc0 0x7f4458159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4455d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4458153cc0 0x7f4458159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51964/0 (socket says 172.21.15.84:51964) 2023-10-06T03:00:26.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4455d9b700 1 -- 172.21.15.84:0/4130005515 learned_addr learned my addr 172.21.15.84:0/4130005515 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:26.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4456d9d700 1 --2- 172.21.15.84:0/4130005515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f445815a010 0x7f44580cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f445659c700 1 --2- 172.21.15.84:0/4130005515 >> v2:172.21.15.131:3300/0 conn(0x7f44581538f0 0x7f44580a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4455d9b700 1 -- 172.21.15.84:0/4130005515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f445815a010 msgr2=0x7f44580cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:26.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4455d9b700 1 --2- 172.21.15.84:0/4130005515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f445815a010 0x7f44580cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4455d9b700 1 -- 172.21.15.84:0/4130005515 >> v2:172.21.15.131:3300/0 conn(0x7f44581538f0 msgr2=0x7f44580a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:26.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4455d9b700 1 --2- 172.21.15.84:0/4130005515 >> v2:172.21.15.131:3300/0 conn(0x7f44581538f0 0x7f44580a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4455d9b700 1 -- 172.21.15.84:0/4130005515 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445815a520 con 0x7f4458153cc0 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.602+0000 7f4455d9b700 1 --2- 172.21.15.84:0/4130005515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 0x7f4458159ad0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f44580686d0 tx=0x7f4440009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911380bbea85cab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445559a700 1 -- 172.21.15.84:0/4130005515 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444000b860 con 0x7f4458153cc0 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445559a700 1 -- 172.21.15.84:0/4130005515 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444000b9c0 con 0x7f4458153cc0 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445559a700 1 -- 172.21.15.84:0/4130005515 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444000bd60 con 0x7f4458153cc0 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445759e700 1 -- 172.21.15.84:0/4130005515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 msgr2=0x7f4458159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445759e700 1 --2- 172.21.15.84:0/4130005515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 0x7f4458159ad0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f44580686d0 tx=0x7f4440009250 comp rx=0 tx=0).stop 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445759e700 1 -- 172.21.15.84:0/4130005515 shutdown_connections 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445759e700 1 --2- 172.21.15.84:0/4130005515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f445815a010 0x7f44580cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445759e700 1 --2- 172.21.15.84:0/4130005515 >> v2:172.21.15.131:3300/0 conn(0x7f44581538f0 0x7f44580a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445759e700 1 --2- 172.21.15.84:0/4130005515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 0x7f4458159ad0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445759e700 1 -- 172.21.15.84:0/4130005515 >> 172.21.15.84:0/4130005515 conn(0x7f44580691d0 msgr2=0x7f44580cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445759e700 1 -- 172.21.15.84:0/4130005515 shutdown_connections 2023-10-06T03:00:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.603+0000 7f445759e700 1 -- 172.21.15.84:0/4130005515 wait complete. 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.604+0000 7f445759e700 1 Processor -- start 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.604+0000 7f445759e700 1 -- start start 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f445759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44581538f0 0x7f4458152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f445759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 0x7f445815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f445759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f445815a010 0x7f445816d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f445759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445815c210 con 0x7f4458153cc0 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f445759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44580c4690 con 0x7f445815a010 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f445759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445815bf30 con 0x7f44581538f0 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f4455d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 0x7f445815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f4455d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 0x7f445815b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51966/0 (socket says 172.21.15.84:51966) 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f4455d9b700 1 -- 172.21.15.84:0/1206935567 learned_addr learned my addr 172.21.15.84:0/1206935567 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f445659c700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44581538f0 0x7f4458152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f4456d9d700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f445815a010 0x7f445816d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f4455d9b700 1 -- 172.21.15.84:0/1206935567 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44581538f0 msgr2=0x7f4458152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f4455d9b700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44581538f0 0x7f4458152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f4455d9b700 1 -- 172.21.15.84:0/1206935567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f445815a010 msgr2=0x7f445816d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f4455d9b700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f445815a010 0x7f445816d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f4455d9b700 1 -- 172.21.15.84:0/1206935567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400094f0 con 0x7f4458153cc0 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.605+0000 7f445659c700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44581538f0 0x7f4458152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.606+0000 7f4455d9b700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 0x7f445815b5e0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f445806d880 tx=0x7f4440017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:26.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.606+0000 7f444e7fc700 1 -- 172.21.15.84:0/1206935567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440024440 con 0x7f4458153cc0 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.606+0000 7f444e7fc700 1 -- 172.21.15.84:0/1206935567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44400245a0 con 0x7f4458153cc0 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.606+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44580c4930 con 0x7f4458153cc0 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.606+0000 7f444e7fc700 1 -- 172.21.15.84:0/1206935567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440024960 con 0x7f4458153cc0 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.606+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4458153050 con 0x7f4458153cc0 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.607+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44580cd8c0 con 0x7f4458153cc0 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.607+0000 7f444e7fc700 1 -- 172.21.15.84:0/1206935567 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f444001a420 con 0x7f4458153cc0 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.607+0000 7f444e7fc700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4438066f30 0x7f44380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.607+0000 7f444e7fc700 1 -- 172.21.15.84:0/1206935567 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4440086640 con 0x7f4458153cc0 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.607+0000 7f445659c700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4438066f30 0x7f44380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.608+0000 7f445659c700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4438066f30 0x7f44380693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f445000e420 tx=0x7f4450007670 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:26.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.612+0000 7f444e7fc700 1 -- 172.21.15.84:0/1206935567 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4440053610 con 0x7f4458153cc0 2023-10-06T03:00:26.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.835+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f445805f270 con 0x7f4458153cc0 2023-10-06T03:00:26.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.835+0000 7f444e7fc700 1 -- 172.21.15.84:0/1206935567 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4639 (secure 0 0 0) 0x7f4440056c30 con 0x7f4458153cc0 2023-10-06T03:00:26.837 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:26.837 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":76,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T02:59:56.011330+0000","modified":"2023-10-06T03:00:26.181788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7185,"mds_1":7182,"mds_2":6382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6382":{"gid":6382,"name":"d","rank":2,"incarnation":72,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/1887986838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1887986838},{"type":"v1","addr":"172.21.15.131:6835","nonce":1887986838}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7182":{"gid":7182,"name":"a","rank":1,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/2917413983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2917413983},{"type":"v1","addr":"172.21.15.84:6836","nonce":2917413983}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7185":{"gid":7185,"name":"c","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/2418120362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2418120362},{"type":"v1","addr":"172.21.15.84:6837","nonce":2418120362}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T03:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4438066f30 msgr2=0x7f44380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4438066f30 0x7f44380693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f445000e420 tx=0x7f4450007670 comp rx=0 tx=0).stop 2023-10-06T03:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 msgr2=0x7f445815b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 0x7f445815b5e0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f445806d880 tx=0x7f4440017000 comp rx=0 tx=0).stop 2023-10-06T03:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 shutdown_connections 2023-10-06T03:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4438066f30 0x7f44380693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f445815a010 0x7f445816d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f44581538f0 0x7f4458152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 --2- 172.21.15.84:0/1206935567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4458153cc0 0x7f445815b5e0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 >> 172.21.15.84:0/1206935567 conn(0x7f44580691d0 msgr2=0x7f44580c3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:26.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 shutdown_connections 2023-10-06T03:00:26.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.837+0000 7f445759e700 1 -- 172.21.15.84:0/1206935567 wait complete. 2023-10-06T03:00:26.840 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 76 2023-10-06T03:00:26.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.963+0000 7f21544a9700 1 Processor -- start 2023-10-06T03:00:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.963+0000 7f21544a9700 1 -- start start 2023-10-06T03:00:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.964+0000 7f21544a9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c1595a0 0x7f214c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.964+0000 7f21544a9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f214c0b07a0 0x7f214c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.964+0000 7f21544a9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0b0ca0 con 0x7f214c0b49e0 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.964+0000 7f21544a9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c0b0f80 con 0x7f214c0b07a0 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.964+0000 7f21544a9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0b1260 con 0x7f214c1595a0 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2152a46700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f214c0b07a0 0x7f214c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2152a46700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f214c0b07a0 0x7f214c0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51978/0 (socket says 172.21.15.84:51978) 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2152a46700 1 -- 172.21.15.84:0/1336049846 learned_addr learned my addr 172.21.15.84:0/1336049846 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2152245700 1 --2- 172.21.15.84:0/1336049846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c1595a0 0x7f214c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2152a46700 1 -- 172.21.15.84:0/1336049846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c1595a0 msgr2=0x7f214c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2152a46700 1 --2- 172.21.15.84:0/1336049846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c1595a0 0x7f214c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2152a46700 1 -- 172.21.15.84:0/1336049846 >> v1:172.21.15.131:6789/0 conn(0x7f214c0b49e0 legacy=0x7f214c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2152a46700 1 -- 172.21.15.84:0/1336049846 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0b1540 con 0x7f214c0b07a0 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2152a46700 1 --2- 172.21.15.84:0/1336049846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b07a0 0x7f214c0b1c00 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f21440099b0 tx=0x7f2144009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7815e6d2eb74756a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2151243700 1 -- 172.21.15.84:0/1336049846 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400b820 con 0x7f214c0b07a0 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2151243700 1 -- 172.21.15.84:0/1336049846 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400b980 con 0x7f214c0b07a0 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.965+0000 7f2151243700 1 -- 172.21.15.84:0/1336049846 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400bd20 con 0x7f214c0b07a0 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.966+0000 7f21544a9700 1 -- 172.21.15.84:0/1336049846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b07a0 msgr2=0x7f214c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.966+0000 7f21544a9700 1 --2- 172.21.15.84:0/1336049846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b07a0 0x7f214c0b1c00 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f21440099b0 tx=0x7f2144009250 comp rx=0 tx=0).stop 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.966+0000 7f21544a9700 1 -- 172.21.15.84:0/1336049846 shutdown_connections 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.966+0000 7f21544a9700 1 --2- 172.21.15.84:0/1336049846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b07a0 0x7f214c0b1c00 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.966+0000 7f21544a9700 1 --2- 172.21.15.84:0/1336049846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c1595a0 0x7f214c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.966+0000 7f21544a9700 1 -- 172.21.15.84:0/1336049846 >> 172.21.15.84:0/1336049846 conn(0x7f214c099830 msgr2=0x7f214c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.966+0000 7f21544a9700 1 -- 172.21.15.84:0/1336049846 shutdown_connections 2023-10-06T03:00:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.966+0000 7f21544a9700 1 -- 172.21.15.84:0/1336049846 wait complete. 2023-10-06T03:00:26.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.967+0000 7f21544a9700 1 Processor -- start 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.967+0000 7f21544a9700 1 -- start start 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21544a9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c0b07a0 0x7f214c169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21544a9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b49e0 0x7f214c158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21544a9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f214c1595a0 0x7f214c0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21544a9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c09d0a0 con 0x7f214c0b49e0 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21544a9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0c6ab0 con 0x7f214c1595a0 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21544a9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c09c770 con 0x7f214c0b07a0 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2151a44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b49e0 0x7f214c158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2151a44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b49e0 0x7f214c158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51990/0 (socket says 172.21.15.84:51990) 2023-10-06T03:00:26.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2151a44700 1 -- 172.21.15.84:0/3339351305 learned_addr learned my addr 172.21.15.84:0/3339351305 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2152245700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c0b07a0 0x7f214c169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2152a46700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f214c1595a0 0x7f214c0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2151a44700 1 -- 172.21.15.84:0/3339351305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c0b07a0 msgr2=0x7f214c169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2151a44700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c0b07a0 0x7f214c169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2151a44700 1 -- 172.21.15.84:0/3339351305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f214c1595a0 msgr2=0x7f214c0cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2151a44700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f214c1595a0 0x7f214c0cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2151a44700 1 -- 172.21.15.84:0/3339351305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440094f0 con 0x7f214c0b49e0 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f2151a44700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b49e0 0x7f214c158a60 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c590 tx=0x7f213c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21427fc700 1 -- 172.21.15.84:0/3339351305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c011590 con 0x7f214c0b49e0 2023-10-06T03:00:26.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21427fc700 1 -- 172.21.15.84:0/3339351305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c011730 con 0x7f214c0b49e0 2023-10-06T03:00:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c09ca50 con 0x7f214c0b49e0 2023-10-06T03:00:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21427fc700 1 -- 172.21.15.84:0/3339351305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c011af0 con 0x7f214c0b49e0 2023-10-06T03:00:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.968+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c169f50 con 0x7f214c0b49e0 2023-10-06T03:00:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.969+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c064ad0 con 0x7f214c0b49e0 2023-10-06T03:00:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.970+0000 7f21427fc700 1 -- 172.21.15.84:0/3339351305 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f213c01c460 con 0x7f214c0b49e0 2023-10-06T03:00:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.970+0000 7f21427fc700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2130066f30 0x7f21300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.970+0000 7f21427fc700 1 -- 172.21.15.84:0/3339351305 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f213c084540 con 0x7f214c0b49e0 2023-10-06T03:00:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.970+0000 7f2152245700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2130066f30 0x7f21300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:26.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.970+0000 7f2152245700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2130066f30 0x7f21300693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f214800e420 tx=0x7f21480076a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:26.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:26.974+0000 7f21427fc700 1 -- 172.21.15.84:0/3339351305 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f213c051510 con 0x7f214c0b49e0 2023-10-06T03:00:27.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.160+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f214c0b1820 con 0x7f214c0b49e0 2023-10-06T03:00:27.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.161+0000 7f21427fc700 1 -- 172.21.15.84:0/3339351305 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f213c054b30 con 0x7f214c0b49e0 2023-10-06T03:00:27.163 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:27.163 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":82,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T02:59:57.647692+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-06T02:59:53.640511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-06T02:59:54.978352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:27.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2130066f30 msgr2=0x7f21300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2130066f30 0x7f21300693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f214800e420 tx=0x7f21480076a0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b49e0 msgr2=0x7f214c158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b49e0 0x7f214c158a60 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c590 tx=0x7f213c007f30 comp rx=0 tx=0).stop 2023-10-06T03:00:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 shutdown_connections 2023-10-06T03:00:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2130066f30 0x7f21300693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f214c1595a0 0x7f214c0cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f214c0b07a0 0x7f214c169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 --2- 172.21.15.84:0/3339351305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f214c0b49e0 0x7f214c158a60 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 >> 172.21.15.84:0/3339351305 conn(0x7f214c099830 msgr2=0x7f214c069540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 shutdown_connections 2023-10-06T03:00:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.163+0000 7f21544a9700 1 -- 172.21.15.84:0/3339351305 wait complete. 2023-10-06T03:00:27.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:00:27.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.290+0000 7fde6c75a700 1 Processor -- start 2023-10-06T03:00:27.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.290+0000 7fde6c75a700 1 -- start start 2023-10-06T03:00:27.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.291+0000 7fde6c75a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde640ad360 0x7fde640ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.291+0000 7fde6c75a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde64159f80 con 0x7fde64068d10 2023-10-06T03:00:27.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.291+0000 7fde6c75a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6415a260 con 0x7fde640ad730 2023-10-06T03:00:27.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.291+0000 7fde6c75a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6415a540 con 0x7fde640ad360 2023-10-06T03:00:27.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.291+0000 7fde6acf7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fde64068d10 0x7fde6415b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42384/0 (socket says 172.21.15.84:42384) 2023-10-06T03:00:27.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.291+0000 7fde6acf7700 1 -- 172.21.15.84:0/1205959776 learned_addr learned my addr 172.21.15.84:0/1205959776 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.291+0000 7fde6a4f6700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde640ad360 0x7fde640ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472688198 0 0) 0x7fde64159f80 con 0x7fde64068d10 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde50003570 con 0x7fde64068d10 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205990160 0 0) 0x7fde6415a260 con 0x7fde640ad730 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde64159f80 con 0x7fde640ad730 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1128658462 0 0) 0x7fde50003570 con 0x7fde64068d10 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde640ad360 msgr2=0x7fde640ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde640ad360 0x7fde640ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 >> v1:172.21.15.131:6789/0 conn(0x7fde640ad730 legacy=0x7fde64068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6415a820 con 0x7fde64068d10 2023-10-06T03:00:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fde5c0017f0 con 0x7fde64068d10 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 >> v1:172.21.15.84:6789/0 conn(0x7fde64068d10 legacy=0x7fde6415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde50003c20 0x7fde50004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde50004810 0x7fde50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde500051c0 0x7fde5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6415a540 con 0x7fde500051c0 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5000c0b0 con 0x7fde50004810 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5000c270 con 0x7fde50003c20 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde6a4f6700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde640ad360 0x7fde640ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde6acf7700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde500051c0 0x7fde5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde69cf5700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde50004810 0x7fde50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde6a4f6700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde50003c20 0x7fde50004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde6acf7700 1 -- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde50003c20 msgr2=0x7fde50004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde6acf7700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde50003c20 0x7fde50004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde6acf7700 1 -- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde50004810 msgr2=0x7fde50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde6acf7700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde50004810 0x7fde50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde6acf7700 1 -- 172.21.15.84:0/1205959776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50003570 con 0x7fde500051c0 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.292+0000 7fde6acf7700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde500051c0 0x7fde5000ba60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fde6406dcc0 tx=0x7fde6415ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22c85f4296d4812 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0070f0 con 0x7fde500051c0 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c007250 con 0x7fde500051c0 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde694f4700 1 -- 172.21.15.84:0/1205959776 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c007610 con 0x7fde500051c0 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde6c75a700 1 -- 172.21.15.84:0/1205959776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde500051c0 msgr2=0x7fde5000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde6c75a700 1 --2- 172.21.15.84:0/1205959776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde500051c0 0x7fde5000ba60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fde6406dcc0 tx=0x7fde6415ab00 comp rx=0 tx=0).stop 2023-10-06T03:00:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde6acf7700 1 -- 172.21.15.84:0/1205959776 reap_dead start 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde6c75a700 1 -- 172.21.15.84:0/1205959776 shutdown_connections 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde6c75a700 1 -- 172.21.15.84:0/1205959776 >> 172.21.15.84:0/1205959776 conn(0x7fde6406dd10 msgr2=0x7fde6406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde6c75a700 1 -- 172.21.15.84:0/1205959776 shutdown_connections 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.293+0000 7fde6c75a700 1 -- 172.21.15.84:0/1205959776 wait complete. 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.294+0000 7fde6c75a700 1 Processor -- start 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.294+0000 7fde6c75a700 1 -- start start 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde6c75a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500051c0 0x7fde64141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde6c75a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde640c9720 0x7fde6415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde6c75a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde6415e2b0 0x7fde640af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde6c75a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6415e750 con 0x7fde640c9720 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde6c75a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c9290 con 0x7fde500051c0 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde6c75a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640b0460 con 0x7fde6415e2b0 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde69cf5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde640c9720 0x7fde6415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde69cf5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde640c9720 0x7fde6415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52008/0 (socket says 172.21.15.84:52008) 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde69cf5700 1 -- 172.21.15.84:0/3789557593 learned_addr learned my addr 172.21.15.84:0/3789557593 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde6a4f6700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500051c0 0x7fde64141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.295+0000 7fde6acf7700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde6415e2b0 0x7fde640af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde69cf5700 1 -- 172.21.15.84:0/3789557593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde6415e2b0 msgr2=0x7fde640af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde69cf5700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde6415e2b0 0x7fde640af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde69cf5700 1 -- 172.21.15.84:0/3789557593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500051c0 msgr2=0x7fde64141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde69cf5700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500051c0 0x7fde64141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde69cf5700 1 -- 172.21.15.84:0/3789557593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640c8c40 con 0x7fde640c9720 2023-10-06T03:00:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde69cf5700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde640c9720 0x7fde6415dd70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fde54002c00 tx=0x7fde54007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde5a7fc700 1 -- 172.21.15.84:0/3789557593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400fa50 con 0x7fde640c9720 2023-10-06T03:00:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde5a7fc700 1 -- 172.21.15.84:0/3789557593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400fbd0 con 0x7fde640c9720 2023-10-06T03:00:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde640c8f20 con 0x7fde640c9720 2023-10-06T03:00:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde5a7fc700 1 -- 172.21.15.84:0/3789557593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540133f0 con 0x7fde640c9720 2023-10-06T03:00:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.296+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde640afcb0 con 0x7fde640c9720 2023-10-06T03:00:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.297+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde640c8a80 con 0x7fde640c9720 2023-10-06T03:00:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.297+0000 7fde5a7fc700 1 -- 172.21.15.84:0/3789557593 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde54013760 con 0x7fde640c9720 2023-10-06T03:00:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.297+0000 7fde5a7fc700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.298+0000 7fde5a7fc700 1 -- 172.21.15.84:0/3789557593 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fde540850d0 con 0x7fde640c9720 2023-10-06T03:00:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.298+0000 7fde6a4f6700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.298+0000 7fde6a4f6700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fde64063df0 tx=0x7fde60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.302+0000 7fde5a7fc700 1 -- 172.21.15.84:0/3789557593 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde540520c0 con 0x7fde640c9720 2023-10-06T03:00:27.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.530+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fde64064ad0 con 0x7fde640c9720 2023-10-06T03:00:27.532 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:00:27.531+0000 7fedbe922700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:00:27.542 INFO:tasks.ceph.mds.c.smithi084.stderr: -7498> 2023-10-06T03:00:00.921+0000 7f5c998ca700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:00:27.542 INFO:tasks.ceph.mds.c.smithi084.stderr: -7071> 2023-10-06T03:00:05.921+0000 7f5c998ca700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-06T03:00:27.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.548+0000 7fde5a7fc700 1 -- 172.21.15.84:0/3789557593 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7fde540556e0 con 0x7fde640c9720 2023-10-06T03:00:27.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde48066f30 msgr2=0x7fde480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fde64063df0 tx=0x7fde60008040 comp rx=0 tx=0).stop 2023-10-06T03:00:27.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde640c9720 msgr2=0x7fde6415dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde640c9720 0x7fde6415dd70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fde54002c00 tx=0x7fde54007d30 comp rx=0 tx=0).stop 2023-10-06T03:00:27.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 shutdown_connections 2023-10-06T03:00:27.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500051c0 0x7fde64141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde6415e2b0 0x7fde640af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 --2- 172.21.15.84:0/3789557593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde640c9720 0x7fde6415dd70 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 >> 172.21.15.84:0/3789557593 conn(0x7fde6406dd10 msgr2=0x7fde64152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:27.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 shutdown_connections 2023-10-06T03:00:27.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.550+0000 7fde6c75a700 1 -- 172.21.15.84:0/3789557593 wait complete. 2023-10-06T03:00:27.556 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:00:27.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:00:27.566 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:00:27.566 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:00:27.572 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:00:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.683+0000 7f34ac20c700 1 Processor -- start 2023-10-06T03:00:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.683+0000 7f34ac20c700 1 -- start start 2023-10-06T03:00:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.684+0000 7f34ac20c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34a415b980 0x7f34a406b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.684+0000 7f34ac20c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a4158420 0x7f34a4158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.684+0000 7f34ac20c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a4158820 con 0x7f34a406be20 2023-10-06T03:00:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.684+0000 7f34ac20c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a406c2c0 con 0x7f34a415b980 2023-10-06T03:00:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.684+0000 7f34ac20c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40afbf0 con 0x7f34a4158420 2023-10-06T03:00:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.684+0000 7f34a9fa8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34a415b980 0x7f34a406b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.684+0000 7f34a97a7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f34a406be20 0x7f34a4157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42404/0 (socket says 172.21.15.84:42404) 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.684+0000 7f34a97a7700 1 -- 172.21.15.84:0/2457592913 learned_addr learned my addr 172.21.15.84:0/2457592913 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.684+0000 7f34aa7a9700 1 --2- 172.21.15.84:0/2457592913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a4158420 0x7f34a4158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34a9fa8700 1 -- 172.21.15.84:0/2457592913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a4158420 msgr2=0x7f34a4158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34a9fa8700 1 --2- 172.21.15.84:0/2457592913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a4158420 0x7f34a4158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34a9fa8700 1 -- 172.21.15.84:0/2457592913 >> v1:172.21.15.84:6789/0 conn(0x7f34a406be20 legacy=0x7f34a4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34a9fa8700 1 -- 172.21.15.84:0/2457592913 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a40afed0 con 0x7f34a415b980 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34a8fa6700 1 -- 172.21.15.84:0/2457592913 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831208422 0 0) 0x7f34a4158820 con 0x7f34a406be20 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34a9fa8700 1 --2- 172.21.15.84:0/2457592913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 0x7f34a406b8e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009e60 tx=0x7f34a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f327c9a2a5b23c06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34a8fa6700 1 -- 172.21.15.84:0/2457592913 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000e070 con 0x7f34a415b980 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34a8fa6700 1 -- 172.21.15.84:0/2457592913 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000bc30 con 0x7f34a415b980 2023-10-06T03:00:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34a8fa6700 1 -- 172.21.15.84:0/2457592913 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0012430 con 0x7f34a415b980 2023-10-06T03:00:27.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34ac20c700 1 -- 172.21.15.84:0/2457592913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 msgr2=0x7f34a406b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34ac20c700 1 --2- 172.21.15.84:0/2457592913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 0x7f34a406b8e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009e60 tx=0x7f34a0009780 comp rx=0 tx=0).stop 2023-10-06T03:00:27.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34ac20c700 1 -- 172.21.15.84:0/2457592913 shutdown_connections 2023-10-06T03:00:27.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34ac20c700 1 --2- 172.21.15.84:0/2457592913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a4158420 0x7f34a4158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34ac20c700 1 --2- 172.21.15.84:0/2457592913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 0x7f34a406b8e0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.685+0000 7f34ac20c700 1 -- 172.21.15.84:0/2457592913 >> 172.21.15.84:0/2457592913 conn(0x7f34a40ce330 msgr2=0x7f34a40ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:27.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.686+0000 7f34ac20c700 1 -- 172.21.15.84:0/2457592913 shutdown_connections 2023-10-06T03:00:27.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.686+0000 7f34ac20c700 1 -- 172.21.15.84:0/2457592913 wait complete. 2023-10-06T03:00:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34ac20c700 1 Processor -- start 2023-10-06T03:00:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34ac20c700 1 -- start start 2023-10-06T03:00:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34ac20c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a406be20 0x7f34a4169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34ac20c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34a4158420 0x7f34a40b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34ac20c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 0x7f34a4156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34ac20c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40b33f0 con 0x7f34a415b980 2023-10-06T03:00:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34ac20c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a4156fb0 con 0x7f34a4158420 2023-10-06T03:00:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34ac20c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40b2da0 con 0x7f34a406be20 2023-10-06T03:00:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34aa7a9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 0x7f34a4156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34aa7a9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 0x7f34a4156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52070/0 (socket says 172.21.15.84:52070) 2023-10-06T03:00:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.687+0000 7f34aa7a9700 1 -- 172.21.15.84:0/1111355929 learned_addr learned my addr 172.21.15.84:0/1111355929 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34a9fa8700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a406be20 0x7f34a4169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34a97a7700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34a4158420 0x7f34a40b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34aa7a9700 1 -- 172.21.15.84:0/1111355929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a406be20 msgr2=0x7f34a4169700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34aa7a9700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a406be20 0x7f34a4169700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34aa7a9700 1 -- 172.21.15.84:0/1111355929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34a4158420 msgr2=0x7f34a40b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34aa7a9700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34a4158420 0x7f34a40b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34aa7a9700 1 -- 172.21.15.84:0/1111355929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009a20 con 0x7f34a415b980 2023-10-06T03:00:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34aa7a9700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 0x7f34a4156440 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f349c00d890 tx=0x7f349c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f3499ffb700 1 -- 172.21.15.84:0/1111355929 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0125f0 con 0x7f34a415b980 2023-10-06T03:00:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f3499ffb700 1 -- 172.21.15.84:0/1111355929 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c012770 con 0x7f34a415b980 2023-10-06T03:00:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a40b3080 con 0x7f34a415b980 2023-10-06T03:00:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f3499ffb700 1 -- 172.21.15.84:0/1111355929 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c012b30 con 0x7f34a415b980 2023-10-06T03:00:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.688+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a40b2a70 con 0x7f34a415b980 2023-10-06T03:00:27.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.689+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a4064ad0 con 0x7f34a415b980 2023-10-06T03:00:27.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.690+0000 7f3499ffb700 1 -- 172.21.15.84:0/1111355929 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f349c01e460 con 0x7f34a415b980 2023-10-06T03:00:27.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.690+0000 7f3499ffb700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3488066f30 0x7f34880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:27.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.690+0000 7f3499ffb700 1 -- 172.21.15.84:0/1111355929 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6636+0+0 (secure 0 0 0) 0x7f349c084e20 con 0x7f34a415b980 2023-10-06T03:00:27.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.690+0000 7f34a9fa8700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3488066f30 0x7f34880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:27.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.690+0000 7f34a9fa8700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3488066f30 0x7f34880693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009e60 tx=0x7f34a0019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:27.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.694+0000 7f3499ffb700 1 -- 172.21.15.84:0/1111355929 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f349c051cf0 con 0x7f34a415b980 2023-10-06T03:00:27.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:27.924+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f34a40b01b0 con 0x7f34a415b980 2023-10-06T03:00:28.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.538+0000 7f3499ffb700 1 -- 172.21.15.84:0/1111355929 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7f349c055310 con 0x7f34a415b980 2023-10-06T03:00:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.540+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3488066f30 msgr2=0x7f34880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:28.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.540+0000 7f34ac20c700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3488066f30 0x7f34880693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009e60 tx=0x7f34a0019000 comp rx=0 tx=0).stop 2023-10-06T03:00:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.540+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 msgr2=0x7f34a4156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:28.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.540+0000 7f34ac20c700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 0x7f34a4156440 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f349c00d890 tx=0x7f349c008040 comp rx=0 tx=0).stop 2023-10-06T03:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.541+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 shutdown_connections 2023-10-06T03:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.541+0000 7f34ac20c700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3488066f30 0x7f34880693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.541+0000 7f34ac20c700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34a415b980 0x7f34a4156440 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.541+0000 7f34ac20c700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f34a406be20 0x7f34a4169700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.541+0000 7f34ac20c700 1 --2- 172.21.15.84:0/1111355929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34a4158420 0x7f34a40b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.541+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 >> 172.21.15.84:0/1111355929 conn(0x7f34a40ce330 msgr2=0x7f34a40cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.541+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 shutdown_connections 2023-10-06T03:00:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.541+0000 7f34ac20c700 1 -- 172.21.15.84:0/1111355929 wait complete. 2023-10-06T03:00:28.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:00:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.714+0000 7f688fb98700 1 Processor -- start 2023-10-06T03:00:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.714+0000 7f688fb98700 1 -- start start 2023-10-06T03:00:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688fb98700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f688806ed20 0x7f68880b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688fb98700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880b2d20 con 0x7f68880aee20 2023-10-06T03:00:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688fb98700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880b0450 con 0x7f688806f0f0 2023-10-06T03:00:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688fb98700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688806fb80 con 0x7f688806ed20 2023-10-06T03:00:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688d934700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f688806ed20 0x7f68880b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688e135700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f68880aee20 0x7f68880af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42416/0 (socket says 172.21.15.84:42416) 2023-10-06T03:00:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688e135700 1 -- 172.21.15.84:0/2689307657 learned_addr learned my addr 172.21.15.84:0/2689307657 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688d934700 1 -- 172.21.15.84:0/2689307657 >> v1:172.21.15.131:6789/0 conn(0x7f688806f0f0 legacy=0x7f68880b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688d934700 1 -- 172.21.15.84:0/2689307657 >> v1:172.21.15.84:6789/0 conn(0x7f68880aee20 legacy=0x7f68880af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.715+0000 7f688c932700 1 -- 172.21.15.84:0/2689307657 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703543892 0 0) 0x7f68880b2d20 con 0x7f68880aee20 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688d934700 1 -- 172.21.15.84:0/2689307657 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880b2a40 con 0x7f688806ed20 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688d934700 1 --2- 172.21.15.84:0/2689307657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688806ed20 0x7f68880b23a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f6884009910 tx=0x7f68840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f200995c42ad887 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688c932700 1 -- 172.21.15.84:0/2689307657 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400b7e0 con 0x7f688806ed20 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688c932700 1 -- 172.21.15.84:0/2689307657 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688400b940 con 0x7f688806ed20 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688c932700 1 -- 172.21.15.84:0/2689307657 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400bce0 con 0x7f688806ed20 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688fb98700 1 -- 172.21.15.84:0/2689307657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688806ed20 msgr2=0x7f68880b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688fb98700 1 --2- 172.21.15.84:0/2689307657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688806ed20 0x7f68880b23a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f6884009910 tx=0x7f68840091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688fb98700 1 -- 172.21.15.84:0/2689307657 shutdown_connections 2023-10-06T03:00:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688fb98700 1 --2- 172.21.15.84:0/2689307657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f688806ed20 0x7f68880b23a0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688fb98700 1 -- 172.21.15.84:0/2689307657 >> 172.21.15.84:0/2689307657 conn(0x7f6888068330 msgr2=0x7f6888068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688fb98700 1 -- 172.21.15.84:0/2689307657 shutdown_connections 2023-10-06T03:00:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.716+0000 7f688fb98700 1 -- 172.21.15.84:0/2689307657 wait complete. 2023-10-06T03:00:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.717+0000 7f688fb98700 1 Processor -- start 2023-10-06T03:00:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.717+0000 7f688fb98700 1 -- start start 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.718+0000 7f688fb98700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f688806ed20 0x7f68880ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.718+0000 7f688fb98700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f688806f0f0 0x7f6888168e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.718+0000 7f688fb98700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68880aee20 0x7f6888169390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.718+0000 7f688fb98700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888156290 con 0x7f68880aee20 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.718+0000 7f688fb98700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68880ae900 con 0x7f688806ed20 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.718+0000 7f688fb98700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68880adcf0 con 0x7f688806f0f0 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.718+0000 7f688e135700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68880aee20 0x7f6888169390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.718+0000 7f688e135700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68880aee20 0x7f6888169390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52096/0 (socket says 172.21.15.84:52096) 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.718+0000 7f688e135700 1 -- 172.21.15.84:0/2968335528 learned_addr learned my addr 172.21.15.84:0/2968335528 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688d934700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f688806ed20 0x7f68880ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688e135700 1 -- 172.21.15.84:0/2968335528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f688806f0f0 msgr2=0x7f6888168e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688e135700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f688806f0f0 0x7f6888168e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688e135700 1 -- 172.21.15.84:0/2968335528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f688806ed20 msgr2=0x7f68880ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688e135700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f688806ed20 0x7f68880ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688e135700 1 -- 172.21.15.84:0/2968335528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884009420 con 0x7f68880aee20 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688d934700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f688806ed20 0x7f68880ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688e135700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68880aee20 0x7f6888169390 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f688000cc90 tx=0x7f6880001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f687dffb700 1 -- 172.21.15.84:0/2968335528 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000cea0 con 0x7f68880aee20 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f687dffb700 1 -- 172.21.15.84:0/2968335528 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688000ab70 con 0x7f68880aee20 2023-10-06T03:00:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f687dffb700 1 -- 172.21.15.84:0/2968335528 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800070f0 con 0x7f68880aee20 2023-10-06T03:00:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68880adfd0 con 0x7f68880aee20 2023-10-06T03:00:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.719+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68880ad970 con 0x7f68880aee20 2023-10-06T03:00:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.720+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68880aea90 con 0x7f68880aee20 2023-10-06T03:00:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.720+0000 7f687dffb700 1 -- 172.21.15.84:0/2968335528 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68800074a0 con 0x7f68880aee20 2023-10-06T03:00:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.721+0000 7f687dffb700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f686c066f30 0x7f686c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.721+0000 7f687dffb700 1 -- 172.21.15.84:0/2968335528 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6636+0+0 (secure 0 0 0) 0x7f6880084d80 con 0x7f68880aee20 2023-10-06T03:00:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.721+0000 7f688d934700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f686c066f30 0x7f686c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:28.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.721+0000 7f688d934700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f686c066f30 0x7f686c0693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6888156b80 tx=0x7f6884016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.725+0000 7f687dffb700 1 -- 172.21.15.84:0/2968335528 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6880051cd0 con 0x7f68880aee20 2023-10-06T03:00:28.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:28.910+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6888064ad0 con 0x7f68880aee20 2023-10-06T03:00:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.542+0000 7f687dffb700 1 -- 172.21.15.84:0/2968335528 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7f68800552f0 con 0x7f68880aee20 2023-10-06T03:00:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f686c066f30 msgr2=0x7f686c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f686c066f30 0x7f686c0693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6888156b80 tx=0x7f6884016000 comp rx=0 tx=0).stop 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68880aee20 msgr2=0x7f6888169390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68880aee20 0x7f6888169390 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f688000cc90 tx=0x7f6880001a80 comp rx=0 tx=0).stop 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 shutdown_connections 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f686c066f30 0x7f686c0693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f688806ed20 0x7f68880ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68880aee20 0x7f6888169390 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 --2- 172.21.15.84:0/2968335528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f688806f0f0 0x7f6888168e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 >> 172.21.15.84:0/2968335528 conn(0x7f6888068330 msgr2=0x7f68880af280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 shutdown_connections 2023-10-06T03:00:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.546+0000 7f688fb98700 1 -- 172.21.15.84:0/2968335528 wait complete. 2023-10-06T03:00:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:00:29.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:00:29.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.677+0000 7f4b9f4aa700 1 Processor -- start 2023-10-06T03:00:29.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.677+0000 7f4b9f4aa700 1 -- start start 2023-10-06T03:00:29.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9f4aa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4b981593a0 0x7f4b980b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9f4aa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b980ab200 con 0x7f4b98159770 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9f4aa700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b980b1660 con 0x7f4b980b4490 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9f4aa700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b980b0a50 con 0x7f4b981593a0 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9dca7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4b98159770 0x7f4b980b3d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42420/0 (socket says 172.21.15.84:42420) 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9dca7700 1 -- 172.21.15.84:0/3137687076 learned_addr learned my addr 172.21.15.84:0/3137687076 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9e4a8700 1 --2- 172.21.15.84:0/3137687076 >> v2:172.21.15.131:3300/0 conn(0x7f4b981593a0 0x7f4b980b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713357780 0 0) 0x7f4b88001110 con 0x7f4b98159770 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84003570 con 0x7f4b98159770 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4024122972 0 0) 0x7f4b84003570 con 0x7f4b98159770 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 >> v2:172.21.15.131:3300/0 conn(0x7f4b981593a0 msgr2=0x7f4b980b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:29.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9d4a6700 1 --2- 172.21.15.84:0/3137687076 >> v2:172.21.15.131:3300/0 conn(0x7f4b981593a0 0x7f4b980b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 >> v1:172.21.15.131:6789/0 conn(0x7f4b980b4490 legacy=0x7f4b980cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980b0d30 con 0x7f4b98159770 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.678+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f4b88001600 con 0x7f4b98159770 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 >> v1:172.21.15.84:6789/0 conn(0x7f4b98159770 legacy=0x7f4b980b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b84003a60 0x7f4b84003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b84004810 0x7f4b84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b840051c0 0x7f4b8400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980b0a50 con 0x7f4b84004810 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400c0d0 con 0x7f4b84003a60 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400c290 con 0x7f4b840051c0 2023-10-06T03:00:29.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9dca7700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b84004810 0x7f4b84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9e4a8700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b84003a60 0x7f4b84003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9eca9700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b840051c0 0x7f4b8400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9dca7700 1 -- 172.21.15.84:0/3137687076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b840051c0 msgr2=0x7f4b8400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9dca7700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b840051c0 0x7f4b8400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9dca7700 1 -- 172.21.15.84:0/3137687076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b84003a60 msgr2=0x7f4b84003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9dca7700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b84003a60 0x7f4b84003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9dca7700 1 -- 172.21.15.84:0/3137687076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84003570 con 0x7f4b84004810 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9eca9700 1 -- 172.21.15.84:0/3137687076 reap_dead start 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9e4a8700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b84003a60 0x7f4b84003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:29.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9dca7700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b84004810 0x7f4b84004c80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800c5c0 tx=0x7f4b88007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c45b5ae58261b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:29.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800cdc0 con 0x7f4b84004810 2023-10-06T03:00:29.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b88005920 con 0x7f4b84004810 2023-10-06T03:00:29.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.679+0000 7f4b9d4a6700 1 -- 172.21.15.84:0/3137687076 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88005ce0 con 0x7f4b84004810 2023-10-06T03:00:29.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.680+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/3137687076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b84004810 msgr2=0x7f4b84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:29.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.680+0000 7f4b9f4aa700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b84004810 0x7f4b84004c80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800c5c0 tx=0x7f4b88007a50 comp rx=0 tx=0).stop 2023-10-06T03:00:29.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.680+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/3137687076 shutdown_connections 2023-10-06T03:00:29.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.680+0000 7f4b9f4aa700 1 --2- 172.21.15.84:0/3137687076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b84004810 0x7f4b84004c80 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.680+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/3137687076 >> 172.21.15.84:0/3137687076 conn(0x7f4b980995c0 msgr2=0x7f4b9806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:29.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.680+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/3137687076 shutdown_connections 2023-10-06T03:00:29.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.680+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/3137687076 wait complete. 2023-10-06T03:00:29.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.681+0000 7f4b9f4aa700 1 Processor -- start 2023-10-06T03:00:29.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.681+0000 7f4b9f4aa700 1 -- start start 2023-10-06T03:00:29.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9f4aa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b84004810 0x7f4b980a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:29.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9f4aa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b9815ad60 0x7f4b9815b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9f4aa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b980ad630 0x7f4b980ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9f4aa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98159d00 con 0x7f4b9815ad60 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9f4aa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98159fa0 con 0x7f4b980ad630 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9f4aa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9815a280 con 0x7f4b84004810 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9dca7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b9815ad60 0x7f4b9815b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9dca7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b9815ad60 0x7f4b9815b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52124/0 (socket says 172.21.15.84:52124) 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9dca7700 1 -- 172.21.15.84:0/2116882913 learned_addr learned my addr 172.21.15.84:0/2116882913 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9e4a8700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b84004810 0x7f4b980a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9eca9700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b980ad630 0x7f4b980ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:29.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9dca7700 1 -- 172.21.15.84:0/2116882913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b84004810 msgr2=0x7f4b980a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9dca7700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b84004810 0x7f4b980a9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9dca7700 1 -- 172.21.15.84:0/2116882913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b980ad630 msgr2=0x7f4b980ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9dca7700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b980ad630 0x7f4b980ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9dca7700 1 -- 172.21.15.84:0/2116882913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9815a560 con 0x7f4b9815ad60 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9dca7700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b9815ad60 0x7f4b9815b1d0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400c0a0 tx=0x7f4b88015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b8e7fc700 1 -- 172.21.15.84:0/2116882913 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800cdc0 con 0x7f4b9815ad60 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b8e7fc700 1 -- 172.21.15.84:0/2116882913 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b880072e0 con 0x7f4b9815ad60 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9815a840 con 0x7f4b9815ad60 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b8e7fc700 1 -- 172.21.15.84:0/2116882913 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880076a0 con 0x7f4b9815ad60 2023-10-06T03:00:29.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.682+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b980ac250 con 0x7f4b9815ad60 2023-10-06T03:00:29.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.683+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b980af830 con 0x7f4b9815ad60 2023-10-06T03:00:29.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.684+0000 7f4b8e7fc700 1 -- 172.21.15.84:0/2116882913 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b8801e640 con 0x7f4b9815ad60 2023-10-06T03:00:29.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.684+0000 7f4b8e7fc700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b7c066f30 0x7f4b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:29.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.684+0000 7f4b8e7fc700 1 -- 172.21.15.84:0/2116882913 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6198+0+0 (secure 0 0 0) 0x7f4b880850b0 con 0x7f4b9815ad60 2023-10-06T03:00:29.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.684+0000 7f4b9e4a8700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b7c066f30 0x7f4b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:29.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.685+0000 7f4b9e4a8700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b7c066f30 0x7f4b7c0693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009fd0 tx=0x7f4b9000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:29.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.688+0000 7f4b8e7fc700 1 -- 172.21.15.84:0/2116882913 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b88052130 con 0x7f4b9815ad60 2023-10-06T03:00:29.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:29.872+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4b9805f270 con 0x7f4b9815ad60 2023-10-06T03:00:30.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.550+0000 7f4b8e7fc700 1 -- 172.21.15.84:0/2116882913 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4b88055750 con 0x7f4b9815ad60 2023-10-06T03:00:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.552+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b7c066f30 msgr2=0x7f4b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.552+0000 7f4b9f4aa700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b7c066f30 0x7f4b7c0693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009fd0 tx=0x7f4b9000b040 comp rx=0 tx=0).stop 2023-10-06T03:00:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.552+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b9815ad60 msgr2=0x7f4b9815b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.552+0000 7f4b9f4aa700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b9815ad60 0x7f4b9815b1d0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400c0a0 tx=0x7f4b88015000 comp rx=0 tx=0).stop 2023-10-06T03:00:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.552+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 shutdown_connections 2023-10-06T03:00:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.552+0000 7f4b9f4aa700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b7c066f30 0x7f4b7c0693e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.552+0000 7f4b9f4aa700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b980ad630 0x7f4b980ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.552+0000 7f4b9f4aa700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b84004810 0x7f4b980a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.552+0000 7f4b9f4aa700 1 --2- 172.21.15.84:0/2116882913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b9815ad60 0x7f4b9815b1d0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.553+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 >> 172.21.15.84:0/2116882913 conn(0x7f4b980995c0 msgr2=0x7f4b9809a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.553+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 shutdown_connections 2023-10-06T03:00:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.553+0000 7f4b9f4aa700 1 -- 172.21.15.84:0/2116882913 wait complete. 2023-10-06T03:00:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:00:30.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:00:30.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.682+0000 7f6737702700 1 Processor -- start 2023-10-06T03:00:30.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.682+0000 7f6737702700 1 -- start start 2023-10-06T03:00:30.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.683+0000 7f6737702700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6730142f20 0x7f673006b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.683+0000 7f6737702700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f673006bb80 0x7f67300675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.683+0000 7f6737702700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6730067b30 0x7f67300c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.683+0000 7f6737702700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6730067fb0 con 0x7f6730067b30 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.683+0000 7f6737702700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673006b1b0 con 0x7f673006bb80 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.683+0000 7f6737702700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67301432f0 con 0x7f6730142f20 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.683+0000 7f6735c9f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6730067b30 0x7f67300c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6735c9f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6730067b30 0x7f67300c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52136/0 (socket says 172.21.15.84:52136) 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6735c9f700 1 -- 172.21.15.84:0/2234798045 learned_addr learned my addr 172.21.15.84:0/2234798045 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6735c9f700 1 -- 172.21.15.84:0/2234798045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6730142f20 msgr2=0x7f673006b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6735c9f700 1 --2- 172.21.15.84:0/2234798045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6730142f20 0x7f673006b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6735c9f700 1 -- 172.21.15.84:0/2234798045 >> v2:172.21.15.131:3300/0 conn(0x7f673006bb80 msgr2=0x7f67300675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6734c9d700 1 --2- 172.21.15.84:0/2234798045 >> v2:172.21.15.131:3300/0 conn(0x7f673006bb80 0x7f67300675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6735c9f700 1 --2- 172.21.15.84:0/2234798045 >> v2:172.21.15.131:3300/0 conn(0x7f673006bb80 0x7f67300675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6735c9f700 1 -- 172.21.15.84:0/2234798045 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67300cba10 con 0x7f6730067b30 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6735c9f700 1 --2- 172.21.15.84:0/2234798045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 0x7f67300c7830 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f673006dc40 tx=0x7f6728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17db2d908dac7764 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6727fff700 1 -- 172.21.15.84:0/2234798045 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672800b860 con 0x7f6730067b30 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6727fff700 1 -- 172.21.15.84:0/2234798045 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672800b9c0 con 0x7f6730067b30 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.684+0000 7f6727fff700 1 -- 172.21.15.84:0/2234798045 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672800bd60 con 0x7f6730067b30 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.685+0000 7f6737702700 1 -- 172.21.15.84:0/2234798045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 msgr2=0x7f67300c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.685+0000 7f6737702700 1 --2- 172.21.15.84:0/2234798045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 0x7f67300c7830 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f673006dc40 tx=0x7f6728009250 comp rx=0 tx=0).stop 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.685+0000 7f6737702700 1 -- 172.21.15.84:0/2234798045 shutdown_connections 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.685+0000 7f6737702700 1 --2- 172.21.15.84:0/2234798045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 0x7f67300c7830 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.685+0000 7f6737702700 1 --2- 172.21.15.84:0/2234798045 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6730142f20 0x7f673006b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.685+0000 7f6737702700 1 --2- 172.21.15.84:0/2234798045 >> v2:172.21.15.131:3300/0 conn(0x7f673006bb80 0x7f67300675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.685+0000 7f6737702700 1 -- 172.21.15.84:0/2234798045 >> 172.21.15.84:0/2234798045 conn(0x7f67300cd1f0 msgr2=0x7f67300cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.685+0000 7f6737702700 1 -- 172.21.15.84:0/2234798045 shutdown_connections 2023-10-06T03:00:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.685+0000 7f6737702700 1 -- 172.21.15.84:0/2234798045 wait complete. 2023-10-06T03:00:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.686+0000 7f6737702700 1 Processor -- start 2023-10-06T03:00:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.686+0000 7f6737702700 1 -- start start 2023-10-06T03:00:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f6737702700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 0x7f6730169440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f6737702700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f673006bb80 0x7f67300c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f6737702700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6730142f20 0x7f67300b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f6737702700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673016cbc0 con 0x7f6730067b30 2023-10-06T03:00:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f6737702700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730169a30 con 0x7f6730142f20 2023-10-06T03:00:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f6737702700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6730169d10 con 0x7f673006bb80 2023-10-06T03:00:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f673549e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 0x7f6730169440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f673549e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 0x7f6730169440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52138/0 (socket says 172.21.15.84:52138) 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f673549e700 1 -- 172.21.15.84:0/2742341229 learned_addr learned my addr 172.21.15.84:0/2742341229 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f6735c9f700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6730142f20 0x7f67300b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f673549e700 1 -- 172.21.15.84:0/2742341229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f673006bb80 msgr2=0x7f67300c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f673549e700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f673006bb80 0x7f67300c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f673549e700 1 -- 172.21.15.84:0/2742341229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6730142f20 msgr2=0x7f67300b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f673549e700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6730142f20 0x7f67300b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f673549e700 1 -- 172.21.15.84:0/2742341229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280094f0 con 0x7f6730067b30 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f673549e700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 0x7f6730169440 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f672c00bc30 tx=0x7f672c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f67257fa700 1 -- 172.21.15.84:0/2742341229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0092e0 con 0x7f6730067b30 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f67257fa700 1 -- 172.21.15.84:0/2742341229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c00c7a0 con 0x7f6730067b30 2023-10-06T03:00:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6730169ff0 con 0x7f6730067b30 2023-10-06T03:00:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f67257fa700 1 -- 172.21.15.84:0/2742341229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c00cb80 con 0x7f6730067b30 2023-10-06T03:00:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.687+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67300c9610 con 0x7f6730067b30 2023-10-06T03:00:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.688+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6730064ad0 con 0x7f6730067b30 2023-10-06T03:00:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.689+0000 7f67257fa700 1 -- 172.21.15.84:0/2742341229 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f672c012070 con 0x7f6730067b30 2023-10-06T03:00:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.689+0000 7f67257fa700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6714066f30 0x7f67140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.689+0000 7f67257fa700 1 -- 172.21.15.84:0/2742341229 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f672c0841e0 con 0x7f6730067b30 2023-10-06T03:00:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.689+0000 7f6734c9d700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6714066f30 0x7f67140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.690+0000 7f6734c9d700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6714066f30 0x7f67140693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f67300c3160 tx=0x7f6720008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:30.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.693+0000 7f67257fa700 1 -- 172.21.15.84:0/2742341229 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f672c051400 con 0x7f6730067b30 2023-10-06T03:00:30.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.879+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f673006a880 con 0x7f6730067b30 2023-10-06T03:00:30.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.883+0000 7f67257fa700 1 -- 172.21.15.84:0/2742341229 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f672c054a20 con 0x7f6730067b30 2023-10-06T03:00:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6714066f30 msgr2=0x7f67140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6714066f30 0x7f67140693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f67300c3160 tx=0x7f6720008040 comp rx=0 tx=0).stop 2023-10-06T03:00:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 msgr2=0x7f6730169440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 0x7f6730169440 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f672c00bc30 tx=0x7f672c009840 comp rx=0 tx=0).stop 2023-10-06T03:00:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 shutdown_connections 2023-10-06T03:00:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6714066f30 0x7f67140693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6730142f20 0x7f67300b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6730067b30 0x7f6730169440 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 --2- 172.21.15.84:0/2742341229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f673006bb80 0x7f67300c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 >> 172.21.15.84:0/2742341229 conn(0x7f67300cd1f0 msgr2=0x7f67300cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 shutdown_connections 2023-10-06T03:00:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:30.885+0000 7f6737702700 1 -- 172.21.15.84:0/2742341229 wait complete. 2023-10-06T03:00:30.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2023-10-06T03:00:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.011+0000 7f83ca12f700 1 Processor -- start 2023-10-06T03:00:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.012+0000 7f83ca12f700 1 -- start start 2023-10-06T03:00:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.012+0000 7f83ca12f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83c41595a0 0x7f83c40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.012+0000 7f83ca12f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b49e0 0x7f83c40aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.012+0000 7f83ca12f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c40b0ca0 con 0x7f83c40b07a0 2023-10-06T03:00:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.012+0000 7f83ca12f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c40b0f80 con 0x7f83c41595a0 2023-10-06T03:00:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.012+0000 7f83ca12f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40b1260 con 0x7f83c40b49e0 2023-10-06T03:00:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.012+0000 7f83c37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83c41595a0 0x7f83c40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.012+0000 7f83c37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83c41595a0 0x7f83c40aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52150/0 (socket says 172.21.15.84:52150) 2023-10-06T03:00:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.012+0000 7f83c37fe700 1 -- 172.21.15.84:0/2191927368 learned_addr learned my addr 172.21.15.84:0/2191927368 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c2ffd700 1 --2- 172.21.15.84:0/2191927368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b49e0 0x7f83c40aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c37fe700 1 -- 172.21.15.84:0/2191927368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b49e0 msgr2=0x7f83c40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c37fe700 1 --2- 172.21.15.84:0/2191927368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b49e0 0x7f83c40aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c37fe700 1 -- 172.21.15.84:0/2191927368 >> v1:172.21.15.131:6789/0 conn(0x7f83c40b07a0 legacy=0x7f83c40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c37fe700 1 -- 172.21.15.84:0/2191927368 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40b1540 con 0x7f83c41595a0 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c2ffd700 1 --2- 172.21.15.84:0/2191927368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b49e0 0x7f83c40aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c37fe700 1 --2- 172.21.15.84:0/2191927368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 0x7f83c40aa570 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009f70 tx=0x7f83b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c579872e4550f858 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c27fc700 1 -- 172.21.15.84:0/2191927368 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400e070 con 0x7f83c41595a0 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c27fc700 1 -- 172.21.15.84:0/2191927368 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400ba90 con 0x7f83c41595a0 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83c27fc700 1 -- 172.21.15.84:0/2191927368 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40092e0 con 0x7f83c41595a0 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83ca12f700 1 -- 172.21.15.84:0/2191927368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 msgr2=0x7f83c40aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.013+0000 7f83ca12f700 1 --2- 172.21.15.84:0/2191927368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 0x7f83c40aa570 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009f70 tx=0x7f83b4009840 comp rx=0 tx=0).stop 2023-10-06T03:00:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.014+0000 7f83ca12f700 1 -- 172.21.15.84:0/2191927368 shutdown_connections 2023-10-06T03:00:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.014+0000 7f83ca12f700 1 --2- 172.21.15.84:0/2191927368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 0x7f83c40aa570 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.014+0000 7f83ca12f700 1 --2- 172.21.15.84:0/2191927368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b49e0 0x7f83c40aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.014+0000 7f83ca12f700 1 -- 172.21.15.84:0/2191927368 >> 172.21.15.84:0/2191927368 conn(0x7f83c4099830 msgr2=0x7f83c406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.014+0000 7f83ca12f700 1 -- 172.21.15.84:0/2191927368 shutdown_connections 2023-10-06T03:00:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.014+0000 7f83ca12f700 1 -- 172.21.15.84:0/2191927368 wait complete. 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.015+0000 7f83ca12f700 1 Processor -- start 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.015+0000 7f83ca12f700 1 -- start start 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ca12f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b07a0 0x7f83c4153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ca12f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c40b49e0 0x7f83c414fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ca12f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 0x7f83c4157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ca12f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4159ff0 con 0x7f83c41595a0 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ca12f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4153740 con 0x7f83c40b49e0 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ca12f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4159a10 con 0x7f83c40b07a0 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 0x7f83c4157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 0x7f83c4157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52164/0 (socket says 172.21.15.84:52164) 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c3fff700 1 -- 172.21.15.84:0/1563618392 learned_addr learned my addr 172.21.15.84:0/1563618392 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c37fe700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b07a0 0x7f83c4153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c2ffd700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c40b49e0 0x7f83c414fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c3fff700 1 -- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b07a0 msgr2=0x7f83c4153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c3fff700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b07a0 0x7f83c4153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c3fff700 1 -- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c40b49e0 msgr2=0x7f83c414fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c3fff700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c40b49e0 0x7f83c414fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c3fff700 1 -- 172.21.15.84:0/1563618392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4009ae0 con 0x7f83c41595a0 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c37fe700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b07a0 0x7f83c4153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c2ffd700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c40b49e0 0x7f83c414fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83c3fff700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 0x7f83c4157440 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c5e0 tx=0x7f83bc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ab7fe700 1 -- 172.21.15.84:0/1563618392 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc011590 con 0x7f83c41595a0 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ab7fe700 1 -- 172.21.15.84:0/1563618392 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc011710 con 0x7f83c41595a0 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c4155030 con 0x7f83c41595a0 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ab7fe700 1 -- 172.21.15.84:0/1563618392 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc011ad0 con 0x7f83c41595a0 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.016+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c4159c80 con 0x7f83c41595a0 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.017+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c4064ad0 con 0x7f83c41595a0 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.018+0000 7f83ab7fe700 1 -- 172.21.15.84:0/1563618392 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83bc01c460 con 0x7f83c41595a0 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.018+0000 7f83ab7fe700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f83b0066f30 0x7f83b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.018+0000 7f83c37fe700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f83b0066f30 0x7f83b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.018+0000 7f83ab7fe700 1 -- 172.21.15.84:0/1563618392 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f83bc0841f0 con 0x7f83c41595a0 2023-10-06T03:00:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.019+0000 7f83c37fe700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f83b0066f30 0x7f83b00693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009ab0 tx=0x7f83b4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.022+0000 7f83ab7fe700 1 -- 172.21.15.84:0/1563618392 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83bc051410 con 0x7f83c41595a0 2023-10-06T03:00:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.279+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) v1 -- 0x7f83c40b1820 con 0x7f83c41595a0 2023-10-06T03:00:31.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.548+0000 7f83ab7fe700 1 -- 172.21.15.84:0/1563618392 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v280) v1 ==== 141+0+0 (secure 0 0 0) 0x7f83bc054a30 con 0x7f83c41595a0 2023-10-06T03:00:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f83b0066f30 msgr2=0x7f83b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f83b0066f30 0x7f83b00693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009ab0 tx=0x7f83b4017000 comp rx=0 tx=0).stop 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 msgr2=0x7f83c4157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 0x7f83c4157440 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c5e0 tx=0x7f83bc007f60 comp rx=0 tx=0).stop 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 shutdown_connections 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f83b0066f30 0x7f83b00693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83c41595a0 0x7f83c4157440 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83c40b07a0 0x7f83c4153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 --2- 172.21.15.84:0/1563618392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c40b49e0 0x7f83c414fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 >> 172.21.15.84:0/1563618392 conn(0x7f83c4099830 msgr2=0x7f83c4158180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 shutdown_connections 2023-10-06T03:00:31.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.550+0000 7f83ca12f700 1 -- 172.21.15.84:0/1563618392 wait complete. 2023-10-06T03:00:31.563 INFO:tasks.cephfs_test_runner:test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-10-06T03:00:31.564 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-10-06T03:00:31.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2023-10-06T03:00:31.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.682+0000 7f003c88b700 1 Processor -- start 2023-10-06T03:00:31.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.682+0000 7f003c88b700 1 -- start start 2023-10-06T03:00:31.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.682+0000 7f003c88b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00380b07a0 0x7f00380ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.682+0000 7f003c88b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00380b0ca0 con 0x7f00380b49e0 2023-10-06T03:00:31.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.682+0000 7f003c88b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00380b0f80 con 0x7f00381595a0 2023-10-06T03:00:31.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.682+0000 7f003c88b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00380ab390 con 0x7f00380b07a0 2023-10-06T03:00:31.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f002dd9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f00380b49e0 0x7f00380aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:42430/0 (socket says 172.21.15.84:42430) 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f002dd9b700 1 -- 172.21.15.84:0/1237448355 learned_addr learned my addr 172.21.15.84:0/1237448355 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225212416 0 0) 0x7f00380b0ca0 con 0x7f00380b49e0 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0024003570 con 0x7f00380b49e0 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0036d9d700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00380b07a0 0x7f00380ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 947408111 0 0) 0x7f0024003570 con 0x7f00380b49e0 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00380b07a0 msgr2=0x7f00380ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00380b07a0 0x7f00380ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 >> v1:172.21.15.131:6789/0 conn(0x7f00381595a0 legacy=0x7f00380aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380b1260 con 0x7f00380b49e0 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f0020001470 con 0x7f00380b49e0 2023-10-06T03:00:31.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 >> v1:172.21.15.84:6789/0 conn(0x7f00380b49e0 legacy=0x7f00380aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0024003a90 0x7f0024003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0024004810 0x7f0024004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00380b07a0 0x7f00240051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380ab390 con 0x7f0024004810 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002400bb60 con 0x7f0024003a90 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002400bd20 con 0x7f00380b07a0 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f002dd9b700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0024004810 0x7f0024004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f003659c700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0024003a90 0x7f0024003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.683+0000 7f0036d9d700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00380b07a0 0x7f00240051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f002dd9b700 1 -- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00380b07a0 msgr2=0x7f00240051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:31.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f002dd9b700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00380b07a0 0x7f00240051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f002dd9b700 1 -- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0024003a90 msgr2=0x7f0024003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f002dd9b700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0024003a90 0x7f0024003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f002dd9b700 1 -- 172.21.15.84:0/1237448355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024003570 con 0x7f0024004810 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f002dd9b700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0024004810 0x7f0024004c80 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0038088e20 tx=0x7f0020001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fce4f6c4480063 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002000cc30 con 0x7f0024004810 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002000cd90 con 0x7f0024004810 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f0035d9b700 1 -- 172.21.15.84:0/1237448355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020005b50 con 0x7f0024004810 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f003c88b700 1 -- 172.21.15.84:0/1237448355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0024004810 msgr2=0x7f0024004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f003c88b700 1 --2- 172.21.15.84:0/1237448355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0024004810 0x7f0024004c80 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0038088e20 tx=0x7f0020001e50 comp rx=0 tx=0).stop 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f0036d9d700 1 -- 172.21.15.84:0/1237448355 reap_dead start 2023-10-06T03:00:31.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f003c88b700 1 -- 172.21.15.84:0/1237448355 shutdown_connections 2023-10-06T03:00:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f003c88b700 1 -- 172.21.15.84:0/1237448355 >> 172.21.15.84:0/1237448355 conn(0x7f0038099830 msgr2=0x7f003806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f003c88b700 1 -- 172.21.15.84:0/1237448355 shutdown_connections 2023-10-06T03:00:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.684+0000 7f003c88b700 1 -- 172.21.15.84:0/1237448355 wait complete. 2023-10-06T03:00:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.686+0000 7f003c88b700 1 Processor -- start 2023-10-06T03:00:31.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.686+0000 7f003c88b700 1 -- start start 2023-10-06T03:00:31.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.686+0000 7f003c88b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0024004810 0x7f003815f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.686+0000 7f003c88b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00381588e0 0x7f003809b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.686+0000 7f003c88b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f003809bd60 0x7f0038169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.686+0000 7f003c88b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003809e0b0 con 0x7f003809bd60 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.686+0000 7f003c88b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003809c200 con 0x7f00381588e0 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.686+0000 7f003c88b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003809d8c0 con 0x7f0024004810 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.686+0000 7f0036d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f003809bd60 0x7f0038169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f0036d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f003809bd60 0x7f0038169900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52180/0 (socket says 172.21.15.84:52180) 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f0036d9d700 1 -- 172.21.15.84:0/3153103460 learned_addr learned my addr 172.21.15.84:0/3153103460 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f003659c700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0024004810 0x7f003815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f002dd9b700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00381588e0 0x7f003809b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f0036d9d700 1 -- 172.21.15.84:0/3153103460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0024004810 msgr2=0x7f003815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f0036d9d700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0024004810 0x7f003815f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f0036d9d700 1 -- 172.21.15.84:0/3153103460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00381588e0 msgr2=0x7f003809b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f0036d9d700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00381588e0 0x7f003809b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f0036d9d700 1 -- 172.21.15.84:0/3153103460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003809af40 con 0x7f003809bd60 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f0036d9d700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f003809bd60 0x7f0038169900 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f00300094d0 tx=0x7f003000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f002effd700 1 -- 172.21.15.84:0/3153103460 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003000e040 con 0x7f003809bd60 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f002effd700 1 -- 172.21.15.84:0/3153103460 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003000f040 con 0x7f003809bd60 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f002effd700 1 -- 172.21.15.84:0/3153103460 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003000fd90 con 0x7f003809bd60 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003809daf0 con 0x7f003809bd60 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.687+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003809abd0 con 0x7f003809bd60 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.688+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003809b0d0 con 0x7f003809bd60 2023-10-06T03:00:31.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.688+0000 7f002effd700 1 -- 172.21.15.84:0/3153103460 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0030015640 con 0x7f003809bd60 2023-10-06T03:00:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.689+0000 7f002effd700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0018066f30 0x7f00180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.689+0000 7f002effd700 1 -- 172.21.15.84:0/3153103460 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f0030084ec0 con 0x7f003809bd60 2023-10-06T03:00:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.689+0000 7f003659c700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0018066f30 0x7f00180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.689+0000 7f003659c700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0018066f30 0x7f00180693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f003815d000 tx=0x7f0028007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.693+0000 7f002effd700 1 -- 172.21.15.84:0/3153103460 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00300520e0 con 0x7f003809bd60 2023-10-06T03:00:31.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:31.949+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) v1 -- 0x7f0038064ad0 con 0x7f003809bd60 2023-10-06T03:00:32.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.557+0000 7f002effd700 1 -- 172.21.15.84:0/3153103460 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v281) v1 ==== 157+0+0 (secure 0 0 0) 0x7f0030055700 con 0x7f003809bd60 2023-10-06T03:00:32.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0018066f30 msgr2=0x7f00180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0018066f30 0x7f00180693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f003815d000 tx=0x7f0028007d80 comp rx=0 tx=0).stop 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f003809bd60 msgr2=0x7f0038169900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f003809bd60 0x7f0038169900 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f00300094d0 tx=0x7f003000b040 comp rx=0 tx=0).stop 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 shutdown_connections 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0018066f30 0x7f00180693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f003809bd60 0x7f0038169900 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0024004810 0x7f003815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 --2- 172.21.15.84:0/3153103460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00381588e0 0x7f003809b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 >> 172.21.15.84:0/3153103460 conn(0x7f0038099830 msgr2=0x7f00380b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 shutdown_connections 2023-10-06T03:00:32.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.559+0000 7f003c88b700 1 -- 172.21.15.84:0/3153103460 wait complete. 2023-10-06T03:00:32.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:00:32.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.687+0000 7f28632cd700 1 Processor -- start 2023-10-06T03:00:32.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.687+0000 7f28632cd700 1 -- start start 2023-10-06T03:00:32.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f28632cd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f285c0b2660 0x7f285c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f28632cd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f285c0cf1f0 0x7f285c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f28632cd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c0cc9b0 con 0x7f285c0b2a30 2023-10-06T03:00:32.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f28632cd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c0cbda0 con 0x7f285c0cf1f0 2023-10-06T03:00:32.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f28632cd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c0cc080 con 0x7f285c0b2660 2023-10-06T03:00:32.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f2862acc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f285c0cf1f0 0x7f285c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f2861aca700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f285c0b2a30 0x7f285c0ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55342/0 (socket says 172.21.15.84:55342) 2023-10-06T03:00:32.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f2861aca700 1 -- 172.21.15.84:0/4242672654 learned_addr learned my addr 172.21.15.84:0/4242672654 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:32.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f28622cb700 1 --2- 172.21.15.84:0/4242672654 >> v2:172.21.15.131:3300/0 conn(0x7f285c0b2660 0x7f285c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f2862acc700 1 -- 172.21.15.84:0/4242672654 >> v2:172.21.15.131:3300/0 conn(0x7f285c0b2660 msgr2=0x7f285c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f2862acc700 1 --2- 172.21.15.84:0/4242672654 >> v2:172.21.15.131:3300/0 conn(0x7f285c0b2660 0x7f285c0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f2862acc700 1 -- 172.21.15.84:0/4242672654 >> v1:172.21.15.84:6789/0 conn(0x7f285c0b2a30 legacy=0x7f285c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f2862acc700 1 -- 172.21.15.84:0/4242672654 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0cc360 con 0x7f285c0cf1f0 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f28612c9700 1 -- 172.21.15.84:0/4242672654 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364800696 0 0) 0x7f285c0cc9b0 con 0x7f285c0b2a30 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f28622cb700 1 --2- 172.21.15.84:0/4242672654 >> v2:172.21.15.131:3300/0 conn(0x7f285c0b2660 0x7f285c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f2862acc700 1 --2- 172.21.15.84:0/4242672654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0cf1f0 0x7f285c0cd230 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f285c089500 tx=0x7f28580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8010ef5aaf62ce91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.688+0000 7f28612c9700 1 -- 172.21.15.84:0/4242672654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800b6b0 con 0x7f285c0cf1f0 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28612c9700 1 -- 172.21.15.84:0/4242672654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285800b810 con 0x7f285c0cf1f0 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28612c9700 1 -- 172.21.15.84:0/4242672654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800bbb0 con 0x7f285c0cf1f0 2023-10-06T03:00:32.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28632cd700 1 -- 172.21.15.84:0/4242672654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0cf1f0 msgr2=0x7f285c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28632cd700 1 --2- 172.21.15.84:0/4242672654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0cf1f0 0x7f285c0cd230 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f285c089500 tx=0x7f28580091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28632cd700 1 -- 172.21.15.84:0/4242672654 shutdown_connections 2023-10-06T03:00:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28632cd700 1 --2- 172.21.15.84:0/4242672654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0cf1f0 0x7f285c0cd230 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28632cd700 1 --2- 172.21.15.84:0/4242672654 >> v2:172.21.15.131:3300/0 conn(0x7f285c0b2660 0x7f285c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28632cd700 1 -- 172.21.15.84:0/4242672654 >> 172.21.15.84:0/4242672654 conn(0x7f285c099560 msgr2=0x7f285c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28632cd700 1 -- 172.21.15.84:0/4242672654 shutdown_connections 2023-10-06T03:00:32.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.689+0000 7f28632cd700 1 -- 172.21.15.84:0/4242672654 wait complete. 2023-10-06T03:00:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.690+0000 7f28632cd700 1 Processor -- start 2023-10-06T03:00:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.690+0000 7f28632cd700 1 -- start start 2023-10-06T03:00:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28632cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0b2660 0x7f285c152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28632cd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f285c0b2a30 0x7f285c0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28632cd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f285c0cf1f0 0x7f285c0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28632cd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c153100 con 0x7f285c0b2660 2023-10-06T03:00:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28632cd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c15e870 con 0x7f285c0b2a30 2023-10-06T03:00:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28632cd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0b49d0 con 0x7f285c0cf1f0 2023-10-06T03:00:32.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28622cb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0b2660 0x7f285c152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28622cb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0b2660 0x7f285c152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45920/0 (socket says 172.21.15.84:45920) 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28622cb700 1 -- 172.21.15.84:0/3492802404 learned_addr learned my addr 172.21.15.84:0/3492802404 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28622cb700 1 -- 172.21.15.84:0/3492802404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f285c0cf1f0 msgr2=0x7f285c0c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28622cb700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f285c0cf1f0 0x7f285c0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28622cb700 1 -- 172.21.15.84:0/3492802404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f285c0b2a30 msgr2=0x7f285c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28622cb700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f285c0b2a30 0x7f285c0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28622cb700 1 -- 172.21.15.84:0/3492802404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858009420 con 0x7f285c0b2660 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28622cb700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0b2660 0x7f285c152bc0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f285400a300 tx=0x7f28540078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.691+0000 7f28527fc700 1 -- 172.21.15.84:0/3492802404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854015440 con 0x7f285c0b2660 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.692+0000 7f28527fc700 1 -- 172.21.15.84:0/3492802404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28540155a0 con 0x7f285c0b2660 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.692+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c15df80 con 0x7f285c0b2660 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.692+0000 7f28527fc700 1 -- 172.21.15.84:0/3492802404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854015920 con 0x7f285c0b2660 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.692+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c15e500 con 0x7f285c0b2660 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.693+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c05f270 con 0x7f285c0b2660 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.693+0000 7f28527fc700 1 -- 172.21.15.84:0/3492802404 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2854015cd0 con 0x7f285c0b2660 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.693+0000 7f28527fc700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2840066f30 0x7f28400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.693+0000 7f28527fc700 1 -- 172.21.15.84:0/3492802404 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f2854084c80 con 0x7f285c0b2660 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.693+0000 7f2861aca700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2840066f30 0x7f28400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.694+0000 7f2861aca700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2840066f30 0x7f28400693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f284c0011e0 tx=0x7f284c0079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:32.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.698+0000 7f28527fc700 1 -- 172.21.15.84:0/3492802404 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f285404e5a0 con 0x7f285c0b2660 2023-10-06T03:00:32.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.878+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f285c0cc640 con 0x7f285c0b2660 2023-10-06T03:00:32.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.882+0000 7f28527fc700 1 -- 172.21.15.84:0/3492802404 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f285401a0c0 con 0x7f285c0b2660 2023-10-06T03:00:32.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2840066f30 msgr2=0x7f28400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2840066f30 0x7f28400693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f284c0011e0 tx=0x7f284c0079d0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0b2660 msgr2=0x7f285c152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0b2660 0x7f285c152bc0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f285400a300 tx=0x7f28540078c0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 shutdown_connections 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2840066f30 0x7f28400693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f285c0cf1f0 0x7f285c0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f285c0b2660 0x7f285c152bc0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 --2- 172.21.15.84:0/3492802404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f285c0b2a30 0x7f285c0b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.884+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 >> 172.21.15.84:0/3492802404 conn(0x7f285c099560 msgr2=0x7f285c156bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.885+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 shutdown_connections 2023-10-06T03:00:32.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:32.885+0000 7f28632cd700 1 -- 172.21.15.84:0/3492802404 wait complete. 2023-10-06T03:00:32.898 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:00:32.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:00:32.936 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:00:32.979 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:00:32.979 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:00:32.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:33.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.092+0000 7fa3e5509700 1 Processor -- start 2023-10-06T03:00:33.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.092+0000 7fa3e5509700 1 -- start start 2023-10-06T03:00:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3e5509700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa3e0153c70 0x7fa3e0068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3e5509700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e00cbfd0 0x7fa3e0068b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3e5509700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3e0156690 0x7fa3e0156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3e5509700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e006eb90 con 0x7fa3e0156690 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3e5509700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e0157660 con 0x7fa3e0153c70 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3e5509700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0157380 con 0x7fa3e00cbfd0 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3df7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3e0156690 0x7fa3e0156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3df7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3e0156690 0x7fa3e0156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45924/0 (socket says 172.21.15.84:45924) 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3df7fe700 1 -- 172.21.15.84:0/4247069784 learned_addr learned my addr 172.21.15.84:0/4247069784 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3deffd700 1 --2- 172.21.15.84:0/4247069784 >> v2:172.21.15.131:3300/0 conn(0x7fa3e0153c70 0x7fa3e0068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3de7fc700 1 --2- 172.21.15.84:0/4247069784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e00cbfd0 0x7fa3e0068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3df7fe700 1 -- 172.21.15.84:0/4247069784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e00cbfd0 msgr2=0x7fa3e0068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:33.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3df7fe700 1 --2- 172.21.15.84:0/4247069784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e00cbfd0 0x7fa3e0068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3df7fe700 1 -- 172.21.15.84:0/4247069784 >> v2:172.21.15.131:3300/0 conn(0x7fa3e0153c70 msgr2=0x7fa3e0068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3df7fe700 1 --2- 172.21.15.84:0/4247069784 >> v2:172.21.15.131:3300/0 conn(0x7fa3e0153c70 0x7fa3e0068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.093+0000 7fa3df7fe700 1 -- 172.21.15.84:0/4247069784 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00cb4f0 con 0x7fa3e0156690 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3df7fe700 1 --2- 172.21.15.84:0/4247069784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0156690 0x7fa3e0156af0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0069190 tx=0x7fa3d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ecf70950eb546a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3ddffb700 1 -- 172.21.15.84:0/4247069784 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800e070 con 0x7fa3e0156690 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3ddffb700 1 -- 172.21.15.84:0/4247069784 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800ba50 con 0x7fa3e0156690 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3ddffb700 1 -- 172.21.15.84:0/4247069784 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80092e0 con 0x7fa3e0156690 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3e5509700 1 -- 172.21.15.84:0/4247069784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0156690 msgr2=0x7fa3e0156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3e5509700 1 --2- 172.21.15.84:0/4247069784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0156690 0x7fa3e0156af0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0069190 tx=0x7fa3d8009840 comp rx=0 tx=0).stop 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3e5509700 1 -- 172.21.15.84:0/4247069784 shutdown_connections 2023-10-06T03:00:33.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3e5509700 1 --2- 172.21.15.84:0/4247069784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0156690 0x7fa3e0156af0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3e5509700 1 --2- 172.21.15.84:0/4247069784 >> v2:172.21.15.131:3300/0 conn(0x7fa3e0153c70 0x7fa3e0068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3e5509700 1 --2- 172.21.15.84:0/4247069784 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e00cbfd0 0x7fa3e0068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3e5509700 1 -- 172.21.15.84:0/4247069784 >> 172.21.15.84:0/4247069784 conn(0x7fa3e00c9c50 msgr2=0x7fa3e006db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3e5509700 1 -- 172.21.15.84:0/4247069784 shutdown_connections 2023-10-06T03:00:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.094+0000 7fa3e5509700 1 -- 172.21.15.84:0/4247069784 wait complete. 2023-10-06T03:00:33.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.095+0000 7fa3e5509700 1 Processor -- start 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3e5509700 1 -- start start 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3e5509700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00cbfd0 0x7fa3e00c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3e5509700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0153c70 0x7fa3e014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3e5509700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e0156690 0x7fa3e01589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3e5509700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00b0c50 con 0x7fa3e0153c70 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3e5509700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00b0de0 con 0x7fa3e00cbfd0 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3e5509700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e014c8b0 con 0x7fa3e0156690 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3de7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0153c70 0x7fa3e014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3de7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0153c70 0x7fa3e014bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45928/0 (socket says 172.21.15.84:45928) 2023-10-06T03:00:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3de7fc700 1 -- 172.21.15.84:0/456236412 learned_addr learned my addr 172.21.15.84:0/456236412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3deffd700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00cbfd0 0x7fa3e00c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.096+0000 7fa3df7fe700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e0156690 0x7fa3e01589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3de7fc700 1 -- 172.21.15.84:0/456236412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e0156690 msgr2=0x7fa3e01589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3de7fc700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e0156690 0x7fa3e01589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3de7fc700 1 -- 172.21.15.84:0/456236412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00cbfd0 msgr2=0x7fa3e00c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3de7fc700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00cbfd0 0x7fa3e00c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3de7fc700 1 -- 172.21.15.84:0/456236412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8009ae0 con 0x7fa3e0153c70 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3de7fc700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0153c70 0x7fa3e014bf40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d860 tx=0x7fa3d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3c6ffd700 1 -- 172.21.15.84:0/456236412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40125f0 con 0x7fa3e0153c70 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3c6ffd700 1 -- 172.21.15.84:0/456236412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4012770 con 0x7fa3e0153c70 2023-10-06T03:00:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e014cb90 con 0x7fa3e0153c70 2023-10-06T03:00:33.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3c6ffd700 1 -- 172.21.15.84:0/456236412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4012b30 con 0x7fa3e0153c70 2023-10-06T03:00:33.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.097+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e014d150 con 0x7fa3e0153c70 2023-10-06T03:00:33.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.098+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e00b0f50 con 0x7fa3e0153c70 2023-10-06T03:00:33.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.098+0000 7fa3c6ffd700 1 -- 172.21.15.84:0/456236412 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3d4013480 con 0x7fa3e0153c70 2023-10-06T03:00:33.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.099+0000 7fa3c6ffd700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa3cc066f30 0x7fa3cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.099+0000 7fa3c6ffd700 1 -- 172.21.15.84:0/456236412 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fa3d40848e0 con 0x7fa3e0153c70 2023-10-06T03:00:33.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.099+0000 7fa3deffd700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa3cc066f30 0x7fa3cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.099+0000 7fa3deffd700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa3cc066f30 0x7fa3cc0693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0006fd0 tx=0x7fa3d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.103+0000 7fa3c6ffd700 1 -- 172.21.15.84:0/456236412 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3d4051b00 con 0x7fa3e0153c70 2023-10-06T03:00:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.326+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3e005f270 con 0x7fa3e0153c70 2023-10-06T03:00:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.326+0000 7fa3c6ffd700 1 -- 172.21.15.84:0/456236412 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fa3d4055120 con 0x7fa3e0153c70 2023-10-06T03:00:33.329 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:33.329 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3149371302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3149371302},{"type":"v1","addr":"172.21.15.131:6834","nonce":3149371302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2053428602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2053428602},{"type":"v1","addr":"172.21.15.131:6835","nonce":2053428602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7644,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1520244836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1520244836},{"type":"v1","addr":"172.21.15.84:6835","nonce":1520244836}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7653,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/687686431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":687686431},{"type":"v1","addr":"172.21.15.84:6837","nonce":687686431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[]} 2023-10-06T03:00:33.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa3cc066f30 msgr2=0x7fa3cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa3cc066f30 0x7fa3cc0693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0006fd0 tx=0x7fa3d0008040 comp rx=0 tx=0).stop 2023-10-06T03:00:33.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0153c70 msgr2=0x7fa3e014bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0153c70 0x7fa3e014bf40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d860 tx=0x7fa3d4008040 comp rx=0 tx=0).stop 2023-10-06T03:00:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 shutdown_connections 2023-10-06T03:00:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa3cc066f30 0x7fa3cc0693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00cbfd0 0x7fa3e00c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3e0156690 0x7fa3e01589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 --2- 172.21.15.84:0/456236412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e0153c70 0x7fa3e014bf40 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 >> 172.21.15.84:0/456236412 conn(0x7fa3e00c9c50 msgr2=0x7fa3e00c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.328+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 shutdown_connections 2023-10-06T03:00:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.329+0000 7fa3e5509700 1 -- 172.21.15.84:0/456236412 wait complete. 2023-10-06T03:00:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 78 2023-10-06T03:00:33.342 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:00:33.343 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:00:33.343 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:00:33.343 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:00:33.343 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:00:33.343 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:00:33.343 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:00:33.344 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:00:33.344 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:00:33.344 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:00:33.344 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:00:33.344 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:00:33.344 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:00:33.344 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:00:33.345 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:00:33.345 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:00:33.351 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:00:33.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:00:33.352 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:00:33.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:00:33.355 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:00:33.355 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:00:33.356 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:00:33.356 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:00:33.393 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:00:33.394 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:33.394 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:00:33.394 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:33.397 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:00:33.398 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:33.398 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:00:33.398 DEBUG:teuthology.parallel:result is None 2023-10-06T03:00:33.398 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:00:33.466 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:00:33.467 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:00:33.481 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:00:33.481 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:00:33.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.517+0000 7f94f02ec700 1 Processor -- start 2023-10-06T03:00:33.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.517+0000 7f94f02ec700 1 -- start start 2023-10-06T03:00:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.518+0000 7f94f02ec700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f94e8159690 0x7f94e80ac480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.518+0000 7f94f02ec700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80a9fd0 con 0x7f94e80ab470 2023-10-06T03:00:33.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.518+0000 7f94f02ec700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e815e1b0 con 0x7f94e8068600 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.518+0000 7f94f02ec700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e80ac9c0 con 0x7f94e8159690 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.518+0000 7f94ee889700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f94e80ab470 0x7f94e815daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55348/0 (socket says 172.21.15.84:55348) 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.518+0000 7f94ee889700 1 -- 172.21.15.84:0/2184176725 learned_addr learned my addr 172.21.15.84:0/2184176725 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.518+0000 7f94ee088700 1 --2- 172.21.15.84:0/2184176725 >> v2:172.21.15.131:3300/0 conn(0x7f94e8159690 0x7f94e80ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ed086700 1 -- 172.21.15.84:0/2184176725 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901355459 0 0) 0x7f94e80a9fd0 con 0x7f94e80ab470 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ed086700 1 -- 172.21.15.84:0/2184176725 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d4003570 con 0x7f94e80ab470 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ed086700 1 -- 172.21.15.84:0/2184176725 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431786763 0 0) 0x7f94e815e1b0 con 0x7f94e8068600 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ed086700 1 -- 172.21.15.84:0/2184176725 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e80a9fd0 con 0x7f94e8068600 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ee088700 1 -- 172.21.15.84:0/2184176725 >> v1:172.21.15.131:6789/0 conn(0x7f94e8068600 legacy=0x7f94e815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ed086700 1 -- 172.21.15.84:0/2184176725 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2463873596 0 0) 0x7f94d4003570 con 0x7f94e80ab470 2023-10-06T03:00:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ee088700 1 -- 172.21.15.84:0/2184176725 >> v1:172.21.15.84:6789/0 conn(0x7f94e80ab470 legacy=0x7f94e815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ee088700 1 -- 172.21.15.84:0/2184176725 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e80abfe0 con 0x7f94e8159690 2023-10-06T03:00:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ee088700 1 --2- 172.21.15.84:0/2184176725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e8159690 0x7f94e80ac480 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f94e40098d0 tx=0x7f94e4009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfbb4764e1aeb7c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ed086700 1 -- 172.21.15.84:0/2184176725 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00017f0 con 0x7f94e8159690 2023-10-06T03:00:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ed086700 1 -- 172.21.15.84:0/2184176725 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e4011420 con 0x7f94e8159690 2023-10-06T03:00:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.519+0000 7f94ed086700 1 -- 172.21.15.84:0/2184176725 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e40117c0 con 0x7f94e8159690 2023-10-06T03:00:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.520+0000 7f94f02ec700 1 -- 172.21.15.84:0/2184176725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e8159690 msgr2=0x7f94e80ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.520+0000 7f94f02ec700 1 --2- 172.21.15.84:0/2184176725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e8159690 0x7f94e80ac480 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f94e40098d0 tx=0x7f94e4009120 comp rx=0 tx=0).stop 2023-10-06T03:00:33.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.520+0000 7f94f02ec700 1 -- 172.21.15.84:0/2184176725 shutdown_connections 2023-10-06T03:00:33.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.520+0000 7f94f02ec700 1 --2- 172.21.15.84:0/2184176725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e8159690 0x7f94e80ac480 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.520+0000 7f94f02ec700 1 -- 172.21.15.84:0/2184176725 >> 172.21.15.84:0/2184176725 conn(0x7f94e806de80 msgr2=0x7f94e806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.520+0000 7f94f02ec700 1 -- 172.21.15.84:0/2184176725 shutdown_connections 2023-10-06T03:00:33.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.520+0000 7f94f02ec700 1 -- 172.21.15.84:0/2184176725 wait complete. 2023-10-06T03:00:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.521+0000 7f94f02ec700 1 Processor -- start 2023-10-06T03:00:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.521+0000 7f94f02ec700 1 -- start start 2023-10-06T03:00:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94f02ec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e8068600 0x7f94e814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94f02ec700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94e80ab470 0x7f94e815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94f02ec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94e8159690 0x7f94e815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94f02ec700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e815c310 con 0x7f94e8159690 2023-10-06T03:00:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94f02ec700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e8150d10 con 0x7f94e8068600 2023-10-06T03:00:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94f02ec700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e815b700 con 0x7f94e80ab470 2023-10-06T03:00:33.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee889700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94e8159690 0x7f94e815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee889700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94e8159690 0x7f94e815b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45976/0 (socket says 172.21.15.84:45976) 2023-10-06T03:00:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee889700 1 -- 172.21.15.84:0/1054168709 learned_addr learned my addr 172.21.15.84:0/1054168709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee088700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e8068600 0x7f94e814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ed887700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94e80ab470 0x7f94e815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee889700 1 -- 172.21.15.84:0/1054168709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94e80ab470 msgr2=0x7f94e815ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee889700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94e80ab470 0x7f94e815ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee889700 1 -- 172.21.15.84:0/1054168709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e8068600 msgr2=0x7f94e814d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee889700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e8068600 0x7f94e814d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee889700 1 -- 172.21.15.84:0/1054168709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e40093c0 con 0x7f94e8159690 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ed887700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94e80ab470 0x7f94e815ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94ee889700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94e8159690 0x7f94e815b0d0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f94e000cca0 tx=0x7f94e0007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94de7fc700 1 -- 172.21.15.84:0/1054168709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000ce50 con 0x7f94e8159690 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94de7fc700 1 -- 172.21.15.84:0/1054168709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e0004dc0 con 0x7f94e8159690 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94de7fc700 1 -- 172.21.15.84:0/1054168709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000ab70 con 0x7f94e8159690 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e815b9e0 con 0x7f94e8159690 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.522+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e815bfa0 con 0x7f94e8159690 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.523+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e80ac480 con 0x7f94e8159690 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.524+0000 7f94de7fc700 1 -- 172.21.15.84:0/1054168709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f94e0007150 con 0x7f94e8159690 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.524+0000 7f94de7fc700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f94cc066f30 0x7f94cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.524+0000 7f94de7fc700 1 -- 172.21.15.84:0/1054168709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f94e0083e30 con 0x7f94e8159690 2023-10-06T03:00:33.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.524+0000 7f94ee088700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f94cc066f30 0x7f94cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.524+0000 7f94ee088700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f94cc066f30 0x7f94cc0693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009390 tx=0x7f94e4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.528+0000 7f94de7fc700 1 -- 172.21.15.84:0/1054168709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94e00510d0 con 0x7f94e8159690 2023-10-06T03:00:33.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:33.729+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f94e8064ad0 con 0x7f94e8159690 2023-10-06T03:00:34.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.572+0000 7f94de7fc700 1 -- 172.21.15.84:0/1054168709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7f94e0018020 con 0x7f94e8159690 2023-10-06T03:00:34.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f94cc066f30 msgr2=0x7f94cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f94cc066f30 0x7f94cc0693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009390 tx=0x7f94e4016000 comp rx=0 tx=0).stop 2023-10-06T03:00:34.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94e8159690 msgr2=0x7f94e815b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94e8159690 0x7f94e815b0d0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f94e000cca0 tx=0x7f94e0007d20 comp rx=0 tx=0).stop 2023-10-06T03:00:34.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 shutdown_connections 2023-10-06T03:00:34.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f94cc066f30 0x7f94cc0693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e8068600 0x7f94e814d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94e8159690 0x7f94e815b0d0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 --2- 172.21.15.84:0/1054168709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94e80ab470 0x7f94e815ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 >> 172.21.15.84:0/1054168709 conn(0x7f94e806de80 msgr2=0x7f94e8158890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:34.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 shutdown_connections 2023-10-06T03:00:34.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.575+0000 7f94f02ec700 1 -- 172.21.15.84:0/1054168709 wait complete. 2023-10-06T03:00:34.579 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T03:00:34.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:00:34.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.705+0000 7f93c5f5d700 1 Processor -- start 2023-10-06T03:00:34.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.705+0000 7f93c5f5d700 1 -- start start 2023-10-06T03:00:34.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.706+0000 7f93c5f5d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00b07a0 0x7f93c00ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.706+0000 7f93c5f5d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00b0ca0 con 0x7f93c00b49e0 2023-10-06T03:00:34.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.706+0000 7f93c5f5d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00b0f80 con 0x7f93c01595a0 2023-10-06T03:00:34.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.706+0000 7f93c5f5d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00ab390 con 0x7f93c00b07a0 2023-10-06T03:00:34.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.706+0000 7f93b7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f93c00b49e0 0x7f93c00aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55354/0 (socket says 172.21.15.84:55354) 2023-10-06T03:00:34.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.706+0000 7f93b7fff700 1 -- 172.21.15.84:0/2701311928 learned_addr learned my addr 172.21.15.84:0/2701311928 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:34.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93bffff700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00b07a0 0x7f93c00ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876322289 0 0) 0x7f93c00b0ca0 con 0x7f93c00b49e0 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93ac003570 con 0x7f93c00b49e0 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1958713141 0 0) 0x7f93ac003570 con 0x7f93c00b49e0 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00b07a0 msgr2=0x7f93c00ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00b07a0 0x7f93c00ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 >> v1:172.21.15.131:6789/0 conn(0x7f93c01595a0 legacy=0x7f93c00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00b1260 con 0x7f93c00b49e0 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f93a8001470 con 0x7f93c00b49e0 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 >> v1:172.21.15.84:6789/0 conn(0x7f93c00b49e0 legacy=0x7f93c00aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00b07a0 0x7f93ac003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ac004010 0x7f93ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac004d50 0x7f93ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00ab390 con 0x7f93ac004010 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac00bbf0 con 0x7f93ac004d50 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac00bdb0 con 0x7f93c00b07a0 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93b7fff700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ac004010 0x7f93ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93bf7fe700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00b07a0 0x7f93ac003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93bffff700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac004d50 0x7f93ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93b7fff700 1 -- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00b07a0 msgr2=0x7f93ac003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93b7fff700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00b07a0 0x7f93ac003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93b7fff700 1 -- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac004d50 msgr2=0x7f93ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93b7fff700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac004d50 0x7f93ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.707+0000 7f93b7fff700 1 -- 172.21.15.84:0/2701311928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac003570 con 0x7f93ac004010 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93b7fff700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ac004010 0x7f93ac004810 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f93c0099f60 tx=0x7f93a8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccdbaccfa103ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800cc00 con 0x7f93ac004010 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a800cd60 con 0x7f93ac004010 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93beffd700 1 -- 172.21.15.84:0/2701311928 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8005b50 con 0x7f93ac004010 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93c5f5d700 1 -- 172.21.15.84:0/2701311928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ac004010 msgr2=0x7f93ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93c5f5d700 1 --2- 172.21.15.84:0/2701311928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ac004010 0x7f93ac004810 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f93c0099f60 tx=0x7f93a8001e50 comp rx=0 tx=0).stop 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93bffff700 1 -- 172.21.15.84:0/2701311928 reap_dead start 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93c5f5d700 1 -- 172.21.15.84:0/2701311928 shutdown_connections 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93c5f5d700 1 -- 172.21.15.84:0/2701311928 >> 172.21.15.84:0/2701311928 conn(0x7f93c0099830 msgr2=0x7f93c006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93c5f5d700 1 -- 172.21.15.84:0/2701311928 shutdown_connections 2023-10-06T03:00:34.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.708+0000 7f93c5f5d700 1 -- 172.21.15.84:0/2701311928 wait complete. 2023-10-06T03:00:34.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.709+0000 7f93c5f5d700 1 Processor -- start 2023-10-06T03:00:34.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.709+0000 7f93c5f5d700 1 -- start start 2023-10-06T03:00:34.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93c5f5d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac004010 0x7f93c0147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93c5f5d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c00ceb80 0x7f93c00ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93c5f5d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00ab5c0 0x7f93c00aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93c5f5d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00cf530 con 0x7f93c00ceb80 2023-10-06T03:00:34.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93c5f5d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c009acb0 con 0x7f93ac004010 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93c5f5d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c009a0a0 con 0x7f93c00ab5c0 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c00ceb80 0x7f93c00ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93b7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c00ceb80 0x7f93c00ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45986/0 (socket says 172.21.15.84:45986) 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93b7fff700 1 -- 172.21.15.84:0/1440529584 learned_addr learned my addr 172.21.15.84:0/1440529584 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93bf7fe700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac004010 0x7f93c0147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93bffff700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00ab5c0 0x7f93c00aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93b7fff700 1 -- 172.21.15.84:0/1440529584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00ab5c0 msgr2=0x7f93c00aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.710+0000 7f93b7fff700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00ab5c0 0x7f93c00aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.711+0000 7f93b7fff700 1 -- 172.21.15.84:0/1440529584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac004010 msgr2=0x7f93c0147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.711+0000 7f93b7fff700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac004010 0x7f93c0147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.711+0000 7f93b7fff700 1 -- 172.21.15.84:0/1440529584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c009a380 con 0x7f93c00ceb80 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.711+0000 7f93b7fff700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c00ceb80 0x7f93c00ceff0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f93a8007cd0 tx=0x7f93a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.711+0000 7f93b77fe700 1 -- 172.21.15.84:0/1440529584 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800cc00 con 0x7f93c00ceb80 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.711+0000 7f93b77fe700 1 -- 172.21.15.84:0/1440529584 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a800ced0 con 0x7f93c00ceb80 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.711+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c009a660 con 0x7f93c00ceb80 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.711+0000 7f93b77fe700 1 -- 172.21.15.84:0/1440529584 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8007510 con 0x7f93c00ceb80 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.711+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c0147db0 con 0x7f93c00ceb80 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.712+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c009ae60 con 0x7f93c00ceb80 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.712+0000 7f93b77fe700 1 -- 172.21.15.84:0/1440529584 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93a8019070 con 0x7f93c00ceb80 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.712+0000 7f93b77fe700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93a0066f30 0x7f93a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.713+0000 7f93bf7fe700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93a0066f30 0x7f93a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.713+0000 7f93b77fe700 1 -- 172.21.15.84:0/1440529584 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f93a80856e0 con 0x7f93c00ceb80 2023-10-06T03:00:34.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.713+0000 7f93bf7fe700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93a0066f30 0x7f93a00693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f93b0000c00 tx=0x7f93b0007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:34.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.717+0000 7f93b77fe700 1 -- 172.21.15.84:0/1440529584 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93c009ae60 con 0x7f93c00ceb80 2023-10-06T03:00:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.973+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f93c0159190 con 0x7f93c00ceb80 2023-10-06T03:00:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.974+0000 7f93b77fe700 1 -- 172.21.15.84:0/1440529584 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f93a8052a00 con 0x7f93c00ceb80 2023-10-06T03:00:34.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:34.976 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:34.976 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T03:00:34.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.976 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T03:00:34.976 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lFrNmJBAAeVhw9betN9snqLPgSK9efw==", 2023-10-06T03:00:34.976 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.976 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:00:34.976 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lbi6hLxAAICzxeAsbJ5rhbyMBkPcrAQ==", 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:00:34.977 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lSCo1KxAAuETY4PeWDJS3bGzqTpHLpQ==", 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:00:34.978 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:00:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T03:00:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lvPxyNhAAKlqBTG/Fr8/2Rf+lcGQxIg==", 2023-10-06T03:00:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:00:34.979 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDUdh9lV3sRIRAAoUtG7F6EMyew6CX3NaNufw==", 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:00:34.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.981 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.981 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.981 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T03:00:34.981 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDXdh9ls5OxHhAAanGTRmjW75UAwrqzL0CIdw==", 2023-10-06T03:00:34.981 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.982 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:00:34.982 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:00:34.982 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.982 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.982 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.982 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T03:00:34.982 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDadh9lQeJTHhAAFeayQY1F10UDCck78/ja4w==", 2023-10-06T03:00:34.982 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDddh9l+cx8HhAAeAcoLzCUiCC+9O+WZYYTsA==", 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:00:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDjdh9lA4upJxAAdFHhR2/rMyG2NbQEu7JpLw==", 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:00:34.984 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.985 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.985 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T03:00:34.985 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDmdh9lOGETJRAA7nLtgcumxqfum8cirnbaRA==", 2023-10-06T03:00:34.985 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.985 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:00:34.985 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:00:34.985 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T03:00:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDpdh9lSbDhJBAAnMWhjKSKYcLaZeRk9drdgA==", 2023-10-06T03:00:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:00:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:00:34.986 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDsdh9lImOeIhAAPUO3jy2/cPZW+eKukBywcw==", 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.987 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.988 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.988 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T03:00:34.988 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lRRw/OhAAwavsq3e0HeVF3/G4SX0v+A==", 2023-10-06T03:00:34.988 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.988 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:00:34.988 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T03:00:34.988 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:00:34.988 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.989 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.989 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T03:00:34.989 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lftv/BhAAo8sb1EG96nHv77bn3af/dg==", 2023-10-06T03:00:34.989 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.989 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:00:34.989 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:00:34.989 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:00:34.989 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lxOX6AxAAWDpHCodRcEc2/YF5yqnkQg==", 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:00:34.990 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lheJnDBAAqAQeFxMQ9Qv108TLz65mVw==", 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9l8qZuCBAArPoeoGgydlQPFp7XYwI9KQ==", 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9ly2pdIRAAX7YmT9B/MzoD8xJH347ruQ==", 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lW/KSHBAAEvgj/BAe20tCp8uwBEIVbA==", 2023-10-06T03:00:34.993 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:00:34.994 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:00:34.994 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:00:34.994 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:00:34.994 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.994 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:34.994 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T03:00:34.994 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:34.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93a0066f30 msgr2=0x7f93a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93a0066f30 0x7f93a00693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f93b0000c00 tx=0x7f93b0007d80 comp rx=0 tx=0).stop 2023-10-06T03:00:34.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c00ceb80 msgr2=0x7f93c00ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c00ceb80 0x7f93c00ceff0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f93a8007cd0 tx=0x7f93a8015000 comp rx=0 tx=0).stop 2023-10-06T03:00:34.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 shutdown_connections 2023-10-06T03:00:34.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f93a0066f30 0x7f93a00693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac004010 0x7f93c0147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93c00ab5c0 0x7f93c00aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 --2- 172.21.15.84:0/1440529584 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c00ceb80 0x7f93c00ceff0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 >> 172.21.15.84:0/1440529584 conn(0x7f93c0099830 msgr2=0x7f93c00afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:34.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 shutdown_connections 2023-10-06T03:00:34.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:34.976+0000 7f93c5f5d700 1 -- 172.21.15.84:0/1440529584 wait complete. 2023-10-06T03:00:34.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:35.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.110+0000 7f2aaaad3700 1 Processor -- start 2023-10-06T03:00:35.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.110+0000 7f2aaaad3700 1 -- start start 2023-10-06T03:00:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aaaad3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2aa4159e30 0x7f2aa415a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aaaad3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2aa415a740 0x7f2aa40cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aaaad3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa415e060 con 0x7f2aa40cd6c0 2023-10-06T03:00:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aaaad3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa40cdae0 con 0x7f2aa415a740 2023-10-06T03:00:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aaaad3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa415d4e0 con 0x7f2aa4159e30 2023-10-06T03:00:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2aa415a740 0x7f2aa40cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa9070700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2aa40cd6c0 0x7f2aa406ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55370/0 (socket says 172.21.15.84:55370) 2023-10-06T03:00:35.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa9070700 1 -- 172.21.15.84:0/2686975270 learned_addr learned my addr 172.21.15.84:0/2686975270 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa886f700 1 --2- 172.21.15.84:0/2686975270 >> v2:172.21.15.131:3300/0 conn(0x7f2aa4159e30 0x7f2aa415a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa3fff700 1 -- 172.21.15.84:0/2686975270 >> v2:172.21.15.131:3300/0 conn(0x7f2aa4159e30 msgr2=0x7f2aa415a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa3fff700 1 --2- 172.21.15.84:0/2686975270 >> v2:172.21.15.131:3300/0 conn(0x7f2aa4159e30 0x7f2aa415a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa3fff700 1 -- 172.21.15.84:0/2686975270 >> v1:172.21.15.84:6789/0 conn(0x7f2aa40cd6c0 legacy=0x7f2aa406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa3fff700 1 -- 172.21.15.84:0/2686975270 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa415d7c0 con 0x7f2aa415a740 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa37fe700 1 -- 172.21.15.84:0/2686975270 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369926163 0 0) 0x7f2aa415e060 con 0x7f2aa40cd6c0 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa3fff700 1 --2- 172.21.15.84:0/2686975270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa415a740 0x7f2aa40cd180 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4068a40 tx=0x7f2a900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4a0391433c2fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.111+0000 7f2aa37fe700 1 -- 172.21.15.84:0/2686975270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000b6b0 con 0x7f2aa415a740 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aa37fe700 1 -- 172.21.15.84:0/2686975270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9000b810 con 0x7f2aa415a740 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aa37fe700 1 -- 172.21.15.84:0/2686975270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000bbb0 con 0x7f2aa415a740 2023-10-06T03:00:35.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aaaad3700 1 -- 172.21.15.84:0/2686975270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa415a740 msgr2=0x7f2aa40cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aaaad3700 1 --2- 172.21.15.84:0/2686975270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa415a740 0x7f2aa40cd180 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4068a40 tx=0x7f2a900091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aaaad3700 1 -- 172.21.15.84:0/2686975270 shutdown_connections 2023-10-06T03:00:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aaaad3700 1 --2- 172.21.15.84:0/2686975270 >> v2:172.21.15.131:3300/0 conn(0x7f2aa4159e30 0x7f2aa415a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aaaad3700 1 --2- 172.21.15.84:0/2686975270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa415a740 0x7f2aa40cd180 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aaaad3700 1 -- 172.21.15.84:0/2686975270 >> 172.21.15.84:0/2686975270 conn(0x7f2aa4070810 msgr2=0x7f2aa4070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aaaad3700 1 -- 172.21.15.84:0/2686975270 shutdown_connections 2023-10-06T03:00:35.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.112+0000 7f2aaaad3700 1 -- 172.21.15.84:0/2686975270 wait complete. 2023-10-06T03:00:35.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.113+0000 7f2aaaad3700 1 Processor -- start 2023-10-06T03:00:35.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.113+0000 7f2aaaad3700 1 -- start start 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aaaad3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2aa40cd6c0 0x7f2aa4169cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aaaad3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa4159e30 0x7f2aa41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aaaad3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2aa415a740 0x7f2aa4155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aaaad3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40c8950 con 0x7f2aa4159e30 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aaaad3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40c8c30 con 0x7f2aa415a740 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aaaad3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40c8f10 con 0x7f2aa40cd6c0 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa4159e30 0x7f2aa41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa4159e30 0x7f2aa41588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46018/0 (socket says 172.21.15.84:46018) 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa3fff700 1 -- 172.21.15.84:0/1495380077 learned_addr learned my addr 172.21.15.84:0/1495380077 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:35.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa9070700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2aa415a740 0x7f2aa4155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa886f700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2aa40cd6c0 0x7f2aa4169cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa3fff700 1 -- 172.21.15.84:0/1495380077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2aa40cd6c0 msgr2=0x7f2aa4169cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa3fff700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2aa40cd6c0 0x7f2aa4169cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa3fff700 1 -- 172.21.15.84:0/1495380077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2aa415a740 msgr2=0x7f2aa4155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa3fff700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2aa415a740 0x7f2aa4155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.114+0000 7f2aa3fff700 1 -- 172.21.15.84:0/1495380077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a90009420 con 0x7f2aa4159e30 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.115+0000 7f2aa3fff700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa4159e30 0x7f2aa41588b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4068300 tx=0x7f2a90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.115+0000 7f2aa0ff9700 1 -- 172.21.15.84:0/1495380077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90006af0 con 0x7f2aa4159e30 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.115+0000 7f2aa0ff9700 1 -- 172.21.15.84:0/1495380077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9000bb90 con 0x7f2aa4159e30 2023-10-06T03:00:35.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.115+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa40c91f0 con 0x7f2aa4159e30 2023-10-06T03:00:35.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.115+0000 7f2aa0ff9700 1 -- 172.21.15.84:0/1495380077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90011650 con 0x7f2aa4159e30 2023-10-06T03:00:35.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.115+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa416a230 con 0x7f2aa4159e30 2023-10-06T03:00:35.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.116+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa4064ad0 con 0x7f2aa4159e30 2023-10-06T03:00:35.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.116+0000 7f2aa0ff9700 1 -- 172.21.15.84:0/1495380077 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a90011a40 con 0x7f2aa4159e30 2023-10-06T03:00:35.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.116+0000 7f2aa0ff9700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a88066f30 0x7f2a880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.116+0000 7f2aa0ff9700 1 -- 172.21.15.84:0/1495380077 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2a90085eb0 con 0x7f2aa4159e30 2023-10-06T03:00:35.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.116+0000 7f2aa886f700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a88066f30 0x7f2a880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.117+0000 7f2aa886f700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a88066f30 0x7f2a880693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2a98006fd0 tx=0x7f2a98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.121+0000 7f2aa0ff9700 1 -- 172.21.15.84:0/1495380077 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a900531d0 con 0x7f2aa4159e30 2023-10-06T03:00:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.305+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2aa40c8a90 con 0x7f2aa4159e30 2023-10-06T03:00:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.306+0000 7f2aa0ff9700 1 -- 172.21.15.84:0/1495380077 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+13856 (secure 0 0 0) 0x7f2aa40c8a90 con 0x7f2aa4159e30 2023-10-06T03:00:35.308 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:35.308 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":90,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:00:34.567802+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:35.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a88066f30 msgr2=0x7f2a880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a88066f30 0x7f2a880693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2a98006fd0 tx=0x7f2a98008040 comp rx=0 tx=0).stop 2023-10-06T03:00:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa4159e30 msgr2=0x7f2aa41588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa4159e30 0x7f2aa41588b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4068300 tx=0x7f2a90017000 comp rx=0 tx=0).stop 2023-10-06T03:00:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 shutdown_connections 2023-10-06T03:00:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a88066f30 0x7f2a880693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2aa415a740 0x7f2aa4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2aa40cd6c0 0x7f2aa4169cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 --2- 172.21.15.84:0/1495380077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2aa4159e30 0x7f2aa41588b0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.308+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 >> 172.21.15.84:0/1495380077 conn(0x7f2aa4070810 msgr2=0x7f2aa4070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:35.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.309+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 shutdown_connections 2023-10-06T03:00:35.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.309+0000 7f2aaaad3700 1 -- 172.21.15.84:0/1495380077 wait complete. 2023-10-06T03:00:35.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:00:35.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:00:35.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.439+0000 7face599d700 1 Processor -- start 2023-10-06T03:00:35.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.439+0000 7face599d700 1 -- start start 2023-10-06T03:00:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7face599d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7face00cd400 0x7face00ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7face599d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b2a30 0x7face00cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7face599d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face00cc9b0 con 0x7face00b2660 2023-10-06T03:00:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7face599d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face00cf560 con 0x7face00cd400 2023-10-06T03:00:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7face599d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face00cbda0 con 0x7face00b2a30 2023-10-06T03:00:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7face499b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7face00b2660 0x7face00cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55380/0 (socket says 172.21.15.84:55380) 2023-10-06T03:00:35.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7face499b700 1 -- 172.21.15.84:0/2674560198 learned_addr learned my addr 172.21.15.84:0/2674560198 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7facdffff700 1 --2- 172.21.15.84:0/2674560198 >> v2:172.21.15.131:3300/0 conn(0x7face00cd400 0x7face00ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7face519c700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b2a30 0x7face00cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421269305 0 0) 0x7face00cc9b0 con 0x7face00b2660 2023-10-06T03:00:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.440+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc8003570 con 0x7face00b2660 2023-10-06T03:00:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2795078388 0 0) 0x7facc8003570 con 0x7face00b2660 2023-10-06T03:00:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b2a30 msgr2=0x7face00cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b2a30 0x7face00cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 >> v2:172.21.15.131:3300/0 conn(0x7face00cd400 msgr2=0x7face00ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 --2- 172.21.15.84:0/2674560198 >> v2:172.21.15.131:3300/0 conn(0x7face00cd400 0x7face00ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face00cc080 con 0x7face00b2660 2023-10-06T03:00:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7facd0001970 con 0x7face00b2660 2023-10-06T03:00:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 >> v1:172.21.15.84:6789/0 conn(0x7face00b2660 legacy=0x7face00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b2a30 0x7facc8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7facc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facc8004d50 0x7facc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face00cbda0 con 0x7facc8003fe0 2023-10-06T03:00:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc800ba60 con 0x7facc8004d50 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc800bbd0 con 0x7face00b2a30 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdffff700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7facc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7face499b700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b2a30 0x7facc8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7face519c700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facc8004d50 0x7facc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdffff700 1 -- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b2a30 msgr2=0x7facc8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdffff700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b2a30 0x7facc8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdffff700 1 -- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facc8004d50 msgr2=0x7facc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdffff700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facc8004d50 0x7facc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdffff700 1 -- 172.21.15.84:0/2674560198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc8003570 con 0x7facc8003fe0 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7face519c700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facc8004d50 0x7facc80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdffff700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7facc8004810 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7face00cd800 tx=0x7facd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967b459a9442940f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd400e6b0 con 0x7facc8003fe0 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd400e810 con 0x7facc8003fe0 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.441+0000 7facdf7fe700 1 -- 172.21.15.84:0/2674560198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd400ebd0 con 0x7facc8003fe0 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.442+0000 7face599d700 1 -- 172.21.15.84:0/2674560198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 msgr2=0x7facc8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.442+0000 7face599d700 1 --2- 172.21.15.84:0/2674560198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7facc8004810 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7face00cd800 tx=0x7facd40091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.442+0000 7face519c700 1 -- 172.21.15.84:0/2674560198 reap_dead start 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.442+0000 7face599d700 1 -- 172.21.15.84:0/2674560198 shutdown_connections 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.442+0000 7face599d700 1 -- 172.21.15.84:0/2674560198 >> 172.21.15.84:0/2674560198 conn(0x7face0099560 msgr2=0x7face006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.442+0000 7face599d700 1 -- 172.21.15.84:0/2674560198 shutdown_connections 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.442+0000 7face599d700 1 -- 172.21.15.84:0/2674560198 wait complete. 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.443+0000 7face599d700 1 Processor -- start 2023-10-06T03:00:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.443+0000 7face599d700 1 -- start start 2023-10-06T03:00:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face599d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7face00b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face599d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b5c90 0x7face014cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face599d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face00c73c0 0x7face00c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face599d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face015a680 con 0x7facc8003fe0 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face599d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face00c7d70 con 0x7face00c73c0 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face599d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face00b41e0 con 0x7face00b5c90 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face499b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7face00b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face499b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7face00b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46036/0 (socket says 172.21.15.84:46036) 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face499b700 1 -- 172.21.15.84:0/3401074310 learned_addr learned my addr 172.21.15.84:0/3401074310 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face499b700 1 -- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b5c90 msgr2=0x7face014cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7facdffff700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b5c90 0x7face014cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face519c700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face00c73c0 0x7face00c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face499b700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b5c90 0x7face014cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face499b700 1 -- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face00c73c0 msgr2=0x7face00c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face499b700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face00c73c0 0x7face00c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face499b700 1 -- 172.21.15.84:0/3401074310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face00b44c0 con 0x7facc8003fe0 2023-10-06T03:00:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7facdffff700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b5c90 0x7face014cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.444+0000 7face519c700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face00c73c0 0x7face00c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.445+0000 7face499b700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7face00b3ae0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7facd0001140 tx=0x7facd0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.445+0000 7facdcff9700 1 -- 172.21.15.84:0/3401074310 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0005d80 con 0x7facc8003fe0 2023-10-06T03:00:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.445+0000 7facdcff9700 1 -- 172.21.15.84:0/3401074310 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd000da40 con 0x7facc8003fe0 2023-10-06T03:00:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.445+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face00b47a0 con 0x7facc8003fe0 2023-10-06T03:00:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.445+0000 7facdcff9700 1 -- 172.21.15.84:0/3401074310 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd000de00 con 0x7facc8003fe0 2023-10-06T03:00:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.445+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face00b6100 con 0x7facc8003fe0 2023-10-06T03:00:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.446+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face015a7f0 con 0x7facc8003fe0 2023-10-06T03:00:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.446+0000 7facdcff9700 1 -- 172.21.15.84:0/3401074310 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facd00072e0 con 0x7facc8003fe0 2023-10-06T03:00:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.446+0000 7facdcff9700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faccc066f30 0x7faccc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.446+0000 7facdcff9700 1 -- 172.21.15.84:0/3401074310 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5526+0+0 (secure 0 0 0) 0x7facd0084b40 con 0x7facc8003fe0 2023-10-06T03:00:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.446+0000 7facdffff700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faccc066f30 0x7faccc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.447+0000 7facdffff700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faccc066f30 0x7faccc0693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7face00ca8a0 tx=0x7facd401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.451+0000 7facdcff9700 1 -- 172.21.15.84:0/3401074310 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face015a7f0 con 0x7facc8003fe0 2023-10-06T03:00:35.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.632+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7face015a7c0 con 0x7facc8003fe0 2023-10-06T03:00:35.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.632+0000 7facdcff9700 1 -- 172.21.15.84:0/3401074310 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7facd0051e60 con 0x7facc8003fe0 2023-10-06T03:00:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:00:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faccc066f30 msgr2=0x7faccc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faccc066f30 0x7faccc0693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7face00ca8a0 tx=0x7facd401a000 comp rx=0 tx=0).stop 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 msgr2=0x7face00b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7face00b3ae0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7facd0001140 tx=0x7facd0009040 comp rx=0 tx=0).stop 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 shutdown_connections 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faccc066f30 0x7faccc0693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face00c73c0 0x7face00c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facc8003fe0 0x7face00b3ae0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 --2- 172.21.15.84:0/3401074310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7face00b5c90 0x7face014cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 >> 172.21.15.84:0/3401074310 conn(0x7face0099560 msgr2=0x7face00682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 shutdown_connections 2023-10-06T03:00:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.635+0000 7face599d700 1 -- 172.21.15.84:0/3401074310 wait complete. 2023-10-06T03:00:35.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:00:35.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.764+0000 7f7757fe4700 1 Processor -- start 2023-10-06T03:00:35.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.764+0000 7f7757fe4700 1 -- start start 2023-10-06T03:00:35.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7757fe4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7750159510 0x7f77500cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7757fe4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77501598e0 0x7f77500cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7757fe4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500ce820 0x7f77500cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7757fe4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77500cf610 con 0x7f77501598e0 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7757fe4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77500cf8f0 con 0x7f7750159510 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7757fe4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77500cfbd0 con 0x7f77500ce820 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f775557f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77501598e0 0x7f77500cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f775557f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77501598e0 0x7f77500cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46038/0 (socket says 172.21.15.84:46038) 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f775557f700 1 -- 172.21.15.84:0/3767622001 learned_addr learned my addr 172.21.15.84:0/3767622001 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7755d80700 1 --2- 172.21.15.84:0/3767622001 >> v2:172.21.15.131:3300/0 conn(0x7f7750159510 0x7f77500cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7756581700 1 --2- 172.21.15.84:0/3767622001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500ce820 0x7f77500cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f775557f700 1 -- 172.21.15.84:0/3767622001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500ce820 msgr2=0x7f77500cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f775557f700 1 --2- 172.21.15.84:0/3767622001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500ce820 0x7f77500cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f775557f700 1 -- 172.21.15.84:0/3767622001 >> v2:172.21.15.131:3300/0 conn(0x7f7750159510 msgr2=0x7f77500cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f775557f700 1 --2- 172.21.15.84:0/3767622001 >> v2:172.21.15.131:3300/0 conn(0x7f7750159510 0x7f77500cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f775557f700 1 -- 172.21.15.84:0/3767622001 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77500cfeb0 con 0x7f77501598e0 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f775557f700 1 --2- 172.21.15.84:0/3767622001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77501598e0 0x7f77500cbae0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7750088fb0 tx=0x7f7744009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9070446db37a2fda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7754d7e700 1 -- 172.21.15.84:0/3767622001 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774400b860 con 0x7f77501598e0 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7754d7e700 1 -- 172.21.15.84:0/3767622001 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774400b9c0 con 0x7f77501598e0 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.765+0000 7f7754d7e700 1 -- 172.21.15.84:0/3767622001 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774400bd60 con 0x7f77501598e0 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.766+0000 7f7757fe4700 1 -- 172.21.15.84:0/3767622001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77501598e0 msgr2=0x7f77500cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.766+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3767622001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77501598e0 0x7f77500cbae0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7750088fb0 tx=0x7f7744009250 comp rx=0 tx=0).stop 2023-10-06T03:00:35.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.766+0000 7f7757fe4700 1 -- 172.21.15.84:0/3767622001 shutdown_connections 2023-10-06T03:00:35.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.766+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3767622001 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77500ce820 0x7f77500cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.766+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3767622001 >> v2:172.21.15.131:3300/0 conn(0x7f7750159510 0x7f77500cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.766+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3767622001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77501598e0 0x7f77500cbae0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.766+0000 7f7757fe4700 1 -- 172.21.15.84:0/3767622001 >> 172.21.15.84:0/3767622001 conn(0x7f7750089e90 msgr2=0x7f77500997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:35.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.766+0000 7f7757fe4700 1 -- 172.21.15.84:0/3767622001 shutdown_connections 2023-10-06T03:00:35.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.766+0000 7f7757fe4700 1 -- 172.21.15.84:0/3767622001 wait complete. 2023-10-06T03:00:35.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.767+0000 7f7757fe4700 1 Processor -- start 2023-10-06T03:00:35.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.767+0000 7f7757fe4700 1 -- start start 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7757fe4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500ce820 0x7f7750154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7757fe4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7750159510 0x7f77500b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7757fe4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77501598e0 0x7f775016f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7757fe4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77500b36c0 con 0x7f77500ce820 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7757fe4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77501538d0 con 0x7f7750159510 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7757fe4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7750153bb0 con 0x7f77501598e0 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7755d80700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500ce820 0x7f7750154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7755d80700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500ce820 0x7f7750154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46042/0 (socket says 172.21.15.84:46042) 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7755d80700 1 -- 172.21.15.84:0/3046522489 learned_addr learned my addr 172.21.15.84:0/3046522489 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f775557f700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7750159510 0x7f77500b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7756581700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77501598e0 0x7f775016f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7755d80700 1 -- 172.21.15.84:0/3046522489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77501598e0 msgr2=0x7f775016f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7755d80700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77501598e0 0x7f775016f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7755d80700 1 -- 172.21.15.84:0/3046522489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7750159510 msgr2=0x7f77500b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7755d80700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7750159510 0x7f77500b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7755d80700 1 -- 172.21.15.84:0/3046522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77440094f0 con 0x7f77500ce820 2023-10-06T03:00:35.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f775557f700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7750159510 0x7f77500b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f7755d80700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500ce820 0x7f7750154970 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f774800d890 tx=0x7f7748008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.768+0000 7f774dffb700 1 -- 172.21.15.84:0/3046522489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800b600 con 0x7f77500ce820 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.769+0000 7f774dffb700 1 -- 172.21.15.84:0/3046522489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774800b760 con 0x7f77500ce820 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.769+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7750153e90 con 0x7f77500ce820 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.769+0000 7f774dffb700 1 -- 172.21.15.84:0/3046522489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800bae0 con 0x7f77500ce820 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.769+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7750154450 con 0x7f77500ce820 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.770+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77501547c0 con 0x7f77500ce820 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.770+0000 7f774dffb700 1 -- 172.21.15.84:0/3046522489 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f774801e460 con 0x7f77500ce820 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.770+0000 7f774dffb700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f773c066f30 0x7f773c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.770+0000 7f774dffb700 1 -- 172.21.15.84:0/3046522489 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7748084b30 con 0x7f77500ce820 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.771+0000 7f775557f700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f773c066f30 0x7f773c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.771+0000 7f775557f700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f773c066f30 0x7f773c0693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f775008a870 tx=0x7f7744017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.774+0000 7f774dffb700 1 -- 172.21.15.84:0/3046522489 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7748051e50 con 0x7f77500ce820 2023-10-06T03:00:35.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.958+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7750064ad0 con 0x7f77500ce820 2023-10-06T03:00:35.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.958+0000 7f774dffb700 1 -- 172.21.15.84:0/3046522489 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7748055470 con 0x7f77500ce820 2023-10-06T03:00:35.960 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:00:35.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f773c066f30 msgr2=0x7f773c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f773c066f30 0x7f773c0693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f775008a870 tx=0x7f7744017000 comp rx=0 tx=0).stop 2023-10-06T03:00:35.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500ce820 msgr2=0x7f7750154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500ce820 0x7f7750154970 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f774800d890 tx=0x7f7748008040 comp rx=0 tx=0).stop 2023-10-06T03:00:35.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 shutdown_connections 2023-10-06T03:00:35.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f773c066f30 0x7f773c0693e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77501598e0 0x7f775016f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77500ce820 0x7f7750154970 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 --2- 172.21.15.84:0/3046522489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7750159510 0x7f77500b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 >> 172.21.15.84:0/3046522489 conn(0x7f7750089e90 msgr2=0x7f77500cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:35.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.960+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 shutdown_connections 2023-10-06T03:00:35.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:35.961+0000 7f7757fe4700 1 -- 172.21.15.84:0/3046522489 wait complete. 2023-10-06T03:00:35.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:00:36.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.087+0000 7fe086b20700 1 Processor -- start 2023-10-06T03:00:36.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.087+0000 7fe086b20700 1 -- start start 2023-10-06T03:00:36.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe086b20700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe080159480 0x7fe0800b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe086b20700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe0800b2140 0x7fe0800b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe086b20700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0800cb7e0 con 0x7fe0800b3610 2023-10-06T03:00:36.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe086b20700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800b08a0 con 0x7fe080159480 2023-10-06T03:00:36.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe086b20700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800cb190 con 0x7fe0800b2140 2023-10-06T03:00:36.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe085b1e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe080159480 0x7fe0800b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe085b1e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe080159480 0x7fe0800b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46056/0 (socket says 172.21.15.84:46056) 2023-10-06T03:00:36.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe085b1e700 1 -- 172.21.15.84:0/11063089 learned_addr learned my addr 172.21.15.84:0/11063089 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe08631f700 1 --2- 172.21.15.84:0/11063089 >> v2:172.21.15.131:3300/0 conn(0x7fe0800b2140 0x7fe0800b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe085b1e700 1 -- 172.21.15.84:0/11063089 >> v2:172.21.15.131:3300/0 conn(0x7fe0800b2140 msgr2=0x7fe0800b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe085b1e700 1 --2- 172.21.15.84:0/11063089 >> v2:172.21.15.131:3300/0 conn(0x7fe0800b2140 0x7fe0800b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe085b1e700 1 -- 172.21.15.84:0/11063089 >> v1:172.21.15.131:6789/0 conn(0x7fe0800b3610 legacy=0x7fe0800cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe085b1e700 1 -- 172.21.15.84:0/11063089 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800cb470 con 0x7fe080159480 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe085b1e700 1 --2- 172.21.15.84:0/11063089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe080159480 0x7fe0800b30d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe0800ca830 tx=0x7fe078009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cd83f6c1f4c2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.088+0000 7fe084b1c700 1 -- 172.21.15.84:0/11063089 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078009e70 con 0x7fe080159480 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe084b1c700 1 -- 172.21.15.84:0/11063089 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07800b860 con 0x7fe080159480 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe084b1c700 1 -- 172.21.15.84:0/11063089 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800bc00 con 0x7fe080159480 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe086b20700 1 -- 172.21.15.84:0/11063089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe080159480 msgr2=0x7fe0800b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe086b20700 1 --2- 172.21.15.84:0/11063089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe080159480 0x7fe0800b30d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe0800ca830 tx=0x7fe078009250 comp rx=0 tx=0).stop 2023-10-06T03:00:36.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe086b20700 1 -- 172.21.15.84:0/11063089 shutdown_connections 2023-10-06T03:00:36.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe086b20700 1 --2- 172.21.15.84:0/11063089 >> v2:172.21.15.131:3300/0 conn(0x7fe0800b2140 0x7fe0800b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe086b20700 1 --2- 172.21.15.84:0/11063089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe080159480 0x7fe0800b30d0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe086b20700 1 -- 172.21.15.84:0/11063089 >> 172.21.15.84:0/11063089 conn(0x7fe08006ed20 msgr2=0x7fe08006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:36.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe086b20700 1 -- 172.21.15.84:0/11063089 shutdown_connections 2023-10-06T03:00:36.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.089+0000 7fe086b20700 1 -- 172.21.15.84:0/11063089 wait complete. 2023-10-06T03:00:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.090+0000 7fe086b20700 1 Processor -- start 2023-10-06T03:00:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.090+0000 7fe086b20700 1 -- start start 2023-10-06T03:00:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe086b20700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0800b2140 0x7fe0800c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe086b20700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0800b3610 0x7fe08016cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe086b20700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe080159480 0x7fe08016d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe086b20700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c6210 con 0x7fe0800b3610 2023-10-06T03:00:36.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe086b20700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c5590 con 0x7fe0800b2140 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe086b20700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800c5870 con 0x7fe080159480 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe08531d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0800b3610 0x7fe08016cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe08531d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0800b3610 0x7fe08016cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46066/0 (socket says 172.21.15.84:46066) 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe085b1e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0800b2140 0x7fe0800c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe08531d700 1 -- 172.21.15.84:0/226448157 learned_addr learned my addr 172.21.15.84:0/226448157 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe08631f700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe080159480 0x7fe08016d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe08531d700 1 -- 172.21.15.84:0/226448157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe080159480 msgr2=0x7fe08016d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe08531d700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe080159480 0x7fe08016d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe08531d700 1 -- 172.21.15.84:0/226448157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0800b2140 msgr2=0x7fe0800c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe08531d700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0800b2140 0x7fe0800c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.091+0000 7fe08531d700 1 -- 172.21.15.84:0/226448157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780094f0 con 0x7fe0800b3610 2023-10-06T03:00:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.092+0000 7fe08531d700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0800b3610 0x7fe08016cc50 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe07400c590 tx=0x7fe07400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.092+0000 7fe07dffb700 1 -- 172.21.15.84:0/226448157 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011590 con 0x7fe0800b3610 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.092+0000 7fe07dffb700 1 -- 172.21.15.84:0/226448157 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074011710 con 0x7fe0800b3610 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.092+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0800c5b50 con 0x7fe0800b3610 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.092+0000 7fe07dffb700 1 -- 172.21.15.84:0/226448157 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011ad0 con 0x7fe0800b3610 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.092+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe080156370 con 0x7fe0800b3610 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.093+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0800c6350 con 0x7fe0800b3610 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.093+0000 7fe07dffb700 1 -- 172.21.15.84:0/226448157 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe07401b3b0 con 0x7fe0800b3610 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.093+0000 7fe07dffb700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe06c066f30 0x7fe06c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.094+0000 7fe07dffb700 1 -- 172.21.15.84:0/226448157 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fe074083910 con 0x7fe0800b3610 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.094+0000 7fe085b1e700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe06c066f30 0x7fe06c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.094+0000 7fe085b1e700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe06c066f30 0x7fe06c0693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe0800ca830 tx=0x7fe078017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.098+0000 7fe07dffb700 1 -- 172.21.15.84:0/226448157 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0800c6350 con 0x7fe0800b3610 2023-10-06T03:00:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.281+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe0800c6350 con 0x7fe0800b3610 2023-10-06T03:00:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.281+0000 7fe07dffb700 1 -- 172.21.15.84:0/226448157 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe0800c6350 con 0x7fe0800b3610 2023-10-06T03:00:36.283 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:36.283 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T03:00:36.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:36.283 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T03:00:36.283 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T03:00:36.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:00:36.283 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:00:36.283 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T03:00:36.284 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T03:00:36.284 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:00:36.284 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T03:00:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe06c066f30 msgr2=0x7fe06c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe06c066f30 0x7fe06c0693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe0800ca830 tx=0x7fe078017000 comp rx=0 tx=0).stop 2023-10-06T03:00:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0800b3610 msgr2=0x7fe08016cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0800b3610 0x7fe08016cc50 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe07400c590 tx=0x7fe07400c8a0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 shutdown_connections 2023-10-06T03:00:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe06c066f30 0x7fe06c0693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0800b2140 0x7fe0800c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe080159480 0x7fe08016d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 --2- 172.21.15.84:0/226448157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0800b3610 0x7fe08016cc50 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 >> 172.21.15.84:0/226448157 conn(0x7fe08006ed20 msgr2=0x7fe0800d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 shutdown_connections 2023-10-06T03:00:36.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.283+0000 7fe086b20700 1 -- 172.21.15.84:0/226448157 wait complete. 2023-10-06T03:00:36.296 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:00:36.296 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:00:36.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.413+0000 7fbb653b8700 1 Processor -- start 2023-10-06T03:00:36.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.413+0000 7fbb653b8700 1 -- start start 2023-10-06T03:00:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.414+0000 7fbb653b8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbb6006b600 0x7fbb60068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.414+0000 7fbb653b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006ad70 0x7fbb60068b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.414+0000 7fbb653b8700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb600c8a20 con 0x7fbb6006b9d0 2023-10-06T03:00:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.414+0000 7fbb653b8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb600c7e10 con 0x7fbb6006b600 2023-10-06T03:00:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.414+0000 7fbb653b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600c80f0 con 0x7fbb6006ad70 2023-10-06T03:00:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5f7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006ad70 0x7fbb60068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5effd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbb6006b600 0x7fbb60068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5f7fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006ad70 0x7fbb60068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:44056/0 (socket says 172.21.15.84:44056) 2023-10-06T03:00:36.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5f7fe700 1 -- 172.21.15.84:0/2640503470 learned_addr learned my addr 172.21.15.84:0/2640503470 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5f7fe700 1 -- 172.21.15.84:0/2640503470 >> v2:172.21.15.131:3300/0 conn(0x7fbb6006b600 msgr2=0x7fbb60068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5f7fe700 1 --2- 172.21.15.84:0/2640503470 >> v2:172.21.15.131:3300/0 conn(0x7fbb6006b600 0x7fbb60068600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5f7fe700 1 -- 172.21.15.84:0/2640503470 >> v1:172.21.15.131:6789/0 conn(0x7fbb6006b9d0 legacy=0x7fbb600a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5f7fe700 1 -- 172.21.15.84:0/2640503470 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb600c83d0 con 0x7fbb6006ad70 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5effd700 1 --2- 172.21.15.84:0/2640503470 >> v2:172.21.15.131:3300/0 conn(0x7fbb6006b600 0x7fbb60068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5f7fe700 1 --2- 172.21.15.84:0/2640503470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006ad70 0x7fbb60068b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009f20 tx=0x7fbb58009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e05c55709a6cfc4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5e7fc700 1 -- 172.21.15.84:0/2640503470 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800e070 con 0x7fbb6006ad70 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5e7fc700 1 -- 172.21.15.84:0/2640503470 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5800b9d0 con 0x7fbb6006ad70 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.415+0000 7fbb5e7fc700 1 -- 172.21.15.84:0/2640503470 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580092e0 con 0x7fbb6006ad70 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.416+0000 7fbb653b8700 1 -- 172.21.15.84:0/2640503470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006ad70 msgr2=0x7fbb60068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.416+0000 7fbb653b8700 1 --2- 172.21.15.84:0/2640503470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006ad70 0x7fbb60068b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009f20 tx=0x7fbb58009840 comp rx=0 tx=0).stop 2023-10-06T03:00:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.416+0000 7fbb653b8700 1 -- 172.21.15.84:0/2640503470 shutdown_connections 2023-10-06T03:00:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.416+0000 7fbb653b8700 1 --2- 172.21.15.84:0/2640503470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006ad70 0x7fbb60068b40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.416+0000 7fbb653b8700 1 --2- 172.21.15.84:0/2640503470 >> v2:172.21.15.131:3300/0 conn(0x7fbb6006b600 0x7fbb60068600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.416+0000 7fbb653b8700 1 -- 172.21.15.84:0/2640503470 >> 172.21.15.84:0/2640503470 conn(0x7fbb600c9e30 msgr2=0x7fbb6006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.416+0000 7fbb653b8700 1 -- 172.21.15.84:0/2640503470 shutdown_connections 2023-10-06T03:00:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.416+0000 7fbb653b8700 1 -- 172.21.15.84:0/2640503470 wait complete. 2023-10-06T03:00:36.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.417+0000 7fbb653b8700 1 Processor -- start 2023-10-06T03:00:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.417+0000 7fbb653b8700 1 -- start start 2023-10-06T03:00:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb653b8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb6006ad70 0x7fbb600c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb653b8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb6006b600 0x7fbb60159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb653b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006b9d0 0x7fbb6015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb653b8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6015a530 con 0x7fbb6006b600 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb653b8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600c58a0 con 0x7fbb6006ad70 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb653b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600c5b80 con 0x7fbb6006b9d0 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb567fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb6006b600 0x7fbb60159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb567fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb6006b600 0x7fbb60159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46080/0 (socket says 172.21.15.84:46080) 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb567fc700 1 -- 172.21.15.84:0/3592356432 learned_addr learned my addr 172.21.15.84:0/3592356432 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb5f7fe700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006b9d0 0x7fbb6015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb5effd700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb6006ad70 0x7fbb600c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb567fc700 1 -- 172.21.15.84:0/3592356432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006b9d0 msgr2=0x7fbb6015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb567fc700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006b9d0 0x7fbb6015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb567fc700 1 -- 172.21.15.84:0/3592356432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb6006ad70 msgr2=0x7fbb600c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb567fc700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb6006ad70 0x7fbb600c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb567fc700 1 -- 172.21.15.84:0/3592356432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50009420 con 0x7fbb6006b600 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.418+0000 7fbb567fc700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb6006b600 0x7fbb60159ff0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c590 tx=0x7fbb48007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.419+0000 7fbb577fe700 1 -- 172.21.15.84:0/3592356432 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48011590 con 0x7fbb6006b600 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.419+0000 7fbb577fe700 1 -- 172.21.15.84:0/3592356432 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48011730 con 0x7fbb6006b600 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.419+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb58009ae0 con 0x7fbb6006b600 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.419+0000 7fbb577fe700 1 -- 172.21.15.84:0/3592356432 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48011af0 con 0x7fbb6006b600 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.419+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb600c6140 con 0x7fbb6006b600 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.419+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb60064ad0 con 0x7fbb6006b600 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.420+0000 7fbb577fe700 1 -- 172.21.15.84:0/3592356432 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb48012420 con 0x7fbb6006b600 2023-10-06T03:00:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.420+0000 7fbb577fe700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb40066f30 0x7fbb400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.420+0000 7fbb577fe700 1 -- 172.21.15.84:0/3592356432 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fbb480837a0 con 0x7fbb6006b600 2023-10-06T03:00:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.420+0000 7fbb5effd700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb40066f30 0x7fbb400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.421+0000 7fbb5effd700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb40066f30 0x7fbb400693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbb500093f0 tx=0x7fbb50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.425+0000 7fbb577fe700 1 -- 172.21.15.84:0/3592356432 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb4804b5a0 con 0x7fbb6006b600 2023-10-06T03:00:36.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:36.609+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbb6004bb80 con 0x7fbb6006b600 2023-10-06T03:00:36.876 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:36.879 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:37.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.586+0000 7fbb577fe700 1 -- 172.21.15.84:0/3592356432 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v91) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbb48017020 con 0x7fbb6006b600 2023-10-06T03:00:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb40066f30 msgr2=0x7fbb400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb40066f30 0x7fbb400693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbb500093f0 tx=0x7fbb50008040 comp rx=0 tx=0).stop 2023-10-06T03:00:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb6006b600 msgr2=0x7fbb60159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb6006b600 0x7fbb60159ff0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c590 tx=0x7fbb48007f30 comp rx=0 tx=0).stop 2023-10-06T03:00:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 shutdown_connections 2023-10-06T03:00:37.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbb40066f30 0x7fbb400693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:37.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb6006ad70 0x7fbb600c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:37.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbb6006b9d0 0x7fbb6015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:37.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 --2- 172.21.15.84:0/3592356432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb6006b600 0x7fbb60159ff0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:37.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.590+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 >> 172.21.15.84:0/3592356432 conn(0x7fbb600c9e30 msgr2=0x7fbb6006dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:37.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.591+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 shutdown_connections 2023-10-06T03:00:37.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.591+0000 7fbb653b8700 1 -- 172.21.15.84:0/3592356432 wait complete. 2023-10-06T03:00:37.594 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T03:00:37.607 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:00:37.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.729+0000 7f969565a700 1 Processor -- start 2023-10-06T03:00:37.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.729+0000 7f969565a700 1 -- start start 2023-10-06T03:00:37.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.729+0000 7f969565a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9690159340 0x7f96900af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:37.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.729+0000 7f969565a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9690159710 0x7f96900cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.729+0000 7f969565a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900cbed0 con 0x7f96900cba70 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.729+0000 7f969565a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900cf820 con 0x7f9690159340 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.729+0000 7f969565a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900cfb00 con 0x7f9690159710 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9690159340 0x7f96900af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9690159340 0x7f96900af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46090/0 (socket says 172.21.15.84:46090) 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968effd700 1 -- 172.21.15.84:0/357373433 learned_addr learned my addr 172.21.15.84:0/357373433 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968e7fc700 1 --2- 172.21.15.84:0/357373433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9690159710 0x7f96900cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968effd700 1 -- 172.21.15.84:0/357373433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9690159710 msgr2=0x7f96900cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968effd700 1 --2- 172.21.15.84:0/357373433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9690159710 0x7f96900cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968effd700 1 -- 172.21.15.84:0/357373433 >> v1:172.21.15.131:6789/0 conn(0x7f96900cba70 legacy=0x7f96900cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:37.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968effd700 1 -- 172.21.15.84:0/357373433 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900cfde0 con 0x7f9690159340 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968e7fc700 1 --2- 172.21.15.84:0/357373433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9690159710 0x7f96900cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968effd700 1 --2- 172.21.15.84:0/357373433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 0x7f96900af4d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9680009990 tx=0x7f9680009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa9ea58280b7146 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968dffb700 1 -- 172.21.15.84:0/357373433 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680005c10 con 0x7f9690159340 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968dffb700 1 -- 172.21.15.84:0/357373433 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680005d70 con 0x7f9690159340 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.730+0000 7f968dffb700 1 -- 172.21.15.84:0/357373433 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000b880 con 0x7f9690159340 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.731+0000 7f969565a700 1 -- 172.21.15.84:0/357373433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 msgr2=0x7f96900af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.731+0000 7f969565a700 1 --2- 172.21.15.84:0/357373433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 0x7f96900af4d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9680009990 tx=0x7f9680009220 comp rx=0 tx=0).stop 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.731+0000 7f969565a700 1 -- 172.21.15.84:0/357373433 shutdown_connections 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.731+0000 7f969565a700 1 --2- 172.21.15.84:0/357373433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 0x7f96900af4d0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:37.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.731+0000 7f969565a700 1 --2- 172.21.15.84:0/357373433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9690159710 0x7f96900cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:37.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.731+0000 7f969565a700 1 -- 172.21.15.84:0/357373433 >> 172.21.15.84:0/357373433 conn(0x7f9690099720 msgr2=0x7f969006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:37.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.731+0000 7f969565a700 1 -- 172.21.15.84:0/357373433 shutdown_connections 2023-10-06T03:00:37.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.731+0000 7f969565a700 1 -- 172.21.15.84:0/357373433 wait complete. 2023-10-06T03:00:37.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.732+0000 7f969565a700 1 Processor -- start 2023-10-06T03:00:37.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.732+0000 7f969565a700 1 -- start start 2023-10-06T03:00:37.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f969565a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96900cba70 0x7f96900af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:37.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f969565a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 0x7f96900c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:37.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f969565a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9690159710 0x7f96900c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:37.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f969565a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969016acf0 con 0x7f9690159340 2023-10-06T03:00:37.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f969565a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900aff10 con 0x7f9690159710 2023-10-06T03:00:37.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f969565a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900b0140 con 0x7f96900cba70 2023-10-06T03:00:37.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 0x7f96900c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:37.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 0x7f96900c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46104/0 (socket says 172.21.15.84:46104) 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968e7fc700 1 -- 172.21.15.84:0/923110661 learned_addr learned my addr 172.21.15.84:0/923110661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968f7fe700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9690159710 0x7f96900c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968effd700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96900cba70 0x7f96900af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968e7fc700 1 -- 172.21.15.84:0/923110661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96900cba70 msgr2=0x7f96900af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968e7fc700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96900cba70 0x7f96900af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968e7fc700 1 -- 172.21.15.84:0/923110661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9690159710 msgr2=0x7f96900c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968e7fc700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9690159710 0x7f96900c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968e7fc700 1 -- 172.21.15.84:0/923110661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9680009480 con 0x7f9690159340 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968f7fe700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9690159710 0x7f96900c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.733+0000 7f968e7fc700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 0x7f96900c9bf0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f967800d860 tx=0x7f9678008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:37.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.734+0000 7f9686ffd700 1 -- 172.21.15.84:0/923110661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96780125f0 con 0x7f9690159340 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.734+0000 7f9686ffd700 1 -- 172.21.15.84:0/923110661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678012750 con 0x7f9690159340 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.734+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969016a860 con 0x7f9690159340 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.734+0000 7f9686ffd700 1 -- 172.21.15.84:0/923110661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678012ad0 con 0x7f9690159340 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.734+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969016a210 con 0x7f9690159340 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.735+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969016a9f0 con 0x7f9690159340 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.735+0000 7f9686ffd700 1 -- 172.21.15.84:0/923110661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9678014430 con 0x7f9690159340 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.736+0000 7f9686ffd700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9670066f30 0x7f96700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.736+0000 7f968effd700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9670066f30 0x7f96700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.736+0000 7f9686ffd700 1 -- 172.21.15.84:0/923110661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f9678084a20 con 0x7f9690159340 2023-10-06T03:00:37.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.736+0000 7f968effd700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9670066f30 0x7f96700693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9680009260 tx=0x7f9680016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:37.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.740+0000 7f9686ffd700 1 -- 172.21.15.84:0/923110661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9678055660 con 0x7f9690159340 2023-10-06T03:00:37.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:37.924+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9690064ad0 con 0x7f9690159340 2023-10-06T03:00:38.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.595+0000 7f9686ffd700 1 -- 172.21.15.84:0/923110661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v92) v1 ==== 170+0+0 (secure 0 0 0) 0x7f96780551f0 con 0x7f9690159340 2023-10-06T03:00:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.604+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9670066f30 msgr2=0x7f96700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.604+0000 7f969565a700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9670066f30 0x7f96700693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9680009260 tx=0x7f9680016000 comp rx=0 tx=0).stop 2023-10-06T03:00:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.604+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 msgr2=0x7f96900c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:38.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.604+0000 7f969565a700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 0x7f96900c9bf0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f967800d860 tx=0x7f9678008040 comp rx=0 tx=0).stop 2023-10-06T03:00:38.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.607+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 shutdown_connections 2023-10-06T03:00:38.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.607+0000 7f969565a700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9670066f30 0x7f96700693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:38.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.607+0000 7f969565a700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9690159710 0x7f96900c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:38.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.607+0000 7f969565a700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96900cba70 0x7f96900af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:38.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.607+0000 7f969565a700 1 --2- 172.21.15.84:0/923110661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9690159340 0x7f96900c9bf0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:38.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.607+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 >> 172.21.15.84:0/923110661 conn(0x7f9690099720 msgr2=0x7f96900c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:38.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.608+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 shutdown_connections 2023-10-06T03:00:38.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.608+0000 7f969565a700 1 -- 172.21.15.84:0/923110661 wait complete. 2023-10-06T03:00:38.614 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T03:00:38.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:00:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.743+0000 7f4954b7d700 1 Processor -- start 2023-10-06T03:00:38.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.743+0000 7f4954b7d700 1 -- start start 2023-10-06T03:00:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f4954b7d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4950153a00 0x7f4950069590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f4954b7d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4950069ad0 0x7f495015d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:38.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f4954b7d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495015dbd0 con 0x7f4950153dd0 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f4954b7d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495015abb0 con 0x7f4950153a00 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f4954b7d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495015deb0 con 0x7f4950069ad0 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f494e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4950153a00 0x7f4950069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f494e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4950153a00 0x7f4950069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46114/0 (socket says 172.21.15.84:46114) 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f494e59c700 1 -- 172.21.15.84:0/485252214 learned_addr learned my addr 172.21.15.84:0/485252214 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f4945d9b700 1 --2- 172.21.15.84:0/485252214 >> v2:172.21.15.131:3300/0 conn(0x7f4950069ad0 0x7f495015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.744+0000 7f494e59c700 1 -- 172.21.15.84:0/485252214 >> v2:172.21.15.131:3300/0 conn(0x7f4950069ad0 msgr2=0x7f495015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f494e59c700 1 --2- 172.21.15.84:0/485252214 >> v2:172.21.15.131:3300/0 conn(0x7f4950069ad0 0x7f495015d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f494e59c700 1 -- 172.21.15.84:0/485252214 >> v1:172.21.15.131:6789/0 conn(0x7f4950153dd0 legacy=0x7f49500cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:38.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f494e59c700 1 -- 172.21.15.84:0/485252214 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950068d90 con 0x7f4950153a00 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f494e59c700 1 --2- 172.21.15.84:0/485252214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950153a00 0x7f4950069590 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f495006ded0 tx=0x7f4940009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cda22a1b6c7aa8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f494dd9b700 1 -- 172.21.15.84:0/485252214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000b860 con 0x7f4950153a00 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f494dd9b700 1 -- 172.21.15.84:0/485252214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494000b9c0 con 0x7f4950153a00 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f494dd9b700 1 -- 172.21.15.84:0/485252214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000bd60 con 0x7f4950153a00 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f4954b7d700 1 -- 172.21.15.84:0/485252214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950153a00 msgr2=0x7f4950069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f4954b7d700 1 --2- 172.21.15.84:0/485252214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950153a00 0x7f4950069590 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f495006ded0 tx=0x7f4940009250 comp rx=0 tx=0).stop 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f4954b7d700 1 -- 172.21.15.84:0/485252214 shutdown_connections 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f4954b7d700 1 --2- 172.21.15.84:0/485252214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950153a00 0x7f4950069590 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f4954b7d700 1 --2- 172.21.15.84:0/485252214 >> v2:172.21.15.131:3300/0 conn(0x7f4950069ad0 0x7f495015d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:38.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f4954b7d700 1 -- 172.21.15.84:0/485252214 >> 172.21.15.84:0/485252214 conn(0x7f495006b650 msgr2=0x7f495006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:38.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f4954b7d700 1 -- 172.21.15.84:0/485252214 shutdown_connections 2023-10-06T03:00:38.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.745+0000 7f4954b7d700 1 -- 172.21.15.84:0/485252214 wait complete. 2023-10-06T03:00:38.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f4954b7d700 1 Processor -- start 2023-10-06T03:00:38.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f4954b7d700 1 -- start start 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f4954b7d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950069ad0 0x7f495015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f4954b7d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4950153a00 0x7f49500b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f4954b7d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4950153dd0 0x7f495013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f4954b7d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4950154310 con 0x7f4950069ad0 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f4954b7d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49501545f0 con 0x7f4950153a00 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f4954b7d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49501548d0 con 0x7f4950153dd0 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f494e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950069ad0 0x7f495015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f494e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950069ad0 0x7f495015c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46120/0 (socket says 172.21.15.84:46120) 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.747+0000 7f494e59c700 1 -- 172.21.15.84:0/2515226008 learned_addr learned my addr 172.21.15.84:0/2515226008 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f4945d9b700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4950153a00 0x7f49500b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f494e59c700 1 -- 172.21.15.84:0/2515226008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4950153dd0 msgr2=0x7f495013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f494e59c700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4950153dd0 0x7f495013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f494e59c700 1 -- 172.21.15.84:0/2515226008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4950153a00 msgr2=0x7f49500b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f494e59c700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4950153a00 0x7f49500b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f494e59c700 1 -- 172.21.15.84:0/2515226008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49400094f0 con 0x7f4950069ad0 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f4945d9b700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4950153a00 0x7f49500b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f494e59c700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950069ad0 0x7f495015c710 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f495006ed80 tx=0x7f4940017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f4946ffd700 1 -- 172.21.15.84:0/2515226008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940011e60 con 0x7f4950069ad0 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f4946ffd700 1 -- 172.21.15.84:0/2515226008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494001a630 con 0x7f4950069ad0 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4950154bb0 con 0x7f4950069ad0 2023-10-06T03:00:38.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f4946ffd700 1 -- 172.21.15.84:0/2515226008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494001a9f0 con 0x7f4950069ad0 2023-10-06T03:00:38.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.748+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495014e340 con 0x7f4950069ad0 2023-10-06T03:00:38.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.749+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4950064ad0 con 0x7f4950069ad0 2023-10-06T03:00:38.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.749+0000 7f4946ffd700 1 -- 172.21.15.84:0/2515226008 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49400233e0 con 0x7f4950069ad0 2023-10-06T03:00:38.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.750+0000 7f4946ffd700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4930066f60 0x7f4930069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:38.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.750+0000 7f4946ffd700 1 -- 172.21.15.84:0/2515226008 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f4940085e40 con 0x7f4950069ad0 2023-10-06T03:00:38.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.750+0000 7f4945d9b700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4930066f60 0x7f4930069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:38.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.750+0000 7f4945d9b700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4930066f60 0x7f4930069410 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4950159780 tx=0x7f4938008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:38.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.754+0000 7f4946ffd700 1 -- 172.21.15.84:0/2515226008 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4940052e70 con 0x7f4950069ad0 2023-10-06T03:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:38.981+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f495015b140 con 0x7f4950069ad0 2023-10-06T03:00:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.598+0000 7f4946ffd700 1 -- 172.21.15.84:0/2515226008 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v80) v1 ==== 174+0+0 (secure 0 0 0) 0x7f49400150c0 con 0x7f4950069ad0 2023-10-06T03:00:39.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4930066f60 msgr2=0x7f4930069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:39.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4930066f60 0x7f4930069410 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4950159780 tx=0x7f4938008040 comp rx=0 tx=0).stop 2023-10-06T03:00:39.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950069ad0 msgr2=0x7f495015c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:39.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950069ad0 0x7f495015c710 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f495006ed80 tx=0x7f4940017000 comp rx=0 tx=0).stop 2023-10-06T03:00:39.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 shutdown_connections 2023-10-06T03:00:39.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4930066f60 0x7f4930069410 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4950153dd0 0x7f495013f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4950069ad0 0x7f495015c710 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 --2- 172.21.15.84:0/2515226008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4950153a00 0x7f49500b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 >> 172.21.15.84:0/2515226008 conn(0x7f495006b650 msgr2=0x7f495015b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:39.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 shutdown_connections 2023-10-06T03:00:39.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.603+0000 7f4954b7d700 1 -- 172.21.15.84:0/2515226008 wait complete. 2023-10-06T03:00:39.614 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 14 and data pool 15 2023-10-06T03:00:39.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:39.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.746+0000 7f05326b9700 1 Processor -- start 2023-10-06T03:00:39.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.746+0000 7f05326b9700 1 -- start start 2023-10-06T03:00:39.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05326b9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f052c157080 0x7f052c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:39.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05326b9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f052c157450 0x7f052c06d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:39.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05326b9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c15b210 con 0x7f052c15b6a0 2023-10-06T03:00:39.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05326b9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c06db20 con 0x7f052c157080 2023-10-06T03:00:39.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05326b9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c0ce4f0 con 0x7f052c157450 2023-10-06T03:00:39.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05316b7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f052c157080 0x7f052c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05316b7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f052c157080 0x7f052c0cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46126/0 (socket says 172.21.15.84:46126) 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05316b7700 1 -- 172.21.15.84:0/2998006335 learned_addr learned my addr 172.21.15.84:0/2998006335 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05316b7700 1 -- 172.21.15.84:0/2998006335 >> v2:172.21.15.131:3300/0 conn(0x7f052c157450 msgr2=0x7f052c06d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05316b7700 1 --2- 172.21.15.84:0/2998006335 >> v2:172.21.15.131:3300/0 conn(0x7f052c157450 0x7f052c06d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05316b7700 1 -- 172.21.15.84:0/2998006335 >> v1:172.21.15.131:6789/0 conn(0x7f052c15b6a0 legacy=0x7f052c0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.747+0000 7f05316b7700 1 -- 172.21.15.84:0/2998006335 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c0ce7d0 con 0x7f052c157080 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f05316b7700 1 --2- 172.21.15.84:0/2998006335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c157080 0x7f052c0cdea0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f052c06e050 tx=0x7f0528009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ec402f0f25646f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f0523fff700 1 -- 172.21.15.84:0/2998006335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800b820 con 0x7f052c157080 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f0523fff700 1 -- 172.21.15.84:0/2998006335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052800b980 con 0x7f052c157080 2023-10-06T03:00:39.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f0523fff700 1 -- 172.21.15.84:0/2998006335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800bd20 con 0x7f052c157080 2023-10-06T03:00:39.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f05326b9700 1 -- 172.21.15.84:0/2998006335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c157080 msgr2=0x7f052c0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:39.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f05326b9700 1 --2- 172.21.15.84:0/2998006335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c157080 0x7f052c0cdea0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f052c06e050 tx=0x7f0528009250 comp rx=0 tx=0).stop 2023-10-06T03:00:39.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f05326b9700 1 -- 172.21.15.84:0/2998006335 shutdown_connections 2023-10-06T03:00:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f05326b9700 1 --2- 172.21.15.84:0/2998006335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c157080 0x7f052c0cdea0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f05326b9700 1 --2- 172.21.15.84:0/2998006335 >> v2:172.21.15.131:3300/0 conn(0x7f052c157450 0x7f052c06d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f05326b9700 1 -- 172.21.15.84:0/2998006335 >> 172.21.15.84:0/2998006335 conn(0x7f052c06b540 msgr2=0x7f052c06b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f05326b9700 1 -- 172.21.15.84:0/2998006335 shutdown_connections 2023-10-06T03:00:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.748+0000 7f05326b9700 1 -- 172.21.15.84:0/2998006335 wait complete. 2023-10-06T03:00:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.749+0000 7f05326b9700 1 Processor -- start 2023-10-06T03:00:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.749+0000 7f05326b9700 1 -- start start 2023-10-06T03:00:39.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f05326b9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052c157080 0x7f052c148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f05326b9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052c157450 0x7f052c147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f05326b9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c15b6a0 0x7f052c150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f05326b9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c148d60 con 0x7f052c15b6a0 2023-10-06T03:00:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f05326b9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c149040 con 0x7f052c157450 2023-10-06T03:00:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f05326b9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c149320 con 0x7f052c157080 2023-10-06T03:00:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f0531eb8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c15b6a0 0x7f052c150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f0531eb8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c15b6a0 0x7f052c150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46130/0 (socket says 172.21.15.84:46130) 2023-10-06T03:00:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f0531eb8700 1 -- 172.21.15.84:0/2409371886 learned_addr learned my addr 172.21.15.84:0/2409371886 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:39.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.750+0000 7f0530eb6700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052c157450 0x7f052c147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f05316b7700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052c157080 0x7f052c148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f0531eb8700 1 -- 172.21.15.84:0/2409371886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052c157080 msgr2=0x7f052c148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f0531eb8700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052c157080 0x7f052c148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f0531eb8700 1 -- 172.21.15.84:0/2409371886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052c157450 msgr2=0x7f052c147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f0531eb8700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052c157450 0x7f052c147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f0531eb8700 1 -- 172.21.15.84:0/2409371886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280094f0 con 0x7f052c15b6a0 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f0531eb8700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c15b6a0 0x7f052c150800 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f052400bbb0 tx=0x7f0524009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f05217fa700 1 -- 172.21.15.84:0/2409371886 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240092e0 con 0x7f052c15b6a0 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f05217fa700 1 -- 172.21.15.84:0/2409371886 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052400c630 con 0x7f052c15b6a0 2023-10-06T03:00:39.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c149600 con 0x7f052c15b6a0 2023-10-06T03:00:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f05217fa700 1 -- 172.21.15.84:0/2409371886 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400c9f0 con 0x7f052c15b6a0 2023-10-06T03:00:39.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.751+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c14c790 con 0x7f052c15b6a0 2023-10-06T03:00:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.752+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052c05f270 con 0x7f052c15b6a0 2023-10-06T03:00:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.752+0000 7f05217fa700 1 -- 172.21.15.84:0/2409371886 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0524012070 con 0x7f052c15b6a0 2023-10-06T03:00:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.753+0000 7f05217fa700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0510066f30 0x7f05100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.753+0000 7f05217fa700 1 -- 172.21.15.84:0/2409371886 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0524084310 con 0x7f052c15b6a0 2023-10-06T03:00:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.753+0000 7f05316b7700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0510066f30 0x7f05100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:39.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.753+0000 7f05316b7700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0510066f30 0x7f05100693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f052c06e050 tx=0x7f0528016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:39.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.757+0000 7f05217fa700 1 -- 172.21.15.84:0/2409371886 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05240512e0 con 0x7f052c15b6a0 2023-10-06T03:00:39.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.941+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f052c15aea0 con 0x7f052c15b6a0 2023-10-06T03:00:39.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.942+0000 7f05217fa700 1 -- 172.21.15.84:0/2409371886 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f0524054900 con 0x7f052c15b6a0 2023-10-06T03:00:39.944 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:39.944 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:00:38.983160+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:36.627631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:37.942934+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:39.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.944+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0510066f30 msgr2=0x7f05100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:39.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.944+0000 7f05326b9700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0510066f30 0x7f05100693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f052c06e050 tx=0x7f0528016000 comp rx=0 tx=0).stop 2023-10-06T03:00:39.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.944+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c15b6a0 msgr2=0x7f052c150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.944+0000 7f05326b9700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c15b6a0 0x7f052c150800 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f052400bbb0 tx=0x7f0524009840 comp rx=0 tx=0).stop 2023-10-06T03:00:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.945+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 shutdown_connections 2023-10-06T03:00:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.945+0000 7f05326b9700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0510066f30 0x7f05100693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.945+0000 7f05326b9700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c15b6a0 0x7f052c150800 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.945+0000 7f05326b9700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052c157080 0x7f052c148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.945+0000 7f05326b9700 1 --2- 172.21.15.84:0/2409371886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052c157450 0x7f052c147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.945+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 >> 172.21.15.84:0/2409371886 conn(0x7f052c06b540 msgr2=0x7f052c0adaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.945+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 shutdown_connections 2023-10-06T03:00:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:39.945+0000 7f05326b9700 1 -- 172.21.15.84:0/2409371886 wait complete. 2023-10-06T03:00:39.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.071+0000 7fb1eb59e700 1 Processor -- start 2023-10-06T03:00:40.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.071+0000 7fb1eb59e700 1 -- start start 2023-10-06T03:00:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1eb59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb1ec159480 0x7fb1ec0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1eb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec0b2140 0x7fb1ec0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1eb59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec0cb7e0 con 0x7fb1ec0b3610 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1eb59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ec0b08a0 con 0x7fb1ec159480 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1eb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0cb190 con 0x7fb1ec0b2140 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1ead9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec0b2140 0x7fb1ec0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1ea59c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb1ec159480 0x7fb1ec0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1ead9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec0b2140 0x7fb1ec0b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:44108/0 (socket says 172.21.15.84:44108) 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1e9d9b700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb1ec0b3610 0x7fb1ec0cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:56630/0 (socket says 172.21.15.84:56630) 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.072+0000 7fb1ead9d700 1 -- 172.21.15.84:0/1180165428 learned_addr learned my addr 172.21.15.84:0/1180165428 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1ea59c700 1 -- 172.21.15.84:0/1180165428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec0b2140 msgr2=0x7fb1ec0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1ea59c700 1 --2- 172.21.15.84:0/1180165428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec0b2140 0x7fb1ec0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1ea59c700 1 -- 172.21.15.84:0/1180165428 >> v1:172.21.15.131:6789/0 conn(0x7fb1ec0b3610 legacy=0x7fb1ec0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1ea59c700 1 -- 172.21.15.84:0/1180165428 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec0cb470 con 0x7fb1ec159480 2023-10-06T03:00:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1e959a700 1 -- 172.21.15.84:0/1180165428 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295943004 0 0) 0x7fb1ec0cb7e0 con 0x7fb1ec0b3610 2023-10-06T03:00:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1ead9d700 1 --2- 172.21.15.84:0/1180165428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec0b2140 0x7fb1ec0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1ea59c700 1 --2- 172.21.15.84:0/1180165428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ec159480 0x7fb1ec0b30d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009e60 tx=0x7fb1e4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4daf16510d093cb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1e959a700 1 -- 172.21.15.84:0/1180165428 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e400e070 con 0x7fb1ec159480 2023-10-06T03:00:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1e959a700 1 -- 172.21.15.84:0/1180165428 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e400bb60 con 0x7fb1ec159480 2023-10-06T03:00:40.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1e959a700 1 -- 172.21.15.84:0/1180165428 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4012430 con 0x7fb1ec159480 2023-10-06T03:00:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1eb59e700 1 -- 172.21.15.84:0/1180165428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ec159480 msgr2=0x7fb1ec0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.073+0000 7fb1eb59e700 1 --2- 172.21.15.84:0/1180165428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ec159480 0x7fb1ec0b30d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009e60 tx=0x7fb1e4009780 comp rx=0 tx=0).stop 2023-10-06T03:00:40.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.074+0000 7fb1eb59e700 1 -- 172.21.15.84:0/1180165428 shutdown_connections 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.074+0000 7fb1eb59e700 1 --2- 172.21.15.84:0/1180165428 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec0b2140 0x7fb1ec0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.074+0000 7fb1eb59e700 1 --2- 172.21.15.84:0/1180165428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ec159480 0x7fb1ec0b30d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.074+0000 7fb1eb59e700 1 -- 172.21.15.84:0/1180165428 >> 172.21.15.84:0/1180165428 conn(0x7fb1ec06ed20 msgr2=0x7fb1ec06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.074+0000 7fb1eb59e700 1 -- 172.21.15.84:0/1180165428 shutdown_connections 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.074+0000 7fb1eb59e700 1 -- 172.21.15.84:0/1180165428 wait complete. 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.075+0000 7fb1eb59e700 1 Processor -- start 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.075+0000 7fb1eb59e700 1 -- start start 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.075+0000 7fb1eb59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ec0b2140 0x7fb1ec14a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.075+0000 7fb1eb59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ec0b3610 0x7fb1ec0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.075+0000 7fb1eb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec159480 0x7fb1ec0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.075+0000 7fb1eb59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0c3f70 con 0x7fb1ec0b3610 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.075+0000 7fb1eb59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0c5cc0 con 0x7fb1ec0b2140 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.075+0000 7fb1eb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec15c7b0 con 0x7fb1ec159480 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.075+0000 7fb1e9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ec0b3610 0x7fb1ec0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ec0b3610 0x7fb1ec0c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46134/0 (socket says 172.21.15.84:46134) 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e9d9b700 1 -- 172.21.15.84:0/2053356529 learned_addr learned my addr 172.21.15.84:0/2053356529 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1ea59c700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ec0b2140 0x7fb1ec14a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1ead9d700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec159480 0x7fb1ec0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e9d9b700 1 -- 172.21.15.84:0/2053356529 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec159480 msgr2=0x7fb1ec0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e9d9b700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec159480 0x7fb1ec0c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e9d9b700 1 -- 172.21.15.84:0/2053356529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ec0b2140 msgr2=0x7fb1ec14a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e9d9b700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ec0b2140 0x7fb1ec14a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e9d9b700 1 -- 172.21.15.84:0/2053356529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc0094f0 con 0x7fb1ec0b3610 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1ead9d700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec159480 0x7fb1ec0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e9d9b700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ec0b3610 0x7fb1ec0c82e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40011e0 tx=0x7fb1d4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e27fc700 1 -- 172.21.15.84:0/2053356529 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4005a70 con 0x7fb1ec0b3610 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e27fc700 1 -- 172.21.15.84:0/2053356529 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d4005bd0 con 0x7fb1ec0b3610 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1e27fc700 1 -- 172.21.15.84:0/2053356529 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40070d0 con 0x7fb1ec0b3610 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e4009a20 con 0x7fb1ec0b3610 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.076+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec14ac10 con 0x7fb1ec0b3610 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.077+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec0c5e70 con 0x7fb1ec0b3610 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.078+0000 7fb1e27fc700 1 -- 172.21.15.84:0/2053356529 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1d4007480 con 0x7fb1ec0b3610 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.078+0000 7fb1e27fc700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1cc066f30 0x7fb1cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.078+0000 7fb1e27fc700 1 -- 172.21.15.84:0/2053356529 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb1d4083c30 con 0x7fb1ec0b3610 2023-10-06T03:00:40.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.078+0000 7fb1ea59c700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1cc066f30 0x7fb1cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.078+0000 7fb1ea59c700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1cc066f30 0x7fb1cc0693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097c0 tx=0x7fb1e4019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:40.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.082+0000 7fb1e27fc700 1 -- 172.21.15.84:0/2053356529 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1d404b5a0 con 0x7fb1ec0b3610 2023-10-06T03:00:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.264+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1ec0b2ae0 con 0x7fb1ec0b3610 2023-10-06T03:00:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.265+0000 7fb1e27fc700 1 -- 172.21.15.84:0/2053356529 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17087 (secure 0 0 0) 0x7fb1d4017020 con 0x7fb1ec0b3610 2023-10-06T03:00:40.266 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:40.266 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:00:38.983160+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:36.627631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:37.942934+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.266+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1cc066f30 msgr2=0x7fb1cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.266+0000 7fb1eb59e700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1cc066f30 0x7fb1cc0693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097c0 tx=0x7fb1e4019000 comp rx=0 tx=0).stop 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ec0b3610 msgr2=0x7fb1ec0c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ec0b3610 0x7fb1ec0c82e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40011e0 tx=0x7fb1d4007e10 comp rx=0 tx=0).stop 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 shutdown_connections 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb1cc066f30 0x7fb1cc0693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ec0b2140 0x7fb1ec14a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ec159480 0x7fb1ec0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 --2- 172.21.15.84:0/2053356529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1ec0b3610 0x7fb1ec0c82e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 >> 172.21.15.84:0/2053356529 conn(0x7fb1ec06ed20 msgr2=0x7fb1ec155710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 shutdown_connections 2023-10-06T03:00:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.267+0000 7fb1eb59e700 1 -- 172.21.15.84:0/2053356529 wait complete. 2023-10-06T03:00:40.280 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:00:40.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.396+0000 7f948581a700 1 Processor -- start 2023-10-06T03:00:40.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.397+0000 7f948581a700 1 -- start start 2023-10-06T03:00:40.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.397+0000 7f948581a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94801598e0 0x7f94800ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.397+0000 7f948581a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 0x7f94800ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.397+0000 7f948581a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94800cf610 con 0x7f9480159510 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.397+0000 7f948581a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94800cf8f0 con 0x7f94801598e0 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.397+0000 7f948581a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94800cfbd0 con 0x7f94800cbcb0 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.397+0000 7f94767fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94801598e0 0x7f94800ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.397+0000 7f94767fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94801598e0 0x7f94800ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46142/0 (socket says 172.21.15.84:46142) 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.397+0000 7f94767fc700 1 -- 172.21.15.84:0/1068466442 learned_addr learned my addr 172.21.15.84:0/1068466442 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.398+0000 7f947f7fe700 1 --2- 172.21.15.84:0/1068466442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 0x7f94800ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.398+0000 7f94767fc700 1 -- 172.21.15.84:0/1068466442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 msgr2=0x7f94800ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.398+0000 7f94767fc700 1 --2- 172.21.15.84:0/1068466442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 0x7f94800ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.398+0000 7f94767fc700 1 -- 172.21.15.84:0/1068466442 >> v1:172.21.15.131:6789/0 conn(0x7f9480159510 legacy=0x7f94800cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.398+0000 7f94767fc700 1 -- 172.21.15.84:0/1068466442 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800cfeb0 con 0x7f94801598e0 2023-10-06T03:00:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.398+0000 7f94767fc700 1 --2- 172.21.15.84:0/1068466442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94801598e0 0x7f94800ce820 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f94680099b0 tx=0x7f9468009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f983766865eb89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.398+0000 7f947e7fc700 1 -- 172.21.15.84:0/1068466442 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946800b860 con 0x7f94801598e0 2023-10-06T03:00:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.398+0000 7f947e7fc700 1 -- 172.21.15.84:0/1068466442 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946800b9c0 con 0x7f94801598e0 2023-10-06T03:00:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.398+0000 7f947e7fc700 1 -- 172.21.15.84:0/1068466442 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946800bd60 con 0x7f94801598e0 2023-10-06T03:00:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.399+0000 7f948581a700 1 -- 172.21.15.84:0/1068466442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94801598e0 msgr2=0x7f94800ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.399+0000 7f948581a700 1 --2- 172.21.15.84:0/1068466442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94801598e0 0x7f94800ce820 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f94680099b0 tx=0x7f9468009250 comp rx=0 tx=0).stop 2023-10-06T03:00:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.399+0000 7f948581a700 1 -- 172.21.15.84:0/1068466442 shutdown_connections 2023-10-06T03:00:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.399+0000 7f948581a700 1 --2- 172.21.15.84:0/1068466442 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 0x7f94800ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.399+0000 7f948581a700 1 --2- 172.21.15.84:0/1068466442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94801598e0 0x7f94800ce820 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.399+0000 7f948581a700 1 -- 172.21.15.84:0/1068466442 >> 172.21.15.84:0/1068466442 conn(0x7f9480089e90 msgr2=0x7f94800997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.399+0000 7f948581a700 1 -- 172.21.15.84:0/1068466442 shutdown_connections 2023-10-06T03:00:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.399+0000 7f948581a700 1 -- 172.21.15.84:0/1068466442 wait complete. 2023-10-06T03:00:40.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.400+0000 7f948581a700 1 Processor -- start 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.400+0000 7f948581a700 1 -- start start 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f948581a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 0x7f948015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f948581a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9480159510 0x7f94800c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f948581a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94801598e0 0x7f94800c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f948581a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94800c9850 con 0x7f9480159510 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f948581a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948016b570 con 0x7f94801598e0 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f948581a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948016af50 con 0x7f94800cbcb0 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94767fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9480159510 0x7f94800c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94767fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9480159510 0x7f94800c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46158/0 (socket says 172.21.15.84:46158) 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94767fc700 1 -- 172.21.15.84:0/824556790 learned_addr learned my addr 172.21.15.84:0/824556790 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f947f7fe700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94801598e0 0x7f94800c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f947effd700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 0x7f948015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94767fc700 1 -- 172.21.15.84:0/824556790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 msgr2=0x7f948015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94767fc700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 0x7f948015bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94767fc700 1 -- 172.21.15.84:0/824556790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94801598e0 msgr2=0x7f94800c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94767fc700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94801598e0 0x7f94800c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94767fc700 1 -- 172.21.15.84:0/824556790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680094f0 con 0x7f9480159510 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f947f7fe700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94801598e0 0x7f94800c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94767fc700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9480159510 0x7f94800c7600 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f94680099b0 tx=0x7f9468017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94777fe700 1 -- 172.21.15.84:0/824556790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468024440 con 0x7f9480159510 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94777fe700 1 -- 172.21.15.84:0/824556790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94680245a0 con 0x7f9480159510 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f94777fe700 1 -- 172.21.15.84:0/824556790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468024940 con 0x7f9480159510 2023-10-06T03:00:40.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948016b810 con 0x7f9480159510 2023-10-06T03:00:40.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.401+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948016b230 con 0x7f9480159510 2023-10-06T03:00:40.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.402+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94800d1450 con 0x7f9480159510 2023-10-06T03:00:40.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.403+0000 7f94777fe700 1 -- 172.21.15.84:0/824556790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f946801a420 con 0x7f9480159510 2023-10-06T03:00:40.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.403+0000 7f94777fe700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9460066f30 0x7f94600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:40.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.403+0000 7f94777fe700 1 -- 172.21.15.84:0/824556790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9468086630 con 0x7f9480159510 2023-10-06T03:00:40.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.403+0000 7f947effd700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9460066f30 0x7f94600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:40.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.403+0000 7f947effd700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9460066f30 0x7f94600693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9470001780 tx=0x7f9470009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:40.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.407+0000 7f94777fe700 1 -- 172.21.15.84:0/824556790 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9468053600 con 0x7f9480159510 2023-10-06T03:00:40.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:40.635+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f948006a240 con 0x7f9480159510 2023-10-06T03:00:41.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.623+0000 7f94777fe700 1 -- 172.21.15.84:0/824556790 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9468056c20 con 0x7f9480159510 2023-10-06T03:00:41.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9460066f30 msgr2=0x7f94600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:41.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9460066f30 0x7f94600693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9470001780 tx=0x7f9470009040 comp rx=0 tx=0).stop 2023-10-06T03:00:41.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9480159510 msgr2=0x7f94800c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:41.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9480159510 0x7f94800c7600 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f94680099b0 tx=0x7f9468017000 comp rx=0 tx=0).stop 2023-10-06T03:00:41.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 shutdown_connections 2023-10-06T03:00:41.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9460066f30 0x7f94600693e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:41.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94801598e0 0x7f94800c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:41.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f94800cbcb0 0x7f948015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:41.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 --2- 172.21.15.84:0/824556790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9480159510 0x7f94800c7600 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:41.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 >> 172.21.15.84:0/824556790 conn(0x7f9480089e90 msgr2=0x7f94800683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:41.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 shutdown_connections 2023-10-06T03:00:41.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.626+0000 7f948581a700 1 -- 172.21.15.84:0/824556790 wait complete. 2023-10-06T03:00:41.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:00:41.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.764+0000 7fbeab5da700 1 Processor -- start 2023-10-06T03:00:41.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.764+0000 7fbeab5da700 1 -- start start 2023-10-06T03:00:41.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.765+0000 7fbeab5da700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40b0680 0x7fbea40ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:41.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.765+0000 7fbeab5da700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbea40cc630 0x7fbea40c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:41.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.765+0000 7fbeab5da700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea40ccad0 con 0x7fbea40b0a50 2023-10-06T03:00:41.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.765+0000 7fbeab5da700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea40ca7d0 con 0x7fbea40cc630 2023-10-06T03:00:41.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.765+0000 7fbeab5da700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea40c5400 con 0x7fbea40b0680 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.765+0000 7fbea9b77700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbea40cc630 0x7fbea40c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.765+0000 7fbea9b77700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbea40cc630 0x7fbea40c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46160/0 (socket says 172.21.15.84:46160) 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.765+0000 7fbea8b75700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbea40b0a50 0x7fbea40cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55390/0 (socket says 172.21.15.84:55390) 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.765+0000 7fbea9b77700 1 -- 172.21.15.84:0/2610129717 learned_addr learned my addr 172.21.15.84:0/2610129717 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbea9b77700 1 -- 172.21.15.84:0/2610129717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40b0680 msgr2=0x7fbea40ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbea9376700 1 --2- 172.21.15.84:0/2610129717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40b0680 0x7fbea40ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbea9b77700 1 --2- 172.21.15.84:0/2610129717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40b0680 0x7fbea40ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbe9bfff700 1 -- 172.21.15.84:0/2610129717 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851309925 0 0) 0x7fbea40ccad0 con 0x7fbea40b0a50 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbea9b77700 1 -- 172.21.15.84:0/2610129717 >> v1:172.21.15.84:6789/0 conn(0x7fbea40b0a50 legacy=0x7fbea40cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbea9b77700 1 -- 172.21.15.84:0/2610129717 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea40ccd40 con 0x7fbea40cc630 2023-10-06T03:00:41.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbea9b77700 1 --2- 172.21.15.84:0/2610129717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40cc630 0x7fbea40c9090 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009f20 tx=0x7fbe9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a882dabbadfa61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbe9bfff700 1 -- 172.21.15.84:0/2610129717 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00e070 con 0x7fbea40cc630 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbe9bfff700 1 -- 172.21.15.84:0/2610129717 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00ba80 con 0x7fbea40cc630 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbe9bfff700 1 -- 172.21.15.84:0/2610129717 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c0092e0 con 0x7fbea40cc630 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbeab5da700 1 -- 172.21.15.84:0/2610129717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40cc630 msgr2=0x7fbea40c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbeab5da700 1 --2- 172.21.15.84:0/2610129717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40cc630 0x7fbea40c9090 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009f20 tx=0x7fbe9c009840 comp rx=0 tx=0).stop 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbeab5da700 1 -- 172.21.15.84:0/2610129717 shutdown_connections 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbeab5da700 1 --2- 172.21.15.84:0/2610129717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40cc630 0x7fbea40c9090 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbeab5da700 1 --2- 172.21.15.84:0/2610129717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40b0680 0x7fbea40ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.766+0000 7fbeab5da700 1 -- 172.21.15.84:0/2610129717 >> 172.21.15.84:0/2610129717 conn(0x7fbea4088000 msgr2=0x7fbea40ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.767+0000 7fbeab5da700 1 -- 172.21.15.84:0/2610129717 shutdown_connections 2023-10-06T03:00:41.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.767+0000 7fbeab5da700 1 -- 172.21.15.84:0/2610129717 wait complete. 2023-10-06T03:00:41.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.768+0000 7fbeab5da700 1 Processor -- start 2023-10-06T03:00:41.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.768+0000 7fbeab5da700 1 -- start start 2023-10-06T03:00:41.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.768+0000 7fbeab5da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40b0680 0x7fbea416ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:41.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.768+0000 7fbeab5da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbea40b0a50 0x7fbea4159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.768+0000 7fbeab5da700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40cc630 0x7fbea40af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.768+0000 7fbeab5da700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea406a720 con 0x7fbea40b0680 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.768+0000 7fbeab5da700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea416d3a0 con 0x7fbea40b0a50 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.768+0000 7fbeab5da700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea406a290 con 0x7fbea40cc630 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9376700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40b0680 0x7fbea416ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9376700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40b0680 0x7fbea416ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46176/0 (socket says 172.21.15.84:46176) 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9376700 1 -- 172.21.15.84:0/538983969 learned_addr learned my addr 172.21.15.84:0/538983969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9b77700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40cc630 0x7fbea40af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea8b75700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbea40b0a50 0x7fbea4159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9376700 1 -- 172.21.15.84:0/538983969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40cc630 msgr2=0x7fbea40af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:41.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9376700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40cc630 0x7fbea40af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9376700 1 -- 172.21.15.84:0/538983969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbea40b0a50 msgr2=0x7fbea4159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9376700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbea40b0a50 0x7fbea4159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9376700 1 -- 172.21.15.84:0/538983969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c009ae0 con 0x7fbea40b0680 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbea9376700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40b0680 0x7fbea416ce60 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c8b0 tx=0x7fbea0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbe997fa700 1 -- 172.21.15.84:0/538983969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0011600 con 0x7fbea40b0680 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbe997fa700 1 -- 172.21.15.84:0/538983969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea0011760 con 0x7fbea40b0680 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea415a4c0 con 0x7fbea40b0680 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbe997fa700 1 -- 172.21.15.84:0/538983969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0011b00 con 0x7fbea40b0680 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.769+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea4069c40 con 0x7fbea40b0680 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.770+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea4064ad0 con 0x7fbea40b0680 2023-10-06T03:00:41.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.771+0000 7fbe997fa700 1 -- 172.21.15.84:0/538983969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbea0018360 con 0x7fbea40b0680 2023-10-06T03:00:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.771+0000 7fbe997fa700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe88066f30 0x7fbe880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.771+0000 7fbe997fa700 1 -- 172.21.15.84:0/538983969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbea00844d0 con 0x7fbea40b0680 2023-10-06T03:00:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.771+0000 7fbea8b75700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe88066f30 0x7fbe880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.771+0000 7fbea8b75700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe88066f30 0x7fbe880693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbe94007fd0 tx=0x7fbe94007db0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:41.775+0000 7fbe997fa700 1 -- 172.21.15.84:0/538983969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbea0054f30 con 0x7fbea40b0680 2023-10-06T03:00:42.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.004+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbea40cd020 con 0x7fbea40b0680 2023-10-06T03:00:42.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.624+0000 7fbe997fa700 1 -- 172.21.15.84:0/538983969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbea0054ac0 con 0x7fbea40b0680 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe88066f30 msgr2=0x7fbe880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe88066f30 0x7fbe880693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbe94007fd0 tx=0x7fbe94007db0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40b0680 msgr2=0x7fbea416ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40b0680 0x7fbea416ce60 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fbea000c8b0 tx=0x7fbea0008040 comp rx=0 tx=0).stop 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 shutdown_connections 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbe88066f30 0x7fbe880693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbea40cc630 0x7fbea40af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbea40b0680 0x7fbea416ce60 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 --2- 172.21.15.84:0/538983969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbea40b0a50 0x7fbea4159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 >> 172.21.15.84:0/538983969 conn(0x7fbea4088000 msgr2=0x7fbea406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:42.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 shutdown_connections 2023-10-06T03:00:42.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.627+0000 7fbeab5da700 1 -- 172.21.15.84:0/538983969 wait complete. 2023-10-06T03:00:42.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:42.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.754+0000 7f75d1f77700 1 Processor -- start 2023-10-06T03:00:42.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.754+0000 7f75d1f77700 1 -- start start 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75d1f77700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75cc1595a0 0x7f75cc0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75d1f77700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f75cc0b07a0 0x7f75cc0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75d1f77700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0b0ca0 con 0x7f75cc0b49e0 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75d1f77700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0b0f80 con 0x7f75cc1595a0 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75d1f77700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0b1260 con 0x7f75cc0b07a0 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75cb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75cc1595a0 0x7f75cc0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75caffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f75cc0b49e0 0x7f75cc0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52314/0 (socket says 172.21.15.84:52314) 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75caffd700 1 -- 172.21.15.84:0/2911923206 learned_addr learned my addr 172.21.15.84:0/2911923206 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75cb7fe700 1 --2- 172.21.15.84:0/2911923206 >> v2:172.21.15.84:3300/0 conn(0x7f75cc1595a0 0x7f75cc0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41492/0 (socket says 172.21.15.84:41492) 2023-10-06T03:00:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75cb7fe700 1 -- 172.21.15.84:0/2911923206 >> v2:172.21.15.131:3300/0 conn(0x7f75cc0b07a0 msgr2=0x7f75cc0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.755+0000 7f75cbfff700 1 --2- 172.21.15.84:0/2911923206 >> v2:172.21.15.131:3300/0 conn(0x7f75cc0b07a0 0x7f75cc0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75cb7fe700 1 --2- 172.21.15.84:0/2911923206 >> v2:172.21.15.131:3300/0 conn(0x7f75cc0b07a0 0x7f75cc0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75cb7fe700 1 -- 172.21.15.84:0/2911923206 >> v1:172.21.15.84:6789/0 conn(0x7f75cc0b49e0 legacy=0x7f75cc0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75ca7fc700 1 -- 172.21.15.84:0/2911923206 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315053659 0 0) 0x7f75cc0b0ca0 con 0x7f75cc0b49e0 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75cb7fe700 1 -- 172.21.15.84:0/2911923206 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0b1540 con 0x7f75cc1595a0 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75cbfff700 1 --2- 172.21.15.84:0/2911923206 >> v2:172.21.15.131:3300/0 conn(0x7f75cc0b07a0 0x7f75cc0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75cb7fe700 1 --2- 172.21.15.84:0/2911923206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc1595a0 0x7f75cc0aa570 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0098d0 tx=0x7f75bc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2fd5638a064ae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75ca7fc700 1 -- 172.21.15.84:0/2911923206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc009e70 con 0x7f75cc1595a0 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75ca7fc700 1 -- 172.21.15.84:0/2911923206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc005c10 con 0x7f75cc1595a0 2023-10-06T03:00:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75ca7fc700 1 -- 172.21.15.84:0/2911923206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00b610 con 0x7f75cc1595a0 2023-10-06T03:00:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75d1f77700 1 -- 172.21.15.84:0/2911923206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc1595a0 msgr2=0x7f75cc0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75d1f77700 1 --2- 172.21.15.84:0/2911923206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc1595a0 0x7f75cc0aa570 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0098d0 tx=0x7f75bc009120 comp rx=0 tx=0).stop 2023-10-06T03:00:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75d1f77700 1 -- 172.21.15.84:0/2911923206 shutdown_connections 2023-10-06T03:00:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75d1f77700 1 --2- 172.21.15.84:0/2911923206 >> v2:172.21.15.131:3300/0 conn(0x7f75cc0b07a0 0x7f75cc0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75d1f77700 1 --2- 172.21.15.84:0/2911923206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc1595a0 0x7f75cc0aa570 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75d1f77700 1 -- 172.21.15.84:0/2911923206 >> 172.21.15.84:0/2911923206 conn(0x7f75cc099830 msgr2=0x7f75cc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75d1f77700 1 -- 172.21.15.84:0/2911923206 shutdown_connections 2023-10-06T03:00:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.756+0000 7f75d1f77700 1 -- 172.21.15.84:0/2911923206 wait complete. 2023-10-06T03:00:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.758+0000 7f75d1f77700 1 Processor -- start 2023-10-06T03:00:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.758+0000 7f75d1f77700 1 -- start start 2023-10-06T03:00:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.758+0000 7f75d1f77700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75cc0b07a0 0x7f75cc15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.758+0000 7f75d1f77700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0b49e0 0x7f75cc15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.758+0000 7f75d1f77700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75cc1595a0 0x7f75cc158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.758+0000 7f75d1f77700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc15baf0 con 0x7f75cc0b49e0 2023-10-06T03:00:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.758+0000 7f75d1f77700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc15a940 con 0x7f75cc1595a0 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.758+0000 7f75d1f77700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc15ac20 con 0x7f75cc0b07a0 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.758+0000 7f75caffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0b49e0 0x7f75cc15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75caffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0b49e0 0x7f75cc15cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41500/0 (socket says 172.21.15.84:41500) 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75caffd700 1 -- 172.21.15.84:0/2072677281 learned_addr learned my addr 172.21.15.84:0/2072677281 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75caffd700 1 -- 172.21.15.84:0/2072677281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75cc0b07a0 msgr2=0x7f75cc15a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75caffd700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75cc0b07a0 0x7f75cc15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75caffd700 1 -- 172.21.15.84:0/2072677281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75cc1595a0 msgr2=0x7f75cc158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75cbfff700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75cc1595a0 0x7f75cc158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75caffd700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75cc1595a0 0x7f75cc158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75caffd700 1 -- 172.21.15.84:0/2072677281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0093c0 con 0x7f75cc0b49e0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75cbfff700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75cc1595a0 0x7f75cc158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75caffd700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0b49e0 0x7f75cc15cd60 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c7e0 tx=0x7f75c0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75b37fe700 1 -- 172.21.15.84:0/2072677281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0005c00 con 0x7f75cc0b49e0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75b37fe700 1 -- 172.21.15.84:0/2072677281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0005d60 con 0x7f75cc0b49e0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc15af00 con 0x7f75cc0b49e0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75b37fe700 1 -- 172.21.15.84:0/2072677281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c00072e0 con 0x7f75cc0b49e0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.759+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc158d80 con 0x7f75cc0b49e0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.760+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc064ad0 con 0x7f75cc0b49e0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.760+0000 7f75b37fe700 1 -- 172.21.15.84:0/2072677281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75c001b3b0 con 0x7f75cc0b49e0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.761+0000 7f75b37fe700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75b8066f30 0x7f75b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.761+0000 7f75b37fe700 1 -- 172.21.15.84:0/2072677281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f75c0083c20 con 0x7f75cc0b49e0 2023-10-06T03:00:42.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.761+0000 7f75cb7fe700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75b8066f30 0x7f75b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.761+0000 7f75cb7fe700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75b8066f30 0x7f75b80693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0098d0 tx=0x7f75bc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:42.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.765+0000 7f75b37fe700 1 -- 172.21.15.84:0/2072677281 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75c004b5a0 con 0x7f75cc0b49e0 2023-10-06T03:00:42.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.988+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75cc0b1820 con 0x7f75cc0b49e0 2023-10-06T03:00:42.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.989+0000 7f75b37fe700 1 -- 172.21.15.84:0/2072677281 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f75c0017090 con 0x7f75cc0b49e0 2023-10-06T03:00:42.991 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:42.991 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6799,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:00:42.623396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:00:42.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75b8066f30 msgr2=0x7f75b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75b8066f30 0x7f75b80693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0098d0 tx=0x7f75bc016000 comp rx=0 tx=0).stop 2023-10-06T03:00:42.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0b49e0 msgr2=0x7f75cc15cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0b49e0 0x7f75cc15cd60 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c7e0 tx=0x7f75c0007d90 comp rx=0 tx=0).stop 2023-10-06T03:00:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 shutdown_connections 2023-10-06T03:00:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75b8066f30 0x7f75b80693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75cc1595a0 0x7f75cc158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75cc0b07a0 0x7f75cc15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 --2- 172.21.15.84:0/2072677281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75cc0b49e0 0x7f75cc15cd60 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 >> 172.21.15.84:0/2072677281 conn(0x7f75cc099830 msgr2=0x7f75cc0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:42.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 shutdown_connections 2023-10-06T03:00:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:42.991+0000 7f75d1f77700 1 -- 172.21.15.84:0/2072677281 wait complete. 2023-10-06T03:00:42.995 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 84 2023-10-06T03:00:43.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:43.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.118+0000 7f1692df6700 1 Processor -- start 2023-10-06T03:00:43.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.118+0000 7f1692df6700 1 -- start start 2023-10-06T03:00:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1692df6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f168c1595a0 0x7f168c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1692df6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f168c0b07a0 0x7f168c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1692df6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0b0ca0 con 0x7f168c0b49e0 2023-10-06T03:00:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1692df6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0b0f80 con 0x7f168c1595a0 2023-10-06T03:00:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1692df6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0b1260 con 0x7f168c0b07a0 2023-10-06T03:00:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1690b92700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f168c1595a0 0x7f168c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f168bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f168c0b49e0 0x7f168c0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52320/0 (socket says 172.21.15.84:52320) 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f168bfff700 1 -- 172.21.15.84:0/2012765554 learned_addr learned my addr 172.21.15.84:0/2012765554 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1691393700 1 --2- 172.21.15.84:0/2012765554 >> v2:172.21.15.131:3300/0 conn(0x7f168c0b07a0 0x7f168c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f168b7fe700 1 -- 172.21.15.84:0/2012765554 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027873491 0 0) 0x7f168c0b0ca0 con 0x7f168c0b49e0 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f168b7fe700 1 -- 172.21.15.84:0/2012765554 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1674003570 con 0x7f168c0b49e0 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1690b92700 1 -- 172.21.15.84:0/2012765554 >> v2:172.21.15.131:3300/0 conn(0x7f168c0b07a0 msgr2=0x7f168c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1690b92700 1 --2- 172.21.15.84:0/2012765554 >> v2:172.21.15.131:3300/0 conn(0x7f168c0b07a0 0x7f168c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1690b92700 1 -- 172.21.15.84:0/2012765554 >> v1:172.21.15.84:6789/0 conn(0x7f168c0b49e0 legacy=0x7f168c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1690b92700 1 -- 172.21.15.84:0/2012765554 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0b1540 con 0x7f168c1595a0 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f1690b92700 1 --2- 172.21.15.84:0/2012765554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c1595a0 0x7f168c0aa570 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f167c009eb0 tx=0x7f167c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a56156b89e0f64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.119+0000 7f168b7fe700 1 -- 172.21.15.84:0/2012765554 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c00e070 con 0x7f168c1595a0 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f168b7fe700 1 -- 172.21.15.84:0/2012765554 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c00bbf0 con 0x7f168c1595a0 2023-10-06T03:00:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f168b7fe700 1 -- 172.21.15.84:0/2012765554 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c012430 con 0x7f168c1595a0 2023-10-06T03:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f1692df6700 1 -- 172.21.15.84:0/2012765554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c1595a0 msgr2=0x7f168c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f1692df6700 1 --2- 172.21.15.84:0/2012765554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c1595a0 0x7f168c0aa570 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f167c009eb0 tx=0x7f167c009780 comp rx=0 tx=0).stop 2023-10-06T03:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f1692df6700 1 -- 172.21.15.84:0/2012765554 shutdown_connections 2023-10-06T03:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f1692df6700 1 --2- 172.21.15.84:0/2012765554 >> v2:172.21.15.131:3300/0 conn(0x7f168c0b07a0 0x7f168c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f1692df6700 1 --2- 172.21.15.84:0/2012765554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c1595a0 0x7f168c0aa570 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f1692df6700 1 -- 172.21.15.84:0/2012765554 >> 172.21.15.84:0/2012765554 conn(0x7f168c099830 msgr2=0x7f168c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f1692df6700 1 -- 172.21.15.84:0/2012765554 shutdown_connections 2023-10-06T03:00:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.120+0000 7f1692df6700 1 -- 172.21.15.84:0/2012765554 wait complete. 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.121+0000 7f1692df6700 1 Processor -- start 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.121+0000 7f1692df6700 1 -- start start 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f1692df6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f168c0b07a0 0x7f168c158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f1692df6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c0b49e0 0x7f168c159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f1692df6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f168c1595a0 0x7f168c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f1692df6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c15b0f0 con 0x7f168c0b49e0 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f1692df6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c09a350 con 0x7f168c1595a0 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f1692df6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c15a4e0 con 0x7f168c0b07a0 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f168bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c0b49e0 0x7f168c159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f168bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c0b49e0 0x7f168c159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41514/0 (socket says 172.21.15.84:41514) 2023-10-06T03:00:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f168bfff700 1 -- 172.21.15.84:0/3482307958 learned_addr learned my addr 172.21.15.84:0/3482307958 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f168bfff700 1 -- 172.21.15.84:0/3482307958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f168c0b07a0 msgr2=0x7f168c158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f168bfff700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f168c0b07a0 0x7f168c158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f168bfff700 1 -- 172.21.15.84:0/3482307958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f168c1595a0 msgr2=0x7f168c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f168bfff700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f168c1595a0 0x7f168c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.122+0000 7f168bfff700 1 -- 172.21.15.84:0/3482307958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c009a20 con 0x7f168c0b49e0 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.123+0000 7f168bfff700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c0b49e0 0x7f168c159970 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f168000c790 tx=0x7f1680007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.123+0000 7f1688ff9700 1 -- 172.21.15.84:0/3482307958 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1680005c00 con 0x7f168c0b49e0 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.123+0000 7f1688ff9700 1 -- 172.21.15.84:0/3482307958 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1680005d60 con 0x7f168c0b49e0 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.123+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c15a7c0 con 0x7f168c0b49e0 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.123+0000 7f1688ff9700 1 -- 172.21.15.84:0/3482307958 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16800072e0 con 0x7f168c0b49e0 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.123+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c15ad80 con 0x7f168c0b49e0 2023-10-06T03:00:43.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.124+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c064ad0 con 0x7f168c0b49e0 2023-10-06T03:00:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.124+0000 7f1688ff9700 1 -- 172.21.15.84:0/3482307958 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f168001b3b0 con 0x7f168c0b49e0 2023-10-06T03:00:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.124+0000 7f1688ff9700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1678066f30 0x7f16780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.125+0000 7f1690b92700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1678066f30 0x7f16780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.125+0000 7f1688ff9700 1 -- 172.21.15.84:0/3482307958 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1680083bd0 con 0x7f168c0b49e0 2023-10-06T03:00:43.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.125+0000 7f1690b92700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1678066f30 0x7f16780693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f167c003440 tx=0x7f167c019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:43.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.129+0000 7f1688ff9700 1 -- 172.21.15.84:0/3482307958 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f168004b5a0 con 0x7f168c0b49e0 2023-10-06T03:00:43.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.312+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f168c15b230 con 0x7f168c0b49e0 2023-10-06T03:00:43.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.313+0000 7f1688ff9700 1 -- 172.21.15.84:0/3482307958 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f1680017020 con 0x7f168c0b49e0 2023-10-06T03:00:43.314 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:43.314 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":94,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:00:40.595235+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:36.627631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:37.942934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:43.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.314+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1678066f30 msgr2=0x7f16780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.314+0000 7f1692df6700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1678066f30 0x7f16780693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f167c003440 tx=0x7f167c019000 comp rx=0 tx=0).stop 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.314+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c0b49e0 msgr2=0x7f168c159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.314+0000 7f1692df6700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c0b49e0 0x7f168c159970 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f168000c790 tx=0x7f1680007db0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.315+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 shutdown_connections 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.315+0000 7f1692df6700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1678066f30 0x7f16780693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.315+0000 7f1692df6700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f168c1595a0 0x7f168c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.315+0000 7f1692df6700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f168c0b07a0 0x7f168c158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.315+0000 7f1692df6700 1 --2- 172.21.15.84:0/3482307958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f168c0b49e0 0x7f168c159970 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.315+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 >> 172.21.15.84:0/3482307958 conn(0x7f168c099830 msgr2=0x7f168c0b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.315+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 shutdown_connections 2023-10-06T03:00:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.315+0000 7f1692df6700 1 -- 172.21.15.84:0/3482307958 wait complete. 2023-10-06T03:00:43.328 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:00:43.329 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:00:43.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.441+0000 7f942b59e700 1 Processor -- start 2023-10-06T03:00:43.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.441+0000 7f942b59e700 1 -- start start 2023-10-06T03:00:43.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942b59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c0cbc70 0x7f942c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942b59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f942c0b2140 0x7f942c0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942b59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942c0cb7e0 con 0x7f942c159480 2023-10-06T03:00:43.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942b59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942c0b08a0 con 0x7f942c0b2140 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942b59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0cb190 con 0x7f942c0cbc70 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942a59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f942c159480 0x7f942c0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52322/0 (socket says 172.21.15.84:52322) 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942a59c700 1 -- 172.21.15.84:0/2962061921 learned_addr learned my addr 172.21.15.84:0/2962061921 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942ad9d700 1 --2- 172.21.15.84:0/2962061921 >> v2:172.21.15.131:3300/0 conn(0x7f942c0b2140 0x7f942c0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543264584 0 0) 0x7f942c0cb7e0 con 0x7f942c159480 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f9429d9b700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c0cbc70 0x7f942c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9414003570 con 0x7f942c159480 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3614151950 0 0) 0x7f9414003570 con 0x7f942c159480 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c0cbc70 msgr2=0x7f942c0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942959a700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c0cbc70 0x7f942c0cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 >> v2:172.21.15.131:3300/0 conn(0x7f942c0b2140 msgr2=0x7f942c0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942959a700 1 --2- 172.21.15.84:0/2962061921 >> v2:172.21.15.131:3300/0 conn(0x7f942c0b2140 0x7f942c0b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0cb470 con 0x7f942c159480 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.442+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f941c001470 con 0x7f942c159480 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 >> v1:172.21.15.84:6789/0 conn(0x7f942c159480 legacy=0x7f942c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9414003a60 0x7f9414003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c0cbc70 0x7f9414004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9414004d50 0x7f94140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0b08a0 con 0x7f9414004d50 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0cb190 con 0x7f9414003a60 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941400ba60 con 0x7f942c0cbc70 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942ad9d700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9414004d50 0x7f94140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942a59c700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9414003a60 0x7f9414003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f9429d9b700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c0cbc70 0x7f9414004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942ad9d700 1 -- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c0cbc70 msgr2=0x7f9414004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942ad9d700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c0cbc70 0x7f9414004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942ad9d700 1 -- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9414003a60 msgr2=0x7f9414003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942ad9d700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9414003a60 0x7f9414003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942ad9d700 1 -- 172.21.15.84:0/2962061921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414003570 con 0x7f9414004d50 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942ad9d700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9414004d50 0x7f94140051c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f942400e210 tx=0x7f942400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9039e47f50abaad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400ea60 con 0x7f9414004d50 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942400f040 con 0x7f9414004d50 2023-10-06T03:00:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.443+0000 7f942959a700 1 -- 172.21.15.84:0/2962061921 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400ee10 con 0x7f9414004d50 2023-10-06T03:00:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.444+0000 7f942b59e700 1 -- 172.21.15.84:0/2962061921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9414004d50 msgr2=0x7f94140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.444+0000 7f942b59e700 1 --2- 172.21.15.84:0/2962061921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9414004d50 0x7f94140051c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f942400e210 tx=0x7f942400b040 comp rx=0 tx=0).stop 2023-10-06T03:00:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.444+0000 7f942ad9d700 1 -- 172.21.15.84:0/2962061921 reap_dead start 2023-10-06T03:00:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.444+0000 7f942b59e700 1 -- 172.21.15.84:0/2962061921 shutdown_connections 2023-10-06T03:00:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.444+0000 7f942b59e700 1 -- 172.21.15.84:0/2962061921 >> 172.21.15.84:0/2962061921 conn(0x7f942c06ed20 msgr2=0x7f942c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.444+0000 7f942b59e700 1 -- 172.21.15.84:0/2962061921 shutdown_connections 2023-10-06T03:00:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.444+0000 7f942b59e700 1 -- 172.21.15.84:0/2962061921 wait complete. 2023-10-06T03:00:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.445+0000 7f942b59e700 1 Processor -- start 2023-10-06T03:00:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.445+0000 7f942b59e700 1 -- start start 2023-10-06T03:00:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942b59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9414004d50 0x7f942c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942b59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c15e1d0 0x7f942c0c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f942c0c9650 0x7f942c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942b59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0ca000 con 0x7f942c0c9650 2023-10-06T03:00:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942b59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0c8d30 con 0x7f9414004d50 2023-10-06T03:00:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942b59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942c169990 con 0x7f942c15e1d0 2023-10-06T03:00:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f942c0c9650 0x7f942c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f942c0c9650 0x7f942c0c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41536/0 (socket says 172.21.15.84:41536) 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942ad9d700 1 -- 172.21.15.84:0/2338950947 learned_addr learned my addr 172.21.15.84:0/2338950947 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f9429d9b700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c15e1d0 0x7f942c0c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942a59c700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9414004d50 0x7f942c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942ad9d700 1 -- 172.21.15.84:0/2338950947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c15e1d0 msgr2=0x7f942c0c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942ad9d700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c15e1d0 0x7f942c0c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942ad9d700 1 -- 172.21.15.84:0/2338950947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9414004d50 msgr2=0x7f942c0c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942ad9d700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9414004d50 0x7f942c0c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942ad9d700 1 -- 172.21.15.84:0/2338950947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0c8210 con 0x7f942c0c9650 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942ad9d700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f942c0c9650 0x7f942c0c9ac0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9424016000 tx=0x7f942401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f941a7fc700 1 -- 172.21.15.84:0/2338950947 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400eee0 con 0x7f942c0c9650 2023-10-06T03:00:43.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f941a7fc700 1 -- 172.21.15.84:0/2338950947 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942401d630 con 0x7f942c0c9650 2023-10-06T03:00:43.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942c0c8490 con 0x7f942c0c9650 2023-10-06T03:00:43.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f941a7fc700 1 -- 172.21.15.84:0/2338950947 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942401d9f0 con 0x7f942c0c9650 2023-10-06T03:00:43.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.446+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c0c8a50 con 0x7f942c0c9650 2023-10-06T03:00:43.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.447+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f942c05f270 con 0x7f942c0c9650 2023-10-06T03:00:43.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.448+0000 7f941a7fc700 1 -- 172.21.15.84:0/2338950947 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9424003040 con 0x7f942c0c9650 2023-10-06T03:00:43.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.448+0000 7f941a7fc700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f940c066f30 0x7f940c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.448+0000 7f941a7fc700 1 -- 172.21.15.84:0/2338950947 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9424085590 con 0x7f942c0c9650 2023-10-06T03:00:43.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.448+0000 7f942a59c700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f940c066f30 0x7f940c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.449+0000 7f942a59c700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f940c066f30 0x7f940c0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f941c000e10 tx=0x7f941c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:43.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.452+0000 7f941a7fc700 1 -- 172.21.15.84:0/2338950947 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9424052560 con 0x7f942c0c9650 2023-10-06T03:00:43.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.633+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f942c169760 con 0x7f940c066f30 2023-10-06T03:00:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.641+0000 7f941a7fc700 1 -- 172.21.15.84:0/2338950947 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308886 (secure 0 0 0) 0x7f942c169760 con 0x7f940c066f30 2023-10-06T03:00:43.646 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f940c066f30 msgr2=0x7f940c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f940c066f30 0x7f940c0693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f941c000e10 tx=0x7f941c009040 comp rx=0 tx=0).stop 2023-10-06T03:00:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f942c0c9650 msgr2=0x7f942c0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f942c0c9650 0x7f942c0c9ac0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9424016000 tx=0x7f942401a000 comp rx=0 tx=0).stop 2023-10-06T03:00:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 shutdown_connections 2023-10-06T03:00:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f940c066f30 0x7f940c0693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9414004d50 0x7f942c0c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f942c0c9650 0x7f942c0c9ac0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 --2- 172.21.15.84:0/2338950947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f942c15e1d0 0x7f942c0c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 >> 172.21.15.84:0/2338950947 conn(0x7f942c06ed20 msgr2=0x7f942c158440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 shutdown_connections 2023-10-06T03:00:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.645+0000 7f942b59e700 1 -- 172.21.15.84:0/2338950947 wait complete. 2023-10-06T03:00:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:00:43.658 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2023-10-06T03:00:41.875450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388268,"kb_used_data":9964,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586452,"statfs":{"total":773094113280,"available":770648526848,"internally_reserved":0,"allocated":10203136,"data_stored":5489967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.289113"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.597641+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:33.428483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.603501+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:30.698656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.596407+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:28.519128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.603337+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:26.794760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.603987+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:45.843117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.597935+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:33.963536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.598019+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:10.363837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.599486+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:49.788635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602255+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:16.179195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602082+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:21.380104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.597923+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:10.112325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602645+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:49.788635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602102+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:51.720107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.606365+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:28.808079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602689+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:33.963536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.599392+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.759314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600293+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:27.604859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602151+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:10.363837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.604765+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:32.049769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602140+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:42.531832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.605697+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:42.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.599931+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:19.315240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.599686+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:35.561259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.598771+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:36.244665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602877+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:39.924480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602702+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:06.829781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.599786+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.687102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.605197+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:16.000521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600369+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:44.876137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.606856+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:03.049348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602249+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:10.112325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.596387+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:09.145757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.608467+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:06.111471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.610992+0000","last_change":"2023-10-06T03:00:38.610992+0000","last_active":"2023-10-06T03:00:38.610992+0000","last_peered":"2023-10-06T03:00:38.610992+0000","last_clean":"2023-10-06T03:00:38.610992+0000","last_became_active":"2023-10-06T03:00:38.610740+0000","last_became_peered":"2023-10-06T03:00:38.610740+0000","last_unstale":"2023-10-06T03:00:38.610992+0000","last_undegraded":"2023-10-06T03:00:38.610992+0000","last_fullsized":"2023-10-06T03:00:38.610992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:25.786744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602026+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:20.282703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.621226+0000","last_change":"2023-10-06T03:00:38.621226+0000","last_active":"2023-10-06T03:00:38.621226+0000","last_peered":"2023-10-06T03:00:38.621226+0000","last_clean":"2023-10-06T03:00:38.621226+0000","last_became_active":"2023-10-06T03:00:38.620988+0000","last_became_peered":"2023-10-06T03:00:38.620988+0000","last_unstale":"2023-10-06T03:00:38.621226+0000","last_undegraded":"2023-10-06T03:00:38.621226+0000","last_fullsized":"2023-10-06T03:00:38.621226+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:29.938752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.597015+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:39.994993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.615667+0000","last_change":"2023-10-06T03:00:38.615667+0000","last_active":"2023-10-06T03:00:38.615667+0000","last_peered":"2023-10-06T03:00:38.615667+0000","last_clean":"2023-10-06T03:00:38.615667+0000","last_became_active":"2023-10-06T03:00:38.615468+0000","last_became_peered":"2023-10-06T03:00:38.615468+0000","last_unstale":"2023-10-06T03:00:38.615667+0000","last_undegraded":"2023-10-06T03:00:38.615667+0000","last_fullsized":"2023-10-06T03:00:38.615667+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:58.730027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602609+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:41.901013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611646+0000","last_change":"2023-10-06T03:00:38.611646+0000","last_active":"2023-10-06T03:00:38.611646+0000","last_peered":"2023-10-06T03:00:38.611646+0000","last_clean":"2023-10-06T03:00:38.611646+0000","last_became_active":"2023-10-06T03:00:38.611385+0000","last_became_peered":"2023-10-06T03:00:38.611385+0000","last_unstale":"2023-10-06T03:00:38.611646+0000","last_undegraded":"2023-10-06T03:00:38.611646+0000","last_fullsized":"2023-10-06T03:00:38.611646+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:39.554832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600041+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:30.443243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.612839+0000","last_change":"2023-10-06T03:00:38.612839+0000","last_active":"2023-10-06T03:00:38.612839+0000","last_peered":"2023-10-06T03:00:38.612839+0000","last_clean":"2023-10-06T03:00:38.612839+0000","last_became_active":"2023-10-06T03:00:38.611041+0000","last_became_peered":"2023-10-06T03:00:38.611041+0000","last_unstale":"2023-10-06T03:00:38.612839+0000","last_undegraded":"2023-10-06T03:00:38.612839+0000","last_fullsized":"2023-10-06T03:00:38.612839+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:43.393360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.598346+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:26.794760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.609253+0000","last_change":"2023-10-06T03:00:38.609253+0000","last_active":"2023-10-06T03:00:38.609253+0000","last_peered":"2023-10-06T03:00:38.609253+0000","last_clean":"2023-10-06T03:00:38.609253+0000","last_became_active":"2023-10-06T03:00:38.609006+0000","last_became_peered":"2023-10-06T03:00:38.609006+0000","last_unstale":"2023-10-06T03:00:38.609253+0000","last_undegraded":"2023-10-06T03:00:38.609253+0000","last_fullsized":"2023-10-06T03:00:38.609253+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:49.712054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600872+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:30.946768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.608740+0000","last_change":"2023-10-06T03:00:38.608740+0000","last_active":"2023-10-06T03:00:38.608740+0000","last_peered":"2023-10-06T03:00:38.608740+0000","last_clean":"2023-10-06T03:00:38.608740+0000","last_became_active":"2023-10-06T03:00:38.608391+0000","last_became_peered":"2023-10-06T03:00:38.608391+0000","last_unstale":"2023-10-06T03:00:38.608740+0000","last_undegraded":"2023-10-06T03:00:38.608740+0000","last_fullsized":"2023-10-06T03:00:38.608740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:03.710659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600895+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:59.738043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.612718+0000","last_change":"2023-10-06T03:00:38.612718+0000","last_active":"2023-10-06T03:00:38.612718+0000","last_peered":"2023-10-06T03:00:38.612718+0000","last_clean":"2023-10-06T03:00:38.612718+0000","last_became_active":"2023-10-06T03:00:38.610838+0000","last_became_peered":"2023-10-06T03:00:38.610838+0000","last_unstale":"2023-10-06T03:00:38.612718+0000","last_undegraded":"2023-10-06T03:00:38.612718+0000","last_fullsized":"2023-10-06T03:00:38.612718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:02.041332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.601805+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:57.585854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.610365+0000","last_change":"2023-10-06T03:00:38.610365+0000","last_active":"2023-10-06T03:00:38.610365+0000","last_peered":"2023-10-06T03:00:38.610365+0000","last_clean":"2023-10-06T03:00:38.610365+0000","last_became_active":"2023-10-06T03:00:38.610069+0000","last_became_peered":"2023-10-06T03:00:38.610069+0000","last_unstale":"2023-10-06T03:00:38.610365+0000","last_undegraded":"2023-10-06T03:00:38.610365+0000","last_fullsized":"2023-10-06T03:00:38.610365+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:27.800063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.601800+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:40.562848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611067+0000","last_change":"2023-10-06T03:00:38.611067+0000","last_active":"2023-10-06T03:00:38.611067+0000","last_peered":"2023-10-06T03:00:38.611067+0000","last_clean":"2023-10-06T03:00:38.611067+0000","last_became_active":"2023-10-06T03:00:38.610826+0000","last_became_peered":"2023-10-06T03:00:38.610826+0000","last_unstale":"2023-10-06T03:00:38.611067+0000","last_undegraded":"2023-10-06T03:00:38.611067+0000","last_fullsized":"2023-10-06T03:00:38.611067+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:02.991587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.604743+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:57.968379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611585+0000","last_change":"2023-10-06T03:00:38.611585+0000","last_active":"2023-10-06T03:00:38.611585+0000","last_peered":"2023-10-06T03:00:38.611585+0000","last_clean":"2023-10-06T03:00:38.611585+0000","last_became_active":"2023-10-06T03:00:38.611323+0000","last_became_peered":"2023-10-06T03:00:38.611323+0000","last_unstale":"2023-10-06T03:00:38.611585+0000","last_undegraded":"2023-10-06T03:00:38.611585+0000","last_fullsized":"2023-10-06T03:00:38.611585+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:39.109899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.599333+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:34.326609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611028+0000","last_change":"2023-10-06T03:00:38.611028+0000","last_active":"2023-10-06T03:00:38.611028+0000","last_peered":"2023-10-06T03:00:38.611028+0000","last_clean":"2023-10-06T03:00:38.611028+0000","last_became_active":"2023-10-06T03:00:38.610750+0000","last_became_peered":"2023-10-06T03:00:38.610750+0000","last_unstale":"2023-10-06T03:00:38.611028+0000","last_undegraded":"2023-10-06T03:00:38.611028+0000","last_fullsized":"2023-10-06T03:00:38.611028+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:21.751299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600678+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:40.117914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.613814+0000","last_change":"2023-10-06T03:00:38.613814+0000","last_active":"2023-10-06T03:00:38.613814+0000","last_peered":"2023-10-06T03:00:38.613814+0000","last_clean":"2023-10-06T03:00:38.613814+0000","last_became_active":"2023-10-06T03:00:38.613461+0000","last_became_peered":"2023-10-06T03:00:38.613461+0000","last_unstale":"2023-10-06T03:00:38.613814+0000","last_undegraded":"2023-10-06T03:00:38.613814+0000","last_fullsized":"2023-10-06T03:00:38.613814+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:13.881016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.598031+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:45.959231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611362+0000","last_change":"2023-10-06T03:00:38.611362+0000","last_active":"2023-10-06T03:00:38.611362+0000","last_peered":"2023-10-06T03:00:38.611362+0000","last_clean":"2023-10-06T03:00:38.611362+0000","last_became_active":"2023-10-06T03:00:38.611104+0000","last_became_peered":"2023-10-06T03:00:38.611104+0000","last_unstale":"2023-10-06T03:00:38.611362+0000","last_undegraded":"2023-10-06T03:00:38.611362+0000","last_fullsized":"2023-10-06T03:00:38.611362+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:08.219515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600083+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:35.321893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611183+0000","last_change":"2023-10-06T03:00:38.611183+0000","last_active":"2023-10-06T03:00:38.611183+0000","last_peered":"2023-10-06T03:00:38.611183+0000","last_clean":"2023-10-06T03:00:38.611183+0000","last_became_active":"2023-10-06T03:00:38.610909+0000","last_became_peered":"2023-10-06T03:00:38.610909+0000","last_unstale":"2023-10-06T03:00:38.611183+0000","last_undegraded":"2023-10-06T03:00:38.611183+0000","last_fullsized":"2023-10-06T03:00:38.611183+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:49.712054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.604261+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:07:29.687242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611096+0000","last_change":"2023-10-06T03:00:38.611096+0000","last_active":"2023-10-06T03:00:38.611096+0000","last_peered":"2023-10-06T03:00:38.611096+0000","last_clean":"2023-10-06T03:00:38.611096+0000","last_became_active":"2023-10-06T03:00:38.610525+0000","last_became_peered":"2023-10-06T03:00:38.610525+0000","last_unstale":"2023-10-06T03:00:38.611096+0000","last_undegraded":"2023-10-06T03:00:38.611096+0000","last_fullsized":"2023-10-06T03:00:38.611096+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:33.675510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.603069+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:20.458747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.610447+0000","last_change":"2023-10-06T03:00:38.610447+0000","last_active":"2023-10-06T03:00:38.610447+0000","last_peered":"2023-10-06T03:00:38.610447+0000","last_clean":"2023-10-06T03:00:38.610447+0000","last_became_active":"2023-10-06T03:00:38.610220+0000","last_became_peered":"2023-10-06T03:00:38.610220+0000","last_unstale":"2023-10-06T03:00:38.610447+0000","last_undegraded":"2023-10-06T03:00:38.610447+0000","last_fullsized":"2023-10-06T03:00:38.610447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:14.557028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.597228+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:04.854046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611822+0000","last_change":"2023-10-06T03:00:38.611822+0000","last_active":"2023-10-06T03:00:38.611822+0000","last_peered":"2023-10-06T03:00:38.611822+0000","last_clean":"2023-10-06T03:00:38.611822+0000","last_became_active":"2023-10-06T03:00:38.611473+0000","last_became_peered":"2023-10-06T03:00:38.611473+0000","last_unstale":"2023-10-06T03:00:38.611822+0000","last_undegraded":"2023-10-06T03:00:38.611822+0000","last_fullsized":"2023-10-06T03:00:38.611822+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:34.313878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.596579+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:39.442741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611099+0000","last_change":"2023-10-06T03:00:38.611099+0000","last_active":"2023-10-06T03:00:38.611099+0000","last_peered":"2023-10-06T03:00:38.611099+0000","last_clean":"2023-10-06T03:00:38.611099+0000","last_became_active":"2023-10-06T03:00:38.610863+0000","last_became_peered":"2023-10-06T03:00:38.610863+0000","last_unstale":"2023-10-06T03:00:38.611099+0000","last_undegraded":"2023-10-06T03:00:38.611099+0000","last_fullsized":"2023-10-06T03:00:38.611099+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:21.679086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.601710+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:43.827269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.610942+0000","last_change":"2023-10-06T03:00:38.610942+0000","last_active":"2023-10-06T03:00:38.610942+0000","last_peered":"2023-10-06T03:00:38.610942+0000","last_clean":"2023-10-06T03:00:38.610942+0000","last_became_active":"2023-10-06T03:00:38.610652+0000","last_became_peered":"2023-10-06T03:00:38.610652+0000","last_unstale":"2023-10-06T03:00:38.610942+0000","last_undegraded":"2023-10-06T03:00:38.610942+0000","last_fullsized":"2023-10-06T03:00:38.610942+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:09.545331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.604637+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:58.968625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.608342+0000","last_change":"2023-10-06T03:00:38.608342+0000","last_active":"2023-10-06T03:00:38.608342+0000","last_peered":"2023-10-06T03:00:38.608342+0000","last_clean":"2023-10-06T03:00:38.608342+0000","last_became_active":"2023-10-06T03:00:38.608055+0000","last_became_peered":"2023-10-06T03:00:38.608055+0000","last_unstale":"2023-10-06T03:00:38.608342+0000","last_undegraded":"2023-10-06T03:00:38.608342+0000","last_fullsized":"2023-10-06T03:00:38.608342+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:41.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.601359+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.322266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611188+0000","last_change":"2023-10-06T03:00:38.611188+0000","last_active":"2023-10-06T03:00:38.611188+0000","last_peered":"2023-10-06T03:00:38.611188+0000","last_clean":"2023-10-06T03:00:38.611188+0000","last_became_active":"2023-10-06T03:00:38.610932+0000","last_became_peered":"2023-10-06T03:00:38.610932+0000","last_unstale":"2023-10-06T03:00:38.611188+0000","last_undegraded":"2023-10-06T03:00:38.611188+0000","last_fullsized":"2023-10-06T03:00:38.611188+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:45.110149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.606161+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:08.254447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.604472+0000","last_change":"2023-10-06T03:00:38.604472+0000","last_active":"2023-10-06T03:00:38.604472+0000","last_peered":"2023-10-06T03:00:38.604472+0000","last_clean":"2023-10-06T03:00:38.604472+0000","last_became_active":"2023-10-06T03:00:38.603951+0000","last_became_peered":"2023-10-06T03:00:38.603951+0000","last_unstale":"2023-10-06T03:00:38.604472+0000","last_undegraded":"2023-10-06T03:00:38.604472+0000","last_fullsized":"2023-10-06T03:00:38.604472+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:24.176118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600105+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:15.565043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611690+0000","last_change":"2023-10-06T03:00:38.611690+0000","last_active":"2023-10-06T03:00:38.611690+0000","last_peered":"2023-10-06T03:00:38.611690+0000","last_clean":"2023-10-06T03:00:38.611690+0000","last_became_active":"2023-10-06T03:00:38.611427+0000","last_became_peered":"2023-10-06T03:00:38.611427+0000","last_unstale":"2023-10-06T03:00:38.611690+0000","last_undegraded":"2023-10-06T03:00:38.611690+0000","last_fullsized":"2023-10-06T03:00:38.611690+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:14.592153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600597+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:40.221479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.621210+0000","last_change":"2023-10-06T03:00:38.621210+0000","last_active":"2023-10-06T03:00:38.621210+0000","last_peered":"2023-10-06T03:00:38.621210+0000","last_clean":"2023-10-06T03:00:38.621210+0000","last_became_active":"2023-10-06T03:00:38.620944+0000","last_became_peered":"2023-10-06T03:00:38.620944+0000","last_unstale":"2023-10-06T03:00:38.621210+0000","last_undegraded":"2023-10-06T03:00:38.621210+0000","last_fullsized":"2023-10-06T03:00:38.621210+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:33.318594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T03:00:37.590313+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T03:00:37.590313+0000","last_peered":"2023-10-06T03:00:37.590313+0000","last_clean":"2023-10-06T03:00:37.590313+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T03:00:37.590313+0000","last_undegraded":"2023-10-06T03:00:37.590313+0000","last_fullsized":"2023-10-06T03:00:37.590313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.602417+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:30.443243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.611563+0000","last_change":"2023-10-06T03:00:38.611563+0000","last_active":"2023-10-06T03:00:38.611563+0000","last_peered":"2023-10-06T03:00:38.611563+0000","last_clean":"2023-10-06T03:00:38.611563+0000","last_became_active":"2023-10-06T03:00:38.611308+0000","last_became_peered":"2023-10-06T03:00:38.611308+0000","last_unstale":"2023-10-06T03:00:38.611563+0000","last_undegraded":"2023-10-06T03:00:38.611563+0000","last_fullsized":"2023-10-06T03:00:38.611563+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:33.318594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T03:00:37.594323+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T03:00:37.594323+0000","last_peered":"2023-10-06T03:00:37.594323+0000","last_clean":"2023-10-06T03:00:37.594323+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T03:00:37.594323+0000","last_undegraded":"2023-10-06T03:00:37.594323+0000","last_fullsized":"2023-10-06T03:00:37.594323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.600011+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:21.380104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.608515+0000","last_change":"2023-10-06T03:00:38.608515+0000","last_active":"2023-10-06T03:00:38.608515+0000","last_peered":"2023-10-06T03:00:38.608515+0000","last_clean":"2023-10-06T03:00:38.608515+0000","last_became_active":"2023-10-06T03:00:38.608218+0000","last_became_peered":"2023-10-06T03:00:38.608218+0000","last_unstale":"2023-10-06T03:00:38.608515+0000","last_undegraded":"2023-10-06T03:00:38.608515+0000","last_fullsized":"2023-10-06T03:00:38.608515+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:24.092949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T03:00:37.587389+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T03:00:37.587389+0000","last_peered":"2023-10-06T03:00:37.587389+0000","last_clean":"2023-10-06T03:00:37.587389+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T03:00:37.587389+0000","last_undegraded":"2023-10-06T03:00:37.587389+0000","last_fullsized":"2023-10-06T03:00:37.587389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.605989+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:44.401375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.608760+0000","last_change":"2023-10-06T03:00:38.608760+0000","last_active":"2023-10-06T03:00:38.608760+0000","last_peered":"2023-10-06T03:00:38.608760+0000","last_clean":"2023-10-06T03:00:38.608760+0000","last_became_active":"2023-10-06T03:00:38.608452+0000","last_became_peered":"2023-10-06T03:00:38.608452+0000","last_unstale":"2023-10-06T03:00:38.608760+0000","last_undegraded":"2023-10-06T03:00:38.608760+0000","last_fullsized":"2023-10-06T03:00:38.608760+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:19.274687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T03:00:37.594162+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T03:00:37.594162+0000","last_peered":"2023-10-06T03:00:37.594162+0000","last_clean":"2023-10-06T03:00:37.594162+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T03:00:37.594162+0000","last_undegraded":"2023-10-06T03:00:37.594162+0000","last_fullsized":"2023-10-06T03:00:37.594162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":223,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T03:00:37.596382+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T03:00:37.596382+0000","last_peered":"2023-10-06T03:00:37.596382+0000","last_clean":"2023-10-06T03:00:37.596382+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T03:00:37.596382+0000","last_undegraded":"2023-10-06T03:00:37.596382+0000","last_fullsized":"2023-10-06T03:00:37.596382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.598795+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:50.720070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.610812+0000","last_change":"2023-10-06T03:00:38.610812+0000","last_active":"2023-10-06T03:00:38.610812+0000","last_peered":"2023-10-06T03:00:38.610812+0000","last_clean":"2023-10-06T03:00:38.610812+0000","last_became_active":"2023-10-06T03:00:38.610462+0000","last_became_peered":"2023-10-06T03:00:38.610462+0000","last_unstale":"2023-10-06T03:00:38.610812+0000","last_undegraded":"2023-10-06T03:00:38.610812+0000","last_fullsized":"2023-10-06T03:00:38.610812+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:21.751299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T03:00:37.596473+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T03:00:37.596473+0000","last_peered":"2023-10-06T03:00:37.596473+0000","last_clean":"2023-10-06T03:00:37.596473+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T03:00:37.596473+0000","last_undegraded":"2023-10-06T03:00:37.596473+0000","last_fullsized":"2023-10-06T03:00:37.596473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.604712+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:54:53.796813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.613575+0000","last_change":"2023-10-06T03:00:38.613575+0000","last_active":"2023-10-06T03:00:38.613575+0000","last_peered":"2023-10-06T03:00:38.613575+0000","last_clean":"2023-10-06T03:00:38.613575+0000","last_became_active":"2023-10-06T03:00:38.613328+0000","last_became_peered":"2023-10-06T03:00:38.613328+0000","last_unstale":"2023-10-06T03:00:38.613575+0000","last_undegraded":"2023-10-06T03:00:38.613575+0000","last_fullsized":"2023-10-06T03:00:38.613575+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:39.213463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T03:00:37.596565+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T03:00:37.596565+0000","last_peered":"2023-10-06T03:00:37.596565+0000","last_clean":"2023-10-06T03:00:37.596565+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T03:00:37.596565+0000","last_undegraded":"2023-10-06T03:00:37.596565+0000","last_fullsized":"2023-10-06T03:00:37.596565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.608413+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:39.442741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.607683+0000","last_change":"2023-10-06T03:00:38.607683+0000","last_active":"2023-10-06T03:00:38.607683+0000","last_peered":"2023-10-06T03:00:38.607683+0000","last_clean":"2023-10-06T03:00:38.607683+0000","last_became_active":"2023-10-06T03:00:38.607424+0000","last_became_peered":"2023-10-06T03:00:38.607424+0000","last_unstale":"2023-10-06T03:00:38.607683+0000","last_undegraded":"2023-10-06T03:00:38.607683+0000","last_fullsized":"2023-10-06T03:00:38.607683+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:38.573583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T03:00:37.590373+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T03:00:37.590373+0000","last_peered":"2023-10-06T03:00:37.590373+0000","last_clean":"2023-10-06T03:00:37.590373+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T03:00:37.590373+0000","last_undegraded":"2023-10-06T03:00:37.590373+0000","last_fullsized":"2023-10-06T03:00:37.590373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:00:38.586315+0000","last_change":"2023-10-06T03:00:38.605071+0000","last_active":"2023-10-06T03:00:38.586315+0000","last_peered":"2023-10-06T03:00:38.586315+0000","last_clean":"2023-10-06T03:00:38.586315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:00:38.586315+0000","last_undegraded":"2023-10-06T03:00:38.586315+0000","last_fullsized":"2023-10-06T03:00:38.586315+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:29.050393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-06T03:00:38.616913+0000","last_change":"2023-10-06T03:00:38.616913+0000","last_active":"2023-10-06T03:00:38.616913+0000","last_peered":"2023-10-06T03:00:38.616913+0000","last_clean":"2023-10-06T03:00:38.616913+0000","last_became_active":"2023-10-06T03:00:38.616671+0000","last_became_peered":"2023-10-06T03:00:38.616671+0000","last_unstale":"2023-10-06T03:00:38.616913+0000","last_undegraded":"2023-10-06T03:00:38.616913+0000","last_fullsized":"2023-10-06T03:00:38.616913+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:23.314251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-06T03:00:37.593051+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T03:00:37.593051+0000","last_peered":"2023-10-06T03:00:37.593051+0000","last_clean":"2023-10-06T03:00:37.593051+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T03:00:37.593051+0000","last_undegraded":"2023-10-06T03:00:37.593051+0000","last_fullsized":"2023-10-06T03:00:37.593051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298964,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072876,"statfs":{"total":96636764160,"available":96330625024,"internally_reserved":0,"allocated":1716224,"data_stored":1125933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.75700000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.441,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68300000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.49299999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71199999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.498}]},{"osd":5,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50900000000000001,"15min":0.52700000000000002},"min":{"1min":0.30599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78300000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51600000000000001,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":542501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.60399999999999998},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86099999999999999,"5min":3.415,"15min":3.415},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.58499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81999999999999995,"5min":1.546,"15min":1.546},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.45400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.77700000000000002,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79500000000000004,"5min":1.74,"15min":1.74},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.70799999999999996},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80300000000000005,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61899999999999999,"15min":0.70599999999999996},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":3.577,"15min":3.577},"last":0.754},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.67000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82099999999999995,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.58599999999999997},"min":{"1min":0.42199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.77600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80200000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.84799999999999998,"5min":0.87,"15min":0.87},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70399999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83899999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.82499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298380,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073460,"statfs":{"total":96636764160,"available":96331223040,"internally_reserved":0,"allocated":1118208,"data_stored":534554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34699999999999998,"15min":0.39100000000000001},"min":{"1min":0.193,"5min":0.19,"15min":0.19},"max":{"1min":0.57699999999999996,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.53600000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.57399999999999995,"15min":1.1379999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51600000000000001,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":1.181,"15min":1.181},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40600000000000003,"15min":0.436},"min":{"1min":0.26400000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.505,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.248,"15min":0.248},"max":{"1min":0.52900000000000003,"5min":0.626,"15min":0.626},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95699999999999996,"5min":1.02,"15min":1.02},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.79500000000000004,"15min":1.355},"min":{"1min":0.44600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.749,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.79400000000000004,"15min":1.3440000000000001},"min":{"1min":0.45800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89800000000000002,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.58499999999999996},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.505},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80500000000000005,"15min":1.3740000000000001},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82099999999999995,"5min":21.166,"15min":21.166},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61799999999999999,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.99099999999999999,"5min":0.997,"15min":0.997},"last":0.55700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298960,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072880,"statfs":{"total":96636764160,"available":96330629120,"internally_reserved":0,"allocated":1712128,"data_stored":1124922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.221,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45900000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.28000000000000003,"5min":0.222,"15min":0.222},"max":{"1min":0.55600000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.246}]},{"osd":2,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.376,"15min":0.373},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.249,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48699999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.40500000000000003},"min":{"1min":0.32200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29999999999999999}]},{"osd":4,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.58299999999999996},"min":{"1min":0.439,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79600000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79200000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81499999999999995,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.435},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.45400000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.48699999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.78400000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.438,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86599999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.51500000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89200000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298384,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073456,"statfs":{"total":96636764160,"available":96331218944,"internally_reserved":0,"allocated":1122304,"data_stored":535565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.312},"min":{"1min":0.23300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.32400000000000001},"min":{"1min":0.24299999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.46100000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36099999999999999},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.56100000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.313},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53500000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.495,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.41299999999999998,"15min":0.40200000000000002},"min":{"1min":0.33800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63100000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.55400000000000005},"min":{"1min":0.46200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82599999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58799999999999997,"15min":0.56200000000000006},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.495,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92700000000000005,"5min":1.276,"15min":1.276},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.57699999999999996},"min":{"1min":0.504,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80500000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89500000000000002,"5min":1.077,"15min":1.077},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61699999999999999,"15min":0.57399999999999995},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298392,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073448,"statfs":{"total":96636764160,"available":96331210752,"internally_reserved":0,"allocated":1130496,"data_stored":541490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.38200000000000001,"15min":0.439},"min":{"1min":0.22500000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.46500000000000002,"5min":2.569,"15min":2.569},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.441},"min":{"1min":0.28799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.53300000000000003,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.374,"15min":0.42799999999999999},"min":{"1min":0.23799999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.46500000000000002},"min":{"1min":0.254,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58199999999999996,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41299999999999998,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.56699999999999995,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42999999999999999,"15min":0.48399999999999999},"min":{"1min":0.28899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55300000000000005,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.63300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.66600000000000004},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.62,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82199999999999995,"5min":2.532,"15min":2.532},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.64600000000000002},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63800000000000001,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.80000000000000004,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.90000000000000002,"5min":2.496,"15min":2.496},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.65700000000000003},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76600000000000001,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.50600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":542501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54100000000000004,"15min":0.51900000000000002},"min":{"1min":0.40200000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55500000000000005},"min":{"1min":0.38600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73699999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.375,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70899999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58099999999999996,"15min":0.56799999999999995},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56299999999999994,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.436},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.71399999999999997,"15min":0.97399999999999998},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.76900000000000002,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76600000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78600000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":542501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51900000000000002,"15min":0.496},"min":{"1min":0.38400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69099999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73899999999999999,"5min":1.167,"15min":1.167},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.57099999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.74099999999999999,"5min":1.117,"15min":1.117},"last":0.498},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52800000000000002,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68799999999999994,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":1.2,"15min":1.2},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55800000000000005,"15min":0.59199999999999997},"min":{"1min":0.39200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64100000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73799999999999999,"5min":1.135,"15min":1.135},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77600000000000002,"5min":1.208,"15min":1.208},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47499999999999998,"15min":0.498},"min":{"1min":0.29299999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65100000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.71899999999999997,"5min":0.87,"15min":0.87},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52900000000000003,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72899999999999998,"5min":1.054,"15min":1.054},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54000000000000004,"15min":0.57899999999999996},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54600000000000004,"15min":0.58099999999999996},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.629},"min":{"1min":0.42099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":1.008,"15min":1.008},"last":0.623}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:00:43.666 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:00:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.811+0000 7fea72e4c700 1 Processor -- start 2023-10-06T03:00:43.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.811+0000 7fea72e4c700 1 -- start start 2023-10-06T03:00:43.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.812+0000 7fea72e4c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b49e0 0x7fea6c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.812+0000 7fea72e4c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea6c0b07a0 0x7fea6c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.812+0000 7fea72e4c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0b0ca0 con 0x7fea6c1595a0 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.812+0000 7fea72e4c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6c0b0f80 con 0x7fea6c0b07a0 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.812+0000 7fea72e4c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0b1260 con 0x7fea6c0b49e0 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.812+0000 7fea713e9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fea6c0b07a0 0x7fea6c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.812+0000 7fea70be8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fea6c1595a0 0x7fea6c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52336/0 (socket says 172.21.15.84:52336) 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.812+0000 7fea70be8700 1 -- 172.21.15.84:0/3998142737 learned_addr learned my addr 172.21.15.84:0/3998142737 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea637fe700 1 -- 172.21.15.84:0/3998142737 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779049865 0 0) 0x7fea6c0b0ca0 con 0x7fea6c1595a0 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea637fe700 1 -- 172.21.15.84:0/3998142737 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea54003570 con 0x7fea6c1595a0 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea63fff700 1 --2- 172.21.15.84:0/3998142737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b49e0 0x7fea6c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea713e9700 1 -- 172.21.15.84:0/3998142737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b49e0 msgr2=0x7fea6c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:43.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea713e9700 1 --2- 172.21.15.84:0/3998142737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b49e0 0x7fea6c0aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea713e9700 1 -- 172.21.15.84:0/3998142737 >> v1:172.21.15.84:6789/0 conn(0x7fea6c1595a0 legacy=0x7fea6c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea713e9700 1 -- 172.21.15.84:0/3998142737 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c0b1540 con 0x7fea6c0b07a0 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea713e9700 1 --2- 172.21.15.84:0/3998142737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b07a0 0x7fea6c0b1c00 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fea640098e0 tx=0x7fea640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bede0760cc67c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea637fe700 1 -- 172.21.15.84:0/3998142737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400b640 con 0x7fea6c0b07a0 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea637fe700 1 -- 172.21.15.84:0/3998142737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6400b7a0 con 0x7fea6c0b07a0 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea637fe700 1 -- 172.21.15.84:0/3998142737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400bb40 con 0x7fea6c0b07a0 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.813+0000 7fea72e4c700 1 -- 172.21.15.84:0/3998142737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b07a0 msgr2=0x7fea6c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.814+0000 7fea72e4c700 1 --2- 172.21.15.84:0/3998142737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b07a0 0x7fea6c0b1c00 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fea640098e0 tx=0x7fea640091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.814+0000 7fea72e4c700 1 -- 172.21.15.84:0/3998142737 shutdown_connections 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.814+0000 7fea72e4c700 1 --2- 172.21.15.84:0/3998142737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b07a0 0x7fea6c0b1c00 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.814+0000 7fea72e4c700 1 --2- 172.21.15.84:0/3998142737 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b49e0 0x7fea6c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.814+0000 7fea72e4c700 1 -- 172.21.15.84:0/3998142737 >> 172.21.15.84:0/3998142737 conn(0x7fea6c099830 msgr2=0x7fea6c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:43.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.814+0000 7fea72e4c700 1 -- 172.21.15.84:0/3998142737 shutdown_connections 2023-10-06T03:00:43.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.814+0000 7fea72e4c700 1 -- 172.21.15.84:0/3998142737 wait complete. 2023-10-06T03:00:43.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.815+0000 7fea72e4c700 1 Processor -- start 2023-10-06T03:00:43.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.815+0000 7fea72e4c700 1 -- start start 2023-10-06T03:00:43.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea72e4c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b07a0 0x7fea6c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea72e4c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b49e0 0x7fea6c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea72e4c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6c1595a0 0x7fea6c09d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea72e4c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c15cdc0 con 0x7fea6c0b49e0 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea72e4c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0acb80 con 0x7fea6c1595a0 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea72e4c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c15c2a0 con 0x7fea6c0b07a0 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b49e0 0x7fea6c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea63fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b49e0 0x7fea6c15bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41546/0 (socket says 172.21.15.84:41546) 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea63fff700 1 -- 172.21.15.84:0/4043565337 learned_addr learned my addr 172.21.15.84:0/4043565337 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea70be8700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b07a0 0x7fea6c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea63fff700 1 -- 172.21.15.84:0/4043565337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b07a0 msgr2=0x7fea6c157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea713e9700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6c1595a0 0x7fea6c09d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea63fff700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b07a0 0x7fea6c157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea63fff700 1 -- 172.21.15.84:0/4043565337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6c1595a0 msgr2=0x7fea6c09d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea63fff700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6c1595a0 0x7fea6c09d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea63fff700 1 -- 172.21.15.84:0/4043565337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64009420 con 0x7fea6c0b49e0 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea70be8700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b07a0 0x7fea6c157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea63fff700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b49e0 0x7fea6c15bd60 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c800 tx=0x7fea5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea60ff9700 1 -- 172.21.15.84:0/4043565337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011600 con 0x7fea6c0b49e0 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea60ff9700 1 -- 172.21.15.84:0/4043565337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c011760 con 0x7fea6c0b49e0 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c0ac850 con 0x7fea6c0b49e0 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea60ff9700 1 -- 172.21.15.84:0/4043565337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011b00 con 0x7fea6c0b49e0 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.816+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c15c800 con 0x7fea6c0b49e0 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.817+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c0acd30 con 0x7fea6c0b49e0 2023-10-06T03:00:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.818+0000 7fea60ff9700 1 -- 172.21.15.84:0/4043565337 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea5c0193f0 con 0x7fea6c0b49e0 2023-10-06T03:00:43.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.818+0000 7fea60ff9700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea58066f30 0x7fea580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:43.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.818+0000 7fea60ff9700 1 -- 172.21.15.84:0/4043565337 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fea5c084b70 con 0x7fea6c0b49e0 2023-10-06T03:00:43.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.818+0000 7fea70be8700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea58066f30 0x7fea580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:43.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.818+0000 7fea70be8700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea58066f30 0x7fea580693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fea680016e0 tx=0x7fea68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:43.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:43.822+0000 7fea60ff9700 1 -- 172.21.15.84:0/4043565337 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea6c0acd30 con 0x7fea6c0b49e0 2023-10-06T03:00:43.888 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:00:43.887+0000 7fd4ebbfb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:00:44.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.003+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea6c0acd30 con 0x7fea58066f30 2023-10-06T03:00:44.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.011+0000 7fea60ff9700 1 -- 172.21.15.84:0/4043565337 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311673 (secure 0 0 0) 0x7fea6c0acd30 con 0x7fea58066f30 2023-10-06T03:00:44.016 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:44.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea58066f30 msgr2=0x7fea580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea58066f30 0x7fea580693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fea680016e0 tx=0x7fea68009040 comp rx=0 tx=0).stop 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b49e0 msgr2=0x7fea6c15bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b49e0 0x7fea6c15bd60 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c800 tx=0x7fea5c008040 comp rx=0 tx=0).stop 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 shutdown_connections 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fea58066f30 0x7fea580693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea6c1595a0 0x7fea6c09d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fea6c0b07a0 0x7fea6c157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 --2- 172.21.15.84:0/4043565337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea6c0b49e0 0x7fea6c15bd60 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 >> 172.21.15.84:0/4043565337 conn(0x7fea6c099830 msgr2=0x7fea6c158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:44.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 shutdown_connections 2023-10-06T03:00:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.014+0000 7fea72e4c700 1 -- 172.21.15.84:0/4043565337 wait complete. 2023-10-06T03:00:44.020 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:00:44.028 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-10-06T03:00:43.875718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2388572,"kb_used_data":10268,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752586148,"statfs":{"total":773094113280,"available":770648215552,"internally_reserved":0,"allocated":10514432,"data_stored":5637499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000908"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.617860+0000","last_change":"2023-10-06T03:00:39.612111+0000","last_active":"2023-10-06T03:00:39.617860+0000","last_peered":"2023-10-06T03:00:39.617860+0000","last_clean":"2023-10-06T03:00:39.617860+0000","last_became_active":"2023-10-06T03:00:39.611895+0000","last_became_peered":"2023-10-06T03:00:39.611895+0000","last_unstale":"2023-10-06T03:00:39.617860+0000","last_undegraded":"2023-10-06T03:00:39.617860+0000","last_fullsized":"2023-10-06T03:00:39.617860+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:07.005112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.628068+0000","last_change":"2023-10-06T03:00:39.622959+0000","last_active":"2023-10-06T03:00:39.628068+0000","last_peered":"2023-10-06T03:00:39.628068+0000","last_clean":"2023-10-06T03:00:39.628068+0000","last_became_active":"2023-10-06T03:00:39.622707+0000","last_became_peered":"2023-10-06T03:00:39.622707+0000","last_unstale":"2023-10-06T03:00:39.628068+0000","last_undegraded":"2023-10-06T03:00:39.628068+0000","last_fullsized":"2023-10-06T03:00:39.628068+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:22:59.094393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.625775+0000","last_change":"2023-10-06T03:00:39.613197+0000","last_active":"2023-10-06T03:00:39.625775+0000","last_peered":"2023-10-06T03:00:39.625775+0000","last_clean":"2023-10-06T03:00:39.625775+0000","last_became_active":"2023-10-06T03:00:39.612954+0000","last_became_peered":"2023-10-06T03:00:39.612954+0000","last_unstale":"2023-10-06T03:00:39.625775+0000","last_undegraded":"2023-10-06T03:00:39.625775+0000","last_fullsized":"2023-10-06T03:00:39.625775+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:28.416973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.633833+0000","last_change":"2023-10-06T03:00:39.631498+0000","last_active":"2023-10-06T03:00:39.633833+0000","last_peered":"2023-10-06T03:00:39.633833+0000","last_clean":"2023-10-06T03:00:39.633833+0000","last_became_active":"2023-10-06T03:00:39.631224+0000","last_became_peered":"2023-10-06T03:00:39.631224+0000","last_unstale":"2023-10-06T03:00:39.633833+0000","last_undegraded":"2023-10-06T03:00:39.633833+0000","last_fullsized":"2023-10-06T03:00:39.633833+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:22.687102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.623371+0000","last_change":"2023-10-06T03:00:39.618492+0000","last_active":"2023-10-06T03:00:39.623371+0000","last_peered":"2023-10-06T03:00:39.623371+0000","last_clean":"2023-10-06T03:00:39.623371+0000","last_became_active":"2023-10-06T03:00:39.618149+0000","last_became_peered":"2023-10-06T03:00:39.618149+0000","last_unstale":"2023-10-06T03:00:39.623371+0000","last_undegraded":"2023-10-06T03:00:39.623371+0000","last_fullsized":"2023-10-06T03:00:39.623371+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:03.999603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.618325+0000","last_change":"2023-10-06T03:00:39.613155+0000","last_active":"2023-10-06T03:00:39.618325+0000","last_peered":"2023-10-06T03:00:39.618325+0000","last_clean":"2023-10-06T03:00:39.618325+0000","last_became_active":"2023-10-06T03:00:39.612840+0000","last_became_peered":"2023-10-06T03:00:39.612840+0000","last_unstale":"2023-10-06T03:00:39.618325+0000","last_undegraded":"2023-10-06T03:00:39.618325+0000","last_fullsized":"2023-10-06T03:00:39.618325+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:35.321893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.618446+0000","last_change":"2023-10-06T03:00:39.613068+0000","last_active":"2023-10-06T03:00:39.618446+0000","last_peered":"2023-10-06T03:00:39.618446+0000","last_clean":"2023-10-06T03:00:39.618446+0000","last_became_active":"2023-10-06T03:00:39.612800+0000","last_became_peered":"2023-10-06T03:00:39.612800+0000","last_unstale":"2023-10-06T03:00:39.618446+0000","last_undegraded":"2023-10-06T03:00:39.618446+0000","last_fullsized":"2023-10-06T03:00:39.618446+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:59.738043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.614346+0000","last_change":"2023-10-06T03:00:39.604075+0000","last_active":"2023-10-06T03:00:39.614346+0000","last_peered":"2023-10-06T03:00:39.614346+0000","last_clean":"2023-10-06T03:00:39.614346+0000","last_became_active":"2023-10-06T03:00:39.603788+0000","last_became_peered":"2023-10-06T03:00:39.603788+0000","last_unstale":"2023-10-06T03:00:39.614346+0000","last_undegraded":"2023-10-06T03:00:39.614346+0000","last_fullsized":"2023-10-06T03:00:39.614346+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:32.230256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.622494+0000","last_change":"2023-10-06T03:00:39.619182+0000","last_active":"2023-10-06T03:00:39.622494+0000","last_peered":"2023-10-06T03:00:39.622494+0000","last_clean":"2023-10-06T03:00:39.622494+0000","last_became_active":"2023-10-06T03:00:39.618917+0000","last_became_peered":"2023-10-06T03:00:39.618917+0000","last_unstale":"2023-10-06T03:00:39.622494+0000","last_undegraded":"2023-10-06T03:00:39.622494+0000","last_fullsized":"2023-10-06T03:00:39.622494+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:57.585854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.617836+0000","last_change":"2023-10-06T03:00:39.615689+0000","last_active":"2023-10-06T03:00:39.617836+0000","last_peered":"2023-10-06T03:00:39.617836+0000","last_clean":"2023-10-06T03:00:39.617836+0000","last_became_active":"2023-10-06T03:00:39.615401+0000","last_became_peered":"2023-10-06T03:00:39.615401+0000","last_unstale":"2023-10-06T03:00:39.617836+0000","last_undegraded":"2023-10-06T03:00:39.617836+0000","last_fullsized":"2023-10-06T03:00:39.617836+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:16.402559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.621840+0000","last_change":"2023-10-06T03:00:39.619196+0000","last_active":"2023-10-06T03:00:39.621840+0000","last_peered":"2023-10-06T03:00:39.621840+0000","last_clean":"2023-10-06T03:00:39.621840+0000","last_became_active":"2023-10-06T03:00:39.617796+0000","last_became_peered":"2023-10-06T03:00:39.617796+0000","last_unstale":"2023-10-06T03:00:39.621840+0000","last_undegraded":"2023-10-06T03:00:39.621840+0000","last_fullsized":"2023-10-06T03:00:39.621840+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:40.562848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.625715+0000","last_change":"2023-10-06T03:00:39.620399+0000","last_active":"2023-10-06T03:00:39.625715+0000","last_peered":"2023-10-06T03:00:39.625715+0000","last_clean":"2023-10-06T03:00:39.625715+0000","last_became_active":"2023-10-06T03:00:39.619484+0000","last_became_peered":"2023-10-06T03:00:39.619484+0000","last_unstale":"2023-10-06T03:00:39.625715+0000","last_undegraded":"2023-10-06T03:00:39.625715+0000","last_fullsized":"2023-10-06T03:00:39.625715+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:30.698656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.625119+0000","last_change":"2023-10-06T03:00:39.621862+0000","last_active":"2023-10-06T03:00:39.625119+0000","last_peered":"2023-10-06T03:00:39.625119+0000","last_clean":"2023-10-06T03:00:39.625119+0000","last_became_active":"2023-10-06T03:00:39.621605+0000","last_became_peered":"2023-10-06T03:00:39.621605+0000","last_unstale":"2023-10-06T03:00:39.625119+0000","last_undegraded":"2023-10-06T03:00:39.625119+0000","last_fullsized":"2023-10-06T03:00:39.625119+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:22.759314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.632939+0000","last_change":"2023-10-06T03:00:39.627473+0000","last_active":"2023-10-06T03:00:39.632939+0000","last_peered":"2023-10-06T03:00:39.632939+0000","last_clean":"2023-10-06T03:00:39.632939+0000","last_became_active":"2023-10-06T03:00:39.624161+0000","last_became_peered":"2023-10-06T03:00:39.624161+0000","last_unstale":"2023-10-06T03:00:39.632939+0000","last_undegraded":"2023-10-06T03:00:39.632939+0000","last_fullsized":"2023-10-06T03:00:39.632939+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:39.994993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.628174+0000","last_change":"2023-10-06T03:00:39.624988+0000","last_active":"2023-10-06T03:00:39.628174+0000","last_peered":"2023-10-06T03:00:39.628174+0000","last_clean":"2023-10-06T03:00:39.628174+0000","last_became_active":"2023-10-06T03:00:39.624725+0000","last_became_peered":"2023-10-06T03:00:39.624725+0000","last_unstale":"2023-10-06T03:00:39.628174+0000","last_undegraded":"2023-10-06T03:00:39.628174+0000","last_fullsized":"2023-10-06T03:00:39.628174+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:34.326609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.621304+0000","last_change":"2023-10-06T03:00:39.618164+0000","last_active":"2023-10-06T03:00:39.621304+0000","last_peered":"2023-10-06T03:00:39.621304+0000","last_clean":"2023-10-06T03:00:39.621304+0000","last_became_active":"2023-10-06T03:00:39.617905+0000","last_became_peered":"2023-10-06T03:00:39.617905+0000","last_unstale":"2023-10-06T03:00:39.621304+0000","last_undegraded":"2023-10-06T03:00:39.621304+0000","last_fullsized":"2023-10-06T03:00:39.621304+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:35.561259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.618886+0000","last_change":"2023-10-06T03:00:39.617408+0000","last_active":"2023-10-06T03:00:39.618886+0000","last_peered":"2023-10-06T03:00:39.618886+0000","last_clean":"2023-10-06T03:00:39.618886+0000","last_became_active":"2023-10-06T03:00:39.617045+0000","last_became_peered":"2023-10-06T03:00:39.617045+0000","last_unstale":"2023-10-06T03:00:39.618886+0000","last_undegraded":"2023-10-06T03:00:39.618886+0000","last_fullsized":"2023-10-06T03:00:39.618886+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:45.788033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.633845+0000","last_change":"2023-10-06T03:00:39.631547+0000","last_active":"2023-10-06T03:00:39.633845+0000","last_peered":"2023-10-06T03:00:39.633845+0000","last_clean":"2023-10-06T03:00:39.633845+0000","last_became_active":"2023-10-06T03:00:39.631144+0000","last_became_peered":"2023-10-06T03:00:39.631144+0000","last_unstale":"2023-10-06T03:00:39.633845+0000","last_undegraded":"2023-10-06T03:00:39.633845+0000","last_fullsized":"2023-10-06T03:00:39.633845+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:35.321893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.632942+0000","last_change":"2023-10-06T03:00:39.627688+0000","last_active":"2023-10-06T03:00:39.632942+0000","last_peered":"2023-10-06T03:00:39.632942+0000","last_clean":"2023-10-06T03:00:39.632942+0000","last_became_active":"2023-10-06T03:00:39.627405+0000","last_became_peered":"2023-10-06T03:00:39.627405+0000","last_unstale":"2023-10-06T03:00:39.632942+0000","last_undegraded":"2023-10-06T03:00:39.632942+0000","last_fullsized":"2023-10-06T03:00:39.632942+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:41:04.854046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.625737+0000","last_change":"2023-10-06T03:00:39.620568+0000","last_active":"2023-10-06T03:00:39.625737+0000","last_peered":"2023-10-06T03:00:39.625737+0000","last_clean":"2023-10-06T03:00:39.625737+0000","last_became_active":"2023-10-06T03:00:39.620143+0000","last_became_peered":"2023-10-06T03:00:39.620143+0000","last_unstale":"2023-10-06T03:00:39.625737+0000","last_undegraded":"2023-10-06T03:00:39.625737+0000","last_fullsized":"2023-10-06T03:00:39.625737+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:06.829781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.633016+0000","last_change":"2023-10-06T03:00:39.628895+0000","last_active":"2023-10-06T03:00:39.633016+0000","last_peered":"2023-10-06T03:00:39.633016+0000","last_clean":"2023-10-06T03:00:39.633016+0000","last_became_active":"2023-10-06T03:00:39.628343+0000","last_became_peered":"2023-10-06T03:00:39.628343+0000","last_unstale":"2023-10-06T03:00:39.633016+0000","last_undegraded":"2023-10-06T03:00:39.633016+0000","last_fullsized":"2023-10-06T03:00:39.633016+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:45.959231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.617306+0000","last_change":"2023-10-06T03:00:39.613994+0000","last_active":"2023-10-06T03:00:39.617306+0000","last_peered":"2023-10-06T03:00:39.617306+0000","last_clean":"2023-10-06T03:00:39.617306+0000","last_became_active":"2023-10-06T03:00:39.613727+0000","last_became_peered":"2023-10-06T03:00:39.613727+0000","last_unstale":"2023-10-06T03:00:39.617306+0000","last_undegraded":"2023-10-06T03:00:39.617306+0000","last_fullsized":"2023-10-06T03:00:39.617306+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:29:45.364048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.617334+0000","last_change":"2023-10-06T03:00:39.613922+0000","last_active":"2023-10-06T03:00:39.617334+0000","last_peered":"2023-10-06T03:00:39.617334+0000","last_clean":"2023-10-06T03:00:39.617334+0000","last_became_active":"2023-10-06T03:00:39.613640+0000","last_became_peered":"2023-10-06T03:00:39.613640+0000","last_unstale":"2023-10-06T03:00:39.617334+0000","last_undegraded":"2023-10-06T03:00:39.617334+0000","last_fullsized":"2023-10-06T03:00:39.617334+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:45.872015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.619438+0000","last_change":"2023-10-06T03:00:39.617543+0000","last_active":"2023-10-06T03:00:39.619438+0000","last_peered":"2023-10-06T03:00:39.619438+0000","last_clean":"2023-10-06T03:00:39.619438+0000","last_became_active":"2023-10-06T03:00:39.617236+0000","last_became_peered":"2023-10-06T03:00:39.617236+0000","last_unstale":"2023-10-06T03:00:39.619438+0000","last_undegraded":"2023-10-06T03:00:39.619438+0000","last_fullsized":"2023-10-06T03:00:39.619438+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.322266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.622271+0000","last_change":"2023-10-06T03:00:39.616138+0000","last_active":"2023-10-06T03:00:39.622271+0000","last_peered":"2023-10-06T03:00:39.622271+0000","last_clean":"2023-10-06T03:00:39.622271+0000","last_became_active":"2023-10-06T03:00:39.615738+0000","last_became_peered":"2023-10-06T03:00:39.615738+0000","last_unstale":"2023-10-06T03:00:39.622271+0000","last_undegraded":"2023-10-06T03:00:39.622271+0000","last_fullsized":"2023-10-06T03:00:39.622271+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:12:17.811217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.625171+0000","last_change":"2023-10-06T03:00:39.621602+0000","last_active":"2023-10-06T03:00:39.625171+0000","last_peered":"2023-10-06T03:00:39.625171+0000","last_clean":"2023-10-06T03:00:39.625171+0000","last_became_active":"2023-10-06T03:00:39.621294+0000","last_became_peered":"2023-10-06T03:00:39.621294+0000","last_unstale":"2023-10-06T03:00:39.625171+0000","last_undegraded":"2023-10-06T03:00:39.625171+0000","last_fullsized":"2023-10-06T03:00:39.625171+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:40.741250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.634232+0000","last_change":"2023-10-06T03:00:39.631192+0000","last_active":"2023-10-06T03:00:39.634232+0000","last_peered":"2023-10-06T03:00:39.634232+0000","last_clean":"2023-10-06T03:00:39.634232+0000","last_became_active":"2023-10-06T03:00:39.630956+0000","last_became_peered":"2023-10-06T03:00:39.630956+0000","last_unstale":"2023-10-06T03:00:39.634232+0000","last_undegraded":"2023-10-06T03:00:39.634232+0000","last_fullsized":"2023-10-06T03:00:39.634232+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:49.788635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.623421+0000","last_change":"2023-10-06T03:00:39.618612+0000","last_active":"2023-10-06T03:00:39.623421+0000","last_peered":"2023-10-06T03:00:39.623421+0000","last_clean":"2023-10-06T03:00:39.623421+0000","last_became_active":"2023-10-06T03:00:39.617340+0000","last_became_peered":"2023-10-06T03:00:39.617340+0000","last_unstale":"2023-10-06T03:00:39.623421+0000","last_undegraded":"2023-10-06T03:00:39.623421+0000","last_fullsized":"2023-10-06T03:00:39.623421+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:40.117914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.618858+0000","last_change":"2023-10-06T03:00:39.614891+0000","last_active":"2023-10-06T03:00:39.618858+0000","last_peered":"2023-10-06T03:00:39.618858+0000","last_clean":"2023-10-06T03:00:39.618858+0000","last_became_active":"2023-10-06T03:00:39.614469+0000","last_became_peered":"2023-10-06T03:00:39.614469+0000","last_unstale":"2023-10-06T03:00:39.618858+0000","last_undegraded":"2023-10-06T03:00:39.618858+0000","last_fullsized":"2023-10-06T03:00:39.618858+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:27.568403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.632916+0000","last_change":"2023-10-06T03:00:39.627466+0000","last_active":"2023-10-06T03:00:39.632916+0000","last_peered":"2023-10-06T03:00:39.632916+0000","last_clean":"2023-10-06T03:00:39.632916+0000","last_became_active":"2023-10-06T03:00:39.624950+0000","last_became_peered":"2023-10-06T03:00:39.624950+0000","last_unstale":"2023-10-06T03:00:39.632916+0000","last_undegraded":"2023-10-06T03:00:39.632916+0000","last_fullsized":"2023-10-06T03:00:39.632916+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:54.869434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.619898+0000","last_change":"2023-10-06T03:00:39.617777+0000","last_active":"2023-10-06T03:00:39.619898+0000","last_peered":"2023-10-06T03:00:39.619898+0000","last_clean":"2023-10-06T03:00:39.619898+0000","last_became_active":"2023-10-06T03:00:39.617493+0000","last_became_peered":"2023-10-06T03:00:39.617493+0000","last_unstale":"2023-10-06T03:00:39.619898+0000","last_undegraded":"2023-10-06T03:00:39.619898+0000","last_fullsized":"2023-10-06T03:00:39.619898+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:59.738043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.626001+0000","last_change":"2023-10-06T03:00:39.622220+0000","last_active":"2023-10-06T03:00:39.626001+0000","last_peered":"2023-10-06T03:00:39.626001+0000","last_clean":"2023-10-06T03:00:39.626001+0000","last_became_active":"2023-10-06T03:00:39.621973+0000","last_became_peered":"2023-10-06T03:00:39.621973+0000","last_unstale":"2023-10-06T03:00:39.626001+0000","last_undegraded":"2023-10-06T03:00:39.626001+0000","last_fullsized":"2023-10-06T03:00:39.626001+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:50.188507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.632767+0000","last_change":"2023-10-06T03:00:39.623446+0000","last_active":"2023-10-06T03:00:39.632767+0000","last_peered":"2023-10-06T03:00:39.632767+0000","last_clean":"2023-10-06T03:00:39.632767+0000","last_became_active":"2023-10-06T03:00:39.623193+0000","last_became_peered":"2023-10-06T03:00:39.623193+0000","last_unstale":"2023-10-06T03:00:39.632767+0000","last_undegraded":"2023-10-06T03:00:39.632767+0000","last_fullsized":"2023-10-06T03:00:39.632767+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:27:07.005112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.620407+0000","last_change":"2023-10-06T03:00:38.610992+0000","last_active":"2023-10-06T03:00:39.620407+0000","last_peered":"2023-10-06T03:00:39.620407+0000","last_clean":"2023-10-06T03:00:39.620407+0000","last_became_active":"2023-10-06T03:00:38.610740+0000","last_became_peered":"2023-10-06T03:00:38.610740+0000","last_unstale":"2023-10-06T03:00:39.620407+0000","last_undegraded":"2023-10-06T03:00:39.620407+0000","last_fullsized":"2023-10-06T03:00:39.620407+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:25.786744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.625325+0000","last_change":"2023-10-06T03:00:39.620992+0000","last_active":"2023-10-06T03:00:39.625325+0000","last_peered":"2023-10-06T03:00:39.625325+0000","last_clean":"2023-10-06T03:00:39.625325+0000","last_became_active":"2023-10-06T03:00:39.620661+0000","last_became_peered":"2023-10-06T03:00:39.620661+0000","last_unstale":"2023-10-06T03:00:39.625325+0000","last_undegraded":"2023-10-06T03:00:39.625325+0000","last_fullsized":"2023-10-06T03:00:39.625325+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.322266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.620876+0000","last_change":"2023-10-06T03:00:38.621226+0000","last_active":"2023-10-06T03:00:39.620876+0000","last_peered":"2023-10-06T03:00:39.620876+0000","last_clean":"2023-10-06T03:00:39.620876+0000","last_became_active":"2023-10-06T03:00:38.620988+0000","last_became_peered":"2023-10-06T03:00:38.620988+0000","last_unstale":"2023-10-06T03:00:39.620876+0000","last_undegraded":"2023-10-06T03:00:39.620876+0000","last_fullsized":"2023-10-06T03:00:39.620876+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:29.938752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.625973+0000","last_change":"2023-10-06T03:00:39.617136+0000","last_active":"2023-10-06T03:00:39.625973+0000","last_peered":"2023-10-06T03:00:39.625973+0000","last_clean":"2023-10-06T03:00:39.625973+0000","last_became_active":"2023-10-06T03:00:39.616885+0000","last_became_peered":"2023-10-06T03:00:39.616885+0000","last_unstale":"2023-10-06T03:00:39.625973+0000","last_undegraded":"2023-10-06T03:00:39.625973+0000","last_fullsized":"2023-10-06T03:00:39.625973+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:44.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.630692+0000","last_change":"2023-10-06T03:00:38.615667+0000","last_active":"2023-10-06T03:00:39.630692+0000","last_peered":"2023-10-06T03:00:39.630692+0000","last_clean":"2023-10-06T03:00:39.630692+0000","last_became_active":"2023-10-06T03:00:38.615468+0000","last_became_peered":"2023-10-06T03:00:38.615468+0000","last_unstale":"2023-10-06T03:00:39.630692+0000","last_undegraded":"2023-10-06T03:00:39.630692+0000","last_fullsized":"2023-10-06T03:00:39.630692+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:58.730027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.617486+0000","last_change":"2023-10-06T03:00:39.614864+0000","last_active":"2023-10-06T03:00:39.617486+0000","last_peered":"2023-10-06T03:00:39.617486+0000","last_clean":"2023-10-06T03:00:39.617486+0000","last_became_active":"2023-10-06T03:00:39.614089+0000","last_became_peered":"2023-10-06T03:00:39.614089+0000","last_unstale":"2023-10-06T03:00:39.617486+0000","last_undegraded":"2023-10-06T03:00:39.617486+0000","last_fullsized":"2023-10-06T03:00:39.617486+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:27.604859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.621285+0000","last_change":"2023-10-06T03:00:38.611646+0000","last_active":"2023-10-06T03:00:39.621285+0000","last_peered":"2023-10-06T03:00:39.621285+0000","last_clean":"2023-10-06T03:00:39.621285+0000","last_became_active":"2023-10-06T03:00:38.611385+0000","last_became_peered":"2023-10-06T03:00:38.611385+0000","last_unstale":"2023-10-06T03:00:39.621285+0000","last_undegraded":"2023-10-06T03:00:39.621285+0000","last_fullsized":"2023-10-06T03:00:39.621285+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:00:39.554832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.622912+0000","last_change":"2023-10-06T03:00:39.614905+0000","last_active":"2023-10-06T03:00:39.622912+0000","last_peered":"2023-10-06T03:00:39.622912+0000","last_clean":"2023-10-06T03:00:39.622912+0000","last_became_active":"2023-10-06T03:00:39.614549+0000","last_became_peered":"2023-10-06T03:00:39.614549+0000","last_unstale":"2023-10-06T03:00:39.622912+0000","last_undegraded":"2023-10-06T03:00:39.622912+0000","last_fullsized":"2023-10-06T03:00:39.622912+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:39.924480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.618911+0000","last_change":"2023-10-06T03:00:38.612839+0000","last_active":"2023-10-06T03:00:39.618911+0000","last_peered":"2023-10-06T03:00:39.618911+0000","last_clean":"2023-10-06T03:00:39.618911+0000","last_became_active":"2023-10-06T03:00:38.611041+0000","last_became_peered":"2023-10-06T03:00:38.611041+0000","last_unstale":"2023-10-06T03:00:39.618911+0000","last_undegraded":"2023-10-06T03:00:39.618911+0000","last_fullsized":"2023-10-06T03:00:39.618911+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:43.393360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.613425+0000","last_change":"2023-10-06T03:00:39.605539+0000","last_active":"2023-10-06T03:00:39.613425+0000","last_peered":"2023-10-06T03:00:39.613425+0000","last_clean":"2023-10-06T03:00:39.613425+0000","last_became_active":"2023-10-06T03:00:39.605277+0000","last_became_peered":"2023-10-06T03:00:39.605277+0000","last_unstale":"2023-10-06T03:00:39.613425+0000","last_undegraded":"2023-10-06T03:00:39.613425+0000","last_fullsized":"2023-10-06T03:00:39.613425+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:13:16.179195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.620529+0000","last_change":"2023-10-06T03:00:38.609253+0000","last_active":"2023-10-06T03:00:39.620529+0000","last_peered":"2023-10-06T03:00:39.620529+0000","last_clean":"2023-10-06T03:00:39.620529+0000","last_became_active":"2023-10-06T03:00:38.609006+0000","last_became_peered":"2023-10-06T03:00:38.609006+0000","last_unstale":"2023-10-06T03:00:39.620529+0000","last_undegraded":"2023-10-06T03:00:39.620529+0000","last_fullsized":"2023-10-06T03:00:39.620529+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:49.712054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.622560+0000","last_change":"2023-10-06T03:00:39.619476+0000","last_active":"2023-10-06T03:00:39.622560+0000","last_peered":"2023-10-06T03:00:39.622560+0000","last_clean":"2023-10-06T03:00:39.622560+0000","last_became_active":"2023-10-06T03:00:39.619221+0000","last_became_peered":"2023-10-06T03:00:39.619221+0000","last_unstale":"2023-10-06T03:00:39.622560+0000","last_undegraded":"2023-10-06T03:00:39.622560+0000","last_fullsized":"2023-10-06T03:00:39.622560+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:36.244665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.599493+0000","last_change":"2023-10-06T03:00:38.608740+0000","last_active":"2023-10-06T03:00:39.599493+0000","last_peered":"2023-10-06T03:00:39.599493+0000","last_clean":"2023-10-06T03:00:39.599493+0000","last_became_active":"2023-10-06T03:00:38.608391+0000","last_became_peered":"2023-10-06T03:00:38.608391+0000","last_unstale":"2023-10-06T03:00:39.599493+0000","last_undegraded":"2023-10-06T03:00:39.599493+0000","last_fullsized":"2023-10-06T03:00:39.599493+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:03.710659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.616908+0000","last_change":"2023-10-06T03:00:39.614463+0000","last_active":"2023-10-06T03:00:39.616908+0000","last_peered":"2023-10-06T03:00:39.616908+0000","last_clean":"2023-10-06T03:00:39.616908+0000","last_became_active":"2023-10-06T03:00:39.614139+0000","last_became_peered":"2023-10-06T03:00:39.614139+0000","last_unstale":"2023-10-06T03:00:39.616908+0000","last_undegraded":"2023-10-06T03:00:39.616908+0000","last_fullsized":"2023-10-06T03:00:39.616908+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:06:44.876137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.601382+0000","last_change":"2023-10-06T03:00:38.612718+0000","last_active":"2023-10-06T03:00:39.601382+0000","last_peered":"2023-10-06T03:00:39.601382+0000","last_clean":"2023-10-06T03:00:39.601382+0000","last_became_active":"2023-10-06T03:00:38.610838+0000","last_became_peered":"2023-10-06T03:00:38.610838+0000","last_unstale":"2023-10-06T03:00:39.601382+0000","last_undegraded":"2023-10-06T03:00:39.601382+0000","last_fullsized":"2023-10-06T03:00:39.601382+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:02.041332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.621704+0000","last_change":"2023-10-06T03:00:39.618631+0000","last_active":"2023-10-06T03:00:39.621704+0000","last_peered":"2023-10-06T03:00:39.621704+0000","last_clean":"2023-10-06T03:00:39.621704+0000","last_became_active":"2023-10-06T03:00:39.618322+0000","last_became_peered":"2023-10-06T03:00:39.618322+0000","last_unstale":"2023-10-06T03:00:39.621704+0000","last_undegraded":"2023-10-06T03:00:39.621704+0000","last_fullsized":"2023-10-06T03:00:39.621704+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:55:53.427580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.604317+0000","last_change":"2023-10-06T03:00:38.610365+0000","last_active":"2023-10-06T03:00:39.604317+0000","last_peered":"2023-10-06T03:00:39.604317+0000","last_clean":"2023-10-06T03:00:39.604317+0000","last_became_active":"2023-10-06T03:00:38.610069+0000","last_became_peered":"2023-10-06T03:00:38.610069+0000","last_unstale":"2023-10-06T03:00:39.604317+0000","last_undegraded":"2023-10-06T03:00:39.604317+0000","last_fullsized":"2023-10-06T03:00:39.604317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:42:27.800063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.622195+0000","last_change":"2023-10-06T03:00:39.615853+0000","last_active":"2023-10-06T03:00:39.622195+0000","last_peered":"2023-10-06T03:00:39.622195+0000","last_clean":"2023-10-06T03:00:39.622195+0000","last_became_active":"2023-10-06T03:00:39.615323+0000","last_became_peered":"2023-10-06T03:00:39.615323+0000","last_unstale":"2023-10-06T03:00:39.622195+0000","last_undegraded":"2023-10-06T03:00:39.622195+0000","last_fullsized":"2023-10-06T03:00:39.622195+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:19.315240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.609321+0000","last_change":"2023-10-06T03:00:38.611067+0000","last_active":"2023-10-06T03:00:39.609321+0000","last_peered":"2023-10-06T03:00:39.609321+0000","last_clean":"2023-10-06T03:00:39.609321+0000","last_became_active":"2023-10-06T03:00:38.610826+0000","last_became_peered":"2023-10-06T03:00:38.610826+0000","last_unstale":"2023-10-06T03:00:39.609321+0000","last_undegraded":"2023-10-06T03:00:39.609321+0000","last_fullsized":"2023-10-06T03:00:39.609321+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:02.991587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.622662+0000","last_change":"2023-10-06T03:00:39.616535+0000","last_active":"2023-10-06T03:00:39.622662+0000","last_peered":"2023-10-06T03:00:39.622662+0000","last_clean":"2023-10-06T03:00:39.622662+0000","last_became_active":"2023-10-06T03:00:39.613155+0000","last_became_peered":"2023-10-06T03:00:39.613155+0000","last_unstale":"2023-10-06T03:00:39.622662+0000","last_undegraded":"2023-10-06T03:00:39.622662+0000","last_fullsized":"2023-10-06T03:00:39.622662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:16.856948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.621756+0000","last_change":"2023-10-06T03:00:38.611585+0000","last_active":"2023-10-06T03:00:39.621756+0000","last_peered":"2023-10-06T03:00:39.621756+0000","last_clean":"2023-10-06T03:00:39.621756+0000","last_became_active":"2023-10-06T03:00:38.611323+0000","last_became_peered":"2023-10-06T03:00:38.611323+0000","last_unstale":"2023-10-06T03:00:39.621756+0000","last_undegraded":"2023-10-06T03:00:39.621756+0000","last_fullsized":"2023-10-06T03:00:39.621756+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:39.109899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.621822+0000","last_change":"2023-10-06T03:00:39.619022+0000","last_active":"2023-10-06T03:00:39.621822+0000","last_peered":"2023-10-06T03:00:39.621822+0000","last_clean":"2023-10-06T03:00:39.621822+0000","last_became_active":"2023-10-06T03:00:39.617178+0000","last_became_peered":"2023-10-06T03:00:39.617178+0000","last_unstale":"2023-10-06T03:00:39.621822+0000","last_undegraded":"2023-10-06T03:00:39.621822+0000","last_fullsized":"2023-10-06T03:00:39.621822+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:41.901013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"93'6","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.626061+0000","last_change":"2023-10-06T03:00:38.611028+0000","last_active":"2023-10-06T03:00:39.626061+0000","last_peered":"2023-10-06T03:00:39.626061+0000","last_clean":"2023-10-06T03:00:39.626061+0000","last_became_active":"2023-10-06T03:00:38.610750+0000","last_became_peered":"2023-10-06T03:00:38.610750+0000","last_unstale":"2023-10-06T03:00:39.626061+0000","last_undegraded":"2023-10-06T03:00:39.626061+0000","last_fullsized":"2023-10-06T03:00:39.626061+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:21.751299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.618008+0000","last_change":"2023-10-06T03:00:39.615806+0000","last_active":"2023-10-06T03:00:39.618008+0000","last_peered":"2023-10-06T03:00:39.618008+0000","last_clean":"2023-10-06T03:00:39.618008+0000","last_became_active":"2023-10-06T03:00:39.615558+0000","last_became_peered":"2023-10-06T03:00:39.615558+0000","last_unstale":"2023-10-06T03:00:39.618008+0000","last_undegraded":"2023-10-06T03:00:39.618008+0000","last_fullsized":"2023-10-06T03:00:39.618008+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:50.720070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.628185+0000","last_change":"2023-10-06T03:00:38.613814+0000","last_active":"2023-10-06T03:00:39.628185+0000","last_peered":"2023-10-06T03:00:39.628185+0000","last_clean":"2023-10-06T03:00:39.628185+0000","last_became_active":"2023-10-06T03:00:38.613461+0000","last_became_peered":"2023-10-06T03:00:38.613461+0000","last_unstale":"2023-10-06T03:00:39.628185+0000","last_undegraded":"2023-10-06T03:00:39.628185+0000","last_fullsized":"2023-10-06T03:00:39.628185+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:13.881016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.629806+0000","last_change":"2023-10-06T03:00:39.629298+0000","last_active":"2023-10-06T03:00:39.629806+0000","last_peered":"2023-10-06T03:00:39.629806+0000","last_clean":"2023-10-06T03:00:39.629806+0000","last_became_active":"2023-10-06T03:00:39.629045+0000","last_became_peered":"2023-10-06T03:00:39.629045+0000","last_unstale":"2023-10-06T03:00:39.629806+0000","last_undegraded":"2023-10-06T03:00:39.629806+0000","last_fullsized":"2023-10-06T03:00:39.629806+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:28.415937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.608193+0000","last_change":"2023-10-06T03:00:38.611362+0000","last_active":"2023-10-06T03:00:39.608193+0000","last_peered":"2023-10-06T03:00:39.608193+0000","last_clean":"2023-10-06T03:00:39.608193+0000","last_became_active":"2023-10-06T03:00:38.611104+0000","last_became_peered":"2023-10-06T03:00:38.611104+0000","last_unstale":"2023-10-06T03:00:39.608193+0000","last_undegraded":"2023-10-06T03:00:39.608193+0000","last_fullsized":"2023-10-06T03:00:39.608193+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:08.219515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.622227+0000","last_change":"2023-10-06T03:00:39.616361+0000","last_active":"2023-10-06T03:00:39.622227+0000","last_peered":"2023-10-06T03:00:39.622227+0000","last_clean":"2023-10-06T03:00:39.622227+0000","last_became_active":"2023-10-06T03:00:39.616099+0000","last_became_peered":"2023-10-06T03:00:39.616099+0000","last_unstale":"2023-10-06T03:00:39.622227+0000","last_undegraded":"2023-10-06T03:00:39.622227+0000","last_fullsized":"2023-10-06T03:00:39.622227+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:32:35.561259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.609634+0000","last_change":"2023-10-06T03:00:38.611183+0000","last_active":"2023-10-06T03:00:39.609634+0000","last_peered":"2023-10-06T03:00:39.609634+0000","last_clean":"2023-10-06T03:00:39.609634+0000","last_became_active":"2023-10-06T03:00:38.610909+0000","last_became_peered":"2023-10-06T03:00:38.610909+0000","last_unstale":"2023-10-06T03:00:39.609634+0000","last_undegraded":"2023-10-06T03:00:39.609634+0000","last_fullsized":"2023-10-06T03:00:39.609634+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:49.712054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.632888+0000","last_change":"2023-10-06T03:00:39.627108+0000","last_active":"2023-10-06T03:00:39.632888+0000","last_peered":"2023-10-06T03:00:39.632888+0000","last_clean":"2023-10-06T03:00:39.632888+0000","last_became_active":"2023-10-06T03:00:39.623662+0000","last_became_peered":"2023-10-06T03:00:39.623662+0000","last_unstale":"2023-10-06T03:00:39.632888+0000","last_undegraded":"2023-10-06T03:00:39.632888+0000","last_fullsized":"2023-10-06T03:00:39.632888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:34.683526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"93'8","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.620452+0000","last_change":"2023-10-06T03:00:38.611096+0000","last_active":"2023-10-06T03:00:39.620452+0000","last_peered":"2023-10-06T03:00:39.620452+0000","last_clean":"2023-10-06T03:00:39.620452+0000","last_became_active":"2023-10-06T03:00:38.610525+0000","last_became_peered":"2023-10-06T03:00:38.610525+0000","last_unstale":"2023-10-06T03:00:39.620452+0000","last_undegraded":"2023-10-06T03:00:39.620452+0000","last_fullsized":"2023-10-06T03:00:39.620452+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:33.675510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.618516+0000","last_change":"2023-10-06T03:00:39.611709+0000","last_active":"2023-10-06T03:00:39.618516+0000","last_peered":"2023-10-06T03:00:39.618516+0000","last_clean":"2023-10-06T03:00:39.618516+0000","last_became_active":"2023-10-06T03:00:39.611459+0000","last_became_peered":"2023-10-06T03:00:39.611459+0000","last_unstale":"2023-10-06T03:00:39.618516+0000","last_undegraded":"2023-10-06T03:00:39.618516+0000","last_fullsized":"2023-10-06T03:00:39.618516+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:43:17.565556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.620970+0000","last_change":"2023-10-06T03:00:38.610447+0000","last_active":"2023-10-06T03:00:39.620970+0000","last_peered":"2023-10-06T03:00:39.620970+0000","last_clean":"2023-10-06T03:00:39.620970+0000","last_became_active":"2023-10-06T03:00:38.610220+0000","last_became_peered":"2023-10-06T03:00:38.610220+0000","last_unstale":"2023-10-06T03:00:39.620970+0000","last_undegraded":"2023-10-06T03:00:39.620970+0000","last_fullsized":"2023-10-06T03:00:39.620970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:14.557028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.626116+0000","last_change":"2023-10-06T03:00:39.625019+0000","last_active":"2023-10-06T03:00:39.626116+0000","last_peered":"2023-10-06T03:00:39.626116+0000","last_clean":"2023-10-06T03:00:39.626116+0000","last_became_active":"2023-10-06T03:00:39.624717+0000","last_became_peered":"2023-10-06T03:00:39.624717+0000","last_unstale":"2023-10-06T03:00:39.626116+0000","last_undegraded":"2023-10-06T03:00:39.626116+0000","last_fullsized":"2023-10-06T03:00:39.626116+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:54.869434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"94'1","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-06T03:00:40.599516+0000","last_change":"2023-10-06T03:00:38.611822+0000","last_active":"2023-10-06T03:00:40.599516+0000","last_peered":"2023-10-06T03:00:40.599516+0000","last_clean":"2023-10-06T03:00:40.599516+0000","last_became_active":"2023-10-06T03:00:38.611473+0000","last_became_peered":"2023-10-06T03:00:38.611473+0000","last_unstale":"2023-10-06T03:00:40.599516+0000","last_undegraded":"2023-10-06T03:00:40.599516+0000","last_fullsized":"2023-10-06T03:00:40.599516+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:34.313878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.625953+0000","last_change":"2023-10-06T03:00:39.615134+0000","last_active":"2023-10-06T03:00:39.625953+0000","last_peered":"2023-10-06T03:00:39.625953+0000","last_clean":"2023-10-06T03:00:39.625953+0000","last_became_active":"2023-10-06T03:00:39.614867+0000","last_became_peered":"2023-10-06T03:00:39.614867+0000","last_unstale":"2023-10-06T03:00:39.625953+0000","last_undegraded":"2023-10-06T03:00:39.625953+0000","last_fullsized":"2023-10-06T03:00:39.625953+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:18.003384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.598517+0000","last_change":"2023-10-06T03:00:38.611099+0000","last_active":"2023-10-06T03:00:39.598517+0000","last_peered":"2023-10-06T03:00:39.598517+0000","last_clean":"2023-10-06T03:00:39.598517+0000","last_became_active":"2023-10-06T03:00:38.610863+0000","last_became_peered":"2023-10-06T03:00:38.610863+0000","last_unstale":"2023-10-06T03:00:39.598517+0000","last_undegraded":"2023-10-06T03:00:39.598517+0000","last_fullsized":"2023-10-06T03:00:39.598517+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:49:21.679086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.626463+0000","last_change":"2023-10-06T03:00:39.623434+0000","last_active":"2023-10-06T03:00:39.626463+0000","last_peered":"2023-10-06T03:00:39.626463+0000","last_clean":"2023-10-06T03:00:39.626463+0000","last_became_active":"2023-10-06T03:00:39.623017+0000","last_became_peered":"2023-10-06T03:00:39.623017+0000","last_unstale":"2023-10-06T03:00:39.626463+0000","last_undegraded":"2023-10-06T03:00:39.626463+0000","last_fullsized":"2023-10-06T03:00:39.626463+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:25.184133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.599588+0000","last_change":"2023-10-06T03:00:38.610942+0000","last_active":"2023-10-06T03:00:39.599588+0000","last_peered":"2023-10-06T03:00:39.599588+0000","last_clean":"2023-10-06T03:00:39.599588+0000","last_became_active":"2023-10-06T03:00:38.610652+0000","last_became_peered":"2023-10-06T03:00:38.610652+0000","last_unstale":"2023-10-06T03:00:39.599588+0000","last_undegraded":"2023-10-06T03:00:39.599588+0000","last_fullsized":"2023-10-06T03:00:39.599588+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:09.545331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.632864+0000","last_change":"2023-10-06T03:00:39.625374+0000","last_active":"2023-10-06T03:00:39.632864+0000","last_peered":"2023-10-06T03:00:39.632864+0000","last_clean":"2023-10-06T03:00:39.632864+0000","last_became_active":"2023-10-06T03:00:39.623916+0000","last_became_peered":"2023-10-06T03:00:39.623916+0000","last_unstale":"2023-10-06T03:00:39.632864+0000","last_undegraded":"2023-10-06T03:00:39.632864+0000","last_fullsized":"2023-10-06T03:00:39.632864+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:28:14.662376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.598271+0000","last_change":"2023-10-06T03:00:38.608342+0000","last_active":"2023-10-06T03:00:39.598271+0000","last_peered":"2023-10-06T03:00:39.598271+0000","last_clean":"2023-10-06T03:00:39.598271+0000","last_became_active":"2023-10-06T03:00:38.608055+0000","last_became_peered":"2023-10-06T03:00:38.608055+0000","last_unstale":"2023-10-06T03:00:39.598271+0000","last_undegraded":"2023-10-06T03:00:39.598271+0000","last_fullsized":"2023-10-06T03:00:39.598271+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:41.523817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.625824+0000","last_change":"2023-10-06T03:00:39.621455+0000","last_active":"2023-10-06T03:00:39.625824+0000","last_peered":"2023-10-06T03:00:39.625824+0000","last_clean":"2023-10-06T03:00:39.625824+0000","last_became_active":"2023-10-06T03:00:39.621260+0000","last_became_peered":"2023-10-06T03:00:39.621260+0000","last_unstale":"2023-10-06T03:00:39.625824+0000","last_undegraded":"2023-10-06T03:00:39.625824+0000","last_fullsized":"2023-10-06T03:00:39.625824+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:20.458747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.599245+0000","last_change":"2023-10-06T03:00:38.611188+0000","last_active":"2023-10-06T03:00:39.599245+0000","last_peered":"2023-10-06T03:00:39.599245+0000","last_clean":"2023-10-06T03:00:39.599245+0000","last_became_active":"2023-10-06T03:00:38.610932+0000","last_became_peered":"2023-10-06T03:00:38.610932+0000","last_unstale":"2023-10-06T03:00:39.599245+0000","last_undegraded":"2023-10-06T03:00:39.599245+0000","last_fullsized":"2023-10-06T03:00:39.599245+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:45.110149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.632979+0000","last_change":"2023-10-06T03:00:39.624162+0000","last_active":"2023-10-06T03:00:39.632979+0000","last_peered":"2023-10-06T03:00:39.632979+0000","last_clean":"2023-10-06T03:00:39.632979+0000","last_became_active":"2023-10-06T03:00:39.623914+0000","last_became_peered":"2023-10-06T03:00:39.623914+0000","last_unstale":"2023-10-06T03:00:39.632979+0000","last_undegraded":"2023-10-06T03:00:39.632979+0000","last_fullsized":"2023-10-06T03:00:39.632979+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:33.428483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.613511+0000","last_change":"2023-10-06T03:00:38.604472+0000","last_active":"2023-10-06T03:00:39.613511+0000","last_peered":"2023-10-06T03:00:39.613511+0000","last_clean":"2023-10-06T03:00:39.613511+0000","last_became_active":"2023-10-06T03:00:38.603951+0000","last_became_peered":"2023-10-06T03:00:38.603951+0000","last_unstale":"2023-10-06T03:00:39.613511+0000","last_undegraded":"2023-10-06T03:00:39.613511+0000","last_fullsized":"2023-10-06T03:00:39.613511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:24.176118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.623386+0000","last_change":"2023-10-06T03:00:39.618523+0000","last_active":"2023-10-06T03:00:39.623386+0000","last_peered":"2023-10-06T03:00:39.623386+0000","last_clean":"2023-10-06T03:00:39.623386+0000","last_became_active":"2023-10-06T03:00:39.618278+0000","last_became_peered":"2023-10-06T03:00:39.618278+0000","last_unstale":"2023-10-06T03:00:39.623386+0000","last_undegraded":"2023-10-06T03:00:39.623386+0000","last_fullsized":"2023-10-06T03:00:39.623386+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:11.699117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.607447+0000","last_change":"2023-10-06T03:00:38.611690+0000","last_active":"2023-10-06T03:00:39.607447+0000","last_peered":"2023-10-06T03:00:39.607447+0000","last_clean":"2023-10-06T03:00:39.607447+0000","last_became_active":"2023-10-06T03:00:38.611427+0000","last_became_peered":"2023-10-06T03:00:38.611427+0000","last_unstale":"2023-10-06T03:00:39.607447+0000","last_undegraded":"2023-10-06T03:00:39.607447+0000","last_fullsized":"2023-10-06T03:00:39.607447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:14.592153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.623523+0000","last_change":"2023-10-06T03:00:39.620571+0000","last_active":"2023-10-06T03:00:39.623523+0000","last_peered":"2023-10-06T03:00:39.623523+0000","last_clean":"2023-10-06T03:00:39.623523+0000","last_became_active":"2023-10-06T03:00:39.620316+0000","last_became_peered":"2023-10-06T03:00:39.620316+0000","last_unstale":"2023-10-06T03:00:39.623523+0000","last_undegraded":"2023-10-06T03:00:39.623523+0000","last_fullsized":"2023-10-06T03:00:39.623523+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:14.168944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.597912+0000","last_change":"2023-10-06T03:00:38.621210+0000","last_active":"2023-10-06T03:00:39.597912+0000","last_peered":"2023-10-06T03:00:39.597912+0000","last_clean":"2023-10-06T03:00:39.597912+0000","last_became_active":"2023-10-06T03:00:38.620944+0000","last_became_peered":"2023-10-06T03:00:38.620944+0000","last_unstale":"2023-10-06T03:00:39.597912+0000","last_undegraded":"2023-10-06T03:00:39.597912+0000","last_fullsized":"2023-10-06T03:00:39.597912+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:33.318594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.604190+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T03:00:39.604190+0000","last_peered":"2023-10-06T03:00:39.604190+0000","last_clean":"2023-10-06T03:00:39.604190+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T03:00:39.604190+0000","last_undegraded":"2023-10-06T03:00:39.604190+0000","last_fullsized":"2023-10-06T03:00:39.604190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.623333+0000","last_change":"2023-10-06T03:00:39.618072+0000","last_active":"2023-10-06T03:00:39.623333+0000","last_peered":"2023-10-06T03:00:39.623333+0000","last_clean":"2023-10-06T03:00:39.623333+0000","last_became_active":"2023-10-06T03:00:39.617827+0000","last_became_peered":"2023-10-06T03:00:39.617827+0000","last_unstale":"2023-10-06T03:00:39.623333+0000","last_undegraded":"2023-10-06T03:00:39.623333+0000","last_fullsized":"2023-10-06T03:00:39.623333+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:47.901192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.624042+0000","last_change":"2023-10-06T03:00:38.611563+0000","last_active":"2023-10-06T03:00:39.624042+0000","last_peered":"2023-10-06T03:00:39.624042+0000","last_clean":"2023-10-06T03:00:39.624042+0000","last_became_active":"2023-10-06T03:00:38.611308+0000","last_became_peered":"2023-10-06T03:00:38.611308+0000","last_unstale":"2023-10-06T03:00:39.624042+0000","last_undegraded":"2023-10-06T03:00:39.624042+0000","last_fullsized":"2023-10-06T03:00:39.624042+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:33.318594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":71,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.611061+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T03:00:39.611061+0000","last_peered":"2023-10-06T03:00:39.611061+0000","last_clean":"2023-10-06T03:00:39.611061+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T03:00:39.611061+0000","last_undegraded":"2023-10-06T03:00:39.611061+0000","last_fullsized":"2023-10-06T03:00:39.611061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.620780+0000","last_change":"2023-10-06T03:00:39.613003+0000","last_active":"2023-10-06T03:00:39.620780+0000","last_peered":"2023-10-06T03:00:39.620780+0000","last_clean":"2023-10-06T03:00:39.620780+0000","last_became_active":"2023-10-06T03:00:39.612737+0000","last_became_peered":"2023-10-06T03:00:39.612737+0000","last_unstale":"2023-10-06T03:00:39.620780+0000","last_undegraded":"2023-10-06T03:00:39.620780+0000","last_fullsized":"2023-10-06T03:00:39.620780+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:24:45.843117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.623277+0000","last_change":"2023-10-06T03:00:38.608515+0000","last_active":"2023-10-06T03:00:39.623277+0000","last_peered":"2023-10-06T03:00:39.623277+0000","last_clean":"2023-10-06T03:00:39.623277+0000","last_became_active":"2023-10-06T03:00:38.608218+0000","last_became_peered":"2023-10-06T03:00:38.608218+0000","last_unstale":"2023-10-06T03:00:39.623277+0000","last_undegraded":"2023-10-06T03:00:39.623277+0000","last_fullsized":"2023-10-06T03:00:39.623277+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:24.092949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":76,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.605139+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T03:00:39.605139+0000","last_peered":"2023-10-06T03:00:39.605139+0000","last_clean":"2023-10-06T03:00:39.605139+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T03:00:39.605139+0000","last_undegraded":"2023-10-06T03:00:39.605139+0000","last_fullsized":"2023-10-06T03:00:39.605139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.633744+0000","last_change":"2023-10-06T03:00:39.631367+0000","last_active":"2023-10-06T03:00:39.633744+0000","last_peered":"2023-10-06T03:00:39.633744+0000","last_clean":"2023-10-06T03:00:39.633744+0000","last_became_active":"2023-10-06T03:00:39.630500+0000","last_became_peered":"2023-10-06T03:00:39.630500+0000","last_unstale":"2023-10-06T03:00:39.633744+0000","last_undegraded":"2023-10-06T03:00:39.633744+0000","last_fullsized":"2023-10-06T03:00:39.633744+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:21:28.416973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.615778+0000","last_change":"2023-10-06T03:00:38.608760+0000","last_active":"2023-10-06T03:00:39.615778+0000","last_peered":"2023-10-06T03:00:39.615778+0000","last_clean":"2023-10-06T03:00:39.615778+0000","last_became_active":"2023-10-06T03:00:38.608452+0000","last_became_peered":"2023-10-06T03:00:38.608452+0000","last_unstale":"2023-10-06T03:00:39.615778+0000","last_undegraded":"2023-10-06T03:00:39.615778+0000","last_fullsized":"2023-10-06T03:00:39.615778+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:19.274687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":71,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.610927+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T03:00:39.610927+0000","last_peered":"2023-10-06T03:00:39.610927+0000","last_clean":"2023-10-06T03:00:39.610927+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T03:00:39.610927+0000","last_undegraded":"2023-10-06T03:00:39.610927+0000","last_fullsized":"2023-10-06T03:00:39.610927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.601778+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T03:00:39.601778+0000","last_peered":"2023-10-06T03:00:39.601778+0000","last_clean":"2023-10-06T03:00:39.601778+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T03:00:39.601778+0000","last_undegraded":"2023-10-06T03:00:39.601778+0000","last_fullsized":"2023-10-06T03:00:39.601778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.621857+0000","last_change":"2023-10-06T03:00:39.619354+0000","last_active":"2023-10-06T03:00:39.621857+0000","last_peered":"2023-10-06T03:00:39.621857+0000","last_clean":"2023-10-06T03:00:39.621857+0000","last_became_active":"2023-10-06T03:00:39.618137+0000","last_became_peered":"2023-10-06T03:00:39.618137+0000","last_unstale":"2023-10-06T03:00:39.621857+0000","last_undegraded":"2023-10-06T03:00:39.621857+0000","last_fullsized":"2023-10-06T03:00:39.621857+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:42.531832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.598452+0000","last_change":"2023-10-06T03:00:38.610812+0000","last_active":"2023-10-06T03:00:39.598452+0000","last_peered":"2023-10-06T03:00:39.598452+0000","last_clean":"2023-10-06T03:00:39.598452+0000","last_became_active":"2023-10-06T03:00:38.610462+0000","last_became_peered":"2023-10-06T03:00:38.610462+0000","last_unstale":"2023-10-06T03:00:39.598452+0000","last_undegraded":"2023-10-06T03:00:39.598452+0000","last_fullsized":"2023-10-06T03:00:39.598452+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:20:21.751299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.601873+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T03:00:39.601873+0000","last_peered":"2023-10-06T03:00:39.601873+0000","last_clean":"2023-10-06T03:00:39.601873+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T03:00:39.601873+0000","last_undegraded":"2023-10-06T03:00:39.601873+0000","last_fullsized":"2023-10-06T03:00:39.601873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.632823+0000","last_change":"2023-10-06T03:00:39.624028+0000","last_active":"2023-10-06T03:00:39.632823+0000","last_peered":"2023-10-06T03:00:39.632823+0000","last_clean":"2023-10-06T03:00:39.632823+0000","last_became_active":"2023-10-06T03:00:39.623781+0000","last_became_peered":"2023-10-06T03:00:39.623781+0000","last_unstale":"2023-10-06T03:00:39.632823+0000","last_undegraded":"2023-10-06T03:00:39.632823+0000","last_fullsized":"2023-10-06T03:00:39.632823+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:09.145757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.610942+0000","last_change":"2023-10-06T03:00:38.613575+0000","last_active":"2023-10-06T03:00:39.610942+0000","last_peered":"2023-10-06T03:00:39.610942+0000","last_clean":"2023-10-06T03:00:39.610942+0000","last_became_active":"2023-10-06T03:00:38.613328+0000","last_became_peered":"2023-10-06T03:00:38.613328+0000","last_unstale":"2023-10-06T03:00:39.610942+0000","last_undegraded":"2023-10-06T03:00:39.610942+0000","last_fullsized":"2023-10-06T03:00:39.610942+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:21:39.213463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.603455+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T03:00:39.603455+0000","last_peered":"2023-10-06T03:00:39.603455+0000","last_clean":"2023-10-06T03:00:39.603455+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T03:00:39.603455+0000","last_undegraded":"2023-10-06T03:00:39.603455+0000","last_fullsized":"2023-10-06T03:00:39.603455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.633036+0000","last_change":"2023-10-06T03:00:39.629070+0000","last_active":"2023-10-06T03:00:39.633036+0000","last_peered":"2023-10-06T03:00:39.633036+0000","last_clean":"2023-10-06T03:00:39.633036+0000","last_became_active":"2023-10-06T03:00:39.628608+0000","last_became_peered":"2023-10-06T03:00:39.628608+0000","last_unstale":"2023-10-06T03:00:39.633036+0000","last_undegraded":"2023-10-06T03:00:39.633036+0000","last_fullsized":"2023-10-06T03:00:39.633036+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:44.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.611034+0000","last_change":"2023-10-06T03:00:38.607683+0000","last_active":"2023-10-06T03:00:39.611034+0000","last_peered":"2023-10-06T03:00:39.611034+0000","last_clean":"2023-10-06T03:00:39.611034+0000","last_became_active":"2023-10-06T03:00:38.607424+0000","last_became_peered":"2023-10-06T03:00:38.607424+0000","last_unstale":"2023-10-06T03:00:39.611034+0000","last_undegraded":"2023-10-06T03:00:39.611034+0000","last_fullsized":"2023-10-06T03:00:39.611034+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:38.573583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":72,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.604077+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T03:00:39.604077+0000","last_peered":"2023-10-06T03:00:39.604077+0000","last_clean":"2023-10-06T03:00:39.604077+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T03:00:39.604077+0000","last_undegraded":"2023-10-06T03:00:39.604077+0000","last_fullsized":"2023-10-06T03:00:39.604077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.632850+0000","last_change":"2023-10-06T03:00:39.625214+0000","last_active":"2023-10-06T03:00:39.632850+0000","last_peered":"2023-10-06T03:00:39.632850+0000","last_clean":"2023-10-06T03:00:39.632850+0000","last_became_active":"2023-10-06T03:00:39.623849+0000","last_became_peered":"2023-10-06T03:00:39.623849+0000","last_unstale":"2023-10-06T03:00:39.632850+0000","last_undegraded":"2023-10-06T03:00:39.632850+0000","last_fullsized":"2023-10-06T03:00:39.632850+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:38.586315+0000","last_clean_scrub_stamp":"2023-10-06T03:00:38.586315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:28.519128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.630771+0000","last_change":"2023-10-06T03:00:38.616913+0000","last_active":"2023-10-06T03:00:39.630771+0000","last_peered":"2023-10-06T03:00:39.630771+0000","last_clean":"2023-10-06T03:00:39.630771+0000","last_became_active":"2023-10-06T03:00:38.616671+0000","last_became_peered":"2023-10-06T03:00:38.616671+0000","last_unstale":"2023-10-06T03:00:39.630771+0000","last_undegraded":"2023-10-06T03:00:39.630771+0000","last_fullsized":"2023-10-06T03:00:39.630771+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:37.578299+0000","last_clean_scrub_stamp":"2023-10-06T03:00:37.578299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:23.314251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-06T03:00:39.599789+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T03:00:39.599789+0000","last_peered":"2023-10-06T03:00:39.599789+0000","last_clean":"2023-10-06T03:00:39.599789+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T03:00:39.599789+0000","last_undegraded":"2023-10-06T03:00:39.599789+0000","last_fullsized":"2023-10-06T03:00:39.599789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299008,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072832,"statfs":{"total":96636764160,"available":96330579968,"internally_reserved":0,"allocated":1761280,"data_stored":1147378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.75700000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.433,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.441,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68300000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55600000000000005,"15min":0.57299999999999995},"min":{"1min":0.39400000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.56499999999999995},"min":{"1min":0.49299999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.502}]},{"osd":4,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71199999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.68700000000000006,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50900000000000001,"15min":0.52700000000000002},"min":{"1min":0.30599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.78300000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51600000000000001,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42999999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.56299999999999994},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298428,"kb_used_data":1140,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073412,"statfs":{"total":96636764160,"available":96331173888,"internally_reserved":0,"allocated":1167360,"data_stored":557522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.60399999999999998},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86099999999999999,"5min":3.415,"15min":3.415},"last":0.377},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.58499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.26200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81999999999999995,"5min":1.546,"15min":1.546},"last":0.308},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.45400000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.77700000000000002,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.57399999999999995},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79500000000000004,"5min":1.74,"15min":1.74},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.60399999999999998,"15min":0.70799999999999996},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80300000000000005,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61899999999999999,"15min":0.70599999999999996},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":3.577,"15min":3.577},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.67000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82099999999999995,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.41499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.58599999999999997},"min":{"1min":0.42199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.44800000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80200000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.84799999999999998,"5min":0.87,"15min":0.87},"last":0.495}]},{"osd":7,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.56599999999999995},"min":{"1min":0.376,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70399999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.40699999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.83899999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1155072,"data_stored":555887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.34699999999999998,"15min":0.39100000000000001},"min":{"1min":0.193,"5min":0.19,"15min":0.19},"max":{"1min":0.57699999999999996,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.53600000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.57399999999999995,"15min":1.1379999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51600000000000001,"5min":21.193999999999999,"15min":21.193999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":1.181,"15min":1.181},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.40600000000000003,"15min":0.436},"min":{"1min":0.26400000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.505,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.308},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.248,"15min":0.248},"max":{"1min":0.52900000000000003,"5min":0.626,"15min":0.626},"last":0.32000000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95699999999999996,"5min":1.02,"15min":1.02},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.79500000000000004,"15min":1.355},"min":{"1min":0.44600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.749,"5min":21.135000000000002,"15min":21.135000000000002},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.79400000000000004,"15min":1.3440000000000001},"min":{"1min":0.45800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89800000000000002,"5min":21.085000000000001,"15min":21.085000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.624}]},{"osd":6,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.58499999999999996},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.80500000000000005,"15min":1.3740000000000001},"min":{"1min":0.41099999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82099999999999995,"5min":21.166,"15min":21.166},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77800000000000002,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61799999999999999,"15min":0.60899999999999999},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.99099999999999999,"5min":0.997,"15min":0.997},"last":0.60399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299000,"kb_used_data":1712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072840,"statfs":{"total":96636764160,"available":96330588160,"internally_reserved":0,"allocated":1753088,"data_stored":1146809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.221,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.45900000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.28000000000000003,"5min":0.222,"15min":0.222},"max":{"1min":0.55600000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.28499999999999998}]},{"osd":2,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.376,"15min":0.373},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.54200000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.249,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48699999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.312}]},{"osd":3,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.26600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.40500000000000003},"min":{"1min":0.32200000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59899999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.58299999999999996},"min":{"1min":0.439,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79600000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79200000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.39100000000000001}]},{"osd":5,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57199999999999995,"15min":0.58399999999999996},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81499999999999995,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.45400000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85299999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.622}]},{"osd":6,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.48699999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.78400000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.438,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Oct 6 02:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86599999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.51500000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89200000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298424,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073416,"statfs":{"total":96636764160,"available":96331177984,"internally_reserved":0,"allocated":1163264,"data_stored":556932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32900000000000001,"15min":0.312},"min":{"1min":0.23300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45500000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.379},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.32400000000000001},"min":{"1min":0.24299999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.46100000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36099999999999999},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.56100000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53500000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.28000000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.26600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.495,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.41299999999999998,"15min":0.40200000000000002},"min":{"1min":0.33800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63100000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.55400000000000005},"min":{"1min":0.46200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82599999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58799999999999997,"15min":0.56200000000000006},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60199999999999998,"15min":0.56999999999999995},"min":{"1min":0.495,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92700000000000005,"5min":1.276,"15min":1.276},"last":0.504}]},{"osd":6,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.60899999999999999,"15min":0.57699999999999996},"min":{"1min":0.504,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80500000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.439},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89500000000000002,"5min":1.077,"15min":1.077},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61699999999999999,"15min":0.57399999999999995},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1171456,"data_stored":557445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.38200000000000001,"15min":0.439},"min":{"1min":0.22500000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.46500000000000002,"5min":2.569,"15min":2.569},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.39100000000000001,"15min":0.441},"min":{"1min":0.28799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.53300000000000003,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.27100000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.374,"15min":0.42799999999999999},"min":{"1min":0.23799999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.40300000000000002,"15min":0.46500000000000002},"min":{"1min":0.254,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58199999999999996,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":0.29699999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41299999999999998,"15min":0.45700000000000002},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.56699999999999995,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.318},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42999999999999999,"15min":0.48399999999999999},"min":{"1min":0.28899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55300000000000005,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60599999999999998,"15min":0.66000000000000003},"min":{"1min":0.48199999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.503}]},{"osd":5,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60699999999999998,"15min":0.66600000000000004},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.62,"15min":0.68000000000000005},"min":{"1min":0.49399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.82199999999999995,"5min":2.532,"15min":2.532},"last":0.56499999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.64600000000000002},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77400000000000002,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63800000000000001,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.80000000000000004,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:00:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.90000000000000002,"5min":2.496,"15min":2.496},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.61699999999999999,"15min":0.65700000000000003},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76600000000000001,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.52100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1179648,"data_stored":558558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54100000000000004,"15min":0.51900000000000002},"min":{"1min":0.40200000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.75,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55500000000000005},"min":{"1min":0.38600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.53200000000000003},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73699999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55500000000000005,"15min":0.56799999999999995},"min":{"1min":0.375,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70899999999999996,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58099999999999996,"15min":0.56799999999999995},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56299999999999994,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.441},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.71399999999999997,"15min":0.97399999999999998},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.76900000000000002,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.50800000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.55200000000000005},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38}]},{"osd":6,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76600000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.46400000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78600000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298424,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073416,"statfs":{"total":96636764160,"available":96331177984,"internally_reserved":0,"allocated":1163264,"data_stored":556968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51900000000000002,"15min":0.496},"min":{"1min":0.38400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.69099999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73899999999999999,"5min":1.167,"15min":1.167},"last":0.73699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.57099999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.74099999999999999,"5min":1.117,"15min":1.117},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52800000000000002,"15min":0.51000000000000001},"min":{"1min":0.34399999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68799999999999994,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":1.2,"15min":1.2},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55800000000000005,"15min":0.59199999999999997},"min":{"1min":0.39200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64100000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55300000000000005,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73799999999999999,"5min":1.135,"15min":1.135},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77600000000000002,"5min":1.208,"15min":1.208},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47499999999999998,"15min":0.498},"min":{"1min":0.29299999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65100000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.71899999999999997,"5min":0.87,"15min":0.87},"last":0.77900000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52900000000000003,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72899999999999998,"5min":1.054,"15min":1.054},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54000000000000004,"15min":0.57899999999999996},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67900000000000005,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54600000000000004,"15min":0.58099999999999996},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73899999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.629},"min":{"1min":0.42099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":1.008,"15min":1.008},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:00:44.037 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:00:44.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:00:44.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.189+0000 7fde0abf9700 1 Processor -- start 2023-10-06T03:00:44.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.189+0000 7fde0abf9700 1 -- start start 2023-10-06T03:00:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0abf9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040ccab0 0x7fde040d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0abf9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde040d0830 0x7fde040ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0abf9700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde040cdc30 con 0x7fde041539d0 2023-10-06T03:00:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0abf9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde040d0cb0 con 0x7fde040d0830 2023-10-06T03:00:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0abf9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040cb500 con 0x7fde040ccab0 2023-10-06T03:00:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0a3f8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde040d0830 0x7fde040ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0a3f8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde040d0830 0x7fde040ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41554/0 (socket says 172.21.15.84:41554) 2023-10-06T03:00:44.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0a3f8700 1 -- 172.21.15.84:0/2362633478 learned_addr learned my addr 172.21.15.84:0/2362633478 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:44.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde093f6700 1 --2- 172.21.15.84:0/2362633478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040ccab0 0x7fde040d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0a3f8700 1 -- 172.21.15.84:0/2362633478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040ccab0 msgr2=0x7fde040d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:44.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0a3f8700 1 --2- 172.21.15.84:0/2362633478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040ccab0 0x7fde040d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0a3f8700 1 -- 172.21.15.84:0/2362633478 >> v1:172.21.15.131:6789/0 conn(0x7fde041539d0 legacy=0x7fde0415a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0a3f8700 1 -- 172.21.15.84:0/2362633478 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040cd020 con 0x7fde040d0830 2023-10-06T03:00:44.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.190+0000 7fde0a3f8700 1 --2- 172.21.15.84:0/2362633478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde040d0830 0x7fde040ce8a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fddf40099b0 tx=0x7fddf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5b594ae51b8e3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:44.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde08bf5700 1 -- 172.21.15.84:0/2362633478 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4009ea0 con 0x7fde040d0830 2023-10-06T03:00:44.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde08bf5700 1 -- 172.21.15.84:0/2362633478 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf400b860 con 0x7fde040d0830 2023-10-06T03:00:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde08bf5700 1 -- 172.21.15.84:0/2362633478 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400bc00 con 0x7fde040d0830 2023-10-06T03:00:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde0abf9700 1 -- 172.21.15.84:0/2362633478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde040d0830 msgr2=0x7fde040ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde0abf9700 1 --2- 172.21.15.84:0/2362633478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde040d0830 0x7fde040ce8a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fddf40099b0 tx=0x7fddf4009250 comp rx=0 tx=0).stop 2023-10-06T03:00:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde0abf9700 1 -- 172.21.15.84:0/2362633478 shutdown_connections 2023-10-06T03:00:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde0abf9700 1 --2- 172.21.15.84:0/2362633478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde040d0830 0x7fde040ce8a0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde0abf9700 1 --2- 172.21.15.84:0/2362633478 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040ccab0 0x7fde040d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde0abf9700 1 -- 172.21.15.84:0/2362633478 >> 172.21.15.84:0/2362633478 conn(0x7fde04068100 msgr2=0x7fde040684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde0abf9700 1 -- 172.21.15.84:0/2362633478 shutdown_connections 2023-10-06T03:00:44.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.191+0000 7fde0abf9700 1 -- 172.21.15.84:0/2362633478 wait complete. 2023-10-06T03:00:44.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.192+0000 7fde0abf9700 1 Processor -- start 2023-10-06T03:00:44.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.192+0000 7fde0abf9700 1 -- start start 2023-10-06T03:00:44.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0abf9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde040ccab0 0x7fde040b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0abf9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040d0830 0x7fde040b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0abf9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde041539d0 0x7fde0415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0abf9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040c8c60 con 0x7fde041539d0 2023-10-06T03:00:44.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0abf9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b1d30 con 0x7fde040ccab0 2023-10-06T03:00:44.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0abf9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b0ea0 con 0x7fde040d0830 2023-10-06T03:00:44.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0a3f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde041539d0 0x7fde0415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0a3f8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde041539d0 0x7fde0415b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41566/0 (socket says 172.21.15.84:41566) 2023-10-06T03:00:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0a3f8700 1 -- 172.21.15.84:0/1850596845 learned_addr learned my addr 172.21.15.84:0/1850596845 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:44.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde09bf7700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde040ccab0 0x7fde040b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde093f6700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040d0830 0x7fde040b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0a3f8700 1 -- 172.21.15.84:0/1850596845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040d0830 msgr2=0x7fde040b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0a3f8700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040d0830 0x7fde040b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0a3f8700 1 -- 172.21.15.84:0/1850596845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde040ccab0 msgr2=0x7fde040b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0a3f8700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde040ccab0 0x7fde040b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde0a3f8700 1 -- 172.21.15.84:0/1850596845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf40094f0 con 0x7fde041539d0 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.193+0000 7fde09bf7700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde040ccab0 0x7fde040b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.194+0000 7fde0a3f8700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde041539d0 0x7fde0415b810 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fde040890f0 tx=0x7fddf4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.194+0000 7fde01ffb700 1 -- 172.21.15.84:0/1850596845 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400bb20 con 0x7fde041539d0 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.194+0000 7fde01ffb700 1 -- 172.21.15.84:0/1850596845 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4025420 con 0x7fde041539d0 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.194+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde040b1120 con 0x7fde041539d0 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.194+0000 7fde01ffb700 1 -- 172.21.15.84:0/1850596845 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40257e0 con 0x7fde041539d0 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.194+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040b16e0 con 0x7fde041539d0 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.195+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0405f270 con 0x7fde041539d0 2023-10-06T03:00:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.195+0000 7fde01ffb700 1 -- 172.21.15.84:0/1850596845 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddf4023070 con 0x7fde041539d0 2023-10-06T03:00:44.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.196+0000 7fde01ffb700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fddf0066f30 0x7fddf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.196+0000 7fde01ffb700 1 -- 172.21.15.84:0/1850596845 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fddf4085ef0 con 0x7fde041539d0 2023-10-06T03:00:44.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.196+0000 7fde09bf7700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fddf0066f30 0x7fddf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.196+0000 7fde09bf7700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fddf0066f30 0x7fddf00693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fddfc001780 tx=0x7fddfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:44.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.200+0000 7fde01ffb700 1 -- 172.21.15.84:0/1850596845 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddf4052ec0 con 0x7fde041539d0 2023-10-06T03:00:44.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.456+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fde040cd300 con 0x7fde041539d0 2023-10-06T03:00:44.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.460+0000 7fde01ffb700 1 -- 172.21.15.84:0/1850596845 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fddf40564e0 con 0x7fde041539d0 2023-10-06T03:00:44.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fddf0066f30 msgr2=0x7fddf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fddf0066f30 0x7fddf00693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fddfc001780 tx=0x7fddfc009040 comp rx=0 tx=0).stop 2023-10-06T03:00:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde041539d0 msgr2=0x7fde0415b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde041539d0 0x7fde0415b810 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fde040890f0 tx=0x7fddf4017000 comp rx=0 tx=0).stop 2023-10-06T03:00:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 shutdown_connections 2023-10-06T03:00:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fddf0066f30 0x7fddf00693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde040ccab0 0x7fde040b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde041539d0 0x7fde0415b810 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 --2- 172.21.15.84:0/1850596845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde040d0830 0x7fde040b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 >> 172.21.15.84:0/1850596845 conn(0x7fde04068100 msgr2=0x7fde040ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:44.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 shutdown_connections 2023-10-06T03:00:44.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.462+0000 7fde0abf9700 1 -- 172.21.15.84:0/1850596845 wait complete. 2023-10-06T03:00:44.466 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T03:00:44.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.588+0000 7f4bc7fff700 1 Processor -- start 2023-10-06T03:00:44.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.588+0000 7f4bc7fff700 1 -- start start 2023-10-06T03:00:44.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bc7fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4bc8159580 0x7f4bc80ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bc7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc80c6060 0x7f4bc80ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bc7fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc80ae250 con 0x7f4bc8159950 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bc7fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc80ad3a0 con 0x7f4bc8159580 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bc7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80ad640 con 0x7f4bc80c6060 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bbffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4bc8159950 0x7f4bc80ae6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52348/0 (socket says 172.21.15.84:52348) 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bbffff700 1 -- 172.21.15.84:0/2154766977 learned_addr learned my addr 172.21.15.84:0/2154766977 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644316299 0 0) 0x7f4bc80ae250 con 0x7f4bc8159950 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bc6ffd700 1 --2- 172.21.15.84:0/2154766977 >> v2:172.21.15.131:3300/0 conn(0x7f4bc8159580 0x7f4bc80ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb4003570 con 0x7f4bc8159950 2023-10-06T03:00:44.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.589+0000 7f4bc77fe700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc80c6060 0x7f4bc80ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 100372912 0 0) 0x7f4bb4003570 con 0x7f4bc8159950 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc80c6060 msgr2=0x7f4bc80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc80c6060 0x7f4bc80ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 >> v2:172.21.15.131:3300/0 conn(0x7f4bc8159580 msgr2=0x7f4bc80ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 --2- 172.21.15.84:0/2154766977 >> v2:172.21.15.131:3300/0 conn(0x7f4bc8159580 0x7f4bc80ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc80ad920 con 0x7f4bc8159950 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f4bb0001470 con 0x7f4bc8159950 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 >> v1:172.21.15.84:6789/0 conn(0x7f4bc8159950 legacy=0x7f4bc80ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc80c6060 0x7f4bb4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bb4003fe0 0x7f4bb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bb4004d50 0x7f4bb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80ad3a0 con 0x7f4bb4004d50 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80ad640 con 0x7f4bb4003fe0 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb400bb40 con 0x7f4bc80c6060 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc77fe700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bb4004d50 0x7f4bb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc6ffd700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc80c6060 0x7f4bb4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bbffff700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bb4003fe0 0x7f4bb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc77fe700 1 -- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc80c6060 msgr2=0x7f4bb4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc77fe700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc80c6060 0x7f4bb4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc77fe700 1 -- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bb4003fe0 msgr2=0x7f4bb4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc77fe700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bb4003fe0 0x7f4bb4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc77fe700 1 -- 172.21.15.84:0/2154766977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4003570 con 0x7f4bb4004d50 2023-10-06T03:00:44.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bbffff700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bb4003fe0 0x7f4bb4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc77fe700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bb4004d50 0x7f4bb40051c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00094d0 tx=0x7f4bc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13ddfc14565235f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000ea90 con 0x7f4bb4004d50 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc000f040 con 0x7f4bb4004d50 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.590+0000 7f4bc67fc700 1 -- 172.21.15.84:0/2154766977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000ee20 con 0x7f4bb4004d50 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.591+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2154766977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bb4004d50 msgr2=0x7f4bb40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.591+0000 7f4bc7fff700 1 --2- 172.21.15.84:0/2154766977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bb4004d50 0x7f4bb40051c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00094d0 tx=0x7f4bc000b040 comp rx=0 tx=0).stop 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.591+0000 7f4bc77fe700 1 -- 172.21.15.84:0/2154766977 reap_dead start 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.591+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2154766977 shutdown_connections 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.591+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2154766977 >> 172.21.15.84:0/2154766977 conn(0x7f4bc8099560 msgr2=0x7f4bc806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.591+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2154766977 shutdown_connections 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.591+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2154766977 wait complete. 2023-10-06T03:00:44.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.592+0000 7f4bc7fff700 1 Processor -- start 2023-10-06T03:00:44.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.592+0000 7f4bc7fff700 1 -- start start 2023-10-06T03:00:44.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bc7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8145690 0x7f4bc80b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bc7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc80aeff0 0x7f4bc80b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bc7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc8068e10 0x7f4bc8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bc7fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80af460 con 0x7f4bc80aeff0 2023-10-06T03:00:44.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bc7fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80697c0 con 0x7f4bc8145690 2023-10-06T03:00:44.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bc7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80af680 con 0x7f4bc8068e10 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc80aeff0 0x7f4bc80b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc80aeff0 0x7f4bc80b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41580/0 (socket says 172.21.15.84:41580) 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbffff700 1 -- 172.21.15.84:0/2440501641 learned_addr learned my addr 172.21.15.84:0/2440501641 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bc6ffd700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8145690 0x7f4bc80b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bc77fe700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc8068e10 0x7f4bc8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbffff700 1 -- 172.21.15.84:0/2440501641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc8068e10 msgr2=0x7f4bc8069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbffff700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc8068e10 0x7f4bc8069280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbffff700 1 -- 172.21.15.84:0/2440501641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8145690 msgr2=0x7f4bc80b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbffff700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8145690 0x7f4bc80b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbffff700 1 -- 172.21.15.84:0/2440501641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc80af960 con 0x7f4bc80aeff0 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbffff700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc80aeff0 0x7f4bc80b12f0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0004890 tx=0x7f4bb00014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:44.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.593+0000 7f4bbeffd700 1 -- 172.21.15.84:0/2440501641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000a7a0 con 0x7f4bc80aeff0 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.594+0000 7f4bbeffd700 1 -- 172.21.15.84:0/2440501641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb0010040 con 0x7f4bc80aeff0 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.594+0000 7f4bbeffd700 1 -- 172.21.15.84:0/2440501641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000ab50 con 0x7f4bc80aeff0 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.594+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc80afc40 con 0x7f4bc80aeff0 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.594+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc80b0200 con 0x7f4bc80aeff0 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.594+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc80b1830 con 0x7f4bc80aeff0 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.595+0000 7f4bbeffd700 1 -- 172.21.15.84:0/2440501641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4bb00143f0 con 0x7f4bc80aeff0 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.595+0000 7f4bbeffd700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ba8066f30 0x7f4ba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.595+0000 7f4bbeffd700 1 -- 172.21.15.84:0/2440501641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4bb0083e40 con 0x7f4bc80aeff0 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.595+0000 7f4bc6ffd700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ba8066f30 0x7f4ba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:44.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.596+0000 7f4bc6ffd700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ba8066f30 0x7f4ba80693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8006ed0 tx=0x7f4bb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:44.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.600+0000 7f4bbeffd700 1 -- 172.21.15.84:0/2440501641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bb004d5a0 con 0x7f4bc80aeff0 2023-10-06T03:00:44.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.825+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bc80b0420 con 0x7f4bc80aeff0 2023-10-06T03:00:44.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.825+0000 7f4bbeffd700 1 -- 172.21.15.84:0/2440501641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f4bb0019070 con 0x7f4bc80aeff0 2023-10-06T03:00:44.827 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:44.827 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6799,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:00:42.623396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7716},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:00:44.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ba8066f30 msgr2=0x7f4ba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ba8066f30 0x7f4ba80693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8006ed0 tx=0x7f4bb8008040 comp rx=0 tx=0).stop 2023-10-06T03:00:44.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc80aeff0 msgr2=0x7f4bc80b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:44.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc80aeff0 0x7f4bc80b12f0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0004890 tx=0x7f4bb00014e0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 shutdown_connections 2023-10-06T03:00:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4ba8066f30 0x7f4ba80693e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bc8145690 0x7f4bc80b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bc8068e10 0x7f4bc8069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 --2- 172.21.15.84:0/2440501641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc80aeff0 0x7f4bc80b12f0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 >> 172.21.15.84:0/2440501641 conn(0x7f4bc8099560 msgr2=0x7f4bc8068150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 shutdown_connections 2023-10-06T03:00:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:44.827+0000 7f4bc7fff700 1 -- 172.21.15.84:0/2440501641 wait complete. 2023-10-06T03:00:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 84 2023-10-06T03:00:45.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:00:38.983477+0000', 'modified': '2023-10-06T03:00:42.623396+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7716}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7716': {'gid': 7716, 'name': 'a', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6836/4266209083', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 4266209083}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 4266209083}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:00:45.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:00:45.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:00:45.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.359+0000 7f47014d7700 1 Processor -- start 2023-10-06T03:00:45.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.359+0000 7f47014d7700 1 -- start start 2023-10-06T03:00:45.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.360+0000 7f47014d7700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46fc0cdb40 0x7f46fc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.360+0000 7f47014d7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc0aecd0 con 0x7f46fc067d00 2023-10-06T03:00:45.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.360+0000 7f47014d7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc0aefb0 con 0x7f46fc1574a0 2023-10-06T03:00:45.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.360+0000 7f47014d7700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc0c4070 con 0x7f46fc0cdb40 2023-10-06T03:00:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.360+0000 7f46f27fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f46fc067d00 0x7f46fc0ac5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52364/0 (socket says 172.21.15.84:52364) 2023-10-06T03:00:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.360+0000 7f46f27fc700 1 -- 172.21.15.84:0/1885247058 learned_addr learned my addr 172.21.15.84:0/1885247058 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.360+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/1885247058 >> v2:172.21.15.131:3300/0 conn(0x7f46fc0cdb40 0x7f46fc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763931420 0 0) 0x7f46fc0aecd0 con 0x7f46fc067d00 2023-10-06T03:00:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46e8003570 con 0x7f46fc067d00 2023-10-06T03:00:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267516392 0 0) 0x7f46fc0aefb0 con 0x7f46fc1574a0 2023-10-06T03:00:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46fc0aecd0 con 0x7f46fc1574a0 2023-10-06T03:00:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 614817415 0 0) 0x7f46e8003570 con 0x7f46fc067d00 2023-10-06T03:00:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 >> v2:172.21.15.131:3300/0 conn(0x7f46fc0cdb40 msgr2=0x7f46fc06eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 --2- 172.21.15.84:0/1885247058 >> v2:172.21.15.131:3300/0 conn(0x7f46fc0cdb40 0x7f46fc06eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 >> v1:172.21.15.131:6789/0 conn(0x7f46fc1574a0 legacy=0x7f46fc0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc0af290 con 0x7f46fc067d00 2023-10-06T03:00:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f46e4001470 con 0x7f46fc067d00 2023-10-06T03:00:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 >> v1:172.21.15.84:6789/0 conn(0x7f46fc067d00 legacy=0x7f46fc0ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e8003bf0 0x7f46e8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8004810 0x7f46e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46e80051c0 0x7f46e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e800c130 con 0x7f46e8003bf0 2023-10-06T03:00:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e800c2a0 con 0x7f46e8004810 2023-10-06T03:00:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e800c460 con 0x7f46e80051c0 2023-10-06T03:00:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46faffd700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e8003bf0 0x7f46e8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46f27fc700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8004810 0x7f46e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46e80051c0 0x7f46e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46faffd700 1 -- 172.21.15.84:0/1885247058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46e80051c0 msgr2=0x7f46e800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46faffd700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46e80051c0 0x7f46e800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46faffd700 1 -- 172.21.15.84:0/1885247058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8004810 msgr2=0x7f46e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46faffd700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8004810 0x7f46e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46faffd700 1 -- 172.21.15.84:0/1885247058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e8003570 con 0x7f46e8003bf0 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46e80051c0 0x7f46e800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46fb7fe700 1 -- 172.21.15.84:0/1885247058 reap_dead start 2023-10-06T03:00:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.361+0000 7f46faffd700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e8003bf0 0x7f46e8003fe0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0019e0 tx=0x7f46ec007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2909233389a834c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00c5d0 con 0x7f46e8003bf0 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec00c730 con 0x7f46e8003bf0 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f46fa7fc700 1 -- 172.21.15.84:0/1885247058 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00caf0 con 0x7f46e8003bf0 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f47014d7700 1 -- 172.21.15.84:0/1885247058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e8003bf0 msgr2=0x7f46e8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f47014d7700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e8003bf0 0x7f46e8003fe0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0019e0 tx=0x7f46ec007d30 comp rx=0 tx=0).stop 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f47014d7700 1 -- 172.21.15.84:0/1885247058 shutdown_connections 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f47014d7700 1 --2- 172.21.15.84:0/1885247058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e8003bf0 0x7f46e8003fe0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f47014d7700 1 -- 172.21.15.84:0/1885247058 >> 172.21.15.84:0/1885247058 conn(0x7f46fc069180 msgr2=0x7f46fc0cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f47014d7700 1 -- 172.21.15.84:0/1885247058 shutdown_connections 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.362+0000 7f47014d7700 1 -- 172.21.15.84:0/1885247058 wait complete. 2023-10-06T03:00:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.363+0000 7f47014d7700 1 Processor -- start 2023-10-06T03:00:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.363+0000 7f47014d7700 1 -- start start 2023-10-06T03:00:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f47014d7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8003bf0 0x7f46fc15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f47014d7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46fc0c84b0 0x7f46fc0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f47014d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc0c4230 0x7f46fc0c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f47014d7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0c77c0 con 0x7f46fc0c4230 2023-10-06T03:00:45.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f47014d7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc15af20 con 0x7f46e8003bf0 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f47014d7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0c8020 con 0x7f46fc0c84b0 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46fb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc0c4230 0x7f46fc0c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46fb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc0c4230 0x7f46fc0c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41602/0 (socket says 172.21.15.84:41602) 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46fb7fe700 1 -- 172.21.15.84:0/212287321 learned_addr learned my addr 172.21.15.84:0/212287321 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46faffd700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8003bf0 0x7f46fc15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46f27fc700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46fc0c84b0 0x7f46fc0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46fb7fe700 1 -- 172.21.15.84:0/212287321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46fc0c84b0 msgr2=0x7f46fc0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46fc0c84b0 0x7f46fc0c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46fb7fe700 1 -- 172.21.15.84:0/212287321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8003bf0 msgr2=0x7f46fc15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8003bf0 0x7f46fc15a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46fb7fe700 1 -- 172.21.15.84:0/212287321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc16a960 con 0x7f46fc0c4230 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.364+0000 7f46faffd700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8003bf0 0x7f46fc15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.365+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc0c4230 0x7f46fc0c46a0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0700c0 tx=0x7f46f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.365+0000 7f46f37fe700 1 -- 172.21.15.84:0/212287321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f401b070 con 0x7f46fc0c4230 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.365+0000 7f46f37fe700 1 -- 172.21.15.84:0/212287321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f400f040 con 0x7f46fc0c4230 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.365+0000 7f47014d7700 1 -- 172.21.15.84:0/212287321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc0c79d0 con 0x7f46fc0c4230 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.365+0000 7f46f37fe700 1 -- 172.21.15.84:0/212287321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400e050 con 0x7f46fc0c4230 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.365+0000 7f47014d7700 1 -- 172.21.15.84:0/212287321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc06a770 con 0x7f46fc0c4230 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.366+0000 7f46f37fe700 1 -- 172.21.15.84:0/212287321 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46f4015650 con 0x7f46fc0c4230 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.367+0000 7f46f37fe700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f46dc066f30 0x7f46dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.367+0000 7f46faffd700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f46dc066f30 0x7f46dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.367+0000 7f46f37fe700 1 -- 172.21.15.84:0/212287321 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f46f4085120 con 0x7f46fc0c4230 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.367+0000 7f46faffd700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f46dc066f30 0x7f46dc0693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f46fc15c300 tx=0x7f46ec015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.369+0000 7f470a7cfb80 1 Processor -- start 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.369+0000 7f470a7cfb80 1 -- start start 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.369+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c34840 0x555809c34c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.369+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c35cc0 0x555809c846c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.369+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c84c00 0x555809c85050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.369+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555809b8ba70 con 0x555809c34840 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555809b89270 con 0x555809c84c00 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555809b85060 con 0x555809c35cc0 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c34840 0x555809c34c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c34840 0x555809c34c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41618/0 (socket says 172.21.15.84:41618) 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46faffd700 1 -- 172.21.15.84:0/407005891 learned_addr learned my addr 172.21.15.84:0/407005891 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46f27fc700 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c35cc0 0x555809c846c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c84c00 0x555809c85050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46faffd700 1 -- 172.21.15.84:0/407005891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c35cc0 msgr2=0x555809c846c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46faffd700 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c35cc0 0x555809c846c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46faffd700 1 -- 172.21.15.84:0/407005891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c84c00 msgr2=0x555809c85050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46faffd700 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c84c00 0x555809c85050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46faffd700 1 -- 172.21.15.84:0/407005891 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555809a1f270 con 0x555809c34840 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c84c00 0x555809c85050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46faffd700 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c34840 0x555809c34c10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00d000 tx=0x7f46ec021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1556843770d711a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46dbfff700 1 -- 172.21.15.84:0/407005891 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec000c30 con 0x555809c34840 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46dbfff700 1 -- 172.21.15.84:0/407005891 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec023070 con 0x555809c34840 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.370+0000 7f46dbfff700 1 -- 172.21.15.84:0/407005891 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec013af0 con 0x555809c34840 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.371+0000 7f470a7cfb80 1 -- 172.21.15.84:0/407005891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c34840 msgr2=0x555809c34c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.371+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c34840 0x555809c34c10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00d000 tx=0x7f46ec021070 comp rx=0 tx=0).stop 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.371+0000 7f470a7cfb80 1 -- 172.21.15.84:0/407005891 shutdown_connections 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.371+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c84c00 0x555809c85050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.371+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c34840 0x555809c34c10 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.371+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/407005891 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c35cc0 0x555809c846c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.371+0000 7f470a7cfb80 1 -- 172.21.15.84:0/407005891 >> 172.21.15.84:0/407005891 conn(0x555809c36160 msgr2=0x555809c36530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.371+0000 7f470a7cfb80 1 -- 172.21.15.84:0/407005891 shutdown_connections 2023-10-06T03:00:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.371+0000 7f470a7cfb80 1 -- 172.21.15.84:0/407005891 wait complete. 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.372+0000 7f470a7cfb80 1 -- start start 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.372+0000 7f470a7cfb80 1 Processor -- start 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.372+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c5b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.372+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c8b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.372+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c75fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.372+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555809b30890 con 0x555809c35cc0 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555809b4bea0 con 0x555809c34840 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555809a07e30 con 0x555809c84c00 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f470a7cfb80 10 client.0 _ll_register_callbacks cb 0x555809bf7e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46f27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c8b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46f27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c8b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41626/0 (socket says 172.21.15.84:41626) 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46f27fc700 1 -- 172.21.15.84:0/1296830319 learned_addr learned my addr 172.21.15.84:0/1296830319 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46faffd700 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c5b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c75fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46f27fc700 1 -- 172.21.15.84:0/1296830319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 msgr2=0x555809c75fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46f27fc700 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c75fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46f27fc700 1 -- 172.21.15.84:0/1296830319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 msgr2=0x555809c5b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46f27fc700 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c5b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46f27fc700 1 -- 172.21.15.84:0/1296830319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e8003570 con 0x555809c35cc0 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46f27fc700 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c8b710 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f46e4004e40 tx=0x7f46e4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd22999be0a36cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:45.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46d97fa700 1 -- 172.21.15.84:0/1296830319 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4000bc0 con 0x555809c35cc0 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46d97fa700 1 -- 172.21.15.84:0/1296830319 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f46e401bb70 con 0x555809c35cc0 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1296830319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555809c29940 con 0x555809c35cc0 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46d97fa700 1 -- 172.21.15.84:0/1296830319 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46e4016630 con 0x555809c35cc0 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f470a7cfb80 10 client.7863 fetch_fsmap learned FSMap version 84 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1296830319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x5558099c1fe0 con 0x555809c35cc0 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46d97fa700 1 -- 172.21.15.84:0/1296830319 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555809c29940 con 0x555809c35cc0 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.373+0000 7f46d97fa700 1 -- 172.21.15.84:0/1296830319 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 84) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f46e4016790 con 0x555809c35cc0 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f470a7cfb80 10 client.7863 fetch_fsmap finished waiting for FSMap version 84 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f470a7cfb80 10 client.7863 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f470a7cfb80 20 client.7863 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:45.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x555809c78400 0x555809c787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f470a7cfb80 4 client.7863 mds_command: new command op to 7716 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1296830319 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555809c06870 con 0x555809c78400 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f46faffd700 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x555809c78400 0x555809c787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f46faffd700 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x555809c78400 0x555809c787d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f00788c03d2b8fd8 server_cookie=78e8a1c4fe085636 in_seq=0 out_seq=0 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f46d97fa700 10 client.7863 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f46d97fa700 1 -- 172.21.15.84:0/1296830319 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555809c06870 con 0x555809c78400 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f46d97fa700 10 client.7863 handle_command_reply: tid=0 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.374+0000 7f470a7cfb80 1 client.7863 shutdown 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1296830319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 msgr2=0x555809c8b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c8b710 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f46e4004e40 tx=0x7f46e4009040 comp rx=0 tx=0).stop 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1296830319 shutdown_connections 2023-10-06T03:00:45.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x555809c78400 0x555809c787d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c5b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c75fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f46d97fa700 0 client.7863 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:00:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1296830319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c8b710 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1296830319 >> 172.21.15.84:0/1296830319 conn(0x555809c36160 msgr2=0x555809c5da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1296830319 shutdown_connections 2023-10-06T03:00:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1296830319 wait complete. 2023-10-06T03:00:45.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.375+0000 7f470a7cfb80 20 client.7863 trim_cache size 0 max 16384 2023-10-06T03:00:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.392+0000 7f470a7cfb80 1 Processor -- start 2023-10-06T03:00:45.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.392+0000 7f470a7cfb80 1 -- start start 2023-10-06T03:00:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c8b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c2d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c36700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555809c339b0 con 0x555809c35cc0 2023-10-06T03:00:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555809c35b80 con 0x555809c34840 2023-10-06T03:00:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555809c64950 con 0x555809c84c00 2023-10-06T03:00:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c2d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c2d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41638/0 (socket says 172.21.15.84:41638) 2023-10-06T03:00:45.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f27fc700 1 -- 172.21.15.84:0/3765541182 learned_addr learned my addr 172.21.15.84:0/3765541182 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f27fc700 1 -- 172.21.15.84:0/3765541182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 msgr2=0x555809c36700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f27fc700 1 --2- 172.21.15.84:0/3765541182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c36700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46faffd700 1 --2- 172.21.15.84:0/3765541182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c8b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f27fc700 1 -- 172.21.15.84:0/3765541182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 msgr2=0x555809c8b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f27fc700 1 --2- 172.21.15.84:0/3765541182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c8b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f27fc700 1 -- 172.21.15.84:0/3765541182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555809b53780 con 0x555809c35cc0 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46faffd700 1 --2- 172.21.15.84:0/3765541182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c8b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f27fc700 1 --2- 172.21.15.84:0/3765541182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c2d280 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f46e4004dc0 tx=0x7f46e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ca5a3420a96a62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f0ff9700 1 -- 172.21.15.84:0/3765541182 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4000bc0 con 0x555809c35cc0 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f0ff9700 1 -- 172.21.15.84:0/3765541182 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4007620 con 0x555809c35cc0 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.393+0000 7f46f0ff9700 1 -- 172.21.15.84:0/3765541182 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4016840 con 0x555809c35cc0 2023-10-06T03:00:45.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 -- 172.21.15.84:0/3765541182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 msgr2=0x555809c2d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/3765541182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c2d280 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f46e4004dc0 tx=0x7f46e4018000 comp rx=0 tx=0).stop 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 -- 172.21.15.84:0/3765541182 shutdown_connections 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/3765541182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c8b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/3765541182 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c36700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/3765541182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c2d280 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 -- 172.21.15.84:0/3765541182 >> 172.21.15.84:0/3765541182 conn(0x555809c36160 msgr2=0x555809c5da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 -- 172.21.15.84:0/3765541182 shutdown_connections 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 -- 172.21.15.84:0/3765541182 wait complete. 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 -- start start 2023-10-06T03:00:45.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.394+0000 7f470a7cfb80 1 Processor -- start 2023-10-06T03:00:45.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c74330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c74870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f470a7cfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c63720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555809ce24a0 con 0x555809c35cc0 2023-10-06T03:00:45.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555809c7d110 con 0x555809c34840 2023-10-06T03:00:45.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f470a7cfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555809c54dd0 con 0x555809c84c00 2023-10-06T03:00:45.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f470a7cfb80 10 client.0 _ll_register_callbacks cb 0x555809bf7e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:45.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f46f27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c74870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f46f27fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c74870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41642/0 (socket says 172.21.15.84:41642) 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.395+0000 7f46f27fc700 1 -- 172.21.15.84:0/1301157357 learned_addr learned my addr 172.21.15.84:0/1301157357 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46faffd700 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c74330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46fb7fe700 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c63720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46f27fc700 1 -- 172.21.15.84:0/1301157357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 msgr2=0x555809c63720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46f27fc700 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c63720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46f27fc700 1 -- 172.21.15.84:0/1301157357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 msgr2=0x555809c74330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46f27fc700 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c74330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46f27fc700 1 -- 172.21.15.84:0/1301157357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558099c1fe0 con 0x555809c35cc0 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46f27fc700 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c74870 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f46e40078c0 tx=0x7f46e4023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99678729d219f90a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46d97fa700 1 -- 172.21.15.84:0/1301157357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e401b4a0 con 0x555809c35cc0 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46d97fa700 1 -- 172.21.15.84:0/1301157357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f46e401b600 con 0x555809c35cc0 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1301157357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46ec023070 con 0x555809c35cc0 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46d97fa700 1 -- 172.21.15.84:0/1301157357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46e401b9d0 con 0x555809c35cc0 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f470a7cfb80 10 client.7869 fetch_fsmap learned FSMap version 84 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1301157357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x555809b3a470 con 0x555809c35cc0 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46d97fa700 1 -- 172.21.15.84:0/1301157357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec023070 con 0x555809c35cc0 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46d97fa700 1 -- 172.21.15.84:0/1301157357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 84) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f46e4032040 con 0x555809c35cc0 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f470a7cfb80 10 client.7869 fetch_fsmap finished waiting for FSMap version 84 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f470a7cfb80 10 client.7869 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:45.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f470a7cfb80 20 client.7869 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x555809cd7ae0 0x555809c63c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f470a7cfb80 4 client.7869 mds_command: new command op to 7716 tid=0[{"prefix": "status"}] 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1301157357 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555809b27e00 con 0x555809cd7ae0 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.396+0000 7f46faffd700 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x555809cd7ae0 0x555809c63c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f46d97fa700 10 client.7869 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f46faffd700 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x555809cd7ae0 0x555809c63c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa475e70bdf799df server_cookie=1adba54da9150fc0 in_seq=0 out_seq=0 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f46d97fa700 1 -- 172.21.15.84:0/1301157357 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555809b27e00 con 0x555809cd7ae0 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f46d97fa700 10 client.7869 handle_command_reply: tid=0 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 client.7869 shutdown 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1301157357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 msgr2=0x555809c74870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c74870 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f46e40078c0 tx=0x7f46e4023040 comp rx=0 tx=0).stop 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1301157357 shutdown_connections 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x555809cd7ae0 0x555809c63c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555809c34840 0x555809c74330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555809c84c00 0x555809c63720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f46d97fa700 0 client.7869 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 --2- 172.21.15.84:0/1301157357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555809c35cc0 0x555809c74870 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1301157357 >> 172.21.15.84:0/1301157357 conn(0x555809c36160 msgr2=0x555809c2d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1301157357 shutdown_connections 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 1 -- 172.21.15.84:0/1301157357 wait complete. 2023-10-06T03:00:45.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.397+0000 7f470a7cfb80 20 client.7869 trim_cache size 0 max 16384 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7716, 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 5.8029594429999998, 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 84, 2023-10-06T03:00:45.407 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 94, 2023-10-06T03:00:45.408 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 94, 2023-10-06T03:00:45.408 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 11.930933702000001 2023-10-06T03:00:45.408 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:45.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 -- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f46dc066f30 msgr2=0x7f46dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f46dc066f30 0x7f46dc0693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f46fc15c300 tx=0x7f46ec015000 comp rx=0 tx=0).stop 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 -- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc0c4230 msgr2=0x7f46fc0c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc0c4230 0x7f46fc0c46a0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0700c0 tx=0x7f46f400b040 comp rx=0 tx=0).stop 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 -- 172.21.15.84:0/212287321 shutdown_connections 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f46dc066f30 0x7f46dc0693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e8003bf0 0x7f46fc15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc0c4230 0x7f46fc0c46a0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 --2- 172.21.15.84:0/212287321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46fc0c84b0 0x7f46fc0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 -- 172.21.15.84:0/212287321 >> 172.21.15.84:0/212287321 conn(0x7f46fc069180 msgr2=0x7f46fc0cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 -- 172.21.15.84:0/212287321 shutdown_connections 2023-10-06T03:00:45.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.398+0000 7f47014d7700 1 -- 172.21.15.84:0/212287321 wait complete. 2023-10-06T03:00:45.411 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:00:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.524+0000 7f07419e7700 1 Processor -- start 2023-10-06T03:00:45.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.524+0000 7f07419e7700 1 -- start start 2023-10-06T03:00:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f07419e7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c0c6260 0x7f073c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f07419e7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0cc840 con 0x7f073c0cd370 2023-10-06T03:00:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f07419e7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0cbc70 con 0x7f073c1594b0 2023-10-06T03:00:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f07419e7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0cbf10 con 0x7f073c0c6260 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f073bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f073c0cd370 0x7f073c0ce9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52378/0 (socket says 172.21.15.84:52378) 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f073bfff700 1 -- 172.21.15.84:0/1895452342 learned_addr learned my addr 172.21.15.84:0/1895452342 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f07411e6700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c0c6260 0x7f073c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128753239 0 0) 0x7f073c0cc840 con 0x7f073c0cd370 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0728003570 con 0x7f073c0cd370 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559004148 0 0) 0x7f0728003570 con 0x7f073c0cd370 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.525+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c0c6260 msgr2=0x7f073c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c0c6260 0x7f073c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 >> v1:172.21.15.131:6789/0 conn(0x7f073c1594b0 legacy=0x7f073c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0cc1f0 con 0x7f073c0cd370 2023-10-06T03:00:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f072c001970 con 0x7f073c0cd370 2023-10-06T03:00:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 >> v1:172.21.15.84:6789/0 conn(0x7f073c0cd370 legacy=0x7f073c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0728003a90 0x7f0728003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c0c6260 0x7f0728004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f07280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0cbf10 con 0x7f0728004d50 2023-10-06T03:00:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072800bc20 con 0x7f0728003a90 2023-10-06T03:00:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072800bde0 con 0x7f073c0c6260 2023-10-06T03:00:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f07411e6700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f07280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073bfff700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c0c6260 0x7f0728004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f07409e5700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0728003a90 0x7f0728003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f07411e6700 1 -- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c0c6260 msgr2=0x7f0728004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f07411e6700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c0c6260 0x7f0728004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f07411e6700 1 -- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0728003a90 msgr2=0x7f0728003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f07411e6700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0728003a90 0x7f0728003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f07411e6700 1 -- 172.21.15.84:0/1895452342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728003570 con 0x7f0728004d50 2023-10-06T03:00:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073bfff700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c0c6260 0x7f0728004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f07411e6700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f07280051c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0724006f00 tx=0x7f07240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801c8eafa5475c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400e710 con 0x7f0728004d50 2023-10-06T03:00:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072400e870 con 0x7f0728004d50 2023-10-06T03:00:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.526+0000 7f073b7fe700 1 -- 172.21.15.84:0/1895452342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400ec30 con 0x7f0728004d50 2023-10-06T03:00:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.527+0000 7f07419e7700 1 -- 172.21.15.84:0/1895452342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 msgr2=0x7f07280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.527+0000 7f07419e7700 1 --2- 172.21.15.84:0/1895452342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f07280051c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0724006f00 tx=0x7f07240091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.527+0000 7f07411e6700 1 -- 172.21.15.84:0/1895452342 reap_dead start 2023-10-06T03:00:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.527+0000 7f07419e7700 1 -- 172.21.15.84:0/1895452342 shutdown_connections 2023-10-06T03:00:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.527+0000 7f07419e7700 1 -- 172.21.15.84:0/1895452342 >> 172.21.15.84:0/1895452342 conn(0x7f073c099600 msgr2=0x7f073c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.527+0000 7f07419e7700 1 -- 172.21.15.84:0/1895452342 shutdown_connections 2023-10-06T03:00:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.527+0000 7f07419e7700 1 -- 172.21.15.84:0/1895452342 wait complete. 2023-10-06T03:00:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.528+0000 7f07419e7700 1 Processor -- start 2023-10-06T03:00:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.528+0000 7f07419e7700 1 -- start start 2023-10-06T03:00:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07419e7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f073c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07419e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f073c0c99e0 0x7f073c155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07419e7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c156180 0x7f073c09c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07419e7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c155ae0 con 0x7f0728004d50 2023-10-06T03:00:45.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07419e7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c09b9f0 con 0x7f073c0c99e0 2023-10-06T03:00:45.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07419e7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0c9550 con 0x7f073c156180 2023-10-06T03:00:45.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07409e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f073c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07409e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f073c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41662/0 (socket says 172.21.15.84:41662) 2023-10-06T03:00:45.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07409e5700 1 -- 172.21.15.84:0/152535050 learned_addr learned my addr 172.21.15.84:0/152535050 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:45.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f073bfff700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f073c0c99e0 0x7f073c155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07411e6700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c156180 0x7f073c09c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07409e5700 1 -- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c156180 msgr2=0x7f073c09c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07409e5700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c156180 0x7f073c09c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07409e5700 1 -- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f073c0c99e0 msgr2=0x7f073c155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07409e5700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f073c0c99e0 0x7f073c155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07409e5700 1 -- 172.21.15.84:0/152535050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c09a3b0 con 0x7f0728004d50 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f073bfff700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f073c0c99e0 0x7f073c155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.529+0000 7f07411e6700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c156180 0x7f073c09c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.530+0000 7f07409e5700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f073c1555a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f073400e550 tx=0x7f0734009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.530+0000 7f0738ff9700 1 -- 172.21.15.84:0/152535050 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734012500 con 0x7f0728004d50 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.530+0000 7f0738ff9700 1 -- 172.21.15.84:0/152535050 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0734010040 con 0x7f0728004d50 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.530+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c09a0f0 con 0x7f0728004d50 2023-10-06T03:00:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.530+0000 7f0738ff9700 1 -- 172.21.15.84:0/152535050 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734012890 con 0x7f0728004d50 2023-10-06T03:00:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.530+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c0c91e0 con 0x7f0728004d50 2023-10-06T03:00:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.531+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073c05f270 con 0x7f0728004d50 2023-10-06T03:00:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.531+0000 7f0738ff9700 1 -- 172.21.15.84:0/152535050 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0734012c80 con 0x7f0728004d50 2023-10-06T03:00:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.531+0000 7f0738ff9700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f071c066f30 0x7f071c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.532+0000 7f073bfff700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f071c066f30 0x7f071c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.532+0000 7f0738ff9700 1 -- 172.21.15.84:0/152535050 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f07340843d0 con 0x7f0728004d50 2023-10-06T03:00:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.532+0000 7f073bfff700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f071c066f30 0x7f071c0693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f072c001190 tx=0x7f072c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.536+0000 7f0738ff9700 1 -- 172.21.15.84:0/152535050 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0734051450 con 0x7f0728004d50 2023-10-06T03:00:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.762+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f073c0cc4d0 con 0x7f0728004d50 2023-10-06T03:00:45.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.763+0000 7f0738ff9700 1 -- 172.21.15.84:0/152535050 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0734054a70 con 0x7f0728004d50 2023-10-06T03:00:45.765 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:00:45.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f071c066f30 msgr2=0x7f071c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f071c066f30 0x7f071c0693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f072c001190 tx=0x7f072c00c040 comp rx=0 tx=0).stop 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 msgr2=0x7f073c1555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f073c1555a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f073400e550 tx=0x7f0734009040 comp rx=0 tx=0).stop 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 shutdown_connections 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f071c066f30 0x7f071c0693e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f073c156180 0x7f073c09c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0728004d50 0x7f073c1555a0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 --2- 172.21.15.84:0/152535050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f073c0c99e0 0x7f073c155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 >> 172.21.15.84:0/152535050 conn(0x7f073c099600 msgr2=0x7f073c0cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:45.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 shutdown_connections 2023-10-06T03:00:45.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:45.765+0000 7f07419e7700 1 -- 172.21.15.84:0/152535050 wait complete. 2023-10-06T03:00:45.778 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:00:45.778 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:00:45.778 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:00:45.778 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:00:45.779 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:45.779 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:00:45.779 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:00:45.779 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:00:45.780 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:00:45.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:45.780 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:00:45.795 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:00:45.795 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:00:45.795 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:00:45.795 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:45.795 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:00:45.795 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:45.795 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:00:45.795 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42163sec preferred_lft 42163sec 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-10-06T03:00:45.796 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c4d3:64ff:fe4d:ee22/64 scope link 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::41f:f5ff:fe77:615a/64 scope link 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:45.797 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:00:45.798 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 66:ce:03:f1:65:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:00:45.798 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::64ce:3ff:fef1:6538/64 scope link 2023-10-06T03:00:45.798 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:00:45.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:45.798 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:00:45.858 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:00:45.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:45.860 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:00:45.916 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:00:45.916 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:00:45.917 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:00:45.917 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:00:45.917 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:00:45.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:45.917 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:00:45.917 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:00:45.917 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:00:45.917 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:00:45.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:00:45.918 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:00:46.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:46.016 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:00:46.031 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:00:46.031 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:00:46.031 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:00:46.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:46.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:00:46.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:46.095 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:46.150 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:00:46.150 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:00:46.150 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:46.205 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:00:46.205 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:00:46.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:00:46.284 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:00:46.285 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:00:46.285 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T03:00:46.293 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:00:46.293 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:00:46.293 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T03:00:46.293 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:00:46.293 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:00:46.315 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:00:46.316 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:00:46.316 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T03:00:46.316 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:00:46.316 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:00:46.316 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:00:46.316 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:00:46.316 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T03:00:46.317 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:00:46.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:00:46.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:00:46.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-10-06T03:00:46.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.537+0000 7fafbac92700 1 Processor -- start 2023-10-06T03:00:46.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.537+0000 7fafbac92700 1 -- start start 2023-10-06T03:00:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafbac92700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fafb4159510 0x7fafb40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafbac92700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fafb40cbae0 0x7fafb40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafbac92700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb40cbf20 con 0x7fafb41598e0 2023-10-06T03:00:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafbac92700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb40cf610 con 0x7fafb4159510 2023-10-06T03:00:46.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafbac92700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb40cf8f0 con 0x7fafb40cbae0 2023-10-06T03:00:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafb8a2e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fafb4159510 0x7fafb40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafabfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fafb41598e0 0x7fafb40ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52386/0 (socket says 172.21.15.84:52386) 2023-10-06T03:00:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafabfff700 1 -- 172.21.15.84:0/647233164 learned_addr learned my addr 172.21.15.84:0/647233164 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafb922f700 1 --2- 172.21.15.84:0/647233164 >> v2:172.21.15.131:3300/0 conn(0x7fafb40cbae0 0x7fafb40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafb8a2e700 1 -- 172.21.15.84:0/647233164 >> v2:172.21.15.131:3300/0 conn(0x7fafb40cbae0 msgr2=0x7fafb40cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafb8a2e700 1 --2- 172.21.15.84:0/647233164 >> v2:172.21.15.131:3300/0 conn(0x7fafb40cbae0 0x7fafb40cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafb8a2e700 1 -- 172.21.15.84:0/647233164 >> v1:172.21.15.84:6789/0 conn(0x7fafb41598e0 legacy=0x7fafb40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafb8a2e700 1 -- 172.21.15.84:0/647233164 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb40cfbd0 con 0x7fafb4159510 2023-10-06T03:00:46.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.538+0000 7fafab7fe700 1 -- 172.21.15.84:0/647233164 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583555676 0 0) 0x7fafb40cbf20 con 0x7fafb41598e0 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafb8a2e700 1 --2- 172.21.15.84:0/647233164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 0x7fafb40cb5a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fafb406f990 tx=0x7fafb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85d876ec75a0f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafab7fe700 1 -- 172.21.15.84:0/647233164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000e070 con 0x7fafb4159510 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafab7fe700 1 -- 172.21.15.84:0/647233164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb000bc30 con 0x7fafb4159510 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafab7fe700 1 -- 172.21.15.84:0/647233164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0012430 con 0x7fafb4159510 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafbac92700 1 -- 172.21.15.84:0/647233164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 msgr2=0x7fafb40cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafbac92700 1 --2- 172.21.15.84:0/647233164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 0x7fafb40cb5a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fafb406f990 tx=0x7fafb0009780 comp rx=0 tx=0).stop 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafbac92700 1 -- 172.21.15.84:0/647233164 shutdown_connections 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafbac92700 1 --2- 172.21.15.84:0/647233164 >> v2:172.21.15.131:3300/0 conn(0x7fafb40cbae0 0x7fafb40cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafbac92700 1 --2- 172.21.15.84:0/647233164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 0x7fafb40cb5a0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafbac92700 1 -- 172.21.15.84:0/647233164 >> 172.21.15.84:0/647233164 conn(0x7fafb4089e90 msgr2=0x7fafb40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafbac92700 1 -- 172.21.15.84:0/647233164 shutdown_connections 2023-10-06T03:00:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.539+0000 7fafbac92700 1 -- 172.21.15.84:0/647233164 wait complete. 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.540+0000 7fafbac92700 1 Processor -- start 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafbac92700 1 -- start start 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafbac92700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb40cbae0 0x7fafb40b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafbac92700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 0x7fafb409b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafbac92700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafb41598e0 0x7fafb415c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafbac92700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb415bde0 con 0x7fafb4159510 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafbac92700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb414ea70 con 0x7fafb40cbae0 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafbac92700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb415b1d0 con 0x7fafb41598e0 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafabfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 0x7fafb409b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:46.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafabfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 0x7fafb409b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41672/0 (socket says 172.21.15.84:41672) 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafabfff700 1 -- 172.21.15.84:0/3525103368 learned_addr learned my addr 172.21.15.84:0/3525103368 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.541+0000 7fafb8a2e700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb40cbae0 0x7fafb40b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafb922f700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafb41598e0 0x7fafb415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafabfff700 1 -- 172.21.15.84:0/3525103368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafb41598e0 msgr2=0x7fafb415c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafabfff700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafb41598e0 0x7fafb415c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafabfff700 1 -- 172.21.15.84:0/3525103368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb40cbae0 msgr2=0x7fafb40b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafabfff700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb40cbae0 0x7fafb40b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafabfff700 1 -- 172.21.15.84:0/3525103368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0009a20 con 0x7fafb4159510 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafabfff700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 0x7fafb409b380 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c510 tx=0x7fafa400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafa8ff9700 1 -- 172.21.15.84:0/3525103368 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4005b30 con 0x7fafb4159510 2023-10-06T03:00:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafa8ff9700 1 -- 172.21.15.84:0/3525103368 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4005c90 con 0x7fafb4159510 2023-10-06T03:00:46.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb415b4b0 con 0x7fafb4159510 2023-10-06T03:00:46.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafa8ff9700 1 -- 172.21.15.84:0/3525103368 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4007300 con 0x7fafb4159510 2023-10-06T03:00:46.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.542+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb415ba70 con 0x7fafb4159510 2023-10-06T03:00:46.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.543+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb415bf50 con 0x7fafb4159510 2023-10-06T03:00:46.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.543+0000 7fafa8ff9700 1 -- 172.21.15.84:0/3525103368 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafa401b3b0 con 0x7fafb4159510 2023-10-06T03:00:46.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.544+0000 7fafa8ff9700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fafa0066f30 0x7fafa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:46.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.544+0000 7fafa8ff9700 1 -- 172.21.15.84:0/3525103368 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fafa4083bf0 con 0x7fafb4159510 2023-10-06T03:00:46.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.544+0000 7fafb8a2e700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fafa0066f30 0x7fafa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:46.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.544+0000 7fafb8a2e700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fafa0066f30 0x7fafa00693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fafb406f990 tx=0x7fafb0019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:46.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.548+0000 7fafa8ff9700 1 -- 172.21.15.84:0/3525103368 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafa4050bc0 con 0x7fafb4159510 2023-10-06T03:00:46.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:46.779+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fafb4064ad0 con 0x7fafb4159510 2023-10-06T03:00:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.153+0000 7fafa8ff9700 1 -- 172.21.15.84:0/3525103368 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v85) v1 ==== 105+0+0 (secure 0 0 0) 0x7fafa40170b0 con 0x7fafb4159510 2023-10-06T03:00:47.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.155+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fafa0066f30 msgr2=0x7fafa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.155+0000 7fafbac92700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fafa0066f30 0x7fafa00693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fafb406f990 tx=0x7fafb0019000 comp rx=0 tx=0).stop 2023-10-06T03:00:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.155+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 msgr2=0x7fafb409b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.155+0000 7fafbac92700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 0x7fafb409b380 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c510 tx=0x7fafa400c820 comp rx=0 tx=0).stop 2023-10-06T03:00:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.156+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 shutdown_connections 2023-10-06T03:00:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.156+0000 7fafbac92700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fafa0066f30 0x7fafa00693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.156+0000 7fafbac92700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb40cbae0 0x7fafb40b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.156+0000 7fafbac92700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fafb41598e0 0x7fafb415c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.156+0000 7fafbac92700 1 --2- 172.21.15.84:0/3525103368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafb4159510 0x7fafb409b380 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.156+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 >> 172.21.15.84:0/3525103368 conn(0x7fafb4089e90 msgr2=0x7fafb4069450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:47.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.156+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 shutdown_connections 2023-10-06T03:00:47.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.156+0000 7fafbac92700 1 -- 172.21.15.84:0/3525103368 wait complete. 2023-10-06T03:00:47.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:47.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.288+0000 7f0771031700 1 Processor -- start 2023-10-06T03:00:47.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.288+0000 7f0771031700 1 -- start start 2023-10-06T03:00:47.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.289+0000 7f0771031700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f076c1595a0 0x7f076c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:47.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.289+0000 7f0771031700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f076c0b49e0 0x7f076c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:47.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.289+0000 7f0771031700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c0b0ca0 con 0x7f076c0b07a0 2023-10-06T03:00:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.289+0000 7f0771031700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0b0f80 con 0x7f076c0b49e0 2023-10-06T03:00:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.289+0000 7f0771031700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0b1260 con 0x7f076c1595a0 2023-10-06T03:00:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.289+0000 7f076b59e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f076c0b07a0 0x7f076c0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52400/0 (socket says 172.21.15.84:52400) 2023-10-06T03:00:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.289+0000 7f076b59e700 1 -- 172.21.15.84:0/2638065115 learned_addr learned my addr 172.21.15.84:0/2638065115 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.289+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267462079 0 0) 0x7f076c0b0ca0 con 0x7f076c0b07a0 2023-10-06T03:00:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0758003570 con 0x7f076c0b07a0 2023-10-06T03:00:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076259c700 1 --2- 172.21.15.84:0/2638065115 >> v2:172.21.15.131:3300/0 conn(0x7f076c0b49e0 0x7f076c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076ad9d700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f076c1595a0 0x7f076c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785653058 0 0) 0x7f0758003570 con 0x7f076c0b07a0 2023-10-06T03:00:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f076c1595a0 msgr2=0x7f076c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f076c1595a0 0x7f076c0aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 >> v2:172.21.15.131:3300/0 conn(0x7f076c0b49e0 msgr2=0x7f076c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 --2- 172.21.15.84:0/2638065115 >> v2:172.21.15.131:3300/0 conn(0x7f076c0b49e0 0x7f076c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0b1540 con 0x7f076c0b07a0 2023-10-06T03:00:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076ad9d700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f076c1595a0 0x7f076c0aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f07640017f0 con 0x7f076c0b07a0 2023-10-06T03:00:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 >> v1:172.21.15.84:6789/0 conn(0x7f076c0b07a0 legacy=0x7f076c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f076c1595a0 0x7f0758003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0758003fa0 0x7f0758004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758004d50 0x7f07580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0b0f80 con 0x7f0758003fa0 2023-10-06T03:00:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0b1260 con 0x7f0758004d50 2023-10-06T03:00:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075800bb10 con 0x7f076c1595a0 2023-10-06T03:00:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076259c700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0758003fa0 0x7f0758004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076ad9d700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f076c1595a0 0x7f0758003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076b59e700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758004d50 0x7f07580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076259c700 1 -- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f076c1595a0 msgr2=0x7f0758003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076259c700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f076c1595a0 0x7f0758003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076259c700 1 -- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758004d50 msgr2=0x7f07580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076259c700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758004d50 0x7f07580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076259c700 1 -- 172.21.15.84:0/2638065115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758003570 con 0x7f0758003fa0 2023-10-06T03:00:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076259c700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0758003fa0 0x7f0758004810 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f0754006f00 tx=0x7f07540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2188b998a8bb156 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.290+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400e6e0 con 0x7f0758003fa0 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.291+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075400e840 con 0x7f0758003fa0 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.291+0000 7f076a59c700 1 -- 172.21.15.84:0/2638065115 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400ec00 con 0x7f0758003fa0 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.291+0000 7f0771031700 1 -- 172.21.15.84:0/2638065115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0758003fa0 msgr2=0x7f0758004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.291+0000 7f0771031700 1 --2- 172.21.15.84:0/2638065115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0758003fa0 0x7f0758004810 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f0754006f00 tx=0x7f07540091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.291+0000 7f076b59e700 1 -- 172.21.15.84:0/2638065115 reap_dead start 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.291+0000 7f0771031700 1 -- 172.21.15.84:0/2638065115 shutdown_connections 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.291+0000 7f0771031700 1 -- 172.21.15.84:0/2638065115 >> 172.21.15.84:0/2638065115 conn(0x7f076c099830 msgr2=0x7f076c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.291+0000 7f0771031700 1 -- 172.21.15.84:0/2638065115 shutdown_connections 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.291+0000 7f0771031700 1 -- 172.21.15.84:0/2638065115 wait complete. 2023-10-06T03:00:47.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.292+0000 7f0771031700 1 Processor -- start 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.292+0000 7f0771031700 1 -- start start 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f0771031700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0758003fa0 0x7f076c09db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f0771031700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f076c069760 0x7f076c09bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f0771031700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f076c069bd0 0x7f076c1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f0771031700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c09e050 con 0x7f076c069760 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f0771031700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c09ca70 con 0x7f076c069bd0 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f0771031700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c09cd50 con 0x7f0758003fa0 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f076c069760 0x7f076c09bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f076c069760 0x7f076c09bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41688/0 (socket says 172.21.15.84:41688) 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076259c700 1 -- 172.21.15.84:0/1315500977 learned_addr learned my addr 172.21.15.84:0/1315500977 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076b59e700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f076c069bd0 0x7f076c1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076ad9d700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0758003fa0 0x7f076c09db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076259c700 1 -- 172.21.15.84:0/1315500977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0758003fa0 msgr2=0x7f076c09db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076259c700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0758003fa0 0x7f076c09db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076259c700 1 -- 172.21.15.84:0/1315500977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f076c069bd0 msgr2=0x7f076c1565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076259c700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f076c069bd0 0x7f076c1565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076259c700 1 -- 172.21.15.84:0/1315500977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c09d030 con 0x7f076c069760 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.293+0000 7f076b59e700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f076c069bd0 0x7f076c1565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.294+0000 7f076259c700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f076c069760 0x7f076c09bfd0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f075800ba60 tx=0x7f075401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.294+0000 7f07637fe700 1 -- 172.21.15.84:0/1315500977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754022070 con 0x7f076c069760 2023-10-06T03:00:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.294+0000 7f07637fe700 1 -- 172.21.15.84:0/1315500977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075400e9b0 con 0x7f076c069760 2023-10-06T03:00:47.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.294+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c09d310 con 0x7f076c069760 2023-10-06T03:00:47.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.294+0000 7f07637fe700 1 -- 172.21.15.84:0/1315500977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075401c450 con 0x7f076c069760 2023-10-06T03:00:47.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.294+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c0cc490 con 0x7f076c069760 2023-10-06T03:00:47.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.295+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c09d960 con 0x7f076c069760 2023-10-06T03:00:47.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.295+0000 7f07637fe700 1 -- 172.21.15.84:0/1315500977 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f075401c860 con 0x7f076c069760 2023-10-06T03:00:47.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.295+0000 7f07637fe700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f074c066f30 0x7f074c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:47.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.295+0000 7f07637fe700 1 -- 172.21.15.84:0/1315500977 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0754086160 con 0x7f076c069760 2023-10-06T03:00:47.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.295+0000 7f076ad9d700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f074c066f30 0x7f074c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:47.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.296+0000 7f076ad9d700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f074c066f30 0x7f074c0693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f075c006f20 tx=0x7f075c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:47.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.300+0000 7f07637fe700 1 -- 172.21.15.84:0/1315500977 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0754053090 con 0x7f076c069760 2023-10-06T03:00:47.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.526+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f076c09e050 con 0x7f076c069760 2023-10-06T03:00:47.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.526+0000 7f07637fe700 1 -- 172.21.15.84:0/1315500977 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f076c09e050 con 0x7f076c069760 2023-10-06T03:00:47.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:47.528 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6799,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:00:47.151312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":7716,"mds_1":6802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:creating","state_seq":1,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:00:47.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.528+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f074c066f30 msgr2=0x7f074c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:47.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.528+0000 7f0771031700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f074c066f30 0x7f074c0693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f075c006f20 tx=0x7f075c008040 comp rx=0 tx=0).stop 2023-10-06T03:00:47.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.528+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f076c069760 msgr2=0x7f076c09bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:47.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.528+0000 7f0771031700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f076c069760 0x7f076c09bfd0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f075800ba60 tx=0x7f075401a000 comp rx=0 tx=0).stop 2023-10-06T03:00:47.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.529+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 shutdown_connections 2023-10-06T03:00:47.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.529+0000 7f0771031700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f074c066f30 0x7f074c0693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.529+0000 7f0771031700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f076c069bd0 0x7f076c1565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.529+0000 7f0771031700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0758003fa0 0x7f076c09db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.529+0000 7f0771031700 1 --2- 172.21.15.84:0/1315500977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f076c069760 0x7f076c09bfd0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:47.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.529+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 >> 172.21.15.84:0/1315500977 conn(0x7f076c099830 msgr2=0x7f076c0cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:47.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.529+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 shutdown_connections 2023-10-06T03:00:47.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:47.529+0000 7f0771031700 1 -- 172.21.15.84:0/1315500977 wait complete. 2023-10-06T03:00:47.532 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 85 2023-10-06T03:00:47.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:00:38.983477+0000', 'modified': '2023-10-06T03:00:47.151312+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 7716, 'mds_1': 6802}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6802': {'gid': 6802, 'name': 'b', 'rank': 1, 'incarnation': 85, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.131:6835/2772432276', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 2772432276}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 2772432276}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7716': {'gid': 7716, 'name': 'a', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6836/4266209083', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 4266209083}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 4266209083}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:00:47.945 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6802:up:creating 2023-10-06T03:00:48.889 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:00:48.888+0000 7fd4ebbfb700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-06T03:00:48.946 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:49.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.070+0000 7f73d039a700 1 Processor -- start 2023-10-06T03:00:49.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.070+0000 7f73d039a700 1 -- start start 2023-10-06T03:00:49.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.071+0000 7f73d039a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f73c8069af0 0x7f73c80adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.071+0000 7f73d039a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73c806d390 0x7f73c806eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.071+0000 7f73d039a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c806e710 con 0x7f73c8069720 2023-10-06T03:00:49.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.071+0000 7f73d039a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c80cd040 con 0x7f73c806d390 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.071+0000 7f73d039a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c806db00 con 0x7f73c8069af0 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.071+0000 7f73ce937700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73c806d390 0x7f73c806eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73ce937700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73c806d390 0x7f73c806eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41702/0 (socket says 172.21.15.84:41702) 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73ce937700 1 -- 172.21.15.84:0/2938151098 learned_addr learned my addr 172.21.15.84:0/2938151098 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73cd935700 1 --2- 172.21.15.84:0/2938151098 >> v2:172.21.15.131:3300/0 conn(0x7f73c8069af0 0x7f73c80adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73ce937700 1 -- 172.21.15.84:0/2938151098 >> v2:172.21.15.131:3300/0 conn(0x7f73c8069af0 msgr2=0x7f73c80adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73ce937700 1 --2- 172.21.15.84:0/2938151098 >> v2:172.21.15.131:3300/0 conn(0x7f73c8069af0 0x7f73c80adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73ce937700 1 -- 172.21.15.84:0/2938151098 >> v1:172.21.15.131:6789/0 conn(0x7f73c8069720 legacy=0x7f73c80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73ce937700 1 -- 172.21.15.84:0/2938151098 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c806dde0 con 0x7f73c806d390 2023-10-06T03:00:49.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73ce937700 1 --2- 172.21.15.84:0/2938151098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 0x7f73c806eba0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f73c8070020 tx=0x7f73c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574f728be49620a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73cd134700 1 -- 172.21.15.84:0/2938151098 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000b820 con 0x7f73c806d390 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73cd134700 1 -- 172.21.15.84:0/2938151098 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c000b980 con 0x7f73c806d390 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.072+0000 7f73cd134700 1 -- 172.21.15.84:0/2938151098 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000bd20 con 0x7f73c806d390 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.073+0000 7f73d039a700 1 -- 172.21.15.84:0/2938151098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 msgr2=0x7f73c806eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.073+0000 7f73d039a700 1 --2- 172.21.15.84:0/2938151098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 0x7f73c806eba0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f73c8070020 tx=0x7f73c0009250 comp rx=0 tx=0).stop 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.073+0000 7f73d039a700 1 -- 172.21.15.84:0/2938151098 shutdown_connections 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.073+0000 7f73d039a700 1 --2- 172.21.15.84:0/2938151098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 0x7f73c806eba0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.073+0000 7f73d039a700 1 --2- 172.21.15.84:0/2938151098 >> v2:172.21.15.131:3300/0 conn(0x7f73c8069af0 0x7f73c80adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.073+0000 7f73d039a700 1 -- 172.21.15.84:0/2938151098 >> 172.21.15.84:0/2938151098 conn(0x7f73c80680c0 msgr2=0x7f73c80cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.073+0000 7f73d039a700 1 -- 172.21.15.84:0/2938151098 shutdown_connections 2023-10-06T03:00:49.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.073+0000 7f73d039a700 1 -- 172.21.15.84:0/2938151098 wait complete. 2023-10-06T03:00:49.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.074+0000 7f73d039a700 1 Processor -- start 2023-10-06T03:00:49.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.074+0000 7f73d039a700 1 -- start start 2023-10-06T03:00:49.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73d039a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73c8069720 0x7f73c8171920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73d039a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73c8069af0 0x7f73c80c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73d039a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 0x7f73c81556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73d039a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80c66c0 con 0x7f73c806d390 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73d039a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c8158970 con 0x7f73c8069af0 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73d039a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c8158c10 con 0x7f73c8069720 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce937700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 0x7f73c81556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce937700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 0x7f73c81556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41712/0 (socket says 172.21.15.84:41712) 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce937700 1 -- 172.21.15.84:0/1707603154 learned_addr learned my addr 172.21.15.84:0/1707603154 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce136700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73c8069720 0x7f73c8171920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73cd935700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73c8069af0 0x7f73c80c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce937700 1 -- 172.21.15.84:0/1707603154 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73c8069720 msgr2=0x7f73c8171920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce937700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73c8069720 0x7f73c8171920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce937700 1 -- 172.21.15.84:0/1707603154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73c8069af0 msgr2=0x7f73c80c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce937700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73c8069af0 0x7f73c80c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce937700 1 -- 172.21.15.84:0/1707603154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c00094f0 con 0x7f73c806d390 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73ce937700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 0x7f73c81556c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009290 tx=0x7f73c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73be7fc700 1 -- 172.21.15.84:0/1707603154 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c001b520 con 0x7f73c806d390 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73be7fc700 1 -- 172.21.15.84:0/1707603154 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c0020070 con 0x7f73c806d390 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73be7fc700 1 -- 172.21.15.84:0/1707603154 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c001b8f0 con 0x7f73c806d390 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c8158ef0 con 0x7f73c806d390 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.075+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c81594b0 con 0x7f73c806d390 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.076+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c80c6830 con 0x7f73c806d390 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.077+0000 7f73be7fc700 1 -- 172.21.15.84:0/1707603154 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73c0022030 con 0x7f73c806d390 2023-10-06T03:00:49.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.077+0000 7f73be7fc700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f73ac066f30 0x7f73ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.077+0000 7f73be7fc700 1 -- 172.21.15.84:0/1707603154 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f73c0086930 con 0x7f73c806d390 2023-10-06T03:00:49.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.077+0000 7f73ce136700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f73ac066f30 0x7f73ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.077+0000 7f73ce136700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f73ac066f30 0x7f73ac0693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f73c4007fd0 tx=0x7f73c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.081+0000 7f73be7fc700 1 -- 172.21.15.84:0/1707603154 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73c80c6830 con 0x7f73c806d390 2023-10-06T03:00:49.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.308+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73c80c6800 con 0x7f73c806d390 2023-10-06T03:00:49.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.309+0000 7f73be7fc700 1 -- 172.21.15.84:0/1707603154 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4633 (secure 0 0 0) 0x7f73c0053900 con 0x7f73c806d390 2023-10-06T03:00:49.310 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:49.311 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:00:49.161879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:00:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f73ac066f30 msgr2=0x7f73ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f73ac066f30 0x7f73ac0693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f73c4007fd0 tx=0x7f73c4009040 comp rx=0 tx=0).stop 2023-10-06T03:00:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 msgr2=0x7f73c81556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 0x7f73c81556c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009290 tx=0x7f73c0016000 comp rx=0 tx=0).stop 2023-10-06T03:00:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 shutdown_connections 2023-10-06T03:00:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f73ac066f30 0x7f73ac0693e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73c806d390 0x7f73c81556c0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f73c8069720 0x7f73c8171920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 --2- 172.21.15.84:0/1707603154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73c8069af0 0x7f73c80c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 >> 172.21.15.84:0/1707603154 conn(0x7f73c80680c0 msgr2=0x7f73c80c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 shutdown_connections 2023-10-06T03:00:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.311+0000 7f73d039a700 1 -- 172.21.15.84:0/1707603154 wait complete. 2023-10-06T03:00:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 88 2023-10-06T03:00:49.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:00:38.983477+0000', 'modified': '2023-10-06T03:00:49.161879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 7716, 'mds_1': 6802, 'mds_2': 6799}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6799': {'gid': 6799, 'name': 'd', 'rank': 2, 'incarnation': 87, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.131:6834/3567954898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6832', 'nonce': 3567954898}, {'type': 'v1', 'addr': '172.21.15.131:6834', 'nonce': 3567954898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6802': {'gid': 6802, 'name': 'b', 'rank': 1, 'incarnation': 85, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.131:6835/2772432276', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 2772432276}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 2772432276}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7716': {'gid': 7716, 'name': 'a', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6836/4266209083', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 4266209083}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 4266209083}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:00:49.730 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-06T03:00:49.730 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T03:00:49.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.845+0000 7fdfa11bd700 1 Processor -- start 2023-10-06T03:00:49.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.845+0000 7fdfa11bd700 1 -- start start 2023-10-06T03:00:49.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.845+0000 7fdfa11bd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf9c0b49e0 0x7fdf9c0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.845+0000 7fdfa11bd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b07a0 0x7fdf9c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.845+0000 7fdfa11bd700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9c0b0ca0 con 0x7fdf9c1595a0 2023-10-06T03:00:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.845+0000 7fdfa11bd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9c0b0f80 con 0x7fdf9c0b49e0 2023-10-06T03:00:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.845+0000 7fdfa11bd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c0b1260 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9b59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b07a0 0x7fdf9c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9a59c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf9c0b49e0 0x7fdf9c0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9ad9d700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fdf9c1595a0 0x7fdf9c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:53224/0 (socket says 172.21.15.84:53224) 2023-10-06T03:00:49.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9ad9d700 1 -- 172.21.15.84:0/3727432355 learned_addr learned my addr 172.21.15.84:0/3727432355 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf99d9b700 1 -- 172.21.15.84:0/3727432355 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075675110 0 0) 0x7fdf9c0b0ca0 con 0x7fdf9c1595a0 2023-10-06T03:00:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf99d9b700 1 -- 172.21.15.84:0/3727432355 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf84003570 con 0x7fdf9c1595a0 2023-10-06T03:00:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9b59e700 1 -- 172.21.15.84:0/3727432355 >> v2:172.21.15.131:3300/0 conn(0x7fdf9c0b49e0 msgr2=0x7fdf9c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/3727432355 >> v2:172.21.15.131:3300/0 conn(0x7fdf9c0b49e0 0x7fdf9c0aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9b59e700 1 -- 172.21.15.84:0/3727432355 >> v1:172.21.15.131:6789/0 conn(0x7fdf9c1595a0 legacy=0x7fdf9c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9b59e700 1 -- 172.21.15.84:0/3727432355 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c0b1540 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/3727432355 >> v2:172.21.15.131:3300/0 conn(0x7fdf9c0b49e0 0x7fdf9c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.846+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/3727432355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b07a0 0x7fdf9c0b1c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009e90 tx=0x7fdf94009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f6b1f2a25eb8cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdf99d9b700 1 -- 172.21.15.84:0/3727432355 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400e070 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdf99d9b700 1 -- 172.21.15.84:0/3727432355 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9400bb40 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdf99d9b700 1 -- 172.21.15.84:0/3727432355 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94012430 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3727432355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b07a0 msgr2=0x7fdf9c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdfa11bd700 1 --2- 172.21.15.84:0/3727432355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b07a0 0x7fdf9c0b1c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009e90 tx=0x7fdf94009780 comp rx=0 tx=0).stop 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3727432355 shutdown_connections 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdfa11bd700 1 --2- 172.21.15.84:0/3727432355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b07a0 0x7fdf9c0b1c00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdfa11bd700 1 --2- 172.21.15.84:0/3727432355 >> v2:172.21.15.131:3300/0 conn(0x7fdf9c0b49e0 0x7fdf9c0aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3727432355 >> 172.21.15.84:0/3727432355 conn(0x7fdf9c099830 msgr2=0x7fdf9c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3727432355 shutdown_connections 2023-10-06T03:00:49.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.847+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3727432355 wait complete. 2023-10-06T03:00:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.848+0000 7fdfa11bd700 1 Processor -- start 2023-10-06T03:00:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.848+0000 7fdfa11bd700 1 -- start start 2023-10-06T03:00:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdfa11bd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c0b07a0 0x7fdf9c0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdfa11bd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b49e0 0x7fdf9c15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdfa11bd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf9c1595a0 0x7fdf9c09a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdfa11bd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c09afa0 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdfa11bd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c15c4b0 con 0x7fdf9c1595a0 2023-10-06T03:00:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdfa11bd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c15b930 con 0x7fdf9c0b49e0 2023-10-06T03:00:49.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdf9ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c0b07a0 0x7fdf9c0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdf9ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c0b07a0 0x7fdf9c0ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41726/0 (socket says 172.21.15.84:41726) 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdf9ad9d700 1 -- 172.21.15.84:0/3247733961 learned_addr learned my addr 172.21.15.84:0/3247733961 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf9c1595a0 0x7fdf9c09a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.849+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b49e0 0x7fdf9c15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdf9ad9d700 1 -- 172.21.15.84:0/3247733961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b49e0 msgr2=0x7fdf9c15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b49e0 0x7fdf9c15b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdf9ad9d700 1 -- 172.21.15.84:0/3247733961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf9c1595a0 msgr2=0x7fdf9c09a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf9c1595a0 0x7fdf9c09a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdf9ad9d700 1 -- 172.21.15.84:0/3247733961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90009420 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c0b07a0 0x7fdf9c0ceb70 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c001f20 tx=0x7fdf8c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdf82ffd700 1 -- 172.21.15.84:0/3247733961 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c005b80 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdf82ffd700 1 -- 172.21.15.84:0/3247733961 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c005ce0 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3247733961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf94009a20 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdf82ffd700 1 -- 172.21.15.84:0/3247733961 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c007320 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.850+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3247733961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9c15bef0 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.851+0000 7fdf82ffd700 1 -- 172.21.15.84:0/3247733961 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf8c0076d0 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.852+0000 7fdf82ffd700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf88066f30 0x7fdf880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.852+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf88066f30 0x7fdf880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.852+0000 7fdf82ffd700 1 -- 172.21.15.84:0/3247733961 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdf8c083ba0 con 0x7fdf9c0b07a0 2023-10-06T03:00:49.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.852+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf88066f30 0x7fdf880693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c099f60 tx=0x7fdf900091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.854+0000 7fdfaa4b5b80 1 Processor -- start 2023-10-06T03:00:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.854+0000 7fdfaa4b5b80 1 -- start start 2023-10-06T03:00:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d027840 0x55aa3d027c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d028cc0 0x55aa3d0776c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 0x55aa3d078050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3cf7ea70 con 0x55aa3d028cc0 2023-10-06T03:00:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3cf7c270 con 0x55aa3d077c00 2023-10-06T03:00:49.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa3cf78060 con 0x55aa3d027840 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d028cc0 0x55aa3d0776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d028cc0 0x55aa3d0776c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41740/0 (socket says 172.21.15.84:41740) 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9a59c700 1 -- 172.21.15.84:0/123365272 learned_addr learned my addr 172.21.15.84:0/123365272 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d027840 0x55aa3d027c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 0x55aa3d078050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9a59c700 1 -- 172.21.15.84:0/123365272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d027840 msgr2=0x55aa3d027c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d027840 0x55aa3d027c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9a59c700 1 -- 172.21.15.84:0/123365272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 msgr2=0x55aa3d078050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 0x55aa3d078050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9a59c700 1 -- 172.21.15.84:0/123365272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa3ce12270 con 0x55aa3d028cc0 2023-10-06T03:00:49.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d027840 0x55aa3d027c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d028cc0 0x55aa3d0776c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdf90012010 tx=0x7fdf90019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb0e85df00e16fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf7bfff700 1 -- 172.21.15.84:0/123365272 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90014d10 con 0x55aa3d028cc0 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf7bfff700 1 -- 172.21.15.84:0/123365272 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9002a070 con 0x55aa3d028cc0 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.855+0000 7fdf7bfff700 1 -- 172.21.15.84:0/123365272 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90026d40 con 0x55aa3d028cc0 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.856+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/123365272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d028cc0 msgr2=0x55aa3d0776c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.856+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d028cc0 0x55aa3d0776c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdf90012010 tx=0x7fdf90019000 comp rx=0 tx=0).stop 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.856+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/123365272 shutdown_connections 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.856+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 0x55aa3d078050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.856+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d027840 0x55aa3d027c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.856+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/123365272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d028cc0 0x55aa3d0776c0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.856+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/123365272 >> 172.21.15.84:0/123365272 conn(0x55aa3d029160 msgr2=0x55aa3d029530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.856+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/123365272 shutdown_connections 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.856+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/123365272 wait complete. 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.857+0000 7fdfaa4b5b80 1 -- start start 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.857+0000 7fdfaa4b5b80 1 Processor -- start 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d027840 0x55aa3d0543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d022f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 0x55aa3d023470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3cf23890 con 0x55aa3d027840 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3cf3eea0 con 0x55aa3d077c00 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa3cdfae30 con 0x55aa3d028cc0 2023-10-06T03:00:49.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdfaa4b5b80 10 client.0 _ll_register_callbacks cb 0x55aa3cfeae70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d027840 0x55aa3d0543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d027840 0x55aa3d0543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41746/0 (socket says 172.21.15.84:41746) 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9ad9d700 1 -- 172.21.15.84:0/3357818276 learned_addr learned my addr 172.21.15.84:0/3357818276 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 0x55aa3d023470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d022f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9ad9d700 1 -- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 msgr2=0x55aa3d022f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d022f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9ad9d700 1 -- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 msgr2=0x55aa3d023470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 0x55aa3d023470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9ad9d700 1 -- 172.21.15.84:0/3357818276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf90011bf0 con 0x55aa3d027840 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d027840 0x55aa3d0543f0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c000c00 tx=0x7fdf8c081d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f710e9e112958d9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf797fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf797fa700 1 -- 172.21.15.84:0/3357818276 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c057a60 con 0x55aa3d027840 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdf797fa700 1 -- 172.21.15.84:0/3357818276 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdf8c05b7b0 con 0x55aa3d027840 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.858+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/3357818276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa3d01c940 con 0x55aa3d027840 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdf797fa700 1 -- 172.21.15.84:0/3357818276 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf8c07dea0 con 0x55aa3d027840 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdfaa4b5b80 10 client.7905 fetch_fsmap learned FSMap version 88 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/3357818276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x55aa3cdb4fe0 con 0x55aa3d027840 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdf797fa700 1 -- 172.21.15.84:0/3357818276 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aa3d01c940 con 0x55aa3d027840 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdf797fa700 1 -- 172.21.15.84:0/3357818276 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 88) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fdf8c070250 con 0x55aa3d027840 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdfaa4b5b80 10 client.7905 fetch_fsmap finished waiting for FSMap version 88 2023-10-06T03:00:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdfaa4b5b80 10 client.7905 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdfaa4b5b80 20 client.7905 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55aa3d06a730 0x55aa3d06ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdfaa4b5b80 4 client.7905 mds_command: new command op to 6799 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/3357818276 --> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa3cff9870 con 0x55aa3d06a730 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.859+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55aa3d06a730 0x55aa3d06ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdf797fa700 10 client.7905 ms_handle_connect on v2:172.21.15.131:6832/3567954898 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55aa3d06a730 0x55aa3d06ab00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbcb869a8eb959b1 server_cookie=41d1fc2c7abef47a in_seq=0 out_seq=0 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdf797fa700 1 -- 172.21.15.84:0/3357818276 <== mds.2 v2:172.21.15.131:6832/3567954898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55aa3cff9870 con 0x55aa3d06a730 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdf797fa700 10 client.7905 handle_command_reply: tid=0 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdfaa4b5b80 1 client.7905 shutdown 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/3357818276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d027840 msgr2=0x55aa3d0543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d027840 0x55aa3d0543f0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c000c00 tx=0x7fdf8c081d60 comp rx=0 tx=0).stop 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/3357818276 shutdown_connections 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55aa3d06a730 0x55aa3d06ab00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d077c00 0x55aa3d023470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d027840 0x55aa3d0543f0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/3357818276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d022f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.860+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/3357818276 >> 172.21.15.84:0/3357818276 conn(0x55aa3d029160 msgr2=0x55aa3d02aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.861+0000 7fdf797fa700 0 client.7905 ms_handle_reset on v2:172.21.15.131:6832/3567954898 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.861+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/3357818276 shutdown_connections 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.861+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/3357818276 wait complete. 2023-10-06T03:00:49.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.861+0000 7fdfaa4b5b80 20 client.7905 trim_cache size 0 max 16384 2023-10-06T03:00:49.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.877+0000 7fdfaa4b5b80 1 Processor -- start 2023-10-06T03:00:49.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdfaa4b5b80 1 -- start start 2023-10-06T03:00:49.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d027840 0x55aa3d071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d072450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3d022620 con 0x55aa3d077c00 2023-10-06T03:00:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3d04d850 con 0x55aa3d027840 2023-10-06T03:00:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa3d0072e0 con 0x55aa3d028cc0 2023-10-06T03:00:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdf9b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdf9b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d072450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41758/0 (socket says 172.21.15.84:41758) 2023-10-06T03:00:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdf9b59e700 1 -- 172.21.15.84:0/568027532 learned_addr learned my addr 172.21.15.84:0/568027532 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.878+0000 7fdf9b59e700 1 -- 172.21.15.84:0/568027532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 msgr2=0x55aa3d071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/568027532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdf9b59e700 1 -- 172.21.15.84:0/568027532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d027840 msgr2=0x55aa3d071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/568027532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d027840 0x55aa3d071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdf9b59e700 1 -- 172.21.15.84:0/568027532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa3cf46780 con 0x55aa3d077c00 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/568027532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d072450 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fdf940094d0 tx=0x7fdf94019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa0baf42422f356 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdf80ff9700 1 -- 172.21.15.84:0/568027532 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94012bc0 con 0x55aa3d077c00 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdf80ff9700 1 -- 172.21.15.84:0/568027532 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf94025040 con 0x55aa3d077c00 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdf80ff9700 1 -- 172.21.15.84:0/568027532 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9401e420 con 0x55aa3d077c00 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/568027532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 msgr2=0x55aa3d072450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/568027532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d072450 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fdf940094d0 tx=0x7fdf94019000 comp rx=0 tx=0).stop 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/568027532 shutdown_connections 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/568027532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d027840 0x55aa3d071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/568027532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d072450 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/568027532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/568027532 >> 172.21.15.84:0/568027532 conn(0x55aa3d029160 msgr2=0x55aa3d0258d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/568027532 shutdown_connections 2023-10-06T03:00:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.879+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/568027532 wait complete. 2023-10-06T03:00:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.880+0000 7fdfaa4b5b80 1 -- start start 2023-10-06T03:00:49.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.880+0000 7fdfaa4b5b80 1 Processor -- start 2023-10-06T03:00:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d027840 0x55aa3d074000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d087980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdfaa4b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3d074900 con 0x55aa3d077c00 2023-10-06T03:00:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa3d0874f0 con 0x55aa3d027840 2023-10-06T03:00:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdfaa4b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa3d0871a0 con 0x55aa3d028cc0 2023-10-06T03:00:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdfaa4b5b80 10 client.0 _ll_register_callbacks cb 0x55aa3cfeae70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41762/0 (socket says 172.21.15.84:41762) 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9b59e700 1 -- 172.21.15.84:0/1715576626 learned_addr learned my addr 172.21.15.84:0/1715576626 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9a59c700 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d087980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d027840 0x55aa3d074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9b59e700 1 -- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 msgr2=0x55aa3d087980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d087980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9b59e700 1 -- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d027840 msgr2=0x55aa3d074000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d027840 0x55aa3d074000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9b59e700 1 -- 172.21.15.84:0/1715576626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9c0b1540 con 0x55aa3d077c00 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf9b59e700 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d071f10 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400d010 tx=0x7fdf94026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96846587423c159b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.881+0000 7fdf797fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:49.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdf797fa700 1 -- 172.21.15.84:0/1715576626 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9401e9a0 con 0x55aa3d077c00 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdf797fa700 1 -- 172.21.15.84:0/1715576626 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fdf9401eb00 con 0x55aa3d077c00 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/1715576626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf9002a070 con 0x55aa3d077c00 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdf797fa700 1 -- 172.21.15.84:0/1715576626 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf94032410 con 0x55aa3d077c00 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdfaa4b5b80 10 client.7911 fetch_fsmap learned FSMap version 88 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/1715576626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x55aa3cf2d470 con 0x55aa3d077c00 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdf797fa700 1 -- 172.21.15.84:0/1715576626 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9002a070 con 0x55aa3d077c00 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdf797fa700 1 -- 172.21.15.84:0/1715576626 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 88) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fdf94032570 con 0x55aa3d077c00 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdfaa4b5b80 10 client.7911 fetch_fsmap finished waiting for FSMap version 88 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdfaa4b5b80 10 client.7911 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdfaa4b5b80 20 client.7911 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55aa3d087ec0 0x55aa3d072450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdfaa4b5b80 4 client.7911 mds_command: new command op to 6799 tid=0[{"prefix": "status"}] 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/1715576626 --> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55aa3cf1ae00 con 0x55aa3d087ec0 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.882+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55aa3d087ec0 0x55aa3d072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdf797fa700 10 client.7911 ms_handle_connect on v2:172.21.15.131:6832/3567954898 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdf9ad9d700 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55aa3d087ec0 0x55aa3d072450 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ceb21e28e510f10 server_cookie=76771a5930ed396 in_seq=0 out_seq=0 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdf797fa700 1 -- 172.21.15.84:0/1715576626 <== mds.2 v2:172.21.15.131:6832/3567954898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55aa3cf1ae00 con 0x55aa3d087ec0 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdf797fa700 10 client.7911 handle_command_reply: tid=0 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 client.7911 shutdown 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/1715576626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 msgr2=0x55aa3d071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d071f10 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400d010 tx=0x7fdf94026000 comp rx=0 tx=0).stop 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/1715576626 shutdown_connections 2023-10-06T03:00:49.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55aa3d087ec0 0x55aa3d072450 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa3d027840 0x55aa3d074000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa3d077c00 0x55aa3d071f10 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 --2- 172.21.15.84:0/1715576626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aa3d028cc0 0x55aa3d087980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdf797fa700 0 client.7911 ms_handle_reset on v2:172.21.15.131:6832/3567954898 2023-10-06T03:00:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/1715576626 >> 172.21.15.84:0/1715576626 conn(0x55aa3d029160 msgr2=0x55aa3d071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/1715576626 shutdown_connections 2023-10-06T03:00:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 1 -- 172.21.15.84:0/1715576626 wait complete. 2023-10-06T03:00:49.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.883+0000 7fdfaa4b5b80 20 client.7911 trim_cache size 0 max 16384 2023-10-06T03:00:49.892 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6799, 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 1.721664912, 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 88, 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 94, 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 94, 2023-10-06T03:00:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.402402565999999 2023-10-06T03:00:49.894 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:49.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf88066f30 msgr2=0x7fdf880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf88066f30 0x7fdf880693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c099f60 tx=0x7fdf900091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c0b07a0 msgr2=0x7fdf9c0ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c0b07a0 0x7fdf9c0ceb70 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c001f20 tx=0x7fdf8c007de0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3247733961 shutdown_connections 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf88066f30 0x7fdf880693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf9c1595a0 0x7fdf9c09a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c0b07a0 0x7fdf9c0ceb70 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 --2- 172.21.15.84:0/3247733961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf9c0b49e0 0x7fdf9c15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3247733961 >> 172.21.15.84:0/3247733961 conn(0x7fdf9c099830 msgr2=0x7fdf9c068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3247733961 shutdown_connections 2023-10-06T03:00:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:49.884+0000 7fdfa11bd700 1 -- 172.21.15.84:0/3247733961 wait complete. 2023-10-06T03:00:49.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:00:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.011+0000 7f7d8a613700 1 Processor -- start 2023-10-06T03:00:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.011+0000 7f7d8a613700 1 -- start start 2023-10-06T03:00:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.012+0000 7f7d8a613700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d840adf60 0x7f7d840ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.012+0000 7f7d8a613700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d8406e280 0x7f7d8406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.012+0000 7f7d8a613700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d840c7370 con 0x7f7d84069560 2023-10-06T03:00:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.012+0000 7f7d8a613700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d84156150 con 0x7f7d8406e280 2023-10-06T03:00:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.012+0000 7f7d8a613700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840ac580 con 0x7f7d840adf60 2023-10-06T03:00:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.012+0000 7f7d837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7d8406e280 0x7f7d8406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.012+0000 7f7d88bb0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7d84069560 0x7f7d840c7800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52410/0 (socket says 172.21.15.84:52410) 2023-10-06T03:00:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.012+0000 7f7d88bb0700 1 -- 172.21.15.84:0/1308967726 learned_addr learned my addr 172.21.15.84:0/1308967726 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:50.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d83fff700 1 --2- 172.21.15.84:0/1308967726 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d840adf60 0x7f7d840ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d82ffd700 1 -- 172.21.15.84:0/1308967726 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519076757 0 0) 0x7f7d840c7370 con 0x7f7d84069560 2023-10-06T03:00:50.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d82ffd700 1 -- 172.21.15.84:0/1308967726 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d6c003570 con 0x7f7d84069560 2023-10-06T03:00:50.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d837fe700 1 -- 172.21.15.84:0/1308967726 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d840adf60 msgr2=0x7f7d840ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d837fe700 1 --2- 172.21.15.84:0/1308967726 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d840adf60 0x7f7d840ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d837fe700 1 -- 172.21.15.84:0/1308967726 >> v1:172.21.15.84:6789/0 conn(0x7f7d84069560 legacy=0x7f7d840c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d837fe700 1 -- 172.21.15.84:0/1308967726 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d840c6760 con 0x7f7d8406e280 2023-10-06T03:00:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d837fe700 1 --2- 172.21.15.84:0/1308967726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d8406e280 0x7f7d8406e6f0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7d780098e0 tx=0x7f7d780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132ea214686bacc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d82ffd700 1 -- 172.21.15.84:0/1308967726 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78011630 con 0x7f7d8406e280 2023-10-06T03:00:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d82ffd700 1 -- 172.21.15.84:0/1308967726 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78011790 con 0x7f7d8406e280 2023-10-06T03:00:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.013+0000 7f7d82ffd700 1 -- 172.21.15.84:0/1308967726 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78011b30 con 0x7f7d8406e280 2023-10-06T03:00:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.014+0000 7f7d8a613700 1 -- 172.21.15.84:0/1308967726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d8406e280 msgr2=0x7f7d8406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.014+0000 7f7d8a613700 1 --2- 172.21.15.84:0/1308967726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d8406e280 0x7f7d8406e6f0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7d780098e0 tx=0x7f7d780091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.014+0000 7f7d8a613700 1 -- 172.21.15.84:0/1308967726 shutdown_connections 2023-10-06T03:00:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.014+0000 7f7d8a613700 1 --2- 172.21.15.84:0/1308967726 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d840adf60 0x7f7d840ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.014+0000 7f7d8a613700 1 --2- 172.21.15.84:0/1308967726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d8406e280 0x7f7d8406e6f0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.014+0000 7f7d8a613700 1 -- 172.21.15.84:0/1308967726 >> 172.21.15.84:0/1308967726 conn(0x7f7d840680c0 msgr2=0x7f7d840cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.014+0000 7f7d8a613700 1 -- 172.21.15.84:0/1308967726 shutdown_connections 2023-10-06T03:00:50.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.014+0000 7f7d8a613700 1 -- 172.21.15.84:0/1308967726 wait complete. 2023-10-06T03:00:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.015+0000 7f7d8a613700 1 Processor -- start 2023-10-06T03:00:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.015+0000 7f7d8a613700 1 -- start start 2023-10-06T03:00:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d8a613700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d84069560 0x7f7d840c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d8a613700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d8406e280 0x7f7d840c1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d8a613700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d840adf60 0x7f7d8414e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d8a613700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c2f40 con 0x7f7d84069560 2023-10-06T03:00:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d8a613700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c2570 con 0x7f7d840adf60 2023-10-06T03:00:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d8a613700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c1960 con 0x7f7d8406e280 2023-10-06T03:00:50.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d83fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d84069560 0x7f7d840c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d83fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d84069560 0x7f7d840c2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41786/0 (socket says 172.21.15.84:41786) 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d83fff700 1 -- 172.21.15.84:0/124323672 learned_addr learned my addr 172.21.15.84:0/124323672 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d837fe700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d8406e280 0x7f7d840c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d88bb0700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d840adf60 0x7f7d8414e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d83fff700 1 -- 172.21.15.84:0/124323672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d8406e280 msgr2=0x7f7d840c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d83fff700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d8406e280 0x7f7d840c1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d83fff700 1 -- 172.21.15.84:0/124323672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d840adf60 msgr2=0x7f7d8414e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d83fff700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d840adf60 0x7f7d8414e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d83fff700 1 -- 172.21.15.84:0/124323672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d78009420 con 0x7f7d84069560 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d83fff700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d84069560 0x7f7d840c2a00 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400e930 tx=0x7f7d740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d6bfff700 1 -- 172.21.15.84:0/124323672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74013680 con 0x7f7d84069560 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d6bfff700 1 -- 172.21.15.84:0/124323672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d740137e0 con 0x7f7d84069560 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d8a613700 1 -- 172.21.15.84:0/124323672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d840c1c40 con 0x7f7d84069560 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d6bfff700 1 -- 172.21.15.84:0/124323672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74013b80 con 0x7f7d84069560 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.016+0000 7f7d8a613700 1 -- 172.21.15.84:0/124323672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d840c2200 con 0x7f7d84069560 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.018+0000 7f7d6bfff700 1 -- 172.21.15.84:0/124323672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d7400c460 con 0x7f7d84069560 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.018+0000 7f7d6bfff700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d70066f30 0x7f7d700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.018+0000 7f7d6bfff700 1 -- 172.21.15.84:0/124323672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7d740849b0 con 0x7f7d84069560 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.018+0000 7f7d837fe700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d70066f30 0x7f7d700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.019+0000 7f7d837fe700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d70066f30 0x7f7d700693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7d780091e0 tx=0x7f7d78017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.020+0000 7f7d9390bb80 1 Processor -- start 2023-10-06T03:00:50.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.020+0000 7f7d9390bb80 1 -- start start 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 0x557a098f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a0990f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a0981fa70 con 0x557a09912af0 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a0981d270 con 0x557a098f5220 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a09819060 con 0x557a098c8bb0 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41802/0 (socket says 172.21.15.84:41802) 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d837fe700 1 -- 172.21.15.84:0/1423718651 learned_addr learned my addr 172.21.15.84:0/1423718651 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d83fff700 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 0x557a098f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.021+0000 7f7d88bb0700 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a0990f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d837fe700 1 -- 172.21.15.84:0/1423718651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 msgr2=0x557a0990f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d837fe700 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a0990f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d837fe700 1 -- 172.21.15.84:0/1423718651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 msgr2=0x557a098f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d837fe700 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 0x557a098f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d837fe700 1 -- 172.21.15.84:0/1423718651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a096b3270 con 0x557a09912af0 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d88bb0700 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a0990f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d837fe700 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c8670 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f7d78013000 tx=0x7f7d78021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2877ae5d70d2ec56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d697fa700 1 -- 172.21.15.84:0/1423718651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7802d070 con 0x557a09912af0 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d697fa700 1 -- 172.21.15.84:0/1423718651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78028a00 con 0x557a09912af0 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.022+0000 7f7d697fa700 1 -- 172.21.15.84:0/1423718651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78021070 con 0x557a09912af0 2023-10-06T03:00:50.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1423718651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 msgr2=0x557a098c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c8670 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f7d78013000 tx=0x7f7d78021000 comp rx=0 tx=0).stop 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1423718651 shutdown_connections 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 0x557a098f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a0990f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1423718651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c8670 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1423718651 >> 172.21.15.84:0/1423718651 conn(0x557a098ca160 msgr2=0x557a098ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1423718651 shutdown_connections 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1423718651 wait complete. 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 -- start start 2023-10-06T03:00:50.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.023+0000 7f7d9390bb80 1 Processor -- start 2023-10-06T03:00:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098c8bb0 0x557a098f4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a09912af0 0x557a0990c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a097c4890 con 0x557a098f5220 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a097dfea0 con 0x557a098c8bb0 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a0969be30 con 0x557a09912af0 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d9390bb80 10 client.0 _ll_register_callbacks cb 0x557a0988be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098c5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41816/0 (socket says 172.21.15.84:41816) 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d837fe700 1 -- 172.21.15.84:0/3682281227 learned_addr learned my addr 172.21.15.84:0/3682281227 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d83fff700 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098c8bb0 0x557a098f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.024+0000 7f7d88bb0700 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a09912af0 0x557a0990c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d837fe700 1 -- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a09912af0 msgr2=0x557a0990c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d837fe700 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a09912af0 0x557a0990c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d837fe700 1 -- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098c8bb0 msgr2=0x557a098f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d837fe700 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098c8bb0 0x557a098f4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d837fe700 1 -- 172.21.15.84:0/3682281227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d840c6760 con 0x557a098f5220 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d83fff700 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098c8bb0 0x557a098f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d837fe700 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098c5ab0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f7d840cd110 tx=0x7f7d7802a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd100bb85ca6a28c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d627fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d627fc700 1 -- 172.21.15.84:0/3682281227 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7802d070 con 0x557a098f5220 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d627fc700 1 -- 172.21.15.84:0/3682281227 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7d78033700 con 0x557a098f5220 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d9390bb80 1 -- 172.21.15.84:0/3682281227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a098bd940 con 0x557a098f5220 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d627fc700 1 -- 172.21.15.84:0/3682281227 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d78021040 con 0x557a098f5220 2023-10-06T03:00:50.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d9390bb80 10 client.7926 fetch_fsmap learned FSMap version 88 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d9390bb80 1 -- 172.21.15.84:0/3682281227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x557a09655fe0 con 0x557a098f5220 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d627fc700 1 -- 172.21.15.84:0/3682281227 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557a098bd940 con 0x557a098f5220 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d627fc700 1 -- 172.21.15.84:0/3682281227 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 88) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f7d78033ad0 con 0x557a098f5220 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d9390bb80 10 client.7926 fetch_fsmap finished waiting for FSMap version 88 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d9390bb80 10 client.7926 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d9390bb80 20 client.7926 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x557a098f5be0 0x557a098f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d9390bb80 4 client.7926 mds_command: new command op to 6802 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.025+0000 7f7d9390bb80 1 -- 172.21.15.84:0/3682281227 --> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a0989a870 con 0x557a098f5be0 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.026+0000 7f7d83fff700 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x557a098f5be0 0x557a098f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.026+0000 7f7d627fc700 10 client.7926 ms_handle_connect on v2:172.21.15.131:6833/2772432276 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.026+0000 7f7d83fff700 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x557a098f5be0 0x557a098f5fb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf865b41bd8c4aca server_cookie=9c2a85f9e6dc13ff in_seq=0 out_seq=0 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.026+0000 7f7d627fc700 1 -- 172.21.15.84:0/3682281227 <== mds.1 v2:172.21.15.131:6833/2772432276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557a0989a870 con 0x557a098f5be0 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.026+0000 7f7d627fc700 10 client.7926 handle_command_reply: tid=0 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.026+0000 7f7d9390bb80 1 client.7926 shutdown 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 -- 172.21.15.84:0/3682281227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 msgr2=0x557a098c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098c5ab0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f7d840cd110 tx=0x7f7d7802a050 comp rx=0 tx=0).stop 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 -- 172.21.15.84:0/3682281227 shutdown_connections 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x557a098f5be0 0x557a098f5fb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098c8bb0 0x557a098f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d627fc700 0 client.7926 ms_handle_reset on v2:172.21.15.131:6833/2772432276 2023-10-06T03:00:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a09912af0 0x557a0990c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/3682281227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098c5ab0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 -- 172.21.15.84:0/3682281227 >> 172.21.15.84:0/3682281227 conn(0x557a098ca160 msgr2=0x557a098c91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 -- 172.21.15.84:0/3682281227 shutdown_connections 2023-10-06T03:00:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 1 -- 172.21.15.84:0/3682281227 wait complete. 2023-10-06T03:00:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.027+0000 7f7d9390bb80 20 client.7926 trim_cache size 0 max 16384 2023-10-06T03:00:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.043+0000 7f7d9390bb80 1 Processor -- start 2023-10-06T03:00:50.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.044+0000 7f7d9390bb80 1 -- start start 2023-10-06T03:00:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.044+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a098c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.044+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 0x557a09909500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.044+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.044+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a0990f110 con 0x557a09912af0 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.044+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a0990f2f0 con 0x557a098f5220 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.044+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a0989a870 con 0x557a098c8bb0 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d88bb0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d88bb0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41822/0 (socket says 172.21.15.84:41822) 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d88bb0700 1 -- 172.21.15.84:0/1826160257 learned_addr learned my addr 172.21.15.84:0/1826160257 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d88bb0700 1 -- 172.21.15.84:0/1826160257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 msgr2=0x557a098c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d88bb0700 1 --2- 172.21.15.84:0/1826160257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a098c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d88bb0700 1 -- 172.21.15.84:0/1826160257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 msgr2=0x557a09909500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d837fe700 1 --2- 172.21.15.84:0/1826160257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 0x557a09909500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d88bb0700 1 --2- 172.21.15.84:0/1826160257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 0x557a09909500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d88bb0700 1 -- 172.21.15.84:0/1826160257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a097e7780 con 0x557a09912af0 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d88bb0700 1 --2- 172.21.15.84:0/1826160257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c3a10 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0020d0 tx=0x7f7d7c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a969593b611ff8aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d69ffb700 1 -- 172.21.15.84:0/1826160257 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0079a0 con 0x557a09912af0 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d69ffb700 1 -- 172.21.15.84:0/1826160257 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c007b00 con 0x557a09912af0 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.045+0000 7f7d69ffb700 1 -- 172.21.15.84:0/1826160257 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0166d0 con 0x557a09912af0 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1826160257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 msgr2=0x557a098c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1826160257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c3a10 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0020d0 tx=0x7f7d7c009040 comp rx=0 tx=0).stop 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1826160257 shutdown_connections 2023-10-06T03:00:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1826160257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a09912af0 0x557a098c3a10 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1826160257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a098c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1826160257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a098f5220 0x557a09909500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1826160257 >> 172.21.15.84:0/1826160257 conn(0x557a098ca160 msgr2=0x557a098f24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1826160257 shutdown_connections 2023-10-06T03:00:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1826160257 wait complete. 2023-10-06T03:00:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 -- start start 2023-10-06T03:00:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.046+0000 7f7d9390bb80 1 Processor -- start 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a09961d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098f4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d9390bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a09912af0 0x557a098f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a09911fa0 con 0x557a098f5220 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a098f49b0 con 0x557a09912af0 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d9390bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a099790b0 con 0x557a098c8bb0 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d9390bb80 10 client.0 _ll_register_callbacks cb 0x557a0988be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41828/0 (socket says 172.21.15.84:41828) 2023-10-06T03:00:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d837fe700 1 -- 172.21.15.84:0/1700324242 learned_addr learned my addr 172.21.15.84:0/1700324242 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d88bb0700 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a09912af0 0x557a098f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d83fff700 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a09961d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d837fe700 1 -- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 msgr2=0x557a09961d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d837fe700 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a09961d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d837fe700 1 -- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a09912af0 msgr2=0x557a098f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d837fe700 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a09912af0 0x557a098f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d837fe700 1 -- 172.21.15.84:0/1700324242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7c00f040 con 0x557a098f5220 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.047+0000 7f7d83fff700 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a09961d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d837fe700 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098f4470 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f7d78000e50 tx=0x7f7d78035040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e716eed808dd519d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d627fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d627fc700 1 -- 172.21.15.84:0/1700324242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78021040 con 0x557a098f5220 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d627fc700 1 -- 172.21.15.84:0/1700324242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7d78033700 con 0x557a098f5220 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1700324242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d78028a00 con 0x557a098f5220 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d627fc700 1 -- 172.21.15.84:0/1700324242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d7802d040 con 0x557a098f5220 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d9390bb80 10 client.7932 fetch_fsmap learned FSMap version 88 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1700324242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x557a097ce470 con 0x557a098f5220 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d627fc700 1 -- 172.21.15.84:0/1700324242 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78028a00 con 0x557a098f5220 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d627fc700 1 -- 172.21.15.84:0/1700324242 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 88) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f7d78033ad0 con 0x557a098f5220 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d9390bb80 10 client.7932 fetch_fsmap finished waiting for FSMap version 88 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d9390bb80 10 client.7932 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d9390bb80 20 client.7932 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x557a098f2bb0 0x557a098f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d9390bb80 4 client.7932 mds_command: new command op to 6802 tid=0[{"prefix": "status"}] 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1700324242 --> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557a097bbe00 con 0x557a098f2bb0 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.048+0000 7f7d83fff700 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x557a098f2bb0 0x557a098f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d627fc700 10 client.7932 ms_handle_connect on v2:172.21.15.131:6833/2772432276 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d83fff700 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x557a098f2bb0 0x557a098f2f80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba6acb8609073324 server_cookie=4048620b9f19825c in_seq=0 out_seq=0 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d627fc700 1 -- 172.21.15.84:0/1700324242 <== mds.1 v2:172.21.15.131:6833/2772432276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x557a097bbe00 con 0x557a098f2bb0 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d627fc700 10 client.7932 handle_command_reply: tid=0 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 client.7932 shutdown 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1700324242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 msgr2=0x557a098f4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098f4470 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f7d78000e50 tx=0x7f7d78035040 comp rx=0 tx=0).stop 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1700324242 shutdown_connections 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x557a098f2bb0 0x557a098f2f80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a09912af0 0x557a098f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557a098c8bb0 0x557a09961d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d627fc700 0 client.7932 ms_handle_reset on v2:172.21.15.131:6833/2772432276 2023-10-06T03:00:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 --2- 172.21.15.84:0/1700324242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557a098f5220 0x557a098f4470 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1700324242 >> 172.21.15.84:0/1700324242 conn(0x557a098ca160 msgr2=0x557a098c3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1700324242 shutdown_connections 2023-10-06T03:00:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 1 -- 172.21.15.84:0/1700324242 wait complete. 2023-10-06T03:00:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.049+0000 7f7d9390bb80 20 client.7932 trim_cache size 0 max 16384 2023-10-06T03:00:50.058 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6802, 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 2.89692353, 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 88, 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 94, 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 94, 2023-10-06T03:00:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.568361204999999 2023-10-06T03:00:50.060 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:50.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 -- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d70066f30 msgr2=0x7f7d700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d70066f30 0x7f7d700693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7d780091e0 tx=0x7f7d78017000 comp rx=0 tx=0).stop 2023-10-06T03:00:50.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 -- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d84069560 msgr2=0x7f7d840c2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d84069560 0x7f7d840c2a00 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400e930 tx=0x7f7d740091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 -- 172.21.15.84:0/124323672 shutdown_connections 2023-10-06T03:00:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d70066f30 0x7f7d700693e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d840adf60 0x7f7d8414e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d84069560 0x7f7d840c2a00 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 --2- 172.21.15.84:0/124323672 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d8406e280 0x7f7d840c1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 -- 172.21.15.84:0/124323672 >> 172.21.15.84:0/124323672 conn(0x7f7d840680c0 msgr2=0x7f7d8406d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 -- 172.21.15.84:0/124323672 shutdown_connections 2023-10-06T03:00:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.050+0000 7f7d8a613700 1 -- 172.21.15.84:0/124323672 wait complete. 2023-10-06T03:00:50.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:00:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.179+0000 7fcfd5f93700 1 Processor -- start 2023-10-06T03:00:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.179+0000 7fcfd5f93700 1 -- start start 2023-10-06T03:00:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.179+0000 7fcfd5f93700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcfd0069720 0x7fcfd0069af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.179+0000 7fcfd5f93700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd006e710 con 0x7fcfd00adaa0 2023-10-06T03:00:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.179+0000 7fcfd5f93700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd006db00 con 0x7fcfd006d390 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.179+0000 7fcfd5f93700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00cd040 con 0x7fcfd0069720 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfcf7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcfd0069720 0x7fcfd0069af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfcf7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcfd0069720 0x7fcfd0069af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41830/0 (socket says 172.21.15.84:41830) 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfceffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcfd00adaa0 0x7fcfd00aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52416/0 (socket says 172.21.15.84:52416) 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/370273908 learned_addr learned my addr 172.21.15.84:0/370273908 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/370273908 >> v1:172.21.15.131:6789/0 conn(0x7fcfd006d390 legacy=0x7fcfd006eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/370273908 >> v1:172.21.15.84:6789/0 conn(0x7fcfd00adaa0 legacy=0x7fcfd00aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/370273908 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd006dde0 con 0x7fcfd0069720 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfce7fc700 1 -- 172.21.15.84:0/370273908 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181777952 0 0) 0x7fcfd006e710 con 0x7fcfd00adaa0 2023-10-06T03:00:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/370273908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd0069720 0x7fcfd0069af0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009f20 tx=0x7fcfc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e967530357a1c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfce7fc700 1 -- 172.21.15.84:0/370273908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc000e070 con 0x7fcfd0069720 2023-10-06T03:00:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfce7fc700 1 -- 172.21.15.84:0/370273908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc000ba80 con 0x7fcfd0069720 2023-10-06T03:00:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.180+0000 7fcfce7fc700 1 -- 172.21.15.84:0/370273908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00092e0 con 0x7fcfd0069720 2023-10-06T03:00:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.181+0000 7fcfd5f93700 1 -- 172.21.15.84:0/370273908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd0069720 msgr2=0x7fcfd0069af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.181+0000 7fcfd5f93700 1 --2- 172.21.15.84:0/370273908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd0069720 0x7fcfd0069af0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009f20 tx=0x7fcfc0009840 comp rx=0 tx=0).stop 2023-10-06T03:00:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.181+0000 7fcfd5f93700 1 -- 172.21.15.84:0/370273908 shutdown_connections 2023-10-06T03:00:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.181+0000 7fcfd5f93700 1 --2- 172.21.15.84:0/370273908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd0069720 0x7fcfd0069af0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.181+0000 7fcfd5f93700 1 -- 172.21.15.84:0/370273908 >> 172.21.15.84:0/370273908 conn(0x7fcfd00680c0 msgr2=0x7fcfd00cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.181+0000 7fcfd5f93700 1 -- 172.21.15.84:0/370273908 shutdown_connections 2023-10-06T03:00:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.181+0000 7fcfd5f93700 1 -- 172.21.15.84:0/370273908 wait complete. 2023-10-06T03:00:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.182+0000 7fcfd5f93700 1 Processor -- start 2023-10-06T03:00:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.182+0000 7fcfd5f93700 1 -- start start 2023-10-06T03:00:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfd5f93700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd0069720 0x7fcfd00b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfd5f93700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd006d390 0x7fcfd0150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfd5f93700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd00adaa0 0x7fcfd00c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfd5f93700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00af8e0 con 0x7fcfd006d390 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfd5f93700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00b0740 con 0x7fcfd00adaa0 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfd5f93700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00c2550 con 0x7fcfd0069720 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd006d390 0x7fcfd0150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd006d390 0x7fcfd0150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41832/0 (socket says 172.21.15.84:41832) 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfceffd700 1 -- 172.21.15.84:0/2144693788 learned_addr learned my addr 172.21.15.84:0/2144693788 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfcffff700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd00adaa0 0x7fcfd00c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd0069720 0x7fcfd00b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfceffd700 1 -- 172.21.15.84:0/2144693788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd0069720 msgr2=0x7fcfd00b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfceffd700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd0069720 0x7fcfd00b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfceffd700 1 -- 172.21.15.84:0/2144693788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd00adaa0 msgr2=0x7fcfd00c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfceffd700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd00adaa0 0x7fcfd00c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfceffd700 1 -- 172.21.15.84:0/2144693788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0009ae0 con 0x7fcfd006d390 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfceffd700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd006d390 0x7fcfd0150a60 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800c5e0 tx=0x7fcfb8001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfc77fe700 1 -- 172.21.15.84:0/2144693788 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8005a70 con 0x7fcfd006d390 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfc77fe700 1 -- 172.21.15.84:0/2144693788 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8005bd0 con 0x7fcfd006d390 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.183+0000 7fcfd5f93700 1 -- 172.21.15.84:0/2144693788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd00afb30 con 0x7fcfd006d390 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.184+0000 7fcfc77fe700 1 -- 172.21.15.84:0/2144693788 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80070d0 con 0x7fcfd006d390 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.184+0000 7fcfd5f93700 1 -- 172.21.15.84:0/2144693788 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd00b00f0 con 0x7fcfd006d390 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.185+0000 7fcfc77fe700 1 -- 172.21.15.84:0/2144693788 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfb80074c0 con 0x7fcfd006d390 2023-10-06T03:00:50.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.186+0000 7fcfc77fe700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfb0066f30 0x7fcfb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.186+0000 7fcfc77fe700 1 -- 172.21.15.84:0/2144693788 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcfb8083b70 con 0x7fcfd006d390 2023-10-06T03:00:50.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.186+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfb0066f30 0x7fcfb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.186+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfb0066f30 0x7fcfb00693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009ab0 tx=0x7fcfc0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.187+0000 7fcfdf28bb80 1 Processor -- start 2023-10-06T03:00:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfdf28bb80 1 -- start start 2023-10-06T03:00:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf105220 0x5626cf1055f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf122af0 0x5626cf0d8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf11f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cf02fa70 con 0x5626cf105220 2023-10-06T03:00:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cf02d270 con 0x5626cf122af0 2023-10-06T03:00:50.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626cf029060 con 0x5626cf0d8bb0 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf105220 0x5626cf1055f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf105220 0x5626cf1055f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41848/0 (socket says 172.21.15.84:41848) 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.188+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/2533198206 learned_addr learned my addr 172.21.15.84:0/2533198206 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfceffd700 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf122af0 0x5626cf0d8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfcffff700 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf11f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/2533198206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 msgr2=0x5626cf11f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf11f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/2533198206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf122af0 msgr2=0x5626cf0d8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf122af0 0x5626cf0d8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/2533198206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626ceec3270 con 0x5626cf105220 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfcffff700 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf11f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf105220 0x5626cf1055f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fcfd006fdb0 tx=0x7fcfc0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565e9f2862cd1a66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfc4ff9700 1 -- 172.21.15.84:0/2533198206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0007b40 con 0x5626cf105220 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfc4ff9700 1 -- 172.21.15.84:0/2533198206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc0007ca0 con 0x5626cf105220 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.189+0000 7fcfc4ff9700 1 -- 172.21.15.84:0/2533198206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00276b0 con 0x5626cf105220 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/2533198206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf105220 msgr2=0x5626cf1055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf105220 0x5626cf1055f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fcfd006fdb0 tx=0x7fcfc0020040 comp rx=0 tx=0).stop 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/2533198206 shutdown_connections 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf11f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf105220 0x5626cf1055f0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/2533198206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf122af0 0x5626cf0d8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/2533198206 >> 172.21.15.84:0/2533198206 conn(0x5626cf0da160 msgr2=0x5626cf0da530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/2533198206 shutdown_connections 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/2533198206 wait complete. 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 -- start start 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.190+0000 7fcfdf28bb80 1 Processor -- start 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf106f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf0f4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf133120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cefd4890 con 0x5626cf122af0 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cefefea0 con 0x5626cf105220 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626ceeabe30 con 0x5626cf0d8bb0 2023-10-06T03:00:50.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfdf28bb80 10 client.0 _ll_register_callbacks cb 0x5626cf09be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfcffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf133120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfcffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf133120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41858/0 (socket says 172.21.15.84:41858) 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfcffff700 1 -- 172.21.15.84:0/251898782 learned_addr learned my addr 172.21.15.84:0/251898782 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.191+0000 7fcfceffd700 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf0f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfcffff700 1 -- 172.21.15.84:0/251898782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 msgr2=0x5626cf106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfcffff700 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfcffff700 1 -- 172.21.15.84:0/251898782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 msgr2=0x5626cf0f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfcffff700 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf0f4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfcffff700 1 -- 172.21.15.84:0/251898782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd006dde0 con 0x5626cf122af0 2023-10-06T03:00:50.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfcffff700 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf133120 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8011660 tx=0x7fcfc8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1473d7ed30fc507 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfadffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfadffb700 1 -- 172.21.15.84:0/251898782 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80145e0 con 0x5626cf122af0 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfadffb700 1 -- 172.21.15.84:0/251898782 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcfc8014740 con 0x5626cf122af0 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/251898782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626cf0cd940 con 0x5626cf122af0 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfadffb700 1 -- 172.21.15.84:0/251898782 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc8014b10 con 0x5626cf122af0 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfdf28bb80 10 client.7947 fetch_fsmap learned FSMap version 88 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/251898782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x5626cee65fe0 con 0x5626cf122af0 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfadffb700 1 -- 172.21.15.84:0/251898782 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626cf0cd940 con 0x5626cf122af0 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfadffb700 1 -- 172.21.15.84:0/251898782 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 88) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fcfc8014c70 con 0x5626cf122af0 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfdf28bb80 10 client.7947 fetch_fsmap finished waiting for FSMap version 88 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfdf28bb80 10 client.7947 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:50.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfdf28bb80 20 client.7947 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5626cf121780 0x5626cf121b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfdf28bb80 4 client.7947 mds_command: new command op to 7716 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/251898782 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626cf0aa870 con 0x5626cf121780 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.192+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5626cf121780 0x5626cf121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfadffb700 10 client.7947 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5626cf121780 0x5626cf121b50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c15edd0ef08da887 server_cookie=c6a8a3ca389312a7 in_seq=0 out_seq=0 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfadffb700 1 -- 172.21.15.84:0/251898782 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5626cf0aa870 con 0x5626cf121780 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfadffb700 10 client.7947 handle_command_reply: tid=0 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfdf28bb80 1 client.7947 shutdown 2023-10-06T03:00:50.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/251898782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 msgr2=0x5626cf133120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf133120 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8011660 tx=0x7fcfc8009040 comp rx=0 tx=0).stop 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/251898782 shutdown_connections 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5626cf121780 0x5626cf121b50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf133120 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfadffb700 0 client.7947 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/251898782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf0f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.193+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/251898782 >> 172.21.15.84:0/251898782 conn(0x5626cf0da160 msgr2=0x5626cf0d3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.194+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/251898782 shutdown_connections 2023-10-06T03:00:50.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.194+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/251898782 wait complete. 2023-10-06T03:00:50.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.194+0000 7fcfdf28bb80 20 client.7947 trim_cache size 0 max 16384 2023-10-06T03:00:50.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.210+0000 7fcfdf28bb80 1 Processor -- start 2023-10-06T03:00:50.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.210+0000 7fcfdf28bb80 1 -- start start 2023-10-06T03:00:50.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf11f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf0d9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf13bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cf1200e0 con 0x5626cf122af0 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cf11ea90 con 0x5626cf105220 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626cf0d88a0 con 0x5626cf0d8bb0 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfcffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf13bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfcffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf13bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41862/0 (socket says 172.21.15.84:41862) 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfcffff700 1 -- 172.21.15.84:0/1193184503 learned_addr learned my addr 172.21.15.84:0/1193184503 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfcffff700 1 -- 172.21.15.84:0/1193184503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 msgr2=0x5626cf11f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfcffff700 1 --2- 172.21.15.84:0/1193184503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf11f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfcffff700 1 -- 172.21.15.84:0/1193184503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 msgr2=0x5626cf0d9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfcffff700 1 --2- 172.21.15.84:0/1193184503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf0d9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.211+0000 7fcfcffff700 1 -- 172.21.15.84:0/1193184503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626ceff7780 con 0x5626cf122af0 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfcffff700 1 --2- 172.21.15.84:0/1193184503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf13bd60 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80011d0 tx=0x7fcfc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f47d82e0e6613bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfc57fa700 1 -- 172.21.15.84:0/1193184503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc802b070 con 0x5626cf122af0 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfc57fa700 1 -- 172.21.15.84:0/1193184503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc8011d00 con 0x5626cf122af0 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfc57fa700 1 -- 172.21.15.84:0/1193184503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8000c10 con 0x5626cf122af0 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/1193184503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 msgr2=0x5626cf13bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/1193184503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf13bd60 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80011d0 tx=0x7fcfc8017000 comp rx=0 tx=0).stop 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/1193184503 shutdown_connections 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/1193184503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf122af0 0x5626cf13bd60 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/1193184503 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf0d8bb0 0x5626cf11f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/1193184503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf0d9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/1193184503 >> 172.21.15.84:0/1193184503 conn(0x5626cf0da160 msgr2=0x5626cf0d5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/1193184503 shutdown_connections 2023-10-06T03:00:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.212+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/1193184503 wait complete. 2023-10-06T03:00:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.213+0000 7fcfdf28bb80 1 -- start start 2023-10-06T03:00:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.213+0000 7fcfdf28bb80 1 Processor -- start 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf0d8bb0 0x5626cf128990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf17f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf122af0 0x5626cf17ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cf129170 con 0x5626cf0d8bb0 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cf18a010 con 0x5626cf105220 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626cf128ed0 con 0x5626cf122af0 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 10 client.0 _ll_register_callbacks cb 0x5626cf09be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf0d8bb0 0x5626cf128990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf0d8bb0 0x5626cf128990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41872/0 (socket says 172.21.15.84:41872) 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/534639857 learned_addr learned my addr 172.21.15.84:0/534639857 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfceffd700 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf17f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcffff700 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf122af0 0x5626cf17ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/534639857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf122af0 msgr2=0x5626cf17ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf122af0 0x5626cf17ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/534639857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 msgr2=0x5626cf17f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf17f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcf7fe700 1 -- 172.21.15.84:0/534639857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626cee65fe0 con 0x5626cf0d8bb0 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfceffd700 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf17f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfcf7fe700 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf0d8bb0 0x5626cf128990 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009880 tx=0x7fcfc0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52b6d87d79dac76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfadffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfadffb700 1 -- 172.21.15.84:0/534639857 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0027460 con 0x5626cf0d8bb0 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfadffb700 1 -- 172.21.15.84:0/534639857 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcfc00275c0 con 0x5626cf0d8bb0 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/534639857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfc0007ca0 con 0x5626cf0d8bb0 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfadffb700 1 -- 172.21.15.84:0/534639857 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc0027cb0 con 0x5626cf0d8bb0 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 10 client.7953 fetch_fsmap learned FSMap version 88 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.214+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/534639857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x5626cefde470 con 0x5626cf0d8bb0 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfadffb700 1 -- 172.21.15.84:0/534639857 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc0007ca0 con 0x5626cf0d8bb0 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfadffb700 1 -- 172.21.15.84:0/534639857 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 88) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fcfc0039070 con 0x5626cf0d8bb0 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 10 client.7953 fetch_fsmap finished waiting for FSMap version 88 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 10 client.7953 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 20 client.7953 populate_metadata read hostname 'smithi084' 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5626cf0f2bd0 0x5626cf0f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 4 client.7953 mds_command: new command op to 7716 tid=0[{"prefix": "status"}] 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/534639857 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5626cefcbe00 con 0x5626cf0f2bd0 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfceffd700 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5626cf0f2bd0 0x5626cf0f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfadffb700 10 client.7953 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfceffd700 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5626cf0f2bd0 0x5626cf0f2fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83334469a8d6151e server_cookie=c2167aaa9b480c5c in_seq=0 out_seq=0 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfadffb700 1 -- 172.21.15.84:0/534639857 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5626cefcbe00 con 0x5626cf0f2bd0 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfadffb700 10 client.7953 handle_command_reply: tid=0 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 client.7953 shutdown 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/534639857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf0d8bb0 msgr2=0x5626cf128990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf0d8bb0 0x5626cf128990 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009880 tx=0x7fcfc0020040 comp rx=0 tx=0).stop 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/534639857 shutdown_connections 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5626cf0f2bd0 0x5626cf0f2fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5626cf122af0 0x5626cf17ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfadffb700 0 client.7953 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626cf0d8bb0 0x5626cf128990 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 --2- 172.21.15.84:0/534639857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5626cf105220 0x5626cf17f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/534639857 >> 172.21.15.84:0/534639857 conn(0x5626cf0da160 msgr2=0x5626cf0d9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/534639857 shutdown_connections 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.215+0000 7fcfdf28bb80 1 -- 172.21.15.84:0/534639857 wait complete. 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfdf28bb80 20 client.7953 trim_cache size 0 max 16384 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 7716, 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 10.62127845, 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 88, 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 94, 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 94, 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.749253584000002 2023-10-06T03:00:50.226 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:00:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 -- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfb0066f30 msgr2=0x7fcfb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfb0066f30 0x7fcfb00693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009ab0 tx=0x7fcfc0018000 comp rx=0 tx=0).stop 2023-10-06T03:00:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 -- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd006d390 msgr2=0x7fcfd0150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd006d390 0x7fcfd0150a60 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800c5e0 tx=0x7fcfb8001040 comp rx=0 tx=0).stop 2023-10-06T03:00:50.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 -- 172.21.15.84:0/2144693788 shutdown_connections 2023-10-06T03:00:50.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfb0066f30 0x7fcfb00693e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfd00adaa0 0x7fcfd00c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcfd0069720 0x7fcfd00b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 --2- 172.21.15.84:0/2144693788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfd006d390 0x7fcfd0150a60 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 -- 172.21.15.84:0/2144693788 >> 172.21.15.84:0/2144693788 conn(0x7fcfd00680c0 msgr2=0x7fcfd0153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 -- 172.21.15.84:0/2144693788 shutdown_connections 2023-10-06T03:00:50.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.216+0000 7fcfd5f93700 1 -- 172.21.15.84:0/2144693788 wait complete. 2023-10-06T03:00:50.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.341+0000 7fac8b15c700 1 Processor -- start 2023-10-06T03:00:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.341+0000 7fac8b15c700 1 -- start start 2023-10-06T03:00:50.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac8b15c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840cbc70 0x7fac840cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac8b15c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac840cb7e0 con 0x7fac840b2140 2023-10-06T03:00:50.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac8b15c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac840b08a0 con 0x7fac84159480 2023-10-06T03:00:50.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac8b15c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac840cb190 con 0x7fac840cbc70 2023-10-06T03:00:50.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac8a95b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fac840b2140 0x7fac840b25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52432/0 (socket says 172.21.15.84:52432) 2023-10-06T03:00:50.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac8a95b700 1 -- 172.21.15.84:0/3472731801 learned_addr learned my addr 172.21.15.84:0/3472731801 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac89959700 1 --2- 172.21.15.84:0/3472731801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840cbc70 0x7fac840cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac89158700 1 -- 172.21.15.84:0/3472731801 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182605441 0 0) 0x7fac840cb7e0 con 0x7fac840b2140 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac89158700 1 -- 172.21.15.84:0/3472731801 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac70003570 con 0x7fac840b2140 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac89158700 1 -- 172.21.15.84:0/3472731801 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016747375 0 0) 0x7fac840b08a0 con 0x7fac84159480 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.342+0000 7fac89158700 1 -- 172.21.15.84:0/3472731801 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac840cb7e0 con 0x7fac84159480 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac89959700 1 -- 172.21.15.84:0/3472731801 >> v1:172.21.15.131:6789/0 conn(0x7fac84159480 legacy=0x7fac840b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac89959700 1 -- 172.21.15.84:0/3472731801 >> v1:172.21.15.84:6789/0 conn(0x7fac840b2140 legacy=0x7fac840b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac89959700 1 -- 172.21.15.84:0/3472731801 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac840cb470 con 0x7fac840cbc70 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac89959700 1 --2- 172.21.15.84:0/3472731801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840cbc70 0x7fac840cc0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac74009910 tx=0x7fac740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64e95b11150fb5ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac89158700 1 -- 172.21.15.84:0/3472731801 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74011630 con 0x7fac840cbc70 2023-10-06T03:00:50.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac89158700 1 -- 172.21.15.84:0/3472731801 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac74011790 con 0x7fac840cbc70 2023-10-06T03:00:50.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac89158700 1 -- 172.21.15.84:0/3472731801 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac74011b30 con 0x7fac840cbc70 2023-10-06T03:00:50.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac8b15c700 1 -- 172.21.15.84:0/3472731801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840cbc70 msgr2=0x7fac840cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac8b15c700 1 --2- 172.21.15.84:0/3472731801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840cbc70 0x7fac840cc0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac74009910 tx=0x7fac740091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac8b15c700 1 -- 172.21.15.84:0/3472731801 shutdown_connections 2023-10-06T03:00:50.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.343+0000 7fac8b15c700 1 --2- 172.21.15.84:0/3472731801 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840cbc70 0x7fac840cc0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.344+0000 7fac8b15c700 1 -- 172.21.15.84:0/3472731801 >> 172.21.15.84:0/3472731801 conn(0x7fac8406ed20 msgr2=0x7fac8406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.344+0000 7fac8b15c700 1 -- 172.21.15.84:0/3472731801 shutdown_connections 2023-10-06T03:00:50.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.344+0000 7fac8b15c700 1 -- 172.21.15.84:0/3472731801 wait complete. 2023-10-06T03:00:50.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8b15c700 1 Processor -- start 2023-10-06T03:00:50.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8b15c700 1 -- start start 2023-10-06T03:00:50.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8b15c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840b2140 0x7fac840c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8b15c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac840cbc70 0x7fac8414ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8b15c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac84159480 0x7fac841577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8b15c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8416aa20 con 0x7fac84159480 2023-10-06T03:00:50.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8b15c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac840c4aa0 con 0x7fac840cbc70 2023-10-06T03:00:50.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8b15c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac840c3c40 con 0x7fac840b2140 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8a95b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac84159480 0x7fac841577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8a95b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac84159480 0x7fac841577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41880/0 (socket says 172.21.15.84:41880) 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.345+0000 7fac8a95b700 1 -- 172.21.15.84:0/2336928135 learned_addr learned my addr 172.21.15.84:0/2336928135 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac8a15a700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840b2140 0x7fac840c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac89959700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac840cbc70 0x7fac8414ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac8a95b700 1 -- 172.21.15.84:0/2336928135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840b2140 msgr2=0x7fac840c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac8a95b700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840b2140 0x7fac840c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac8a95b700 1 -- 172.21.15.84:0/2336928135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac840cbc70 msgr2=0x7fac8414ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac8a95b700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac840cbc70 0x7fac8414ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac8a95b700 1 -- 172.21.15.84:0/2336928135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac74009420 con 0x7fac84159480 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac8a95b700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac84159480 0x7fac841577b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00cd00 tx=0x7fac7c001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac7a7fc700 1 -- 172.21.15.84:0/2336928135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00ce00 con 0x7fac84159480 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac7a7fc700 1 -- 172.21.15.84:0/2336928135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c00aac0 con 0x7fac84159480 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac840c3e90 con 0x7fac84159480 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac7a7fc700 1 -- 172.21.15.84:0/2336928135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00ae80 con 0x7fac84159480 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.346+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac840c4450 con 0x7fac84159480 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.347+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8405f270 con 0x7fac84159480 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.347+0000 7fac7a7fc700 1 -- 172.21.15.84:0/2336928135 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac7c007300 con 0x7fac84159480 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.348+0000 7fac7a7fc700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fac68066f30 0x7fac680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.348+0000 7fac7a7fc700 1 -- 172.21.15.84:0/2336928135 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fac7c084b20 con 0x7fac84159480 2023-10-06T03:00:50.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.348+0000 7fac8a15a700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fac68066f30 0x7fac680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.348+0000 7fac8a15a700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fac68066f30 0x7fac680693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fac840c72a0 tx=0x7fac80007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.352+0000 7fac7a7fc700 1 -- 172.21.15.84:0/2336928135 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac7c051b70 con 0x7fac84159480 2023-10-06T03:00:50.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.576+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac840c47f0 con 0x7fac84159480 2023-10-06T03:00:50.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.577+0000 7fac7a7fc700 1 -- 172.21.15.84:0/2336928135 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4633 (secure 0 0 0) 0x7fac7c055190 con 0x7fac84159480 2023-10-06T03:00:50.578 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:00:50.579 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:00:49.161879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:00:50.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fac68066f30 msgr2=0x7fac680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fac68066f30 0x7fac680693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fac840c72a0 tx=0x7fac80007d50 comp rx=0 tx=0).stop 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac84159480 msgr2=0x7fac841577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac84159480 0x7fac841577b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00cd00 tx=0x7fac7c001ac0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 shutdown_connections 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fac68066f30 0x7fac680693e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac84159480 0x7fac841577b0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac840b2140 0x7fac840c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 --2- 172.21.15.84:0/2336928135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac840cbc70 0x7fac8414ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 >> 172.21.15.84:0/2336928135 conn(0x7fac8406ed20 msgr2=0x7fac84155950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 shutdown_connections 2023-10-06T03:00:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:00:50.579+0000 7fac8b15c700 1 -- 172.21.15.84:0/2336928135 wait complete. 2023-10-06T03:00:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 88 2023-10-06T03:00:50.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:50.592 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T03:00:50.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:50.617 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T03:00:50.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:50.677 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-10-06T03:00:50.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:50.732 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-10-06T03:00:50.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:00:50.787 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-10-06T03:00:50.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:00:51.014 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:00:51.014 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:51.014 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:53.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:00:53.159 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:00:53.159 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:53.160 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:55.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:00:55.304 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:00:55.305 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:55.305 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:57.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:00:57.450 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:00:57.450 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:57.451 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:59.451 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:00:59.594 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-10-06T03:00:59.594 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T03:00:59.595 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:00:59.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-10-06T03:00:59.736 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T03:00:59.736 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:00:59.736 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:01:01.737 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-10-06T03:01:01.885 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T03:01:01.886 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:01:01.886 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:01:03.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-10-06T03:01:04.027 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T03:01:04.028 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:01:04.028 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:01:06.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-10-06T03:01:06.172 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-10-06T03:01:06.173 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T03:01:06.173 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:01:06.174 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-10-06T03:01:06.304 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T03:01:06.305 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:01:06.305 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:01:06.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-10-06T03:01:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.435+0000 7f649cce8700 1 Processor -- start 2023-10-06T03:01:06.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.435+0000 7f649cce8700 1 -- start start 2023-10-06T03:01:06.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.436+0000 7f649cce8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f649813fcd0 0x7f649806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.436+0000 7f649cce8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 0x7f64980c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.436+0000 7f649cce8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64981400a0 con 0x7f64980c7e70 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.436+0000 7f649cce8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64980c82b0 con 0x7f649813fcd0 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.436+0000 7f649cce8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649806ea40 con 0x7f6498157460 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.436+0000 7f6496d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f64980c7e70 0x7f64980c6710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37582/0 (socket says 172.21.15.84:37582) 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f6496d9d700 1 -- 172.21.15.84:0/3171276384 learned_addr learned my addr 172.21.15.84:0/3171276384 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f649659c700 1 --2- 172.21.15.84:0/3171276384 >> v2:172.21.15.131:3300/0 conn(0x7f649813fcd0 0x7f649806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f648dd9b700 1 --2- 172.21.15.84:0/3171276384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 0x7f64980c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f6495d9b700 1 -- 172.21.15.84:0/3171276384 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710535410 0 0) 0x7f64981400a0 con 0x7f64980c7e70 2023-10-06T03:01:06.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f6495d9b700 1 -- 172.21.15.84:0/3171276384 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6484003570 con 0x7f64980c7e70 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f6495d9b700 1 -- 172.21.15.84:0/3171276384 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333900821 0 0) 0x7f6484003570 con 0x7f64980c7e70 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f649659c700 1 -- 172.21.15.84:0/3171276384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 msgr2=0x7f64980c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f649659c700 1 --2- 172.21.15.84:0/3171276384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 0x7f64980c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f649659c700 1 -- 172.21.15.84:0/3171276384 >> v1:172.21.15.84:6789/0 conn(0x7f64980c7e70 legacy=0x7f64980c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f649659c700 1 -- 172.21.15.84:0/3171276384 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649806ed20 con 0x7f649813fcd0 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f648dd9b700 1 --2- 172.21.15.84:0/3171276384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 0x7f64980c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f649659c700 1 --2- 172.21.15.84:0/3171276384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f649813fcd0 0x7f649806e440 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f64880098e0 tx=0x7f64880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94cb92cd2ef9fc13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f6495d9b700 1 -- 172.21.15.84:0/3171276384 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900017f0 con 0x7f649813fcd0 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f6495d9b700 1 -- 172.21.15.84:0/3171276384 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6488011420 con 0x7f649813fcd0 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.437+0000 7f6495d9b700 1 -- 172.21.15.84:0/3171276384 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880117a0 con 0x7f649813fcd0 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.438+0000 7f649cce8700 1 -- 172.21.15.84:0/3171276384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f649813fcd0 msgr2=0x7f649806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.438+0000 7f649cce8700 1 --2- 172.21.15.84:0/3171276384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f649813fcd0 0x7f649806e440 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f64880098e0 tx=0x7f64880091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.438+0000 7f649cce8700 1 -- 172.21.15.84:0/3171276384 shutdown_connections 2023-10-06T03:01:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.438+0000 7f649cce8700 1 --2- 172.21.15.84:0/3171276384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f649813fcd0 0x7f649806e440 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.438+0000 7f649cce8700 1 --2- 172.21.15.84:0/3171276384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 0x7f64980c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.438+0000 7f649cce8700 1 -- 172.21.15.84:0/3171276384 >> 172.21.15.84:0/3171276384 conn(0x7f64980cc0d0 msgr2=0x7f64980cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.438+0000 7f649cce8700 1 -- 172.21.15.84:0/3171276384 shutdown_connections 2023-10-06T03:01:06.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.438+0000 7f649cce8700 1 -- 172.21.15.84:0/3171276384 wait complete. 2023-10-06T03:01:06.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.439+0000 7f649cce8700 1 Processor -- start 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.439+0000 7f649cce8700 1 -- start start 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f649cce8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64980c7e70 0x7f649815cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f649cce8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f649813fcd0 0x7f64980c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f649cce8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 0x7f64980c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f649cce8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649813d390 con 0x7f649813fcd0 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f649cce8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980af250 con 0x7f64980c7e70 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f649cce8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64980af530 con 0x7f6498157460 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f648dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f649813fcd0 0x7f64980c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f648dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f649813fcd0 0x7f64980c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59770/0 (socket says 172.21.15.84:59770) 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f648dd9b700 1 -- 172.21.15.84:0/3366696205 learned_addr learned my addr 172.21.15.84:0/3366696205 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f649659c700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64980c7e70 0x7f649815cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f6496d9d700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 0x7f64980c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f648dd9b700 1 -- 172.21.15.84:0/3366696205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 msgr2=0x7f64980c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f648dd9b700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 0x7f64980c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f648dd9b700 1 -- 172.21.15.84:0/3366696205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64980c7e70 msgr2=0x7f649815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f648dd9b700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64980c7e70 0x7f649815cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f648dd9b700 1 -- 172.21.15.84:0/3366696205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480009420 con 0x7f649813fcd0 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.440+0000 7f649659c700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64980c7e70 0x7f649815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.441+0000 7f648dd9b700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f649813fcd0 0x7f64980c8b20 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f648000ec80 tx=0x7f64800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.441+0000 7f648effd700 1 -- 172.21.15.84:0/3366696205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000c9d0 con 0x7f649813fcd0 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.441+0000 7f648effd700 1 -- 172.21.15.84:0/3366696205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648000cb30 con 0x7f649813fcd0 2023-10-06T03:01:06.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.441+0000 7f649cce8700 1 -- 172.21.15.84:0/3366696205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6488009420 con 0x7f649813fcd0 2023-10-06T03:01:06.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.441+0000 7f648effd700 1 -- 172.21.15.84:0/3366696205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000ceb0 con 0x7f649813fcd0 2023-10-06T03:01:06.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.441+0000 7f649cce8700 1 -- 172.21.15.84:0/3366696205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64980afaf0 con 0x7f649813fcd0 2023-10-06T03:01:06.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.442+0000 7f648effd700 1 -- 172.21.15.84:0/3366696205 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6480013680 con 0x7f649813fcd0 2023-10-06T03:01:06.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.442+0000 7f648effd700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6478066f30 0x7f64780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.443+0000 7f648effd700 1 -- 172.21.15.84:0/3366696205 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6480084c20 con 0x7f649813fcd0 2023-10-06T03:01:06.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.443+0000 7f649659c700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6478066f30 0x7f64780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.443+0000 7f649659c700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6478066f30 0x7f64780693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f64880091e0 tx=0x7f6488016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f64a5fe0b80 1 Processor -- start 2023-10-06T03:01:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f64a5fe0b80 1 -- start start 2023-10-06T03:01:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c0fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1c600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1b66ac0 con 0x55e7d1c0f890 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1b642c0 con 0x55e7d1c10d10 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1b600b0 con 0x55e7d1c5fc50 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f649659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c0fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f649659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c0fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59772/0 (socket says 172.21.15.84:59772) 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.445+0000 7f649659c700 1 -- 172.21.15.84:0/549959008 learned_addr learned my addr 172.21.15.84:0/549959008 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f648dd9b700 1 --2- 172.21.15.84:0/549959008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f6496d9d700 1 --2- 172.21.15.84:0/549959008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1c600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f649659c700 1 -- 172.21.15.84:0/549959008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 msgr2=0x55e7d1c600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f649659c700 1 --2- 172.21.15.84:0/549959008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1c600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f649659c700 1 -- 172.21.15.84:0/549959008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 msgr2=0x55e7d1c5f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f649659c700 1 --2- 172.21.15.84:0/549959008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f649659c700 1 -- 172.21.15.84:0/549959008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7d19fa2c0 con 0x55e7d1c0f890 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f649659c700 1 --2- 172.21.15.84:0/549959008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c0fc60 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6488009ed0 tx=0x7f6488021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b2d436664e967 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f64777fe700 1 -- 172.21.15.84:0/549959008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488021070 con 0x55e7d1c0f890 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f64777fe700 1 -- 172.21.15.84:0/549959008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64880296a0 con 0x55e7d1c0f890 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.446+0000 7f64777fe700 1 -- 172.21.15.84:0/549959008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488029810 con 0x55e7d1c0f890 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/549959008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 msgr2=0x55e7d1c0fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/549959008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c0fc60 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6488009ed0 tx=0x7f6488021000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/549959008 shutdown_connections 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/549959008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1c600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/549959008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c0fc60 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/549959008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/549959008 >> 172.21.15.84:0/549959008 conn(0x55e7d1c111b0 msgr2=0x55e7d1c11580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/549959008 shutdown_connections 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/549959008 wait complete. 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 -- start start 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.447+0000 7f64a5fe0b80 1 Processor -- start 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.448+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1c53170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.448+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c10d10 0x55e7d1c69e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.448+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c5fc50 0x55e7d1c3bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.448+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1b0b8e0 con 0x55e7d1c5fc50 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.448+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1b26ef0 con 0x55e7d1c0f890 2023-10-06T03:01:06.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.448+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7d19e2e80 con 0x55e7d1c10d10 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.448+0000 7f64a5fe0b80 10 client.0 _ll_register_callbacks cb 0x55e7d1bd2ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f6496d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c5fc50 0x55e7d1c3bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f649659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1c53170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f648dd9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c10d10 0x55e7d1c69e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f649659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1c53170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:44902/0 (socket says 172.21.15.84:44902) 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f649659c700 1 -- 172.21.15.84:0/1312180528 learned_addr learned my addr 172.21.15.84:0/1312180528 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f6496d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c5fc50 0x55e7d1c3bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59776/0 (socket says 172.21.15.84:59776) 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f649659c700 1 -- 172.21.15.84:0/1312180528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c10d10 msgr2=0x55e7d1c69e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f649659c700 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c10d10 0x55e7d1c69e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f649659c700 1 -- 172.21.15.84:0/1312180528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c5fc50 msgr2=0x55e7d1c3bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f649659c700 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c5fc50 0x55e7d1c3bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f649659c700 1 -- 172.21.15.84:0/1312180528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649806ed20 con 0x55e7d1c0f890 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f648dd9b700 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c10d10 0x55e7d1c69e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f649659c700 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1c53170 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f64880299c0 tx=0x7f648802b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ba14f75c84b1a93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f6474ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f6474ff9700 1 -- 172.21.15.84:0/1312180528 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488021040 con 0x55e7d1c0f890 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f6474ff9700 1 -- 172.21.15.84:0/1312180528 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f648801c840 con 0x55e7d1c0f890 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/1312180528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7d1c04990 con 0x55e7d1c0f890 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f6474ff9700 1 -- 172.21.15.84:0/1312180528 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f648801cc10 con 0x55e7d1c0f890 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f64a5fe0b80 10 client.6988 fetch_fsmap learned FSMap version 90 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.449+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/1312180528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x55e7d199d030 con 0x55e7d1c0f890 2023-10-06T03:01:06.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f6474ff9700 1 -- 172.21.15.84:0/1312180528 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7d1c04990 con 0x55e7d1c0f890 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f6474ff9700 1 -- 172.21.15.84:0/1312180528 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 90) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f648803c430 con 0x55e7d1c0f890 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f64a5fe0b80 10 client.6988 fetch_fsmap finished waiting for FSMap version 90 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f64a5fe0b80 10 client.6988 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f64a5fe0b80 20 client.6988 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55e7d1c51f60 0x55e7d1c4ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f64a5fe0b80 4 client.6988 mds_command: new command op to 7716 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/1312180528 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7d1be18c0 con 0x55e7d1c51f60 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f648dd9b700 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55e7d1c51f60 0x55e7d1c4ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f6474ff9700 10 client.6988 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.450+0000 7f648dd9b700 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55e7d1c51f60 0x55e7d1c4ffb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3590098cb086a400 server_cookie=f597c6fba8b60540 in_seq=0 out_seq=0 2023-10-06T03:01:06.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f6474ff9700 1 -- 172.21.15.84:0/1312180528 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e7d1be18c0 con 0x55e7d1c51f60 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f6474ff9700 10 client.6988 handle_command_reply: tid=0 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 client.6988 shutdown 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/1312180528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 msgr2=0x55e7d1c53170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1c53170 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f64880299c0 tx=0x7f648802b040 comp rx=0 tx=0).stop 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/1312180528 shutdown_connections 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55e7d1c51f60 0x55e7d1c4ffb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1c53170 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f6474ff9700 0 client.6988 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c5fc50 0x55e7d1c3bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/1312180528 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c10d10 0x55e7d1c69e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/1312180528 >> 172.21.15.84:0/1312180528 conn(0x55e7d1c111b0 msgr2=0x55e7d1c12cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/1312180528 shutdown_connections 2023-10-06T03:01:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/1312180528 wait complete. 2023-10-06T03:01:06.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.451+0000 7f64a5fe0b80 20 client.6988 trim_cache size 0 max 16384 2023-10-06T03:01:06.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.465+0000 7f64a5fe0b80 1 Processor -- start 2023-10-06T03:01:06.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.465+0000 7f64a5fe0b80 1 -- start start 2023-10-06T03:01:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c69c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 0x55e7d1c4ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1c50480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1c3ba50 con 0x55e7d1c0f890 2023-10-06T03:01:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1c3c790 con 0x55e7d1c10d10 2023-10-06T03:01:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1c0d0e0 con 0x55e7d1c5fc50 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f649659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c69c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f649659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c69c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59790/0 (socket says 172.21.15.84:59790) 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f649659c700 1 -- 172.21.15.84:0/2274215911 learned_addr learned my addr 172.21.15.84:0/2274215911 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f648dd9b700 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 0x55e7d1c4ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f6496d9d700 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1c50480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f649659c700 1 -- 172.21.15.84:0/2274215911 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 msgr2=0x55e7d1c50480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f649659c700 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1c50480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f649659c700 1 -- 172.21.15.84:0/2274215911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 msgr2=0x55e7d1c4ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f649659c700 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 0x55e7d1c4ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f649659c700 1 -- 172.21.15.84:0/2274215911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7d1b2e7d0 con 0x55e7d1c0f890 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f6496d9d700 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1c50480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f649659c700 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c69c30 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6488029990 tx=0x7f6488038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2189e5d4c278d2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f6477fff700 1 -- 172.21.15.84:0/2274215911 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488021050 con 0x55e7d1c0f890 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f6477fff700 1 -- 172.21.15.84:0/2274215911 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648801c460 con 0x55e7d1c0f890 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.466+0000 7f6477fff700 1 -- 172.21.15.84:0/2274215911 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648803c990 con 0x55e7d1c0f890 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/2274215911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 msgr2=0x55e7d1c69c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c69c30 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6488029990 tx=0x7f6488038000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/2274215911 shutdown_connections 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1c50480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c0f890 0x55e7d1c69c30 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/2274215911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c10d10 0x55e7d1c4ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/2274215911 >> 172.21.15.84:0/2274215911 conn(0x55e7d1c111b0 msgr2=0x55e7d1c36310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/2274215911 shutdown_connections 2023-10-06T03:01:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/2274215911 wait complete. 2023-10-06T03:01:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 -- start start 2023-10-06T03:01:06.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.467+0000 7f64a5fe0b80 1 Processor -- start 2023-10-06T03:01:06.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1ca3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f64a5fe0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1cba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1c3fed0 con 0x55e7d1c10d10 2023-10-06T03:01:06.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1cbb170 con 0x55e7d1c0f890 2023-10-06T03:01:06.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f64a5fe0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7d1c5a400 con 0x55e7d1c5fc50 2023-10-06T03:01:06.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f64a5fe0b80 10 client.0 _ll_register_callbacks cb 0x55e7d1bd2ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:06.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f648dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f648dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59806/0 (socket says 172.21.15.84:59806) 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f648dd9b700 1 -- 172.21.15.84:0/3495638888 learned_addr learned my addr 172.21.15.84:0/3495638888 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f649659c700 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1ca3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.468+0000 7f6496d9d700 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1cba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f648dd9b700 1 -- 172.21.15.84:0/3495638888 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 msgr2=0x55e7d1cba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f648dd9b700 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1cba4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f648dd9b700 1 -- 172.21.15.84:0/3495638888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 msgr2=0x55e7d1ca3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f648dd9b700 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1ca3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f648dd9b700 1 -- 172.21.15.84:0/3495638888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7d199d030 con 0x55e7d1c10d10 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f648dd9b700 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5a890 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f6480051db0 tx=0x7f6480015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db8c352035cc206 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f6474ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:06.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f6474ff9700 1 -- 172.21.15.84:0/3495638888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480055b10 con 0x55e7d1c10d10 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f6474ff9700 1 -- 172.21.15.84:0/3495638888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6480055c70 con 0x55e7d1c10d10 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/3495638888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64880296a0 con 0x55e7d1c10d10 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f6474ff9700 1 -- 172.21.15.84:0/3495638888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6480054fb0 con 0x55e7d1c10d10 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f64a5fe0b80 10 client.7977 fetch_fsmap learned FSMap version 90 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/3495638888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x55e7d1b154c0 con 0x55e7d1c10d10 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f6474ff9700 1 -- 172.21.15.84:0/3495638888 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64880296a0 con 0x55e7d1c10d10 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f6474ff9700 1 -- 172.21.15.84:0/3495638888 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 90) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f648005c3c0 con 0x55e7d1c10d10 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f64a5fe0b80 10 client.7977 fetch_fsmap finished waiting for FSMap version 90 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f64a5fe0b80 10 client.7977 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f64a5fe0b80 20 client.7977 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55e7d1cbaa30 0x55e7d1c4fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f64a5fe0b80 4 client.7977 mds_command: new command op to 7716 tid=0[{"prefix": "flush journal"}] 2023-10-06T03:01:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/3495638888 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e7d1b02e50 con 0x55e7d1cbaa30 2023-10-06T03:01:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.469+0000 7f649659c700 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55e7d1cbaa30 0x55e7d1c4fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.470+0000 7f649659c700 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55e7d1cbaa30 0x55e7d1c4fb20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5cc53d77bfa3a0d server_cookie=82a59bb9829141ad in_seq=0 out_seq=0 2023-10-06T03:01:06.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.470+0000 7f6474ff9700 10 client.7977 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f6474ff9700 1 -- 172.21.15.84:0/3495638888 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e7d1b02e50 con 0x55e7d1cbaa30 2023-10-06T03:01:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f6474ff9700 10 client.7977 handle_command_reply: tid=0 2023-10-06T03:01:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 client.7977 shutdown 2023-10-06T03:01:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/3495638888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c10d10 msgr2=0x55e7d1c5a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5a890 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f6480051db0 tx=0x7f6480015040 comp rx=0 tx=0).stop 2023-10-06T03:01:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/3495638888 shutdown_connections 2023-10-06T03:01:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55e7d1cbaa30 0x55e7d1c4fb20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7d1c0f890 0x55e7d1ca3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f6474ff9700 0 client.7977 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e7d1c5fc50 0x55e7d1cba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 --2- 172.21.15.84:0/3495638888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e7d1c10d10 0x55e7d1c5a890 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/3495638888 >> 172.21.15.84:0/3495638888 conn(0x55e7d1c111b0 msgr2=0x55e7d1c69c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/3495638888 shutdown_connections 2023-10-06T03:01:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 1 -- 172.21.15.84:0/3495638888 wait complete. 2023-10-06T03:01:06.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f64a5fe0b80 20 client.7977 trim_cache size 0 max 16384 2023-10-06T03:01:06.494 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T03:01:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:01:06.495 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:06.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.491+0000 7f649cce8700 1 -- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6478066f30 msgr2=0x7f64780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6478066f30 0x7f64780693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f64880091e0 tx=0x7f6488016000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 -- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f649813fcd0 msgr2=0x7f64980c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f649813fcd0 0x7f64980c8b20 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f648000ec80 tx=0x7f64800091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 -- 172.21.15.84:0/3366696205 shutdown_connections 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6478066f30 0x7f64780693e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64980c7e70 0x7f649815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6498157460 0x7f64980c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 --2- 172.21.15.84:0/3366696205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f649813fcd0 0x7f64980c8b20 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 -- 172.21.15.84:0/3366696205 >> 172.21.15.84:0/3366696205 conn(0x7f64980cc0d0 msgr2=0x7f649815d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 -- 172.21.15.84:0/3366696205 shutdown_connections 2023-10-06T03:01:06.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.492+0000 7f649cce8700 1 -- 172.21.15.84:0/3366696205 wait complete. 2023-10-06T03:01:06.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 flush journal 2023-10-06T03:01:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.619+0000 7ffa85abe700 1 Processor -- start 2023-10-06T03:01:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.620+0000 7ffa85abe700 1 -- start start 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.620+0000 7ffa85abe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffa8006bff0 0x7ffa80157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.620+0000 7ffa85abe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa80158250 0x7ffa80158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.620+0000 7ffa85abe700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa800afbf0 con 0x7ffa8015b980 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.620+0000 7ffa85abe700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa800afed0 con 0x7ffa8006bff0 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.620+0000 7ffa85abe700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800b01b0 con 0x7ffa80158250 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.620+0000 7ffa7f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ffa8015b980 0x7ffa8006b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37594/0 (socket says 172.21.15.84:37594) 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7f7fe700 1 -- 172.21.15.84:0/3912522575 learned_addr learned my addr 172.21.15.84:0/3912522575 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa80158250 0x7ffa80158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7effd700 1 --2- 172.21.15.84:0/3912522575 >> v2:172.21.15.131:3300/0 conn(0x7ffa8006bff0 0x7ffa80157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314282464 0 0) 0x7ffa800afbf0 con 0x7ffa8015b980 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa68003570 con 0x7ffa8015b980 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 9997675 0 0) 0x7ffa68003570 con 0x7ffa8015b980 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa80158250 msgr2=0x7ffa80158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa80158250 0x7ffa80158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 >> v2:172.21.15.131:3300/0 conn(0x7ffa8006bff0 msgr2=0x7ffa80157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 --2- 172.21.15.84:0/3912522575 >> v2:172.21.15.131:3300/0 conn(0x7ffa8006bff0 0x7ffa80157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800b0490 con 0x7ffa8015b980 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7ffa700017f0 con 0x7ffa8015b980 2023-10-06T03:01:06.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 >> v1:172.21.15.84:6789/0 conn(0x7ffa8015b980 legacy=0x7ffa8006b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa68003a60 0x7ffa68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa68004810 0x7ffa68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa680051c0 0x7ffa6800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800afed0 con 0x7ffa68004810 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800b01b0 con 0x7ffa680051c0 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800c020 con 0x7ffa68003a60 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa80158250 0x7ffa80158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7effd700 1 --2- 172.21.15.84:0/3912522575 >> v2:172.21.15.131:3300/0 conn(0x7ffa8006bff0 0x7ffa80157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa68003a60 0x7ffa68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7effd700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa68004810 0x7ffa68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.621+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa680051c0 0x7ffa6800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7effd700 1 -- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa68003a60 msgr2=0x7ffa68003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7effd700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa68003a60 0x7ffa68003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7effd700 1 -- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa680051c0 msgr2=0x7ffa6800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7effd700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa680051c0 0x7ffa6800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7effd700 1 -- 172.21.15.84:0/3912522575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68003570 con 0x7ffa68004810 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7effd700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa68004810 0x7ffa68004c80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ffa800ce2e0 tx=0x7ffa740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4718c7823c970f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74009740 con 0x7ffa68004810 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400e8f0 con 0x7ffa68004810 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7e7fc700 1 -- 172.21.15.84:0/3912522575 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400ec90 con 0x7ffa68004810 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa85abe700 1 -- 172.21.15.84:0/3912522575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa68004810 msgr2=0x7ffa68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa85abe700 1 --2- 172.21.15.84:0/3912522575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa68004810 0x7ffa68004c80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7ffa800ce2e0 tx=0x7ffa740091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa7ffff700 1 -- 172.21.15.84:0/3912522575 reap_dead start 2023-10-06T03:01:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa85abe700 1 -- 172.21.15.84:0/3912522575 shutdown_connections 2023-10-06T03:01:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa85abe700 1 -- 172.21.15.84:0/3912522575 >> 172.21.15.84:0/3912522575 conn(0x7ffa800ce330 msgr2=0x7ffa800ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa85abe700 1 -- 172.21.15.84:0/3912522575 shutdown_connections 2023-10-06T03:01:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.622+0000 7ffa85abe700 1 -- 172.21.15.84:0/3912522575 wait complete. 2023-10-06T03:01:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa85abe700 1 Processor -- start 2023-10-06T03:01:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa85abe700 1 -- start start 2023-10-06T03:01:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa85abe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa68004810 0x7ffa800cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa85abe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa800c1440 0x7ffa8016a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa85abe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa800b10e0 0x7ffa800b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa85abe700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c75d0 con 0x7ffa800b10e0 2023-10-06T03:01:06.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa85abe700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800cb290 con 0x7ffa68004810 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa85abe700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8016a9c0 con 0x7ffa800c1440 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa800b10e0 0x7ffa800b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa800c1440 0x7ffa8016a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa800b10e0 0x7ffa800b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59826/0 (socket says 172.21.15.84:59826) 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa7f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa68004810 0x7ffa800cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.624+0000 7ffa7ffff700 1 -- 172.21.15.84:0/3460455340 learned_addr learned my addr 172.21.15.84:0/3460455340 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa7ffff700 1 -- 172.21.15.84:0/3460455340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa800c1440 msgr2=0x7ffa8016a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa800c1440 0x7ffa8016a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa7ffff700 1 -- 172.21.15.84:0/3460455340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa68004810 msgr2=0x7ffa800cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa68004810 0x7ffa800cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa7ffff700 1 -- 172.21.15.84:0/3460455340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800c4900 con 0x7ffa800b10e0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa800b10e0 0x7ffa800b1550 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ffa800c1d60 tx=0x7ffa780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa677fe700 1 -- 172.21.15.84:0/3460455340 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800f770 con 0x7ffa800b10e0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa677fe700 1 -- 172.21.15.84:0/3460455340 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7800f8d0 con 0x7ffa800b10e0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa85abe700 1 -- 172.21.15.84:0/3460455340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa800b38d0 con 0x7ffa800b10e0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa677fe700 1 -- 172.21.15.84:0/3460455340 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800fc70 con 0x7ffa800b10e0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.625+0000 7ffa85abe700 1 -- 172.21.15.84:0/3460455340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800b3e90 con 0x7ffa800b10e0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.626+0000 7ffa677fe700 1 -- 172.21.15.84:0/3460455340 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa7801a030 con 0x7ffa800b10e0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.627+0000 7ffa677fe700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa6c066f60 0x7ffa6c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.627+0000 7ffa677fe700 1 -- 172.21.15.84:0/3460455340 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffa78018070 con 0x7ffa800b10e0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.627+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa6c066f60 0x7ffa6c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.627+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa6c066f60 0x7ffa6c069410 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffa70001190 tx=0x7ffa70006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.629+0000 7ffa8edb6b80 1 Processor -- start 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.629+0000 7ffa8edb6b80 1 -- start start 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4d890 0x559ce5d4dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4ed10 0x559ce5d9d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d9dc50 0x559ce5d9e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce5ca4ac0 con 0x559ce5d4ed10 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce5ca22c0 con 0x559ce5d9dc50 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce5c9e0b0 con 0x559ce5d4d890 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4ed10 0x559ce5d9d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4ed10 0x559ce5d9d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59840/0 (socket says 172.21.15.84:59840) 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7effd700 1 -- 172.21.15.84:0/716845507 learned_addr learned my addr 172.21.15.84:0/716845507 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4d890 0x559ce5d4dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d9dc50 0x559ce5d9e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7effd700 1 -- 172.21.15.84:0/716845507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4d890 msgr2=0x559ce5d4dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7effd700 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4d890 0x559ce5d4dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7effd700 1 -- 172.21.15.84:0/716845507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d9dc50 msgr2=0x559ce5d9e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7effd700 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d9dc50 0x559ce5d9e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7effd700 1 -- 172.21.15.84:0/716845507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ce5b382c0 con 0x559ce5d4ed10 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d9dc50 0x559ce5d9e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa7effd700 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4ed10 0x559ce5d9d710 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7ffa680057f0 tx=0x7ffa74019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdf04b715e2085c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa64ff9700 1 -- 172.21.15.84:0/716845507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400ea60 con 0x559ce5d4ed10 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa64ff9700 1 -- 172.21.15.84:0/716845507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74021040 con 0x559ce5d4ed10 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.630+0000 7ffa64ff9700 1 -- 172.21.15.84:0/716845507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74005a00 con 0x559ce5d4ed10 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.631+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/716845507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4ed10 msgr2=0x559ce5d9d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.631+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4ed10 0x559ce5d9d710 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7ffa680057f0 tx=0x7ffa74019000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.631+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/716845507 shutdown_connections 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.631+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d9dc50 0x559ce5d9e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.631+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4d890 0x559ce5d4dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.631+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/716845507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4ed10 0x559ce5d9d710 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.631+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/716845507 >> 172.21.15.84:0/716845507 conn(0x559ce5d4f1b0 msgr2=0x559ce5d4f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.631+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/716845507 shutdown_connections 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.631+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/716845507 wait complete. 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.632+0000 7ffa8edb6b80 1 -- start start 2023-10-06T03:01:06.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.632+0000 7ffa8edb6b80 1 Processor -- start 2023-10-06T03:01:06.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.632+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5d9b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.632+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 0x559ce5da7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.632+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5da84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce5c498e0 con 0x559ce5d9dc50 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce5c64ef0 con 0x559ce5d4d890 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce5b20e80 con 0x559ce5d4ed10 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa8edb6b80 10 client.0 _ll_register_callbacks cb 0x559ce5d10ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5da84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5d9b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7effd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 0x559ce5da7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5da84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59854/0 (socket says 172.21.15.84:59854) 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5d9b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:44966/0 (socket says 172.21.15.84:44966) 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7ffff700 1 -- 172.21.15.84:0/1192446569 learned_addr learned my addr 172.21.15.84:0/1192446569 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7ffff700 1 -- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 msgr2=0x559ce5da7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 0x559ce5da7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7ffff700 1 -- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 msgr2=0x559ce5d9b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5d9b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7ffff700 1 -- 172.21.15.84:0/1192446569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa68003570 con 0x559ce5d9dc50 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5da84f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7ffa78016040 tx=0x7ffa78058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5601cd4fc896a7f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa5dffb700 1 -- 172.21.15.84:0/1192446569 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78058a20 con 0x559ce5d9dc50 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa5dffb700 1 -- 172.21.15.84:0/1192446569 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffa7805c770 con 0x559ce5d9dc50 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/1192446569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ce5d42990 con 0x559ce5d9dc50 2023-10-06T03:01:06.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa5dffb700 1 -- 172.21.15.84:0/1192446569 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa78054ed0 con 0x559ce5d9dc50 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa8edb6b80 10 client.7989 fetch_fsmap learned FSMap version 90 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.633+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/1192446569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x559ce5adb030 con 0x559ce5d9dc50 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa5dffb700 1 -- 172.21.15.84:0/1192446569 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78065020 con 0x559ce5d9dc50 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa5dffb700 1 -- 172.21.15.84:0/1192446569 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 90) v1 ==== 3136+0+0 (secure 0 0 0) 0x7ffa7805c2e0 con 0x559ce5d9dc50 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa8edb6b80 10 client.7989 fetch_fsmap finished waiting for FSMap version 90 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa8edb6b80 10 client.7989 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa8edb6b80 20 client.7989 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x559ce5d90610 0x559ce5d90a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa8edb6b80 4 client.7989 mds_command: new command op to 6802 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/1192446569 --> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ce5d1f8c0 con 0x559ce5d90610 2023-10-06T03:01:06.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x559ce5d90610 0x559ce5d90a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa5dffb700 10 client.7989 ms_handle_connect on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.634+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x559ce5d90610 0x559ce5d90a10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a5d23ac282da000 server_cookie=75711615d0ff6512 in_seq=0 out_seq=0 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa5dffb700 1 -- 172.21.15.84:0/1192446569 <== mds.1 v2:172.21.15.131:6833/2772432276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559ce5d1f8c0 con 0x559ce5d90610 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa5dffb700 10 client.7989 handle_command_reply: tid=0 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 client.7989 shutdown 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/1192446569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 msgr2=0x559ce5da84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5da84f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7ffa78016040 tx=0x7ffa78058040 comp rx=0 tx=0).stop 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/1192446569 shutdown_connections 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x559ce5d90610 0x559ce5d90a10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5d9b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5da84f0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa5dffb700 0 client.7989 ms_handle_reset on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/1192446569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 0x559ce5da7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/1192446569 >> 172.21.15.84:0/1192446569 conn(0x559ce5d4f1b0 msgr2=0x559ce5d4e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/1192446569 shutdown_connections 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/1192446569 wait complete. 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.635+0000 7ffa8edb6b80 20 client.7989 trim_cache size 0 max 16384 2023-10-06T03:01:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa8edb6b80 1 Processor -- start 2023-10-06T03:01:06.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa8edb6b80 1 -- start start 2023-10-06T03:01:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4d890 0x559ce5d97060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4ed10 0x559ce5d48f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d9dc50 0x559ce5da7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce5d9d910 con 0x559ce5d4d890 2023-10-06T03:01:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce5d4bcb0 con 0x559ce5d4ed10 2023-10-06T03:01:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce5d7dd10 con 0x559ce5d9dc50 2023-10-06T03:01:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa7f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4d890 0x559ce5d97060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa7f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4d890 0x559ce5d97060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59858/0 (socket says 172.21.15.84:59858) 2023-10-06T03:01:06.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.649+0000 7ffa7f7fe700 1 -- 172.21.15.84:0/3608566393 learned_addr learned my addr 172.21.15.84:0/3608566393 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/3608566393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d9dc50 0x559ce5da7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa7effd700 1 --2- 172.21.15.84:0/3608566393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4ed10 0x559ce5d48f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa7f7fe700 1 -- 172.21.15.84:0/3608566393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d9dc50 msgr2=0x559ce5da7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/3608566393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d9dc50 0x559ce5da7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa7f7fe700 1 -- 172.21.15.84:0/3608566393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4ed10 msgr2=0x559ce5d48f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/3608566393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4ed10 0x559ce5d48f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa7f7fe700 1 -- 172.21.15.84:0/3608566393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ce5c6c7d0 con 0x559ce5d4d890 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/3608566393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4d890 0x559ce5d97060 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x559ce5d9acc0 tx=0x7ffa70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b202150a85613851 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa657fa700 1 -- 172.21.15.84:0/3608566393 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70027040 con 0x559ce5d4d890 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa657fa700 1 -- 172.21.15.84:0/3608566393 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70030070 con 0x559ce5d4d890 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa657fa700 1 -- 172.21.15.84:0/3608566393 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70015e70 con 0x559ce5d4d890 2023-10-06T03:01:06.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/3608566393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4d890 msgr2=0x559ce5d97060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/3608566393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4d890 0x559ce5d97060 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x559ce5d9acc0 tx=0x7ffa70017000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/3608566393 shutdown_connections 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/3608566393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d9dc50 0x559ce5da7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/3608566393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d4d890 0x559ce5d97060 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/3608566393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4ed10 0x559ce5d48f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.650+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/3608566393 >> 172.21.15.84:0/3608566393 conn(0x559ce5d4f1b0 msgr2=0x559ce5d4e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.651+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/3608566393 shutdown_connections 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.651+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/3608566393 wait complete. 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.651+0000 7ffa8edb6b80 1 -- start start 2023-10-06T03:01:06.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.651+0000 7ffa8edb6b80 1 Processor -- start 2023-10-06T03:01:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5dfb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 0x559ce5d97060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa8edb6b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5d975a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce5d9b930 con 0x559ce5d9dc50 2023-10-06T03:01:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce5dfde00 con 0x559ce5d4d890 2023-10-06T03:01:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa8edb6b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce5d48d00 con 0x559ce5d4ed10 2023-10-06T03:01:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa8edb6b80 10 client.0 _ll_register_callbacks cb 0x559ce5d10ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:06.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5d975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5d975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59872/0 (socket says 172.21.15.84:59872) 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7ffff700 1 -- 172.21.15.84:0/2051381059 learned_addr learned my addr 172.21.15.84:0/2051381059 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7effd700 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 0x559ce5d97060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5dfb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7ffff700 1 -- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 msgr2=0x559ce5d97060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 0x559ce5d97060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7ffff700 1 -- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 msgr2=0x559ce5dfb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5dfb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7ffff700 1 -- 172.21.15.84:0/2051381059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800b0490 con 0x559ce5d9dc50 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5dfb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa7ffff700 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5d975a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7ffa78006c70 tx=0x7ffa7806a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16beb53ea9dffa32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.652+0000 7ffa5dffb700 1 -- 172.21.15.84:0/2051381059 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78054ed0 con 0x559ce5d9dc50 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/2051381059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa74021040 con 0x559ce5d9dc50 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa5dffb700 1 -- 172.21.15.84:0/2051381059 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffa78066080 con 0x559ce5d9dc50 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa5dffb700 1 -- 172.21.15.84:0/2051381059 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa7805c770 con 0x559ce5d9dc50 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa8edb6b80 10 client.7995 fetch_fsmap learned FSMap version 90 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/2051381059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x559ce5c534c0 con 0x559ce5d9dc50 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa5dffb700 1 -- 172.21.15.84:0/2051381059 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78070020 con 0x559ce5d9dc50 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa5dffb700 1 -- 172.21.15.84:0/2051381059 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 90) v1 ==== 3136+0+0 (secure 0 0 0) 0x7ffa7805c2e0 con 0x559ce5d9dc50 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa8edb6b80 10 client.7995 fetch_fsmap finished waiting for FSMap version 90 2023-10-06T03:01:06.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa8edb6b80 10 client.7995 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-10-06T03:01:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa8edb6b80 20 client.7995 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x559ce5d909e0 0x559ce5d8a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa8edb6b80 4 client.7995 mds_command: new command op to 6802 tid=0[{"prefix": "flush journal"}] 2023-10-06T03:01:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/2051381059 --> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559ce5c40e50 con 0x559ce5d909e0 2023-10-06T03:01:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x559ce5d909e0 0x559ce5d8a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa5dffb700 10 client.7995 ms_handle_connect on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:06.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.653+0000 7ffa7f7fe700 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x559ce5d909e0 0x559ce5d8a3a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8dc8166c5f525dd7 server_cookie=58ad222cba8a4991 in_seq=0 out_seq=0 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa5dffb700 1 -- 172.21.15.84:0/2051381059 <== mds.1 v2:172.21.15.131:6833/2772432276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559ce5c40e50 con 0x559ce5d909e0 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa5dffb700 10 client.7995 handle_command_reply: tid=0 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 client.7995 shutdown 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/2051381059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 msgr2=0x559ce5d975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5d975a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7ffa78006c70 tx=0x7ffa7806a000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/2051381059 shutdown_connections 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x559ce5d909e0 0x559ce5d8a3a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ce5d4d890 0x559ce5dfb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ce5d9dc50 0x559ce5d975a0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa5dffb700 0 client.7995 ms_handle_reset on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 --2- 172.21.15.84:0/2051381059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ce5d4ed10 0x559ce5d97060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/2051381059 >> 172.21.15.84:0/2051381059 conn(0x559ce5d4f1b0 msgr2=0x559ce5da81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/2051381059 shutdown_connections 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.665+0000 7ffa8edb6b80 1 -- 172.21.15.84:0/2051381059 wait complete. 2023-10-06T03:01:06.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa8edb6b80 20 client.7995 trim_cache size 0 max 16384 2023-10-06T03:01:06.669 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T03:01:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:01:06.669 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 -- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa6c066f60 msgr2=0x7ffa6c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa6c066f60 0x7ffa6c069410 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffa70001190 tx=0x7ffa70006040 comp rx=0 tx=0).stop 2023-10-06T03:01:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 -- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa800b10e0 msgr2=0x7ffa800b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa800b10e0 0x7ffa800b1550 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7ffa800c1d60 tx=0x7ffa780091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 -- 172.21.15.84:0/3460455340 shutdown_connections 2023-10-06T03:01:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ffa6c066f60 0x7ffa6c069410 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa68004810 0x7ffa800cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa800b10e0 0x7ffa800b1550 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 --2- 172.21.15.84:0/3460455340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa800c1440 0x7ffa8016a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 -- 172.21.15.84:0/3460455340 >> 172.21.15.84:0/3460455340 conn(0x7ffa800ce330 msgr2=0x7ffa800c3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 -- 172.21.15.84:0/3460455340 shutdown_connections 2023-10-06T03:01:06.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.666+0000 7ffa85abe700 1 -- 172.21.15.84:0/3460455340 wait complete. 2023-10-06T03:01:06.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 flush journal 2023-10-06T03:01:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.794+0000 7f52b2e2d700 1 Processor -- start 2023-10-06T03:01:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.794+0000 7f52b2e2d700 1 -- start start 2023-10-06T03:01:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52b2e2d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0cbb50 0x7f52ac0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52b2e2d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac0b2e60 con 0x7f52ac0b2a90 2023-10-06T03:01:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52b2e2d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac0cf5d0 con 0x7f52ac0c6610 2023-10-06T03:01:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52b2e2d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0cf8b0 con 0x7f52ac0cbb50 2023-10-06T03:01:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52b0bc9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f52ac0b2a90 0x7f52ac0cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37604/0 (socket says 172.21.15.84:37604) 2023-10-06T03:01:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52b0bc9700 1 -- 172.21.15.84:0/536219116 learned_addr learned my addr 172.21.15.84:0/536219116 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52abfff700 1 --2- 172.21.15.84:0/536219116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0cbb50 0x7f52ac0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52ab7fe700 1 -- 172.21.15.84:0/536219116 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870548867 0 0) 0x7f52ac0b2e60 con 0x7f52ac0b2a90 2023-10-06T03:01:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52ab7fe700 1 -- 172.21.15.84:0/536219116 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f529c003570 con 0x7f52ac0b2a90 2023-10-06T03:01:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52ab7fe700 1 -- 172.21.15.84:0/536219116 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195463833 0 0) 0x7f52ac0cf5d0 con 0x7f52ac0c6610 2023-10-06T03:01:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52ab7fe700 1 -- 172.21.15.84:0/536219116 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ac0b2e60 con 0x7f52ac0c6610 2023-10-06T03:01:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52abfff700 1 -- 172.21.15.84:0/536219116 >> v1:172.21.15.131:6789/0 conn(0x7f52ac0c6610 legacy=0x7f52ac0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52ab7fe700 1 -- 172.21.15.84:0/536219116 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948059155 0 0) 0x7f529c003570 con 0x7f52ac0b2a90 2023-10-06T03:01:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52abfff700 1 -- 172.21.15.84:0/536219116 >> v1:172.21.15.84:6789/0 conn(0x7f52ac0b2a90 legacy=0x7f52ac0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.795+0000 7f52abfff700 1 -- 172.21.15.84:0/536219116 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac0cfb90 con 0x7f52ac0cbb50 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52abfff700 1 --2- 172.21.15.84:0/536219116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0cbb50 0x7f52ac0ce850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5298009910 tx=0x7f52980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4fcf348c1a07b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52ab7fe700 1 -- 172.21.15.84:0/536219116 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a00015f0 con 0x7f52ac0cbb50 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52ab7fe700 1 -- 172.21.15.84:0/536219116 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5298011420 con 0x7f52ac0cbb50 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52ab7fe700 1 -- 172.21.15.84:0/536219116 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52980117c0 con 0x7f52ac0cbb50 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52b2e2d700 1 -- 172.21.15.84:0/536219116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0cbb50 msgr2=0x7f52ac0ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52b2e2d700 1 --2- 172.21.15.84:0/536219116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0cbb50 0x7f52ac0ce850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5298009910 tx=0x7f52980091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52b2e2d700 1 -- 172.21.15.84:0/536219116 shutdown_connections 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52b2e2d700 1 --2- 172.21.15.84:0/536219116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0cbb50 0x7f52ac0ce850 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52b2e2d700 1 -- 172.21.15.84:0/536219116 >> 172.21.15.84:0/536219116 conn(0x7f52ac099740 msgr2=0x7f52ac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52b2e2d700 1 -- 172.21.15.84:0/536219116 shutdown_connections 2023-10-06T03:01:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.796+0000 7f52b2e2d700 1 -- 172.21.15.84:0/536219116 wait complete. 2023-10-06T03:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.797+0000 7f52b2e2d700 1 Processor -- start 2023-10-06T03:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.798+0000 7f52b2e2d700 1 -- start start 2023-10-06T03:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.798+0000 7f52b2e2d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52ac0b2a90 0x7f52ac0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.798+0000 7f52b2e2d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0c6610 0x7f52ac0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.798+0000 7f52b2e2d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52ac0cbb50 0x7f52ac14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.798+0000 7f52b2e2d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0b42f0 con 0x7f52ac0cbb50 2023-10-06T03:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.798+0000 7f52b2e2d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0c7730 con 0x7f52ac0b2a90 2023-10-06T03:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.798+0000 7f52b2e2d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0b44d0 con 0x7f52ac0c6610 2023-10-06T03:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.798+0000 7f52b13ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52ac0cbb50 0x7f52ac14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b13ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52ac0cbb50 0x7f52ac14ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59880/0 (socket says 172.21.15.84:59880) 2023-10-06T03:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b0bc9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52ac0b2a90 0x7f52ac0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b13ca700 1 -- 172.21.15.84:0/2176219202 learned_addr learned my addr 172.21.15.84:0/2176219202 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52abfff700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0c6610 0x7f52ac0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b13ca700 1 -- 172.21.15.84:0/2176219202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0c6610 msgr2=0x7f52ac0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b13ca700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0c6610 0x7f52ac0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b13ca700 1 -- 172.21.15.84:0/2176219202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52ac0b2a90 msgr2=0x7f52ac0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b13ca700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52ac0b2a90 0x7f52ac0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b13ca700 1 -- 172.21.15.84:0/2176219202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5298009420 con 0x7f52ac0cbb50 2023-10-06T03:01:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52abfff700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0c6610 0x7f52ac0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b13ca700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52ac0cbb50 0x7f52ac14ad90 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c910 tx=0x7f52a40027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52a8ff9700 1 -- 172.21.15.84:0/2176219202 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a4012630 con 0x7f52ac0cbb50 2023-10-06T03:01:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52a8ff9700 1 -- 172.21.15.84:0/2176219202 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a40127b0 con 0x7f52ac0cbb50 2023-10-06T03:01:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b2e2d700 1 -- 172.21.15.84:0/2176219202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ac0b47b0 con 0x7f52ac0cbb50 2023-10-06T03:01:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52a8ff9700 1 -- 172.21.15.84:0/2176219202 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a4012b70 con 0x7f52ac0cbb50 2023-10-06T03:01:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.799+0000 7f52b2e2d700 1 -- 172.21.15.84:0/2176219202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac0b5050 con 0x7f52ac0cbb50 2023-10-06T03:01:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.800+0000 7f52a8ff9700 1 -- 172.21.15.84:0/2176219202 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52a401b400 con 0x7f52ac0cbb50 2023-10-06T03:01:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.801+0000 7f52a8ff9700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5290066f30 0x7f52900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.801+0000 7f52a8ff9700 1 -- 172.21.15.84:0/2176219202 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f52a4084ae0 con 0x7f52ac0cbb50 2023-10-06T03:01:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.801+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5290066f30 0x7f52900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.801+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5290066f30 0x7f52900693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000c00 tx=0x7f52a00016e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.803+0000 7f52bc125b80 1 Processor -- start 2023-10-06T03:01:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.803+0000 7f52bc125b80 1 -- start start 2023-10-06T03:01:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.803+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efa5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.803+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940eff5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.803+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 0x55940eff60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.803+0000 7f52bc125b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940eefcac0 con 0x55940efa5890 2023-10-06T03:01:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.803+0000 7f52bc125b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940eefa2c0 con 0x55940eff5c50 2023-10-06T03:01:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.803+0000 7f52bc125b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55940eef60b0 con 0x55940efa6d10 2023-10-06T03:01:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b0bc9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efa5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b0bc9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efa5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59896/0 (socket says 172.21.15.84:59896) 2023-10-06T03:01:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52abfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940eff5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b0bc9700 1 -- 172.21.15.84:0/3329720759 learned_addr learned my addr 172.21.15.84:0/3329720759 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b13ca700 1 --2- 172.21.15.84:0/3329720759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 0x55940eff60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b0bc9700 1 -- 172.21.15.84:0/3329720759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 msgr2=0x55940eff5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/3329720759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940eff5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b0bc9700 1 -- 172.21.15.84:0/3329720759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 msgr2=0x55940eff60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/3329720759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 0x55940eff60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b0bc9700 1 -- 172.21.15.84:0/3329720759 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940ed902c0 con 0x55940efa5890 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52abfff700 1 --2- 172.21.15.84:0/3329720759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940eff5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/3329720759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efa5c60 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f52a000fdb0 tx=0x7f52a0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665cbb2c0a974ff6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f5295ffb700 1 -- 172.21.15.84:0/3329720759 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a000feb0 con 0x55940efa5890 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f5295ffb700 1 -- 172.21.15.84:0/3329720759 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a0018070 con 0x55940efa5890 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.804+0000 7f5295ffb700 1 -- 172.21.15.84:0/3329720759 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a0014d00 con 0x55940efa5890 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 -- 172.21.15.84:0/3329720759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 msgr2=0x55940efa5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 --2- 172.21.15.84:0/3329720759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efa5c60 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f52a000fdb0 tx=0x7f52a0015000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 -- 172.21.15.84:0/3329720759 shutdown_connections 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 --2- 172.21.15.84:0/3329720759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 0x55940eff60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 --2- 172.21.15.84:0/3329720759 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efa5c60 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 --2- 172.21.15.84:0/3329720759 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940eff5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 -- 172.21.15.84:0/3329720759 >> 172.21.15.84:0/3329720759 conn(0x55940efa71b0 msgr2=0x55940efa7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 -- 172.21.15.84:0/3329720759 shutdown_connections 2023-10-06T03:01:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 -- 172.21.15.84:0/3329720759 wait complete. 2023-10-06T03:01:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.805+0000 7f52bc125b80 1 -- start start 2023-10-06T03:01:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52bc125b80 1 Processor -- start 2023-10-06T03:01:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940effc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 0x55940efa0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52bc125b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940eea18e0 con 0x55940efa5890 2023-10-06T03:01:06.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52bc125b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940eebcef0 con 0x55940eff5c50 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52bc125b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55940ed78e80 con 0x55940efa6d10 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52bc125b80 10 client.0 _ll_register_callbacks cb 0x55940ef68ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52b0bc9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52b0bc9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59904/0 (socket says 172.21.15.84:59904) 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.806+0000 7f52b0bc9700 1 -- 172.21.15.84:0/1433745930 learned_addr learned my addr 172.21.15.84:0/1433745930 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52abfff700 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940effc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52b13ca700 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 0x55940efa0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52b0bc9700 1 -- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 msgr2=0x55940effc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940effc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52b0bc9700 1 -- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 msgr2=0x55940efa0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 0x55940efa0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52b0bc9700 1 -- 172.21.15.84:0/1433745930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac0cfb90 con 0x55940efa5890 2023-10-06T03:01:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52abfff700 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940effc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52b13ca700 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 0x55940efa0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efce8f0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f52a0022040 tx=0x7f52a001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff58998d2633a376 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f528affd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f528affd700 1 -- 172.21.15.84:0/1433745930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a002e070 con 0x55940efa5890 2023-10-06T03:01:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f528affd700 1 -- 172.21.15.84:0/1433745930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f52a0005c10 con 0x55940efa5890 2023-10-06T03:01:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52bc125b80 1 -- 172.21.15.84:0/1433745930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55940ef9a990 con 0x55940efa5890 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f528affd700 1 -- 172.21.15.84:0/1433745930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52a0006050 con 0x55940efa5890 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52bc125b80 10 client.8007 fetch_fsmap learned FSMap version 90 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52bc125b80 1 -- 172.21.15.84:0/1433745930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x7f52a000fa30 con 0x55940efa5890 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f528affd700 1 -- 172.21.15.84:0/1433745930 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55940ef9a990 con 0x55940efa5890 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f528affd700 1 -- 172.21.15.84:0/1433745930 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 90) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f52a0031020 con 0x55940efa5890 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52bc125b80 10 client.8007 fetch_fsmap finished waiting for FSMap version 90 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52bc125b80 10 client.8007 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52bc125b80 20 client.8007 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55940efe53a0 0x55940efee340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52bc125b80 4 client.8007 mds_command: new command op to 6799 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:06.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.807+0000 7f52bc125b80 1 -- 172.21.15.84:0/1433745930 --> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55940ef778c0 con 0x55940efe53a0 2023-10-06T03:01:06.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.808+0000 7f52abfff700 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55940efe53a0 0x55940efee340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.808+0000 7f528affd700 10 client.8007 ms_handle_connect on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:06.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.808+0000 7f52abfff700 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55940efe53a0 0x55940efee340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87cdfd2c2a1b0990 server_cookie=e24a4647eb72a16b in_seq=0 out_seq=0 2023-10-06T03:01:06.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f528affd700 1 -- 172.21.15.84:0/1433745930 <== mds.2 v2:172.21.15.131:6832/3567954898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55940ef778c0 con 0x55940efe53a0 2023-10-06T03:01:06.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f528affd700 10 client.8007 handle_command_reply: tid=0 2023-10-06T03:01:06.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 client.8007 shutdown 2023-10-06T03:01:06.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 -- 172.21.15.84:0/1433745930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 msgr2=0x55940efce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efce8f0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f52a0022040 tx=0x7f52a001e000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 -- 172.21.15.84:0/1433745930 shutdown_connections 2023-10-06T03:01:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55940efe53a0 0x55940efee340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940eff5c50 0x55940efa0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940efa5890 0x55940efce8f0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1433745930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940effc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f528affd700 0 client.8007 ms_handle_reset on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 -- 172.21.15.84:0/1433745930 >> 172.21.15.84:0/1433745930 conn(0x55940efa71b0 msgr2=0x55940efa6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 -- 172.21.15.84:0/1433745930 shutdown_connections 2023-10-06T03:01:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 1 -- 172.21.15.84:0/1433745930 wait complete. 2023-10-06T03:01:06.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.809+0000 7f52bc125b80 20 client.8007 trim_cache size 0 max 16384 2023-10-06T03:01:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52bc125b80 1 Processor -- start 2023-10-06T03:01:06.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52bc125b80 1 -- start start 2023-10-06T03:01:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 0x55940efd5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940efa2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940efa2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52bc125b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940efa51e0 con 0x55940eff5c50 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52bc125b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940efe4ed0 con 0x55940efa5890 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52bc125b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55940efce020 con 0x55940efa6d10 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52b13ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940efa2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52b13ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940efa2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59918/0 (socket says 172.21.15.84:59918) 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52b13ca700 1 -- 172.21.15.84:0/1728709415 learned_addr learned my addr 172.21.15.84:0/1728709415 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.823+0000 7f52abfff700 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940efa2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 0x55940efd5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52b13ca700 1 -- 172.21.15.84:0/1728709415 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 msgr2=0x55940efa2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52b13ca700 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940efa2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52b13ca700 1 -- 172.21.15.84:0/1728709415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 msgr2=0x55940efd5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52b13ca700 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 0x55940efd5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52b13ca700 1 -- 172.21.15.84:0/1728709415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940ed33030 con 0x55940eff5c50 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 0x55940efd5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52b13ca700 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940efa2db0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f52a400a270 tx=0x7f52a4058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca5c3999b02b78e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52967fc700 1 -- 172.21.15.84:0/1728709415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a40550d0 con 0x55940eff5c50 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52967fc700 1 -- 172.21.15.84:0/1728709415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a40589c0 con 0x55940eff5c50 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52967fc700 1 -- 172.21.15.84:0/1728709415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a405c710 con 0x55940eff5c50 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52bc125b80 1 -- 172.21.15.84:0/1728709415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 msgr2=0x55940efa2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940efa2db0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f52a400a270 tx=0x7f52a4058040 comp rx=0 tx=0).stop 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52bc125b80 1 -- 172.21.15.84:0/1728709415 shutdown_connections 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 0x55940efd5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940efa2db0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52bc125b80 1 --2- 172.21.15.84:0/1728709415 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940efa2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52bc125b80 1 -- 172.21.15.84:0/1728709415 >> 172.21.15.84:0/1728709415 conn(0x55940efa71b0 msgr2=0x55940efa6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52bc125b80 1 -- 172.21.15.84:0/1728709415 shutdown_connections 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.824+0000 7f52bc125b80 1 -- 172.21.15.84:0/1728709415 wait complete. 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.825+0000 7f52bc125b80 1 -- start start 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.825+0000 7f52bc125b80 1 Processor -- start 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 0x55940eff9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940efa7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52bc125b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940f04bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52bc125b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940eff9fe0 con 0x55940eff5c50 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52bc125b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940f0526c0 con 0x55940efa5890 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52bc125b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55940efa7ea0 con 0x55940efa6d10 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52bc125b80 10 client.0 _ll_register_callbacks cb 0x55940ef68ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b13ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940f04bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b13ca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940f04bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59928/0 (socket says 172.21.15.84:59928) 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b13ca700 1 -- 172.21.15.84:0/2509511973 learned_addr learned my addr 172.21.15.84:0/2509511973 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 0x55940eff9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52abfff700 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940efa7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b13ca700 1 -- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 msgr2=0x55940efa7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b13ca700 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940efa7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b13ca700 1 -- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 msgr2=0x55940eff9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b13ca700 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 0x55940eff9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b13ca700 1 -- 172.21.15.84:0/2509511973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac0b5050 con 0x55940eff5c50 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52abfff700 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940efa7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f52b13ca700 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940f04bc30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f52a4055470 tx=0x7f52a406d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ffa3ffd8d3273b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.826+0000 7f528affd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f528affd700 1 -- 172.21.15.84:0/2509511973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a4060070 con 0x55940eff5c50 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f528affd700 1 -- 172.21.15.84:0/2509511973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f52a4071270 con 0x55940eff5c50 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52bc125b80 1 -- 172.21.15.84:0/2509511973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f52a0018070 con 0x55940eff5c50 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f528affd700 1 -- 172.21.15.84:0/2509511973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52a4054e70 con 0x55940eff5c50 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52bc125b80 10 client.8013 fetch_fsmap learned FSMap version 90 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52bc125b80 1 -- 172.21.15.84:0/2509511973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x55940eec47d0 con 0x55940eff5c50 2023-10-06T03:01:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f528affd700 1 -- 172.21.15.84:0/2509511973 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a0018070 con 0x55940eff5c50 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f528affd700 1 -- 172.21.15.84:0/2509511973 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 90) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f52a405c280 con 0x55940eff5c50 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52bc125b80 10 client.8013 fetch_fsmap finished waiting for FSMap version 90 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52bc125b80 10 client.8013 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52bc125b80 20 client.8013 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52bc125b80 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55940efa2740 0x55940f04c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52bc125b80 4 client.8013 mds_command: new command op to 6799 tid=0[{"prefix": "flush journal"}] 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52bc125b80 1 -- 172.21.15.84:0/2509511973 --> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55940ee98e50 con 0x55940efa2740 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.827+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55940efa2740 0x55940f04c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.828+0000 7f528affd700 10 client.8013 ms_handle_connect on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.828+0000 7f52b0bc9700 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55940efa2740 0x55940f04c170 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6725fa78c027c261 server_cookie=4438bfc1c288bf02 in_seq=0 out_seq=0 2023-10-06T03:01:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f528affd700 1 -- 172.21.15.84:0/2509511973 <== mds.2 v2:172.21.15.131:6832/3567954898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55940ee98e50 con 0x55940efa2740 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f528affd700 10 client.8013 handle_command_reply: tid=0 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 client.8013 shutdown 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 -- 172.21.15.84:0/2509511973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 msgr2=0x55940f04bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940f04bc30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f52a4055470 tx=0x7f52a406d000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 -- 172.21.15.84:0/2509511973 shutdown_connections 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55940efa2740 0x55940f04c170 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55940efa5890 0x55940eff9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f528affd700 0 client.8013 ms_handle_reset on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55940eff5c50 0x55940f04bc30 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 --2- 172.21.15.84:0/2509511973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55940efa6d10 0x55940efa7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 -- 172.21.15.84:0/2509511973 >> 172.21.15.84:0/2509511973 conn(0x55940efa71b0 msgr2=0x55940efa8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 -- 172.21.15.84:0/2509511973 shutdown_connections 2023-10-06T03:01:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 1 -- 172.21.15.84:0/2509511973 wait complete. 2023-10-06T03:01:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.834+0000 7f52bc125b80 20 client.8013 trim_cache size 0 max 16384 2023-10-06T03:01:06.840 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T03:01:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:01:06.840 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 -- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5290066f30 msgr2=0x7f52900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5290066f30 0x7f52900693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000c00 tx=0x7f52a00016e0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 -- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52ac0cbb50 msgr2=0x7f52ac14ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52ac0cbb50 0x7f52ac14ad90 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c910 tx=0x7f52a40027a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 -- 172.21.15.84:0/2176219202 shutdown_connections 2023-10-06T03:01:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5290066f30 0x7f52900693e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52ac0b2a90 0x7f52ac0ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52ac0cbb50 0x7f52ac14ad90 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 --2- 172.21.15.84:0/2176219202 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f52ac0c6610 0x7f52ac0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 -- 172.21.15.84:0/2176219202 >> 172.21.15.84:0/2176219202 conn(0x7f52ac099740 msgr2=0x7f52ac158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 -- 172.21.15.84:0/2176219202 shutdown_connections 2023-10-06T03:01:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:06.835+0000 7f52b2e2d700 1 -- 172.21.15.84:0/2176219202 wait complete. 2023-10-06T03:01:06.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:06.848 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-10-06T03:01:06.869 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/ 2023-10-06T03:01:06.869 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4 2023-10-06T03:01:06.869 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5 2023-10-06T03:01:06.869 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6 2023-10-06T03:01:06.870 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7 2023-10-06T03:01:06.870 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-10-06T03:01:06.870 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:01:06.870 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:01:06.870 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:01:06.870 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:01:06.870 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-10-06T03:01:06.870 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:01:06.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:06.944 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:06.974 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627778 2023-10-06T03:01:07.169 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:01:07.170 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:01:07.170 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:01:07.170 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:01:07.170 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-10-06T03:01:07.170 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:01:07.235 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627779 2023-10-06T03:01:07.424 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:01:07.424 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:01:07.424 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:01:07.424 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:01:07.424 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-10-06T03:01:07.424 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:01:07.527 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627780 2023-10-06T03:01:07.716 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:01:07.717 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:01:07.717 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:01:07.717 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:01:07.717 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-10-06T03:01:07.717 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:01:07.821 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627781 2023-10-06T03:01:08.010 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:01:08.010 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:01:08.010 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:01:08.010 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:01:08.010 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-10-06T03:01:08.011 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:01:08.114 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627782 2023-10-06T03:01:08.304 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:01:08.305 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:01:08.305 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:01:08.305 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:01:08.305 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-10-06T03:01:08.305 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:01:08.407 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627783 2023-10-06T03:01:08.596 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2023-10-06T03:01:08.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.672+0000 7f3a6f016000 1 Processor -- start 2023-10-06T03:01:08.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a6f016000 1 -- start start 2023-10-06T03:01:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a6f016000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac88c30 0x55f0facfac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a6f016000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f0fad14e00 0x55f0facfb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a6f016000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0fac81890 0x55f0fac8aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a6f016000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fabe8320 con 0x55f0fac88c30 2023-10-06T03:01:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a6f016000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fab8c980 con 0x55f0fac81890 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a6f016000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0fab8c620 con 0x55f0fad14e00 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a68251700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac88c30 0x55f0facfac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a68251700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac88c30 0x55f0facfac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59948/0 (socket says 172.21.15.84:59948) 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a68251700 1 -- 172.21.15.84:0/4108877632 learned_addr learned my addr 172.21.15.84:0/4108877632 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.673+0000 7f3a68a52700 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0fac81890 0x55f0fac8aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a67a50700 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f0fad14e00 0x55f0facfb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a68251700 1 -- 172.21.15.84:0/4108877632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f0fad14e00 msgr2=0x55f0facfb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a68251700 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f0fad14e00 0x55f0facfb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a68251700 1 -- 172.21.15.84:0/4108877632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0fac81890 msgr2=0x55f0fac8aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a68251700 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0fac81890 0x55f0fac8aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a68251700 1 -- 172.21.15.84:0/4108877632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c005cf0 con 0x55f0fac88c30 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a67a50700 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f0fad14e00 0x55f0facfb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a68251700 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac88c30 0x55f0facfac10 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800b320 tx=0x7f3a580068f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4604de713b3d6e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a66a4e700 1 -- 172.21.15.84:0/4108877632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800be30 con 0x55f0fac88c30 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a66a4e700 1 -- 172.21.15.84:0/4108877632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800e470 con 0x55f0fac88c30 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a66a4e700 1 -- 172.21.15.84:0/4108877632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800e830 con 0x55f0fac88c30 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a6f016000 1 -- 172.21.15.84:0/4108877632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac88c30 msgr2=0x55f0facfac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a6f016000 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac88c30 0x55f0facfac10 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800b320 tx=0x7f3a580068f0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a6f016000 1 -- 172.21.15.84:0/4108877632 shutdown_connections 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a6f016000 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0fac81890 0x55f0fac8aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a6f016000 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac88c30 0x55f0facfac10 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a6f016000 1 --2- 172.21.15.84:0/4108877632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f0fad14e00 0x55f0facfb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a6f016000 1 -- 172.21.15.84:0/4108877632 >> 172.21.15.84:0/4108877632 conn(0x55f0fac43050 msgr2=0x55f0fad17770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a6f016000 1 -- 172.21.15.84:0/4108877632 shutdown_connections 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.674+0000 7f3a6f016000 1 -- 172.21.15.84:0/4108877632 wait complete. 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.675+0000 7f3a6f016000 1 Processor -- start 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.675+0000 7f3a6f016000 1 -- start start 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6f016000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac81890 0x55f0facf4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6f016000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f0fac88c30 0x55f0fad117d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6f016000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0fad14e00 0x55f0fad11d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6f016000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0fab83400 con 0x55f0fac81890 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6f016000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0facf4070 con 0x55f0fad14e00 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6f016000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0facf3890 con 0x55f0fac88c30 2023-10-06T03:01:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a68251700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac81890 0x55f0facf4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a68251700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac81890 0x55f0facf4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59960/0 (socket says 172.21.15.84:59960) 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a68251700 1 -- 172.21.15.84:0/2439380404 learned_addr learned my addr 172.21.15.84:0/2439380404 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a68251700 1 -- 172.21.15.84:0/2439380404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f0fac88c30 msgr2=0x55f0fad117d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a68251700 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f0fac88c30 0x55f0fad117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a68251700 1 -- 172.21.15.84:0/2439380404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0fad14e00 msgr2=0x55f0fad11d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a68251700 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0fad14e00 0x55f0fad11d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a68251700 1 -- 172.21.15.84:0/2439380404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58006bd0 con 0x55f0fac81890 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a68251700 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac81890 0x55f0facf4480 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800e9a0 tx=0x7f3a58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6524b700 1 -- 172.21.15.84:0/2439380404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580188d0 con 0x55f0fac81890 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6524b700 1 -- 172.21.15.84:0/2439380404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a58018a30 con 0x55f0fac81890 2023-10-06T03:01:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0fab8eae0 con 0x55f0fac81890 2023-10-06T03:01:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6524b700 1 -- 172.21.15.84:0/2439380404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58018df0 con 0x55f0fac81890 2023-10-06T03:01:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.676+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0fab8e540 con 0x55f0fac81890 2023-10-06T03:01:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.678+0000 7f3a6524b700 1 -- 172.21.15.84:0/2439380404 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a5800d3d0 con 0x55f0fac81890 2023-10-06T03:01:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.678+0000 7f3a6524b700 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a540658c0 0x7f3a54067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.678+0000 7f3a6524b700 1 -- 172.21.15.84:0/2439380404 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3a58084e90 con 0x55f0fac81890 2023-10-06T03:01:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.678+0000 7f3a67a50700 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a540658c0 0x7f3a54067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.678+0000 7f3a6f016000 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55f0facf49c0 0x55f0fad25b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.678+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 --> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] -- osd_op(unknown.0.0:1 14.12 14:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v8 -- 0x55f0fad17c30 con 0x55f0facf49c0 2023-10-06T03:01:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.678+0000 7f3a68a52700 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55f0facf49c0 0x55f0fad25b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.678+0000 7f3a67a50700 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a540658c0 0x7f3a54067d70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55f0fad155a0 tx=0x7f3a5c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.679+0000 7f3a68a52700 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55f0facf49c0 0x55f0fad25b60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a68a52700 1 -- 172.21.15.84:0/2439380404 <== osd.2 v2:172.21.15.84:6800/90631 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v94'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f3a60003790 con 0x55f0facf49c0 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55f0facf49c0 msgr2=0x55f0fad25b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55f0facf49c0 0x55f0fad25b60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a540658c0 msgr2=0x7f3a54067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3a540658c0 0x7f3a54067d70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55f0fad155a0 tx=0x7f3a5c016000 comp rx=0 tx=0).stop 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac81890 msgr2=0x55f0facf4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 --2- 172.21.15.84:0/2439380404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f0fac81890 0x55f0facf4480 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800e9a0 tx=0x7f3a58017000 comp rx=0 tx=0).stop 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a68a52700 1 -- 172.21.15.84:0/2439380404 reap_dead start 2023-10-06T03:01:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 shutdown_connections 2023-10-06T03:01:08.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 >> 172.21.15.84:0/2439380404 conn(0x55f0fac43050 msgr2=0x55f0fac8aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 shutdown_connections 2023-10-06T03:01:08.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.680+0000 7f3a6f016000 1 -- 172.21.15.84:0/2439380404 wait complete. 2023-10-06T03:01:08.687 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2023-10-06T03:01:08.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.761+0000 7fd2bc1d8000 1 Processor -- start 2023-10-06T03:01:08.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.761+0000 7fd2bc1d8000 1 -- start start 2023-10-06T03:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2bc1d8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580d6a568e0 0x5580d6a93530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2bc1d8000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6a6abe0 0x5580d6b3dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2bc1d8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580d6b364a0 0x5580d6b36a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2bc1d8000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d69b3980 con 0x5580d6a6abe0 2023-10-06T03:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2bc1d8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d69b3620 con 0x5580d6b364a0 2023-10-06T03:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2bc1d8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d69aa400 con 0x5580d6a568e0 2023-10-06T03:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b4c12700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6a6abe0 0x5580d6b3dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b4c12700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6a6abe0 0x5580d6b3dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59970/0 (socket says 172.21.15.84:59970) 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b4c12700 1 -- 172.21.15.84:0/4062817269 learned_addr learned my addr 172.21.15.84:0/4062817269 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b5c14700 1 --2- 172.21.15.84:0/4062817269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580d6b364a0 0x5580d6b36a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b5413700 1 --2- 172.21.15.84:0/4062817269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580d6a568e0 0x5580d6a93530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b4c12700 1 -- 172.21.15.84:0/4062817269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580d6a568e0 msgr2=0x5580d6a93530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b4c12700 1 --2- 172.21.15.84:0/4062817269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580d6a568e0 0x5580d6a93530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b4c12700 1 -- 172.21.15.84:0/4062817269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580d6b364a0 msgr2=0x5580d6b36a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b4c12700 1 --2- 172.21.15.84:0/4062817269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580d6b364a0 0x5580d6b36a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.762+0000 7fd2b4c12700 1 -- 172.21.15.84:0/4062817269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0005db0 con 0x5580d6a6abe0 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2b4c12700 1 --2- 172.21.15.84:0/4062817269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6a6abe0 0x5580d6b3dd00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x5580d6a95090 tx=0x7fd2a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6a28347f433ceb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2af7fe700 1 -- 172.21.15.84:0/4062817269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0000bc0 con 0x5580d6a6abe0 2023-10-06T03:01:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2af7fe700 1 -- 172.21.15.84:0/4062817269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a00089d0 con 0x5580d6a6abe0 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2af7fe700 1 -- 172.21.15.84:0/4062817269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0000d20 con 0x5580d6a6abe0 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/4062817269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6a6abe0 msgr2=0x5580d6b3dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2bc1d8000 1 --2- 172.21.15.84:0/4062817269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6a6abe0 0x5580d6b3dd00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x5580d6a95090 tx=0x7fd2a0016000 comp rx=0 tx=0).stop 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/4062817269 shutdown_connections 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2bc1d8000 1 --2- 172.21.15.84:0/4062817269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580d6b364a0 0x5580d6b36a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2bc1d8000 1 --2- 172.21.15.84:0/4062817269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580d6a568e0 0x5580d6a93530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2bc1d8000 1 --2- 172.21.15.84:0/4062817269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6a6abe0 0x5580d6b3dd00 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/4062817269 >> 172.21.15.84:0/4062817269 conn(0x5580d6a697d0 msgr2=0x5580d6b3fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/4062817269 shutdown_connections 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.763+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/4062817269 wait complete. 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.764+0000 7fd2bc1d8000 1 Processor -- start 2023-10-06T03:01:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.764+0000 7fd2bc1d8000 1 -- start start 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.764+0000 7fd2bc1d8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580d6a568e0 0x5580d6b272d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.764+0000 7fd2bc1d8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580d6a6abe0 0x5580d6b27810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.764+0000 7fd2bc1d8000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6b364a0 0x5580d6b413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.764+0000 7fd2bc1d8000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d6b42250 con 0x5580d6b364a0 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.764+0000 7fd2bc1d8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d6b28020 con 0x5580d6a6abe0 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.764+0000 7fd2bc1d8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d6b282c0 con 0x5580d6a568e0 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5c14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6b364a0 0x5580d6b413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5c14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6b364a0 0x5580d6b413e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59974/0 (socket says 172.21.15.84:59974) 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5c14700 1 -- 172.21.15.84:0/3162394794 learned_addr learned my addr 172.21.15.84:0/3162394794 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b4c12700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580d6a6abe0 0x5580d6b27810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5413700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580d6a568e0 0x5580d6b272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5c14700 1 -- 172.21.15.84:0/3162394794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580d6a568e0 msgr2=0x5580d6b272d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5c14700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5580d6a568e0 0x5580d6b272d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5c14700 1 -- 172.21.15.84:0/3162394794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580d6a6abe0 msgr2=0x5580d6b27810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5c14700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580d6a6abe0 0x5580d6b27810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5c14700 1 -- 172.21.15.84:0/3162394794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580d69dc1c0 con 0x5580d6b364a0 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2b5c14700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6b364a0 0x5580d6b413e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8008a70 tx=0x7fd2a800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2adffb700 1 -- 172.21.15.84:0/3162394794 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a800f040 con 0x5580d6b364a0 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2adffb700 1 -- 172.21.15.84:0/3162394794 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a80106a0 con 0x5580d6b364a0 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2adffb700 1 -- 172.21.15.84:0/3162394794 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8010a60 con 0x5580d6b364a0 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5580d69c23d0 con 0x5580d6b364a0 2023-10-06T03:01:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.765+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5580d69b5ae0 con 0x5580d6b364a0 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.766+0000 7fd2adffb700 1 -- 172.21.15.84:0/3162394794 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2a8015450 con 0x5580d6b364a0 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.767+0000 7fd2adffb700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd298065890 0x7fd298067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.767+0000 7fd2adffb700 1 -- 172.21.15.84:0/3162394794 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd2a8084120 con 0x5580d6b364a0 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.767+0000 7fd2b5413700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd298065890 0x7fd298067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.767+0000 7fd2bc1d8000 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x5580d6b3eea0 0x5580d6b28f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.767+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 --> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] -- osd_op(unknown.0.0:1 14.12 14:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v8 -- 0x5580d6b29450 con 0x5580d6b3eea0 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.767+0000 7fd2b4c12700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x5580d6b3eea0 0x5580d6b28f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.767+0000 7fd2b5413700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd298065890 0x7fd298067d40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0000f80 tx=0x7fd2b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.767+0000 7fd2b4c12700 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x5580d6b3eea0 0x5580d6b28f10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.768+0000 7fd2b4c12700 1 -- 172.21.15.84:0/3162394794 <== osd.2 v2:172.21.15.84:6800/90631 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v94'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd2a00084f0 con 0x5580d6b3eea0 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.768+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x5580d6b3eea0 msgr2=0x5580d6b28f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.768+0000 7fd2bc1d8000 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x5580d6b3eea0 0x5580d6b28f10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.769+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd298065890 msgr2=0x7fd298067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.769+0000 7fd2bc1d8000 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd298065890 0x7fd298067d40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0000f80 tx=0x7fd2b0008040 comp rx=0 tx=0).stop 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.769+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6b364a0 msgr2=0x5580d6b413e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.769+0000 7fd2bc1d8000 1 --2- 172.21.15.84:0/3162394794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5580d6b364a0 0x5580d6b413e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8008a70 tx=0x7fd2a800c040 comp rx=0 tx=0).stop 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.769+0000 7fd2b5c14700 1 -- 172.21.15.84:0/3162394794 reap_dead start 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.769+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 shutdown_connections 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.769+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 >> 172.21.15.84:0/3162394794 conn(0x5580d6a697d0 msgr2=0x5580d6b3fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.769+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 shutdown_connections 2023-10-06T03:01:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.769+0000 7fd2bc1d8000 1 -- 172.21.15.84:0/3162394794 wait complete. 2023-10-06T03:01:08.776 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2023-10-06T03:01:08.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.851+0000 7fb3cc295000 1 Processor -- start 2023-10-06T03:01:08.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.851+0000 7fb3cc295000 1 -- start start 2023-10-06T03:01:08.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.851+0000 7fb3cc295000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 0x55edd4ee56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.851+0000 7fb3cc295000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78580 0x55edd4ed37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.851+0000 7fb3cc295000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78950 0x55edd4f7b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.851+0000 7fb3cc295000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd4df0980 con 0x55edd4f78950 2023-10-06T03:01:08.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.851+0000 7fb3cc295000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd4df0620 con 0x55edd4f78580 2023-10-06T03:01:08.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.851+0000 7fb3cc295000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edd4de7400 con 0x55edd4eec3b0 2023-10-06T03:01:08.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.851+0000 7fb3c5cd1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78950 0x55edd4f7b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c5cd1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78950 0x55edd4f7b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59994/0 (socket says 172.21.15.84:59994) 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c5cd1700 1 -- 172.21.15.84:0/3701382912 learned_addr learned my addr 172.21.15.84:0/3701382912 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c4ccf700 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78580 0x55edd4ed37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c54d0700 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 0x55edd4ee56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c5cd1700 1 -- 172.21.15.84:0/3701382912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 msgr2=0x55edd4ee56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c5cd1700 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 0x55edd4ee56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c5cd1700 1 -- 172.21.15.84:0/3701382912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78580 msgr2=0x55edd4ed37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c5cd1700 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78580 0x55edd4ed37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c5cd1700 1 -- 172.21.15.84:0/3701382912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc005cb0 con 0x55edd4f78950 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c4ccf700 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78580 0x55edd4ed37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:08.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3c5cd1700 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78950 0x55edd4f7b440 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0001580 tx=0x7fb3c0006b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0b6ac850f2df8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3b77fe700 1 -- 172.21.15.84:0/3701382912 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0004160 con 0x55edd4f78950 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3b77fe700 1 -- 172.21.15.84:0/3701382912 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c000e470 con 0x55edd4f78950 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3b77fe700 1 -- 172.21.15.84:0/3701382912 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000e810 con 0x55edd4f78950 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3cc295000 1 -- 172.21.15.84:0/3701382912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78950 msgr2=0x55edd4f7b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3cc295000 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78950 0x55edd4f7b440 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0001580 tx=0x7fb3c0006b10 comp rx=0 tx=0).stop 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3cc295000 1 -- 172.21.15.84:0/3701382912 shutdown_connections 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3cc295000 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78950 0x55edd4f7b440 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3cc295000 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 0x55edd4ee56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3cc295000 1 --2- 172.21.15.84:0/3701382912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78580 0x55edd4ed37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.852+0000 7fb3cc295000 1 -- 172.21.15.84:0/3701382912 >> 172.21.15.84:0/3701382912 conn(0x55edd4ea67d0 msgr2=0x55edd4ea80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.853+0000 7fb3cc295000 1 -- 172.21.15.84:0/3701382912 shutdown_connections 2023-10-06T03:01:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.853+0000 7fb3cc295000 1 -- 172.21.15.84:0/3701382912 wait complete. 2023-10-06T03:01:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.853+0000 7fb3cc295000 1 Processor -- start 2023-10-06T03:01:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.853+0000 7fb3cc295000 1 -- start start 2023-10-06T03:01:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3cc295000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 0x55edd4f811a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3cc295000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78580 0x55edd4f79920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3cc295000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78950 0x55edd4ee98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3cc295000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd4f6ee10 con 0x55edd4f78580 2023-10-06T03:01:08.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3cc295000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edd4eeb6b0 con 0x55edd4f78950 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3cc295000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edd4eeb950 con 0x55edd4eec3b0 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c4ccf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78580 0x55edd4f79920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c4ccf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78580 0x55edd4f79920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60004/0 (socket says 172.21.15.84:60004) 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c4ccf700 1 -- 172.21.15.84:0/490882048 learned_addr learned my addr 172.21.15.84:0/490882048 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c54d0700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 0x55edd4f811a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c5cd1700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78950 0x55edd4ee98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c4ccf700 1 -- 172.21.15.84:0/490882048 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 msgr2=0x55edd4f811a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c4ccf700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 0x55edd4f811a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c4ccf700 1 -- 172.21.15.84:0/490882048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78950 msgr2=0x55edd4ee98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c4ccf700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55edd4f78950 0x55edd4ee98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c4ccf700 1 -- 172.21.15.84:0/490882048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edd4df2750 con 0x55edd4f78580 2023-10-06T03:01:08.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c54d0700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55edd4eec3b0 0x55edd4f811a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:08.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3c4ccf700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78580 0x55edd4f79920 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc007000 tx=0x7fb3bc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3b5ffb700 1 -- 172.21.15.84:0/490882048 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc014760 con 0x55edd4f78580 2023-10-06T03:01:08.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3b5ffb700 1 -- 172.21.15.84:0/490882048 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc0148c0 con 0x55edd4f78580 2023-10-06T03:01:08.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55edd4dff3d0 con 0x55edd4f78580 2023-10-06T03:01:08.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.854+0000 7fb3b5ffb700 1 -- 172.21.15.84:0/490882048 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc014c60 con 0x55edd4f78580 2023-10-06T03:01:08.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.855+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edd4df2ae0 con 0x55edd4f78580 2023-10-06T03:01:08.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.856+0000 7fb3b5ffb700 1 -- 172.21.15.84:0/490882048 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3bc01c040 con 0x55edd4f78580 2023-10-06T03:01:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.856+0000 7fb3b5ffb700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a8065890 0x7fb3a8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.856+0000 7fb3c54d0700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a8065890 0x7fb3a8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.856+0000 7fb3b5ffb700 1 -- 172.21.15.84:0/490882048 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb3bc0871f0 con 0x55edd4f78580 2023-10-06T03:01:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.856+0000 7fb3cc295000 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55edd4f79e60 0x55edd4f8be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.856+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- osd_op(unknown.0.0:1 14.5 14:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v8 -- 0x55edd4ee9e30 con 0x55edd4f79e60 2023-10-06T03:01:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.856+0000 7fb3c5cd1700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55edd4f79e60 0x55edd4f8be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.856+0000 7fb3c54d0700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a8065890 0x7fb3a8067d40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8005fd0 tx=0x7fb3b800c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.857+0000 7fb3c5cd1700 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55edd4f79e60 0x55edd4f8be50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3c5cd1700 1 -- 172.21.15.84:0/490882048 <== osd.0 v2:172.21.15.84:6808/90632 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v94'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb3c000eb80 con 0x55edd4f79e60 2023-10-06T03:01:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55edd4f79e60 msgr2=0x55edd4f8be50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3cc295000 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55edd4f79e60 0x55edd4f8be50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a8065890 msgr2=0x7fb3a8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3cc295000 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3a8065890 0x7fb3a8067d40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8005fd0 tx=0x7fb3b800c040 comp rx=0 tx=0).stop 2023-10-06T03:01:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78580 msgr2=0x55edd4f79920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3cc295000 1 --2- 172.21.15.84:0/490882048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55edd4f78580 0x55edd4f79920 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc007000 tx=0x7fb3bc01a000 comp rx=0 tx=0).stop 2023-10-06T03:01:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3c5cd1700 1 -- 172.21.15.84:0/490882048 reap_dead start 2023-10-06T03:01:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 shutdown_connections 2023-10-06T03:01:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 >> 172.21.15.84:0/490882048 conn(0x55edd4ea67d0 msgr2=0x55edd4f78d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.858+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 shutdown_connections 2023-10-06T03:01:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.859+0000 7fb3cc295000 1 -- 172.21.15.84:0/490882048 wait complete. 2023-10-06T03:01:08.867 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.943+0000 7fda89a33000 1 Processor -- start 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.943+0000 7fda89a33000 1 -- start start 2023-10-06T03:01:08.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda89a33000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbca670 0x55e39fbacf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda89a33000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbc46b0 0x55e39fc3eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda89a33000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 0x55e39fc3f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda89a33000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e39facb980 con 0x55e39fbc46b0 2023-10-06T03:01:08.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda89a33000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e39facb620 con 0x55e39fbcaa40 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda89a33000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e39fac2400 con 0x55e39fbca670 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8246d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbc46b0 0x55e39fc3eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8246d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbc46b0 0x55e39fc3eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60020/0 (socket says 172.21.15.84:60020) 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8246d700 1 -- 172.21.15.84:0/2978055268 learned_addr learned my addr 172.21.15.84:0/2978055268 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda82c6e700 1 --2- 172.21.15.84:0/2978055268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbca670 0x55e39fbacf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8346f700 1 --2- 172.21.15.84:0/2978055268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 0x55e39fc3f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8246d700 1 -- 172.21.15.84:0/2978055268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbca670 msgr2=0x55e39fbacf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8246d700 1 --2- 172.21.15.84:0/2978055268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbca670 0x55e39fbacf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8246d700 1 -- 172.21.15.84:0/2978055268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 msgr2=0x55e39fc3f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8246d700 1 --2- 172.21.15.84:0/2978055268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 0x55e39fc3f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8246d700 1 -- 172.21.15.84:0/2978055268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e39fada3d0 con 0x55e39fbc46b0 2023-10-06T03:01:08.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8246d700 1 --2- 172.21.15.84:0/2978055268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbc46b0 0x55e39fc3eeb0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fda780098d0 tx=0x7fda7800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e216d91b0f002b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8146b700 1 -- 172.21.15.84:0/2978055268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78019070 con 0x55e39fbc46b0 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8146b700 1 -- 172.21.15.84:0/2978055268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda78010040 con 0x55e39fbc46b0 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.944+0000 7fda8146b700 1 -- 172.21.15.84:0/2978055268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7800f050 con 0x55e39fbc46b0 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 -- 172.21.15.84:0/2978055268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbc46b0 msgr2=0x55e39fc3eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 --2- 172.21.15.84:0/2978055268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbc46b0 0x55e39fc3eeb0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fda780098d0 tx=0x7fda7800c040 comp rx=0 tx=0).stop 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 -- 172.21.15.84:0/2978055268 shutdown_connections 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 --2- 172.21.15.84:0/2978055268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 0x55e39fc3f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 --2- 172.21.15.84:0/2978055268 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbca670 0x55e39fbacf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 --2- 172.21.15.84:0/2978055268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbc46b0 0x55e39fc3eeb0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 -- 172.21.15.84:0/2978055268 >> 172.21.15.84:0/2978055268 conn(0x55e39fb815d0 msgr2=0x55e39fc58160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 -- 172.21.15.84:0/2978055268 shutdown_connections 2023-10-06T03:01:08.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 -- 172.21.15.84:0/2978055268 wait complete. 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.945+0000 7fda89a33000 1 Processor -- start 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda89a33000 1 -- start start 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda89a33000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbc46b0 0x55e39fba5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda89a33000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbca670 0x55e39fba9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda89a33000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 0x55e39fba6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda89a33000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e39fc574f0 con 0x55e39fbca670 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda89a33000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e39fbaa7f0 con 0x55e39fbcaa40 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda89a33000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e39fbaaa90 con 0x55e39fbc46b0 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda8246d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbca670 0x55e39fba9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda8246d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbca670 0x55e39fba9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60034/0 (socket says 172.21.15.84:60034) 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda8246d700 1 -- 172.21.15.84:0/4204077625 learned_addr learned my addr 172.21.15.84:0/4204077625 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:08.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda82c6e700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbc46b0 0x55e39fba5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.946+0000 7fda8346f700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 0x55e39fba6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda8246d700 1 -- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbc46b0 msgr2=0x55e39fba5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda8246d700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbc46b0 0x55e39fba5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda8246d700 1 -- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 msgr2=0x55e39fba6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda8246d700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 0x55e39fba6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda8246d700 1 -- 172.21.15.84:0/4204077625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780094d0 con 0x55e39fbca670 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda82c6e700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e39fbc46b0 0x55e39fba5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda8346f700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e39fbcaa40 0x55e39fba6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda8246d700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbca670 0x55e39fba9e00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fda78008700 tx=0x7fda78019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda737fe700 1 -- 172.21.15.84:0/4204077625 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7801f420 con 0x55e39fbca670 2023-10-06T03:01:08.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda737fe700 1 -- 172.21.15.84:0/4204077625 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7801f580 con 0x55e39fbca670 2023-10-06T03:01:08.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda737fe700 1 -- 172.21.15.84:0/4204077625 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7801f900 con 0x55e39fbca670 2023-10-06T03:01:08.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e39facdae0 con 0x55e39fbca670 2023-10-06T03:01:08.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.947+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e39facd540 con 0x55e39fbca670 2023-10-06T03:01:08.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.948+0000 7fda737fe700 1 -- 172.21.15.84:0/4204077625 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda7801fcf0 con 0x55e39fbca670 2023-10-06T03:01:08.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.948+0000 7fda737fe700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda68065890 0x7fda68067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.949+0000 7fda737fe700 1 -- 172.21.15.84:0/4204077625 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fda780855f0 con 0x55e39fbca670 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.949+0000 7fda82c6e700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda68065890 0x7fda68067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.949+0000 7fda89a33000 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55e39fbaa340 0x55e39fc331a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.949+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 --> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] -- osd_op(unknown.0.0:1 14.9 14:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v8 -- 0x55e39fc336e0 con 0x55e39fbaa340 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.949+0000 7fda82c6e700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda68065890 0x7fda68067d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fda74005cc0 tx=0x7fda7400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.949+0000 7fda8346f700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55e39fbaa340 0x55e39fc331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.950+0000 7fda8346f700 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55e39fbaa340 0x55e39fc331a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda8346f700 1 -- 172.21.15.84:0/4204077625 <== osd.5 v2:172.21.15.131:6808/90923 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v94'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fda7c018040 con 0x55e39fbaa340 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55e39fbaa340 msgr2=0x55e39fc331a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x55e39fbaa340 0x55e39fc331a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda68065890 msgr2=0x7fda68067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fda68065890 0x7fda68067d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fda74005cc0 tx=0x7fda7400c040 comp rx=0 tx=0).stop 2023-10-06T03:01:08.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbca670 msgr2=0x55e39fba9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 --2- 172.21.15.84:0/4204077625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e39fbca670 0x55e39fba9e00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fda78008700 tx=0x7fda78019000 comp rx=0 tx=0).stop 2023-10-06T03:01:08.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda8346f700 1 -- 172.21.15.84:0/4204077625 reap_dead start 2023-10-06T03:01:08.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 shutdown_connections 2023-10-06T03:01:08.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 >> 172.21.15.84:0/4204077625 conn(0x55e39fb815d0 msgr2=0x55e39fbb0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 shutdown_connections 2023-10-06T03:01:08.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:08.951+0000 7fda89a33000 1 -- 172.21.15.84:0/4204077625 wait complete. 2023-10-06T03:01:08.958 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2023-10-06T03:01:09.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.033+0000 7f1a11d17000 1 Processor -- start 2023-10-06T03:01:09.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.033+0000 7f1a11d17000 1 -- start start 2023-10-06T03:01:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a11d17000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642cee630 0x564642d958d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a11d17000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564642d05bb0 0x564642cbfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a11d17000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642d96630 0x564642d7a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a11d17000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564642c09980 con 0x564642cee630 2023-10-06T03:01:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a11d17000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564642c09620 con 0x564642d96630 2023-10-06T03:01:09.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a11d17000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564642c00400 con 0x564642d05bb0 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0af52700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642cee630 0x564642d958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0af52700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642cee630 0x564642d958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60044/0 (socket says 172.21.15.84:60044) 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0af52700 1 -- 172.21.15.84:0/171981847 learned_addr learned my addr 172.21.15.84:0/171981847 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0b753700 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642d96630 0x564642d7a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a02751700 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564642d05bb0 0x564642cbfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0af52700 1 -- 172.21.15.84:0/171981847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564642d05bb0 msgr2=0x564642cbfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0af52700 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564642d05bb0 0x564642cbfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0af52700 1 -- 172.21.15.84:0/171981847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642d96630 msgr2=0x564642d7a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0af52700 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642d96630 0x564642d7a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0af52700 1 -- 172.21.15.84:0/171981847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc005cf0 con 0x564642cee630 2023-10-06T03:01:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0b753700 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642d96630 0x564642d7a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a0af52700 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642cee630 0x564642d958d0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f19fc012000 tx=0x7f19fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693eb5e90338848d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.034+0000 7f1a09f50700 1 -- 172.21.15.84:0/171981847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc000bc0 con 0x564642cee630 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a09f50700 1 -- 172.21.15.84:0/171981847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc020070 con 0x564642cee630 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a09f50700 1 -- 172.21.15.84:0/171981847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc008bc0 con 0x564642cee630 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a11d17000 1 -- 172.21.15.84:0/171981847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642cee630 msgr2=0x564642d958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a11d17000 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642cee630 0x564642d958d0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f19fc012000 tx=0x7f19fc016000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a11d17000 1 -- 172.21.15.84:0/171981847 shutdown_connections 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a11d17000 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642d96630 0x564642d7a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a11d17000 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642cee630 0x564642d958d0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a11d17000 1 --2- 172.21.15.84:0/171981847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564642d05bb0 0x564642cbfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a11d17000 1 -- 172.21.15.84:0/171981847 >> 172.21.15.84:0/171981847 conn(0x564642cbf5d0 msgr2=0x564642ce97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a11d17000 1 -- 172.21.15.84:0/171981847 shutdown_connections 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.035+0000 7f1a11d17000 1 -- 172.21.15.84:0/171981847 wait complete. 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.036+0000 7f1a11d17000 1 Processor -- start 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.036+0000 7f1a11d17000 1 -- start start 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.036+0000 7f1a11d17000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642cee630 0x564642d90d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.036+0000 7f1a11d17000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564642d05bb0 0x564642d75480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.036+0000 7f1a11d17000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642d96630 0x564642d996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.036+0000 7f1a11d17000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564642d985a0 con 0x564642d96630 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.036+0000 7f1a11d17000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564642d98840 con 0x564642cee630 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.036+0000 7f1a11d17000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564642d98ae0 con 0x564642d05bb0 2023-10-06T03:01:09.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.036+0000 7f1a0b753700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642d96630 0x564642d996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a0b753700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642d96630 0x564642d996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60048/0 (socket says 172.21.15.84:60048) 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a0b753700 1 -- 172.21.15.84:0/720818778 learned_addr learned my addr 172.21.15.84:0/720818778 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a0af52700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642cee630 0x564642d90d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a02751700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564642d05bb0 0x564642d75480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a0b753700 1 -- 172.21.15.84:0/720818778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564642d05bb0 msgr2=0x564642d75480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a0b753700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564642d05bb0 0x564642d75480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a0b753700 1 -- 172.21.15.84:0/720818778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642cee630 msgr2=0x564642d90d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a0b753700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564642cee630 0x564642d90d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a0b753700 1 -- 172.21.15.84:0/720818778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564642c321c0 con 0x564642d96630 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a0b753700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642d96630 0x564642d996b0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f1a040068a0 tx=0x7f1a040063b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a03fff700 1 -- 172.21.15.84:0/720818778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400de40 con 0x564642d96630 2023-10-06T03:01:09.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a03fff700 1 -- 172.21.15.84:0/720818778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a04012420 con 0x564642d96630 2023-10-06T03:01:09.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564642c183d0 con 0x564642d96630 2023-10-06T03:01:09.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a03fff700 1 -- 172.21.15.84:0/720818778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040127a0 con 0x564642d96630 2023-10-06T03:01:09.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.037+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564642c0bae0 con 0x564642d96630 2023-10-06T03:01:09.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.038+0000 7f1a03fff700 1 -- 172.21.15.84:0/720818778 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a04012bd0 con 0x564642d96630 2023-10-06T03:01:09.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.039+0000 7f1a03fff700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19ec0658c0 0x7f19ec067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.039+0000 7f1a03fff700 1 -- 172.21.15.84:0/720818778 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1a040831b0 con 0x564642d96630 2023-10-06T03:01:09.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.039+0000 7f1a0af52700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19ec0658c0 0x7f19ec067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.039+0000 7f1a11d17000 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564642d759c0 0x564642da4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.039+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- osd_op(unknown.0.0:1 14.5 14:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v8 -- 0x564642da46b0 con 0x564642d759c0 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.039+0000 7f1a02751700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564642d759c0 0x564642da4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.039+0000 7f1a0af52700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19ec0658c0 0x7f19ec067d70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19fc012000 tx=0x7f19fc01e070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.039+0000 7f1a02751700 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564642d759c0 0x564642da4170 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a02751700 1 -- 172.21.15.84:0/720818778 <== osd.0 v2:172.21.15.84:6808/90632 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v94'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f19f4009950 con 0x564642d759c0 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564642d759c0 msgr2=0x564642da4170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564642d759c0 0x564642da4170 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19ec0658c0 msgr2=0x7f19ec067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f19ec0658c0 0x7f19ec067d70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19fc012000 tx=0x7f19fc01e070 comp rx=0 tx=0).stop 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642d96630 msgr2=0x564642d996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 --2- 172.21.15.84:0/720818778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564642d96630 0x564642d996b0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f1a040068a0 tx=0x7f1a040063b0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a0b753700 1 -- 172.21.15.84:0/720818778 reap_dead start 2023-10-06T03:01:09.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 shutdown_connections 2023-10-06T03:01:09.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 >> 172.21.15.84:0/720818778 conn(0x564642cbf5d0 msgr2=0x564642d76b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 shutdown_connections 2023-10-06T03:01:09.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.041+0000 7f1a11d17000 1 -- 172.21.15.84:0/720818778 wait complete. 2023-10-06T03:01:09.048 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2023-10-06T03:01:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48c1478000 1 Processor -- start 2023-10-06T03:01:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48c1478000 1 -- start start 2023-10-06T03:01:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48c1478000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8002300 0x55d129298a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48c1478000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d12929c3b0 0x55d12929cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48c1478000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 0x55d1291ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48c1478000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d12916c320 con 0x7f48a8002300 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48c1478000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d129110980 con 0x55d12920d550 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48c1478000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d129110620 con 0x55d12929c3b0 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48ba6b3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8002300 0x55d129298a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48ba6b3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8002300 0x55d129298a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60062/0 (socket says 172.21.15.84:60062) 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.123+0000 7f48ba6b3700 1 -- 172.21.15.84:0/2962319748 learned_addr learned my addr 172.21.15.84:0/2962319748 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48baeb4700 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 0x55d1291ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48b1eb2700 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d12929c3b0 0x55d12929cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48ba6b3700 1 -- 172.21.15.84:0/2962319748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d12929c3b0 msgr2=0x55d12929cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48ba6b3700 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d12929c3b0 0x55d12929cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48ba6b3700 1 -- 172.21.15.84:0/2962319748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 msgr2=0x55d1291ef5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48ba6b3700 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 0x55d1291ef5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48ba6b3700 1 -- 172.21.15.84:0/2962319748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d129112ae0 con 0x7f48a8002300 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48baeb4700 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 0x55d1291ef5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48ba6b3700 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8002300 0x55d129298a10 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00b5d0 tx=0x7f48ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28bfcc25ed1ae1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48b96b1700 1 -- 172.21.15.84:0/2962319748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac009560 con 0x7f48a8002300 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48b96b1700 1 -- 172.21.15.84:0/2962319748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00bb40 con 0x7f48a8002300 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48b96b1700 1 -- 172.21.15.84:0/2962319748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00b870 con 0x7f48a8002300 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48c1478000 1 -- 172.21.15.84:0/2962319748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8002300 msgr2=0x55d129298a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48c1478000 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8002300 0x55d129298a10 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00b5d0 tx=0x7f48ac017000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48c1478000 1 -- 172.21.15.84:0/2962319748 shutdown_connections 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48c1478000 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 0x55d1291ef5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48c1478000 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48a8002300 0x55d129298a10 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48c1478000 1 --2- 172.21.15.84:0/2962319748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d12929c3b0 0x55d12929cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.124+0000 7f48c1478000 1 -- 172.21.15.84:0/2962319748 >> 172.21.15.84:0/2962319748 conn(0x55d1291c67d0 msgr2=0x55d1291f53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.125+0000 7f48c1478000 1 -- 172.21.15.84:0/2962319748 shutdown_connections 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.125+0000 7f48c1478000 1 -- 172.21.15.84:0/2962319748 wait complete. 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.125+0000 7f48c1478000 1 Processor -- start 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.125+0000 7f48c1478000 1 -- start start 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48c1478000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 0x55d129298640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48c1478000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d12929c3b0 0x55d12928a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48c1478000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48a8002300 0x55d1291f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48c1478000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d129107400 con 0x55d12929c3b0 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48c1478000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1291f1b90 con 0x55d12920d550 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48c1478000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d12928c550 con 0x7f48a8002300 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b1eb2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d12929c3b0 0x55d12928a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b1eb2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d12929c3b0 0x55d12928a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60066/0 (socket says 172.21.15.84:60066) 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b1eb2700 1 -- 172.21.15.84:0/2835947789 learned_addr learned my addr 172.21.15.84:0/2835947789 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48baeb4700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48a8002300 0x55d1291f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48ba6b3700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 0x55d129298640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b1eb2700 1 -- 172.21.15.84:0/2835947789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48a8002300 msgr2=0x55d1291f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b1eb2700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f48a8002300 0x55d1291f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b1eb2700 1 -- 172.21.15.84:0/2835947789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 msgr2=0x55d129298640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b1eb2700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d12920d550 0x55d129298640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b1eb2700 1 -- 172.21.15.84:0/2835947789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8001e10 con 0x55d12929c3b0 2023-10-06T03:01:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b1eb2700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d12929c3b0 0x55d12928a2e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f48a4007780 tx=0x7f48a4005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.126+0000 7f48b37fe700 1 -- 172.21.15.84:0/2835947789 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4019070 con 0x55d12929c3b0 2023-10-06T03:01:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.127+0000 7f48b37fe700 1 -- 172.21.15.84:0/2835947789 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4010050 con 0x55d12929c3b0 2023-10-06T03:01:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.127+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d129112540 con 0x55d12929c3b0 2023-10-06T03:01:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.127+0000 7f48b37fe700 1 -- 172.21.15.84:0/2835947789 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40068d0 con 0x55d12929c3b0 2023-10-06T03:01:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.127+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d12928c7b0 con 0x55d12929c3b0 2023-10-06T03:01:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.128+0000 7f48b37fe700 1 -- 172.21.15.84:0/2835947789 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48a4006c40 con 0x55d12929c3b0 2023-10-06T03:01:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.128+0000 7f48b37fe700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f489c0658c0 0x7f489c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.128+0000 7f48b37fe700 1 -- 172.21.15.84:0/2835947789 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f48a40832c0 con 0x55d12929c3b0 2023-10-06T03:01:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.128+0000 7f48ba6b3700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f489c0658c0 0x7f489c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.128+0000 7f48c1478000 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55d1291f0ea0 0x55d12928d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.128+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- osd_op(unknown.0.0:1 14.1d 14:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v8 -- 0x55d12928d660 con 0x55d1291f0ea0 2023-10-06T03:01:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.129+0000 7f48baeb4700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55d1291f0ea0 0x55d12928d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.129+0000 7f48ba6b3700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f489c0658c0 0x7f489c067d70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00bcf0 tx=0x7f48ac01f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.129+0000 7f48baeb4700 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55d1291f0ea0 0x55d12928d120 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48baeb4700 1 -- 172.21.15.84:0/2835947789 <== osd.0 v2:172.21.15.84:6808/90632 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v94'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f48b40037c0 con 0x55d1291f0ea0 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55d1291f0ea0 msgr2=0x55d12928d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x55d1291f0ea0 0x55d12928d120 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f489c0658c0 msgr2=0x7f489c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f489c0658c0 0x7f489c067d70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00bcf0 tx=0x7f48ac01f000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d12929c3b0 msgr2=0x55d12928a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 --2- 172.21.15.84:0/2835947789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d12929c3b0 0x55d12928a2e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f48a4007780 tx=0x7f48a4005c50 comp rx=0 tx=0).stop 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48baeb4700 1 -- 172.21.15.84:0/2835947789 reap_dead start 2023-10-06T03:01:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 shutdown_connections 2023-10-06T03:01:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 >> 172.21.15.84:0/2835947789 conn(0x55d1291c67d0 msgr2=0x55d12929b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 shutdown_connections 2023-10-06T03:01:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.130+0000 7f48c1478000 1 -- 172.21.15.84:0/2835947789 wait complete. 2023-10-06T03:01:09.138 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub start /d1/d2/d3 recursive,force 2023-10-06T03:01:09.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.293+0000 7feb9a45f700 1 Processor -- start 2023-10-06T03:01:09.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.293+0000 7feb9a45f700 1 -- start start 2023-10-06T03:01:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb9a45f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb940d0a00 0x7feb94164330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb9a45f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940cdc30 con 0x7feb941539d0 2023-10-06T03:01:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb9a45f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940cb500 con 0x7feb940ccab0 2023-10-06T03:01:09.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb9a45f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb940cd020 con 0x7feb940d0a00 2023-10-06T03:01:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb9945d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feb941539d0 0x7feb9415a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37674/0 (socket says 172.21.15.84:37674) 2023-10-06T03:01:09.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb9945d700 1 -- 172.21.15.84:0/742131350 learned_addr learned my addr 172.21.15.84:0/742131350 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:09.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb99c5e700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb940d0a00 0x7feb94164330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319027395 0 0) 0x7feb940cdc30 con 0x7feb941539d0 2023-10-06T03:01:09.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb7c003570 con 0x7feb941539d0 2023-10-06T03:01:09.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2641147042 0 0) 0x7feb7c003570 con 0x7feb941539d0 2023-10-06T03:01:09.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb940d0a00 msgr2=0x7feb94164330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb93fff700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb940d0a00 0x7feb94164330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 >> v1:172.21.15.131:6789/0 conn(0x7feb940ccab0 legacy=0x7feb940d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.294+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940cd300 con 0x7feb941539d0 2023-10-06T03:01:09.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7feb8c0017f0 con 0x7feb941539d0 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 >> v1:172.21.15.84:6789/0 conn(0x7feb941539d0 legacy=0x7feb9415a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb7c003a90 0x7feb7c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb940d0a00 0x7feb7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c004d50 0x7feb7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940cd020 con 0x7feb7c003a90 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c00bb10 con 0x7feb7c004d50 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c00bcd0 con 0x7feb940d0a00 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb9945d700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb7c003a90 0x7feb7c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb98c5c700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb940d0a00 0x7feb7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb99c5e700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c004d50 0x7feb7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb9945d700 1 -- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb940d0a00 msgr2=0x7feb7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb9945d700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb940d0a00 0x7feb7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb9945d700 1 -- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c004d50 msgr2=0x7feb7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb9945d700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c004d50 0x7feb7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb9945d700 1 -- 172.21.15.84:0/742131350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c003570 con 0x7feb7c003a90 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb98c5c700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb940d0a00 0x7feb7c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb9945d700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb7c003a90 0x7feb7c003e60 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a950 tx=0x7feb8c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83819ef757fd7e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0070d0 con 0x7feb7c003a90 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c007250 con 0x7feb7c003a90 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.295+0000 7feb93fff700 1 -- 172.21.15.84:0/742131350 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c007610 con 0x7feb7c003a90 2023-10-06T03:01:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.296+0000 7feb9a45f700 1 -- 172.21.15.84:0/742131350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb7c003a90 msgr2=0x7feb7c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.296+0000 7feb9a45f700 1 --2- 172.21.15.84:0/742131350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb7c003a90 0x7feb7c003e60 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a950 tx=0x7feb8c0021f0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.296+0000 7feb99c5e700 1 -- 172.21.15.84:0/742131350 reap_dead start 2023-10-06T03:01:09.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.296+0000 7feb9a45f700 1 -- 172.21.15.84:0/742131350 shutdown_connections 2023-10-06T03:01:09.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.296+0000 7feb9a45f700 1 -- 172.21.15.84:0/742131350 >> 172.21.15.84:0/742131350 conn(0x7feb94068100 msgr2=0x7feb940684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.296+0000 7feb9a45f700 1 -- 172.21.15.84:0/742131350 shutdown_connections 2023-10-06T03:01:09.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.296+0000 7feb9a45f700 1 -- 172.21.15.84:0/742131350 wait complete. 2023-10-06T03:01:09.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.297+0000 7feb9a45f700 1 Processor -- start 2023-10-06T03:01:09.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.297+0000 7feb9a45f700 1 -- start start 2023-10-06T03:01:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb9a45f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c003a90 0x7feb940b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb9a45f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb94150e90 0x7feb940b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb9a45f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb9415ab60 0x7feb9415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb9a45f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9415b520 con 0x7feb9415ab60 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb9a45f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940c8150 con 0x7feb7c003a90 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb9a45f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb940c7540 con 0x7feb94150e90 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb99c5e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb9415ab60 0x7feb9415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb99c5e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb9415ab60 0x7feb9415afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60080/0 (socket says 172.21.15.84:60080) 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb99c5e700 1 -- 172.21.15.84:0/679838198 learned_addr learned my addr 172.21.15.84:0/679838198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb9945d700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c003a90 0x7feb940b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb98c5c700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb94150e90 0x7feb940b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb99c5e700 1 -- 172.21.15.84:0/679838198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb94150e90 msgr2=0x7feb940b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb99c5e700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb94150e90 0x7feb940b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb99c5e700 1 -- 172.21.15.84:0/679838198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c003a90 msgr2=0x7feb940b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb99c5e700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c003a90 0x7feb940b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb99c5e700 1 -- 172.21.15.84:0/679838198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940c7820 con 0x7feb9415ab60 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb9945d700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c003a90 0x7feb940b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb99c5e700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb9415ab60 0x7feb9415afe0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7feb94069150 tx=0x7feb84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.298+0000 7feb917fa700 1 -- 172.21.15.84:0/679838198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84015670 con 0x7feb9415ab60 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.299+0000 7feb917fa700 1 -- 172.21.15.84:0/679838198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb840157d0 con 0x7feb9415ab60 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.299+0000 7feb9a45f700 1 -- 172.21.15.84:0/679838198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb940c7b00 con 0x7feb9415ab60 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.299+0000 7feb917fa700 1 -- 172.21.15.84:0/679838198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84015b90 con 0x7feb9415ab60 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.299+0000 7feb9a45f700 1 -- 172.21.15.84:0/679838198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb940b0f50 con 0x7feb9415ab60 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.300+0000 7feb917fa700 1 -- 172.21.15.84:0/679838198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb8401e400 con 0x7feb9415ab60 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.300+0000 7feb917fa700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb80066f30 0x7feb800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.300+0000 7feb917fa700 1 -- 172.21.15.84:0/679838198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7feb84084b80 con 0x7feb9415ab60 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.300+0000 7feb9945d700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb80066f30 0x7feb800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.301+0000 7feb9945d700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb80066f30 0x7feb800693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feb940ca490 tx=0x7feb8c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feba49b9b80 1 Processor -- start 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feba49b9b80 1 -- start start 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd153da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd154820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feba49b9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639cd0aeb50 con 0x5639cd15aaf0 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feba49b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639cd0ac350 con 0x5639cd178f30 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feba49b9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639cd0a8140 con 0x5639cd1593a0 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb99c5e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb99c5e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60092/0 (socket says 172.21.15.84:60092) 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb99c5e700 1 -- 172.21.15.84:0/4292915585 learned_addr learned my addr 172.21.15.84:0/4292915585 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb9945d700 1 --2- 172.21.15.84:0/4292915585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb98c5c700 1 --2- 172.21.15.84:0/4292915585 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb99c5e700 1 -- 172.21.15.84:0/4292915585 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 msgr2=0x5639cd1542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb99c5e700 1 --2- 172.21.15.84:0/4292915585 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd1542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb99c5e700 1 -- 172.21.15.84:0/4292915585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 msgr2=0x5639cd153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb99c5e700 1 --2- 172.21.15.84:0/4292915585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb99c5e700 1 -- 172.21.15.84:0/4292915585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639ccf42350 con 0x5639cd15aaf0 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.303+0000 7feb99c5e700 1 --2- 172.21.15.84:0/4292915585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd154820 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7feb840091e0 tx=0x7feb84082cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab35013d1cf74f70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feb7a7fc700 1 -- 172.21.15.84:0/4292915585 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840589c0 con 0x5639cd15aaf0 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feb7a7fc700 1 -- 172.21.15.84:0/4292915585 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8405c710 con 0x5639cd15aaf0 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feb7a7fc700 1 -- 172.21.15.84:0/4292915585 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84053b10 con 0x5639cd15aaf0 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feba49b9b80 1 -- 172.21.15.84:0/4292915585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 msgr2=0x5639cd154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feba49b9b80 1 --2- 172.21.15.84:0/4292915585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd154820 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7feb840091e0 tx=0x7feb84082cc0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feba49b9b80 1 -- 172.21.15.84:0/4292915585 shutdown_connections 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feba49b9b80 1 --2- 172.21.15.84:0/4292915585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feba49b9b80 1 --2- 172.21.15.84:0/4292915585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd154820 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feba49b9b80 1 --2- 172.21.15.84:0/4292915585 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd1542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feba49b9b80 1 -- 172.21.15.84:0/4292915585 >> 172.21.15.84:0/4292915585 conn(0x5639cd158f60 msgr2=0x5639cd159790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feba49b9b80 1 -- 172.21.15.84:0/4292915585 shutdown_connections 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.304+0000 7feba49b9b80 1 -- 172.21.15.84:0/4292915585 wait complete. 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.305+0000 7feba49b9b80 1 -- start start 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.305+0000 7feba49b9b80 1 Processor -- start 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd179b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd1869d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639cd053970 con 0x5639cd15aaf0 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639cd06ef80 con 0x5639cd178f30 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639ccf2af10 con 0x5639cd1593a0 2023-10-06T03:01:09.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 10 client.0 _ll_register_callbacks cb 0x5639cd11b100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb98c5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb98c5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd1a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60106/0 (socket says 172.21.15.84:60106) 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb98c5c700 1 -- 172.21.15.84:0/1010965081 learned_addr learned my addr 172.21.15.84:0/1010965081 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb9945d700 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd179b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb99c5e700 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd1869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb98c5c700 1 -- 172.21.15.84:0/1010965081 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 msgr2=0x5639cd179b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb98c5c700 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd179b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb98c5c700 1 -- 172.21.15.84:0/1010965081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 msgr2=0x5639cd1869d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb98c5c700 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd1869d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb98c5c700 1 -- 172.21.15.84:0/1010965081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb940b0f50 con 0x5639cd15aaf0 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb98c5c700 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd1a1580 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7feb880013f0 tx=0x7feb88009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1aa1704a510497 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb737fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb737fe700 1 -- 172.21.15.84:0/1010965081 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88001e80 con 0x5639cd15aaf0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb737fe700 1 -- 172.21.15.84:0/1010965081 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7feb880155f0 con 0x5639cd15aaf0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 1 -- 172.21.15.84:0/1010965081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639cd14ca20 con 0x5639cd15aaf0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feb737fe700 1 -- 172.21.15.84:0/1010965081 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb880159c0 con 0x5639cd15aaf0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 10 client.8085 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.306+0000 7feba49b9b80 1 -- 172.21.15.84:0/1010965081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x5639ccee50c0 con 0x5639cd15aaf0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feb737fe700 1 -- 172.21.15.84:0/1010965081 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5639cd14ca20 con 0x5639cd15aaf0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feb737fe700 1 -- 172.21.15.84:0/1010965081 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7feb88015b20 con 0x5639cd15aaf0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feba49b9b80 10 client.8085 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feba49b9b80 10 client.8085 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feba49b9b80 20 client.8085 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5639cd180b60 0x5639cd168220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feba49b9b80 4 client.8085 mds_command: new command op to 7716 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feba49b9b80 1 -- 172.21.15.84:0/1010965081 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639cd129950 con 0x5639cd180b60 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feb9945d700 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5639cd180b60 0x5639cd168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feb737fe700 10 client.8085 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.307+0000 7feb9945d700 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5639cd180b60 0x5639cd168220 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814085d3e12439c2 server_cookie=59d6ad3152afc78f in_seq=0 out_seq=0 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feb737fe700 1 -- 172.21.15.84:0/1010965081 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5639cd129950 con 0x5639cd180b60 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feb737fe700 10 client.8085 handle_command_reply: tid=0 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 client.8085 shutdown 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 -- 172.21.15.84:0/1010965081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 msgr2=0x5639cd1a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd1a1580 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7feb880013f0 tx=0x7feb88009040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 -- 172.21.15.84:0/1010965081 shutdown_connections 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5639cd180b60 0x5639cd168220 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd1869d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd179b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feb737fe700 0 client.8085 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1010965081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd1a1580 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 -- 172.21.15.84:0/1010965081 >> 172.21.15.84:0/1010965081 conn(0x5639cd158f60 msgr2=0x5639cd159e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 -- 172.21.15.84:0/1010965081 shutdown_connections 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 1 -- 172.21.15.84:0/1010965081 wait complete. 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.308+0000 7feba49b9b80 20 client.8085 trim_cache size 0 max 16384 2023-10-06T03:01:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.324+0000 7feba49b9b80 1 Processor -- start 2023-10-06T03:01:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.324+0000 7feba49b9b80 1 -- start start 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd1ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feba49b9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639cd15a570 con 0x5639cd15aaf0 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feba49b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639cd158d20 con 0x5639cd178f30 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feba49b9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639cd1c0a80 con 0x5639cd1593a0 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb98c5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb98c5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60110/0 (socket says 172.21.15.84:60110) 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb98c5c700 1 -- 172.21.15.84:0/3003397197 learned_addr learned my addr 172.21.15.84:0/3003397197 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb9945d700 1 --2- 172.21.15.84:0/3003397197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd1ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb98c5c700 1 -- 172.21.15.84:0/3003397197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 msgr2=0x5639cd1ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb98c5c700 1 --2- 172.21.15.84:0/3003397197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd1ad5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb98c5c700 1 -- 172.21.15.84:0/3003397197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 msgr2=0x5639cd1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb98c5c700 1 --2- 172.21.15.84:0/3003397197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb98c5c700 1 -- 172.21.15.84:0/3003397197 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639cd076860 con 0x5639cd15aaf0 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb98c5c700 1 --2- 172.21.15.84:0/3003397197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd153bb0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7feb88007a60 tx=0x7feb88021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2260963cdccd098c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb7affd700 1 -- 172.21.15.84:0/3003397197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88001e80 con 0x5639cd15aaf0 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb7affd700 1 -- 172.21.15.84:0/3003397197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880033f0 con 0x5639cd15aaf0 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.325+0000 7feb7affd700 1 -- 172.21.15.84:0/3003397197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880159c0 con 0x5639cd15aaf0 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 -- 172.21.15.84:0/3003397197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 msgr2=0x5639cd153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 --2- 172.21.15.84:0/3003397197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd153bb0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7feb88007a60 tx=0x7feb88021000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 -- 172.21.15.84:0/3003397197 shutdown_connections 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 --2- 172.21.15.84:0/3003397197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 --2- 172.21.15.84:0/3003397197 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd1593a0 0x5639cd1ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 --2- 172.21.15.84:0/3003397197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd15aaf0 0x5639cd153bb0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 -- 172.21.15.84:0/3003397197 >> 172.21.15.84:0/3003397197 conn(0x5639cd158f60 msgr2=0x5639cd1a0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 -- 172.21.15.84:0/3003397197 shutdown_connections 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 -- 172.21.15.84:0/3003397197 wait complete. 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.326+0000 7feba49b9b80 1 -- start start 2023-10-06T03:01:09.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feba49b9b80 1 Processor -- start 2023-10-06T03:01:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd1593a0 0x5639cd1eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd15aaf0 0x5639cd17bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feba49b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd17c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feba49b9b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639cd17edc0 con 0x5639cd1593a0 2023-10-06T03:01:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feba49b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639cd177440 con 0x5639cd178f30 2023-10-06T03:01:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feba49b9b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639cd1eaf60 con 0x5639cd15aaf0 2023-10-06T03:01:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feba49b9b80 10 client.0 _ll_register_callbacks cb 0x5639cd11b100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feb9945d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd1593a0 0x5639cd1eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feb9945d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd1593a0 0x5639cd1eaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60114/0 (socket says 172.21.15.84:60114) 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.327+0000 7feb9945d700 1 -- 172.21.15.84:0/1399259149 learned_addr learned my addr 172.21.15.84:0/1399259149 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb99c5e700 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd17c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb98c5c700 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd15aaf0 0x5639cd17bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb9945d700 1 -- 172.21.15.84:0/1399259149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd15aaf0 msgr2=0x5639cd17bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb9945d700 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd15aaf0 0x5639cd17bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb9945d700 1 -- 172.21.15.84:0/1399259149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 msgr2=0x5639cd17c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb9945d700 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd17c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb9945d700 1 -- 172.21.15.84:0/1399259149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639ccee50c0 con 0x5639cd1593a0 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb9945d700 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd1593a0 0x5639cd1eaa20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a700 tx=0x7feb8c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb8af2fcd08e820 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb737fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb737fe700 1 -- 172.21.15.84:0/1399259149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0070d0 con 0x5639cd1593a0 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb737fe700 1 -- 172.21.15.84:0/1399259149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7feb8c004bb0 con 0x5639cd1593a0 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feba49b9b80 1 -- 172.21.15.84:0/1399259149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb8405c710 con 0x5639cd1593a0 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb737fe700 1 -- 172.21.15.84:0/1399259149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb8c028440 con 0x5639cd1593a0 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feba49b9b80 10 client.8091 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feba49b9b80 1 -- 172.21.15.84:0/1399259149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x5639cd05d550 con 0x5639cd1593a0 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb737fe700 1 -- 172.21.15.84:0/1399259149 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8405c710 con 0x5639cd1593a0 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feb737fe700 1 -- 172.21.15.84:0/1399259149 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7feb8c03b070 con 0x5639cd1593a0 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feba49b9b80 10 client.8091 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feba49b9b80 10 client.8091 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feba49b9b80 20 client.8091 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5639cd17b1b0 0x5639cd17dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feba49b9b80 4 client.8091 mds_command: new command op to 7716 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.328+0000 7feba49b9b80 1 -- 172.21.15.84:0/1399259149 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x5639cd04aee0 con 0x5639cd17b1b0 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.329+0000 7feb98c5c700 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5639cd17b1b0 0x5639cd17dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.329+0000 7feb737fe700 10 client.8091 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.329+0000 7feb98c5c700 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5639cd17b1b0 0x5639cd17dcb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8c0f14be34312cb server_cookie=709d6ca91c1fee8 in_seq=0 out_seq=0 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.329+0000 7feb737fe700 1 -- 172.21.15.84:0/1399259149 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5639cd04aee0 con 0x5639cd17b1b0 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.329+0000 7feb737fe700 10 client.8091 handle_command_reply: tid=0 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.329+0000 7feba49b9b80 1 client.8091 shutdown 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 -- 172.21.15.84:0/1399259149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd1593a0 msgr2=0x5639cd1eaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd1593a0 0x5639cd1eaa20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a700 tx=0x7feb8c013000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 -- 172.21.15.84:0/1399259149 shutdown_connections 2023-10-06T03:01:09.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5639cd17b1b0 0x5639cd17dcb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639cd178f30 0x5639cd17c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feb737fe700 0 client.8091 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639cd1593a0 0x5639cd1eaa20 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 --2- 172.21.15.84:0/1399259149 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639cd15aaf0 0x5639cd17bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 -- 172.21.15.84:0/1399259149 >> 172.21.15.84:0/1399259149 conn(0x5639cd158f60 msgr2=0x5639cd1ad5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.338 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:01:09.330+0000 7fd4e83f4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-10-06T03:00:50.610576+0000 1=0+1) n(v3 rc2023-10-06T03:00:50.840572+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={6368=pAsLsXsFsx/pAsLsXsFsx@5},l=6368 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x556da0e95700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.610576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.840572+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.610576+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-10-06T03:00:50.840572+0000 6=0+6)","error_str":""},"return_code":-61} 2023-10-06T03:01:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 -- 172.21.15.84:0/1399259149 shutdown_connections 2023-10-06T03:01:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 1 -- 172.21.15.84:0/1399259149 wait complete. 2023-10-06T03:01:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feba49b9b80 20 client.8091 trim_cache size 0 max 16384 2023-10-06T03:01:09.339 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:09.339 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2023-10-06T03:01:09.340 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "ea81fb44-d37d-452e-9e53-a92144a2920c", 2023-10-06T03:01:09.340 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2023-10-06T03:01:09.340 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:09.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feb9a45f700 1 -- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb80066f30 msgr2=0x7feb800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feb9a45f700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb80066f30 0x7feb800693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feb940ca490 tx=0x7feb8c015000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feb9a45f700 1 -- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb9415ab60 msgr2=0x7feb9415afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feb9a45f700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb9415ab60 0x7feb9415afe0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7feb94069150 tx=0x7feb84008040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.330+0000 7feb9a45f700 1 -- 172.21.15.84:0/679838198 shutdown_connections 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.331+0000 7feb9a45f700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7feb80066f30 0x7feb800693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.331+0000 7feb9a45f700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb7c003a90 0x7feb940b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.331+0000 7feb9a45f700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb9415ab60 0x7feb9415afe0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.331+0000 7feb9a45f700 1 --2- 172.21.15.84:0/679838198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb94150e90 0x7feb940b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.331+0000 7feb9a45f700 1 -- 172.21.15.84:0/679838198 >> 172.21.15.84:0/679838198 conn(0x7feb94068100 msgr2=0x7feb94158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.331+0000 7feb9a45f700 1 -- 172.21.15.84:0/679838198 shutdown_connections 2023-10-06T03:01:09.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.331+0000 7feb9a45f700 1 -- 172.21.15.84:0/679838198 wait complete. 2023-10-06T03:01:09.342 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:01:09.331+0000 7fd4ee400700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-10-06T03:00:50.611576+0000 1=0+1) n(v4 rc2023-10-06T03:00:50.840572+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={6368=pAsLsXsFs/pAsLsXsFsx@9} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x556da0f4e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.611576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.840572+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.611576+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-10-06T03:00:50.840572+0000 5=0+5)","error_str":""},"return_code":-61} 2023-10-06T03:01:09.342 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-10-06T03:01:09.330+0000 7f4b61173700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1) n(v2 rc2023-10-06T03:00:50.840572+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={6368=pAsLsXsFsx/pAsLsXsFsx@4},l=6368 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55b919e08680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.840572+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-10-06T03:00:50.840572+0000 4=0+4)","error_str":""},"return_code":-61} 2023-10-06T03:01:09.343 INFO:tasks.ceph.mds.d.smithi131.stderr:2023-10-06T03:01:09.331+0000 7fead8db1700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-10-06T03:00:50.613576+0000 1=0+1) n(v0 rc2023-10-06T03:00:50.613576+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={6368=pAsLsXsFsx/pAsLsXsFsx@4},l=6368 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55743e5d2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.613576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.613576+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.613576+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-10-06T03:00:50.613576+0000 2=0+2)","error_str":""},"return_code":-61} 2023-10-06T03:01:09.343 INFO:tasks.ceph.mds.d.smithi131.stderr:2023-10-06T03:01:09.331+0000 7fead8db1700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={6368=pAsLsXsFsx/AsLsXsFsx@2},l=6368 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55743e5d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-10-06T03:01:09.343 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-10-06T03:01:09.332+0000 7f4b6717f700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1) n(v1 rc2023-10-06T03:00:50.840572+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={6368=pAsLsXsFs/pAsLsXsFsx@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55b919e09700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.613576+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-06T03:00:50.840572+0000 3=0+3)","error_str":""},"return_code":-61} 2023-10-06T03:01:09.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub pause 2023-10-06T03:01:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.458+0000 7f93b2266700 1 Processor -- start 2023-10-06T03:01:09.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.458+0000 7f93b2266700 1 -- start start 2023-10-06T03:01:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.459+0000 7f93b2266700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f93ac0c6610 0x7f93ac0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.459+0000 7f93b2266700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0b2e60 con 0x7f93ac0b2a90 2023-10-06T03:01:09.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.459+0000 7f93b2266700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0cf5d0 con 0x7f93ac0cbb50 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.459+0000 7f93b2266700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0cf8b0 con 0x7f93ac0c6610 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.459+0000 7f93abfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f93ac0b2a90 0x7f93ac0cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37680/0 (socket says 172.21.15.84:37680) 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.459+0000 7f93abfff700 1 -- 172.21.15.84:0/829123693 learned_addr learned my addr 172.21.15.84:0/829123693 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93b0803700 1 --2- 172.21.15.84:0/829123693 >> v2:172.21.15.131:3300/0 conn(0x7f93ac0c6610 0x7f93ac0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363820037 0 0) 0x7f93ac0b2e60 con 0x7f93ac0b2a90 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9394003570 con 0x7f93ac0b2a90 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872733059 0 0) 0x7f9394003570 con 0x7f93ac0b2a90 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 >> v2:172.21.15.131:3300/0 conn(0x7f93ac0c6610 msgr2=0x7f93ac0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 --2- 172.21.15.84:0/829123693 >> v2:172.21.15.131:3300/0 conn(0x7f93ac0c6610 0x7f93ac0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 >> v1:172.21.15.131:6789/0 conn(0x7f93ac0cbb50 legacy=0x7f93ac0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0cfb90 con 0x7f93ac0b2a90 2023-10-06T03:01:09.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f939c0015f0 con 0x7f93ac0b2a90 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 >> v1:172.21.15.84:6789/0 conn(0x7f93ac0b2a90 legacy=0x7f93ac0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9394003a60 0x7f9394003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9394004810 0x7f9394004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f939400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0cf8b0 con 0x7f93940053c0 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939400c2d0 con 0x7f9394003a60 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939400c490 con 0x7f9394004810 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93b0803700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f939400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93abfff700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9394003a60 0x7f9394003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9394004810 0x7f9394004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93b0803700 1 -- 172.21.15.84:0/829123693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9394004810 msgr2=0x7f9394004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93b0803700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9394004810 0x7f9394004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93b0803700 1 -- 172.21.15.84:0/829123693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9394003a60 msgr2=0x7f9394003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93b0803700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9394003a60 0x7f9394003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93b0803700 1 -- 172.21.15.84:0/829123693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9394003570 con 0x7f93940053c0 2023-10-06T03:01:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9394004810 0x7f9394004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93b0803700 1 -- 172.21.15.84:0/829123693 reap_dead start 2023-10-06T03:01:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.460+0000 7f93b0803700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f939400ba60 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007440 tx=0x7f93a4009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952a247baedc6465 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4009a40 con 0x7f93940053c0 2023-10-06T03:01:09.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4007cf0 con 0x7f93940053c0 2023-10-06T03:01:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93aaffd700 1 -- 172.21.15.84:0/829123693 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4014650 con 0x7f93940053c0 2023-10-06T03:01:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93b2266700 1 -- 172.21.15.84:0/829123693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 msgr2=0x7f939400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93b2266700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f939400ba60 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007440 tx=0x7f93a4009710 comp rx=0 tx=0).stop 2023-10-06T03:01:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93b2266700 1 -- 172.21.15.84:0/829123693 shutdown_connections 2023-10-06T03:01:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93b2266700 1 --2- 172.21.15.84:0/829123693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f939400ba60 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93b2266700 1 -- 172.21.15.84:0/829123693 >> 172.21.15.84:0/829123693 conn(0x7f93ac099740 msgr2=0x7f93ac06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93b2266700 1 -- 172.21.15.84:0/829123693 shutdown_connections 2023-10-06T03:01:09.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.461+0000 7f93b2266700 1 -- 172.21.15.84:0/829123693 wait complete. 2023-10-06T03:01:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.463+0000 7f93b2266700 1 Processor -- start 2023-10-06T03:01:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.463+0000 7f93b2266700 1 -- start start 2023-10-06T03:01:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93b2266700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f93ac15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93b2266700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac0b4d60 0x7f93ac157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93b2266700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93ac158ca0 0x7f93ac159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93b2266700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0b51d0 con 0x7f93940053c0 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93b2266700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac159680 con 0x7f93ac0b4d60 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93b2266700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0b4b00 con 0x7f93ac158ca0 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f93ac15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f93ac15ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60128/0 (socket says 172.21.15.84:60128) 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93abfff700 1 -- 172.21.15.84:0/3458149421 learned_addr learned my addr 172.21.15.84:0/3458149421 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac0b4d60 0x7f93ac157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.464+0000 7f93b0803700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93ac158ca0 0x7f93ac159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f93abfff700 1 -- 172.21.15.84:0/3458149421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93ac158ca0 msgr2=0x7f93ac159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f93abfff700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93ac158ca0 0x7f93ac159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f93abfff700 1 -- 172.21.15.84:0/3458149421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac0b4d60 msgr2=0x7f93ac157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f93abfff700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac0b4d60 0x7f93ac157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f93abfff700 1 -- 172.21.15.84:0/3458149421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0b4820 con 0x7f93940053c0 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f93b0803700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93ac158ca0 0x7f93ac159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f93abfff700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f93ac15ea30 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f939c0012a0 tx=0x7f939c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f9393fff700 1 -- 172.21.15.84:0/3458149421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0073b0 con 0x7f93940053c0 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f9393fff700 1 -- 172.21.15.84:0/3458149421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c007510 con 0x7f93940053c0 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f93b2266700 1 -- 172.21.15.84:0/3458149421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac15df50 con 0x7f93940053c0 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f9393fff700 1 -- 172.21.15.84:0/3458149421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c005a40 con 0x7f93940053c0 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.465+0000 7f93b2266700 1 -- 172.21.15.84:0/3458149421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac15e510 con 0x7f93940053c0 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.466+0000 7f9393fff700 1 -- 172.21.15.84:0/3458149421 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f939c00d5e0 con 0x7f93940053c0 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.466+0000 7f9393fff700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9398066f30 0x7f93980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.467+0000 7f9393fff700 1 -- 172.21.15.84:0/3458149421 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f939c084980 con 0x7f93940053c0 2023-10-06T03:01:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.467+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9398066f30 0x7f93980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.467+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9398066f30 0x7f93980693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f93a0007fd0 tx=0x7f93a000c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.468+0000 7f93bb55eb80 1 Processor -- start 2023-10-06T03:01:09.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.468+0000 7f93bb55eb80 1 -- start start 2023-10-06T03:01:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.469+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b806699880 0x55b806699c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.469+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 0x55b8066e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.469+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8066e9c40 0x55b8066ea090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.469+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8065f0ab0 con 0x55b8066e9c40 2023-10-06T03:01:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.469+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8065ee2b0 con 0x55b806699880 2023-10-06T03:01:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.469+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8065ea0a0 con 0x55b80669ad00 2023-10-06T03:01:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.469+0000 7f93b0803700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8066e9c40 0x55b8066ea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.469+0000 7f93b0803700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8066e9c40 0x55b8066ea090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60132/0 (socket says 172.21.15.84:60132) 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.469+0000 7f93b0803700 1 -- 172.21.15.84:0/513282686 learned_addr learned my addr 172.21.15.84:0/513282686 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93abfff700 1 --2- 172.21.15.84:0/513282686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b806699880 0x55b806699c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/513282686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 0x55b8066e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93b0803700 1 -- 172.21.15.84:0/513282686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 msgr2=0x55b8066e9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93b0803700 1 --2- 172.21.15.84:0/513282686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 0x55b8066e9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93b0803700 1 -- 172.21.15.84:0/513282686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b806699880 msgr2=0x55b806699c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93b0803700 1 --2- 172.21.15.84:0/513282686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b806699880 0x55b806699c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93b0803700 1 -- 172.21.15.84:0/513282686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8064842b0 con 0x55b8066e9c40 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93b0803700 1 --2- 172.21.15.84:0/513282686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8066e9c40 0x55b8066ea090 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007a30 tx=0x7f93a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a74b860601c2b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93917fa700 1 -- 172.21.15.84:0/513282686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4009420 con 0x55b8066e9c40 2023-10-06T03:01:09.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93917fa700 1 -- 172.21.15.84:0/513282686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4007e60 con 0x55b8066e9c40 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.470+0000 7f93917fa700 1 -- 172.21.15.84:0/513282686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4014610 con 0x55b8066e9c40 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 -- 172.21.15.84:0/513282686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8066e9c40 msgr2=0x55b8066ea090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/513282686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8066e9c40 0x55b8066ea090 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007a30 tx=0x7f93a4017000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 -- 172.21.15.84:0/513282686 shutdown_connections 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/513282686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b806699880 0x55b806699c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/513282686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8066e9c40 0x55b8066ea090 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/513282686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 0x55b8066e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 -- 172.21.15.84:0/513282686 >> 172.21.15.84:0/513282686 conn(0x55b80669b1a0 msgr2=0x55b80669b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 -- 172.21.15.84:0/513282686 shutdown_connections 2023-10-06T03:01:09.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 -- 172.21.15.84:0/513282686 wait complete. 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.471+0000 7f93bb55eb80 1 -- start start 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93bb55eb80 1 Processor -- start 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066da880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 0x55b8066f0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 0x55b8066c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8065958d0 con 0x55b806699880 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8065b0ee0 con 0x55b80669ad00 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b80646ce70 con 0x55b8066e9c40 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93bb55eb80 10 client.0 _ll_register_callbacks cb 0x55b80665ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066da880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60144/0 (socket says 172.21.15.84:60144) 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93abfff700 1 -- 172.21.15.84:0/3337480501 learned_addr learned my addr 172.21.15.84:0/3337480501 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 0x55b8066f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.472+0000 7f93b0803700 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 0x55b8066c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93abfff700 1 -- 172.21.15.84:0/3337480501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 msgr2=0x55b8066c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93abfff700 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 0x55b8066c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93abfff700 1 -- 172.21.15.84:0/3337480501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 msgr2=0x55b8066f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93abfff700 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 0x55b8066f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93abfff700 1 -- 172.21.15.84:0/3337480501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9394003570 con 0x55b806699880 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93abfff700 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066da880 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f939c055270 tx=0x7f939c007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6ec0f350c0bda7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f938a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f938a7fc700 1 -- 172.21.15.84:0/3337480501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c055570 con 0x55b806699880 2023-10-06T03:01:09.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f938a7fc700 1 -- 172.21.15.84:0/3337480501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f939c0587c0 con 0x55b806699880 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93bb55eb80 1 -- 172.21.15.84:0/3337480501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b80668e980 con 0x55b806699880 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f938a7fc700 1 -- 172.21.15.84:0/3337480501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f939c05c510 con 0x55b806699880 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93bb55eb80 10 client.8103 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93bb55eb80 1 -- 172.21.15.84:0/3337480501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55b806427020 con 0x55b806699880 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f938a7fc700 1 -- 172.21.15.84:0/3337480501 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b80668e980 con 0x55b806699880 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f938a7fc700 1 -- 172.21.15.84:0/3337480501 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f939c054a60 con 0x55b806699880 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93bb55eb80 10 client.8103 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93bb55eb80 10 client.8103 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93bb55eb80 20 client.8103 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55b8066be8e0 0x55b8066becb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93bb55eb80 4 client.8103 mds_command: new command op to 7716 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93bb55eb80 1 -- 172.21.15.84:0/3337480501 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b80666b8b0 con 0x55b8066be8e0 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.473+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55b8066be8e0 0x55b8066becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f938a7fc700 10 client.8103 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55b8066be8e0 0x55b8066becb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d45cd0e2e1c115f server_cookie=4415f0bb6888937d in_seq=0 out_seq=0 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f938a7fc700 1 -- 172.21.15.84:0/3337480501 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b80666b8b0 con 0x55b8066be8e0 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f938a7fc700 10 client.8103 handle_command_reply: tid=0 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 client.8103 shutdown 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 -- 172.21.15.84:0/3337480501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 msgr2=0x55b8066da880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066da880 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f939c055270 tx=0x7f939c007920 comp rx=0 tx=0).stop 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 -- 172.21.15.84:0/3337480501 shutdown_connections 2023-10-06T03:01:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55b8066be8e0 0x55b8066becb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 0x55b8066c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f938a7fc700 0 client.8103 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066da880 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/3337480501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 0x55b8066f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 -- 172.21.15.84:0/3337480501 >> 172.21.15.84:0/3337480501 conn(0x55b80669b1a0 msgr2=0x55b8066c2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 -- 172.21.15.84:0/3337480501 shutdown_connections 2023-10-06T03:01:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.474+0000 7f93bb55eb80 1 -- 172.21.15.84:0/3337480501 wait complete. 2023-10-06T03:01:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.475+0000 7f93bb55eb80 20 client.8103 trim_cache size 0 max 16384 2023-10-06T03:01:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.490+0000 7f93bb55eb80 1 Processor -- start 2023-10-06T03:01:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.490+0000 7f93bb55eb80 1 -- start start 2023-10-06T03:01:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 0x55b806696730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8066e9c40 0x55b806696c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b80669d2f0 con 0x55b806699880 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b806694660 con 0x55b8066e9c40 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8066fb4c0 con 0x55b80669ad00 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60156/0 (socket says 172.21.15.84:60156) 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93abfff700 1 -- 172.21.15.84:0/2551341068 learned_addr learned my addr 172.21.15.84:0/2551341068 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/2551341068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 0x55b806696730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93b0803700 1 --2- 172.21.15.84:0/2551341068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8066e9c40 0x55b806696c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93abfff700 1 -- 172.21.15.84:0/2551341068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 msgr2=0x55b806696730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93abfff700 1 --2- 172.21.15.84:0/2551341068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 0x55b806696730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93abfff700 1 -- 172.21.15.84:0/2551341068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8066e9c40 msgr2=0x55b806696c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93abfff700 1 --2- 172.21.15.84:0/2551341068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8066e9c40 0x55b806696c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93abfff700 1 -- 172.21.15.84:0/2551341068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8065b87c0 con 0x55b806699880 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93abfff700 1 --2- 172.21.15.84:0/2551341068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066c5910 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f939c00d430 tx=0x7f939c06b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2582b2f2b984cb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f9391ffb700 1 -- 172.21.15.84:0/2551341068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c05c510 con 0x55b806699880 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f9391ffb700 1 -- 172.21.15.84:0/2551341068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c055cd0 con 0x55b806699880 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f9391ffb700 1 -- 172.21.15.84:0/2551341068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0518b0 con 0x55b806699880 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2551341068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 msgr2=0x55b8066c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2551341068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066c5910 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f939c00d430 tx=0x7f939c06b000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2551341068 shutdown_connections 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2551341068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8066e9c40 0x55b806696c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2551341068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b8066c5910 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2551341068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b80669ad00 0x55b806696730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2551341068 >> 172.21.15.84:0/2551341068 conn(0x55b80669b1a0 msgr2=0x55b8066da880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2551341068 shutdown_connections 2023-10-06T03:01:09.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.492+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2551341068 wait complete. 2023-10-06T03:01:09.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93bb55eb80 1 -- start start 2023-10-06T03:01:09.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93bb55eb80 1 Processor -- start 2023-10-06T03:01:09.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b806742ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 0x55b8066bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93bb55eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 0x55b8066bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8066e90b0 con 0x55b806699880 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8067466f0 con 0x55b80669ad00 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93bb55eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b806743410 con 0x55b8066e9c40 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93bb55eb80 10 client.0 _ll_register_callbacks cb 0x55b80665ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b806742ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93abfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b806742ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60158/0 (socket says 172.21.15.84:60158) 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.493+0000 7f93abfff700 1 -- 172.21.15.84:0/2966706465 learned_addr learned my addr 172.21.15.84:0/2966706465 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 0x55b8066bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93b0803700 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 0x55b8066bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93abfff700 1 -- 172.21.15.84:0/2966706465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 msgr2=0x55b8066bdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93abfff700 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 0x55b8066bdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93abfff700 1 -- 172.21.15.84:0/2966706465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 msgr2=0x55b8066bd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93abfff700 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 0x55b8066bd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93abfff700 1 -- 172.21.15.84:0/2966706465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939c06f020 con 0x55b806699880 2023-10-06T03:01:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 0x55b8066bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93abfff700 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b806742ed0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f939c001130 tx=0x7f939c082070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ea044149d32a07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f938a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f938a7fc700 1 -- 172.21.15.84:0/2966706465 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c007680 con 0x55b806699880 2023-10-06T03:01:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f938a7fc700 1 -- 172.21.15.84:0/2966706465 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f939c0587c0 con 0x55b806699880 2023-10-06T03:01:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2966706465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b80658ce40 con 0x55b806699880 2023-10-06T03:01:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f938a7fc700 1 -- 172.21.15.84:0/2966706465 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f939c0518b0 con 0x55b806699880 2023-10-06T03:01:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93bb55eb80 10 client.8109 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2966706465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55b80659f4b0 con 0x55b806699880 2023-10-06T03:01:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f938a7fc700 1 -- 172.21.15.84:0/2966706465 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b80658ce40 con 0x55b806699880 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f938a7fc700 1 -- 172.21.15.84:0/2966706465 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f939c005ba0 con 0x55b806699880 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93bb55eb80 10 client.8109 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93bb55eb80 10 client.8109 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93bb55eb80 20 client.8109 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55b8066dcd90 0x55b806745760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93bb55eb80 4 client.8109 mds_command: new command op to 7716 tid=0[{"prefix": "scrub pause"}] 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2966706465 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x55b80658cb60 con 0x55b8066dcd90 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.494+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55b8066dcd90 0x55b806745760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f938a7fc700 10 client.8109 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93ab7fe700 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55b8066dcd90 0x55b806745760 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f4e3d55d666cd server_cookie=dee5340b37e662f3 in_seq=0 out_seq=0 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f938a7fc700 1 -- 172.21.15.84:0/2966706465 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55b80658cb60 con 0x55b8066dcd90 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f938a7fc700 10 client.8109 handle_command_reply: tid=0 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 client.8109 shutdown 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2966706465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 msgr2=0x55b806742ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b806742ed0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f939c001130 tx=0x7f939c082070 comp rx=0 tx=0).stop 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2966706465 shutdown_connections 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55b8066dcd90 0x55b806745760 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55b8066e9c40 0x55b8066bdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f938a7fc700 0 client.8109 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b806699880 0x55b806742ed0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 --2- 172.21.15.84:0/2966706465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b80669ad00 0x55b8066bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2966706465 >> 172.21.15.84:0/2966706465 conn(0x55b80669b1a0 msgr2=0x55b8066c2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2966706465 shutdown_connections 2023-10-06T03:01:09.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 1 -- 172.21.15.84:0/2966706465 wait complete. 2023-10-06T03:01:09.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.495+0000 7f93bb55eb80 20 client.8109 trim_cache size 0 max 16384 2023-10-06T03:01:09.506 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:09.506 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:01:09.506 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:09.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 -- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9398066f30 msgr2=0x7f93980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9398066f30 0x7f93980693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f93a0007fd0 tx=0x7f93a000c040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 -- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 msgr2=0x7f93ac15ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f93ac15ea30 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f939c0012a0 tx=0x7f939c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 -- 172.21.15.84:0/3458149421 shutdown_connections 2023-10-06T03:01:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9398066f30 0x7f93980693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93ac158ca0 0x7f93ac159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93940053c0 0x7f93ac15ea30 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 --2- 172.21.15.84:0/3458149421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ac0b4d60 0x7f93ac157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 -- 172.21.15.84:0/3458149421 >> 172.21.15.84:0/3458149421 conn(0x7f93ac099740 msgr2=0x7f93ac0b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 -- 172.21.15.84:0/3458149421 shutdown_connections 2023-10-06T03:01:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.496+0000 7f93b2266700 1 -- 172.21.15.84:0/3458149421 wait complete. 2023-10-06T03:01:09.509 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 scrub status 2023-10-06T03:01:09.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.623+0000 7f7e98e44700 1 Processor -- start 2023-10-06T03:01:09.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.623+0000 7f7e98e44700 1 -- start start 2023-10-06T03:01:09.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 0x7f7e940ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e940c6610 0x7f7e940ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940b2e60 con 0x7f7e940b2a90 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e940cf5d0 con 0x7f7e940c6610 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940cf8b0 con 0x7f7e940cbb50 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e92d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e940c6610 0x7f7e940ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e92d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e940c6610 0x7f7e940ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60164/0 (socket says 172.21.15.84:60164) 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e92d9d700 1 -- 172.21.15.84:0/310903114 learned_addr learned my addr 172.21.15.84:0/310903114 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/310903114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 0x7f7e940ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e92d9d700 1 -- 172.21.15.84:0/310903114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 msgr2=0x7f7e940ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/310903114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 0x7f7e940ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e92d9d700 1 -- 172.21.15.84:0/310903114 >> v1:172.21.15.131:6789/0 conn(0x7f7e940b2a90 legacy=0x7f7e940cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e92d9d700 1 -- 172.21.15.84:0/310903114 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940cfb90 con 0x7f7e940c6610 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/310903114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 0x7f7e940ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/310903114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940c6610 0x7f7e940ced90 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009f20 tx=0x7f7e8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ab8e793581c4cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e91d9b700 1 -- 172.21.15.84:0/310903114 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00e070 con 0x7f7e940c6610 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e91d9b700 1 -- 172.21.15.84:0/310903114 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00ba40 con 0x7f7e940c6610 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e91d9b700 1 -- 172.21.15.84:0/310903114 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0092e0 con 0x7f7e940c6610 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 -- 172.21.15.84:0/310903114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940c6610 msgr2=0x7f7e940ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 --2- 172.21.15.84:0/310903114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940c6610 0x7f7e940ced90 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009f20 tx=0x7f7e8c009840 comp rx=0 tx=0).stop 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 -- 172.21.15.84:0/310903114 shutdown_connections 2023-10-06T03:01:09.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 --2- 172.21.15.84:0/310903114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940c6610 0x7f7e940ced90 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 --2- 172.21.15.84:0/310903114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 0x7f7e940ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 -- 172.21.15.84:0/310903114 >> 172.21.15.84:0/310903114 conn(0x7f7e94099740 msgr2=0x7f7e9406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 -- 172.21.15.84:0/310903114 shutdown_connections 2023-10-06T03:01:09.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.625+0000 7f7e98e44700 1 -- 172.21.15.84:0/310903114 wait complete. 2023-10-06T03:01:09.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e98e44700 1 Processor -- start 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e98e44700 1 -- start start 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e98e44700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940b2a90 0x7f7e9414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e98e44700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e940c6610 0x7f7e94169650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e98e44700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 0x7f7e940d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e98e44700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9409aef0 con 0x7f7e940b2a90 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e98e44700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9409a2e0 con 0x7f7e940c6610 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e98e44700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9409a5c0 con 0x7f7e940cbb50 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e9259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940b2a90 0x7f7e9414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.627+0000 7f7e9259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940b2a90 0x7f7e9414ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60174/0 (socket says 172.21.15.84:60174) 2023-10-06T03:01:09.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e9259c700 1 -- 172.21.15.84:0/1771590798 learned_addr learned my addr 172.21.15.84:0/1771590798 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e940c6610 0x7f7e94169650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 0x7f7e940d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e9259c700 1 -- 172.21.15.84:0/1771590798 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 msgr2=0x7f7e940d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e9259c700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 0x7f7e940d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e9259c700 1 -- 172.21.15.84:0/1771590798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e940c6610 msgr2=0x7f7e94169650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e9259c700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e940c6610 0x7f7e94169650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e9259c700 1 -- 172.21.15.84:0/1771590798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009ae0 con 0x7f7e940b2a90 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e9259c700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940b2a90 0x7f7e9414ae90 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c5b0 tx=0x7f7e840020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e8affd700 1 -- 172.21.15.84:0/1771590798 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84011590 con 0x7f7e940b2a90 2023-10-06T03:01:09.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e8affd700 1 -- 172.21.15.84:0/1771590798 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e840116f0 con 0x7f7e940b2a90 2023-10-06T03:01:09.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e98e44700 1 -- 172.21.15.84:0/1771590798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9409a8a0 con 0x7f7e940b2a90 2023-10-06T03:01:09.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e8affd700 1 -- 172.21.15.84:0/1771590798 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84011a90 con 0x7f7e940b2a90 2023-10-06T03:01:09.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.628+0000 7f7e98e44700 1 -- 172.21.15.84:0/1771590798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9414b3d0 con 0x7f7e940b2a90 2023-10-06T03:01:09.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.630+0000 7f7e8affd700 1 -- 172.21.15.84:0/1771590798 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e8401c460 con 0x7f7e940b2a90 2023-10-06T03:01:09.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.630+0000 7f7e8affd700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7e74066f30 0x7f7e740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.630+0000 7f7e8affd700 1 -- 172.21.15.84:0/1771590798 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7e84084470 con 0x7f7e940b2a90 2023-10-06T03:01:09.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.630+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7e74066f30 0x7f7e740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.631+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7e74066f30 0x7f7e740693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c006fd0 tx=0x7f7e7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.632+0000 7f7ea213cb80 1 Processor -- start 2023-10-06T03:01:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.632+0000 7f7ea213cb80 1 -- start start 2023-10-06T03:01:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 0x564292f8bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292f8cd10 0x564292fdb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292fdbc50 0x564292fdc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564292ee2ac0 con 0x564292fdbc50 2023-10-06T03:01:09.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564292ee02c0 con 0x564292f8cd10 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564292edc0b0 con 0x564292f8b890 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e92d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292fdbc50 0x564292fdc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e92d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292fdbc50 0x564292fdc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60182/0 (socket says 172.21.15.84:60182) 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e92d9d700 1 -- 172.21.15.84:0/3745835348 learned_addr learned my addr 172.21.15.84:0/3745835348 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/3745835348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292f8cd10 0x564292fdb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e9259c700 1 --2- 172.21.15.84:0/3745835348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 0x564292f8bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e92d9d700 1 -- 172.21.15.84:0/3745835348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 msgr2=0x564292f8bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/3745835348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 0x564292f8bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e92d9d700 1 -- 172.21.15.84:0/3745835348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292f8cd10 msgr2=0x564292fdb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/3745835348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292f8cd10 0x564292fdb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e92d9d700 1 -- 172.21.15.84:0/3745835348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564292d762c0 con 0x564292fdbc50 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.633+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/3745835348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292fdbc50 0x564292fdc0a0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00b6c0 tx=0x7f7e8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41239f708ee3f16f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7e737fe700 1 -- 172.21.15.84:0/3745835348 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00bc30 con 0x564292fdbc50 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7e737fe700 1 -- 172.21.15.84:0/3745835348 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00bd90 con 0x564292fdbc50 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7e737fe700 1 -- 172.21.15.84:0/3745835348 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c012850 con 0x564292fdbc50 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7ea213cb80 1 -- 172.21.15.84:0/3745835348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292fdbc50 msgr2=0x564292fdc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/3745835348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292fdbc50 0x564292fdc0a0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00b6c0 tx=0x7f7e8c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7ea213cb80 1 -- 172.21.15.84:0/3745835348 shutdown_connections 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/3745835348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292fdbc50 0x564292fdc0a0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/3745835348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 0x564292f8bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/3745835348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292f8cd10 0x564292fdb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7ea213cb80 1 -- 172.21.15.84:0/3745835348 >> 172.21.15.84:0/3745835348 conn(0x564292f8d1b0 msgr2=0x564292f8d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7ea213cb80 1 -- 172.21.15.84:0/3745835348 shutdown_connections 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.634+0000 7f7ea213cb80 1 -- 172.21.15.84:0/3745835348 wait complete. 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.635+0000 7f7ea213cb80 1 -- start start 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.635+0000 7f7ea213cb80 1 Processor -- start 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 0x564292fe54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8cd10 0x564292fe59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564292fca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564292e878e0 con 0x564292f8cd10 2023-10-06T03:01:09.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564292ea2ef0 con 0x564292fdbc50 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564292d5ee80 con 0x564292f8b890 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 10 client.0 _ll_register_callbacks cb 0x564292f4eec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e89d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8cd10 0x564292fe59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e89d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8cd10 0x564292fe59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60186/0 (socket says 172.21.15.84:60186) 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e89d9b700 1 -- 172.21.15.84:0/632158849 learned_addr learned my addr 172.21.15.84:0/632158849 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564292fca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e9259c700 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 0x564292fe54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e89d9b700 1 -- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 msgr2=0x564292fe54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 0x564292fe54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e89d9b700 1 -- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 msgr2=0x564292fca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564292fca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e89d9b700 1 -- 172.21.15.84:0/632158849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e940cfb90 con 0x564292f8cd10 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e9259c700 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 0x564292fe54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8cd10 0x564292fe59e0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00f8b0 tx=0x7f7e7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a127f0618590132e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e70ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e70ff9700 1 -- 172.21.15.84:0/632158849 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c013630 con 0x564292f8cd10 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e70ff9700 1 -- 172.21.15.84:0/632158849 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7e7c01a040 con 0x564292f8cd10 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 -- 172.21.15.84:0/632158849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564292f80990 con 0x564292f8cd10 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e70ff9700 1 -- 172.21.15.84:0/632158849 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e7c0139a0 con 0x564292f8cd10 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 10 client.8121 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 -- 172.21.15.84:0/632158849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x564292d19030 con 0x564292f8cd10 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e70ff9700 1 -- 172.21.15.84:0/632158849 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564292f80990 con 0x564292f8cd10 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e70ff9700 1 -- 172.21.15.84:0/632158849 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f7e7c013b00 con 0x564292f8cd10 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 10 client.8121 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 10 client.8121 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 20 client.8121 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x564292fb1580 0x564292fcafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 4 client.8121 mds_command: new command op to 6802 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7ea213cb80 1 -- 172.21.15.84:0/632158849 --> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564292f5d8c0 con 0x564292fb1580 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.637+0000 7f7e9259c700 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x564292fb1580 0x564292fcafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7e70ff9700 10 client.8121 ms_handle_connect on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7e9259c700 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x564292fb1580 0x564292fcafd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18ce1d54a49754ab server_cookie=1053a6c00682c5e6 in_seq=0 out_seq=0 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7e70ff9700 1 -- 172.21.15.84:0/632158849 <== mds.1 v2:172.21.15.131:6833/2772432276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564292f5d8c0 con 0x564292fb1580 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7e70ff9700 10 client.8121 handle_command_reply: tid=0 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 client.8121 shutdown 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 -- 172.21.15.84:0/632158849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8cd10 msgr2=0x564292fe59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8cd10 0x564292fe59e0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00f8b0 tx=0x7f7e7c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 -- 172.21.15.84:0/632158849 shutdown_connections 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x564292fb1580 0x564292fcafd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564292fca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7e70ff9700 0 client.8121 ms_handle_reset on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8b890 0x564292fe54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/632158849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8cd10 0x564292fe59e0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 -- 172.21.15.84:0/632158849 >> 172.21.15.84:0/632158849 conn(0x564292f8d1b0 msgr2=0x564292fb4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 -- 172.21.15.84:0/632158849 shutdown_connections 2023-10-06T03:01:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.638+0000 7f7ea213cb80 1 -- 172.21.15.84:0/632158849 wait complete. 2023-10-06T03:01:09.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.639+0000 7f7ea213cb80 20 client.8121 trim_cache size 0 max 16384 2023-10-06T03:01:09.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.654+0000 7f7ea213cb80 1 Processor -- start 2023-10-06T03:01:09.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7ea213cb80 1 -- start start 2023-10-06T03:01:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292fcf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8cd10 0x564292fe5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564292fe5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564292f64230 con 0x564292f8b890 2023-10-06T03:01:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564292fcd010 con 0x564292fdbc50 2023-10-06T03:01:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564292fcb070 con 0x564292f8cd10 2023-10-06T03:01:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7e9259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292fcf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7e9259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292fcf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60190/0 (socket says 172.21.15.84:60190) 2023-10-06T03:01:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7e9259c700 1 -- 172.21.15.84:0/1047647984 learned_addr learned my addr 172.21.15.84:0/1047647984 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7e9259c700 1 -- 172.21.15.84:0/1047647984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8cd10 msgr2=0x564292fe5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7e9259c700 1 --2- 172.21.15.84:0/1047647984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8cd10 0x564292fe5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7e9259c700 1 -- 172.21.15.84:0/1047647984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 msgr2=0x564292fe5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.655+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/1047647984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564292fe5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7e9259c700 1 --2- 172.21.15.84:0/1047647984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564292fe5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7e9259c700 1 -- 172.21.15.84:0/1047647984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564292eaa7d0 con 0x564292f8b890 2023-10-06T03:01:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/1047647984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564292fe5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7e9259c700 1 --2- 172.21.15.84:0/1047647984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292fcf990 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f7e840582c0 tx=0x7f7e8401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757124425844436f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7e73fff700 1 -- 172.21.15.84:0/1047647984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840583d0 con 0x564292f8b890 2023-10-06T03:01:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7e73fff700 1 -- 172.21.15.84:0/1047647984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8405c0a0 con 0x564292f8b890 2023-10-06T03:01:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7e73fff700 1 -- 172.21.15.84:0/1047647984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84011e80 con 0x564292f8b890 2023-10-06T03:01:09.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1047647984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 msgr2=0x564292fcf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1047647984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292fcf990 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f7e840582c0 tx=0x7f7e8401e040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1047647984 shutdown_connections 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1047647984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564292fe5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1047647984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292fcf990 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1047647984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8cd10 0x564292fe5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1047647984 >> 172.21.15.84:0/1047647984 conn(0x564292f8d1b0 msgr2=0x564292fd5690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1047647984 shutdown_connections 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.656+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1047647984 wait complete. 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.657+0000 7f7ea213cb80 1 -- start start 2023-10-06T03:01:09.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.657+0000 7f7ea213cb80 1 Processor -- start 2023-10-06T03:01:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292f87950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8cd10 0x564292fc8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7ea213cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564293021860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564293021da0 con 0x564292f8b890 2023-10-06T03:01:09.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564292fe1480 con 0x564292fdbc50 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7ea213cb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564292fbb410 con 0x564292f8cd10 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7ea213cb80 10 client.0 _ll_register_callbacks cb 0x564292fd1100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e9259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292f87950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e9259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292f87950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60198/0 (socket says 172.21.15.84:60198) 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e9259c700 1 -- 172.21.15.84:0/1553876419 learned_addr learned my addr 172.21.15.84:0/1553876419 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564293021860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8cd10 0x564292fc8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e9259c700 1 -- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8cd10 msgr2=0x564292fc8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e9259c700 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8cd10 0x564292fc8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e9259c700 1 -- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 msgr2=0x564293021860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e9259c700 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564293021860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e9259c700 1 -- 172.21.15.84:0/1553876419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9414b3d0 con 0x564292f8b890 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e92d9d700 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564293021860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e9259c700 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292f87950 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f7e840582c0 tx=0x7f7e8406c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189c21e08278074a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.658+0000 7f7e70ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7e70ff9700 1 -- 172.21.15.84:0/1553876419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400f470 con 0x564292f8b890 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7e70ff9700 1 -- 172.21.15.84:0/1553876419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7e84082310 con 0x564292f8b890 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1553876419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e8c00bd90 con 0x564292f8b890 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7e70ff9700 1 -- 172.21.15.84:0/1553876419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e840824d0 con 0x564292f8b890 2023-10-06T03:01:09.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7ea213cb80 10 client.8127 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1553876419 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x564292e914c0 con 0x564292f8b890 2023-10-06T03:01:09.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7e70ff9700 1 -- 172.21.15.84:0/1553876419 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00bd90 con 0x564292f8b890 2023-10-06T03:01:09.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7e70ff9700 1 -- 172.21.15.84:0/1553876419 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f7e840545f0 con 0x564292f8b890 2023-10-06T03:01:09.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7ea213cb80 10 client.8127 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7ea213cb80 10 client.8127 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-10-06T03:01:09.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7ea213cb80 20 client.8127 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x564292fbad80 0x564292fe0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7ea213cb80 4 client.8127 mds_command: new command op to 6802 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:01:09.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1553876419 --> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564292e7ee50 con 0x564292fbad80 2023-10-06T03:01:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.659+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x564292fbad80 0x564292fe0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7e70ff9700 10 client.8127 ms_handle_connect on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7e89d9b700 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x564292fbad80 0x564292fe0680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92b2ad0a5634c68e server_cookie=3ae359dfdcb65a74 in_seq=0 out_seq=0 2023-10-06T03:01:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7e70ff9700 1 -- 172.21.15.84:0/1553876419 <== mds.1 v2:172.21.15.131:6833/2772432276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x564292e7ee50 con 0x564292fbad80 2023-10-06T03:01:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7e70ff9700 10 client.8127 handle_command_reply: tid=0 2023-10-06T03:01:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 client.8127 shutdown 2023-10-06T03:01:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1553876419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 msgr2=0x564292f87950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292f87950 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f7e840582c0 tx=0x7f7e8406c000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1553876419 shutdown_connections 2023-10-06T03:01:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x564292fbad80 0x564292fe0680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564292fdbc50 0x564293021860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7e70ff9700 0 client.8127 ms_handle_reset on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564292f8b890 0x564292f87950 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 --2- 172.21.15.84:0/1553876419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564292f8cd10 0x564292fc8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1553876419 >> 172.21.15.84:0/1553876419 conn(0x564292f8d1b0 msgr2=0x564292fcd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1553876419 shutdown_connections 2023-10-06T03:01:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 1 -- 172.21.15.84:0/1553876419 wait complete. 2023-10-06T03:01:09.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7ea213cb80 20 client.8127 trim_cache size 0 max 16384 2023-10-06T03:01:09.671 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:09.671 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:01:09.671 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:01:09.671 INFO:teuthology.orchestra.run.smithi084.stdout: "ea81fb44-d37d-452e-9e53-a92144a2920c": { 2023-10-06T03:01:09.671 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:01:09.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "ea81fb44-d37d-452e-9e53-a92144a2920c", 2023-10-06T03:01:09.671 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:01:09.671 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:09.671 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:09.672 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:09.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7e98e44700 1 -- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7e74066f30 msgr2=0x7f7e740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7e98e44700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7e74066f30 0x7f7e740693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c006fd0 tx=0x7f7e7c008040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7e98e44700 1 -- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940b2a90 msgr2=0x7f7e9414ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.660+0000 7f7e98e44700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940b2a90 0x7f7e9414ae90 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c5b0 tx=0x7f7e840020e0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.661+0000 7f7e98e44700 1 -- 172.21.15.84:0/1771590798 shutdown_connections 2023-10-06T03:01:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.661+0000 7f7e98e44700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7e74066f30 0x7f7e740693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.661+0000 7f7e98e44700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7e940cbb50 0x7f7e940d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.661+0000 7f7e98e44700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e940b2a90 0x7f7e9414ae90 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.661+0000 7f7e98e44700 1 --2- 172.21.15.84:0/1771590798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e940c6610 0x7f7e94169650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.661+0000 7f7e98e44700 1 -- 172.21.15.84:0/1771590798 >> 172.21.15.84:0/1771590798 conn(0x7f7e94099740 msgr2=0x7f7e940ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.661+0000 7f7e98e44700 1 -- 172.21.15.84:0/1771590798 shutdown_connections 2023-10-06T03:01:09.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.661+0000 7f7e98e44700 1 -- 172.21.15.84:0/1771590798 wait complete. 2023-10-06T03:01:09.675 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:01:09.675 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 scrub status 2023-10-06T03:01:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.789+0000 7f7a73fff700 1 Processor -- start 2023-10-06T03:01:09.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.789+0000 7f7a73fff700 1 -- start start 2023-10-06T03:01:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a73fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7a740b2660 0x7f7a740cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a73fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a740b2a30 0x7f7a740cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a73fff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a740cc9b0 con 0x7f7a740ceae0 2023-10-06T03:01:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a73fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740cbda0 con 0x7f7a740b2a30 2023-10-06T03:01:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a73fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740cc080 con 0x7f7a740b2660 2023-10-06T03:01:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a737fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7a740ceae0 0x7f7a740cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37690/0 (socket says 172.21.15.84:37690) 2023-10-06T03:01:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a727fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7a740b2a30 0x7f7a740cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a737fe700 1 -- 172.21.15.84:0/1478560363 learned_addr learned my addr 172.21.15.84:0/1478560363 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/1478560363 >> v2:172.21.15.131:3300/0 conn(0x7f7a740b2660 0x7f7a740cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a727fc700 1 -- 172.21.15.84:0/1478560363 >> v2:172.21.15.131:3300/0 conn(0x7f7a740b2660 msgr2=0x7f7a740cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a727fc700 1 --2- 172.21.15.84:0/1478560363 >> v2:172.21.15.131:3300/0 conn(0x7f7a740b2660 0x7f7a740cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a727fc700 1 -- 172.21.15.84:0/1478560363 >> v1:172.21.15.84:6789/0 conn(0x7f7a740ceae0 legacy=0x7f7a740cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.790+0000 7f7a727fc700 1 -- 172.21.15.84:0/1478560363 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a740cc360 con 0x7f7a740b2a30 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a727fc700 1 --2- 172.21.15.84:0/1478560363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 0x7f7a740cd230 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f7a74089500 tx=0x7f7a5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f838af3b4211ea73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a71ffb700 1 -- 172.21.15.84:0/1478560363 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00b6b0 con 0x7f7a740b2a30 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a71ffb700 1 -- 172.21.15.84:0/1478560363 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c00b810 con 0x7f7a740b2a30 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a71ffb700 1 -- 172.21.15.84:0/1478560363 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00bbb0 con 0x7f7a740b2a30 2023-10-06T03:01:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a73fff700 1 -- 172.21.15.84:0/1478560363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 msgr2=0x7f7a740cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a73fff700 1 --2- 172.21.15.84:0/1478560363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 0x7f7a740cd230 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f7a74089500 tx=0x7f7a5c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a73fff700 1 -- 172.21.15.84:0/1478560363 shutdown_connections 2023-10-06T03:01:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a73fff700 1 --2- 172.21.15.84:0/1478560363 >> v2:172.21.15.131:3300/0 conn(0x7f7a740b2660 0x7f7a740cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a73fff700 1 --2- 172.21.15.84:0/1478560363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 0x7f7a740cd230 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a73fff700 1 -- 172.21.15.84:0/1478560363 >> 172.21.15.84:0/1478560363 conn(0x7f7a74099560 msgr2=0x7f7a7406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a73fff700 1 -- 172.21.15.84:0/1478560363 shutdown_connections 2023-10-06T03:01:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.791+0000 7f7a73fff700 1 -- 172.21.15.84:0/1478560363 wait complete. 2023-10-06T03:01:09.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a73fff700 1 Processor -- start 2023-10-06T03:01:09.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a73fff700 1 -- start start 2023-10-06T03:01:09.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a73fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740b2660 0x7f7a74144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a73fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 0x7f7a740cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a73fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740ceae0 0x7f7a740ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a73fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7416b500 con 0x7f7a740b2a30 2023-10-06T03:01:09.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a73fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740b5020 con 0x7f7a740ceae0 2023-10-06T03:01:09.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a73fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7416aeb0 con 0x7f7a740b2660 2023-10-06T03:01:09.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a727fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 0x7f7a740cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a727fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 0x7f7a740cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60214/0 (socket says 172.21.15.84:60214) 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a727fc700 1 -- 172.21.15.84:0/386940115 learned_addr learned my addr 172.21.15.84:0/386940115 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740b2660 0x7f7a74144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.793+0000 7f7a737fe700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740ceae0 0x7f7a740ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a727fc700 1 -- 172.21.15.84:0/386940115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740b2660 msgr2=0x7f7a74144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a727fc700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740b2660 0x7f7a74144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a727fc700 1 -- 172.21.15.84:0/386940115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740ceae0 msgr2=0x7f7a740ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a727fc700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740ceae0 0x7f7a740ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a727fc700 1 -- 172.21.15.84:0/386940115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c009420 con 0x7f7a740b2a30 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a727fc700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 0x7f7a740cde40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0091e0 tx=0x7f7a5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a6affd700 1 -- 172.21.15.84:0/386940115 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c000d10 con 0x7f7a740b2a30 2023-10-06T03:01:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a6affd700 1 -- 172.21.15.84:0/386940115 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c00bb90 con 0x7f7a740b2a30 2023-10-06T03:01:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a73fff700 1 -- 172.21.15.84:0/386940115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7416b190 con 0x7f7a740b2a30 2023-10-06T03:01:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a6affd700 1 -- 172.21.15.84:0/386940115 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c011690 con 0x7f7a740b2a30 2023-10-06T03:01:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.794+0000 7f7a73fff700 1 -- 172.21.15.84:0/386940115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a740b42d0 con 0x7f7a740b2a30 2023-10-06T03:01:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.796+0000 7f7a6affd700 1 -- 172.21.15.84:0/386940115 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a5c011ac0 con 0x7f7a740b2a30 2023-10-06T03:01:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.796+0000 7f7a6affd700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a54066f30 0x7f7a540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.796+0000 7f7a6affd700 1 -- 172.21.15.84:0/386940115 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7a5c086150 con 0x7f7a740b2a30 2023-10-06T03:01:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.796+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a54066f30 0x7f7a540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.796+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a54066f30 0x7f7a540693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009fd0 tx=0x7f7a64009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.798+0000 7f7a82ac4b80 1 Processor -- start 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.798+0000 7f7a82ac4b80 1 -- start start 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16160bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 0x55f16160c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 0x55f16160c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161566ac0 con 0x55f161630ea0 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1615642c0 con 0x55f161612a60 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1615600b0 con 0x55f161611310 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16160bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16160bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60216/0 (socket says 172.21.15.84:60216) 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a72ffd700 1 -- 172.21.15.84:0/2131253354 learned_addr learned my addr 172.21.15.84:0/2131253354 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a727fc700 1 --2- 172.21.15.84:0/2131253354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 0x55f16160c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a737fe700 1 --2- 172.21.15.84:0/2131253354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 0x55f16160c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a72ffd700 1 -- 172.21.15.84:0/2131253354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 msgr2=0x55f16160c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/2131253354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 0x55f16160c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a72ffd700 1 -- 172.21.15.84:0/2131253354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 msgr2=0x55f16160c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/2131253354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 0x55f16160c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a72ffd700 1 -- 172.21.15.84:0/2131253354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1613fa2c0 con 0x55f161630ea0 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/2131253354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16160bd10 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f7a64017700 tx=0x7f7a64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed475fb29c9dc69f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a53fff700 1 -- 172.21.15.84:0/2131253354 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640155f0 con 0x55f161630ea0 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a53fff700 1 -- 172.21.15.84:0/2131253354 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a64015750 con 0x55f161630ea0 2023-10-06T03:01:09.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a53fff700 1 -- 172.21.15.84:0/2131253354 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64015ad0 con 0x55f161630ea0 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2131253354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 msgr2=0x55f16160bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/2131253354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16160bd10 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f7a64017700 tx=0x7f7a64017000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2131253354 shutdown_connections 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/2131253354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 0x55f16160c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/2131253354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16160bd10 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/2131253354 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 0x55f16160c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2131253354 >> 172.21.15.84:0/2131253354 conn(0x55f161610ed0 msgr2=0x55f161611700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2131253354 shutdown_connections 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.800+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2131253354 wait complete. 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.801+0000 7f7a82ac4b80 1 -- start start 2023-10-06T03:01:09.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.801+0000 7f7a82ac4b80 1 Processor -- start 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.801+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 0x55f161628a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.801+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 0x55f161655a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16162a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16150b8e0 con 0x55f161630ea0 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161526ef0 con 0x55f161612a60 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1613e2e80 con 0x55f161611310 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a82ac4b80 10 client.0 _ll_register_callbacks cb 0x55f1615d3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16162a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16162a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60224/0 (socket says 172.21.15.84:60224) 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a737fe700 1 -- 172.21.15.84:0/4068054242 learned_addr learned my addr 172.21.15.84:0/4068054242 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a727fc700 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 0x55f161655a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 0x55f161628a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a737fe700 1 -- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 msgr2=0x55f161628a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a737fe700 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 0x55f161628a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a737fe700 1 -- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 msgr2=0x55f161655a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a737fe700 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 0x55f161655a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a737fe700 1 -- 172.21.15.84:0/4068054242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a64011040 con 0x55f161630ea0 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a737fe700 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16162a500 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c007880 tx=0x7f7a6c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241bacac995e200 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a517fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a517fa700 1 -- 172.21.15.84:0/4068054242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c001cf0 con 0x55f161630ea0 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a517fa700 1 -- 172.21.15.84:0/4068054242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7a6c015470 con 0x55f161630ea0 2023-10-06T03:01:09.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/4068054242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f161604990 con 0x55f161630ea0 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a517fa700 1 -- 172.21.15.84:0/4068054242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a6c015860 con 0x55f161630ea0 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a82ac4b80 10 client.8142 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/4068054242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55f16139d030 con 0x55f161630ea0 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.802+0000 7f7a517fa700 1 -- 172.21.15.84:0/4068054242 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f161604990 con 0x55f161630ea0 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a517fa700 1 -- 172.21.15.84:0/4068054242 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f7a6c0159c0 con 0x55f161630ea0 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a82ac4b80 10 client.8142 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a82ac4b80 10 client.8142 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a82ac4b80 20 client.8142 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55f16163b510 0x55f16163e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a82ac4b80 4 client.8142 mds_command: new command op to 6799 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:09.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/4068054242 --> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1615e18c0 con 0x55f16163b510 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55f16163b510 0x55f16163e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a517fa700 10 client.8142 ms_handle_connect on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.803+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55f16163b510 0x55f16163e310 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3fdaf91602c348ce server_cookie=8d3edbc7fea53c3d in_seq=0 out_seq=0 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a517fa700 1 -- 172.21.15.84:0/4068054242 <== mds.2 v2:172.21.15.131:6832/3567954898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f1615e18c0 con 0x55f16163b510 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a517fa700 10 client.8142 handle_command_reply: tid=0 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 client.8142 shutdown 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/4068054242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 msgr2=0x55f16162a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16162a500 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c007880 tx=0x7f7a6c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/4068054242 shutdown_connections 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55f16163b510 0x55f16163e310 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161630ea0 0x55f16162a500 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a517fa700 0 client.8142 ms_handle_reset on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:09.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161611310 0x55f161628a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/4068054242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161612a60 0x55f161655a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/4068054242 >> 172.21.15.84:0/4068054242 conn(0x55f161610ed0 msgr2=0x55f16160fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/4068054242 shutdown_connections 2023-10-06T03:01:09.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.804+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/4068054242 wait complete. 2023-10-06T03:01:09.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.805+0000 7f7a82ac4b80 20 client.8142 trim_cache size 0 max 16384 2023-10-06T03:01:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a82ac4b80 1 Processor -- start 2023-10-06T03:01:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a82ac4b80 1 -- start start 2023-10-06T03:01:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161611310 0x55f1616118b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161612a60 0x55f16160f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161630ea0 0x55f16160fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1616133c0 con 0x55f161611310 2023-10-06T03:01:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161655830 con 0x55f161630ea0 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f16162f170 con 0x55f161612a60 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161611310 0x55f1616118b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a72ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161611310 0x55f1616118b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60238/0 (socket says 172.21.15.84:60238) 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a72ffd700 1 -- 172.21.15.84:0/2075469299 learned_addr learned my addr 172.21.15.84:0/2075469299 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a737fe700 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161630ea0 0x55f16160fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a727fc700 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161612a60 0x55f16160f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a72ffd700 1 -- 172.21.15.84:0/2075469299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161612a60 msgr2=0x55f16160f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161612a60 0x55f16160f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a72ffd700 1 -- 172.21.15.84:0/2075469299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161630ea0 msgr2=0x55f16160fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161630ea0 0x55f16160fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a72ffd700 1 -- 172.21.15.84:0/2075469299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f16152e7d0 con 0x55f161611310 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.821+0000 7f7a727fc700 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161612a60 0x55f16160f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161611310 0x55f1616118b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7a640175d0 tx=0x7f7a64019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3063dae995e378ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a68ff9700 1 -- 172.21.15.84:0/2075469299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640032f0 con 0x55f161611310 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a68ff9700 1 -- 172.21.15.84:0/2075469299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a640158c0 con 0x55f161611310 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a68ff9700 1 -- 172.21.15.84:0/2075469299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64015a50 con 0x55f161611310 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2075469299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161611310 msgr2=0x55f1616118b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161611310 0x55f1616118b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7a640175d0 tx=0x7f7a64019040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2075469299 shutdown_connections 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161630ea0 0x55f16160fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161611310 0x55f1616118b0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/2075469299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161612a60 0x55f16160f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2075469299 >> 172.21.15.84:0/2075469299 conn(0x55f161610ed0 msgr2=0x55f161639380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2075469299 shutdown_connections 2023-10-06T03:01:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.822+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/2075469299 wait complete. 2023-10-06T03:01:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.823+0000 7f7a82ac4b80 1 -- start start 2023-10-06T03:01:09.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.823+0000 7f7a82ac4b80 1 Processor -- start 2023-10-06T03:01:09.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161611310 0x55f16160bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161612a60 0x55f16163bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a82ac4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161630ea0 0x55f1616b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161676cd0 con 0x55f161612a60 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161627250 con 0x55f161611310 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a82ac4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1616274a0 con 0x55f161630ea0 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a82ac4b80 10 client.0 _ll_register_callbacks cb 0x55f1615d3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a727fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161612a60 0x55f16163bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a727fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161612a60 0x55f16163bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60246/0 (socket says 172.21.15.84:60246) 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a727fc700 1 -- 172.21.15.84:0/236177648 learned_addr learned my addr 172.21.15.84:0/236177648 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161611310 0x55f16160bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a737fe700 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161630ea0 0x55f1616b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a727fc700 1 -- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161630ea0 msgr2=0x55f1616b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a727fc700 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161630ea0 0x55f1616b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a727fc700 1 -- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161611310 msgr2=0x55f16160bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a727fc700 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161611310 0x55f16160bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a727fc700 1 -- 172.21.15.84:0/236177648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1613fa2c0 con 0x55f161612a60 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a727fc700 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161612a60 0x55f16163bf30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c053290 tx=0x7f7a5c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab388258690bb3e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a517fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.824+0000 7f7a517fa700 1 -- 172.21.15.84:0/236177648 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c05a030 con 0x55f161612a60 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a517fa700 1 -- 172.21.15.84:0/236177648 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7a5c05dd80 con 0x55f161612a60 2023-10-06T03:01:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/236177648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a64015750 con 0x55f161612a60 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a517fa700 1 -- 172.21.15.84:0/236177648 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a5c06d1b0 con 0x55f161612a60 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a82ac4b80 10 client.8148 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/236177648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55f1615154c0 con 0x55f161612a60 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a517fa700 1 -- 172.21.15.84:0/236177648 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a64015750 con 0x55f161612a60 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a517fa700 1 -- 172.21.15.84:0/236177648 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f7a5c0562d0 con 0x55f161612a60 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a82ac4b80 10 client.8148 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a82ac4b80 10 client.8148 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a82ac4b80 20 client.8148 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55f161626d30 0x55f1616b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a82ac4b80 4 client.8148 mds_command: new command op to 6799 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/236177648 --> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f161502e50 con 0x55f161626d30 2023-10-06T03:01:09.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55f161626d30 0x55f1616b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a517fa700 10 client.8148 ms_handle_connect on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.825+0000 7f7a72ffd700 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55f161626d30 0x55f1616b5a10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adebf30c839666b4 server_cookie=943dd7267efb483b in_seq=0 out_seq=0 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a517fa700 1 -- 172.21.15.84:0/236177648 <== mds.2 v2:172.21.15.131:6832/3567954898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55f161502e50 con 0x55f161626d30 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a517fa700 10 client.8148 handle_command_reply: tid=0 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 client.8148 shutdown 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/236177648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161612a60 msgr2=0x55f16163bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161612a60 0x55f16163bf30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c053290 tx=0x7f7a5c086040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/236177648 shutdown_connections 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55f161626d30 0x55f1616b5a10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f161611310 0x55f16160bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f161630ea0 0x55f1616b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 --2- 172.21.15.84:0/236177648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f161612a60 0x55f16163bf30 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a517fa700 0 client.8148 ms_handle_reset on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:09.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/236177648 >> 172.21.15.84:0/236177648 conn(0x55f161610ed0 msgr2=0x55f1616118b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/236177648 shutdown_connections 2023-10-06T03:01:09.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 1 -- 172.21.15.84:0/236177648 wait complete. 2023-10-06T03:01:09.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a82ac4b80 20 client.8148 trim_cache size 0 max 16384 2023-10-06T03:01:09.835 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:09.835 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:01:09.836 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:01:09.836 INFO:teuthology.orchestra.run.smithi084.stdout: "ea81fb44-d37d-452e-9e53-a92144a2920c": { 2023-10-06T03:01:09.836 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:01:09.836 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "ea81fb44-d37d-452e-9e53-a92144a2920c", 2023-10-06T03:01:09.836 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:01:09.836 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:09.836 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:09.836 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:09.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a73fff700 1 -- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a54066f30 msgr2=0x7f7a540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a73fff700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a54066f30 0x7f7a540693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009fd0 tx=0x7f7a64009830 comp rx=0 tx=0).stop 2023-10-06T03:01:09.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a73fff700 1 -- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 msgr2=0x7f7a740cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.826+0000 7f7a73fff700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 0x7f7a740cde40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0091e0 tx=0x7f7a5c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.827+0000 7f7a73fff700 1 -- 172.21.15.84:0/386940115 shutdown_connections 2023-10-06T03:01:09.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.827+0000 7f7a73fff700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7a54066f30 0x7f7a540693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.827+0000 7f7a73fff700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a740ceae0 0x7f7a740ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.827+0000 7f7a73fff700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a740b2660 0x7f7a74144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.827+0000 7f7a73fff700 1 --2- 172.21.15.84:0/386940115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a740b2a30 0x7f7a740cde40 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.827+0000 7f7a73fff700 1 -- 172.21.15.84:0/386940115 >> 172.21.15.84:0/386940115 conn(0x7f7a74099560 msgr2=0x7f7a740c5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.827+0000 7f7a73fff700 1 -- 172.21.15.84:0/386940115 shutdown_connections 2023-10-06T03:01:09.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.827+0000 7f7a73fff700 1 -- 172.21.15.84:0/386940115 wait complete. 2023-10-06T03:01:09.839 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:01:09.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-10-06T03:01:09.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.954+0000 7ff36f59e700 1 Processor -- start 2023-10-06T03:01:09.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.954+0000 7ff36f59e700 1 -- start start 2023-10-06T03:01:09.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.955+0000 7ff36f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3700cd400 0x7ff3700ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.955+0000 7ff36f59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3700cc9b0 con 0x7ff3700b2a30 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.955+0000 7ff36f59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3700cbda0 con 0x7ff3700b2660 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.955+0000 7ff36f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700cc080 con 0x7ff3700cd400 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.955+0000 7ff36ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff3700b2a30 0x7ff3700c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37704/0 (socket says 172.21.15.84:37704) 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.955+0000 7ff36ed9d700 1 -- 172.21.15.84:0/3737805239 learned_addr learned my addr 172.21.15.84:0/3737805239 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.955+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466090102 0 0) 0x7ff3700cc9b0 con 0x7ff3700b2a30 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.955+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3700cd400 0x7ff3700ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.955+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff358003570 con 0x7ff3700b2a30 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2855355803 0 0) 0x7ff358003570 con 0x7ff3700b2a30 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3700cd400 msgr2=0x7ff3700ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3700cd400 0x7ff3700ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 >> v1:172.21.15.131:6789/0 conn(0x7ff3700b2660 legacy=0x7ff3700cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3700cc360 con 0x7ff3700b2a30 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7ff368001470 con 0x7ff3700b2a30 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 >> v1:172.21.15.84:6789/0 conn(0x7ff3700b2a30 legacy=0x7ff3700c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3700cd400 0x7ff358003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff358004010 0x7ff358004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700cc080 con 0x7ff358004d50 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35800bbf0 con 0x7ff358004010 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35800bdb0 con 0x7ff3700cd400 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36e59c700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3700cd400 0x7ff358003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff358004010 0x7ff358004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36ed9d700 1 -- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3700cd400 msgr2=0x7ff358003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3700cd400 0x7ff358003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36ed9d700 1 -- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff358004010 msgr2=0x7ff358004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff358004010 0x7ff358004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36ed9d700 1 -- 172.21.15.84:0/3737805239 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358003570 con 0x7ff358004d50 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3580051c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ff3700b2e50 tx=0x7ff368001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46786f11ffa7a016 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.956+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800cc30 con 0x7ff358004d50 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.957+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36800cd90 con 0x7ff358004d50 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.957+0000 7ff36d59a700 1 -- 172.21.15.84:0/3737805239 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368005b70 con 0x7ff358004d50 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.957+0000 7ff36f59e700 1 -- 172.21.15.84:0/3737805239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 msgr2=0x7ff3580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.957+0000 7ff36f59e700 1 --2- 172.21.15.84:0/3737805239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3580051c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ff3700b2e50 tx=0x7ff368001e50 comp rx=0 tx=0).stop 2023-10-06T03:01:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.957+0000 7ff36ed9d700 1 -- 172.21.15.84:0/3737805239 reap_dead start 2023-10-06T03:01:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.957+0000 7ff36f59e700 1 -- 172.21.15.84:0/3737805239 shutdown_connections 2023-10-06T03:01:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.957+0000 7ff36f59e700 1 -- 172.21.15.84:0/3737805239 >> 172.21.15.84:0/3737805239 conn(0x7ff370099560 msgr2=0x7ff37006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.957+0000 7ff36f59e700 1 -- 172.21.15.84:0/3737805239 shutdown_connections 2023-10-06T03:01:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.957+0000 7ff36f59e700 1 -- 172.21.15.84:0/3737805239 wait complete. 2023-10-06T03:01:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.958+0000 7ff36f59e700 1 Processor -- start 2023-10-06T03:01:09.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.958+0000 7ff36f59e700 1 -- start start 2023-10-06T03:01:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36f59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3700ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3700b2080 0x7ff3700b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff370168a00 0x7ff370168e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36f59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37016d510 con 0x7ff358004d50 2023-10-06T03:01:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36f59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700c9890 con 0x7ff3700b2080 2023-10-06T03:01:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3701693c0 con 0x7ff370168a00 2023-10-06T03:01:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3700ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3700ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60272/0 (socket says 172.21.15.84:60272) 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36e59c700 1 -- 172.21.15.84:0/1824532847 learned_addr learned my addr 172.21.15.84:0/1824532847 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3700b2080 0x7ff3700b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff370168a00 0x7ff370168e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36e59c700 1 -- 172.21.15.84:0/1824532847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff370168a00 msgr2=0x7ff370168e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36e59c700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff370168a00 0x7ff370168e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36e59c700 1 -- 172.21.15.84:0/1824532847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3700b2080 msgr2=0x7ff3700b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36e59c700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3700b2080 0x7ff3700b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36e59c700 1 -- 172.21.15.84:0/1824532847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3700ca680 con 0x7ff358004d50 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3700b2080 0x7ff3700b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff36e59c700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3700ca010 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7ff36000c200 tx=0x7ff360001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.959+0000 7ff35e7fc700 1 -- 172.21.15.84:0/1824532847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000cea0 con 0x7ff358004d50 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.960+0000 7ff35e7fc700 1 -- 172.21.15.84:0/1824532847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff360015430 con 0x7ff358004d50 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.960+0000 7ff36f59e700 1 -- 172.21.15.84:0/1824532847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37016cbe0 con 0x7ff358004d50 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.960+0000 7ff35e7fc700 1 -- 172.21.15.84:0/1824532847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3600157d0 con 0x7ff358004d50 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.960+0000 7ff36f59e700 1 -- 172.21.15.84:0/1824532847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37016d1a0 con 0x7ff358004d50 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.962+0000 7ff35e7fc700 1 -- 172.21.15.84:0/1824532847 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff360015b80 con 0x7ff358004d50 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.962+0000 7ff35e7fc700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff350066f30 0x7ff3500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.962+0000 7ff35e7fc700 1 -- 172.21.15.84:0/1824532847 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff360084e60 con 0x7ff358004d50 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.962+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff350066f30 0x7ff3500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.963+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff350066f30 0x7ff3500693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff3700c95a0 tx=0x7ff364008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.963+0000 7ff37ddd1b80 1 Processor -- start 2023-10-06T03:01:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff37ddd1b80 1 -- start start 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 0x5599d26ca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26d0a60 0x5599d26ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d2624ac0 con 0x5599d26eeea0 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d26222c0 con 0x5599d26cf310 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599d261e0b0 con 0x5599d26d0a60 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff36e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff36e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60284/0 (socket says 172.21.15.84:60284) 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff36e59c700 1 -- 172.21.15.84:0/3720684900 learned_addr learned my addr 172.21.15.84:0/3720684900 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.964+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 0x5599d26ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26d0a60 0x5599d26ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff36e59c700 1 -- 172.21.15.84:0/3720684900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26d0a60 msgr2=0x5599d26ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff36e59c700 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26d0a60 0x5599d26ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff36e59c700 1 -- 172.21.15.84:0/3720684900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 msgr2=0x5599d26ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff36e59c700 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 0x5599d26ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff36e59c700 1 -- 172.21.15.84:0/3720684900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599d24b82c0 con 0x5599d26eeea0 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26d0a60 0x5599d26ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff36e59c700 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c9d10 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7ff360052080 tx=0x7ff360009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14cf90a43b3f50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff34f7fe700 1 -- 172.21.15.84:0/3720684900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360058d20 con 0x5599d26eeea0 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff34f7fe700 1 -- 172.21.15.84:0/3720684900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36005ca70 con 0x5599d26eeea0 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.965+0000 7ff34f7fe700 1 -- 172.21.15.84:0/3720684900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360053f20 con 0x5599d26eeea0 2023-10-06T03:01:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3720684900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 msgr2=0x5599d26c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c9d10 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7ff360052080 tx=0x7ff360009040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3720684900 shutdown_connections 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26d0a60 0x5599d26ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c9d10 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3720684900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 0x5599d26ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3720684900 >> 172.21.15.84:0/3720684900 conn(0x5599d26ceed0 msgr2=0x5599d26cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3720684900 shutdown_connections 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3720684900 wait complete. 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 -- start start 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.966+0000 7ff37ddd1b80 1 Processor -- start 2023-10-06T03:01:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 0x5599d26ecf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2714990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26eeea0 0x5599d26ef270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d25c98e0 con 0x5599d26d0a60 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d25e4ef0 con 0x5599d26cf310 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599d24a0e80 con 0x5599d26eeea0 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff37ddd1b80 10 client.0 _ll_register_callbacks cb 0x5599d2691070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2714990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2714990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60286/0 (socket says 172.21.15.84:60286) 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff36dd9b700 1 -- 172.21.15.84:0/2827409515 learned_addr learned my addr 172.21.15.84:0/2827409515 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.967+0000 7ff36e59c700 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 0x5599d26ecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26eeea0 0x5599d26ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff36dd9b700 1 -- 172.21.15.84:0/2827409515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26eeea0 msgr2=0x5599d26ef270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26eeea0 0x5599d26ef270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff36dd9b700 1 -- 172.21.15.84:0/2827409515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 msgr2=0x5599d26ecf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 0x5599d26ecf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff36dd9b700 1 -- 172.21.15.84:0/2827409515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37016d1a0 con 0x5599d26d0a60 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2714990 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff364016b90 tx=0x7ff364019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8415ba3d4c975fa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff34cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff34cff9700 1 -- 172.21.15.84:0/2827409515 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36401c040 con 0x5599d26d0a60 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff34cff9700 1 -- 172.21.15.84:0/2827409515 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff3640156d0 con 0x5599d26d0a60 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/2827409515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599d26c2990 con 0x5599d26d0a60 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff34cff9700 1 -- 172.21.15.84:0/2827409515 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff364015aa0 con 0x5599d26d0a60 2023-10-06T03:01:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff37ddd1b80 10 client.8160 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/2827409515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x5599d245b030 con 0x5599d26d0a60 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff34cff9700 1 -- 172.21.15.84:0/2827409515 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5599d26c2990 con 0x5599d26d0a60 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff34cff9700 1 -- 172.21.15.84:0/2827409515 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7ff364015c00 con 0x5599d26d0a60 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff37ddd1b80 10 client.8160 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff37ddd1b80 10 client.8160 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff37ddd1b80 20 client.8160 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5599d272e780 0x5599d2730b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff37ddd1b80 4 client.8160 mds_command: new command op to 7716 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.968+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/2827409515 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599d269f8c0 con 0x5599d272e780 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff36e59c700 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5599d272e780 0x5599d2730b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff36e59c700 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5599d272e780 0x5599d2730b60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=250ed64ecdf4c780 server_cookie=ff7b77b087f4045d in_seq=0 out_seq=0 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff34cff9700 10 client.8160 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff34cff9700 1 -- 172.21.15.84:0/2827409515 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5599d269f8c0 con 0x5599d272e780 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff34cff9700 10 client.8160 handle_command_reply: tid=0 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff37ddd1b80 1 client.8160 shutdown 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/2827409515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 msgr2=0x5599d2714990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2714990 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff364016b90 tx=0x7ff364019000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/2827409515 shutdown_connections 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5599d272e780 0x5599d2730b60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26cf310 0x5599d26ecf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff34cff9700 0 client.8160 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26eeea0 0x5599d26ef270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/2827409515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2714990 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.969+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/2827409515 >> 172.21.15.84:0/2827409515 conn(0x5599d26ceed0 msgr2=0x5599d26cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.970+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/2827409515 shutdown_connections 2023-10-06T03:01:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.970+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/2827409515 wait complete. 2023-10-06T03:01:09.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.970+0000 7ff37ddd1b80 20 client.8160 trim_cache size 0 max 16384 2023-10-06T03:01:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.986+0000 7ff37ddd1b80 1 Processor -- start 2023-10-06T03:01:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff37ddd1b80 1 -- start start 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 0x5599d26c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2724600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26eeea0 0x5599d2717d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d26fbe00 con 0x5599d26d0a60 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d26f0460 con 0x5599d26eeea0 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599d26a6230 con 0x5599d26cf310 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2724600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2724600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60300/0 (socket says 172.21.15.84:60300) 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36dd9b700 1 -- 172.21.15.84:0/6065388 learned_addr learned my addr 172.21.15.84:0/6065388 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26eeea0 0x5599d2717d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36dd9b700 1 -- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 msgr2=0x5599d26c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36e59c700 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 0x5599d26c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 0x5599d26c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36dd9b700 1 -- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26eeea0 msgr2=0x5599d2717d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26eeea0 0x5599d2717d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36dd9b700 1 -- 172.21.15.84:0/6065388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599d25ec7d0 con 0x5599d26d0a60 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26eeea0 0x5599d2717d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36e59c700 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 0x5599d26c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff36dd9b700 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2724600 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff364016b60 tx=0x7ff36401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0342e2f02f5134 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff34ffff700 1 -- 172.21.15.84:0/6065388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3640156d0 con 0x5599d26d0a60 2023-10-06T03:01:09.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff34ffff700 1 -- 172.21.15.84:0/6065388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff364025410 con 0x5599d26d0a60 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff34ffff700 1 -- 172.21.15.84:0/6065388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364015aa0 con 0x5599d26d0a60 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/6065388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 msgr2=0x5599d2724600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.987+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2724600 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff364016b60 tx=0x7ff36401e000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.988+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/6065388 shutdown_connections 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.988+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26eeea0 0x5599d2717d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.988+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 0x5599d26c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.988+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/6065388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26d0a60 0x5599d2724600 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.988+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/6065388 >> 172.21.15.84:0/6065388 conn(0x5599d26ceed0 msgr2=0x5599d26f6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.988+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/6065388 shutdown_connections 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.988+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/6065388 wait complete. 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.988+0000 7ff37ddd1b80 1 -- start start 2023-10-06T03:01:09.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.988+0000 7ff37ddd1b80 1 Processor -- start 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 0x5599d275c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26d0a60 0x5599d26f3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff37ddd1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d26ee090 con 0x5599d26eeea0 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d26f3b90 con 0x5599d26d0a60 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff37ddd1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599d26f3940 con 0x5599d26cf310 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff37ddd1b80 10 client.0 _ll_register_callbacks cb 0x5599d2691070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff36ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff36ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60316/0 (socket says 172.21.15.84:60316) 2023-10-06T03:01:09.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff36ed9d700 1 -- 172.21.15.84:0/3502779269 learned_addr learned my addr 172.21.15.84:0/3502779269 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff36ed9d700 1 -- 172.21.15.84:0/3502779269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 msgr2=0x5599d275c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 0x5599d275c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff36ed9d700 1 -- 172.21.15.84:0/3502779269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26d0a60 msgr2=0x5599d26f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26d0a60 0x5599d26f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.989+0000 7ff36ed9d700 1 -- 172.21.15.84:0/3502779269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599d245b030 con 0x5599d26eeea0 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff36ed9d700 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c4450 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff368009020 tx=0x7ff368015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7693ee01798f52cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff34cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff34cff9700 1 -- 172.21.15.84:0/3502779269 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368024070 con 0x5599d26eeea0 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff34cff9700 1 -- 172.21.15.84:0/3502779269 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff368007b40 con 0x5599d26eeea0 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3502779269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff36005ca70 con 0x5599d26eeea0 2023-10-06T03:01:09.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff34cff9700 1 -- 172.21.15.84:0/3502779269 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff36800c980 con 0x5599d26eeea0 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff37ddd1b80 10 client.8166 fetch_fsmap learned FSMap version 91 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3502779269 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x5599d25d34c0 con 0x5599d26eeea0 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff34cff9700 1 -- 172.21.15.84:0/3502779269 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36005ca70 con 0x5599d26eeea0 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff34cff9700 1 -- 172.21.15.84:0/3502779269 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 91) v1 ==== 3140+0+0 (secure 0 0 0) 0x7ff368027030 con 0x5599d26eeea0 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff37ddd1b80 10 client.8166 fetch_fsmap finished waiting for FSMap version 91 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff37ddd1b80 10 client.8166 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff37ddd1b80 20 client.8166 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5599d26c4a30 0x5599d26ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff37ddd1b80 4 client.8166 mds_command: new command op to 7716 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:01:09.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3502779269 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5599d25c0e50 con 0x5599d26c4a30 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff36e59c700 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5599d26c4a30 0x5599d26ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.990+0000 7ff34cff9700 10 client.8166 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff36e59c700 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5599d26c4a30 0x5599d26ebbd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8065e15c3fc787d7 server_cookie=4897ccfea9c8ce20 in_seq=0 out_seq=0 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff34cff9700 1 -- 172.21.15.84:0/3502779269 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5599d25c0e50 con 0x5599d26c4a30 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff34cff9700 10 client.8166 handle_command_reply: tid=0 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 client.8166 shutdown 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3502779269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 msgr2=0x5599d26c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c4450 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff368009020 tx=0x7ff368015000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3502779269 shutdown_connections 2023-10-06T03:01:09.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5599d26c4a30 0x5599d26ebbd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599d26eeea0 0x5599d26c4450 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff34cff9700 0 client.8166 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:10.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5599d26cf310 0x5599d275c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 --2- 172.21.15.84:0/3502779269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599d26d0a60 0x5599d26f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3502779269 >> 172.21.15.84:0/3502779269 conn(0x5599d26ceed0 msgr2=0x5599d26ca640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3502779269 shutdown_connections 2023-10-06T03:01:10.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 1 -- 172.21.15.84:0/3502779269 wait complete. 2023-10-06T03:01:10.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.991+0000 7ff37ddd1b80 20 client.8166 trim_cache size 0 max 16384 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout: "ea81fb44-d37d-452e-9e53-a92144a2920c": { 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "ea81fb44-d37d-452e-9e53-a92144a2920c", 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:10.001 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:10.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 -- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff350066f30 msgr2=0x7ff3500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff350066f30 0x7ff3500693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff3700c95a0 tx=0x7ff364008040 comp rx=0 tx=0).stop 2023-10-06T03:01:10.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 -- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 msgr2=0x7ff3700ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3700ca010 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7ff36000c200 tx=0x7ff360001a70 comp rx=0 tx=0).stop 2023-10-06T03:01:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 -- 172.21.15.84:0/1824532847 shutdown_connections 2023-10-06T03:01:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff350066f30 0x7ff3500693e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff370168a00 0x7ff370168e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff358004d50 0x7ff3700ca010 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 --2- 172.21.15.84:0/1824532847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3700b2080 0x7ff3700b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 -- 172.21.15.84:0/1824532847 >> 172.21.15.84:0/1824532847 conn(0x7ff370099560 msgr2=0x7ff370068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 -- 172.21.15.84:0/1824532847 shutdown_connections 2023-10-06T03:01:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:09.992+0000 7ff36f59e700 1 -- 172.21.15.84:0/1824532847 wait complete. 2023-10-06T03:01:10.005 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:01:10.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.117+0000 7f603f59e700 1 Processor -- start 2023-10-06T03:01:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.117+0000 7f603f59e700 1 -- start start 2023-10-06T03:01:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 0x7f60400b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603f59e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60400cb7e0 con 0x7f60400b2140 2023-10-06T03:01:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603f59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60400b08a0 con 0x7f60400b3610 2023-10-06T03:01:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60400cb190 con 0x7f6040159480 2023-10-06T03:01:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f60400b2140 0x7f60400b25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37716/0 (socket says 172.21.15.84:37716) 2023-10-06T03:01:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603ed9d700 1 -- 172.21.15.84:0/52216382 learned_addr learned my addr 172.21.15.84:0/52216382 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603e59c700 1 --2- 172.21.15.84:0/52216382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 0x7f60400b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603d59a700 1 -- 172.21.15.84:0/52216382 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072179544 0 0) 0x7f60400cb7e0 con 0x7f60400b2140 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603d59a700 1 -- 172.21.15.84:0/52216382 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6028003570 con 0x7f60400b2140 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603d59a700 1 -- 172.21.15.84:0/52216382 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650010515 0 0) 0x7f60400b08a0 con 0x7f60400b3610 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603d59a700 1 -- 172.21.15.84:0/52216382 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60400cb7e0 con 0x7f60400b3610 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603e59c700 1 -- 172.21.15.84:0/52216382 >> v1:172.21.15.131:6789/0 conn(0x7f60400b3610 legacy=0x7f60400cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603e59c700 1 -- 172.21.15.84:0/52216382 >> v1:172.21.15.84:6789/0 conn(0x7f60400b2140 legacy=0x7f60400b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603e59c700 1 -- 172.21.15.84:0/52216382 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400cb470 con 0x7f6040159480 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.118+0000 7f603e59c700 1 --2- 172.21.15.84:0/52216382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 0x7f60400b30d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6038009e90 tx=0x7f6038009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ab1f440e76f937a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603d59a700 1 -- 172.21.15.84:0/52216382 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800e070 con 0x7f6040159480 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603d59a700 1 -- 172.21.15.84:0/52216382 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603800bb80 con 0x7f6040159480 2023-10-06T03:01:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603d59a700 1 -- 172.21.15.84:0/52216382 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038012430 con 0x7f6040159480 2023-10-06T03:01:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603f59e700 1 -- 172.21.15.84:0/52216382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 msgr2=0x7f60400b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603f59e700 1 --2- 172.21.15.84:0/52216382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 0x7f60400b30d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6038009e90 tx=0x7f6038009780 comp rx=0 tx=0).stop 2023-10-06T03:01:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603f59e700 1 -- 172.21.15.84:0/52216382 shutdown_connections 2023-10-06T03:01:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603f59e700 1 --2- 172.21.15.84:0/52216382 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 0x7f60400b30d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603f59e700 1 -- 172.21.15.84:0/52216382 >> 172.21.15.84:0/52216382 conn(0x7f604006ed20 msgr2=0x7f604006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603f59e700 1 -- 172.21.15.84:0/52216382 shutdown_connections 2023-10-06T03:01:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.119+0000 7f603f59e700 1 -- 172.21.15.84:0/52216382 wait complete. 2023-10-06T03:01:10.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.120+0000 7f603f59e700 1 Processor -- start 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.120+0000 7f603f59e700 1 -- start start 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60400b2140 0x7f6040153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603f59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400b3610 0x7f604015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603f59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 0x7f604015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603f59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c6fa0 con 0x7f60400b3610 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603f59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6040169d50 con 0x7f60400b2140 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603f59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6040169490 con 0x7f6040159480 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400b3610 0x7f604015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400b3610 0x7f604015bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60322/0 (socket says 172.21.15.84:60322) 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603dd9b700 1 -- 172.21.15.84:0/2839187589 learned_addr learned my addr 172.21.15.84:0/2839187589 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:10.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603ed9d700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 0x7f604015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.121+0000 7f603e59c700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60400b2140 0x7f6040153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f603dd9b700 1 -- 172.21.15.84:0/2839187589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 msgr2=0x7f604015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f603dd9b700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 0x7f604015c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f603dd9b700 1 -- 172.21.15.84:0/2839187589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60400b2140 msgr2=0x7f6040153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f603dd9b700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60400b2140 0x7f6040153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f603dd9b700 1 -- 172.21.15.84:0/2839187589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038009a20 con 0x7f60400b3610 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f603dd9b700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400b3610 0x7f604015bae0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f603400c790 tx=0x7f6034007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f602e7fc700 1 -- 172.21.15.84:0/2839187589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034010510 con 0x7f60400b3610 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f602e7fc700 1 -- 172.21.15.84:0/2839187589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034010670 con 0x7f60400b3610 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f602e7fc700 1 -- 172.21.15.84:0/2839187589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034010a10 con 0x7f60400b3610 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60400c3de0 con 0x7f60400b3610 2023-10-06T03:01:10.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.122+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60401699e0 con 0x7f60400b3610 2023-10-06T03:01:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.123+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6040169ec0 con 0x7f60400b3610 2023-10-06T03:01:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.123+0000 7f602e7fc700 1 -- 172.21.15.84:0/2839187589 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f603401b3b0 con 0x7f60400b3610 2023-10-06T03:01:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.123+0000 7f602e7fc700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6020066f30 0x7f60200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.124+0000 7f602e7fc700 1 -- 172.21.15.84:0/2839187589 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6034084100 con 0x7f60400b3610 2023-10-06T03:01:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.124+0000 7f603e59c700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6020066f30 0x7f60200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.124+0000 7f603e59c700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6020066f30 0x7f60200693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6038009de0 tx=0x7f6038019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.128+0000 7f602e7fc700 1 -- 172.21.15.84:0/2839187589 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60340510d0 con 0x7f60400b3610 2023-10-06T03:01:10.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.354+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f604005f270 con 0x7f60400b3610 2023-10-06T03:01:10.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.354+0000 7f602e7fc700 1 -- 172.21.15.84:0/2839187589 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4639 (secure 0 0 0) 0x7f60340546f0 con 0x7f60400b3610 2023-10-06T03:01:10.356 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:10.356 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:09.208269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:10.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6020066f30 msgr2=0x7f60200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6020066f30 0x7f60200693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6038009de0 tx=0x7f6038019000 comp rx=0 tx=0).stop 2023-10-06T03:01:10.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400b3610 msgr2=0x7f604015bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400b3610 0x7f604015bae0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f603400c790 tx=0x7f6034007e10 comp rx=0 tx=0).stop 2023-10-06T03:01:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 shutdown_connections 2023-10-06T03:01:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6020066f30 0x7f60200693e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60400b2140 0x7f6040153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6040159480 0x7f604015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 --2- 172.21.15.84:0/2839187589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400b3610 0x7f604015bae0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.356+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 >> 172.21.15.84:0/2839187589 conn(0x7f604006ed20 msgr2=0x7f6040155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.357+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 shutdown_connections 2023-10-06T03:01:10.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.357+0000 7f603f59e700 1 -- 172.21.15.84:0/2839187589 wait complete. 2023-10-06T03:01:10.360 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 91 2023-10-06T03:01:10.370 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:10.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:10.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f732b0bc700 1 Processor -- start 2023-10-06T03:01:10.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f732b0bc700 1 -- start start 2023-10-06T03:01:10.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f732b0bc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7324159480 0x7f73240b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f732b0bc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73240cb7e0 con 0x7f73240b3610 2023-10-06T03:01:10.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f732b0bc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73240b08a0 con 0x7f73240b2140 2023-10-06T03:01:10.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f732b0bc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73240cb190 con 0x7f7324159480 2023-10-06T03:01:10.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f73298b9700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f73240b3610 0x7f73240cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37720/0 (socket says 172.21.15.84:37720) 2023-10-06T03:01:10.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f73298b9700 1 -- 172.21.15.84:0/2760335406 learned_addr learned my addr 172.21.15.84:0/2760335406 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:10.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005486674 0 0) 0x7f73240cb7e0 con 0x7f73240b3610 2023-10-06T03:01:10.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f732a0ba700 1 --2- 172.21.15.84:0/2760335406 >> v2:172.21.15.131:3300/0 conn(0x7f7324159480 0x7f73240b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.483+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7310003570 con 0x7f73240b3610 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279611843 0 0) 0x7f7310003570 con 0x7f73240b3610 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 >> v2:172.21.15.131:3300/0 conn(0x7f7324159480 msgr2=0x7f73240b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 --2- 172.21.15.84:0/2760335406 >> v2:172.21.15.131:3300/0 conn(0x7f7324159480 0x7f73240b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 >> v1:172.21.15.131:6789/0 conn(0x7f73240b2140 legacy=0x7f73240b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73240cb470 con 0x7f73240b3610 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f7314001470 con 0x7f73240b3610 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 >> v1:172.21.15.84:6789/0 conn(0x7f73240b3610 legacy=0x7f73240cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7310003a60 0x7f7310003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7310004810 0x7f7310004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100051c0 0x7f731000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73240cb190 con 0x7f7310004810 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731000c160 con 0x7f73100051c0 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731000c320 con 0x7f7310003a60 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73298b9700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7310004810 0x7f7310004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f732a8bb700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100051c0 0x7f731000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f732a0ba700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7310003a60 0x7f7310003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73298b9700 1 -- 172.21.15.84:0/2760335406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7310003a60 msgr2=0x7f7310003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73298b9700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7310003a60 0x7f7310003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73298b9700 1 -- 172.21.15.84:0/2760335406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100051c0 msgr2=0x7f731000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73298b9700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73100051c0 0x7f731000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f732a8bb700 1 -- 172.21.15.84:0/2760335406 reap_dead start 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73298b9700 1 -- 172.21.15.84:0/2760335406 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310003570 con 0x7f7310004810 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f732a0ba700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7310003a60 0x7f7310003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73298b9700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7310004810 0x7f7310004c80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f731400c3c0 tx=0x7f7314001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fccc2b878d61bb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400cc90 con 0x7f7310004810 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400cdf0 con 0x7f7310004810 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.484+0000 7f73290b8700 1 -- 172.21.15.84:0/2760335406 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314005b50 con 0x7f7310004810 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.485+0000 7f732b0bc700 1 -- 172.21.15.84:0/2760335406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7310004810 msgr2=0x7f7310004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.485+0000 7f732b0bc700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7310004810 0x7f7310004c80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f731400c3c0 tx=0x7f7314001e50 comp rx=0 tx=0).stop 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.485+0000 7f732b0bc700 1 -- 172.21.15.84:0/2760335406 shutdown_connections 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.485+0000 7f732b0bc700 1 --2- 172.21.15.84:0/2760335406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7310004810 0x7f7310004c80 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.485+0000 7f732b0bc700 1 -- 172.21.15.84:0/2760335406 >> 172.21.15.84:0/2760335406 conn(0x7f732406ed20 msgr2=0x7f732406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.485+0000 7f732b0bc700 1 -- 172.21.15.84:0/2760335406 shutdown_connections 2023-10-06T03:01:10.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.485+0000 7f732b0bc700 1 -- 172.21.15.84:0/2760335406 wait complete. 2023-10-06T03:01:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.486+0000 7f732b0bc700 1 Processor -- start 2023-10-06T03:01:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.486+0000 7f732b0bc700 1 -- start start 2023-10-06T03:01:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732b0bc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7310004810 0x7f732415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732b0bc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f732415c710 0x7f73240c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732b0bc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73240c53b0 0x7f7324154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732b0bc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732415b960 con 0x7f73240c53b0 2023-10-06T03:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732b0bc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732415b4d0 con 0x7f7310004810 2023-10-06T03:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732b0bc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732415a8c0 con 0x7f732415c710 2023-10-06T03:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732a8bb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73240c53b0 0x7f7324154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732a8bb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73240c53b0 0x7f7324154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60348/0 (socket says 172.21.15.84:60348) 2023-10-06T03:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732a8bb700 1 -- 172.21.15.84:0/3559226288 learned_addr learned my addr 172.21.15.84:0/3559226288 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732a8bb700 1 -- 172.21.15.84:0/3559226288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f732415c710 msgr2=0x7f73240c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732a8bb700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f732415c710 0x7f73240c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732a8bb700 1 -- 172.21.15.84:0/3559226288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7310004810 msgr2=0x7f732415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732a8bb700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7310004810 0x7f732415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732a8bb700 1 -- 172.21.15.84:0/3559226288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732415aba0 con 0x7f73240c53b0 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732a8bb700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73240c53b0 0x7f7324154690 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f73240b6070 tx=0x7f731c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f731a7fc700 1 -- 172.21.15.84:0/3559226288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c006e80 con 0x7f73240c53b0 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f731a7fc700 1 -- 172.21.15.84:0/3559226288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c00c5a0 con 0x7f73240c53b0 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f731a7fc700 1 -- 172.21.15.84:0/3559226288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c00c940 con 0x7f73240c53b0 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.487+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732415ae80 con 0x7f73240c53b0 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.488+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732415a4e0 con 0x7f73240c53b0 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.488+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732415b7b0 con 0x7f73240c53b0 2023-10-06T03:01:10.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.489+0000 7f731a7fc700 1 -- 172.21.15.84:0/3559226288 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f731c00ccf0 con 0x7f73240c53b0 2023-10-06T03:01:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.489+0000 7f731a7fc700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7308066f30 0x7f73080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.489+0000 7f731a7fc700 1 -- 172.21.15.84:0/3559226288 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f731c084160 con 0x7f73240c53b0 2023-10-06T03:01:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.489+0000 7f732a0ba700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7308066f30 0x7f73080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.489+0000 7f732a0ba700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7308066f30 0x7f73080693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f73240b0d70 tx=0x7f7320008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.493+0000 7f731a7fc700 1 -- 172.21.15.84:0/3559226288 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f731c054c80 con 0x7f73240c53b0 2023-10-06T03:01:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.755+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f732405f270 con 0x7f73240c53b0 2023-10-06T03:01:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.755+0000 7f731a7fc700 1 -- 172.21.15.84:0/3559226288 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1342 (secure 0 0 0) 0x7f731c054810 con 0x7f73240c53b0 2023-10-06T03:01:10.756 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:10.756 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":388,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":698974,"bytes_used":2446192640,"bytes_avail":770647920640,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9810,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":91,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-06T03:00:27.873158+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:01:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7308066f30 msgr2=0x7f73080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7308066f30 0x7f73080693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f73240b0d70 tx=0x7f7320008040 comp rx=0 tx=0).stop 2023-10-06T03:01:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73240c53b0 msgr2=0x7f7324154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73240c53b0 0x7f7324154690 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f73240b6070 tx=0x7f731c001670 comp rx=0 tx=0).stop 2023-10-06T03:01:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 shutdown_connections 2023-10-06T03:01:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7308066f30 0x7f73080693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7310004810 0x7f732415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73240c53b0 0x7f7324154690 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 --2- 172.21.15.84:0/3559226288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f732415c710 0x7f73240c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 >> 172.21.15.84:0/3559226288 conn(0x7f732406ed20 msgr2=0x7f73240680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 shutdown_connections 2023-10-06T03:01:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:10.757+0000 7f732b0bc700 1 -- 172.21.15.84:0/3559226288 wait complete. 2023-10-06T03:01:10.769 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T03:01:11.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:11.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.895+0000 7f753f2ff700 1 Processor -- start 2023-10-06T03:01:11.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.895+0000 7f753f2ff700 1 -- start start 2023-10-06T03:01:11.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.896+0000 7f753f2ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75381595a0 0x7f75380aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.896+0000 7f753f2ff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f75380b49e0 0x7f75380aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.896+0000 7f753f2ff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75380b07a0 0x7f75380b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.896+0000 7f753f2ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75380b0ca0 con 0x7f75381595a0 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.896+0000 7f753f2ff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75380b0f80 con 0x7f75380b49e0 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.896+0000 7f753f2ff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380b1260 con 0x7f75380b07a0 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.896+0000 7f753d09b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75381595a0 0x7f75380aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.896+0000 7f753d09b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75381595a0 0x7f75380aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60364/0 (socket says 172.21.15.84:60364) 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.896+0000 7f753d09b700 1 -- 172.21.15.84:0/2587547902 learned_addr learned my addr 172.21.15.84:0/2587547902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f753c89a700 1 --2- 172.21.15.84:0/2587547902 >> v2:172.21.15.131:3300/0 conn(0x7f75380b49e0 0x7f75380aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f753d09b700 1 -- 172.21.15.84:0/2587547902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75380b07a0 msgr2=0x7f75380b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f753d89c700 1 --2- 172.21.15.84:0/2587547902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75380b07a0 0x7f75380b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f753d09b700 1 --2- 172.21.15.84:0/2587547902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75380b07a0 0x7f75380b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f753d09b700 1 -- 172.21.15.84:0/2587547902 >> v2:172.21.15.131:3300/0 conn(0x7f75380b49e0 msgr2=0x7f75380aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f753d09b700 1 --2- 172.21.15.84:0/2587547902 >> v2:172.21.15.131:3300/0 conn(0x7f75380b49e0 0x7f75380aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f753d09b700 1 -- 172.21.15.84:0/2587547902 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380b1540 con 0x7f75381595a0 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f753d09b700 1 --2- 172.21.15.84:0/2587547902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75381595a0 0x7f75380aa570 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7534009990 tx=0x7f7534009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0297b8726379281 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f752ffff700 1 -- 172.21.15.84:0/2587547902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534005c10 con 0x7f75381595a0 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f752ffff700 1 -- 172.21.15.84:0/2587547902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7534005d70 con 0x7f75381595a0 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f752ffff700 1 -- 172.21.15.84:0/2587547902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400b840 con 0x7f75381595a0 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.897+0000 7f753f2ff700 1 -- 172.21.15.84:0/2587547902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75381595a0 msgr2=0x7f75380aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.898+0000 7f753f2ff700 1 --2- 172.21.15.84:0/2587547902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75381595a0 0x7f75380aa570 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7534009990 tx=0x7f7534009220 comp rx=0 tx=0).stop 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.898+0000 7f753f2ff700 1 -- 172.21.15.84:0/2587547902 shutdown_connections 2023-10-06T03:01:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.898+0000 7f753f2ff700 1 --2- 172.21.15.84:0/2587547902 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75380b07a0 0x7f75380b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.898+0000 7f753f2ff700 1 --2- 172.21.15.84:0/2587547902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75381595a0 0x7f75380aa570 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.898+0000 7f753f2ff700 1 --2- 172.21.15.84:0/2587547902 >> v2:172.21.15.131:3300/0 conn(0x7f75380b49e0 0x7f75380aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.898+0000 7f753f2ff700 1 -- 172.21.15.84:0/2587547902 >> 172.21.15.84:0/2587547902 conn(0x7f7538099830 msgr2=0x7f753806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.898+0000 7f753f2ff700 1 -- 172.21.15.84:0/2587547902 shutdown_connections 2023-10-06T03:01:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.898+0000 7f753f2ff700 1 -- 172.21.15.84:0/2587547902 wait complete. 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.899+0000 7f753f2ff700 1 Processor -- start 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.899+0000 7f753f2ff700 1 -- start start 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753f2ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380b07a0 0x7f753814c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753f2ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75380b49e0 0x7f7538150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753f2ff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75381595a0 0x7f753815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753f2ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7538154a60 con 0x7f75380b07a0 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753f2ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753814cee0 con 0x7f75380b49e0 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753f2ff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7538153e50 con 0x7f75381595a0 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d09b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380b07a0 0x7f753814c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d09b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380b07a0 0x7f753814c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60380/0 (socket says 172.21.15.84:60380) 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d09b700 1 -- 172.21.15.84:0/4212188362 learned_addr learned my addr 172.21.15.84:0/4212188362 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d09b700 1 -- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75381595a0 msgr2=0x7f753815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d89c700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75381595a0 0x7f753815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753c89a700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75380b49e0 0x7f7538150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d09b700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75381595a0 0x7f753815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d09b700 1 -- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75380b49e0 msgr2=0x7f7538150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d09b700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75380b49e0 0x7f7538150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d09b700 1 -- 172.21.15.84:0/4212188362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534009480 con 0x7f75380b07a0 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753c89a700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75380b49e0 0x7f7538150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d89c700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75381595a0 0x7f753815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753d09b700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380b07a0 0x7f753814c9a0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f7538067c60 tx=0x7f7534016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f752d7fa700 1 -- 172.21.15.84:0/4212188362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534011ae0 con 0x7f75380b07a0 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f752d7fa700 1 -- 172.21.15.84:0/4212188362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7534011c40 con 0x7f75380b07a0 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.900+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7538154130 con 0x7f75380b07a0 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.901+0000 7f752d7fa700 1 -- 172.21.15.84:0/4212188362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753401b430 con 0x7f75380b07a0 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.901+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75381546f0 con 0x7f75380b07a0 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.901+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75380cd440 con 0x7f75380b07a0 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.902+0000 7f752d7fa700 1 -- 172.21.15.84:0/4212188362 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f753401b800 con 0x7f75380b07a0 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.902+0000 7f752d7fa700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f751c067000 0x7f751c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.902+0000 7f752d7fa700 1 -- 172.21.15.84:0/4212188362 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f75340861e0 con 0x7f75380b07a0 2023-10-06T03:01:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.902+0000 7f753c89a700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f751c067000 0x7f751c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.903+0000 7f753c89a700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f751c067000 0x7f751c0694b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f753816d070 tx=0x7f7528008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:11.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:11.906+0000 7f752d7fa700 1 -- 172.21.15.84:0/4212188362 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7534053230 con 0x7f75380b07a0 2023-10-06T03:01:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.131+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7538064ad0 con 0x7f75380b07a0 2023-10-06T03:01:12.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.132+0000 7f752d7fa700 1 -- 172.21.15.84:0/4212188362 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4639 (secure 0 0 0) 0x7f7534056850 con 0x7f75380b07a0 2023-10-06T03:01:12.133 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:12.133 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:09.208269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f751c067000 msgr2=0x7f751c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f751c067000 0x7f751c0694b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f753816d070 tx=0x7f7528008040 comp rx=0 tx=0).stop 2023-10-06T03:01:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380b07a0 msgr2=0x7f753814c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380b07a0 0x7f753814c9a0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f7538067c60 tx=0x7f7534016000 comp rx=0 tx=0).stop 2023-10-06T03:01:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 shutdown_connections 2023-10-06T03:01:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f751c067000 0x7f751c0694b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75381595a0 0x7f753815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75380b07a0 0x7f753814c9a0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 --2- 172.21.15.84:0/4212188362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75380b49e0 0x7f7538150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 >> 172.21.15.84:0/4212188362 conn(0x7f7538099830 msgr2=0x7f75380ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 shutdown_connections 2023-10-06T03:01:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.134+0000 7f753f2ff700 1 -- 172.21.15.84:0/4212188362 wait complete. 2023-10-06T03:01:12.136 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 91 2023-10-06T03:01:12.147 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:12.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:12.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.261+0000 7f64df59e700 1 Processor -- start 2023-10-06T03:01:12.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.261+0000 7f64df59e700 1 -- start start 2023-10-06T03:01:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64df59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64e0159480 0x7f64e00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64df59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f64e00b2140 0x7f64e00b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64df59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e00cb7e0 con 0x7f64e00b3610 2023-10-06T03:01:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64df59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e00b08a0 con 0x7f64e0159480 2023-10-06T03:01:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64df59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e00cb190 con 0x7f64e00b2140 2023-10-06T03:01:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64de59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64e0159480 0x7f64e00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64de59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f64e0159480 0x7f64e00b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60384/0 (socket says 172.21.15.84:60384) 2023-10-06T03:01:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64de59c700 1 -- 172.21.15.84:0/3968891212 learned_addr learned my addr 172.21.15.84:0/3968891212 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:12.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64de59c700 1 -- 172.21.15.84:0/3968891212 >> v2:172.21.15.131:3300/0 conn(0x7f64e00b2140 msgr2=0x7f64e00b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64de59c700 1 --2- 172.21.15.84:0/3968891212 >> v2:172.21.15.131:3300/0 conn(0x7f64e00b2140 0x7f64e00b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64de59c700 1 -- 172.21.15.84:0/3968891212 >> v1:172.21.15.131:6789/0 conn(0x7f64e00b3610 legacy=0x7f64e00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64de59c700 1 -- 172.21.15.84:0/3968891212 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e00cb470 con 0x7f64e0159480 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64de59c700 1 --2- 172.21.15.84:0/3968891212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e0159480 0x7f64e00b30d0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f64e00ca830 tx=0x7f64d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bc8c3bda454f65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64ddd9b700 1 -- 172.21.15.84:0/3968891212 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000b820 con 0x7f64e0159480 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.262+0000 7f64ddd9b700 1 -- 172.21.15.84:0/3968891212 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d000b980 con 0x7f64e0159480 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.263+0000 7f64ddd9b700 1 -- 172.21.15.84:0/3968891212 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000bd20 con 0x7f64e0159480 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.263+0000 7f64df59e700 1 -- 172.21.15.84:0/3968891212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e0159480 msgr2=0x7f64e00b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.263+0000 7f64df59e700 1 --2- 172.21.15.84:0/3968891212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e0159480 0x7f64e00b30d0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f64e00ca830 tx=0x7f64d0009250 comp rx=0 tx=0).stop 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.263+0000 7f64df59e700 1 -- 172.21.15.84:0/3968891212 shutdown_connections 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.263+0000 7f64df59e700 1 --2- 172.21.15.84:0/3968891212 >> v2:172.21.15.131:3300/0 conn(0x7f64e00b2140 0x7f64e00b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.263+0000 7f64df59e700 1 --2- 172.21.15.84:0/3968891212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e0159480 0x7f64e00b30d0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.263+0000 7f64df59e700 1 -- 172.21.15.84:0/3968891212 >> 172.21.15.84:0/3968891212 conn(0x7f64e006ed20 msgr2=0x7f64e006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.263+0000 7f64df59e700 1 -- 172.21.15.84:0/3968891212 shutdown_connections 2023-10-06T03:01:12.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.263+0000 7f64df59e700 1 -- 172.21.15.84:0/3968891212 wait complete. 2023-10-06T03:01:12.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.264+0000 7f64df59e700 1 Processor -- start 2023-10-06T03:01:12.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.264+0000 7f64df59e700 1 -- start start 2023-10-06T03:01:12.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64df59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64e00b2140 0x7f64e00c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64df59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e00b3610 0x7f64e0152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64df59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64e0159480 0x7f64e015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64df59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00c4990 con 0x7f64e00b3610 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64df59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00c8940 con 0x7f64e0159480 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64df59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e01532d0 con 0x7f64e00b2140 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64d5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e00b3610 0x7f64e0152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64d5d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e00b3610 0x7f64e0152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:60386/0 (socket says 172.21.15.84:60386) 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64d5d9b700 1 -- 172.21.15.84:0/3722619876 learned_addr learned my addr 172.21.15.84:0/3722619876 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64de59c700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64e00b2140 0x7f64e00c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64ded9d700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64e0159480 0x7f64e015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64d5d9b700 1 -- 172.21.15.84:0/3722619876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64e00b2140 msgr2=0x7f64e00c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64d5d9b700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64e00b2140 0x7f64e00c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64d5d9b700 1 -- 172.21.15.84:0/3722619876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64e0159480 msgr2=0x7f64e015aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64d5d9b700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64e0159480 0x7f64e015aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.265+0000 7f64d5d9b700 1 -- 172.21.15.84:0/3722619876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00094f0 con 0x7f64e00b3610 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.266+0000 7f64d5d9b700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e00b3610 0x7f64e0152d90 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f64c800b600 tx=0x7f64c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.266+0000 7f64d6ffd700 1 -- 172.21.15.84:0/3722619876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800f510 con 0x7f64e00b3610 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.266+0000 7f64d6ffd700 1 -- 172.21.15.84:0/3722619876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c800f690 con 0x7f64e00b3610 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.266+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e015b3c0 con 0x7f64e00b3610 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.266+0000 7f64d6ffd700 1 -- 172.21.15.84:0/3722619876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c800fa50 con 0x7f64e00b3610 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.266+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e015b980 con 0x7f64e00b3610 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.267+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e00c8af0 con 0x7f64e00b3610 2023-10-06T03:01:12.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.267+0000 7f64d6ffd700 1 -- 172.21.15.84:0/3722619876 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64c801a400 con 0x7f64e00b3610 2023-10-06T03:01:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.267+0000 7f64d6ffd700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64c0066f30 0x7f64c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.268+0000 7f64d6ffd700 1 -- 172.21.15.84:0/3722619876 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f64c8084160 con 0x7f64e00b3610 2023-10-06T03:01:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.268+0000 7f64de59c700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64c0066f30 0x7f64c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.268+0000 7f64de59c700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64c0066f30 0x7f64c00693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f64e00ca830 tx=0x7f64d0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.272+0000 7f64d6ffd700 1 -- 172.21.15.84:0/3722619876 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64e00c8af0 con 0x7f64e00b3610 2023-10-06T03:01:12.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.532+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f64e00c8ab0 con 0x7f64e00b3610 2023-10-06T03:01:12.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.533+0000 7f64d6ffd700 1 -- 172.21.15.84:0/3722619876 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1342 (secure 0 0 0) 0x7f64c80511b0 con 0x7f64e00b3610 2023-10-06T03:01:12.533 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:12.534 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":390,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":698974,"bytes_used":2446192640,"bytes_avail":770647920640,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7677,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":91,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-06T03:00:27.873158+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:01:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64c0066f30 msgr2=0x7f64c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64c0066f30 0x7f64c00693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f64e00ca830 tx=0x7f64d0016000 comp rx=0 tx=0).stop 2023-10-06T03:01:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e00b3610 msgr2=0x7f64e0152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e00b3610 0x7f64e0152d90 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f64c800b600 tx=0x7f64c80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 shutdown_connections 2023-10-06T03:01:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64c0066f30 0x7f64c00693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64e0159480 0x7f64e015aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64e00b2140 0x7f64e00c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 --2- 172.21.15.84:0/3722619876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64e00b3610 0x7f64e0152d90 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 >> 172.21.15.84:0/3722619876 conn(0x7f64e006ed20 msgr2=0x7f64e0156890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:12.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 shutdown_connections 2023-10-06T03:01:12.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:12.535+0000 7f64df59e700 1 -- 172.21.15.84:0/3722619876 wait complete. 2023-10-06T03:01:12.547 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T03:01:13.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:13.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.673+0000 7f0641dac700 1 Processor -- start 2023-10-06T03:01:13.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.673+0000 7f0641dac700 1 -- start start 2023-10-06T03:01:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f0641dac700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f063c1595a0 0x7f063c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f0641dac700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c0b49e0 0x7f063c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f0641dac700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c0b0ca0 con 0x7f063c0b07a0 2023-10-06T03:01:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f0641dac700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0b0f80 con 0x7f063c1595a0 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f0641dac700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0b1260 con 0x7f063c0b49e0 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f063b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f063c1595a0 0x7f063c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f063bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f063c0b07a0 0x7f063c0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:32772/0 (socket says 172.21.15.84:32772) 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f063bfff700 1 -- 172.21.15.84:0/2560059227 learned_addr learned my addr 172.21.15.84:0/2560059227 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f063b7fe700 1 -- 172.21.15.84:0/2560059227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c0b49e0 msgr2=0x7f063c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f063b7fe700 1 --2- 172.21.15.84:0/2560059227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c0b49e0 0x7f063c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f063b7fe700 1 -- 172.21.15.84:0/2560059227 >> v1:172.21.15.84:6789/0 conn(0x7f063c0b07a0 legacy=0x7f063c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.674+0000 7f063a7fc700 1 -- 172.21.15.84:0/2560059227 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767908848 0 0) 0x7f063c0b0ca0 con 0x7f063c0b07a0 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f063b7fe700 1 -- 172.21.15.84:0/2560059227 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0b1540 con 0x7f063c1595a0 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f063b7fe700 1 --2- 172.21.15.84:0/2560059227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c1595a0 0x7f063c0aa570 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f062c009eb0 tx=0x7f062c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3129c31a9512f45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f063a7fc700 1 -- 172.21.15.84:0/2560059227 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00e070 con 0x7f063c1595a0 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f063a7fc700 1 -- 172.21.15.84:0/2560059227 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c00bc30 con 0x7f063c1595a0 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f063a7fc700 1 -- 172.21.15.84:0/2560059227 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c012430 con 0x7f063c1595a0 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f0641dac700 1 -- 172.21.15.84:0/2560059227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c1595a0 msgr2=0x7f063c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f0641dac700 1 --2- 172.21.15.84:0/2560059227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c1595a0 0x7f063c0aa570 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f062c009eb0 tx=0x7f062c009780 comp rx=0 tx=0).stop 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f0641dac700 1 -- 172.21.15.84:0/2560059227 shutdown_connections 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f0641dac700 1 --2- 172.21.15.84:0/2560059227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c1595a0 0x7f063c0aa570 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f0641dac700 1 --2- 172.21.15.84:0/2560059227 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c0b49e0 0x7f063c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f0641dac700 1 -- 172.21.15.84:0/2560059227 >> 172.21.15.84:0/2560059227 conn(0x7f063c099830 msgr2=0x7f063c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f0641dac700 1 -- 172.21.15.84:0/2560059227 shutdown_connections 2023-10-06T03:01:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.675+0000 7f0641dac700 1 -- 172.21.15.84:0/2560059227 wait complete. 2023-10-06T03:01:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.677+0000 7f0641dac700 1 Processor -- start 2023-10-06T03:01:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.677+0000 7f0641dac700 1 -- start start 2023-10-06T03:01:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.677+0000 7f0641dac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0b07a0 0x7f063c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.677+0000 7f0641dac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0b49e0 0x7f063c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.677+0000 7f0641dac700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c1595a0 0x7f063c1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.677+0000 7f0641dac700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c159fc0 con 0x7f063c0b49e0 2023-10-06T03:01:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.677+0000 7f0641dac700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0af3d0 con 0x7f063c0b07a0 2023-10-06T03:01:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.677+0000 7f0641dac700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c154310 con 0x7f063c1595a0 2023-10-06T03:01:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0b49e0 0x7f063c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0b49e0 0x7f063c154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56228/0 (socket says 172.21.15.84:56228) 2023-10-06T03:01:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063affd700 1 -- 172.21.15.84:0/3316771457 learned_addr learned my addr 172.21.15.84:0/3316771457 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063bfff700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c1595a0 0x7f063c1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063b7fe700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0b07a0 0x7f063c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063affd700 1 -- 172.21.15.84:0/3316771457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c1595a0 msgr2=0x7f063c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063affd700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c1595a0 0x7f063c1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063affd700 1 -- 172.21.15.84:0/3316771457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0b07a0 msgr2=0x7f063c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063affd700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0b07a0 0x7f063c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063affd700 1 -- 172.21.15.84:0/3316771457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c009a20 con 0x7f063c0b49e0 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f063affd700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0b49e0 0x7f063c154f60 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f062400b810 tx=0x7f0624009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f06337fe700 1 -- 172.21.15.84:0/3316771457 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062400f510 con 0x7f063c0b49e0 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f06337fe700 1 -- 172.21.15.84:0/3316771457 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062400f690 con 0x7f063c0b49e0 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f06337fe700 1 -- 172.21.15.84:0/3316771457 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062400fa50 con 0x7f063c0b49e0 2023-10-06T03:01:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c1545f0 con 0x7f063c0b49e0 2023-10-06T03:01:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.678+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c159c50 con 0x7f063c0b49e0 2023-10-06T03:01:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.679+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c15a130 con 0x7f063c0b49e0 2023-10-06T03:01:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.679+0000 7f06337fe700 1 -- 172.21.15.84:0/3316771457 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f062401a400 con 0x7f063c0b49e0 2023-10-06T03:01:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.680+0000 7f06337fe700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f061c066f30 0x7f061c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.680+0000 7f06337fe700 1 -- 172.21.15.84:0/3316771457 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0624084250 con 0x7f063c0b49e0 2023-10-06T03:01:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.680+0000 7f063b7fe700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f061c066f30 0x7f061c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.680+0000 7f063b7fe700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f061c066f30 0x7f061c0693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f062c009eb0 tx=0x7f062c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.684+0000 7f06337fe700 1 -- 172.21.15.84:0/3316771457 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06240512a0 con 0x7f063c0b49e0 2023-10-06T03:01:13.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.911+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f063c064ad0 con 0x7f063c0b49e0 2023-10-06T03:01:13.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.912+0000 7f06337fe700 1 -- 172.21.15.84:0/3316771457 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4639 (secure 0 0 0) 0x7f06240548c0 con 0x7f063c0b49e0 2023-10-06T03:01:13.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:13.913 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:09.208269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:13.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f061c066f30 msgr2=0x7f061c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f061c066f30 0x7f061c0693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f062c009eb0 tx=0x7f062c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0b49e0 msgr2=0x7f063c154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0b49e0 0x7f063c154f60 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f062400b810 tx=0x7f0624009250 comp rx=0 tx=0).stop 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 shutdown_connections 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f061c066f30 0x7f061c0693e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f063c0b07a0 0x7f063c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f063c1595a0 0x7f063c1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 --2- 172.21.15.84:0/3316771457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f063c0b49e0 0x7f063c154f60 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 >> 172.21.15.84:0/3316771457 conn(0x7f063c099830 msgr2=0x7f063c158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 shutdown_connections 2023-10-06T03:01:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:13.914+0000 7f0641dac700 1 -- 172.21.15.84:0/3316771457 wait complete. 2023-10-06T03:01:13.916 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 91 2023-10-06T03:01:13.926 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:13.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.038+0000 7fa3057dd700 1 Processor -- start 2023-10-06T03:01:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.038+0000 7fa3057dd700 1 -- start start 2023-10-06T03:01:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.039+0000 7fa3057dd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3000ac040 0x7fa300069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.039+0000 7fa3057dd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa300069aa0 0x7fa3000c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.039+0000 7fa3057dd700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa300069f00 con 0x7fa3000adf60 2023-10-06T03:01:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.039+0000 7fa3057dd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa300156150 con 0x7fa3000ac040 2023-10-06T03:01:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.039+0000 7fa3057dd700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000c7370 con 0x7fa300069aa0 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.039+0000 7fa2f67fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3000ac040 0x7fa300069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.039+0000 7fa2f67fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3000ac040 0x7fa300069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56236/0 (socket says 172.21.15.84:56236) 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.039+0000 7fa2f67fc700 1 -- 172.21.15.84:0/240515983 learned_addr learned my addr 172.21.15.84:0/240515983 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.039+0000 7fa2ff7fe700 1 --2- 172.21.15.84:0/240515983 >> v2:172.21.15.131:3300/0 conn(0x7fa300069aa0 0x7fa3000c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa2f67fc700 1 -- 172.21.15.84:0/240515983 >> v2:172.21.15.131:3300/0 conn(0x7fa300069aa0 msgr2=0x7fa3000c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa2f67fc700 1 --2- 172.21.15.84:0/240515983 >> v2:172.21.15.131:3300/0 conn(0x7fa300069aa0 0x7fa3000c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa2f67fc700 1 -- 172.21.15.84:0/240515983 >> v1:172.21.15.131:6789/0 conn(0x7fa3000adf60 legacy=0x7fa30006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa2f67fc700 1 -- 172.21.15.84:0/240515983 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000c6760 con 0x7fa3000ac040 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa2ff7fe700 1 --2- 172.21.15.84:0/240515983 >> v2:172.21.15.131:3300/0 conn(0x7fa300069aa0 0x7fa3000c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa2f67fc700 1 --2- 172.21.15.84:0/240515983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 0x7fa300069560 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fa3000abe10 tx=0x7fa2e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badbfda216644556 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa2fe7fc700 1 -- 172.21.15.84:0/240515983 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800b860 con 0x7fa3000ac040 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa2fe7fc700 1 -- 172.21.15.84:0/240515983 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e800b9c0 con 0x7fa3000ac040 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa2fe7fc700 1 -- 172.21.15.84:0/240515983 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800bd60 con 0x7fa3000ac040 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa3057dd700 1 -- 172.21.15.84:0/240515983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 msgr2=0x7fa300069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa3057dd700 1 --2- 172.21.15.84:0/240515983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 0x7fa300069560 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fa3000abe10 tx=0x7fa2e8009250 comp rx=0 tx=0).stop 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa3057dd700 1 -- 172.21.15.84:0/240515983 shutdown_connections 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa3057dd700 1 --2- 172.21.15.84:0/240515983 >> v2:172.21.15.131:3300/0 conn(0x7fa300069aa0 0x7fa3000c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa3057dd700 1 --2- 172.21.15.84:0/240515983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 0x7fa300069560 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa3057dd700 1 -- 172.21.15.84:0/240515983 >> 172.21.15.84:0/240515983 conn(0x7fa3000680c0 msgr2=0x7fa3000cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa3057dd700 1 -- 172.21.15.84:0/240515983 shutdown_connections 2023-10-06T03:01:14.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.040+0000 7fa3057dd700 1 -- 172.21.15.84:0/240515983 wait complete. 2023-10-06T03:01:14.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.042+0000 7fa3057dd700 1 Processor -- start 2023-10-06T03:01:14.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.042+0000 7fa3057dd700 1 -- start start 2023-10-06T03:01:14.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.042+0000 7fa3057dd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa300069aa0 0x7fa300155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.042+0000 7fa3057dd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 0x7fa300156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.042+0000 7fa3057dd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3000adf60 0x7fa3000c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.042+0000 7fa3057dd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300157de0 con 0x7fa3000ac040 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.042+0000 7fa3057dd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300157540 con 0x7fa3000adf60 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.042+0000 7fa3057dd700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa300157820 con 0x7fa300069aa0 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.042+0000 7fa2f67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 0x7fa300156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 0x7fa300156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56252/0 (socket says 172.21.15.84:56252) 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f67fc700 1 -- 172.21.15.84:0/2827289985 learned_addr learned my addr 172.21.15.84:0/2827289985 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2ff7fe700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3000adf60 0x7fa3000c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2feffd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa300069aa0 0x7fa300155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f67fc700 1 -- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa300069aa0 msgr2=0x7fa300155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f67fc700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa300069aa0 0x7fa300155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f67fc700 1 -- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3000adf60 msgr2=0x7fa3000c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f67fc700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3000adf60 0x7fa3000c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f67fc700 1 -- 172.21.15.84:0/2827289985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80094f0 con 0x7fa3000ac040 2023-10-06T03:01:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2ff7fe700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3000adf60 0x7fa3000c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2feffd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa300069aa0 0x7fa300155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f67fc700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 0x7fa300156b80 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009290 tx=0x7fa2e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f77fe700 1 -- 172.21.15.84:0/2827289985 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8011e60 con 0x7fa3000ac040 2023-10-06T03:01:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f77fe700 1 -- 172.21.15.84:0/2827289985 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e801f070 con 0x7fa3000ac040 2023-10-06T03:01:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa2f77fe700 1 -- 172.21.15.84:0/2827289985 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e801a870 con 0x7fa3000ac040 2023-10-06T03:01:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa300157b00 con 0x7fa3000ac040 2023-10-06T03:01:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.043+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa300156640 con 0x7fa3000ac040 2023-10-06T03:01:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.044+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa300167e00 con 0x7fa3000ac040 2023-10-06T03:01:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.044+0000 7fa2f77fe700 1 -- 172.21.15.84:0/2827289985 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2e801abe0 con 0x7fa3000ac040 2023-10-06T03:01:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.045+0000 7fa2f77fe700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2e0066f30 0x7fa2e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.045+0000 7fa2f77fe700 1 -- 172.21.15.84:0/2827289985 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa2e8021070 con 0x7fa3000ac040 2023-10-06T03:01:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.045+0000 7fa2feffd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2e0066f30 0x7fa2e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.045+0000 7fa2feffd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2e0066f30 0x7fa2e00693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00017a0 tx=0x7fa2f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.049+0000 7fa2f77fe700 1 -- 172.21.15.84:0/2827289985 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa300167e00 con 0x7fa3000ac040 2023-10-06T03:01:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.310+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa300167e00 con 0x7fa3000ac040 2023-10-06T03:01:14.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.310+0000 7fa2f77fe700 1 -- 172.21.15.84:0/2827289985 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1342 (secure 0 0 0) 0x7fa300167e00 con 0x7fa3000ac040 2023-10-06T03:01:14.311 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:14.311 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":392,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2446209024,"bytes_avail":770647904256,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":8360,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":91,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-06T03:00:27.873158+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:01:14.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2e0066f30 msgr2=0x7fa2e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2e0066f30 0x7fa2e00693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00017a0 tx=0x7fa2f0009040 comp rx=0 tx=0).stop 2023-10-06T03:01:14.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 msgr2=0x7fa300156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 0x7fa300156b80 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009290 tx=0x7fa2e8017000 comp rx=0 tx=0).stop 2023-10-06T03:01:14.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 shutdown_connections 2023-10-06T03:01:14.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa2e0066f30 0x7fa2e00693e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3000adf60 0x7fa3000c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa300069aa0 0x7fa300155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 --2- 172.21.15.84:0/2827289985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3000ac040 0x7fa300156b80 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 >> 172.21.15.84:0/2827289985 conn(0x7fa3000680c0 msgr2=0x7fa3000cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:14.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 shutdown_connections 2023-10-06T03:01:14.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:14.312+0000 7fa3057dd700 1 -- 172.21.15.84:0/2827289985 wait complete. 2023-10-06T03:01:14.325 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T03:01:15.245 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:01:15.245+0000 7fedc1127700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T03:01:15.325 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:15.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.440+0000 7f0ae1453700 1 Processor -- start 2023-10-06T03:01:15.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.440+0000 7f0ae1453700 1 -- start start 2023-10-06T03:01:15.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.440+0000 7f0ae1453700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0adc0b07a0 0x7f0adc0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.440+0000 7f0ae1453700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0b0ca0 con 0x7f0adc1595a0 2023-10-06T03:01:15.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.440+0000 7f0ae1453700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0b0f80 con 0x7f0adc0b49e0 2023-10-06T03:01:15.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.440+0000 7f0ae1453700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0ab390 con 0x7f0adc0b07a0 2023-10-06T03:01:15.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0adaffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0adc1595a0 0x7f0adc0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:32784/0 (socket says 172.21.15.84:32784) 2023-10-06T03:01:15.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0adaffd700 1 -- 172.21.15.84:0/4096756620 learned_addr learned my addr 172.21.15.84:0/4096756620 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0adb7fe700 1 --2- 172.21.15.84:0/4096756620 >> v2:172.21.15.131:3300/0 conn(0x7f0adc0b07a0 0x7f0adc0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593795655 0 0) 0x7f0adc0b0ca0 con 0x7f0adc1595a0 2023-10-06T03:01:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac8003570 con 0x7f0adc1595a0 2023-10-06T03:01:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 815062529 0 0) 0x7f0ac8003570 con 0x7f0adc1595a0 2023-10-06T03:01:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 >> v2:172.21.15.131:3300/0 conn(0x7f0adc0b07a0 msgr2=0x7f0adc0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 --2- 172.21.15.84:0/4096756620 >> v2:172.21.15.131:3300/0 conn(0x7f0adc0b07a0 0x7f0adc0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 >> v1:172.21.15.131:6789/0 conn(0x7f0adc0b49e0 legacy=0x7f0adc0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0b1260 con 0x7f0adc1595a0 2023-10-06T03:01:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f0acc0015f0 con 0x7f0adc1595a0 2023-10-06T03:01:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 >> v1:172.21.15.84:6789/0 conn(0x7f0adc1595a0 legacy=0x7f0adc0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac8003a60 0x7f0ac8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ac8004810 0x7f0ac8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ac80051c0 0x7f0ac800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0ab390 con 0x7f0ac8004810 2023-10-06T03:01:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac800c050 con 0x7f0ac8003a60 2023-10-06T03:01:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac800c210 con 0x7f0ac80051c0 2023-10-06T03:01:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0ad27fc700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ac8004810 0x7f0ac8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0adaffd700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac8003a60 0x7f0ac8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.441+0000 7f0adb7fe700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ac80051c0 0x7f0ac800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ad27fc700 1 -- 172.21.15.84:0/4096756620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ac80051c0 msgr2=0x7f0ac800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ad27fc700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ac80051c0 0x7f0ac800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ad27fc700 1 -- 172.21.15.84:0/4096756620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac8003a60 msgr2=0x7f0ac8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ad27fc700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac8003a60 0x7f0ac8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0adb7fe700 1 -- 172.21.15.84:0/4096756620 reap_dead start 2023-10-06T03:01:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ad27fc700 1 -- 172.21.15.84:0/4096756620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8003570 con 0x7f0ac8004810 2023-10-06T03:01:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ad27fc700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ac8004810 0x7f0ac8004c80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0adc088e20 tx=0x7f0ac4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5800c6a1d60ee2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400c5d0 con 0x7f0ac8004810 2023-10-06T03:01:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac400c730 con 0x7f0ac8004810 2023-10-06T03:01:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ada7fc700 1 -- 172.21.15.84:0/4096756620 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400cad0 con 0x7f0ac8004810 2023-10-06T03:01:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ae1453700 1 -- 172.21.15.84:0/4096756620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ac8004810 msgr2=0x7f0ac8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ae1453700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ac8004810 0x7f0ac8004c80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0adc088e20 tx=0x7f0ac4007d10 comp rx=0 tx=0).stop 2023-10-06T03:01:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ae1453700 1 -- 172.21.15.84:0/4096756620 shutdown_connections 2023-10-06T03:01:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ae1453700 1 --2- 172.21.15.84:0/4096756620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ac8004810 0x7f0ac8004c80 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ae1453700 1 -- 172.21.15.84:0/4096756620 >> 172.21.15.84:0/4096756620 conn(0x7f0adc099830 msgr2=0x7f0adc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:15.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.442+0000 7f0ae1453700 1 -- 172.21.15.84:0/4096756620 shutdown_connections 2023-10-06T03:01:15.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.443+0000 7f0ae1453700 1 -- 172.21.15.84:0/4096756620 wait complete. 2023-10-06T03:01:15.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.444+0000 7f0ae1453700 1 Processor -- start 2023-10-06T03:01:15.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.444+0000 7f0ae1453700 1 -- start start 2023-10-06T03:01:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.444+0000 7f0ae1453700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac8004810 0x7f0adc0ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.444+0000 7f0ae1453700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc0aaea0 0x7f0adc157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.444+0000 7f0ae1453700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc169dd0 0x7f0adc0cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.444+0000 7f0ae1453700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc16ada0 con 0x7f0adc169dd0 2023-10-06T03:01:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.444+0000 7f0ae1453700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc09ce80 con 0x7f0ac8004810 2023-10-06T03:01:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.444+0000 7f0ae1453700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc16a7e0 con 0x7f0adc0aaea0 2023-10-06T03:01:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc169dd0 0x7f0adc0cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc169dd0 0x7f0adc0cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56278/0 (socket says 172.21.15.84:56278) 2023-10-06T03:01:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adb7fe700 1 -- 172.21.15.84:0/3217095360 learned_addr learned my addr 172.21.15.84:0/3217095360 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adaffd700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac8004810 0x7f0adc0ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0ad27fc700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc0aaea0 0x7f0adc157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adb7fe700 1 -- 172.21.15.84:0/3217095360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc0aaea0 msgr2=0x7f0adc157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adb7fe700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc0aaea0 0x7f0adc157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adb7fe700 1 -- 172.21.15.84:0/3217095360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac8004810 msgr2=0x7f0adc0ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adb7fe700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac8004810 0x7f0adc0ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adb7fe700 1 -- 172.21.15.84:0/3217095360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc16aac0 con 0x7f0adc169dd0 2023-10-06T03:01:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0adb7fe700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc169dd0 0x7f0adc0cec00 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40094d0 tx=0x7f0ad400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:15.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0ad37fe700 1 -- 172.21.15.84:0/3217095360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400e040 con 0x7f0adc169dd0 2023-10-06T03:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0ad37fe700 1 -- 172.21.15.84:0/3217095360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad400f040 con 0x7f0adc169dd0 2023-10-06T03:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc09cb10 con 0x7f0adc169dd0 2023-10-06T03:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0ad37fe700 1 -- 172.21.15.84:0/3217095360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400fdf0 con 0x7f0adc169dd0 2023-10-06T03:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.445+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc16a230 con 0x7f0adc169dd0 2023-10-06T03:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.446+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc09c970 con 0x7f0adc169dd0 2023-10-06T03:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.447+0000 7f0ad37fe700 1 -- 172.21.15.84:0/3217095360 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ad4015640 con 0x7f0adc169dd0 2023-10-06T03:01:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.447+0000 7f0ad37fe700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0abc066f30 0x7f0abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.447+0000 7f0ad37fe700 1 -- 172.21.15.84:0/3217095360 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0ad4084fd0 con 0x7f0adc169dd0 2023-10-06T03:01:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.447+0000 7f0adaffd700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0abc066f30 0x7f0abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.447+0000 7f0adaffd700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0abc066f30 0x7f0abc0693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0acc001720 tx=0x7f0acc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:15.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.451+0000 7f0ad37fe700 1 -- 172.21.15.84:0/3217095360 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0adc09c970 con 0x7f0adc169dd0 2023-10-06T03:01:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.676+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0adc09c970 con 0x7f0adc169dd0 2023-10-06T03:01:15.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.677+0000 7f0ad37fe700 1 -- 172.21.15.84:0/3217095360 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4640 (secure 0 0 0) 0x7f0adc09c970 con 0x7f0adc169dd0 2023-10-06T03:01:15.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:15.677 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:15.245697+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.678+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0abc066f30 msgr2=0x7f0abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0abc066f30 0x7f0abc0693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0acc001720 tx=0x7f0acc009040 comp rx=0 tx=0).stop 2023-10-06T03:01:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc169dd0 msgr2=0x7f0adc0cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc169dd0 0x7f0adc0cec00 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40094d0 tx=0x7f0ad400b040 comp rx=0 tx=0).stop 2023-10-06T03:01:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 shutdown_connections 2023-10-06T03:01:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0abc066f30 0x7f0abc0693e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac8004810 0x7f0adc0ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0adc169dd0 0x7f0adc0cec00 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 --2- 172.21.15.84:0/3217095360 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0adc0aaea0 0x7f0adc157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 >> 172.21.15.84:0/3217095360 conn(0x7f0adc099830 msgr2=0x7f0adc0695b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 shutdown_connections 2023-10-06T03:01:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.679+0000 7f0ae1453700 1 -- 172.21.15.84:0/3217095360 wait complete. 2023-10-06T03:01:15.680 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 92 2023-10-06T03:01:15.691 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:15.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.805+0000 7f1b052a6700 1 Processor -- start 2023-10-06T03:01:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.805+0000 7f1b052a6700 1 -- start start 2023-10-06T03:01:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.806+0000 7f1b052a6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1b00159480 0x7f1b000b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.806+0000 7f1b052a6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b000cb7e0 con 0x7f1b000b2140 2023-10-06T03:01:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.806+0000 7f1b052a6700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b000b08a0 con 0x7f1b000b3610 2023-10-06T03:01:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.806+0000 7f1b052a6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b000cb190 con 0x7f1b00159480 2023-10-06T03:01:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.806+0000 7f1b04aa5700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1b000b2140 0x7f1b000b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:32792/0 (socket says 172.21.15.84:32792) 2023-10-06T03:01:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.806+0000 7f1b04aa5700 1 -- 172.21.15.84:0/2562054753 learned_addr learned my addr 172.21.15.84:0/2562054753 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.806+0000 7f1afffff700 1 --2- 172.21.15.84:0/2562054753 >> v2:172.21.15.131:3300/0 conn(0x7f1b00159480 0x7f1b000b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.806+0000 7f1afeffd700 1 -- 172.21.15.84:0/2562054753 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818233338 0 0) 0x7f1b000cb7e0 con 0x7f1b000b2140 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.806+0000 7f1afeffd700 1 -- 172.21.15.84:0/2562054753 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae8003570 con 0x7f1b000b2140 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1afeffd700 1 -- 172.21.15.84:0/2562054753 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3058655140 0 0) 0x7f1ae8003570 con 0x7f1b000b2140 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1afffff700 1 -- 172.21.15.84:0/2562054753 >> v1:172.21.15.131:6789/0 conn(0x7f1b000b3610 legacy=0x7f1b000cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1afffff700 1 -- 172.21.15.84:0/2562054753 >> v1:172.21.15.84:6789/0 conn(0x7f1b000b2140 legacy=0x7f1b000b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1afffff700 1 -- 172.21.15.84:0/2562054753 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000cb470 con 0x7f1b00159480 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1afffff700 1 --2- 172.21.15.84:0/2562054753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b00159480 0x7f1b000b30d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1af00098e0 tx=0x7f1af00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad5e772ef44e3f9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1afeffd700 1 -- 172.21.15.84:0/2562054753 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af80017f0 con 0x7f1b00159480 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1afeffd700 1 -- 172.21.15.84:0/2562054753 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0011420 con 0x7f1b00159480 2023-10-06T03:01:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1afeffd700 1 -- 172.21.15.84:0/2562054753 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af00117c0 con 0x7f1b00159480 2023-10-06T03:01:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1b052a6700 1 -- 172.21.15.84:0/2562054753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b00159480 msgr2=0x7f1b000b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.807+0000 7f1b052a6700 1 --2- 172.21.15.84:0/2562054753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b00159480 0x7f1b000b30d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1af00098e0 tx=0x7f1af00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.808+0000 7f1b052a6700 1 -- 172.21.15.84:0/2562054753 shutdown_connections 2023-10-06T03:01:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.808+0000 7f1b052a6700 1 --2- 172.21.15.84:0/2562054753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b00159480 0x7f1b000b30d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.808+0000 7f1b052a6700 1 -- 172.21.15.84:0/2562054753 >> 172.21.15.84:0/2562054753 conn(0x7f1b0006ed20 msgr2=0x7f1b0006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.808+0000 7f1b052a6700 1 -- 172.21.15.84:0/2562054753 shutdown_connections 2023-10-06T03:01:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.808+0000 7f1b052a6700 1 -- 172.21.15.84:0/2562054753 wait complete. 2023-10-06T03:01:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.809+0000 7f1b052a6700 1 Processor -- start 2023-10-06T03:01:15.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.809+0000 7f1b052a6700 1 -- start start 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.809+0000 7f1b052a6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b2140 0x7f1b000c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.809+0000 7f1b052a6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b000b3610 0x7f1b00147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.809+0000 7f1b052a6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b00159480 0x7f1b000cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.809+0000 7f1b052a6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000ceeb0 con 0x7f1b000b3610 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.809+0000 7f1b052a6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000c7a90 con 0x7f1b00159480 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.809+0000 7f1b052a6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000cebd0 con 0x7f1b000b2140 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1aff7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b000b3610 0x7f1b00147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1aff7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b000b3610 0x7f1b00147550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56286/0 (socket says 172.21.15.84:56286) 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1aff7fe700 1 -- 172.21.15.84:0/165439352 learned_addr learned my addr 172.21.15.84:0/165439352 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:15.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1b04aa5700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b00159480 0x7f1b000cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1afffff700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b2140 0x7f1b000c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1aff7fe700 1 -- 172.21.15.84:0/165439352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b2140 msgr2=0x7f1b000c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1aff7fe700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b2140 0x7f1b000c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1aff7fe700 1 -- 172.21.15.84:0/165439352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b00159480 msgr2=0x7f1b000cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1aff7fe700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b00159480 0x7f1b000cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1aff7fe700 1 -- 172.21.15.84:0/165439352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0009420 con 0x7f1b000b3610 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1aff7fe700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b000b3610 0x7f1b00147550 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c790 tx=0x7f1af4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1ae7fff700 1 -- 172.21.15.84:0/165439352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011590 con 0x7f1b000b3610 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1ae7fff700 1 -- 172.21.15.84:0/165439352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4011710 con 0x7f1b000b3610 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1ae7fff700 1 -- 172.21.15.84:0/165439352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011ad0 con 0x7f1b000b3610 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b000c7440 con 0x7f1b000b3610 2023-10-06T03:01:15.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.810+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b00147a90 con 0x7f1b000b3610 2023-10-06T03:01:15.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.811+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b000c7c40 con 0x7f1b000b3610 2023-10-06T03:01:15.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.812+0000 7f1ae7fff700 1 -- 172.21.15.84:0/165439352 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1af401c440 con 0x7f1b000b3610 2023-10-06T03:01:15.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.812+0000 7f1ae7fff700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1aec066f30 0x7f1aec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:15.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.812+0000 7f1ae7fff700 1 -- 172.21.15.84:0/165439352 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1af4083ec0 con 0x7f1b000b3610 2023-10-06T03:01:15.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.812+0000 7f1afffff700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1aec066f30 0x7f1aec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:15.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.813+0000 7f1afffff700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1aec066f30 0x7f1aec0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1af00091e0 tx=0x7f1af0016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:15.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:15.816+0000 7f1ae7fff700 1 -- 172.21.15.84:0/165439352 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1af4050f10 con 0x7f1b000b3610 2023-10-06T03:01:16.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.073+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1b000c7c00 con 0x7f1b000b3610 2023-10-06T03:01:16.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.074+0000 7f1ae7fff700 1 -- 172.21.15.84:0/165439352 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1460 (secure 0 0 0) 0x7f1af4017080 con 0x7f1b000b3610 2023-10-06T03:01:16.074 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:16.074 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":393,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2446209024,"bytes_avail":770647904256,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":8360,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":92,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-06T03:00:27.873158+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:01:16.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1aec066f30 msgr2=0x7f1aec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:16.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1aec066f30 0x7f1aec0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1af00091e0 tx=0x7f1af0016000 comp rx=0 tx=0).stop 2023-10-06T03:01:16.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b000b3610 msgr2=0x7f1b00147550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:16.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b000b3610 0x7f1b00147550 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f1af400c790 tx=0x7f1af4007f60 comp rx=0 tx=0).stop 2023-10-06T03:01:16.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 shutdown_connections 2023-10-06T03:01:16.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1aec066f30 0x7f1aec0693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b00159480 0x7f1b000cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b000b2140 0x7f1b000c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 --2- 172.21.15.84:0/165439352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b000b3610 0x7f1b00147550 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 >> 172.21.15.84:0/165439352 conn(0x7f1b0006ed20 msgr2=0x7f1b000b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:16.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 shutdown_connections 2023-10-06T03:01:16.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:16.076+0000 7f1b052a6700 1 -- 172.21.15.84:0/165439352 wait complete. 2023-10-06T03:01:16.088 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T03:01:17.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:17.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.211+0000 7faf3f03c700 1 Processor -- start 2023-10-06T03:01:17.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.211+0000 7faf3f03c700 1 -- start start 2023-10-06T03:01:17.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.212+0000 7faf3f03c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faf380cbc70 0x7faf380cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.212+0000 7faf3f03c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf380cb7e0 con 0x7faf38159480 2023-10-06T03:01:17.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.212+0000 7faf3f03c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf380b08a0 con 0x7faf380b2140 2023-10-06T03:01:17.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.212+0000 7faf3f03c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf380cb190 con 0x7faf380cbc70 2023-10-06T03:01:17.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.212+0000 7faf3e03a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faf38159480 0x7faf380b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:32808/0 (socket says 172.21.15.84:32808) 2023-10-06T03:01:17.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.212+0000 7faf3e03a700 1 -- 172.21.15.84:0/61611911 learned_addr learned my addr 172.21.15.84:0/61611911 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:17.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.212+0000 7faf3d839700 1 --2- 172.21.15.84:0/61611911 >> v2:172.21.15.131:3300/0 conn(0x7faf380cbc70 0x7faf380cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.212+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591877501 0 0) 0x7faf380cb7e0 con 0x7faf38159480 2023-10-06T03:01:17.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.212+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf20003570 con 0x7faf38159480 2023-10-06T03:01:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 882380512 0 0) 0x7faf20003570 con 0x7faf38159480 2023-10-06T03:01:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 >> v2:172.21.15.131:3300/0 conn(0x7faf380cbc70 msgr2=0x7faf380cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 --2- 172.21.15.84:0/61611911 >> v2:172.21.15.131:3300/0 conn(0x7faf380cbc70 0x7faf380cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 >> v1:172.21.15.131:6789/0 conn(0x7faf380b2140 legacy=0x7faf380b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf380cb470 con 0x7faf38159480 2023-10-06T03:01:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7faf280017f0 con 0x7faf38159480 2023-10-06T03:01:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 >> v1:172.21.15.84:6789/0 conn(0x7faf38159480 legacy=0x7faf380b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf20003a60 0x7faf20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf20004810 0x7faf20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf200051c0 0x7faf2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380cb190 con 0x7faf20004810 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2000c0d0 con 0x7faf20003a60 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2000c290 con 0x7faf200051c0 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d839700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf20004810 0x7faf20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3e03a700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf20003a60 0x7faf20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3e83b700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf200051c0 0x7faf2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d839700 1 -- 172.21.15.84:0/61611911 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf200051c0 msgr2=0x7faf2000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d839700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf200051c0 0x7faf2000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d839700 1 -- 172.21.15.84:0/61611911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf20003a60 msgr2=0x7faf20003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d839700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf20003a60 0x7faf20003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d839700 1 -- 172.21.15.84:0/61611911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf20003570 con 0x7faf20004810 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3e83b700 1 -- 172.21.15.84:0/61611911 reap_dead start 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d839700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf20004810 0x7faf20004c80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009c00 tx=0x7faf2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f11ea6a26623ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00e710 con 0x7faf20004810 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00e870 con 0x7faf20004810 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.213+0000 7faf3d038700 1 -- 172.21.15.84:0/61611911 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00ec30 con 0x7faf20004810 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.214+0000 7faf3f03c700 1 -- 172.21.15.84:0/61611911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf20004810 msgr2=0x7faf20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.214+0000 7faf3f03c700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf20004810 0x7faf20004c80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009c00 tx=0x7faf2c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.214+0000 7faf3f03c700 1 -- 172.21.15.84:0/61611911 shutdown_connections 2023-10-06T03:01:17.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.214+0000 7faf3f03c700 1 --2- 172.21.15.84:0/61611911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf20004810 0x7faf20004c80 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.214+0000 7faf3f03c700 1 -- 172.21.15.84:0/61611911 >> 172.21.15.84:0/61611911 conn(0x7faf3806ed20 msgr2=0x7faf3806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:17.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.214+0000 7faf3f03c700 1 -- 172.21.15.84:0/61611911 shutdown_connections 2023-10-06T03:01:17.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.214+0000 7faf3f03c700 1 -- 172.21.15.84:0/61611911 wait complete. 2023-10-06T03:01:17.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.215+0000 7faf3f03c700 1 Processor -- start 2023-10-06T03:01:17.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.215+0000 7faf3f03c700 1 -- start start 2023-10-06T03:01:17.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3f03c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf20004810 0x7faf380c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3f03c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38159ad0 0x7faf380c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3f03c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf380cc730 0x7faf380ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3f03c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380c46d0 con 0x7faf380cc730 2023-10-06T03:01:17.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3f03c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380cd0c0 con 0x7faf38159ad0 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3f03c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf38159f40 con 0x7faf20004810 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e83b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf380cc730 0x7faf380ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e83b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf380cc730 0x7faf380ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56304/0 (socket says 172.21.15.84:56304) 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e83b700 1 -- 172.21.15.84:0/753758329 learned_addr learned my addr 172.21.15.84:0/753758329 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e03a700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf20004810 0x7faf380c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3d839700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38159ad0 0x7faf380c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e83b700 1 -- 172.21.15.84:0/753758329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf20004810 msgr2=0x7faf380c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e83b700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf20004810 0x7faf380c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e83b700 1 -- 172.21.15.84:0/753758329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38159ad0 msgr2=0x7faf380c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e83b700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38159ad0 0x7faf380c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e83b700 1 -- 172.21.15.84:0/753758329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3815a1d0 con 0x7faf380cc730 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3d839700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38159ad0 0x7faf380c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3e83b700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf380cc730 0x7faf380ccb80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7faf380b63e0 tx=0x7faf30007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf367fc700 1 -- 172.21.15.84:0/753758329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30006a30 con 0x7faf380cc730 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf367fc700 1 -- 172.21.15.84:0/753758329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30006bb0 con 0x7faf380cc730 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3815a4b0 con 0x7faf380cc730 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf367fc700 1 -- 172.21.15.84:0/753758329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30007030 con 0x7faf380cc730 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.216+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3815aa70 con 0x7faf380cc730 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.217+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf380c9c80 con 0x7faf380cc730 2023-10-06T03:01:17.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.218+0000 7faf367fc700 1 -- 172.21.15.84:0/753758329 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf300073a0 con 0x7faf380cc730 2023-10-06T03:01:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.218+0000 7faf367fc700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.218+0000 7faf367fc700 1 -- 172.21.15.84:0/753758329 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7faf30084220 con 0x7faf380cc730 2023-10-06T03:01:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.218+0000 7faf3e03a700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.218+0000 7faf3e03a700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf24066f30 0x7faf240693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf280013d0 tx=0x7faf28006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.222+0000 7faf367fc700 1 -- 172.21.15.84:0/753758329 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf300511f0 con 0x7faf380cc730 2023-10-06T03:01:17.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.449+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf380c44a0 con 0x7faf380cc730 2023-10-06T03:01:17.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.450+0000 7faf367fc700 1 -- 172.21.15.84:0/753758329 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7faf380c44a0 con 0x7faf380cc730 2023-10-06T03:01:17.450 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:17.451 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:17.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf24066f30 msgr2=0x7faf240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf24066f30 0x7faf240693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf280013d0 tx=0x7faf28006040 comp rx=0 tx=0).stop 2023-10-06T03:01:17.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf380cc730 msgr2=0x7faf380ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf380cc730 0x7faf380ccb80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7faf380b63e0 tx=0x7faf30007d30 comp rx=0 tx=0).stop 2023-10-06T03:01:17.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 shutdown_connections 2023-10-06T03:01:17.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faf24066f30 0x7faf240693e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf380cc730 0x7faf380ccb80 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf20004810 0x7faf380c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 --2- 172.21.15.84:0/753758329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf38159ad0 0x7faf380c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 >> 172.21.15.84:0/753758329 conn(0x7faf3806ed20 msgr2=0x7faf380cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:17.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 shutdown_connections 2023-10-06T03:01:17.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.452+0000 7faf3f03c700 1 -- 172.21.15.84:0/753758329 wait complete. 2023-10-06T03:01:17.454 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:17.464 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:17.464 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:17.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.577+0000 7f910f207700 1 Processor -- start 2023-10-06T03:01:17.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.577+0000 7f910f207700 1 -- start start 2023-10-06T03:01:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910f207700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9108159990 0x7f91080675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910f207700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9108067b30 0x7f91080b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910f207700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9108067f40 con 0x7f91081595c0 2023-10-06T03:01:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910f207700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91080cde70 con 0x7f9108067b30 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910f207700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910806ef60 con 0x7f9108159990 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910d7a4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9108067b30 0x7f91080b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910d7a4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9108067b30 0x7f91080b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56308/0 (socket says 172.21.15.84:56308) 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910d7a4700 1 -- 172.21.15.84:0/1156286824 learned_addr learned my addr 172.21.15.84:0/1156286824 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910d7a4700 1 -- 172.21.15.84:0/1156286824 >> v2:172.21.15.131:3300/0 conn(0x7f9108159990 msgr2=0x7f91080675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910d7a4700 1 --2- 172.21.15.84:0/1156286824 >> v2:172.21.15.131:3300/0 conn(0x7f9108159990 0x7f91080675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910d7a4700 1 -- 172.21.15.84:0/1156286824 >> v1:172.21.15.131:6789/0 conn(0x7f91081595c0 legacy=0x7f910806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.578+0000 7f910d7a4700 1 -- 172.21.15.84:0/1156286824 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910806f240 con 0x7f9108067b30 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f910d7a4700 1 --2- 172.21.15.84:0/1156286824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9108067b30 0x7f91080b0990 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f91080c9700 tx=0x7f9100009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d3b7796e17ea6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f91077fe700 1 -- 172.21.15.84:0/1156286824 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100005c60 con 0x7f9108067b30 2023-10-06T03:01:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f91077fe700 1 -- 172.21.15.84:0/1156286824 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9100005dc0 con 0x7f9108067b30 2023-10-06T03:01:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f91077fe700 1 -- 172.21.15.84:0/1156286824 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910000b860 con 0x7f9108067b30 2023-10-06T03:01:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f910f207700 1 -- 172.21.15.84:0/1156286824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9108067b30 msgr2=0x7f91080b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f910f207700 1 --2- 172.21.15.84:0/1156286824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9108067b30 0x7f91080b0990 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f91080c9700 tx=0x7f9100009250 comp rx=0 tx=0).stop 2023-10-06T03:01:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f910f207700 1 -- 172.21.15.84:0/1156286824 shutdown_connections 2023-10-06T03:01:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f910f207700 1 --2- 172.21.15.84:0/1156286824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9108067b30 0x7f91080b0990 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f910f207700 1 --2- 172.21.15.84:0/1156286824 >> v2:172.21.15.131:3300/0 conn(0x7f9108159990 0x7f91080675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f910f207700 1 -- 172.21.15.84:0/1156286824 >> 172.21.15.84:0/1156286824 conn(0x7f9108069180 msgr2=0x7f91080cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f910f207700 1 -- 172.21.15.84:0/1156286824 shutdown_connections 2023-10-06T03:01:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.579+0000 7f910f207700 1 -- 172.21.15.84:0/1156286824 wait complete. 2023-10-06T03:01:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.580+0000 7f910f207700 1 Processor -- start 2023-10-06T03:01:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.581+0000 7f910f207700 1 -- start start 2023-10-06T03:01:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.581+0000 7f910f207700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9108067b30 0x7f9108154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.581+0000 7f910f207700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91081595c0 0x7f910815b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.581+0000 7f910f207700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9108159990 0x7f91081566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.581+0000 7f910f207700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91080c2300 con 0x7f91081595c0 2023-10-06T03:01:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.581+0000 7f910f207700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91080c1730 con 0x7f9108067b30 2023-10-06T03:01:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.581+0000 7f910f207700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9108154f50 con 0x7f9108159990 2023-10-06T03:01:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9107fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91081595c0 0x7f910815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9107fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91081595c0 0x7f910815b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56318/0 (socket says 172.21.15.84:56318) 2023-10-06T03:01:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9107fff700 1 -- 172.21.15.84:0/1331261991 learned_addr learned my addr 172.21.15.84:0/1331261991 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f910cfa3700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9108067b30 0x7f9108154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f910d7a4700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9108159990 0x7f91081566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9107fff700 1 -- 172.21.15.84:0/1331261991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9108159990 msgr2=0x7f91081566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9107fff700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9108159990 0x7f91081566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9107fff700 1 -- 172.21.15.84:0/1331261991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9108067b30 msgr2=0x7f9108154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9107fff700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9108067b30 0x7f9108154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9107fff700 1 -- 172.21.15.84:0/1331261991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000094d0 con 0x7f91081595c0 2023-10-06T03:01:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9107fff700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91081595c0 0x7f910815b670 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f90f000b810 tx=0x7f90f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9104ff9700 1 -- 172.21.15.84:0/1331261991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000f510 con 0x7f91081595c0 2023-10-06T03:01:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9104ff9700 1 -- 172.21.15.84:0/1331261991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f000f670 con 0x7f91081595c0 2023-10-06T03:01:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f9104ff9700 1 -- 172.21.15.84:0/1331261991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000fa30 con 0x7f91081595c0 2023-10-06T03:01:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91080c19d0 con 0x7f91081595c0 2023-10-06T03:01:17.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.582+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91080c1f90 con 0x7f91081595c0 2023-10-06T03:01:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.583+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91080c2470 con 0x7f91081595c0 2023-10-06T03:01:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.583+0000 7f9104ff9700 1 -- 172.21.15.84:0/1331261991 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90f001a400 con 0x7f91081595c0 2023-10-06T03:01:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.584+0000 7f9104ff9700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90e8066f60 0x7f90e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.584+0000 7f9104ff9700 1 -- 172.21.15.84:0/1331261991 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f90f0084200 con 0x7f91081595c0 2023-10-06T03:01:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.584+0000 7f910cfa3700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90e8066f60 0x7f90e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.584+0000 7f910cfa3700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90e8066f60 0x7f90e8069410 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f90f80075c0 tx=0x7f90f8009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.588+0000 7f9104ff9700 1 -- 172.21.15.84:0/1331261991 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90f0051250 con 0x7f91081595c0 2023-10-06T03:01:17.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.847+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9108064ad0 con 0x7f91081595c0 2023-10-06T03:01:17.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.848+0000 7f9104ff9700 1 -- 172.21.15.84:0/1331261991 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1970 (secure 0 0 0) 0x7f90f0054870 con 0x7f91081595c0 2023-10-06T03:01:17.848 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:17.849 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":395,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2446209024,"bytes_avail":770647904256,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6995,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":93,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2023-10-06T03:01:15.883206+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-10-06T03:01:17.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.849+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90e8066f60 msgr2=0x7f90e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.849+0000 7f910f207700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90e8066f60 0x7f90e8069410 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f90f80075c0 tx=0x7f90f8009780 comp rx=0 tx=0).stop 2023-10-06T03:01:17.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.849+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91081595c0 msgr2=0x7f910815b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.849+0000 7f910f207700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91081595c0 0x7f910815b670 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f90f000b810 tx=0x7f90f00091d0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.849+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 shutdown_connections 2023-10-06T03:01:17.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.849+0000 7f910f207700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f90e8066f60 0x7f90e8069410 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.850+0000 7f910f207700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9108067b30 0x7f9108154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.850+0000 7f910f207700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9108159990 0x7f91081566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.850+0000 7f910f207700 1 --2- 172.21.15.84:0/1331261991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91081595c0 0x7f910815b670 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.850+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 >> 172.21.15.84:0/1331261991 conn(0x7f9108069180 msgr2=0x7f910815ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:17.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.850+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 shutdown_connections 2023-10-06T03:01:17.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.850+0000 7f910f207700 1 -- 172.21.15.84:0/1331261991 wait complete. 2023-10-06T03:01:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2023-10-06T03:01:17.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub resume 2023-10-06T03:01:17.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.978+0000 7f9cf9ce6700 1 Processor -- start 2023-10-06T03:01:17.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.978+0000 7f9cf9ce6700 1 -- start start 2023-10-06T03:01:17.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.978+0000 7f9cf9ce6700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9cf40cbb50 0x7f9cf40ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.978+0000 7f9cf9ce6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9cf40c6610 0x7f9cf40ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.978+0000 7f9cf9ce6700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf40b2e60 con 0x7f9cf40b2a90 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.978+0000 7f9cf9ce6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf40cf5d0 con 0x7f9cf40c6610 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.978+0000 7f9cf9ce6700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf40cf8b0 con 0x7f9cf40cbb50 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9cf40c6610 0x7f9cf40ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9cf40c6610 0x7f9cf40ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56330/0 (socket says 172.21.15.84:56330) 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf3fff700 1 -- 172.21.15.84:0/831178009 learned_addr learned my addr 172.21.15.84:0/831178009 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf3fff700 1 -- 172.21.15.84:0/831178009 >> v2:172.21.15.131:3300/0 conn(0x7f9cf40cbb50 msgr2=0x7f9cf40ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf3fff700 1 --2- 172.21.15.84:0/831178009 >> v2:172.21.15.131:3300/0 conn(0x7f9cf40cbb50 0x7f9cf40ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf3fff700 1 -- 172.21.15.84:0/831178009 >> v1:172.21.15.131:6789/0 conn(0x7f9cf40b2a90 legacy=0x7f9cf40cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf3fff700 1 -- 172.21.15.84:0/831178009 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf40cfb90 con 0x7f9cf40c6610 2023-10-06T03:01:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf3fff700 1 --2- 172.21.15.84:0/831178009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40c6610 0x7f9cf40ced90 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4088cd0 tx=0x7f9cec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26219002328edc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf27fc700 1 -- 172.21.15.84:0/831178009 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00b820 con 0x7f9cf40c6610 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf27fc700 1 -- 172.21.15.84:0/831178009 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec00b980 con 0x7f9cf40c6610 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.979+0000 7f9cf27fc700 1 -- 172.21.15.84:0/831178009 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00bd20 con 0x7f9cf40c6610 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.980+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/831178009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40c6610 msgr2=0x7f9cf40ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.980+0000 7f9cf9ce6700 1 --2- 172.21.15.84:0/831178009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40c6610 0x7f9cf40ced90 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4088cd0 tx=0x7f9cec009250 comp rx=0 tx=0).stop 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.980+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/831178009 shutdown_connections 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.980+0000 7f9cf9ce6700 1 --2- 172.21.15.84:0/831178009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40c6610 0x7f9cf40ced90 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.980+0000 7f9cf9ce6700 1 --2- 172.21.15.84:0/831178009 >> v2:172.21.15.131:3300/0 conn(0x7f9cf40cbb50 0x7f9cf40ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.980+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/831178009 >> 172.21.15.84:0/831178009 conn(0x7f9cf4099740 msgr2=0x7f9cf406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.980+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/831178009 shutdown_connections 2023-10-06T03:01:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.980+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/831178009 wait complete. 2023-10-06T03:01:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.981+0000 7f9cf9ce6700 1 Processor -- start 2023-10-06T03:01:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.981+0000 7f9cf9ce6700 1 -- start start 2023-10-06T03:01:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf9ce6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf40b2a90 0x7f9cf4157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf9ce6700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c6610 0x7f9cf415dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf9ce6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40cbb50 0x7f9cf415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf9ce6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf41576b0 con 0x7f9cf40cbb50 2023-10-06T03:01:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf9ce6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf409a2c0 con 0x7f9cf40b2a90 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf9ce6700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf415bd30 con 0x7f9cf40c6610 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40cbb50 0x7f9cf415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40cbb50 0x7f9cf415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56332/0 (socket says 172.21.15.84:56332) 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf3fff700 1 -- 172.21.15.84:0/1151622267 learned_addr learned my addr 172.21.15.84:0/1151622267 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf40b2a90 0x7f9cf4157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c6610 0x7f9cf415dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf3fff700 1 -- 172.21.15.84:0/1151622267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c6610 msgr2=0x7f9cf415dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf3fff700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c6610 0x7f9cf415dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf3fff700 1 -- 172.21.15.84:0/1151622267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf40b2a90 msgr2=0x7f9cf4157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf3fff700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf40b2a90 0x7f9cf4157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf3fff700 1 -- 172.21.15.84:0/1151622267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0094f0 con 0x7f9cf40cbb50 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c6610 0x7f9cf415dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.982+0000 7f9cf3fff700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40cbb50 0x7f9cf415e500 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4088fe0 tx=0x7f9cec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.983+0000 7f9cdb7fe700 1 -- 172.21.15.84:0/1151622267 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec01a670 con 0x7f9cf40cbb50 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.983+0000 7f9cdb7fe700 1 -- 172.21.15.84:0/1151622267 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec01a7d0 con 0x7f9cf40cbb50 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.983+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/1151622267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf415c010 con 0x7f9cf40cbb50 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.983+0000 7f9cdb7fe700 1 -- 172.21.15.84:0/1151622267 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec01ab90 con 0x7f9cf40cbb50 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.983+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/1151622267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf40c9840 con 0x7f9cf40cbb50 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.984+0000 7f9cdb7fe700 1 -- 172.21.15.84:0/1151622267 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cec01b440 con 0x7f9cf40cbb50 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.984+0000 7f9cdb7fe700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.984+0000 7f9cdb7fe700 1 -- 172.21.15.84:0/1151622267 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9cec0862e0 con 0x7f9cf40cbb50 2023-10-06T03:01:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.984+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.985+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce0066f30 0x7f9ce00693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9cf41677d0 tx=0x7f9ce4009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.986+0000 7f9d02fdeb80 1 Processor -- start 2023-10-06T03:01:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.986+0000 7f9d02fdeb80 1 -- start start 2023-10-06T03:01:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55e890 0x5606ae55ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae5ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae5af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ae4b5ac0 con 0x5606ae55fd10 2023-10-06T03:01:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ae4b32c0 con 0x5606ae55e890 2023-10-06T03:01:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606ae4af0b0 con 0x5606ae5aec50 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9cf2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae5ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9cf2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae5ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56342/0 (socket says 172.21.15.84:56342) 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9cf2ffd700 1 -- 172.21.15.84:0/348172796 learned_addr learned my addr 172.21.15.84:0/348172796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9cf2ffd700 1 -- 172.21.15.84:0/348172796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 msgr2=0x5606ae5af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/348172796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae5af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9cf2ffd700 1 -- 172.21.15.84:0/348172796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55e890 msgr2=0x5606ae55ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/348172796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55e890 0x5606ae55ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.987+0000 7f9cf2ffd700 1 -- 172.21.15.84:0/348172796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ae3492c0 con 0x5606ae55fd10 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/348172796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae5ae710 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80098f0 tx=0x7f9ce8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcef35570577564 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9cd8ff9700 1 -- 172.21.15.84:0/348172796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8009e90 con 0x5606ae55fd10 2023-10-06T03:01:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9cd8ff9700 1 -- 172.21.15.84:0/348172796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce800d800 con 0x5606ae55fd10 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9cd8ff9700 1 -- 172.21.15.84:0/348172796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800dba0 con 0x5606ae55fd10 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/348172796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 msgr2=0x5606ae5ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/348172796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae5ae710 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80098f0 tx=0x7f9ce8008040 comp rx=0 tx=0).stop 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/348172796 shutdown_connections 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/348172796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55e890 0x5606ae55ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/348172796 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae5af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/348172796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae5ae710 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/348172796 >> 172.21.15.84:0/348172796 conn(0x5606ae5601b0 msgr2=0x5606ae560580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/348172796 shutdown_connections 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.988+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/348172796 wait complete. 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.989+0000 7f9d02fdeb80 1 -- start start 2023-10-06T03:01:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.989+0000 7f9d02fdeb80 1 Processor -- start 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae55e890 0x5606ae5a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae588d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae5aec50 0x5606ae589250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ae45a8e0 con 0x5606ae55fd10 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ae475ef0 con 0x5606ae5aec50 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606ae331e80 con 0x5606ae55e890 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9d02fdeb80 10 client.0 _ll_register_callbacks cb 0x5606ae521ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae588d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae588d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56358/0 (socket says 172.21.15.84:56358) 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf2ffd700 1 -- 172.21.15.84:0/2555322867 learned_addr learned my addr 172.21.15.84:0/2555322867 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf3fff700 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae5aec50 0x5606ae589250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae55e890 0x5606ae5a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf2ffd700 1 -- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae55e890 msgr2=0x5606ae5a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae55e890 0x5606ae5a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf2ffd700 1 -- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae5aec50 msgr2=0x5606ae589250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae5aec50 0x5606ae589250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf2ffd700 1 -- 172.21.15.84:0/2555322867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce800e040 con 0x5606ae55fd10 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae55e890 0x5606ae5a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf3fff700 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae5aec50 0x5606ae589250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae588d10 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8013000 tx=0x7f9ce8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170019a533277396 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/2555322867 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800db40 con 0x5606ae55fd10 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/2555322867 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9ce801d650 con 0x5606ae55fd10 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.990+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/2555322867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606ae553990 con 0x5606ae55fd10 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/2555322867 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ce801d850 con 0x5606ae55fd10 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9d02fdeb80 10 client.8241 fetch_fsmap learned FSMap version 93 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/2555322867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x5606ae2ec030 con 0x5606ae55fd10 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/2555322867 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606ae553990 con 0x5606ae55fd10 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/2555322867 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 93) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f9ce801d9b0 con 0x5606ae55fd10 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9d02fdeb80 10 client.8241 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9d02fdeb80 10 client.8241 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9d02fdeb80 20 client.8241 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5606ae584680 0x5606ae58b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9d02fdeb80 4 client.8241 mds_command: new command op to 7716 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/2555322867 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606ae5308c0 con 0x5606ae584680 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5606ae584680 0x5606ae58b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9cd1ffb700 10 client.8241 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.991+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5606ae584680 0x5606ae58b160 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5385dd90251417e5 server_cookie=f89ea03409d8bc30 in_seq=0 out_seq=0 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/2555322867 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5606ae5308c0 con 0x5606ae584680 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9cd1ffb700 10 client.8241 handle_command_reply: tid=0 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 client.8241 shutdown 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/2555322867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 msgr2=0x5606ae588d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae588d10 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8013000 tx=0x7f9ce8019000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/2555322867 shutdown_connections 2023-10-06T03:01:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5606ae584680 0x5606ae58b160 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae5aec50 0x5606ae589250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9cd1ffb700 0 client.8241 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae55e890 0x5606ae5a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/2555322867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55fd10 0x5606ae588d10 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/2555322867 >> 172.21.15.84:0/2555322867 conn(0x5606ae5601b0 msgr2=0x5606ae55f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/2555322867 shutdown_connections 2023-10-06T03:01:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/2555322867 wait complete. 2023-10-06T03:01:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:17.992+0000 7f9d02fdeb80 20 client.8241 trim_cache size 0 max 16384 2023-10-06T03:01:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.007+0000 7f9d02fdeb80 1 Processor -- start 2023-10-06T03:01:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.007+0000 7f9d02fdeb80 1 -- start start 2023-10-06T03:01:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.008+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae58b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.008+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 0x5606ae55bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.008+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae55c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.008+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ae55db80 con 0x5606ae55e890 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.008+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ae58efd0 con 0x5606ae55fd10 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.008+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606ae5a0400 con 0x5606ae5aec50 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.008+0000 7f9cf37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae58b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.008+0000 7f9cf37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae58b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56368/0 (socket says 172.21.15.84:56368) 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.008+0000 7f9cf37fe700 1 -- 172.21.15.84:0/1451307724 learned_addr learned my addr 172.21.15.84:0/1451307724 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9cf37fe700 1 -- 172.21.15.84:0/1451307724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 msgr2=0x5606ae55c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/1451307724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae55c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9cf37fe700 1 -- 172.21.15.84:0/1451307724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 msgr2=0x5606ae55bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/1451307724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 0x5606ae55bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9cf37fe700 1 -- 172.21.15.84:0/1451307724 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ae47d7d0 con 0x5606ae55e890 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/1451307724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae58b160 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x5606ae5a0080 tx=0x7f9ce4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1453673a0deedb44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9cd97fa700 1 -- 172.21.15.84:0/1451307724 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4024580 con 0x5606ae55e890 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9cd97fa700 1 -- 172.21.15.84:0/1451307724 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce400f040 con 0x5606ae55e890 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9cd97fa700 1 -- 172.21.15.84:0/1451307724 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4024910 con 0x5606ae55e890 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/1451307724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 msgr2=0x5606ae58b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/1451307724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae58b160 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x5606ae5a0080 tx=0x7f9ce4013000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/1451307724 shutdown_connections 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/1451307724 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae55c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/1451307724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae58b160 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/1451307724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 0x5606ae55bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/1451307724 >> 172.21.15.84:0/1451307724 conn(0x5606ae5601b0 msgr2=0x5606ae5572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/1451307724 shutdown_connections 2023-10-06T03:01:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.009+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/1451307724 wait complete. 2023-10-06T03:01:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.010+0000 7f9d02fdeb80 1 -- start start 2023-10-06T03:01:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.010+0000 7f9d02fdeb80 1 Processor -- start 2023-10-06T03:01:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae59f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 0x5606ae58da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9d02fdeb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae58df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ae55c5e0 con 0x5606ae55e890 2023-10-06T03:01:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ae582eb0 con 0x5606ae55fd10 2023-10-06T03:01:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9d02fdeb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606ae583190 con 0x5606ae5aec50 2023-10-06T03:01:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9d02fdeb80 10 client.0 _ll_register_callbacks cb 0x5606ae521ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae59f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae59f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56372/0 (socket says 172.21.15.84:56372) 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf37fe700 1 -- 172.21.15.84:0/3380764543 learned_addr learned my addr 172.21.15.84:0/3380764543 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 0x5606ae58da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf3fff700 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae58df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf37fe700 1 -- 172.21.15.84:0/3380764543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 msgr2=0x5606ae58df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae58df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf37fe700 1 -- 172.21.15.84:0/3380764543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 msgr2=0x5606ae58da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 0x5606ae58da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf37fe700 1 -- 172.21.15.84:0/3380764543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ae4644c0 con 0x5606ae55e890 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 0x5606ae58da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cf37fe700 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae59f2c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4007140 tx=0x7f9ce4028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658262b01032473e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/3380764543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40248e0 con 0x5606ae55e890 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/3380764543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9ce401b040 con 0x5606ae55e890 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/3380764543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ce800d800 con 0x5606ae55e890 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.011+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/3380764543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ce402c3f0 con 0x5606ae55e890 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9d02fdeb80 10 client.8247 fetch_fsmap learned FSMap version 93 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/3380764543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x5606ae313fd0 con 0x5606ae55e890 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/3380764543 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce800d800 con 0x5606ae55e890 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/3380764543 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 93) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f9ce402c550 con 0x5606ae55e890 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9d02fdeb80 10 client.8247 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9d02fdeb80 10 client.8247 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9d02fdeb80 20 client.8247 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5606ae58b160 0x5606ae59b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9d02fdeb80 4 client.8247 mds_command: new command op to 7716 tid=0[{"prefix": "scrub resume"}] 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/3380764543 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x5606ae451e50 con 0x5606ae58b160 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5606ae58b160 0x5606ae59b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9cf2ffd700 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5606ae58b160 0x5606ae59b3a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=375c5a24c2d3b9c8 server_cookie=e712ad66da255249 in_seq=0 out_seq=0 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9cd1ffb700 10 client.8247 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9cd1ffb700 1 -- 172.21.15.84:0/3380764543 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5606ae451e50 con 0x5606ae58b160 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9cd1ffb700 10 client.8247 handle_command_reply: tid=0 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.012+0000 7f9d02fdeb80 1 client.8247 shutdown 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/3380764543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 msgr2=0x5606ae59f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae59f2c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4007140 tx=0x7f9ce4028000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/3380764543 shutdown_connections 2023-10-06T03:01:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x5606ae58b160 0x5606ae59b3a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5606ae5aec50 0x5606ae58df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5606ae55e890 0x5606ae59f2c0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 --2- 172.21.15.84:0/3380764543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606ae55fd10 0x5606ae58da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cd1ffb700 0 client.8247 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/3380764543 >> 172.21.15.84:0/3380764543 conn(0x5606ae5601b0 msgr2=0x5606ae5bead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/3380764543 shutdown_connections 2023-10-06T03:01:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 1 -- 172.21.15.84:0/3380764543 wait complete. 2023-10-06T03:01:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9d02fdeb80 20 client.8247 trim_cache size 0 max 16384 2023-10-06T03:01:18.022 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:18.022 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:01:18.022 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce0066f30 msgr2=0x7f9ce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce0066f30 0x7f9ce00693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9cf41677d0 tx=0x7f9ce4009780 comp rx=0 tx=0).stop 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40cbb50 msgr2=0x7f9cf415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40cbb50 0x7f9cf415e500 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4088fe0 tx=0x7f9cec016000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/1151622267 shutdown_connections 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9ce0066f30 0x7f9ce00693e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cf40b2a90 0x7f9cf4157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf40cbb50 0x7f9cf415e500 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 --2- 172.21.15.84:0/1151622267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9cf40c6610 0x7f9cf415dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/1151622267 >> 172.21.15.84:0/1151622267 conn(0x7f9cf4099740 msgr2=0x7f9cf4063450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/1151622267 shutdown_connections 2023-10-06T03:01:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.013+0000 7f9cf9ce6700 1 -- 172.21.15.84:0/1151622267 wait complete. 2023-10-06T03:01:18.025 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 scrub status 2023-10-06T03:01:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.142+0000 7f4b4d1a2700 1 Processor -- start 2023-10-06T03:01:18.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.142+0000 7f4b4d1a2700 1 -- start start 2023-10-06T03:01:18.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4d1a2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4b480b2660 0x7f4b480cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4d1a2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b480cf1f0 0x7f4b480cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4d1a2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b480cc9b0 con 0x7f4b480b2a30 2023-10-06T03:01:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4d1a2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b480cbda0 con 0x7f4b480cf1f0 2023-10-06T03:01:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4d1a2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b480cc080 con 0x7f4b480b2660 2023-10-06T03:01:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4c9a1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b480cf1f0 0x7f4b480cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4c9a1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b480cf1f0 0x7f4b480cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56376/0 (socket says 172.21.15.84:56376) 2023-10-06T03:01:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/2637242239 learned_addr learned my addr 172.21.15.84:0/2637242239 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/2637242239 >> v2:172.21.15.131:3300/0 conn(0x7f4b480b2660 msgr2=0x7f4b480cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b47fff700 1 --2- 172.21.15.84:0/2637242239 >> v2:172.21.15.131:3300/0 conn(0x7f4b480b2660 0x7f4b480cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/2637242239 >> v2:172.21.15.131:3300/0 conn(0x7f4b480b2660 0x7f4b480cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/2637242239 >> v1:172.21.15.131:6789/0 conn(0x7f4b480b2a30 legacy=0x7f4b480ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/2637242239 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480cc360 con 0x7f4b480cf1f0 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/2637242239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480cf1f0 0x7f4b480cd230 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4b48089500 tx=0x7f4b40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613713d149115960 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b46ffd700 1 -- 172.21.15.84:0/2637242239 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4000e070 con 0x7f4b480cf1f0 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b46ffd700 1 -- 172.21.15.84:0/2637242239 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4000ba10 con 0x7f4b480cf1f0 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.143+0000 7f4b46ffd700 1 -- 172.21.15.84:0/2637242239 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b400092e0 con 0x7f4b480cf1f0 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.144+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/2637242239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480cf1f0 msgr2=0x7f4b480cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.144+0000 7f4b4d1a2700 1 --2- 172.21.15.84:0/2637242239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480cf1f0 0x7f4b480cd230 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4b48089500 tx=0x7f4b40009840 comp rx=0 tx=0).stop 2023-10-06T03:01:18.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.144+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/2637242239 shutdown_connections 2023-10-06T03:01:18.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.144+0000 7f4b4d1a2700 1 --2- 172.21.15.84:0/2637242239 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480cf1f0 0x7f4b480cd230 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.144+0000 7f4b4d1a2700 1 --2- 172.21.15.84:0/2637242239 >> v2:172.21.15.131:3300/0 conn(0x7f4b480b2660 0x7f4b480cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.144+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/2637242239 >> 172.21.15.84:0/2637242239 conn(0x7f4b48099560 msgr2=0x7f4b4806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.144+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/2637242239 shutdown_connections 2023-10-06T03:01:18.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.144+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/2637242239 wait complete. 2023-10-06T03:01:18.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.145+0000 7f4b4d1a2700 1 Processor -- start 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.145+0000 7f4b4d1a2700 1 -- start start 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b4d1a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480b2660 0x7f4b480c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b4d1a2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b480b2a30 0x7f4b480c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b4d1a2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480cf1f0 0x7f4b480b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b4d1a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4813eec0 con 0x7f4b480b2660 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b4d1a2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480c8bb0 con 0x7f4b480cf1f0 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b4d1a2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480c7fa0 con 0x7f4b480b2a30 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b47fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480b2660 0x7f4b480c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b47fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480b2660 0x7f4b480c73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56390/0 (socket says 172.21.15.84:56390) 2023-10-06T03:01:18.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b47fff700 1 -- 172.21.15.84:0/798576146 learned_addr learned my addr 172.21.15.84:0/798576146 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480cf1f0 0x7f4b480b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b477fe700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b480b2a30 0x7f4b480c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b47fff700 1 -- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b480b2a30 msgr2=0x7f4b480c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b47fff700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b480b2a30 0x7f4b480c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b47fff700 1 -- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480cf1f0 msgr2=0x7f4b480b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b47fff700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480cf1f0 0x7f4b480b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b47fff700 1 -- 172.21.15.84:0/798576146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40009ae0 con 0x7f4b480b2660 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480cf1f0 0x7f4b480b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.146+0000 7f4b477fe700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b480b2a30 0x7f4b480c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.147+0000 7f4b47fff700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480b2660 0x7f4b480c73c0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c880 tx=0x7f4b30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.147+0000 7f4b3ffff700 1 -- 172.21.15.84:0/798576146 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30011600 con 0x7f4b480b2660 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.147+0000 7f4b3ffff700 1 -- 172.21.15.84:0/798576146 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b30011780 con 0x7f4b480b2660 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.147+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/798576146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b480c8280 con 0x7f4b480b2660 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.147+0000 7f4b3ffff700 1 -- 172.21.15.84:0/798576146 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30011b40 con 0x7f4b480b2660 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.147+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/798576146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b480c8840 con 0x7f4b480b2660 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.148+0000 7f4b3ffff700 1 -- 172.21.15.84:0/798576146 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b30018360 con 0x7f4b480b2660 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.149+0000 7f4b3ffff700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b28066f30 0x7f4b280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.149+0000 7f4b3ffff700 1 -- 172.21.15.84:0/798576146 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4b300845a0 con 0x7f4b480b2660 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.149+0000 7f4b477fe700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b28066f30 0x7f4b280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.149+0000 7f4b477fe700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b28066f30 0x7f4b280693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4b38007fd0 tx=0x7f4b38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.151+0000 7f4b576fcb80 1 Processor -- start 2023-10-06T03:01:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.151+0000 7f4b576fcb80 1 -- start start 2023-10-06T03:01:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 0x558fef19e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 0x558fef19e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fef0f8ac0 con 0x558fef1c2ea0 2023-10-06T03:01:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fef0f62c0 con 0x558fef1a4a60 2023-10-06T03:01:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x558fef0f20b0 con 0x558fef1a3310 2023-10-06T03:01:18.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b47fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b47fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56392/0 (socket says 172.21.15.84:56392) 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b47fff700 1 -- 172.21.15.84:0/582842543 learned_addr learned my addr 172.21.15.84:0/582842543 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b477fe700 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 0x558fef19e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 0x558fef19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b47fff700 1 -- 172.21.15.84:0/582842543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 msgr2=0x558fef19e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b47fff700 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 0x558fef19e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b47fff700 1 -- 172.21.15.84:0/582842543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 msgr2=0x558fef19e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b47fff700 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 0x558fef19e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b47fff700 1 -- 172.21.15.84:0/582842543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558feef8c2c0 con 0x558fef1c2ea0 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 0x558fef19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b47fff700 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19dd10 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f4b30000c00 tx=0x7f4b30082780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3545499bdaeabc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b3d7fa700 1 -- 172.21.15.84:0/582842543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3006b070 con 0x558fef1c2ea0 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b3d7fa700 1 -- 172.21.15.84:0/582842543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b300584e0 con 0x558fef1c2ea0 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.152+0000 7f4b3d7fa700 1 -- 172.21.15.84:0/582842543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30054d70 con 0x558fef1c2ea0 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.153+0000 7f4b576fcb80 1 -- 172.21.15.84:0/582842543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 msgr2=0x558fef19dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.153+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19dd10 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f4b30000c00 tx=0x7f4b30082780 comp rx=0 tx=0).stop 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.153+0000 7f4b576fcb80 1 -- 172.21.15.84:0/582842543 shutdown_connections 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.153+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 0x558fef19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.153+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19dd10 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.153+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/582842543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 0x558fef19e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.153+0000 7f4b576fcb80 1 -- 172.21.15.84:0/582842543 >> 172.21.15.84:0/582842543 conn(0x558fef1a2ed0 msgr2=0x558fef1a3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.153+0000 7f4b576fcb80 1 -- 172.21.15.84:0/582842543 shutdown_connections 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.153+0000 7f4b576fcb80 1 -- 172.21.15.84:0/582842543 wait complete. 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.154+0000 7f4b576fcb80 1 -- start start 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.154+0000 7f4b576fcb80 1 Processor -- start 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 0x558fef1cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 0x558fef1eb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef1e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fef09d8e0 con 0x558fef1c2ea0 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fef0b8ef0 con 0x558fef1a4a60 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x558feef74e80 con 0x558fef1a3310 2023-10-06T03:01:18.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b576fcb80 10 client.0 _ll_register_callbacks cb 0x558fef165070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b4c9a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef1e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b4c9a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef1e9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56396/0 (socket says 172.21.15.84:56396) 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/3038386515 learned_addr learned my addr 172.21.15.84:0/3038386515 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b47fff700 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 0x558fef1cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b477fe700 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 0x558fef1eb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 msgr2=0x558fef1cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 0x558fef1cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 msgr2=0x558fef1eb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 0x558fef1eb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/3038386515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b480c8840 con 0x558fef1c2ea0 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef1e9f60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f4b40003000 tx=0x7f4b40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c827d94abfb94cd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b267fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.155+0000 7f4b267fc700 1 -- 172.21.15.84:0/3038386515 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b400092e0 con 0x558fef1c2ea0 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b267fc700 1 -- 172.21.15.84:0/3038386515 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4b40028d80 con 0x558fef1c2ea0 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3038386515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fef196990 con 0x558fef1c2ea0 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b267fc700 1 -- 172.21.15.84:0/3038386515 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b4001f410 con 0x558fef1c2ea0 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b576fcb80 10 client.8259 fetch_fsmap learned FSMap version 93 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3038386515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x558feef2f030 con 0x558fef1c2ea0 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b267fc700 1 -- 172.21.15.84:0/3038386515 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558fef196990 con 0x558fef1c2ea0 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b267fc700 1 -- 172.21.15.84:0/3038386515 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 93) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f4b4001f570 con 0x558fef1c2ea0 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b576fcb80 10 client.8259 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b576fcb80 10 client.8259 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b576fcb80 20 client.8259 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:18.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x558fef1c3b40 0x558fef1ec590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b576fcb80 4 client.8259 mds_command: new command op to 6802 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3038386515 --> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fef1738c0 con 0x558fef1c3b40 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.156+0000 7f4b47fff700 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x558fef1c3b40 0x558fef1ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b267fc700 10 client.8259 ms_handle_connect on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b47fff700 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x558fef1c3b40 0x558fef1ec590 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10575afbeccf9342 server_cookie=f7705faa8773b6bb in_seq=0 out_seq=0 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b267fc700 1 -- 172.21.15.84:0/3038386515 <== mds.1 v2:172.21.15.131:6833/2772432276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558fef1738c0 con 0x558fef1c3b40 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b267fc700 10 client.8259 handle_command_reply: tid=0 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 client.8259 shutdown 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3038386515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 msgr2=0x558fef1e9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef1e9f60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f4b40003000 tx=0x7f4b40017000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3038386515 shutdown_connections 2023-10-06T03:01:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x558fef1c3b40 0x558fef1ec590 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef1e9f60 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b267fc700 0 client.8259 ms_handle_reset on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a3310 0x558fef1cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3038386515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a4a60 0x558fef1eb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3038386515 >> 172.21.15.84:0/3038386515 conn(0x558fef1a2ed0 msgr2=0x558fef1a1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3038386515 shutdown_connections 2023-10-06T03:01:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.157+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3038386515 wait complete. 2023-10-06T03:01:18.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.158+0000 7f4b576fcb80 20 client.8259 trim_cache size 0 max 16384 2023-10-06T03:01:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.173+0000 7f4b576fcb80 1 Processor -- start 2023-10-06T03:01:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.173+0000 7f4b576fcb80 1 -- start start 2023-10-06T03:01:18.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.174+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.174+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a4a60 0x558fef19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.174+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.174+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fef1ed0d0 con 0x558fef1c2ea0 2023-10-06T03:01:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.174+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fef1f7ee0 con 0x558fef1a3310 2023-10-06T03:01:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.174+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x558fef20aa50 con 0x558fef1a4a60 2023-10-06T03:01:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.174+0000 7f4b4c9a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.174+0000 7f4b4c9a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56412/0 (socket says 172.21.15.84:56412) 2023-10-06T03:01:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.174+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/3274484277 learned_addr learned my addr 172.21.15.84:0/3274484277 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b47fff700 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a4a60 msgr2=0x558fef19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b477fe700 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a4a60 0x558fef19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a4a60 0x558fef19ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 msgr2=0x558fef1c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b4c9a1700 1 -- 172.21.15.84:0/3274484277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fef0c07d0 con 0x558fef1c2ea0 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b47fff700 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b477fe700 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a4a60 0x558fef19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19f290 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f4b40012f90 tx=0x7f4b40021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfe8a032c363e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b3dffb700 1 -- 172.21.15.84:0/3274484277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4000be90 con 0x558fef1c2ea0 2023-10-06T03:01:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b3dffb700 1 -- 172.21.15.84:0/3274484277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4001fad0 con 0x558fef1c2ea0 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b3dffb700 1 -- 172.21.15.84:0/3274484277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b400092e0 con 0x558fef1c2ea0 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3274484277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 msgr2=0x558fef19f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19f290 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f4b40012f90 tx=0x7f4b40021070 comp rx=0 tx=0).stop 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3274484277 shutdown_connections 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1c2ea0 0x558fef19f290 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/3274484277 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1a4a60 0x558fef19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.175+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3274484277 >> 172.21.15.84:0/3274484277 conn(0x558fef1a2ed0 msgr2=0x558fef19fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.176+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3274484277 shutdown_connections 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.176+0000 7f4b576fcb80 1 -- 172.21.15.84:0/3274484277 wait complete. 2023-10-06T03:01:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.176+0000 7f4b576fcb80 1 -- start start 2023-10-06T03:01:18.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.176+0000 7f4b576fcb80 1 Processor -- start 2023-10-06T03:01:18.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1bf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1a4a60 0x558fef236b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b576fcb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1c2ea0 0x558fef24db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fef1ea3c0 con 0x558fef1a4a60 2023-10-06T03:01:18.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fef1ca2a0 con 0x558fef1a3310 2023-10-06T03:01:18.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b576fcb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x558fef1bf7d0 con 0x558fef1c2ea0 2023-10-06T03:01:18.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b576fcb80 10 client.0 _ll_register_callbacks cb 0x558fef165070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1a4a60 0x558fef236b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b477fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1a4a60 0x558fef236b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56424/0 (socket says 172.21.15.84:56424) 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b477fe700 1 -- 172.21.15.84:0/872232356 learned_addr learned my addr 172.21.15.84:0/872232356 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1c2ea0 0x558fef24db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b47fff700 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b477fe700 1 -- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1c2ea0 msgr2=0x558fef24db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b477fe700 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1c2ea0 0x558fef24db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b477fe700 1 -- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 msgr2=0x558fef1bf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b477fe700 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1bf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b477fe700 1 -- 172.21.15.84:0/872232356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558feef2f030 con 0x558fef1a4a60 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b4c9a1700 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1c2ea0 0x558fef24db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b47fff700 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1bf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b477fe700 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1a4a60 0x558fef236b20 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f4b480c6c60 tx=0x7f4b3801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47b1e9f0c45f376 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.177+0000 7f4b267fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b267fc700 1 -- 172.21.15.84:0/872232356 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3801d040 con 0x558fef1a4a60 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b267fc700 1 -- 172.21.15.84:0/872232356 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4b380076e0 con 0x558fef1a4a60 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b576fcb80 1 -- 172.21.15.84:0/872232356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b300584e0 con 0x558fef1a4a60 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b267fc700 1 -- 172.21.15.84:0/872232356 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b38006e00 con 0x558fef1a4a60 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b576fcb80 10 client.8265 fetch_fsmap learned FSMap version 93 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b576fcb80 1 -- 172.21.15.84:0/872232356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x558fef0a74c0 con 0x558fef1a4a60 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b267fc700 1 -- 172.21.15.84:0/872232356 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b300584e0 con 0x558fef1a4a60 2023-10-06T03:01:18.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b267fc700 1 -- 172.21.15.84:0/872232356 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 93) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f4b38024870 con 0x558fef1a4a60 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b576fcb80 10 client.8265 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b576fcb80 10 client.8265 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b576fcb80 20 client.8265 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x558fef24e070 0x558fef1c1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b576fcb80 4 client.8265 mds_command: new command op to 6802 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b576fcb80 1 -- 172.21.15.84:0/872232356 --> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558fef094e50 con 0x558fef24e070 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.178+0000 7f4b47fff700 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x558fef24e070 0x558fef1c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b267fc700 10 client.8265 ms_handle_connect on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b47fff700 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x558fef24e070 0x558fef1c1160 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=12063d3a6722f68d server_cookie=2052b4bfaa66e24f in_seq=0 out_seq=0 2023-10-06T03:01:18.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b267fc700 1 -- 172.21.15.84:0/872232356 <== mds.1 v2:172.21.15.131:6833/2772432276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x558fef094e50 con 0x558fef24e070 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b267fc700 10 client.8265 handle_command_reply: tid=0 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 client.8265 shutdown 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 -- 172.21.15.84:0/872232356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1a4a60 msgr2=0x558fef236b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1a4a60 0x558fef236b20 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f4b480c6c60 tx=0x7f4b3801a040 comp rx=0 tx=0).stop 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 -- 172.21.15.84:0/872232356 shutdown_connections 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:6833/2772432276,v1:172.21.15.131:6835/2772432276] conn(0x558fef24e070 0x558fef1c1160 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fef1a3310 0x558fef1bf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b267fc700 0 client.8265 ms_handle_reset on v2:172.21.15.131:6833/2772432276 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558fef1c2ea0 0x558fef24db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 --2- 172.21.15.84:0/872232356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558fef1a4a60 0x558fef236b20 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 -- 172.21.15.84:0/872232356 >> 172.21.15.84:0/872232356 conn(0x558fef1a2ed0 msgr2=0x558fef1cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 -- 172.21.15.84:0/872232356 shutdown_connections 2023-10-06T03:01:18.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 1 -- 172.21.15.84:0/872232356 wait complete. 2023-10-06T03:01:18.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b576fcb80 20 client.8265 trim_cache size 0 max 16384 2023-10-06T03:01:18.188 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T03:01:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:01:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "ea81fb44-d37d-452e-9e53-a92144a2920c": { 2023-10-06T03:01:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:01:18.188 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "ea81fb44-d37d-452e-9e53-a92144a2920c", 2023-10-06T03:01:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:01:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:18.189 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:18.189 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b28066f30 msgr2=0x7f4b280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b4d1a2700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b28066f30 0x7f4b280693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4b38007fd0 tx=0x7f4b38009040 comp rx=0 tx=0).stop 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480b2660 msgr2=0x7f4b480c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b4d1a2700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480b2660 0x7f4b480c73c0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c880 tx=0x7f4b30008040 comp rx=0 tx=0).stop 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/798576146 shutdown_connections 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b4d1a2700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4b28066f30 0x7f4b280693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b4d1a2700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480cf1f0 0x7f4b480b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b4d1a2700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b480b2660 0x7f4b480c73c0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.179+0000 7f4b4d1a2700 1 --2- 172.21.15.84:0/798576146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b480b2a30 0x7f4b480c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.180+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/798576146 >> 172.21.15.84:0/798576146 conn(0x7f4b48099560 msgr2=0x7f4b480cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.180+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/798576146 shutdown_connections 2023-10-06T03:01:18.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.180+0000 7f4b4d1a2700 1 -- 172.21.15.84:0/798576146 wait complete. 2023-10-06T03:01:18.191 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:01:18.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 scrub status 2023-10-06T03:01:18.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.307+0000 7f9944ea7700 1 Processor -- start 2023-10-06T03:01:18.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.307+0000 7f9944ea7700 1 -- start start 2023-10-06T03:01:18.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f9944ea7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99400b2a90 0x7f99400cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f9944ea7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99400c6610 0x7f99400cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f9944ea7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400cbdf0 con 0x7f99400cb980 2023-10-06T03:01:18.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f9944ea7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99400b2e60 con 0x7f99400c6610 2023-10-06T03:01:18.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f9944ea7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99400cf5d0 con 0x7f99400b2a90 2023-10-06T03:01:18.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f993ed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99400c6610 0x7f99400cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f993dd9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f99400cb980 0x7f99400ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:32814/0 (socket says 172.21.15.84:32814) 2023-10-06T03:01:18.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f993dd9b700 1 -- 172.21.15.84:0/4259010441 learned_addr learned my addr 172.21.15.84:0/4259010441 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:18.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f993ed9d700 1 -- 172.21.15.84:0/4259010441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99400b2a90 msgr2=0x7f99400cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f993ed9d700 1 --2- 172.21.15.84:0/4259010441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99400b2a90 0x7f99400cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f993ed9d700 1 -- 172.21.15.84:0/4259010441 >> v1:172.21.15.84:6789/0 conn(0x7f99400cb980 legacy=0x7f99400ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f993ed9d700 1 -- 172.21.15.84:0/4259010441 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99400cf8b0 con 0x7f99400c6610 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f993d59a700 1 -- 172.21.15.84:0/4259010441 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168786508 0 0) 0x7f99400cbdf0 con 0x7f99400cb980 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.308+0000 7f993ed9d700 1 --2- 172.21.15.84:0/4259010441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 0x7f99400cef60 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f99300098e0 tx=0x7f99300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d698a116264ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f993d59a700 1 -- 172.21.15.84:0/4259010441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930009e80 con 0x7f99400c6610 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f993d59a700 1 -- 172.21.15.84:0/4259010441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993000b860 con 0x7f99400c6610 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f993d59a700 1 -- 172.21.15.84:0/4259010441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993000bbe0 con 0x7f99400c6610 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f9944ea7700 1 -- 172.21.15.84:0/4259010441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 msgr2=0x7f99400cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f9944ea7700 1 --2- 172.21.15.84:0/4259010441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 0x7f99400cef60 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f99300098e0 tx=0x7f99300091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f9944ea7700 1 -- 172.21.15.84:0/4259010441 shutdown_connections 2023-10-06T03:01:18.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f9944ea7700 1 --2- 172.21.15.84:0/4259010441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 0x7f99400cef60 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f9944ea7700 1 --2- 172.21.15.84:0/4259010441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99400b2a90 0x7f99400cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f9944ea7700 1 -- 172.21.15.84:0/4259010441 >> 172.21.15.84:0/4259010441 conn(0x7f9940099740 msgr2=0x7f994006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f9944ea7700 1 -- 172.21.15.84:0/4259010441 shutdown_connections 2023-10-06T03:01:18.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.309+0000 7f9944ea7700 1 -- 172.21.15.84:0/4259010441 wait complete. 2023-10-06T03:01:18.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.310+0000 7f9944ea7700 1 Processor -- start 2023-10-06T03:01:18.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.310+0000 7f9944ea7700 1 -- start start 2023-10-06T03:01:18.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f9944ea7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99400b2a90 0x7f994009dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f9944ea7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 0x7f99400c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f9944ea7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99400cb980 0x7f994009b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f9944ea7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99400c97c0 con 0x7f99400c6610 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f9944ea7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994009ae70 con 0x7f99400b2a90 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f9944ea7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99400c9a10 con 0x7f99400cb980 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f993dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 0x7f99400c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f993dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 0x7f99400c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56440/0 (socket says 172.21.15.84:56440) 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f993dd9b700 1 -- 172.21.15.84:0/3036821916 learned_addr learned my addr 172.21.15.84:0/3036821916 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f993dd9b700 1 -- 172.21.15.84:0/3036821916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99400cb980 msgr2=0x7f994009b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f993dd9b700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99400cb980 0x7f994009b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f993dd9b700 1 -- 172.21.15.84:0/3036821916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99400b2a90 msgr2=0x7f994009dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f993dd9b700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99400b2a90 0x7f994009dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.311+0000 7f993dd9b700 1 -- 172.21.15.84:0/3036821916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9930009420 con 0x7f99400c6610 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.312+0000 7f993dd9b700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 0x7f99400c75a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f993400c5b0 tx=0x7f9934001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.312+0000 7f992e7fc700 1 -- 172.21.15.84:0/3036821916 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934005b30 con 0x7f99400c6610 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.312+0000 7f992e7fc700 1 -- 172.21.15.84:0/3036821916 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9934005c90 con 0x7f99400c6610 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.312+0000 7f9944ea7700 1 -- 172.21.15.84:0/3036821916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99400c9cf0 con 0x7f99400c6610 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.312+0000 7f992e7fc700 1 -- 172.21.15.84:0/3036821916 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934007300 con 0x7f99400c6610 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.312+0000 7f9944ea7700 1 -- 172.21.15.84:0/3036821916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994009e100 con 0x7f99400c6610 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.313+0000 7f992e7fc700 1 -- 172.21.15.84:0/3036821916 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f993401b3b0 con 0x7f99400c6610 2023-10-06T03:01:18.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.313+0000 7f992e7fc700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9920066f30 0x7f99200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.314+0000 7f992e7fc700 1 -- 172.21.15.84:0/3036821916 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9934083d10 con 0x7f99400c6610 2023-10-06T03:01:18.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.314+0000 7f993e59c700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9920066f30 0x7f99200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.314+0000 7f993e59c700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9920066f30 0x7f99200693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f994015e840 tx=0x7f9938009370 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.316+0000 7f994e19fb80 1 Processor -- start 2023-10-06T03:01:18.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.316+0000 7f994e19fb80 1 -- start start 2023-10-06T03:01:18.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.316+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4d890 0x55fc0be4dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.316+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 0x55fc0be9d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.316+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be9e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.316+0000 7f994e19fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0bda4ac0 con 0x55fc0be9dc50 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.316+0000 7f994e19fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0bda22c0 con 0x55fc0be4ed10 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.316+0000 7f994e19fb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc0bd9e0b0 con 0x55fc0be4d890 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.316+0000 7f993ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be9e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be9e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56444/0 (socket says 172.21.15.84:56444) 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993ed9d700 1 -- 172.21.15.84:0/1492527937 learned_addr learned my addr 172.21.15.84:0/1492527937 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993e59c700 1 --2- 172.21.15.84:0/1492527937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4d890 0x55fc0be4dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993dd9b700 1 --2- 172.21.15.84:0/1492527937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 0x55fc0be9d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993ed9d700 1 -- 172.21.15.84:0/1492527937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4d890 msgr2=0x55fc0be4dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993ed9d700 1 --2- 172.21.15.84:0/1492527937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4d890 0x55fc0be4dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993ed9d700 1 -- 172.21.15.84:0/1492527937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 msgr2=0x55fc0be9d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993ed9d700 1 --2- 172.21.15.84:0/1492527937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 0x55fc0be9d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993ed9d700 1 -- 172.21.15.84:0/1492527937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc0bc382c0 con 0x55fc0be9dc50 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f993ed9d700 1 --2- 172.21.15.84:0/1492527937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be9e0a0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f993000b3c0 tx=0x7f9930017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2052818f102644ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f991f7fe700 1 -- 172.21.15.84:0/1492527937 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930006c00 con 0x55fc0be9dc50 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f991f7fe700 1 -- 172.21.15.84:0/1492527937 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993000b9d0 con 0x55fc0be9dc50 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.317+0000 7f991f7fe700 1 -- 172.21.15.84:0/1492527937 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99300266a0 con 0x55fc0be9dc50 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 -- 172.21.15.84:0/1492527937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 msgr2=0x55fc0be9e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 --2- 172.21.15.84:0/1492527937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be9e0a0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f993000b3c0 tx=0x7f9930017000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 -- 172.21.15.84:0/1492527937 shutdown_connections 2023-10-06T03:01:18.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 --2- 172.21.15.84:0/1492527937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be9e0a0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 --2- 172.21.15.84:0/1492527937 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4d890 0x55fc0be4dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 --2- 172.21.15.84:0/1492527937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 0x55fc0be9d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 -- 172.21.15.84:0/1492527937 >> 172.21.15.84:0/1492527937 conn(0x55fc0be4f1b0 msgr2=0x55fc0be4f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 -- 172.21.15.84:0/1492527937 shutdown_connections 2023-10-06T03:01:18.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 -- 172.21.15.84:0/1492527937 wait complete. 2023-10-06T03:01:18.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 -- start start 2023-10-06T03:01:18.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.318+0000 7f994e19fb80 1 Processor -- start 2023-10-06T03:01:18.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be4d890 0x55fc0be4ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 0x55fc0be95310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be9dc50 0x55fc0be95850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f994e19fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0bd498e0 con 0x55fc0be4d890 2023-10-06T03:01:18.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f994e19fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0bd64ef0 con 0x55fc0be4ed10 2023-10-06T03:01:18.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f994e19fb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc0bc20e80 con 0x55fc0be9dc50 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f994e19fb80 10 client.0 _ll_register_callbacks cb 0x55fc0be10ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f993e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be4d890 0x55fc0be4ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f993e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be4d890 0x55fc0be4ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56456/0 (socket says 172.21.15.84:56456) 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.319+0000 7f993e59c700 1 -- 172.21.15.84:0/404459917 learned_addr learned my addr 172.21.15.84:0/404459917 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f993dd9b700 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 0x55fc0be95310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f993ed9d700 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be9dc50 0x55fc0be95850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f993e59c700 1 -- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be9dc50 msgr2=0x55fc0be95850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f993e59c700 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be9dc50 0x55fc0be95850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f993e59c700 1 -- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 msgr2=0x55fc0be95310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f993e59c700 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 0x55fc0be95310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f993e59c700 1 -- 172.21.15.84:0/404459917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99400cf8b0 con 0x55fc0be4d890 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f993e59c700 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be4d890 0x55fc0be4ab70 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f9938009800 tx=0x7f9938012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a6b13abae12456 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f991cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f991cff9700 1 -- 172.21.15.84:0/404459917 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993801c070 con 0x55fc0be4d890 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f991cff9700 1 -- 172.21.15.84:0/404459917 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9938024d80 con 0x55fc0be4d890 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f994e19fb80 1 -- 172.21.15.84:0/404459917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc0be42990 con 0x55fc0be4d890 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f991cff9700 1 -- 172.21.15.84:0/404459917 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f993800f070 con 0x55fc0be4d890 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f994e19fb80 10 client.8280 fetch_fsmap learned FSMap version 93 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f994e19fb80 1 -- 172.21.15.84:0/404459917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55fc0bbdb030 con 0x55fc0be4d890 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f991cff9700 1 -- 172.21.15.84:0/404459917 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc0be42990 con 0x55fc0be4d890 2023-10-06T03:01:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f991cff9700 1 -- 172.21.15.84:0/404459917 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 93) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f9938013870 con 0x55fc0be4d890 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f994e19fb80 10 client.8280 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f994e19fb80 10 client.8280 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f994e19fb80 20 client.8280 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f994e19fb80 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55fc0be734e0 0x55fc0be8cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f994e19fb80 4 client.8280 mds_command: new command op to 6799 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.320+0000 7f994e19fb80 1 -- 172.21.15.84:0/404459917 --> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc0be1f8c0 con 0x55fc0be734e0 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.321+0000 7f993dd9b700 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55fc0be734e0 0x55fc0be8cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.321+0000 7f991cff9700 10 client.8280 ms_handle_connect on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.321+0000 7f993dd9b700 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55fc0be734e0 0x55fc0be8cb60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d4744a60ebc8252 server_cookie=b404b48cf1c31d9a in_seq=0 out_seq=0 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f991cff9700 1 -- 172.21.15.84:0/404459917 <== mds.2 v2:172.21.15.131:6832/3567954898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55fc0be1f8c0 con 0x55fc0be734e0 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f991cff9700 10 client.8280 handle_command_reply: tid=0 2023-10-06T03:01:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 client.8280 shutdown 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 -- 172.21.15.84:0/404459917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be4d890 msgr2=0x55fc0be4ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be4d890 0x55fc0be4ab70 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f9938009800 tx=0x7f9938012000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 -- 172.21.15.84:0/404459917 shutdown_connections 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55fc0be734e0 0x55fc0be8cb60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be9dc50 0x55fc0be95850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f991cff9700 0 client.8280 ms_handle_reset on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be4d890 0x55fc0be4ab70 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 --2- 172.21.15.84:0/404459917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4ed10 0x55fc0be95310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 -- 172.21.15.84:0/404459917 >> 172.21.15.84:0/404459917 conn(0x55fc0be4f1b0 msgr2=0x55fc0be76b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 -- 172.21.15.84:0/404459917 shutdown_connections 2023-10-06T03:01:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 1 -- 172.21.15.84:0/404459917 wait complete. 2023-10-06T03:01:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.322+0000 7f994e19fb80 20 client.8280 trim_cache size 0 max 16384 2023-10-06T03:01:18.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.338+0000 7f994e19fb80 1 Processor -- start 2023-10-06T03:01:18.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.338+0000 7f994e19fb80 1 -- start start 2023-10-06T03:01:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0be91870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0bea66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be4a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f994e19fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0be9da90 con 0x55fc0be9dc50 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f994e19fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0be26230 con 0x55fc0be4d890 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f994e19fb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc0be97c70 con 0x55fc0be4ed10 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be4a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be4a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56462/0 (socket says 172.21.15.84:56462) 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993ed9d700 1 -- 172.21.15.84:0/636455931 learned_addr learned my addr 172.21.15.84:0/636455931 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993e59c700 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0be91870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993dd9b700 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0bea66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993ed9d700 1 -- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 msgr2=0x55fc0bea66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993ed9d700 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0bea66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993ed9d700 1 -- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 msgr2=0x55fc0be91870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993ed9d700 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0be91870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993ed9d700 1 -- 172.21.15.84:0/636455931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc0bd6c7d0 con 0x55fc0be9dc50 2023-10-06T03:01:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993e59c700 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0be91870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993dd9b700 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0bea66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f993ed9d700 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be4a9d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f99300093a0 tx=0x7f993001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d06304b6e81edee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f991ffff700 1 -- 172.21.15.84:0/636455931 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993002c040 con 0x55fc0be9dc50 2023-10-06T03:01:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f991ffff700 1 -- 172.21.15.84:0/636455931 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993000bb40 con 0x55fc0be9dc50 2023-10-06T03:01:18.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.339+0000 7f991ffff700 1 -- 172.21.15.84:0/636455931 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930026450 con 0x55fc0be9dc50 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.340+0000 7f994e19fb80 1 -- 172.21.15.84:0/636455931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 msgr2=0x55fc0be4a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.340+0000 7f994e19fb80 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be4a9d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f99300093a0 tx=0x7f993001d040 comp rx=0 tx=0).stop 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.340+0000 7f994e19fb80 1 -- 172.21.15.84:0/636455931 shutdown_connections 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.340+0000 7f994e19fb80 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0be91870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.340+0000 7f994e19fb80 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be4a9d0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.340+0000 7f994e19fb80 1 --2- 172.21.15.84:0/636455931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0bea66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.340+0000 7f994e19fb80 1 -- 172.21.15.84:0/636455931 >> 172.21.15.84:0/636455931 conn(0x55fc0be4f1b0 msgr2=0x55fc0be770e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.340+0000 7f994e19fb80 1 -- 172.21.15.84:0/636455931 shutdown_connections 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.340+0000 7f994e19fb80 1 -- 172.21.15.84:0/636455931 wait complete. 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.341+0000 7f994e19fb80 1 -- start start 2023-10-06T03:01:18.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.341+0000 7f994e19fb80 1 Processor -- start 2023-10-06T03:01:18.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.341+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0bef9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.341+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0be8edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.341+0000 7f994e19fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be8f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.341+0000 7f994e19fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0befa050 con 0x55fc0be9dc50 2023-10-06T03:01:18.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.341+0000 7f994e19fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0be49cf0 con 0x55fc0be4d890 2023-10-06T03:01:18.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.341+0000 7f994e19fb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc0be9bb40 con 0x55fc0be4ed10 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f994e19fb80 10 client.0 _ll_register_callbacks cb 0x55fc0be10ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be8f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be8f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56468/0 (socket says 172.21.15.84:56468) 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993ed9d700 1 -- 172.21.15.84:0/537175040 learned_addr learned my addr 172.21.15.84:0/537175040 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993e59c700 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0bef9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993dd9b700 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0be8edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993ed9d700 1 -- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 msgr2=0x55fc0be8edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993ed9d700 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0be8edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993ed9d700 1 -- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 msgr2=0x55fc0bef9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993ed9d700 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0bef9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993ed9d700 1 -- 172.21.15.84:0/537175040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc0bc382c0 con 0x55fc0be9dc50 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993dd9b700 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0be8edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993e59c700 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0bef9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f993ed9d700 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be8f300 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f99300093f0 tx=0x7f9930003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea6360d69b4e97e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f991cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f991cff9700 1 -- 172.21.15.84:0/537175040 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993002c040 con 0x55fc0be9dc50 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f991cff9700 1 -- 172.21.15.84:0/537175040 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9930026a90 con 0x55fc0be9dc50 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f994e19fb80 1 -- 172.21.15.84:0/537175040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f993000b9d0 con 0x55fc0be9dc50 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f991cff9700 1 -- 172.21.15.84:0/537175040 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9930026e60 con 0x55fc0be9dc50 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f994e19fb80 10 client.8286 fetch_fsmap learned FSMap version 93 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f994e19fb80 1 -- 172.21.15.84:0/537175040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55fc0bd534c0 con 0x55fc0be9dc50 2023-10-06T03:01:18.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.342+0000 7f991cff9700 1 -- 172.21.15.84:0/537175040 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993000b9d0 con 0x55fc0be9dc50 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f991cff9700 1 -- 172.21.15.84:0/537175040 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 93) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f9930031430 con 0x55fc0be9dc50 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f994e19fb80 10 client.8286 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f994e19fb80 10 client.8286 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f994e19fb80 20 client.8286 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f994e19fb80 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55fc0be4f580 0x55fc0be8a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f994e19fb80 4 client.8286 mds_command: new command op to 6799 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f994e19fb80 1 -- 172.21.15.84:0/537175040 --> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fc0bd40e50 con 0x55fc0be4f580 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f993e59c700 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55fc0be4f580 0x55fc0be8a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f991cff9700 10 client.8286 ms_handle_connect on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f993e59c700 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55fc0be4f580 0x55fc0be8a3a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=604baed7105a3a2b server_cookie=bcfb5422bcb70a28 in_seq=0 out_seq=0 2023-10-06T03:01:18.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f991cff9700 1 -- 172.21.15.84:0/537175040 <== mds.2 v2:172.21.15.131:6832/3567954898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55fc0bd40e50 con 0x55fc0be4f580 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f991cff9700 10 client.8286 handle_command_reply: tid=0 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.343+0000 7f994e19fb80 1 client.8286 shutdown 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 -- 172.21.15.84:0/537175040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 msgr2=0x55fc0be8f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be8f300 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f99300093f0 tx=0x7f9930003050 comp rx=0 tx=0).stop 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 -- 172.21.15.84:0/537175040 shutdown_connections 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:6832/3567954898,v1:172.21.15.131:6834/3567954898] conn(0x55fc0be4f580 0x55fc0be8a3a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc0be4d890 0x55fc0bef9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fc0be9dc50 0x55fc0be8f300 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 --2- 172.21.15.84:0/537175040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55fc0be4ed10 0x55fc0be8edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 -- 172.21.15.84:0/537175040 >> 172.21.15.84:0/537175040 conn(0x55fc0be4f1b0 msgr2=0x55fc0bea6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f991cff9700 0 client.8286 ms_handle_reset on v2:172.21.15.131:6832/3567954898 2023-10-06T03:01:18.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 -- 172.21.15.84:0/537175040 shutdown_connections 2023-10-06T03:01:18.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 1 -- 172.21.15.84:0/537175040 wait complete. 2023-10-06T03:01:18.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f994e19fb80 20 client.8286 trim_cache size 0 max 16384 2023-10-06T03:01:18.353 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:18.353 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T03:01:18.353 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:01:18.353 INFO:teuthology.orchestra.run.smithi084.stdout: "ea81fb44-d37d-452e-9e53-a92144a2920c": { 2023-10-06T03:01:18.353 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:01:18.353 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "ea81fb44-d37d-452e-9e53-a92144a2920c", 2023-10-06T03:01:18.354 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:01:18.354 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:18.354 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:18.354 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 -- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9920066f30 msgr2=0x7f99200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9920066f30 0x7f99200693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f994015e840 tx=0x7f9938009370 comp rx=0 tx=0).stop 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 -- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 msgr2=0x7f99400c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 0x7f99400c75a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f993400c5b0 tx=0x7f9934001070 comp rx=0 tx=0).stop 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 -- 172.21.15.84:0/3036821916 shutdown_connections 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9920066f30 0x7f99200693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99400b2a90 0x7f994009dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99400cb980 0x7f994009b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 --2- 172.21.15.84:0/3036821916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99400c6610 0x7f99400c75a0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 -- 172.21.15.84:0/3036821916 >> 172.21.15.84:0/3036821916 conn(0x7f9940099740 msgr2=0x7f9940159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 -- 172.21.15.84:0/3036821916 shutdown_connections 2023-10-06T03:01:18.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.344+0000 7f9944ea7700 1 -- 172.21.15.84:0/3036821916 wait complete. 2023-10-06T03:01:18.356 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:01:18.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-10-06T03:01:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.471+0000 7f0c00e67700 1 Processor -- start 2023-10-06T03:01:18.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.471+0000 7f0c00e67700 1 -- start start 2023-10-06T03:01:18.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0c00e67700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bfc06a120 0x7f0bfc0675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0c00e67700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0bfc15a6f0 0x7f0bfc067b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0c00e67700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc15a260 con 0x7f0bfc159320 2023-10-06T03:01:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0c00e67700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc06ace0 con 0x7f0bfc06a120 2023-10-06T03:01:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0c00e67700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc159c10 con 0x7f0bfc15a6f0 2023-10-06T03:01:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0bfaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bfc06a120 0x7f0bfc0675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0bfaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bfc06a120 0x7f0bfc0675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56482/0 (socket says 172.21.15.84:56482) 2023-10-06T03:01:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0bfaffd700 1 -- 172.21.15.84:0/1950547635 learned_addr learned my addr 172.21.15.84:0/1950547635 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0bfbfff700 1 --2- 172.21.15.84:0/1950547635 >> v2:172.21.15.131:3300/0 conn(0x7f0bfc15a6f0 0x7f0bfc067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0bfaffd700 1 -- 172.21.15.84:0/1950547635 >> v2:172.21.15.131:3300/0 conn(0x7f0bfc15a6f0 msgr2=0x7f0bfc067b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/1950547635 >> v2:172.21.15.131:3300/0 conn(0x7f0bfc15a6f0 0x7f0bfc067b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0bfaffd700 1 -- 172.21.15.84:0/1950547635 >> v1:172.21.15.131:6789/0 conn(0x7f0bfc159320 legacy=0x7f0bfc069a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.472+0000 7f0bfaffd700 1 -- 172.21.15.84:0/1950547635 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc159ef0 con 0x7f0bfc06a120 2023-10-06T03:01:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/1950547635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 0x7f0bfc0675f0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc063ed0 tx=0x7f0bf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd7174d3d1be0b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0bfa7fc700 1 -- 172.21.15.84:0/1950547635 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0009e70 con 0x7f0bfc06a120 2023-10-06T03:01:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0bfa7fc700 1 -- 172.21.15.84:0/1950547635 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000b860 con 0x7f0bfc06a120 2023-10-06T03:01:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0bfa7fc700 1 -- 172.21.15.84:0/1950547635 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000bc00 con 0x7f0bfc06a120 2023-10-06T03:01:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0c00e67700 1 -- 172.21.15.84:0/1950547635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 msgr2=0x7f0bfc0675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0c00e67700 1 --2- 172.21.15.84:0/1950547635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 0x7f0bfc0675f0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc063ed0 tx=0x7f0bf0009250 comp rx=0 tx=0).stop 2023-10-06T03:01:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0c00e67700 1 -- 172.21.15.84:0/1950547635 shutdown_connections 2023-10-06T03:01:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0c00e67700 1 --2- 172.21.15.84:0/1950547635 >> v2:172.21.15.131:3300/0 conn(0x7f0bfc15a6f0 0x7f0bfc067b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0c00e67700 1 --2- 172.21.15.84:0/1950547635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 0x7f0bfc0675f0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0c00e67700 1 -- 172.21.15.84:0/1950547635 >> 172.21.15.84:0/1950547635 conn(0x7f0bfc0cd220 msgr2=0x7f0bfc0c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0c00e67700 1 -- 172.21.15.84:0/1950547635 shutdown_connections 2023-10-06T03:01:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.473+0000 7f0c00e67700 1 -- 172.21.15.84:0/1950547635 wait complete. 2023-10-06T03:01:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.474+0000 7f0c00e67700 1 Processor -- start 2023-10-06T03:01:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0c00e67700 1 -- start start 2023-10-06T03:01:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0c00e67700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 0x7f0bfc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0c00e67700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bfc159320 0x7f0bfc0c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0c00e67700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bfc15a6f0 0x7f0bfc15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0c00e67700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc16d940 con 0x7f0bfc06a120 2023-10-06T03:01:18.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0c00e67700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc16ca50 con 0x7f0bfc159320 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0c00e67700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc16cd30 con 0x7f0bfc15a6f0 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 0x7f0bfc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 0x7f0bfc0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56498/0 (socket says 172.21.15.84:56498) 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/1877449873 learned_addr learned my addr 172.21.15.84:0/1877449873 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.475+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bfc159320 0x7f0bfc0c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0bfbfff700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bfc15a6f0 0x7f0bfc15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/1877449873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bfc15a6f0 msgr2=0x7f0bfc15d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bfc15a6f0 0x7f0bfc15d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/1877449873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bfc159320 msgr2=0x7f0bfc0c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bfc159320 0x7f0bfc0c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/1877449873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf00094f0 con 0x7f0bfc06a120 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bfc159320 0x7f0bfc0c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 0x7f0bfc0c7550 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00cb10 tx=0x7f0bec0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0be37fe700 1 -- 172.21.15.84:0/1877449873 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00a760 con 0x7f0bfc06a120 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0be37fe700 1 -- 172.21.15.84:0/1877449873 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec00a8e0 con 0x7f0bfc06a120 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0c00e67700 1 -- 172.21.15.84:0/1877449873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc16d010 con 0x7f0bfc06a120 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0be37fe700 1 -- 172.21.15.84:0/1877449873 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00aca0 con 0x7f0bfc06a120 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.476+0000 7f0c00e67700 1 -- 172.21.15.84:0/1877449873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc16d5d0 con 0x7f0bfc06a120 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.477+0000 7f0be37fe700 1 -- 172.21.15.84:0/1877449873 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bec003030 con 0x7f0bfc06a120 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.478+0000 7f0be37fe700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0be8066f30 0x7f0be80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.478+0000 7f0be37fe700 1 -- 172.21.15.84:0/1877449873 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0bec084950 con 0x7f0bfc06a120 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.478+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0be8066f30 0x7f0be80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.478+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0be8066f30 0x7f0be80693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc063ed0 tx=0x7f0bf0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.480+0000 7f0c0b3c1b80 1 Processor -- start 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.480+0000 7f0c0b3c1b80 1 -- start start 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.480+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 0x55a819448d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.480+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a819449250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.480+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 0x55a819449790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.480+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8193a3ac0 con 0x55a81944e310 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.480+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8193a12c0 con 0x55a81946dea0 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.480+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a81939d0b0 con 0x55a81944fa60 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a819449250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a819449250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56502/0 (socket says 172.21.15.84:56502) 2023-10-06T03:01:18.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfaffd700 1 -- 172.21.15.84:0/2995838905 learned_addr learned my addr 172.21.15.84:0/2995838905 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 0x55a819448d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfbfff700 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 0x55a819449790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfaffd700 1 -- 172.21.15.84:0/2995838905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 msgr2=0x55a819449790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 0x55a819449790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfaffd700 1 -- 172.21.15.84:0/2995838905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 msgr2=0x55a819448d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 0x55a819448d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfaffd700 1 -- 172.21.15.84:0/2995838905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8192372c0 con 0x55a81944e310 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 0x55a819448d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a819449250 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000b3c0 tx=0x7f0bf0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76b7228807c828a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0be0ff9700 1 -- 172.21.15.84:0/2995838905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0020070 con 0x55a81944e310 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0be0ff9700 1 -- 172.21.15.84:0/2995838905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000bb00 con 0x55a81944e310 2023-10-06T03:01:18.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.481+0000 7f0be0ff9700 1 -- 172.21.15.84:0/2995838905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0029c50 con 0x55a81944e310 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2995838905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 msgr2=0x55a819449250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a819449250 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000b3c0 tx=0x7f0bf0020000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2995838905 shutdown_connections 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 0x55a819448d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 0x55a819449790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2995838905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a819449250 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2995838905 >> 172.21.15.84:0/2995838905 conn(0x55a81944ded0 msgr2=0x55a81944e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2995838905 shutdown_connections 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2995838905 wait complete. 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.482+0000 7f0c0b3c1b80 1 -- start start 2023-10-06T03:01:18.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0c0b3c1b80 1 Processor -- start 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a81946b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 0x55a81946e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 0x55a81947b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8193488e0 con 0x55a81944e310 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a819363ef0 con 0x55a81946dea0 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a81921fe80 con 0x55a81944fa60 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0c0b3c1b80 10 client.0 _ll_register_callbacks cb 0x55a819410070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a81946b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a81946b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56516/0 (socket says 172.21.15.84:56516) 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.483+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/2077165123 learned_addr learned my addr 172.21.15.84:0/2077165123 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bfbfff700 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 0x55a81947b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 0x55a81946e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/2077165123 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 msgr2=0x55a81946e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 0x55a81946e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/2077165123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 msgr2=0x55a81947b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 0x55a81947b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/2077165123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc159ef0 con 0x55a81944e310 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a81946b330 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f0bec001a40 tx=0x7f0bec01d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5844f3f2ccc53e62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bd9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/2077165123 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00ae60 con 0x55a81944e310 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/2077165123 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0bec00f260 con 0x55a81944e310 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2077165123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a819441990 con 0x55a81944e310 2023-10-06T03:01:18.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/2077165123 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bec0557a0 con 0x55a81944e310 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0c0b3c1b80 10 client.8298 fetch_fsmap learned FSMap version 93 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2077165123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55a8191da030 con 0x55a81944e310 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/2077165123 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a819441990 con 0x55a81944e310 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/2077165123 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 93) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f0bec054a30 con 0x55a81944e310 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0c0b3c1b80 10 client.8298 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0c0b3c1b80 10 client.8298 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0c0b3c1b80 20 client.8298 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55a8194a3930 0x55a819496040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0c0b3c1b80 4 client.8298 mds_command: new command op to 7716 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2077165123 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a81941e8c0 con 0x55a8194a3930 2023-10-06T03:01:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.484+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55a8194a3930 0x55a819496040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0bd9ffb700 10 client.8298 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55a8194a3930 0x55a819496040 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4330f6a4fa5f0637 server_cookie=92272756487503f7 in_seq=0 out_seq=0 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/2077165123 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a81941e8c0 con 0x55a8194a3930 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0bd9ffb700 10 client.8298 handle_command_reply: tid=0 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 client.8298 shutdown 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2077165123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 msgr2=0x55a81946b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a81946b330 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f0bec001a40 tx=0x7f0bec01d040 comp rx=0 tx=0).stop 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2077165123 shutdown_connections 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55a8194a3930 0x55a819496040 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81946dea0 0x55a81947b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0bd9ffb700 0 client.8298 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:18.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944e310 0x55a81946b330 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/2077165123 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944fa60 0x55a81946e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2077165123 >> 172.21.15.84:0/2077165123 conn(0x55a81944ded0 msgr2=0x55a81944ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2077165123 shutdown_connections 2023-10-06T03:01:18.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.485+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/2077165123 wait complete. 2023-10-06T03:01:18.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.486+0000 7f0c0b3c1b80 20 client.8298 trim_cache size 0 max 16384 2023-10-06T03:01:18.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.501+0000 7f0c0b3c1b80 1 Processor -- start 2023-10-06T03:01:18.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.501+0000 7f0c0b3c1b80 1 -- start start 2023-10-06T03:01:18.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a819450000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 0x55a819449cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 0x55a819449500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a819449a40 con 0x55a81944ccb0 2023-10-06T03:01:18.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8194a6180 con 0x55a81944ded0 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a819441750 con 0x55a81944e310 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a819450000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a819450000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56530/0 (socket says 172.21.15.84:56530) 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/3233015551 learned_addr learned my addr 172.21.15.84:0/3233015551 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/3233015551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 msgr2=0x55a819449500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/3233015551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 0x55a819449500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/3233015551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 msgr2=0x55a819449cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/3233015551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 0x55a819449cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/3233015551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a81936b7d0 con 0x55a81944ccb0 2023-10-06T03:01:18.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/3233015551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a819450000 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f0bec071270 tx=0x7f0bec058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44af08de6c237738 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0be17fa700 1 -- 172.21.15.84:0/3233015551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00ae60 con 0x55a81944ccb0 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0be17fa700 1 -- 172.21.15.84:0/3233015551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec055080 con 0x55a81944ccb0 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.502+0000 7f0be17fa700 1 -- 172.21.15.84:0/3233015551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00f260 con 0x55a81944ccb0 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3233015551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 msgr2=0x55a819450000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3233015551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a819450000 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f0bec071270 tx=0x7f0bec058000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3233015551 shutdown_connections 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3233015551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 0x55a819449500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3233015551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a819450000 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3233015551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 0x55a819449cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3233015551 >> 172.21.15.84:0/3233015551 conn(0x55a81946e900 msgr2=0x55a81946a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3233015551 shutdown_connections 2023-10-06T03:01:18.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3233015551 wait complete. 2023-10-06T03:01:18.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.503+0000 7f0c0b3c1b80 1 -- start start 2023-10-06T03:01:18.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0c0b3c1b80 1 Processor -- start 2023-10-06T03:01:18.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a81944ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 0x55a8194949d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0c0b3c1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 0x55a819494f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8194df100 con 0x55a81944ccb0 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8194df560 con 0x55a81944ded0 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0c0b3c1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8194a7280 con 0x55a81944e310 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0c0b3c1b80 10 client.0 _ll_register_callbacks cb 0x55a819410070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a81944ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0bfb7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a81944ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56538/0 (socket says 172.21.15.84:56538) 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/3771867083 learned_addr learned my addr 172.21.15.84:0/3771867083 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 0x55a8194949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.504+0000 7f0bfbfff700 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 0x55a819494f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 msgr2=0x55a819494f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 0x55a819494f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 msgr2=0x55a8194949d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 0x55a8194949d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bfb7fe700 1 -- 172.21.15.84:0/3771867083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8191da030 con 0x55a81944ccb0 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 0x55a8194949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bfbfff700 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 0x55a819494f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bfb7fe700 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a81944ec90 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0554d0 tx=0x7f0bec06d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a97a6878a0f3fa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bd9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/3771867083 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00ae00 con 0x55a81944ccb0 2023-10-06T03:01:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/3771867083 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0bec0559b0 con 0x55a81944ccb0 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3771867083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bf000bb00 con 0x55a81944ccb0 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/3771867083 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bec06bb60 con 0x55a81944ccb0 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0c0b3c1b80 10 client.8304 fetch_fsmap learned FSMap version 93 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3771867083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55a8193524c0 con 0x55a81944ccb0 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/3771867083 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000bb00 con 0x55a81944ccb0 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/3771867083 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 93) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f0bec072d20 con 0x55a81944ccb0 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0c0b3c1b80 10 client.8304 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0c0b3c1b80 10 client.8304 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0c0b3c1b80 20 client.8304 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55a81944fa60 0x55a819478b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0c0b3c1b80 4 client.8304 mds_command: new command op to 7716 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:01:18.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3771867083 --> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a81933fe50 con 0x55a81944fa60 2023-10-06T03:01:18.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.505+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55a81944fa60 0x55a819478b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0bd9ffb700 10 client.8304 ms_handle_connect on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:18.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0bfaffd700 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55a81944fa60 0x55a819478b60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e5f6b475b7b5c72 server_cookie=4165ea228e469f27 in_seq=0 out_seq=0 2023-10-06T03:01:18.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0bd9ffb700 1 -- 172.21.15.84:0/3771867083 <== mds.0 v2:172.21.15.84:6834/4266209083 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55a81933fe50 con 0x55a81944fa60 2023-10-06T03:01:18.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0bd9ffb700 10 client.8304 handle_command_reply: tid=0 2023-10-06T03:01:18.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 client.8304 shutdown 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3771867083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 msgr2=0x55a81944ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a81944ec90 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f0bec0554d0 tx=0x7f0bec06d040 comp rx=0 tx=0).stop 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3771867083 shutdown_connections 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.84:6834/4266209083,v1:172.21.15.84:6836/4266209083] conn(0x55a81944fa60 0x55a819478b60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a81944e310 0x55a819494f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0bd9ffb700 0 client.8304 ms_handle_reset on v2:172.21.15.84:6834/4266209083 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a81944ccb0 0x55a81944ec90 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 --2- 172.21.15.84:0/3771867083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a81944ded0 0x55a8194949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3771867083 >> 172.21.15.84:0/3771867083 conn(0x55a81946e900 msgr2=0x55a81946a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3771867083 shutdown_connections 2023-10-06T03:01:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 1 -- 172.21.15.84:0/3771867083 wait complete. 2023-10-06T03:01:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c0b3c1b80 20 client.8304 trim_cache size 0 max 16384 2023-10-06T03:01:18.516 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:18.516 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T03:01:18.516 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:01:18.516 INFO:teuthology.orchestra.run.smithi084.stdout: "ea81fb44-d37d-452e-9e53-a92144a2920c": { 2023-10-06T03:01:18.516 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:01:18.516 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "ea81fb44-d37d-452e-9e53-a92144a2920c", 2023-10-06T03:01:18.516 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:01:18.516 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:18.517 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:18.517 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:18.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c00e67700 1 -- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0be8066f30 msgr2=0x7f0be80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c00e67700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0be8066f30 0x7f0be80693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc063ed0 tx=0x7f0bf0017000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c00e67700 1 -- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 msgr2=0x7f0bfc0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.506+0000 7f0c00e67700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 0x7f0bfc0c7550 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00cb10 tx=0x7f0bec0017b0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.507+0000 7f0c00e67700 1 -- 172.21.15.84:0/1877449873 shutdown_connections 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.507+0000 7f0c00e67700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0be8066f30 0x7f0be80693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.507+0000 7f0c00e67700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bfc15a6f0 0x7f0bfc15d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.507+0000 7f0c00e67700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bfc06a120 0x7f0bfc0c7550 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.507+0000 7f0c00e67700 1 --2- 172.21.15.84:0/1877449873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bfc159320 0x7f0bfc0c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.507+0000 7f0c00e67700 1 -- 172.21.15.84:0/1877449873 >> 172.21.15.84:0/1877449873 conn(0x7f0bfc0cd220 msgr2=0x7f0bfc1563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.507+0000 7f0c00e67700 1 -- 172.21.15.84:0/1877449873 shutdown_connections 2023-10-06T03:01:18.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.507+0000 7f0c00e67700 1 -- 172.21.15.84:0/1877449873 wait complete. 2023-10-06T03:01:18.519 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:01:18.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.634+0000 7fd08a464700 1 Processor -- start 2023-10-06T03:01:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.634+0000 7fd08a464700 1 -- start start 2023-10-06T03:01:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.635+0000 7fd08a464700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0841595a0 0x7fd0840aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.635+0000 7fd08a464700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0840b07a0 0x7fd0840b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.635+0000 7fd08a464700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840b0ca0 con 0x7fd0840b49e0 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.635+0000 7fd08a464700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840b0f80 con 0x7fd0840b07a0 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.635+0000 7fd08a464700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840b1260 con 0x7fd0841595a0 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.635+0000 7fd0837fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd0840b49e0 0x7fd0840aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:55364/0 (socket says 172.21.15.84:55364) 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.635+0000 7fd0837fe700 1 -- 172.21.15.84:0/1265442948 learned_addr learned my addr 172.21.15.84:0/1265442948 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.635+0000 7fd088a01700 1 --2- 172.21.15.84:0/1265442948 >> v2:172.21.15.84:3300/0 conn(0x7fd0840b07a0 0x7fd0840b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.635+0000 7fd083fff700 1 --2- 172.21.15.84:0/1265442948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0841595a0 0x7fd0840aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.636+0000 7fd082ffd700 1 -- 172.21.15.84:0/1265442948 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657202183 0 0) 0x7fd0840b0ca0 con 0x7fd0840b49e0 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.636+0000 7fd088a01700 1 -- 172.21.15.84:0/1265442948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0841595a0 msgr2=0x7fd0840aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.636+0000 7fd088a01700 1 --2- 172.21.15.84:0/1265442948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0841595a0 0x7fd0840aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.636+0000 7fd088a01700 1 -- 172.21.15.84:0/1265442948 >> v1:172.21.15.131:6789/0 conn(0x7fd0840b49e0 legacy=0x7fd0840aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.636+0000 7fd088a01700 1 -- 172.21.15.84:0/1265442948 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840b1540 con 0x7fd0840b07a0 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.636+0000 7fd088a01700 1 --2- 172.21.15.84:0/1265442948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b07a0 0x7fd0840b1c00 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009e60 tx=0x7fd07c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706d0e8bcdf99409 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.636+0000 7fd082ffd700 1 -- 172.21.15.84:0/1265442948 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c00e070 con 0x7fd0840b07a0 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.636+0000 7fd082ffd700 1 -- 172.21.15.84:0/1265442948 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c00bb60 con 0x7fd0840b07a0 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.636+0000 7fd082ffd700 1 -- 172.21.15.84:0/1265442948 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c012430 con 0x7fd0840b07a0 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.637+0000 7fd08a464700 1 -- 172.21.15.84:0/1265442948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b07a0 msgr2=0x7fd0840b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.637+0000 7fd08a464700 1 --2- 172.21.15.84:0/1265442948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b07a0 0x7fd0840b1c00 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009e60 tx=0x7fd07c009780 comp rx=0 tx=0).stop 2023-10-06T03:01:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.637+0000 7fd08a464700 1 -- 172.21.15.84:0/1265442948 shutdown_connections 2023-10-06T03:01:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.637+0000 7fd08a464700 1 --2- 172.21.15.84:0/1265442948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b07a0 0x7fd0840b1c00 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.637+0000 7fd08a464700 1 --2- 172.21.15.84:0/1265442948 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0841595a0 0x7fd0840aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.637+0000 7fd08a464700 1 -- 172.21.15.84:0/1265442948 >> 172.21.15.84:0/1265442948 conn(0x7fd084099830 msgr2=0x7fd08406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.637+0000 7fd08a464700 1 -- 172.21.15.84:0/1265442948 shutdown_connections 2023-10-06T03:01:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.637+0000 7fd08a464700 1 -- 172.21.15.84:0/1265442948 wait complete. 2023-10-06T03:01:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.638+0000 7fd08a464700 1 Processor -- start 2023-10-06T03:01:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.638+0000 7fd08a464700 1 -- start start 2023-10-06T03:01:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd08a464700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0840b07a0 0x7fd0840acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd08a464700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b49e0 0x7fd0840b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd08a464700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0841595a0 0x7fd0840ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd08a464700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840ac880 con 0x7fd0840b49e0 2023-10-06T03:01:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd08a464700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840ad250 con 0x7fd0841595a0 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd08a464700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840abc70 con 0x7fd0840b07a0 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd0837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b49e0 0x7fd0840b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd0837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b49e0 0x7fd0840b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56556/0 (socket says 172.21.15.84:56556) 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd0837fe700 1 -- 172.21.15.84:0/3258082200 learned_addr learned my addr 172.21.15.84:0/3258082200 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd083fff700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0840b07a0 0x7fd0840acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd088a01700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0841595a0 0x7fd0840ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd0837fe700 1 -- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0840b07a0 msgr2=0x7fd0840acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd0837fe700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0840b07a0 0x7fd0840acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd0837fe700 1 -- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0841595a0 msgr2=0x7fd0840ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd0837fe700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0841595a0 0x7fd0840ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd0837fe700 1 -- 172.21.15.84:0/3258082200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c009a20 con 0x7fd0840b49e0 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd083fff700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0840b07a0 0x7fd0840acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd088a01700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0841595a0 0x7fd0840ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd0837fe700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b49e0 0x7fd0840b22f0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c810 tx=0x7fd078007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd06bfff700 1 -- 172.21.15.84:0/3258082200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078005c00 con 0x7fd0840b49e0 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd06bfff700 1 -- 172.21.15.84:0/3258082200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078005d60 con 0x7fd0840b49e0 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd06bfff700 1 -- 172.21.15.84:0/3258082200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078007320 con 0x7fd0840b49e0 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0840abf50 con 0x7fd0840b49e0 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.639+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0840ac510 con 0x7fd0840b49e0 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.640+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd084064ad0 con 0x7fd0840b49e0 2023-10-06T03:01:18.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.641+0000 7fd06bfff700 1 -- 172.21.15.84:0/3258082200 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd07801b400 con 0x7fd0840b49e0 2023-10-06T03:01:18.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.641+0000 7fd06bfff700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd070066f30 0x7fd0700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.641+0000 7fd06bfff700 1 -- 172.21.15.84:0/3258082200 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd078084300 con 0x7fd0840b49e0 2023-10-06T03:01:18.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.641+0000 7fd083fff700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd070066f30 0x7fd0700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.641+0000 7fd083fff700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd070066f30 0x7fd0700693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd074006ea0 tx=0x7fd074008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.645+0000 7fd06bfff700 1 -- 172.21.15.84:0/3258082200 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd078051350 con 0x7fd0840b49e0 2023-10-06T03:01:18.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.874+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd08404bb80 con 0x7fd0840b49e0 2023-10-06T03:01:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.874+0000 7fd06bfff700 1 -- 172.21.15.84:0/3258082200 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fd078054970 con 0x7fd0840b49e0 2023-10-06T03:01:18.875 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:18.875 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd070066f30 msgr2=0x7fd0700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd070066f30 0x7fd0700693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd074006ea0 tx=0x7fd074008040 comp rx=0 tx=0).stop 2023-10-06T03:01:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b49e0 msgr2=0x7fd0840b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b49e0 0x7fd0840b22f0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c810 tx=0x7fd078007db0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 shutdown_connections 2023-10-06T03:01:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd070066f30 0x7fd0700693e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0841595a0 0x7fd0840ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd0840b07a0 0x7fd0840acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 --2- 172.21.15.84:0/3258082200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0840b49e0 0x7fd0840b22f0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 >> 172.21.15.84:0/3258082200 conn(0x7fd084099830 msgr2=0x7fd084069700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 shutdown_connections 2023-10-06T03:01:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:18.876+0000 7fd08a464700 1 -- 172.21.15.84:0/3258082200 wait complete. 2023-10-06T03:01:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:18.889 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:18.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:19.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.001+0000 7efe88f31700 1 Processor -- start 2023-10-06T03:01:19.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.001+0000 7efe88f31700 1 -- start start 2023-10-06T03:01:19.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe88f31700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 0x7efe840c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:19.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe88f31700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efe840c75b0 0x7efe8406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:19.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe88f31700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe8406ebd0 0x7efe8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe88f31700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8406f470 con 0x7efe8406ebd0 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe88f31700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8406f050 con 0x7efe840c75b0 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe88f31700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe840acd60 con 0x7efe84156540 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe82d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe8406ebd0 0x7efe8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe82d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe8406ebd0 0x7efe8406d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56560/0 (socket says 172.21.15.84:56560) 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe82d9d700 1 -- 172.21.15.84:0/1592883835 learned_addr learned my addr 172.21.15.84:0/1592883835 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe8259c700 1 --2- 172.21.15.84:0/1592883835 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 0x7efe840c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.002+0000 7efe81d9b700 1 --2- 172.21.15.84:0/1592883835 >> v2:172.21.15.131:3300/0 conn(0x7efe840c75b0 0x7efe8406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe82d9d700 1 -- 172.21.15.84:0/1592883835 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 msgr2=0x7efe840c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe82d9d700 1 --2- 172.21.15.84:0/1592883835 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 0x7efe840c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe82d9d700 1 -- 172.21.15.84:0/1592883835 >> v2:172.21.15.131:3300/0 conn(0x7efe840c75b0 msgr2=0x7efe8406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe82d9d700 1 --2- 172.21.15.84:0/1592883835 >> v2:172.21.15.131:3300/0 conn(0x7efe840c75b0 0x7efe8406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe82d9d700 1 -- 172.21.15.84:0/1592883835 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84156910 con 0x7efe8406ebd0 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe82d9d700 1 --2- 172.21.15.84:0/1592883835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8406ebd0 0x7efe8406d390 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7efe84064fe0 tx=0x7efe7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361d5ad4a9f7fb61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe8159a700 1 -- 172.21.15.84:0/1592883835 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00b820 con 0x7efe8406ebd0 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe8159a700 1 -- 172.21.15.84:0/1592883835 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c00b980 con 0x7efe8406ebd0 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe8159a700 1 -- 172.21.15.84:0/1592883835 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00bd20 con 0x7efe8406ebd0 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe88f31700 1 -- 172.21.15.84:0/1592883835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8406ebd0 msgr2=0x7efe8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe88f31700 1 --2- 172.21.15.84:0/1592883835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8406ebd0 0x7efe8406d390 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7efe84064fe0 tx=0x7efe7c009250 comp rx=0 tx=0).stop 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe88f31700 1 -- 172.21.15.84:0/1592883835 shutdown_connections 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe88f31700 1 --2- 172.21.15.84:0/1592883835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8406ebd0 0x7efe8406d390 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe88f31700 1 --2- 172.21.15.84:0/1592883835 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 0x7efe840c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe88f31700 1 --2- 172.21.15.84:0/1592883835 >> v2:172.21.15.131:3300/0 conn(0x7efe840c75b0 0x7efe8406e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe88f31700 1 -- 172.21.15.84:0/1592883835 >> 172.21.15.84:0/1592883835 conn(0x7efe840680c0 msgr2=0x7efe840cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.003+0000 7efe88f31700 1 -- 172.21.15.84:0/1592883835 shutdown_connections 2023-10-06T03:01:19.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.004+0000 7efe88f31700 1 -- 172.21.15.84:0/1592883835 wait complete. 2023-10-06T03:01:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe88f31700 1 Processor -- start 2023-10-06T03:01:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe88f31700 1 -- start start 2023-10-06T03:01:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe88f31700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8406ebd0 0x7efe8414c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe88f31700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe840c75b0 0x7efe84155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe88f31700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 0x7efe841559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe88f31700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8416ad80 con 0x7efe840c75b0 2023-10-06T03:01:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe88f31700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8416ab50 con 0x7efe8406ebd0 2023-10-06T03:01:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe88f31700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8416a870 con 0x7efe84156540 2023-10-06T03:01:19.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe81d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe840c75b0 0x7efe84155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe81d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe840c75b0 0x7efe84155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56568/0 (socket says 172.21.15.84:56568) 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe81d9b700 1 -- 172.21.15.84:0/3931619969 learned_addr learned my addr 172.21.15.84:0/3931619969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe82d9d700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 0x7efe841559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.005+0000 7efe8259c700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8406ebd0 0x7efe8414c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe81d9b700 1 -- 172.21.15.84:0/3931619969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 msgr2=0x7efe841559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe81d9b700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 0x7efe841559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe81d9b700 1 -- 172.21.15.84:0/3931619969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8406ebd0 msgr2=0x7efe8414c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe81d9b700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8406ebd0 0x7efe8414c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe81d9b700 1 -- 172.21.15.84:0/3931619969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c0094f0 con 0x7efe840c75b0 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe81d9b700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe840c75b0 0x7efe84155480 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00d890 tx=0x7efe6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:19.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe7a7fc700 1 -- 172.21.15.84:0/3931619969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00b600 con 0x7efe840c75b0 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe7a7fc700 1 -- 172.21.15.84:0/3931619969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c00b760 con 0x7efe840c75b0 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8414cad0 con 0x7efe840c75b0 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe7a7fc700 1 -- 172.21.15.84:0/3931619969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00bae0 con 0x7efe840c75b0 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.006+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8414d090 con 0x7efe840c75b0 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.007+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8414d250 con 0x7efe840c75b0 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.007+0000 7efe7a7fc700 1 -- 172.21.15.84:0/3931619969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe6c01e460 con 0x7efe840c75b0 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.008+0000 7efe7a7fc700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe64066f30 0x7efe640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.008+0000 7efe7a7fc700 1 -- 172.21.15.84:0/3931619969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7efe6c084e80 con 0x7efe840c75b0 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.008+0000 7efe8259c700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe64066f30 0x7efe640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:19.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.008+0000 7efe8259c700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe64066f30 0x7efe640693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efe840aefa0 tx=0x7efe74009720 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:19.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.012+0000 7efe7a7fc700 1 -- 172.21.15.84:0/3931619969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe6c051e50 con 0x7efe840c75b0 2023-10-06T03:01:19.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.272+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7efe84064ad0 con 0x7efe840c75b0 2023-10-06T03:01:19.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.272+0000 7efe7a7fc700 1 -- 172.21.15.84:0/3931619969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1970 (secure 0 0 0) 0x7efe6c055470 con 0x7efe840c75b0 2023-10-06T03:01:19.273 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:19.273 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":396,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2446209024,"bytes_avail":770647904256,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6996,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":93,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2023-10-06T03:01:15.883206+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-10-06T03:01:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe64066f30 msgr2=0x7efe640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe64066f30 0x7efe640693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efe840aefa0 tx=0x7efe74009720 comp rx=0 tx=0).stop 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe840c75b0 msgr2=0x7efe84155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe840c75b0 0x7efe84155480 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00d890 tx=0x7efe6c008040 comp rx=0 tx=0).stop 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 shutdown_connections 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7efe64066f30 0x7efe640693e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe8406ebd0 0x7efe8414c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efe84156540 0x7efe841559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 --2- 172.21.15.84:0/3931619969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe840c75b0 0x7efe84155480 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 >> 172.21.15.84:0/3931619969 conn(0x7efe840680c0 msgr2=0x7efe840af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 shutdown_connections 2023-10-06T03:01:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:19.274+0000 7efe88f31700 1 -- 172.21.15.84:0/3931619969 wait complete. 2023-10-06T03:01:19.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2023-10-06T03:01:20.288 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:20.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.412+0000 7f59576da700 1 Processor -- start 2023-10-06T03:01:20.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.413+0000 7f59576da700 1 -- start start 2023-10-06T03:01:20.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.413+0000 7f59576da700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59500b29f0 0x7f5950159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.413+0000 7f59576da700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 0x7f59500cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.413+0000 7f59576da700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59500b0de0 con 0x7f59500b2620 2023-10-06T03:01:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.413+0000 7f59576da700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59500cbfe0 con 0x7f59500b29f0 2023-10-06T03:01:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.413+0000 7f59576da700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59500cb3d0 con 0x7f59501596a0 2023-10-06T03:01:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.413+0000 7f5954c75700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59500b29f0 0x7f5950159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.413+0000 7f5955476700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f59500b2620 0x7f59500b06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:32822/0 (socket says 172.21.15.84:32822) 2023-10-06T03:01:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.413+0000 7f5955476700 1 -- 172.21.15.84:0/84746381 learned_addr learned my addr 172.21.15.84:0/84746381 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5955c77700 1 --2- 172.21.15.84:0/84746381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 0x7f59500cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5954c75700 1 -- 172.21.15.84:0/84746381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 msgr2=0x7f59500cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:20.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5954c75700 1 --2- 172.21.15.84:0/84746381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 0x7f59500cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5954c75700 1 -- 172.21.15.84:0/84746381 >> v1:172.21.15.84:6789/0 conn(0x7f59500b2620 legacy=0x7f59500b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5947fff700 1 -- 172.21.15.84:0/84746381 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492059950 0 0) 0x7f594c001610 con 0x7f59500b2620 2023-10-06T03:01:20.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5954c75700 1 -- 172.21.15.84:0/84746381 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500cb6b0 con 0x7f59500b29f0 2023-10-06T03:01:20.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5954c75700 1 --2- 172.21.15.84:0/84746381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 0x7f5950159160 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f59400098e0 tx=0x7f59400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9ac5ff96131453 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:20.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5947fff700 1 -- 172.21.15.84:0/84746381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940009e80 con 0x7f59500b29f0 2023-10-06T03:01:20.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5947fff700 1 -- 172.21.15.84:0/84746381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594000b860 con 0x7f59500b29f0 2023-10-06T03:01:20.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.414+0000 7f5947fff700 1 -- 172.21.15.84:0/84746381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594000bbe0 con 0x7f59500b29f0 2023-10-06T03:01:20.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.415+0000 7f59576da700 1 -- 172.21.15.84:0/84746381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 msgr2=0x7f5950159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.415+0000 7f59576da700 1 --2- 172.21.15.84:0/84746381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 0x7f5950159160 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f59400098e0 tx=0x7f59400091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.415+0000 7f59576da700 1 -- 172.21.15.84:0/84746381 shutdown_connections 2023-10-06T03:01:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.415+0000 7f59576da700 1 --2- 172.21.15.84:0/84746381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 0x7f59500cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.415+0000 7f59576da700 1 --2- 172.21.15.84:0/84746381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 0x7f5950159160 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.415+0000 7f59576da700 1 -- 172.21.15.84:0/84746381 >> 172.21.15.84:0/84746381 conn(0x7f595006ed20 msgr2=0x7f595006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.415+0000 7f59576da700 1 -- 172.21.15.84:0/84746381 shutdown_connections 2023-10-06T03:01:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.415+0000 7f59576da700 1 -- 172.21.15.84:0/84746381 wait complete. 2023-10-06T03:01:20.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.416+0000 7f59576da700 1 Processor -- start 2023-10-06T03:01:20.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.416+0000 7f59576da700 1 -- start start 2023-10-06T03:01:20.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59576da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59500b2620 0x7f5950153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59576da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 0x7f59500c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59576da700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 0x7f5950155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59576da700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c51c0 con 0x7f59500b29f0 2023-10-06T03:01:20.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59576da700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c54a0 con 0x7f59500b2620 2023-10-06T03:01:20.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59576da700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c5780 con 0x7f59501596a0 2023-10-06T03:01:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5954c75700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 0x7f59500c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5954c75700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 0x7f59500c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56586/0 (socket says 172.21.15.84:56586) 2023-10-06T03:01:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5954c75700 1 -- 172.21.15.84:0/1497867388 learned_addr learned my addr 172.21.15.84:0/1497867388 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5955476700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59500b2620 0x7f5950153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5955c77700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 0x7f5950155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5954c75700 1 -- 172.21.15.84:0/1497867388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 msgr2=0x7f5950155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5954c75700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 0x7f5950155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5954c75700 1 -- 172.21.15.84:0/1497867388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59500b2620 msgr2=0x7f5950153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5954c75700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59500b2620 0x7f5950153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5954c75700 1 -- 172.21.15.84:0/1497867388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5940009420 con 0x7f59500b29f0 2023-10-06T03:01:20.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5955476700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59500b2620 0x7f5950153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:20.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f5954c75700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 0x7f59500c4970 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f595015d200 tx=0x7f5940017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:20.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59457fa700 1 -- 172.21.15.84:0/1497867388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594000bbe0 con 0x7f59500b29f0 2023-10-06T03:01:20.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59457fa700 1 -- 172.21.15.84:0/1497867388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5940011420 con 0x7f59500b29f0 2023-10-06T03:01:20.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595015a780 con 0x7f59500b29f0 2023-10-06T03:01:20.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59457fa700 1 -- 172.21.15.84:0/1497867388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400117c0 con 0x7f59500b29f0 2023-10-06T03:01:20.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.417+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59500c4eb0 con 0x7f59500b29f0 2023-10-06T03:01:20.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.418+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595015a9c0 con 0x7f59500b29f0 2023-10-06T03:01:20.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.419+0000 7f59457fa700 1 -- 172.21.15.84:0/1497867388 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5940011bb0 con 0x7f59500b29f0 2023-10-06T03:01:20.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.419+0000 7f59457fa700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5934066f30 0x7f59340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.419+0000 7f59457fa700 1 -- 172.21.15.84:0/1497867388 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f59400861c0 con 0x7f59500b29f0 2023-10-06T03:01:20.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.419+0000 7f5955476700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5934066f30 0x7f59340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.419+0000 7f5955476700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5934066f30 0x7f59340693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f594c002030 tx=0x7f594c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:20.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.423+0000 7f59457fa700 1 -- 172.21.15.84:0/1497867388 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f595015a9c0 con 0x7f59500b29f0 2023-10-06T03:01:20.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.651+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f595015a9c0 con 0x7f59500b29f0 2023-10-06T03:01:20.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.651+0000 7f59457fa700 1 -- 172.21.15.84:0/1497867388 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f595015a9c0 con 0x7f59500b29f0 2023-10-06T03:01:20.652 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:20.652 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5934066f30 msgr2=0x7f59340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5934066f30 0x7f59340693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f594c002030 tx=0x7f594c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 msgr2=0x7f59500c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 0x7f59500c4970 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f595015d200 tx=0x7f5940017000 comp rx=0 tx=0).stop 2023-10-06T03:01:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 shutdown_connections 2023-10-06T03:01:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5934066f30 0x7f59340693e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59500b2620 0x7f5950153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59501596a0 0x7f5950155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 --2- 172.21.15.84:0/1497867388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59500b29f0 0x7f59500c4970 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 >> 172.21.15.84:0/1497867388 conn(0x7f595006ed20 msgr2=0x7f59500d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 shutdown_connections 2023-10-06T03:01:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.653+0000 7f59576da700 1 -- 172.21.15.84:0/1497867388 wait complete. 2023-10-06T03:01:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:20.666 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:20.666 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.778+0000 7f314b24d700 1 Processor -- start 2023-10-06T03:01:20.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.778+0000 7f314b24d700 1 -- start start 2023-10-06T03:01:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314b24d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3144159480 0x7f31440b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314b24d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31440b2140 0x7f31440b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314b24d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31440cb7e0 con 0x7f31440b3610 2023-10-06T03:01:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314b24d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31440b08a0 con 0x7f31440b2140 2023-10-06T03:01:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314b24d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440cb190 con 0x7f3144159480 2023-10-06T03:01:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314aa4c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31440b2140 0x7f31440b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314aa4c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31440b2140 0x7f31440b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56594/0 (socket says 172.21.15.84:56594) 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314aa4c700 1 -- 172.21.15.84:0/3662602117 learned_addr learned my addr 172.21.15.84:0/3662602117 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314a24b700 1 --2- 172.21.15.84:0/3662602117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3144159480 0x7f31440b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314aa4c700 1 -- 172.21.15.84:0/3662602117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3144159480 msgr2=0x7f31440b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314aa4c700 1 --2- 172.21.15.84:0/3662602117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3144159480 0x7f31440b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314aa4c700 1 -- 172.21.15.84:0/3662602117 >> v1:172.21.15.131:6789/0 conn(0x7f31440b3610 legacy=0x7f31440cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.779+0000 7f314aa4c700 1 -- 172.21.15.84:0/3662602117 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31440cb470 con 0x7f31440b2140 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f314aa4c700 1 --2- 172.21.15.84:0/3662602117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 0x7f31440b25c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f313c009f20 tx=0x7f313c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8059774e61ebb5be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f3149249700 1 -- 172.21.15.84:0/3662602117 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00e070 con 0x7f31440b2140 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f3149249700 1 -- 172.21.15.84:0/3662602117 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00b9d0 con 0x7f31440b2140 2023-10-06T03:01:20.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f3149249700 1 -- 172.21.15.84:0/3662602117 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0092e0 con 0x7f31440b2140 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f314b24d700 1 -- 172.21.15.84:0/3662602117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 msgr2=0x7f31440b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f314b24d700 1 --2- 172.21.15.84:0/3662602117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 0x7f31440b25c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f313c009f20 tx=0x7f313c009840 comp rx=0 tx=0).stop 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f314b24d700 1 -- 172.21.15.84:0/3662602117 shutdown_connections 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f314b24d700 1 --2- 172.21.15.84:0/3662602117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 0x7f31440b25c0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f314b24d700 1 --2- 172.21.15.84:0/3662602117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3144159480 0x7f31440b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f314b24d700 1 -- 172.21.15.84:0/3662602117 >> 172.21.15.84:0/3662602117 conn(0x7f314406ed20 msgr2=0x7f314406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f314b24d700 1 -- 172.21.15.84:0/3662602117 shutdown_connections 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.780+0000 7f314b24d700 1 -- 172.21.15.84:0/3662602117 wait complete. 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.781+0000 7f314b24d700 1 Processor -- start 2023-10-06T03:01:20.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.781+0000 7f314b24d700 1 -- start start 2023-10-06T03:01:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314b24d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 0x7f3144151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314b24d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31440b3610 0x7f31440aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314b24d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3144159480 0x7f31440c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314b24d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314416cc70 con 0x7f31440b2140 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314b24d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c57d0 con 0x7f3144159480 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314b24d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c5ab0 con 0x7f31440b3610 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314a24b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 0x7f3144151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314a24b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 0x7f3144151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56606/0 (socket says 172.21.15.84:56606) 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314a24b700 1 -- 172.21.15.84:0/2907512369 learned_addr learned my addr 172.21.15.84:0/2907512369 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f314aa4c700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3144159480 0x7f31440c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.782+0000 7f3149a4a700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31440b3610 0x7f31440aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f314a24b700 1 -- 172.21.15.84:0/2907512369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31440b3610 msgr2=0x7f31440aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f314a24b700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31440b3610 0x7f31440aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f314a24b700 1 -- 172.21.15.84:0/2907512369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3144159480 msgr2=0x7f31440c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f314a24b700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3144159480 0x7f31440c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f314a24b700 1 -- 172.21.15.84:0/2907512369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c009ae0 con 0x7f31440b2140 2023-10-06T03:01:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f314aa4c700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3144159480 0x7f31440c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f314a24b700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 0x7f3144151120 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f314000e930 tx=0x7f31400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f313a7fc700 1 -- 172.21.15.84:0/2907512369 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000eed0 con 0x7f31440b2140 2023-10-06T03:01:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f313a7fc700 1 -- 172.21.15.84:0/2907512369 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314000c850 con 0x7f31440b2140 2023-10-06T03:01:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f313a7fc700 1 -- 172.21.15.84:0/2907512369 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000cbf0 con 0x7f31440b2140 2023-10-06T03:01:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31440c5d90 con 0x7f31440b2140 2023-10-06T03:01:20.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.783+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31440c6070 con 0x7f31440b2140 2023-10-06T03:01:20.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.784+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314416cf50 con 0x7f31440b2140 2023-10-06T03:01:20.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.784+0000 7f313a7fc700 1 -- 172.21.15.84:0/2907512369 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3140013470 con 0x7f31440b2140 2023-10-06T03:01:20.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.784+0000 7f313a7fc700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3128066f30 0x7f31280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.785+0000 7f313a7fc700 1 -- 172.21.15.84:0/2907512369 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3140084a00 con 0x7f31440b2140 2023-10-06T03:01:20.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.785+0000 7f3149a4a700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3128066f30 0x7f31280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.785+0000 7f3149a4a700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3128066f30 0x7f31280693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f314415ed90 tx=0x7f3134009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:20.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:20.789+0000 7f313a7fc700 1 -- 172.21.15.84:0/2907512369 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31400519d0 con 0x7f31440b2140 2023-10-06T03:01:21.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.051+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f314405f270 con 0x7f31440b2140 2023-10-06T03:01:21.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.052+0000 7f313a7fc700 1 -- 172.21.15.84:0/2907512369 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1976 (secure 0 0 0) 0x7f3140054ff0 con 0x7f31440b2140 2023-10-06T03:01:21.053 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:21.053 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":398,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2446209024,"bytes_avail":770647904256,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6995,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":93,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-10-06T03:01:19.884170+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-10-06T03:01:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3128066f30 msgr2=0x7f31280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3128066f30 0x7f31280693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f314415ed90 tx=0x7f3134009040 comp rx=0 tx=0).stop 2023-10-06T03:01:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 msgr2=0x7f3144151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 0x7f3144151120 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f314000e930 tx=0x7f31400091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 shutdown_connections 2023-10-06T03:01:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3128066f30 0x7f31280693e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3144159480 0x7f31440c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440b2140 0x7f3144151120 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 --2- 172.21.15.84:0/2907512369 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31440b3610 0x7f31440aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 >> 172.21.15.84:0/2907512369 conn(0x7f314406ed20 msgr2=0x7f3144155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 shutdown_connections 2023-10-06T03:01:21.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:21.054+0000 7f314b24d700 1 -- 172.21.15.84:0/2907512369 wait complete. 2023-10-06T03:01:21.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2023-10-06T03:01:22.068 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:22.158 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:01:22.158+0000 7fedc1127700 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T03:01:22.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.187+0000 7f1969a25700 1 Processor -- start 2023-10-06T03:01:22.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.187+0000 7f1969a25700 1 -- start start 2023-10-06T03:01:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.188+0000 7f1969a25700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f19640adba0 0x7f19640ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.188+0000 7f1969a25700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f196415af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.188+0000 7f1969a25700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1964157e20 con 0x7f19640ca3b0 2023-10-06T03:01:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.188+0000 7f1969a25700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19640cbbd0 con 0x7f19640adba0 2023-10-06T03:01:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.188+0000 7f1969a25700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19640ceb50 con 0x7f19640ce710 2023-10-06T03:01:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f19637fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f196415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f19627fc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f19640adba0 0x7f19640ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f1962ffd700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f19640ca3b0 0x7f19641582b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:55384/0 (socket says 172.21.15.84:55384) 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f19637fe700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f196415af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55782/0 (socket says 172.21.15.84:55782) 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f1962ffd700 1 -- 172.21.15.84:0/3836319757 learned_addr learned my addr 172.21.15.84:0/3836319757 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f19637fe700 1 -- 172.21.15.84:0/3836319757 >> v2:172.21.15.131:3300/0 conn(0x7f19640adba0 msgr2=0x7f19640ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f19637fe700 1 --2- 172.21.15.84:0/3836319757 >> v2:172.21.15.131:3300/0 conn(0x7f19640adba0 0x7f19640ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f19637fe700 1 -- 172.21.15.84:0/3836319757 >> v1:172.21.15.131:6789/0 conn(0x7f19640ca3b0 legacy=0x7f19641582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f19637fe700 1 -- 172.21.15.84:0/3836319757 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19640cb610 con 0x7f19640ce710 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f1961ffb700 1 -- 172.21.15.84:0/3836319757 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236854235 0 0) 0x7f1964157e20 con 0x7f19640ca3b0 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f19627fc700 1 --2- 172.21.15.84:0/3836319757 >> v2:172.21.15.131:3300/0 conn(0x7f19640adba0 0x7f19640ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f19637fe700 1 --2- 172.21.15.84:0/3836319757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f196415af10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f195c0098e0 tx=0x7f195c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=950741b7cabc8b99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f1961ffb700 1 -- 172.21.15.84:0/3836319757 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00b640 con 0x7f19640ce710 2023-10-06T03:01:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f1961ffb700 1 -- 172.21.15.84:0/3836319757 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c00b7a0 con 0x7f19640ce710 2023-10-06T03:01:22.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.189+0000 7f1961ffb700 1 -- 172.21.15.84:0/3836319757 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00bb40 con 0x7f19640ce710 2023-10-06T03:01:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.190+0000 7f1969a25700 1 -- 172.21.15.84:0/3836319757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 msgr2=0x7f196415af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.190+0000 7f1969a25700 1 --2- 172.21.15.84:0/3836319757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f196415af10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f195c0098e0 tx=0x7f195c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.190+0000 7f1969a25700 1 -- 172.21.15.84:0/3836319757 shutdown_connections 2023-10-06T03:01:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.190+0000 7f1969a25700 1 --2- 172.21.15.84:0/3836319757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f196415af10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.190+0000 7f1969a25700 1 --2- 172.21.15.84:0/3836319757 >> v2:172.21.15.131:3300/0 conn(0x7f19640adba0 0x7f19640ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.190+0000 7f1969a25700 1 -- 172.21.15.84:0/3836319757 >> 172.21.15.84:0/3836319757 conn(0x7f1964070810 msgr2=0x7f1964070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.190+0000 7f1969a25700 1 -- 172.21.15.84:0/3836319757 shutdown_connections 2023-10-06T03:01:22.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.190+0000 7f1969a25700 1 -- 172.21.15.84:0/3836319757 wait complete. 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.191+0000 7f1969a25700 1 Processor -- start 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.191+0000 7f1969a25700 1 -- start start 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f1969a25700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19640adba0 0x7f196414b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f1969a25700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19640ca3b0 0x7f19640b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f1969a25700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f19641554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f1969a25700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196414b630 con 0x7f19640adba0 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f1969a25700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19640b10c0 con 0x7f19640ca3b0 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f1969a25700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196416ac40 con 0x7f19640ce710 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f1962ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19640adba0 0x7f196414b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f1962ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19640adba0 0x7f196414b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56618/0 (socket says 172.21.15.84:56618) 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f1962ffd700 1 -- 172.21.15.84:0/4169278140 learned_addr learned my addr 172.21.15.84:0/4169278140 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f19627fc700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19640ca3b0 0x7f19640b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.192+0000 7f19637fe700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f19641554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f1962ffd700 1 -- 172.21.15.84:0/4169278140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 msgr2=0x7f19641554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f1962ffd700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f19641554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f1962ffd700 1 -- 172.21.15.84:0/4169278140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19640ca3b0 msgr2=0x7f19640b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f1962ffd700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19640ca3b0 0x7f19640b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f1962ffd700 1 -- 172.21.15.84:0/4169278140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958009420 con 0x7f19640adba0 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f1962ffd700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19640adba0 0x7f196414b0f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f195400cdb0 tx=0x7f1954001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f194affd700 1 -- 172.21.15.84:0/4169278140 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400aa20 con 0x7f19640adba0 2023-10-06T03:01:22.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f194affd700 1 -- 172.21.15.84:0/4169278140 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195400ab80 con 0x7f19640adba0 2023-10-06T03:01:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c009420 con 0x7f19640adba0 2023-10-06T03:01:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f194affd700 1 -- 172.21.15.84:0/4169278140 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540070f0 con 0x7f19640adba0 2023-10-06T03:01:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.193+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19640b1fb0 con 0x7f19640adba0 2023-10-06T03:01:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.194+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19641575f0 con 0x7f19640adba0 2023-10-06T03:01:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.194+0000 7f194affd700 1 -- 172.21.15.84:0/4169278140 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19540074a0 con 0x7f19640adba0 2023-10-06T03:01:22.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.195+0000 7f194affd700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1950066f30 0x7f19500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.195+0000 7f19627fc700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1950066f30 0x7f19500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.195+0000 7f194affd700 1 -- 172.21.15.84:0/4169278140 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1954084b50 con 0x7f19640adba0 2023-10-06T03:01:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.195+0000 7f19627fc700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1950066f30 0x7f19500693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f19641568e0 tx=0x7f19580091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.199+0000 7f194affd700 1 -- 172.21.15.84:0/4169278140 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1954051ba0 con 0x7f19640adba0 2023-10-06T03:01:22.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.427+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1964064ad0 con 0x7f19640adba0 2023-10-06T03:01:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.427+0000 7f194affd700 1 -- 172.21.15.84:0/4169278140 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f1954001c20 con 0x7f19640adba0 2023-10-06T03:01:22.429 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:22.429 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.429+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1950066f30 msgr2=0x7f19500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.429+0000 7f1969a25700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1950066f30 0x7f19500693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f19641568e0 tx=0x7f19580091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.429+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19640adba0 msgr2=0x7f196414b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.429+0000 7f1969a25700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19640adba0 0x7f196414b0f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f195400cdb0 tx=0x7f1954001ae0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.430+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 shutdown_connections 2023-10-06T03:01:22.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.430+0000 7f1969a25700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1950066f30 0x7f19500693e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.430+0000 7f1969a25700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f19640ce710 0x7f19641554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.430+0000 7f1969a25700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19640adba0 0x7f196414b0f0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.430+0000 7f1969a25700 1 --2- 172.21.15.84:0/4169278140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19640ca3b0 0x7f19640b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.430+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 >> 172.21.15.84:0/4169278140 conn(0x7f1964070810 msgr2=0x7f19640cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:22.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.430+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 shutdown_connections 2023-10-06T03:01:22.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.430+0000 7f1969a25700 1 -- 172.21.15.84:0/4169278140 wait complete. 2023-10-06T03:01:22.433 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:22.443 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:22.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:22.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.557+0000 7fa34de8c700 1 Processor -- start 2023-10-06T03:01:22.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.557+0000 7fa34de8c700 1 -- start start 2023-10-06T03:01:22.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.557+0000 7fa34de8c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa348159b10 0x7fa348159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.557+0000 7fa34de8c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa348068d50 con 0x7fa3480cb630 2023-10-06T03:01:22.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.557+0000 7fa34de8c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34815a6b0 con 0x7fa3480ca6b0 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.557+0000 7fa34de8c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34815a4d0 con 0x7fa348159b10 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3477fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa3480cb630 0x7fa3480691e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33444/0 (socket says 172.21.15.84:33444) 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3477fe700 1 -- 172.21.15.84:0/2856242281 learned_addr learned my addr 172.21.15.84:0/2856242281 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa346ffd700 1 --2- 172.21.15.84:0/2856242281 >> v2:172.21.15.131:3300/0 conn(0x7fa348159b10 0x7fa348159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152745699 0 0) 0x7fa348068d50 con 0x7fa3480cb630 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa334003570 con 0x7fa3480cb630 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3799413738 0 0) 0x7fa334003570 con 0x7fa3480cb630 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 >> v2:172.21.15.131:3300/0 conn(0x7fa348159b10 msgr2=0x7fa348159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 --2- 172.21.15.84:0/2856242281 >> v2:172.21.15.131:3300/0 conn(0x7fa348159b10 0x7fa348159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 >> v1:172.21.15.131:6789/0 conn(0x7fa3480ca6b0 legacy=0x7fa3480ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34815a990 con 0x7fa3480cb630 2023-10-06T03:01:22.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fa3400017f0 con 0x7fa3480cb630 2023-10-06T03:01:22.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 >> v1:172.21.15.84:6789/0 conn(0x7fa3480cb630 legacy=0x7fa3480691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa334003a60 0x7fa334003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa334004810 0x7fa334004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3340051c0 0x7fa33400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34815a4d0 con 0x7fa3340051c0 2023-10-06T03:01:22.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33400c160 con 0x7fa334004810 2023-10-06T03:01:22.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33400c320 con 0x7fa334003a60 2023-10-06T03:01:22.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa347fff700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3340051c0 0x7fa33400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa3477fe700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa334003a60 0x7fa334003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.558+0000 7fa346ffd700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa334004810 0x7fa334004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa347fff700 1 -- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa334003a60 msgr2=0x7fa334003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:22.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa347fff700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa334003a60 0x7fa334003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa347fff700 1 -- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa334004810 msgr2=0x7fa334004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:22.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa347fff700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa334004810 0x7fa334004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa347fff700 1 -- 172.21.15.84:0/2856242281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334003570 con 0x7fa3340051c0 2023-10-06T03:01:22.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa3477fe700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa334003a60 0x7fa334003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:22.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa346ffd700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa334004810 0x7fa334004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:22.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa347fff700 1 -- 172.21.15.84:0/2856242281 reap_dead start 2023-10-06T03:01:22.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa347fff700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3340051c0 0x7fa33400ba60 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa3380018b0 tx=0x7fa338007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ee05c6fbc5e859 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338012420 con 0x7fa3340051c0 2023-10-06T03:01:22.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3380125a0 con 0x7fa3340051c0 2023-10-06T03:01:22.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa3467fc700 1 -- 172.21.15.84:0/2856242281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338012960 con 0x7fa3340051c0 2023-10-06T03:01:22.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa34de8c700 1 -- 172.21.15.84:0/2856242281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3340051c0 msgr2=0x7fa33400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa34de8c700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3340051c0 0x7fa33400ba60 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa3380018b0 tx=0x7fa338007d30 comp rx=0 tx=0).stop 2023-10-06T03:01:22.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa34de8c700 1 -- 172.21.15.84:0/2856242281 shutdown_connections 2023-10-06T03:01:22.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa34de8c700 1 --2- 172.21.15.84:0/2856242281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3340051c0 0x7fa33400ba60 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa34de8c700 1 -- 172.21.15.84:0/2856242281 >> 172.21.15.84:0/2856242281 conn(0x7fa348070810 msgr2=0x7fa348070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:22.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa34de8c700 1 -- 172.21.15.84:0/2856242281 shutdown_connections 2023-10-06T03:01:22.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.559+0000 7fa34de8c700 1 -- 172.21.15.84:0/2856242281 wait complete. 2023-10-06T03:01:22.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.561+0000 7fa34de8c700 1 Processor -- start 2023-10-06T03:01:22.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.561+0000 7fa34de8c700 1 -- start start 2023-10-06T03:01:22.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.561+0000 7fa34de8c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3340051c0 0x7fa348151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.561+0000 7fa34de8c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3480c5c70 0x7fa3481560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.561+0000 7fa34de8c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348156610 0x7fa3480b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.561+0000 7fa34de8c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa348156a80 con 0x7fa348156610 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.561+0000 7fa34de8c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa348154860 con 0x7fa3340051c0 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.561+0000 7fa34de8c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3481520e0 con 0x7fa3480c5c70 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa347fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348156610 0x7fa3480b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa347fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348156610 0x7fa3480b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38026/0 (socket says 172.21.15.84:38026) 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa347fff700 1 -- 172.21.15.84:0/3678305291 learned_addr learned my addr 172.21.15.84:0/3678305291 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa3477fe700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3340051c0 0x7fa348151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa346ffd700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3480c5c70 0x7fa3481560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa347fff700 1 -- 172.21.15.84:0/3678305291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3480c5c70 msgr2=0x7fa3481560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa347fff700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3480c5c70 0x7fa3481560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa347fff700 1 -- 172.21.15.84:0/3678305291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3340051c0 msgr2=0x7fa348151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa347fff700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3340051c0 0x7fa348151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa347fff700 1 -- 172.21.15.84:0/3678305291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3480b3190 con 0x7fa348156610 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa347fff700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348156610 0x7fa3480b24a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fa34806c0f0 tx=0x7fa338015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa33f7fe700 1 -- 172.21.15.84:0/3678305291 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338012420 con 0x7fa348156610 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa33f7fe700 1 -- 172.21.15.84:0/3678305291 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa338001200 con 0x7fa348156610 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa33f7fe700 1 -- 172.21.15.84:0/3678305291 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33800cda0 con 0x7fa348156610 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3480b3470 con 0x7fa348156610 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.562+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3481544f0 con 0x7fa348156610 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.563+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa348154060 con 0x7fa348156610 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.563+0000 7fa33f7fe700 1 -- 172.21.15.84:0/3678305291 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa338019070 con 0x7fa348156610 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.564+0000 7fa33f7fe700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa328066f30 0x7fa3280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.564+0000 7fa3477fe700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa328066f30 0x7fa3280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.564+0000 7fa33f7fe700 1 -- 172.21.15.84:0/3678305291 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa3380859b0 con 0x7fa348156610 2023-10-06T03:01:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.564+0000 7fa3477fe700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa328066f30 0x7fa3280693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa340002250 tx=0x7fa34000c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.568+0000 7fa33f7fe700 1 -- 172.21.15.84:0/3678305291 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa338052a40 con 0x7fa348156610 2023-10-06T03:01:22.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.825+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa348064ad0 con 0x7fa348156610 2023-10-06T03:01:22.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.826+0000 7fa33f7fe700 1 -- 172.21.15.84:0/3678305291 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1956 (secure 0 0 0) 0x7fa338017020 con 0x7fa348156610 2023-10-06T03:01:22.826 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:22.827 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":400,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2446209024,"bytes_avail":770647904256,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":93,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-10-06T03:01:19.884170+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-10-06T03:01:22.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa328066f30 msgr2=0x7fa3280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa328066f30 0x7fa3280693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa340002250 tx=0x7fa34000c040 comp rx=0 tx=0).stop 2023-10-06T03:01:22.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348156610 msgr2=0x7fa3480b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348156610 0x7fa3480b24a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fa34806c0f0 tx=0x7fa338015000 comp rx=0 tx=0).stop 2023-10-06T03:01:22.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 shutdown_connections 2023-10-06T03:01:22.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa328066f30 0x7fa3280693e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3340051c0 0x7fa348151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa348156610 0x7fa3480b24a0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 --2- 172.21.15.84:0/3678305291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3480c5c70 0x7fa3481560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 >> 172.21.15.84:0/3678305291 conn(0x7fa348070810 msgr2=0x7fa348152b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:22.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 shutdown_connections 2023-10-06T03:01:22.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:22.828+0000 7fa34de8c700 1 -- 172.21.15.84:0/3678305291 wait complete. 2023-10-06T03:01:22.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2023-10-06T03:01:23.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:23.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.967+0000 7fba24483700 1 Processor -- start 2023-10-06T03:01:23.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.967+0000 7fba24483700 1 -- start start 2023-10-06T03:01:23.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba24483700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fba1c0b07a0 0x7fba1c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba24483700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c0b0ca0 con 0x7fba1c0b49e0 2023-10-06T03:01:23.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba24483700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c0b0f80 con 0x7fba1c1595a0 2023-10-06T03:01:23.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba24483700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c0ab390 con 0x7fba1c0b07a0 2023-10-06T03:01:23.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba21a1e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fba1c0b49e0 0x7fba1c0aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33460/0 (socket says 172.21.15.84:33460) 2023-10-06T03:01:23.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba21a1e700 1 -- 172.21.15.84:0/3695335080 learned_addr learned my addr 172.21.15.84:0/3695335080 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:23.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097631071 0 0) 0x7fba1c0b0ca0 con 0x7fba1c0b49e0 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba22a20700 1 --2- 172.21.15.84:0/3695335080 >> v2:172.21.15.131:3300/0 conn(0x7fba1c0b07a0 0x7fba1c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba04003570 con 0x7fba1c0b49e0 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4186827639 0 0) 0x7fba04003570 con 0x7fba1c0b49e0 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 >> v2:172.21.15.131:3300/0 conn(0x7fba1c0b07a0 msgr2=0x7fba1c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.968+0000 7fba2121d700 1 --2- 172.21.15.84:0/3695335080 >> v2:172.21.15.131:3300/0 conn(0x7fba1c0b07a0 0x7fba1c0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 >> v1:172.21.15.131:6789/0 conn(0x7fba1c1595a0 legacy=0x7fba1c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0b1260 con 0x7fba1c0b49e0 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fba10001470 con 0x7fba1c0b49e0 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 >> v1:172.21.15.84:6789/0 conn(0x7fba1c0b49e0 legacy=0x7fba1c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba04003a60 0x7fba04003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba04004810 0x7fba04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba040051c0 0x7fba0400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0ab390 con 0x7fba040051c0 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0400c0d0 con 0x7fba04004810 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0400c290 con 0x7fba04003a60 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba22a20700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba040051c0 0x7fba0400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2221f700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba04003a60 0x7fba04003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba21a1e700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba04004810 0x7fba04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba22a20700 1 -- 172.21.15.84:0/3695335080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba04003a60 msgr2=0x7fba04003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba22a20700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba04003a60 0x7fba04003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba22a20700 1 -- 172.21.15.84:0/3695335080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba04004810 msgr2=0x7fba04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:23.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba22a20700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba04004810 0x7fba04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba22a20700 1 -- 172.21.15.84:0/3695335080 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04003570 con 0x7fba040051c0 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba22a20700 1 -- 172.21.15.84:0/3695335080 reap_dead start 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba22a20700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba040051c0 0x7fba0400ba60 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009c00 tx=0x7fba0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c58b0d77446e23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00e710 con 0x7fba040051c0 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c00e890 con 0x7fba040051c0 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.969+0000 7fba2121d700 1 -- 172.21.15.84:0/3695335080 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00ec50 con 0x7fba040051c0 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.970+0000 7fba24483700 1 -- 172.21.15.84:0/3695335080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba040051c0 msgr2=0x7fba0400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.970+0000 7fba24483700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba040051c0 0x7fba0400ba60 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009c00 tx=0x7fba0c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.970+0000 7fba24483700 1 -- 172.21.15.84:0/3695335080 shutdown_connections 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.970+0000 7fba24483700 1 --2- 172.21.15.84:0/3695335080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba040051c0 0x7fba0400ba60 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.970+0000 7fba24483700 1 -- 172.21.15.84:0/3695335080 >> 172.21.15.84:0/3695335080 conn(0x7fba1c099830 msgr2=0x7fba1c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:23.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.970+0000 7fba24483700 1 -- 172.21.15.84:0/3695335080 shutdown_connections 2023-10-06T03:01:23.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.970+0000 7fba24483700 1 -- 172.21.15.84:0/3695335080 wait complete. 2023-10-06T03:01:23.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.971+0000 7fba24483700 1 Processor -- start 2023-10-06T03:01:23.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.971+0000 7fba24483700 1 -- start start 2023-10-06T03:01:23.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba24483700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba040051c0 0x7fba1c0aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba24483700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1c0ad980 0x7fba1c0ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba24483700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba1c147250 0x7fba1c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba24483700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0af4a0 con 0x7fba1c0ad980 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba24483700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c09d9f0 con 0x7fba1c147250 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba24483700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c157ff0 con 0x7fba040051c0 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba21a1e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1c0ad980 0x7fba1c0ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba21a1e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1c0ad980 0x7fba1c0ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38044/0 (socket says 172.21.15.84:38044) 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba21a1e700 1 -- 172.21.15.84:0/1449003903 learned_addr learned my addr 172.21.15.84:0/1449003903 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba22a20700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba1c147250 0x7fba1c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba2221f700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba040051c0 0x7fba1c0aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba21a1e700 1 -- 172.21.15.84:0/1449003903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba040051c0 msgr2=0x7fba1c0aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba21a1e700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba040051c0 0x7fba1c0aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba21a1e700 1 -- 172.21.15.84:0/1449003903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba1c147250 msgr2=0x7fba1c068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba21a1e700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba1c147250 0x7fba1c068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba21a1e700 1 -- 172.21.15.84:0/1449003903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0aba10 con 0x7fba1c0ad980 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba22a20700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba1c147250 0x7fba1c068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.972+0000 7fba21a1e700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1c0ad980 0x7fba1c0ab4d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fba10007390 tx=0x7fba10001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.973+0000 7fba1a7fc700 1 -- 172.21.15.84:0/1449003903 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10018030 con 0x7fba1c0ad980 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.973+0000 7fba1a7fc700 1 -- 172.21.15.84:0/1449003903 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba10007800 con 0x7fba1c0ad980 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.973+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c0adec0 con 0x7fba1c0ad980 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.973+0000 7fba1a7fc700 1 -- 172.21.15.84:0/1449003903 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000fb40 con 0x7fba1c0ad980 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.973+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c0ae480 con 0x7fba1c0ad980 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.974+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c064ad0 con 0x7fba1c0ad980 2023-10-06T03:01:23.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.974+0000 7fba1a7fc700 1 -- 172.21.15.84:0/1449003903 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba1001b070 con 0x7fba1c0ad980 2023-10-06T03:01:23.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.974+0000 7fba1a7fc700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fba08066f30 0x7fba080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.974+0000 7fba1a7fc700 1 -- 172.21.15.84:0/1449003903 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fba10019070 con 0x7fba1c0ad980 2023-10-06T03:01:23.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.974+0000 7fba2221f700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fba08066f30 0x7fba080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.975+0000 7fba2221f700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fba08066f30 0x7fba080693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fba14001b80 tx=0x7fba14001a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:23.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:23.978+0000 7fba1a7fc700 1 -- 172.21.15.84:0/1449003903 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba10051710 con 0x7fba1c0ad980 2023-10-06T03:01:24.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.203+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba1c0b1540 con 0x7fba1c0ad980 2023-10-06T03:01:24.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.203+0000 7fba1a7fc700 1 -- 172.21.15.84:0/1449003903 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fba10054d30 con 0x7fba1c0ad980 2023-10-06T03:01:24.204 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:24.204 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:24.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.205+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fba08066f30 msgr2=0x7fba080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.205+0000 7fba24483700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fba08066f30 0x7fba080693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fba14001b80 tx=0x7fba14001a70 comp rx=0 tx=0).stop 2023-10-06T03:01:24.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1c0ad980 msgr2=0x7fba1c0ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1c0ad980 0x7fba1c0ab4d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fba10007390 tx=0x7fba10001e50 comp rx=0 tx=0).stop 2023-10-06T03:01:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 shutdown_connections 2023-10-06T03:01:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fba08066f30 0x7fba080693e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba1c147250 0x7fba1c068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fba040051c0 0x7fba1c0aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 --2- 172.21.15.84:0/1449003903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba1c0ad980 0x7fba1c0ab4d0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 >> 172.21.15.84:0/1449003903 conn(0x7fba1c099830 msgr2=0x7fba1c0cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 shutdown_connections 2023-10-06T03:01:24.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.206+0000 7fba24483700 1 -- 172.21.15.84:0/1449003903 wait complete. 2023-10-06T03:01:24.208 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:24.218 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:24.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.331+0000 7f7749ec3700 1 Processor -- start 2023-10-06T03:01:24.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.331+0000 7f7749ec3700 1 -- start start 2023-10-06T03:01:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7749ec3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f77440b07a0 0x7f77440ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7749ec3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77440b0ca0 con 0x7f77440b49e0 2023-10-06T03:01:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7749ec3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77440b0f80 con 0x7f77441595a0 2023-10-06T03:01:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7749ec3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77440ab390 con 0x7f77440b07a0 2023-10-06T03:01:24.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7742ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f77440b49e0 0x7f77440aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33472/0 (socket says 172.21.15.84:33472) 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7742ffd700 1 -- 172.21.15.84:0/2126501551 learned_addr learned my addr 172.21.15.84:0/2126501551 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7743fff700 1 --2- 172.21.15.84:0/2126501551 >> v2:172.21.15.131:3300/0 conn(0x7f77440b07a0 0x7f77440ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f77427fc700 1 -- 172.21.15.84:0/2126501551 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056085968 0 0) 0x7f77440b0ca0 con 0x7f77440b49e0 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f77427fc700 1 -- 172.21.15.84:0/2126501551 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f772c003570 con 0x7f77440b49e0 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7743fff700 1 -- 172.21.15.84:0/2126501551 >> v1:172.21.15.131:6789/0 conn(0x7f77441595a0 legacy=0x7f77440aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7743fff700 1 -- 172.21.15.84:0/2126501551 >> v1:172.21.15.84:6789/0 conn(0x7f77440b49e0 legacy=0x7f77440aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.332+0000 7f7743fff700 1 -- 172.21.15.84:0/2126501551 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77440b1260 con 0x7f77440b07a0 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f7743fff700 1 --2- 172.21.15.84:0/2126501551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77440b07a0 0x7f77440ccfd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f773c009e90 tx=0x7f773c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e9f07175a9acd02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f77427fc700 1 -- 172.21.15.84:0/2126501551 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c00e070 con 0x7f77440b07a0 2023-10-06T03:01:24.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f77427fc700 1 -- 172.21.15.84:0/2126501551 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c00bc40 con 0x7f77440b07a0 2023-10-06T03:01:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f77427fc700 1 -- 172.21.15.84:0/2126501551 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c012430 con 0x7f77440b07a0 2023-10-06T03:01:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f7749ec3700 1 -- 172.21.15.84:0/2126501551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77440b07a0 msgr2=0x7f77440ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f7749ec3700 1 --2- 172.21.15.84:0/2126501551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77440b07a0 0x7f77440ccfd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f773c009e90 tx=0x7f773c009780 comp rx=0 tx=0).stop 2023-10-06T03:01:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f7749ec3700 1 -- 172.21.15.84:0/2126501551 shutdown_connections 2023-10-06T03:01:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f7749ec3700 1 --2- 172.21.15.84:0/2126501551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77440b07a0 0x7f77440ccfd0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f7749ec3700 1 -- 172.21.15.84:0/2126501551 >> 172.21.15.84:0/2126501551 conn(0x7f7744099830 msgr2=0x7f774406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f7749ec3700 1 -- 172.21.15.84:0/2126501551 shutdown_connections 2023-10-06T03:01:24.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.333+0000 7f7749ec3700 1 -- 172.21.15.84:0/2126501551 wait complete. 2023-10-06T03:01:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.334+0000 7f7749ec3700 1 Processor -- start 2023-10-06T03:01:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7749ec3700 1 -- start start 2023-10-06T03:01:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7749ec3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77440b07a0 0x7f774415cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7749ec3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77440b49e0 0x7f774416a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7749ec3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77441595a0 0x7f774416d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7749ec3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7744169ac0 con 0x7f77440b49e0 2023-10-06T03:01:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7749ec3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774416a040 con 0x7f77440b07a0 2023-10-06T03:01:24.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7749ec3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774415d070 con 0x7f77441595a0 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7742ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77440b49e0 0x7f774416a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7742ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77440b49e0 0x7f774416a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38048/0 (socket says 172.21.15.84:38048) 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7742ffd700 1 -- 172.21.15.84:0/697453117 learned_addr learned my addr 172.21.15.84:0/697453117 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f77437fe700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77440b07a0 0x7f774415cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.335+0000 7f7743fff700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77441595a0 0x7f774416d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f7742ffd700 1 -- 172.21.15.84:0/697453117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77441595a0 msgr2=0x7f774416d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f7742ffd700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77441595a0 0x7f774416d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f7742ffd700 1 -- 172.21.15.84:0/697453117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77440b07a0 msgr2=0x7f774415cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f7742ffd700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77440b07a0 0x7f774415cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f7742ffd700 1 -- 172.21.15.84:0/697453117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c009a20 con 0x7f77440b49e0 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f7742ffd700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77440b49e0 0x7f774416a4d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f773800c790 tx=0x7f7738007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f772b7fe700 1 -- 172.21.15.84:0/697453117 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738005c00 con 0x7f77440b49e0 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f772b7fe700 1 -- 172.21.15.84:0/697453117 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738005d60 con 0x7f77440b49e0 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774416db10 con 0x7f77440b49e0 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f772b7fe700 1 -- 172.21.15.84:0/697453117 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77380072e0 con 0x7f77440b49e0 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.336+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7744169cd0 con 0x7f77440b49e0 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.337+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774416e030 con 0x7f77440b49e0 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.337+0000 7f772b7fe700 1 -- 172.21.15.84:0/697453117 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7738012400 con 0x7f77440b49e0 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.338+0000 7f772b7fe700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7730066f30 0x7f77300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.338+0000 7f772b7fe700 1 -- 172.21.15.84:0/697453117 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7738083aa0 con 0x7f77440b49e0 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.338+0000 7f77437fe700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7730066f30 0x7f77300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.338+0000 7f77437fe700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7730066f30 0x7f77300693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f77440af5e0 tx=0x7f7734009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.342+0000 7f772b7fe700 1 -- 172.21.15.84:0/697453117 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f773804b5a0 con 0x7f77440b49e0 2023-10-06T03:01:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.601+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7744064ad0 con 0x7f77440b49e0 2023-10-06T03:01:24.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.602+0000 7f772b7fe700 1 -- 172.21.15.84:0/697453117 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1957 (secure 0 0 0) 0x7f7738017080 con 0x7f77440b49e0 2023-10-06T03:01:24.603 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:24.603 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":402,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":710079,"bytes_used":2446217216,"bytes_avail":770647896064,"bytes_total":773094113280,"write_bytes_sec":1279,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":93,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-10-06T03:01:19.884170+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-10-06T03:01:24.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7730066f30 msgr2=0x7f77300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7730066f30 0x7f77300693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f77440af5e0 tx=0x7f7734009040 comp rx=0 tx=0).stop 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77440b49e0 msgr2=0x7f774416a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77440b49e0 0x7f774416a4d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f773800c790 tx=0x7f7738007db0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 shutdown_connections 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7730066f30 0x7f77300693e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77440b07a0 0x7f774415cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f77441595a0 0x7f774416d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 --2- 172.21.15.84:0/697453117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77440b49e0 0x7f774416a4d0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 >> 172.21.15.84:0/697453117 conn(0x7f7744099830 msgr2=0x7f7744158810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 shutdown_connections 2023-10-06T03:01:24.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:24.604+0000 7f7749ec3700 1 -- 172.21.15.84:0/697453117 wait complete. 2023-10-06T03:01:24.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2023-10-06T03:01:25.617 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.738+0000 7fe59faaa700 1 Processor -- start 2023-10-06T03:01:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.738+0000 7fe59faaa700 1 -- start start 2023-10-06T03:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59faaa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980b49e0 0x7fe5980aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59faaa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5980b0ca0 con 0x7fe5981595a0 2023-10-06T03:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59faaa700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5980b0f80 con 0x7fe5980b07a0 2023-10-06T03:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59faaa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980b1260 con 0x7fe5980b49e0 2023-10-06T03:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59d846700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe5981595a0 0x7fe5980aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33488/0 (socket says 172.21.15.84:33488) 2023-10-06T03:01:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59d846700 1 -- 172.21.15.84:0/1174281111 learned_addr learned my addr 172.21.15.84:0/1174281111 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:25.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218208091 0 0) 0x7fe5980b0ca0 con 0x7fe5981595a0 2023-10-06T03:01:25.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe584003570 con 0x7fe5981595a0 2023-10-06T03:01:25.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59d045700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980b49e0 0x7fe5980aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4231776897 0 0) 0x7fe584003570 con 0x7fe5981595a0 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980b49e0 msgr2=0x7fe5980aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980b49e0 0x7fe5980aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 >> v1:172.21.15.131:6789/0 conn(0x7fe5980b07a0 legacy=0x7fe5980b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980b1540 con 0x7fe5981595a0 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fe5940015f0 con 0x7fe5981595a0 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59d045700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980b49e0 0x7fe5980aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 >> v1:172.21.15.84:6789/0 conn(0x7fe5981595a0 legacy=0x7fe5980aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe584003a90 0x7fe584003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980b49e0 0x7fe584004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe5840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980b1260 con 0x7fe584004d50 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58400bc40 con 0x7fe584003a90 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58400be00 con 0x7fe5980b49e0 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.739+0000 7fe59e047700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe5840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59d846700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe584003a90 0x7fe584003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59d045700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980b49e0 0x7fe584004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59e047700 1 -- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980b49e0 msgr2=0x7fe584004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59e047700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980b49e0 0x7fe584004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59e047700 1 -- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe584003a90 msgr2=0x7fe584003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59e047700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe584003a90 0x7fe584003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59e047700 1 -- 172.21.15.84:0/1174281111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe584003570 con 0x7fe584004d50 2023-10-06T03:01:25.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59e047700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe5840051c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fe590001fc0 tx=0x7fe590001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2599f6ffa7e6ce39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590001950 con 0x7fe584004d50 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59000c8b0 con 0x7fe584004d50 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.740+0000 7fe59c844700 1 -- 172.21.15.84:0/1174281111 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59000cc50 con 0x7fe584004d50 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.741+0000 7fe59faaa700 1 -- 172.21.15.84:0/1174281111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 msgr2=0x7fe5840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.741+0000 7fe59faaa700 1 --2- 172.21.15.84:0/1174281111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe5840051c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fe590001fc0 tx=0x7fe590001640 comp rx=0 tx=0).stop 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.741+0000 7fe59e047700 1 -- 172.21.15.84:0/1174281111 reap_dead start 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.741+0000 7fe59faaa700 1 -- 172.21.15.84:0/1174281111 shutdown_connections 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.741+0000 7fe59faaa700 1 -- 172.21.15.84:0/1174281111 >> 172.21.15.84:0/1174281111 conn(0x7fe598099830 msgr2=0x7fe59806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.741+0000 7fe59faaa700 1 -- 172.21.15.84:0/1174281111 shutdown_connections 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.741+0000 7fe59faaa700 1 -- 172.21.15.84:0/1174281111 wait complete. 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.742+0000 7fe59faaa700 1 Processor -- start 2023-10-06T03:01:25.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.742+0000 7fe59faaa700 1 -- start start 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.742+0000 7fe59faaa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe59815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.742+0000 7fe59faaa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980af620 0x7fe598099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.742+0000 7fe59faaa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe59815e200 0x7fe59809a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.742+0000 7fe59faaa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59809c780 con 0x7fe584004d50 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.742+0000 7fe59faaa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59815e7d0 con 0x7fe59815e200 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.742+0000 7fe59faaa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59815eab0 con 0x7fe5980af620 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d846700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe59815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d846700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe59815dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38062/0 (socket says 172.21.15.84:38062) 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d846700 1 -- 172.21.15.84:0/1007365804 learned_addr learned my addr 172.21.15.84:0/1007365804 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59e047700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe59815e200 0x7fe59809a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d045700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980af620 0x7fe598099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d846700 1 -- 172.21.15.84:0/1007365804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980af620 msgr2=0x7fe598099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d846700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980af620 0x7fe598099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d846700 1 -- 172.21.15.84:0/1007365804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe59815e200 msgr2=0x7fe59809a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d846700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe59815e200 0x7fe59809a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d846700 1 -- 172.21.15.84:0/1007365804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59809c410 con 0x7fe584004d50 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59e047700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe59815e200 0x7fe59809a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59d846700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe59815dcc0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fe594001360 tx=0x7fe594009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe58dffb700 1 -- 172.21.15.84:0/1007365804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5940072e0 con 0x7fe584004d50 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe58dffb700 1 -- 172.21.15.84:0/1007365804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe594007440 con 0x7fe584004d50 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe598155690 con 0x7fe584004d50 2023-10-06T03:01:25.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe58dffb700 1 -- 172.21.15.84:0/1007365804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5940057f0 con 0x7fe584004d50 2023-10-06T03:01:25.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.743+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59815a020 con 0x7fe584004d50 2023-10-06T03:01:25.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.744+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59815a210 con 0x7fe584004d50 2023-10-06T03:01:25.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.745+0000 7fe58dffb700 1 -- 172.21.15.84:0/1007365804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe594005b80 con 0x7fe584004d50 2023-10-06T03:01:25.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.745+0000 7fe58dffb700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe57c066f30 0x7fe57c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.745+0000 7fe58dffb700 1 -- 172.21.15.84:0/1007365804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe5940848c0 con 0x7fe584004d50 2023-10-06T03:01:25.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.745+0000 7fe59d045700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe57c066f30 0x7fe57c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.746+0000 7fe59d045700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe57c066f30 0x7fe57c0693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe59815f050 tx=0x7fe588008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.749+0000 7fe58dffb700 1 -- 172.21.15.84:0/1007365804 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5940517f0 con 0x7fe584004d50 2023-10-06T03:01:25.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.974+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe598064ad0 con 0x7fe584004d50 2023-10-06T03:01:25.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.975+0000 7fe58dffb700 1 -- 172.21.15.84:0/1007365804 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fe594054e10 con 0x7fe584004d50 2023-10-06T03:01:25.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:25.977 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:25.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe57c066f30 msgr2=0x7fe57c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe57c066f30 0x7fe57c0693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe59815f050 tx=0x7fe588008040 comp rx=0 tx=0).stop 2023-10-06T03:01:25.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 msgr2=0x7fe59815dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe59815dcc0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fe594001360 tx=0x7fe594009040 comp rx=0 tx=0).stop 2023-10-06T03:01:25.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 shutdown_connections 2023-10-06T03:01:25.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe57c066f30 0x7fe57c0693e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe59815e200 0x7fe59809a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe584004d50 0x7fe59815dcc0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 --2- 172.21.15.84:0/1007365804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5980af620 0x7fe598099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 >> 172.21.15.84:0/1007365804 conn(0x7fe598099830 msgr2=0x7fe5981572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:25.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 shutdown_connections 2023-10-06T03:01:25.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:25.977+0000 7fe59faaa700 1 -- 172.21.15.84:0/1007365804 wait complete. 2023-10-06T03:01:25.980 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:25.990 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'd'] 2023-10-06T03:01:25.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:01:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.102+0000 7f92a66b8700 1 Processor -- start 2023-10-06T03:01:26.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.102+0000 7f92a66b8700 1 -- start start 2023-10-06T03:01:26.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.103+0000 7f92a66b8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f92a01595a0 0x7f92a00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.103+0000 7f92a66b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b49e0 0x7f92a00aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.103+0000 7f92a66b8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a00b0ca0 con 0x7f92a00b07a0 2023-10-06T03:01:26.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.103+0000 7f92a66b8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a00b0f80 con 0x7f92a01595a0 2023-10-06T03:01:26.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.103+0000 7f92a66b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00b1260 con 0x7f92a00b49e0 2023-10-06T03:01:26.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.103+0000 7f92a4c55700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f92a00b07a0 0x7f92a00b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33500/0 (socket says 172.21.15.84:33500) 2023-10-06T03:01:26.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.103+0000 7f92a4c55700 1 -- 172.21.15.84:0/4015125648 learned_addr learned my addr 172.21.15.84:0/4015125648 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929f7fe700 1 --2- 172.21.15.84:0/4015125648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b49e0 0x7f92a00aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929ffff700 1 --2- 172.21.15.84:0/4015125648 >> v2:172.21.15.131:3300/0 conn(0x7f92a01595a0 0x7f92a00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929effd700 1 -- 172.21.15.84:0/4015125648 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695881198 0 0) 0x7f92a00b0ca0 con 0x7f92a00b07a0 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929effd700 1 -- 172.21.15.84:0/4015125648 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9288003570 con 0x7f92a00b07a0 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929f7fe700 1 -- 172.21.15.84:0/4015125648 >> v2:172.21.15.131:3300/0 conn(0x7f92a01595a0 msgr2=0x7f92a00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929f7fe700 1 --2- 172.21.15.84:0/4015125648 >> v2:172.21.15.131:3300/0 conn(0x7f92a01595a0 0x7f92a00aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929f7fe700 1 -- 172.21.15.84:0/4015125648 >> v1:172.21.15.84:6789/0 conn(0x7f92a00b07a0 legacy=0x7f92a00b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929f7fe700 1 -- 172.21.15.84:0/4015125648 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00b1540 con 0x7f92a00b49e0 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929ffff700 1 --2- 172.21.15.84:0/4015125648 >> v2:172.21.15.131:3300/0 conn(0x7f92a01595a0 0x7f92a00aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:26.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929f7fe700 1 --2- 172.21.15.84:0/4015125648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b49e0 0x7f92a00aaab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f92940098e0 tx=0x7f92940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eec1dbfc37b4177 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929effd700 1 -- 172.21.15.84:0/4015125648 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294011630 con 0x7f92a00b49e0 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929effd700 1 -- 172.21.15.84:0/4015125648 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9294011790 con 0x7f92a00b49e0 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.104+0000 7f929effd700 1 -- 172.21.15.84:0/4015125648 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294011b10 con 0x7f92a00b49e0 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.105+0000 7f92a66b8700 1 -- 172.21.15.84:0/4015125648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b49e0 msgr2=0x7f92a00aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.105+0000 7f92a66b8700 1 --2- 172.21.15.84:0/4015125648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b49e0 0x7f92a00aaab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f92940098e0 tx=0x7f92940091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.105+0000 7f92a66b8700 1 -- 172.21.15.84:0/4015125648 shutdown_connections 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.105+0000 7f92a66b8700 1 --2- 172.21.15.84:0/4015125648 >> v2:172.21.15.131:3300/0 conn(0x7f92a01595a0 0x7f92a00aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.105+0000 7f92a66b8700 1 --2- 172.21.15.84:0/4015125648 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b49e0 0x7f92a00aaab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.105+0000 7f92a66b8700 1 -- 172.21.15.84:0/4015125648 >> 172.21.15.84:0/4015125648 conn(0x7f92a0099830 msgr2=0x7f92a006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.105+0000 7f92a66b8700 1 -- 172.21.15.84:0/4015125648 shutdown_connections 2023-10-06T03:01:26.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.105+0000 7f92a66b8700 1 -- 172.21.15.84:0/4015125648 wait complete. 2023-10-06T03:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.106+0000 7f92a66b8700 1 Processor -- start 2023-10-06T03:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.106+0000 7f92a66b8700 1 -- start start 2023-10-06T03:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f92a66b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b07a0 0x7f92a0149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f92a66b8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00b49e0 0x7f92a009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f92a66b8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92a01595a0 0x7f92a009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f92a66b8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a009ce50 con 0x7f92a00b49e0 2023-10-06T03:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f92a66b8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a009d130 con 0x7f92a01595a0 2023-10-06T03:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f92a66b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a009d410 con 0x7f92a00b07a0 2023-10-06T03:01:26.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00b49e0 0x7f92a009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00b49e0 0x7f92a009a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38064/0 (socket says 172.21.15.84:38064) 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929f7fe700 1 -- 172.21.15.84:0/4006643985 learned_addr learned my addr 172.21.15.84:0/4006643985 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929ffff700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b07a0 0x7f92a0149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f92a4c55700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92a01595a0 0x7f92a009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929f7fe700 1 -- 172.21.15.84:0/4006643985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b07a0 msgr2=0x7f92a0149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929f7fe700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b07a0 0x7f92a0149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929f7fe700 1 -- 172.21.15.84:0/4006643985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92a01595a0 msgr2=0x7f92a009af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929f7fe700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92a01595a0 0x7f92a009af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929f7fe700 1 -- 172.21.15.84:0/4006643985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900093c0 con 0x7f92a00b49e0 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.107+0000 7f929f7fe700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00b49e0 0x7f92a009a9d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f92a00b13a0 tx=0x7f9294017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.108+0000 7f9287fff700 1 -- 172.21.15.84:0/4006643985 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294011b10 con 0x7f92a00b49e0 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.108+0000 7f9287fff700 1 -- 172.21.15.84:0/4006643985 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929401a430 con 0x7f92a00b49e0 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.108+0000 7f9287fff700 1 -- 172.21.15.84:0/4006643985 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929401a7f0 con 0x7f92a00b49e0 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.108+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9294009420 con 0x7f92a00b49e0 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.108+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a009cb00 con 0x7f92a00b49e0 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.108+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a009cf90 con 0x7f92a00b49e0 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.109+0000 7f9287fff700 1 -- 172.21.15.84:0/4006643985 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f929401aba0 con 0x7f92a00b49e0 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.109+0000 7f9287fff700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f928c066f30 0x7f928c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.109+0000 7f9287fff700 1 -- 172.21.15.84:0/4006643985 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9294086520 con 0x7f92a00b49e0 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.109+0000 7f929ffff700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f928c066f30 0x7f928c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.110+0000 7f929ffff700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f928c066f30 0x7f928c0693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9290006ea0 tx=0x7f9290008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.114+0000 7f9287fff700 1 -- 172.21.15.84:0/4006643985 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92a009cf90 con 0x7f92a00b49e0 2023-10-06T03:01:26.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.375+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f92a009d930 con 0x7f92a00b49e0 2023-10-06T03:01:26.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.375+0000 7f9287fff700 1 -- 172.21.15.84:0/4006643985 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1921 (secure 0 0 0) 0x7f92a009d930 con 0x7f92a00b49e0 2023-10-06T03:01:26.377 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:26.377 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":404,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":710079,"bytes_used":2446217216,"bytes_avail":770647896064,"bytes_total":773094113280,"write_bytes_sec":597,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":93,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6799},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":6802},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7716}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-10-06T03:01:25.885381+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-10-06T03:01:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f928c066f30 msgr2=0x7f928c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f928c066f30 0x7f928c0693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9290006ea0 tx=0x7f9290008040 comp rx=0 tx=0).stop 2023-10-06T03:01:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00b49e0 msgr2=0x7f92a009a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00b49e0 0x7f92a009a9d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f92a00b13a0 tx=0x7f9294017000 comp rx=0 tx=0).stop 2023-10-06T03:01:26.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 shutdown_connections 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f928c066f30 0x7f928c0693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92a01595a0 0x7f92a009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f92a00b07a0 0x7f92a0149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 --2- 172.21.15.84:0/4006643985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92a00b49e0 0x7f92a009a9d0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 >> 172.21.15.84:0/4006643985 conn(0x7f92a0099830 msgr2=0x7f92a0157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 shutdown_connections 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.377+0000 7f92a66b8700 1 -- 172.21.15.84:0/4006643985 wait complete. 2023-10-06T03:01:26.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2023-10-06T03:01:26.390 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:01:26.391 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:01:26.437 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:01:26.480 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:01:26.481 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:01:26.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:26.481 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:26.517 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:01:26.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:26.517 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:01:26.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.725+0000 7f6e1f3bb700 1 Processor -- start 2023-10-06T03:01:26.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.725+0000 7f6e1f3bb700 1 -- start start 2023-10-06T03:01:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.726+0000 7f6e1f3bb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e181595a0 0x7f6e180aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.726+0000 7f6e1f3bb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e180b49e0 0x7f6e180aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.726+0000 7f6e1f3bb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e180b0ca0 con 0x7f6e180b07a0 2023-10-06T03:01:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.726+0000 7f6e1f3bb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e180b0f80 con 0x7f6e180b49e0 2023-10-06T03:01:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.726+0000 7f6e1f3bb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180b1260 con 0x7f6e181595a0 2023-10-06T03:01:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.726+0000 7f6e1d958700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6e180b07a0 0x7f6e180b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33502/0 (socket says 172.21.15.84:33502) 2023-10-06T03:01:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.726+0000 7f6e1d958700 1 -- 172.21.15.84:0/4199061035 learned_addr learned my addr 172.21.15.84:0/4199061035 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:26.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.726+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224775099 0 0) 0x7f6e180b0ca0 con 0x7f6e180b07a0 2023-10-06T03:01:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1d157700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e181595a0 0x7f6e180aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1c956700 1 --2- 172.21.15.84:0/4199061035 >> v2:172.21.15.131:3300/0 conn(0x7f6e180b49e0 0x7f6e180aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e04003570 con 0x7f6e180b07a0 2023-10-06T03:01:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3459616798 0 0) 0x7f6e04003570 con 0x7f6e180b07a0 2023-10-06T03:01:26.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e181595a0 msgr2=0x7f6e180aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e181595a0 0x7f6e180aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 >> v2:172.21.15.131:3300/0 conn(0x7f6e180b49e0 msgr2=0x7f6e180aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/4199061035 >> v2:172.21.15.131:3300/0 conn(0x7f6e180b49e0 0x7f6e180aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e180b1540 con 0x7f6e180b07a0 2023-10-06T03:01:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f6e10001470 con 0x7f6e180b07a0 2023-10-06T03:01:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 >> v1:172.21.15.84:6789/0 conn(0x7f6e180b07a0 legacy=0x7f6e180b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e181595a0 0x7f6e04003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e04003fe0 0x7f6e04004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180b0f80 con 0x7f6e04004d50 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180b1260 con 0x7f6e04003fe0 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0400bb40 con 0x7f6e181595a0 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1c956700 1 --2- 172.21.15.84:0/4199061035 >> v2:172.21.15.131:3300/0 conn(0x7f6e180b49e0 0x7f6e180aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1d958700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1d157700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e181595a0 0x7f6e04003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1c956700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e04003fe0 0x7f6e04004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1d958700 1 -- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e181595a0 msgr2=0x7f6e04003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:26.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1d958700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e181595a0 0x7f6e04003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1d958700 1 -- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e04003fe0 msgr2=0x7f6e04004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1d958700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e04003fe0 0x7f6e04004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1d958700 1 -- 172.21.15.84:0/4199061035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e04003570 con 0x7f6e04004d50 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.727+0000 7f6e1d958700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e040051c0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c390 tx=0x7f6e10001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc137a10551a8861 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000cc60 con 0x7f6e04004d50 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1000ce00 con 0x7f6e04004d50 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e0ffff700 1 -- 172.21.15.84:0/4199061035 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10005b70 con 0x7f6e04004d50 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4199061035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 msgr2=0x7f6e040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e1f3bb700 1 --2- 172.21.15.84:0/4199061035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e040051c0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c390 tx=0x7f6e10001e90 comp rx=0 tx=0).stop 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e1d958700 1 -- 172.21.15.84:0/4199061035 reap_dead start 2023-10-06T03:01:26.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4199061035 shutdown_connections 2023-10-06T03:01:26.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4199061035 >> 172.21.15.84:0/4199061035 conn(0x7f6e18099830 msgr2=0x7f6e1806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:26.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4199061035 shutdown_connections 2023-10-06T03:01:26.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.728+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4199061035 wait complete. 2023-10-06T03:01:26.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.729+0000 7f6e1f3bb700 1 Processor -- start 2023-10-06T03:01:26.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.729+0000 7f6e1f3bb700 1 -- start start 2023-10-06T03:01:26.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1f3bb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e1814a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1f3bb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1814ae90 0x7f6e1809c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1f3bb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1809cca0 0x7f6e1815ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1f3bb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1809a090 con 0x7f6e04004d50 2023-10-06T03:01:26.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1f3bb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1809d0e0 con 0x7f6e1814ae90 2023-10-06T03:01:26.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1f3bb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1809a2e0 con 0x7f6e1809cca0 2023-10-06T03:01:26.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1d157700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e1814a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1d157700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e1814a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38080/0 (socket says 172.21.15.84:38080) 2023-10-06T03:01:26.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1d157700 1 -- 172.21.15.84:0/4248898279 learned_addr learned my addr 172.21.15.84:0/4248898279 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:26.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1d958700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1809cca0 0x7f6e1815ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1c956700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1814ae90 0x7f6e1809c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.730+0000 7f6e1d157700 1 -- 172.21.15.84:0/4248898279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1809cca0 msgr2=0x7f6e1815ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e1d157700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1809cca0 0x7f6e1815ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e1d157700 1 -- 172.21.15.84:0/4248898279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1814ae90 msgr2=0x7f6e1809c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e1d157700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1814ae90 0x7f6e1809c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e1d157700 1 -- 172.21.15.84:0/4248898279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1809a5c0 con 0x7f6e04004d50 2023-10-06T03:01:26.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e1c956700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1814ae90 0x7f6e1809c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:26.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e1d157700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e1814a950 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f6e14011f50 tx=0x7f6e1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e0d7fa700 1 -- 172.21.15.84:0/4248898279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400e040 con 0x7f6e04004d50 2023-10-06T03:01:26.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e0d7fa700 1 -- 172.21.15.84:0/4248898279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1400f040 con 0x7f6e04004d50 2023-10-06T03:01:26.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1809a8a0 con 0x7f6e04004d50 2023-10-06T03:01:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e0d7fa700 1 -- 172.21.15.84:0/4248898279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14015430 con 0x7f6e04004d50 2023-10-06T03:01:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.731+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e18148110 con 0x7f6e04004d50 2023-10-06T03:01:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.732+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e18064ad0 con 0x7f6e04004d50 2023-10-06T03:01:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.732+0000 7f6e0d7fa700 1 -- 172.21.15.84:0/4248898279 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e14015820 con 0x7f6e04004d50 2023-10-06T03:01:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.733+0000 7f6e0d7fa700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.733+0000 7f6e0d7fa700 1 -- 172.21.15.84:0/4248898279 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6e14085460 con 0x7f6e04004d50 2023-10-06T03:01:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.733+0000 7f6e1c956700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.733+0000 7f6e1c956700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009310 tx=0x7f6e0800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.737+0000 7f6e0d7fa700 1 -- 172.21.15.84:0/4248898279 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e14052430 con 0x7f6e04004d50 2023-10-06T03:01:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.965+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e1809aef0 con 0x7f6e04004d50 2023-10-06T03:01:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.965+0000 7f6e0d7fa700 1 -- 172.21.15.84:0/4248898279 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f6e14055a50 con 0x7f6e04004d50 2023-10-06T03:01:26.967 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:26.967 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.967+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 msgr2=0x7f6dfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.967+0000 7f6e1f3bb700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009310 tx=0x7f6e0800b040 comp rx=0 tx=0).stop 2023-10-06T03:01:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.967+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 msgr2=0x7f6e1814a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.967+0000 7f6e1f3bb700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e1814a950 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f6e14011f50 tx=0x7f6e1400b040 comp rx=0 tx=0).stop 2023-10-06T03:01:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.968+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 shutdown_connections 2023-10-06T03:01:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.968+0000 7f6e1f3bb700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6dfc066f30 0x7f6dfc0693e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.968+0000 7f6e1f3bb700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e1809cca0 0x7f6e1815ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.968+0000 7f6e1f3bb700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e04004d50 0x7f6e1814a950 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.968+0000 7f6e1f3bb700 1 --2- 172.21.15.84:0/4248898279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e1814ae90 0x7f6e1809c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.968+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 >> 172.21.15.84:0/4248898279 conn(0x7f6e18099830 msgr2=0x7f6e18069990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.968+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 shutdown_connections 2023-10-06T03:01:26.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:26.968+0000 7f6e1f3bb700 1 -- 172.21.15.84:0/4248898279 wait complete. 2023-10-06T03:01:26.971 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:26.981 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:27.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.094+0000 7fd0a3327700 1 Processor -- start 2023-10-06T03:01:27.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.094+0000 7fd0a3327700 1 -- start start 2023-10-06T03:01:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a3327700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd09c159480 0x7fd09c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a3327700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd09c0b2140 0x7fd09c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a3327700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c0cb7e0 con 0x7fd09c0b3610 2023-10-06T03:01:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a3327700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0b08a0 con 0x7fd09c159480 2023-10-06T03:01:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a3327700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0cb190 con 0x7fd09c0b2140 2023-10-06T03:01:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a2325700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd09c159480 0x7fd09c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a2325700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd09c159480 0x7fd09c0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38094/0 (socket says 172.21.15.84:38094) 2023-10-06T03:01:27.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a2325700 1 -- 172.21.15.84:0/166773395 learned_addr learned my addr 172.21.15.84:0/166773395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a1b24700 1 --1- 172.21.15.84:0/166773395 >> v1:172.21.15.84:6789/0 conn(0x7fd09c0b3610 0x7fd09c0cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33510/0 (socket says 172.21.15.84:33510) 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a2b26700 1 --2- 172.21.15.84:0/166773395 >> v2:172.21.15.131:3300/0 conn(0x7fd09c0b2140 0x7fd09c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a2325700 1 -- 172.21.15.84:0/166773395 >> v2:172.21.15.131:3300/0 conn(0x7fd09c0b2140 msgr2=0x7fd09c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a2325700 1 --2- 172.21.15.84:0/166773395 >> v2:172.21.15.131:3300/0 conn(0x7fd09c0b2140 0x7fd09c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a2325700 1 -- 172.21.15.84:0/166773395 >> v1:172.21.15.84:6789/0 conn(0x7fd09c0b3610 legacy=0x7fd09c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.095+0000 7fd0a2325700 1 -- 172.21.15.84:0/166773395 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0cb470 con 0x7fd09c159480 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a2325700 1 --2- 172.21.15.84:0/166773395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c159480 0x7fd09c0b30d0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0ca830 tx=0x7fd098009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2402adbbc7e7029 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a1323700 1 -- 172.21.15.84:0/166773395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800b860 con 0x7fd09c159480 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a1323700 1 -- 172.21.15.84:0/166773395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800b9c0 con 0x7fd09c159480 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a1323700 1 -- 172.21.15.84:0/166773395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800bd60 con 0x7fd09c159480 2023-10-06T03:01:27.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a3327700 1 -- 172.21.15.84:0/166773395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c159480 msgr2=0x7fd09c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a3327700 1 --2- 172.21.15.84:0/166773395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c159480 0x7fd09c0b30d0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0ca830 tx=0x7fd098009250 comp rx=0 tx=0).stop 2023-10-06T03:01:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a3327700 1 -- 172.21.15.84:0/166773395 shutdown_connections 2023-10-06T03:01:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a3327700 1 --2- 172.21.15.84:0/166773395 >> v2:172.21.15.131:3300/0 conn(0x7fd09c0b2140 0x7fd09c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a3327700 1 --2- 172.21.15.84:0/166773395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c159480 0x7fd09c0b30d0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a3327700 1 -- 172.21.15.84:0/166773395 >> 172.21.15.84:0/166773395 conn(0x7fd09c06ed20 msgr2=0x7fd09c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a3327700 1 -- 172.21.15.84:0/166773395 shutdown_connections 2023-10-06T03:01:27.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.096+0000 7fd0a3327700 1 -- 172.21.15.84:0/166773395 wait complete. 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.097+0000 7fd0a3327700 1 Processor -- start 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.097+0000 7fd0a3327700 1 -- start start 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a3327700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c0b2140 0x7fd09c0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a3327700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd09c0b3610 0x7fd09c16cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a3327700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c159480 0x7fd09c16d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a3327700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0c6210 con 0x7fd09c0b2140 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a3327700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0c5590 con 0x7fd09c159480 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a3327700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0c5870 con 0x7fd09c0b3610 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a2325700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c0b2140 0x7fd09c0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a2325700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c0b2140 0x7fd09c0c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38106/0 (socket says 172.21.15.84:38106) 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a2325700 1 -- 172.21.15.84:0/610014276 learned_addr learned my addr 172.21.15.84:0/610014276 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a2b26700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c159480 0x7fd09c16d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a1b24700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd09c0b3610 0x7fd09c16cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a2325700 1 -- 172.21.15.84:0/610014276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd09c0b3610 msgr2=0x7fd09c16cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a2325700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd09c0b3610 0x7fd09c16cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a2325700 1 -- 172.21.15.84:0/610014276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c159480 msgr2=0x7fd09c16d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a2325700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c159480 0x7fd09c16d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.098+0000 7fd0a2325700 1 -- 172.21.15.84:0/610014276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0980094f0 con 0x7fd09c0b2140 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.099+0000 7fd0a2325700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c0b2140 0x7fd09c0c4ad0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fd09c069190 tx=0x7fd098017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.099+0000 7fd0927fc700 1 -- 172.21.15.84:0/610014276 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098011e60 con 0x7fd09c0b2140 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.099+0000 7fd0927fc700 1 -- 172.21.15.84:0/610014276 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09801a630 con 0x7fd09c0b2140 2023-10-06T03:01:27.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.099+0000 7fd0927fc700 1 -- 172.21.15.84:0/610014276 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09801a9f0 con 0x7fd09c0b2140 2023-10-06T03:01:27.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.099+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c0c5b50 con 0x7fd09c0b2140 2023-10-06T03:01:27.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.099+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c156370 con 0x7fd09c0b2140 2023-10-06T03:01:27.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.100+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c0c6350 con 0x7fd09c0b2140 2023-10-06T03:01:27.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.100+0000 7fd0927fc700 1 -- 172.21.15.84:0/610014276 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd09802d440 con 0x7fd09c0b2140 2023-10-06T03:01:27.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.100+0000 7fd0927fc700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd080066f30 0x7fd0800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.100+0000 7fd0927fc700 1 -- 172.21.15.84:0/610014276 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd0980862b0 con 0x7fd09c0b2140 2023-10-06T03:01:27.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.100+0000 7fd0a1b24700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd080066f30 0x7fd0800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.101+0000 7fd0a1b24700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd080066f30 0x7fd0800693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd08c007fd0 tx=0x7fd08c007d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.105+0000 7fd0927fc700 1 -- 172.21.15.84:0/610014276 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd09c0c6350 con 0x7fd09c0b2140 2023-10-06T03:01:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.288+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd09c0c6350 con 0x7fd09c0b2140 2023-10-06T03:01:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.288+0000 7fd0927fc700 1 -- 172.21.15.84:0/610014276 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fd098053280 con 0x7fd09c0b2140 2023-10-06T03:01:27.291 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:27.291 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":94,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:00:40.595235+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:36.627631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:37.942934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:27.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd080066f30 msgr2=0x7fd0800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd080066f30 0x7fd0800693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd08c007fd0 tx=0x7fd08c007d70 comp rx=0 tx=0).stop 2023-10-06T03:01:27.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c0b2140 msgr2=0x7fd09c0c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c0b2140 0x7fd09c0c4ad0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fd09c069190 tx=0x7fd098017000 comp rx=0 tx=0).stop 2023-10-06T03:01:27.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 shutdown_connections 2023-10-06T03:01:27.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd080066f30 0x7fd0800693e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c159480 0x7fd09c16d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09c0b2140 0x7fd09c0c4ad0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 --2- 172.21.15.84:0/610014276 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd09c0b3610 0x7fd09c16cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 >> 172.21.15.84:0/610014276 conn(0x7fd09c06ed20 msgr2=0x7fd09c0d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 shutdown_connections 2023-10-06T03:01:27.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.290+0000 7fd0a3327700 1 -- 172.21.15.84:0/610014276 wait complete. 2023-10-06T03:01:27.304 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:00:36.627631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:00:37.942934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:01:27.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:27.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.420+0000 7f6fa9d3a700 1 Processor -- start 2023-10-06T03:01:27.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.420+0000 7f6fa9d3a700 1 -- start start 2023-10-06T03:01:27.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa9d3a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6fa40b2660 0x7f6fa40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa9d3a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6fa40cf1f0 0x7f6fa40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa9d3a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa40cc9b0 con 0x7f6fa40b2a30 2023-10-06T03:01:27.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa9d3a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa40cbda0 con 0x7f6fa40b2660 2023-10-06T03:01:27.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa9d3a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa40cc080 con 0x7f6fa40cf1f0 2023-10-06T03:01:27.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa8d38700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6fa40b2660 0x7f6fa40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6fa40b2a30 0x7f6fa40ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33518/0 (socket says 172.21.15.84:33518) 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa3fff700 1 -- 172.21.15.84:0/3785620579 learned_addr learned my addr 172.21.15.84:0/3785620579 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa8d38700 1 -- 172.21.15.84:0/3785620579 >> v2:172.21.15.131:3300/0 conn(0x7f6fa40cf1f0 msgr2=0x7f6fa40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa8d38700 1 --2- 172.21.15.84:0/3785620579 >> v2:172.21.15.131:3300/0 conn(0x7f6fa40cf1f0 0x7f6fa40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa8d38700 1 -- 172.21.15.84:0/3785620579 >> v1:172.21.15.84:6789/0 conn(0x7f6fa40b2a30 legacy=0x7f6fa40ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa8d38700 1 -- 172.21.15.84:0/3785620579 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa40cc360 con 0x7f6fa40b2660 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.421+0000 7f6fa37fe700 1 -- 172.21.15.84:0/3785620579 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181361857 0 0) 0x7f6fa40cc9b0 con 0x7f6fa40b2a30 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa8d38700 1 --2- 172.21.15.84:0/3785620579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2660 0x7f6fa40cccf0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40894b0 tx=0x7f6f94009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2afd969a3252a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa37fe700 1 -- 172.21.15.84:0/3785620579 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94005c10 con 0x7f6fa40b2660 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa37fe700 1 -- 172.21.15.84:0/3785620579 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94005d70 con 0x7f6fa40b2660 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa37fe700 1 -- 172.21.15.84:0/3785620579 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94006260 con 0x7f6fa40b2660 2023-10-06T03:01:27.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/3785620579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2660 msgr2=0x7f6fa40cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa9d3a700 1 --2- 172.21.15.84:0/3785620579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2660 0x7f6fa40cccf0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40894b0 tx=0x7f6f94009120 comp rx=0 tx=0).stop 2023-10-06T03:01:27.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/3785620579 shutdown_connections 2023-10-06T03:01:27.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa9d3a700 1 --2- 172.21.15.84:0/3785620579 >> v2:172.21.15.131:3300/0 conn(0x7f6fa40cf1f0 0x7f6fa40cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa9d3a700 1 --2- 172.21.15.84:0/3785620579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2660 0x7f6fa40cccf0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/3785620579 >> 172.21.15.84:0/3785620579 conn(0x7f6fa4099560 msgr2=0x7f6fa406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/3785620579 shutdown_connections 2023-10-06T03:01:27.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.422+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/3785620579 wait complete. 2023-10-06T03:01:27.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.423+0000 7f6fa9d3a700 1 Processor -- start 2023-10-06T03:01:27.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa9d3a700 1 -- start start 2023-10-06T03:01:27.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa9d3a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa40b2660 0x7f6fa40c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa9d3a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2a30 0x7f6fa4169470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa9d3a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa40cf1f0 0x7f6fa41667f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa9d3a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41699b0 con 0x7f6fa40b2a30 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa9d3a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4169c50 con 0x7f6fa40b2660 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa9d3a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4169f30 con 0x7f6fa40cf1f0 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2a30 0x7f6fa4169470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2a30 0x7f6fa4169470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38116/0 (socket says 172.21.15.84:38116) 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.424+0000 7f6fa3fff700 1 -- 172.21.15.84:0/4229175716 learned_addr learned my addr 172.21.15.84:0/4229175716 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa8d38700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa40b2660 0x7f6fa40c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa9539700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa40cf1f0 0x7f6fa41667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa3fff700 1 -- 172.21.15.84:0/4229175716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa40cf1f0 msgr2=0x7f6fa41667f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa3fff700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa40cf1f0 0x7f6fa41667f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa3fff700 1 -- 172.21.15.84:0/4229175716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa40b2660 msgr2=0x7f6fa40c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa3fff700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa40b2660 0x7f6fa40c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa3fff700 1 -- 172.21.15.84:0/4229175716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940093c0 con 0x7f6fa40b2a30 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa8d38700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa40b2660 0x7f6fa40c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa3fff700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2a30 0x7f6fa4169470 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800c810 tx=0x7f6f98007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa0ff9700 1 -- 172.21.15.84:0/4229175716 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98005c00 con 0x7f6fa40b2a30 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa0ff9700 1 -- 172.21.15.84:0/4229175716 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98005d60 con 0x7f6fa40b2a30 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa0ff9700 1 -- 172.21.15.84:0/4229175716 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98007320 con 0x7f6fa40b2a30 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa416a210 con 0x7f6fa40b2a30 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.425+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa4166d30 con 0x7f6fa40b2a30 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.426+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa416a450 con 0x7f6fa40b2a30 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.426+0000 7f6fa0ff9700 1 -- 172.21.15.84:0/4229175716 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f9801b400 con 0x7f6fa40b2a30 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.427+0000 7f6fa0ff9700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f90066f30 0x7f6f900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.427+0000 7f6fa0ff9700 1 -- 172.21.15.84:0/4229175716 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6f980842b0 con 0x7f6fa40b2a30 2023-10-06T03:01:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.427+0000 7f6fa8d38700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f90066f30 0x7f6f900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.427+0000 7f6fa8d38700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f90066f30 0x7f6f900693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009340 tx=0x7f6f94016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.431+0000 7f6fa0ff9700 1 -- 172.21.15.84:0/4229175716 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fa416a450 con 0x7f6fa40b2a30 2023-10-06T03:01:27.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.616+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fa40c7820 con 0x7f6fa40b2a30 2023-10-06T03:01:27.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.617+0000 7f6fa0ff9700 1 -- 172.21.15.84:0/4229175716 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fa40c7820 con 0x7f6fa40b2a30 2023-10-06T03:01:27.618 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:01:27.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f90066f30 msgr2=0x7f6f900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f90066f30 0x7f6f900693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009340 tx=0x7f6f94016000 comp rx=0 tx=0).stop 2023-10-06T03:01:27.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2a30 msgr2=0x7f6fa4169470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2a30 0x7f6fa4169470 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800c810 tx=0x7f6f98007db0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 shutdown_connections 2023-10-06T03:01:27.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6f90066f30 0x7f6f900693e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fa40b2660 0x7f6fa40c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6fa40cf1f0 0x7f6fa41667f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 --2- 172.21.15.84:0/4229175716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa40b2a30 0x7f6fa4169470 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 >> 172.21.15.84:0/4229175716 conn(0x7f6fa4099560 msgr2=0x7f6fa40c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 shutdown_connections 2023-10-06T03:01:27.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.619+0000 7f6fa9d3a700 1 -- 172.21.15.84:0/4229175716 wait complete. 2023-10-06T03:01:27.632 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:27.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.748+0000 7f21730c2700 1 Processor -- start 2023-10-06T03:01:27.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.749+0000 7f21730c2700 1 -- start start 2023-10-06T03:01:27.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.749+0000 7f21730c2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f216c159340 0x7f216c0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.749+0000 7f21730c2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c159710 0x7f216c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.749+0000 7f21730c2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0cbed0 con 0x7f216c0cba70 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.749+0000 7f21730c2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c0cf820 con 0x7f216c159340 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.749+0000 7f21730c2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0cfb00 con 0x7f216c159710 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.749+0000 7f2170e5e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f216c159340 0x7f216c0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.749+0000 7f217165f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f216c0cba70 0x7f216c0cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33522/0 (socket says 172.21.15.84:33522) 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.749+0000 7f217165f700 1 -- 172.21.15.84:0/1746268248 learned_addr learned my addr 172.21.15.84:0/1746268248 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f2170e5e700 1 -- 172.21.15.84:0/1746268248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c159710 msgr2=0x7f216c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f2163fff700 1 --2- 172.21.15.84:0/1746268248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c159710 0x7f216c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f2170e5e700 1 --2- 172.21.15.84:0/1746268248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c159710 0x7f216c0cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f2170e5e700 1 -- 172.21.15.84:0/1746268248 >> v1:172.21.15.84:6789/0 conn(0x7f216c0cba70 legacy=0x7f216c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f21637fe700 1 -- 172.21.15.84:0/1746268248 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117349244 0 0) 0x7f2164001490 con 0x7f216c0cba70 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f2170e5e700 1 -- 172.21.15.84:0/1746268248 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0cfde0 con 0x7f216c159340 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f2170e5e700 1 --2- 172.21.15.84:0/1746268248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 0x7f216c0af4d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f21680098d0 tx=0x7f2168009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285e9a009427725a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f21637fe700 1 -- 172.21.15.84:0/1746268248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168009e70 con 0x7f216c159340 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f21637fe700 1 -- 172.21.15.84:0/1746268248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2168005c10 con 0x7f216c159340 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.750+0000 7f21637fe700 1 -- 172.21.15.84:0/1746268248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800b650 con 0x7f216c159340 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.751+0000 7f21730c2700 1 -- 172.21.15.84:0/1746268248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 msgr2=0x7f216c0af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.751+0000 7f21730c2700 1 --2- 172.21.15.84:0/1746268248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 0x7f216c0af4d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f21680098d0 tx=0x7f2168009120 comp rx=0 tx=0).stop 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.751+0000 7f21730c2700 1 -- 172.21.15.84:0/1746268248 shutdown_connections 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.751+0000 7f21730c2700 1 --2- 172.21.15.84:0/1746268248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 0x7f216c0af4d0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.751+0000 7f21730c2700 1 --2- 172.21.15.84:0/1746268248 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c159710 0x7f216c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.751+0000 7f21730c2700 1 -- 172.21.15.84:0/1746268248 >> 172.21.15.84:0/1746268248 conn(0x7f216c099720 msgr2=0x7f216c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.751+0000 7f21730c2700 1 -- 172.21.15.84:0/1746268248 shutdown_connections 2023-10-06T03:01:27.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.751+0000 7f21730c2700 1 -- 172.21.15.84:0/1746268248 wait complete. 2023-10-06T03:01:27.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.752+0000 7f21730c2700 1 Processor -- start 2023-10-06T03:01:27.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.752+0000 7f21730c2700 1 -- start start 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f21730c2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cba70 0x7f216c0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f21730c2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 0x7f216c1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f21730c2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c159710 0x7f216c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f21730c2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b5840 con 0x7f216c159340 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f21730c2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b5560 con 0x7f216c159710 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f21730c2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c7b70 con 0x7f216c0cba70 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2163fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 0x7f216c1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2163fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 0x7f216c1585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38134/0 (socket says 172.21.15.84:38134) 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2163fff700 1 -- 172.21.15.84:0/1937417282 learned_addr learned my addr 172.21.15.84:0/1937417282 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:27.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f217165f700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c159710 0x7f216c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2170e5e700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cba70 0x7f216c0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2163fff700 1 -- 172.21.15.84:0/1937417282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cba70 msgr2=0x7f216c0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2163fff700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cba70 0x7f216c0b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2163fff700 1 -- 172.21.15.84:0/1937417282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c159710 msgr2=0x7f216c0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2163fff700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c159710 0x7f216c0ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2163fff700 1 -- 172.21.15.84:0/1937417282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21680093c0 con 0x7f216c159340 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f217165f700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c159710 0x7f216c0ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2163fff700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 0x7f216c1585d0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c880 tx=0x7f215c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2160ff9700 1 -- 172.21.15.84:0/1937417282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c011600 con 0x7f216c159340 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2160ff9700 1 -- 172.21.15.84:0/1937417282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c011780 con 0x7f216c159340 2023-10-06T03:01:27.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f2160ff9700 1 -- 172.21.15.84:0/1937417282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c011b40 con 0x7f216c159340 2023-10-06T03:01:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c0c7e50 con 0x7f216c159340 2023-10-06T03:01:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.753+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c158b10 con 0x7f216c159340 2023-10-06T03:01:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.754+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c0c8350 con 0x7f216c159340 2023-10-06T03:01:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.755+0000 7f2160ff9700 1 -- 172.21.15.84:0/1937417282 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f215c018360 con 0x7f216c159340 2023-10-06T03:01:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.755+0000 7f2160ff9700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2158066f30 0x7f21580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.755+0000 7f2160ff9700 1 -- 172.21.15.84:0/1937417282 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f215c084550 con 0x7f216c159340 2023-10-06T03:01:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.755+0000 7f2170e5e700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2158066f30 0x7f21580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.756+0000 7f2170e5e700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2158066f30 0x7f21580693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2168009160 tx=0x7f2168016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.759+0000 7f2160ff9700 1 -- 172.21.15.84:0/1937417282 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f215c054fb0 con 0x7f216c159340 2023-10-06T03:01:27.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.941+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f216c064ad0 con 0x7f216c159340 2023-10-06T03:01:27.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.942+0000 7f2160ff9700 1 -- 172.21.15.84:0/1937417282 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f215c05a070 con 0x7f216c159340 2023-10-06T03:01:27.943 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:01:27.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2158066f30 msgr2=0x7f21580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2158066f30 0x7f21580693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2168009160 tx=0x7f2168016000 comp rx=0 tx=0).stop 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 msgr2=0x7f216c1585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 0x7f216c1585d0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c880 tx=0x7f215c008040 comp rx=0 tx=0).stop 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 shutdown_connections 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2158066f30 0x7f21580693e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f216c159710 0x7f216c0ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f216c0cba70 0x7f216c0b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 --2- 172.21.15.84:0/1937417282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f216c159340 0x7f216c1585d0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 >> 172.21.15.84:0/1937417282 conn(0x7f216c099720 msgr2=0x7f216c0c5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 shutdown_connections 2023-10-06T03:01:27.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:27.944+0000 7f21730c2700 1 -- 172.21.15.84:0/1937417282 wait complete. 2023-10-06T03:01:27.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:01:28.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.072+0000 7f3bf95cf700 1 Processor -- start 2023-10-06T03:01:28.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.072+0000 7f3bf95cf700 1 -- start start 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf95cf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bf4159510 0x7f3bf40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf95cf700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3bf40cbae0 0x7f3bf40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf95cf700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf40cbf20 con 0x7f3bf41598e0 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf95cf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf40cf610 con 0x7f3bf4159510 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf95cf700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf40cf8f0 con 0x7f3bf40cbae0 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bf4159510 0x7f3bf40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bf4159510 0x7f3bf40cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38146/0 (socket says 172.21.15.84:38146) 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf2ffd700 1 -- 172.21.15.84:0/753789382 learned_addr learned my addr 172.21.15.84:0/753789382 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf37fe700 1 --2- 172.21.15.84:0/753789382 >> v2:172.21.15.131:3300/0 conn(0x7f3bf40cbae0 0x7f3bf40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf2ffd700 1 -- 172.21.15.84:0/753789382 >> v2:172.21.15.131:3300/0 conn(0x7f3bf40cbae0 msgr2=0x7f3bf40cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf2ffd700 1 --2- 172.21.15.84:0/753789382 >> v2:172.21.15.131:3300/0 conn(0x7f3bf40cbae0 0x7f3bf40cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf2ffd700 1 -- 172.21.15.84:0/753789382 >> v1:172.21.15.131:6789/0 conn(0x7f3bf41598e0 legacy=0x7f3bf40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf2ffd700 1 -- 172.21.15.84:0/753789382 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf40cfbd0 con 0x7f3bf4159510 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf2ffd700 1 --2- 172.21.15.84:0/753789382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf4159510 0x7f3bf40cb5a0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3bf406f990 tx=0x7f3be4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25732002bcd381f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf27fc700 1 -- 172.21.15.84:0/753789382 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400b820 con 0x7f3bf4159510 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf27fc700 1 -- 172.21.15.84:0/753789382 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400b980 con 0x7f3bf4159510 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.073+0000 7f3bf27fc700 1 -- 172.21.15.84:0/753789382 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400bd20 con 0x7f3bf4159510 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.074+0000 7f3bf95cf700 1 -- 172.21.15.84:0/753789382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf4159510 msgr2=0x7f3bf40cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.074+0000 7f3bf95cf700 1 --2- 172.21.15.84:0/753789382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf4159510 0x7f3bf40cb5a0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3bf406f990 tx=0x7f3be4009250 comp rx=0 tx=0).stop 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.074+0000 7f3bf95cf700 1 -- 172.21.15.84:0/753789382 shutdown_connections 2023-10-06T03:01:28.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.074+0000 7f3bf95cf700 1 --2- 172.21.15.84:0/753789382 >> v2:172.21.15.131:3300/0 conn(0x7f3bf40cbae0 0x7f3bf40cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.074+0000 7f3bf95cf700 1 --2- 172.21.15.84:0/753789382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf4159510 0x7f3bf40cb5a0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.074+0000 7f3bf95cf700 1 -- 172.21.15.84:0/753789382 >> 172.21.15.84:0/753789382 conn(0x7f3bf4089e90 msgr2=0x7f3bf40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.074+0000 7f3bf95cf700 1 -- 172.21.15.84:0/753789382 shutdown_connections 2023-10-06T03:01:28.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.074+0000 7f3bf95cf700 1 -- 172.21.15.84:0/753789382 wait complete. 2023-10-06T03:01:28.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.075+0000 7f3bf95cf700 1 Processor -- start 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.075+0000 7f3bf95cf700 1 -- start start 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf95cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf40cbae0 0x7f3bf40c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf95cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf4159510 0x7f3bf4158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf95cf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf41598e0 0x7f3bf4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf95cf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4156360 con 0x7f3bf40cbae0 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf95cf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4157840 con 0x7f3bf4159510 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf95cf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf41583a0 con 0x7f3bf41598e0 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf40cbae0 0x7f3bf40c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf40cbae0 0x7f3bf40c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38162/0 (socket says 172.21.15.84:38162) 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf2ffd700 1 -- 172.21.15.84:0/2093646516 learned_addr learned my addr 172.21.15.84:0/2093646516 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf37fe700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf41598e0 0x7f3bf4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf2ffd700 1 -- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf41598e0 msgr2=0x7f3bf4155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bebfff700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf4159510 0x7f3bf4158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf2ffd700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf41598e0 0x7f3bf4155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf2ffd700 1 -- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf4159510 msgr2=0x7f3bf4158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf2ffd700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf4159510 0x7f3bf4158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf2ffd700 1 -- 172.21.15.84:0/2093646516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be40094f0 con 0x7f3bf40cbae0 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bebfff700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf4159510 0x7f3bf4158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf37fe700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf41598e0 0x7f3bf4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf2ffd700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf40cbae0 0x7f3bf40c81d0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009290 tx=0x7f3be4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3beaffd700 1 -- 172.21.15.84:0/2093646516 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4011e20 con 0x7f3bf40cbae0 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3beaffd700 1 -- 172.21.15.84:0/2093646516 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be4020070 con 0x7f3bf40cbae0 2023-10-06T03:01:28.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf41560c0 con 0x7f3bf40cbae0 2023-10-06T03:01:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3beaffd700 1 -- 172.21.15.84:0/2093646516 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be401b6a0 con 0x7f3bf40cbae0 2023-10-06T03:01:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.076+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf4157d50 con 0x7f3bf40cbae0 2023-10-06T03:01:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.077+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf4064ad0 con 0x7f3bf40cbae0 2023-10-06T03:01:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.078+0000 7f3beaffd700 1 -- 172.21.15.84:0/2093646516 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3be4022030 con 0x7f3bf40cbae0 2023-10-06T03:01:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.078+0000 7f3beaffd700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd4066f30 0x7f3bd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.078+0000 7f3beaffd700 1 -- 172.21.15.84:0/2093646516 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3be4086780 con 0x7f3bf40cbae0 2023-10-06T03:01:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.078+0000 7f3bebfff700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd4066f30 0x7f3bd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.079+0000 7f3bebfff700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd4066f30 0x7f3bd40693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc006fd0 tx=0x7f3bdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.082+0000 7f3beaffd700 1 -- 172.21.15.84:0/2093646516 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3be40536b0 con 0x7f3bf40cbae0 2023-10-06T03:01:28.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.265+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bf4064ad0 con 0x7f3bf40cbae0 2023-10-06T03:01:28.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.265+0000 7f3beaffd700 1 -- 172.21.15.84:0/2093646516 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3be4056cd0 con 0x7f3bf40cbae0 2023-10-06T03:01:28.267 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:01:28.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.267+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd4066f30 msgr2=0x7f3bd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.267+0000 7f3bf95cf700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd4066f30 0x7f3bd40693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc006fd0 tx=0x7f3bdc008040 comp rx=0 tx=0).stop 2023-10-06T03:01:28.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.267+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf40cbae0 msgr2=0x7f3bf40c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.267+0000 7f3bf95cf700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf40cbae0 0x7f3bf40c81d0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009290 tx=0x7f3be4016000 comp rx=0 tx=0).stop 2023-10-06T03:01:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.268+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 shutdown_connections 2023-10-06T03:01:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.268+0000 7f3bf95cf700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3bd4066f30 0x7f3bd40693e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.268+0000 7f3bf95cf700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3bf41598e0 0x7f3bf4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.268+0000 7f3bf95cf700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bf40cbae0 0x7f3bf40c81d0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.268+0000 7f3bf95cf700 1 --2- 172.21.15.84:0/2093646516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf4159510 0x7f3bf4158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.268+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 >> 172.21.15.84:0/2093646516 conn(0x7f3bf4089e90 msgr2=0x7f3bf415bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.268+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 shutdown_connections 2023-10-06T03:01:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.268+0000 7f3bf95cf700 1 -- 172.21.15.84:0/2093646516 wait complete. 2023-10-06T03:01:28.281 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:01:28.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.396+0000 7f00a5b4d700 1 Processor -- start 2023-10-06T03:01:28.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.396+0000 7f00a5b4d700 1 -- start start 2023-10-06T03:01:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f00a5b4d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00a01598e0 0x7f00a00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f00a5b4d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f00a00cbcb0 0x7f00a00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f00a5b4d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a00cf610 con 0x7f00a0159510 2023-10-06T03:01:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f00a5b4d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a00cf8f0 con 0x7f00a01598e0 2023-10-06T03:01:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f00a5b4d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a00cfbd0 con 0x7f00a00cbcb0 2023-10-06T03:01:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00a01598e0 0x7f00a00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f00a0159510 0x7f00a00cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33534/0 (socket says 172.21.15.84:33534) 2023-10-06T03:01:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00a01598e0 0x7f00a00ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38172/0 (socket says 172.21.15.84:38172) 2023-10-06T03:01:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009f7fe700 1 -- 172.21.15.84:0/651385435 learned_addr learned my addr 172.21.15.84:0/651385435 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009ffff700 1 --2- 172.21.15.84:0/651385435 >> v2:172.21.15.131:3300/0 conn(0x7f00a00cbcb0 0x7f00a00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009effd700 1 -- 172.21.15.84:0/651385435 >> v2:172.21.15.131:3300/0 conn(0x7f00a00cbcb0 msgr2=0x7f00a00ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009effd700 1 --2- 172.21.15.84:0/651385435 >> v2:172.21.15.131:3300/0 conn(0x7f00a00cbcb0 0x7f00a00ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009effd700 1 -- 172.21.15.84:0/651385435 >> v1:172.21.15.84:6789/0 conn(0x7f00a0159510 legacy=0x7f00a00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009effd700 1 -- 172.21.15.84:0/651385435 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a00cfeb0 con 0x7f00a01598e0 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.397+0000 7f009ffff700 1 --2- 172.21.15.84:0/651385435 >> v2:172.21.15.131:3300/0 conn(0x7f00a00cbcb0 0x7f00a00ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f009effd700 1 --2- 172.21.15.84:0/651385435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a01598e0 0x7f00a00ce820 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f00a006f990 tx=0x7f00940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67eba77aa0d3cbc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f009e7fc700 1 -- 172.21.15.84:0/651385435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009400b6b0 con 0x7f00a01598e0 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f009e7fc700 1 -- 172.21.15.84:0/651385435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009400b810 con 0x7f00a01598e0 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f009e7fc700 1 -- 172.21.15.84:0/651385435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009400bbb0 con 0x7f00a01598e0 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f00a5b4d700 1 -- 172.21.15.84:0/651385435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a01598e0 msgr2=0x7f00a00ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f00a5b4d700 1 --2- 172.21.15.84:0/651385435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a01598e0 0x7f00a00ce820 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f00a006f990 tx=0x7f00940091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f00a5b4d700 1 -- 172.21.15.84:0/651385435 shutdown_connections 2023-10-06T03:01:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f00a5b4d700 1 --2- 172.21.15.84:0/651385435 >> v2:172.21.15.131:3300/0 conn(0x7f00a00cbcb0 0x7f00a00ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f00a5b4d700 1 --2- 172.21.15.84:0/651385435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a01598e0 0x7f00a00ce820 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f00a5b4d700 1 -- 172.21.15.84:0/651385435 >> 172.21.15.84:0/651385435 conn(0x7f00a0089e90 msgr2=0x7f00a00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f00a5b4d700 1 -- 172.21.15.84:0/651385435 shutdown_connections 2023-10-06T03:01:28.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.398+0000 7f00a5b4d700 1 -- 172.21.15.84:0/651385435 wait complete. 2023-10-06T03:01:28.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f00a5b4d700 1 Processor -- start 2023-10-06T03:01:28.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f00a5b4d700 1 -- start start 2023-10-06T03:01:28.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f00a5b4d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00a00cbcb0 0x7f00a0159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f00a5b4d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a0159510 0x7f00a015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f00a5b4d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00a01598e0 0x7f00a00b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f00a5b4d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a015c260 con 0x7f00a0159510 2023-10-06T03:01:28.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f00a5b4d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a015a370 con 0x7f00a01598e0 2023-10-06T03:01:28.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f00a5b4d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a015a650 con 0x7f00a00cbcb0 2023-10-06T03:01:28.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f009effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a0159510 0x7f00a015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f009effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a0159510 0x7f00a015bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38176/0 (socket says 172.21.15.84:38176) 2023-10-06T03:01:28.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.400+0000 7f009effd700 1 -- 172.21.15.84:0/1949598118 learned_addr learned my addr 172.21.15.84:0/1949598118 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:28.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009f7fe700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00a00cbcb0 0x7f00a0159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009ffff700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00a01598e0 0x7f00a00b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009effd700 1 -- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00a00cbcb0 msgr2=0x7f00a0159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009effd700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00a00cbcb0 0x7f00a0159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009effd700 1 -- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00a01598e0 msgr2=0x7f00a00b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009effd700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00a01598e0 0x7f00a00b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009effd700 1 -- 172.21.15.84:0/1949598118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094009420 con 0x7f00a0159510 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009f7fe700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00a00cbcb0 0x7f00a0159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009ffff700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00a01598e0 0x7f00a00b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f009effd700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a0159510 0x7f00a015bd20 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0094013000 tx=0x7f0094017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f00877fe700 1 -- 172.21.15.84:0/1949598118 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094011420 con 0x7f00a0159510 2023-10-06T03:01:28.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f00877fe700 1 -- 172.21.15.84:0/1949598118 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0094011580 con 0x7f00a0159510 2023-10-06T03:01:28.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f00877fe700 1 -- 172.21.15.84:0/1949598118 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094011920 con 0x7f00a0159510 2023-10-06T03:01:28.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a015a930 con 0x7f00a0159510 2023-10-06T03:01:28.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.401+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a00b5420 con 0x7f00a0159510 2023-10-06T03:01:28.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.402+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a0064ad0 con 0x7f00a0159510 2023-10-06T03:01:28.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.402+0000 7f00877fe700 1 -- 172.21.15.84:0/1949598118 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0094011cd0 con 0x7f00a0159510 2023-10-06T03:01:28.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.403+0000 7f00877fe700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f008c066f30 0x7f008c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.403+0000 7f00877fe700 1 -- 172.21.15.84:0/1949598118 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0094085df0 con 0x7f00a0159510 2023-10-06T03:01:28.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.403+0000 7f009f7fe700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f008c066f30 0x7f008c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.403+0000 7f009f7fe700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f008c066f30 0x7f008c0693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f009000e230 tx=0x7f0090009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.407+0000 7f00877fe700 1 -- 172.21.15.84:0/1949598118 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0094052e40 con 0x7f00a0159510 2023-10-06T03:01:28.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.588+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00a00cf2a0 con 0x7f00a0159510 2023-10-06T03:01:28.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.589+0000 7f00877fe700 1 -- 172.21.15.84:0/1949598118 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0094056460 con 0x7f00a0159510 2023-10-06T03:01:28.591 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:01:28.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f008c066f30 msgr2=0x7f008c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f008c066f30 0x7f008c0693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f009000e230 tx=0x7f0090009040 comp rx=0 tx=0).stop 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a0159510 msgr2=0x7f00a015bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a0159510 0x7f00a015bd20 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0094013000 tx=0x7f0094017000 comp rx=0 tx=0).stop 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 shutdown_connections 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f008c066f30 0x7f008c0693e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00a01598e0 0x7f00a00b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f00a00cbcb0 0x7f00a0159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 --2- 172.21.15.84:0/1949598118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00a0159510 0x7f00a015bd20 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 >> 172.21.15.84:0/1949598118 conn(0x7f00a0089e90 msgr2=0x7f00a00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 shutdown_connections 2023-10-06T03:01:28.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.591+0000 7f00a5b4d700 1 -- 172.21.15.84:0/1949598118 wait complete. 2023-10-06T03:01:28.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.717+0000 7fa393d0d700 1 Processor -- start 2023-10-06T03:01:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.717+0000 7fa393d0d700 1 -- start start 2023-10-06T03:01:28.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.718+0000 7fa393d0d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa38c0ca3b0 0x7fa38c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.718+0000 7fa393d0d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 0x7fa38c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.718+0000 7fa393d0d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c0ceb70 con 0x7fa38c0ce710 2023-10-06T03:01:28.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.718+0000 7fa393d0d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c0cbbd0 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.718+0000 7fa393d0d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c157e20 con 0x7fa38c0adba0 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.718+0000 7fa391aa9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa38c0ca3b0 0x7fa38c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.718+0000 7fa3922aa700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa38c0ce710 0x7fa38c15af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33544/0 (socket says 172.21.15.84:33544) 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.718+0000 7fa3922aa700 1 -- 172.21.15.84:0/3454947361 learned_addr learned my addr 172.21.15.84:0/3454947361 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.718+0000 7fa391aa9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa38c0ca3b0 0x7fa38c1582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38188/0 (socket says 172.21.15.84:38188) 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa3912a8700 1 --2- 172.21.15.84:0/3454947361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 0x7fa38c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa391aa9700 1 -- 172.21.15.84:0/3454947361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 msgr2=0x7fa38c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa391aa9700 1 --2- 172.21.15.84:0/3454947361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 0x7fa38c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa391aa9700 1 -- 172.21.15.84:0/3454947361 >> v1:172.21.15.84:6789/0 conn(0x7fa38c0ce710 legacy=0x7fa38c15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa391aa9700 1 -- 172.21.15.84:0/3454947361 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0cb610 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa390aa7700 1 -- 172.21.15.84:0/3454947361 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178201795 0 0) 0x7fa384001490 con 0x7fa38c0ce710 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa391aa9700 1 --2- 172.21.15.84:0/3454947361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 0x7fa38c1582b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fa3880098e0 tx=0x7fa3880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8e8899451c770e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa390aa7700 1 -- 172.21.15.84:0/3454947361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388009e80 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa390aa7700 1 -- 172.21.15.84:0/3454947361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38800b860 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa390aa7700 1 -- 172.21.15.84:0/3454947361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38800bbe0 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa393d0d700 1 -- 172.21.15.84:0/3454947361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 msgr2=0x7fa38c1582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.719+0000 7fa393d0d700 1 --2- 172.21.15.84:0/3454947361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 0x7fa38c1582b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fa3880098e0 tx=0x7fa3880091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.720+0000 7fa393d0d700 1 -- 172.21.15.84:0/3454947361 shutdown_connections 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.720+0000 7fa393d0d700 1 --2- 172.21.15.84:0/3454947361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 0x7fa38c1582b0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.720+0000 7fa393d0d700 1 --2- 172.21.15.84:0/3454947361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 0x7fa38c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.720+0000 7fa393d0d700 1 -- 172.21.15.84:0/3454947361 >> 172.21.15.84:0/3454947361 conn(0x7fa38c070810 msgr2=0x7fa38c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.720+0000 7fa393d0d700 1 -- 172.21.15.84:0/3454947361 shutdown_connections 2023-10-06T03:01:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.720+0000 7fa393d0d700 1 -- 172.21.15.84:0/3454947361 wait complete. 2023-10-06T03:01:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.721+0000 7fa393d0d700 1 Processor -- start 2023-10-06T03:01:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.721+0000 7fa393d0d700 1 -- start start 2023-10-06T03:01:28.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.721+0000 7fa393d0d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 0x7fa38c0c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.721+0000 7fa393d0d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 0x7fa38c153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.721+0000 7fa393d0d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c0ce710 0x7fa38c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.721+0000 7fa393d0d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c152920 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.721+0000 7fa393d0d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c151da0 con 0x7fa38c0ce710 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.721+0000 7fa393d0d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c152080 con 0x7fa38c0adba0 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3912a8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 0x7fa38c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3912a8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 0x7fa38c153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38192/0 (socket says 172.21.15.84:38192) 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3912a8700 1 -- 172.21.15.84:0/2929326904 learned_addr learned my addr 172.21.15.84:0/2929326904 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa391aa9700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 0x7fa38c0c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3922aa700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c0ce710 0x7fa38c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3912a8700 1 -- 172.21.15.84:0/2929326904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 msgr2=0x7fa38c0c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3912a8700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 0x7fa38c0c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3912a8700 1 -- 172.21.15.84:0/2929326904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c0ce710 msgr2=0x7fa38c14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3912a8700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c0ce710 0x7fa38c14d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3912a8700 1 -- 172.21.15.84:0/2929326904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa388009420 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3922aa700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c0ce710 0x7fa38c14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa3912a8700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 0x7fa38c153380 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00d860 tx=0x7fa37c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa381ffb700 1 -- 172.21.15.84:0/2929326904 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c0125f0 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa381ffb700 1 -- 172.21.15.84:0/2929326904 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c012750 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c152360 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa381ffb700 1 -- 172.21.15.84:0/2929326904 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c012b10 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.722+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c1538c0 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.723+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c0b1150 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.723+0000 7fa381ffb700 1 -- 172.21.15.84:0/2929326904 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa37c01e460 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.724+0000 7fa381ffb700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa370066f30 0x7fa3700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.724+0000 7fa391aa9700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa370066f30 0x7fa3700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.724+0000 7fa381ffb700 1 -- 172.21.15.84:0/2929326904 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa37c084d00 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.724+0000 7fa391aa9700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa370066f30 0x7fa3700693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa3880091e0 tx=0x7fa388017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.728+0000 7fa381ffb700 1 -- 172.21.15.84:0/2929326904 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa38c0b1150 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.959+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa38c0b1150 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.959+0000 7fa381ffb700 1 -- 172.21.15.84:0/2929326904 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fa38c0b1150 con 0x7fa38c0ca3b0 2023-10-06T03:01:28.961 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:28.961 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa370066f30 msgr2=0x7fa3700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa370066f30 0x7fa3700693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa3880091e0 tx=0x7fa388017000 comp rx=0 tx=0).stop 2023-10-06T03:01:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 msgr2=0x7fa38c153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 0x7fa38c153380 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00d860 tx=0x7fa37c008040 comp rx=0 tx=0).stop 2023-10-06T03:01:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 shutdown_connections 2023-10-06T03:01:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa370066f30 0x7fa3700693e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c0ce710 0x7fa38c14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0adba0 0x7fa38c0c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 --2- 172.21.15.84:0/2929326904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa38c0ca3b0 0x7fa38c153380 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.961+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 >> 172.21.15.84:0/2929326904 conn(0x7fa38c070810 msgr2=0x7fa38c1597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.962+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 shutdown_connections 2023-10-06T03:01:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:28.962+0000 7fa393d0d700 1 -- 172.21.15.84:0/2929326904 wait complete. 2023-10-06T03:01:28.965 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:28.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:29.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.088+0000 7fcff8de5700 1 Processor -- start 2023-10-06T03:01:29.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.088+0000 7fcff8de5700 1 -- start start 2023-10-06T03:01:29.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff8de5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcff4159480 0x7fcff40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff8de5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 0x7fcff40b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff8de5700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff40cb7e0 con 0x7fcff40b3610 2023-10-06T03:01:29.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff8de5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff40b08a0 con 0x7fcff4159480 2023-10-06T03:01:29.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff8de5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff40cb190 con 0x7fcff40b2140 2023-10-06T03:01:29.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcff4159480 0x7fcff40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff37fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcff4159480 0x7fcff40b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38194/0 (socket says 172.21.15.84:38194) 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff37fe700 1 -- 172.21.15.84:0/1289952692 learned_addr learned my addr 172.21.15.84:0/1289952692 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff3fff700 1 --2- 172.21.15.84:0/1289952692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 0x7fcff40b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff37fe700 1 -- 172.21.15.84:0/1289952692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 msgr2=0x7fcff40b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff37fe700 1 --2- 172.21.15.84:0/1289952692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 0x7fcff40b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff37fe700 1 -- 172.21.15.84:0/1289952692 >> v1:172.21.15.131:6789/0 conn(0x7fcff40b3610 legacy=0x7fcff40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff37fe700 1 -- 172.21.15.84:0/1289952692 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40cb470 con 0x7fcff4159480 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.089+0000 7fcff37fe700 1 --2- 172.21.15.84:0/1289952692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff4159480 0x7fcff40b30d0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009f20 tx=0x7fcfe4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e817dec14decccf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff27fc700 1 -- 172.21.15.84:0/1289952692 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400e070 con 0x7fcff4159480 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff27fc700 1 -- 172.21.15.84:0/1289952692 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400ba80 con 0x7fcff4159480 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff27fc700 1 -- 172.21.15.84:0/1289952692 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40092e0 con 0x7fcff4159480 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff8de5700 1 -- 172.21.15.84:0/1289952692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff4159480 msgr2=0x7fcff40b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff8de5700 1 --2- 172.21.15.84:0/1289952692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff4159480 0x7fcff40b30d0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009f20 tx=0x7fcfe4009840 comp rx=0 tx=0).stop 2023-10-06T03:01:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff8de5700 1 -- 172.21.15.84:0/1289952692 shutdown_connections 2023-10-06T03:01:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff8de5700 1 --2- 172.21.15.84:0/1289952692 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 0x7fcff40b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff8de5700 1 --2- 172.21.15.84:0/1289952692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff4159480 0x7fcff40b30d0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff8de5700 1 -- 172.21.15.84:0/1289952692 >> 172.21.15.84:0/1289952692 conn(0x7fcff406ed20 msgr2=0x7fcff406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff8de5700 1 -- 172.21.15.84:0/1289952692 shutdown_connections 2023-10-06T03:01:29.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.090+0000 7fcff8de5700 1 -- 172.21.15.84:0/1289952692 wait complete. 2023-10-06T03:01:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.091+0000 7fcff8de5700 1 Processor -- start 2023-10-06T03:01:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.091+0000 7fcff8de5700 1 -- start start 2023-10-06T03:01:29.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff8de5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 0x7fcff4150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff8de5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff40b3610 0x7fcff416a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff8de5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff4159480 0x7fcff4154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff8de5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff4154eb0 con 0x7fcff40b3610 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff8de5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff41546c0 con 0x7fcff4159480 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff8de5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff40c8a60 con 0x7fcff40b2140 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff40b3610 0x7fcff416a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff2ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff40b3610 0x7fcff416a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38196/0 (socket says 172.21.15.84:38196) 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff2ffd700 1 -- 172.21.15.84:0/2407180206 learned_addr learned my addr 172.21.15.84:0/2407180206 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff37fe700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 0x7fcff4150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.092+0000 7fcff3fff700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff4159480 0x7fcff4154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcff2ffd700 1 -- 172.21.15.84:0/2407180206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 msgr2=0x7fcff4150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcff2ffd700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 0x7fcff4150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcff2ffd700 1 -- 172.21.15.84:0/2407180206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff4159480 msgr2=0x7fcff4154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcff2ffd700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff4159480 0x7fcff4154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcff2ffd700 1 -- 172.21.15.84:0/2407180206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe4009ae0 con 0x7fcff40b3610 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcff2ffd700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff40b3610 0x7fcff416a060 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800c590 tx=0x7fcfe800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcfdb7fe700 1 -- 172.21.15.84:0/2407180206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8011590 con 0x7fcff40b3610 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcfdb7fe700 1 -- 172.21.15.84:0/2407180206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe8011710 con 0x7fcff40b3610 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff40c8450 con 0x7fcff40b3610 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcfdb7fe700 1 -- 172.21.15.84:0/2407180206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8011ad0 con 0x7fcff40b3610 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.093+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff4154bd0 con 0x7fcff40b3610 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.094+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff405f270 con 0x7fcff40b3610 2023-10-06T03:01:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.094+0000 7fcfdb7fe700 1 -- 172.21.15.84:0/2407180206 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfe801b3b0 con 0x7fcff40b3610 2023-10-06T03:01:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.095+0000 7fcfdb7fe700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfe0066f30 0x7fcfe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.095+0000 7fcfdb7fe700 1 -- 172.21.15.84:0/2407180206 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcfe8083be0 con 0x7fcff40b3610 2023-10-06T03:01:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.095+0000 7fcff37fe700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfe0066f30 0x7fcfe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.095+0000 7fcff37fe700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfe0066f30 0x7fcfe00693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009880 tx=0x7fcfe4018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.099+0000 7fcfdb7fe700 1 -- 172.21.15.84:0/2407180206 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfe8050bb0 con 0x7fcff40b3610 2023-10-06T03:01:29.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.280+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcff40b2ae0 con 0x7fcff40b3610 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.281+0000 7fcfdb7fe700 1 -- 172.21.15.84:0/2407180206 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fcfe8017070 con 0x7fcff40b3610 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":94,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:00:40.595235+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:36.627631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:37.942934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfe0066f30 msgr2=0x7fcfe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfe0066f30 0x7fcfe00693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009880 tx=0x7fcfe4018000 comp rx=0 tx=0).stop 2023-10-06T03:01:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff40b3610 msgr2=0x7fcff416a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff40b3610 0x7fcff416a060 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800c590 tx=0x7fcfe800c8a0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 shutdown_connections 2023-10-06T03:01:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcfe0066f30 0x7fcfe00693e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcff4159480 0x7fcff4154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcff40b2140 0x7fcff4150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 --2- 172.21.15.84:0/2407180206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcff40b3610 0x7fcff416a060 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 >> 172.21.15.84:0/2407180206 conn(0x7fcff406ed20 msgr2=0x7fcff40cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 shutdown_connections 2023-10-06T03:01:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.283+0000 7fcff8de5700 1 -- 172.21.15.84:0/2407180206 wait complete. 2023-10-06T03:01:29.297 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:01:29.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.410+0000 7fb98445e700 1 Processor -- start 2023-10-06T03:01:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.410+0000 7fb98445e700 1 -- start start 2023-10-06T03:01:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.411+0000 7fb98445e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.411+0000 7fb98445e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb97c0b07a0 0x7fb97c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.411+0000 7fb98445e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c0b0ca0 con 0x7fb97c0b49e0 2023-10-06T03:01:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.411+0000 7fb98445e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c0b0f80 con 0x7fb97c0b07a0 2023-10-06T03:01:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.411+0000 7fb98445e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0b1260 con 0x7fb97c1595a0 2023-10-06T03:01:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9821fa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9829fb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb97c0b07a0 0x7fb97c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9821fa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:53342/0 (socket says 172.21.15.84:53342) 2023-10-06T03:01:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9821fa700 1 -- 172.21.15.84:0/784382886 learned_addr learned my addr 172.21.15.84:0/784382886 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9821fa700 1 -- 172.21.15.84:0/784382886 >> v2:172.21.15.131:3300/0 conn(0x7fb97c0b07a0 msgr2=0x7fb97c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9821fa700 1 --2- 172.21.15.84:0/784382886 >> v2:172.21.15.131:3300/0 conn(0x7fb97c0b07a0 0x7fb97c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9821fa700 1 -- 172.21.15.84:0/784382886 >> v1:172.21.15.131:6789/0 conn(0x7fb97c0b49e0 legacy=0x7fb97c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9821fa700 1 -- 172.21.15.84:0/784382886 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0b1540 con 0x7fb97c1595a0 2023-10-06T03:01:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9821fa700 1 --2- 172.21.15.84:0/784382886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c0aa570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb978009f70 tx=0x7fb978009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd81cac9b24ccbf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9811f8700 1 -- 172.21.15.84:0/784382886 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97800e070 con 0x7fb97c1595a0 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9811f8700 1 -- 172.21.15.84:0/784382886 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97800ba20 con 0x7fb97c1595a0 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.412+0000 7fb9811f8700 1 -- 172.21.15.84:0/784382886 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9780092e0 con 0x7fb97c1595a0 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.413+0000 7fb98445e700 1 -- 172.21.15.84:0/784382886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 msgr2=0x7fb97c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.413+0000 7fb98445e700 1 --2- 172.21.15.84:0/784382886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c0aa570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb978009f70 tx=0x7fb978009840 comp rx=0 tx=0).stop 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.413+0000 7fb98445e700 1 -- 172.21.15.84:0/784382886 shutdown_connections 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.413+0000 7fb98445e700 1 --2- 172.21.15.84:0/784382886 >> v2:172.21.15.131:3300/0 conn(0x7fb97c0b07a0 0x7fb97c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.413+0000 7fb98445e700 1 --2- 172.21.15.84:0/784382886 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c0aa570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.413+0000 7fb98445e700 1 -- 172.21.15.84:0/784382886 >> 172.21.15.84:0/784382886 conn(0x7fb97c099830 msgr2=0x7fb97c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.413+0000 7fb98445e700 1 -- 172.21.15.84:0/784382886 shutdown_connections 2023-10-06T03:01:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.413+0000 7fb98445e700 1 -- 172.21.15.84:0/784382886 wait complete. 2023-10-06T03:01:29.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.414+0000 7fb98445e700 1 Processor -- start 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.414+0000 7fb98445e700 1 -- start start 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb98445e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb97c0b07a0 0x7fb97c16b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb98445e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b49e0 0x7fb97c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb98445e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c16d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb98445e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c15a000 con 0x7fb97c0b07a0 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb98445e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c16c620 con 0x7fb97c0b49e0 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb98445e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c16ba10 con 0x7fb97c1595a0 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9821fa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb97c0b07a0 0x7fb97c16b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9821fa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb97c0b07a0 0x7fb97c16b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38210/0 (socket says 172.21.15.84:38210) 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9821fa700 1 -- 172.21.15.84:0/4222425700 learned_addr learned my addr 172.21.15.84:0/4222425700 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:29.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9819f9700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b49e0 0x7fb97c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9829fb700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c16d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9821fa700 1 -- 172.21.15.84:0/4222425700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 msgr2=0x7fb97c16d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9821fa700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c16d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9821fa700 1 -- 172.21.15.84:0/4222425700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b49e0 msgr2=0x7fb97c159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9821fa700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b49e0 0x7fb97c159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9821fa700 1 -- 172.21.15.84:0/4222425700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978009ae0 con 0x7fb97c0b07a0 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9819f9700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b49e0 0x7fb97c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.415+0000 7fb9821fa700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb97c0b07a0 0x7fb97c16b3e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fb97800b6c0 tx=0x7fb978018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.416+0000 7fb9727fc700 1 -- 172.21.15.84:0/4222425700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978008d00 con 0x7fb97c0b07a0 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.416+0000 7fb9727fc700 1 -- 172.21.15.84:0/4222425700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb978008e60 con 0x7fb97c0b07a0 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.416+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c16bcf0 con 0x7fb97c0b07a0 2023-10-06T03:01:29.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.416+0000 7fb9727fc700 1 -- 172.21.15.84:0/4222425700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97801c660 con 0x7fb97c0b07a0 2023-10-06T03:01:29.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.416+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c16c2b0 con 0x7fb97c0b07a0 2023-10-06T03:01:29.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.417+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c064ad0 con 0x7fb97c0b07a0 2023-10-06T03:01:29.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.417+0000 7fb9727fc700 1 -- 172.21.15.84:0/4222425700 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb978003040 con 0x7fb97c0b07a0 2023-10-06T03:01:29.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.417+0000 7fb9727fc700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb960066f30 0x7fb9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.417+0000 7fb9727fc700 1 -- 172.21.15.84:0/4222425700 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb978086100 con 0x7fb97c0b07a0 2023-10-06T03:01:29.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.417+0000 7fb9819f9700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb960066f30 0x7fb9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.418+0000 7fb9819f9700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb960066f30 0x7fb9600693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb97c167440 tx=0x7fb96c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.422+0000 7fb9727fc700 1 -- 172.21.15.84:0/4222425700 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9780530d0 con 0x7fb97c0b07a0 2023-10-06T03:01:29.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.651+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb97c0b1820 con 0x7fb97c0b07a0 2023-10-06T03:01:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.651+0000 7fb9727fc700 1 -- 172.21.15.84:0/4222425700 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7fb9780566f0 con 0x7fb97c0b07a0 2023-10-06T03:01:29.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:29.653 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:29.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb960066f30 msgr2=0x7fb9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb960066f30 0x7fb9600693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb97c167440 tx=0x7fb96c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb97c0b07a0 msgr2=0x7fb97c16b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb97c0b07a0 0x7fb97c16b3e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fb97800b6c0 tx=0x7fb978018000 comp rx=0 tx=0).stop 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 shutdown_connections 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb960066f30 0x7fb9600693e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb97c1595a0 0x7fb97c16d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb97c0b07a0 0x7fb97c16b3e0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 --2- 172.21.15.84:0/4222425700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb97c0b49e0 0x7fb97c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 >> 172.21.15.84:0/4222425700 conn(0x7fb97c099830 msgr2=0x7fb97c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.653+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 shutdown_connections 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.654+0000 7fb98445e700 1 -- 172.21.15.84:0/4222425700 wait complete. 2023-10-06T03:01:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:29.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:29.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.779+0000 7f451bfff700 1 Processor -- start 2023-10-06T03:01:29.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.779+0000 7f451bfff700 1 -- start start 2023-10-06T03:01:29.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f451c159480 0x7f451c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451bfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f451c0b3610 0x7f451c0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451bfff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c0cb7e0 con 0x7f451c0cc1b0 2023-10-06T03:01:29.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451bfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c0b08a0 con 0x7f451c159480 2023-10-06T03:01:29.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451bfff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c0cb190 con 0x7f451c0b3610 2023-10-06T03:01:29.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f451c159480 0x7f451c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f451c159480 0x7f451c0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38226/0 (socket says 172.21.15.84:38226) 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451affd700 1 -- 172.21.15.84:0/1751151072 learned_addr learned my addr 172.21.15.84:0/1751151072 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451a7fc700 1 --2- 172.21.15.84:0/1751151072 >> v2:172.21.15.131:3300/0 conn(0x7f451c0b3610 0x7f451c0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451affd700 1 -- 172.21.15.84:0/1751151072 >> v2:172.21.15.131:3300/0 conn(0x7f451c0b3610 msgr2=0x7f451c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451affd700 1 --2- 172.21.15.84:0/1751151072 >> v2:172.21.15.131:3300/0 conn(0x7f451c0b3610 0x7f451c0cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451affd700 1 -- 172.21.15.84:0/1751151072 >> v1:172.21.15.131:6789/0 conn(0x7f451c0cc1b0 legacy=0x7f451c0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.780+0000 7f451affd700 1 -- 172.21.15.84:0/1751151072 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c0cb470 con 0x7f451c159480 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f451affd700 1 --2- 172.21.15.84:0/1751151072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 0x7f451c0b30d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f451c0d0260 tx=0x7f450c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549a153dcd6a3b4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f4519ffb700 1 -- 172.21.15.84:0/1751151072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00e070 con 0x7f451c159480 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f4519ffb700 1 -- 172.21.15.84:0/1751151072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c00ba20 con 0x7f451c159480 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f4519ffb700 1 -- 172.21.15.84:0/1751151072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c0092e0 con 0x7f451c159480 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f451bfff700 1 -- 172.21.15.84:0/1751151072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 msgr2=0x7f451c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f451bfff700 1 --2- 172.21.15.84:0/1751151072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 0x7f451c0b30d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f451c0d0260 tx=0x7f450c009840 comp rx=0 tx=0).stop 2023-10-06T03:01:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f451bfff700 1 -- 172.21.15.84:0/1751151072 shutdown_connections 2023-10-06T03:01:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f451bfff700 1 --2- 172.21.15.84:0/1751151072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 0x7f451c0b30d0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f451bfff700 1 --2- 172.21.15.84:0/1751151072 >> v2:172.21.15.131:3300/0 conn(0x7f451c0b3610 0x7f451c0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f451bfff700 1 -- 172.21.15.84:0/1751151072 >> 172.21.15.84:0/1751151072 conn(0x7f451c06ed20 msgr2=0x7f451c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f451bfff700 1 -- 172.21.15.84:0/1751151072 shutdown_connections 2023-10-06T03:01:29.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.781+0000 7f451bfff700 1 -- 172.21.15.84:0/1751151072 wait complete. 2023-10-06T03:01:29.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.782+0000 7f451bfff700 1 Processor -- start 2023-10-06T03:01:29.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.782+0000 7f451bfff700 1 -- start start 2023-10-06T03:01:29.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0b3610 0x7f451c153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f451c0cc1b0 0x7f451c0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 0x7f451c0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c0c4240 con 0x7f451c159480 2023-10-06T03:01:29.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451bfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c0c3c30 con 0x7f451c0b3610 2023-10-06T03:01:29.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451bfff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c154250 con 0x7f451c0cc1b0 2023-10-06T03:01:29.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 0x7f451c0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 0x7f451c0c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38228/0 (socket says 172.21.15.84:38228) 2023-10-06T03:01:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451b7fe700 1 -- 172.21.15.84:0/1555197385 learned_addr learned my addr 172.21.15.84:0/1555197385 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451affd700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0b3610 0x7f451c153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.783+0000 7f451a7fc700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f451c0cc1b0 0x7f451c0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f451b7fe700 1 -- 172.21.15.84:0/1555197385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f451c0cc1b0 msgr2=0x7f451c0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f451b7fe700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f451c0cc1b0 0x7f451c0c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f451b7fe700 1 -- 172.21.15.84:0/1555197385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0b3610 msgr2=0x7f451c153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f451b7fe700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0b3610 0x7f451c153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f451b7fe700 1 -- 172.21.15.84:0/1555197385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c009ae0 con 0x7f451c159480 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f451b7fe700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 0x7f451c0c6580 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f451400c560 tx=0x7f4514007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f4502ffd700 1 -- 172.21.15.84:0/1555197385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514011590 con 0x7f451c159480 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f4502ffd700 1 -- 172.21.15.84:0/1555197385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45140116f0 con 0x7f451c159480 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451c0c9880 con 0x7f451c159480 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f4502ffd700 1 -- 172.21.15.84:0/1555197385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514011ab0 con 0x7f451c159480 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.784+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c0c9b60 con 0x7f451c159480 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.785+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451c0c43f0 con 0x7f451c159480 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.785+0000 7f4502ffd700 1 -- 172.21.15.84:0/1555197385 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f451401b3b0 con 0x7f451c159480 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.786+0000 7f4502ffd700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4508066f60 0x7f4508069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.786+0000 7f451affd700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4508066f60 0x7f4508069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.786+0000 7f4502ffd700 1 -- 172.21.15.84:0/1555197385 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4514083b60 con 0x7f451c159480 2023-10-06T03:01:29.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.786+0000 7f451affd700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4508066f60 0x7f4508069410 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f450c009880 tx=0x7f450c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:29.790+0000 7f4502ffd700 1 -- 172.21.15.84:0/1555197385 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f451c0c43f0 con 0x7f451c159480 2023-10-06T03:01:30.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.017+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f451c05f270 con 0x7f451c159480 2023-10-06T03:01:30.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.018+0000 7f4502ffd700 1 -- 172.21.15.84:0/1555197385 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4642 (secure 0 0 0) 0x7f4514017070 con 0x7f451c159480 2023-10-06T03:01:30.020 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:30.020 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:38.983477+0000","modified":"2023-10-06T03:01:16.254236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7716,"mds_1":6802,"mds_2":6799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6799":{"gid":6799,"name":"d","rank":2,"incarnation":87,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6834/3567954898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3567954898},{"type":"v1","addr":"172.21.15.131:6834","nonce":3567954898}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6802":{"gid":6802,"name":"b","rank":1,"incarnation":85,"state":"up:active","state_seq":12,"addr":"172.21.15.131:6835/2772432276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2772432276},{"type":"v1","addr":"172.21.15.131:6835","nonce":2772432276}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7716":{"gid":7716,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":12,"addr":"172.21.15.84:6836/4266209083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4266209083},{"type":"v1","addr":"172.21.15.84:6836","nonce":4266209083}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T03:01:30.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4508066f60 msgr2=0x7f4508069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4508066f60 0x7f4508069410 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f450c009880 tx=0x7f450c018000 comp rx=0 tx=0).stop 2023-10-06T03:01:30.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 msgr2=0x7f451c0c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 0x7f451c0c6580 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f451400c560 tx=0x7f4514007ef0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 shutdown_connections 2023-10-06T03:01:30.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4508066f60 0x7f4508069410 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f451c0b3610 0x7f451c153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f451c159480 0x7f451c0c6580 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 --2- 172.21.15.84:0/1555197385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f451c0cc1b0 0x7f451c0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 >> 172.21.15.84:0/1555197385 conn(0x7f451c06ed20 msgr2=0x7f451c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:30.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 shutdown_connections 2023-10-06T03:01:30.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.020+0000 7f451bfff700 1 -- 172.21.15.84:0/1555197385 wait complete. 2023-10-06T03:01:30.024 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 93 2023-10-06T03:01:30.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.146+0000 7fe6a2225700 1 Processor -- start 2023-10-06T03:01:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.146+0000 7fe6a2225700 1 -- start start 2023-10-06T03:01:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe6a2225700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe69c1595a0 0x7fe69c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe6a2225700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b49e0 0x7fe69c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe6a2225700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe69c0b07a0 0x7fe69c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe6a2225700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c0b0ca0 con 0x7fe69c1595a0 2023-10-06T03:01:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe6a2225700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c0b0f80 con 0x7fe69c0b07a0 2023-10-06T03:01:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe6a2225700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0b1260 con 0x7fe69c0b49e0 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe69b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe69c1595a0 0x7fe69c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe69b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe69c1595a0 0x7fe69c0aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38242/0 (socket says 172.21.15.84:38242) 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe69b7fe700 1 -- 172.21.15.84:0/2802445092 learned_addr learned my addr 172.21.15.84:0/2802445092 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe69bfff700 1 --2- 172.21.15.84:0/2802445092 >> v2:172.21.15.131:3300/0 conn(0x7fe69c0b07a0 0x7fe69c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.147+0000 7fe69affd700 1 --2- 172.21.15.84:0/2802445092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b49e0 0x7fe69c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69b7fe700 1 -- 172.21.15.84:0/2802445092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b49e0 msgr2=0x7fe69c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69b7fe700 1 --2- 172.21.15.84:0/2802445092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b49e0 0x7fe69c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69b7fe700 1 -- 172.21.15.84:0/2802445092 >> v2:172.21.15.131:3300/0 conn(0x7fe69c0b07a0 msgr2=0x7fe69c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69b7fe700 1 --2- 172.21.15.84:0/2802445092 >> v2:172.21.15.131:3300/0 conn(0x7fe69c0b07a0 0x7fe69c0b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69b7fe700 1 -- 172.21.15.84:0/2802445092 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0b1540 con 0x7fe69c1595a0 2023-10-06T03:01:30.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69affd700 1 --2- 172.21.15.84:0/2802445092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b49e0 0x7fe69c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69b7fe700 1 --2- 172.21.15.84:0/2802445092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 0x7fe69c0aa570 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0d04a0 tx=0x7fe68c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a488f48ba56a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69a7fc700 1 -- 172.21.15.84:0/2802445092 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c00e070 con 0x7fe69c1595a0 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69a7fc700 1 -- 172.21.15.84:0/2802445092 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c00ba20 con 0x7fe69c1595a0 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe69a7fc700 1 -- 172.21.15.84:0/2802445092 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0092e0 con 0x7fe69c1595a0 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe6a2225700 1 -- 172.21.15.84:0/2802445092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 msgr2=0x7fe69c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe6a2225700 1 --2- 172.21.15.84:0/2802445092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 0x7fe69c0aa570 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0d04a0 tx=0x7fe68c009840 comp rx=0 tx=0).stop 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe6a2225700 1 -- 172.21.15.84:0/2802445092 shutdown_connections 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe6a2225700 1 --2- 172.21.15.84:0/2802445092 >> v2:172.21.15.131:3300/0 conn(0x7fe69c0b07a0 0x7fe69c0b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe6a2225700 1 --2- 172.21.15.84:0/2802445092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 0x7fe69c0aa570 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe6a2225700 1 --2- 172.21.15.84:0/2802445092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b49e0 0x7fe69c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.148+0000 7fe6a2225700 1 -- 172.21.15.84:0/2802445092 >> 172.21.15.84:0/2802445092 conn(0x7fe69c099830 msgr2=0x7fe69c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:30.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.149+0000 7fe6a2225700 1 -- 172.21.15.84:0/2802445092 shutdown_connections 2023-10-06T03:01:30.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.149+0000 7fe6a2225700 1 -- 172.21.15.84:0/2802445092 wait complete. 2023-10-06T03:01:30.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.150+0000 7fe6a2225700 1 Processor -- start 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.150+0000 7fe6a2225700 1 -- start start 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6a2225700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b07a0 0x7fe69c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6a2225700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe69c0b49e0 0x7fe69c15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6a2225700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 0x7fe69c09b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6a2225700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c15a320 con 0x7fe69c1595a0 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6a2225700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c15a870 con 0x7fe69c0b49e0 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6a2225700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c15bac0 con 0x7fe69c0b07a0 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 0x7fe69c09b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 0x7fe69c09b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38244/0 (socket says 172.21.15.84:38244) 2023-10-06T03:01:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69bfff700 1 -- 172.21.15.84:0/141370367 learned_addr learned my addr 172.21.15.84:0/141370367 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69b7fe700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b07a0 0x7fe69c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69affd700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe69c0b49e0 0x7fe69c15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69bfff700 1 -- 172.21.15.84:0/141370367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b07a0 msgr2=0x7fe69c156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69bfff700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b07a0 0x7fe69c156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69bfff700 1 -- 172.21.15.84:0/141370367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe69c0b49e0 msgr2=0x7fe69c15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69bfff700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe69c0b49e0 0x7fe69c15ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69bfff700 1 -- 172.21.15.84:0/141370367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c009ae0 con 0x7fe69c1595a0 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe69bfff700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 0x7fe69c09b990 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fe69400ea50 tx=0x7fe6940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6837fe700 1 -- 172.21.15.84:0/141370367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940096b0 con 0x7fe69c1595a0 2023-10-06T03:01:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6837fe700 1 -- 172.21.15.84:0/141370367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69400c850 con 0x7fe69c1595a0 2023-10-06T03:01:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6837fe700 1 -- 172.21.15.84:0/141370367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69400cc10 con 0x7fe69c1595a0 2023-10-06T03:01:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c15bd60 con 0x7fe69c1595a0 2023-10-06T03:01:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.151+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c15b240 con 0x7fe69c1595a0 2023-10-06T03:01:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.152+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c15bfa0 con 0x7fe69c1595a0 2023-10-06T03:01:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.153+0000 7fe6837fe700 1 -- 172.21.15.84:0/141370367 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe694013470 con 0x7fe69c1595a0 2023-10-06T03:01:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.153+0000 7fe6837fe700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe688066f30 0x7fe6880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.153+0000 7fe6837fe700 1 -- 172.21.15.84:0/141370367 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe6940848c0 con 0x7fe69c1595a0 2023-10-06T03:01:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.153+0000 7fe69b7fe700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe688066f30 0x7fe6880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.154+0000 7fe69b7fe700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe688066f30 0x7fe6880693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009fd0 tx=0x7fe68c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.157+0000 7fe6837fe700 1 -- 172.21.15.84:0/141370367 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe694051890 con 0x7fe69c1595a0 2023-10-06T03:01:30.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.343+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe69c15a9e0 con 0x7fe69c1595a0 2023-10-06T03:01:30.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.344+0000 7fe6837fe700 1 -- 172.21.15.84:0/141370367 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fe694054eb0 con 0x7fe69c1595a0 2023-10-06T03:01:30.346 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:30.346 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":94,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:00:40.595235+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:36.627631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:37.942934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:30.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe688066f30 msgr2=0x7fe6880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe688066f30 0x7fe6880693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009fd0 tx=0x7fe68c018000 comp rx=0 tx=0).stop 2023-10-06T03:01:30.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 msgr2=0x7fe69c09b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 0x7fe69c09b990 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fe69400ea50 tx=0x7fe6940091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 shutdown_connections 2023-10-06T03:01:30.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe688066f30 0x7fe6880693e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe69c1595a0 0x7fe69c09b990 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe69c0b07a0 0x7fe69c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 --2- 172.21.15.84:0/141370367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe69c0b49e0 0x7fe69c15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 >> 172.21.15.84:0/141370367 conn(0x7fe69c099830 msgr2=0x7fe69c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:30.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 shutdown_connections 2023-10-06T03:01:30.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.346+0000 7fe6a2225700 1 -- 172.21.15.84:0/141370367 wait complete. 2023-10-06T03:01:30.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:01:30.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.473+0000 7f391a45f700 1 Processor -- start 2023-10-06T03:01:30.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.473+0000 7f391a45f700 1 -- start start 2023-10-06T03:01:30.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f391a45f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39141595a0 0x7f39140aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f391a45f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39140b49e0 0x7f39140aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f391a45f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f39140b07a0 0x7f39140b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f391a45f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39140b0ca0 con 0x7f39141595a0 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f391a45f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39140b0f80 con 0x7f39140b07a0 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f391a45f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39140b1260 con 0x7f39140b49e0 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3913fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39141595a0 0x7f39140aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3913fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39141595a0 0x7f39140aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38260/0 (socket says 172.21.15.84:38260) 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3913fff700 1 -- 172.21.15.84:0/1609642173 learned_addr learned my addr 172.21.15.84:0/1609642173 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3913fff700 1 -- 172.21.15.84:0/1609642173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39140b49e0 msgr2=0x7f39140aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f39189fc700 1 --2- 172.21.15.84:0/1609642173 >> v2:172.21.15.131:3300/0 conn(0x7f39140b07a0 0x7f39140b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f39137fe700 1 --2- 172.21.15.84:0/1609642173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39140b49e0 0x7f39140aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3913fff700 1 --2- 172.21.15.84:0/1609642173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39140b49e0 0x7f39140aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3913fff700 1 -- 172.21.15.84:0/1609642173 >> v2:172.21.15.131:3300/0 conn(0x7f39140b07a0 msgr2=0x7f39140b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3913fff700 1 --2- 172.21.15.84:0/1609642173 >> v2:172.21.15.131:3300/0 conn(0x7f39140b07a0 0x7f39140b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3913fff700 1 -- 172.21.15.84:0/1609642173 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140b1540 con 0x7f39141595a0 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3913fff700 1 --2- 172.21.15.84:0/1609642173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39141595a0 0x7f39140aa570 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f39140d04a0 tx=0x7f3904009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82f1bbd58d3cdfd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3912ffd700 1 -- 172.21.15.84:0/1609642173 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904005c10 con 0x7f39141595a0 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3912ffd700 1 -- 172.21.15.84:0/1609642173 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904005d70 con 0x7f39141595a0 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.474+0000 7f3912ffd700 1 -- 172.21.15.84:0/1609642173 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390400b880 con 0x7f39141595a0 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.475+0000 7f391a45f700 1 -- 172.21.15.84:0/1609642173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39141595a0 msgr2=0x7f39140aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.475+0000 7f391a45f700 1 --2- 172.21.15.84:0/1609642173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39141595a0 0x7f39140aa570 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f39140d04a0 tx=0x7f3904009220 comp rx=0 tx=0).stop 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.475+0000 7f391a45f700 1 -- 172.21.15.84:0/1609642173 shutdown_connections 2023-10-06T03:01:30.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.475+0000 7f391a45f700 1 --2- 172.21.15.84:0/1609642173 >> v2:172.21.15.131:3300/0 conn(0x7f39140b07a0 0x7f39140b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.475+0000 7f391a45f700 1 --2- 172.21.15.84:0/1609642173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39141595a0 0x7f39140aa570 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.475+0000 7f391a45f700 1 --2- 172.21.15.84:0/1609642173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39140b49e0 0x7f39140aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.475+0000 7f391a45f700 1 -- 172.21.15.84:0/1609642173 >> 172.21.15.84:0/1609642173 conn(0x7f3914099830 msgr2=0x7f391406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:30.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.475+0000 7f391a45f700 1 -- 172.21.15.84:0/1609642173 shutdown_connections 2023-10-06T03:01:30.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.475+0000 7f391a45f700 1 -- 172.21.15.84:0/1609642173 wait complete. 2023-10-06T03:01:30.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.476+0000 7f391a45f700 1 Processor -- start 2023-10-06T03:01:30.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.476+0000 7f391a45f700 1 -- start start 2023-10-06T03:01:30.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f391a45f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39140b07a0 0x7f3914156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f391a45f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39140b49e0 0x7f39141565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f391a45f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39141595a0 0x7f391409b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f391a45f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391416a970 con 0x7f39140b07a0 2023-10-06T03:01:30.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f391a45f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391409a150 con 0x7f39140b49e0 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f391a45f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391416a3f0 con 0x7f39141595a0 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f3913fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39140b07a0 0x7f3914156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f3913fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39140b07a0 0x7f3914156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38268/0 (socket says 172.21.15.84:38268) 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f3913fff700 1 -- 172.21.15.84:0/585381790 learned_addr learned my addr 172.21.15.84:0/585381790 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f3913fff700 1 -- 172.21.15.84:0/585381790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39141595a0 msgr2=0x7f391409b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f3913fff700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39141595a0 0x7f391409b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f3913fff700 1 -- 172.21.15.84:0/585381790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39140b49e0 msgr2=0x7f39141565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f3913fff700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39140b49e0 0x7f39141565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f3913fff700 1 -- 172.21.15.84:0/585381790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3904009480 con 0x7f39140b07a0 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f3913fff700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39140b07a0 0x7f3914156020 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f390400b3c0 tx=0x7f3904016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f38fbfff700 1 -- 172.21.15.84:0/585381790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904011b30 con 0x7f39140b07a0 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f38fbfff700 1 -- 172.21.15.84:0/585381790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904011c90 con 0x7f39140b07a0 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391409dd50 con 0x7f39140b07a0 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f38fbfff700 1 -- 172.21.15.84:0/585381790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390401b660 con 0x7f39140b07a0 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.477+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391409d900 con 0x7f39140b07a0 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.478+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391409dac0 con 0x7f39140b07a0 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.479+0000 7f38fbfff700 1 -- 172.21.15.84:0/585381790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f390401ba90 con 0x7f39140b07a0 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.479+0000 7f38fbfff700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3900066f30 0x7f39000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.479+0000 7f39137fe700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3900066f30 0x7f39000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.479+0000 7f38fbfff700 1 -- 172.21.15.84:0/585381790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f39040861a0 con 0x7f39140b07a0 2023-10-06T03:01:30.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.480+0000 7f39137fe700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3900066f30 0x7f39000693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3914156560 tx=0x7f3908008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.484+0000 7f38fbfff700 1 -- 172.21.15.84:0/585381790 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39040530d0 con 0x7f39140b07a0 2023-10-06T03:01:30.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.709+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3914064ad0 con 0x7f39140b07a0 2023-10-06T03:01:30.710 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:01:30.709+0000 7fedbe922700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:01:30.719 INFO:tasks.ceph.mds.a.smithi084.stderr: -9859> 2023-10-06T03:00:48.888+0000 7fd4ebbfb700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-06T03:01:30.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.718+0000 7f38fbfff700 1 -- 172.21.15.84:0/585381790 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 161+0+0 (secure 0 0 0) 0x7f39040566f0 con 0x7f39140b07a0 2023-10-06T03:01:30.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3900066f30 msgr2=0x7f39000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3900066f30 0x7f39000693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3914156560 tx=0x7f3908008040 comp rx=0 tx=0).stop 2023-10-06T03:01:30.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39140b07a0 msgr2=0x7f3914156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39140b07a0 0x7f3914156020 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f390400b3c0 tx=0x7f3904016000 comp rx=0 tx=0).stop 2023-10-06T03:01:30.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 shutdown_connections 2023-10-06T03:01:30.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3900066f30 0x7f39000693e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39141595a0 0x7f391409b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39140b07a0 0x7f3914156020 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 --2- 172.21.15.84:0/585381790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39140b49e0 0x7f39141565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.720+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 >> 172.21.15.84:0/585381790 conn(0x7f3914099830 msgr2=0x7f3914069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:30.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.721+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 shutdown_connections 2023-10-06T03:01:30.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.721+0000 7f391a45f700 1 -- 172.21.15.84:0/585381790 wait complete. 2023-10-06T03:01:30.723 INFO:tasks.ceph.mds.d.smithi131.stderr: -896> 2023-10-06T03:01:09.331+0000 7fead8db1700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-10-06T03:00:50.613576+0000 1=0+1) n(v0 rc2023-10-06T03:00:50.613576+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={6368=pAsLsXsFsx/pAsLsXsFsx@4},l=6368 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55743e5d2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.613576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.613576+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.613576+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-10-06T03:00:50.613576+0000 2=0+2)","error_str":""},"return_code":-61} 2023-10-06T03:01:30.723 INFO:tasks.ceph.mds.d.smithi131.stderr: -882> 2023-10-06T03:01:09.331+0000 7fead8db1700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={6368=pAsLsXsFsx/AsLsXsFsx@2},l=6368 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55743e5d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-10-06T03:01:30.724 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:01:30.724 INFO:tasks.ceph.mds.b.smithi131.stderr: -1003> 2023-10-06T03:01:09.330+0000 7f4b61173700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1) n(v2 rc2023-10-06T03:00:50.840572+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={6368=pAsLsXsFsx/pAsLsXsFsx@4},l=6368 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55b919e08680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.840572+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-10-06T03:00:50.840572+0000 4=0+4)","error_str":""},"return_code":-61} 2023-10-06T03:01:30.724 INFO:tasks.ceph.mds.b.smithi131.stderr: -881> 2023-10-06T03:01:09.332+0000 7f4b6717f700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1) n(v1 rc2023-10-06T03:00:50.840572+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={6368=pAsLsXsFs/pAsLsXsFsx@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55b919e09700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.613576+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.612576+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-06T03:00:50.840572+0000 3=0+3)","error_str":""},"return_code":-61} 2023-10-06T03:01:30.728 INFO:tasks.ceph.mds.a.smithi084.stderr: -2296> 2023-10-06T03:01:09.330+0000 7fd4e83f4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-10-06T03:00:50.610576+0000 1=0+1) n(v3 rc2023-10-06T03:00:50.840572+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={6368=pAsLsXsFsx/pAsLsXsFsx@5},l=6368 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x556da0e95700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.610576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.840572+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.610576+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-10-06T03:00:50.840572+0000 6=0+6)","error_str":""},"return_code":-61} 2023-10-06T03:01:30.728 INFO:tasks.ceph.mds.a.smithi084.stderr: -2187> 2023-10-06T03:01:09.331+0000 7fd4ee400700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-10-06T03:00:50.611576+0000 1=0+1) n(v4 rc2023-10-06T03:00:50.840572+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={6368=pAsLsXsFs/pAsLsXsFsx@9} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x556da0f4e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:00:50.611576+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:00:50.840572+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-10-06T03:00:50.611576+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-10-06T03:00:50.840572+0000 5=0+5)","error_str":""},"return_code":-61} 2023-10-06T03:01:30.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:01:30.746 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:01:30.747 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:01:30.751 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:01:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.849+0000 7fe0ac6b8700 1 Processor -- start 2023-10-06T03:01:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.849+0000 7fe0ac6b8700 1 -- start start 2023-10-06T03:01:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0ac6b8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0a4156bb0 0x7fe0a40c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0ac6b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a4156f80 0x7fe0a41573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0ac6b8700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe0a406a570 0x7fe0a406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0ac6b8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a406c1c0 con 0x7fe0a4156bb0 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0ac6b8700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a4157910 con 0x7fe0a406a570 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0ac6b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a406af10 con 0x7fe0a4156f80 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0aa454700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0a4156bb0 0x7fe0a40c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0aa454700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0a4156bb0 0x7fe0a40c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38284/0 (socket says 172.21.15.84:38284) 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0aa454700 1 -- 172.21.15.84:0/1303628232 learned_addr learned my addr 172.21.15.84:0/1303628232 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0a9c53700 1 --2- 172.21.15.84:0/1303628232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a4156f80 0x7fe0a41573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.850+0000 7fe0aac55700 1 --2- 172.21.15.84:0/1303628232 >> v2:172.21.15.131:3300/0 conn(0x7fe0a406a570 0x7fe0a406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.851+0000 7fe0aa454700 1 -- 172.21.15.84:0/1303628232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a4156f80 msgr2=0x7fe0a41573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.851+0000 7fe0aa454700 1 --2- 172.21.15.84:0/1303628232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a4156f80 0x7fe0a41573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.851+0000 7fe0aa454700 1 -- 172.21.15.84:0/1303628232 >> v2:172.21.15.131:3300/0 conn(0x7fe0a406a570 msgr2=0x7fe0a406a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.851+0000 7fe0aa454700 1 --2- 172.21.15.84:0/1303628232 >> v2:172.21.15.131:3300/0 conn(0x7fe0a406a570 0x7fe0a406a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.851+0000 7fe0aa454700 1 -- 172.21.15.84:0/1303628232 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40c8b30 con 0x7fe0a4156bb0 2023-10-06T03:01:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.851+0000 7fe0aa454700 1 --2- 172.21.15.84:0/1303628232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156bb0 0x7fe0a40c84e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fe0a41568f0 tx=0x7fe0a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f8a9a890b3f0f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.851+0000 7fe0a9452700 1 -- 172.21.15.84:0/1303628232 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a000e070 con 0x7fe0a4156bb0 2023-10-06T03:01:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.851+0000 7fe0a9452700 1 -- 172.21.15.84:0/1303628232 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a000b970 con 0x7fe0a4156bb0 2023-10-06T03:01:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.851+0000 7fe0a9452700 1 -- 172.21.15.84:0/1303628232 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00092e0 con 0x7fe0a4156bb0 2023-10-06T03:01:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.852+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1303628232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156bb0 msgr2=0x7fe0a40c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.852+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1303628232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156bb0 0x7fe0a40c84e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fe0a41568f0 tx=0x7fe0a0009840 comp rx=0 tx=0).stop 2023-10-06T03:01:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.852+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1303628232 shutdown_connections 2023-10-06T03:01:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.852+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1303628232 >> v2:172.21.15.131:3300/0 conn(0x7fe0a406a570 0x7fe0a406a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.852+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1303628232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156bb0 0x7fe0a40c84e0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.852+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1303628232 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a4156f80 0x7fe0a41573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.852+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1303628232 >> 172.21.15.84:0/1303628232 conn(0x7fe0a40cd1e0 msgr2=0x7fe0a40cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.852+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1303628232 shutdown_connections 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.852+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1303628232 wait complete. 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.853+0000 7fe0ac6b8700 1 Processor -- start 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.853+0000 7fe0ac6b8700 1 -- start start 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.853+0000 7fe0ac6b8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a406a570 0x7fe0a40b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.853+0000 7fe0ac6b8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a4156bb0 0x7fe0a4148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.853+0000 7fe0ac6b8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156f80 0x7fe0a4150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.853+0000 7fe0ac6b8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a414a360 con 0x7fe0a4156f80 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.853+0000 7fe0ac6b8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a41514c0 con 0x7fe0a4156bb0 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.853+0000 7fe0ac6b8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a414bb90 con 0x7fe0a406a570 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aac55700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156f80 0x7fe0a4150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aac55700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156f80 0x7fe0a4150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38288/0 (socket says 172.21.15.84:38288) 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aac55700 1 -- 172.21.15.84:0/1517945179 learned_addr learned my addr 172.21.15.84:0/1517945179 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aa454700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a406a570 0x7fe0a40b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0a9c53700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a4156bb0 0x7fe0a4148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aac55700 1 -- 172.21.15.84:0/1517945179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a406a570 msgr2=0x7fe0a40b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aac55700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a406a570 0x7fe0a40b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aac55700 1 -- 172.21.15.84:0/1517945179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a4156bb0 msgr2=0x7fe0a4148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aac55700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a4156bb0 0x7fe0a4148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aac55700 1 -- 172.21.15.84:0/1517945179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0009ae0 con 0x7fe0a4156f80 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0aac55700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156f80 0x7fe0a4150f80 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00ea50 tx=0x7fe09c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe09a7fc700 1 -- 172.21.15.84:0/1517945179 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00ee90 con 0x7fe0a4156f80 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe09a7fc700 1 -- 172.21.15.84:0/1517945179 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c00c850 con 0x7fe0a4156f80 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a40b2730 con 0x7fe0a4156f80 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe09a7fc700 1 -- 172.21.15.84:0/1517945179 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00cc10 con 0x7fe0a4156f80 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.854+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a4149d10 con 0x7fe0a4156f80 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.855+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a414a510 con 0x7fe0a4156f80 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.856+0000 7fe09a7fc700 1 -- 172.21.15.84:0/1517945179 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe09c013470 con 0x7fe0a4156f80 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.856+0000 7fe09a7fc700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.856+0000 7fe09a7fc700 1 -- 172.21.15.84:0/1517945179 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6636+0+0 (secure 0 0 0) 0x7fe09c084a90 con 0x7fe0a4156f80 2023-10-06T03:01:30.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.856+0000 7fe0aa454700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.856+0000 7fe0aa454700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009880 tx=0x7fe0a0018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:30.860+0000 7fe09a7fc700 1 -- 172.21.15.84:0/1517945179 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0a414a510 con 0x7fe0a4156f80 2023-10-06T03:01:31.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.085+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe0a4064ad0 con 0x7fe0a4156f80 2023-10-06T03:01:31.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.718+0000 7fe09a7fc700 1 -- 172.21.15.84:0/1517945179 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe09c051960 con 0x7fe0a4156f80 2023-10-06T03:01:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 msgr2=0x7fe0880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0009880 tx=0x7fe0a0018000 comp rx=0 tx=0).stop 2023-10-06T03:01:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156f80 msgr2=0x7fe0a4150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156f80 0x7fe0a4150f80 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00ea50 tx=0x7fe09c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 shutdown_connections 2023-10-06T03:01:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe088066f30 0x7fe0880693e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0a4156f80 0x7fe0a4150f80 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0a406a570 0x7fe0a40b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 --2- 172.21.15.84:0/1517945179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0a4156bb0 0x7fe0a4148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 >> 172.21.15.84:0/1517945179 conn(0x7fe0a40cd1e0 msgr2=0x7fe0a41592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 shutdown_connections 2023-10-06T03:01:31.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.720+0000 7fe0ac6b8700 1 -- 172.21.15.84:0/1517945179 wait complete. 2023-10-06T03:01:31.734 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:01:31.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.891+0000 7f93a7f4a700 1 Processor -- start 2023-10-06T03:01:31.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.891+0000 7f93a7f4a700 1 -- start start 2023-10-06T03:01:31.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a7f4a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f93a0157270 0x7f93a0159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a7f4a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93a015d290 0x7f93a00c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a7f4a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93a00c3ad0 0x7f93a00c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a7f4a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00cc870 con 0x7f93a015d290 2023-10-06T03:01:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a7f4a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a015e210 con 0x7f93a0157270 2023-10-06T03:01:31.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a7f4a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a015d6e0 con 0x7f93a00c3ad0 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a54e5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93a015d290 0x7f93a00c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a54e5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93a015d290 0x7f93a00c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38290/0 (socket says 172.21.15.84:38290) 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a54e5700 1 -- 172.21.15.84:0/1571131980 learned_addr learned my addr 172.21.15.84:0/1571131980 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a54e5700 1 -- 172.21.15.84:0/1571131980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93a00c3ad0 msgr2=0x7f93a00c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a54e5700 1 --2- 172.21.15.84:0/1571131980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93a00c3ad0 0x7f93a00c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a54e5700 1 -- 172.21.15.84:0/1571131980 >> v2:172.21.15.131:3300/0 conn(0x7f93a0157270 msgr2=0x7f93a0159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a54e5700 1 --2- 172.21.15.84:0/1571131980 >> v2:172.21.15.131:3300/0 conn(0x7f93a0157270 0x7f93a0159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a54e5700 1 -- 172.21.15.84:0/1571131980 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a015d970 con 0x7f93a015d290 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a54e5700 1 --2- 172.21.15.84:0/1571131980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a015d290 0x7f93a00c89d0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f93a006b050 tx=0x7f9390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd715837e2eb8b69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:31.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a4ce4700 1 -- 172.21.15.84:0/1571131980 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000b860 con 0x7f93a015d290 2023-10-06T03:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.892+0000 7f93a4ce4700 1 -- 172.21.15.84:0/1571131980 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939000b9c0 con 0x7f93a015d290 2023-10-06T03:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a4ce4700 1 -- 172.21.15.84:0/1571131980 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000bd60 con 0x7f93a015d290 2023-10-06T03:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a7f4a700 1 -- 172.21.15.84:0/1571131980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a015d290 msgr2=0x7f93a00c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/1571131980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a015d290 0x7f93a00c89d0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f93a006b050 tx=0x7f9390009250 comp rx=0 tx=0).stop 2023-10-06T03:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a7f4a700 1 -- 172.21.15.84:0/1571131980 shutdown_connections 2023-10-06T03:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/1571131980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93a00c3ad0 0x7f93a00c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/1571131980 >> v2:172.21.15.131:3300/0 conn(0x7f93a0157270 0x7f93a0159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/1571131980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a015d290 0x7f93a00c89d0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a7f4a700 1 -- 172.21.15.84:0/1571131980 >> 172.21.15.84:0/1571131980 conn(0x7f93a0088000 msgr2=0x7f93a0067dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a7f4a700 1 -- 172.21.15.84:0/1571131980 shutdown_connections 2023-10-06T03:01:31.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.893+0000 7f93a7f4a700 1 -- 172.21.15.84:0/1571131980 wait complete. 2023-10-06T03:01:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.894+0000 7f93a7f4a700 1 Processor -- start 2023-10-06T03:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.894+0000 7f93a7f4a700 1 -- start start 2023-10-06T03:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a7f4a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93a00c3ad0 0x7f93a00b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a7f4a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a0157270 0x7f93a00694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a7f4a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a015d290 0x7f93a0141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a7f4a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0069030 con 0x7f93a0157270 2023-10-06T03:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a7f4a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00b3df0 con 0x7f93a015d290 2023-10-06T03:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a7f4a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0068700 con 0x7f93a00c3ad0 2023-10-06T03:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a54e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a0157270 0x7f93a00694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a54e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a0157270 0x7f93a00694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38302/0 (socket says 172.21.15.84:38302) 2023-10-06T03:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a54e5700 1 -- 172.21.15.84:0/2720516324 learned_addr learned my addr 172.21.15.84:0/2720516324 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a54e5700 1 -- 172.21.15.84:0/2720516324 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93a00c3ad0 msgr2=0x7f93a00b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a5ce6700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93a00c3ad0 0x7f93a00b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a64e7700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a015d290 0x7f93a0141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a54e5700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93a00c3ad0 0x7f93a00b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a54e5700 1 -- 172.21.15.84:0/2720516324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a015d290 msgr2=0x7f93a0141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a54e5700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a015d290 0x7f93a0141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a54e5700 1 -- 172.21.15.84:0/2720516324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900094f0 con 0x7f93a0157270 2023-10-06T03:01:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.895+0000 7f93a54e5700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a0157270 0x7f93a00694c0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f93900090b0 tx=0x7f9390017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.896+0000 7f9395ffb700 1 -- 172.21.15.84:0/2720516324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390011e20 con 0x7f93a0157270 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.896+0000 7f9395ffb700 1 -- 172.21.15.84:0/2720516324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939001a630 con 0x7f93a0157270 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.896+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a00689e0 con 0x7f93a0157270 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.896+0000 7f9395ffb700 1 -- 172.21.15.84:0/2720516324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939001a9f0 con 0x7f93a0157270 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.896+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a006a5b0 con 0x7f93a0157270 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.897+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a00691a0 con 0x7f93a0157270 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.897+0000 7f9395ffb700 1 -- 172.21.15.84:0/2720516324 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93900253f0 con 0x7f93a0157270 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.898+0000 7f9395ffb700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9384066f30 0x7f93840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.898+0000 7f9395ffb700 1 -- 172.21.15.84:0/2720516324 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6636+0+0 (secure 0 0 0) 0x7f9390086370 con 0x7f93a0157270 2023-10-06T03:01:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.898+0000 7f93a5ce6700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9384066f30 0x7f93840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.898+0000 7f93a5ce6700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9384066f30 0x7f93840693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f93a0142050 tx=0x7f939c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:31.902+0000 7f9395ffb700 1 -- 172.21.15.84:0/2720516324 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9390053240 con 0x7f93a0157270 2023-10-06T03:01:32.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.085+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f93a0064ad0 con 0x7f93a0157270 2023-10-06T03:01:32.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.728+0000 7f9395ffb700 1 -- 172.21.15.84:0/2720516324 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9390056860 con 0x7f93a0157270 2023-10-06T03:01:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.731+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9384066f30 msgr2=0x7f93840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.731+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9384066f30 0x7f93840693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f93a0142050 tx=0x7f939c008040 comp rx=0 tx=0).stop 2023-10-06T03:01:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.731+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a0157270 msgr2=0x7f93a00694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.731+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a0157270 0x7f93a00694c0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f93900090b0 tx=0x7f9390017000 comp rx=0 tx=0).stop 2023-10-06T03:01:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.732+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 shutdown_connections 2023-10-06T03:01:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.732+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9384066f30 0x7f93840693e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.732+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a015d290 0x7f93a0141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.732+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93a00c3ad0 0x7f93a00b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.732+0000 7f93a7f4a700 1 --2- 172.21.15.84:0/2720516324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93a0157270 0x7f93a00694c0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.732+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 >> 172.21.15.84:0/2720516324 conn(0x7f93a0088000 msgr2=0x7f93a00c3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.732+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 shutdown_connections 2023-10-06T03:01:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.732+0000 7f93a7f4a700 1 -- 172.21.15.84:0/2720516324 wait complete. 2023-10-06T03:01:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:01:32.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.864+0000 7f6e13c31700 1 Processor -- start 2023-10-06T03:01:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.864+0000 7f6e13c31700 1 -- start start 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e13c31700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6e0c06ed20 0x7f6e0c0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e13c31700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e0c06f0f0 0x7f6e0c0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e13c31700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c0b2d20 con 0x7f6e0c0aee20 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e13c31700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c06fb80 con 0x7f6e0c06f0f0 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e13c31700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c0b0450 con 0x7f6e0c06ed20 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e111cc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e0c06f0f0 0x7f6e0c0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e121ce700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6e0c0aee20 0x7f6e0c0af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50950/0 (socket says 172.21.15.84:50950) 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e121ce700 1 -- 172.21.15.84:0/705533665 learned_addr learned my addr 172.21.15.84:0/705533665 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e111cc700 1 -- 172.21.15.84:0/705533665 >> v2:172.21.15.131:3300/0 conn(0x7f6e0c06ed20 msgr2=0x7f6e0c0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e111cc700 1 --2- 172.21.15.84:0/705533665 >> v2:172.21.15.131:3300/0 conn(0x7f6e0c06ed20 0x7f6e0c0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e111cc700 1 -- 172.21.15.84:0/705533665 >> v1:172.21.15.84:6789/0 conn(0x7f6e0c0aee20 legacy=0x7f6e0c0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e109cb700 1 -- 172.21.15.84:0/705533665 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803773946 0 0) 0x7f6e0c0b2d20 con 0x7f6e0c0aee20 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e111cc700 1 -- 172.21.15.84:0/705533665 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c0b2a40 con 0x7f6e0c06f0f0 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.865+0000 7f6e111cc700 1 --2- 172.21.15.84:0/705533665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c06f0f0 0x7f6e0c0b08e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0098e0 tx=0x7f6dfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2042c4597f3e5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e109cb700 1 -- 172.21.15.84:0/705533665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc009e80 con 0x7f6e0c06f0f0 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e109cb700 1 -- 172.21.15.84:0/705533665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc00b820 con 0x7f6e0c06f0f0 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e109cb700 1 -- 172.21.15.84:0/705533665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc00bba0 con 0x7f6e0c06f0f0 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e13c31700 1 -- 172.21.15.84:0/705533665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c06f0f0 msgr2=0x7f6e0c0b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e13c31700 1 --2- 172.21.15.84:0/705533665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c06f0f0 0x7f6e0c0b08e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0098e0 tx=0x7f6dfc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e13c31700 1 -- 172.21.15.84:0/705533665 shutdown_connections 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e13c31700 1 --2- 172.21.15.84:0/705533665 >> v2:172.21.15.131:3300/0 conn(0x7f6e0c06ed20 0x7f6e0c0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e13c31700 1 --2- 172.21.15.84:0/705533665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c06f0f0 0x7f6e0c0b08e0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e13c31700 1 -- 172.21.15.84:0/705533665 >> 172.21.15.84:0/705533665 conn(0x7f6e0c068330 msgr2=0x7f6e0c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e13c31700 1 -- 172.21.15.84:0/705533665 shutdown_connections 2023-10-06T03:01:32.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.866+0000 7f6e13c31700 1 -- 172.21.15.84:0/705533665 wait complete. 2023-10-06T03:01:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.867+0000 7f6e13c31700 1 Processor -- start 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.867+0000 7f6e13c31700 1 -- start start 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e13c31700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e0c06ed20 0x7f6e0c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e13c31700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0c06f0f0 0x7f6e0c0a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e13c31700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c0aee20 0x7f6e0c0a8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e13c31700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0a7b30 con 0x7f6e0c0aee20 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e13c31700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0a9700 con 0x7f6e0c06f0f0 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e13c31700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0a6f20 con 0x7f6e0c06ed20 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e121ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c0aee20 0x7f6e0c0a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e121ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c0aee20 0x7f6e0c0a8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54306/0 (socket says 172.21.15.84:54306) 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e121ce700 1 -- 172.21.15.84:0/1563659521 learned_addr learned my addr 172.21.15.84:0/1563659521 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e111cc700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0c06f0f0 0x7f6e0c0a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e119cd700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e0c06ed20 0x7f6e0c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e121ce700 1 -- 172.21.15.84:0/1563659521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e0c06ed20 msgr2=0x7f6e0c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e121ce700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e0c06ed20 0x7f6e0c1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e121ce700 1 -- 172.21.15.84:0/1563659521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0c06f0f0 msgr2=0x7f6e0c0a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e121ce700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0c06f0f0 0x7f6e0c0a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e121ce700 1 -- 172.21.15.84:0/1563659521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc009420 con 0x7f6e0c0aee20 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.868+0000 7f6e119cd700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e0c06ed20 0x7f6e0c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.869+0000 7f6e121ce700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c0aee20 0x7f6e0c0a8500 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400cc90 tx=0x7f6e04001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.869+0000 7f6e01ffb700 1 -- 172.21.15.84:0/1563659521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400cea0 con 0x7f6e0c0aee20 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.869+0000 7f6e01ffb700 1 -- 172.21.15.84:0/1563659521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0400ab70 con 0x7f6e0c0aee20 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.869+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c0a7200 con 0x7f6e0c0aee20 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.869+0000 7f6e01ffb700 1 -- 172.21.15.84:0/1563659521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e040070f0 con 0x7f6e0c0aee20 2023-10-06T03:01:32.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.869+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c0a77c0 con 0x7f6e0c0aee20 2023-10-06T03:01:32.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.870+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c064ad0 con 0x7f6e0c0aee20 2023-10-06T03:01:32.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.870+0000 7f6e01ffb700 1 -- 172.21.15.84:0/1563659521 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e040074e0 con 0x7f6e0c0aee20 2023-10-06T03:01:32.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.871+0000 7f6e01ffb700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6df0066f30 0x7f6df00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.871+0000 7f6e01ffb700 1 -- 172.21.15.84:0/1563659521 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6198+0+0 (secure 0 0 0) 0x7f6e04084b10 con 0x7f6e0c0aee20 2023-10-06T03:01:32.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.871+0000 7f6e119cd700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6df0066f30 0x7f6df00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.871+0000 7f6e119cd700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6df0066f30 0x7f6df00693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6e080079b0 tx=0x7f6e08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:32.875+0000 7f6e01ffb700 1 -- 172.21.15.84:0/1563659521 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e04051c10 con 0x7f6e0c0aee20 2023-10-06T03:01:33.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.057+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6e0c04bb80 con 0x7f6e0c0aee20 2023-10-06T03:01:33.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.728+0000 7f6e01ffb700 1 -- 172.21.15.84:0/1563659521 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6e04055230 con 0x7f6e0c0aee20 2023-10-06T03:01:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6df0066f30 msgr2=0x7f6df00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6df0066f30 0x7f6df00693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6e080079b0 tx=0x7f6e08008040 comp rx=0 tx=0).stop 2023-10-06T03:01:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c0aee20 msgr2=0x7f6e0c0a8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c0aee20 0x7f6e0c0a8500 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400cc90 tx=0x7f6e04001a80 comp rx=0 tx=0).stop 2023-10-06T03:01:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 shutdown_connections 2023-10-06T03:01:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6df0066f30 0x7f6df00693e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e0c0aee20 0x7f6e0c0a8500 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6e0c06ed20 0x7f6e0c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 --2- 172.21.15.84:0/1563659521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e0c06f0f0 0x7f6e0c0a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.733+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 >> 172.21.15.84:0/1563659521 conn(0x7f6e0c068330 msgr2=0x7f6e0c0b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.734+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 shutdown_connections 2023-10-06T03:01:33.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.734+0000 7f6e13c31700 1 -- 172.21.15.84:0/1563659521 wait complete. 2023-10-06T03:01:33.743 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:01:33.752 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:01:33.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.869+0000 7fc0470d3700 1 Processor -- start 2023-10-06T03:01:33.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.869+0000 7fc0470d3700 1 -- start start 2023-10-06T03:01:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.870+0000 7fc0470d3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc0400cbb50 0x7fc0400ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.870+0000 7fc0470d3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400b2e60 con 0x7fc0400b2a90 2023-10-06T03:01:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.870+0000 7fc0470d3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400cf5d0 con 0x7fc0400c6610 2023-10-06T03:01:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.870+0000 7fc0470d3700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400cf8b0 con 0x7fc0400cbb50 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.870+0000 7fc044e6f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc0400b2a90 0x7fc0400cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50966/0 (socket says 172.21.15.84:50966) 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.870+0000 7fc044e6f700 1 -- 172.21.15.84:0/2685452031 learned_addr learned my addr 172.21.15.84:0/2685452031 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502466337 0 0) 0x7fc0400b2e60 con 0x7fc0400b2a90 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc028003570 con 0x7fc0400b2a90 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc037fff700 1 --2- 172.21.15.84:0/2685452031 >> v2:172.21.15.131:3300/0 conn(0x7fc0400cbb50 0x7fc0400ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1543477416 0 0) 0x7fc028003570 con 0x7fc0400b2a90 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 >> v2:172.21.15.131:3300/0 conn(0x7fc0400cbb50 msgr2=0x7fc0400ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 --2- 172.21.15.84:0/2685452031 >> v2:172.21.15.131:3300/0 conn(0x7fc0400cbb50 0x7fc0400ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 >> v1:172.21.15.131:6789/0 conn(0x7fc0400c6610 legacy=0x7fc0400ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400cfb90 con 0x7fc0400b2a90 2023-10-06T03:01:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fc03c001970 con 0x7fc0400b2a90 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 >> v1:172.21.15.84:6789/0 conn(0x7fc0400b2a90 legacy=0x7fc0400cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc028003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc028004810 0x7fc028004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0280052e0 0x7fc02800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400cf8b0 con 0x7fc028003a60 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02800c2a0 con 0x7fc028004810 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02800c460 con 0x7fc0280052e0 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc044e6f700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc028003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc037fff700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc028004810 0x7fc028004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc045670700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0280052e0 0x7fc02800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc044e6f700 1 -- 172.21.15.84:0/2685452031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0280052e0 msgr2=0x7fc02800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc044e6f700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc0280052e0 0x7fc02800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc044e6f700 1 -- 172.21.15.84:0/2685452031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc028004810 msgr2=0x7fc028004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc044e6f700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc028004810 0x7fc028004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc044e6f700 1 -- 172.21.15.84:0/2685452031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028003570 con 0x7fc028003a60 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.871+0000 7fc045670700 1 -- 172.21.15.84:0/2685452031 reap_dead start 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc044e6f700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc028003e70 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00c670 tx=0x7fc03c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c9f9a41f23c88d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c005b70 con 0x7fc028003a60 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c005cf0 con 0x7fc028003a60 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0377fe700 1 -- 172.21.15.84:0/2685452031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c007360 con 0x7fc028003a60 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0470d3700 1 -- 172.21.15.84:0/2685452031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 msgr2=0x7fc028003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0470d3700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc028003e70 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00c670 tx=0x7fc03c007ca0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0470d3700 1 -- 172.21.15.84:0/2685452031 shutdown_connections 2023-10-06T03:01:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0470d3700 1 --2- 172.21.15.84:0/2685452031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc028003e70 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0470d3700 1 -- 172.21.15.84:0/2685452031 >> 172.21.15.84:0/2685452031 conn(0x7fc040099740 msgr2=0x7fc04006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0470d3700 1 -- 172.21.15.84:0/2685452031 shutdown_connections 2023-10-06T03:01:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.872+0000 7fc0470d3700 1 -- 172.21.15.84:0/2685452031 wait complete. 2023-10-06T03:01:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.873+0000 7fc0470d3700 1 Processor -- start 2023-10-06T03:01:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc0470d3700 1 -- start start 2023-10-06T03:01:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc0470d3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc04009baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc0470d3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc04009b140 0x7fc040158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc0470d3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0400d01c0 0x7fc0400d0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc0470d3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04009cd70 con 0x7fc028003a60 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc0470d3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400d0b50 con 0x7fc0400d01c0 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc0470d3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04009c160 con 0x7fc04009b140 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc044e6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc04009baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc044e6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc04009baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54326/0 (socket says 172.21.15.84:54326) 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc044e6f700 1 -- 172.21.15.84:0/3365124349 learned_addr learned my addr 172.21.15.84:0/3365124349 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc045670700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0400d01c0 0x7fc0400d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.874+0000 7fc037fff700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc04009b140 0x7fc040158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc044e6f700 1 -- 172.21.15.84:0/3365124349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc04009b140 msgr2=0x7fc040158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc044e6f700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc04009b140 0x7fc040158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc044e6f700 1 -- 172.21.15.84:0/3365124349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0400d01c0 msgr2=0x7fc0400d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc044e6f700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0400d01c0 0x7fc0400d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc044e6f700 1 -- 172.21.15.84:0/3365124349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04009c440 con 0x7fc028003a60 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc044e6f700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc04009baa0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fc02800c270 tx=0x7fc03c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc034ff9700 1 -- 172.21.15.84:0/3365124349 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c003080 con 0x7fc028003a60 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc034ff9700 1 -- 172.21.15.84:0/3365124349 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c001930 con 0x7fc028003a60 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04009c720 con 0x7fc028003a60 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc034ff9700 1 -- 172.21.15.84:0/3365124349 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c001d10 con 0x7fc028003a60 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.875+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04009b5b0 con 0x7fc028003a60 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.876+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04008a750 con 0x7fc028003a60 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.876+0000 7fc034ff9700 1 -- 172.21.15.84:0/3365124349 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc03c014630 con 0x7fc028003a60 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.877+0000 7fc034ff9700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc02c066f30 0x7fc02c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.877+0000 7fc034ff9700 1 -- 172.21.15.84:0/3365124349 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fc03c0865d0 con 0x7fc028003a60 2023-10-06T03:01:33.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.877+0000 7fc037fff700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc02c066f30 0x7fc02c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.877+0000 7fc037fff700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc02c066f30 0x7fc02c0693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc0400d0de0 tx=0x7fc030008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:33.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:33.881+0000 7fc034ff9700 1 -- 172.21.15.84:0/3365124349 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc03c0537f0 con 0x7fc028003a60 2023-10-06T03:01:34.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.073+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc04008a750 con 0x7fc028003a60 2023-10-06T03:01:34.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.076+0000 7fc034ff9700 1 -- 172.21.15.84:0/3365124349 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc03c056e10 con 0x7fc028003a60 2023-10-06T03:01:34.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc02c066f30 msgr2=0x7fc02c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc02c066f30 0x7fc02c0693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc0400d0de0 tx=0x7fc030008040 comp rx=0 tx=0).stop 2023-10-06T03:01:34.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 msgr2=0x7fc04009baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc04009baa0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fc02800c270 tx=0x7fc03c015000 comp rx=0 tx=0).stop 2023-10-06T03:01:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 shutdown_connections 2023-10-06T03:01:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc02c066f30 0x7fc02c0693e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0400d01c0 0x7fc0400d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc028003a60 0x7fc04009baa0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 --2- 172.21.15.84:0/3365124349 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc04009b140 0x7fc040158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.078+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 >> 172.21.15.84:0/3365124349 conn(0x7fc040099740 msgr2=0x7fc0400b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.079+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 shutdown_connections 2023-10-06T03:01:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.079+0000 7fc0470d3700 1 -- 172.21.15.84:0/3365124349 wait complete. 2023-10-06T03:01:34.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2023-10-06T03:01:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.205+0000 7f6c81fbc700 1 Processor -- start 2023-10-06T03:01:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.205+0000 7f6c81fbc700 1 -- start start 2023-10-06T03:01:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c81fbc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c7c1595a0 0x7f6c7c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c81fbc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0b0ca0 con 0x7f6c7c0b49e0 2023-10-06T03:01:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c81fbc700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0b0f80 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c81fbc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b1260 con 0x7f6c7c1595a0 2023-10-06T03:01:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c7b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c7c1595a0 0x7f6c7c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c7affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6c7c0b49e0 0x7f6c7c0aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50980/0 (socket says 172.21.15.84:50980) 2023-10-06T03:01:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c7affd700 1 -- 172.21.15.84:0/23027717 learned_addr learned my addr 172.21.15.84:0/23027717 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c7b7fe700 1 -- 172.21.15.84:0/23027717 >> v1:172.21.15.131:6789/0 conn(0x7f6c7c0b07a0 legacy=0x7f6c7c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c7b7fe700 1 -- 172.21.15.84:0/23027717 >> v1:172.21.15.84:6789/0 conn(0x7f6c7c0b49e0 legacy=0x7f6c7c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c7b7fe700 1 -- 172.21.15.84:0/23027717 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0b1540 con 0x7f6c7c1595a0 2023-10-06T03:01:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.206+0000 7f6c7a7fc700 1 -- 172.21.15.84:0/23027717 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296645620 0 0) 0x7f6c7c0b0ca0 con 0x7f6c7c0b49e0 2023-10-06T03:01:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c7b7fe700 1 --2- 172.21.15.84:0/23027717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c1595a0 0x7f6c7c0aa570 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ee0 tx=0x7f6c6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07437db5a30eeac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c7a7fc700 1 -- 172.21.15.84:0/23027717 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00e070 con 0x7f6c7c1595a0 2023-10-06T03:01:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c7a7fc700 1 -- 172.21.15.84:0/23027717 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c00bc10 con 0x7f6c7c1595a0 2023-10-06T03:01:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c7a7fc700 1 -- 172.21.15.84:0/23027717 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c012430 con 0x7f6c7c1595a0 2023-10-06T03:01:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c81fbc700 1 -- 172.21.15.84:0/23027717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c1595a0 msgr2=0x7f6c7c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c81fbc700 1 --2- 172.21.15.84:0/23027717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c1595a0 0x7f6c7c0aa570 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ee0 tx=0x7f6c6c009780 comp rx=0 tx=0).stop 2023-10-06T03:01:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c81fbc700 1 -- 172.21.15.84:0/23027717 shutdown_connections 2023-10-06T03:01:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c81fbc700 1 --2- 172.21.15.84:0/23027717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c1595a0 0x7f6c7c0aa570 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c81fbc700 1 -- 172.21.15.84:0/23027717 >> 172.21.15.84:0/23027717 conn(0x7f6c7c099830 msgr2=0x7f6c7c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c81fbc700 1 -- 172.21.15.84:0/23027717 shutdown_connections 2023-10-06T03:01:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.207+0000 7f6c81fbc700 1 -- 172.21.15.84:0/23027717 wait complete. 2023-10-06T03:01:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.208+0000 7f6c81fbc700 1 Processor -- start 2023-10-06T03:01:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c81fbc700 1 -- start start 2023-10-06T03:01:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c81fbc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c0b07a0 0x7f6c7c16a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c81fbc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c7c0b49e0 0x7f6c7c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c81fbc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c7c1595a0 0x7f6c7c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c81fbc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c16de00 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c81fbc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0abf20 con 0x7f6c7c1595a0 2023-10-06T03:01:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c81fbc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c16d4d0 con 0x7f6c7c0b49e0 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c7b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c0b07a0 0x7f6c7c16a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c7b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c0b07a0 0x7f6c7c16a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54344/0 (socket says 172.21.15.84:54344) 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c7b7fe700 1 -- 172.21.15.84:0/2125083497 learned_addr learned my addr 172.21.15.84:0/2125083497 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c7affd700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c7c0b49e0 0x7f6c7c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.209+0000 7f6c7bfff700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c7c1595a0 0x7f6c7c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c7b7fe700 1 -- 172.21.15.84:0/2125083497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c7c0b49e0 msgr2=0x7f6c7c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c7b7fe700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c7c0b49e0 0x7f6c7c15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c7b7fe700 1 -- 172.21.15.84:0/2125083497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c7c1595a0 msgr2=0x7f6c7c15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c7b7fe700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c7c1595a0 0x7f6c7c15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c7b7fe700 1 -- 172.21.15.84:0/2125083497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c009a20 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c7b7fe700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c0b07a0 0x7f6c7c16a4e0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c067c60 tx=0x7f6c6c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c637fe700 1 -- 172.21.15.84:0/2125083497 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c012e00 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c637fe700 1 -- 172.21.15.84:0/2125083497 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c01e640 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c16d7b0 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c637fe700 1 -- 172.21.15.84:0/2125083497 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c01ea00 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.210+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c16aa20 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.211+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c064ad0 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.211+0000 7f6c637fe700 1 -- 172.21.15.84:0/2125083497 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c6c02f3f0 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.212+0000 7f6c637fe700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c68066f30 0x7f6c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.212+0000 7f6c637fe700 1 -- 172.21.15.84:0/2125083497 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f6c6c086da0 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.212+0000 7f6c7affd700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c68066f30 0x7f6c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.212+0000 7f6c7affd700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c68066f30 0x7f6c680693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0afdf0 tx=0x7f6c70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.216+0000 7f6c637fe700 1 -- 172.21.15.84:0/2125083497 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c6c053fc0 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.472+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) v1 -- 0x7f6c7c16e0e0 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.732+0000 7f6c637fe700 1 -- 172.21.15.84:0/2125083497 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v334) v1 ==== 154+0+0 (secure 0 0 0) 0x7f6c6c0575e0 con 0x7f6c7c0b07a0 2023-10-06T03:01:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c68066f30 msgr2=0x7f6c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c68066f30 0x7f6c680693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0afdf0 tx=0x7f6c70009040 comp rx=0 tx=0).stop 2023-10-06T03:01:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c0b07a0 msgr2=0x7f6c7c16a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c0b07a0 0x7f6c7c16a4e0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c067c60 tx=0x7f6c6c018000 comp rx=0 tx=0).stop 2023-10-06T03:01:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 shutdown_connections 2023-10-06T03:01:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c68066f30 0x7f6c680693e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c7c1595a0 0x7f6c7c15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c7c0b07a0 0x7f6c7c16a4e0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 --2- 172.21.15.84:0/2125083497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6c7c0b49e0 0x7f6c7c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 >> 172.21.15.84:0/2125083497 conn(0x7f6c7c099830 msgr2=0x7f6c7c069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 shutdown_connections 2023-10-06T03:01:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.734+0000 7f6c81fbc700 1 -- 172.21.15.84:0/2125083497 wait complete. 2023-10-06T03:01:34.748 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-10-06T03:01:34.748 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-10-06T03:01:34.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2023-10-06T03:01:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.861+0000 7f075346b700 1 Processor -- start 2023-10-06T03:01:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.861+0000 7f075346b700 1 -- start start 2023-10-06T03:01:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f075346b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f074c159480 0x7f074c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f075346b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c0b3610 0x7f074c0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f075346b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f074c0cc1b0 0x7f074c0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f075346b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c0cb7e0 con 0x7f074c159480 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f075346b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c0b08a0 con 0x7f074c0cc1b0 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f075346b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0cb190 con 0x7f074c0b3610 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f0752469700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f074c159480 0x7f074c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f0752469700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f074c159480 0x7f074c0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54348/0 (socket says 172.21.15.84:54348) 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f0752469700 1 -- 172.21.15.84:0/3664449397 learned_addr learned my addr 172.21.15.84:0/3664449397 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f0752c6a700 1 --2- 172.21.15.84:0/3664449397 >> v2:172.21.15.131:3300/0 conn(0x7f074c0cc1b0 0x7f074c0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.862+0000 7f0751c68700 1 --2- 172.21.15.84:0/3664449397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c0b3610 0x7f074c0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0752469700 1 -- 172.21.15.84:0/3664449397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c0b3610 msgr2=0x7f074c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0752469700 1 --2- 172.21.15.84:0/3664449397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c0b3610 0x7f074c0cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0752469700 1 -- 172.21.15.84:0/3664449397 >> v2:172.21.15.131:3300/0 conn(0x7f074c0cc1b0 msgr2=0x7f074c0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0752469700 1 --2- 172.21.15.84:0/3664449397 >> v2:172.21.15.131:3300/0 conn(0x7f074c0cc1b0 0x7f074c0b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0752469700 1 -- 172.21.15.84:0/3664449397 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0cb470 con 0x7f074c159480 2023-10-06T03:01:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0752c6a700 1 --2- 172.21.15.84:0/3664449397 >> v2:172.21.15.131:3300/0 conn(0x7f074c0cc1b0 0x7f074c0b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0752469700 1 --2- 172.21.15.84:0/3664449397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c159480 0x7f074c0b30d0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f074c15cf30 tx=0x7f073c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568615f41fff93e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0751467700 1 -- 172.21.15.84:0/3664449397 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00e070 con 0x7f074c159480 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0751467700 1 -- 172.21.15.84:0/3664449397 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c00ba50 con 0x7f074c159480 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f0751467700 1 -- 172.21.15.84:0/3664449397 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0092e0 con 0x7f074c159480 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f075346b700 1 -- 172.21.15.84:0/3664449397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c159480 msgr2=0x7f074c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.863+0000 7f075346b700 1 --2- 172.21.15.84:0/3664449397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c159480 0x7f074c0b30d0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f074c15cf30 tx=0x7f073c009840 comp rx=0 tx=0).stop 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.864+0000 7f075346b700 1 -- 172.21.15.84:0/3664449397 shutdown_connections 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.864+0000 7f075346b700 1 --2- 172.21.15.84:0/3664449397 >> v2:172.21.15.131:3300/0 conn(0x7f074c0cc1b0 0x7f074c0b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.864+0000 7f075346b700 1 --2- 172.21.15.84:0/3664449397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c159480 0x7f074c0b30d0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.864+0000 7f075346b700 1 --2- 172.21.15.84:0/3664449397 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c0b3610 0x7f074c0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.864+0000 7f075346b700 1 -- 172.21.15.84:0/3664449397 >> 172.21.15.84:0/3664449397 conn(0x7f074c06ed20 msgr2=0x7f074c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.864+0000 7f075346b700 1 -- 172.21.15.84:0/3664449397 shutdown_connections 2023-10-06T03:01:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.864+0000 7f075346b700 1 -- 172.21.15.84:0/3664449397 wait complete. 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f075346b700 1 Processor -- start 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f075346b700 1 -- start start 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f075346b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c0b3610 0x7f074c0afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f075346b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f074c0cc1b0 0x7f074c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f075346b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c159480 0x7f074c0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f075346b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0d0b10 con 0x7f074c0b3610 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f075346b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c4e90 con 0x7f074c0cc1b0 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f075346b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c5170 con 0x7f074c159480 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f0752469700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c0b3610 0x7f074c0afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f0752469700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c0b3610 0x7f074c0afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54362/0 (socket says 172.21.15.84:54362) 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.865+0000 7f0752469700 1 -- 172.21.15.84:0/2192074569 learned_addr learned my addr 172.21.15.84:0/2192074569 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f0752c6a700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c159480 0x7f074c0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f0751c68700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f074c0cc1b0 0x7f074c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f0752469700 1 -- 172.21.15.84:0/2192074569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c159480 msgr2=0x7f074c0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f0752469700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c159480 0x7f074c0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f0752469700 1 -- 172.21.15.84:0/2192074569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f074c0cc1b0 msgr2=0x7f074c151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f0752469700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f074c0cc1b0 0x7f074c151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f0752469700 1 -- 172.21.15.84:0/2192074569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c009ae0 con 0x7f074c0b3610 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f0752469700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c0b3610 0x7f074c0afec0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f074c069190 tx=0x7f073c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f074a7fc700 1 -- 172.21.15.84:0/2192074569 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c0078f0 con 0x7f074c0b3610 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f074a7fc700 1 -- 172.21.15.84:0/2192074569 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c007a90 con 0x7f074c0b3610 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c0c5450 con 0x7f074c0b3610 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f074a7fc700 1 -- 172.21.15.84:0/2192074569 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c007e50 con 0x7f074c0b3610 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.866+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c0c5a10 con 0x7f074c0b3610 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.867+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c05f270 con 0x7f074c0b3610 2023-10-06T03:01:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.867+0000 7f074a7fc700 1 -- 172.21.15.84:0/2192074569 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f073c003040 con 0x7f074c0b3610 2023-10-06T03:01:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.868+0000 7f074a7fc700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0738066f30 0x7f07380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.868+0000 7f074a7fc700 1 -- 172.21.15.84:0/2192074569 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f073c085d80 con 0x7f074c0b3610 2023-10-06T03:01:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.868+0000 7f0751c68700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0738066f30 0x7f07380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.868+0000 7f0751c68700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0738066f30 0x7f07380693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0740006fd0 tx=0x7f0740008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:34.872+0000 7f074a7fc700 1 -- 172.21.15.84:0/2192074569 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f073c052fa0 con 0x7f074c0b3610 2023-10-06T03:01:35.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.136+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) v1 -- 0x7f074c159850 con 0x7f074c0b3610 2023-10-06T03:01:35.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.734+0000 7f074a7fc700 1 -- 172.21.15.84:0/2192074569 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v335) v1 ==== 168+0+0 (secure 0 0 0) 0x7f073c009940 con 0x7f074c0b3610 2023-10-06T03:01:35.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0738066f30 msgr2=0x7f07380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0738066f30 0x7f07380693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0740006fd0 tx=0x7f0740008040 comp rx=0 tx=0).stop 2023-10-06T03:01:35.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c0b3610 msgr2=0x7f074c0afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c0b3610 0x7f074c0afec0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f074c069190 tx=0x7f073c018000 comp rx=0 tx=0).stop 2023-10-06T03:01:35.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 shutdown_connections 2023-10-06T03:01:35.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0738066f30 0x7f07380693e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f074c159480 0x7f074c0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c0b3610 0x7f074c0afec0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 --2- 172.21.15.84:0/2192074569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f074c0cc1b0 0x7f074c151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 >> 172.21.15.84:0/2192074569 conn(0x7f074c06ed20 msgr2=0x7f074c0b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:35.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 shutdown_connections 2023-10-06T03:01:35.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.736+0000 7f075346b700 1 -- 172.21.15.84:0/2192074569 wait complete. 2023-10-06T03:01:35.751 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:01:35.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.868+0000 7fc5c7ddf700 1 Processor -- start 2023-10-06T03:01:35.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.868+0000 7fc5c7ddf700 1 -- start start 2023-10-06T03:01:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c7ddf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c0159510 0x7fc5c00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c7ddf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5c01598e0 0x7fc5c00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c7ddf700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c00cf350 con 0x7fc5c00ce820 2023-10-06T03:01:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c7ddf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c00cf610 con 0x7fc5c01598e0 2023-10-06T03:01:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c7ddf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c00cf8f0 con 0x7fc5c0159510 2023-10-06T03:01:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c537a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5c01598e0 0x7fc5c00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c537a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5c01598e0 0x7fc5c00cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54370/0 (socket says 172.21.15.84:54370) 2023-10-06T03:01:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c537a700 1 -- 172.21.15.84:0/2743498154 learned_addr learned my addr 172.21.15.84:0/2743498154 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c537a700 1 -- 172.21.15.84:0/2743498154 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c0159510 msgr2=0x7fc5c00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c537a700 1 --2- 172.21.15.84:0/2743498154 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c0159510 0x7fc5c00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c537a700 1 -- 172.21.15.84:0/2743498154 >> v1:172.21.15.131:6789/0 conn(0x7fc5c00ce820 legacy=0x7fc5c00cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c537a700 1 -- 172.21.15.84:0/2743498154 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c00cfbd0 con 0x7fc5c01598e0 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c537a700 1 --2- 172.21.15.84:0/2743498154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 0x7fc5c00cbae0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00099b0 tx=0x7fc5b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687bbf0f068b9ac1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c4b79700 1 -- 172.21.15.84:0/2743498154 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000b820 con 0x7fc5c01598e0 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c4b79700 1 -- 172.21.15.84:0/2743498154 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b000b980 con 0x7fc5c01598e0 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.869+0000 7fc5c4b79700 1 -- 172.21.15.84:0/2743498154 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000bd20 con 0x7fc5c01598e0 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.870+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2743498154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 msgr2=0x7fc5c00cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.870+0000 7fc5c7ddf700 1 --2- 172.21.15.84:0/2743498154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 0x7fc5c00cbae0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00099b0 tx=0x7fc5b0009250 comp rx=0 tx=0).stop 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.870+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2743498154 shutdown_connections 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.870+0000 7fc5c7ddf700 1 --2- 172.21.15.84:0/2743498154 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c0159510 0x7fc5c00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.870+0000 7fc5c7ddf700 1 --2- 172.21.15.84:0/2743498154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 0x7fc5c00cbae0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.870+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2743498154 >> 172.21.15.84:0/2743498154 conn(0x7fc5c0089e90 msgr2=0x7fc5c00997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.870+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2743498154 shutdown_connections 2023-10-06T03:01:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.870+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2743498154 wait complete. 2023-10-06T03:01:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.871+0000 7fc5c7ddf700 1 Processor -- start 2023-10-06T03:01:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.871+0000 7fc5c7ddf700 1 -- start start 2023-10-06T03:01:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c7ddf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c00ce820 0x7fc5c01559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c7ddf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c0159510 0x7fc5c0155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c7ddf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 0x7fc5c015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c7ddf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c0156460 con 0x7fc5c01598e0 2023-10-06T03:01:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c7ddf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c0156ba0 con 0x7fc5c0159510 2023-10-06T03:01:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c7ddf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c016aa30 con 0x7fc5c00ce820 2023-10-06T03:01:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c637c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 0x7fc5c015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c637c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 0x7fc5c015be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54380/0 (socket says 172.21.15.84:54380) 2023-10-06T03:01:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c637c700 1 -- 172.21.15.84:0/2851499488 learned_addr learned my addr 172.21.15.84:0/2851499488 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c5b7b700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c00ce820 0x7fc5c01559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c537a700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c0159510 0x7fc5c0155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c637c700 1 -- 172.21.15.84:0/2851499488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c00ce820 msgr2=0x7fc5c01559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c637c700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c00ce820 0x7fc5c01559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c637c700 1 -- 172.21.15.84:0/2851499488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c0159510 msgr2=0x7fc5c0155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c637c700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c0159510 0x7fc5c0155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c637c700 1 -- 172.21.15.84:0/2851499488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00094f0 con 0x7fc5c01598e0 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c537a700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c0159510 0x7fc5c0155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c637c700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 0x7fc5c015be20 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800b5e0 tx=0x7fc5b8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5b5ffb700 1 -- 172.21.15.84:0/2851499488 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b800f510 con 0x7fc5c01598e0 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5b5ffb700 1 -- 172.21.15.84:0/2851499488 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b800f670 con 0x7fc5c01598e0 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.872+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c016ad10 con 0x7fc5c01598e0 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.873+0000 7fc5b5ffb700 1 -- 172.21.15.84:0/2851499488 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b800fa30 con 0x7fc5c01598e0 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.873+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c016b2d0 con 0x7fc5c01598e0 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.874+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c0064ad0 con 0x7fc5c01598e0 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.874+0000 7fc5b5ffb700 1 -- 172.21.15.84:0/2851499488 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5b801a400 con 0x7fc5c01598e0 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.874+0000 7fc5b5ffb700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5a4066f30 0x7fc5a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.874+0000 7fc5b5ffb700 1 -- 172.21.15.84:0/2851499488 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fc5b8083f70 con 0x7fc5c01598e0 2023-10-06T03:01:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.874+0000 7fc5c5b7b700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5a4066f30 0x7fc5a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.875+0000 7fc5c5b7b700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5a4066f30 0x7fc5a40693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc007580 tx=0x7fc5bc009780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:35.878+0000 7fc5b5ffb700 1 -- 172.21.15.84:0/2851499488 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5b8051210 con 0x7fc5c01598e0 2023-10-06T03:01:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.063+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc5c00cfeb0 con 0x7fc5c01598e0 2023-10-06T03:01:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.067+0000 7fc5b5ffb700 1 -- 172.21.15.84:0/2851499488 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc5b8058e60 con 0x7fc5c01598e0 2023-10-06T03:01:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5a4066f30 msgr2=0x7fc5a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5a4066f30 0x7fc5a40693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc007580 tx=0x7fc5bc009780 comp rx=0 tx=0).stop 2023-10-06T03:01:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 msgr2=0x7fc5c015be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 0x7fc5c015be20 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800b5e0 tx=0x7fc5b8009120 comp rx=0 tx=0).stop 2023-10-06T03:01:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 shutdown_connections 2023-10-06T03:01:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc5a4066f30 0x7fc5a40693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c01598e0 0x7fc5c015be20 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5c00ce820 0x7fc5c01559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 --2- 172.21.15.84:0/2851499488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5c0159510 0x7fc5c0155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 >> 172.21.15.84:0/2851499488 conn(0x7fc5c0089e90 msgr2=0x7fc5c00c6130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:36.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 shutdown_connections 2023-10-06T03:01:36.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.069+0000 7fc5c7ddf700 1 -- 172.21.15.84:0/2851499488 wait complete. 2023-10-06T03:01:36.083 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:01:36.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:01:36.115 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:01:36.160 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:01:36.160 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:01:36.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:36.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.273+0000 7fb912838700 1 Processor -- start 2023-10-06T03:01:36.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.273+0000 7fb912838700 1 -- start start 2023-10-06T03:01:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.274+0000 7fb912838700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb90c0cbc70 0x7fb90c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.274+0000 7fb912838700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 0x7fb90c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.274+0000 7fb912838700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c0cb7e0 con 0x7fb90c159480 2023-10-06T03:01:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.274+0000 7fb912838700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90c0b08a0 con 0x7fb90c0cbc70 2023-10-06T03:01:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.274+0000 7fb912838700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0cb190 con 0x7fb90c0b2140 2023-10-06T03:01:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.274+0000 7fb911035700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb90c0cbc70 0x7fb90c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.274+0000 7fb912037700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 0x7fb90c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.274+0000 7fb911836700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb90c159480 0x7fb90c0b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:35576/0 (socket says 172.21.15.84:35576) 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.274+0000 7fb911836700 1 -- 172.21.15.84:0/3077164327 learned_addr learned my addr 172.21.15.84:0/3077164327 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb910834700 1 -- 172.21.15.84:0/3077164327 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782358563 0 0) 0x7fb90c0cb7e0 con 0x7fb90c159480 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb910834700 1 -- 172.21.15.84:0/3077164327 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f4003570 con 0x7fb90c159480 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb912037700 1 -- 172.21.15.84:0/3077164327 >> v2:172.21.15.131:3300/0 conn(0x7fb90c0cbc70 msgr2=0x7fb90c0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb912037700 1 --2- 172.21.15.84:0/3077164327 >> v2:172.21.15.131:3300/0 conn(0x7fb90c0cbc70 0x7fb90c0cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb912037700 1 -- 172.21.15.84:0/3077164327 >> v1:172.21.15.131:6789/0 conn(0x7fb90c159480 legacy=0x7fb90c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb912037700 1 -- 172.21.15.84:0/3077164327 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0cb470 con 0x7fb90c0b2140 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb911035700 1 --2- 172.21.15.84:0/3077164327 >> v2:172.21.15.131:3300/0 conn(0x7fb90c0cbc70 0x7fb90c0cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb912037700 1 --2- 172.21.15.84:0/3077164327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 0x7fb90c0b25a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0098e0 tx=0x7fb8fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd620ca7ead47003 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:36.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb910834700 1 -- 172.21.15.84:0/3077164327 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc011630 con 0x7fb90c0b2140 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb910834700 1 -- 172.21.15.84:0/3077164327 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc011790 con 0x7fb90c0b2140 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb910834700 1 -- 172.21.15.84:0/3077164327 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc011b10 con 0x7fb90c0b2140 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb912838700 1 -- 172.21.15.84:0/3077164327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 msgr2=0x7fb90c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.275+0000 7fb912838700 1 --2- 172.21.15.84:0/3077164327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 0x7fb90c0b25a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0098e0 tx=0x7fb8fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.276+0000 7fb912838700 1 -- 172.21.15.84:0/3077164327 shutdown_connections 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.276+0000 7fb912838700 1 --2- 172.21.15.84:0/3077164327 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 0x7fb90c0b25a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.276+0000 7fb912838700 1 --2- 172.21.15.84:0/3077164327 >> v2:172.21.15.131:3300/0 conn(0x7fb90c0cbc70 0x7fb90c0cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.276+0000 7fb912838700 1 -- 172.21.15.84:0/3077164327 >> 172.21.15.84:0/3077164327 conn(0x7fb90c06ed20 msgr2=0x7fb90c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.276+0000 7fb912838700 1 -- 172.21.15.84:0/3077164327 shutdown_connections 2023-10-06T03:01:36.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.276+0000 7fb912838700 1 -- 172.21.15.84:0/3077164327 wait complete. 2023-10-06T03:01:36.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.277+0000 7fb912838700 1 Processor -- start 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.277+0000 7fb912838700 1 -- start start 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.277+0000 7fb912838700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 0x7fb90c155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.277+0000 7fb912838700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb90c0cbc70 0x7fb90c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.277+0000 7fb912838700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb90c159480 0x7fb90c15bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.277+0000 7fb912838700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c15ddc0 con 0x7fb90c0cbc70 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.277+0000 7fb912838700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c15c0d0 con 0x7fb90c159480 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.277+0000 7fb912838700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0c6520 con 0x7fb90c0b2140 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911035700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb90c0cbc70 0x7fb90c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911035700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb90c0cbc70 0x7fb90c15b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54394/0 (socket says 172.21.15.84:54394) 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911035700 1 -- 172.21.15.84:0/2435241863 learned_addr learned my addr 172.21.15.84:0/2435241863 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:36.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb912037700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb90c159480 0x7fb90c15bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911836700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 0x7fb90c155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911035700 1 -- 172.21.15.84:0/2435241863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 msgr2=0x7fb90c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911035700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 0x7fb90c155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911035700 1 -- 172.21.15.84:0/2435241863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb90c159480 msgr2=0x7fb90c15bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911035700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb90c159480 0x7fb90c15bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911035700 1 -- 172.21.15.84:0/2435241863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb900009420 con 0x7fb90c0cbc70 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb911035700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb90c0cbc70 0x7fb90c15b650 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fb90000ec80 tx=0x7fb9000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb909ffb700 1 -- 172.21.15.84:0/2435241863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90000c920 con 0x7fb90c0cbc70 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb909ffb700 1 -- 172.21.15.84:0/2435241863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90000ca80 con 0x7fb90c0cbc70 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8fc009420 con 0x7fb90c0cbc70 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb909ffb700 1 -- 172.21.15.84:0/2435241863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90000ce00 con 0x7fb90c0cbc70 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.278+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c15d7f0 con 0x7fb90c0cbc70 2023-10-06T03:01:36.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.279+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90c15db70 con 0x7fb90c0cbc70 2023-10-06T03:01:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.280+0000 7fb909ffb700 1 -- 172.21.15.84:0/2435241863 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb900013680 con 0x7fb90c0cbc70 2023-10-06T03:01:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.280+0000 7fb909ffb700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb8f8066f30 0x7fb8f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.280+0000 7fb909ffb700 1 -- 172.21.15.84:0/2435241863 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fb900084960 con 0x7fb90c0cbc70 2023-10-06T03:01:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.280+0000 7fb911836700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb8f8066f30 0x7fb8f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.280+0000 7fb911836700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb8f8066f30 0x7fb8f80693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb904002250 tx=0x7fb904009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:36.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.284+0000 7fb909ffb700 1 -- 172.21.15.84:0/2435241863 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb900051b80 con 0x7fb90c0cbc70 2023-10-06T03:01:36.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.510+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb90c05f270 con 0x7fb90c0cbc70 2023-10-06T03:01:36.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.511+0000 7fb909ffb700 1 -- 172.21.15.84:0/2435241863 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fb900017de0 con 0x7fb90c0cbc70 2023-10-06T03:01:36.512 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:36.512 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":95,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3077946037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3077946037},{"type":"v1","addr":"172.21.15.84:6837","nonce":3077946037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6728,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/849533166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":849533166},{"type":"v1","addr":"172.21.15.131:6834","nonce":849533166}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":95},{"gid":7387,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1043363277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":1043363277},{"type":"v1","addr":"172.21.15.131:6835","nonce":1043363277}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":95},{"gid":8472,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2432942565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2432942565},{"type":"v1","addr":"172.21.15.84:6836","nonce":2432942565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":95}],"filesystems":[]} 2023-10-06T03:01:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb8f8066f30 msgr2=0x7fb8f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb8f8066f30 0x7fb8f80693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb904002250 tx=0x7fb904009040 comp rx=0 tx=0).stop 2023-10-06T03:01:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb90c0cbc70 msgr2=0x7fb90c15b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb90c0cbc70 0x7fb90c15b650 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fb90000ec80 tx=0x7fb9000091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 shutdown_connections 2023-10-06T03:01:36.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb8f8066f30 0x7fb8f80693e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb90c159480 0x7fb90c15bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb90c0b2140 0x7fb90c155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 --2- 172.21.15.84:0/2435241863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb90c0cbc70 0x7fb90c15b650 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 >> 172.21.15.84:0/2435241863 conn(0x7fb90c06ed20 msgr2=0x7fb90c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 shutdown_connections 2023-10-06T03:01:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.513+0000 7fb912838700 1 -- 172.21.15.84:0/2435241863 wait complete. 2023-10-06T03:01:36.516 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 95 2023-10-06T03:01:36.527 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:01:36.527 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:01:36.527 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:01:36.527 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:36.527 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:01:36.527 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:01:36.527 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:01:36.528 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:36.528 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:01:36.528 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:01:36.528 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:01:36.528 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:36.528 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:01:36.528 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:01:36.529 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:01:36.529 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:36.535 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:01:36.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:01:36.536 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:01:36.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:01:36.540 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:01:36.540 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:01:36.541 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:01:36.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:01:36.577 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:01:36.578 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:36.578 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:01:36.578 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:36.582 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:01:36.582 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:36.583 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:01:36.583 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:36.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:01:36.651 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:01:36.651 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:01:36.665 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2023-10-06T03:01:36.665 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:01:36.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.703+0000 7fda0eb53700 1 Processor -- start 2023-10-06T03:01:36.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.703+0000 7fda0eb53700 1 -- start start 2023-10-06T03:01:36.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0eb53700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fda081595a0 0x7fda080aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0eb53700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 0x7fda080aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0eb53700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda080b0ca0 con 0x7fda080b07a0 2023-10-06T03:01:36.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0eb53700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda080b0f80 con 0x7fda081595a0 2023-10-06T03:01:36.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0eb53700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda080b1260 con 0x7fda080b49e0 2023-10-06T03:01:36.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda07fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 0x7fda080aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0c8ef700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fda081595a0 0x7fda080aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0d0f0700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fda080b07a0 0x7fda080b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:35586/0 (socket says 172.21.15.84:35586) 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0d0f0700 1 -- 172.21.15.84:0/2260215650 learned_addr learned my addr 172.21.15.84:0/2260215650 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda077fe700 1 -- 172.21.15.84:0/2260215650 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703274493 0 0) 0x7fda080b0ca0 con 0x7fda080b07a0 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda077fe700 1 -- 172.21.15.84:0/2260215650 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f8003570 con 0x7fda080b07a0 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0c8ef700 1 -- 172.21.15.84:0/2260215650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 msgr2=0x7fda080aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0c8ef700 1 --2- 172.21.15.84:0/2260215650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 0x7fda080aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.704+0000 7fda0c8ef700 1 -- 172.21.15.84:0/2260215650 >> v1:172.21.15.131:6789/0 conn(0x7fda080b07a0 legacy=0x7fda080b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0c8ef700 1 -- 172.21.15.84:0/2260215650 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080b1540 con 0x7fda081595a0 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda07fff700 1 --2- 172.21.15.84:0/2260215650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 0x7fda080aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0c8ef700 1 --2- 172.21.15.84:0/2260215650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda081595a0 0x7fda080aa570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0098d0 tx=0x7fd9fc009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1612187aa3c21b33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda077fe700 1 -- 172.21.15.84:0/2260215650 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc005c10 con 0x7fda081595a0 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda077fe700 1 -- 172.21.15.84:0/2260215650 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc005d70 con 0x7fda081595a0 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda077fe700 1 -- 172.21.15.84:0/2260215650 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc006260 con 0x7fda081595a0 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0eb53700 1 -- 172.21.15.84:0/2260215650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda081595a0 msgr2=0x7fda080aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0eb53700 1 --2- 172.21.15.84:0/2260215650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda081595a0 0x7fda080aa570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0098d0 tx=0x7fd9fc009120 comp rx=0 tx=0).stop 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0eb53700 1 -- 172.21.15.84:0/2260215650 shutdown_connections 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0eb53700 1 --2- 172.21.15.84:0/2260215650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda081595a0 0x7fda080aa570 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0eb53700 1 --2- 172.21.15.84:0/2260215650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 0x7fda080aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0eb53700 1 -- 172.21.15.84:0/2260215650 >> 172.21.15.84:0/2260215650 conn(0x7fda08099830 msgr2=0x7fda0806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0eb53700 1 -- 172.21.15.84:0/2260215650 shutdown_connections 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.705+0000 7fda0eb53700 1 -- 172.21.15.84:0/2260215650 wait complete. 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.706+0000 7fda0eb53700 1 Processor -- start 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.707+0000 7fda0eb53700 1 -- start start 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.707+0000 7fda0eb53700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda080b07a0 0x7fda0815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.707+0000 7fda0eb53700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 0x7fda0809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.707+0000 7fda0eb53700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda081595a0 0x7fda0809b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.707+0000 7fda0eb53700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809b280 con 0x7fda081595a0 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.707+0000 7fda0eb53700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809d680 con 0x7fda080b07a0 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.707+0000 7fda0eb53700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809d920 con 0x7fda080b49e0 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0d0f0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda081595a0 0x7fda0809b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda07fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 0x7fda0809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0d0f0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda081595a0 0x7fda0809b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54416/0 (socket says 172.21.15.84:54416) 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0c8ef700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda080b07a0 0x7fda0815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0d0f0700 1 -- 172.21.15.84:0/2012827434 learned_addr learned my addr 172.21.15.84:0/2012827434 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0c8ef700 1 -- 172.21.15.84:0/2012827434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 msgr2=0x7fda0809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0c8ef700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 0x7fda0809aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0c8ef700 1 -- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda081595a0 msgr2=0x7fda0809b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0c8ef700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda081595a0 0x7fda0809b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0c8ef700 1 -- 172.21.15.84:0/2012827434 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4009420 con 0x7fda080b07a0 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0d0f0700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda081595a0 0x7fda0809b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0c8ef700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda080b07a0 0x7fda0815ba70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda080d04a0 tx=0x7fd9fc016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:36.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda04ff9700 1 -- 172.21.15.84:0/2012827434 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc01d6b0 con 0x7fda080b07a0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda04ff9700 1 -- 172.21.15.84:0/2012827434 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc01d830 con 0x7fda080b07a0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc0093c0 con 0x7fda080b07a0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda04ff9700 1 -- 172.21.15.84:0/2012827434 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc01dbf0 con 0x7fda080b07a0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.708+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda08159a90 con 0x7fda080b07a0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.709+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0809dd00 con 0x7fda080b07a0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.710+0000 7fda04ff9700 1 -- 172.21.15.84:0/2012827434 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9fc01b480 con 0x7fda080b07a0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.710+0000 7fda04ff9700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9ec066f30 0x7fd9ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.710+0000 7fda04ff9700 1 -- 172.21.15.84:0/2012827434 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fd9fc086360 con 0x7fda080b07a0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.710+0000 7fda07fff700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9ec066f30 0x7fd9ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.710+0000 7fda07fff700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9ec066f30 0x7fd9ec0693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fda0815bfd0 tx=0x7fd9f40091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.715+0000 7fda04ff9700 1 -- 172.21.15.84:0/2012827434 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda0809dd00 con 0x7fda080b07a0 2023-10-06T03:01:36.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:36.916+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fda0809dd00 con 0x7fda080b07a0 2023-10-06T03:01:37.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:37.039 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:37.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.756+0000 7fda04ff9700 1 -- 172.21.15.84:0/2012827434 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v102) v1 ==== 97+0+0 (secure 0 0 0) 0x7fda0809dd00 con 0x7fda080b07a0 2023-10-06T03:01:37.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9ec066f30 msgr2=0x7fd9ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:37.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9ec066f30 0x7fd9ec0693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fda0815bfd0 tx=0x7fd9f40091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda080b07a0 msgr2=0x7fda0815ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:37.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda080b07a0 0x7fda0815ba70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda080d04a0 tx=0x7fd9fc016000 comp rx=0 tx=0).stop 2023-10-06T03:01:37.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 shutdown_connections 2023-10-06T03:01:37.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9ec066f30 0x7fd9ec0693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda080b07a0 0x7fda0815ba70 secure :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda080d04a0 tx=0x7fd9fc016000 comp rx=0 tx=0).stop 2023-10-06T03:01:37.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda081595a0 0x7fda0809b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 --2- 172.21.15.84:0/2012827434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda080b49e0 0x7fda0809aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 >> 172.21.15.84:0/2012827434 conn(0x7fda08099830 msgr2=0x7fda08158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:37.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 shutdown_connections 2023-10-06T03:01:37.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.758+0000 7fda0eb53700 1 -- 172.21.15.84:0/2012827434 wait complete. 2023-10-06T03:01:37.761 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-10-06T03:01:37.772 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:01:37.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.885+0000 7faf0ef65700 1 Processor -- start 2023-10-06T03:01:37.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.885+0000 7faf0ef65700 1 -- start start 2023-10-06T03:01:37.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0ef65700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf08159480 0x7faf080b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:37.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0ef65700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080cb7e0 con 0x7faf080b3610 2023-10-06T03:01:37.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0ef65700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080b08a0 con 0x7faf080b2140 2023-10-06T03:01:37.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0ef65700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf080cb190 con 0x7faf08159480 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0d762700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faf080b3610 0x7faf080cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50982/0 (socket says 172.21.15.84:50982) 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0d762700 1 -- 172.21.15.84:0/3840937034 learned_addr learned my addr 172.21.15.84:0/3840937034 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0df63700 1 --2- 172.21.15.84:0/3840937034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf08159480 0x7faf080b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0cf61700 1 -- 172.21.15.84:0/3840937034 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689686682 0 0) 0x7faf080cb7e0 con 0x7faf080b3610 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0cf61700 1 -- 172.21.15.84:0/3840937034 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef4003570 con 0x7faf080b3610 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.886+0000 7faf0cf61700 1 -- 172.21.15.84:0/3840937034 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609017865 0 0) 0x7faf080b08a0 con 0x7faf080b2140 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0cf61700 1 -- 172.21.15.84:0/3840937034 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf080cb7e0 con 0x7faf080b2140 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0cf61700 1 -- 172.21.15.84:0/3840937034 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3044196452 0 0) 0x7faef4003570 con 0x7faf080b3610 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0df63700 1 -- 172.21.15.84:0/3840937034 >> v1:172.21.15.131:6789/0 conn(0x7faf080b2140 legacy=0x7faf080b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0df63700 1 -- 172.21.15.84:0/3840937034 >> v1:172.21.15.84:6789/0 conn(0x7faf080b3610 legacy=0x7faf080cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0df63700 1 -- 172.21.15.84:0/3840937034 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080cb470 con 0x7faf08159480 2023-10-06T03:01:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0df63700 1 --2- 172.21.15.84:0/3840937034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf08159480 0x7faf080b30d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf00009e90 tx=0x7faf00009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71e789ce68743e46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0cf61700 1 -- 172.21.15.84:0/3840937034 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000e070 con 0x7faf08159480 2023-10-06T03:01:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0cf61700 1 -- 172.21.15.84:0/3840937034 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000b870 con 0x7faf08159480 2023-10-06T03:01:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0cf61700 1 -- 172.21.15.84:0/3840937034 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8001470 con 0x7faf08159480 2023-10-06T03:01:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0ef65700 1 -- 172.21.15.84:0/3840937034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf08159480 msgr2=0x7faf080b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.887+0000 7faf0ef65700 1 --2- 172.21.15.84:0/3840937034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf08159480 0x7faf080b30d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faf00009e90 tx=0x7faf00009780 comp rx=0 tx=0).stop 2023-10-06T03:01:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.888+0000 7faf0ef65700 1 -- 172.21.15.84:0/3840937034 shutdown_connections 2023-10-06T03:01:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.888+0000 7faf0ef65700 1 --2- 172.21.15.84:0/3840937034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf08159480 0x7faf080b30d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.888+0000 7faf0ef65700 1 -- 172.21.15.84:0/3840937034 >> 172.21.15.84:0/3840937034 conn(0x7faf0806ed20 msgr2=0x7faf0806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:37.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.888+0000 7faf0ef65700 1 -- 172.21.15.84:0/3840937034 shutdown_connections 2023-10-06T03:01:37.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.888+0000 7faf0ef65700 1 -- 172.21.15.84:0/3840937034 wait complete. 2023-10-06T03:01:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.889+0000 7faf0ef65700 1 Processor -- start 2023-10-06T03:01:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.889+0000 7faf0ef65700 1 -- start start 2023-10-06T03:01:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.889+0000 7faf0ef65700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf080b2140 0x7faf08153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.889+0000 7faf0ef65700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf080b3610 0x7faf0815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.889+0000 7faf0ef65700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf08159480 0x7faf080ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.889+0000 7faf0ef65700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0816cd20 con 0x7faf08159480 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.889+0000 7faf0ef65700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0816d550 con 0x7faf080b3610 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.889+0000 7faf0ef65700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0815af50 con 0x7faf080b2140 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0e764700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf08159480 0x7faf080ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0df63700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf080b2140 0x7faf08153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0e764700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf08159480 0x7faf080ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54428/0 (socket says 172.21.15.84:54428) 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0e764700 1 -- 172.21.15.84:0/1706705657 learned_addr learned my addr 172.21.15.84:0/1706705657 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0d762700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf080b3610 0x7faf0815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0e764700 1 -- 172.21.15.84:0/1706705657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf080b2140 msgr2=0x7faf08153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0e764700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf080b2140 0x7faf08153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0e764700 1 -- 172.21.15.84:0/1706705657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf080b3610 msgr2=0x7faf0815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0e764700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf080b3610 0x7faf0815a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0e764700 1 -- 172.21.15.84:0/1706705657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00009a20 con 0x7faf08159480 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0e764700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf08159480 0x7faf080ccc40 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7faf0400c5c0 tx=0x7faf04007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faefdffb700 1 -- 172.21.15.84:0/1706705657 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04016070 con 0x7faf08159480 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faefdffb700 1 -- 172.21.15.84:0/1706705657 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf04011590 con 0x7faf08159480 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0816cf00 con 0x7faf08159480 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faefdffb700 1 -- 172.21.15.84:0/1706705657 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04011970 con 0x7faf08159480 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.890+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf08153c10 con 0x7faf08159480 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.891+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0816d6e0 con 0x7faf08159480 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.892+0000 7faefdffb700 1 -- 172.21.15.84:0/1706705657 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf04012420 con 0x7faf08159480 2023-10-06T03:01:37.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.892+0000 7faefdffb700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faeec066f30 0x7faeec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:37.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.892+0000 7faefdffb700 1 -- 172.21.15.84:0/1706705657 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5526+0+0 (secure 0 0 0) 0x7faf04083f40 con 0x7faf08159480 2023-10-06T03:01:37.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.892+0000 7faf0df63700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faeec066f30 0x7faeec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:37.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.892+0000 7faf0df63700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faeec066f30 0x7faeec0693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7faf00009de0 tx=0x7faf00017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:37.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:37.896+0000 7faefdffb700 1 -- 172.21.15.84:0/1706705657 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf04051260 con 0x7faf08159480 2023-10-06T03:01:38.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.149+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faf0805f270 con 0x7faf08159480 2023-10-06T03:01:38.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.150+0000 7faefdffb700 1 -- 172.21.15.84:0/1706705657 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7faf04054880 con 0x7faf08159480 2023-10-06T03:01:38.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:38.152 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:38.152 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-10-06T03:01:38.152 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.152 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-10-06T03:01:38.153 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lFrNmJBAAeVhw9betN9snqLPgSK9efw==", 2023-10-06T03:01:38.153 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.153 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:01:38.153 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:01:38.153 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:01:38.153 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lbi6hLxAAICzxeAsbJ5rhbyMBkPcrAQ==", 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:01:38.154 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lSCo1KxAAuETY4PeWDJS3bGzqTpHLpQ==", 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lvPxyNhAAKlqBTG/Fr8/2Rf+lcGQxIg==", 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.157 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.157 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-10-06T03:01:38.157 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDUdh9lV3sRIRAAoUtG7F6EMyew6CX3NaNufw==", 2023-10-06T03:01:38.157 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.157 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:38.157 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:01:38.157 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.157 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDXdh9ls5OxHhAAanGTRmjW75UAwrqzL0CIdw==", 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.158 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDadh9lQeJTHhAAFeayQY1F10UDCck78/ja4w==", 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDddh9l+cx8HhAAeAcoLzCUiCC+9O+WZYYTsA==", 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.159 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDjdh9lA4upJxAAdFHhR2/rMyG2NbQEu7JpLw==", 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDmdh9lOGETJRAA7nLtgcumxqfum8cirnbaRA==", 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-10-06T03:01:38.161 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDpdh9lSbDhJBAAnMWhjKSKYcLaZeRk9drdgA==", 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDsdh9lImOeIhAAPUO3jy2/cPZW+eKukBywcw==", 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.162 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lRRw/OhAAwavsq3e0HeVF3/G4SX0v+A==", 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-10-06T03:01:38.163 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lftv/BhAAo8sb1EG96nHv77bn3af/dg==", 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:01:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lxOX6AxAAWDpHCodRcEc2/YF5yqnkQg==", 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:01:38.165 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDRdh9lheJnDBAAqAQeFxMQ9Qv108TLz65mVw==", 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.167 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.167 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-10-06T03:01:38.167 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9l8qZuCBAArPoeoGgydlQPFp7XYwI9KQ==", 2023-10-06T03:01:38.167 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.167 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:01:38.167 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-10-06T03:01:38.167 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-10-06T03:01:38.168 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.168 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.168 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-10-06T03:01:38.168 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9ly2pdIRAAX7YmT9B/MzoD8xJH347ruQ==", 2023-10-06T03:01:38.169 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.169 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:01:38.169 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:01:38.169 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.169 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:38.169 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:38.170 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-10-06T03:01:38.170 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQdh9lW/KSHBAAEvgj/BAe20tCp8uwBEIVbA==", 2023-10-06T03:01:38.170 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-10-06T03:01:38.170 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-10-06T03:01:38.170 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-10-06T03:01:38.170 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-10-06T03:01:38.171 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.171 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:38.171 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-10-06T03:01:38.171 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faeec066f30 msgr2=0x7faeec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faeec066f30 0x7faeec0693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7faf00009de0 tx=0x7faf00017000 comp rx=0 tx=0).stop 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf08159480 msgr2=0x7faf080ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf08159480 0x7faf080ccc40 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7faf0400c5c0 tx=0x7faf04007d80 comp rx=0 tx=0).stop 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 shutdown_connections 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faeec066f30 0x7faeec0693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf08159480 0x7faf080ccc40 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faf080b2140 0x7faf08153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 --2- 172.21.15.84:0/1706705657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf080b3610 0x7faf0815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 >> 172.21.15.84:0/1706705657 conn(0x7faf0806ed20 msgr2=0x7faf08154830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:38.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 shutdown_connections 2023-10-06T03:01:38.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.152+0000 7faf0ef65700 1 -- 172.21.15.84:0/1706705657 wait complete. 2023-10-06T03:01:38.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:38.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.286+0000 7f0bd4187700 1 Processor -- start 2023-10-06T03:01:38.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.286+0000 7f0bd4187700 1 -- start start 2023-10-06T03:01:38.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.287+0000 7f0bd4187700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bcc0b49e0 0x7f0bcc0aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.287+0000 7f0bd4187700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0bcc0b07a0 0x7f0bcc0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.287+0000 7f0bd4187700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0b0ca0 con 0x7f0bcc1595a0 2023-10-06T03:01:38.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.287+0000 7f0bd4187700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b0f80 con 0x7f0bcc0b49e0 2023-10-06T03:01:38.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.287+0000 7f0bd4187700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b1260 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.287+0000 7f0bd1722700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bcc0b49e0 0x7f0bcc0aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.287+0000 7f0bd1722700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0bcc0b49e0 0x7f0bcc0aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54430/0 (socket says 172.21.15.84:54430) 2023-10-06T03:01:38.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.287+0000 7f0bd1722700 1 -- 172.21.15.84:0/3195683501 learned_addr learned my addr 172.21.15.84:0/3195683501 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:38.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.287+0000 7f0bd2724700 1 --2- 172.21.15.84:0/3195683501 >> v2:172.21.15.131:3300/0 conn(0x7f0bcc0b07a0 0x7f0bcc0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd1722700 1 -- 172.21.15.84:0/3195683501 >> v2:172.21.15.131:3300/0 conn(0x7f0bcc0b07a0 msgr2=0x7f0bcc0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd1722700 1 --2- 172.21.15.84:0/3195683501 >> v2:172.21.15.131:3300/0 conn(0x7f0bcc0b07a0 0x7f0bcc0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd1722700 1 -- 172.21.15.84:0/3195683501 >> v1:172.21.15.131:6789/0 conn(0x7f0bcc1595a0 legacy=0x7f0bcc0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd1722700 1 -- 172.21.15.84:0/3195683501 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0b1540 con 0x7f0bcc0b49e0 2023-10-06T03:01:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd1722700 1 --2- 172.21.15.84:0/3195683501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b49e0 0x7f0bcc0aac80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00099b0 tx=0x7f0bc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b7ab711bd4c2ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd0f21700 1 -- 172.21.15.84:0/3195683501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0009ea0 con 0x7f0bcc0b49e0 2023-10-06T03:01:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd0f21700 1 -- 172.21.15.84:0/3195683501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc000b820 con 0x7f0bcc0b49e0 2023-10-06T03:01:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd0f21700 1 -- 172.21.15.84:0/3195683501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000bbc0 con 0x7f0bcc0b49e0 2023-10-06T03:01:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd4187700 1 -- 172.21.15.84:0/3195683501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b49e0 msgr2=0x7f0bcc0aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd4187700 1 --2- 172.21.15.84:0/3195683501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b49e0 0x7f0bcc0aac80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00099b0 tx=0x7f0bc0009250 comp rx=0 tx=0).stop 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd4187700 1 -- 172.21.15.84:0/3195683501 shutdown_connections 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd4187700 1 --2- 172.21.15.84:0/3195683501 >> v2:172.21.15.131:3300/0 conn(0x7f0bcc0b07a0 0x7f0bcc0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd4187700 1 --2- 172.21.15.84:0/3195683501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b49e0 0x7f0bcc0aac80 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.288+0000 7f0bd4187700 1 -- 172.21.15.84:0/3195683501 >> 172.21.15.84:0/3195683501 conn(0x7f0bcc099830 msgr2=0x7f0bcc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.289+0000 7f0bd4187700 1 -- 172.21.15.84:0/3195683501 shutdown_connections 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.289+0000 7f0bd4187700 1 -- 172.21.15.84:0/3195683501 wait complete. 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd4187700 1 Processor -- start 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd4187700 1 -- start start 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd4187700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd4187700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b49e0 0x7f0bcc157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd4187700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc1595a0 0x7f0bcc0b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd4187700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0ac210 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd4187700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc09c380 con 0x7f0bcc0b49e0 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd4187700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc09ae10 con 0x7f0bcc1595a0 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd1f23700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd1f23700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54432/0 (socket says 172.21.15.84:54432) 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.290+0000 7f0bd1f23700 1 -- 172.21.15.84:0/203577689 learned_addr learned my addr 172.21.15.84:0/203577689 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd2724700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc1595a0 0x7f0bcc0b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd1722700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b49e0 0x7f0bcc157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd1f23700 1 -- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc1595a0 msgr2=0x7f0bcc0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd1f23700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc1595a0 0x7f0bcc0b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd1f23700 1 -- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b49e0 msgr2=0x7f0bcc157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd1f23700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b49e0 0x7f0bcc157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd1f23700 1 -- 172.21.15.84:0/203577689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00094f0 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd2724700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc1595a0 0x7f0bcc0b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd1722700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b49e0 0x7f0bcc157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd1f23700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0aef20 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00cd30 tx=0x7f0bbc001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/203577689 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00ab70 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/203577689 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc00acd0 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc09b0f0 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/203577689 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc012670 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.291+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc0abe30 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.292+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc0ad740 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.292+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/203577689 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bbc012a60 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.293+0000 7f0bc9ffb700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bb8066f30 0x7f0bb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.293+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/203577689 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0bbc084be0 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.293+0000 7f0bd1722700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bb8066f30 0x7f0bb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.293+0000 7f0bd1722700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bb8066f30 0x7f0bb80693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc088e20 tx=0x7f0bc0017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.297+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/203577689 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bbc051f00 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.481+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bcc064ad0 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.482+0000 7f0bc9ffb700 1 -- 172.21.15.84:0/203577689 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+13857 (secure 0 0 0) 0x7f0bbc055520 con 0x7f0bcc0b07a0 2023-10-06T03:01:38.483 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:38.484 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":102,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:01:37.749127+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:38.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bb8066f30 msgr2=0x7f0bb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bb8066f30 0x7f0bb80693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc088e20 tx=0x7f0bc0017000 comp rx=0 tx=0).stop 2023-10-06T03:01:38.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b07a0 msgr2=0x7f0bcc0aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0aef20 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00cd30 tx=0x7f0bbc001b40 comp rx=0 tx=0).stop 2023-10-06T03:01:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 shutdown_connections 2023-10-06T03:01:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0bb8066f30 0x7f0bb80693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0bcc1595a0 0x7f0bcc0b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bcc0b07a0 0x7f0bcc0aef20 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 --2- 172.21.15.84:0/203577689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bcc0b49e0 0x7f0bcc157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 >> 172.21.15.84:0/203577689 conn(0x7f0bcc099830 msgr2=0x7f0bcc069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 shutdown_connections 2023-10-06T03:01:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.484+0000 7f0bd4187700 1 -- 172.21.15.84:0/203577689 wait complete. 2023-10-06T03:01:38.498 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:01:38.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:38.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.614+0000 7f1bde01f700 1 Processor -- start 2023-10-06T03:01:38.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.614+0000 7f1bde01f700 1 -- start start 2023-10-06T03:01:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.614+0000 7f1bde01f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8159510 0x7f1bd80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.614+0000 7f1bde01f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1bd80cbae0 0x7f1bd80cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.614+0000 7f1bde01f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd80cbf00 con 0x7f1bd81598e0 2023-10-06T03:01:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.614+0000 7f1bde01f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd80cf610 con 0x7f1bd80cbae0 2023-10-06T03:01:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.614+0000 7f1bde01f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80cf8f0 con 0x7f1bd8159510 2023-10-06T03:01:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1bd81598e0 0x7f1bd80ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50992/0 (socket says 172.21.15.84:50992) 2023-10-06T03:01:38.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd6ffd700 1 -- 172.21.15.84:0/4033030316 learned_addr learned my addr 172.21.15.84:0/4033030316 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294768053 0 0) 0x7f1bd80cbf00 con 0x7f1bd81598e0 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd7fff700 1 --2- 172.21.15.84:0/4033030316 >> v2:172.21.15.131:3300/0 conn(0x7f1bd80cbae0 0x7f1bd80cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd77fe700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8159510 0x7f1bd80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc0003570 con 0x7f1bd81598e0 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1023935511 0 0) 0x7f1bc0003570 con 0x7f1bd81598e0 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8159510 msgr2=0x7f1bd80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8159510 0x7f1bd80cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 >> v2:172.21.15.131:3300/0 conn(0x7f1bd80cbae0 msgr2=0x7f1bd80cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 --2- 172.21.15.84:0/4033030316 >> v2:172.21.15.131:3300/0 conn(0x7f1bd80cbae0 0x7f1bd80cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd80cfbd0 con 0x7f1bd81598e0 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f1bcc001470 con 0x7f1bd81598e0 2023-10-06T03:01:38.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 >> v1:172.21.15.84:6789/0 conn(0x7f1bd81598e0 legacy=0x7f1bd80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc0003a60 0x7f1bc0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8159510 0x7f1bc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0004d50 0x7f1bc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80cf610 con 0x7f1bc0003a60 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80cf8f0 con 0x7f1bc0004d50 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc000ba60 con 0x7f1bd8159510 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd77fe700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc0003a60 0x7f1bc0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd7fff700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0004d50 0x7f1bc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.615+0000 7f1bd6ffd700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8159510 0x7f1bc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd77fe700 1 -- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8159510 msgr2=0x7f1bc0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd77fe700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8159510 0x7f1bc0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd77fe700 1 -- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0004d50 msgr2=0x7f1bc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd77fe700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0004d50 0x7f1bc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd77fe700 1 -- 172.21.15.84:0/4033030316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0003570 con 0x7f1bc0003a60 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd77fe700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc0003a60 0x7f1bc0003e50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009c00 tx=0x7f1bc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2494c613b45de4f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800e6b0 con 0x7f1bc0003a60 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc800e810 con 0x7f1bc0003a60 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd67fc700 1 -- 172.21.15.84:0/4033030316 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800ebd0 con 0x7f1bc0003a60 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bde01f700 1 -- 172.21.15.84:0/4033030316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc0003a60 msgr2=0x7f1bc0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bde01f700 1 --2- 172.21.15.84:0/4033030316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bc0003a60 0x7f1bc0003e50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009c00 tx=0x7f1bc80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bd7fff700 1 -- 172.21.15.84:0/4033030316 reap_dead start 2023-10-06T03:01:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bde01f700 1 -- 172.21.15.84:0/4033030316 shutdown_connections 2023-10-06T03:01:38.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bde01f700 1 -- 172.21.15.84:0/4033030316 >> 172.21.15.84:0/4033030316 conn(0x7f1bd8089e90 msgr2=0x7f1bd80997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:38.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.616+0000 7f1bde01f700 1 -- 172.21.15.84:0/4033030316 shutdown_connections 2023-10-06T03:01:38.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.617+0000 7f1bde01f700 1 -- 172.21.15.84:0/4033030316 wait complete. 2023-10-06T03:01:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.618+0000 7f1bde01f700 1 Processor -- start 2023-10-06T03:01:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.618+0000 7f1bde01f700 1 -- start start 2023-10-06T03:01:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.618+0000 7f1bde01f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0003a60 0x7f1bd816afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bde01f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8155610 0x7f1bd80c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bde01f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bd80c9c90 0x7f1bd816a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bde01f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80ca130 con 0x7f1bd80c9c90 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bde01f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd8157050 con 0x7f1bc0003a60 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bde01f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd81572f0 con 0x7f1bd8155610 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bd80c9c90 0x7f1bd816a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bd80c9c90 0x7f1bd816a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54462/0 (socket says 172.21.15.84:54462) 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd7fff700 1 -- 172.21.15.84:0/2788881384 learned_addr learned my addr 172.21.15.84:0/2788881384 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd77fe700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0003a60 0x7f1bd816afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd6ffd700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8155610 0x7f1bd80c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd7fff700 1 -- 172.21.15.84:0/2788881384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8155610 msgr2=0x7f1bd80c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd7fff700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8155610 0x7f1bd80c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd7fff700 1 -- 172.21.15.84:0/2788881384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0003a60 msgr2=0x7f1bd816afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd7fff700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0003a60 0x7f1bd816afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd7fff700 1 -- 172.21.15.84:0/2788881384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd81575d0 con 0x7f1bd80c9c90 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd77fe700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0003a60 0x7f1bd816afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bd7fff700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bd80c9c90 0x7f1bd816a100 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80c73e0 tx=0x7f1bd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bbf7fe700 1 -- 172.21.15.84:0/2788881384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000e040 con 0x7f1bd80c9c90 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bbf7fe700 1 -- 172.21.15.84:0/2788881384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd000f040 con 0x7f1bd80c9c90 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bbf7fe700 1 -- 172.21.15.84:0/2788881384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000fe20 con 0x7f1bd80c9c90 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd81578b0 con 0x7f1bd80c9c90 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.619+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd8155a80 con 0x7f1bd80c9c90 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.620+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd8064ad0 con 0x7f1bd80c9c90 2023-10-06T03:01:38.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.621+0000 7f1bbf7fe700 1 -- 172.21.15.84:0/2788881384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bd0015640 con 0x7f1bd80c9c90 2023-10-06T03:01:38.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.621+0000 7f1bbf7fe700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1bc4066f30 0x7f1bc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.621+0000 7f1bbf7fe700 1 -- 172.21.15.84:0/2788881384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1bd0084c70 con 0x7f1bd80c9c90 2023-10-06T03:01:38.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.621+0000 7f1bd77fe700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1bc4066f30 0x7f1bc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.621+0000 7f1bd77fe700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1bc4066f30 0x7f1bc40693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80091e0 tx=0x7f1bc801a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.625+0000 7f1bbf7fe700 1 -- 172.21.15.84:0/2788881384 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bd0051f90 con 0x7f1bd80c9c90 2023-10-06T03:01:38.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.811+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1bd80cfeb0 con 0x7f1bd80c9c90 2023-10-06T03:01:38.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.811+0000 7f1bbf7fe700 1 -- 172.21.15.84:0/2788881384 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1bd00555b0 con 0x7f1bd80c9c90 2023-10-06T03:01:38.812 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:01:38.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1bc4066f30 msgr2=0x7f1bc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1bc4066f30 0x7f1bc40693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80091e0 tx=0x7f1bc801a000 comp rx=0 tx=0).stop 2023-10-06T03:01:38.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bd80c9c90 msgr2=0x7f1bd816a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bd80c9c90 0x7f1bd816a100 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80c73e0 tx=0x7f1bd000b040 comp rx=0 tx=0).stop 2023-10-06T03:01:38.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 shutdown_connections 2023-10-06T03:01:38.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1bc4066f30 0x7f1bc40693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bc0003a60 0x7f1bd816afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bd80c9c90 0x7f1bd816a100 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 --2- 172.21.15.84:0/2788881384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1bd8155610 0x7f1bd80c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 >> 172.21.15.84:0/2788881384 conn(0x7f1bd8089e90 msgr2=0x7f1bd80683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:38.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 shutdown_connections 2023-10-06T03:01:38.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.813+0000 7f1bde01f700 1 -- 172.21.15.84:0/2788881384 wait complete. 2023-10-06T03:01:38.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:38.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.942+0000 7f16313f7700 1 Processor -- start 2023-10-06T03:01:38.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.942+0000 7f16313f7700 1 -- start start 2023-10-06T03:01:38.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.943+0000 7f16313f7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f162c0cbcb0 0x7f162c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.943+0000 7f16313f7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0cf610 con 0x7f162c1598e0 2023-10-06T03:01:38.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.943+0000 7f16313f7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c0cf8f0 con 0x7f162c159510 2023-10-06T03:01:38.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.943+0000 7f16313f7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c0cfbd0 con 0x7f162c0cbcb0 2023-10-06T03:01:38.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.943+0000 7f162b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f162c0cbcb0 0x7f162c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.943+0000 7f162a7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f162c1598e0 0x7f162c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50994/0 (socket says 172.21.15.84:50994) 2023-10-06T03:01:38.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.943+0000 7f162a7fc700 1 -- 172.21.15.84:0/901864767 learned_addr learned my addr 172.21.15.84:0/901864767 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:38.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f162b7fe700 1 -- 172.21.15.84:0/901864767 >> v1:172.21.15.131:6789/0 conn(0x7f162c159510 legacy=0x7f162c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f162b7fe700 1 -- 172.21.15.84:0/901864767 >> v1:172.21.15.84:6789/0 conn(0x7f162c1598e0 legacy=0x7f162c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f1629ffb700 1 -- 172.21.15.84:0/901864767 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160654681 0 0) 0x7f162c0cf610 con 0x7f162c1598e0 2023-10-06T03:01:38.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f162b7fe700 1 -- 172.21.15.84:0/901864767 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0cfeb0 con 0x7f162c0cbcb0 2023-10-06T03:01:38.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f162b7fe700 1 --2- 172.21.15.84:0/901864767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c0cbcb0 0x7f162c0cef30 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f16240098e0 tx=0x7f16240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5cdf4f37234b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f1629ffb700 1 -- 172.21.15.84:0/901864767 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624009e80 con 0x7f162c0cbcb0 2023-10-06T03:01:38.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f1629ffb700 1 -- 172.21.15.84:0/901864767 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162400b860 con 0x7f162c0cbcb0 2023-10-06T03:01:38.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f1629ffb700 1 -- 172.21.15.84:0/901864767 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162400bbe0 con 0x7f162c0cbcb0 2023-10-06T03:01:38.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f16313f7700 1 -- 172.21.15.84:0/901864767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c0cbcb0 msgr2=0x7f162c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f16313f7700 1 --2- 172.21.15.84:0/901864767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c0cbcb0 0x7f162c0cef30 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f16240098e0 tx=0x7f16240091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f16313f7700 1 -- 172.21.15.84:0/901864767 shutdown_connections 2023-10-06T03:01:38.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f16313f7700 1 --2- 172.21.15.84:0/901864767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c0cbcb0 0x7f162c0cef30 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f16313f7700 1 -- 172.21.15.84:0/901864767 >> 172.21.15.84:0/901864767 conn(0x7f162c089e90 msgr2=0x7f162c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:38.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f16313f7700 1 -- 172.21.15.84:0/901864767 shutdown_connections 2023-10-06T03:01:38.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.944+0000 7f16313f7700 1 -- 172.21.15.84:0/901864767 wait complete. 2023-10-06T03:01:38.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.946+0000 7f16313f7700 1 Processor -- start 2023-10-06T03:01:38.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.946+0000 7f16313f7700 1 -- start start 2023-10-06T03:01:38.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.946+0000 7f16313f7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f162c0cbcb0 0x7f162c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.946+0000 7f16313f7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f162c159510 0x7f162c14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.946+0000 7f16313f7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c1598e0 0x7f162c14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.946+0000 7f16313f7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c14cbf0 con 0x7f162c1598e0 2023-10-06T03:01:38.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.946+0000 7f16313f7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c14f8f0 con 0x7f162c0cbcb0 2023-10-06T03:01:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.946+0000 7f16313f7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c14aec0 con 0x7f162c159510 2023-10-06T03:01:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.946+0000 7f162b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c1598e0 0x7f162c14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c1598e0 0x7f162c14d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54472/0 (socket says 172.21.15.84:54472) 2023-10-06T03:01:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162b7fe700 1 -- 172.21.15.84:0/144647974 learned_addr learned my addr 172.21.15.84:0/144647974 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162affd700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f162c0cbcb0 0x7f162c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162a7fc700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f162c159510 0x7f162c14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162b7fe700 1 -- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f162c159510 msgr2=0x7f162c14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162b7fe700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f162c159510 0x7f162c14a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162b7fe700 1 -- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f162c0cbcb0 msgr2=0x7f162c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162b7fe700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f162c0cbcb0 0x7f162c14f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162b7fe700 1 -- 172.21.15.84:0/144647974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009420 con 0x7f162c1598e0 2023-10-06T03:01:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162a7fc700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f162c159510 0x7f162c14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162affd700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f162c0cbcb0 0x7f162c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f162b7fe700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c1598e0 0x7f162c14d8e0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f16240093f0 tx=0x7f1624017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f1622ffd700 1 -- 172.21.15.84:0/144647974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162401f070 con 0x7f162c1598e0 2023-10-06T03:01:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f1622ffd700 1 -- 172.21.15.84:0/144647974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162400ba50 con 0x7f162c1598e0 2023-10-06T03:01:38.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c15c980 con 0x7f162c1598e0 2023-10-06T03:01:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f1622ffd700 1 -- 172.21.15.84:0/144647974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624025690 con 0x7f162c1598e0 2023-10-06T03:01:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.947+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c14d0e0 con 0x7f162c1598e0 2023-10-06T03:01:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.948+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c064ad0 con 0x7f162c1598e0 2023-10-06T03:01:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.948+0000 7f1622ffd700 1 -- 172.21.15.84:0/144647974 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1624023070 con 0x7f162c1598e0 2023-10-06T03:01:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.949+0000 7f1622ffd700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.949+0000 7f1622ffd700 1 -- 172.21.15.84:0/144647974 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1624085c00 con 0x7f162c1598e0 2023-10-06T03:01:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.949+0000 7f162affd700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.949+0000 7f162affd700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f160c066f30 0x7f160c0693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f161c007fd0 tx=0x7f161c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:38.953+0000 7f1622ffd700 1 -- 172.21.15.84:0/144647974 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f162408c080 con 0x7f162c1598e0 2023-10-06T03:01:39.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.134+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f162c0c66e0 con 0x7f162c1598e0 2023-10-06T03:01:39.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.135+0000 7f1622ffd700 1 -- 172.21.15.84:0/144647974 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1624052f20 con 0x7f162c1598e0 2023-10-06T03:01:39.136 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:01:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f160c066f30 msgr2=0x7f160c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f160c066f30 0x7f160c0693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f161c007fd0 tx=0x7f161c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c1598e0 msgr2=0x7f162c14d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c1598e0 0x7f162c14d8e0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f16240093f0 tx=0x7f1624017000 comp rx=0 tx=0).stop 2023-10-06T03:01:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 shutdown_connections 2023-10-06T03:01:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f162c0cbcb0 0x7f162c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c1598e0 0x7f162c14d8e0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 --2- 172.21.15.84:0/144647974 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f162c159510 0x7f162c14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 >> 172.21.15.84:0/144647974 conn(0x7f162c089e90 msgr2=0x7f162c14bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:39.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 shutdown_connections 2023-10-06T03:01:39.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.137+0000 7f16313f7700 1 -- 172.21.15.84:0/144647974 wait complete. 2023-10-06T03:01:39.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:01:39.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.263+0000 7f56a96e8700 1 Processor -- start 2023-10-06T03:01:39.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.263+0000 7f56a96e8700 1 -- start start 2023-10-06T03:01:39.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a96e8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56a4159480 0x7f56a40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a96e8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56a40b3610 0x7f56a40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a96e8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a40cb7e0 con 0x7f56a40cc1b0 2023-10-06T03:01:39.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a96e8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a40b08a0 con 0x7f56a4159480 2023-10-06T03:01:39.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a96e8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40cb190 con 0x7f56a40b3610 2023-10-06T03:01:39.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f56a4159480 0x7f56a40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a8ee7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f56a40cc1b0 0x7f56a40b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51008/0 (socket says 172.21.15.84:51008) 2023-10-06T03:01:39.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a8ee7700 1 -- 172.21.15.84:0/2515103095 learned_addr learned my addr 172.21.15.84:0/2515103095 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:39.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a37fe700 1 --2- 172.21.15.84:0/2515103095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56a40b3610 0x7f56a40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a2ffd700 1 -- 172.21.15.84:0/2515103095 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113085884 0 0) 0x7f56a40cb7e0 con 0x7f56a40cc1b0 2023-10-06T03:01:39.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a2ffd700 1 -- 172.21.15.84:0/2515103095 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f568c003570 con 0x7f56a40cc1b0 2023-10-06T03:01:39.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a3fff700 1 -- 172.21.15.84:0/2515103095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56a40b3610 msgr2=0x7f56a40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:39.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a3fff700 1 --2- 172.21.15.84:0/2515103095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56a40b3610 0x7f56a40cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a3fff700 1 -- 172.21.15.84:0/2515103095 >> v1:172.21.15.84:6789/0 conn(0x7f56a40cc1b0 legacy=0x7f56a40b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a3fff700 1 -- 172.21.15.84:0/2515103095 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a40cb470 con 0x7f56a4159480 2023-10-06T03:01:39.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.264+0000 7f56a3fff700 1 --2- 172.21.15.84:0/2515103095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a4159480 0x7f56a40b30d0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f56940098e0 tx=0x7f56940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda8334164dd2bc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:39.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a2ffd700 1 -- 172.21.15.84:0/2515103095 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400b640 con 0x7f56a4159480 2023-10-06T03:01:39.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a2ffd700 1 -- 172.21.15.84:0/2515103095 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400b7a0 con 0x7f56a4159480 2023-10-06T03:01:39.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a2ffd700 1 -- 172.21.15.84:0/2515103095 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400bb40 con 0x7f56a4159480 2023-10-06T03:01:39.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a96e8700 1 -- 172.21.15.84:0/2515103095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a4159480 msgr2=0x7f56a40b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a96e8700 1 --2- 172.21.15.84:0/2515103095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a4159480 0x7f56a40b30d0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f56940098e0 tx=0x7f56940091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a96e8700 1 -- 172.21.15.84:0/2515103095 shutdown_connections 2023-10-06T03:01:39.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a96e8700 1 --2- 172.21.15.84:0/2515103095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a4159480 0x7f56a40b30d0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a96e8700 1 --2- 172.21.15.84:0/2515103095 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56a40b3610 0x7f56a40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a96e8700 1 -- 172.21.15.84:0/2515103095 >> 172.21.15.84:0/2515103095 conn(0x7f56a406ed20 msgr2=0x7f56a406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:39.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a96e8700 1 -- 172.21.15.84:0/2515103095 shutdown_connections 2023-10-06T03:01:39.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.265+0000 7f56a96e8700 1 -- 172.21.15.84:0/2515103095 wait complete. 2023-10-06T03:01:39.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.266+0000 7f56a96e8700 1 Processor -- start 2023-10-06T03:01:39.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.266+0000 7f56a96e8700 1 -- start start 2023-10-06T03:01:39.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a96e8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a40b3610 0x7f56a40c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a96e8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56a40cc1b0 0x7f56a4159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a96e8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a4159480 0x7f56a4169220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a96e8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40c9a30 con 0x7f56a40b3610 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a96e8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a415a010 con 0x7f56a4159480 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a96e8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a415a270 con 0x7f56a40cc1b0 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a40b3610 0x7f56a40c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a40b3610 0x7f56a40c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54494/0 (socket says 172.21.15.84:54494) 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a3fff700 1 -- 172.21.15.84:0/2543445912 learned_addr learned my addr 172.21.15.84:0/2543445912 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a3fff700 1 -- 172.21.15.84:0/2543445912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56a40cc1b0 msgr2=0x7f56a4159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a3fff700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56a40cc1b0 0x7f56a4159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a3fff700 1 -- 172.21.15.84:0/2543445912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a4159480 msgr2=0x7f56a4169220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a3fff700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a4159480 0x7f56a4169220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.267+0000 7f56a3fff700 1 -- 172.21.15.84:0/2543445912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009420 con 0x7f56a40b3610 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.268+0000 7f56a3fff700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a40b3610 0x7f56a40c94f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f56a4069190 tx=0x7f5694017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.268+0000 7f568bfff700 1 -- 172.21.15.84:0/2543445912 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569401bda0 con 0x7f56a40b3610 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.268+0000 7f568bfff700 1 -- 172.21.15.84:0/2543445912 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694011420 con 0x7f56a40b3610 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.268+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a415a550 con 0x7f56a40b3610 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.268+0000 7f568bfff700 1 -- 172.21.15.84:0/2543445912 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940117e0 con 0x7f56a40b3610 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.268+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a415ab10 con 0x7f56a40b3610 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.269+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a40ca9f0 con 0x7f56a40b3610 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.269+0000 7f568bfff700 1 -- 172.21.15.84:0/2543445912 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5694011b90 con 0x7f56a40b3610 2023-10-06T03:01:39.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.269+0000 7f568bfff700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5690066f30 0x7f56900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.270+0000 7f568bfff700 1 -- 172.21.15.84:0/2543445912 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5694085b00 con 0x7f56a40b3610 2023-10-06T03:01:39.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.270+0000 7f56a37fe700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5690066f30 0x7f56900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.270+0000 7f56a37fe700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5690066f30 0x7f56900693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f56a40b5a90 tx=0x7f5698008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:39.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.274+0000 7f568bfff700 1 -- 172.21.15.84:0/2543445912 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5694052e20 con 0x7f56a40b3610 2023-10-06T03:01:39.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.457+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f56a405f270 con 0x7f56a40b3610 2023-10-06T03:01:39.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.457+0000 7f568bfff700 1 -- 172.21.15.84:0/2543445912 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v102) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5694015090 con 0x7f56a40b3610 2023-10-06T03:01:39.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:39.459 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-10-06T03:01:39.459 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:39.459 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-10-06T03:01:39.459 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-10-06T03:01:39.459 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-10-06T03:01:39.459 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-10-06T03:01:39.459 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 2, 2023-10-06T03:01:39.459 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": "rbd" 2023-10-06T03:01:39.460 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:01:39.460 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-10-06T03:01:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5690066f30 msgr2=0x7f56900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5690066f30 0x7f56900693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f56a40b5a90 tx=0x7f5698008040 comp rx=0 tx=0).stop 2023-10-06T03:01:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a40b3610 msgr2=0x7f56a40c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a40b3610 0x7f56a40c94f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f56a4069190 tx=0x7f5694017000 comp rx=0 tx=0).stop 2023-10-06T03:01:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 shutdown_connections 2023-10-06T03:01:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5690066f30 0x7f56900693e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56a4159480 0x7f56a4169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56a40b3610 0x7f56a40c94f0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 --2- 172.21.15.84:0/2543445912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56a40cc1b0 0x7f56a4159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 >> 172.21.15.84:0/2543445912 conn(0x7f56a406ed20 msgr2=0x7f56a40cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 shutdown_connections 2023-10-06T03:01:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.459+0000 7f56a96e8700 1 -- 172.21.15.84:0/2543445912 wait complete. 2023-10-06T03:01:39.472 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:01:39.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:01:39.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.588+0000 7fc32eb24700 1 Processor -- start 2023-10-06T03:01:39.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.588+0000 7fc32eb24700 1 -- start start 2023-10-06T03:01:39.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc32eb24700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3280b23a0 0x7fc3280b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc32eb24700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc3280aee20 0x7fc3280af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc32eb24700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280b2810 con 0x7fc32806ed20 2023-10-06T03:01:39.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc32eb24700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32806fb80 con 0x7fc3280aee20 2023-10-06T03:01:39.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc32eb24700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280b2d20 con 0x7fc3280b23a0 2023-10-06T03:01:39.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc32c8c0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc32806ed20 0x7fc32806f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51024/0 (socket says 172.21.15.84:51024) 2023-10-06T03:01:39.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc32c8c0700 1 -- 172.21.15.84:0/1781347288 learned_addr learned my addr 172.21.15.84:0/1781347288 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:39.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc327fff700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3280b23a0 0x7fc3280b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759018378 0 0) 0x7fc3280b2810 con 0x7fc32806ed20 2023-10-06T03:01:39.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc32d0c1700 1 --2- 172.21.15.84:0/1781347288 >> v2:172.21.15.131:3300/0 conn(0x7fc3280aee20 0x7fc3280af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.589+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc310003570 con 0x7fc32806ed20 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 169484111 0 0) 0x7fc310003570 con 0x7fc32806ed20 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3280b23a0 msgr2=0x7fc3280b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3280b23a0 0x7fc3280b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 >> v2:172.21.15.131:3300/0 conn(0x7fc3280aee20 msgr2=0x7fc3280af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 --2- 172.21.15.84:0/1781347288 >> v2:172.21.15.131:3300/0 conn(0x7fc3280aee20 0x7fc3280af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280b0450 con 0x7fc32806ed20 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fc3180017f0 con 0x7fc32806ed20 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 >> v1:172.21.15.84:6789/0 conn(0x7fc32806ed20 legacy=0x7fc32806f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3280b23a0 0x7fc310003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc310003fe0 0x7fc310004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc310004d50 0x7fc3100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280b2d20 con 0x7fc310004d50 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31000ba60 con 0x7fc310003fe0 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31000bbd0 con 0x7fc3280b23a0 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc32d0c1700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc310004d50 0x7fc3100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc327fff700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc310003fe0 0x7fc310004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc32c8c0700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3280b23a0 0x7fc310003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc32d0c1700 1 -- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3280b23a0 msgr2=0x7fc310003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc32d0c1700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc3280b23a0 0x7fc310003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc32d0c1700 1 -- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc310003fe0 msgr2=0x7fc310004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc32d0c1700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc310003fe0 0x7fc310004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc32d0c1700 1 -- 172.21.15.84:0/1781347288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310003570 con 0x7fc310004d50 2023-10-06T03:01:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc32d0c1700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc310004d50 0x7fc3100051c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc320009c00 tx=0x7fc3200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c924fba2119e78f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000e6b0 con 0x7fc310004d50 2023-10-06T03:01:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32000e810 con 0x7fc310004d50 2023-10-06T03:01:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.590+0000 7fc3277fe700 1 -- 172.21.15.84:0/1781347288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000ebd0 con 0x7fc310004d50 2023-10-06T03:01:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.591+0000 7fc32eb24700 1 -- 172.21.15.84:0/1781347288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc310004d50 msgr2=0x7fc3100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.591+0000 7fc32eb24700 1 --2- 172.21.15.84:0/1781347288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc310004d50 0x7fc3100051c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc320009c00 tx=0x7fc3200091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.591+0000 7fc32d0c1700 1 -- 172.21.15.84:0/1781347288 reap_dead start 2023-10-06T03:01:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.591+0000 7fc32eb24700 1 -- 172.21.15.84:0/1781347288 shutdown_connections 2023-10-06T03:01:39.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.591+0000 7fc32eb24700 1 -- 172.21.15.84:0/1781347288 >> 172.21.15.84:0/1781347288 conn(0x7fc328068330 msgr2=0x7fc328068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.591+0000 7fc32eb24700 1 -- 172.21.15.84:0/1781347288 shutdown_connections 2023-10-06T03:01:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.591+0000 7fc32eb24700 1 -- 172.21.15.84:0/1781347288 wait complete. 2023-10-06T03:01:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.592+0000 7fc32eb24700 1 Processor -- start 2023-10-06T03:01:39.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.592+0000 7fc32eb24700 1 -- start start 2023-10-06T03:01:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc32eb24700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc328151880 0x7fc3281696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc32eb24700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc328169bf0 0x7fc3280c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc32eb24700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc328151c50 0x7fc3280c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc32eb24700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32816aca0 con 0x7fc328169bf0 2023-10-06T03:01:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc32eb24700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280c9380 con 0x7fc328151c50 2023-10-06T03:01:39.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc32eb24700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32816a090 con 0x7fc328151880 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc327fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc328169bf0 0x7fc3280c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc327fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc328169bf0 0x7fc3280c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54510/0 (socket says 172.21.15.84:54510) 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc327fff700 1 -- 172.21.15.84:0/2531518373 learned_addr learned my addr 172.21.15.84:0/2531518373 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc327fff700 1 -- 172.21.15.84:0/2531518373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc328151880 msgr2=0x7fc3281696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc327fff700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc328151880 0x7fc3281696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc327fff700 1 -- 172.21.15.84:0/2531518373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc328151c50 msgr2=0x7fc3280c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc327fff700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc328151c50 0x7fc3280c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc327fff700 1 -- 172.21.15.84:0/2531518373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32816a370 con 0x7fc328169bf0 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc327fff700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc328169bf0 0x7fc3280c8900 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc31c006ac0 tx=0x7fc31c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc324ff9700 1 -- 172.21.15.84:0/2531518373 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00fa10 con 0x7fc328169bf0 2023-10-06T03:01:39.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc324ff9700 1 -- 172.21.15.84:0/2531518373 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c00fb70 con 0x7fc328169bf0 2023-10-06T03:01:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32816a650 con 0x7fc328169bf0 2023-10-06T03:01:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc324ff9700 1 -- 172.21.15.84:0/2531518373 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c014440 con 0x7fc328169bf0 2023-10-06T03:01:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.593+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3280c9d00 con 0x7fc328169bf0 2023-10-06T03:01:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.594+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32816af80 con 0x7fc328169bf0 2023-10-06T03:01:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.595+0000 7fc324ff9700 1 -- 172.21.15.84:0/2531518373 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc31c014870 con 0x7fc328169bf0 2023-10-06T03:01:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.595+0000 7fc324ff9700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc314066f30 0x7fc3140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.595+0000 7fc324ff9700 1 -- 172.21.15.84:0/2531518373 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc31c018030 con 0x7fc328169bf0 2023-10-06T03:01:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.595+0000 7fc32c8c0700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc314066f30 0x7fc3140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.595+0000 7fc32c8c0700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc314066f30 0x7fc3140693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc318001190 tx=0x7fc318002210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:39.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.599+0000 7fc324ff9700 1 -- 172.21.15.84:0/2531518373 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc31c0522a0 con 0x7fc328169bf0 2023-10-06T03:01:39.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:39.782+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc32816ade0 con 0x7fc328169bf0 2023-10-06T03:01:40.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.766+0000 7fc324ff9700 1 -- 172.21.15.84:0/2531518373 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v103) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc32816ade0 con 0x7fc328169bf0 2023-10-06T03:01:40.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc314066f30 msgr2=0x7fc3140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc314066f30 0x7fc3140693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc318001190 tx=0x7fc318002210 comp rx=0 tx=0).stop 2023-10-06T03:01:40.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc328169bf0 msgr2=0x7fc3280c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc328169bf0 0x7fc3280c8900 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc31c006ac0 tx=0x7fc31c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 shutdown_connections 2023-10-06T03:01:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc314066f30 0x7fc3140693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc328151c50 0x7fc3280c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc328151880 0x7fc3281696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 --2- 172.21.15.84:0/2531518373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc328169bf0 0x7fc3280c8900 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 >> 172.21.15.84:0/2531518373 conn(0x7fc328068330 msgr2=0x7fc3280ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 shutdown_connections 2023-10-06T03:01:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.769+0000 7fc32eb24700 1 -- 172.21.15.84:0/2531518373 wait complete. 2023-10-06T03:01:40.775 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-10-06T03:01:40.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:01:40.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.907+0000 7fc77226c700 1 Processor -- start 2023-10-06T03:01:40.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.907+0000 7fc77226c700 1 -- start start 2023-10-06T03:01:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.907+0000 7fc77226c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc76c0b2660 0x7fc76c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc77226c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc76c0cf1f0 0x7fc76c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc77226c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c0cc9b0 con 0x7fc76c0b2a30 2023-10-06T03:01:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc77226c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0cbda0 con 0x7fc76c0cf1f0 2023-10-06T03:01:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc77226c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0cc080 con 0x7fc76c0b2660 2023-10-06T03:01:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc771a6b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc76c0cf1f0 0x7fc76c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc771a6b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc76c0cf1f0 0x7fc76c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54512/0 (socket says 172.21.15.84:54512) 2023-10-06T03:01:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc771a6b700 1 -- 172.21.15.84:0/2715224497 learned_addr learned my addr 172.21.15.84:0/2715224497 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc77126a700 1 --2- 172.21.15.84:0/2715224497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc76c0b2660 0x7fc76c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc771a6b700 1 -- 172.21.15.84:0/2715224497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc76c0b2660 msgr2=0x7fc76c0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc771a6b700 1 --2- 172.21.15.84:0/2715224497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc76c0b2660 0x7fc76c0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc771a6b700 1 -- 172.21.15.84:0/2715224497 >> v1:172.21.15.131:6789/0 conn(0x7fc76c0b2a30 legacy=0x7fc76c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc771a6b700 1 -- 172.21.15.84:0/2715224497 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0cc360 con 0x7fc76c0cf1f0 2023-10-06T03:01:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc771a6b700 1 --2- 172.21.15.84:0/2715224497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0cf1f0 0x7fc76c0cd230 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc764009f20 tx=0x7fc764009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3428e24cff9f8a0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc763fff700 1 -- 172.21.15.84:0/2715224497 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400e070 con 0x7fc76c0cf1f0 2023-10-06T03:01:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc763fff700 1 -- 172.21.15.84:0/2715224497 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400ba80 con 0x7fc76c0cf1f0 2023-10-06T03:01:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.908+0000 7fc763fff700 1 -- 172.21.15.84:0/2715224497 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640092e0 con 0x7fc76c0cf1f0 2023-10-06T03:01:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.909+0000 7fc77226c700 1 -- 172.21.15.84:0/2715224497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0cf1f0 msgr2=0x7fc76c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.909+0000 7fc77226c700 1 --2- 172.21.15.84:0/2715224497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0cf1f0 0x7fc76c0cd230 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc764009f20 tx=0x7fc764009840 comp rx=0 tx=0).stop 2023-10-06T03:01:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.909+0000 7fc77226c700 1 -- 172.21.15.84:0/2715224497 shutdown_connections 2023-10-06T03:01:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.909+0000 7fc77226c700 1 --2- 172.21.15.84:0/2715224497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0cf1f0 0x7fc76c0cd230 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.909+0000 7fc77226c700 1 --2- 172.21.15.84:0/2715224497 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc76c0b2660 0x7fc76c0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.909+0000 7fc77226c700 1 -- 172.21.15.84:0/2715224497 >> 172.21.15.84:0/2715224497 conn(0x7fc76c099560 msgr2=0x7fc76c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.909+0000 7fc77226c700 1 -- 172.21.15.84:0/2715224497 shutdown_connections 2023-10-06T03:01:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.909+0000 7fc77226c700 1 -- 172.21.15.84:0/2715224497 wait complete. 2023-10-06T03:01:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.910+0000 7fc77226c700 1 Processor -- start 2023-10-06T03:01:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.910+0000 7fc77226c700 1 -- start start 2023-10-06T03:01:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc77226c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc76c0b2660 0x7fc76c139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc77226c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b2a30 0x7fc76c169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc77226c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc76c0cf1f0 0x7fc76c0c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc77226c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c13a530 con 0x7fc76c0b2a30 2023-10-06T03:01:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc77226c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0b49e0 con 0x7fc76c0cf1f0 2023-10-06T03:01:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc77226c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0b5840 con 0x7fc76c0b2660 2023-10-06T03:01:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc770a69700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b2a30 0x7fc76c169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc770a69700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b2a30 0x7fc76c169be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54524/0 (socket says 172.21.15.84:54524) 2023-10-06T03:01:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc770a69700 1 -- 172.21.15.84:0/3432311894 learned_addr learned my addr 172.21.15.84:0/3432311894 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc770a69700 1 -- 172.21.15.84:0/3432311894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc76c0b2660 msgr2=0x7fc76c139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc770a69700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc76c0b2660 0x7fc76c139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc770a69700 1 -- 172.21.15.84:0/3432311894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc76c0cf1f0 msgr2=0x7fc76c0c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc771a6b700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc76c0cf1f0 0x7fc76c0c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc770a69700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc76c0cf1f0 0x7fc76c0c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc770a69700 1 -- 172.21.15.84:0/3432311894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764009ae0 con 0x7fc76c0b2a30 2023-10-06T03:01:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc770a69700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b2a30 0x7fc76c169be0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c590 tx=0x7fc75c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.911+0000 7fc7617fa700 1 -- 172.21.15.84:0/3432311894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011590 con 0x7fc76c0b2a30 2023-10-06T03:01:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.912+0000 7fc7617fa700 1 -- 172.21.15.84:0/3432311894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c0116f0 con 0x7fc76c0b2a30 2023-10-06T03:01:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.912+0000 7fc7617fa700 1 -- 172.21.15.84:0/3432311894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011ab0 con 0x7fc76c0b2a30 2023-10-06T03:01:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.912+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c0b4c30 con 0x7fc76c0b2a30 2023-10-06T03:01:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.912+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c0b51f0 con 0x7fc76c0b2a30 2023-10-06T03:01:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.913+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c05f270 con 0x7fc76c0b2a30 2023-10-06T03:01:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.913+0000 7fc7617fa700 1 -- 172.21.15.84:0/3432311894 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc75c01b3b0 con 0x7fc76c0b2a30 2023-10-06T03:01:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.913+0000 7fc7617fa700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc750066f30 0x7fc7500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.913+0000 7fc7617fa700 1 -- 172.21.15.84:0/3432311894 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5896+0+0 (secure 0 0 0) 0x7fc75c083ba0 con 0x7fc76c0b2a30 2023-10-06T03:01:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.913+0000 7fc77126a700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc750066f30 0x7fc7500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.914+0000 7fc77126a700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc750066f30 0x7fc7500693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc768006fd0 tx=0x7fc768008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:40.918+0000 7fc7617fa700 1 -- 172.21.15.84:0/3432311894 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc75c050d50 con 0x7fc76c0b2a30 2023-10-06T03:01:41.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.100+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc76c0cc640 con 0x7fc76c0b2a30 2023-10-06T03:01:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.774+0000 7fc7617fa700 1 -- 172.21.15.84:0/3432311894 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v104) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc75c017020 con 0x7fc76c0b2a30 2023-10-06T03:01:41.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.778+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc750066f30 msgr2=0x7fc7500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.778+0000 7fc77226c700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc750066f30 0x7fc7500693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc768006fd0 tx=0x7fc768008040 comp rx=0 tx=0).stop 2023-10-06T03:01:41.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.778+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b2a30 msgr2=0x7fc76c169be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.778+0000 7fc77226c700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b2a30 0x7fc76c169be0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c590 tx=0x7fc75c00c950 comp rx=0 tx=0).stop 2023-10-06T03:01:41.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.780+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 shutdown_connections 2023-10-06T03:01:41.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.780+0000 7fc77226c700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc750066f30 0x7fc7500693e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.780+0000 7fc77226c700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc76c0cf1f0 0x7fc76c0c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.780+0000 7fc77226c700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc76c0b2660 0x7fc76c139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.780+0000 7fc77226c700 1 --2- 172.21.15.84:0/3432311894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76c0b2a30 0x7fc76c169be0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.780+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 >> 172.21.15.84:0/3432311894 conn(0x7fc76c099560 msgr2=0x7fc76c1589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:41.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.783+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 shutdown_connections 2023-10-06T03:01:41.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.783+0000 7fc77226c700 1 -- 172.21.15.84:0/3432311894 wait complete. 2023-10-06T03:01:41.787 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-10-06T03:01:41.805 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:01:41.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.923+0000 7fab96195700 1 Processor -- start 2023-10-06T03:01:41.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.923+0000 7fab96195700 1 -- start start 2023-10-06T03:01:41.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab96195700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab90159710 0x7fab900cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab96195700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab900cba70 0x7fab900c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab96195700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900afbe0 con 0x7fab90159340 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab96195700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab900cbed0 con 0x7fab90159710 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab96195700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900cf820 con 0x7fab900cba70 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab90159710 0x7fab900cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fab90159340 0x7fab900af4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51034/0 (socket says 172.21.15.84:51034) 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8f7fe700 1 -- 172.21.15.84:0/2654991858 learned_addr learned my addr 172.21.15.84:0/2654991858 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8effd700 1 --2- 172.21.15.84:0/2654991858 >> v2:172.21.15.84:3300/0 conn(0x7fab90159710 0x7fab900cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54528/0 (socket says 172.21.15.84:54528) 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8ffff700 1 --2- 172.21.15.84:0/2654991858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab900cba70 0x7fab900c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8effd700 1 -- 172.21.15.84:0/2654991858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab900cba70 msgr2=0x7fab900c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:41.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8effd700 1 --2- 172.21.15.84:0/2654991858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab900cba70 0x7fab900c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8effd700 1 -- 172.21.15.84:0/2654991858 >> v1:172.21.15.84:6789/0 conn(0x7fab90159340 legacy=0x7fab900af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8e7fc700 1 -- 172.21.15.84:0/2654991858 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094259677 0 0) 0x7fab80001290 con 0x7fab90159340 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8effd700 1 -- 172.21.15.84:0/2654991858 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900cfb00 con 0x7fab90159710 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8effd700 1 --2- 172.21.15.84:0/2654991858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159710 0x7fab900cb530 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fab840098e0 tx=0x7fab840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50c795097b2ffda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8e7fc700 1 -- 172.21.15.84:0/2654991858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84009e80 con 0x7fab90159710 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8e7fc700 1 -- 172.21.15.84:0/2654991858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400b860 con 0x7fab90159710 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.924+0000 7fab8e7fc700 1 -- 172.21.15.84:0/2654991858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400bbe0 con 0x7fab90159710 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.925+0000 7fab96195700 1 -- 172.21.15.84:0/2654991858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159710 msgr2=0x7fab900cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.925+0000 7fab96195700 1 --2- 172.21.15.84:0/2654991858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159710 0x7fab900cb530 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fab840098e0 tx=0x7fab840091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.925+0000 7fab96195700 1 -- 172.21.15.84:0/2654991858 shutdown_connections 2023-10-06T03:01:41.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.925+0000 7fab96195700 1 --2- 172.21.15.84:0/2654991858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab900cba70 0x7fab900c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.925+0000 7fab96195700 1 --2- 172.21.15.84:0/2654991858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159710 0x7fab900cb530 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.925+0000 7fab96195700 1 -- 172.21.15.84:0/2654991858 >> 172.21.15.84:0/2654991858 conn(0x7fab90099720 msgr2=0x7fab9006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:41.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.925+0000 7fab96195700 1 -- 172.21.15.84:0/2654991858 shutdown_connections 2023-10-06T03:01:41.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.925+0000 7fab96195700 1 -- 172.21.15.84:0/2654991858 wait complete. 2023-10-06T03:01:41.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.926+0000 7fab96195700 1 Processor -- start 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.926+0000 7fab96195700 1 -- start start 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab96195700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab900cba70 0x7fab90147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab96195700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159340 0x7fab90159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab96195700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab90159710 0x7fab901573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab96195700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90147860 con 0x7fab90159340 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab96195700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900c84c0 con 0x7fab900cba70 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab96195700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900c9560 con 0x7fab90159710 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159340 0x7fab90159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159340 0x7fab90159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54544/0 (socket says 172.21.15.84:54544) 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8effd700 1 -- 172.21.15.84:0/3163088365 learned_addr learned my addr 172.21.15.84:0/3163088365 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8ffff700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab90159710 0x7fab901573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8f7fe700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab900cba70 0x7fab90147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8effd700 1 -- 172.21.15.84:0/3163088365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab90159710 msgr2=0x7fab901573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8effd700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab90159710 0x7fab901573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8effd700 1 -- 172.21.15.84:0/3163088365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab900cba70 msgr2=0x7fab90147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8effd700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab900cba70 0x7fab90147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8effd700 1 -- 172.21.15.84:0/3163088365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009420 con 0x7fab90159340 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8f7fe700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab900cba70 0x7fab90147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.927+0000 7fab8effd700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159340 0x7fab90159bb0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fab900712c0 tx=0x7fab84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.928+0000 7fab777fe700 1 -- 172.21.15.84:0/3163088365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400bbe0 con 0x7fab90159340 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.928+0000 7fab777fe700 1 -- 172.21.15.84:0/3163088365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab84011420 con 0x7fab90159340 2023-10-06T03:01:41.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.928+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab900c8c30 con 0x7fab90159340 2023-10-06T03:01:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.928+0000 7fab777fe700 1 -- 172.21.15.84:0/3163088365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840117e0 con 0x7fab90159340 2023-10-06T03:01:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.928+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab900c91f0 con 0x7fab90159340 2023-10-06T03:01:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.929+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab900c96d0 con 0x7fab90159340 2023-10-06T03:01:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.929+0000 7fab777fe700 1 -- 172.21.15.84:0/3163088365 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab84011bd0 con 0x7fab90159340 2023-10-06T03:01:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.930+0000 7fab777fe700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fab7c066f30 0x7fab7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.930+0000 7fab8f7fe700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fab7c066f30 0x7fab7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.930+0000 7fab777fe700 1 -- 172.21.15.84:0/3163088365 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fab84086100 con 0x7fab90159340 2023-10-06T03:01:41.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.930+0000 7fab8f7fe700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fab7c066f30 0x7fab7c0693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fab80001850 tx=0x7fab80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:41.934+0000 7fab777fe700 1 -- 172.21.15.84:0/3163088365 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab84053130 con 0x7fab90159340 2023-10-06T03:01:42.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.158+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fab90064ad0 con 0x7fab90159340 2023-10-06T03:01:42.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.781+0000 7fab777fe700 1 -- 172.21.15.84:0/3163088365 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v97) v1 ==== 174+0+0 (secure 0 0 0) 0x7fab84056750 con 0x7fab90159340 2023-10-06T03:01:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.785+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fab7c066f30 msgr2=0x7fab7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.785+0000 7fab96195700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fab7c066f30 0x7fab7c0693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fab80001850 tx=0x7fab80009040 comp rx=0 tx=0).stop 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.785+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159340 msgr2=0x7fab90159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.785+0000 7fab96195700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159340 0x7fab90159bb0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fab900712c0 tx=0x7fab84017000 comp rx=0 tx=0).stop 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.786+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 shutdown_connections 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.786+0000 7fab96195700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fab7c066f30 0x7fab7c0693e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.786+0000 7fab96195700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab900cba70 0x7fab90147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.786+0000 7fab96195700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab90159710 0x7fab901573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.786+0000 7fab96195700 1 --2- 172.21.15.84:0/3163088365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab90159340 0x7fab90159bb0 secure :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fab900712c0 tx=0x7fab84017000 comp rx=0 tx=0).stop 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.786+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 >> 172.21.15.84:0/3163088365 conn(0x7fab90099720 msgr2=0x7fab900688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.786+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 shutdown_connections 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.786+0000 7fab96195700 1 -- 172.21.15.84:0/3163088365 wait complete. 2023-10-06T03:01:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 16 and data pool 17 2023-10-06T03:01:42.804 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:42.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.917+0000 7f8c16593700 1 Processor -- start 2023-10-06T03:01:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.917+0000 7f8c16593700 1 -- start start 2023-10-06T03:01:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.918+0000 7f8c16593700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c6060 0x7f8c100ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.918+0000 7f8c16593700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c100ae250 con 0x7f8c10159580 2023-10-06T03:01:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.918+0000 7f8c16593700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c100ad640 con 0x7f8c10159950 2023-10-06T03:01:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.918+0000 7f8c16593700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100ad920 con 0x7f8c100c6060 2023-10-06T03:01:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.918+0000 7f8c15591700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8c10159580 0x7f8c100ace60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49332/0 (socket says 172.21.15.84:49332) 2023-10-06T03:01:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.918+0000 7f8c15591700 1 -- 172.21.15.84:0/2737696003 learned_addr learned my addr 172.21.15.84:0/2737696003 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.918+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185565194 0 0) 0x7f8c100ae250 con 0x7f8c10159580 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.918+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bfc003570 con 0x7f8c10159580 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.918+0000 7f8c15d92700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c6060 0x7f8c100ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1062719451 0 0) 0x7f8bfc003570 con 0x7f8c10159580 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c6060 msgr2=0x7f8c100ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c6060 0x7f8c100ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 >> v1:172.21.15.131:6789/0 conn(0x7f8c10159950 legacy=0x7f8c100ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100adc00 con 0x7f8c10159580 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f8c0c001470 con 0x7f8c10159580 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 >> v1:172.21.15.84:6789/0 conn(0x7f8c10159580 legacy=0x7f8c100ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bfc003a90 0x7f8bfc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c6060 0x7f8bfc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc004d50 0x7f8bfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100ad920 con 0x7f8bfc003a90 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc00bc20 con 0x7f8bfc004d50 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc00bde0 con 0x7f8c100c6060 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c15591700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bfc003a90 0x7f8bfc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c14d90700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c6060 0x7f8bfc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c15d92700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc004d50 0x7f8bfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c15591700 1 -- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c6060 msgr2=0x7f8bfc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c15591700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c6060 0x7f8bfc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c15591700 1 -- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc004d50 msgr2=0x7f8bfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c15591700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc004d50 0x7f8bfc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c15591700 1 -- 172.21.15.84:0/2737696003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc003570 con 0x7f8bfc003a90 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c15d92700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc004d50 0x7f8bfc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c15591700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bfc003a90 0x7f8bfc003ea0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00c390 tx=0x7f8c0c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0504bde2e0bdded server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c00cc60 con 0x7f8bfc003a90 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00cdc0 con 0x7f8bfc003a90 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.919+0000 7f8c07fff700 1 -- 172.21.15.84:0/2737696003 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c005b50 con 0x7f8bfc003a90 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.920+0000 7f8c16593700 1 -- 172.21.15.84:0/2737696003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bfc003a90 msgr2=0x7f8bfc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.920+0000 7f8c16593700 1 --2- 172.21.15.84:0/2737696003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8bfc003a90 0x7f8bfc003ea0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00c390 tx=0x7f8c0c001e50 comp rx=0 tx=0).stop 2023-10-06T03:01:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.920+0000 7f8c15d92700 1 -- 172.21.15.84:0/2737696003 reap_dead start 2023-10-06T03:01:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.920+0000 7f8c16593700 1 -- 172.21.15.84:0/2737696003 shutdown_connections 2023-10-06T03:01:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.920+0000 7f8c16593700 1 -- 172.21.15.84:0/2737696003 >> 172.21.15.84:0/2737696003 conn(0x7f8c10099560 msgr2=0x7f8c1006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.920+0000 7f8c16593700 1 -- 172.21.15.84:0/2737696003 shutdown_connections 2023-10-06T03:01:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.920+0000 7f8c16593700 1 -- 172.21.15.84:0/2737696003 wait complete. 2023-10-06T03:01:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.921+0000 7f8c16593700 1 Processor -- start 2023-10-06T03:01:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.921+0000 7f8c16593700 1 -- start start 2023-10-06T03:01:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c16593700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc003a90 0x7f8c10159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c16593700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c100b5c40 0x7f8c1014bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c16593700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c8880 0x7f8c100ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c16593700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1014c2c0 con 0x7f8c100b5c40 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c16593700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c9a90 con 0x7f8bfc003a90 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c16593700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c91f0 con 0x7f8c100c8880 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c14d90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c100b5c40 0x7f8c1014bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c14d90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c100b5c40 0x7f8c1014bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48888/0 (socket says 172.21.15.84:48888) 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c14d90700 1 -- 172.21.15.84:0/4048517189 learned_addr learned my addr 172.21.15.84:0/4048517189 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c15d92700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c8880 0x7f8c100ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c15591700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc003a90 0x7f8c10159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c14d90700 1 -- 172.21.15.84:0/4048517189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c8880 msgr2=0x7f8c100ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c14d90700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c8880 0x7f8c100ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c14d90700 1 -- 172.21.15.84:0/4048517189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc003a90 msgr2=0x7f8c10159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c14d90700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc003a90 0x7f8c10159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c14d90700 1 -- 172.21.15.84:0/4048517189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100c94d0 con 0x7f8c100b5c40 2023-10-06T03:01:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.922+0000 7f8c15591700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc003a90 0x7f8c10159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.923+0000 7f8c14d90700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c100b5c40 0x7f8c1014bd80 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f8c00002980 tx=0x7f8c00007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.923+0000 7f8c057fa700 1 -- 172.21.15.84:0/4048517189 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000f870 con 0x7f8c100b5c40 2023-10-06T03:01:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.923+0000 7f8c057fa700 1 -- 172.21.15.84:0/4048517189 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0000f9d0 con 0x7f8c100b5c40 2023-10-06T03:01:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.923+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c100c97b0 con 0x7f8c100b5c40 2023-10-06T03:01:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.923+0000 7f8c057fa700 1 -- 172.21.15.84:0/4048517189 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000fd70 con 0x7f8c100b5c40 2023-10-06T03:01:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.923+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c100c8d00 con 0x7f8c100b5c40 2023-10-06T03:01:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.924+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c100c76d0 con 0x7f8c100b5c40 2023-10-06T03:01:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.924+0000 7f8c057fa700 1 -- 172.21.15.84:0/4048517189 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c00013600 con 0x7f8c100b5c40 2023-10-06T03:01:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.924+0000 7f8c057fa700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8bf4066f30 0x7f8bf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.924+0000 7f8c057fa700 1 -- 172.21.15.84:0/4048517189 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8c00084cc0 con 0x7f8c100b5c40 2023-10-06T03:01:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.924+0000 7f8c15591700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8bf4066f30 0x7f8bf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.925+0000 7f8c15591700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8bf4066f30 0x7f8bf40693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c001ed0 tx=0x7f8c0c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:42.929+0000 7f8c057fa700 1 -- 172.21.15.84:0/4048517189 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c100c76d0 con 0x7f8c100b5c40 2023-10-06T03:01:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.121+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c100c76d0 con 0x7f8c100b5c40 2023-10-06T03:01:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.121+0000 7f8c057fa700 1 -- 172.21.15.84:0/4048517189 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+17098 (secure 0 0 0) 0x7f8c100c76d0 con 0x7f8c100b5c40 2023-10-06T03:01:43.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:43.123 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":105,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:01:42.160470+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:39.801172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:41.118752+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8bf4066f30 msgr2=0x7f8bf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8bf4066f30 0x7f8bf40693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c001ed0 tx=0x7f8c0c015000 comp rx=0 tx=0).stop 2023-10-06T03:01:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c100b5c40 msgr2=0x7f8c1014bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c100b5c40 0x7f8c1014bd80 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f8c00002980 tx=0x7f8c00007d30 comp rx=0 tx=0).stop 2023-10-06T03:01:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 shutdown_connections 2023-10-06T03:01:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8bf4066f30 0x7f8bf40693e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc003a90 0x7f8c10159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c100c8880 0x7f8c100ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 --2- 172.21.15.84:0/4048517189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c100b5c40 0x7f8c1014bd80 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 >> 172.21.15.84:0/4048517189 conn(0x7f8c10099560 msgr2=0x7f8c1006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 shutdown_connections 2023-10-06T03:01:43.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.124+0000 7f8c16593700 1 -- 172.21.15.84:0/4048517189 wait complete. 2023-10-06T03:01:43.138 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.252+0000 7f3a088ce700 1 Processor -- start 2023-10-06T03:01:43.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.252+0000 7f3a088ce700 1 -- start start 2023-10-06T03:01:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.253+0000 7f3a088ce700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a040ce8e0 0x7f3a0415af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.253+0000 7f3a088ce700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a04157e20 con 0x7f3a040ca3b0 2023-10-06T03:01:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.253+0000 7f3a088ce700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a040cb610 con 0x7f3a040adba0 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.253+0000 7f3a088ce700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a040cbbd0 con 0x7f3a040ce8e0 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.253+0000 7f3a02d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a040ce8e0 0x7f3a0415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.253+0000 7f3a0259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3a040ca3b0 0x7f3a041582b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49344/0 (socket says 172.21.15.84:49344) 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.253+0000 7f3a0259c700 1 -- 172.21.15.84:0/3657860864 learned_addr learned my addr 172.21.15.84:0/3657860864 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a02d9d700 1 -- 172.21.15.84:0/3657860864 >> v1:172.21.15.131:6789/0 conn(0x7f3a040adba0 legacy=0x7f3a040ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a02d9d700 1 -- 172.21.15.84:0/3657860864 >> v1:172.21.15.84:6789/0 conn(0x7f3a040ca3b0 legacy=0x7f3a041582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a02d9d700 1 -- 172.21.15.84:0/3657860864 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040cb8f0 con 0x7f3a040ce8e0 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a0159a700 1 -- 172.21.15.84:0/3657860864 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786132101 0 0) 0x7f3a04157e20 con 0x7f3a040ca3b0 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a02d9d700 1 --2- 172.21.15.84:0/3657860864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040ce8e0 0x7f3a0415af10 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0098e0 tx=0x7f39fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba111a8289b21dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a0159a700 1 -- 172.21.15.84:0/3657860864 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc009e80 con 0x7f3a040ce8e0 2023-10-06T03:01:43.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a0159a700 1 -- 172.21.15.84:0/3657860864 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc00b820 con 0x7f3a040ce8e0 2023-10-06T03:01:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a0159a700 1 -- 172.21.15.84:0/3657860864 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc00bba0 con 0x7f3a040ce8e0 2023-10-06T03:01:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a088ce700 1 -- 172.21.15.84:0/3657860864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040ce8e0 msgr2=0x7f3a0415af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a088ce700 1 --2- 172.21.15.84:0/3657860864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040ce8e0 0x7f3a0415af10 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0098e0 tx=0x7f39fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a088ce700 1 -- 172.21.15.84:0/3657860864 shutdown_connections 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.254+0000 7f3a088ce700 1 --2- 172.21.15.84:0/3657860864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040ce8e0 0x7f3a0415af10 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.255+0000 7f3a088ce700 1 -- 172.21.15.84:0/3657860864 >> 172.21.15.84:0/3657860864 conn(0x7f3a04070810 msgr2=0x7f3a04070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.255+0000 7f3a088ce700 1 -- 172.21.15.84:0/3657860864 shutdown_connections 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.255+0000 7f3a088ce700 1 -- 172.21.15.84:0/3657860864 wait complete. 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a088ce700 1 Processor -- start 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a088ce700 1 -- start start 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a088ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040adba0 0x7f3a04155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a088ce700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a040ca3b0 0x7f3a04151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a088ce700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a040ce8e0 0x7f3a040c1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a088ce700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04156480 con 0x7f3a040adba0 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a088ce700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04156760 con 0x7f3a040ce8e0 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a088ce700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04156a40 con 0x7f3a040ca3b0 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a0259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040adba0 0x7f3a04155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a0259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040adba0 0x7f3a04155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48910/0 (socket says 172.21.15.84:48910) 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.256+0000 7f3a0259c700 1 -- 172.21.15.84:0/2137557661 learned_addr learned my addr 172.21.15.84:0/2137557661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a02d9d700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a040ce8e0 0x7f3a040c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a01d9b700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a040ca3b0 0x7f3a04151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a0259c700 1 -- 172.21.15.84:0/2137557661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a040ca3b0 msgr2=0x7f3a04151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a0259c700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a040ca3b0 0x7f3a04151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a0259c700 1 -- 172.21.15.84:0/2137557661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a040ce8e0 msgr2=0x7f3a040c1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a0259c700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a040ce8e0 0x7f3a040c1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a0259c700 1 -- 172.21.15.84:0/2137557661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc009420 con 0x7f3a040adba0 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a01d9b700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a040ca3b0 0x7f3a04151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a0259c700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040adba0 0x7f3a04155e90 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f39f400cd80 tx=0x7f39f4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f39f27fc700 1 -- 172.21.15.84:0/2137557661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f400ab10 con 0x7f3a040adba0 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f39f27fc700 1 -- 172.21.15.84:0/2137557661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f400ac70 con 0x7f3a040adba0 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a04156d20 con 0x7f3a040adba0 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f39f27fc700 1 -- 172.21.15.84:0/2137557661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f40070f0 con 0x7f3a040adba0 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.257+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a040c15a0 con 0x7f3a040adba0 2023-10-06T03:01:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.258+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a04064ad0 con 0x7f3a040adba0 2023-10-06T03:01:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.258+0000 7f39f27fc700 1 -- 172.21.15.84:0/2137557661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39f40074e0 con 0x7f3a040adba0 2023-10-06T03:01:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.259+0000 7f39f27fc700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39e4066f30 0x7f39e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.259+0000 7f39f27fc700 1 -- 172.21.15.84:0/2137557661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f39f4084d80 con 0x7f3a040adba0 2023-10-06T03:01:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.259+0000 7f3a01d9b700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39e4066f30 0x7f39e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.259+0000 7f3a01d9b700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39e4066f30 0x7f39e40693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f39f8006fd0 tx=0x7f39f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.263+0000 7f39f27fc700 1 -- 172.21.15.84:0/2137557661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39f4051d50 con 0x7f3a040adba0 2023-10-06T03:01:43.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.448+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a0404bb80 con 0x7f3a040adba0 2023-10-06T03:01:43.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.449+0000 7f39f27fc700 1 -- 172.21.15.84:0/2137557661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+17085 (secure 0 0 0) 0x7f39f4055370 con 0x7f3a040adba0 2023-10-06T03:01:43.450 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:43.450 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:01:43.163738+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:39.801172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:41.118752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:43.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.450+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39e4066f30 msgr2=0x7f39e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.450+0000 7f3a088ce700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39e4066f30 0x7f39e40693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f39f8006fd0 tx=0x7f39f8008040 comp rx=0 tx=0).stop 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.450+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040adba0 msgr2=0x7f3a04155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.451+0000 7f3a088ce700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040adba0 0x7f3a04155e90 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f39f400cd80 tx=0x7f39f4001ae0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.451+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 shutdown_connections 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.451+0000 7f3a088ce700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39e4066f30 0x7f39e40693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.451+0000 7f3a088ce700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a040ce8e0 0x7f3a040c1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.451+0000 7f3a088ce700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a040adba0 0x7f3a04155e90 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.451+0000 7f3a088ce700 1 --2- 172.21.15.84:0/2137557661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3a040ca3b0 0x7f3a04151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.451+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 >> 172.21.15.84:0/2137557661 conn(0x7f3a04070810 msgr2=0x7f3a04153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.451+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 shutdown_connections 2023-10-06T03:01:43.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.451+0000 7f3a088ce700 1 -- 172.21.15.84:0/2137557661 wait complete. 2023-10-06T03:01:43.464 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:01:43.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.579+0000 7f04d73bf700 1 Processor -- start 2023-10-06T03:01:43.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.580+0000 7f04d73bf700 1 -- start start 2023-10-06T03:01:43.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.580+0000 7f04d73bf700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f04d0159340 0x7f04d00af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.580+0000 7f04d73bf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d00cbc40 0x7f04d00c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.580+0000 7f04d73bf700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d00cf820 con 0x7f04d0159710 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.580+0000 7f04d73bf700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00cfb00 con 0x7f04d0159340 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.580+0000 7f04d73bf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00cfde0 con 0x7f04d00cbc40 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.580+0000 7f04d515b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f04d0159340 0x7f04d00af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.580+0000 7f04d515b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f04d0159340 0x7f04d00af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48914/0 (socket says 172.21.15.84:48914) 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.581+0000 7f04d515b700 1 -- 172.21.15.84:0/977741875 learned_addr learned my addr 172.21.15.84:0/977741875 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.581+0000 7f04d515b700 1 -- 172.21.15.84:0/977741875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d00cbc40 msgr2=0x7f04d00c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.581+0000 7f04d515b700 1 --2- 172.21.15.84:0/977741875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d00cbc40 0x7f04d00c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.581+0000 7f04d515b700 1 -- 172.21.15.84:0/977741875 >> v1:172.21.15.131:6789/0 conn(0x7f04d0159710 legacy=0x7f04d00cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.581+0000 7f04d515b700 1 -- 172.21.15.84:0/977741875 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00d00c0 con 0x7f04d0159340 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.581+0000 7f04d515b700 1 --2- 172.21.15.84:0/977741875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 0x7f04d00af4d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009990 tx=0x7f04cc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a59399266414a96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.581+0000 7f04c7fff700 1 -- 172.21.15.84:0/977741875 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc005c10 con 0x7f04d0159340 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.581+0000 7f04c7fff700 1 -- 172.21.15.84:0/977741875 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc005d70 con 0x7f04d0159340 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.581+0000 7f04c7fff700 1 -- 172.21.15.84:0/977741875 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00b840 con 0x7f04d0159340 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.582+0000 7f04d73bf700 1 -- 172.21.15.84:0/977741875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 msgr2=0x7f04d00af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.582+0000 7f04d73bf700 1 --2- 172.21.15.84:0/977741875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 0x7f04d00af4d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009990 tx=0x7f04cc009220 comp rx=0 tx=0).stop 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.582+0000 7f04d73bf700 1 -- 172.21.15.84:0/977741875 shutdown_connections 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.582+0000 7f04d73bf700 1 --2- 172.21.15.84:0/977741875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d00cbc40 0x7f04d00c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.582+0000 7f04d73bf700 1 --2- 172.21.15.84:0/977741875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 0x7f04d00af4d0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.582+0000 7f04d73bf700 1 -- 172.21.15.84:0/977741875 >> 172.21.15.84:0/977741875 conn(0x7f04d0099720 msgr2=0x7f04d006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.582+0000 7f04d73bf700 1 -- 172.21.15.84:0/977741875 shutdown_connections 2023-10-06T03:01:43.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.582+0000 7f04d73bf700 1 -- 172.21.15.84:0/977741875 wait complete. 2023-10-06T03:01:43.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.583+0000 7f04d73bf700 1 Processor -- start 2023-10-06T03:01:43.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.583+0000 7f04d73bf700 1 -- start start 2023-10-06T03:01:43.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d73bf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d00cbc40 0x7f04d00c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d73bf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 0x7f04d00c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d73bf700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0159710 0x7f04d00c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d73bf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00b45a0 con 0x7f04d0159340 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d73bf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00add20 con 0x7f04d00cbc40 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d73bf700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00b4860 con 0x7f04d0159710 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d495a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 0x7f04d00c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d495a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 0x7f04d00c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48916/0 (socket says 172.21.15.84:48916) 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d495a700 1 -- 172.21.15.84:0/4186130626 learned_addr learned my addr 172.21.15.84:0/4186130626 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d515b700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d00cbc40 0x7f04d00c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d595c700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0159710 0x7f04d00c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d495a700 1 -- 172.21.15.84:0/4186130626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0159710 msgr2=0x7f04d00c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d495a700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0159710 0x7f04d00c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d495a700 1 -- 172.21.15.84:0/4186130626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d00cbc40 msgr2=0x7f04d00c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d495a700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d00cbc40 0x7f04d00c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d495a700 1 -- 172.21.15.84:0/4186130626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc009480 con 0x7f04d0159340 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d515b700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d00cbc40 0x7f04d00c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d495a700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 0x7f04d00c9910 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f04c000b5e0 tx=0x7f04c0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04c57fa700 1 -- 172.21.15.84:0/4186130626 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000f510 con 0x7f04d0159340 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04c57fa700 1 -- 172.21.15.84:0/4186130626 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c000f670 con 0x7f04d0159340 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d00ad480 con 0x7f04d0159340 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04c57fa700 1 -- 172.21.15.84:0/4186130626 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000fa30 con 0x7f04d0159340 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.584+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d00ada40 con 0x7f04d0159340 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.585+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d00b49d0 con 0x7f04d0159340 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.586+0000 7f04c57fa700 1 -- 172.21.15.84:0/4186130626 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04c001a400 con 0x7f04d0159340 2023-10-06T03:01:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.586+0000 7f04c57fa700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f04b4066f30 0x7f04b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.586+0000 7f04c57fa700 1 -- 172.21.15.84:0/4186130626 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f04c00842c0 con 0x7f04d0159340 2023-10-06T03:01:43.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.586+0000 7f04d515b700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f04b4066f30 0x7f04b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.586+0000 7f04d515b700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f04b4066f30 0x7f04b40693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f04cc007fd0 tx=0x7f04cc015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.590+0000 7f04c57fa700 1 -- 172.21.15.84:0/4186130626 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04c0051310 con 0x7f04d0159340 2023-10-06T03:01:43.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:43.821+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f04d0064ad0 con 0x7f04d0159340 2023-10-06T03:01:44.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.797+0000 7f04c57fa700 1 -- 172.21.15.84:0/4186130626 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v100) v1 ==== 118+0+0 (secure 0 0 0) 0x7f04c0054930 con 0x7f04d0159340 2023-10-06T03:01:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f04b4066f30 msgr2=0x7f04b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f04b4066f30 0x7f04b40693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f04cc007fd0 tx=0x7f04cc015000 comp rx=0 tx=0).stop 2023-10-06T03:01:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 msgr2=0x7f04d00c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 0x7f04d00c9910 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f04c000b5e0 tx=0x7f04c0009120 comp rx=0 tx=0).stop 2023-10-06T03:01:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 shutdown_connections 2023-10-06T03:01:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f04b4066f30 0x7f04b40693e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d00cbc40 0x7f04d00c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0159710 0x7f04d00c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 --2- 172.21.15.84:0/4186130626 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d0159340 0x7f04d00c9910 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 >> 172.21.15.84:0/4186130626 conn(0x7f04d0099720 msgr2=0x7f04d0068780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 shutdown_connections 2023-10-06T03:01:44.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.800+0000 7f04d73bf700 1 -- 172.21.15.84:0/4186130626 wait complete. 2023-10-06T03:01:44.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:01:44.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.935+0000 7fde9a84a700 1 Processor -- start 2023-10-06T03:01:44.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.935+0000 7fde9a84a700 1 -- start start 2023-10-06T03:01:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.936+0000 7fde9a84a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde940cd980 0x7fde94159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.936+0000 7fde9a84a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940b5f30 con 0x7fde940b4eb0 2023-10-06T03:01:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.936+0000 7fde9a84a700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940b3640 con 0x7fde940b4a60 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.936+0000 7fde9a84a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde940b63c0 con 0x7fde940cd980 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.936+0000 7fde93fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fde940cd980 0x7fde94159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.936+0000 7fde98de7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fde940b4eb0 0x7fde94163240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49356/0 (socket says 172.21.15.84:49356) 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.936+0000 7fde98de7700 1 -- 172.21.15.84:0/138348408 learned_addr learned my addr 172.21.15.84:0/138348408 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.937+0000 7fde93fff700 1 -- 172.21.15.84:0/138348408 >> v1:172.21.15.131:6789/0 conn(0x7fde940b4a60 legacy=0x7fde940d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.937+0000 7fde93fff700 1 -- 172.21.15.84:0/138348408 >> v1:172.21.15.84:6789/0 conn(0x7fde940b4eb0 legacy=0x7fde94163240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.937+0000 7fde93fff700 1 -- 172.21.15.84:0/138348408 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940b5320 con 0x7fde940cd980 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.937+0000 7fde93fff700 1 --2- 172.21.15.84:0/138348408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940cd980 0x7fde94159c10 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fde840098e0 tx=0x7fde840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6956fe1bf7d35a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.937+0000 7fde92ffd700 1 -- 172.21.15.84:0/138348408 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84009e80 con 0x7fde940cd980 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.937+0000 7fde92ffd700 1 -- 172.21.15.84:0/138348408 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8400b860 con 0x7fde940cd980 2023-10-06T03:01:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.937+0000 7fde92ffd700 1 -- 172.21.15.84:0/138348408 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8400bbe0 con 0x7fde940cd980 2023-10-06T03:01:44.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.938+0000 7fde9a84a700 1 -- 172.21.15.84:0/138348408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940cd980 msgr2=0x7fde94159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.938+0000 7fde9a84a700 1 --2- 172.21.15.84:0/138348408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940cd980 0x7fde94159c10 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fde840098e0 tx=0x7fde840091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.938+0000 7fde9a84a700 1 -- 172.21.15.84:0/138348408 shutdown_connections 2023-10-06T03:01:44.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.938+0000 7fde9a84a700 1 --2- 172.21.15.84:0/138348408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940cd980 0x7fde94159c10 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.938+0000 7fde9a84a700 1 -- 172.21.15.84:0/138348408 >> 172.21.15.84:0/138348408 conn(0x7fde9406ed20 msgr2=0x7fde9406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:44.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.938+0000 7fde9a84a700 1 -- 172.21.15.84:0/138348408 shutdown_connections 2023-10-06T03:01:44.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.938+0000 7fde9a84a700 1 -- 172.21.15.84:0/138348408 wait complete. 2023-10-06T03:01:44.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.939+0000 7fde9a84a700 1 Processor -- start 2023-10-06T03:01:44.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.939+0000 7fde9a84a700 1 -- start start 2023-10-06T03:01:44.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde9a84a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940b4a60 0x7fde9414c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde9a84a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde940b4eb0 0x7fde9414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde9a84a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde940cd980 0x7fde9414a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde9a84a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9415cee0 con 0x7fde940b4a60 2023-10-06T03:01:44.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde9a84a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9414c990 con 0x7fde940b4eb0 2023-10-06T03:01:44.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde9a84a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9415c5b0 con 0x7fde940cd980 2023-10-06T03:01:44.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde93fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940b4a60 0x7fde9414c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde93fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940b4a60 0x7fde9414c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48924/0 (socket says 172.21.15.84:48924) 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde93fff700 1 -- 172.21.15.84:0/3487477591 learned_addr learned my addr 172.21.15.84:0/3487477591 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde937fe700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde940b4eb0 0x7fde9414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde98de7700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde940cd980 0x7fde9414a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde93fff700 1 -- 172.21.15.84:0/3487477591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde940cd980 msgr2=0x7fde9414a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde93fff700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde940cd980 0x7fde9414a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde93fff700 1 -- 172.21.15.84:0/3487477591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde940b4eb0 msgr2=0x7fde9414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde93fff700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde940b4eb0 0x7fde9414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde93fff700 1 -- 172.21.15.84:0/3487477591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84009420 con 0x7fde940b4a60 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde93fff700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940b4a60 0x7fde9414c3b0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fde94089150 tx=0x7fde84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde7bfff700 1 -- 172.21.15.84:0/3487477591 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84011420 con 0x7fde940b4a60 2023-10-06T03:01:44.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde7bfff700 1 -- 172.21.15.84:0/3487477591 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde840115a0 con 0x7fde940b4a60 2023-10-06T03:01:44.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9415c890 con 0x7fde940b4a60 2023-10-06T03:01:44.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.940+0000 7fde7bfff700 1 -- 172.21.15.84:0/3487477591 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84011960 con 0x7fde940b4a60 2023-10-06T03:01:44.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.941+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9414af80 con 0x7fde940b4a60 2023-10-06T03:01:44.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.941+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde94064ad0 con 0x7fde940b4a60 2023-10-06T03:01:44.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.942+0000 7fde7bfff700 1 -- 172.21.15.84:0/3487477591 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde84011d10 con 0x7fde940b4a60 2023-10-06T03:01:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.942+0000 7fde7bfff700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde80066f30 0x7fde800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.942+0000 7fde7bfff700 1 -- 172.21.15.84:0/3487477591 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fde84086320 con 0x7fde940b4a60 2023-10-06T03:01:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.942+0000 7fde937fe700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde80066f30 0x7fde800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.943+0000 7fde937fe700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde80066f30 0x7fde800693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fde9415f320 tx=0x7fde88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:44.946+0000 7fde7bfff700 1 -- 172.21.15.84:0/3487477591 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde840532f0 con 0x7fde940b4a60 2023-10-06T03:01:45.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.174+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fde940b5600 con 0x7fde940b4a60 2023-10-06T03:01:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.798+0000 7fde7bfff700 1 -- 172.21.15.84:0/3487477591 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v101) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde84006cb0 con 0x7fde940b4a60 2023-10-06T03:01:45.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde80066f30 msgr2=0x7fde800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:45.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde80066f30 0x7fde800693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fde9415f320 tx=0x7fde88009040 comp rx=0 tx=0).stop 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940b4a60 msgr2=0x7fde9414c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940b4a60 0x7fde9414c3b0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fde94089150 tx=0x7fde84017000 comp rx=0 tx=0).stop 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 shutdown_connections 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fde80066f30 0x7fde800693e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fde940cd980 0x7fde9414a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde940b4a60 0x7fde9414c3b0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 --2- 172.21.15.84:0/3487477591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde940b4eb0 0x7fde9414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 >> 172.21.15.84:0/3487477591 conn(0x7fde9406ed20 msgr2=0x7fde940b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 shutdown_connections 2023-10-06T03:01:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.801+0000 7fde9a84a700 1 -- 172.21.15.84:0/3487477591 wait complete. 2023-10-06T03:01:45.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:45.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.928+0000 7f7beee98700 1 Processor -- start 2023-10-06T03:01:45.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.928+0000 7f7beee98700 1 -- start start 2023-10-06T03:01:45.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7beee98700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be81595a0 0x7f7be80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:45.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7beee98700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7be80b07a0 0x7f7be80b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:45.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7beee98700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be80b0ca0 con 0x7f7be80b49e0 2023-10-06T03:01:45.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7beee98700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be80b0f80 con 0x7f7be80b07a0 2023-10-06T03:01:45.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7beee98700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80b1260 con 0x7f7be81595a0 2023-10-06T03:01:45.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7be7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7be80b49e0 0x7f7be80aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49368/0 (socket says 172.21.15.84:49368) 2023-10-06T03:01:45.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7be7fff700 1 -- 172.21.15.84:0/1263833332 learned_addr learned my addr 172.21.15.84:0/1263833332 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7bed435700 1 --2- 172.21.15.84:0/1263833332 >> v2:172.21.15.131:3300/0 conn(0x7f7be80b07a0 0x7f7be80b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7becc34700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be81595a0 0x7f7be80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.929+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782199293 0 0) 0x7f7be80b0ca0 con 0x7f7be80b49e0 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd0003570 con 0x7f7be80b49e0 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1838944551 0 0) 0x7f7bd0003570 con 0x7f7be80b49e0 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be81595a0 msgr2=0x7f7be80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be81595a0 0x7f7be80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 >> v2:172.21.15.131:3300/0 conn(0x7f7be80b07a0 msgr2=0x7f7be80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 --2- 172.21.15.84:0/1263833332 >> v2:172.21.15.131:3300/0 conn(0x7f7be80b07a0 0x7f7be80b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80b1540 con 0x7f7be80b49e0 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f7bdc001470 con 0x7f7be80b49e0 2023-10-06T03:01:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7bed435700 1 --2- 172.21.15.84:0/1263833332 >> v2:172.21.15.131:3300/0 conn(0x7f7be80b07a0 0x7f7be80b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 >> v1:172.21.15.84:6789/0 conn(0x7f7be80b49e0 legacy=0x7f7be80aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be81595a0 0x7f7bd0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bd0003fe0 0x7f7bd0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bd0004d50 0x7f7bd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80b0f80 con 0x7f7bd0004d50 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80b1260 con 0x7f7bd0003fe0 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd000ba90 con 0x7f7be81595a0 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7bed435700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bd0004d50 0x7f7bd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7becc34700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be81595a0 0x7f7bd0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7be7fff700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bd0003fe0 0x7f7bd0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7bed435700 1 -- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be81595a0 msgr2=0x7f7bd0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7bed435700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be81595a0 0x7f7bd0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7bed435700 1 -- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bd0003fe0 msgr2=0x7f7bd0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7bed435700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bd0003fe0 0x7f7bd0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7bed435700 1 -- 172.21.15.84:0/1263833332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd0003570 con 0x7f7bd0004d50 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.930+0000 7f7bed435700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bd0004d50 0x7f7bd00051c0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009df0 tx=0x7f7be00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffdb3417211ae15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000e8c0 con 0x7f7bd0004d50 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000ea20 con 0x7f7bd0004d50 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7be77fe700 1 -- 172.21.15.84:0/1263833332 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000edc0 con 0x7f7bd0004d50 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7beee98700 1 -- 172.21.15.84:0/1263833332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bd0004d50 msgr2=0x7f7bd00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7beee98700 1 --2- 172.21.15.84:0/1263833332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bd0004d50 0x7f7bd00051c0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009df0 tx=0x7f7be00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7bed435700 1 -- 172.21.15.84:0/1263833332 reap_dead start 2023-10-06T03:01:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7beee98700 1 -- 172.21.15.84:0/1263833332 shutdown_connections 2023-10-06T03:01:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7beee98700 1 -- 172.21.15.84:0/1263833332 >> 172.21.15.84:0/1263833332 conn(0x7f7be8099830 msgr2=0x7f7be806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7beee98700 1 -- 172.21.15.84:0/1263833332 shutdown_connections 2023-10-06T03:01:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.931+0000 7f7beee98700 1 -- 172.21.15.84:0/1263833332 wait complete. 2023-10-06T03:01:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.932+0000 7f7beee98700 1 Processor -- start 2023-10-06T03:01:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.932+0000 7f7beee98700 1 -- start start 2023-10-06T03:01:45.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7beee98700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7be81515c0 0x7f7be8154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:45.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7beee98700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be8154f90 0x7f7be8169720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:45.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7beee98700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be8169c60 0x7f7be816cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:45.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7beee98700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be816a0d0 con 0x7f7be81515c0 2023-10-06T03:01:45.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7beee98700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be81545c0 con 0x7f7be8169c60 2023-10-06T03:01:45.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7beee98700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be81539b0 con 0x7f7be8154f90 2023-10-06T03:01:45.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7becc34700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7be81515c0 0x7f7be8154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:45.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7becc34700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7be81515c0 0x7f7be8154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48936/0 (socket says 172.21.15.84:48936) 2023-10-06T03:01:45.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7becc34700 1 -- 172.21.15.84:0/3527141959 learned_addr learned my addr 172.21.15.84:0/3527141959 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7be7fff700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be8154f90 0x7f7be8169720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7becc34700 1 -- 172.21.15.84:0/3527141959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be8154f90 msgr2=0x7f7be8169720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7becc34700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be8154f90 0x7f7be8169720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7becc34700 1 -- 172.21.15.84:0/3527141959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be8169c60 msgr2=0x7f7be816cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7becc34700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be8169c60 0x7f7be816cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.933+0000 7f7becc34700 1 -- 172.21.15.84:0/3527141959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be8153c90 con 0x7f7be81515c0 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.934+0000 7f7becc34700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7be81515c0 0x7f7be8154a50 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8011f50 tx=0x7f7bd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.934+0000 7f7be4ff9700 1 -- 172.21.15.84:0/3527141959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800e040 con 0x7f7be81515c0 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.934+0000 7f7be4ff9700 1 -- 172.21.15.84:0/3527141959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd800f040 con 0x7f7be81515c0 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.934+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be8153f70 con 0x7f7be81515c0 2023-10-06T03:01:45.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.934+0000 7f7be4ff9700 1 -- 172.21.15.84:0/3527141959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8015430 con 0x7f7be81515c0 2023-10-06T03:01:45.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.934+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be8151990 con 0x7f7be81515c0 2023-10-06T03:01:45.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.935+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be8064ad0 con 0x7f7be81515c0 2023-10-06T03:01:45.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.935+0000 7f7be4ff9700 1 -- 172.21.15.84:0/3527141959 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bd8015820 con 0x7f7be81515c0 2023-10-06T03:01:45.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.935+0000 7f7be4ff9700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7bd4066f30 0x7f7bd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:45.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.935+0000 7f7be4ff9700 1 -- 172.21.15.84:0/3527141959 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7bd8085540 con 0x7f7be81515c0 2023-10-06T03:01:45.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.936+0000 7f7be7fff700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7bd4066f30 0x7f7bd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:45.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.936+0000 7f7be7fff700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7bd4066f30 0x7f7bd40693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0079e0 tx=0x7f7bdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:45.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:45.940+0000 7f7be4ff9700 1 -- 172.21.15.84:0/3527141959 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bd8055fa0 con 0x7f7be81515c0 2023-10-06T03:01:46.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.167+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7be80b1820 con 0x7f7be81515c0 2023-10-06T03:01:46.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.168+0000 7f7be4ff9700 1 -- 172.21.15.84:0/3527141959 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f7bd8055b30 con 0x7f7be81515c0 2023-10-06T03:01:46.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:46.170 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":101,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":8526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:01:45.797474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:01:46.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7bd4066f30 msgr2=0x7f7bd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7bd4066f30 0x7f7bd40693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0079e0 tx=0x7f7bdc009040 comp rx=0 tx=0).stop 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7be81515c0 msgr2=0x7f7be8154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7be81515c0 0x7f7be8154a50 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8011f50 tx=0x7f7bd800b040 comp rx=0 tx=0).stop 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 shutdown_connections 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7bd4066f30 0x7f7bd40693e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be8169c60 0x7f7be816cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7be81515c0 0x7f7be8154a50 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 --2- 172.21.15.84:0/3527141959 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7be8154f90 0x7f7be8169720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 >> 172.21.15.84:0/3527141959 conn(0x7f7be8099830 msgr2=0x7f7be8068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 shutdown_connections 2023-10-06T03:01:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.170+0000 7f7beee98700 1 -- 172.21.15.84:0/3527141959 wait complete. 2023-10-06T03:01:46.173 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 101 2023-10-06T03:01:46.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.296+0000 7f350a54a700 1 Processor -- start 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.296+0000 7f350a54a700 1 -- start start 2023-10-06T03:01:46.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f350a54a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3504159480 0x7f35040b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f350a54a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35040b3610 0x7f35040cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f350a54a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35040cb7e0 con 0x7f35040cc1b0 2023-10-06T03:01:46.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f350a54a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35040b08a0 con 0x7f3504159480 2023-10-06T03:01:46.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f350a54a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35040cb190 con 0x7f35040b3610 2023-10-06T03:01:46.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f3509548700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3504159480 0x7f35040b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f3509d49700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f35040cc1b0 0x7f35040b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49370/0 (socket says 172.21.15.84:49370) 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f3509d49700 1 -- 172.21.15.84:0/3036172451 learned_addr learned my addr 172.21.15.84:0/3036172451 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f3508d47700 1 --2- 172.21.15.84:0/3036172451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35040b3610 0x7f35040cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f3509548700 1 -- 172.21.15.84:0/3036172451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35040b3610 msgr2=0x7f35040cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f3509548700 1 --2- 172.21.15.84:0/3036172451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35040b3610 0x7f35040cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f3509548700 1 -- 172.21.15.84:0/3036172451 >> v1:172.21.15.84:6789/0 conn(0x7f35040cc1b0 legacy=0x7f35040b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f34fbfff700 1 -- 172.21.15.84:0/3036172451 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708549698 0 0) 0x7f35040cb7e0 con 0x7f35040cc1b0 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f3509548700 1 -- 172.21.15.84:0/3036172451 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35040cb470 con 0x7f3504159480 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.297+0000 7f3509548700 1 --2- 172.21.15.84:0/3036172451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3504159480 0x7f35040b30d0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009e60 tx=0x7f34fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcd3180b1a7c1c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f34fbfff700 1 -- 172.21.15.84:0/3036172451 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc00e070 con 0x7f3504159480 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f34fbfff700 1 -- 172.21.15.84:0/3036172451 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc00bc30 con 0x7f3504159480 2023-10-06T03:01:46.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f34fbfff700 1 -- 172.21.15.84:0/3036172451 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc012430 con 0x7f3504159480 2023-10-06T03:01:46.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f350a54a700 1 -- 172.21.15.84:0/3036172451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3504159480 msgr2=0x7f35040b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f350a54a700 1 --2- 172.21.15.84:0/3036172451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3504159480 0x7f35040b30d0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009e60 tx=0x7f34fc009780 comp rx=0 tx=0).stop 2023-10-06T03:01:46.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f350a54a700 1 -- 172.21.15.84:0/3036172451 shutdown_connections 2023-10-06T03:01:46.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f350a54a700 1 --2- 172.21.15.84:0/3036172451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3504159480 0x7f35040b30d0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f350a54a700 1 --2- 172.21.15.84:0/3036172451 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f35040b3610 0x7f35040cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f350a54a700 1 -- 172.21.15.84:0/3036172451 >> 172.21.15.84:0/3036172451 conn(0x7f350406ed20 msgr2=0x7f350406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:46.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f350a54a700 1 -- 172.21.15.84:0/3036172451 shutdown_connections 2023-10-06T03:01:46.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.298+0000 7f350a54a700 1 -- 172.21.15.84:0/3036172451 wait complete. 2023-10-06T03:01:46.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.299+0000 7f350a54a700 1 Processor -- start 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.299+0000 7f350a54a700 1 -- start start 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f350a54a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35040b3610 0x7f3504159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f350a54a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35040cc1b0 0x7f350415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f350a54a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3504159480 0x7f35040cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f350a54a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350416d490 con 0x7f35040b3610 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f350a54a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350416c5a0 con 0x7f35040cc1b0 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f350a54a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350416c880 con 0x7f3504159480 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f3509548700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35040b3610 0x7f3504159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f3509548700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35040b3610 0x7f3504159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48960/0 (socket says 172.21.15.84:48960) 2023-10-06T03:01:46.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f3509548700 1 -- 172.21.15.84:0/1216180317 learned_addr learned my addr 172.21.15.84:0/1216180317 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f3509548700 1 -- 172.21.15.84:0/1216180317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3504159480 msgr2=0x7f35040cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f3509548700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3504159480 0x7f35040cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f3509548700 1 -- 172.21.15.84:0/1216180317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35040cc1b0 msgr2=0x7f350415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f3509548700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35040cc1b0 0x7f350415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.300+0000 7f3509548700 1 -- 172.21.15.84:0/1216180317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc009a20 con 0x7f35040b3610 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.301+0000 7f3509548700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35040b3610 0x7f3504159ad0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f3504069190 tx=0x7f34fc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.301+0000 7f34f97fa700 1 -- 172.21.15.84:0/1216180317 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc012e80 con 0x7f35040b3610 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.301+0000 7f34f97fa700 1 -- 172.21.15.84:0/1216180317 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc027470 con 0x7f35040b3610 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.301+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350416cb60 con 0x7f35040b3610 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.301+0000 7f34f97fa700 1 -- 172.21.15.84:0/1216180317 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc027810 con 0x7f35040b3610 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.301+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350416d120 con 0x7f35040b3610 2023-10-06T03:01:46.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.302+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350405f270 con 0x7f35040b3610 2023-10-06T03:01:46.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.302+0000 7f34f97fa700 1 -- 172.21.15.84:0/1216180317 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34fc024070 con 0x7f35040b3610 2023-10-06T03:01:46.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.302+0000 7f34f97fa700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f34e8066f30 0x7f34e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.303+0000 7f3508d47700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f34e8066f30 0x7f34e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.303+0000 7f34f97fa700 1 -- 172.21.15.84:0/1216180317 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f34fc0871f0 con 0x7f35040b3610 2023-10-06T03:01:46.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.303+0000 7f3508d47700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f34e8066f30 0x7f34e80693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f350415ffa0 tx=0x7f34f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:46.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.307+0000 7f34f97fa700 1 -- 172.21.15.84:0/1216180317 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34fc0541c0 con 0x7f35040b3610 2023-10-06T03:01:46.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.493+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3504159850 con 0x7f35040b3610 2023-10-06T03:01:46.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.494+0000 7f34f97fa700 1 -- 172.21.15.84:0/1216180317 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+17085 (secure 0 0 0) 0x7f34fc0577e0 con 0x7f35040b3610 2023-10-06T03:01:46.496 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:46.496 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:01:43.163738+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:39.801172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:41.118752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:46.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f34e8066f30 msgr2=0x7f34e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f34e8066f30 0x7f34e80693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f350415ffa0 tx=0x7f34f4008040 comp rx=0 tx=0).stop 2023-10-06T03:01:46.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35040b3610 msgr2=0x7f3504159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35040b3610 0x7f3504159ad0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f3504069190 tx=0x7f34fc019000 comp rx=0 tx=0).stop 2023-10-06T03:01:46.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 shutdown_connections 2023-10-06T03:01:46.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f34e8066f30 0x7f34e80693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3504159480 0x7f35040cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35040b3610 0x7f3504159ad0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 --2- 172.21.15.84:0/1216180317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35040cc1b0 0x7f350415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 >> 172.21.15.84:0/1216180317 conn(0x7f350406ed20 msgr2=0x7f35040b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:46.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 shutdown_connections 2023-10-06T03:01:46.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.496+0000 7f350a54a700 1 -- 172.21.15.84:0/1216180317 wait complete. 2023-10-06T03:01:46.510 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:01:46.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:01:46.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.622+0000 7ff3f602b700 1 Processor -- start 2023-10-06T03:01:46.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.622+0000 7ff3f602b700 1 -- start start 2023-10-06T03:01:46.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.622+0000 7ff3f602b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff3f01595a0 0x7ff3f00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.622+0000 7ff3f602b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f00b49e0 0x7ff3f00aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.622+0000 7ff3f602b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f00b0ca0 con 0x7ff3f00b07a0 2023-10-06T03:01:46.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.622+0000 7ff3f602b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00b0f80 con 0x7ff3f01595a0 2023-10-06T03:01:46.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.622+0000 7ff3f602b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00b1260 con 0x7ff3f00b49e0 2023-10-06T03:01:46.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3ef7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff3f01595a0 0x7ff3f00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3eeffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f00b49e0 0x7ff3f00aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3ef7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff3f01595a0 0x7ff3f00aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:42192/0 (socket says 172.21.15.84:42192) 2023-10-06T03:01:46.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3eeffd700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f00b49e0 0x7ff3f00aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55026/0 (socket says 172.21.15.84:55026) 2023-10-06T03:01:46.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3ef7fe700 1 -- 172.21.15.84:0/344372028 learned_addr learned my addr 172.21.15.84:0/344372028 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:46.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3effff700 1 --1- 172.21.15.84:0/344372028 >> v1:172.21.15.131:6789/0 conn(0x7ff3f00b07a0 0x7ff3f00b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:60680/0 (socket says 172.21.15.84:60680) 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3ef7fe700 1 -- 172.21.15.84:0/344372028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f00b49e0 msgr2=0x7ff3f00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3ef7fe700 1 --2- 172.21.15.84:0/344372028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f00b49e0 0x7ff3f00aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3ef7fe700 1 -- 172.21.15.84:0/344372028 >> v1:172.21.15.131:6789/0 conn(0x7ff3f00b07a0 legacy=0x7ff3f00b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3ef7fe700 1 -- 172.21.15.84:0/344372028 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00b1540 con 0x7ff3f01595a0 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.623+0000 7ff3ef7fe700 1 --2- 172.21.15.84:0/344372028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3f01595a0 0x7ff3f00aa570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009990 tx=0x7ff3e0009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1bcbd1d7582183 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3ee7fc700 1 -- 172.21.15.84:0/344372028 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0009e80 con 0x7ff3f01595a0 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3ee7fc700 1 -- 172.21.15.84:0/344372028 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e0005c10 con 0x7ff3f01595a0 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3ee7fc700 1 -- 172.21.15.84:0/344372028 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e000b650 con 0x7ff3f01595a0 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3f602b700 1 -- 172.21.15.84:0/344372028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3f01595a0 msgr2=0x7ff3f00aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3f602b700 1 --2- 172.21.15.84:0/344372028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3f01595a0 0x7ff3f00aa570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009990 tx=0x7ff3e0009220 comp rx=0 tx=0).stop 2023-10-06T03:01:46.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3f602b700 1 -- 172.21.15.84:0/344372028 shutdown_connections 2023-10-06T03:01:46.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3f602b700 1 --2- 172.21.15.84:0/344372028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3f01595a0 0x7ff3f00aa570 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3f602b700 1 --2- 172.21.15.84:0/344372028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f00b49e0 0x7ff3f00aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3f602b700 1 -- 172.21.15.84:0/344372028 >> 172.21.15.84:0/344372028 conn(0x7ff3f0099830 msgr2=0x7ff3f006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:46.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3f602b700 1 -- 172.21.15.84:0/344372028 shutdown_connections 2023-10-06T03:01:46.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.624+0000 7ff3f602b700 1 -- 172.21.15.84:0/344372028 wait complete. 2023-10-06T03:01:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.625+0000 7ff3f602b700 1 Processor -- start 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3f602b700 1 -- start start 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3f602b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b07a0 0x7ff3f0154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3f602b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3f00b49e0 0x7ff3f015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3f602b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f01595a0 0x7ff3f0154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3f602b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f014e210 con 0x7ff3f00b07a0 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3f602b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0153110 con 0x7ff3f00b49e0 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3f602b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f015ca50 con 0x7ff3f01595a0 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3ef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b07a0 0x7ff3f0154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3ef7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b07a0 0x7ff3f0154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48966/0 (socket says 172.21.15.84:48966) 2023-10-06T03:01:46.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3ef7fe700 1 -- 172.21.15.84:0/3518147464 learned_addr learned my addr 172.21.15.84:0/3518147464 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3eeffd700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3f00b49e0 0x7ff3f015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.626+0000 7ff3effff700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f01595a0 0x7ff3f0154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3ef7fe700 1 -- 172.21.15.84:0/3518147464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f01595a0 msgr2=0x7ff3f0154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3ef7fe700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f01595a0 0x7ff3f0154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3ef7fe700 1 -- 172.21.15.84:0/3518147464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3f00b49e0 msgr2=0x7ff3f015c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3ef7fe700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3f00b49e0 0x7ff3f015c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3ef7fe700 1 -- 172.21.15.84:0/3518147464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e0009480 con 0x7ff3f00b07a0 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3ef7fe700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b07a0 0x7ff3f0154100 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0011750 tx=0x7ff3e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3e77fe700 1 -- 172.21.15.84:0/3518147464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0011970 con 0x7ff3f00b07a0 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3e77fe700 1 -- 172.21.15.84:0/3518147464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e0020070 con 0x7ff3f00b07a0 2023-10-06T03:01:46.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f0153c70 con 0x7ff3f00b07a0 2023-10-06T03:01:46.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3e77fe700 1 -- 172.21.15.84:0/3518147464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0011d00 con 0x7ff3f00b07a0 2023-10-06T03:01:46.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.627+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f0153620 con 0x7ff3f00b07a0 2023-10-06T03:01:46.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.628+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f0064ad0 con 0x7ff3f00b07a0 2023-10-06T03:01:46.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.628+0000 7ff3e77fe700 1 -- 172.21.15.84:0/3518147464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3e0022030 con 0x7ff3f00b07a0 2023-10-06T03:01:46.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.629+0000 7ff3e77fe700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff3d0066f30 0x7ff3d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.629+0000 7ff3e77fe700 1 -- 172.21.15.84:0/3518147464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff3e00861f0 con 0x7ff3f00b07a0 2023-10-06T03:01:46.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.629+0000 7ff3eeffd700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff3d0066f30 0x7ff3d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.629+0000 7ff3eeffd700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff3d0066f30 0x7ff3d00693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff3f016d060 tx=0x7ff3d80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:46.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.633+0000 7ff3e77fe700 1 -- 172.21.15.84:0/3518147464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3e00531c0 con 0x7ff3f00b07a0 2023-10-06T03:01:46.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.813+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3f00b1820 con 0x7ff3d0066f30 2023-10-06T03:01:46.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.822+0000 7ff3e77fe700 1 -- 172.21.15.84:0/3518147464 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312433 (secure 0 0 0) 0x7ff3f00b1820 con 0x7ff3d0066f30 2023-10-06T03:01:46.827 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:46.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff3d0066f30 msgr2=0x7ff3d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff3d0066f30 0x7ff3d00693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff3f016d060 tx=0x7ff3d80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b07a0 msgr2=0x7ff3f0154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b07a0 0x7ff3f0154100 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0011750 tx=0x7ff3e0016000 comp rx=0 tx=0).stop 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 shutdown_connections 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff3d0066f30 0x7ff3d00693e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff3f01595a0 0x7ff3f0154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b07a0 0x7ff3f0154100 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 --2- 172.21.15.84:0/3518147464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3f00b49e0 0x7ff3f015c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 >> 172.21.15.84:0/3518147464 conn(0x7ff3f0099830 msgr2=0x7ff3f01589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:46.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 shutdown_connections 2023-10-06T03:01:46.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.825+0000 7ff3f602b700 1 -- 172.21.15.84:0/3518147464 wait complete. 2023-10-06T03:01:46.831 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:01:46.839 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2023-10-06T03:01:45.889044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2393800,"kb_used_data":11400,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752580920,"statfs":{"total":773094113280,"available":770642862080,"internally_reserved":0,"allocated":11673600,"data_stored":6212476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.123061"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.185349+0000","last_change":"2023-10-06T03:01:42.185349+0000","last_active":"2023-10-06T03:01:42.185349+0000","last_peered":"2023-10-06T03:01:42.185349+0000","last_clean":"2023-10-06T03:01:42.185349+0000","last_became_active":"2023-10-06T03:01:42.185063+0000","last_became_peered":"2023-10-06T03:01:42.185063+0000","last_unstale":"2023-10-06T03:01:42.185349+0000","last_undegraded":"2023-10-06T03:01:42.185349+0000","last_fullsized":"2023-10-06T03:01:42.185349+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:07.869848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.181582+0000","last_change":"2023-10-06T03:01:42.181582+0000","last_active":"2023-10-06T03:01:42.181582+0000","last_peered":"2023-10-06T03:01:42.181582+0000","last_clean":"2023-10-06T03:01:42.181582+0000","last_became_active":"2023-10-06T03:01:42.181196+0000","last_became_peered":"2023-10-06T03:01:42.181196+0000","last_unstale":"2023-10-06T03:01:42.181582+0000","last_undegraded":"2023-10-06T03:01:42.181582+0000","last_fullsized":"2023-10-06T03:01:42.181582+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:24.317178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.189634+0000","last_change":"2023-10-06T03:01:42.189634+0000","last_active":"2023-10-06T03:01:42.189634+0000","last_peered":"2023-10-06T03:01:42.189634+0000","last_clean":"2023-10-06T03:01:42.189634+0000","last_became_active":"2023-10-06T03:01:42.189367+0000","last_became_peered":"2023-10-06T03:01:42.189367+0000","last_unstale":"2023-10-06T03:01:42.189634+0000","last_undegraded":"2023-10-06T03:01:42.189634+0000","last_fullsized":"2023-10-06T03:01:42.189634+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:27.234365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183207+0000","last_change":"2023-10-06T03:01:42.183207+0000","last_active":"2023-10-06T03:01:42.183207+0000","last_peered":"2023-10-06T03:01:42.183207+0000","last_clean":"2023-10-06T03:01:42.183207+0000","last_became_active":"2023-10-06T03:01:42.182650+0000","last_became_peered":"2023-10-06T03:01:42.182650+0000","last_unstale":"2023-10-06T03:01:42.183207+0000","last_undegraded":"2023-10-06T03:01:42.183207+0000","last_fullsized":"2023-10-06T03:01:42.183207+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:10.216752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176381+0000","last_change":"2023-10-06T03:01:42.176381+0000","last_active":"2023-10-06T03:01:42.176381+0000","last_peered":"2023-10-06T03:01:42.176381+0000","last_clean":"2023-10-06T03:01:42.176381+0000","last_became_active":"2023-10-06T03:01:42.176123+0000","last_became_peered":"2023-10-06T03:01:42.176123+0000","last_unstale":"2023-10-06T03:01:42.176381+0000","last_undegraded":"2023-10-06T03:01:42.176381+0000","last_fullsized":"2023-10-06T03:01:42.176381+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:28.804847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178049+0000","last_change":"2023-10-06T03:01:42.176924+0000","last_active":"2023-10-06T03:01:42.178049+0000","last_peered":"2023-10-06T03:01:42.178049+0000","last_clean":"2023-10-06T03:01:42.178049+0000","last_became_active":"2023-10-06T03:01:42.176662+0000","last_became_peered":"2023-10-06T03:01:42.176662+0000","last_unstale":"2023-10-06T03:01:42.178049+0000","last_undegraded":"2023-10-06T03:01:42.178049+0000","last_fullsized":"2023-10-06T03:01:42.178049+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:25.903243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186258+0000","last_change":"2023-10-06T03:01:42.186258+0000","last_active":"2023-10-06T03:01:42.186258+0000","last_peered":"2023-10-06T03:01:42.186258+0000","last_clean":"2023-10-06T03:01:42.186258+0000","last_became_active":"2023-10-06T03:01:42.185808+0000","last_became_peered":"2023-10-06T03:01:42.185808+0000","last_unstale":"2023-10-06T03:01:42.186258+0000","last_undegraded":"2023-10-06T03:01:42.186258+0000","last_fullsized":"2023-10-06T03:01:42.186258+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:19.028513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.188826+0000","last_change":"2023-10-06T03:01:42.188826+0000","last_active":"2023-10-06T03:01:42.188826+0000","last_peered":"2023-10-06T03:01:42.188826+0000","last_clean":"2023-10-06T03:01:42.188826+0000","last_became_active":"2023-10-06T03:01:42.188276+0000","last_became_peered":"2023-10-06T03:01:42.188276+0000","last_unstale":"2023-10-06T03:01:42.188826+0000","last_undegraded":"2023-10-06T03:01:42.188826+0000","last_fullsized":"2023-10-06T03:01:42.188826+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:26.249907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.180229+0000","last_change":"2023-10-06T03:01:42.180229+0000","last_active":"2023-10-06T03:01:42.180229+0000","last_peered":"2023-10-06T03:01:42.180229+0000","last_clean":"2023-10-06T03:01:42.180229+0000","last_became_active":"2023-10-06T03:01:42.178260+0000","last_became_peered":"2023-10-06T03:01:42.178260+0000","last_unstale":"2023-10-06T03:01:42.180229+0000","last_undegraded":"2023-10-06T03:01:42.180229+0000","last_fullsized":"2023-10-06T03:01:42.180229+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:33.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.180344+0000","last_change":"2023-10-06T03:01:42.180344+0000","last_active":"2023-10-06T03:01:42.180344+0000","last_peered":"2023-10-06T03:01:42.180344+0000","last_clean":"2023-10-06T03:01:42.180344+0000","last_became_active":"2023-10-06T03:01:42.179385+0000","last_became_peered":"2023-10-06T03:01:42.179385+0000","last_unstale":"2023-10-06T03:01:42.180344+0000","last_undegraded":"2023-10-06T03:01:42.180344+0000","last_fullsized":"2023-10-06T03:01:42.180344+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:54.700670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187699+0000","last_change":"2023-10-06T03:01:42.187699+0000","last_active":"2023-10-06T03:01:42.187699+0000","last_peered":"2023-10-06T03:01:42.187699+0000","last_clean":"2023-10-06T03:01:42.187699+0000","last_became_active":"2023-10-06T03:01:42.187421+0000","last_became_peered":"2023-10-06T03:01:42.187421+0000","last_unstale":"2023-10-06T03:01:42.187699+0000","last_undegraded":"2023-10-06T03:01:42.187699+0000","last_fullsized":"2023-10-06T03:01:42.187699+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:26.249907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178886+0000","last_change":"2023-10-06T03:01:42.178886+0000","last_active":"2023-10-06T03:01:42.178886+0000","last_peered":"2023-10-06T03:01:42.178886+0000","last_clean":"2023-10-06T03:01:42.178886+0000","last_became_active":"2023-10-06T03:01:42.178643+0000","last_became_peered":"2023-10-06T03:01:42.178643+0000","last_unstale":"2023-10-06T03:01:42.178886+0000","last_undegraded":"2023-10-06T03:01:42.178886+0000","last_fullsized":"2023-10-06T03:01:42.178886+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:04.289816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184952+0000","last_change":"2023-10-06T03:01:42.184952+0000","last_active":"2023-10-06T03:01:42.184952+0000","last_peered":"2023-10-06T03:01:42.184952+0000","last_clean":"2023-10-06T03:01:42.184952+0000","last_became_active":"2023-10-06T03:01:42.184715+0000","last_became_peered":"2023-10-06T03:01:42.184715+0000","last_unstale":"2023-10-06T03:01:42.184952+0000","last_undegraded":"2023-10-06T03:01:42.184952+0000","last_fullsized":"2023-10-06T03:01:42.184952+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:25.997488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.189270+0000","last_change":"2023-10-06T03:01:42.189270+0000","last_active":"2023-10-06T03:01:42.189270+0000","last_peered":"2023-10-06T03:01:42.189270+0000","last_clean":"2023-10-06T03:01:42.189270+0000","last_became_active":"2023-10-06T03:01:42.187362+0000","last_became_peered":"2023-10-06T03:01:42.187362+0000","last_unstale":"2023-10-06T03:01:42.189270+0000","last_undegraded":"2023-10-06T03:01:42.189270+0000","last_fullsized":"2023-10-06T03:01:42.189270+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:27.193208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.180989+0000","last_change":"2023-10-06T03:01:42.177826+0000","last_active":"2023-10-06T03:01:42.180989+0000","last_peered":"2023-10-06T03:01:42.180989+0000","last_clean":"2023-10-06T03:01:42.180989+0000","last_became_active":"2023-10-06T03:01:42.177528+0000","last_became_peered":"2023-10-06T03:01:42.177528+0000","last_unstale":"2023-10-06T03:01:42.180989+0000","last_undegraded":"2023-10-06T03:01:42.180989+0000","last_fullsized":"2023-10-06T03:01:42.180989+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:28.804847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.189852+0000","last_change":"2023-10-06T03:01:42.189852+0000","last_active":"2023-10-06T03:01:42.189852+0000","last_peered":"2023-10-06T03:01:42.189852+0000","last_clean":"2023-10-06T03:01:42.189852+0000","last_became_active":"2023-10-06T03:01:42.189585+0000","last_became_peered":"2023-10-06T03:01:42.189585+0000","last_unstale":"2023-10-06T03:01:42.189852+0000","last_undegraded":"2023-10-06T03:01:42.189852+0000","last_fullsized":"2023-10-06T03:01:42.189852+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:59.060184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186522+0000","last_change":"2023-10-06T03:01:42.186522+0000","last_active":"2023-10-06T03:01:42.186522+0000","last_peered":"2023-10-06T03:01:42.186522+0000","last_clean":"2023-10-06T03:01:42.186522+0000","last_became_active":"2023-10-06T03:01:42.186065+0000","last_became_peered":"2023-10-06T03:01:42.186065+0000","last_unstale":"2023-10-06T03:01:42.186522+0000","last_undegraded":"2023-10-06T03:01:42.186522+0000","last_fullsized":"2023-10-06T03:01:42.186522+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:53.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186423+0000","last_change":"2023-10-06T03:01:42.182758+0000","last_active":"2023-10-06T03:01:42.186423+0000","last_peered":"2023-10-06T03:01:42.186423+0000","last_clean":"2023-10-06T03:01:42.186423+0000","last_became_active":"2023-10-06T03:01:42.182520+0000","last_became_peered":"2023-10-06T03:01:42.182520+0000","last_unstale":"2023-10-06T03:01:42.186423+0000","last_undegraded":"2023-10-06T03:01:42.186423+0000","last_fullsized":"2023-10-06T03:01:42.186423+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:49.882416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187068+0000","last_change":"2023-10-06T03:01:42.187068+0000","last_active":"2023-10-06T03:01:42.187068+0000","last_peered":"2023-10-06T03:01:42.187068+0000","last_clean":"2023-10-06T03:01:42.187068+0000","last_became_active":"2023-10-06T03:01:42.186777+0000","last_became_peered":"2023-10-06T03:01:42.186777+0000","last_unstale":"2023-10-06T03:01:42.187068+0000","last_undegraded":"2023-10-06T03:01:42.187068+0000","last_fullsized":"2023-10-06T03:01:42.187068+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:18.133519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.185312+0000","last_change":"2023-10-06T03:01:42.185312+0000","last_active":"2023-10-06T03:01:42.185312+0000","last_peered":"2023-10-06T03:01:42.185312+0000","last_clean":"2023-10-06T03:01:42.185312+0000","last_became_active":"2023-10-06T03:01:42.184293+0000","last_became_peered":"2023-10-06T03:01:42.184293+0000","last_unstale":"2023-10-06T03:01:42.185312+0000","last_undegraded":"2023-10-06T03:01:42.185312+0000","last_fullsized":"2023-10-06T03:01:42.185312+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:54.887916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.182477+0000","last_change":"2023-10-06T03:01:42.182477+0000","last_active":"2023-10-06T03:01:42.182477+0000","last_peered":"2023-10-06T03:01:42.182477+0000","last_clean":"2023-10-06T03:01:42.182477+0000","last_became_active":"2023-10-06T03:01:42.182225+0000","last_became_peered":"2023-10-06T03:01:42.182225+0000","last_unstale":"2023-10-06T03:01:42.182477+0000","last_undegraded":"2023-10-06T03:01:42.182477+0000","last_fullsized":"2023-10-06T03:01:42.182477+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:28.087688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187997+0000","last_change":"2023-10-06T03:01:42.187649+0000","last_active":"2023-10-06T03:01:42.187997+0000","last_peered":"2023-10-06T03:01:42.187997+0000","last_clean":"2023-10-06T03:01:42.187997+0000","last_became_active":"2023-10-06T03:01:42.187306+0000","last_became_peered":"2023-10-06T03:01:42.187306+0000","last_unstale":"2023-10-06T03:01:42.187997+0000","last_undegraded":"2023-10-06T03:01:42.187997+0000","last_fullsized":"2023-10-06T03:01:42.187997+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:26.249907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184869+0000","last_change":"2023-10-06T03:01:42.184869+0000","last_active":"2023-10-06T03:01:42.184869+0000","last_peered":"2023-10-06T03:01:42.184869+0000","last_clean":"2023-10-06T03:01:42.184869+0000","last_became_active":"2023-10-06T03:01:42.184670+0000","last_became_peered":"2023-10-06T03:01:42.184670+0000","last_unstale":"2023-10-06T03:01:42.184869+0000","last_undegraded":"2023-10-06T03:01:42.184869+0000","last_fullsized":"2023-10-06T03:01:42.184869+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:28.869361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.190371+0000","last_change":"2023-10-06T03:01:42.189845+0000","last_active":"2023-10-06T03:01:42.190371+0000","last_peered":"2023-10-06T03:01:42.190371+0000","last_clean":"2023-10-06T03:01:42.190371+0000","last_became_active":"2023-10-06T03:01:42.189585+0000","last_became_peered":"2023-10-06T03:01:42.189585+0000","last_unstale":"2023-10-06T03:01:42.190371+0000","last_undegraded":"2023-10-06T03:01:42.190371+0000","last_fullsized":"2023-10-06T03:01:42.190371+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:18.133519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186642+0000","last_change":"2023-10-06T03:01:42.186642+0000","last_active":"2023-10-06T03:01:42.186642+0000","last_peered":"2023-10-06T03:01:42.186642+0000","last_clean":"2023-10-06T03:01:42.186642+0000","last_became_active":"2023-10-06T03:01:42.186398+0000","last_became_peered":"2023-10-06T03:01:42.186398+0000","last_unstale":"2023-10-06T03:01:42.186642+0000","last_undegraded":"2023-10-06T03:01:42.186642+0000","last_fullsized":"2023-10-06T03:01:42.186642+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:33.197809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184785+0000","last_change":"2023-10-06T03:01:42.184785+0000","last_active":"2023-10-06T03:01:42.184785+0000","last_peered":"2023-10-06T03:01:42.184785+0000","last_clean":"2023-10-06T03:01:42.184785+0000","last_became_active":"2023-10-06T03:01:42.183367+0000","last_became_peered":"2023-10-06T03:01:42.183367+0000","last_unstale":"2023-10-06T03:01:42.184785+0000","last_undegraded":"2023-10-06T03:01:42.184785+0000","last_fullsized":"2023-10-06T03:01:42.184785+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:46.400031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.182631+0000","last_change":"2023-10-06T03:01:42.180157+0000","last_active":"2023-10-06T03:01:42.182631+0000","last_peered":"2023-10-06T03:01:42.182631+0000","last_clean":"2023-10-06T03:01:42.182631+0000","last_became_active":"2023-10-06T03:01:42.179938+0000","last_became_peered":"2023-10-06T03:01:42.179938+0000","last_unstale":"2023-10-06T03:01:42.182631+0000","last_undegraded":"2023-10-06T03:01:42.182631+0000","last_fullsized":"2023-10-06T03:01:42.182631+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:57.941776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.185205+0000","last_change":"2023-10-06T03:01:42.183078+0000","last_active":"2023-10-06T03:01:42.185205+0000","last_peered":"2023-10-06T03:01:42.185205+0000","last_clean":"2023-10-06T03:01:42.185205+0000","last_became_active":"2023-10-06T03:01:42.182844+0000","last_became_peered":"2023-10-06T03:01:42.182844+0000","last_unstale":"2023-10-06T03:01:42.185205+0000","last_undegraded":"2023-10-06T03:01:42.185205+0000","last_fullsized":"2023-10-06T03:01:42.185205+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:28.869361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184559+0000","last_change":"2023-10-06T03:01:42.184559+0000","last_active":"2023-10-06T03:01:42.184559+0000","last_peered":"2023-10-06T03:01:42.184559+0000","last_clean":"2023-10-06T03:01:42.184559+0000","last_became_active":"2023-10-06T03:01:42.184321+0000","last_became_peered":"2023-10-06T03:01:42.184321+0000","last_unstale":"2023-10-06T03:01:42.184559+0000","last_undegraded":"2023-10-06T03:01:42.184559+0000","last_fullsized":"2023-10-06T03:01:42.184559+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:55.852111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176816+0000","last_change":"2023-10-06T03:01:42.176816+0000","last_active":"2023-10-06T03:01:42.176816+0000","last_peered":"2023-10-06T03:01:42.176816+0000","last_clean":"2023-10-06T03:01:42.176816+0000","last_became_active":"2023-10-06T03:01:42.176620+0000","last_became_peered":"2023-10-06T03:01:42.176620+0000","last_unstale":"2023-10-06T03:01:42.176816+0000","last_undegraded":"2023-10-06T03:01:42.176816+0000","last_fullsized":"2023-10-06T03:01:42.176816+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:10.191829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183645+0000","last_change":"2023-10-06T03:01:42.183645+0000","last_active":"2023-10-06T03:01:42.183645+0000","last_peered":"2023-10-06T03:01:42.183645+0000","last_clean":"2023-10-06T03:01:42.183645+0000","last_became_active":"2023-10-06T03:01:42.183397+0000","last_became_peered":"2023-10-06T03:01:42.183397+0000","last_unstale":"2023-10-06T03:01:42.183645+0000","last_undegraded":"2023-10-06T03:01:42.183645+0000","last_fullsized":"2023-10-06T03:01:42.183645+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:44.974082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176842+0000","last_change":"2023-10-06T03:01:42.174963+0000","last_active":"2023-10-06T03:01:42.176842+0000","last_peered":"2023-10-06T03:01:42.176842+0000","last_clean":"2023-10-06T03:01:42.176842+0000","last_became_active":"2023-10-06T03:01:42.174750+0000","last_became_peered":"2023-10-06T03:01:42.174750+0000","last_unstale":"2023-10-06T03:01:42.176842+0000","last_undegraded":"2023-10-06T03:01:42.176842+0000","last_fullsized":"2023-10-06T03:01:42.176842+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:15.426868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.181852+0000","last_change":"2023-10-06T03:01:42.178808+0000","last_active":"2023-10-06T03:01:42.181852+0000","last_peered":"2023-10-06T03:01:42.181852+0000","last_clean":"2023-10-06T03:01:42.181852+0000","last_became_active":"2023-10-06T03:01:42.178531+0000","last_became_peered":"2023-10-06T03:01:42.178531+0000","last_unstale":"2023-10-06T03:01:42.181852+0000","last_undegraded":"2023-10-06T03:01:42.181852+0000","last_fullsized":"2023-10-06T03:01:42.181852+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:13.816346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"105'4","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.794339+0000","last_change":"2023-10-06T03:01:41.793013+0000","last_active":"2023-10-06T03:01:42.794339+0000","last_peered":"2023-10-06T03:01:42.794339+0000","last_clean":"2023-10-06T03:01:42.794339+0000","last_became_active":"2023-10-06T03:01:41.792711+0000","last_became_peered":"2023-10-06T03:01:41.792711+0000","last_unstale":"2023-10-06T03:01:42.794339+0000","last_undegraded":"2023-10-06T03:01:42.794339+0000","last_fullsized":"2023-10-06T03:01:42.794339+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:56.937198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187520+0000","last_change":"2023-10-06T03:01:42.184825+0000","last_active":"2023-10-06T03:01:42.187520+0000","last_peered":"2023-10-06T03:01:42.187520+0000","last_clean":"2023-10-06T03:01:42.187520+0000","last_became_active":"2023-10-06T03:01:42.184449+0000","last_became_peered":"2023-10-06T03:01:42.184449+0000","last_unstale":"2023-10-06T03:01:42.187520+0000","last_undegraded":"2023-10-06T03:01:42.187520+0000","last_fullsized":"2023-10-06T03:01:42.187520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:27.456257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"105'1","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178857+0000","last_change":"2023-10-06T03:01:41.791140+0000","last_active":"2023-10-06T03:01:42.178857+0000","last_peered":"2023-10-06T03:01:42.178857+0000","last_clean":"2023-10-06T03:01:42.178857+0000","last_became_active":"2023-10-06T03:01:41.790854+0000","last_became_peered":"2023-10-06T03:01:41.790854+0000","last_unstale":"2023-10-06T03:01:42.178857+0000","last_undegraded":"2023-10-06T03:01:42.178857+0000","last_fullsized":"2023-10-06T03:01:42.178857+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:13.961202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176810+0000","last_change":"2023-10-06T03:01:42.174962+0000","last_active":"2023-10-06T03:01:42.176810+0000","last_peered":"2023-10-06T03:01:42.176810+0000","last_clean":"2023-10-06T03:01:42.176810+0000","last_became_active":"2023-10-06T03:01:42.174712+0000","last_became_peered":"2023-10-06T03:01:42.174712+0000","last_unstale":"2023-10-06T03:01:42.176810+0000","last_undegraded":"2023-10-06T03:01:42.176810+0000","last_fullsized":"2023-10-06T03:01:42.176810+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:48.468387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"105'2","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.792723+0000","last_change":"2023-10-06T03:01:41.796642+0000","last_active":"2023-10-06T03:01:42.792723+0000","last_peered":"2023-10-06T03:01:42.792723+0000","last_clean":"2023-10-06T03:01:42.792723+0000","last_became_active":"2023-10-06T03:01:41.796383+0000","last_became_peered":"2023-10-06T03:01:41.796383+0000","last_unstale":"2023-10-06T03:01:42.792723+0000","last_undegraded":"2023-10-06T03:01:42.792723+0000","last_fullsized":"2023-10-06T03:01:42.792723+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:44:43.884709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.188367+0000","last_change":"2023-10-06T03:01:42.188367+0000","last_active":"2023-10-06T03:01:42.188367+0000","last_peered":"2023-10-06T03:01:42.188367+0000","last_clean":"2023-10-06T03:01:42.188367+0000","last_became_active":"2023-10-06T03:01:42.188184+0000","last_became_peered":"2023-10-06T03:01:42.188184+0000","last_unstale":"2023-10-06T03:01:42.188367+0000","last_undegraded":"2023-10-06T03:01:42.188367+0000","last_fullsized":"2023-10-06T03:01:42.188367+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:38.185997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"105'2","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.792598+0000","last_change":"2023-10-06T03:01:41.795546+0000","last_active":"2023-10-06T03:01:42.792598+0000","last_peered":"2023-10-06T03:01:42.792598+0000","last_clean":"2023-10-06T03:01:42.792598+0000","last_became_active":"2023-10-06T03:01:41.795298+0000","last_became_peered":"2023-10-06T03:01:41.795298+0000","last_unstale":"2023-10-06T03:01:42.792598+0000","last_undegraded":"2023-10-06T03:01:42.792598+0000","last_fullsized":"2023-10-06T03:01:42.792598+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:07:04.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178673+0000","last_change":"2023-10-06T03:01:42.178673+0000","last_active":"2023-10-06T03:01:42.178673+0000","last_peered":"2023-10-06T03:01:42.178673+0000","last_clean":"2023-10-06T03:01:42.178673+0000","last_became_active":"2023-10-06T03:01:42.178425+0000","last_became_peered":"2023-10-06T03:01:42.178425+0000","last_unstale":"2023-10-06T03:01:42.178673+0000","last_undegraded":"2023-10-06T03:01:42.178673+0000","last_fullsized":"2023-10-06T03:01:42.178673+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:35.356457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"105'1","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.172307+0000","last_change":"2023-10-06T03:01:41.796502+0000","last_active":"2023-10-06T03:01:42.172307+0000","last_peered":"2023-10-06T03:01:42.172307+0000","last_clean":"2023-10-06T03:01:42.172307+0000","last_became_active":"2023-10-06T03:01:41.796201+0000","last_became_peered":"2023-10-06T03:01:41.796201+0000","last_unstale":"2023-10-06T03:01:42.172307+0000","last_undegraded":"2023-10-06T03:01:42.172307+0000","last_fullsized":"2023-10-06T03:01:42.172307+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:09.103882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.182184+0000","last_change":"2023-10-06T03:01:42.182184+0000","last_active":"2023-10-06T03:01:42.182184+0000","last_peered":"2023-10-06T03:01:42.182184+0000","last_clean":"2023-10-06T03:01:42.182184+0000","last_became_active":"2023-10-06T03:01:42.181624+0000","last_became_peered":"2023-10-06T03:01:42.181624+0000","last_unstale":"2023-10-06T03:01:42.182184+0000","last_undegraded":"2023-10-06T03:01:42.182184+0000","last_fullsized":"2023-10-06T03:01:42.182184+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:09.873679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"105'1","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.792859+0000","last_change":"2023-10-06T03:01:41.795066+0000","last_active":"2023-10-06T03:01:42.792859+0000","last_peered":"2023-10-06T03:01:42.792859+0000","last_clean":"2023-10-06T03:01:42.792859+0000","last_became_active":"2023-10-06T03:01:41.794828+0000","last_became_peered":"2023-10-06T03:01:41.794828+0000","last_unstale":"2023-10-06T03:01:42.792859+0000","last_undegraded":"2023-10-06T03:01:42.792859+0000","last_fullsized":"2023-10-06T03:01:42.792859+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:01.485397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176564+0000","last_change":"2023-10-06T03:01:42.176564+0000","last_active":"2023-10-06T03:01:42.176564+0000","last_peered":"2023-10-06T03:01:42.176564+0000","last_clean":"2023-10-06T03:01:42.176564+0000","last_became_active":"2023-10-06T03:01:42.176306+0000","last_became_peered":"2023-10-06T03:01:42.176306+0000","last_unstale":"2023-10-06T03:01:42.176564+0000","last_undegraded":"2023-10-06T03:01:42.176564+0000","last_fullsized":"2023-10-06T03:01:42.176564+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:06.673143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.795365+0000","last_change":"2023-10-06T03:01:41.787840+0000","last_active":"2023-10-06T03:01:41.795365+0000","last_peered":"2023-10-06T03:01:41.795365+0000","last_clean":"2023-10-06T03:01:41.795365+0000","last_became_active":"2023-10-06T03:01:41.787551+0000","last_became_peered":"2023-10-06T03:01:41.787551+0000","last_unstale":"2023-10-06T03:01:41.795365+0000","last_undegraded":"2023-10-06T03:01:41.795365+0000","last_fullsized":"2023-10-06T03:01:41.795365+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:04.618299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186073+0000","last_change":"2023-10-06T03:01:42.186073+0000","last_active":"2023-10-06T03:01:42.186073+0000","last_peered":"2023-10-06T03:01:42.186073+0000","last_clean":"2023-10-06T03:01:42.186073+0000","last_became_active":"2023-10-06T03:01:42.185499+0000","last_became_peered":"2023-10-06T03:01:42.185499+0000","last_unstale":"2023-10-06T03:01:42.186073+0000","last_undegraded":"2023-10-06T03:01:42.186073+0000","last_fullsized":"2023-10-06T03:01:42.186073+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:05.430127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.796130+0000","last_change":"2023-10-06T03:01:41.791952+0000","last_active":"2023-10-06T03:01:41.796130+0000","last_peered":"2023-10-06T03:01:41.796130+0000","last_clean":"2023-10-06T03:01:41.796130+0000","last_became_active":"2023-10-06T03:01:41.791228+0000","last_became_peered":"2023-10-06T03:01:41.791228+0000","last_unstale":"2023-10-06T03:01:41.796130+0000","last_undegraded":"2023-10-06T03:01:41.796130+0000","last_fullsized":"2023-10-06T03:01:41.796130+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:53.883338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.179698+0000","last_change":"2023-10-06T03:01:42.179698+0000","last_active":"2023-10-06T03:01:42.179698+0000","last_peered":"2023-10-06T03:01:42.179698+0000","last_clean":"2023-10-06T03:01:42.179698+0000","last_became_active":"2023-10-06T03:01:42.179211+0000","last_became_peered":"2023-10-06T03:01:42.179211+0000","last_unstale":"2023-10-06T03:01:42.179698+0000","last_undegraded":"2023-10-06T03:01:42.179698+0000","last_fullsized":"2023-10-06T03:01:42.179698+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:25.903243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"105'1","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.168183+0000","last_change":"2023-10-06T03:01:41.792731+0000","last_active":"2023-10-06T03:01:42.168183+0000","last_peered":"2023-10-06T03:01:42.168183+0000","last_clean":"2023-10-06T03:01:42.168183+0000","last_became_active":"2023-10-06T03:01:41.792472+0000","last_became_peered":"2023-10-06T03:01:41.792472+0000","last_unstale":"2023-10-06T03:01:42.168183+0000","last_undegraded":"2023-10-06T03:01:42.168183+0000","last_fullsized":"2023-10-06T03:01:42.168183+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:54.847532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183861+0000","last_change":"2023-10-06T03:01:42.180689+0000","last_active":"2023-10-06T03:01:42.183861+0000","last_peered":"2023-10-06T03:01:42.183861+0000","last_clean":"2023-10-06T03:01:42.183861+0000","last_became_active":"2023-10-06T03:01:42.180433+0000","last_became_peered":"2023-10-06T03:01:42.180433+0000","last_unstale":"2023-10-06T03:01:42.183861+0000","last_undegraded":"2023-10-06T03:01:42.183861+0000","last_fullsized":"2023-10-06T03:01:42.183861+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:49.394400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"105'2","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.788556+0000","last_change":"2023-10-06T03:01:41.797317+0000","last_active":"2023-10-06T03:01:42.788556+0000","last_peered":"2023-10-06T03:01:42.788556+0000","last_clean":"2023-10-06T03:01:42.788556+0000","last_became_active":"2023-10-06T03:01:41.797062+0000","last_became_peered":"2023-10-06T03:01:41.797062+0000","last_unstale":"2023-10-06T03:01:42.788556+0000","last_undegraded":"2023-10-06T03:01:42.788556+0000","last_fullsized":"2023-10-06T03:01:42.788556+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:37.684621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.190080+0000","last_change":"2023-10-06T03:01:42.190080+0000","last_active":"2023-10-06T03:01:42.190080+0000","last_peered":"2023-10-06T03:01:42.190080+0000","last_clean":"2023-10-06T03:01:42.190080+0000","last_became_active":"2023-10-06T03:01:42.189734+0000","last_became_peered":"2023-10-06T03:01:42.189734+0000","last_unstale":"2023-10-06T03:01:42.190080+0000","last_undegraded":"2023-10-06T03:01:42.190080+0000","last_fullsized":"2023-10-06T03:01:42.190080+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:28.869361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"105'1","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.794629+0000","last_change":"2023-10-06T03:01:41.789572+0000","last_active":"2023-10-06T03:01:42.794629+0000","last_peered":"2023-10-06T03:01:42.794629+0000","last_clean":"2023-10-06T03:01:42.794629+0000","last_became_active":"2023-10-06T03:01:41.789334+0000","last_became_peered":"2023-10-06T03:01:41.789334+0000","last_unstale":"2023-10-06T03:01:42.794629+0000","last_undegraded":"2023-10-06T03:01:42.794629+0000","last_fullsized":"2023-10-06T03:01:42.794629+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:04.425548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.191446+0000","last_change":"2023-10-06T03:01:42.191446+0000","last_active":"2023-10-06T03:01:42.191446+0000","last_peered":"2023-10-06T03:01:42.191446+0000","last_clean":"2023-10-06T03:01:42.191446+0000","last_became_active":"2023-10-06T03:01:42.191150+0000","last_became_peered":"2023-10-06T03:01:42.191150+0000","last_unstale":"2023-10-06T03:01:42.191446+0000","last_undegraded":"2023-10-06T03:01:42.191446+0000","last_fullsized":"2023-10-06T03:01:42.191446+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:23.876224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798231+0000","last_change":"2023-10-06T03:01:41.793538+0000","last_active":"2023-10-06T03:01:41.798231+0000","last_peered":"2023-10-06T03:01:41.798231+0000","last_clean":"2023-10-06T03:01:41.798231+0000","last_became_active":"2023-10-06T03:01:41.793272+0000","last_became_peered":"2023-10-06T03:01:41.793272+0000","last_unstale":"2023-10-06T03:01:41.798231+0000","last_undegraded":"2023-10-06T03:01:41.798231+0000","last_fullsized":"2023-10-06T03:01:41.798231+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:47.463809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.190210+0000","last_change":"2023-10-06T03:01:42.190210+0000","last_active":"2023-10-06T03:01:42.190210+0000","last_peered":"2023-10-06T03:01:42.190210+0000","last_clean":"2023-10-06T03:01:42.190210+0000","last_became_active":"2023-10-06T03:01:42.189531+0000","last_became_peered":"2023-10-06T03:01:42.189531+0000","last_unstale":"2023-10-06T03:01:42.190210+0000","last_undegraded":"2023-10-06T03:01:42.190210+0000","last_fullsized":"2023-10-06T03:01:42.190210+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:32.044071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"105'2","reported_seq":12,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.801858+0000","last_change":"2023-10-06T03:01:41.794060+0000","last_active":"2023-10-06T03:01:42.801858+0000","last_peered":"2023-10-06T03:01:42.801858+0000","last_clean":"2023-10-06T03:01:42.801858+0000","last_became_active":"2023-10-06T03:01:41.793527+0000","last_became_peered":"2023-10-06T03:01:41.793527+0000","last_unstale":"2023-10-06T03:01:42.801858+0000","last_undegraded":"2023-10-06T03:01:42.801858+0000","last_fullsized":"2023-10-06T03:01:42.801858+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:54.902600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184957+0000","last_change":"2023-10-06T03:01:42.184957+0000","last_active":"2023-10-06T03:01:42.184957+0000","last_peered":"2023-10-06T03:01:42.184957+0000","last_clean":"2023-10-06T03:01:42.184957+0000","last_became_active":"2023-10-06T03:01:42.184788+0000","last_became_peered":"2023-10-06T03:01:42.184788+0000","last_unstale":"2023-10-06T03:01:42.184957+0000","last_undegraded":"2023-10-06T03:01:42.184957+0000","last_fullsized":"2023-10-06T03:01:42.184957+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:13.639272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798642+0000","last_change":"2023-10-06T03:01:41.792276+0000","last_active":"2023-10-06T03:01:41.798642+0000","last_peered":"2023-10-06T03:01:41.798642+0000","last_clean":"2023-10-06T03:01:41.798642+0000","last_became_active":"2023-10-06T03:01:41.792022+0000","last_became_peered":"2023-10-06T03:01:41.792022+0000","last_unstale":"2023-10-06T03:01:41.798642+0000","last_undegraded":"2023-10-06T03:01:41.798642+0000","last_fullsized":"2023-10-06T03:01:41.798642+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:00.133619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.188641+0000","last_change":"2023-10-06T03:01:42.188641+0000","last_active":"2023-10-06T03:01:42.188641+0000","last_peered":"2023-10-06T03:01:42.188641+0000","last_clean":"2023-10-06T03:01:42.188641+0000","last_became_active":"2023-10-06T03:01:42.188048+0000","last_became_peered":"2023-10-06T03:01:42.188048+0000","last_unstale":"2023-10-06T03:01:42.188641+0000","last_undegraded":"2023-10-06T03:01:42.188641+0000","last_fullsized":"2023-10-06T03:01:42.188641+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:20.048805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.172123+0000","last_change":"2023-10-06T03:01:41.793137+0000","last_active":"2023-10-06T03:01:42.172123+0000","last_peered":"2023-10-06T03:01:42.172123+0000","last_clean":"2023-10-06T03:01:42.172123+0000","last_became_active":"2023-10-06T03:01:41.792867+0000","last_became_peered":"2023-10-06T03:01:41.792867+0000","last_unstale":"2023-10-06T03:01:42.172123+0000","last_undegraded":"2023-10-06T03:01:42.172123+0000","last_fullsized":"2023-10-06T03:01:42.172123+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:51.200930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184959+0000","last_change":"2023-10-06T03:01:42.179603+0000","last_active":"2023-10-06T03:01:42.184959+0000","last_peered":"2023-10-06T03:01:42.184959+0000","last_clean":"2023-10-06T03:01:42.184959+0000","last_became_active":"2023-10-06T03:01:42.179388+0000","last_became_peered":"2023-10-06T03:01:42.179388+0000","last_unstale":"2023-10-06T03:01:42.184959+0000","last_undegraded":"2023-10-06T03:01:42.184959+0000","last_fullsized":"2023-10-06T03:01:42.184959+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:23.876224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.786796+0000","last_change":"2023-10-06T03:01:41.782044+0000","last_active":"2023-10-06T03:01:41.786796+0000","last_peered":"2023-10-06T03:01:41.786796+0000","last_clean":"2023-10-06T03:01:41.786796+0000","last_became_active":"2023-10-06T03:01:41.781278+0000","last_became_peered":"2023-10-06T03:01:41.781278+0000","last_unstale":"2023-10-06T03:01:41.786796+0000","last_undegraded":"2023-10-06T03:01:41.786796+0000","last_fullsized":"2023-10-06T03:01:41.786796+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:27.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186404+0000","last_change":"2023-10-06T03:01:42.179529+0000","last_active":"2023-10-06T03:01:42.186404+0000","last_peered":"2023-10-06T03:01:42.186404+0000","last_clean":"2023-10-06T03:01:42.186404+0000","last_became_active":"2023-10-06T03:01:42.179252+0000","last_became_peered":"2023-10-06T03:01:42.179252+0000","last_unstale":"2023-10-06T03:01:42.186404+0000","last_undegraded":"2023-10-06T03:01:42.186404+0000","last_fullsized":"2023-10-06T03:01:42.186404+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:51.087613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"105'2","reported_seq":12,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.792666+0000","last_change":"2023-10-06T03:01:41.793789+0000","last_active":"2023-10-06T03:01:42.792666+0000","last_peered":"2023-10-06T03:01:42.792666+0000","last_clean":"2023-10-06T03:01:42.792666+0000","last_became_active":"2023-10-06T03:01:41.793540+0000","last_became_peered":"2023-10-06T03:01:41.793540+0000","last_unstale":"2023-10-06T03:01:42.792666+0000","last_undegraded":"2023-10-06T03:01:42.792666+0000","last_fullsized":"2023-10-06T03:01:42.792666+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:17:29.827848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184344+0000","last_change":"2023-10-06T03:01:42.184344+0000","last_active":"2023-10-06T03:01:42.184344+0000","last_peered":"2023-10-06T03:01:42.184344+0000","last_clean":"2023-10-06T03:01:42.184344+0000","last_became_active":"2023-10-06T03:01:42.182573+0000","last_became_peered":"2023-10-06T03:01:42.182573+0000","last_unstale":"2023-10-06T03:01:42.184344+0000","last_undegraded":"2023-10-06T03:01:42.184344+0000","last_fullsized":"2023-10-06T03:01:42.184344+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:08.589651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.169611+0000","last_change":"2023-10-06T03:01:41.790653+0000","last_active":"2023-10-06T03:01:42.169611+0000","last_peered":"2023-10-06T03:01:42.169611+0000","last_clean":"2023-10-06T03:01:42.169611+0000","last_became_active":"2023-10-06T03:01:41.790374+0000","last_became_peered":"2023-10-06T03:01:41.790374+0000","last_unstale":"2023-10-06T03:01:42.169611+0000","last_undegraded":"2023-10-06T03:01:42.169611+0000","last_fullsized":"2023-10-06T03:01:42.169611+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:02.331761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.180179+0000","last_change":"2023-10-06T03:01:42.180179+0000","last_active":"2023-10-06T03:01:42.180179+0000","last_peered":"2023-10-06T03:01:42.180179+0000","last_clean":"2023-10-06T03:01:42.180179+0000","last_became_active":"2023-10-06T03:01:42.179907+0000","last_became_peered":"2023-10-06T03:01:42.179907+0000","last_unstale":"2023-10-06T03:01:42.180179+0000","last_undegraded":"2023-10-06T03:01:42.180179+0000","last_fullsized":"2023-10-06T03:01:42.180179+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:57.870751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.786752+0000","last_change":"2023-10-06T03:01:41.781751+0000","last_active":"2023-10-06T03:01:41.786752+0000","last_peered":"2023-10-06T03:01:41.786752+0000","last_clean":"2023-10-06T03:01:41.786752+0000","last_became_active":"2023-10-06T03:01:41.781511+0000","last_became_peered":"2023-10-06T03:01:41.781511+0000","last_unstale":"2023-10-06T03:01:41.786752+0000","last_undegraded":"2023-10-06T03:01:41.786752+0000","last_fullsized":"2023-10-06T03:01:41.786752+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:32.193230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186599+0000","last_change":"2023-10-06T03:01:42.179609+0000","last_active":"2023-10-06T03:01:42.186599+0000","last_peered":"2023-10-06T03:01:42.186599+0000","last_clean":"2023-10-06T03:01:42.186599+0000","last_became_active":"2023-10-06T03:01:42.179317+0000","last_became_peered":"2023-10-06T03:01:42.179317+0000","last_unstale":"2023-10-06T03:01:42.186599+0000","last_undegraded":"2023-10-06T03:01:42.186599+0000","last_fullsized":"2023-10-06T03:01:42.186599+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:44.637882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.170328+0000","last_change":"2023-10-06T03:01:41.797532+0000","last_active":"2023-10-06T03:01:42.170328+0000","last_peered":"2023-10-06T03:01:42.170328+0000","last_clean":"2023-10-06T03:01:42.170328+0000","last_became_active":"2023-10-06T03:01:41.797260+0000","last_became_peered":"2023-10-06T03:01:41.797260+0000","last_unstale":"2023-10-06T03:01:42.170328+0000","last_undegraded":"2023-10-06T03:01:42.170328+0000","last_fullsized":"2023-10-06T03:01:42.170328+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:30.136969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183976+0000","last_change":"2023-10-06T03:01:42.183976+0000","last_active":"2023-10-06T03:01:42.183976+0000","last_peered":"2023-10-06T03:01:42.183976+0000","last_clean":"2023-10-06T03:01:42.183976+0000","last_became_active":"2023-10-06T03:01:42.183707+0000","last_became_peered":"2023-10-06T03:01:42.183707+0000","last_unstale":"2023-10-06T03:01:42.183976+0000","last_undegraded":"2023-10-06T03:01:42.183976+0000","last_fullsized":"2023-10-06T03:01:42.183976+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:59.573762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798144+0000","last_change":"2023-10-06T03:01:41.790304+0000","last_active":"2023-10-06T03:01:41.798144+0000","last_peered":"2023-10-06T03:01:41.798144+0000","last_clean":"2023-10-06T03:01:41.798144+0000","last_became_active":"2023-10-06T03:01:41.789968+0000","last_became_peered":"2023-10-06T03:01:41.789968+0000","last_unstale":"2023-10-06T03:01:41.798144+0000","last_undegraded":"2023-10-06T03:01:41.798144+0000","last_fullsized":"2023-10-06T03:01:41.798144+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:15.826496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.181577+0000","last_change":"2023-10-06T03:01:42.181577+0000","last_active":"2023-10-06T03:01:42.181577+0000","last_peered":"2023-10-06T03:01:42.181577+0000","last_clean":"2023-10-06T03:01:42.181577+0000","last_became_active":"2023-10-06T03:01:42.181220+0000","last_became_peered":"2023-10-06T03:01:42.181220+0000","last_unstale":"2023-10-06T03:01:42.181577+0000","last_undegraded":"2023-10-06T03:01:42.181577+0000","last_fullsized":"2023-10-06T03:01:42.181577+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:30.597645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.800732+0000","last_change":"2023-10-06T03:01:41.796925+0000","last_active":"2023-10-06T03:01:41.800732+0000","last_peered":"2023-10-06T03:01:41.800732+0000","last_clean":"2023-10-06T03:01:41.800732+0000","last_became_active":"2023-10-06T03:01:41.796682+0000","last_became_peered":"2023-10-06T03:01:41.796682+0000","last_unstale":"2023-10-06T03:01:41.800732+0000","last_undegraded":"2023-10-06T03:01:41.800732+0000","last_fullsized":"2023-10-06T03:01:41.800732+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:12.415491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.188485+0000","last_change":"2023-10-06T03:01:42.188485+0000","last_active":"2023-10-06T03:01:42.188485+0000","last_peered":"2023-10-06T03:01:42.188485+0000","last_clean":"2023-10-06T03:01:42.188485+0000","last_became_active":"2023-10-06T03:01:42.187765+0000","last_became_peered":"2023-10-06T03:01:42.187765+0000","last_unstale":"2023-10-06T03:01:42.188485+0000","last_undegraded":"2023-10-06T03:01:42.188485+0000","last_fullsized":"2023-10-06T03:01:42.188485+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:55.619007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798594+0000","last_change":"2023-10-06T03:01:41.793036+0000","last_active":"2023-10-06T03:01:41.798594+0000","last_peered":"2023-10-06T03:01:41.798594+0000","last_clean":"2023-10-06T03:01:41.798594+0000","last_became_active":"2023-10-06T03:01:41.791532+0000","last_became_peered":"2023-10-06T03:01:41.791532+0000","last_unstale":"2023-10-06T03:01:41.798594+0000","last_undegraded":"2023-10-06T03:01:41.798594+0000","last_fullsized":"2023-10-06T03:01:41.798594+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:57.978663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178339+0000","last_change":"2023-10-06T03:01:42.178339+0000","last_active":"2023-10-06T03:01:42.178339+0000","last_peered":"2023-10-06T03:01:42.178339+0000","last_clean":"2023-10-06T03:01:42.178339+0000","last_became_active":"2023-10-06T03:01:42.178079+0000","last_became_peered":"2023-10-06T03:01:42.178079+0000","last_unstale":"2023-10-06T03:01:42.178339+0000","last_undegraded":"2023-10-06T03:01:42.178339+0000","last_fullsized":"2023-10-06T03:01:42.178339+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:37.831830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.792195+0000","last_change":"2023-10-06T03:01:41.784383+0000","last_active":"2023-10-06T03:01:41.792195+0000","last_peered":"2023-10-06T03:01:41.792195+0000","last_clean":"2023-10-06T03:01:41.792195+0000","last_became_active":"2023-10-06T03:01:41.783961+0000","last_became_peered":"2023-10-06T03:01:41.783961+0000","last_unstale":"2023-10-06T03:01:41.792195+0000","last_undegraded":"2023-10-06T03:01:41.792195+0000","last_fullsized":"2023-10-06T03:01:41.792195+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:25.245328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186553+0000","last_change":"2023-10-06T03:01:42.180651+0000","last_active":"2023-10-06T03:01:42.186553+0000","last_peered":"2023-10-06T03:01:42.186553+0000","last_clean":"2023-10-06T03:01:42.186553+0000","last_became_active":"2023-10-06T03:01:42.180391+0000","last_became_peered":"2023-10-06T03:01:42.180391+0000","last_unstale":"2023-10-06T03:01:42.186553+0000","last_undegraded":"2023-10-06T03:01:42.186553+0000","last_fullsized":"2023-10-06T03:01:42.186553+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:09.254585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.169840+0000","last_change":"2023-10-06T03:01:41.793720+0000","last_active":"2023-10-06T03:01:42.169840+0000","last_peered":"2023-10-06T03:01:42.169840+0000","last_clean":"2023-10-06T03:01:42.169840+0000","last_became_active":"2023-10-06T03:01:41.793437+0000","last_became_peered":"2023-10-06T03:01:41.793437+0000","last_unstale":"2023-10-06T03:01:42.169840+0000","last_undegraded":"2023-10-06T03:01:42.169840+0000","last_fullsized":"2023-10-06T03:01:42.169840+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:23.646405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.173070+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T03:01:42.173070+0000","last_peered":"2023-10-06T03:01:42.173070+0000","last_clean":"2023-10-06T03:01:42.173070+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T03:01:42.173070+0000","last_undegraded":"2023-10-06T03:01:42.173070+0000","last_fullsized":"2023-10-06T03:01:42.173070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184977+0000","last_change":"2023-10-06T03:01:42.181684+0000","last_active":"2023-10-06T03:01:42.184977+0000","last_peered":"2023-10-06T03:01:42.184977+0000","last_clean":"2023-10-06T03:01:42.184977+0000","last_became_active":"2023-10-06T03:01:42.181409+0000","last_became_peered":"2023-10-06T03:01:42.181409+0000","last_unstale":"2023-10-06T03:01:42.184977+0000","last_undegraded":"2023-10-06T03:01:42.184977+0000","last_fullsized":"2023-10-06T03:01:42.184977+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:55.619007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"105'8","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.794522+0000","last_change":"2023-10-06T03:01:41.790689+0000","last_active":"2023-10-06T03:01:42.794522+0000","last_peered":"2023-10-06T03:01:42.794522+0000","last_clean":"2023-10-06T03:01:42.794522+0000","last_became_active":"2023-10-06T03:01:41.790434+0000","last_became_peered":"2023-10-06T03:01:41.790434+0000","last_unstale":"2023-10-06T03:01:42.794522+0000","last_undegraded":"2023-10-06T03:01:42.794522+0000","last_fullsized":"2023-10-06T03:01:42.794522+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:51.200930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.785880+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T03:01:41.785880+0000","last_peered":"2023-10-06T03:01:41.785880+0000","last_clean":"2023-10-06T03:01:41.785880+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T03:01:41.785880+0000","last_undegraded":"2023-10-06T03:01:41.785880+0000","last_fullsized":"2023-10-06T03:01:41.785880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183741+0000","last_change":"2023-10-06T03:01:42.181702+0000","last_active":"2023-10-06T03:01:42.183741+0000","last_peered":"2023-10-06T03:01:42.183741+0000","last_clean":"2023-10-06T03:01:42.183741+0000","last_became_active":"2023-10-06T03:01:42.181472+0000","last_became_peered":"2023-10-06T03:01:42.181472+0000","last_unstale":"2023-10-06T03:01:42.183741+0000","last_undegraded":"2023-10-06T03:01:42.183741+0000","last_fullsized":"2023-10-06T03:01:42.183741+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:46.774669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"105'2","reported_seq":12,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.794346+0000","last_change":"2023-10-06T03:01:41.794232+0000","last_active":"2023-10-06T03:01:42.794346+0000","last_peered":"2023-10-06T03:01:42.794346+0000","last_clean":"2023-10-06T03:01:42.794346+0000","last_became_active":"2023-10-06T03:01:41.793790+0000","last_became_peered":"2023-10-06T03:01:41.793790+0000","last_unstale":"2023-10-06T03:01:42.794346+0000","last_undegraded":"2023-10-06T03:01:42.794346+0000","last_fullsized":"2023-10-06T03:01:42.794346+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:51.503681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.779583+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T03:01:41.779583+0000","last_peered":"2023-10-06T03:01:41.779583+0000","last_clean":"2023-10-06T03:01:41.779583+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T03:01:41.779583+0000","last_undegraded":"2023-10-06T03:01:41.779583+0000","last_fullsized":"2023-10-06T03:01:41.779583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.190353+0000","last_change":"2023-10-06T03:01:42.189810+0000","last_active":"2023-10-06T03:01:42.190353+0000","last_peered":"2023-10-06T03:01:42.190353+0000","last_clean":"2023-10-06T03:01:42.190353+0000","last_became_active":"2023-10-06T03:01:42.189525+0000","last_became_peered":"2023-10-06T03:01:42.189525+0000","last_unstale":"2023-10-06T03:01:42.190353+0000","last_undegraded":"2023-10-06T03:01:42.190353+0000","last_fullsized":"2023-10-06T03:01:42.190353+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:38.185997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.800853+0000","last_change":"2023-10-06T03:01:41.796751+0000","last_active":"2023-10-06T03:01:41.800853+0000","last_peered":"2023-10-06T03:01:41.800853+0000","last_clean":"2023-10-06T03:01:41.800853+0000","last_became_active":"2023-10-06T03:01:41.796516+0000","last_became_peered":"2023-10-06T03:01:41.796516+0000","last_unstale":"2023-10-06T03:01:41.800853+0000","last_undegraded":"2023-10-06T03:01:41.800853+0000","last_fullsized":"2023-10-06T03:01:41.800853+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:48.389822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.785822+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T03:01:41.785822+0000","last_peered":"2023-10-06T03:01:41.785822+0000","last_clean":"2023-10-06T03:01:41.785822+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T03:01:41.785822+0000","last_undegraded":"2023-10-06T03:01:41.785822+0000","last_fullsized":"2023-10-06T03:01:41.785822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.783816+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T03:01:41.783816+0000","last_peered":"2023-10-06T03:01:41.783816+0000","last_clean":"2023-10-06T03:01:41.783816+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T03:01:41.783816+0000","last_undegraded":"2023-10-06T03:01:41.783816+0000","last_fullsized":"2023-10-06T03:01:41.783816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187410+0000","last_change":"2023-10-06T03:01:42.185669+0000","last_active":"2023-10-06T03:01:42.187410+0000","last_peered":"2023-10-06T03:01:42.187410+0000","last_clean":"2023-10-06T03:01:42.187410+0000","last_became_active":"2023-10-06T03:01:42.185408+0000","last_became_peered":"2023-10-06T03:01:42.185408+0000","last_unstale":"2023-10-06T03:01:42.187410+0000","last_undegraded":"2023-10-06T03:01:42.187410+0000","last_fullsized":"2023-10-06T03:01:42.187410+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:27.234365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.169316+0000","last_change":"2023-10-06T03:01:41.784872+0000","last_active":"2023-10-06T03:01:42.169316+0000","last_peered":"2023-10-06T03:01:42.169316+0000","last_clean":"2023-10-06T03:01:42.169316+0000","last_became_active":"2023-10-06T03:01:41.784606+0000","last_became_peered":"2023-10-06T03:01:41.784606+0000","last_unstale":"2023-10-06T03:01:42.169316+0000","last_undegraded":"2023-10-06T03:01:42.169316+0000","last_fullsized":"2023-10-06T03:01:42.169316+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:22.122969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.783860+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T03:01:41.783860+0000","last_peered":"2023-10-06T03:01:41.783860+0000","last_clean":"2023-10-06T03:01:41.783860+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T03:01:41.783860+0000","last_undegraded":"2023-10-06T03:01:41.783860+0000","last_fullsized":"2023-10-06T03:01:41.783860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.181238+0000","last_change":"2023-10-06T03:01:42.181238+0000","last_active":"2023-10-06T03:01:42.181238+0000","last_peered":"2023-10-06T03:01:42.181238+0000","last_clean":"2023-10-06T03:01:42.181238+0000","last_became_active":"2023-10-06T03:01:42.180968+0000","last_became_peered":"2023-10-06T03:01:42.180968+0000","last_unstale":"2023-10-06T03:01:42.181238+0000","last_undegraded":"2023-10-06T03:01:42.181238+0000","last_fullsized":"2023-10-06T03:01:42.181238+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:03.336339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798709+0000","last_change":"2023-10-06T03:01:41.796800+0000","last_active":"2023-10-06T03:01:41.798709+0000","last_peered":"2023-10-06T03:01:41.798709+0000","last_clean":"2023-10-06T03:01:41.798709+0000","last_became_active":"2023-10-06T03:01:41.796541+0000","last_became_peered":"2023-10-06T03:01:41.796541+0000","last_unstale":"2023-10-06T03:01:41.798709+0000","last_undegraded":"2023-10-06T03:01:41.798709+0000","last_fullsized":"2023-10-06T03:01:41.798709+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:58.705380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.783719+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T03:01:41.783719+0000","last_peered":"2023-10-06T03:01:41.783719+0000","last_clean":"2023-10-06T03:01:41.783719+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T03:01:41.783719+0000","last_undegraded":"2023-10-06T03:01:41.783719+0000","last_fullsized":"2023-10-06T03:01:41.783719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.185654+0000","last_change":"2023-10-06T03:01:42.185654+0000","last_active":"2023-10-06T03:01:42.185654+0000","last_peered":"2023-10-06T03:01:42.185654+0000","last_clean":"2023-10-06T03:01:42.185654+0000","last_became_active":"2023-10-06T03:01:42.185396+0000","last_became_peered":"2023-10-06T03:01:42.185396+0000","last_unstale":"2023-10-06T03:01:42.185654+0000","last_undegraded":"2023-10-06T03:01:42.185654+0000","last_fullsized":"2023-10-06T03:01:42.185654+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:22.225685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"105'6","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.793378+0000","last_change":"2023-10-06T03:01:41.794185+0000","last_active":"2023-10-06T03:01:42.793378+0000","last_peered":"2023-10-06T03:01:42.793378+0000","last_clean":"2023-10-06T03:01:42.793378+0000","last_became_active":"2023-10-06T03:01:41.793938+0000","last_became_peered":"2023-10-06T03:01:41.793938+0000","last_unstale":"2023-10-06T03:01:42.793378+0000","last_undegraded":"2023-10-06T03:01:42.793378+0000","last_fullsized":"2023-10-06T03:01:42.793378+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:23.312600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.172010+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T03:01:42.172010+0000","last_peered":"2023-10-06T03:01:42.172010+0000","last_clean":"2023-10-06T03:01:42.172010+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T03:01:42.172010+0000","last_undegraded":"2023-10-06T03:01:42.172010+0000","last_fullsized":"2023-10-06T03:01:42.172010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183716+0000","last_change":"2023-10-06T03:01:42.181986+0000","last_active":"2023-10-06T03:01:42.183716+0000","last_peered":"2023-10-06T03:01:42.183716+0000","last_clean":"2023-10-06T03:01:42.183716+0000","last_became_active":"2023-10-06T03:01:42.181727+0000","last_became_peered":"2023-10-06T03:01:42.181727+0000","last_unstale":"2023-10-06T03:01:42.183716+0000","last_undegraded":"2023-10-06T03:01:42.183716+0000","last_fullsized":"2023-10-06T03:01:42.183716+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:25.997488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"105'3","reported_seq":12,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.789332+0000","last_change":"2023-10-06T03:01:41.792568+0000","last_active":"2023-10-06T03:01:42.789332+0000","last_peered":"2023-10-06T03:01:42.789332+0000","last_clean":"2023-10-06T03:01:42.789332+0000","last_became_active":"2023-10-06T03:01:41.792283+0000","last_became_peered":"2023-10-06T03:01:41.792283+0000","last_unstale":"2023-10-06T03:01:42.789332+0000","last_undegraded":"2023-10-06T03:01:42.789332+0000","last_fullsized":"2023-10-06T03:01:42.789332+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:52.733904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.169811+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T03:01:42.169811+0000","last_peered":"2023-10-06T03:01:42.169811+0000","last_clean":"2023-10-06T03:01:42.169811+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T03:01:42.169811+0000","last_undegraded":"2023-10-06T03:01:42.169811+0000","last_fullsized":"2023-10-06T03:01:42.169811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299148,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072692,"statfs":{"total":96636764160,"available":96330436608,"internally_reserved":0,"allocated":1904640,"data_stored":1218856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.434},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.33100000000000002,"15min":0.29899999999999999},"max":{"1min":0.65100000000000002,"5min":0.746,"15min":0.78700000000000003},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.499},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.41499999999999998,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.78000000000000003},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70699999999999996,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.49299999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63600000000000001,"5min":0.71199999999999997,"15min":0.72399999999999998},"last":0.376},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.35199999999999998,"5min":0.30199999999999999,"15min":0.25600000000000001},"max":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.72799999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.50900000000000001,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.78300000000000003,"15min":0.83299999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.65500000000000003,"5min":0.73699999999999999,"15min":0.75700000000000001},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.56100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.79700000000000004},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":627970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.59799999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.86099999999999999,"15min":3.415},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.57699999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.746,"15min":1.4219999999999999},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.71399999999999997,"5min":0.81999999999999995,"15min":1.546},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56200000000000006,"15min":0.58399999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.6319999999999999},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":1.74},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56399999999999995,"15min":0.69399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.80300000000000005,"15min":3.4830000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58399999999999996,"15min":0.69399999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":3.577},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79700000000000004,"5min":0.82099999999999995,"15min":1.9219999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.58299999999999996},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.80700000000000005},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79500000000000004,"5min":0.80300000000000005,"15min":0.83399999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53400000000000003,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76300000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.745},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.77800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":627013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32600000000000001,"15min":0.38400000000000001},"min":{"1min":0.20699999999999999,"5min":0.193,"15min":0.19},"max":{"1min":0.45100000000000001,"5min":0.57699999999999996,"15min":2.0209999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35099999999999998,"15min":0.36699999999999999},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48599999999999999,"5min":0.59999999999999998,"15min":1.0409999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35799999999999998,"15min":1.0660000000000001},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48699999999999999,"5min":0.58099999999999996,"15min":21.193999999999999},"last":0.499},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40200000000000002,"15min":0.433},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45800000000000002,"5min":0.65500000000000003,"15min":1.181},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38700000000000001,"15min":0.42899999999999999},"min":{"1min":0.26300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.45200000000000001,"5min":0.628,"15min":2.0579999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.248,"15min":0.248},"max":{"1min":0.51600000000000001,"5min":0.626,"15min":0.626},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59099999999999997,"15min":0.56899999999999995},"min":{"1min":0.42699999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82599999999999996,"5min":0.95699999999999996,"15min":1.02},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":1.286},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.29799999999999999},"max":{"1min":0.83599999999999997,"5min":0.85599999999999998,"15min":21.135000000000002},"last":0.80700000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":1.276},"min":{"1min":0.41999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80700000000000005,"5min":0.95699999999999996,"15min":21.085000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":1.2789999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.58799999999999997},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":1.016,"15min":1.016},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59399999999999997,"15min":1.304},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81499999999999995,"5min":0.92600000000000005,"15min":21.166},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.43099999999999999,"15min":0.40999999999999998},"max":{"1min":0.77500000000000002,"5min":0.91800000000000004,"15min":1.2450000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.60999999999999999},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81100000000000005,"5min":0.99099999999999999,"15min":0.997},"last":0.79600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":1912832,"data_stored":1218905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.32300000000000001,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":0.438,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.378},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.33200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.53200000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.374,"15min":0.372},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.47499999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.20799999999999999},"max":{"1min":0.52800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48199999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.441},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38900000000000001,"15min":0.40300000000000002},"min":{"1min":0.29099999999999998,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.60699999999999998},"last":0.39100000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.41399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.89800000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77800000000000002,"5min":0.82499999999999996,"15min":0.85599999999999998},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.61099999999999999},"min":{"1min":0.436,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.48299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.77100000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.80900000000000005,"5min":0.90900000000000003,"15min":0.91200000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298560,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073280,"statfs":{"total":96636764160,"available":96331038720,"internally_reserved":0,"allocated":1302528,"data_stored":627900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33400000000000002,"15min":0.314},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.69499999999999995},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.32800000000000001},"min":{"1min":0.23400000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.25800000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.503,"5min":0.58399999999999996,"15min":0.72399999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":1.0129999999999999},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.255,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.92100000000000004},"last":0.317},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.40300000000000002},"min":{"1min":0.312,"5min":0.26700000000000002,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.63100000000000001,"15min":0.78900000000000003},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.753,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36299999999999999},"max":{"1min":0.88700000000000001,"5min":1.276,"15min":1.276},"last":0.496}]},{"osd":6,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61899999999999999,"15min":0.58099999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":0.89500000000000002,"15min":1.077},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63200000000000001,"15min":0.57899999999999996},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.42299999999999999},"max":{"1min":0.83899999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.60199999999999998},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.47999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298584,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073256,"statfs":{"total":96636764160,"available":96331014144,"internally_reserved":0,"allocated":1327104,"data_stored":635456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.432},"min":{"1min":0.254,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.54600000000000004,"5min":0.623,"15min":2.569},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.375,"15min":0.436},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56100000000000005,"5min":0.57499999999999996,"15min":2.1840000000000002},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35099999999999998,"15min":0.41999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":2.3199999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38400000000000001,"15min":0.45900000000000002},"min":{"1min":0.28000000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60699999999999998,"5min":0.64100000000000001,"15min":2.5979999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.45200000000000001},"min":{"1min":0.24299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":2.3439999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41199999999999998,"15min":0.47799999999999998},"min":{"1min":0.28399999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":2.6269999999999998},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57999999999999996,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.85099999999999998,"15min":2.1240000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59099999999999997,"15min":0.65500000000000003},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.374},"max":{"1min":0.81200000000000006,"5min":0.81899999999999995,"15min":2.2240000000000002},"last":0.53400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.65800000000000003},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.76700000000000002,"5min":0.84699999999999998,"15min":2.2650000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60099999999999998,"15min":0.67300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.82999999999999996,"15min":2.532},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86499999999999999,"5min":0.87,"15min":2.0840000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.68400000000000005},"min":{"1min":0.48099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.81000000000000005,"5min":0.85499999999999998,"15min":2.2930000000000001},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.70699999999999996},"min":{"1min":0.45500000000000002,"5min":0.436,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.90600000000000003,"15min":2.496},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60299999999999998,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38400000000000001},"max":{"1min":0.877,"5min":0.877,"15min":2.1549999999999998},"last":0.57399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298560,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073280,"statfs":{"total":96636764160,"available":96331038720,"internally_reserved":0,"allocated":1302528,"data_stored":627900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.39800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65200000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.496},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.755,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80700000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.40300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.68700000000000006,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60799999999999998,"15min":0.93799999999999994},"min":{"1min":0.40799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.71299999999999997,"5min":0.871,"15min":9.4440000000000008},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.50700000000000001,"15min":0.54600000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.437},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.54900000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64500000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.58999999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67000000000000004,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.61299999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68899999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.65100000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298568,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073272,"statfs":{"total":96636764160,"available":96331030528,"internally_reserved":0,"allocated":1310720,"data_stored":628476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.51500000000000001,"15min":0.495},"min":{"1min":0.34799999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.622,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":1.167},"last":0.379}]},{"osd":1,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.52600000000000002,"15min":0.56399999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.71599999999999997,"5min":0.746,"15min":1.117},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.52400000000000002,"15min":0.50900000000000001},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.29499999999999998},"max":{"1min":0.624,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53800000000000003,"15min":0.56200000000000006},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60399999999999998,"5min":0.76700000000000002,"15min":1.2},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.58499999999999996},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":1.1759999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":1.135},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56100000000000005,"15min":0.59999999999999998},"min":{"1min":0.378,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.81599999999999995,"15min":1.208},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46400000000000002,"15min":0.49399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":0.623,"5min":0.76200000000000001,"15min":0.78000000000000003},"last":0.495},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.87},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.56499999999999995},"min":{"1min":0.33500000000000002,"5min":0.32200000000000001,"15min":0.28499999999999998},"max":{"1min":0.76200000000000001,"5min":0.89200000000000002,"15min":1.054},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52400000000000002,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68500000000000005,"5min":0.80600000000000005,"15min":0.90100000000000002},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53100000000000003,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.622},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":0.75700000000000001,"5min":0.85799999999999998,"15min":1.008},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:01:46.845 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:01:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.992+0000 7ff7828d2700 1 Processor -- start 2023-10-06T03:01:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.992+0000 7ff7828d2700 1 -- start start 2023-10-06T03:01:46.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff7828d2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c1595c0 0x7ff77c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff7828d2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff77c067d00 0x7ff77c0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff7828d2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c0cde70 con 0x7ff77c06e9e0 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff7828d2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c06ef60 con 0x7ff77c067d00 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff7828d2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c06f240 con 0x7ff77c1595c0 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff77c06e9e0 0x7ff77c0675f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49374/0 (socket says 172.21.15.84:49374) 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77b7fe700 1 -- 172.21.15.84:0/4019087832 learned_addr learned my addr 172.21.15.84:0/4019087832 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff780e6f700 1 --2- 172.21.15.84:0/4019087832 >> v2:172.21.15.131:3300/0 conn(0x7ff77c067d00 0x7ff77c0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77bfff700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c1595c0 0x7ff77c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679073720 0 0) 0x7ff77c0cde70 con 0x7ff77c06e9e0 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff764003570 con 0x7ff77c06e9e0 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 756060420 0 0) 0x7ff764003570 con 0x7ff77c06e9e0 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c1595c0 msgr2=0x7ff77c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c1595c0 0x7ff77c06e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 >> v2:172.21.15.131:3300/0 conn(0x7ff77c067d00 msgr2=0x7ff77c0b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 --2- 172.21.15.84:0/4019087832 >> v2:172.21.15.131:3300/0 conn(0x7ff77c067d00 0x7ff77c0b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c0b0190 con 0x7ff77c06e9e0 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7ff770001470 con 0x7ff77c06e9e0 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.993+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 >> v1:172.21.15.84:6789/0 conn(0x7ff77c06e9e0 legacy=0x7ff77c0675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77affd700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff764003a60 0x7ff764003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77affd700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff764004810 0x7ff764004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77affd700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c1595c0 0x7ff7640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c06ef60 con 0x7ff764003a60 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c06f240 con 0x7ff764004810 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76400ba60 con 0x7ff77c1595c0 2023-10-06T03:01:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77bfff700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff764003a60 0x7ff764003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77b7fe700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff764004810 0x7ff764004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff780e6f700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c1595c0 0x7ff7640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77bfff700 1 -- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c1595c0 msgr2=0x7ff7640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77bfff700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c1595c0 0x7ff7640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77bfff700 1 -- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff764004810 msgr2=0x7ff764004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77bfff700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff764004810 0x7ff764004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77bfff700 1 -- 172.21.15.84:0/4019087832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff764003570 con 0x7ff764003a60 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77b7fe700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff764004810 0x7ff764004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff780e6f700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c1595c0 0x7ff7640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:47.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77bfff700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff764003a60 0x7ff764003e70 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009c30 tx=0x7ff76c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db3f9f2ceee4b6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00e710 con 0x7ff764003a60 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c00e870 con 0x7ff764003a60 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.994+0000 7ff77affd700 1 -- 172.21.15.84:0/4019087832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00ec30 con 0x7ff764003a60 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.995+0000 7ff7828d2700 1 -- 172.21.15.84:0/4019087832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff764003a60 msgr2=0x7ff764003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.995+0000 7ff7828d2700 1 --2- 172.21.15.84:0/4019087832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff764003a60 0x7ff764003e70 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009c30 tx=0x7ff76c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.995+0000 7ff780e6f700 1 -- 172.21.15.84:0/4019087832 reap_dead start 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.995+0000 7ff7828d2700 1 -- 172.21.15.84:0/4019087832 shutdown_connections 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.995+0000 7ff7828d2700 1 -- 172.21.15.84:0/4019087832 >> 172.21.15.84:0/4019087832 conn(0x7ff77c069180 msgr2=0x7ff77c0cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.995+0000 7ff7828d2700 1 -- 172.21.15.84:0/4019087832 shutdown_connections 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.995+0000 7ff7828d2700 1 -- 172.21.15.84:0/4019087832 wait complete. 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.996+0000 7ff7828d2700 1 Processor -- start 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.996+0000 7ff7828d2700 1 -- start start 2023-10-06T03:01:47.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff7828d2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff764003a60 0x7ff77c14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff7828d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff77c15c100 0x7ff77c0c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff7828d2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c0c2a30 0x7ff77c0c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff7828d2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0c3410 con 0x7ff77c15c100 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff7828d2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c159a30 con 0x7ff764003a60 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff7828d2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0c1f70 con 0x7ff77c0c2a30 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff77b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff77c15c100 0x7ff77c0c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff77b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff77c15c100 0x7ff77c0c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48992/0 (socket says 172.21.15.84:48992) 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff77b7fe700 1 -- 172.21.15.84:0/3537396670 learned_addr learned my addr 172.21.15.84:0/3537396670 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff77b7fe700 1 -- 172.21.15.84:0/3537396670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c0c2a30 msgr2=0x7ff77c0c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff77b7fe700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c0c2a30 0x7ff77c0c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff77b7fe700 1 -- 172.21.15.84:0/3537396670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff764003a60 msgr2=0x7ff77c14a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff77b7fe700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff764003a60 0x7ff77c14a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff77b7fe700 1 -- 172.21.15.84:0/3537396670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c0c2250 con 0x7ff77c15c100 2023-10-06T03:01:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff77b7fe700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff77c15c100 0x7ff77c0c1630 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff770001ed0 tx=0x7ff7700014c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff763fff700 1 -- 172.21.15.84:0/3537396670 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000c7b0 con 0x7ff77c15c100 2023-10-06T03:01:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff763fff700 1 -- 172.21.15.84:0/3537396670 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77000c910 con 0x7ff77c15c100 2023-10-06T03:01:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c159cd0 con 0x7ff77c15c100 2023-10-06T03:01:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff763fff700 1 -- 172.21.15.84:0/3537396670 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000cc90 con 0x7ff77c15c100 2023-10-06T03:01:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.997+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c14aab0 con 0x7ff77c15c100 2023-10-06T03:01:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.998+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c159f10 con 0x7ff77c15c100 2023-10-06T03:01:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.999+0000 7ff763fff700 1 -- 172.21.15.84:0/3537396670 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff77001d460 con 0x7ff77c15c100 2023-10-06T03:01:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.999+0000 7ff763fff700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff768066f30 0x7ff7680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.999+0000 7ff763fff700 1 -- 172.21.15.84:0/3537396670 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff770084900 con 0x7ff77c15c100 2023-10-06T03:01:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:46.999+0000 7ff77bfff700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff768066f30 0x7ff7680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.000+0000 7ff77bfff700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff768066f30 0x7ff7680693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0091e0 tx=0x7ff76c01a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.003+0000 7ff763fff700 1 -- 172.21.15.84:0/3537396670 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff77c159f10 con 0x7ff77c15c100 2023-10-06T03:01:47.073 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:01:47.072+0000 7fb0e674e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:01:47.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.182+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff77c159f10 con 0x7ff768066f30 2023-10-06T03:01:47.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.191+0000 7ff763fff700 1 -- 172.21.15.84:0/3537396670 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312433 (secure 0 0 0) 0x7ff77c159f10 con 0x7ff768066f30 2023-10-06T03:01:47.196 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:47.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff768066f30 msgr2=0x7ff7680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff768066f30 0x7ff7680693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0091e0 tx=0x7ff76c01a000 comp rx=0 tx=0).stop 2023-10-06T03:01:47.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff77c15c100 msgr2=0x7ff77c0c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff77c15c100 0x7ff77c0c1630 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff770001ed0 tx=0x7ff7700014c0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 shutdown_connections 2023-10-06T03:01:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff768066f30 0x7ff7680693e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff764003a60 0x7ff77c14a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff77c0c2a30 0x7ff77c0c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 --2- 172.21.15.84:0/3537396670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff77c15c100 0x7ff77c0c1630 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 >> 172.21.15.84:0/3537396670 conn(0x7ff77c069180 msgr2=0x7ff77c0ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 shutdown_connections 2023-10-06T03:01:47.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.194+0000 7ff7828d2700 1 -- 172.21.15.84:0/3537396670 wait complete. 2023-10-06T03:01:47.201 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:01:47.208 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2023-10-06T03:01:45.889044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2393800,"kb_used_data":11400,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752580920,"statfs":{"total":773094113280,"available":770642862080,"internally_reserved":0,"allocated":11673600,"data_stored":6212476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.123061"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.185349+0000","last_change":"2023-10-06T03:01:42.185349+0000","last_active":"2023-10-06T03:01:42.185349+0000","last_peered":"2023-10-06T03:01:42.185349+0000","last_clean":"2023-10-06T03:01:42.185349+0000","last_became_active":"2023-10-06T03:01:42.185063+0000","last_became_peered":"2023-10-06T03:01:42.185063+0000","last_unstale":"2023-10-06T03:01:42.185349+0000","last_undegraded":"2023-10-06T03:01:42.185349+0000","last_fullsized":"2023-10-06T03:01:42.185349+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:07.869848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.181582+0000","last_change":"2023-10-06T03:01:42.181582+0000","last_active":"2023-10-06T03:01:42.181582+0000","last_peered":"2023-10-06T03:01:42.181582+0000","last_clean":"2023-10-06T03:01:42.181582+0000","last_became_active":"2023-10-06T03:01:42.181196+0000","last_became_peered":"2023-10-06T03:01:42.181196+0000","last_unstale":"2023-10-06T03:01:42.181582+0000","last_undegraded":"2023-10-06T03:01:42.181582+0000","last_fullsized":"2023-10-06T03:01:42.181582+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:24.317178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.189634+0000","last_change":"2023-10-06T03:01:42.189634+0000","last_active":"2023-10-06T03:01:42.189634+0000","last_peered":"2023-10-06T03:01:42.189634+0000","last_clean":"2023-10-06T03:01:42.189634+0000","last_became_active":"2023-10-06T03:01:42.189367+0000","last_became_peered":"2023-10-06T03:01:42.189367+0000","last_unstale":"2023-10-06T03:01:42.189634+0000","last_undegraded":"2023-10-06T03:01:42.189634+0000","last_fullsized":"2023-10-06T03:01:42.189634+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:27.234365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183207+0000","last_change":"2023-10-06T03:01:42.183207+0000","last_active":"2023-10-06T03:01:42.183207+0000","last_peered":"2023-10-06T03:01:42.183207+0000","last_clean":"2023-10-06T03:01:42.183207+0000","last_became_active":"2023-10-06T03:01:42.182650+0000","last_became_peered":"2023-10-06T03:01:42.182650+0000","last_unstale":"2023-10-06T03:01:42.183207+0000","last_undegraded":"2023-10-06T03:01:42.183207+0000","last_fullsized":"2023-10-06T03:01:42.183207+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:15:10.216752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176381+0000","last_change":"2023-10-06T03:01:42.176381+0000","last_active":"2023-10-06T03:01:42.176381+0000","last_peered":"2023-10-06T03:01:42.176381+0000","last_clean":"2023-10-06T03:01:42.176381+0000","last_became_active":"2023-10-06T03:01:42.176123+0000","last_became_peered":"2023-10-06T03:01:42.176123+0000","last_unstale":"2023-10-06T03:01:42.176381+0000","last_undegraded":"2023-10-06T03:01:42.176381+0000","last_fullsized":"2023-10-06T03:01:42.176381+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:28.804847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178049+0000","last_change":"2023-10-06T03:01:42.176924+0000","last_active":"2023-10-06T03:01:42.178049+0000","last_peered":"2023-10-06T03:01:42.178049+0000","last_clean":"2023-10-06T03:01:42.178049+0000","last_became_active":"2023-10-06T03:01:42.176662+0000","last_became_peered":"2023-10-06T03:01:42.176662+0000","last_unstale":"2023-10-06T03:01:42.178049+0000","last_undegraded":"2023-10-06T03:01:42.178049+0000","last_fullsized":"2023-10-06T03:01:42.178049+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:25.903243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186258+0000","last_change":"2023-10-06T03:01:42.186258+0000","last_active":"2023-10-06T03:01:42.186258+0000","last_peered":"2023-10-06T03:01:42.186258+0000","last_clean":"2023-10-06T03:01:42.186258+0000","last_became_active":"2023-10-06T03:01:42.185808+0000","last_became_peered":"2023-10-06T03:01:42.185808+0000","last_unstale":"2023-10-06T03:01:42.186258+0000","last_undegraded":"2023-10-06T03:01:42.186258+0000","last_fullsized":"2023-10-06T03:01:42.186258+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:19.028513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.188826+0000","last_change":"2023-10-06T03:01:42.188826+0000","last_active":"2023-10-06T03:01:42.188826+0000","last_peered":"2023-10-06T03:01:42.188826+0000","last_clean":"2023-10-06T03:01:42.188826+0000","last_became_active":"2023-10-06T03:01:42.188276+0000","last_became_peered":"2023-10-06T03:01:42.188276+0000","last_unstale":"2023-10-06T03:01:42.188826+0000","last_undegraded":"2023-10-06T03:01:42.188826+0000","last_fullsized":"2023-10-06T03:01:42.188826+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:26.249907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.180229+0000","last_change":"2023-10-06T03:01:42.180229+0000","last_active":"2023-10-06T03:01:42.180229+0000","last_peered":"2023-10-06T03:01:42.180229+0000","last_clean":"2023-10-06T03:01:42.180229+0000","last_became_active":"2023-10-06T03:01:42.178260+0000","last_became_peered":"2023-10-06T03:01:42.178260+0000","last_unstale":"2023-10-06T03:01:42.180229+0000","last_undegraded":"2023-10-06T03:01:42.180229+0000","last_fullsized":"2023-10-06T03:01:42.180229+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:33.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.180344+0000","last_change":"2023-10-06T03:01:42.180344+0000","last_active":"2023-10-06T03:01:42.180344+0000","last_peered":"2023-10-06T03:01:42.180344+0000","last_clean":"2023-10-06T03:01:42.180344+0000","last_became_active":"2023-10-06T03:01:42.179385+0000","last_became_peered":"2023-10-06T03:01:42.179385+0000","last_unstale":"2023-10-06T03:01:42.180344+0000","last_undegraded":"2023-10-06T03:01:42.180344+0000","last_fullsized":"2023-10-06T03:01:42.180344+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:54.700670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187699+0000","last_change":"2023-10-06T03:01:42.187699+0000","last_active":"2023-10-06T03:01:42.187699+0000","last_peered":"2023-10-06T03:01:42.187699+0000","last_clean":"2023-10-06T03:01:42.187699+0000","last_became_active":"2023-10-06T03:01:42.187421+0000","last_became_peered":"2023-10-06T03:01:42.187421+0000","last_unstale":"2023-10-06T03:01:42.187699+0000","last_undegraded":"2023-10-06T03:01:42.187699+0000","last_fullsized":"2023-10-06T03:01:42.187699+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:26.249907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178886+0000","last_change":"2023-10-06T03:01:42.178886+0000","last_active":"2023-10-06T03:01:42.178886+0000","last_peered":"2023-10-06T03:01:42.178886+0000","last_clean":"2023-10-06T03:01:42.178886+0000","last_became_active":"2023-10-06T03:01:42.178643+0000","last_became_peered":"2023-10-06T03:01:42.178643+0000","last_unstale":"2023-10-06T03:01:42.178886+0000","last_undegraded":"2023-10-06T03:01:42.178886+0000","last_fullsized":"2023-10-06T03:01:42.178886+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:11:04.289816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184952+0000","last_change":"2023-10-06T03:01:42.184952+0000","last_active":"2023-10-06T03:01:42.184952+0000","last_peered":"2023-10-06T03:01:42.184952+0000","last_clean":"2023-10-06T03:01:42.184952+0000","last_became_active":"2023-10-06T03:01:42.184715+0000","last_became_peered":"2023-10-06T03:01:42.184715+0000","last_unstale":"2023-10-06T03:01:42.184952+0000","last_undegraded":"2023-10-06T03:01:42.184952+0000","last_fullsized":"2023-10-06T03:01:42.184952+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:25.997488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.189270+0000","last_change":"2023-10-06T03:01:42.189270+0000","last_active":"2023-10-06T03:01:42.189270+0000","last_peered":"2023-10-06T03:01:42.189270+0000","last_clean":"2023-10-06T03:01:42.189270+0000","last_became_active":"2023-10-06T03:01:42.187362+0000","last_became_peered":"2023-10-06T03:01:42.187362+0000","last_unstale":"2023-10-06T03:01:42.189270+0000","last_undegraded":"2023-10-06T03:01:42.189270+0000","last_fullsized":"2023-10-06T03:01:42.189270+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:27.193208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.180989+0000","last_change":"2023-10-06T03:01:42.177826+0000","last_active":"2023-10-06T03:01:42.180989+0000","last_peered":"2023-10-06T03:01:42.180989+0000","last_clean":"2023-10-06T03:01:42.180989+0000","last_became_active":"2023-10-06T03:01:42.177528+0000","last_became_peered":"2023-10-06T03:01:42.177528+0000","last_unstale":"2023-10-06T03:01:42.180989+0000","last_undegraded":"2023-10-06T03:01:42.180989+0000","last_fullsized":"2023-10-06T03:01:42.180989+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:46:28.804847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.189852+0000","last_change":"2023-10-06T03:01:42.189852+0000","last_active":"2023-10-06T03:01:42.189852+0000","last_peered":"2023-10-06T03:01:42.189852+0000","last_clean":"2023-10-06T03:01:42.189852+0000","last_became_active":"2023-10-06T03:01:42.189585+0000","last_became_peered":"2023-10-06T03:01:42.189585+0000","last_unstale":"2023-10-06T03:01:42.189852+0000","last_undegraded":"2023-10-06T03:01:42.189852+0000","last_fullsized":"2023-10-06T03:01:42.189852+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:59.060184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186522+0000","last_change":"2023-10-06T03:01:42.186522+0000","last_active":"2023-10-06T03:01:42.186522+0000","last_peered":"2023-10-06T03:01:42.186522+0000","last_clean":"2023-10-06T03:01:42.186522+0000","last_became_active":"2023-10-06T03:01:42.186065+0000","last_became_peered":"2023-10-06T03:01:42.186065+0000","last_unstale":"2023-10-06T03:01:42.186522+0000","last_undegraded":"2023-10-06T03:01:42.186522+0000","last_fullsized":"2023-10-06T03:01:42.186522+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:53.738482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186423+0000","last_change":"2023-10-06T03:01:42.182758+0000","last_active":"2023-10-06T03:01:42.186423+0000","last_peered":"2023-10-06T03:01:42.186423+0000","last_clean":"2023-10-06T03:01:42.186423+0000","last_became_active":"2023-10-06T03:01:42.182520+0000","last_became_peered":"2023-10-06T03:01:42.182520+0000","last_unstale":"2023-10-06T03:01:42.186423+0000","last_undegraded":"2023-10-06T03:01:42.186423+0000","last_fullsized":"2023-10-06T03:01:42.186423+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:49.882416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187068+0000","last_change":"2023-10-06T03:01:42.187068+0000","last_active":"2023-10-06T03:01:42.187068+0000","last_peered":"2023-10-06T03:01:42.187068+0000","last_clean":"2023-10-06T03:01:42.187068+0000","last_became_active":"2023-10-06T03:01:42.186777+0000","last_became_peered":"2023-10-06T03:01:42.186777+0000","last_unstale":"2023-10-06T03:01:42.187068+0000","last_undegraded":"2023-10-06T03:01:42.187068+0000","last_fullsized":"2023-10-06T03:01:42.187068+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:18.133519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.185312+0000","last_change":"2023-10-06T03:01:42.185312+0000","last_active":"2023-10-06T03:01:42.185312+0000","last_peered":"2023-10-06T03:01:42.185312+0000","last_clean":"2023-10-06T03:01:42.185312+0000","last_became_active":"2023-10-06T03:01:42.184293+0000","last_became_peered":"2023-10-06T03:01:42.184293+0000","last_unstale":"2023-10-06T03:01:42.185312+0000","last_undegraded":"2023-10-06T03:01:42.185312+0000","last_fullsized":"2023-10-06T03:01:42.185312+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:54.887916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.182477+0000","last_change":"2023-10-06T03:01:42.182477+0000","last_active":"2023-10-06T03:01:42.182477+0000","last_peered":"2023-10-06T03:01:42.182477+0000","last_clean":"2023-10-06T03:01:42.182477+0000","last_became_active":"2023-10-06T03:01:42.182225+0000","last_became_peered":"2023-10-06T03:01:42.182225+0000","last_unstale":"2023-10-06T03:01:42.182477+0000","last_undegraded":"2023-10-06T03:01:42.182477+0000","last_fullsized":"2023-10-06T03:01:42.182477+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:28.087688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187997+0000","last_change":"2023-10-06T03:01:42.187649+0000","last_active":"2023-10-06T03:01:42.187997+0000","last_peered":"2023-10-06T03:01:42.187997+0000","last_clean":"2023-10-06T03:01:42.187997+0000","last_became_active":"2023-10-06T03:01:42.187306+0000","last_became_peered":"2023-10-06T03:01:42.187306+0000","last_unstale":"2023-10-06T03:01:42.187997+0000","last_undegraded":"2023-10-06T03:01:42.187997+0000","last_fullsized":"2023-10-06T03:01:42.187997+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:26.249907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184869+0000","last_change":"2023-10-06T03:01:42.184869+0000","last_active":"2023-10-06T03:01:42.184869+0000","last_peered":"2023-10-06T03:01:42.184869+0000","last_clean":"2023-10-06T03:01:42.184869+0000","last_became_active":"2023-10-06T03:01:42.184670+0000","last_became_peered":"2023-10-06T03:01:42.184670+0000","last_unstale":"2023-10-06T03:01:42.184869+0000","last_undegraded":"2023-10-06T03:01:42.184869+0000","last_fullsized":"2023-10-06T03:01:42.184869+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:28.869361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.190371+0000","last_change":"2023-10-06T03:01:42.189845+0000","last_active":"2023-10-06T03:01:42.190371+0000","last_peered":"2023-10-06T03:01:42.190371+0000","last_clean":"2023-10-06T03:01:42.190371+0000","last_became_active":"2023-10-06T03:01:42.189585+0000","last_became_peered":"2023-10-06T03:01:42.189585+0000","last_unstale":"2023-10-06T03:01:42.190371+0000","last_undegraded":"2023-10-06T03:01:42.190371+0000","last_fullsized":"2023-10-06T03:01:42.190371+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:18.133519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186642+0000","last_change":"2023-10-06T03:01:42.186642+0000","last_active":"2023-10-06T03:01:42.186642+0000","last_peered":"2023-10-06T03:01:42.186642+0000","last_clean":"2023-10-06T03:01:42.186642+0000","last_became_active":"2023-10-06T03:01:42.186398+0000","last_became_peered":"2023-10-06T03:01:42.186398+0000","last_unstale":"2023-10-06T03:01:42.186642+0000","last_undegraded":"2023-10-06T03:01:42.186642+0000","last_fullsized":"2023-10-06T03:01:42.186642+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:33.197809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184785+0000","last_change":"2023-10-06T03:01:42.184785+0000","last_active":"2023-10-06T03:01:42.184785+0000","last_peered":"2023-10-06T03:01:42.184785+0000","last_clean":"2023-10-06T03:01:42.184785+0000","last_became_active":"2023-10-06T03:01:42.183367+0000","last_became_peered":"2023-10-06T03:01:42.183367+0000","last_unstale":"2023-10-06T03:01:42.184785+0000","last_undegraded":"2023-10-06T03:01:42.184785+0000","last_fullsized":"2023-10-06T03:01:42.184785+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:46.400031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.182631+0000","last_change":"2023-10-06T03:01:42.180157+0000","last_active":"2023-10-06T03:01:42.182631+0000","last_peered":"2023-10-06T03:01:42.182631+0000","last_clean":"2023-10-06T03:01:42.182631+0000","last_became_active":"2023-10-06T03:01:42.179938+0000","last_became_peered":"2023-10-06T03:01:42.179938+0000","last_unstale":"2023-10-06T03:01:42.182631+0000","last_undegraded":"2023-10-06T03:01:42.182631+0000","last_fullsized":"2023-10-06T03:01:42.182631+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:57.941776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.185205+0000","last_change":"2023-10-06T03:01:42.183078+0000","last_active":"2023-10-06T03:01:42.185205+0000","last_peered":"2023-10-06T03:01:42.185205+0000","last_clean":"2023-10-06T03:01:42.185205+0000","last_became_active":"2023-10-06T03:01:42.182844+0000","last_became_peered":"2023-10-06T03:01:42.182844+0000","last_unstale":"2023-10-06T03:01:42.185205+0000","last_undegraded":"2023-10-06T03:01:42.185205+0000","last_fullsized":"2023-10-06T03:01:42.185205+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:28.869361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184559+0000","last_change":"2023-10-06T03:01:42.184559+0000","last_active":"2023-10-06T03:01:42.184559+0000","last_peered":"2023-10-06T03:01:42.184559+0000","last_clean":"2023-10-06T03:01:42.184559+0000","last_became_active":"2023-10-06T03:01:42.184321+0000","last_became_peered":"2023-10-06T03:01:42.184321+0000","last_unstale":"2023-10-06T03:01:42.184559+0000","last_undegraded":"2023-10-06T03:01:42.184559+0000","last_fullsized":"2023-10-06T03:01:42.184559+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:55.852111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176816+0000","last_change":"2023-10-06T03:01:42.176816+0000","last_active":"2023-10-06T03:01:42.176816+0000","last_peered":"2023-10-06T03:01:42.176816+0000","last_clean":"2023-10-06T03:01:42.176816+0000","last_became_active":"2023-10-06T03:01:42.176620+0000","last_became_peered":"2023-10-06T03:01:42.176620+0000","last_unstale":"2023-10-06T03:01:42.176816+0000","last_undegraded":"2023-10-06T03:01:42.176816+0000","last_fullsized":"2023-10-06T03:01:42.176816+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:10.191829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183645+0000","last_change":"2023-10-06T03:01:42.183645+0000","last_active":"2023-10-06T03:01:42.183645+0000","last_peered":"2023-10-06T03:01:42.183645+0000","last_clean":"2023-10-06T03:01:42.183645+0000","last_became_active":"2023-10-06T03:01:42.183397+0000","last_became_peered":"2023-10-06T03:01:42.183397+0000","last_unstale":"2023-10-06T03:01:42.183645+0000","last_undegraded":"2023-10-06T03:01:42.183645+0000","last_fullsized":"2023-10-06T03:01:42.183645+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:25:44.974082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176842+0000","last_change":"2023-10-06T03:01:42.174963+0000","last_active":"2023-10-06T03:01:42.176842+0000","last_peered":"2023-10-06T03:01:42.176842+0000","last_clean":"2023-10-06T03:01:42.176842+0000","last_became_active":"2023-10-06T03:01:42.174750+0000","last_became_peered":"2023-10-06T03:01:42.174750+0000","last_unstale":"2023-10-06T03:01:42.176842+0000","last_undegraded":"2023-10-06T03:01:42.176842+0000","last_fullsized":"2023-10-06T03:01:42.176842+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:15.426868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.181852+0000","last_change":"2023-10-06T03:01:42.178808+0000","last_active":"2023-10-06T03:01:42.181852+0000","last_peered":"2023-10-06T03:01:42.181852+0000","last_clean":"2023-10-06T03:01:42.181852+0000","last_became_active":"2023-10-06T03:01:42.178531+0000","last_became_peered":"2023-10-06T03:01:42.178531+0000","last_unstale":"2023-10-06T03:01:42.181852+0000","last_undegraded":"2023-10-06T03:01:42.181852+0000","last_fullsized":"2023-10-06T03:01:42.181852+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:38:13.816346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"105'4","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.794339+0000","last_change":"2023-10-06T03:01:41.793013+0000","last_active":"2023-10-06T03:01:42.794339+0000","last_peered":"2023-10-06T03:01:42.794339+0000","last_clean":"2023-10-06T03:01:42.794339+0000","last_became_active":"2023-10-06T03:01:41.792711+0000","last_became_peered":"2023-10-06T03:01:41.792711+0000","last_unstale":"2023-10-06T03:01:42.794339+0000","last_undegraded":"2023-10-06T03:01:42.794339+0000","last_fullsized":"2023-10-06T03:01:42.794339+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:56.937198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187520+0000","last_change":"2023-10-06T03:01:42.184825+0000","last_active":"2023-10-06T03:01:42.187520+0000","last_peered":"2023-10-06T03:01:42.187520+0000","last_clean":"2023-10-06T03:01:42.187520+0000","last_became_active":"2023-10-06T03:01:42.184449+0000","last_became_peered":"2023-10-06T03:01:42.184449+0000","last_unstale":"2023-10-06T03:01:42.187520+0000","last_undegraded":"2023-10-06T03:01:42.187520+0000","last_fullsized":"2023-10-06T03:01:42.187520+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:27.456257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"105'1","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178857+0000","last_change":"2023-10-06T03:01:41.791140+0000","last_active":"2023-10-06T03:01:42.178857+0000","last_peered":"2023-10-06T03:01:42.178857+0000","last_clean":"2023-10-06T03:01:42.178857+0000","last_became_active":"2023-10-06T03:01:41.790854+0000","last_became_peered":"2023-10-06T03:01:41.790854+0000","last_unstale":"2023-10-06T03:01:42.178857+0000","last_undegraded":"2023-10-06T03:01:42.178857+0000","last_fullsized":"2023-10-06T03:01:42.178857+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:13.961202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176810+0000","last_change":"2023-10-06T03:01:42.174962+0000","last_active":"2023-10-06T03:01:42.176810+0000","last_peered":"2023-10-06T03:01:42.176810+0000","last_clean":"2023-10-06T03:01:42.176810+0000","last_became_active":"2023-10-06T03:01:42.174712+0000","last_became_peered":"2023-10-06T03:01:42.174712+0000","last_unstale":"2023-10-06T03:01:42.176810+0000","last_undegraded":"2023-10-06T03:01:42.176810+0000","last_fullsized":"2023-10-06T03:01:42.176810+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:48.468387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"105'2","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.792723+0000","last_change":"2023-10-06T03:01:41.796642+0000","last_active":"2023-10-06T03:01:42.792723+0000","last_peered":"2023-10-06T03:01:42.792723+0000","last_clean":"2023-10-06T03:01:42.792723+0000","last_became_active":"2023-10-06T03:01:41.796383+0000","last_became_peered":"2023-10-06T03:01:41.796383+0000","last_unstale":"2023-10-06T03:01:42.792723+0000","last_undegraded":"2023-10-06T03:01:42.792723+0000","last_fullsized":"2023-10-06T03:01:42.792723+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:44:43.884709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.188367+0000","last_change":"2023-10-06T03:01:42.188367+0000","last_active":"2023-10-06T03:01:42.188367+0000","last_peered":"2023-10-06T03:01:42.188367+0000","last_clean":"2023-10-06T03:01:42.188367+0000","last_became_active":"2023-10-06T03:01:42.188184+0000","last_became_peered":"2023-10-06T03:01:42.188184+0000","last_unstale":"2023-10-06T03:01:42.188367+0000","last_undegraded":"2023-10-06T03:01:42.188367+0000","last_fullsized":"2023-10-06T03:01:42.188367+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:38.185997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"105'2","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.792598+0000","last_change":"2023-10-06T03:01:41.795546+0000","last_active":"2023-10-06T03:01:42.792598+0000","last_peered":"2023-10-06T03:01:42.792598+0000","last_clean":"2023-10-06T03:01:42.792598+0000","last_became_active":"2023-10-06T03:01:41.795298+0000","last_became_peered":"2023-10-06T03:01:41.795298+0000","last_unstale":"2023-10-06T03:01:42.792598+0000","last_undegraded":"2023-10-06T03:01:42.792598+0000","last_fullsized":"2023-10-06T03:01:42.792598+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:07:04.392767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178673+0000","last_change":"2023-10-06T03:01:42.178673+0000","last_active":"2023-10-06T03:01:42.178673+0000","last_peered":"2023-10-06T03:01:42.178673+0000","last_clean":"2023-10-06T03:01:42.178673+0000","last_became_active":"2023-10-06T03:01:42.178425+0000","last_became_peered":"2023-10-06T03:01:42.178425+0000","last_unstale":"2023-10-06T03:01:42.178673+0000","last_undegraded":"2023-10-06T03:01:42.178673+0000","last_fullsized":"2023-10-06T03:01:42.178673+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:35.356457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"105'1","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.172307+0000","last_change":"2023-10-06T03:01:41.796502+0000","last_active":"2023-10-06T03:01:42.172307+0000","last_peered":"2023-10-06T03:01:42.172307+0000","last_clean":"2023-10-06T03:01:42.172307+0000","last_became_active":"2023-10-06T03:01:41.796201+0000","last_became_peered":"2023-10-06T03:01:41.796201+0000","last_unstale":"2023-10-06T03:01:42.172307+0000","last_undegraded":"2023-10-06T03:01:42.172307+0000","last_fullsized":"2023-10-06T03:01:42.172307+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:09.103882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.182184+0000","last_change":"2023-10-06T03:01:42.182184+0000","last_active":"2023-10-06T03:01:42.182184+0000","last_peered":"2023-10-06T03:01:42.182184+0000","last_clean":"2023-10-06T03:01:42.182184+0000","last_became_active":"2023-10-06T03:01:42.181624+0000","last_became_peered":"2023-10-06T03:01:42.181624+0000","last_unstale":"2023-10-06T03:01:42.182184+0000","last_undegraded":"2023-10-06T03:01:42.182184+0000","last_fullsized":"2023-10-06T03:01:42.182184+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:27:09.873679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"105'1","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.792859+0000","last_change":"2023-10-06T03:01:41.795066+0000","last_active":"2023-10-06T03:01:42.792859+0000","last_peered":"2023-10-06T03:01:42.792859+0000","last_clean":"2023-10-06T03:01:42.792859+0000","last_became_active":"2023-10-06T03:01:41.794828+0000","last_became_peered":"2023-10-06T03:01:41.794828+0000","last_unstale":"2023-10-06T03:01:42.792859+0000","last_undegraded":"2023-10-06T03:01:42.792859+0000","last_fullsized":"2023-10-06T03:01:42.792859+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:01.485397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.176564+0000","last_change":"2023-10-06T03:01:42.176564+0000","last_active":"2023-10-06T03:01:42.176564+0000","last_peered":"2023-10-06T03:01:42.176564+0000","last_clean":"2023-10-06T03:01:42.176564+0000","last_became_active":"2023-10-06T03:01:42.176306+0000","last_became_peered":"2023-10-06T03:01:42.176306+0000","last_unstale":"2023-10-06T03:01:42.176564+0000","last_undegraded":"2023-10-06T03:01:42.176564+0000","last_fullsized":"2023-10-06T03:01:42.176564+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:06.673143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.795365+0000","last_change":"2023-10-06T03:01:41.787840+0000","last_active":"2023-10-06T03:01:41.795365+0000","last_peered":"2023-10-06T03:01:41.795365+0000","last_clean":"2023-10-06T03:01:41.795365+0000","last_became_active":"2023-10-06T03:01:41.787551+0000","last_became_peered":"2023-10-06T03:01:41.787551+0000","last_unstale":"2023-10-06T03:01:41.795365+0000","last_undegraded":"2023-10-06T03:01:41.795365+0000","last_fullsized":"2023-10-06T03:01:41.795365+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:04.618299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186073+0000","last_change":"2023-10-06T03:01:42.186073+0000","last_active":"2023-10-06T03:01:42.186073+0000","last_peered":"2023-10-06T03:01:42.186073+0000","last_clean":"2023-10-06T03:01:42.186073+0000","last_became_active":"2023-10-06T03:01:42.185499+0000","last_became_peered":"2023-10-06T03:01:42.185499+0000","last_unstale":"2023-10-06T03:01:42.186073+0000","last_undegraded":"2023-10-06T03:01:42.186073+0000","last_fullsized":"2023-10-06T03:01:42.186073+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:05.430127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.796130+0000","last_change":"2023-10-06T03:01:41.791952+0000","last_active":"2023-10-06T03:01:41.796130+0000","last_peered":"2023-10-06T03:01:41.796130+0000","last_clean":"2023-10-06T03:01:41.796130+0000","last_became_active":"2023-10-06T03:01:41.791228+0000","last_became_peered":"2023-10-06T03:01:41.791228+0000","last_unstale":"2023-10-06T03:01:41.796130+0000","last_undegraded":"2023-10-06T03:01:41.796130+0000","last_fullsized":"2023-10-06T03:01:41.796130+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:53.883338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.179698+0000","last_change":"2023-10-06T03:01:42.179698+0000","last_active":"2023-10-06T03:01:42.179698+0000","last_peered":"2023-10-06T03:01:42.179698+0000","last_clean":"2023-10-06T03:01:42.179698+0000","last_became_active":"2023-10-06T03:01:42.179211+0000","last_became_peered":"2023-10-06T03:01:42.179211+0000","last_unstale":"2023-10-06T03:01:42.179698+0000","last_undegraded":"2023-10-06T03:01:42.179698+0000","last_fullsized":"2023-10-06T03:01:42.179698+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:05:25.903243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"105'1","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.168183+0000","last_change":"2023-10-06T03:01:41.792731+0000","last_active":"2023-10-06T03:01:42.168183+0000","last_peered":"2023-10-06T03:01:42.168183+0000","last_clean":"2023-10-06T03:01:42.168183+0000","last_became_active":"2023-10-06T03:01:41.792472+0000","last_became_peered":"2023-10-06T03:01:41.792472+0000","last_unstale":"2023-10-06T03:01:42.168183+0000","last_undegraded":"2023-10-06T03:01:42.168183+0000","last_fullsized":"2023-10-06T03:01:42.168183+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:54.847532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183861+0000","last_change":"2023-10-06T03:01:42.180689+0000","last_active":"2023-10-06T03:01:42.183861+0000","last_peered":"2023-10-06T03:01:42.183861+0000","last_clean":"2023-10-06T03:01:42.183861+0000","last_became_active":"2023-10-06T03:01:42.180433+0000","last_became_peered":"2023-10-06T03:01:42.180433+0000","last_unstale":"2023-10-06T03:01:42.183861+0000","last_undegraded":"2023-10-06T03:01:42.183861+0000","last_fullsized":"2023-10-06T03:01:42.183861+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:49.394400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"105'2","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.788556+0000","last_change":"2023-10-06T03:01:41.797317+0000","last_active":"2023-10-06T03:01:42.788556+0000","last_peered":"2023-10-06T03:01:42.788556+0000","last_clean":"2023-10-06T03:01:42.788556+0000","last_became_active":"2023-10-06T03:01:41.797062+0000","last_became_peered":"2023-10-06T03:01:41.797062+0000","last_unstale":"2023-10-06T03:01:42.788556+0000","last_undegraded":"2023-10-06T03:01:42.788556+0000","last_fullsized":"2023-10-06T03:01:42.788556+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:37.684621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.190080+0000","last_change":"2023-10-06T03:01:42.190080+0000","last_active":"2023-10-06T03:01:42.190080+0000","last_peered":"2023-10-06T03:01:42.190080+0000","last_clean":"2023-10-06T03:01:42.190080+0000","last_became_active":"2023-10-06T03:01:42.189734+0000","last_became_peered":"2023-10-06T03:01:42.189734+0000","last_unstale":"2023-10-06T03:01:42.190080+0000","last_undegraded":"2023-10-06T03:01:42.190080+0000","last_fullsized":"2023-10-06T03:01:42.190080+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:28.869361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"105'1","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.794629+0000","last_change":"2023-10-06T03:01:41.789572+0000","last_active":"2023-10-06T03:01:42.794629+0000","last_peered":"2023-10-06T03:01:42.794629+0000","last_clean":"2023-10-06T03:01:42.794629+0000","last_became_active":"2023-10-06T03:01:41.789334+0000","last_became_peered":"2023-10-06T03:01:41.789334+0000","last_unstale":"2023-10-06T03:01:42.794629+0000","last_undegraded":"2023-10-06T03:01:42.794629+0000","last_fullsized":"2023-10-06T03:01:42.794629+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:04.425548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.191446+0000","last_change":"2023-10-06T03:01:42.191446+0000","last_active":"2023-10-06T03:01:42.191446+0000","last_peered":"2023-10-06T03:01:42.191446+0000","last_clean":"2023-10-06T03:01:42.191446+0000","last_became_active":"2023-10-06T03:01:42.191150+0000","last_became_peered":"2023-10-06T03:01:42.191150+0000","last_unstale":"2023-10-06T03:01:42.191446+0000","last_undegraded":"2023-10-06T03:01:42.191446+0000","last_fullsized":"2023-10-06T03:01:42.191446+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:23.876224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798231+0000","last_change":"2023-10-06T03:01:41.793538+0000","last_active":"2023-10-06T03:01:41.798231+0000","last_peered":"2023-10-06T03:01:41.798231+0000","last_clean":"2023-10-06T03:01:41.798231+0000","last_became_active":"2023-10-06T03:01:41.793272+0000","last_became_peered":"2023-10-06T03:01:41.793272+0000","last_unstale":"2023-10-06T03:01:41.798231+0000","last_undegraded":"2023-10-06T03:01:41.798231+0000","last_fullsized":"2023-10-06T03:01:41.798231+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:47.463809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.190210+0000","last_change":"2023-10-06T03:01:42.190210+0000","last_active":"2023-10-06T03:01:42.190210+0000","last_peered":"2023-10-06T03:01:42.190210+0000","last_clean":"2023-10-06T03:01:42.190210+0000","last_became_active":"2023-10-06T03:01:42.189531+0000","last_became_peered":"2023-10-06T03:01:42.189531+0000","last_unstale":"2023-10-06T03:01:42.190210+0000","last_undegraded":"2023-10-06T03:01:42.190210+0000","last_fullsized":"2023-10-06T03:01:42.190210+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:32.044071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"105'2","reported_seq":12,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.801858+0000","last_change":"2023-10-06T03:01:41.794060+0000","last_active":"2023-10-06T03:01:42.801858+0000","last_peered":"2023-10-06T03:01:42.801858+0000","last_clean":"2023-10-06T03:01:42.801858+0000","last_became_active":"2023-10-06T03:01:41.793527+0000","last_became_peered":"2023-10-06T03:01:41.793527+0000","last_unstale":"2023-10-06T03:01:42.801858+0000","last_undegraded":"2023-10-06T03:01:42.801858+0000","last_fullsized":"2023-10-06T03:01:42.801858+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:54.902600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184957+0000","last_change":"2023-10-06T03:01:42.184957+0000","last_active":"2023-10-06T03:01:42.184957+0000","last_peered":"2023-10-06T03:01:42.184957+0000","last_clean":"2023-10-06T03:01:42.184957+0000","last_became_active":"2023-10-06T03:01:42.184788+0000","last_became_peered":"2023-10-06T03:01:42.184788+0000","last_unstale":"2023-10-06T03:01:42.184957+0000","last_undegraded":"2023-10-06T03:01:42.184957+0000","last_fullsized":"2023-10-06T03:01:42.184957+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:13.639272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798642+0000","last_change":"2023-10-06T03:01:41.792276+0000","last_active":"2023-10-06T03:01:41.798642+0000","last_peered":"2023-10-06T03:01:41.798642+0000","last_clean":"2023-10-06T03:01:41.798642+0000","last_became_active":"2023-10-06T03:01:41.792022+0000","last_became_peered":"2023-10-06T03:01:41.792022+0000","last_unstale":"2023-10-06T03:01:41.798642+0000","last_undegraded":"2023-10-06T03:01:41.798642+0000","last_fullsized":"2023-10-06T03:01:41.798642+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:00.133619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.188641+0000","last_change":"2023-10-06T03:01:42.188641+0000","last_active":"2023-10-06T03:01:42.188641+0000","last_peered":"2023-10-06T03:01:42.188641+0000","last_clean":"2023-10-06T03:01:42.188641+0000","last_became_active":"2023-10-06T03:01:42.188048+0000","last_became_peered":"2023-10-06T03:01:42.188048+0000","last_unstale":"2023-10-06T03:01:42.188641+0000","last_undegraded":"2023-10-06T03:01:42.188641+0000","last_fullsized":"2023-10-06T03:01:42.188641+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:20.048805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.172123+0000","last_change":"2023-10-06T03:01:41.793137+0000","last_active":"2023-10-06T03:01:42.172123+0000","last_peered":"2023-10-06T03:01:42.172123+0000","last_clean":"2023-10-06T03:01:42.172123+0000","last_became_active":"2023-10-06T03:01:41.792867+0000","last_became_peered":"2023-10-06T03:01:41.792867+0000","last_unstale":"2023-10-06T03:01:42.172123+0000","last_undegraded":"2023-10-06T03:01:42.172123+0000","last_fullsized":"2023-10-06T03:01:42.172123+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:51.200930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184959+0000","last_change":"2023-10-06T03:01:42.179603+0000","last_active":"2023-10-06T03:01:42.184959+0000","last_peered":"2023-10-06T03:01:42.184959+0000","last_clean":"2023-10-06T03:01:42.184959+0000","last_became_active":"2023-10-06T03:01:42.179388+0000","last_became_peered":"2023-10-06T03:01:42.179388+0000","last_unstale":"2023-10-06T03:01:42.184959+0000","last_undegraded":"2023-10-06T03:01:42.184959+0000","last_fullsized":"2023-10-06T03:01:42.184959+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:55:23.876224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.786796+0000","last_change":"2023-10-06T03:01:41.782044+0000","last_active":"2023-10-06T03:01:41.786796+0000","last_peered":"2023-10-06T03:01:41.786796+0000","last_clean":"2023-10-06T03:01:41.786796+0000","last_became_active":"2023-10-06T03:01:41.781278+0000","last_became_peered":"2023-10-06T03:01:41.781278+0000","last_unstale":"2023-10-06T03:01:41.786796+0000","last_undegraded":"2023-10-06T03:01:41.786796+0000","last_fullsized":"2023-10-06T03:01:41.786796+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:47:27.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186404+0000","last_change":"2023-10-06T03:01:42.179529+0000","last_active":"2023-10-06T03:01:42.186404+0000","last_peered":"2023-10-06T03:01:42.186404+0000","last_clean":"2023-10-06T03:01:42.186404+0000","last_became_active":"2023-10-06T03:01:42.179252+0000","last_became_peered":"2023-10-06T03:01:42.179252+0000","last_unstale":"2023-10-06T03:01:42.186404+0000","last_undegraded":"2023-10-06T03:01:42.186404+0000","last_fullsized":"2023-10-06T03:01:42.186404+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:51.087613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"105'2","reported_seq":12,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.792666+0000","last_change":"2023-10-06T03:01:41.793789+0000","last_active":"2023-10-06T03:01:42.792666+0000","last_peered":"2023-10-06T03:01:42.792666+0000","last_clean":"2023-10-06T03:01:42.792666+0000","last_became_active":"2023-10-06T03:01:41.793540+0000","last_became_peered":"2023-10-06T03:01:41.793540+0000","last_unstale":"2023-10-06T03:01:42.792666+0000","last_undegraded":"2023-10-06T03:01:42.792666+0000","last_fullsized":"2023-10-06T03:01:42.792666+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:17:29.827848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184344+0000","last_change":"2023-10-06T03:01:42.184344+0000","last_active":"2023-10-06T03:01:42.184344+0000","last_peered":"2023-10-06T03:01:42.184344+0000","last_clean":"2023-10-06T03:01:42.184344+0000","last_became_active":"2023-10-06T03:01:42.182573+0000","last_became_peered":"2023-10-06T03:01:42.182573+0000","last_unstale":"2023-10-06T03:01:42.184344+0000","last_undegraded":"2023-10-06T03:01:42.184344+0000","last_fullsized":"2023-10-06T03:01:42.184344+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:08.589651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.169611+0000","last_change":"2023-10-06T03:01:41.790653+0000","last_active":"2023-10-06T03:01:42.169611+0000","last_peered":"2023-10-06T03:01:42.169611+0000","last_clean":"2023-10-06T03:01:42.169611+0000","last_became_active":"2023-10-06T03:01:41.790374+0000","last_became_peered":"2023-10-06T03:01:41.790374+0000","last_unstale":"2023-10-06T03:01:42.169611+0000","last_undegraded":"2023-10-06T03:01:42.169611+0000","last_fullsized":"2023-10-06T03:01:42.169611+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:02.331761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.180179+0000","last_change":"2023-10-06T03:01:42.180179+0000","last_active":"2023-10-06T03:01:42.180179+0000","last_peered":"2023-10-06T03:01:42.180179+0000","last_clean":"2023-10-06T03:01:42.180179+0000","last_became_active":"2023-10-06T03:01:42.179907+0000","last_became_peered":"2023-10-06T03:01:42.179907+0000","last_unstale":"2023-10-06T03:01:42.180179+0000","last_undegraded":"2023-10-06T03:01:42.180179+0000","last_fullsized":"2023-10-06T03:01:42.180179+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:57.870751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.786752+0000","last_change":"2023-10-06T03:01:41.781751+0000","last_active":"2023-10-06T03:01:41.786752+0000","last_peered":"2023-10-06T03:01:41.786752+0000","last_clean":"2023-10-06T03:01:41.786752+0000","last_became_active":"2023-10-06T03:01:41.781511+0000","last_became_peered":"2023-10-06T03:01:41.781511+0000","last_unstale":"2023-10-06T03:01:41.786752+0000","last_undegraded":"2023-10-06T03:01:41.786752+0000","last_fullsized":"2023-10-06T03:01:41.786752+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:32.193230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186599+0000","last_change":"2023-10-06T03:01:42.179609+0000","last_active":"2023-10-06T03:01:42.186599+0000","last_peered":"2023-10-06T03:01:42.186599+0000","last_clean":"2023-10-06T03:01:42.186599+0000","last_became_active":"2023-10-06T03:01:42.179317+0000","last_became_peered":"2023-10-06T03:01:42.179317+0000","last_unstale":"2023-10-06T03:01:42.186599+0000","last_undegraded":"2023-10-06T03:01:42.186599+0000","last_fullsized":"2023-10-06T03:01:42.186599+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:44.637882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.170328+0000","last_change":"2023-10-06T03:01:41.797532+0000","last_active":"2023-10-06T03:01:42.170328+0000","last_peered":"2023-10-06T03:01:42.170328+0000","last_clean":"2023-10-06T03:01:42.170328+0000","last_became_active":"2023-10-06T03:01:41.797260+0000","last_became_peered":"2023-10-06T03:01:41.797260+0000","last_unstale":"2023-10-06T03:01:42.170328+0000","last_undegraded":"2023-10-06T03:01:42.170328+0000","last_fullsized":"2023-10-06T03:01:42.170328+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:30.136969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183976+0000","last_change":"2023-10-06T03:01:42.183976+0000","last_active":"2023-10-06T03:01:42.183976+0000","last_peered":"2023-10-06T03:01:42.183976+0000","last_clean":"2023-10-06T03:01:42.183976+0000","last_became_active":"2023-10-06T03:01:42.183707+0000","last_became_peered":"2023-10-06T03:01:42.183707+0000","last_unstale":"2023-10-06T03:01:42.183976+0000","last_undegraded":"2023-10-06T03:01:42.183976+0000","last_fullsized":"2023-10-06T03:01:42.183976+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:24:59.573762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798144+0000","last_change":"2023-10-06T03:01:41.790304+0000","last_active":"2023-10-06T03:01:41.798144+0000","last_peered":"2023-10-06T03:01:41.798144+0000","last_clean":"2023-10-06T03:01:41.798144+0000","last_became_active":"2023-10-06T03:01:41.789968+0000","last_became_peered":"2023-10-06T03:01:41.789968+0000","last_unstale":"2023-10-06T03:01:41.798144+0000","last_undegraded":"2023-10-06T03:01:41.798144+0000","last_fullsized":"2023-10-06T03:01:41.798144+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:15.826496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.181577+0000","last_change":"2023-10-06T03:01:42.181577+0000","last_active":"2023-10-06T03:01:42.181577+0000","last_peered":"2023-10-06T03:01:42.181577+0000","last_clean":"2023-10-06T03:01:42.181577+0000","last_became_active":"2023-10-06T03:01:42.181220+0000","last_became_peered":"2023-10-06T03:01:42.181220+0000","last_unstale":"2023-10-06T03:01:42.181577+0000","last_undegraded":"2023-10-06T03:01:42.181577+0000","last_fullsized":"2023-10-06T03:01:42.181577+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:15:30.597645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.800732+0000","last_change":"2023-10-06T03:01:41.796925+0000","last_active":"2023-10-06T03:01:41.800732+0000","last_peered":"2023-10-06T03:01:41.800732+0000","last_clean":"2023-10-06T03:01:41.800732+0000","last_became_active":"2023-10-06T03:01:41.796682+0000","last_became_peered":"2023-10-06T03:01:41.796682+0000","last_unstale":"2023-10-06T03:01:41.800732+0000","last_undegraded":"2023-10-06T03:01:41.800732+0000","last_fullsized":"2023-10-06T03:01:41.800732+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:12.415491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.188485+0000","last_change":"2023-10-06T03:01:42.188485+0000","last_active":"2023-10-06T03:01:42.188485+0000","last_peered":"2023-10-06T03:01:42.188485+0000","last_clean":"2023-10-06T03:01:42.188485+0000","last_became_active":"2023-10-06T03:01:42.187765+0000","last_became_peered":"2023-10-06T03:01:42.187765+0000","last_unstale":"2023-10-06T03:01:42.188485+0000","last_undegraded":"2023-10-06T03:01:42.188485+0000","last_fullsized":"2023-10-06T03:01:42.188485+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:55.619007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798594+0000","last_change":"2023-10-06T03:01:41.793036+0000","last_active":"2023-10-06T03:01:41.798594+0000","last_peered":"2023-10-06T03:01:41.798594+0000","last_clean":"2023-10-06T03:01:41.798594+0000","last_became_active":"2023-10-06T03:01:41.791532+0000","last_became_peered":"2023-10-06T03:01:41.791532+0000","last_unstale":"2023-10-06T03:01:41.798594+0000","last_undegraded":"2023-10-06T03:01:41.798594+0000","last_fullsized":"2023-10-06T03:01:41.798594+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:57.978663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.178339+0000","last_change":"2023-10-06T03:01:42.178339+0000","last_active":"2023-10-06T03:01:42.178339+0000","last_peered":"2023-10-06T03:01:42.178339+0000","last_clean":"2023-10-06T03:01:42.178339+0000","last_became_active":"2023-10-06T03:01:42.178079+0000","last_became_peered":"2023-10-06T03:01:42.178079+0000","last_unstale":"2023-10-06T03:01:42.178339+0000","last_undegraded":"2023-10-06T03:01:42.178339+0000","last_fullsized":"2023-10-06T03:01:42.178339+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:37.831830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.792195+0000","last_change":"2023-10-06T03:01:41.784383+0000","last_active":"2023-10-06T03:01:41.792195+0000","last_peered":"2023-10-06T03:01:41.792195+0000","last_clean":"2023-10-06T03:01:41.792195+0000","last_became_active":"2023-10-06T03:01:41.783961+0000","last_became_peered":"2023-10-06T03:01:41.783961+0000","last_unstale":"2023-10-06T03:01:41.792195+0000","last_undegraded":"2023-10-06T03:01:41.792195+0000","last_fullsized":"2023-10-06T03:01:41.792195+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:25.245328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.186553+0000","last_change":"2023-10-06T03:01:42.180651+0000","last_active":"2023-10-06T03:01:42.186553+0000","last_peered":"2023-10-06T03:01:42.186553+0000","last_clean":"2023-10-06T03:01:42.186553+0000","last_became_active":"2023-10-06T03:01:42.180391+0000","last_became_peered":"2023-10-06T03:01:42.180391+0000","last_unstale":"2023-10-06T03:01:42.186553+0000","last_undegraded":"2023-10-06T03:01:42.186553+0000","last_fullsized":"2023-10-06T03:01:42.186553+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:09.254585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.169840+0000","last_change":"2023-10-06T03:01:41.793720+0000","last_active":"2023-10-06T03:01:42.169840+0000","last_peered":"2023-10-06T03:01:42.169840+0000","last_clean":"2023-10-06T03:01:42.169840+0000","last_became_active":"2023-10-06T03:01:41.793437+0000","last_became_peered":"2023-10-06T03:01:41.793437+0000","last_unstale":"2023-10-06T03:01:42.169840+0000","last_undegraded":"2023-10-06T03:01:42.169840+0000","last_fullsized":"2023-10-06T03:01:42.169840+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:23.646405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.173070+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T03:01:42.173070+0000","last_peered":"2023-10-06T03:01:42.173070+0000","last_clean":"2023-10-06T03:01:42.173070+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T03:01:42.173070+0000","last_undegraded":"2023-10-06T03:01:42.173070+0000","last_fullsized":"2023-10-06T03:01:42.173070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.184977+0000","last_change":"2023-10-06T03:01:42.181684+0000","last_active":"2023-10-06T03:01:42.184977+0000","last_peered":"2023-10-06T03:01:42.184977+0000","last_clean":"2023-10-06T03:01:42.184977+0000","last_became_active":"2023-10-06T03:01:42.181409+0000","last_became_peered":"2023-10-06T03:01:42.181409+0000","last_unstale":"2023-10-06T03:01:42.184977+0000","last_undegraded":"2023-10-06T03:01:42.184977+0000","last_fullsized":"2023-10-06T03:01:42.184977+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:55.619007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"105'8","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.794522+0000","last_change":"2023-10-06T03:01:41.790689+0000","last_active":"2023-10-06T03:01:42.794522+0000","last_peered":"2023-10-06T03:01:42.794522+0000","last_clean":"2023-10-06T03:01:42.794522+0000","last_became_active":"2023-10-06T03:01:41.790434+0000","last_became_peered":"2023-10-06T03:01:41.790434+0000","last_unstale":"2023-10-06T03:01:42.794522+0000","last_undegraded":"2023-10-06T03:01:42.794522+0000","last_fullsized":"2023-10-06T03:01:42.794522+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:46:51.200930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.785880+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T03:01:41.785880+0000","last_peered":"2023-10-06T03:01:41.785880+0000","last_clean":"2023-10-06T03:01:41.785880+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T03:01:41.785880+0000","last_undegraded":"2023-10-06T03:01:41.785880+0000","last_fullsized":"2023-10-06T03:01:41.785880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183741+0000","last_change":"2023-10-06T03:01:42.181702+0000","last_active":"2023-10-06T03:01:42.183741+0000","last_peered":"2023-10-06T03:01:42.183741+0000","last_clean":"2023-10-06T03:01:42.183741+0000","last_became_active":"2023-10-06T03:01:42.181472+0000","last_became_peered":"2023-10-06T03:01:42.181472+0000","last_unstale":"2023-10-06T03:01:42.183741+0000","last_undegraded":"2023-10-06T03:01:42.183741+0000","last_fullsized":"2023-10-06T03:01:42.183741+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:46.774669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"105'2","reported_seq":12,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.794346+0000","last_change":"2023-10-06T03:01:41.794232+0000","last_active":"2023-10-06T03:01:42.794346+0000","last_peered":"2023-10-06T03:01:42.794346+0000","last_clean":"2023-10-06T03:01:42.794346+0000","last_became_active":"2023-10-06T03:01:41.793790+0000","last_became_peered":"2023-10-06T03:01:41.793790+0000","last_unstale":"2023-10-06T03:01:42.794346+0000","last_undegraded":"2023-10-06T03:01:42.794346+0000","last_fullsized":"2023-10-06T03:01:42.794346+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:51.503681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.779583+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T03:01:41.779583+0000","last_peered":"2023-10-06T03:01:41.779583+0000","last_clean":"2023-10-06T03:01:41.779583+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T03:01:41.779583+0000","last_undegraded":"2023-10-06T03:01:41.779583+0000","last_fullsized":"2023-10-06T03:01:41.779583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.190353+0000","last_change":"2023-10-06T03:01:42.189810+0000","last_active":"2023-10-06T03:01:42.190353+0000","last_peered":"2023-10-06T03:01:42.190353+0000","last_clean":"2023-10-06T03:01:42.190353+0000","last_became_active":"2023-10-06T03:01:42.189525+0000","last_became_peered":"2023-10-06T03:01:42.189525+0000","last_unstale":"2023-10-06T03:01:42.190353+0000","last_undegraded":"2023-10-06T03:01:42.190353+0000","last_fullsized":"2023-10-06T03:01:42.190353+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:38.185997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.800853+0000","last_change":"2023-10-06T03:01:41.796751+0000","last_active":"2023-10-06T03:01:41.800853+0000","last_peered":"2023-10-06T03:01:41.800853+0000","last_clean":"2023-10-06T03:01:41.800853+0000","last_became_active":"2023-10-06T03:01:41.796516+0000","last_became_peered":"2023-10-06T03:01:41.796516+0000","last_unstale":"2023-10-06T03:01:41.800853+0000","last_undegraded":"2023-10-06T03:01:41.800853+0000","last_fullsized":"2023-10-06T03:01:41.800853+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:48.389822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.785822+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T03:01:41.785822+0000","last_peered":"2023-10-06T03:01:41.785822+0000","last_clean":"2023-10-06T03:01:41.785822+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T03:01:41.785822+0000","last_undegraded":"2023-10-06T03:01:41.785822+0000","last_fullsized":"2023-10-06T03:01:41.785822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.783816+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T03:01:41.783816+0000","last_peered":"2023-10-06T03:01:41.783816+0000","last_clean":"2023-10-06T03:01:41.783816+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T03:01:41.783816+0000","last_undegraded":"2023-10-06T03:01:41.783816+0000","last_fullsized":"2023-10-06T03:01:41.783816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.187410+0000","last_change":"2023-10-06T03:01:42.185669+0000","last_active":"2023-10-06T03:01:42.187410+0000","last_peered":"2023-10-06T03:01:42.187410+0000","last_clean":"2023-10-06T03:01:42.187410+0000","last_became_active":"2023-10-06T03:01:42.185408+0000","last_became_peered":"2023-10-06T03:01:42.185408+0000","last_unstale":"2023-10-06T03:01:42.187410+0000","last_undegraded":"2023-10-06T03:01:42.187410+0000","last_fullsized":"2023-10-06T03:01:42.187410+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:27.234365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.169316+0000","last_change":"2023-10-06T03:01:41.784872+0000","last_active":"2023-10-06T03:01:42.169316+0000","last_peered":"2023-10-06T03:01:42.169316+0000","last_clean":"2023-10-06T03:01:42.169316+0000","last_became_active":"2023-10-06T03:01:41.784606+0000","last_became_peered":"2023-10-06T03:01:41.784606+0000","last_unstale":"2023-10-06T03:01:42.169316+0000","last_undegraded":"2023-10-06T03:01:42.169316+0000","last_fullsized":"2023-10-06T03:01:42.169316+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:22.122969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.783860+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T03:01:41.783860+0000","last_peered":"2023-10-06T03:01:41.783860+0000","last_clean":"2023-10-06T03:01:41.783860+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T03:01:41.783860+0000","last_undegraded":"2023-10-06T03:01:41.783860+0000","last_fullsized":"2023-10-06T03:01:41.783860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.181238+0000","last_change":"2023-10-06T03:01:42.181238+0000","last_active":"2023-10-06T03:01:42.181238+0000","last_peered":"2023-10-06T03:01:42.181238+0000","last_clean":"2023-10-06T03:01:42.181238+0000","last_became_active":"2023-10-06T03:01:42.180968+0000","last_became_peered":"2023-10-06T03:01:42.180968+0000","last_unstale":"2023-10-06T03:01:42.181238+0000","last_undegraded":"2023-10-06T03:01:42.181238+0000","last_fullsized":"2023-10-06T03:01:42.181238+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:53:03.336339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.798709+0000","last_change":"2023-10-06T03:01:41.796800+0000","last_active":"2023-10-06T03:01:41.798709+0000","last_peered":"2023-10-06T03:01:41.798709+0000","last_clean":"2023-10-06T03:01:41.798709+0000","last_became_active":"2023-10-06T03:01:41.796541+0000","last_became_peered":"2023-10-06T03:01:41.796541+0000","last_unstale":"2023-10-06T03:01:41.798709+0000","last_undegraded":"2023-10-06T03:01:41.798709+0000","last_fullsized":"2023-10-06T03:01:41.798709+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:58.705380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-06T03:01:41.783719+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T03:01:41.783719+0000","last_peered":"2023-10-06T03:01:41.783719+0000","last_clean":"2023-10-06T03:01:41.783719+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T03:01:41.783719+0000","last_undegraded":"2023-10-06T03:01:41.783719+0000","last_fullsized":"2023-10-06T03:01:41.783719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.185654+0000","last_change":"2023-10-06T03:01:42.185654+0000","last_active":"2023-10-06T03:01:42.185654+0000","last_peered":"2023-10-06T03:01:42.185654+0000","last_clean":"2023-10-06T03:01:42.185654+0000","last_became_active":"2023-10-06T03:01:42.185396+0000","last_became_peered":"2023-10-06T03:01:42.185396+0000","last_unstale":"2023-10-06T03:01:42.185654+0000","last_undegraded":"2023-10-06T03:01:42.185654+0000","last_fullsized":"2023-10-06T03:01:42.185654+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:22.225685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"105'6","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.793378+0000","last_change":"2023-10-06T03:01:41.794185+0000","last_active":"2023-10-06T03:01:42.793378+0000","last_peered":"2023-10-06T03:01:42.793378+0000","last_clean":"2023-10-06T03:01:42.793378+0000","last_became_active":"2023-10-06T03:01:41.793938+0000","last_became_peered":"2023-10-06T03:01:41.793938+0000","last_unstale":"2023-10-06T03:01:42.793378+0000","last_undegraded":"2023-10-06T03:01:42.793378+0000","last_fullsized":"2023-10-06T03:01:42.793378+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:23.312600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.172010+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T03:01:42.172010+0000","last_peered":"2023-10-06T03:01:42.172010+0000","last_clean":"2023-10-06T03:01:42.172010+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T03:01:42.172010+0000","last_undegraded":"2023-10-06T03:01:42.172010+0000","last_fullsized":"2023-10-06T03:01:42.172010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.183716+0000","last_change":"2023-10-06T03:01:42.181986+0000","last_active":"2023-10-06T03:01:42.183716+0000","last_peered":"2023-10-06T03:01:42.183716+0000","last_clean":"2023-10-06T03:01:42.183716+0000","last_became_active":"2023-10-06T03:01:42.181727+0000","last_became_peered":"2023-10-06T03:01:42.181727+0000","last_unstale":"2023-10-06T03:01:42.183716+0000","last_undegraded":"2023-10-06T03:01:42.183716+0000","last_fullsized":"2023-10-06T03:01:42.183716+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:41.766009+0000","last_clean_scrub_stamp":"2023-10-06T03:01:41.766009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:25.997488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"105'3","reported_seq":12,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.789332+0000","last_change":"2023-10-06T03:01:41.792568+0000","last_active":"2023-10-06T03:01:42.789332+0000","last_peered":"2023-10-06T03:01:42.789332+0000","last_clean":"2023-10-06T03:01:42.789332+0000","last_became_active":"2023-10-06T03:01:41.792283+0000","last_became_peered":"2023-10-06T03:01:41.792283+0000","last_unstale":"2023-10-06T03:01:42.789332+0000","last_undegraded":"2023-10-06T03:01:42.789332+0000","last_fullsized":"2023-10-06T03:01:42.789332+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:40.761431+0000","last_clean_scrub_stamp":"2023-10-06T03:01:40.761431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:52.733904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":93,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-06T03:01:42.169811+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T03:01:42.169811+0000","last_peered":"2023-10-06T03:01:42.169811+0000","last_clean":"2023-10-06T03:01:42.169811+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T03:01:42.169811+0000","last_undegraded":"2023-10-06T03:01:42.169811+0000","last_fullsized":"2023-10-06T03:01:42.169811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299148,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072692,"statfs":{"total":96636764160,"available":96330436608,"internally_reserved":0,"allocated":1904640,"data_stored":1218856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.73599999999999999,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.434},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73399999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.33100000000000002,"15min":0.29899999999999999},"max":{"1min":0.65100000000000002,"5min":0.746,"15min":0.78700000000000003},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.499},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.57199999999999995},"min":{"1min":0.41499999999999998,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.71099999999999997,"5min":0.73499999999999999,"15min":0.78000000000000003},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70699999999999996,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.42799999999999999,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45200000000000001,"15min":0.49299999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63600000000000001,"5min":0.71199999999999997,"15min":0.72399999999999998},"last":0.376},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.503,"15min":0.51400000000000001},"min":{"1min":0.35199999999999998,"5min":0.30199999999999999,"15min":0.25600000000000001},"max":{"1min":0.67400000000000004,"5min":0.68700000000000006,"15min":0.72799999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.50900000000000001,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.78300000000000003,"15min":0.83299999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.308,"15min":0.308},"max":{"1min":0.65500000000000003,"5min":0.73699999999999999,"15min":0.75700000000000001},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.56100000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.79700000000000004},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":627970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.59799999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.86099999999999999,"15min":3.415},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.57699999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73199999999999998,"5min":0.746,"15min":1.4219999999999999},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53500000000000003,"15min":0.55200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.71399999999999997,"5min":0.81999999999999995,"15min":1.546},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56200000000000006,"15min":0.58399999999999996},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.6319999999999999},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":1.74},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56399999999999995,"15min":0.69399999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.80300000000000005,"15min":3.4830000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58399999999999996,"15min":0.69399999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":3.577},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.66400000000000003},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79700000000000004,"5min":0.82099999999999995,"15min":1.9219999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.58299999999999996},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.80700000000000005},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79500000000000004,"5min":0.80300000000000005,"15min":0.83399999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.87,"15min":0.87},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53400000000000003,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76300000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.745},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58999999999999997,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.77800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":627013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32600000000000001,"15min":0.38400000000000001},"min":{"1min":0.20699999999999999,"5min":0.193,"15min":0.19},"max":{"1min":0.45100000000000001,"5min":0.57699999999999996,"15min":2.0209999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35099999999999998,"15min":0.36699999999999999},"min":{"1min":0.25,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48599999999999999,"5min":0.59999999999999998,"15min":1.0409999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35799999999999998,"15min":1.0660000000000001},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.48699999999999999,"5min":0.58099999999999996,"15min":21.193999999999999},"last":0.499},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40200000000000002,"15min":0.433},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45800000000000002,"5min":0.65500000000000003,"15min":1.181},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.38700000000000001,"15min":0.42899999999999999},"min":{"1min":0.26300000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.45200000000000001,"5min":0.628,"15min":2.0579999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.248,"15min":0.248},"max":{"1min":0.51600000000000001,"5min":0.626,"15min":0.626},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59099999999999997,"15min":0.56899999999999995},"min":{"1min":0.42699999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82599999999999996,"5min":0.95699999999999996,"15min":1.02},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":1.286},"min":{"1min":0.46700000000000003,"5min":0.308,"15min":0.29799999999999999},"max":{"1min":0.83599999999999997,"5min":0.85599999999999998,"15min":21.135000000000002},"last":0.80700000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":1.276},"min":{"1min":0.41999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80700000000000005,"5min":0.95699999999999996,"15min":21.085000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":1.2789999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.58799999999999997},"min":{"1min":0.46100000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.83099999999999996,"5min":1.016,"15min":1.016},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59399999999999997,"15min":1.304},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81499999999999995,"5min":0.92600000000000005,"15min":21.166},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.43099999999999999,"15min":0.40999999999999998},"max":{"1min":0.77500000000000002,"5min":0.91800000000000004,"15min":1.2450000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.60999999999999999},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81100000000000005,"5min":0.99099999999999999,"15min":0.997},"last":0.79600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":1912832,"data_stored":1218905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.32300000000000001,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":0.438,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.378},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.33200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.53200000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.374,"15min":0.372},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.47499999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34100000000000003,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.22600000000000001,"15min":0.20799999999999999},"max":{"1min":0.52800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48199999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.441},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38900000000000001,"15min":0.40300000000000002},"min":{"1min":0.29099999999999998,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.60699999999999998},"last":0.39100000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.41399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.89800000000000002},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57099999999999995,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77800000000000002,"5min":0.82499999999999996,"15min":0.85599999999999998},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.61099999999999999},"min":{"1min":0.436,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.48299999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.77100000000000002,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.42999999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.80900000000000005,"5min":0.90900000000000003,"15min":0.91200000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78300000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298560,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073280,"statfs":{"total":96636764160,"available":96331038720,"internally_reserved":0,"allocated":1302528,"data_stored":627900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33400000000000002,"15min":0.314},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.69499999999999995},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.32800000000000001},"min":{"1min":0.23400000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.25800000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.503,"5min":0.58399999999999996,"15min":0.72399999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":1.0129999999999999},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.255,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53500000000000003,"5min":0.55400000000000005,"15min":0.92100000000000004},"last":0.317},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.40300000000000002},"min":{"1min":0.312,"5min":0.26700000000000002,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.63100000000000001,"15min":0.78900000000000003},"last":0.30299999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.753,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.36299999999999999},"max":{"1min":0.88700000000000001,"5min":1.276,"15min":1.276},"last":0.496}]},{"osd":6,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61899999999999999,"15min":0.58099999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":0.89500000000000002,"15min":1.077},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63200000000000001,"15min":0.57899999999999996},"min":{"1min":0.45300000000000001,"5min":0.434,"15min":0.42299999999999999},"max":{"1min":0.83899999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63200000000000001,"15min":0.60199999999999998},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.47999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298584,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073256,"statfs":{"total":96636764160,"available":96331014144,"internally_reserved":0,"allocated":1327104,"data_stored":635456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.432},"min":{"1min":0.254,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.54600000000000004,"5min":0.623,"15min":2.569},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.375,"15min":0.436},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56100000000000005,"5min":0.57499999999999996,"15min":2.1840000000000002},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35099999999999998,"15min":0.41999999999999998},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":2.3199999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38400000000000001,"15min":0.45900000000000002},"min":{"1min":0.28000000000000003,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60699999999999998,"5min":0.64100000000000001,"15min":2.5979999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.45200000000000001},"min":{"1min":0.24299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":2.3439999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41199999999999998,"15min":0.47799999999999998},"min":{"1min":0.28399999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":2.6269999999999998},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57999999999999996,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.85099999999999998,"15min":2.1240000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59099999999999997,"15min":0.65500000000000003},"min":{"1min":0.45100000000000001,"5min":0.375,"15min":0.374},"max":{"1min":0.81200000000000006,"5min":0.81899999999999995,"15min":2.2240000000000002},"last":0.53400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.65800000000000003},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.76700000000000002,"5min":0.84699999999999998,"15min":2.2650000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60099999999999998,"15min":0.67300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":0.82999999999999996,"15min":2.532},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86499999999999999,"5min":0.87,"15min":2.0840000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.68400000000000005},"min":{"1min":0.48099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.81000000000000005,"5min":0.85499999999999998,"15min":2.2930000000000001},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.70699999999999996},"min":{"1min":0.45500000000000002,"5min":0.436,"15min":0.434},"max":{"1min":0.81799999999999995,"5min":0.90600000000000003,"15min":2.496},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60299999999999998,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38400000000000001},"max":{"1min":0.877,"5min":0.877,"15min":2.1549999999999998},"last":0.57399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298560,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073280,"statfs":{"total":96636764160,"available":96331038720,"internally_reserved":0,"allocated":1302528,"data_stored":627900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.39800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65200000000000002,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.496},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.755,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80700000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.40300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.57399999999999995,"15min":0.56599999999999995},"min":{"1min":0.40300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.68700000000000006,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60799999999999998,"15min":0.93799999999999994},"min":{"1min":0.40799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.71299999999999997,"5min":0.871,"15min":9.4440000000000008},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.50700000000000001,"15min":0.54600000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.437},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.54900000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64500000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.58999999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67000000000000004,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.61299999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:01:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68899999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.65100000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298568,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073272,"statfs":{"total":96636764160,"available":96331030528,"internally_reserved":0,"allocated":1310720,"data_stored":628476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.51500000000000001,"15min":0.495},"min":{"1min":0.34799999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.622,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73699999999999999,"5min":0.73899999999999999,"15min":1.167},"last":0.379}]},{"osd":1,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.52600000000000002,"15min":0.56399999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.71599999999999997,"5min":0.746,"15min":1.117},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.52400000000000002,"15min":0.50900000000000001},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.29499999999999998},"max":{"1min":0.624,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53800000000000003,"15min":0.56200000000000006},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60399999999999998,"5min":0.76700000000000002,"15min":1.2},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.58499999999999996},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":1.1759999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":1.135},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.56100000000000005,"15min":0.59999999999999998},"min":{"1min":0.378,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.81599999999999995,"15min":1.208},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46400000000000002,"15min":0.49399999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":0.623,"5min":0.76200000000000001,"15min":0.78000000000000003},"last":0.495},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.87},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.56499999999999995},"min":{"1min":0.33500000000000002,"5min":0.32200000000000001,"15min":0.28499999999999998},"max":{"1min":0.76200000000000001,"5min":0.89200000000000002,"15min":1.054},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52400000000000002,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68500000000000005,"5min":0.80600000000000005,"15min":0.90100000000000002},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:01:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53100000000000003,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.622},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":0.75700000000000001,"5min":0.85799999999999998,"15min":1.008},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:01:47.355 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:01:47.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:01:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.476+0000 7f43f2c57700 1 Processor -- start 2023-10-06T03:01:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.476+0000 7f43f2c57700 1 -- start start 2023-10-06T03:01:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2c57700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0cd400 0x7f43ec0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2c57700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f43ec0b2a30 0x7f43ec0cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2c57700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0cc9b0 con 0x7f43ec0b2660 2023-10-06T03:01:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2c57700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0cf560 con 0x7f43ec0b2a30 2023-10-06T03:01:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2c57700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0cbda0 con 0x7f43ec0cd400 2023-10-06T03:01:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f1c55700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f43ec0b2660 0x7f43ec0cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49376/0 (socket says 172.21.15.84:49376) 2023-10-06T03:01:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f1c55700 1 -- 172.21.15.84:0/3377731498 learned_addr learned my addr 172.21.15.84:0/3377731498 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2456700 1 --2- 172.21.15.84:0/3377731498 >> v2:172.21.15.84:3300/0 conn(0x7f43ec0b2a30 0x7f43ec0cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f1454700 1 --2- 172.21.15.84:0/3377731498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0cd400 0x7f43ec0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f0c53700 1 -- 172.21.15.84:0/3377731498 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227242510 0 0) 0x7f43ec0cc9b0 con 0x7f43ec0b2660 2023-10-06T03:01:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f0c53700 1 -- 172.21.15.84:0/3377731498 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d8003570 con 0x7f43ec0b2660 2023-10-06T03:01:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2456700 1 -- 172.21.15.84:0/3377731498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0cd400 msgr2=0x7f43ec0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2456700 1 --2- 172.21.15.84:0/3377731498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0cd400 0x7f43ec0ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2456700 1 -- 172.21.15.84:0/3377731498 >> v1:172.21.15.84:6789/0 conn(0x7f43ec0b2660 legacy=0x7f43ec0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.477+0000 7f43f2456700 1 -- 172.21.15.84:0/3377731498 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0cc080 con 0x7f43ec0b2a30 2023-10-06T03:01:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f2456700 1 --2- 172.21.15.84:0/3377731498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0b2a30 0x7f43ec0cf020 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009e60 tx=0x7f43e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4dc4c56e2d4882 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f0c53700 1 -- 172.21.15.84:0/3377731498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400e070 con 0x7f43ec0b2a30 2023-10-06T03:01:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f0c53700 1 -- 172.21.15.84:0/3377731498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e400bb60 con 0x7f43ec0b2a30 2023-10-06T03:01:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f0c53700 1 -- 172.21.15.84:0/3377731498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4012430 con 0x7f43ec0b2a30 2023-10-06T03:01:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f2c57700 1 -- 172.21.15.84:0/3377731498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0b2a30 msgr2=0x7f43ec0cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f2c57700 1 --2- 172.21.15.84:0/3377731498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0b2a30 0x7f43ec0cf020 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009e60 tx=0x7f43e4009780 comp rx=0 tx=0).stop 2023-10-06T03:01:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f2c57700 1 -- 172.21.15.84:0/3377731498 shutdown_connections 2023-10-06T03:01:47.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f2c57700 1 --2- 172.21.15.84:0/3377731498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0b2a30 0x7f43ec0cf020 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f2c57700 1 --2- 172.21.15.84:0/3377731498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0cd400 0x7f43ec0ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f2c57700 1 -- 172.21.15.84:0/3377731498 >> 172.21.15.84:0/3377731498 conn(0x7f43ec099560 msgr2=0x7f43ec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:47.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f2c57700 1 -- 172.21.15.84:0/3377731498 shutdown_connections 2023-10-06T03:01:47.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.478+0000 7f43f2c57700 1 -- 172.21.15.84:0/3377731498 wait complete. 2023-10-06T03:01:47.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.479+0000 7f43f2c57700 1 Processor -- start 2023-10-06T03:01:47.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.479+0000 7f43f2c57700 1 -- start start 2023-10-06T03:01:47.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f2c57700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43ec0b2660 0x7f43ec154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f2c57700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0b2a30 0x7f43ec0b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f2c57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0cd400 0x7f43ec15d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f2c57700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0c7eb0 con 0x7f43ec0cd400 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f2c57700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec1547d0 con 0x7f43ec0b2660 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f2c57700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0b6020 con 0x7f43ec0b2a30 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f2456700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0cd400 0x7f43ec15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f2456700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0cd400 0x7f43ec15d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49002/0 (socket says 172.21.15.84:49002) 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f2456700 1 -- 172.21.15.84:0/1971431715 learned_addr learned my addr 172.21.15.84:0/1971431715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f1454700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0b2a30 0x7f43ec0b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.480+0000 7f43f1c55700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43ec0b2660 0x7f43ec154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43f2456700 1 -- 172.21.15.84:0/1971431715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0b2a30 msgr2=0x7f43ec0b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43f2456700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0b2a30 0x7f43ec0b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43f2456700 1 -- 172.21.15.84:0/1971431715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43ec0b2660 msgr2=0x7f43ec154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43f2456700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43ec0b2660 0x7f43ec154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43f2456700 1 -- 172.21.15.84:0/1971431715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e4009a20 con 0x7f43ec0cd400 2023-10-06T03:01:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43f1454700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0b2a30 0x7f43ec0b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43f2456700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0cd400 0x7f43ec15d140 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f43e4013000 tx=0x7f43e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43e1ffb700 1 -- 172.21.15.84:0/1971431715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e401d630 con 0x7f43ec0cd400 2023-10-06T03:01:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43e1ffb700 1 -- 172.21.15.84:0/1971431715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e401d7b0 con 0x7f43ec0cd400 2023-10-06T03:01:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec0c7580 con 0x7f43ec0cd400 2023-10-06T03:01:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43e1ffb700 1 -- 172.21.15.84:0/1971431715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e401db70 con 0x7f43ec0cd400 2023-10-06T03:01:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.481+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec0c7b40 con 0x7f43ec0cd400 2023-10-06T03:01:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.482+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec05f270 con 0x7f43ec0cd400 2023-10-06T03:01:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.482+0000 7f43e1ffb700 1 -- 172.21.15.84:0/1971431715 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43e4024070 con 0x7f43ec0cd400 2023-10-06T03:01:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.483+0000 7f43e1ffb700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43d0066f30 0x7f43d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.483+0000 7f43e1ffb700 1 -- 172.21.15.84:0/1971431715 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f43e4087020 con 0x7f43ec0cd400 2023-10-06T03:01:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.483+0000 7f43f1c55700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43d0066f30 0x7f43d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.483+0000 7f43f1c55700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43d0066f30 0x7f43d00693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f43e8001360 tx=0x7f43e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.487+0000 7f43e1ffb700 1 -- 172.21.15.84:0/1971431715 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43e4053ff0 con 0x7f43ec0cd400 2023-10-06T03:01:47.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.741+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f43ec0cc360 con 0x7f43ec0cd400 2023-10-06T03:01:47.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.745+0000 7f43e1ffb700 1 -- 172.21.15.84:0/1971431715 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f43e4057610 con 0x7f43ec0cd400 2023-10-06T03:01:47.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.747+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43d0066f30 msgr2=0x7f43d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.747+0000 7f43f2c57700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43d0066f30 0x7f43d00693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f43e8001360 tx=0x7f43e8009040 comp rx=0 tx=0).stop 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.747+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0cd400 msgr2=0x7f43ec15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.747+0000 7f43f2c57700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0cd400 0x7f43ec15d140 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f43e4013000 tx=0x7f43e4019000 comp rx=0 tx=0).stop 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.748+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 shutdown_connections 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.748+0000 7f43f2c57700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f43d0066f30 0x7f43d00693e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.748+0000 7f43f2c57700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43ec0b2660 0x7f43ec154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.748+0000 7f43f2c57700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43ec0cd400 0x7f43ec15d140 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.748+0000 7f43f2c57700 1 --2- 172.21.15.84:0/1971431715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f43ec0b2a30 0x7f43ec0b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.748+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 >> 172.21.15.84:0/1971431715 conn(0x7f43ec099560 msgr2=0x7f43ec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.748+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 shutdown_connections 2023-10-06T03:01:47.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.748+0000 7f43f2c57700 1 -- 172.21.15.84:0/1971431715 wait complete. 2023-10-06T03:01:47.751 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-10-06T03:01:47.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.875+0000 7f3b085a5700 1 Processor -- start 2023-10-06T03:01:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.875+0000 7f3b085a5700 1 -- start start 2023-10-06T03:01:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.876+0000 7f3b085a5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3b000ac040 0x7f3b00069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.876+0000 7f3b085a5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b00069aa0 0x7f3b000c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.876+0000 7f3b085a5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000c7370 con 0x7f3b000adf60 2023-10-06T03:01:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.876+0000 7f3b085a5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b00156150 con 0x7f3b000ac040 2023-10-06T03:01:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.876+0000 7f3b085a5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00069f20 con 0x7f3b00069aa0 2023-10-06T03:01:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.876+0000 7f3b06341700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3b000adf60 0x7f3b0006e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49378/0 (socket says 172.21.15.84:49378) 2023-10-06T03:01:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.876+0000 7f3b06341700 1 -- 172.21.15.84:0/3714105722 learned_addr learned my addr 172.21.15.84:0/3714105722 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b05b40700 1 --2- 172.21.15.84:0/3714105722 >> v2:172.21.15.131:3300/0 conn(0x7f3b000ac040 0x7f3b00069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b06b42700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b00069aa0 0x7f3b000c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169546105 0 0) 0x7f3b000c7370 con 0x7f3b000adf60 2023-10-06T03:01:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec003570 con 0x7f3b000adf60 2023-10-06T03:01:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4285577811 0 0) 0x7f3aec003570 con 0x7f3b000adf60 2023-10-06T03:01:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b00069aa0 msgr2=0x7f3b000c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b00069aa0 0x7f3b000c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 >> v2:172.21.15.131:3300/0 conn(0x7f3b000ac040 msgr2=0x7f3b00069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 --2- 172.21.15.84:0/3714105722 >> v2:172.21.15.131:3300/0 conn(0x7f3b000ac040 0x7f3b00069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000c6760 con 0x7f3b000adf60 2023-10-06T03:01:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f3afc001470 con 0x7f3b000adf60 2023-10-06T03:01:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 >> v1:172.21.15.84:6789/0 conn(0x7f3b000adf60 legacy=0x7f3b0006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3aec003a90 0x7f3aec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aec004810 0x7f3aec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b00069aa0 0x7f3aec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00156150 con 0x7f3aec004810 2023-10-06T03:01:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00069f20 con 0x7f3aec003a90 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec00ba60 con 0x7f3b00069aa0 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b05b40700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aec004810 0x7f3aec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b06341700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3aec003a90 0x7f3aec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b06b42700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b00069aa0 0x7f3aec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b05b40700 1 -- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b00069aa0 msgr2=0x7f3aec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b05b40700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3b00069aa0 0x7f3aec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b05b40700 1 -- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3aec003a90 msgr2=0x7f3aec003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b05b40700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3aec003a90 0x7f3aec003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.877+0000 7f3b05b40700 1 -- 172.21.15.84:0/3714105722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec003570 con 0x7f3aec004810 2023-10-06T03:01:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b05b40700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aec004810 0x7f3aec004c80 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009c30 tx=0x7f3af00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4669ad186e5b17a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000e710 con 0x7f3aec004810 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000e870 con 0x7f3aec004810 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b0533f700 1 -- 172.21.15.84:0/3714105722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000ec30 con 0x7f3aec004810 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b085a5700 1 -- 172.21.15.84:0/3714105722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aec004810 msgr2=0x7f3aec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b085a5700 1 --2- 172.21.15.84:0/3714105722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aec004810 0x7f3aec004c80 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009c30 tx=0x7f3af00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b06b42700 1 -- 172.21.15.84:0/3714105722 reap_dead start 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b085a5700 1 -- 172.21.15.84:0/3714105722 shutdown_connections 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b085a5700 1 -- 172.21.15.84:0/3714105722 >> 172.21.15.84:0/3714105722 conn(0x7f3b000680c0 msgr2=0x7f3b000cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b085a5700 1 -- 172.21.15.84:0/3714105722 shutdown_connections 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.878+0000 7f3b085a5700 1 -- 172.21.15.84:0/3714105722 wait complete. 2023-10-06T03:01:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.879+0000 7f3b085a5700 1 Processor -- start 2023-10-06T03:01:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.879+0000 7f3b085a5700 1 -- start start 2023-10-06T03:01:47.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b085a5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aec004810 0x7f3b000cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b085a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b000cb700 0x7f3b00169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b085a5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0016a420 0x7f3b000c0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b085a5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000b0020 con 0x7f3b000cb700 2023-10-06T03:01:47.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b085a5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000af410 con 0x7f3b0016a420 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b085a5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000af6f0 con 0x7f3aec004810 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b05b40700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b000cb700 0x7f3b00169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b05b40700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b000cb700 0x7f3b00169ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49006/0 (socket says 172.21.15.84:49006) 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b05b40700 1 -- 172.21.15.84:0/1392731965 learned_addr learned my addr 172.21.15.84:0/1392731965 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b06341700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aec004810 0x7f3b000cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b06b42700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0016a420 0x7f3b000c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b05b40700 1 -- 172.21.15.84:0/1392731965 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aec004810 msgr2=0x7f3b000cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b05b40700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aec004810 0x7f3b000cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b05b40700 1 -- 172.21.15.84:0/1392731965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0016a420 msgr2=0x7f3b000c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.880+0000 7f3b05b40700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0016a420 0x7f3b000c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.881+0000 7f3b05b40700 1 -- 172.21.15.84:0/1392731965 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000af9d0 con 0x7f3b000cb700 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.881+0000 7f3b06b42700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0016a420 0x7f3b000c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.881+0000 7f3b05b40700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b000cb700 0x7f3b00169ee0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e4b0 tx=0x7f3af001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.881+0000 7f3af67fc700 1 -- 172.21.15.84:0/1392731965 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0023070 con 0x7f3b000cb700 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.881+0000 7f3af67fc700 1 -- 172.21.15.84:0/1392731965 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000ec10 con 0x7f3b000cb700 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.881+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b000afcb0 con 0x7f3b000cb700 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.881+0000 7f3af67fc700 1 -- 172.21.15.84:0/1392731965 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000e710 con 0x7f3b000cb700 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.881+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000c0b70 con 0x7f3b000cb700 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.882+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b000b0190 con 0x7f3b000cb700 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.882+0000 7f3af67fc700 1 -- 172.21.15.84:0/1392731965 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3af0013680 con 0x7f3b000cb700 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.882+0000 7f3af67fc700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ae4066f30 0x7f3ae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.883+0000 7f3af67fc700 1 -- 172.21.15.84:0/1392731965 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3af00860a0 con 0x7f3b000cb700 2023-10-06T03:01:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.883+0000 7f3b06341700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ae4066f30 0x7f3ae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.883+0000 7f3b06341700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ae4066f30 0x7f3ae40693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3afc001050 tx=0x7f3afc001e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:47.887+0000 7f3af67fc700 1 -- 172.21.15.84:0/1392731965 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3af0053070 con 0x7f3b000cb700 2023-10-06T03:01:48.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.109+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b00064ad0 con 0x7f3b000cb700 2023-10-06T03:01:48.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.110+0000 7f3af67fc700 1 -- 172.21.15.84:0/1392731965 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f3af0056690 con 0x7f3b000cb700 2023-10-06T03:01:48.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:48.114 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":101,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":8526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:01:45.797474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:01:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ae4066f30 msgr2=0x7f3ae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ae4066f30 0x7f3ae40693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3afc001050 tx=0x7f3afc001e50 comp rx=0 tx=0).stop 2023-10-06T03:01:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b000cb700 msgr2=0x7f3b00169ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b000cb700 0x7f3b00169ee0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e4b0 tx=0x7f3af001a000 comp rx=0 tx=0).stop 2023-10-06T03:01:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 shutdown_connections 2023-10-06T03:01:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ae4066f30 0x7f3ae40693e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b0016a420 0x7f3b000c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3aec004810 0x7f3b000cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 --2- 172.21.15.84:0/1392731965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b000cb700 0x7f3b00169ee0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 >> 172.21.15.84:0/1392731965 conn(0x7f3b000680c0 msgr2=0x7f3b000cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 shutdown_connections 2023-10-06T03:01:48.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.112+0000 7f3b085a5700 1 -- 172.21.15.84:0/1392731965 wait complete. 2023-10-06T03:01:48.116 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 101 2023-10-06T03:01:48.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 101, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:01:42.160779+0000', 'modified': '2023-10-06T03:01:45.797474+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8529}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8529': {'gid': 8529, 'name': 'a', 'rank': 0, 'incarnation': 97, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/868960356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 868960356}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 868960356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:01:48.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:01:48.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:01:48.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.642+0000 7f76c73d2700 1 Processor -- start 2023-10-06T03:01:48.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.642+0000 7f76c73d2700 1 -- start start 2023-10-06T03:01:48.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c73d2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76c00b07a0 0x7f76c00ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c73d2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c00b0ca0 con 0x7f76c01595a0 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c73d2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c00b0f80 con 0x7f76c00b49e0 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c73d2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c00ab390 con 0x7f76c00b07a0 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c596f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76c00b07a0 0x7f76c00ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c516e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f76c01595a0 0x7f76c00aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49380/0 (socket says 172.21.15.84:49380) 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c516e700 1 -- 172.21.15.84:0/973535441 learned_addr learned my addr 172.21.15.84:0/973535441 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c596f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76c00b07a0 0x7f76c00ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49018/0 (socket says 172.21.15.84:49018) 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c596f700 1 -- 172.21.15.84:0/973535441 >> v1:172.21.15.131:6789/0 conn(0x7f76c00b49e0 legacy=0x7f76c00aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c596f700 1 -- 172.21.15.84:0/973535441 >> v1:172.21.15.84:6789/0 conn(0x7f76c01595a0 legacy=0x7f76c00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c596f700 1 -- 172.21.15.84:0/973535441 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c00b1260 con 0x7f76c00b07a0 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76b7fff700 1 -- 172.21.15.84:0/973535441 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208710561 0 0) 0x7f76c00b0ca0 con 0x7f76c01595a0 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76c596f700 1 --2- 172.21.15.84:0/973535441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 0x7f76c00ccfd0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009e90 tx=0x7f76b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa55c0751e6dad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76b7fff700 1 -- 172.21.15.84:0/973535441 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b800e070 con 0x7f76c00b07a0 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76b7fff700 1 -- 172.21.15.84:0/973535441 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b800bbb0 con 0x7f76c00b07a0 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.643+0000 7f76b7fff700 1 -- 172.21.15.84:0/973535441 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8012430 con 0x7f76c00b07a0 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.644+0000 7f76c73d2700 1 -- 172.21.15.84:0/973535441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 msgr2=0x7f76c00ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.644+0000 7f76c73d2700 1 --2- 172.21.15.84:0/973535441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 0x7f76c00ccfd0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009e90 tx=0x7f76b8009780 comp rx=0 tx=0).stop 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.644+0000 7f76c73d2700 1 -- 172.21.15.84:0/973535441 shutdown_connections 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.644+0000 7f76c73d2700 1 --2- 172.21.15.84:0/973535441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 0x7f76c00ccfd0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.644+0000 7f76c73d2700 1 -- 172.21.15.84:0/973535441 >> 172.21.15.84:0/973535441 conn(0x7f76c0099830 msgr2=0x7f76c006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.644+0000 7f76c73d2700 1 -- 172.21.15.84:0/973535441 shutdown_connections 2023-10-06T03:01:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.644+0000 7f76c73d2700 1 -- 172.21.15.84:0/973535441 wait complete. 2023-10-06T03:01:48.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.645+0000 7f76c73d2700 1 Processor -- start 2023-10-06T03:01:48.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.645+0000 7f76c73d2700 1 -- start start 2023-10-06T03:01:48.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c73d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 0x7f76c009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c73d2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c00b49e0 0x7f76c0157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c73d2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c01595a0 0x7f76c0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c73d2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0158230 con 0x7f76c00b07a0 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c73d2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c016a220 con 0x7f76c00b49e0 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c73d2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c016a500 con 0x7f76c01595a0 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c516e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 0x7f76c009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c516e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 0x7f76c009aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49034/0 (socket says 172.21.15.84:49034) 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c516e700 1 -- 172.21.15.84:0/2056907995 learned_addr learned my addr 172.21.15.84:0/2056907995 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c516e700 1 -- 172.21.15.84:0/2056907995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c01595a0 msgr2=0x7f76c0157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c516e700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c01595a0 0x7f76c0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c516e700 1 -- 172.21.15.84:0/2056907995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c00b49e0 msgr2=0x7f76c0157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c516e700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c00b49e0 0x7f76c0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c516e700 1 -- 172.21.15.84:0/2056907995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8009a20 con 0x7f76c00b07a0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.646+0000 7f76c516e700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 0x7f76c009aa60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c5e0 tx=0x7f76bc007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.647+0000 7f76b57fa700 1 -- 172.21.15.84:0/2056907995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0072e0 con 0x7f76c00b07a0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.647+0000 7f76b57fa700 1 -- 172.21.15.84:0/2056907995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc007440 con 0x7f76c00b07a0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.647+0000 7f76c73d2700 1 -- 172.21.15.84:0/2056907995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c016a7e0 con 0x7f76c00b07a0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.647+0000 7f76b57fa700 1 -- 172.21.15.84:0/2056907995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0057f0 con 0x7f76c00b07a0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.647+0000 7f76c73d2700 1 -- 172.21.15.84:0/2056907995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c009afa0 con 0x7f76c00b07a0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.648+0000 7f76b57fa700 1 -- 172.21.15.84:0/2056907995 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76bc005bc0 con 0x7f76c00b07a0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.648+0000 7f76b57fa700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f76a4066f30 0x7f76a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.648+0000 7f76b57fa700 1 -- 172.21.15.84:0/2056907995 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f76bc083e00 con 0x7f76c00b07a0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.648+0000 7f76c496d700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f76a4066f30 0x7f76a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.649+0000 7f76c496d700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f76a4066f30 0x7f76a40693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f76b0007fd0 tx=0x7f76b0007b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.650+0000 7f76d06cab80 1 Processor -- start 2023-10-06T03:01:48.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.650+0000 7f76d06cab80 1 -- start start 2023-10-06T03:01:48.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b21c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b22cc0 0x55bc83b716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b71c00 0x55bc83b72050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76d06cab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc83a78a70 con 0x55bc83b21840 2023-10-06T03:01:48.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76d06cab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc83a76270 con 0x55bc83b22cc0 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76d06cab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc83a72060 con 0x55bc83b71c00 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76c516e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b21c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76c516e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b21c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49040/0 (socket says 172.21.15.84:49040) 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76c516e700 1 -- 172.21.15.84:0/2616515447 learned_addr learned my addr 172.21.15.84:0/2616515447 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76c516e700 1 -- 172.21.15.84:0/2616515447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b71c00 msgr2=0x55bc83b72050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76c516e700 1 --2- 172.21.15.84:0/2616515447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b71c00 0x55bc83b72050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76c516e700 1 -- 172.21.15.84:0/2616515447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b22cc0 msgr2=0x55bc83b716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76c516e700 1 --2- 172.21.15.84:0/2616515447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b22cc0 0x55bc83b716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.651+0000 7f76c516e700 1 -- 172.21.15.84:0/2616515447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc8390c270 con 0x55bc83b21840 2023-10-06T03:01:48.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76c516e700 1 --2- 172.21.15.84:0/2616515447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b21c10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f76bc050ef0 tx=0x7f76bc081f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e453da8ae91ae8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76aa7fc700 1 -- 172.21.15.84:0/2616515447 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0549f0 con 0x55bc83b21840 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76aa7fc700 1 -- 172.21.15.84:0/2616515447 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc057c40 con 0x55bc83b21840 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76aa7fc700 1 -- 172.21.15.84:0/2616515447 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc05b990 con 0x55bc83b21840 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76d06cab80 1 -- 172.21.15.84:0/2616515447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 msgr2=0x55bc83b21c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76d06cab80 1 --2- 172.21.15.84:0/2616515447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b21c10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f76bc050ef0 tx=0x7f76bc081f40 comp rx=0 tx=0).stop 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76d06cab80 1 -- 172.21.15.84:0/2616515447 shutdown_connections 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76d06cab80 1 --2- 172.21.15.84:0/2616515447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b71c00 0x55bc83b72050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76d06cab80 1 --2- 172.21.15.84:0/2616515447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b21c10 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76d06cab80 1 --2- 172.21.15.84:0/2616515447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b22cc0 0x55bc83b716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76d06cab80 1 -- 172.21.15.84:0/2616515447 >> 172.21.15.84:0/2616515447 conn(0x55bc83b23160 msgr2=0x55bc83b23530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76d06cab80 1 -- 172.21.15.84:0/2616515447 shutdown_connections 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.652+0000 7f76d06cab80 1 -- 172.21.15.84:0/2616515447 wait complete. 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.653+0000 7f76d06cab80 1 -- start start 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.653+0000 7f76d06cab80 1 Processor -- start 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b47530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 0x55bc83b68c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 0x55bc83b1ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76d06cab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc83a1d890 con 0x55bc83b21840 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76d06cab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc83a38ea0 con 0x55bc83b71c00 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76d06cab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc838f4e30 con 0x55bc83b22cc0 2023-10-06T03:01:48.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76d06cab80 10 client.0 _ll_register_callbacks cb 0x55bc83ae4e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c516e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b47530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c516e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b47530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49048/0 (socket says 172.21.15.84:49048) 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c516e700 1 -- 172.21.15.84:0/1675556673 learned_addr learned my addr 172.21.15.84:0/1675556673 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c496d700 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 0x55bc83b68c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c596f700 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 0x55bc83b1ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c516e700 1 -- 172.21.15.84:0/1675556673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 msgr2=0x55bc83b68c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c516e700 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 0x55bc83b68c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c516e700 1 -- 172.21.15.84:0/1675556673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 msgr2=0x55bc83b1ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c516e700 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 0x55bc83b1ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c516e700 1 -- 172.21.15.84:0/1675556673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c009afa0 con 0x55bc83b21840 2023-10-06T03:01:48.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c496d700 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 0x55bc83b68c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f76c516e700 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b47530 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f76bc001190 tx=0x7f76bc06a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3447e445e71736 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.654+0000 7f769f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f769f7fe700 1 -- 172.21.15.84:0/1675556673 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc05bbe0 con 0x55bc83b21840 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f769f7fe700 1 -- 172.21.15.84:0/1675556673 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f76bc05bd40 con 0x55bc83b21840 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76d06cab80 1 -- 172.21.15.84:0/1675556673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc83b16940 con 0x55bc83b21840 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f769f7fe700 1 -- 172.21.15.84:0/1675556673 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76bc0540f0 con 0x55bc83b21840 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76d06cab80 10 client.8682 fetch_fsmap learned FSMap version 101 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76d06cab80 1 -- 172.21.15.84:0/1675556673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x55bc838aefe0 con 0x55bc83b21840 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f769f7fe700 1 -- 172.21.15.84:0/1675556673 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc83b16940 con 0x55bc83b21840 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f769f7fe700 1 -- 172.21.15.84:0/1675556673 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f76bc05b500 con 0x55bc83b21840 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76d06cab80 10 client.8682 fetch_fsmap finished waiting for FSMap version 101 2023-10-06T03:01:48.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76d06cab80 10 client.8682 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76d06cab80 20 client.8682 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76d06cab80 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55bc83b608e0 0x55bc83b60cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76d06cab80 4 client.8682 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76d06cab80 1 -- 172.21.15.84:0/1675556673 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc83af3870 con 0x55bc83b608e0 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76c496d700 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55bc83b608e0 0x55bc83b60cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f769f7fe700 10 client.8682 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.655+0000 7f76c496d700 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55bc83b608e0 0x55bc83b60cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98e2345a722fda06 server_cookie=7a6389a1d035749d in_seq=0 out_seq=0 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f769f7fe700 1 -- 172.21.15.84:0/1675556673 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55bc83af3870 con 0x55bc83b608e0 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f769f7fe700 10 client.8682 handle_command_reply: tid=0 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 client.8682 shutdown 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 -- 172.21.15.84:0/1675556673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 msgr2=0x55bc83b47530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b47530 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f76bc001190 tx=0x7f76bc06a000 comp rx=0 tx=0).stop 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 -- 172.21.15.84:0/1675556673 shutdown_connections 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55bc83b608e0 0x55bc83b60cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 0x55bc83b1ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f769f7fe700 0 client.8682 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b21840 0x55bc83b47530 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 --2- 172.21.15.84:0/1675556673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 0x55bc83b68c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 -- 172.21.15.84:0/1675556673 >> 172.21.15.84:0/1675556673 conn(0x55bc83b23160 msgr2=0x55bc83b22400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 -- 172.21.15.84:0/1675556673 shutdown_connections 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 1 -- 172.21.15.84:0/1675556673 wait complete. 2023-10-06T03:01:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.656+0000 7f76d06cab80 20 client.8682 trim_cache size 0 max 16384 2023-10-06T03:01:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.673+0000 7f76d06cab80 1 Processor -- start 2023-10-06T03:01:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.673+0000 7f76d06cab80 1 -- start start 2023-10-06T03:01:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b21840 0x55bc83b23530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b22cc0 0x55bc83b1db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 0x55bc83b1e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76d06cab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc83afa280 con 0x55bc83b22cc0 2023-10-06T03:01:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76d06cab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc83b4b300 con 0x55bc83b71c00 2023-10-06T03:01:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76d06cab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc83b6ad40 con 0x55bc83b21840 2023-10-06T03:01:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c496d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b22cc0 0x55bc83b1db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c496d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b22cc0 0x55bc83b1db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49056/0 (socket says 172.21.15.84:49056) 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c496d700 1 -- 172.21.15.84:0/2629746207 learned_addr learned my addr 172.21.15.84:0/2629746207 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c516e700 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b21840 0x55bc83b23530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c596f700 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 0x55bc83b1e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c496d700 1 -- 172.21.15.84:0/2629746207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b21840 msgr2=0x55bc83b23530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c496d700 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b21840 0x55bc83b23530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c496d700 1 -- 172.21.15.84:0/2629746207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 msgr2=0x55bc83b1e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c496d700 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 0x55bc83b1e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c496d700 1 -- 172.21.15.84:0/2629746207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc83a40780 con 0x55bc83b22cc0 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.674+0000 7f76c596f700 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 0x55bc83b1e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:48.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76c496d700 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b22cc0 0x55bc83b1db60 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f76c0099f60 tx=0x7f76b0018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fea0ca1de49f3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76aaffd700 1 -- 172.21.15.84:0/2629746207 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0023aa0 con 0x55bc83b22cc0 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76aaffd700 1 -- 172.21.15.84:0/2629746207 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b001c040 con 0x55bc83b22cc0 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76aaffd700 1 -- 172.21.15.84:0/2629746207 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0023c00 con 0x55bc83b22cc0 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76d06cab80 1 -- 172.21.15.84:0/2629746207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b22cc0 msgr2=0x55bc83b1db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76d06cab80 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b22cc0 0x55bc83b1db60 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f76c0099f60 tx=0x7f76b0018040 comp rx=0 tx=0).stop 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76d06cab80 1 -- 172.21.15.84:0/2629746207 shutdown_connections 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76d06cab80 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b71c00 0x55bc83b1e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76d06cab80 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b21840 0x55bc83b23530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76d06cab80 1 --2- 172.21.15.84:0/2629746207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b22cc0 0x55bc83b1db60 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76d06cab80 1 -- 172.21.15.84:0/2629746207 >> 172.21.15.84:0/2629746207 conn(0x55bc83b23160 msgr2=0x55bc83b1a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76d06cab80 1 -- 172.21.15.84:0/2629746207 shutdown_connections 2023-10-06T03:01:48.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.675+0000 7f76d06cab80 1 -- 172.21.15.84:0/2629746207 wait complete. 2023-10-06T03:01:48.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.676+0000 7f76d06cab80 1 -- start start 2023-10-06T03:01:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.676+0000 7f76d06cab80 1 Processor -- start 2023-10-06T03:01:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b21840 0x55bc83bd1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 0x55bc83b6c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76d06cab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b71c00 0x55bc83bce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76d06cab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc83b76480 con 0x55bc83b71c00 2023-10-06T03:01:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76d06cab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc83bcda10 con 0x55bc83b21840 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76d06cab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc83b6c960 con 0x55bc83b22cc0 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76d06cab80 10 client.0 _ll_register_callbacks cb 0x55bc83ae4e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c596f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b71c00 0x55bc83bce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c596f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b71c00 0x55bc83bce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49070/0 (socket says 172.21.15.84:49070) 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c596f700 1 -- 172.21.15.84:0/729670241 learned_addr learned my addr 172.21.15.84:0/729670241 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c516e700 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b21840 0x55bc83bd1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c496d700 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 0x55bc83b6c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c596f700 1 -- 172.21.15.84:0/729670241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 msgr2=0x55bc83b6c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c596f700 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 0x55bc83b6c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c596f700 1 -- 172.21.15.84:0/729670241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b21840 msgr2=0x55bc83bd1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c596f700 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b21840 0x55bc83bd1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c596f700 1 -- 172.21.15.84:0/729670241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b00168d0 con 0x55bc83b71c00 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c516e700 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b21840 0x55bc83bd1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f76c596f700 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b71c00 0x55bc83bce120 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f76b8003000 tx=0x7f76b8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fafbacb15638a13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f769f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.677+0000 7f769f7fe700 1 -- 172.21.15.84:0/729670241 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80096f0 con 0x55bc83b71c00 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f769f7fe700 1 -- 172.21.15.84:0/729670241 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f76b8027480 con 0x55bc83b71c00 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76d06cab80 1 -- 172.21.15.84:0/729670241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76bc057c40 con 0x55bc83b71c00 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f769f7fe700 1 -- 172.21.15.84:0/729670241 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76b8027850 con 0x55bc83b71c00 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76d06cab80 10 client.8688 fetch_fsmap learned FSMap version 101 2023-10-06T03:01:48.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76d06cab80 1 -- 172.21.15.84:0/729670241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x55bc83a27470 con 0x55bc83b71c00 2023-10-06T03:01:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f769f7fe700 1 -- 172.21.15.84:0/729670241 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc057c40 con 0x55bc83b71c00 2023-10-06T03:01:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f769f7fe700 1 -- 172.21.15.84:0/729670241 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f76b800b050 con 0x55bc83b71c00 2023-10-06T03:01:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76d06cab80 10 client.8688 fetch_fsmap finished waiting for FSMap version 101 2023-10-06T03:01:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76d06cab80 10 client.8688 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:01:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76d06cab80 20 client.8688 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76d06cab80 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55bc83b47a70 0x55bc83b47e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76d06cab80 4 client.8688 mds_command: new command op to 8529 tid=0[{"prefix": "status"}] 2023-10-06T03:01:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76d06cab80 1 -- 172.21.15.84:0/729670241 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc83a14e00 con 0x55bc83b47a70 2023-10-06T03:01:48.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76c516e700 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55bc83b47a70 0x55bc83b47e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f769f7fe700 10 client.8688 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:01:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f76c516e700 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55bc83b47a70 0x55bc83b47e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afe5c9e56ebf8e75 server_cookie=cfebf939dac21e88 in_seq=0 out_seq=0 2023-10-06T03:01:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f769f7fe700 1 -- 172.21.15.84:0/729670241 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55bc83a14e00 con 0x55bc83b47a70 2023-10-06T03:01:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.678+0000 7f769f7fe700 10 client.8688 handle_command_reply: tid=0 2023-10-06T03:01:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 client.8688 shutdown 2023-10-06T03:01:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 -- 172.21.15.84:0/729670241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b71c00 msgr2=0x55bc83bce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b71c00 0x55bc83bce120 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f76b8003000 tx=0x7f76b8018000 comp rx=0 tx=0).stop 2023-10-06T03:01:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 -- 172.21.15.84:0/729670241 shutdown_connections 2023-10-06T03:01:48.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55bc83b47a70 0x55bc83b47e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc83b21840 0x55bc83bd1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f769f7fe700 0 client.8688 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:01:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc83b71c00 0x55bc83bce120 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 --2- 172.21.15.84:0/729670241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bc83b22cc0 0x55bc83b6c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 -- 172.21.15.84:0/729670241 >> 172.21.15.84:0/729670241 conn(0x55bc83b23160 msgr2=0x55bc83b64cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 -- 172.21.15.84:0/729670241 shutdown_connections 2023-10-06T03:01:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 1 -- 172.21.15.84:0/729670241 wait complete. 2023-10-06T03:01:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76d06cab80 20 client.8688 trim_cache size 0 max 16384 2023-10-06T03:01:48.689 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:01:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:01:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 8529, 2023-10-06T03:01:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:01:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:01:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:01:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 5.9010367439999998, 2023-10-06T03:01:48.689 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 101, 2023-10-06T03:01:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 106, 2023-10-06T03:01:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 106, 2023-10-06T03:01:48.690 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 12.027640851999999 2023-10-06T03:01:48.690 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 -- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f76a4066f30 msgr2=0x7f76a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f76a4066f30 0x7f76a40693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f76b0007fd0 tx=0x7f76b0007b20 comp rx=0 tx=0).stop 2023-10-06T03:01:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 -- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 msgr2=0x7f76c009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 0x7f76c009aa60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c5e0 tx=0x7f76bc007e80 comp rx=0 tx=0).stop 2023-10-06T03:01:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 -- 172.21.15.84:0/2056907995 shutdown_connections 2023-10-06T03:01:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f76a4066f30 0x7f76a40693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76c01595a0 0x7f76c0157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c00b07a0 0x7f76c009aa60 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 --2- 172.21.15.84:0/2056907995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c00b49e0 0x7f76c0157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 -- 172.21.15.84:0/2056907995 >> 172.21.15.84:0/2056907995 conn(0x7f76c0099830 msgr2=0x7f76c0158a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.679+0000 7f76c73d2700 1 -- 172.21.15.84:0/2056907995 shutdown_connections 2023-10-06T03:01:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.680+0000 7f76c73d2700 1 -- 172.21.15.84:0/2056907995 wait complete. 2023-10-06T03:01:48.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:01:48.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.806+0000 7f5aa3b42700 1 Processor -- start 2023-10-06T03:01:48.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.806+0000 7f5aa3b42700 1 -- start start 2023-10-06T03:01:48.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa3b42700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5a9c0b07a0 0x7f5a9c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa3b42700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0b0ca0 con 0x7f5a9c1595a0 2023-10-06T03:01:48.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa3b42700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0b0f80 con 0x7f5a9c0b49e0 2023-10-06T03:01:48.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa3b42700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0ab390 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa18de700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5a9c1595a0 0x7f5a9c0aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49396/0 (socket says 172.21.15.84:49396) 2023-10-06T03:01:48.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa18de700 1 -- 172.21.15.84:0/106195050 learned_addr learned my addr 172.21.15.84:0/106195050 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa20df700 1 --2- 172.21.15.84:0/106195050 >> v2:172.21.15.131:3300/0 conn(0x7f5a9c0b07a0 0x7f5a9c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa08dc700 1 -- 172.21.15.84:0/106195050 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423604957 0 0) 0x7f5a9c0b0ca0 con 0x7f5a9c1595a0 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa08dc700 1 -- 172.21.15.84:0/106195050 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a88003570 con 0x7f5a9c1595a0 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa08dc700 1 -- 172.21.15.84:0/106195050 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509132822 0 0) 0x7f5a88003570 con 0x7f5a9c1595a0 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa20df700 1 -- 172.21.15.84:0/106195050 >> v1:172.21.15.131:6789/0 conn(0x7f5a9c0b49e0 legacy=0x7f5a9c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa20df700 1 -- 172.21.15.84:0/106195050 >> v1:172.21.15.84:6789/0 conn(0x7f5a9c1595a0 legacy=0x7f5a9c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.807+0000 7f5aa20df700 1 -- 172.21.15.84:0/106195050 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c0b1260 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa20df700 1 --2- 172.21.15.84:0/106195050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b07a0 0x7f5a9c0ccfd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5a98009e90 tx=0x7f5a98009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=432876a09e67b761 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa08dc700 1 -- 172.21.15.84:0/106195050 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9800e070 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa08dc700 1 -- 172.21.15.84:0/106195050 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9800b920 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa08dc700 1 -- 172.21.15.84:0/106195050 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940015f0 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa3b42700 1 -- 172.21.15.84:0/106195050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b07a0 msgr2=0x7f5a9c0ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa3b42700 1 --2- 172.21.15.84:0/106195050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b07a0 0x7f5a9c0ccfd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5a98009e90 tx=0x7f5a98009780 comp rx=0 tx=0).stop 2023-10-06T03:01:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa3b42700 1 -- 172.21.15.84:0/106195050 shutdown_connections 2023-10-06T03:01:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa3b42700 1 --2- 172.21.15.84:0/106195050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b07a0 0x7f5a9c0ccfd0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa3b42700 1 -- 172.21.15.84:0/106195050 >> 172.21.15.84:0/106195050 conn(0x7f5a9c099830 msgr2=0x7f5a9c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa3b42700 1 -- 172.21.15.84:0/106195050 shutdown_connections 2023-10-06T03:01:48.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.808+0000 7f5aa3b42700 1 -- 172.21.15.84:0/106195050 wait complete. 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.809+0000 7f5aa3b42700 1 Processor -- start 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa3b42700 1 -- start start 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa3b42700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a9c0b07a0 0x7f5a9c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa3b42700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b49e0 0x7f5a9c0aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa3b42700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a9c1595a0 0x7f5a9c0aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa3b42700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c15af00 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa3b42700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c158fb0 con 0x7f5a9c0b49e0 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa3b42700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c15a330 con 0x7f5a9c1595a0 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa18de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a9c0b07a0 0x7f5a9c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa18de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a9c0b07a0 0x7f5a9c158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49078/0 (socket says 172.21.15.84:49078) 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa18de700 1 -- 172.21.15.84:0/938741839 learned_addr learned my addr 172.21.15.84:0/938741839 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa20df700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a9c1595a0 0x7f5a9c0aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.810+0000 7f5aa10dd700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b49e0 0x7f5a9c0aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa18de700 1 -- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a9c1595a0 msgr2=0x7f5a9c0aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa18de700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a9c1595a0 0x7f5a9c0aca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa18de700 1 -- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b49e0 msgr2=0x7f5a9c0aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa18de700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b49e0 0x7f5a9c0aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa18de700 1 -- 172.21.15.84:0/938741839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98009a20 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa10dd700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b49e0 0x7f5a9c0aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa20df700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a9c1595a0 0x7f5a9c0aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa18de700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a9c0b07a0 0x7f5a9c158a70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400cb60 tx=0x7f5a94002b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5a91ffb700 1 -- 172.21.15.84:0/938741839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94007e60 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5a91ffb700 1 -- 172.21.15.84:0/938741839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a94007300 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c15b390 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5a91ffb700 1 -- 172.21.15.84:0/938741839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940076a0 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.811+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c15a8b0 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.812+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c15b1e0 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.812+0000 7f5a91ffb700 1 -- 172.21.15.84:0/938741839 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a94005a00 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.813+0000 7f5a91ffb700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5a80066f30 0x7f5a800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.813+0000 7f5a91ffb700 1 -- 172.21.15.84:0/938741839 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5a94084550 con 0x7f5a9c0b07a0 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.813+0000 7f5aa10dd700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5a80066f30 0x7f5a800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.813+0000 7f5aa10dd700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5a80066f30 0x7f5a800693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c007fd0 tx=0x7f5a8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:48.817+0000 7f5a91ffb700 1 -- 172.21.15.84:0/938741839 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a940515a0 con 0x7f5a9c0b07a0 2023-10-06T03:01:49.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.043+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a9c064ad0 con 0x7f5a9c0b07a0 2023-10-06T03:01:49.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.044+0000 7f5a91ffb700 1 -- 172.21.15.84:0/938741839 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5a94005cb0 con 0x7f5a9c0b07a0 2023-10-06T03:01:49.046 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:01:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5a80066f30 msgr2=0x7f5a800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5a80066f30 0x7f5a800693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c007fd0 tx=0x7f5a8c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a9c0b07a0 msgr2=0x7f5a9c158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a9c0b07a0 0x7f5a9c158a70 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400cb60 tx=0x7f5a94002b00 comp rx=0 tx=0).stop 2023-10-06T03:01:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 shutdown_connections 2023-10-06T03:01:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5a80066f30 0x7f5a800693e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a9c1595a0 0x7f5a9c0aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a9c0b07a0 0x7f5a9c158a70 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 --2- 172.21.15.84:0/938741839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a9c0b49e0 0x7f5a9c0aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 >> 172.21.15.84:0/938741839 conn(0x7f5a9c099830 msgr2=0x7f5a9c068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 shutdown_connections 2023-10-06T03:01:49.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.046+0000 7f5aa3b42700 1 -- 172.21.15.84:0/938741839 wait complete. 2023-10-06T03:01:49.059 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:01:49.059 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:01:49.059 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-10-06T03:01:49.060 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:01:49.060 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:49.060 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:01:49.060 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:01:49.060 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:01:49.060 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:01:49.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:49.060 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-10-06T03:01:49.075 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:49.075 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:49.075 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:49.075 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:01:49.076 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42100sec preferred_lft 42100sec 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c4d3:64ff:fe4d:ee22/64 scope link 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:01:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 06:1f:f5:77:61:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:01:49.078 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::41f:f5ff:fe77:615a/64 scope link 2023-10-06T03:01:49.078 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:49.078 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:01:49.078 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 66:ce:03:f1:65:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:01:49.078 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::64ce:3ff:fef1:6538/64 scope link 2023-10-06T03:01:49.078 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:49.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:49.078 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:01:49.138 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-10-06T03:01:49.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:49.140 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-10-06T03:01:49.196 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-10-06T03:01:49.196 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:01:49.196 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:01:49.196 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:01:49.197 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:01:49.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:49.197 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-10-06T03:01:49.197 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-10-06T03:01:49.197 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:01:49.197 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:01:49.197 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:01:49.197 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-10-06T03:01:49.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:49.296 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:01:49.311 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:01:49.311 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:01:49.311 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:01:49.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:49.312 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-10-06T03:01:49.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:49.375 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:49.430 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:01:49.430 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:49.430 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:49.484 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:01:49.484 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:01:49.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:49.563 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:49.564 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:01:49.564 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T03:01:49.572 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:49.572 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:01:49.572 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T03:01:49.572 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:01:49.572 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:49.593 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:49.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:01:49.594 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-10-06T03:01:49.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-10-06T03:01:49.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:49.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790" 2023-10-06T03:01:49.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2023-10-06T03:01:49.594 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3949ddc0-2086-4c8d-802f-a1ccf3555047" will pass to kernel 2023-10-06T03:01:49.596 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:01:49.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:49.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:49.661 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-10-06T03:01:49.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.819+0000 7f39f2a4f700 1 Processor -- start 2023-10-06T03:01:49.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.819+0000 7f39f2a4f700 1 -- start start 2023-10-06T03:01:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f2a4f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f39ec0cd400 0x7f39ec0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f2a4f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec0b2a30 0x7f39ec0cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f2a4f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ec0cc9b0 con 0x7f39ec0b2660 2023-10-06T03:01:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f2a4f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ec0cf560 con 0x7f39ec0cd400 2023-10-06T03:01:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f2a4f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0cbda0 con 0x7f39ec0b2a30 2023-10-06T03:01:49.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f1a4d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f39ec0b2660 0x7f39ec0cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49408/0 (socket says 172.21.15.84:49408) 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f1a4d700 1 -- 172.21.15.84:0/410350223 learned_addr learned my addr 172.21.15.84:0/410350223 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f124c700 1 --2- 172.21.15.84:0/410350223 >> v2:172.21.15.131:3300/0 conn(0x7f39ec0cd400 0x7f39ec0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f224e700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec0b2a30 0x7f39ec0cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303754562 0 0) 0x7f39ec0cc9b0 con 0x7f39ec0b2660 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.820+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d8003570 con 0x7f39ec0b2660 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1959319575 0 0) 0x7f39d8003570 con 0x7f39ec0b2660 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec0b2a30 msgr2=0x7f39ec0cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec0b2a30 0x7f39ec0cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 >> v2:172.21.15.131:3300/0 conn(0x7f39ec0cd400 msgr2=0x7f39ec0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 --2- 172.21.15.84:0/410350223 >> v2:172.21.15.131:3300/0 conn(0x7f39ec0cd400 0x7f39ec0ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec0cc080 con 0x7f39ec0b2660 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f39e80015f0 con 0x7f39ec0b2660 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 >> v1:172.21.15.84:6789/0 conn(0x7f39ec0b2660 legacy=0x7f39ec0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec0b2a30 0x7f39d8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d8003fe0 0x7f39d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d8004d50 0x7f39d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0cbda0 con 0x7f39d8004d50 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d800ba60 con 0x7f39d8003fe0 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d800bbd0 con 0x7f39ec0b2a30 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f224e700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d8004d50 0x7f39d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f1a4d700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec0b2a30 0x7f39d8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f124c700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d8003fe0 0x7f39d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:49.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f224e700 1 -- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec0b2a30 msgr2=0x7f39d8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f224e700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec0b2a30 0x7f39d8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f224e700 1 -- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d8003fe0 msgr2=0x7f39d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f224e700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d8003fe0 0x7f39d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f224e700 1 -- 172.21.15.84:0/410350223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d8003570 con 0x7f39d8004d50 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f224e700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d8004d50 0x7f39d80051c0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0894d0 tx=0x7f39e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee91156b340f6b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400ea00 con 0x7f39d8004d50 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e400f040 con 0x7f39d8004d50 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.821+0000 7f39f0a4b700 1 -- 172.21.15.84:0/410350223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400edb0 con 0x7f39d8004d50 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.822+0000 7f39f2a4f700 1 -- 172.21.15.84:0/410350223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d8004d50 msgr2=0x7f39d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:49.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.822+0000 7f39f2a4f700 1 --2- 172.21.15.84:0/410350223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39d8004d50 0x7f39d80051c0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0894d0 tx=0x7f39e400b040 comp rx=0 tx=0).stop 2023-10-06T03:01:49.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.822+0000 7f39f224e700 1 -- 172.21.15.84:0/410350223 reap_dead start 2023-10-06T03:01:49.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.822+0000 7f39f2a4f700 1 -- 172.21.15.84:0/410350223 shutdown_connections 2023-10-06T03:01:49.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.822+0000 7f39f2a4f700 1 -- 172.21.15.84:0/410350223 >> 172.21.15.84:0/410350223 conn(0x7f39ec099560 msgr2=0x7f39ec06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:49.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.822+0000 7f39f2a4f700 1 -- 172.21.15.84:0/410350223 shutdown_connections 2023-10-06T03:01:49.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.822+0000 7f39f2a4f700 1 -- 172.21.15.84:0/410350223 wait complete. 2023-10-06T03:01:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.823+0000 7f39f2a4f700 1 Processor -- start 2023-10-06T03:01:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.823+0000 7f39f2a4f700 1 -- start start 2023-10-06T03:01:49.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f2a4f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec154330 0x7f39ec156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f2a4f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ec0b30d0 0x7f39ec0b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f2a4f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ec0c9b70 0x7f39ec0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f2a4f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0ca550 con 0x7f39ec0c9b70 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f2a4f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec15b0b0 con 0x7f39ec0b30d0 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f2a4f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0b3c40 con 0x7f39ec154330 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f224e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ec0c9b70 0x7f39ec0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f224e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ec0c9b70 0x7f39ec0ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49084/0 (socket says 172.21.15.84:49084) 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f224e700 1 -- 172.21.15.84:0/1995198723 learned_addr learned my addr 172.21.15.84:0/1995198723 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f1a4d700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec154330 0x7f39ec156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f124c700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ec0b30d0 0x7f39ec0b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:49.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f224e700 1 -- 172.21.15.84:0/1995198723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec154330 msgr2=0x7f39ec156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f224e700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec154330 0x7f39ec156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f224e700 1 -- 172.21.15.84:0/1995198723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ec0b30d0 msgr2=0x7f39ec0b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f224e700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ec0b30d0 0x7f39ec0b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f224e700 1 -- 172.21.15.84:0/1995198723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec15aa60 con 0x7f39ec0c9b70 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f1a4d700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec154330 0x7f39ec156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.824+0000 7f39f224e700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ec0c9b70 0x7f39ec0ca010 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f39e4016000 tx=0x7f39e401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.825+0000 7f39e1ffb700 1 -- 172.21.15.84:0/1995198723 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400ee80 con 0x7f39ec0c9b70 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.825+0000 7f39e1ffb700 1 -- 172.21.15.84:0/1995198723 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e4022070 con 0x7f39ec0c9b70 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.825+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ec15ad40 con 0x7f39ec0c9b70 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.825+0000 7f39e1ffb700 1 -- 172.21.15.84:0/1995198723 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4027660 con 0x7f39ec0c9b70 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.825+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec15a770 con 0x7f39ec0c9b70 2023-10-06T03:01:49.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.826+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ec15b260 con 0x7f39ec0c9b70 2023-10-06T03:01:49.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.826+0000 7f39e1ffb700 1 -- 172.21.15.84:0/1995198723 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39e4024030 con 0x7f39ec0c9b70 2023-10-06T03:01:49.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.826+0000 7f39e1ffb700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39d0066f30 0x7f39d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:49.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.827+0000 7f39e1ffb700 1 -- 172.21.15.84:0/1995198723 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f39e4086460 con 0x7f39ec0c9b70 2023-10-06T03:01:49.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.827+0000 7f39f1a4d700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39d0066f30 0x7f39d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:49.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.827+0000 7f39f1a4d700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39d0066f30 0x7f39d00693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f39e8001150 tx=0x7f39e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:49.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:49.831+0000 7f39e1ffb700 1 -- 172.21.15.84:0/1995198723 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39ec15b260 con 0x7f39ec0c9b70 2023-10-06T03:01:50.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.060+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f39ec15aed0 con 0x7f39ec0c9b70 2023-10-06T03:01:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.175+0000 7f39e1ffb700 1 -- 172.21.15.84:0/1995198723 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v102) v1 ==== 105+0+0 (secure 0 0 0) 0x7f39e4053430 con 0x7f39ec0c9b70 2023-10-06T03:01:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39d0066f30 msgr2=0x7f39d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39d0066f30 0x7f39d00693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f39e8001150 tx=0x7f39e8009040 comp rx=0 tx=0).stop 2023-10-06T03:01:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ec0c9b70 msgr2=0x7f39ec0ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ec0c9b70 0x7f39ec0ca010 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f39e4016000 tx=0x7f39e401a000 comp rx=0 tx=0).stop 2023-10-06T03:01:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 shutdown_connections 2023-10-06T03:01:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f39d0066f30 0x7f39d00693e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ec0c9b70 0x7f39ec0ca010 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ec154330 0x7f39ec156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 --2- 172.21.15.84:0/1995198723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ec0b30d0 0x7f39ec0b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 >> 172.21.15.84:0/1995198723 conn(0x7f39ec099560 msgr2=0x7f39ec069950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 shutdown_connections 2023-10-06T03:01:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.177+0000 7f39f2a4f700 1 -- 172.21.15.84:0/1995198723 wait complete. 2023-10-06T03:01:50.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:50.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.308+0000 7f75c81e2700 1 Processor -- start 2023-10-06T03:01:50.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.308+0000 7f75c81e2700 1 -- start start 2023-10-06T03:01:50.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.309+0000 7f75c81e2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c01595a0 0x7f75c00aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.309+0000 7f75c81e2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75c00b07a0 0x7f75c00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.309+0000 7f75c81e2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c00b0ca0 con 0x7f75c00b49e0 2023-10-06T03:01:50.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.309+0000 7f75c81e2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c00b0f80 con 0x7f75c00b07a0 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.309+0000 7f75c81e2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00b1260 con 0x7f75c01595a0 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.309+0000 7f75c677f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75c00b07a0 0x7f75c00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.309+0000 7f75c577d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f75c00b49e0 0x7f75c00aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:49420/0 (socket says 172.21.15.84:49420) 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.309+0000 7f75c577d700 1 -- 172.21.15.84:0/3724911431 learned_addr learned my addr 172.21.15.84:0/3724911431 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c677f700 1 -- 172.21.15.84:0/3724911431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c01595a0 msgr2=0x7f75c00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c677f700 1 --2- 172.21.15.84:0/3724911431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c01595a0 0x7f75c00aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c677f700 1 -- 172.21.15.84:0/3724911431 >> v1:172.21.15.84:6789/0 conn(0x7f75c00b49e0 legacy=0x7f75c00aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c677f700 1 -- 172.21.15.84:0/3724911431 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c00b1540 con 0x7f75c00b07a0 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c4f7c700 1 -- 172.21.15.84:0/3724911431 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989005031 0 0) 0x7f75c00b0ca0 con 0x7f75c00b49e0 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c677f700 1 --2- 172.21.15.84:0/3724911431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b07a0 0x7f75c00b1c00 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009e60 tx=0x7f75b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b228c9705f05352 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c4f7c700 1 -- 172.21.15.84:0/3724911431 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b800e070 con 0x7f75c00b07a0 2023-10-06T03:01:50.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c4f7c700 1 -- 172.21.15.84:0/3724911431 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b800bc30 con 0x7f75c00b07a0 2023-10-06T03:01:50.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c4f7c700 1 -- 172.21.15.84:0/3724911431 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b8012430 con 0x7f75c00b07a0 2023-10-06T03:01:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c81e2700 1 -- 172.21.15.84:0/3724911431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b07a0 msgr2=0x7f75c00b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c81e2700 1 --2- 172.21.15.84:0/3724911431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b07a0 0x7f75c00b1c00 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009e60 tx=0x7f75b8009780 comp rx=0 tx=0).stop 2023-10-06T03:01:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c81e2700 1 -- 172.21.15.84:0/3724911431 shutdown_connections 2023-10-06T03:01:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c81e2700 1 --2- 172.21.15.84:0/3724911431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b07a0 0x7f75c00b1c00 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c81e2700 1 --2- 172.21.15.84:0/3724911431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c01595a0 0x7f75c00aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c81e2700 1 -- 172.21.15.84:0/3724911431 >> 172.21.15.84:0/3724911431 conn(0x7f75c0099830 msgr2=0x7f75c006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c81e2700 1 -- 172.21.15.84:0/3724911431 shutdown_connections 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.310+0000 7f75c81e2700 1 -- 172.21.15.84:0/3724911431 wait complete. 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.311+0000 7f75c81e2700 1 Processor -- start 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c81e2700 1 -- start start 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c81e2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c00b07a0 0x7f75c00ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c81e2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b49e0 0x7f75c016c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c81e2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01595a0 0x7f75c016a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c81e2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c016a8d0 con 0x7f75c00b49e0 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c81e2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00ad710 con 0x7f75c01595a0 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c81e2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c00ac990 con 0x7f75c00b07a0 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c577d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b49e0 0x7f75c016c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c577d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b49e0 0x7f75c016c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49096/0 (socket says 172.21.15.84:49096) 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c577d700 1 -- 172.21.15.84:0/1411022899 learned_addr learned my addr 172.21.15.84:0/1411022899 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.312+0000 7f75c5f7e700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c00b07a0 0x7f75c00ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c677f700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01595a0 0x7f75c016a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c577d700 1 -- 172.21.15.84:0/1411022899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c00b07a0 msgr2=0x7f75c00ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c577d700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c00b07a0 0x7f75c00ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c577d700 1 -- 172.21.15.84:0/1411022899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01595a0 msgr2=0x7f75c016a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c577d700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01595a0 0x7f75c016a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c577d700 1 -- 172.21.15.84:0/1411022899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8009a20 con 0x7f75c00b49e0 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c5f7e700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c00b07a0 0x7f75c00ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c577d700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b49e0 0x7f75c016c870 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c810 tx=0x7f75b0007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75b5ffb700 1 -- 172.21.15.84:0/1411022899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0005c00 con 0x7f75c00b49e0 2023-10-06T03:01:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75b5ffb700 1 -- 172.21.15.84:0/1411022899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b0005d60 con 0x7f75c00b49e0 2023-10-06T03:01:50.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c00acde0 con 0x7f75c00b49e0 2023-10-06T03:01:50.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75b5ffb700 1 -- 172.21.15.84:0/1411022899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0007320 con 0x7f75c00b49e0 2023-10-06T03:01:50.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.313+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c00ad3a0 con 0x7f75c00b49e0 2023-10-06T03:01:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.314+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c0064ad0 con 0x7f75c00b49e0 2023-10-06T03:01:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.314+0000 7f75b5ffb700 1 -- 172.21.15.84:0/1411022899 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75b001b400 con 0x7f75c00b49e0 2023-10-06T03:01:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.315+0000 7f75b5ffb700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75a4066f30 0x7f75a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.315+0000 7f75b5ffb700 1 -- 172.21.15.84:0/1411022899 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f75b00842b0 con 0x7f75c00b49e0 2023-10-06T03:01:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.315+0000 7f75c5f7e700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75a4066f30 0x7f75a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.315+0000 7f75c5f7e700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75a4066f30 0x7f75a40693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009a60 tx=0x7f75bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.319+0000 7f75b5ffb700 1 -- 172.21.15.84:0/1411022899 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75b0051300 con 0x7f75c00b49e0 2023-10-06T03:01:50.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.544+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75c00ad850 con 0x7f75c00b49e0 2023-10-06T03:01:50.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.545+0000 7f75b5ffb700 1 -- 172.21.15.84:0/1411022899 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4621 (secure 0 0 0) 0x7f75b0054920 con 0x7f75c00b49e0 2023-10-06T03:01:50.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:50.546 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":103,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:01:50.176343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":8529,"mds_1":8526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:creating","state_seq":1,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:01:50.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75a4066f30 msgr2=0x7f75a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75a4066f30 0x7f75a40693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009a60 tx=0x7f75bc008040 comp rx=0 tx=0).stop 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b49e0 msgr2=0x7f75c016c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b49e0 0x7f75c016c870 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c810 tx=0x7f75b0007db0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 shutdown_connections 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75a4066f30 0x7f75a40693e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75c01595a0 0x7f75c016a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75c00b07a0 0x7f75c00ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 --2- 172.21.15.84:0/1411022899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75c00b49e0 0x7f75c016c870 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 >> 172.21.15.84:0/1411022899 conn(0x7f75c0099830 msgr2=0x7f75c00cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 shutdown_connections 2023-10-06T03:01:50.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:50.547+0000 7f75c81e2700 1 -- 172.21.15.84:0/1411022899 wait complete. 2023-10-06T03:01:50.550 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 103 2023-10-06T03:01:50.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 103, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:01:42.160779+0000', 'modified': '2023-10-06T03:01:50.176343+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 8529, 'mds_1': 8526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8526': {'gid': 8526, 'name': 'c', 'rank': 1, 'incarnation': 103, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.84:6836/3850699528', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 3850699528}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 3850699528}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8529': {'gid': 8529, 'name': 'a', 'rank': 0, 'incarnation': 97, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/868960356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 868960356}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 868960356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:01:50.963 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8526:up:creating 2023-10-06T03:01:51.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:52.073 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:01:52.072+0000 7fb0e674e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-06T03:01:52.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.090+0000 7f1dc7fff700 1 Processor -- start 2023-10-06T03:01:52.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.090+0000 7f1dc7fff700 1 -- start start 2023-10-06T03:01:52.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc7fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1dc8159580 0x7f1dc80ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc80ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc7fff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc80ae250 con 0x7f1dc80ce890 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc7fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc80ad3a0 con 0x7f1dc8159580 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80ad640 con 0x7f1dc8159950 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc67fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc80ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc6ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1dc8159580 0x7f1dc80ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc67fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc80ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:55208/0 (socket says 172.21.15.84:55208) 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc6ffd700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1dc8159580 0x7f1dc80ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:42370/0 (socket says 172.21.15.84:42370) 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc77fe700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f1dc80ce890 0x7f1dc80cb090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:60712/0 (socket says 172.21.15.84:60712) 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.091+0000 7f1dc67fc700 1 -- 172.21.15.84:0/1022888390 learned_addr learned my addr 172.21.15.84:0/1022888390 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.092+0000 7f1dc67fc700 1 -- 172.21.15.84:0/1022888390 >> v2:172.21.15.131:3300/0 conn(0x7f1dc8159580 msgr2=0x7f1dc80ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.092+0000 7f1dc67fc700 1 --2- 172.21.15.84:0/1022888390 >> v2:172.21.15.131:3300/0 conn(0x7f1dc8159580 0x7f1dc80ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.092+0000 7f1dc67fc700 1 -- 172.21.15.84:0/1022888390 >> v1:172.21.15.131:6789/0 conn(0x7f1dc80ce890 legacy=0x7f1dc80cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.092+0000 7f1dc67fc700 1 -- 172.21.15.84:0/1022888390 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc80ad920 con 0x7f1dc8159950 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.092+0000 7f1dc6ffd700 1 --2- 172.21.15.84:0/1022888390 >> v2:172.21.15.131:3300/0 conn(0x7f1dc8159580 0x7f1dc80ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.092+0000 7f1dc67fc700 1 --2- 172.21.15.84:0/1022888390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc80ae6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1db00099b0 tx=0x7f1db0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99b22a91994b6d67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.092+0000 7f1dc5ffb700 1 -- 172.21.15.84:0/1022888390 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0009ea0 con 0x7f1dc8159950 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.092+0000 7f1dc5ffb700 1 -- 172.21.15.84:0/1022888390 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db000b860 con 0x7f1dc8159950 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.092+0000 7f1dc5ffb700 1 -- 172.21.15.84:0/1022888390 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db000bc00 con 0x7f1dc8159950 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.093+0000 7f1dc7fff700 1 -- 172.21.15.84:0/1022888390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 msgr2=0x7f1dc80ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.093+0000 7f1dc7fff700 1 --2- 172.21.15.84:0/1022888390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc80ae6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1db00099b0 tx=0x7f1db0009250 comp rx=0 tx=0).stop 2023-10-06T03:01:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.093+0000 7f1dc7fff700 1 -- 172.21.15.84:0/1022888390 shutdown_connections 2023-10-06T03:01:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.093+0000 7f1dc7fff700 1 --2- 172.21.15.84:0/1022888390 >> v2:172.21.15.131:3300/0 conn(0x7f1dc8159580 0x7f1dc80ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.093+0000 7f1dc7fff700 1 --2- 172.21.15.84:0/1022888390 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc80ae6e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.093+0000 7f1dc7fff700 1 -- 172.21.15.84:0/1022888390 >> 172.21.15.84:0/1022888390 conn(0x7f1dc8099560 msgr2=0x7f1dc806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.093+0000 7f1dc7fff700 1 -- 172.21.15.84:0/1022888390 shutdown_connections 2023-10-06T03:01:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.093+0000 7f1dc7fff700 1 -- 172.21.15.84:0/1022888390 wait complete. 2023-10-06T03:01:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.094+0000 7f1dc7fff700 1 Processor -- start 2023-10-06T03:01:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.094+0000 7f1dc7fff700 1 -- start start 2023-10-06T03:01:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dc80ce890 0x7f1dc80c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8159580 0x7f1dc80c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc7fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc8157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc7fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80c9980 con 0x7f1dc8159580 2023-10-06T03:01:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc7fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc815d6d0 con 0x7f1dc80ce890 2023-10-06T03:01:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc7fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80ca020 con 0x7f1dc8159950 2023-10-06T03:01:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8159580 0x7f1dc80c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8159580 0x7f1dc80c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49106/0 (socket says 172.21.15.84:49106) 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc67fc700 1 -- 172.21.15.84:0/491114129 learned_addr learned my addr 172.21.15.84:0/491114129 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc6ffd700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dc80ce890 0x7f1dc80c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc77fe700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc8157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc67fc700 1 -- 172.21.15.84:0/491114129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 msgr2=0x7f1dc8157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc67fc700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc8157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc67fc700 1 -- 172.21.15.84:0/491114129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dc80ce890 msgr2=0x7f1dc80c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc67fc700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dc80ce890 0x7f1dc80c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc67fc700 1 -- 172.21.15.84:0/491114129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db8009420 con 0x7f1dc8159580 2023-10-06T03:01:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.095+0000 7f1dc67fc700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8159580 0x7f1dc80c8070 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80ad780 tx=0x7f1db0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.096+0000 7f1dbeffd700 1 -- 172.21.15.84:0/491114129 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0000d10 con 0x7f1dc8159580 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.096+0000 7f1dbeffd700 1 -- 172.21.15.84:0/491114129 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db000bbe0 con 0x7f1dc8159580 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.096+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db00094f0 con 0x7f1dc8159580 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.096+0000 7f1dbeffd700 1 -- 172.21.15.84:0/491114129 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0011670 con 0x7f1dc8159580 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.096+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc80ca3b0 con 0x7f1dc8159580 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.097+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc815d4b0 con 0x7f1dc8159580 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.097+0000 7f1dbeffd700 1 -- 172.21.15.84:0/491114129 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1db0011aa0 con 0x7f1dc8159580 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.097+0000 7f1dbeffd700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1da8066f30 0x7f1da80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.098+0000 7f1dc6ffd700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1da8066f30 0x7f1da80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.098+0000 7f1dbeffd700 1 -- 172.21.15.84:0/491114129 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1db0086020 con 0x7f1dc8159580 2023-10-06T03:01:52.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.098+0000 7f1dc6ffd700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1da8066f30 0x7f1da80693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80cf810 tx=0x7f1db80091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.102+0000 7f1dbeffd700 1 -- 172.21.15.84:0/491114129 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1db0052fb0 con 0x7f1dc8159580 2023-10-06T03:01:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.331+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dc815d860 con 0x7f1dc8159580 2023-10-06T03:01:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.331+0000 7f1dbeffd700 1 -- 172.21.15.84:0/491114129 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4634 (secure 0 0 0) 0x7f1db00565d0 con 0x7f1dc8159580 2023-10-06T03:01:52.333 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:52.333 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:01:52.185686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1da8066f30 msgr2=0x7f1da80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1da8066f30 0x7f1da80693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80cf810 tx=0x7f1db80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8159580 msgr2=0x7f1dc80c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8159580 0x7f1dc80c8070 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80ad780 tx=0x7f1db0017000 comp rx=0 tx=0).stop 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 shutdown_connections 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1da8066f30 0x7f1da80693e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1dc80ce890 0x7f1dc80c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1dc8159950 0x7f1dc8157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 --2- 172.21.15.84:0/491114129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dc8159580 0x7f1dc80c8070 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 >> 172.21.15.84:0/491114129 conn(0x7f1dc8099560 msgr2=0x7f1dc8069270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 shutdown_connections 2023-10-06T03:01:52.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.333+0000 7f1dc7fff700 1 -- 172.21.15.84:0/491114129 wait complete. 2023-10-06T03:01:52.336 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 106 2023-10-06T03:01:52.748 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:01:42.160779+0000', 'modified': '2023-10-06T03:01:52.185686+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 8529, 'mds_1': 8526, 'mds_2': 6782}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6782': {'gid': 6782, 'name': 'b', 'rank': 2, 'incarnation': 105, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.131:6835/3436673358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6833', 'nonce': 3436673358}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 3436673358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8526': {'gid': 8526, 'name': 'c', 'rank': 1, 'incarnation': 103, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6836/3850699528', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 3850699528}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 3850699528}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8529': {'gid': 8529, 'name': 'a', 'rank': 0, 'incarnation': 97, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/868960356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 868960356}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 868960356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:01:52.748 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-10-06T03:01:52.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:01:52.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.865+0000 7fe772b98700 1 Processor -- start 2023-10-06T03:01:52.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.865+0000 7fe772b98700 1 -- start start 2023-10-06T03:01:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe772b98700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c0b07a0 0x7fe76c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe772b98700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c0b0ca0 con 0x7fe76c0b49e0 2023-10-06T03:01:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe772b98700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c0b0f80 con 0x7fe76c1595a0 2023-10-06T03:01:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe772b98700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0ab390 con 0x7fe76c0b07a0 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe76c0b49e0 0x7fe76c0aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53100/0 (socket says 172.21.15.84:53100) 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76bfff700 1 -- 172.21.15.84:0/1721574849 learned_addr learned my addr 172.21.15.84:0/1721574849 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670127121 0 0) 0x7fe76c0b0ca0 con 0x7fe76c0b49e0 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe758003570 con 0x7fe76c0b49e0 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe771135700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c0b07a0 0x7fe76c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2662040279 0 0) 0x7fe758003570 con 0x7fe76c0b49e0 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c0b07a0 msgr2=0x7fe76c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c0b07a0 0x7fe76c0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 >> v1:172.21.15.131:6789/0 conn(0x7fe76c1595a0 legacy=0x7fe76c0aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0b1260 con 0x7fe76c0b49e0 2023-10-06T03:01:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fe75c0017f0 con 0x7fe76c0b49e0 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 >> v1:172.21.15.84:6789/0 conn(0x7fe76c0b49e0 legacy=0x7fe76c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe758003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758004810 0x7fe758004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.866+0000 7fe76b7fe700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe758005230 0x7fe75800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0ab390 con 0x7fe758003a90 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75800c0d0 con 0x7fe758004810 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75800c290 con 0x7fe758005230 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe771135700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c0b07a0 0x7fe76c0ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe770934700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe758003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe76bfff700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758004810 0x7fe758004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe771135700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe758005230 0x7fe75800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe770934700 1 -- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe758005230 msgr2=0x7fe75800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe770934700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe758005230 0x7fe75800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe770934700 1 -- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758004810 msgr2=0x7fe758004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe770934700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe758004810 0x7fe758004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe770934700 1 -- 172.21.15.84:0/1721574849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe758003570 con 0x7fe758003a90 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe770934700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe758003ea0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fe7640018d0 tx=0x7fe764007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454d75732b7f19ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764001290 con 0x7fe758003a90 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764012420 con 0x7fe758003a90 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.867+0000 7fe76b7fe700 1 -- 172.21.15.84:0/1721574849 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7640127e0 con 0x7fe758003a90 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.868+0000 7fe772b98700 1 -- 172.21.15.84:0/1721574849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 msgr2=0x7fe758003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.868+0000 7fe772b98700 1 --2- 172.21.15.84:0/1721574849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe758003ea0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fe7640018d0 tx=0x7fe764007d80 comp rx=0 tx=0).stop 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.868+0000 7fe771135700 1 -- 172.21.15.84:0/1721574849 reap_dead start 2023-10-06T03:01:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.868+0000 7fe772b98700 1 -- 172.21.15.84:0/1721574849 shutdown_connections 2023-10-06T03:01:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.868+0000 7fe772b98700 1 -- 172.21.15.84:0/1721574849 >> 172.21.15.84:0/1721574849 conn(0x7fe76c099830 msgr2=0x7fe76c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.868+0000 7fe772b98700 1 -- 172.21.15.84:0/1721574849 shutdown_connections 2023-10-06T03:01:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.868+0000 7fe772b98700 1 -- 172.21.15.84:0/1721574849 wait complete. 2023-10-06T03:01:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.869+0000 7fe772b98700 1 Processor -- start 2023-10-06T03:01:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.869+0000 7fe772b98700 1 -- start start 2023-10-06T03:01:52.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe772b98700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe76c16e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe772b98700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c156b70 0x7fe76c159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe772b98700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe76c169f40 0x7fe76c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe772b98700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c09b5c0 con 0x7fe758003a90 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe772b98700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c16a850 con 0x7fe76c169f40 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe772b98700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c16ab30 con 0x7fe76c156b70 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe770934700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe76c16e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe770934700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe76c16e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57298/0 (socket says 172.21.15.84:57298) 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe770934700 1 -- 172.21.15.84:0/1992604431 learned_addr learned my addr 172.21.15.84:0/1992604431 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe76bfff700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c156b70 0x7fe76c159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe771135700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe76c169f40 0x7fe76c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe770934700 1 -- 172.21.15.84:0/1992604431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c156b70 msgr2=0x7fe76c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe770934700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c156b70 0x7fe76c159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe770934700 1 -- 172.21.15.84:0/1992604431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe76c169f40 msgr2=0x7fe76c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe770934700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe76c169f40 0x7fe76c15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe770934700 1 -- 172.21.15.84:0/1992604431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c16ae10 con 0x7fe758003a90 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe770934700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe76c16e0c0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe764001ec0 tx=0x7fe764015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe768ff9700 1 -- 172.21.15.84:0/1992604431 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76401f620 con 0x7fe758003a90 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe768ff9700 1 -- 172.21.15.84:0/1992604431 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76401f7a0 con 0x7fe758003a90 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe772b98700 1 -- 172.21.15.84:0/1992604431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c09b250 con 0x7fe758003a90 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe768ff9700 1 -- 172.21.15.84:0/1992604431 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76401fb60 con 0x7fe758003a90 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.870+0000 7fe772b98700 1 -- 172.21.15.84:0/1992604431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c156fe0 con 0x7fe758003a90 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.872+0000 7fe768ff9700 1 -- 172.21.15.84:0/1992604431 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe76401d3a0 con 0x7fe758003a90 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.872+0000 7fe768ff9700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe74c066f30 0x7fe74c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.872+0000 7fe768ff9700 1 -- 172.21.15.84:0/1992604431 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe764085f50 con 0x7fe758003a90 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.873+0000 7fe76bfff700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe74c066f30 0x7fe74c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.873+0000 7fe76bfff700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe74c066f30 0x7fe74c0693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe76c16e600 tx=0x7fe75c006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.874+0000 7fe77be90b80 1 Processor -- start 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.874+0000 7fe77be90b80 1 -- start start 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a83bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a88b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a88c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe77be90b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a792a70 con 0x55c05a83b840 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe77be90b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a790270 con 0x55c05a88bc00 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe77be90b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05a78c060 con 0x55c05a83ccc0 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe770934700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a83bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe770934700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a83bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57310/0 (socket says 172.21.15.84:57310) 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe770934700 1 -- 172.21.15.84:0/1011042282 learned_addr learned my addr 172.21.15.84:0/1011042282 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:52.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe770934700 1 -- 172.21.15.84:0/1011042282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 msgr2=0x55c05a88b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe770934700 1 --2- 172.21.15.84:0/1011042282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a88b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe770934700 1 -- 172.21.15.84:0/1011042282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 msgr2=0x55c05a88c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe770934700 1 --2- 172.21.15.84:0/1011042282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a88c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe770934700 1 -- 172.21.15.84:0/1011042282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c05a626270 con 0x55c05a83b840 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe770934700 1 --2- 172.21.15.84:0/1011042282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a83bc10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fe764056500 tx=0x7fe7640840f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f8ee2d05d63939 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.875+0000 7fe761ffb700 1 -- 172.21.15.84:0/1011042282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764056c00 con 0x55c05a83b840 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe761ffb700 1 -- 172.21.15.84:0/1011042282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764059df0 con 0x55c05a83b840 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe761ffb700 1 -- 172.21.15.84:0/1011042282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76405db40 con 0x55c05a83b840 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe77be90b80 1 -- 172.21.15.84:0/1011042282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 msgr2=0x55c05a83bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe77be90b80 1 --2- 172.21.15.84:0/1011042282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a83bc10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fe764056500 tx=0x7fe7640840f0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe77be90b80 1 -- 172.21.15.84:0/1011042282 shutdown_connections 2023-10-06T03:01:52.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe77be90b80 1 --2- 172.21.15.84:0/1011042282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a88c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe77be90b80 1 --2- 172.21.15.84:0/1011042282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a83bc10 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe77be90b80 1 --2- 172.21.15.84:0/1011042282 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a88b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe77be90b80 1 -- 172.21.15.84:0/1011042282 >> 172.21.15.84:0/1011042282 conn(0x55c05a83d160 msgr2=0x55c05a83d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe77be90b80 1 -- 172.21.15.84:0/1011042282 shutdown_connections 2023-10-06T03:01:52.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.876+0000 7fe77be90b80 1 -- 172.21.15.84:0/1011042282 wait complete. 2023-10-06T03:01:52.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.877+0000 7fe77be90b80 1 -- start start 2023-10-06T03:01:52.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.877+0000 7fe77be90b80 1 Processor -- start 2023-10-06T03:01:52.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a83b840 0x55c05a86a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a836d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a88bc00 0x55c05a837240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe77be90b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a737890 con 0x55c05a88bc00 2023-10-06T03:01:52.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe77be90b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a752ea0 con 0x55c05a83b840 2023-10-06T03:01:52.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe77be90b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05a60ee30 con 0x55c05a83ccc0 2023-10-06T03:01:52.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe77be90b80 10 client.0 _ll_register_callbacks cb 0x55c05a7fee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:52.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe771135700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a88bc00 0x55c05a837240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe771135700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a88bc00 0x55c05a837240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57316/0 (socket says 172.21.15.84:57316) 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe771135700 1 -- 172.21.15.84:0/3719873321 learned_addr learned my addr 172.21.15.84:0/3719873321 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe76bfff700 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a836d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe770934700 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a83b840 0x55c05a86a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe771135700 1 -- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 msgr2=0x55c05a836d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe771135700 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a836d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe771135700 1 -- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a83b840 msgr2=0x55c05a86a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe771135700 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a83b840 0x55c05a86a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe771135700 1 -- 172.21.15.84:0/3719873321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c156fe0 con 0x55c05a88bc00 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe771135700 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a88bc00 0x55c05a837240 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0b0b70 tx=0x7fe754008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d9164a5b299faf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe74affd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:52.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe74affd700 1 -- 172.21.15.84:0/3719873321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754012d50 con 0x55c05a88bc00 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe74affd700 1 -- 172.21.15.84:0/3719873321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe7540153f0 con 0x55c05a88bc00 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.878+0000 7fe77be90b80 1 -- 172.21.15.84:0/3719873321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c05a830940 con 0x55c05a88bc00 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe74affd700 1 -- 172.21.15.84:0/3719873321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7540102f0 con 0x55c05a88bc00 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe77be90b80 10 client.8724 fetch_fsmap learned FSMap version 106 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe77be90b80 1 -- 172.21.15.84:0/3719873321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x55c05a5c8fe0 con 0x55c05a88bc00 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe74affd700 1 -- 172.21.15.84:0/3719873321 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c05a830940 con 0x55c05a88bc00 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe74affd700 1 -- 172.21.15.84:0/3719873321 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 106) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fe7540157c0 con 0x55c05a88bc00 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe77be90b80 10 client.8724 fetch_fsmap finished waiting for FSMap version 106 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe77be90b80 10 client.8724 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe77be90b80 20 client.8724 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:52.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe77be90b80 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c05a866ee0 0x55c05a8672b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe77be90b80 4 client.8724 mds_command: new command op to 6782 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe77be90b80 1 -- 172.21.15.84:0/3719873321 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c05a80d870 con 0x55c05a866ee0 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.879+0000 7fe770934700 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c05a866ee0 0x55c05a8672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe74affd700 10 client.8724 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe770934700 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c05a866ee0 0x55c05a8672b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d59e2456ac5271c2 server_cookie=bc761060e4852d8b in_seq=0 out_seq=0 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe74affd700 1 -- 172.21.15.84:0/3719873321 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c05a80d870 con 0x55c05a866ee0 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe74affd700 10 client.8724 handle_command_reply: tid=0 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe77be90b80 1 client.8724 shutdown 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe77be90b80 1 -- 172.21.15.84:0/3719873321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a88bc00 msgr2=0x55c05a837240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe77be90b80 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a88bc00 0x55c05a837240 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0b0b70 tx=0x7fe754008040 comp rx=0 tx=0).stop 2023-10-06T03:01:52.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe77be90b80 1 -- 172.21.15.84:0/3719873321 shutdown_connections 2023-10-06T03:01:52.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe77be90b80 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a83b840 0x55c05a86a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe77be90b80 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c05a866ee0 0x55c05a8672b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe77be90b80 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a88bc00 0x55c05a837240 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe74affd700 0 client.8724 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:01:52.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe77be90b80 1 --2- 172.21.15.84:0/3719873321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a836d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.880+0000 7fe77be90b80 1 -- 172.21.15.84:0/3719873321 >> 172.21.15.84:0/3719873321 conn(0x55c05a83d160 msgr2=0x55c05a83c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.881+0000 7fe77be90b80 1 -- 172.21.15.84:0/3719873321 shutdown_connections 2023-10-06T03:01:52.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.881+0000 7fe77be90b80 1 -- 172.21.15.84:0/3719873321 wait complete. 2023-10-06T03:01:52.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.881+0000 7fe77be90b80 20 client.8724 trim_cache size 0 max 16384 2023-10-06T03:01:52.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.897+0000 7fe77be90b80 1 Processor -- start 2023-10-06T03:01:52.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.897+0000 7fe77be90b80 1 -- start start 2023-10-06T03:01:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a86b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a867be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a879570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe77be90b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a885930 con 0x55c05a83b840 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe77be90b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a885600 con 0x55c05a88bc00 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe77be90b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05a868cd0 con 0x55c05a83ccc0 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe770934700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a86b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe770934700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a86b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57326/0 (socket says 172.21.15.84:57326) 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe770934700 1 -- 172.21.15.84:0/2087563057 learned_addr learned my addr 172.21.15.84:0/2087563057 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe76bfff700 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a867be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe771135700 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a879570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe770934700 1 -- 172.21.15.84:0/2087563057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 msgr2=0x55c05a867be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe770934700 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a867be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe770934700 1 -- 172.21.15.84:0/2087563057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 msgr2=0x55c05a879570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe770934700 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a879570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe770934700 1 -- 172.21.15.84:0/2087563057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c05a838fd0 con 0x55c05a83b840 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.898+0000 7fe771135700 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a879570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe770934700 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a86b350 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fe7640535c0 tx=0x7fe76402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a770c8581d21aa61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe7627fc700 1 -- 172.21.15.84:0/2087563057 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76405db40 con 0x55c05a83b840 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe7627fc700 1 -- 172.21.15.84:0/2087563057 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764061070 con 0x55c05a83b840 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe7627fc700 1 -- 172.21.15.84:0/2087563057 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764054ce0 con 0x55c05a83b840 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe77be90b80 1 -- 172.21.15.84:0/2087563057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 msgr2=0x55c05a86b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a86b350 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fe7640535c0 tx=0x7fe76402a000 comp rx=0 tx=0).stop 2023-10-06T03:01:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe77be90b80 1 -- 172.21.15.84:0/2087563057 shutdown_connections 2023-10-06T03:01:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a879570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83b840 0x55c05a86b350 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2087563057 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83ccc0 0x55c05a867be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe77be90b80 1 -- 172.21.15.84:0/2087563057 >> 172.21.15.84:0/2087563057 conn(0x55c05a83d160 msgr2=0x55c05a869450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe77be90b80 1 -- 172.21.15.84:0/2087563057 shutdown_connections 2023-10-06T03:01:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.899+0000 7fe77be90b80 1 -- 172.21.15.84:0/2087563057 wait complete. 2023-10-06T03:01:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.900+0000 7fe77be90b80 1 -- start start 2023-10-06T03:01:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.900+0000 7fe77be90b80 1 Processor -- start 2023-10-06T03:01:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83b840 0x55c05a8637b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83ccc0 0x55c05a868210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe77be90b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a868750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe77be90b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a889420 con 0x55c05a83ccc0 2023-10-06T03:01:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe77be90b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a89b970 con 0x55c05a88bc00 2023-10-06T03:01:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe77be90b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c05a89bbc0 con 0x55c05a83b840 2023-10-06T03:01:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe77be90b80 10 client.0 _ll_register_callbacks cb 0x55c05a7fee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe76bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83ccc0 0x55c05a868210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe76bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83ccc0 0x55c05a868210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57330/0 (socket says 172.21.15.84:57330) 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe76bfff700 1 -- 172.21.15.84:0/2046237705 learned_addr learned my addr 172.21.15.84:0/2046237705 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe770934700 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83b840 0x55c05a8637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe771135700 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a868750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe770934700 1 -- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 msgr2=0x55c05a868750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe770934700 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a868750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe770934700 1 -- 172.21.15.84:0/2046237705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83ccc0 msgr2=0x55c05a868210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe770934700 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83ccc0 0x55c05a868210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe770934700 1 -- 172.21.15.84:0/2046237705 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c05a626270 con 0x55c05a83b840 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe76bfff700 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83ccc0 0x55c05a868210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe770934700 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83b840 0x55c05a8637b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7640567c0 tx=0x7fe76405f070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18c832f59bf3bd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.901+0000 7fe74affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3301/0 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe74affd700 1 -- 172.21.15.84:0/2046237705 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764084270 con 0x55c05a83b840 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe77be90b80 1 -- 172.21.15.84:0/2046237705 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe764059df0 con 0x55c05a83b840 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe74affd700 1 -- 172.21.15.84:0/2046237705 <== mon.2 v2:172.21.15.131:3301/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe76401fcc0 con 0x55c05a83b840 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe74affd700 1 -- 172.21.15.84:0/2046237705 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe764069150 con 0x55c05a83b840 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe77be90b80 10 client.6899 fetch_fsmap learned FSMap version 106 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe77be90b80 1 -- 172.21.15.84:0/2046237705 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x55c05a75a780 con 0x55c05a83b840 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe74affd700 1 -- 172.21.15.84:0/2046237705 <== mon.2 v2:172.21.15.131:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764059df0 con 0x55c05a83b840 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe74affd700 1 -- 172.21.15.84:0/2046237705 <== mon.2 v2:172.21.15.131:3301/0 5 ==== fsmap(e 106) v1 ==== 3124+0+0 (secure 0 0 0) 0x7fe76407d070 con 0x55c05a83b840 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe77be90b80 10 client.6899 fetch_fsmap finished waiting for FSMap version 106 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe77be90b80 10 client.6899 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:01:52.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe77be90b80 20 client.6899 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c05a878cb0 0x55c05a879080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe77be90b80 4 client.6899 mds_command: new command op to 6782 tid=0[{"prefix": "status"}] 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe77be90b80 1 -- 172.21.15.84:0/2046237705 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c05a72ee00 con 0x55c05a878cb0 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.902+0000 7fe76bfff700 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c05a878cb0 0x55c05a879080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe74affd700 10 client.6899 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe76bfff700 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c05a878cb0 0x55c05a879080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=438b7d0b6750120f server_cookie=39b1bd31a13204ef in_seq=0 out_seq=0 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe74affd700 1 -- 172.21.15.84:0/2046237705 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x55c05a72ee00 con 0x55c05a878cb0 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe74affd700 10 client.6899 handle_command_reply: tid=0 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 client.6899 shutdown 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 -- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83b840 msgr2=0x55c05a8637b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83b840 0x55c05a8637b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7640567c0 tx=0x7fe76405f070 comp rx=0 tx=0).stop 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 -- 172.21.15.84:0/2046237705 shutdown_connections 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c05a88bc00 0x55c05a868750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c05a878cb0 0x55c05a879080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c05a83b840 0x55c05a8637b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 --2- 172.21.15.84:0/2046237705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c05a83ccc0 0x55c05a868210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe74affd700 0 client.6899 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 -- 172.21.15.84:0/2046237705 >> 172.21.15.84:0/2046237705 conn(0x55c05a83d160 msgr2=0x55c05a87b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 -- 172.21.15.84:0/2046237705 shutdown_connections 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 1 -- 172.21.15.84:0/2046237705 wait complete. 2023-10-06T03:01:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.903+0000 7fe77be90b80 20 client.6899 trim_cache size 0 max 16384 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6782, 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 1.71833871, 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 106, 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 108, 2023-10-06T03:01:52.913 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 108, 2023-10-06T03:01:52.914 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.237540312 2023-10-06T03:01:52.914 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 -- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe74c066f30 msgr2=0x7fe74c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe74c066f30 0x7fe74c0693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe76c16e600 tx=0x7fe75c006040 comp rx=0 tx=0).stop 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 -- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 msgr2=0x7fe76c16e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe76c16e0c0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe764001ec0 tx=0x7fe764015000 comp rx=0 tx=0).stop 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 -- 172.21.15.84:0/1992604431 shutdown_connections 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe74c066f30 0x7fe74c0693e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe76c169f40 0x7fe76c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe758003a90 0x7fe76c16e0c0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 --2- 172.21.15.84:0/1992604431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe76c156b70 0x7fe76c159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 -- 172.21.15.84:0/1992604431 >> 172.21.15.84:0/1992604431 conn(0x7fe76c099830 msgr2=0x7fe76c1589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 -- 172.21.15.84:0/1992604431 shutdown_connections 2023-10-06T03:01:52.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:52.904+0000 7fe772b98700 1 -- 172.21.15.84:0/1992604431 wait complete. 2023-10-06T03:01:52.917 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:01:53.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.030+0000 7f20131f2700 1 Processor -- start 2023-10-06T03:01:53.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.030+0000 7f20131f2700 1 -- start start 2023-10-06T03:01:53.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f20131f2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c1595a0 0x7f200c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f20131f2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f200c0b49e0 0x7f200c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f20131f2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200c0b0ca0 con 0x7f200c0b07a0 2023-10-06T03:01:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f20131f2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c0b0f80 con 0x7f200c0b49e0 2023-10-06T03:01:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f20131f2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c0b1260 con 0x7f200c1595a0 2023-10-06T03:01:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f200bfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f200c0b49e0 0x7f200c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f2010f8e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c1595a0 0x7f200c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f201178f700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f200c0b07a0 0x7f200c0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:57100/0 (socket says 172.21.15.84:57100) 2023-10-06T03:01:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f201178f700 1 -- 172.21.15.84:0/3129652165 learned_addr learned my addr 172.21.15.84:0/3129652165 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f200b7fe700 1 -- 172.21.15.84:0/3129652165 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799428885 0 0) 0x7f200c0b0ca0 con 0x7f200c0b07a0 2023-10-06T03:01:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f200b7fe700 1 -- 172.21.15.84:0/3129652165 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ff4003570 con 0x7f200c0b07a0 2023-10-06T03:01:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f2010f8e700 1 -- 172.21.15.84:0/3129652165 >> v2:172.21.15.131:3300/0 conn(0x7f200c0b49e0 msgr2=0x7f200c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.031+0000 7f2010f8e700 1 --2- 172.21.15.84:0/3129652165 >> v2:172.21.15.131:3300/0 conn(0x7f200c0b49e0 0x7f200c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f2010f8e700 1 -- 172.21.15.84:0/3129652165 >> v1:172.21.15.131:6789/0 conn(0x7f200c0b07a0 legacy=0x7f200c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f2010f8e700 1 -- 172.21.15.84:0/3129652165 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c0b1540 con 0x7f200c1595a0 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f200bfff700 1 --2- 172.21.15.84:0/3129652165 >> v2:172.21.15.131:3300/0 conn(0x7f200c0b49e0 0x7f200c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f2010f8e700 1 --2- 172.21.15.84:0/3129652165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c1595a0 0x7f200c0aa570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009eb0 tx=0x7f1ffc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=668e0a0b5434399e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f200b7fe700 1 -- 172.21.15.84:0/3129652165 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00e070 con 0x7f200c1595a0 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f200b7fe700 1 -- 172.21.15.84:0/3129652165 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc00bb80 con 0x7f200c1595a0 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f200b7fe700 1 -- 172.21.15.84:0/3129652165 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc012430 con 0x7f200c1595a0 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f20131f2700 1 -- 172.21.15.84:0/3129652165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c1595a0 msgr2=0x7f200c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f20131f2700 1 --2- 172.21.15.84:0/3129652165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c1595a0 0x7f200c0aa570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009eb0 tx=0x7f1ffc009780 comp rx=0 tx=0).stop 2023-10-06T03:01:53.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f20131f2700 1 -- 172.21.15.84:0/3129652165 shutdown_connections 2023-10-06T03:01:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f20131f2700 1 --2- 172.21.15.84:0/3129652165 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c1595a0 0x7f200c0aa570 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f20131f2700 1 --2- 172.21.15.84:0/3129652165 >> v2:172.21.15.131:3300/0 conn(0x7f200c0b49e0 0x7f200c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f20131f2700 1 -- 172.21.15.84:0/3129652165 >> 172.21.15.84:0/3129652165 conn(0x7f200c099830 msgr2=0x7f200c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f20131f2700 1 -- 172.21.15.84:0/3129652165 shutdown_connections 2023-10-06T03:01:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.032+0000 7f20131f2700 1 -- 172.21.15.84:0/3129652165 wait complete. 2023-10-06T03:01:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.033+0000 7f20131f2700 1 Processor -- start 2023-10-06T03:01:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.034+0000 7f20131f2700 1 -- start start 2023-10-06T03:01:53.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.034+0000 7f20131f2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b07a0 0x7f200c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.034+0000 7f20131f2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c0b49e0 0x7f200c15e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.034+0000 7f20131f2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f200c1595a0 0x7f200c0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.034+0000 7f20131f2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c09b110 con 0x7f200c0b07a0 2023-10-06T03:01:53.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.034+0000 7f20131f2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c156fa0 con 0x7f200c1595a0 2023-10-06T03:01:53.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.034+0000 7f20131f2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c09a500 con 0x7f200c0b49e0 2023-10-06T03:01:53.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2010f8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b07a0 0x7f200c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2010f8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b07a0 0x7f200c156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57340/0 (socket says 172.21.15.84:57340) 2023-10-06T03:01:53.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f200bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c0b49e0 0x7f200c15e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2010f8e700 1 -- 172.21.15.84:0/486173827 learned_addr learned my addr 172.21.15.84:0/486173827 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f201178f700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f200c1595a0 0x7f200c0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2010f8e700 1 -- 172.21.15.84:0/486173827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c0b49e0 msgr2=0x7f200c15e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2010f8e700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c0b49e0 0x7f200c15e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2010f8e700 1 -- 172.21.15.84:0/486173827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f200c1595a0 msgr2=0x7f200c0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2010f8e700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f200c1595a0 0x7f200c0cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2010f8e700 1 -- 172.21.15.84:0/486173827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000009420 con 0x7f200c0b07a0 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f200bfff700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c0b49e0 0x7f200c15e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2010f8e700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b07a0 0x7f200c156a60 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00b610 tx=0x7f1ffc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2008ff9700 1 -- 172.21.15.84:0/486173827 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc012c00 con 0x7f200c0b07a0 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2008ff9700 1 -- 172.21.15.84:0/486173827 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc012d80 con 0x7f200c0b07a0 2023-10-06T03:01:53.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f20131f2700 1 -- 172.21.15.84:0/486173827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc009a20 con 0x7f200c0b07a0 2023-10-06T03:01:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f2008ff9700 1 -- 172.21.15.84:0/486173827 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0276c0 con 0x7f200c0b07a0 2023-10-06T03:01:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.035+0000 7f20131f2700 1 -- 172.21.15.84:0/486173827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c09aac0 con 0x7f200c0b07a0 2023-10-06T03:01:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.037+0000 7f2008ff9700 1 -- 172.21.15.84:0/486173827 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ffc024070 con 0x7f200c0b07a0 2023-10-06T03:01:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.037+0000 7f2008ff9700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ff8066f30 0x7f1ff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.037+0000 7f2008ff9700 1 -- 172.21.15.84:0/486173827 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1ffc086d50 con 0x7f200c0b07a0 2023-10-06T03:01:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.037+0000 7f200bfff700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ff8066f30 0x7f1ff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.037+0000 7f200bfff700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ff8066f30 0x7f1ff80693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f200c158010 tx=0x7f20000091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.039+0000 7f201c4eab80 1 Processor -- start 2023-10-06T03:01:53.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.039+0000 7f201c4eab80 1 -- start start 2023-10-06T03:01:53.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.039+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e219ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.039+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219fcc0 0x55f5e21ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.039+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 0x55f5e21ef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.039+0000 7f201c4eab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5e20f5a70 con 0x55f5e219e840 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.039+0000 7f201c4eab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5e20f3270 con 0x55f5e219fcc0 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f201c4eab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5e20ef060 con 0x55f5e21eec00 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f2010f8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e219ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f2010f8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e219ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57346/0 (socket says 172.21.15.84:57346) 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f2010f8e700 1 -- 172.21.15.84:0/1648994730 learned_addr learned my addr 172.21.15.84:0/1648994730 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f200bfff700 1 --2- 172.21.15.84:0/1648994730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219fcc0 0x55f5e21ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f201178f700 1 --2- 172.21.15.84:0/1648994730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 0x55f5e21ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f2010f8e700 1 -- 172.21.15.84:0/1648994730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 msgr2=0x55f5e21ef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f2010f8e700 1 --2- 172.21.15.84:0/1648994730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 0x55f5e21ef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f2010f8e700 1 -- 172.21.15.84:0/1648994730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219fcc0 msgr2=0x55f5e21ee6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f2010f8e700 1 --2- 172.21.15.84:0/1648994730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219fcc0 0x55f5e21ee6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f2010f8e700 1 -- 172.21.15.84:0/1648994730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5e1f89270 con 0x55f5e219e840 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f2010f8e700 1 --2- 172.21.15.84:0/1648994730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e219ec10 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc053ea0 tx=0x7f1ffc084ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fe24ebdc5dc75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f1ff1ffb700 1 -- 172.21.15.84:0/1648994730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0579a0 con 0x55f5e219e840 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f1ff1ffb700 1 -- 172.21.15.84:0/1648994730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc05abf0 con 0x55f5e219e840 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.040+0000 7f1ff1ffb700 1 -- 172.21.15.84:0/1648994730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc05e940 con 0x55f5e219e840 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 -- 172.21.15.84:0/1648994730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 msgr2=0x55f5e219ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1648994730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e219ec10 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc053ea0 tx=0x7f1ffc084ef0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 -- 172.21.15.84:0/1648994730 shutdown_connections 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1648994730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 0x55f5e21ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1648994730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e219ec10 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1648994730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219fcc0 0x55f5e21ee6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 -- 172.21.15.84:0/1648994730 >> 172.21.15.84:0/1648994730 conn(0x55f5e21a0160 msgr2=0x55f5e21a0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 -- 172.21.15.84:0/1648994730 shutdown_connections 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 -- 172.21.15.84:0/1648994730 wait complete. 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.041+0000 7f201c4eab80 1 -- start start 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201c4eab80 1 Processor -- start 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 0x55f5e21dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 0x55f5e21e8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e21eec00 0x55f5e21e2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201c4eab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5e209a890 con 0x55f5e21eec00 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201c4eab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5e20b5ea0 con 0x55f5e219e840 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201c4eab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5e1f71e30 con 0x55f5e219fcc0 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201c4eab80 10 client.0 _ll_register_callbacks cb 0x55f5e2161e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:53.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201178f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e21eec00 0x55f5e21e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201178f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e21eec00 0x55f5e21e2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57350/0 (socket says 172.21.15.84:57350) 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f201178f700 1 -- 172.21.15.84:0/4231239802 learned_addr learned my addr 172.21.15.84:0/4231239802 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f2010f8e700 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 0x55f5e21dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.042+0000 7f200bfff700 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 0x55f5e21e8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201178f700 1 -- 172.21.15.84:0/4231239802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 msgr2=0x55f5e21e8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201178f700 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 0x55f5e21e8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201178f700 1 -- 172.21.15.84:0/4231239802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 msgr2=0x55f5e21dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201178f700 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 0x55f5e21dd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201178f700 1 -- 172.21.15.84:0/4231239802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c09aac0 con 0x55f5e21eec00 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201178f700 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e21eec00 0x55f5e21e2370 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f20040078d0 tx=0x7f2004009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b209f6d79034649b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f1feaffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f1feaffd700 1 -- 172.21.15.84:0/4231239802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004015470 con 0x55f5e21eec00 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f1feaffd700 1 -- 172.21.15.84:0/4231239802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f20040155d0 con 0x55f5e21eec00 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201c4eab80 1 -- 172.21.15.84:0/4231239802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5e2193940 con 0x55f5e21eec00 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f1feaffd700 1 -- 172.21.15.84:0/4231239802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2004005b90 con 0x55f5e21eec00 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201c4eab80 10 client.8739 fetch_fsmap learned FSMap version 106 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201c4eab80 1 -- 172.21.15.84:0/4231239802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x55f5e1f2bfe0 con 0x55f5e21eec00 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f1feaffd700 1 -- 172.21.15.84:0/4231239802 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f5e2193940 con 0x55f5e21eec00 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f1feaffd700 1 -- 172.21.15.84:0/4231239802 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 106) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f20040159a0 con 0x55f5e21eec00 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201c4eab80 10 client.8739 fetch_fsmap finished waiting for FSMap version 106 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201c4eab80 10 client.8739 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201c4eab80 20 client.8739 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:53.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201c4eab80 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55f5e21df4a0 0x55f5e21ca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201c4eab80 4 client.8739 mds_command: new command op to 8526 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.043+0000 7f201c4eab80 1 -- 172.21.15.84:0/4231239802 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5e2170870 con 0x55f5e21df4a0 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.044+0000 7f2010f8e700 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55f5e21df4a0 0x55f5e21ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.044+0000 7f1feaffd700 10 client.8739 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.044+0000 7f2010f8e700 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55f5e21df4a0 0x55f5e21ca380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d764ae78c86bef0 server_cookie=96e6bf4f329b61d0 in_seq=0 out_seq=0 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.044+0000 7f1feaffd700 1 -- 172.21.15.84:0/4231239802 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f5e2170870 con 0x55f5e21df4a0 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.044+0000 7f1feaffd700 10 client.8739 handle_command_reply: tid=0 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.044+0000 7f201c4eab80 1 client.8739 shutdown 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 -- 172.21.15.84:0/4231239802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e21eec00 msgr2=0x55f5e21e2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e21eec00 0x55f5e21e2370 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f20040078d0 tx=0x7f2004009040 comp rx=0 tx=0).stop 2023-10-06T03:01:53.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 -- 172.21.15.84:0/4231239802 shutdown_connections 2023-10-06T03:01:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55f5e21df4a0 0x55f5e21ca380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 0x55f5e21dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f1feaffd700 0 client.8739 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:01:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e21eec00 0x55f5e21e2370 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 --2- 172.21.15.84:0/4231239802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 0x55f5e21e8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 -- 172.21.15.84:0/4231239802 >> 172.21.15.84:0/4231239802 conn(0x55f5e21a0160 msgr2=0x55f5e21c7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 -- 172.21.15.84:0/4231239802 shutdown_connections 2023-10-06T03:01:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 1 -- 172.21.15.84:0/4231239802 wait complete. 2023-10-06T03:01:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.045+0000 7f201c4eab80 20 client.8739 trim_cache size 0 max 16384 2023-10-06T03:01:53.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f201c4eab80 1 Processor -- start 2023-10-06T03:01:53.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f201c4eab80 1 -- start start 2023-10-06T03:01:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 0x55f5e21c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219fcc0 0x55f5e21de810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 0x55f5e21ded50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f201c4eab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5e21e1df0 con 0x55f5e219fcc0 2023-10-06T03:01:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f201c4eab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5e2199620 con 0x55f5e219e840 2023-10-06T03:01:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f201c4eab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5e21e3ac0 con 0x55f5e21eec00 2023-10-06T03:01:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f200bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219fcc0 0x55f5e21de810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f200bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219fcc0 0x55f5e21de810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57364/0 (socket says 172.21.15.84:57364) 2023-10-06T03:01:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.062+0000 7f200bfff700 1 -- 172.21.15.84:0/1733866989 learned_addr learned my addr 172.21.15.84:0/1733866989 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f201178f700 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 0x55f5e21ded50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f2010f8e700 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 0x55f5e21c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f200bfff700 1 -- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 msgr2=0x55f5e21ded50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f200bfff700 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 0x55f5e21ded50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f200bfff700 1 -- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 msgr2=0x55f5e21c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f200bfff700 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 0x55f5e21c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f200bfff700 1 -- 172.21.15.84:0/1733866989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5e20bd780 con 0x55f5e219fcc0 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f201178f700 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 0x55f5e21ded50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f2010f8e700 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 0x55f5e21c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f200bfff700 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219fcc0 0x55f5e21de810 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f200c09b7f0 tx=0x7f2000019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b363b575e0b09b4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f1ff27fc700 1 -- 172.21.15.84:0/1733866989 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000014e50 con 0x55f5e219fcc0 2023-10-06T03:01:53.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f1ff27fc700 1 -- 172.21.15.84:0/1733866989 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2000023620 con 0x55f5e219fcc0 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.063+0000 7f1ff27fc700 1 -- 172.21.15.84:0/1733866989 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20000239a0 con 0x55f5e219fcc0 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 -- 172.21.15.84:0/1733866989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219fcc0 msgr2=0x55f5e21de810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219fcc0 0x55f5e21de810 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f200c09b7f0 tx=0x7f2000019000 comp rx=0 tx=0).stop 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 -- 172.21.15.84:0/1733866989 shutdown_connections 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e219e840 0x55f5e21c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e21eec00 0x55f5e21ded50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1733866989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219fcc0 0x55f5e21de810 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 -- 172.21.15.84:0/1733866989 >> 172.21.15.84:0/1733866989 conn(0x55f5e21a0160 msgr2=0x55f5e219f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 -- 172.21.15.84:0/1733866989 shutdown_connections 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 -- 172.21.15.84:0/1733866989 wait complete. 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 -- start start 2023-10-06T03:01:53.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.064+0000 7f201c4eab80 1 Processor -- start 2023-10-06T03:01:53.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e224adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 0x55f5e21e94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f201c4eab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e21eec00 0x55f5e21e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f201c4eab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5e21ff340 con 0x55f5e219e840 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f201c4eab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5e21ec590 con 0x55f5e21eec00 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f201c4eab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5e21c4da0 con 0x55f5e219fcc0 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f201c4eab80 10 client.0 _ll_register_callbacks cb 0x55f5e2161e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f2010f8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e224adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f2010f8e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e224adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57370/0 (socket says 172.21.15.84:57370) 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f2010f8e700 1 -- 172.21.15.84:0/1240042696 learned_addr learned my addr 172.21.15.84:0/1240042696 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f200bfff700 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 0x55f5e21e94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.065+0000 7f201178f700 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e21eec00 0x55f5e21e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f2010f8e700 1 -- 172.21.15.84:0/1240042696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 msgr2=0x55f5e21e94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f2010f8e700 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 0x55f5e21e94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f2010f8e700 1 -- 172.21.15.84:0/1240042696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e21eec00 msgr2=0x55f5e21e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f2010f8e700 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e21eec00 0x55f5e21e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f2010f8e700 1 -- 172.21.15.84:0/1240042696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20000145f0 con 0x55f5e219e840 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201178f700 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e21eec00 0x55f5e21e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f2010f8e700 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e224adf0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc003440 tx=0x7f1ffc06f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fb316d9ae9b683 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f1feaffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f1feaffd700 1 -- 172.21.15.84:0/1240042696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc073040 con 0x55f5e219e840 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f1feaffd700 1 -- 172.21.15.84:0/1240042696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1ffc057c00 con 0x55f5e219e840 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201c4eab80 1 -- 172.21.15.84:0/1240042696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ffc05abf0 con 0x55f5e219e840 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f1feaffd700 1 -- 172.21.15.84:0/1240042696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ffc056e90 con 0x55f5e219e840 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201c4eab80 10 client.8745 fetch_fsmap learned FSMap version 106 2023-10-06T03:01:53.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201c4eab80 1 -- 172.21.15.84:0/1240042696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x55f5e20a4470 con 0x55f5e219e840 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f1feaffd700 1 -- 172.21.15.84:0/1240042696 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc05abf0 con 0x55f5e219e840 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f1feaffd700 1 -- 172.21.15.84:0/1240042696 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 106) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f1ffc05e4b0 con 0x55f5e219e840 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201c4eab80 10 client.8745 fetch_fsmap finished waiting for FSMap version 106 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201c4eab80 10 client.8745 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201c4eab80 20 client.8745 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55f5e21eb600 0x55f5e21eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201c4eab80 4 client.8745 mds_command: new command op to 8526 tid=0[{"prefix": "status"}] 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f201c4eab80 1 -- 172.21.15.84:0/1240042696 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f5e2091e00 con 0x55f5e21eb600 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.066+0000 7f200bfff700 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55f5e21eb600 0x55f5e21eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f1feaffd700 10 client.8745 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f200bfff700 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55f5e21eb600 0x55f5e21eb9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8e931648faee29e4 server_cookie=87e8a85357663cf in_seq=0 out_seq=0 2023-10-06T03:01:53.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f1feaffd700 1 -- 172.21.15.84:0/1240042696 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55f5e2091e00 con 0x55f5e21eb600 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f1feaffd700 10 client.8745 handle_command_reply: tid=0 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 client.8745 shutdown 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 -- 172.21.15.84:0/1240042696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 msgr2=0x55f5e224adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e224adf0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc003440 tx=0x7f1ffc06f040 comp rx=0 tx=0).stop 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 -- 172.21.15.84:0/1240042696 shutdown_connections 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55f5e21eb600 0x55f5e21eb9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5e21eec00 0x55f5e21e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f1feaffd700 0 client.8745 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f5e219e840 0x55f5e224adf0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 --2- 172.21.15.84:0/1240042696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f5e219fcc0 0x55f5e21e94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 -- 172.21.15.84:0/1240042696 >> 172.21.15.84:0/1240042696 conn(0x55f5e21a0160 msgr2=0x55f5e21a0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 -- 172.21.15.84:0/1240042696 shutdown_connections 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 1 -- 172.21.15.84:0/1240042696 wait complete. 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.067+0000 7f201c4eab80 20 client.8745 trim_cache size 0 max 16384 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 8526, 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:01:53.077 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:01:53.078 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 2.886786576, 2023-10-06T03:01:53.078 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 106, 2023-10-06T03:01:53.078 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 108, 2023-10-06T03:01:53.078 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 108, 2023-10-06T03:01:53.078 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.416326130000002 2023-10-06T03:01:53.078 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 -- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ff8066f30 msgr2=0x7f1ff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ff8066f30 0x7f1ff80693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f200c158010 tx=0x7f20000091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 -- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b07a0 msgr2=0x7f200c156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b07a0 0x7f200c156a60 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00b610 tx=0x7f1ffc019000 comp rx=0 tx=0).stop 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 -- 172.21.15.84:0/486173827 shutdown_connections 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1ff8066f30 0x7f1ff80693e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f200c1595a0 0x7f200c0cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f200c0b07a0 0x7f200c156a60 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 --2- 172.21.15.84:0/486173827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f200c0b49e0 0x7f200c15e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 -- 172.21.15.84:0/486173827 >> 172.21.15.84:0/486173827 conn(0x7f200c099830 msgr2=0x7f200c0cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 -- 172.21.15.84:0/486173827 shutdown_connections 2023-10-06T03:01:53.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.068+0000 7f20131f2700 1 -- 172.21.15.84:0/486173827 wait complete. 2023-10-06T03:01:53.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:01:53.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.194+0000 7f7f10c0c700 1 Processor -- start 2023-10-06T03:01:53.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.194+0000 7f7f10c0c700 1 -- start start 2023-10-06T03:01:53.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.195+0000 7f7f10c0c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7f0c0b2620 0x7f7f0c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.195+0000 7f7f10c0c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7f0c159870 0x7f7f0c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.195+0000 7f7f10c0c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c0cbfe0 con 0x7f7f0c0b29f0 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.195+0000 7f7f10c0c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c0cb3d0 con 0x7f7f0c0b2620 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.195+0000 7f7f10c0c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c0cb6b0 con 0x7f7f0c159870 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.195+0000 7f7f0a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7f0c0b2620 0x7f7f0c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.195+0000 7f7f01d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7f0c0b29f0 0x7f7f0c159160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53104/0 (socket says 172.21.15.84:53104) 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.195+0000 7f7f01d9b700 1 -- 172.21.15.84:0/3438281218 learned_addr learned my addr 172.21.15.84:0/3438281218 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/3438281218 >> v2:172.21.15.131:3300/0 conn(0x7f7f0c159870 0x7f7f0c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f0a59c700 1 -- 172.21.15.84:0/3438281218 >> v2:172.21.15.131:3300/0 conn(0x7f7f0c159870 msgr2=0x7f7f0c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/3438281218 >> v2:172.21.15.131:3300/0 conn(0x7f7f0c159870 0x7f7f0c0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f0a59c700 1 -- 172.21.15.84:0/3438281218 >> v1:172.21.15.84:6789/0 conn(0x7f7f0c0b29f0 legacy=0x7f7f0c159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f0a59c700 1 -- 172.21.15.84:0/3438281218 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c0cb990 con 0x7f7f0c0b2620 2023-10-06T03:01:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f09d9b700 1 -- 172.21.15.84:0/3438281218 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201407463 0 0) 0x7f7f0c0cbfe0 con 0x7f7f0c0b29f0 2023-10-06T03:01:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/3438281218 >> v2:172.21.15.131:3300/0 conn(0x7f7f0c159870 0x7f7f0c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/3438281218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c0b2620 0x7f7f0c0b06d0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c15d1d0 tx=0x7f7efc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5bf0195274ad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f09d9b700 1 -- 172.21.15.84:0/3438281218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc005c10 con 0x7f7f0c0b2620 2023-10-06T03:01:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f09d9b700 1 -- 172.21.15.84:0/3438281218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc005d70 con 0x7f7f0c0b2620 2023-10-06T03:01:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f09d9b700 1 -- 172.21.15.84:0/3438281218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc006260 con 0x7f7f0c0b2620 2023-10-06T03:01:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f10c0c700 1 -- 172.21.15.84:0/3438281218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c0b2620 msgr2=0x7f7f0c0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f10c0c700 1 --2- 172.21.15.84:0/3438281218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c0b2620 0x7f7f0c0b06d0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c15d1d0 tx=0x7f7efc009120 comp rx=0 tx=0).stop 2023-10-06T03:01:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f10c0c700 1 -- 172.21.15.84:0/3438281218 shutdown_connections 2023-10-06T03:01:53.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f10c0c700 1 --2- 172.21.15.84:0/3438281218 >> v2:172.21.15.131:3300/0 conn(0x7f7f0c159870 0x7f7f0c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f10c0c700 1 --2- 172.21.15.84:0/3438281218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c0b2620 0x7f7f0c0b06d0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f10c0c700 1 -- 172.21.15.84:0/3438281218 >> 172.21.15.84:0/3438281218 conn(0x7f7f0c06ed20 msgr2=0x7f7f0c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f10c0c700 1 -- 172.21.15.84:0/3438281218 shutdown_connections 2023-10-06T03:01:53.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.196+0000 7f7f10c0c700 1 -- 172.21.15.84:0/3438281218 wait complete. 2023-10-06T03:01:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f10c0c700 1 Processor -- start 2023-10-06T03:01:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f10c0c700 1 -- start start 2023-10-06T03:01:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f10c0c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f0c0b2620 0x7f7f0c158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f10c0c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f0c0b29f0 0x7f7f0c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f10c0c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c159870 0x7f7f0c0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f10c0c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c169f70 con 0x7f7f0c159870 2023-10-06T03:01:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f10c0c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c16ad60 con 0x7f7f0c0b2620 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f10c0c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c16a150 con 0x7f7f0c0b29f0 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f0ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c159870 0x7f7f0c0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f0ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c159870 0x7f7f0c0c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57386/0 (socket says 172.21.15.84:57386) 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.198+0000 7f7f0ad9d700 1 -- 172.21.15.84:0/552344201 learned_addr learned my addr 172.21.15.84:0/552344201 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f0c0b2620 0x7f7f0c158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f01d9b700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f0c0b29f0 0x7f7f0c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f0ad9d700 1 -- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f0c0b29f0 msgr2=0x7f7f0c1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f0c0b29f0 0x7f7f0c1536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f0ad9d700 1 -- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f0c0b2620 msgr2=0x7f7f0c158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f0c0b2620 0x7f7f0c158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f0ad9d700 1 -- 172.21.15.84:0/552344201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0093c0 con 0x7f7f0c159870 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f0c0b2620 0x7f7f0c158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f01d9b700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f0c0b29f0 0x7f7f0c1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c159870 0x7f7f0c0c7e20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400cef0 tx=0x7f7f04007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f02ffd700 1 -- 172.21.15.84:0/552344201 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400ae00 con 0x7f7f0c159870 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f02ffd700 1 -- 172.21.15.84:0/552344201 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f04016420 con 0x7f7f0c159870 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f10c0c700 1 -- 172.21.15.84:0/552344201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c16a430 con 0x7f7f0c159870 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f02ffd700 1 -- 172.21.15.84:0/552344201 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f040167e0 con 0x7f7f0c159870 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.199+0000 7f7f10c0c700 1 -- 172.21.15.84:0/552344201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c16a9f0 con 0x7f7f0c159870 2023-10-06T03:01:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.201+0000 7f7f02ffd700 1 -- 172.21.15.84:0/552344201 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f04016bd0 con 0x7f7f0c159870 2023-10-06T03:01:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.201+0000 7f7f02ffd700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7eec066f30 0x7f7eec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.201+0000 7f7f02ffd700 1 -- 172.21.15.84:0/552344201 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7f04012070 con 0x7f7f0c159870 2023-10-06T03:01:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.201+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7eec066f30 0x7f7eec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.202+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7eec066f30 0x7f7eec0693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0030c0 tx=0x7f7efc016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.203+0000 7f7f19f04b80 1 Processor -- start 2023-10-06T03:01:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.203+0000 7f7f19f04b80 1 -- start start 2023-10-06T03:01:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e84840 0x559ea5e84c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e85cc0 0x559ea5ed46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ed5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea5ddba70 con 0x559ea5e84840 2023-10-06T03:01:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea5dd9270 con 0x559ea5e85cc0 2023-10-06T03:01:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ea5dd5060 con 0x559ea5ed4c00 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f0a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e84840 0x559ea5e84c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f0a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e84840 0x559ea5e84c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57396/0 (socket says 172.21.15.84:57396) 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f0a59c700 1 -- 172.21.15.84:0/3431904267 learned_addr learned my addr 172.21.15.84:0/3431904267 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f0a59c700 1 -- 172.21.15.84:0/3431904267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 msgr2=0x559ea5ed5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/3431904267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ed5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f0a59c700 1 -- 172.21.15.84:0/3431904267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e85cc0 msgr2=0x559ea5ed46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/3431904267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e85cc0 0x559ea5ed46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f0a59c700 1 -- 172.21.15.84:0/3431904267 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ea5c6f270 con 0x559ea5e84840 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/3431904267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e84840 0x559ea5e84c10 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00b0e0 tx=0x7f7efc021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53bedd70e0b92d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7eeb7fe700 1 -- 172.21.15.84:0/3431904267 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc021070 con 0x559ea5e84840 2023-10-06T03:01:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7eeb7fe700 1 -- 172.21.15.84:0/3431904267 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc00ba00 con 0x559ea5e84840 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.204+0000 7f7eeb7fe700 1 -- 172.21.15.84:0/3431904267 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00bb70 con 0x559ea5e84840 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.205+0000 7f7f19f04b80 1 -- 172.21.15.84:0/3431904267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e84840 msgr2=0x559ea5e84c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.205+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/3431904267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e84840 0x559ea5e84c10 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00b0e0 tx=0x7f7efc021000 comp rx=0 tx=0).stop 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.205+0000 7f7f19f04b80 1 -- 172.21.15.84:0/3431904267 shutdown_connections 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.205+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/3431904267 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ed5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.205+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/3431904267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e84840 0x559ea5e84c10 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.205+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/3431904267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e85cc0 0x559ea5ed46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.205+0000 7f7f19f04b80 1 -- 172.21.15.84:0/3431904267 >> 172.21.15.84:0/3431904267 conn(0x559ea5e86160 msgr2=0x559ea5e86530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.205+0000 7f7f19f04b80 1 -- 172.21.15.84:0/3431904267 shutdown_connections 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.205+0000 7f7f19f04b80 1 -- 172.21.15.84:0/3431904267 wait complete. 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.206+0000 7f7f19f04b80 1 -- start start 2023-10-06T03:01:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.206+0000 7f7f19f04b80 1 Processor -- start 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.206+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5ecbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5ec8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ec2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea5d80890 con 0x559ea5e85cc0 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea5d9bea0 con 0x559ea5e84840 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ea5c57e30 con 0x559ea5ed4c00 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f19f04b80 10 client.0 _ll_register_callbacks cb 0x559ea5e47e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f01d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5ec8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f01d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5ec8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57406/0 (socket says 172.21.15.84:57406) 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f01d9b700 1 -- 172.21.15.84:0/830266678 learned_addr learned my addr 172.21.15.84:0/830266678 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5ecbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ec2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f01d9b700 1 -- 172.21.15.84:0/830266678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 msgr2=0x559ea5ec2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f01d9b700 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ec2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f01d9b700 1 -- 172.21.15.84:0/830266678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 msgr2=0x559ea5ecbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f01d9b700 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5ecbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f01d9b700 1 -- 172.21.15.84:0/830266678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c0cb990 con 0x559ea5e85cc0 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ec2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f01d9b700 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5ec8280 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0c9b80 tx=0x7f7ef4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdb4aefacbd3e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7ee8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/830266678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400b070 con 0x559ea5e85cc0 2023-10-06T03:01:53.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/830266678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7ef40058a0 con 0x559ea5e85cc0 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f19f04b80 1 -- 172.21.15.84:0/830266678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ea5e79940 con 0x559ea5e85cc0 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/830266678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ef4005cb0 con 0x559ea5e85cc0 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f19f04b80 10 client.8760 fetch_fsmap learned FSMap version 106 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7f19f04b80 1 -- 172.21.15.84:0/830266678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x559ea5c11fe0 con 0x559ea5e85cc0 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.207+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/830266678 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ea5e79940 con 0x559ea5e85cc0 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/830266678 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 106) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f7ef40070d0 con 0x559ea5e85cc0 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7f19f04b80 10 client.8760 fetch_fsmap finished waiting for FSMap version 106 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7f19f04b80 10 client.8760 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7f19f04b80 20 client.8760 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559ea5ec54b0 0x559ea5ec5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7f19f04b80 4 client.8760 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7f19f04b80 1 -- 172.21.15.84:0/830266678 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ea5e56870 con 0x559ea5ec54b0 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559ea5ec54b0 0x559ea5ec5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7ee8ff9700 10 client.8760 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.208+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559ea5ec54b0 0x559ea5ec5880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5891f1ee493477c server_cookie=b3a0f175c817f38e in_seq=0 out_seq=0 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/830266678 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559ea5e56870 con 0x559ea5ec54b0 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7ee8ff9700 10 client.8760 handle_command_reply: tid=0 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 client.8760 shutdown 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 -- 172.21.15.84:0/830266678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 msgr2=0x559ea5ec8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5ec8280 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0c9b80 tx=0x7f7ef4009040 comp rx=0 tx=0).stop 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 -- 172.21.15.84:0/830266678 shutdown_connections 2023-10-06T03:01:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559ea5ec54b0 0x559ea5ec5880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5ecbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7ee8ff9700 0 client.8760 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:01:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ec2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/830266678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5ec8280 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 -- 172.21.15.84:0/830266678 >> 172.21.15.84:0/830266678 conn(0x559ea5e86160 msgr2=0x559ea5eada00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 -- 172.21.15.84:0/830266678 shutdown_connections 2023-10-06T03:01:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 1 -- 172.21.15.84:0/830266678 wait complete. 2023-10-06T03:01:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.209+0000 7f7f19f04b80 20 client.8760 trim_cache size 0 max 16384 2023-10-06T03:01:53.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.226+0000 7f7f19f04b80 1 Processor -- start 2023-10-06T03:01:53.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.226+0000 7f7f19f04b80 1 -- start start 2023-10-06T03:01:53.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5e80f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5e85cc0 0x559ea5eadbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5ed4c00 0x559ea5ee42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea5ed4360 con 0x559ea5ed4c00 2023-10-06T03:01:53.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea5e86860 con 0x559ea5e84840 2023-10-06T03:01:53.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ea5ec7dd0 con 0x559ea5e85cc0 2023-10-06T03:01:53.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5ed4c00 0x559ea5ee42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0ad9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5ed4c00 0x559ea5ee42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57414/0 (socket says 172.21.15.84:57414) 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0ad9d700 1 -- 172.21.15.84:0/2109654838 learned_addr learned my addr 172.21.15.84:0/2109654838 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f01d9b700 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5e85cc0 0x559ea5eadbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5e80f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0ad9d700 1 -- 172.21.15.84:0/2109654838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5e85cc0 msgr2=0x559ea5eadbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5e85cc0 0x559ea5eadbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0ad9d700 1 -- 172.21.15.84:0/2109654838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 msgr2=0x559ea5e80f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5e80f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0ad9d700 1 -- 172.21.15.84:0/2109654838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ea5da3780 con 0x559ea5ed4c00 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5e80f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5ed4c00 0x559ea5ee42c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f7f04007630 tx=0x7f7f04083350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e285954c5606c675 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7eebfff700 1 -- 172.21.15.84:0/2109654838 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04055e60 con 0x559ea5ed4c00 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7eebfff700 1 -- 172.21.15.84:0/2109654838 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f04059050 con 0x559ea5ed4c00 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.227+0000 7f7eebfff700 1 -- 172.21.15.84:0/2109654838 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0405cda0 con 0x559ea5ed4c00 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 -- 172.21.15.84:0/2109654838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5ed4c00 msgr2=0x559ea5ee42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5ed4c00 0x559ea5ee42c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f7f04007630 tx=0x7f7f04083350 comp rx=0 tx=0).stop 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 -- 172.21.15.84:0/2109654838 shutdown_connections 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5e80f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5ed4c00 0x559ea5ee42c0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/2109654838 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5e85cc0 0x559ea5eadbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 -- 172.21.15.84:0/2109654838 >> 172.21.15.84:0/2109654838 conn(0x559ea5e86160 msgr2=0x559ea5ecdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 -- 172.21.15.84:0/2109654838 shutdown_connections 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 -- 172.21.15.84:0/2109654838 wait complete. 2023-10-06T03:01:53.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 -- start start 2023-10-06T03:01:53.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.228+0000 7f7f19f04b80 1 Processor -- start 2023-10-06T03:01:53.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5f2e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5f2ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f19f04b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ec1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea5e803f0 con 0x559ea5e85cc0 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ea5ec6610 con 0x559ea5e84840 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f19f04b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ea5ec68f0 con 0x559ea5ed4c00 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f19f04b80 10 client.0 _ll_register_callbacks cb 0x559ea5e47e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f01d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5f2ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f01d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5f2ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57428/0 (socket says 172.21.15.84:57428) 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f01d9b700 1 -- 172.21.15.84:0/67103301 learned_addr learned my addr 172.21.15.84:0/67103301 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5f2e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.229+0000 7f7f0ad9d700 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ec1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f01d9b700 1 -- 172.21.15.84:0/67103301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 msgr2=0x559ea5ec1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f01d9b700 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ec1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f01d9b700 1 -- 172.21.15.84:0/67103301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 msgr2=0x559ea5f2e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f01d9b700 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5f2e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f01d9b700 1 -- 172.21.15.84:0/67103301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c16a9f0 con 0x559ea5e85cc0 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f01d9b700 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5f2ed40 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0c9b80 tx=0x7f7ef4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc52a1315894506 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7ee8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/67103301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400d9c0 con 0x559ea5e85cc0 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/67103301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7ef4000e40 con 0x559ea5e85cc0 2023-10-06T03:01:53.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f19f04b80 1 -- 172.21.15.84:0/67103301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7efc00ba00 con 0x559ea5e85cc0 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/67103301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ef40058a0 con 0x559ea5e85cc0 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f19f04b80 10 client.8766 fetch_fsmap learned FSMap version 106 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f19f04b80 1 -- 172.21.15.84:0/67103301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x559ea5d8a470 con 0x559ea5e85cc0 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/67103301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc00ba00 con 0x559ea5e85cc0 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/67103301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 106) v1 ==== 3124+0+0 (secure 0 0 0) 0x7f7ef40070d0 con 0x559ea5e85cc0 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f19f04b80 10 client.8766 fetch_fsmap finished waiting for FSMap version 106 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f19f04b80 10 client.8766 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f19f04b80 20 client.8766 populate_metadata read hostname 'smithi084' 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559ea5f31cd0 0x559ea5f320a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f19f04b80 4 client.8766 mds_command: new command op to 8529 tid=0[{"prefix": "status"}] 2023-10-06T03:01:53.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.230+0000 7f7f19f04b80 1 -- 172.21.15.84:0/67103301 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559ea5d77e00 con 0x559ea5f31cd0 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559ea5f31cd0 0x559ea5f320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7ee8ff9700 10 client.8766 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f0a59c700 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559ea5f31cd0 0x559ea5f320a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=156207a4d83ffc48 server_cookie=8b9b202c3c502b76 in_seq=0 out_seq=0 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7ee8ff9700 1 -- 172.21.15.84:0/67103301 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x559ea5d77e00 con 0x559ea5f31cd0 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7ee8ff9700 10 client.8766 handle_command_reply: tid=0 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 client.8766 shutdown 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 -- 172.21.15.84:0/67103301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 msgr2=0x559ea5f2ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5f2ed40 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0c9b80 tx=0x7f7ef4016000 comp rx=0 tx=0).stop 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 -- 172.21.15.84:0/67103301 shutdown_connections 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559ea5f31cd0 0x559ea5f320a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ea5e84840 0x559ea5f2e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7ee8ff9700 0 client.8766 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559ea5ed4c00 0x559ea5ec1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 --2- 172.21.15.84:0/67103301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ea5e85cc0 0x559ea5f2ed40 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 -- 172.21.15.84:0/67103301 >> 172.21.15.84:0/67103301 conn(0x559ea5e86160 msgr2=0x559ea5e851b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 -- 172.21.15.84:0/67103301 shutdown_connections 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 1 -- 172.21.15.84:0/67103301 wait complete. 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.231+0000 7f7f19f04b80 20 client.8766 trim_cache size 0 max 16384 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "3949ddc0-2086-4c8d-802f-a1ccf3555047", 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-10-06T03:01:53.241 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 8529, 2023-10-06T03:01:53.242 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-10-06T03:01:53.242 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-10-06T03:01:53.242 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-10-06T03:01:53.242 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 10.453565097, 2023-10-06T03:01:53.242 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 106, 2023-10-06T03:01:53.242 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 108, 2023-10-06T03:01:53.242 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 108, 2023-10-06T03:01:53.242 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 16.580170033999998 2023-10-06T03:01:53.242 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:01:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 -- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7eec066f30 msgr2=0x7f7eec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7eec066f30 0x7f7eec0693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0030c0 tx=0x7f7efc016000 comp rx=0 tx=0).stop 2023-10-06T03:01:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 -- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c159870 msgr2=0x7f7f0c0c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c159870 0x7f7f0c0c7e20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400cef0 tx=0x7f7f04007860 comp rx=0 tx=0).stop 2023-10-06T03:01:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 -- 172.21.15.84:0/552344201 shutdown_connections 2023-10-06T03:01:53.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7eec066f30 0x7f7eec0693e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f0c0b2620 0x7f7f0c158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c159870 0x7f7f0c0c7e20 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 --2- 172.21.15.84:0/552344201 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f0c0b29f0 0x7f7f0c1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 -- 172.21.15.84:0/552344201 >> 172.21.15.84:0/552344201 conn(0x7f7f0c06ed20 msgr2=0x7f7f0c0affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 -- 172.21.15.84:0/552344201 shutdown_connections 2023-10-06T03:01:53.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.232+0000 7f7f10c0c700 1 -- 172.21.15.84:0/552344201 wait complete. 2023-10-06T03:01:53.245 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.358+0000 7f15399f4700 1 Processor -- start 2023-10-06T03:01:53.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.358+0000 7f15399f4700 1 -- start start 2023-10-06T03:01:53.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15399f4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f15340cbc70 0x7f15340cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15399f4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15340cb7e0 con 0x7f15340b2140 2023-10-06T03:01:53.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15399f4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15340b08a0 con 0x7f1534159480 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15399f4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15340cb190 con 0x7f15340cbc70 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15391f3700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f15340b2140 0x7f15340b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53108/0 (socket says 172.21.15.84:53108) 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15391f3700 1 -- 172.21.15.84:0/594939135 learned_addr learned my addr 172.21.15.84:0/594939135 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f1533fff700 1 --2- 172.21.15.84:0/594939135 >> v2:172.21.15.131:3300/0 conn(0x7f15340cbc70 0x7f15340cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763851766 0 0) 0x7f15340cb7e0 con 0x7f15340b2140 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1524003570 con 0x7f15340b2140 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4033536986 0 0) 0x7f1524003570 con 0x7f15340b2140 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 >> v2:172.21.15.131:3300/0 conn(0x7f15340cbc70 msgr2=0x7f15340cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15337fe700 1 --2- 172.21.15.84:0/594939135 >> v2:172.21.15.131:3300/0 conn(0x7f15340cbc70 0x7f15340cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 >> v1:172.21.15.131:6789/0 conn(0x7f1534159480 legacy=0x7f15340b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15340cb470 con 0x7f15340b2140 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.359+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f152c0017f0 con 0x7f15340b2140 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 >> v1:172.21.15.84:6789/0 conn(0x7f15340b2140 legacy=0x7f15340b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1524003a60 0x7f1524003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1524004810 0x7f1524004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15240051c0 0x7f152400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15340cb190 con 0x7f15240051c0 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152400c050 con 0x7f1524003a60 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152400c210 con 0x7f1524004810 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15391f3700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15240051c0 0x7f152400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15389f2700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1524003a60 0x7f1524003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f1533fff700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1524004810 0x7f1524004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15391f3700 1 -- 172.21.15.84:0/594939135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1524004810 msgr2=0x7f1524004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15391f3700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1524004810 0x7f1524004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15391f3700 1 -- 172.21.15.84:0/594939135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1524003a60 msgr2=0x7f1524003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15391f3700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1524003a60 0x7f1524003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15391f3700 1 -- 172.21.15.84:0/594939135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524003570 con 0x7f15240051c0 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15391f3700 1 -- 172.21.15.84:0/594939135 reap_dead start 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15391f3700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15240051c0 0x7f152400ba60 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f152c00a8d0 tx=0x7f152c002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e619a9aba54629f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c0070d0 con 0x7f15240051c0 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c007270 con 0x7f15240051c0 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.360+0000 7f15337fe700 1 -- 172.21.15.84:0/594939135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c007630 con 0x7f15240051c0 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.361+0000 7f15399f4700 1 -- 172.21.15.84:0/594939135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15240051c0 msgr2=0x7f152400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.361+0000 7f15399f4700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15240051c0 0x7f152400ba60 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f152c00a8d0 tx=0x7f152c002170 comp rx=0 tx=0).stop 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.361+0000 7f15399f4700 1 -- 172.21.15.84:0/594939135 shutdown_connections 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.361+0000 7f15399f4700 1 --2- 172.21.15.84:0/594939135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15240051c0 0x7f152400ba60 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.361+0000 7f15399f4700 1 -- 172.21.15.84:0/594939135 >> 172.21.15.84:0/594939135 conn(0x7f153406ed20 msgr2=0x7f153406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.361+0000 7f15399f4700 1 -- 172.21.15.84:0/594939135 shutdown_connections 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.361+0000 7f15399f4700 1 -- 172.21.15.84:0/594939135 wait complete. 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.362+0000 7f15399f4700 1 Processor -- start 2023-10-06T03:01:53.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.362+0000 7f15399f4700 1 -- start start 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15399f4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15240051c0 0x7f1534155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15399f4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15340d0bf0 0x7f153415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15399f4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340ce040 0x7f153415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15399f4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15340c4c40 con 0x7f15340ce040 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15399f4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15340c4ee0 con 0x7f15340d0bf0 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15399f4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153415cb40 con 0x7f15240051c0 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15391f3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340ce040 0x7f153415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15391f3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340ce040 0x7f153415c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57436/0 (socket says 172.21.15.84:57436) 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15391f3700 1 -- 172.21.15.84:0/2597671085 learned_addr learned my addr 172.21.15.84:0/2597671085 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15389f2700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15240051c0 0x7f1534155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f1533fff700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15340d0bf0 0x7f153415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15391f3700 1 -- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15240051c0 msgr2=0x7f1534155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15391f3700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15240051c0 0x7f1534155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15391f3700 1 -- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15340d0bf0 msgr2=0x7f153415bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15391f3700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15340d0bf0 0x7f153415bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15391f3700 1 -- 172.21.15.84:0/2597671085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15340cfb10 con 0x7f15340ce040 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15389f2700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15240051c0 0x7f1534155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f1533fff700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15340d0bf0 0x7f153415bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.363+0000 7f15391f3700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340ce040 0x7f153415c210 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f15340b6070 tx=0x7f152c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.364+0000 7f1530ff9700 1 -- 172.21.15.84:0/2597671085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c01d420 con 0x7f15340ce040 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.364+0000 7f1530ff9700 1 -- 172.21.15.84:0/2597671085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c01d5a0 con 0x7f15340ce040 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.364+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15340cef90 con 0x7f15340ce040 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.364+0000 7f1530ff9700 1 -- 172.21.15.84:0/2597671085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c01d960 con 0x7f15340ce040 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.364+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15340cf550 con 0x7f15340ce040 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.364+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153405f270 con 0x7f15340ce040 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.365+0000 7f1530ff9700 1 -- 172.21.15.84:0/2597671085 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f152c01dcd0 con 0x7f15340ce040 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.365+0000 7f1530ff9700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1518066f30 0x7f15180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.365+0000 7f1530ff9700 1 -- 172.21.15.84:0/2597671085 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f152c086af0 con 0x7f15340ce040 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.365+0000 7f15389f2700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1518066f30 0x7f15180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.366+0000 7f15389f2700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1518066f30 0x7f15180693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1528003c10 tx=0x7f1528009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.370+0000 7f1530ff9700 1 -- 172.21.15.84:0/2597671085 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f152c053be0 con 0x7f15340ce040 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.599+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1534159850 con 0x7f15340ce040 2023-10-06T03:01:53.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.599+0000 7f1530ff9700 1 -- 172.21.15.84:0/2597671085 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4634 (secure 0 0 0) 0x7f152c057200 con 0x7f15340ce040 2023-10-06T03:01:53.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:01:53.601 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":106,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:01:52.185686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:01:53.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1518066f30 msgr2=0x7f15180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1518066f30 0x7f15180693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1528003c10 tx=0x7f1528009040 comp rx=0 tx=0).stop 2023-10-06T03:01:53.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340ce040 msgr2=0x7f153415c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340ce040 0x7f153415c210 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f15340b6070 tx=0x7f152c016000 comp rx=0 tx=0).stop 2023-10-06T03:01:53.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 shutdown_connections 2023-10-06T03:01:53.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1518066f30 0x7f15180693e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340ce040 0x7f153415c210 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f15240051c0 0x7f1534155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 --2- 172.21.15.84:0/2597671085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15340d0bf0 0x7f153415bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 >> 172.21.15.84:0/2597671085 conn(0x7f153406ed20 msgr2=0x7f15340b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 shutdown_connections 2023-10-06T03:01:53.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:01:53.602+0000 7f15399f4700 1 -- 172.21.15.84:0/2597671085 wait complete. 2023-10-06T03:01:53.605 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 106 2023-10-06T03:01:53.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:53.615 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T03:01:53.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:53.638 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-10-06T03:01:53.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:53.697 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-10-06T03:01:53.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:53.752 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-10-06T03:01:53.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:53.807 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-10-06T03:01:53.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:01:54.032 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:01:54.032 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:01:54.033 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:01:56.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:01:56.175 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:01:56.175 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:01:56.176 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:01:58.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:01:58.320 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:01:58.320 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:01:58.320 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:02:00.321 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:02:00.666 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-10-06T03:02:00.727 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:02:00.728 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:02:02.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-10-06T03:02:02.934 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-10-06T03:02:02.935 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T03:02:02.936 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-10-06T03:02:02.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T03:02:03.065 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T03:02:03.065 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:02:03.065 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:02:05.071 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T03:02:05.221 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T03:02:05.221 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:02:05.222 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:02:07.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:07.101 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:07.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-10-06T03:02:07.360 INFO:teuthology.orchestra.run.smithi084.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-10-06T03:02:07.361 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-10-06T03:02:07.361 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:02:07.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-10-06T03:02:07.499 INFO:teuthology.orchestra.run.smithi131.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-10-06T03:02:07.499 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-10-06T03:02:07.499 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-10-06T03:02:07.500 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 flush journal 2023-10-06T03:02:07.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.615+0000 7f5efb137700 1 Processor -- start 2023-10-06T03:02:07.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.615+0000 7f5efb137700 1 -- start start 2023-10-06T03:02:07.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5efb137700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef406a120 0x7f5ef40675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5efb137700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ef415a6f0 0x7f5ef4067b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5efb137700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef415a260 con 0x7f5ef4159320 2023-10-06T03:02:07.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5efb137700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef406ace0 con 0x7f5ef415a6f0 2023-10-06T03:02:07.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5efb137700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef4159c10 con 0x7f5ef406a120 2023-10-06T03:02:07.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5efa936700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ef415a6f0 0x7f5ef4067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5ef9934700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef406a120 0x7f5ef40675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5efa135700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f5ef4159320 0x7f5ef4069a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:49132/0 (socket says 172.21.15.84:49132) 2023-10-06T03:02:07.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5efa135700 1 -- 172.21.15.84:0/3140249105 learned_addr learned my addr 172.21.15.84:0/3140249105 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:07.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5ef9934700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef406a120 0x7f5ef40675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:48076/0 (socket says 172.21.15.84:48076) 2023-10-06T03:02:07.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.616+0000 7f5efa936700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5ef415a6f0 0x7f5ef4067b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:60496/0 (socket says 172.21.15.84:60496) 2023-10-06T03:02:07.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5efa936700 1 -- 172.21.15.84:0/3140249105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef406a120 msgr2=0x7f5ef40675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5efa936700 1 --2- 172.21.15.84:0/3140249105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef406a120 0x7f5ef40675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5efa936700 1 -- 172.21.15.84:0/3140249105 >> v1:172.21.15.131:6789/0 conn(0x7f5ef4159320 legacy=0x7f5ef4069a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5efa936700 1 -- 172.21.15.84:0/3140249105 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4159ef0 con 0x7f5ef415a6f0 2023-10-06T03:02:07.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5ef9133700 1 -- 172.21.15.84:0/3140249105 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818507719 0 0) 0x7f5ef415a260 con 0x7f5ef4159320 2023-10-06T03:02:07.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5ef9934700 1 --2- 172.21.15.84:0/3140249105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef406a120 0x7f5ef40675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:07.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5efa936700 1 --2- 172.21.15.84:0/3140249105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef415a6f0 0x7f5ef4067b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0098e0 tx=0x7f5eec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=139983d838d83bd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5ef9133700 1 -- 172.21.15.84:0/3140249105 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00b640 con 0x7f5ef415a6f0 2023-10-06T03:02:07.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5ef9133700 1 -- 172.21.15.84:0/3140249105 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec00b7a0 con 0x7f5ef415a6f0 2023-10-06T03:02:07.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5ef9133700 1 -- 172.21.15.84:0/3140249105 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00bb40 con 0x7f5ef415a6f0 2023-10-06T03:02:07.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5efb137700 1 -- 172.21.15.84:0/3140249105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef415a6f0 msgr2=0x7f5ef4067b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.617+0000 7f5efb137700 1 --2- 172.21.15.84:0/3140249105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef415a6f0 0x7f5ef4067b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0098e0 tx=0x7f5eec0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.618+0000 7f5efb137700 1 -- 172.21.15.84:0/3140249105 shutdown_connections 2023-10-06T03:02:07.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.618+0000 7f5efb137700 1 --2- 172.21.15.84:0/3140249105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef415a6f0 0x7f5ef4067b30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.618+0000 7f5efb137700 1 --2- 172.21.15.84:0/3140249105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef406a120 0x7f5ef40675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.618+0000 7f5efb137700 1 -- 172.21.15.84:0/3140249105 >> 172.21.15.84:0/3140249105 conn(0x7f5ef40cd220 msgr2=0x7f5ef40c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.618+0000 7f5efb137700 1 -- 172.21.15.84:0/3140249105 shutdown_connections 2023-10-06T03:02:07.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.618+0000 7f5efb137700 1 -- 172.21.15.84:0/3140249105 wait complete. 2023-10-06T03:02:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5efb137700 1 Processor -- start 2023-10-06T03:02:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5efb137700 1 -- start start 2023-10-06T03:02:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5efb137700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef406a120 0x7f5ef40c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5efb137700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ef4159320 0x7f5ef40c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5efb137700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef415a6f0 0x7f5ef40c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5efb137700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef415baf0 con 0x7f5ef4159320 2023-10-06T03:02:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5efb137700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef4169e50 con 0x7f5ef406a120 2023-10-06T03:02:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5efb137700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef415bd40 con 0x7f5ef415a6f0 2023-10-06T03:02:07.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5ef9934700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ef4159320 0x7f5ef40c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5ef9934700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ef4159320 0x7f5ef40c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47400/0 (socket says 172.21.15.84:47400) 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.619+0000 7f5ef9934700 1 -- 172.21.15.84:0/840422971 learned_addr learned my addr 172.21.15.84:0/840422971 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efa936700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef415a6f0 0x7f5ef40c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efa135700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef406a120 0x7f5ef40c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efa936700 1 -- 172.21.15.84:0/840422971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef406a120 msgr2=0x7f5ef40c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efa936700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef406a120 0x7f5ef40c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efa936700 1 -- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ef4159320 msgr2=0x7f5ef40c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efa936700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ef4159320 0x7f5ef40c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efa936700 1 -- 172.21.15.84:0/840422971 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009420 con 0x7f5ef415a6f0 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5ef9934700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ef4159320 0x7f5ef40c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:07.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efa936700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef415a6f0 0x7f5ef40c8470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5eec016000 tx=0x7f5eec017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5ef27fc700 1 -- 172.21.15.84:0/840422971 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00bb20 con 0x7f5ef415a6f0 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5ef27fc700 1 -- 172.21.15.84:0/840422971 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec011420 con 0x7f5ef415a6f0 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efb137700 1 -- 172.21.15.84:0/840422971 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eec009420 con 0x7f5ef415a6f0 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5ef27fc700 1 -- 172.21.15.84:0/840422971 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0117c0 con 0x7f5ef415a6f0 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.620+0000 7f5efb137700 1 -- 172.21.15.84:0/840422971 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef415c300 con 0x7f5ef415a6f0 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.622+0000 7f5ef27fc700 1 -- 172.21.15.84:0/840422971 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5eec011b30 con 0x7f5ef415a6f0 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.622+0000 7f5ef27fc700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ee0066f30 0x7f5ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.622+0000 7f5ef27fc700 1 -- 172.21.15.84:0/840422971 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f5eec086350 con 0x7f5ef415a6f0 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.622+0000 7f5efa135700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ee0066f30 0x7f5ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.622+0000 7f5efa135700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ee0066f30 0x7f5ee00693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4002250 tx=0x7f5ee4001a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.624+0000 7f5f05691b80 1 Processor -- start 2023-10-06T03:02:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.624+0000 7f5f05691b80 1 -- start start 2023-10-06T03:02:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.624+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764515d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.624+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 0x55a764516250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.624+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 0x55a764516790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.624+0000 7f5f05691b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a764470ac0 con 0x55a76453aea0 2023-10-06T03:02:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.624+0000 7f5f05691b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76446e2c0 con 0x55a76451ca60 2023-10-06T03:02:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5f05691b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a76446a0b0 con 0x55a76451b310 2023-10-06T03:02:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa135700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764515d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa135700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764515d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47412/0 (socket says 172.21.15.84:47412) 2023-10-06T03:02:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa135700 1 -- 172.21.15.84:0/3022237059 learned_addr learned my addr 172.21.15.84:0/3022237059 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5ef9934700 1 --2- 172.21.15.84:0/3022237059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 0x55a764516250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa936700 1 --2- 172.21.15.84:0/3022237059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 0x55a764516790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa135700 1 -- 172.21.15.84:0/3022237059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 msgr2=0x55a764516250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa135700 1 --2- 172.21.15.84:0/3022237059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 0x55a764516250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa135700 1 -- 172.21.15.84:0/3022237059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 msgr2=0x55a764516790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa135700 1 --2- 172.21.15.84:0/3022237059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 0x55a764516790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa135700 1 -- 172.21.15.84:0/3022237059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7643042c0 con 0x55a76453aea0 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5efa135700 1 --2- 172.21.15.84:0/3022237059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764515d10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4014840 tx=0x7f5ee4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37389159e8bbcdf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5edb7fe700 1 -- 172.21.15.84:0/3022237059 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4020410 con 0x55a76453aea0 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5edb7fe700 1 -- 172.21.15.84:0/3022237059 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4020570 con 0x55a76453aea0 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.625+0000 7f5edb7fe700 1 -- 172.21.15.84:0/3022237059 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4020910 con 0x55a76453aea0 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 -- 172.21.15.84:0/3022237059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 msgr2=0x55a764515d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3022237059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764515d10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4014840 tx=0x7f5ee4015000 comp rx=0 tx=0).stop 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 -- 172.21.15.84:0/3022237059 shutdown_connections 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3022237059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 0x55a764516790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3022237059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764515d10 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3022237059 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 0x55a764516250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 -- 172.21.15.84:0/3022237059 >> 172.21.15.84:0/3022237059 conn(0x55a76451aed0 msgr2=0x55a76451b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 -- 172.21.15.84:0/3022237059 shutdown_connections 2023-10-06T03:02:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 -- 172.21.15.84:0/3022237059 wait complete. 2023-10-06T03:02:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.626+0000 7f5f05691b80 1 -- start start 2023-10-06T03:02:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.627+0000 7f5f05691b80 1 Processor -- start 2023-10-06T03:02:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.627+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 0x55a76456fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.627+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 0x55a7645641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.627+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a7645646f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.627+0000 7f5f05691b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7644158e0 con 0x55a76453aea0 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.627+0000 7f5f05691b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a764430ef0 con 0x55a76451b310 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.627+0000 7f5f05691b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7642ece80 con 0x55a76451ca60 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.627+0000 7f5f05691b80 10 client.0 _ll_register_callbacks cb 0x55a7644dd070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa936700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a7645646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa936700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a7645646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47414/0 (socket says 172.21.15.84:47414) 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa936700 1 -- 172.21.15.84:0/437728632 learned_addr learned my addr 172.21.15.84:0/437728632 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa135700 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 0x55a76456fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5ef9934700 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 0x55a7645641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa936700 1 -- 172.21.15.84:0/437728632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 msgr2=0x55a7645641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa936700 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 0x55a7645641b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa936700 1 -- 172.21.15.84:0/437728632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 msgr2=0x55a76456fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa936700 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 0x55a76456fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa936700 1 -- 172.21.15.84:0/437728632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee4014450 con 0x55a76453aea0 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5efa936700 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a7645646f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5eec056c00 tx=0x7f5eec086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50df77fbbb37608 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5ed8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/437728632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec05a150 con 0x55a76453aea0 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/437728632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f5eec05dea0 con 0x55a76453aea0 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5f05691b80 1 -- 172.21.15.84:0/437728632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a76450e990 con 0x55a76453aea0 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/437728632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eec00fdc0 con 0x55a76453aea0 2023-10-06T03:02:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5f05691b80 10 client.8781 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5f05691b80 1 -- 172.21.15.84:0/437728632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55a7642a7030 con 0x55a76453aea0 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/437728632 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a76450e990 con 0x55a76453aea0 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.628+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/437728632 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f5eec05c0f0 con 0x55a76453aea0 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5f05691b80 10 client.8781 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5f05691b80 10 client.8781 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5f05691b80 20 client.8781 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5f05691b80 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55a76453b6d0 0x55a764538f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5f05691b80 4 client.8781 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5f05691b80 1 -- 172.21.15.84:0/437728632 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7644eb8c0 con 0x55a76453b6d0 2023-10-06T03:02:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5efa135700 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55a76453b6d0 0x55a764538f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5ed8ff9700 10 client.8781 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5efa135700 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55a76453b6d0 0x55a764538f80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=783261ea06accf2d server_cookie=b8f5eb4b4e80b2f in_seq=0 out_seq=0 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/437728632 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a7644eb8c0 con 0x55a76453b6d0 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5ed8ff9700 10 client.8781 handle_command_reply: tid=0 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.629+0000 7f5f05691b80 1 client.8781 shutdown 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 -- 172.21.15.84:0/437728632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 msgr2=0x55a7645646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a7645646f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5eec056c00 tx=0x7f5eec086040 comp rx=0 tx=0).stop 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 -- 172.21.15.84:0/437728632 shutdown_connections 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55a76453b6d0 0x55a764538f80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 0x55a76456fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5ed8ff9700 0 client.8781 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:07.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a7645646f0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 --2- 172.21.15.84:0/437728632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 0x55a7645641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 -- 172.21.15.84:0/437728632 >> 172.21.15.84:0/437728632 conn(0x55a76451aed0 msgr2=0x55a76451bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 -- 172.21.15.84:0/437728632 shutdown_connections 2023-10-06T03:02:07.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 1 -- 172.21.15.84:0/437728632 wait complete. 2023-10-06T03:02:07.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.630+0000 7f5f05691b80 20 client.8781 trim_cache size 0 max 16384 2023-10-06T03:02:07.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5f05691b80 1 Processor -- start 2023-10-06T03:02:07.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5f05691b80 1 -- start start 2023-10-06T03:02:07.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 0x55a7645379a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 0x55a76453a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764516d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5f05691b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76450e7f0 con 0x55a76453aea0 2023-10-06T03:02:07.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5f05691b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76453c560 con 0x55a76451ca60 2023-10-06T03:02:07.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5f05691b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7645615a0 con 0x55a76451b310 2023-10-06T03:02:07.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5efa936700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764516d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5efa936700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764516d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47428/0 (socket says 172.21.15.84:47428) 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.644+0000 7f5efa936700 1 -- 172.21.15.84:0/868534300 learned_addr learned my addr 172.21.15.84:0/868534300 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5efa135700 1 --2- 172.21.15.84:0/868534300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 0x55a7645379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5ef9934700 1 --2- 172.21.15.84:0/868534300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 0x55a76453a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5efa936700 1 -- 172.21.15.84:0/868534300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 msgr2=0x55a7645379a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5efa936700 1 --2- 172.21.15.84:0/868534300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 0x55a7645379a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5efa936700 1 -- 172.21.15.84:0/868534300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 msgr2=0x55a76453a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5efa936700 1 --2- 172.21.15.84:0/868534300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 0x55a76453a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5efa936700 1 -- 172.21.15.84:0/868534300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a76453b540 con 0x55a76453aea0 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5efa936700 1 --2- 172.21.15.84:0/868534300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764516d50 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5eec01bf60 tx=0x7f5eec030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7518da8392a8d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5edbfff700 1 -- 172.21.15.84:0/868534300 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0842a0 con 0x55a76453aea0 2023-10-06T03:02:07.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5edbfff700 1 -- 172.21.15.84:0/868534300 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec05ae90 con 0x55a76453aea0 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5edbfff700 1 -- 172.21.15.84:0/868534300 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec05dea0 con 0x55a76453aea0 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5f05691b80 1 -- 172.21.15.84:0/868534300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 msgr2=0x55a764516d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5f05691b80 1 --2- 172.21.15.84:0/868534300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764516d50 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5eec01bf60 tx=0x7f5eec030000 comp rx=0 tx=0).stop 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5f05691b80 1 -- 172.21.15.84:0/868534300 shutdown_connections 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5f05691b80 1 --2- 172.21.15.84:0/868534300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764516d50 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5f05691b80 1 --2- 172.21.15.84:0/868534300 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451b310 0x55a7645379a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5f05691b80 1 --2- 172.21.15.84:0/868534300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451ca60 0x55a76453a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5f05691b80 1 -- 172.21.15.84:0/868534300 >> 172.21.15.84:0/868534300 conn(0x55a76451aed0 msgr2=0x55a764537f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5f05691b80 1 -- 172.21.15.84:0/868534300 shutdown_connections 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.645+0000 7f5f05691b80 1 -- 172.21.15.84:0/868534300 wait complete. 2023-10-06T03:02:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.646+0000 7f5f05691b80 1 -- start start 2023-10-06T03:02:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.646+0000 7f5f05691b80 1 Processor -- start 2023-10-06T03:02:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 0x55a764515b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 0x55a764545be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5f05691b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764546120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5f05691b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7645c68e0 con 0x55a76453aea0 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5f05691b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7645643b0 con 0x55a76451b310 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5f05691b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7645c5c00 con 0x55a76451ca60 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5f05691b80 10 client.0 _ll_register_callbacks cb 0x55a7644dd070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa936700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764546120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa135700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 0x55a764515b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa936700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764546120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47440/0 (socket says 172.21.15.84:47440) 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa936700 1 -- 172.21.15.84:0/3888901840 learned_addr learned my addr 172.21.15.84:0/3888901840 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5ef9934700 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 0x55a764545be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa936700 1 -- 172.21.15.84:0/3888901840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 msgr2=0x55a764545be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa936700 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 0x55a764545be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa936700 1 -- 172.21.15.84:0/3888901840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 msgr2=0x55a764515b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa936700 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 0x55a764515b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa936700 1 -- 172.21.15.84:0/3888901840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee4014450 con 0x55a76453aea0 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5efa936700 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764546120 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f5eec006d60 tx=0x7f5eec026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bc58bb57db0286 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.647+0000 7f5ed8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/3888901840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0842a0 con 0x55a76453aea0 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/3888901840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f5eec05a150 con 0x55a76453aea0 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5f05691b80 1 -- 172.21.15.84:0/3888901840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ee4020570 con 0x55a76453aea0 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/3888901840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eec056f00 con 0x55a76453aea0 2023-10-06T03:02:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5f05691b80 10 client.8787 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5f05691b80 1 -- 172.21.15.84:0/3888901840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55a7644387d0 con 0x55a76453aea0 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/3888901840 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4020570 con 0x55a76453aea0 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/3888901840 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f5eec062070 con 0x55a76453aea0 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5f05691b80 10 client.8787 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5f05691b80 10 client.8787 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5f05691b80 20 client.8787 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55a76451a9a0 0x55a764538f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5f05691b80 4 client.8787 mds_command: new command op to 8529 tid=0[{"prefix": "flush journal"}] 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5f05691b80 1 -- 172.21.15.84:0/3888901840 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a76440ce50 con 0x55a76451a9a0 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5efa135700 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55a76451a9a0 0x55a764538f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5ed8ff9700 10 client.8787 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.648+0000 7f5efa135700 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55a76451a9a0 0x55a764538f30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=929c5af963c25a8d server_cookie=bc480104c558a8c4 in_seq=0 out_seq=0 2023-10-06T03:02:07.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5ed8ff9700 1 -- 172.21.15.84:0/3888901840 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a76440ce50 con 0x55a76451a9a0 2023-10-06T03:02:07.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5ed8ff9700 10 client.8787 handle_command_reply: tid=0 2023-10-06T03:02:07.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 client.8787 shutdown 2023-10-06T03:02:07.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 -- 172.21.15.84:0/3888901840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 msgr2=0x55a764546120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764546120 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f5eec006d60 tx=0x7f5eec026000 comp rx=0 tx=0).stop 2023-10-06T03:02:07.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 -- 172.21.15.84:0/3888901840 shutdown_connections 2023-10-06T03:02:07.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55a76451a9a0 0x55a764538f30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a76451b310 0x55a764515b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a76453aea0 0x55a764546120 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5ed8ff9700 0 client.8787 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 --2- 172.21.15.84:0/3888901840 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a76451ca60 0x55a764545be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 -- 172.21.15.84:0/3888901840 >> 172.21.15.84:0/3888901840 conn(0x55a76451aed0 msgr2=0x55a764517b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 -- 172.21.15.84:0/3888901840 shutdown_connections 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 1 -- 172.21.15.84:0/3888901840 wait complete. 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.668+0000 7f5f05691b80 20 client.8787 trim_cache size 0 max 16384 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:07.671 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T03:02:07.672 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:02:07.672 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 -- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ee0066f30 msgr2=0x7f5ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ee0066f30 0x7f5ee00693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4002250 tx=0x7f5ee4001a20 comp rx=0 tx=0).stop 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 -- 172.21.15.84:0/840422971 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef415a6f0 msgr2=0x7f5ef40c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef415a6f0 0x7f5ef40c8470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5eec016000 tx=0x7f5eec017000 comp rx=0 tx=0).stop 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 -- 172.21.15.84:0/840422971 shutdown_connections 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5ee0066f30 0x7f5ee00693e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ef406a120 0x7f5ef40c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5ef415a6f0 0x7f5ef40c8470 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 --2- 172.21.15.84:0/840422971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ef4159320 0x7f5ef40c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 -- 172.21.15.84:0/840422971 >> 172.21.15.84:0/840422971 conn(0x7f5ef40cd220 msgr2=0x7f5ef40c2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 -- 172.21.15.84:0/840422971 shutdown_connections 2023-10-06T03:02:07.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.669+0000 7f5efb137700 1 -- 172.21.15.84:0/840422971 wait complete. 2023-10-06T03:02:07.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 flush journal 2023-10-06T03:02:07.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.795+0000 7fdd8a565700 1 Processor -- start 2023-10-06T03:02:07.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.796+0000 7fdd8a565700 1 -- start start 2023-10-06T03:02:07.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.796+0000 7fdd8a565700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 0x7fdd840675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.796+0000 7fdd8a565700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd840afde0 0x7fdd84067b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.796+0000 7fdd8a565700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd840b0310 con 0x7fdd840ad6b0 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.796+0000 7fdd8a565700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840cdea0 con 0x7fdd840afde0 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.796+0000 7fdd8a565700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840c9040 con 0x7fdd841593c0 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.796+0000 7fdd88d62700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd840afde0 0x7fdd84067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.796+0000 7fdd88d62700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd840afde0 0x7fdd84067b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47454/0 (socket says 172.21.15.84:47454) 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.796+0000 7fdd88d62700 1 -- 172.21.15.84:0/151303971 learned_addr learned my addr 172.21.15.84:0/151303971 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.797+0000 7fdd89563700 1 --2- 172.21.15.84:0/151303971 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 0x7fdd840675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.797+0000 7fdd88d62700 1 -- 172.21.15.84:0/151303971 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 msgr2=0x7fdd840675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.797+0000 7fdd88d62700 1 --2- 172.21.15.84:0/151303971 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 0x7fdd840675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.797+0000 7fdd88d62700 1 -- 172.21.15.84:0/151303971 >> v1:172.21.15.131:6789/0 conn(0x7fdd840ad6b0 legacy=0x7fdd840adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.797+0000 7fdd88d62700 1 -- 172.21.15.84:0/151303971 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd840c9320 con 0x7fdd840afde0 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.797+0000 7fdd88d62700 1 --2- 172.21.15.84:0/151303971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 0x7fdd84067b30 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fdd740099b0 tx=0x7fdd74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b593632f685ec1ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.797+0000 7fdd7bfff700 1 -- 172.21.15.84:0/151303971 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74009ea0 con 0x7fdd840afde0 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.797+0000 7fdd7bfff700 1 -- 172.21.15.84:0/151303971 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7400b860 con 0x7fdd840afde0 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.797+0000 7fdd7bfff700 1 -- 172.21.15.84:0/151303971 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7400bc00 con 0x7fdd840afde0 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.798+0000 7fdd8a565700 1 -- 172.21.15.84:0/151303971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 msgr2=0x7fdd84067b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.798+0000 7fdd8a565700 1 --2- 172.21.15.84:0/151303971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 0x7fdd84067b30 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fdd740099b0 tx=0x7fdd74009250 comp rx=0 tx=0).stop 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.798+0000 7fdd8a565700 1 -- 172.21.15.84:0/151303971 shutdown_connections 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.798+0000 7fdd8a565700 1 --2- 172.21.15.84:0/151303971 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 0x7fdd840675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.798+0000 7fdd8a565700 1 --2- 172.21.15.84:0/151303971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 0x7fdd84067b30 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.798+0000 7fdd8a565700 1 -- 172.21.15.84:0/151303971 >> 172.21.15.84:0/151303971 conn(0x7fdd840691d0 msgr2=0x7fdd840cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.798+0000 7fdd8a565700 1 -- 172.21.15.84:0/151303971 shutdown_connections 2023-10-06T03:02:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.798+0000 7fdd8a565700 1 -- 172.21.15.84:0/151303971 wait complete. 2023-10-06T03:02:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.799+0000 7fdd8a565700 1 Processor -- start 2023-10-06T03:02:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.799+0000 7fdd8a565700 1 -- start start 2023-10-06T03:02:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd8a565700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd840ad6b0 0x7fdd840ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd8a565700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 0x7fdd8416d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd8a565700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 0x7fdd84156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd8a565700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd84169960 con 0x7fdd840afde0 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd8a565700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8416a780 con 0x7fdd840ad6b0 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd8a565700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8416de50 con 0x7fdd841593c0 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd88d62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 0x7fdd8416d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd88d62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 0x7fdd8416d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47464/0 (socket says 172.21.15.84:47464) 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd88d62700 1 -- 172.21.15.84:0/2530526990 learned_addr learned my addr 172.21.15.84:0/2530526990 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd89563700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd840ad6b0 0x7fdd840ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd89d64700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 0x7fdd84156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd88d62700 1 -- 172.21.15.84:0/2530526990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 msgr2=0x7fdd84156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd88d62700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 0x7fdd84156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd88d62700 1 -- 172.21.15.84:0/2530526990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd840ad6b0 msgr2=0x7fdd840ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd88d62700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd840ad6b0 0x7fdd840ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd88d62700 1 -- 172.21.15.84:0/2530526990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740094f0 con 0x7fdd840afde0 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd88d62700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 0x7fdd8416d910 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fdd8406df50 tx=0x7fdd74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd797fa700 1 -- 172.21.15.84:0/2530526990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74000d10 con 0x7fdd840afde0 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd797fa700 1 -- 172.21.15.84:0/2530526990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7400bbe0 con 0x7fdd840afde0 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd8a565700 1 -- 172.21.15.84:0/2530526990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd84169b70 con 0x7fdd840afde0 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd797fa700 1 -- 172.21.15.84:0/2530526990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74011670 con 0x7fdd840afde0 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.800+0000 7fdd8a565700 1 -- 172.21.15.84:0/2530526990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8416a130 con 0x7fdd840afde0 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.802+0000 7fdd797fa700 1 -- 172.21.15.84:0/2530526990 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd74011aa0 con 0x7fdd840afde0 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.802+0000 7fdd797fa700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdd68066f30 0x7fdd680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.802+0000 7fdd797fa700 1 -- 172.21.15.84:0/2530526990 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdd74086020 con 0x7fdd840afde0 2023-10-06T03:02:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.802+0000 7fdd89563700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdd68066f30 0x7fdd680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.803+0000 7fdd89563700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdd68066f30 0x7fdd680693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009fd0 tx=0x7fdd8000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.804+0000 7fdd94abfb80 1 Processor -- start 2023-10-06T03:02:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.804+0000 7fdd94abfb80 1 -- start start 2023-10-06T03:02:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 0x5611a58a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 0x5611a58ef130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ef670 0x5611a58efae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a57fbac0 con 0x5611a58ef670 2023-10-06T03:02:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a57f92c0 con 0x5611a58ce760 2023-10-06T03:02:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a57f50b0 con 0x5611a58ce390 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd89d64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ef670 0x5611a58efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd89d64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ef670 0x5611a58efae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47474/0 (socket says 172.21.15.84:47474) 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd89d64700 1 -- 172.21.15.84:0/2221553666 learned_addr learned my addr 172.21.15.84:0/2221553666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd89563700 1 --2- 172.21.15.84:0/2221553666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 0x5611a58a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd88d62700 1 --2- 172.21.15.84:0/2221553666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 0x5611a58ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd89d64700 1 -- 172.21.15.84:0/2221553666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 msgr2=0x5611a58a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd89d64700 1 --2- 172.21.15.84:0/2221553666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 0x5611a58a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd89d64700 1 -- 172.21.15.84:0/2221553666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 msgr2=0x5611a58ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd89d64700 1 --2- 172.21.15.84:0/2221553666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 0x5611a58ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.805+0000 7fdd89d64700 1 -- 172.21.15.84:0/2221553666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611a568f2c0 con 0x5611a58ef670 2023-10-06T03:02:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd89d64700 1 --2- 172.21.15.84:0/2221553666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ef670 0x5611a58efae0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c003840 tx=0x7fdd7c007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e83d90bca2e426c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd6e7fc700 1 -- 172.21.15.84:0/2221553666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c003430 con 0x5611a58ef670 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd6e7fc700 1 -- 172.21.15.84:0/2221553666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c002690 con 0x5611a58ef670 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd6e7fc700 1 -- 172.21.15.84:0/2221553666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c002a10 con 0x5611a58ef670 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2221553666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ef670 msgr2=0x5611a58efae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2221553666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ef670 0x5611a58efae0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c003840 tx=0x7fdd7c007e60 comp rx=0 tx=0).stop 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2221553666 shutdown_connections 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2221553666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ef670 0x5611a58efae0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2221553666 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 0x5611a58a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2221553666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 0x5611a58ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2221553666 >> 172.21.15.84:0/2221553666 conn(0x5611a58a5ed0 msgr2=0x5611a58a6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2221553666 shutdown_connections 2023-10-06T03:02:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.806+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2221553666 wait complete. 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.807+0000 7fdd94abfb80 1 -- start start 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.807+0000 7fdd94abfb80 1 Processor -- start 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 0x5611a58f4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ef670 0x5611a58f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a57a08e0 con 0x5611a58ce760 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a57bbef0 con 0x5611a58ef670 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a5677e80 con 0x5611a58ce390 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd94abfb80 10 client.0 _ll_register_callbacks cb 0x5611a5868070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd88d62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd88d62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47490/0 (socket says 172.21.15.84:47490) 2023-10-06T03:02:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd88d62700 1 -- 172.21.15.84:0/4279962241 learned_addr learned my addr 172.21.15.84:0/4279962241 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd89563700 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 0x5611a58f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd89d64700 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ef670 0x5611a58f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd88d62700 1 -- 172.21.15.84:0/4279962241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 msgr2=0x5611a58f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd88d62700 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 0x5611a58f4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd88d62700 1 -- 172.21.15.84:0/4279962241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ef670 msgr2=0x5611a58f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd88d62700 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ef670 0x5611a58f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd88d62700 1 -- 172.21.15.84:0/4279962241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd840b0310 con 0x5611a58ce760 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd88d62700 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cad50 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fdd74056970 tx=0x7fdd74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffba95266668895 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.808+0000 7fdd637fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd637fe700 1 -- 172.21.15.84:0/4279962241 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74059ec0 con 0x5611a58ce760 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd637fe700 1 -- 172.21.15.84:0/4279962241 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdd7405dc10 con 0x5611a58ce760 2023-10-06T03:02:07.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd94abfb80 1 -- 172.21.15.84:0/4279962241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611a5899990 con 0x5611a58ce760 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd637fe700 1 -- 172.21.15.84:0/4279962241 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd74056370 con 0x5611a58ce760 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd94abfb80 10 client.8799 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd94abfb80 1 -- 172.21.15.84:0/4279962241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x5611a5632030 con 0x5611a58ce760 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd637fe700 1 -- 172.21.15.84:0/4279962241 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611a5899990 con 0x5611a58ce760 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd637fe700 1 -- 172.21.15.84:0/4279962241 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fdd7405d780 con 0x5611a58ce760 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd94abfb80 10 client.8799 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd94abfb80 10 client.8799 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd94abfb80 20 client.8799 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5611a58f2540 0x5611a589b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd94abfb80 4 client.8799 mds_command: new command op to 8526 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd94abfb80 1 -- 172.21.15.84:0/4279962241 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611a58768c0 con 0x5611a58f2540 2023-10-06T03:02:07.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd89563700 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5611a58f2540 0x5611a589b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd637fe700 10 client.8799 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.809+0000 7fdd89563700 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5611a58f2540 0x5611a589b450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3243e3634525224 server_cookie=1457cf38d06c67ff in_seq=0 out_seq=0 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd637fe700 1 -- 172.21.15.84:0/4279962241 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5611a58768c0 con 0x5611a58f2540 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd637fe700 10 client.8799 handle_command_reply: tid=0 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 client.8799 shutdown 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 -- 172.21.15.84:0/4279962241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 msgr2=0x5611a58cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cad50 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fdd74056970 tx=0x7fdd74008040 comp rx=0 tx=0).stop 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 -- 172.21.15.84:0/4279962241 shutdown_connections 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5611a58f2540 0x5611a589b450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ef670 0x5611a58f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd637fe700 0 client.8799 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:07.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ce390 0x5611a58f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/4279962241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cad50 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 -- 172.21.15.84:0/4279962241 >> 172.21.15.84:0/4279962241 conn(0x5611a58a5ed0 msgr2=0x5611a58d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 -- 172.21.15.84:0/4279962241 shutdown_connections 2023-10-06T03:02:07.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 1 -- 172.21.15.84:0/4279962241 wait complete. 2023-10-06T03:02:07.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.810+0000 7fdd94abfb80 20 client.8799 trim_cache size 0 max 16384 2023-10-06T03:02:07.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.824+0000 7fdd94abfb80 1 Processor -- start 2023-10-06T03:02:07.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.824+0000 7fdd94abfb80 1 -- start start 2023-10-06T03:02:07.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce390 0x5611a58efa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 0x5611a58fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a5884330 con 0x5611a58ce760 2023-10-06T03:02:07.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a58a2fc0 con 0x5611a58ce390 2023-10-06T03:02:07.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a59162e0 con 0x5611a58ef670 2023-10-06T03:02:07.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd88d62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd88d62700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47502/0 (socket says 172.21.15.84:47502) 2023-10-06T03:02:07.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd88d62700 1 -- 172.21.15.84:0/56087094 learned_addr learned my addr 172.21.15.84:0/56087094 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd89d64700 1 --2- 172.21.15.84:0/56087094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 0x5611a58fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd89563700 1 --2- 172.21.15.84:0/56087094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce390 0x5611a58efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd88d62700 1 -- 172.21.15.84:0/56087094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 msgr2=0x5611a58fb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd88d62700 1 --2- 172.21.15.84:0/56087094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 0x5611a58fb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd88d62700 1 -- 172.21.15.84:0/56087094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce390 msgr2=0x5611a58efa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd88d62700 1 --2- 172.21.15.84:0/56087094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce390 0x5611a58efa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd88d62700 1 -- 172.21.15.84:0/56087094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611a57c37d0 con 0x5611a58ce760 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd88d62700 1 --2- 172.21.15.84:0/56087094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cbbe0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fdd74020040 tx=0x7fdd7406b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5a4a1e32081989 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd6effd700 1 -- 172.21.15.84:0/56087094 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74059ec0 con 0x5611a58ce760 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd6effd700 1 -- 172.21.15.84:0/56087094 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7405dc10 con 0x5611a58ce760 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.825+0000 7fdd6effd700 1 -- 172.21.15.84:0/56087094 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74056c70 con 0x5611a58ce760 2023-10-06T03:02:07.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 -- 172.21.15.84:0/56087094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 msgr2=0x5611a58cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/56087094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cbbe0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fdd74020040 tx=0x7fdd7406b000 comp rx=0 tx=0).stop 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 -- 172.21.15.84:0/56087094 shutdown_connections 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/56087094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce390 0x5611a58efa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/56087094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 0x5611a58fb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/56087094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce760 0x5611a58cbbe0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 -- 172.21.15.84:0/56087094 >> 172.21.15.84:0/56087094 conn(0x5611a58a5ed0 msgr2=0x5611a58cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 -- 172.21.15.84:0/56087094 shutdown_connections 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 -- 172.21.15.84:0/56087094 wait complete. 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.826+0000 7fdd94abfb80 1 -- start start 2023-10-06T03:02:07.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.827+0000 7fdd94abfb80 1 Processor -- start 2023-10-06T03:02:07.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.827+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce390 0x5611a58ef060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.827+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 0x5611a5942460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.827+0000 7fdd94abfb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 0x5611a58f1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.827+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a5959c90 con 0x5611a58ce390 2023-10-06T03:02:07.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.827+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a58d10d0 con 0x5611a58ce760 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.827+0000 7fdd94abfb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a58f0dd0 con 0x5611a58ef670 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.827+0000 7fdd94abfb80 10 client.0 _ll_register_callbacks cb 0x5611a58f6870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89563700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce390 0x5611a58ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89563700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce390 0x5611a58ef060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47518/0 (socket says 172.21.15.84:47518) 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd88d62700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 0x5611a5942460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89563700 1 -- 172.21.15.84:0/2527158540 learned_addr learned my addr 172.21.15.84:0/2527158540 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89d64700 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 0x5611a58f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89563700 1 -- 172.21.15.84:0/2527158540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 msgr2=0x5611a58f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89563700 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 0x5611a58f1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89563700 1 -- 172.21.15.84:0/2527158540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 msgr2=0x5611a5942460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89563700 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 0x5611a5942460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89563700 1 -- 172.21.15.84:0/2527158540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a5632030 con 0x5611a58ce390 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd88d62700 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 0x5611a5942460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd89563700 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce390 0x5611a58ef060 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x5611a58f6540 tx=0x7fdd80019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c262ab722e443cd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd637fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd637fe700 1 -- 172.21.15.84:0/2527158540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8001c040 con 0x5611a58ce390 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd637fe700 1 -- 172.21.15.84:0/2527158540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdd80015a00 con 0x5611a58ce390 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2527158540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd7c002690 con 0x5611a58ce390 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd637fe700 1 -- 172.21.15.84:0/2527158540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd8000e040 con 0x5611a58ce390 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd94abfb80 10 client.8805 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2527158540 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x5611a57aa4c0 con 0x5611a58ce390 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd637fe700 1 -- 172.21.15.84:0/2527158540 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c002690 con 0x5611a58ce390 2023-10-06T03:02:07.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd637fe700 1 -- 172.21.15.84:0/2527158540 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fdd80035350 con 0x5611a58ce390 2023-10-06T03:02:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd94abfb80 10 client.8805 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.828+0000 7fdd94abfb80 10 client.8805 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.829+0000 7fdd94abfb80 20 client.8805 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.829+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5611a5959080 0x5611a589b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.829+0000 7fdd94abfb80 4 client.8805 mds_command: new command op to 8526 tid=0[{"prefix": "flush journal"}] 2023-10-06T03:02:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.829+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2527158540 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5611a5797e50 con 0x5611a5959080 2023-10-06T03:02:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.829+0000 7fdd88d62700 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5611a5959080 0x5611a589b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.829+0000 7fdd637fe700 10 client.8805 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:07.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.829+0000 7fdd88d62700 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5611a5959080 0x5611a589b450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=685002b598855c35 server_cookie=bf22d62593aa2a3c in_seq=0 out_seq=0 2023-10-06T03:02:07.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.841+0000 7fdd637fe700 1 -- 172.21.15.84:0/2527158540 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5611a5797e50 con 0x5611a5959080 2023-10-06T03:02:07.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.841+0000 7fdd637fe700 10 client.8805 handle_command_reply: tid=0 2023-10-06T03:02:07.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.841+0000 7fdd94abfb80 1 client.8805 shutdown 2023-10-06T03:02:07.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.841+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2527158540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce390 msgr2=0x5611a58ef060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.841+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce390 0x5611a58ef060 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x5611a58f6540 tx=0x7fdd80019000 comp rx=0 tx=0).stop 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2527158540 shutdown_connections 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5611a5959080 0x5611a589b450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5611a58ef670 0x5611a58f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5611a58ce390 0x5611a58ef060 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd637fe700 0 client.8805 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd94abfb80 1 --2- 172.21.15.84:0/2527158540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5611a58ce760 0x5611a5942460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2527158540 >> 172.21.15.84:0/2527158540 conn(0x5611a58a5ed0 msgr2=0x5611a58f4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2527158540 shutdown_connections 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd94abfb80 1 -- 172.21.15.84:0/2527158540 wait complete. 2023-10-06T03:02:07.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd94abfb80 20 client.8805 trim_cache size 0 max 16384 2023-10-06T03:02:07.845 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:07.845 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T03:02:07.845 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:02:07.845 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:07.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 -- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdd68066f30 msgr2=0x7fdd680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdd68066f30 0x7fdd680693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009fd0 tx=0x7fdd8000b040 comp rx=0 tx=0).stop 2023-10-06T03:02:07.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 -- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 msgr2=0x7fdd8416d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 0x7fdd8416d910 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fdd8406df50 tx=0x7fdd74017000 comp rx=0 tx=0).stop 2023-10-06T03:02:07.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 -- 172.21.15.84:0/2530526990 shutdown_connections 2023-10-06T03:02:07.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdd68066f30 0x7fdd680693e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd840ad6b0 0x7fdd840ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd841593c0 0x7fdd84156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 --2- 172.21.15.84:0/2530526990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840afde0 0x7fdd8416d910 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 -- 172.21.15.84:0/2530526990 >> 172.21.15.84:0/2530526990 conn(0x7fdd840691d0 msgr2=0x7fdd84157280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 -- 172.21.15.84:0/2530526990 shutdown_connections 2023-10-06T03:02:07.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.842+0000 7fdd8a565700 1 -- 172.21.15.84:0/2530526990 wait complete. 2023-10-06T03:02:07.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 flush journal 2023-10-06T03:02:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.969+0000 7f1b6bac5700 1 Processor -- start 2023-10-06T03:02:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.969+0000 7f1b6bac5700 1 -- start start 2023-10-06T03:02:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b6bac5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b640b2a90 0x7f1b640cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b6bac5700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1b640c6610 0x7f1b640cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b6bac5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640cbdf0 con 0x7f1b640cb980 2023-10-06T03:02:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b6bac5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b640b2e60 con 0x7f1b640b2a90 2023-10-06T03:02:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b6bac5700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b640cf5d0 con 0x7f1b640c6610 2023-10-06T03:02:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b69861700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b640b2a90 0x7f1b640cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b69861700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b640b2a90 0x7f1b640cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47520/0 (socket says 172.21.15.84:47520) 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b69861700 1 -- 172.21.15.84:0/376861995 learned_addr learned my addr 172.21.15.84:0/376861995 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b69060700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1b640cb980 0x7f1b640ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58402/0 (socket says 172.21.15.84:58402) 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b6a062700 1 --2- 172.21.15.84:0/376861995 >> v2:172.21.15.131:3300/0 conn(0x7f1b640c6610 0x7f1b640cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b69861700 1 -- 172.21.15.84:0/376861995 >> v2:172.21.15.131:3300/0 conn(0x7f1b640c6610 msgr2=0x7f1b640cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b69861700 1 --2- 172.21.15.84:0/376861995 >> v2:172.21.15.131:3300/0 conn(0x7f1b640c6610 0x7f1b640cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b69861700 1 -- 172.21.15.84:0/376861995 >> v1:172.21.15.84:6789/0 conn(0x7f1b640cb980 legacy=0x7f1b640ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b69861700 1 -- 172.21.15.84:0/376861995 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640cf8b0 con 0x7f1b640b2a90 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b6885f700 1 -- 172.21.15.84:0/376861995 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171780512 0 0) 0x7f1b640cbdf0 con 0x7f1b640cb980 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.970+0000 7f1b6a062700 1 --2- 172.21.15.84:0/376861995 >> v2:172.21.15.131:3300/0 conn(0x7f1b640c6610 0x7f1b640cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b69861700 1 --2- 172.21.15.84:0/376861995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640b2a90 0x7f1b640cb440 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009990 tx=0x7f1b60009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ab26958e37fe91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6885f700 1 -- 172.21.15.84:0/376861995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60005c10 con 0x7f1b640b2a90 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6885f700 1 -- 172.21.15.84:0/376861995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b60005d70 con 0x7f1b640b2a90 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6885f700 1 -- 172.21.15.84:0/376861995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000b860 con 0x7f1b640b2a90 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6bac5700 1 -- 172.21.15.84:0/376861995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640b2a90 msgr2=0x7f1b640cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6bac5700 1 --2- 172.21.15.84:0/376861995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640b2a90 0x7f1b640cb440 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009990 tx=0x7f1b60009220 comp rx=0 tx=0).stop 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6bac5700 1 -- 172.21.15.84:0/376861995 shutdown_connections 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6bac5700 1 --2- 172.21.15.84:0/376861995 >> v2:172.21.15.131:3300/0 conn(0x7f1b640c6610 0x7f1b640cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6bac5700 1 --2- 172.21.15.84:0/376861995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640b2a90 0x7f1b640cb440 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6bac5700 1 -- 172.21.15.84:0/376861995 >> 172.21.15.84:0/376861995 conn(0x7f1b64099740 msgr2=0x7f1b6406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6bac5700 1 -- 172.21.15.84:0/376861995 shutdown_connections 2023-10-06T03:02:07.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.971+0000 7f1b6bac5700 1 -- 172.21.15.84:0/376861995 wait complete. 2023-10-06T03:02:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.972+0000 7f1b6bac5700 1 Processor -- start 2023-10-06T03:02:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.972+0000 7f1b6bac5700 1 -- start start 2023-10-06T03:02:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b6bac5700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b640b2a90 0x7f1b64141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b6bac5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640c6610 0x7f1b641548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b6bac5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b640cb980 0x7f1b640ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b6bac5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64155bc0 con 0x7f1b640c6610 2023-10-06T03:02:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b6bac5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641424d0 con 0x7f1b640cb980 2023-10-06T03:02:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b6bac5700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64155320 con 0x7f1b640b2a90 2023-10-06T03:02:07.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69060700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640c6610 0x7f1b641548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69060700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640c6610 0x7f1b641548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47526/0 (socket says 172.21.15.84:47526) 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69060700 1 -- 172.21.15.84:0/1382608722 learned_addr learned my addr 172.21.15.84:0/1382608722 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b6a062700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b640cb980 0x7f1b640ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69861700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b640b2a90 0x7f1b64141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69060700 1 -- 172.21.15.84:0/1382608722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b640b2a90 msgr2=0x7f1b64141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69060700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b640b2a90 0x7f1b64141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69060700 1 -- 172.21.15.84:0/1382608722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b640cb980 msgr2=0x7f1b640ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69060700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b640cb980 0x7f1b640ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69060700 1 -- 172.21.15.84:0/1382608722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b60009480 con 0x7f1b640c6610 2023-10-06T03:02:07.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.973+0000 7f1b69861700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b640b2a90 0x7f1b64141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.974+0000 7f1b69060700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640c6610 0x7f1b641548a0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c5b0 tx=0x7f1b54001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.974+0000 7f1b59ffb700 1 -- 172.21.15.84:0/1382608722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54005a70 con 0x7f1b640c6610 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.974+0000 7f1b59ffb700 1 -- 172.21.15.84:0/1382608722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b54005bd0 con 0x7f1b640c6610 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.974+0000 7f1b59ffb700 1 -- 172.21.15.84:0/1382608722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b540070d0 con 0x7f1b640c6610 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.974+0000 7f1b6bac5700 1 -- 172.21.15.84:0/1382608722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b64155600 con 0x7f1b640c6610 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.974+0000 7f1b6bac5700 1 -- 172.21.15.84:0/1382608722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b64155f20 con 0x7f1b640c6610 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.975+0000 7f1b59ffb700 1 -- 172.21.15.84:0/1382608722 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b54007480 con 0x7f1b640c6610 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.975+0000 7f1b59ffb700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b48066f30 0x7f1b480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.976+0000 7f1b59ffb700 1 -- 172.21.15.84:0/1382608722 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1b54083cf0 con 0x7f1b640c6610 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.976+0000 7f1b69861700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b48066f30 0x7f1b480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.976+0000 7f1b69861700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b48066f30 0x7f1b480693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1b64069910 tx=0x7f1b60016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b74dbdb80 1 Processor -- start 2023-10-06T03:02:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b74dbdb80 1 -- start start 2023-10-06T03:02:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 0x561ae0e5ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5bd10 0x561ae0eaa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 0x561ae0eab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0db1ac0 con 0x561ae0e5bd10 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0daf2c0 con 0x561ae0e5a890 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae0dab0b0 con 0x561ae0eaac50 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b69060700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5bd10 0x561ae0eaa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b69060700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5bd10 0x561ae0eaa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47528/0 (socket says 172.21.15.84:47528) 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.978+0000 7f1b69060700 1 -- 172.21.15.84:0/2797198535 learned_addr learned my addr 172.21.15.84:0/2797198535 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b69861700 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 0x561ae0e5ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b6a062700 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 0x561ae0eab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b69060700 1 -- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 msgr2=0x561ae0eab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b69060700 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 0x561ae0eab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b69060700 1 -- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 msgr2=0x561ae0e5ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b69060700 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 0x561ae0e5ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b69060700 1 -- 172.21.15.84:0/2797198535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ae0c452c0 con 0x561ae0e5bd10 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b6a062700 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 0x561ae0eab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b69861700 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 0x561ae0e5ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b69060700 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5bd10 0x561ae0eaa710 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f1b54081f30 tx=0x7f1b54081e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d77bac669314969 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b46ffd700 1 -- 172.21.15.84:0/2797198535 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54054940 con 0x561ae0e5bd10 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b46ffd700 1 -- 172.21.15.84:0/2797198535 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b54057b90 con 0x561ae0e5bd10 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.979+0000 7f1b46ffd700 1 -- 172.21.15.84:0/2797198535 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5405b8e0 con 0x561ae0e5bd10 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2797198535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5bd10 msgr2=0x561ae0eaa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5bd10 0x561ae0eaa710 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f1b54081f30 tx=0x7f1b54081e90 comp rx=0 tx=0).stop 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2797198535 shutdown_connections 2023-10-06T03:02:07.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 0x561ae0e5ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 0x561ae0eab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2797198535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5bd10 0x561ae0eaa710 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2797198535 >> 172.21.15.84:0/2797198535 conn(0x561ae0e5c1b0 msgr2=0x561ae0e5c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2797198535 shutdown_connections 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2797198535 wait complete. 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 -- start start 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.980+0000 7f1b74dbdb80 1 Processor -- start 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5a890 0x561ae0e9b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 0x561ae0e83710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 0x561ae0e83c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0d568e0 con 0x561ae0e5a890 2023-10-06T03:02:07.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0d71ef0 con 0x561ae0e5bd10 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae0c2de80 con 0x561ae0eaac50 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b74dbdb80 10 client.0 _ll_register_callbacks cb 0x561ae0e1dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b69861700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5a890 0x561ae0e9b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b69861700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5a890 0x561ae0e9b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47542/0 (socket says 172.21.15.84:47542) 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b69861700 1 -- 172.21.15.84:0/1607430167 learned_addr learned my addr 172.21.15.84:0/1607430167 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b69060700 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 0x561ae0e83710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.981+0000 7f1b6a062700 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 0x561ae0e83c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b69861700 1 -- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 msgr2=0x561ae0e83c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b69861700 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 0x561ae0e83c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b69861700 1 -- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 msgr2=0x561ae0e83710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:07.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b69861700 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 0x561ae0e83710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b69861700 1 -- 172.21.15.84:0/1607430167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b64155f20 con 0x561ae0e5a890 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b69861700 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5a890 0x561ae0e9b3b0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f1b60012000 tx=0x7f1b60022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89c6cf4e8fba860 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b3ffff700 1 -- 172.21.15.84:0/1607430167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60030070 con 0x561ae0e5a890 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b3ffff700 1 -- 172.21.15.84:0/1607430167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1b6002b890 con 0x561ae0e5a890 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/1607430167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ae0e4f990 con 0x561ae0e5a890 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b3ffff700 1 -- 172.21.15.84:0/1607430167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b60022070 con 0x561ae0e5a890 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b74dbdb80 10 client.8820 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/1607430167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x561ae0be8030 con 0x561ae0e5a890 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b3ffff700 1 -- 172.21.15.84:0/1607430167 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ae0e4f990 con 0x561ae0e5a890 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b3ffff700 1 -- 172.21.15.84:0/1607430167 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f1b6002bc60 con 0x561ae0e5a890 2023-10-06T03:02:07.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b74dbdb80 10 client.8820 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b74dbdb80 10 client.8820 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.982+0000 7f1b74dbdb80 20 client.8820 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.983+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x561ae0ea2270 0x561ae0e9a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.983+0000 7f1b74dbdb80 4 client.8820 mds_command: new command op to 6782 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.983+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/1607430167 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ae0e2c8c0 con 0x561ae0ea2270 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.983+0000 7f1b69060700 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x561ae0ea2270 0x561ae0e9a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.983+0000 7f1b3ffff700 10 client.8820 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.983+0000 7f1b69060700 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x561ae0ea2270 0x561ae0e9a360 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f47249a924c57f4 server_cookie=701bd0d923eb24f7 in_seq=0 out_seq=0 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.983+0000 7f1b3ffff700 1 -- 172.21.15.84:0/1607430167 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561ae0e2c8c0 con 0x561ae0ea2270 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.983+0000 7f1b3ffff700 10 client.8820 handle_command_reply: tid=0 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 client.8820 shutdown 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/1607430167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5a890 msgr2=0x561ae0e9b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:07.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5a890 0x561ae0e9b3b0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f1b60012000 tx=0x7f1b60022000 comp rx=0 tx=0).stop 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/1607430167 shutdown_connections 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x561ae0ea2270 0x561ae0e9a360 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0eaac50 0x561ae0e83c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b3ffff700 0 client.8820 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5a890 0x561ae0e9b3b0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/1607430167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 0x561ae0e83710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/1607430167 >> 172.21.15.84:0/1607430167 conn(0x561ae0e5c1b0 msgr2=0x561ae0e57170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/1607430167 shutdown_connections 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/1607430167 wait complete. 2023-10-06T03:02:07.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.984+0000 7f1b74dbdb80 20 client.8820 trim_cache size 0 max 16384 2023-10-06T03:02:07.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.997+0000 7f1b74dbdb80 1 Processor -- start 2023-10-06T03:02:07.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b74dbdb80 1 -- start start 2023-10-06T03:02:08.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0e5cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 0x561ae0e9a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0e5bd10 0x561ae0e9a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0e55700 con 0x561ae0e5c1b0 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0e4f800 con 0x561ae0e5a890 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae0e84090 con 0x561ae0e5bd10 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b69861700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0e5cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b69861700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0e5cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47558/0 (socket says 172.21.15.84:47558) 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.998+0000 7f1b69861700 1 -- 172.21.15.84:0/4097337031 learned_addr learned my addr 172.21.15.84:0/4097337031 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b69861700 1 -- 172.21.15.84:0/4097337031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0e5bd10 msgr2=0x561ae0e9a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b69861700 1 --2- 172.21.15.84:0/4097337031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0e5bd10 0x561ae0e9a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b69060700 1 --2- 172.21.15.84:0/4097337031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 0x561ae0e9a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b69861700 1 -- 172.21.15.84:0/4097337031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 msgr2=0x561ae0e9a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b69861700 1 --2- 172.21.15.84:0/4097337031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 0x561ae0e9a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b69861700 1 -- 172.21.15.84:0/4097337031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ae0d797d0 con 0x561ae0e5c1b0 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b69861700 1 --2- 172.21.15.84:0/4097337031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0e5cf70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000a010 tx=0x7f1b60030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9194f8a1504e6e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b477fe700 1 -- 172.21.15.84:0/4097337031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60022050 con 0x561ae0e5c1b0 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b477fe700 1 -- 172.21.15.84:0/4097337031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6002bd30 con 0x561ae0e5c1b0 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b477fe700 1 -- 172.21.15.84:0/4097337031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60011650 con 0x561ae0e5c1b0 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/4097337031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 msgr2=0x561ae0e5cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/4097337031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0e5cf70 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000a010 tx=0x7f1b60030000 comp rx=0 tx=0).stop 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/4097337031 shutdown_connections 2023-10-06T03:02:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/4097337031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0e5bd10 0x561ae0e9a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/4097337031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0e5cf70 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/4097337031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5a890 0x561ae0e9a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/4097337031 >> 172.21.15.84:0/4097337031 conn(0x561ae0e99cb0 msgr2=0x561ae0ea3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:07.999+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/4097337031 shutdown_connections 2023-10-06T03:02:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.000+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/4097337031 wait complete. 2023-10-06T03:02:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.000+0000 7f1b74dbdb80 1 -- start start 2023-10-06T03:02:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.000+0000 7f1b74dbdb80 1 Processor -- start 2023-10-06T03:02:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0e5a890 0x561ae0f06090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 0x561ae0ea4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b74dbdb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0ea54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0e56620 con 0x561ae0e5c1b0 2023-10-06T03:02:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0ec1910 con 0x561ae0e5bd10 2023-10-06T03:02:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b74dbdb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ae0ebeca0 con 0x561ae0e5a890 2023-10-06T03:02:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b74dbdb80 10 client.0 _ll_register_callbacks cb 0x561ae0e5a2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b6a062700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0ea54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b6a062700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0ea54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47564/0 (socket says 172.21.15.84:47564) 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b6a062700 1 -- 172.21.15.84:0/2197045213 learned_addr learned my addr 172.21.15.84:0/2197045213 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b69861700 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0e5a890 0x561ae0f06090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b69060700 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 0x561ae0ea4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b6a062700 1 -- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0e5a890 msgr2=0x561ae0f06090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b6a062700 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0e5a890 0x561ae0f06090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b6a062700 1 -- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 msgr2=0x561ae0ea4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b6a062700 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 0x561ae0ea4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.001+0000 7f1b6a062700 1 -- 172.21.15.84:0/2197045213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ae0be8030 con 0x561ae0e5c1b0 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b6a062700 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0ea54a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007ea0 tx=0x7f1b5c009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ebfba8c601b10e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b3ffff700 1 -- 172.21.15.84:0/2197045213 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0159b0 con 0x561ae0e5c1b0 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b3ffff700 1 -- 172.21.15.84:0/2197045213 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1b5c015b10 con 0x561ae0e5c1b0 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2197045213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b54057b90 con 0x561ae0e5c1b0 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b3ffff700 1 -- 172.21.15.84:0/2197045213 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b5c015ee0 con 0x561ae0e5c1b0 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b74dbdb80 10 client.8826 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2197045213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x561ae0d604c0 con 0x561ae0e5c1b0 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b3ffff700 1 -- 172.21.15.84:0/2197045213 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b54057b90 con 0x561ae0e5c1b0 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b3ffff700 1 -- 172.21.15.84:0/2197045213 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f1b5c020460 con 0x561ae0e5c1b0 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b74dbdb80 10 client.8826 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b74dbdb80 10 client.8826 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b74dbdb80 20 client.8826 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:08.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x561ae0eaac50 0x561ae0e82800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b74dbdb80 4 client.8826 mds_command: new command op to 6782 tid=0[{"prefix": "flush journal"}] 2023-10-06T03:02:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2197045213 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561ae0d4de50 con 0x561ae0eaac50 2023-10-06T03:02:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.002+0000 7f1b69861700 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x561ae0eaac50 0x561ae0e82800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.003+0000 7f1b3ffff700 10 client.8826 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:08.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.003+0000 7f1b69861700 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x561ae0eaac50 0x561ae0e82800 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1efa93592dd5c5cd server_cookie=142aca4ab9e33105 in_seq=0 out_seq=0 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b3ffff700 1 -- 172.21.15.84:0/2197045213 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561ae0d4de50 con 0x561ae0eaac50 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b3ffff700 10 client.8826 handle_command_reply: tid=0 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 client.8826 shutdown 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2197045213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 msgr2=0x561ae0ea54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0ea54a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007ea0 tx=0x7f1b5c009990 comp rx=0 tx=0).stop 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2197045213 shutdown_connections 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x561ae0eaac50 0x561ae0e82800 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561ae0e5c1b0 0x561ae0ea54a0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561ae0e5a890 0x561ae0f06090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 --2- 172.21.15.84:0/2197045213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ae0e5bd10 0x561ae0ea4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b3ffff700 0 client.8826 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2197045213 >> 172.21.15.84:0/2197045213 conn(0x561ae0e99cb0 msgr2=0x561ae0eba910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2197045213 shutdown_connections 2023-10-06T03:02:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 1 -- 172.21.15.84:0/2197045213 wait complete. 2023-10-06T03:02:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b74dbdb80 20 client.8826 trim_cache size 0 max 16384 2023-10-06T03:02:08.014 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:08.014 INFO:teuthology.orchestra.run.smithi084.stdout: "message": "", 2023-10-06T03:02:08.014 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:02:08.015 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b6bac5700 1 -- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b48066f30 msgr2=0x7f1b480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b6bac5700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b48066f30 0x7f1b480693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1b64069910 tx=0x7f1b60016000 comp rx=0 tx=0).stop 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b6bac5700 1 -- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640c6610 msgr2=0x7f1b641548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.011+0000 7f1b6bac5700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640c6610 0x7f1b641548a0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c5b0 tx=0x7f1b54001040 comp rx=0 tx=0).stop 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.012+0000 7f1b6bac5700 1 -- 172.21.15.84:0/1382608722 shutdown_connections 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.012+0000 7f1b6bac5700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1b48066f30 0x7f1b480693e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.012+0000 7f1b6bac5700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b640cb980 0x7f1b640ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.012+0000 7f1b6bac5700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b640b2a90 0x7f1b64141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.012+0000 7f1b6bac5700 1 --2- 172.21.15.84:0/1382608722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b640c6610 0x7f1b641548a0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.012+0000 7f1b6bac5700 1 -- 172.21.15.84:0/1382608722 >> 172.21.15.84:0/1382608722 conn(0x7f1b64099740 msgr2=0x7f1b640b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.012+0000 7f1b6bac5700 1 -- 172.21.15.84:0/1382608722 shutdown_connections 2023-10-06T03:02:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:08.012+0000 7f1b6bac5700 1 -- 172.21.15.84:0/1382608722 wait complete. 2023-10-06T03:02:08.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:08.025 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-10-06T03:02:08.047 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/ 2023-10-06T03:02:08.047 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4 2023-10-06T03:02:08.047 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5 2023-10-06T03:02:08.047 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6 2023-10-06T03:02:08.047 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7 2023-10-06T03:02:08.047 INFO:teuthology.orchestra.run.smithi084.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-10-06T03:02:08.047 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:08.048 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:02:08.048 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:02:08.048 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:02:08.048 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-10-06T03:02:08.048 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:02:08.150 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627778 2023-10-06T03:02:08.340 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:08.340 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:02:08.340 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:02:08.340 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:02:08.340 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-10-06T03:02:08.340 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:02:08.444 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627779 2023-10-06T03:02:08.633 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:08.633 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:02:08.633 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:02:08.633 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:02:08.633 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-10-06T03:02:08.633 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:02:08.737 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627780 2023-10-06T03:02:08.927 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:08.927 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:02:08.927 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:02:08.927 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:02:08.927 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-10-06T03:02:08.927 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:02:09.031 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627781 2023-10-06T03:02:09.220 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:09.221 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:02:09.221 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:02:09.221 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:02:09.221 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-10-06T03:02:09.221 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:02:09.324 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627782 2023-10-06T03:02:09.513 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:09.513 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-10-06T03:02:09.513 DEBUG:teuthology.orchestra.run.smithi084:> import stat 2023-10-06T03:02:09.514 DEBUG:teuthology.orchestra.run.smithi084:> 2023-10-06T03:02:09.514 DEBUG:teuthology.orchestra.run.smithi084:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-10-06T03:02:09.514 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-10-06T03:02:09.617 INFO:teuthology.orchestra.run.smithi084.stdout:1099511627783 2023-10-06T03:02:09.806 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2023-10-06T03:02:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.882+0000 7f64d09c9000 1 Processor -- start 2023-10-06T03:02:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.882+0000 7f64d09c9000 1 -- start start 2023-10-06T03:02:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.882+0000 7f64d09c9000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559441b2d120 0x559441b55a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.882+0000 7f64d09c9000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441b700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.882+0000 7f64d09c9000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559441b59690 0x559441b2bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.882+0000 7f64d09c9000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559441a75980 con 0x559441b592c0 2023-10-06T03:02:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.882+0000 7f64d09c9000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559441a75620 con 0x559441b59690 2023-10-06T03:02:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.882+0000 7f64d09c9000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559441a6c400 con 0x559441b2d120 2023-10-06T03:02:09.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9403700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441b700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9403700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441b700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47566/0 (socket says 172.21.15.84:47566) 2023-10-06T03:02:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9403700 1 -- 172.21.15.84:0/1150412260 learned_addr learned my addr 172.21.15.84:0/1150412260 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9c04700 1 --2- 172.21.15.84:0/1150412260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559441b2d120 0x559441b55a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64ca405700 1 --2- 172.21.15.84:0/1150412260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559441b59690 0x559441b2bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9403700 1 -- 172.21.15.84:0/1150412260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559441b2d120 msgr2=0x559441b55a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9403700 1 --2- 172.21.15.84:0/1150412260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559441b2d120 0x559441b55a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9403700 1 -- 172.21.15.84:0/1150412260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559441b59690 msgr2=0x559441b2bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9403700 1 --2- 172.21.15.84:0/1150412260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559441b59690 0x559441b2bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9403700 1 -- 172.21.15.84:0/1150412260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c400a0e0 con 0x559441b592c0 2023-10-06T03:02:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64c9403700 1 --2- 172.21.15.84:0/1150412260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441b700f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f64c00097d0 tx=0x7f64c000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c3642e68c2299f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64bbfff700 1 -- 172.21.15.84:0/1150412260 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000f040 con 0x559441b592c0 2023-10-06T03:02:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64bbfff700 1 -- 172.21.15.84:0/1150412260 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c0008700 con 0x559441b592c0 2023-10-06T03:02:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.883+0000 7f64bbfff700 1 -- 172.21.15.84:0/1150412260 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0008aa0 con 0x559441b592c0 2023-10-06T03:02:09.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 -- 172.21.15.84:0/1150412260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 msgr2=0x559441b700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 --2- 172.21.15.84:0/1150412260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441b700f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f64c00097d0 tx=0x7f64c000c040 comp rx=0 tx=0).stop 2023-10-06T03:02:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 -- 172.21.15.84:0/1150412260 shutdown_connections 2023-10-06T03:02:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 --2- 172.21.15.84:0/1150412260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559441b59690 0x559441b2bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 --2- 172.21.15.84:0/1150412260 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559441b2d120 0x559441b55a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 --2- 172.21.15.84:0/1150412260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441b700f0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 -- 172.21.15.84:0/1150412260 >> 172.21.15.84:0/1150412260 conn(0x559441b2b7d0 msgr2=0x559441b57c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 -- 172.21.15.84:0/1150412260 shutdown_connections 2023-10-06T03:02:09.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 -- 172.21.15.84:0/1150412260 wait complete. 2023-10-06T03:02:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 Processor -- start 2023-10-06T03:02:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.884+0000 7f64d09c9000 1 -- start start 2023-10-06T03:02:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64d09c9000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559441b2d120 0x559441b558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64d09c9000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441be5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64d09c9000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559441b59690 0x559441bfaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64d09c9000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559441b58010 con 0x559441b592c0 2023-10-06T03:02:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64d09c9000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559441bf93e0 con 0x559441b59690 2023-10-06T03:02:09.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64d09c9000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559441bf9680 con 0x559441b2d120 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64c9403700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441be5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64c9403700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441be5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47570/0 (socket says 172.21.15.84:47570) 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64c9403700 1 -- 172.21.15.84:0/2378553691 learned_addr learned my addr 172.21.15.84:0/2378553691 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64c9c04700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559441b2d120 0x559441b558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64ca405700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559441b59690 0x559441bfaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64c9403700 1 -- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559441b2d120 msgr2=0x559441b558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64c9403700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559441b2d120 0x559441b558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64c9403700 1 -- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559441b59690 msgr2=0x559441bfaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64c9403700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559441b59690 0x559441bfaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.885+0000 7f64c9403700 1 -- 172.21.15.84:0/2378553691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c0009430 con 0x559441b592c0 2023-10-06T03:02:09.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.886+0000 7f64c9403700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441be5140 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009dc0 tx=0x7f64c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.886+0000 7f64ba7fc700 1 -- 172.21.15.84:0/2378553691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000f070 con 0x559441b592c0 2023-10-06T03:02:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.886+0000 7f64ba7fc700 1 -- 172.21.15.84:0/2378553691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c0013860 con 0x559441b592c0 2023-10-06T03:02:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.886+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559441a843d0 con 0x559441b592c0 2023-10-06T03:02:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.886+0000 7f64ba7fc700 1 -- 172.21.15.84:0/2378553691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0013c00 con 0x559441b592c0 2023-10-06T03:02:09.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.886+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559441a77ae0 con 0x559441b592c0 2023-10-06T03:02:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.887+0000 7f64ba7fc700 1 -- 172.21.15.84:0/2378553691 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64c0023070 con 0x559441b592c0 2023-10-06T03:02:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.887+0000 7f64ba7fc700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64ac065890 0x7f64ac067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.887+0000 7f64ba7fc700 1 -- 172.21.15.84:0/2378553691 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f64c00852a0 con 0x559441b592c0 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.887+0000 7f64c9c04700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64ac065890 0x7f64ac067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.888+0000 7f64d09c9000 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559441bf7cc0 0x559441bf80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.888+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- osd_op(unknown.0.0:1 16.12 16:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x559441bf8600 con 0x559441bf7cc0 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.888+0000 7f64c9c04700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64ac065890 0x7f64ac067d40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f64bc000c00 tx=0x7f64bc001730 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.888+0000 7f64ca405700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559441bf7cc0 0x559441bf80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.888+0000 7f64ca405700 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559441bf7cc0 0x559441bf80c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.889+0000 7f64ca405700 1 -- 172.21.15.84:0/2378553691 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v108'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f64c4023040 con 0x559441bf7cc0 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.889+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559441bf7cc0 msgr2=0x559441bf80c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.889+0000 7f64d09c9000 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x559441bf7cc0 0x559441bf80c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.890+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64ac065890 msgr2=0x7f64ac067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.890+0000 7f64d09c9000 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f64ac065890 0x7f64ac067d40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f64bc000c00 tx=0x7f64bc001730 comp rx=0 tx=0).stop 2023-10-06T03:02:09.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.890+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 msgr2=0x559441be5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.890+0000 7f64d09c9000 1 --2- 172.21.15.84:0/2378553691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559441b592c0 0x559441be5140 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009dc0 tx=0x7f64c0018000 comp rx=0 tx=0).stop 2023-10-06T03:02:09.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.890+0000 7f64ca405700 1 -- 172.21.15.84:0/2378553691 reap_dead start 2023-10-06T03:02:09.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.890+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 shutdown_connections 2023-10-06T03:02:09.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.890+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 >> 172.21.15.84:0/2378553691 conn(0x559441b2b7d0 msgr2=0x559441b700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:09.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.890+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 shutdown_connections 2023-10-06T03:02:09.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.890+0000 7f64d09c9000 1 -- 172.21.15.84:0/2378553691 wait complete. 2023-10-06T03:02:09.898 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2023-10-06T03:02:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.973+0000 7f4560a6e000 1 Processor -- start 2023-10-06T03:02:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f4560a6e000 1 -- start start 2023-10-06T03:02:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f4560a6e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4d3b3e2c0 0x55d4d3b3cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f4560a6e000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3ef60 0x55d4d3be67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f4560a6e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 0x55d4d3be6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f4560a6e000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4d3a5b980 con 0x55d4d3b3ef60 2023-10-06T03:02:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f4560a6e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4d3a5b620 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f4560a6e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4d3a52400 con 0x55d4d3bdf6b0 2023-10-06T03:02:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f45514a8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3ef60 0x55d4d3be67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f45514a8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3ef60 0x55d4d3be67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47574/0 (socket says 172.21.15.84:47574) 2023-10-06T03:02:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f45514a8700 1 -- 172.21.15.84:0/647339620 learned_addr learned my addr 172.21.15.84:0/647339620 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f4559ca9700 1 --2- 172.21.15.84:0/647339620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4d3b3e2c0 0x55d4d3b3cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.974+0000 7f455a4aa700 1 --2- 172.21.15.84:0/647339620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 0x55d4d3be6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f45514a8700 1 -- 172.21.15.84:0/647339620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 msgr2=0x55d4d3be6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f45514a8700 1 --2- 172.21.15.84:0/647339620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 0x55d4d3be6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f45514a8700 1 -- 172.21.15.84:0/647339620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4d3b3e2c0 msgr2=0x55d4d3b3cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f45514a8700 1 --2- 172.21.15.84:0/647339620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4d3b3e2c0 0x55d4d3b3cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f45514a8700 1 -- 172.21.15.84:0/647339620 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455400a0e0 con 0x55d4d3b3ef60 2023-10-06T03:02:09.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f45514a8700 1 --2- 172.21.15.84:0/647339620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3ef60 0x55d4d3be67d0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f4544007610 tx=0x7f4544015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73784b76ef657416 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4558ca7700 1 -- 172.21.15.84:0/647339620 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544000bc0 con 0x55d4d3b3ef60 2023-10-06T03:02:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4558ca7700 1 -- 172.21.15.84:0/647339620 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45440078e0 con 0x55d4d3b3ef60 2023-10-06T03:02:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4558ca7700 1 -- 172.21.15.84:0/647339620 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544000d20 con 0x55d4d3b3ef60 2023-10-06T03:02:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4560a6e000 1 -- 172.21.15.84:0/647339620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3ef60 msgr2=0x55d4d3be67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4560a6e000 1 --2- 172.21.15.84:0/647339620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3ef60 0x55d4d3be67d0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f4544007610 tx=0x7f4544015000 comp rx=0 tx=0).stop 2023-10-06T03:02:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4560a6e000 1 -- 172.21.15.84:0/647339620 shutdown_connections 2023-10-06T03:02:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4560a6e000 1 --2- 172.21.15.84:0/647339620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4d3b3e2c0 0x55d4d3b3cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4560a6e000 1 --2- 172.21.15.84:0/647339620 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 0x55d4d3be6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4560a6e000 1 --2- 172.21.15.84:0/647339620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3ef60 0x55d4d3be67d0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4560a6e000 1 -- 172.21.15.84:0/647339620 >> 172.21.15.84:0/647339620 conn(0x55d4d3b117d0 msgr2=0x55d4d3b3c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.975+0000 7f4560a6e000 1 -- 172.21.15.84:0/647339620 shutdown_connections 2023-10-06T03:02:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.976+0000 7f4560a6e000 1 -- 172.21.15.84:0/647339620 wait complete. 2023-10-06T03:02:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.976+0000 7f4560a6e000 1 Processor -- start 2023-10-06T03:02:09.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.976+0000 7f4560a6e000 1 -- start start 2023-10-06T03:02:09.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4560a6e000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3e2c0 0x55d4d3bd9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4560a6e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4d3b3ef60 0x55d4d3b59740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4560a6e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 0x55d4d3bd8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4560a6e000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4d3bd9390 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4560a6e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4d3bd9630 con 0x55d4d3b3ef60 2023-10-06T03:02:09.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4560a6e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4d3be0230 con 0x55d4d3bdf6b0 2023-10-06T03:02:09.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4559ca9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3e2c0 0x55d4d3bd9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4559ca9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3e2c0 0x55d4d3bd9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47588/0 (socket says 172.21.15.84:47588) 2023-10-06T03:02:09.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4559ca9700 1 -- 172.21.15.84:0/3497176557 learned_addr learned my addr 172.21.15.84:0/3497176557 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:09.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f45514a8700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4d3b3ef60 0x55d4d3b59740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f455a4aa700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 0x55d4d3bd8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4559ca9700 1 -- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 msgr2=0x55d4d3bd8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4559ca9700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 0x55d4d3bd8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4559ca9700 1 -- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4d3b3ef60 msgr2=0x55d4d3b59740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4559ca9700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4d3b3ef60 0x55d4d3b59740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4559ca9700 1 -- 172.21.15.84:0/3497176557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4d3a841c0 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f455a4aa700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d4d3bdf6b0 0x55d4d3bd8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4559ca9700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3e2c0 0x55d4d3bd9d70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f454c00efd0 tx=0x7f454c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4552ffd700 1 -- 172.21.15.84:0/3497176557 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c00f450 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4552ffd700 1 -- 172.21.15.84:0/3497176557 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c00f5b0 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4544005cf0 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.977+0000 7f4552ffd700 1 -- 172.21.15.84:0/3497176557 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c00f740 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.978+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4d3a6a3d0 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.979+0000 7f4552ffd700 1 -- 172.21.15.84:0/3497176557 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f454c015020 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.979+0000 7f4552ffd700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f453c0658c0 0x7f453c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.979+0000 7f4552ffd700 1 -- 172.21.15.84:0/3497176557 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f454c0836d0 con 0x55d4d3b3e2c0 2023-10-06T03:02:09.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.979+0000 7f45514a8700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f453c0658c0 0x7f453c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.979+0000 7f4560a6e000 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x55d4d3bdfa80 0x55d4d3c00f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:09.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.979+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- osd_op(unknown.0.0:1 16.12 16:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55d4d3c014b0 con 0x55d4d3bdfa80 2023-10-06T03:02:09.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.980+0000 7f455a4aa700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x55d4d3bdfa80 0x55d4d3c00f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:09.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.980+0000 7f45514a8700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f453c0658c0 0x7f453c067d70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f454401e040 tx=0x7f454401c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:09.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.980+0000 7f455a4aa700 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x55d4d3bdfa80 0x55d4d3c00f70 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:09.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f455a4aa700 1 -- 172.21.15.84:0/3497176557 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v108'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f455400ad50 con 0x55d4d3bdfa80 2023-10-06T03:02:09.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x55d4d3bdfa80 msgr2=0x55d4d3c00f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x55d4d3bdfa80 0x55d4d3c00f70 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f453c0658c0 msgr2=0x7f453c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f453c0658c0 0x7f453c067d70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f454401e040 tx=0x7f454401c000 comp rx=0 tx=0).stop 2023-10-06T03:02:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3e2c0 msgr2=0x55d4d3bd9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 --2- 172.21.15.84:0/3497176557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d4d3b3e2c0 0x55d4d3bd9d70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f454c00efd0 tx=0x7f454c000bc0 comp rx=0 tx=0).stop 2023-10-06T03:02:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f455a4aa700 1 -- 172.21.15.84:0/3497176557 reap_dead start 2023-10-06T03:02:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 shutdown_connections 2023-10-06T03:02:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 >> 172.21.15.84:0/3497176557 conn(0x55d4d3b117d0 msgr2=0x55d4d3b3c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 shutdown_connections 2023-10-06T03:02:09.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:09.981+0000 7f4560a6e000 1 -- 172.21.15.84:0/3497176557 wait complete. 2023-10-06T03:02:09.990 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2023-10-06T03:02:10.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.062+0000 7f6c2a546000 1 Processor -- start 2023-10-06T03:02:10.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.062+0000 7f6c2a546000 1 -- start start 2023-10-06T03:02:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c2a546000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56292b190080 0x56292b237200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c2a546000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56292b1aa510 0x56292b15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c2a546000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b233f50 0x56292b236890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c2a546000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56292b0ab980 con 0x56292b233f50 2023-10-06T03:02:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c2a546000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56292b0ab620 con 0x56292b190080 2023-10-06T03:02:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c2a546000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56292b0a2400 con 0x56292b1aa510 2023-10-06T03:02:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c23f82700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b233f50 0x56292b236890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c23f82700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b233f50 0x56292b236890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47612/0 (socket says 172.21.15.84:47612) 2023-10-06T03:02:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c23f82700 1 -- 172.21.15.84:0/3324167489 learned_addr learned my addr 172.21.15.84:0/3324167489 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c23f82700 1 -- 172.21.15.84:0/3324167489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56292b1aa510 msgr2=0x56292b15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c23f82700 1 --2- 172.21.15.84:0/3324167489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56292b1aa510 0x56292b15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c23f82700 1 -- 172.21.15.84:0/3324167489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56292b190080 msgr2=0x56292b237200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c23f82700 1 --2- 172.21.15.84:0/3324167489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56292b190080 0x56292b237200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c23f82700 1 -- 172.21.15.84:0/3324167489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c18005cf0 con 0x56292b233f50 2023-10-06T03:02:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c23f82700 1 --2- 172.21.15.84:0/3324167489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b233f50 0x56292b236890 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009780 tx=0x7f6c1c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445721295728dd8c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c21f7e700 1 -- 172.21.15.84:0/3324167489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c00f040 con 0x56292b233f50 2023-10-06T03:02:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c21f7e700 1 -- 172.21.15.84:0/3324167489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c0087e0 con 0x56292b233f50 2023-10-06T03:02:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.063+0000 7f6c21f7e700 1 -- 172.21.15.84:0/3324167489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c008b80 con 0x56292b233f50 2023-10-06T03:02:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 -- 172.21.15.84:0/3324167489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b233f50 msgr2=0x56292b236890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 --2- 172.21.15.84:0/3324167489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b233f50 0x56292b236890 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009780 tx=0x7f6c1c00c040 comp rx=0 tx=0).stop 2023-10-06T03:02:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 -- 172.21.15.84:0/3324167489 shutdown_connections 2023-10-06T03:02:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 --2- 172.21.15.84:0/3324167489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56292b190080 0x56292b237200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 --2- 172.21.15.84:0/3324167489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b233f50 0x56292b236890 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 --2- 172.21.15.84:0/3324167489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56292b1aa510 0x56292b15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 -- 172.21.15.84:0/3324167489 >> 172.21.15.84:0/3324167489 conn(0x56292b1615d0 msgr2=0x56292b18b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 -- 172.21.15.84:0/3324167489 shutdown_connections 2023-10-06T03:02:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 -- 172.21.15.84:0/3324167489 wait complete. 2023-10-06T03:02:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.064+0000 7f6c2a546000 1 Processor -- start 2023-10-06T03:02:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c2a546000 1 -- start start 2023-10-06T03:02:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c2a546000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b190080 0x56292b184360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c2a546000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56292b1aa510 0x56292b2309d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c2a546000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56292b233f50 0x56292b184e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c2a546000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56292b1839c0 con 0x56292b190080 2023-10-06T03:02:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c2a546000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56292b185880 con 0x56292b233f50 2023-10-06T03:02:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c2a546000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56292b183c20 con 0x56292b1aa510 2023-10-06T03:02:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c23781700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b190080 0x56292b184360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c23781700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b190080 0x56292b184360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47614/0 (socket says 172.21.15.84:47614) 2023-10-06T03:02:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c23781700 1 -- 172.21.15.84:0/3056652461 learned_addr learned my addr 172.21.15.84:0/3056652461 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c22f80700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56292b1aa510 0x56292b2309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.065+0000 7f6c23f82700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56292b233f50 0x56292b184e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c23781700 1 -- 172.21.15.84:0/3056652461 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56292b1aa510 msgr2=0x56292b2309d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c23781700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56292b1aa510 0x56292b2309d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c23781700 1 -- 172.21.15.84:0/3056652461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56292b233f50 msgr2=0x56292b184e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c23781700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56292b233f50 0x56292b184e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c23781700 1 -- 172.21.15.84:0/3056652461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c009430 con 0x56292b190080 2023-10-06T03:02:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c22f80700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56292b1aa510 0x56292b2309d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c23781700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b190080 0x56292b184360 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400b490 tx=0x7f6c14006bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c0bfff700 1 -- 172.21.15.84:0/3056652461 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1400be70 con 0x56292b190080 2023-10-06T03:02:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c0bfff700 1 -- 172.21.15.84:0/3056652461 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14002090 con 0x56292b190080 2023-10-06T03:02:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56292b0ba3d0 con 0x56292b190080 2023-10-06T03:02:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c0bfff700 1 -- 172.21.15.84:0/3056652461 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c140044c0 con 0x56292b190080 2023-10-06T03:02:10.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.066+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56292b0adae0 con 0x56292b190080 2023-10-06T03:02:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.067+0000 7f6c0bfff700 1 -- 172.21.15.84:0/3056652461 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c140048f0 con 0x56292b190080 2023-10-06T03:02:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.067+0000 7f6c0bfff700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c100658c0 0x7f6c10067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.068+0000 7f6c0bfff700 1 -- 172.21.15.84:0/3056652461 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f6c14082860 con 0x56292b190080 2023-10-06T03:02:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.068+0000 7f6c22f80700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c100658c0 0x7f6c10067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.068+0000 7f6c2a546000 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x56292b185360 0x56292b1828a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.068+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- osd_op(unknown.0.0:1 16.5 16:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x56292b182de0 con 0x56292b185360 2023-10-06T03:02:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.068+0000 7f6c23f82700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x56292b185360 0x56292b1828a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.068+0000 7f6c22f80700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c100658c0 0x7f6c10067d70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6c18005a90 tx=0x7f6c18016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.068+0000 7f6c23f82700 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x56292b185360 0x56292b1828a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c23f82700 1 -- 172.21.15.84:0/3056652461 <== osd.0 v2:172.21.15.84:6808/90632 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v108'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6c1c019020 con 0x56292b185360 2023-10-06T03:02:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x56292b185360 msgr2=0x56292b1828a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x56292b185360 0x56292b1828a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c100658c0 msgr2=0x7f6c10067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6c100658c0 0x7f6c10067d70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6c18005a90 tx=0x7f6c18016000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b190080 msgr2=0x56292b184360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 --2- 172.21.15.84:0/3056652461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56292b190080 0x56292b184360 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400b490 tx=0x7f6c14006bf0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c23f82700 1 -- 172.21.15.84:0/3056652461 reap_dead start 2023-10-06T03:02:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 shutdown_connections 2023-10-06T03:02:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 >> 172.21.15.84:0/3056652461 conn(0x56292b1615d0 msgr2=0x56292b1a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 shutdown_connections 2023-10-06T03:02:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.070+0000 7f6c2a546000 1 -- 172.21.15.84:0/3056652461 wait complete. 2023-10-06T03:02:10.080 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2023-10-06T03:02:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.153+0000 7f0a52b91000 1 Processor -- start 2023-10-06T03:02:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a52b91000 1 -- start start 2023-10-06T03:02:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a52b91000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eaad8be0 0x5601eabb49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a52b91000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eab03e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a52b91000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5601eab1d350 0x5601eab1f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a52b91000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601eaa21980 con 0x5601eab052c0 2023-10-06T03:02:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a52b91000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601eaa21620 con 0x5601eaad8be0 2023-10-06T03:02:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a52b91000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5601eaa18400 con 0x5601eab1d350 2023-10-06T03:02:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a4b5cb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eab03e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a4b5cb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eab03e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47626/0 (socket says 172.21.15.84:47626) 2023-10-06T03:02:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a4b5cb700 1 -- 172.21.15.84:0/3786456639 learned_addr learned my addr 172.21.15.84:0/3786456639 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.154+0000 7f0a4bdcc700 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eaad8be0 0x5601eabb49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4c5cd700 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5601eab1d350 0x5601eab1f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4b5cb700 1 -- 172.21.15.84:0/3786456639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5601eab1d350 msgr2=0x5601eab1f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4b5cb700 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5601eab1d350 0x5601eab1f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4b5cb700 1 -- 172.21.15.84:0/3786456639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eaad8be0 msgr2=0x5601eabb49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4b5cb700 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eaad8be0 0x5601eabb49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4b5cb700 1 -- 172.21.15.84:0/3786456639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c005cf0 con 0x5601eab052c0 2023-10-06T03:02:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4bdcc700 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eaad8be0 0x5601eabb49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4b5cb700 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eab03e60 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x5601eab03090 tx=0x7f0a40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a277e8f752e2703d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4a5c9700 1 -- 172.21.15.84:0/3786456639 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40000bc0 con 0x5601eab052c0 2023-10-06T03:02:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4a5c9700 1 -- 172.21.15.84:0/3786456639 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40008970 con 0x5601eab052c0 2023-10-06T03:02:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a4a5c9700 1 -- 172.21.15.84:0/3786456639 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4001c410 con 0x5601eab052c0 2023-10-06T03:02:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a52b91000 1 -- 172.21.15.84:0/3786456639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 msgr2=0x5601eab03e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a52b91000 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eab03e60 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x5601eab03090 tx=0x7f0a40016000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a52b91000 1 -- 172.21.15.84:0/3786456639 shutdown_connections 2023-10-06T03:02:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a52b91000 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eaad8be0 0x5601eabb49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a52b91000 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5601eab1d350 0x5601eab1f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a52b91000 1 --2- 172.21.15.84:0/3786456639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eab03e60 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a52b91000 1 -- 172.21.15.84:0/3786456639 >> 172.21.15.84:0/3786456639 conn(0x5601eaad77d0 msgr2=0x5601eaad8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a52b91000 1 -- 172.21.15.84:0/3786456639 shutdown_connections 2023-10-06T03:02:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.155+0000 7f0a52b91000 1 -- 172.21.15.84:0/3786456639 wait complete. 2023-10-06T03:02:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.156+0000 7f0a52b91000 1 Processor -- start 2023-10-06T03:02:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.156+0000 7f0a52b91000 1 -- start start 2023-10-06T03:02:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a52b91000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5601eaad8be0 0x5601eaba3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a52b91000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eabafb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a52b91000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eab1d350 0x5601eabb0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a52b91000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601eabb37c0 con 0x5601eab052c0 2023-10-06T03:02:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a52b91000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601eabb3a60 con 0x5601eab1d350 2023-10-06T03:02:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a52b91000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5601eabb3d00 con 0x5601eaad8be0 2023-10-06T03:02:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4b5cb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eabafb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4b5cb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eabafb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47634/0 (socket says 172.21.15.84:47634) 2023-10-06T03:02:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4b5cb700 1 -- 172.21.15.84:0/858736537 learned_addr learned my addr 172.21.15.84:0/858736537 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4c5cd700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eab1d350 0x5601eabb0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4bdcc700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5601eaad8be0 0x5601eaba3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4b5cb700 1 -- 172.21.15.84:0/858736537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5601eaad8be0 msgr2=0x5601eaba3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4b5cb700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5601eaad8be0 0x5601eaba3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4b5cb700 1 -- 172.21.15.84:0/858736537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eab1d350 msgr2=0x5601eabb0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4b5cb700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eab1d350 0x5601eabb0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4b5cb700 1 -- 172.21.15.84:0/858736537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601eaa4a1c0 con 0x5601eab052c0 2023-10-06T03:02:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4c5cd700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5601eab1d350 0x5601eabb0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a4b5cb700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eabafb20 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f0a40020040 tx=0x7f0a4001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a48dc6700 1 -- 172.21.15.84:0/858736537 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40000c90 con 0x5601eab052c0 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a48dc6700 1 -- 172.21.15.84:0/858736537 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40026660 con 0x5601eab052c0 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a48dc6700 1 -- 172.21.15.84:0/858736537 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40026a20 con 0x5601eab052c0 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a40005cf0 con 0x5601eab052c0 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.157+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601eaa303d0 con 0x5601eab052c0 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.159+0000 7f0a48dc6700 1 -- 172.21.15.84:0/858736537 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a40039450 con 0x5601eab052c0 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.159+0000 7f0a48dc6700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a380658c0 0x7f0a38067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.159+0000 7f0a48dc6700 1 -- 172.21.15.84:0/858736537 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f0a40086b70 con 0x5601eab052c0 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.159+0000 7f0a4bdcc700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a380658c0 0x7f0a38067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.159+0000 7f0a52b91000 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x5601eabb0c60 0x5601eab1ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.159+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 --> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] -- osd_op(unknown.0.0:1 16.9 16:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x5601eab1b2a0 con 0x5601eabb0c60 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.159+0000 7f0a4c5cd700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x5601eabb0c60 0x5601eab1ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.159+0000 7f0a4bdcc700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a380658c0 0x7f0a38067d70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c005cc0 tx=0x7f0a3c005a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.160+0000 7f0a4c5cd700 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x5601eabb0c60 0x5601eab1ad60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a4c5cd700 1 -- 172.21.15.84:0/858736537 <== osd.1 v2:172.21.15.84:6816/90643 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v108'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0a44001630 con 0x5601eabb0c60 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x5601eabb0c60 msgr2=0x5601eab1ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x5601eabb0c60 0x5601eab1ad60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a380658c0 msgr2=0x7f0a38067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0a380658c0 0x7f0a38067d70 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c005cc0 tx=0x7f0a3c005a50 comp rx=0 tx=0).stop 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 msgr2=0x5601eabafb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 --2- 172.21.15.84:0/858736537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5601eab052c0 0x5601eabafb20 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f0a40020040 tx=0x7f0a4001d000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a4c5cd700 1 -- 172.21.15.84:0/858736537 reap_dead start 2023-10-06T03:02:10.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 shutdown_connections 2023-10-06T03:02:10.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 >> 172.21.15.84:0/858736537 conn(0x5601eaad77d0 msgr2=0x5601eab00eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 shutdown_connections 2023-10-06T03:02:10.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.161+0000 7f0a52b91000 1 -- 172.21.15.84:0/858736537 wait complete. 2023-10-06T03:02:10.170 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2023-10-06T03:02:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.241+0000 7f0b23b54000 1 Processor -- start 2023-10-06T03:02:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.241+0000 7f0b23b54000 1 -- start start 2023-10-06T03:02:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b23b54000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x5648435bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b23b54000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564843590be0 0x56484365b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b23b54000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56484365c4a0 0x56484365ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b23b54000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648434d9980 con 0x56484357c8e0 2023-10-06T03:02:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b23b54000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648434d9620 con 0x56484365c4a0 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b23b54000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648434d0400 con 0x564843590be0 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b1cd8f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x5648435bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b1cd8f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x5648435bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47650/0 (socket says 172.21.15.84:47650) 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b1cd8f700 1 -- 172.21.15.84:0/1023178901 learned_addr learned my addr 172.21.15.84:0/1023178901 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b17fff700 1 --2- 172.21.15.84:0/1023178901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564843590be0 0x56484365b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b1d590700 1 --2- 172.21.15.84:0/1023178901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56484365c4a0 0x56484365ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b1cd8f700 1 -- 172.21.15.84:0/1023178901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564843590be0 msgr2=0x56484365b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b1cd8f700 1 --2- 172.21.15.84:0/1023178901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564843590be0 0x56484365b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b1cd8f700 1 -- 172.21.15.84:0/1023178901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56484365c4a0 msgr2=0x56484365ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b1cd8f700 1 --2- 172.21.15.84:0/1023178901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56484365c4a0 0x56484365ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.242+0000 7f0b1cd8f700 1 -- 172.21.15.84:0/1023178901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08005db0 con 0x56484357c8e0 2023-10-06T03:02:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b1cd8f700 1 --2- 172.21.15.84:0/1023178901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x5648435bd110 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000a480 tx=0x7f0b100059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984fdd55655b22fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b16ffd700 1 -- 172.21.15.84:0/1023178901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000c610 con 0x56484357c8e0 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b16ffd700 1 -- 172.21.15.84:0/1023178901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000c790 con 0x56484357c8e0 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b16ffd700 1 -- 172.21.15.84:0/1023178901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000cb50 con 0x56484357c8e0 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b23b54000 1 -- 172.21.15.84:0/1023178901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 msgr2=0x5648435bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b23b54000 1 --2- 172.21.15.84:0/1023178901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x5648435bd110 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000a480 tx=0x7f0b100059d0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b23b54000 1 -- 172.21.15.84:0/1023178901 shutdown_connections 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b23b54000 1 --2- 172.21.15.84:0/1023178901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56484365c4a0 0x56484365ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b23b54000 1 --2- 172.21.15.84:0/1023178901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x5648435bd110 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b23b54000 1 --2- 172.21.15.84:0/1023178901 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564843590be0 0x56484365b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b23b54000 1 -- 172.21.15.84:0/1023178901 >> 172.21.15.84:0/1023178901 conn(0x56484358f7d0 msgr2=0x5648435ba6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b23b54000 1 -- 172.21.15.84:0/1023178901 shutdown_connections 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.243+0000 7f0b23b54000 1 -- 172.21.15.84:0/1023178901 wait complete. 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.244+0000 7f0b23b54000 1 Processor -- start 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.244+0000 7f0b23b54000 1 -- start start 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.244+0000 7f0b23b54000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x56484364f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.244+0000 7f0b23b54000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564843590be0 0x56484365e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.244+0000 7f0b23b54000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56484365c4a0 0x56484365e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.244+0000 7f0b23b54000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648435b9b70 con 0x56484357c8e0 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.244+0000 7f0b23b54000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484364f910 con 0x564843590be0 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.244+0000 7f0b23b54000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56484365edd0 con 0x56484365c4a0 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.244+0000 7f0b1cd8f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x56484364f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b1cd8f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x56484364f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47658/0 (socket says 172.21.15.84:47658) 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b1cd8f700 1 -- 172.21.15.84:0/853967680 learned_addr learned my addr 172.21.15.84:0/853967680 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b1d590700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56484365c4a0 0x56484365e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b17fff700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564843590be0 0x56484365e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b1cd8f700 1 -- 172.21.15.84:0/853967680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56484365c4a0 msgr2=0x56484365e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b1cd8f700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x56484365c4a0 0x56484365e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b1cd8f700 1 -- 172.21.15.84:0/853967680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564843590be0 msgr2=0x56484365e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b1cd8f700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564843590be0 0x56484365e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b1cd8f700 1 -- 172.21.15.84:0/853967680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10005c90 con 0x56484357c8e0 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b1cd8f700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x56484364f3d0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000abd0 tx=0x7f0b10015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b157fa700 1 -- 172.21.15.84:0/853967680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000c610 con 0x56484357c8e0 2023-10-06T03:02:10.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b157fa700 1 -- 172.21.15.84:0/853967680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b10016b60 con 0x56484357c8e0 2023-10-06T03:02:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648434e83d0 con 0x56484357c8e0 2023-10-06T03:02:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b157fa700 1 -- 172.21.15.84:0/853967680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10021400 con 0x56484357c8e0 2023-10-06T03:02:10.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.245+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648434dbae0 con 0x56484357c8e0 2023-10-06T03:02:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.246+0000 7f0b157fa700 1 -- 172.21.15.84:0/853967680 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b10007050 con 0x56484357c8e0 2023-10-06T03:02:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.247+0000 7f0b157fa700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0b00065890 0x7f0b00067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.247+0000 7f0b157fa700 1 -- 172.21.15.84:0/853967680 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f0b10084880 con 0x56484357c8e0 2023-10-06T03:02:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.247+0000 7f0b17fff700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0b00065890 0x7f0b00067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.247+0000 7f0b23b54000 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564843671bb0 0x564843671fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.247+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- osd_op(unknown.0.0:1 16.5 16:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x5648436724f0 con 0x564843671bb0 2023-10-06T03:02:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.247+0000 7f0b1d590700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564843671bb0 0x564843671fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.247+0000 7f0b17fff700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0b00065890 0x7f0b00067d40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0b080030c0 tx=0x7f0b08018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.247+0000 7f0b1d590700 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564843671bb0 0x564843671fb0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b1d590700 1 -- 172.21.15.84:0/853967680 <== osd.0 v2:172.21.15.84:6808/90632 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v108'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0b1800d9b0 con 0x564843671bb0 2023-10-06T03:02:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564843671bb0 msgr2=0x564843671fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x564843671bb0 0x564843671fb0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0b00065890 msgr2=0x7f0b00067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0b00065890 0x7f0b00067d40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0b080030c0 tx=0x7f0b08018000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 msgr2=0x56484364f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 --2- 172.21.15.84:0/853967680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56484357c8e0 0x56484364f3d0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000abd0 tx=0x7f0b10015000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b1d590700 1 -- 172.21.15.84:0/853967680 reap_dead start 2023-10-06T03:02:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 shutdown_connections 2023-10-06T03:02:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 >> 172.21.15.84:0/853967680 conn(0x56484358f7d0 msgr2=0x564843661f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 shutdown_connections 2023-10-06T03:02:10.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.249+0000 7f0b23b54000 1 -- 172.21.15.84:0/853967680 wait complete. 2023-10-06T03:02:10.257 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2023-10-06T03:02:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.331+0000 7f70829a2000 1 Processor -- start 2023-10-06T03:02:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.331+0000 7f70829a2000 1 -- start start 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70829a2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 0x55bec158d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70829a2000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec158fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70829a2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 0x55bec15a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70829a2000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec14ad980 con 0x55bec15912c0 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70829a2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec14ad620 con 0x55bec15652f0 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70829a2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bec14a4400 con 0x55bec15a9350 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70733dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec158fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70733dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec158fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47686/0 (socket says 172.21.15.84:47686) 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70733dc700 1 -- 172.21.15.84:0/3770277858 learned_addr learned my addr 172.21.15.84:0/3770277858 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f707bbdd700 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 0x55bec158d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f707c3de700 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 0x55bec15a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70733dc700 1 -- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 msgr2=0x55bec15a5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70733dc700 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 0x55bec15a5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70733dc700 1 -- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 msgr2=0x55bec158d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70733dc700 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 0x55bec158d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70733dc700 1 -- 172.21.15.84:0/3770277858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707400a180 con 0x55bec15912c0 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f707c3de700 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 0x55bec15a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f707bbdd700 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 0x55bec158d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.332+0000 7f70733dc700 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec158fe70 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f7064001d70 tx=0x7f7064001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785e42e6877d0dd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f707abdb700 1 -- 172.21.15.84:0/3770277858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064014070 con 0x55bec15912c0 2023-10-06T03:02:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f707abdb700 1 -- 172.21.15.84:0/3770277858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7064008030 con 0x55bec15912c0 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f707abdb700 1 -- 172.21.15.84:0/3770277858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400bda0 con 0x55bec15912c0 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f70829a2000 1 -- 172.21.15.84:0/3770277858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 msgr2=0x55bec158fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f70829a2000 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec158fe70 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f7064001d70 tx=0x7f7064001810 comp rx=0 tx=0).stop 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f70829a2000 1 -- 172.21.15.84:0/3770277858 shutdown_connections 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f70829a2000 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 0x55bec158d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f70829a2000 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 0x55bec15a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f70829a2000 1 --2- 172.21.15.84:0/3770277858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec158fe70 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f70829a2000 1 -- 172.21.15.84:0/3770277858 >> 172.21.15.84:0/3770277858 conn(0x55bec15637d0 msgr2=0x55bec163b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f70829a2000 1 -- 172.21.15.84:0/3770277858 shutdown_connections 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.333+0000 7f70829a2000 1 -- 172.21.15.84:0/3770277858 wait complete. 2023-10-06T03:02:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.334+0000 7f70829a2000 1 Processor -- start 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.334+0000 7f70829a2000 1 -- start start 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.334+0000 7f70829a2000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 0x55bec1630530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.334+0000 7f70829a2000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec15a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.334+0000 7f70829a2000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 0x55bec16376c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.334+0000 7f70829a2000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec16360a0 con 0x55bec15912c0 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.334+0000 7f70829a2000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec15a6ee0 con 0x55bec15652f0 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.334+0000 7f70829a2000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bec15a7180 con 0x55bec15a9350 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70733dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec15a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70733dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec15a78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47698/0 (socket says 172.21.15.84:47698) 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70733dc700 1 -- 172.21.15.84:0/2460834975 learned_addr learned my addr 172.21.15.84:0/2460834975 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f707c3de700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 0x55bec16376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f707bbdd700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 0x55bec1630530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70733dc700 1 -- 172.21.15.84:0/2460834975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 msgr2=0x55bec16376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70733dc700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bec15a9350 0x55bec16376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70733dc700 1 -- 172.21.15.84:0/2460834975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 msgr2=0x55bec1630530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70733dc700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 0x55bec1630530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70733dc700 1 -- 172.21.15.84:0/2460834975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706400a040 con 0x55bec15912c0 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f707bbdd700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bec15652f0 0x55bec1630530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70733dc700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec15a78c0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f7064000fd0 tx=0x7f7064016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70793d8700 1 -- 172.21.15.84:0/2460834975 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640014b0 con 0x55bec15912c0 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70793d8700 1 -- 172.21.15.84:0/2460834975 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7064021070 con 0x55bec15912c0 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70793d8700 1 -- 172.21.15.84:0/2460834975 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400fe00 con 0x55bec15912c0 2023-10-06T03:02:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bec14bc3d0 con 0x55bec15912c0 2023-10-06T03:02:10.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.335+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bec14afae0 con 0x55bec15912c0 2023-10-06T03:02:10.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.336+0000 7f70793d8700 1 -- 172.21.15.84:0/2460834975 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f706401a690 con 0x55bec15912c0 2023-10-06T03:02:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.337+0000 7f70793d8700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f705c0658c0 0x7f705c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.337+0000 7f70793d8700 1 -- 172.21.15.84:0/2460834975 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7064084d70 con 0x55bec15912c0 2023-10-06T03:02:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.337+0000 7f707bbdd700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f705c0658c0 0x7f705c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.337+0000 7f70829a2000 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55bec158fe70 0x55bec1590240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.337+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 --> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] -- osd_op(unknown.0.0:1 16.1d 16:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) v8 -- 0x55bec16353d0 con 0x55bec158fe70 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.337+0000 7f707c3de700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55bec158fe70 0x55bec1590240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.337+0000 7f707bbdd700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f705c0658c0 0x7f705c067d70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f706c005fd0 tx=0x7f706c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.337+0000 7f707c3de700 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55bec158fe70 0x55bec1590240 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.338+0000 7f707c3de700 1 -- 172.21.15.84:0/2460834975 <== osd.2 v2:172.21.15.84:6800/90631 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v108'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f707400e7e0 con 0x55bec158fe70 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.338+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55bec158fe70 msgr2=0x55bec1590240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.338+0000 7f70829a2000 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x55bec158fe70 0x55bec1590240 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.339+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f705c0658c0 msgr2=0x7f705c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.339+0000 7f70829a2000 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f705c0658c0 0x7f705c067d70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f706c005fd0 tx=0x7f706c00c040 comp rx=0 tx=0).stop 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.339+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 msgr2=0x55bec15a78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.339+0000 7f70829a2000 1 --2- 172.21.15.84:0/2460834975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec15912c0 0x55bec15a78c0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f7064000fd0 tx=0x7f7064016000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.339+0000 7f707c3de700 1 -- 172.21.15.84:0/2460834975 reap_dead start 2023-10-06T03:02:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.339+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 shutdown_connections 2023-10-06T03:02:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.339+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 >> 172.21.15.84:0/2460834975 conn(0x55bec15637d0 msgr2=0x55bec163b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.339+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 shutdown_connections 2023-10-06T03:02:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.339+0000 7f70829a2000 1 -- 172.21.15.84:0/2460834975 wait complete. 2023-10-06T03:02:10.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub start /d1/d2/d3 recursive,force 2023-10-06T03:02:10.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.501+0000 7f631745b700 1 Processor -- start 2023-10-06T03:02:10.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.501+0000 7f631745b700 1 -- start start 2023-10-06T03:02:10.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f631745b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63101539d0 0x7f631015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f631745b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f63100ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f631745b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63100cdc30 con 0x7f63100ccab0 2023-10-06T03:02:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f631745b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63100cb500 con 0x7f63101539d0 2023-10-06T03:02:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f631745b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631015a8f0 con 0x7f63100d0a00 2023-10-06T03:02:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f6316459700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63101539d0 0x7f631015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f6315c58700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f63100ccab0 0x7f63100d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58428/0 (socket says 172.21.15.84:58428) 2023-10-06T03:02:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f6315c58700 1 -- 172.21.15.84:0/2188039967 learned_addr learned my addr 172.21.15.84:0/2188039967 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f6316c5a700 1 --2- 172.21.15.84:0/2188039967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f63100ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f6315457700 1 -- 172.21.15.84:0/2188039967 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104145500 0 0) 0x7f63100cdc30 con 0x7f63100ccab0 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f6315457700 1 -- 172.21.15.84:0/2188039967 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62fc003570 con 0x7f63100ccab0 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f6316c5a700 1 -- 172.21.15.84:0/2188039967 >> v2:172.21.15.84:3300/0 conn(0x7f63101539d0 msgr2=0x7f631015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f6316c5a700 1 --2- 172.21.15.84:0/2188039967 >> v2:172.21.15.84:3300/0 conn(0x7f63101539d0 0x7f631015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.502+0000 7f6316c5a700 1 -- 172.21.15.84:0/2188039967 >> v1:172.21.15.84:6789/0 conn(0x7f63100ccab0 legacy=0x7f63100d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f6316c5a700 1 -- 172.21.15.84:0/2188039967 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63100cd020 con 0x7f63100d0a00 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f6316459700 1 --2- 172.21.15.84:0/2188039967 >> v2:172.21.15.84:3300/0 conn(0x7f63101539d0 0x7f631015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f6316c5a700 1 --2- 172.21.15.84:0/2188039967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f63100ce8a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63080098e0 tx=0x7f63080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cff9eef903d6c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f6315457700 1 -- 172.21.15.84:0/2188039967 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308011630 con 0x7f63100d0a00 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f6315457700 1 -- 172.21.15.84:0/2188039967 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308011790 con 0x7f63100d0a00 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f6315457700 1 -- 172.21.15.84:0/2188039967 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308011b10 con 0x7f63100d0a00 2023-10-06T03:02:10.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f631745b700 1 -- 172.21.15.84:0/2188039967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 msgr2=0x7f63100ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f631745b700 1 --2- 172.21.15.84:0/2188039967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f63100ce8a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63080098e0 tx=0x7f63080091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f631745b700 1 -- 172.21.15.84:0/2188039967 shutdown_connections 2023-10-06T03:02:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f631745b700 1 --2- 172.21.15.84:0/2188039967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f63100ce8a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f631745b700 1 --2- 172.21.15.84:0/2188039967 >> v2:172.21.15.84:3300/0 conn(0x7f63101539d0 0x7f631015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.503+0000 7f631745b700 1 -- 172.21.15.84:0/2188039967 >> 172.21.15.84:0/2188039967 conn(0x7f6310068100 msgr2=0x7f63100684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.504+0000 7f631745b700 1 -- 172.21.15.84:0/2188039967 shutdown_connections 2023-10-06T03:02:10.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.504+0000 7f631745b700 1 -- 172.21.15.84:0/2188039967 wait complete. 2023-10-06T03:02:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f631745b700 1 Processor -- start 2023-10-06T03:02:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f631745b700 1 -- start start 2023-10-06T03:02:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f631745b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63100ccab0 0x7f631016aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f631745b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f631015e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f631745b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63101539d0 0x7f63100b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f631745b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631015e790 con 0x7f63100ccab0 2023-10-06T03:02:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f631745b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631016ac70 con 0x7f63101539d0 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f631745b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631016a0f0 con 0x7f63100d0a00 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f6316459700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63100ccab0 0x7f631016aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.505+0000 7f6316459700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63100ccab0 0x7f631016aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47714/0 (socket says 172.21.15.84:47714) 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6316459700 1 -- 172.21.15.84:0/2043132305 learned_addr learned my addr 172.21.15.84:0/2043132305 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6316c5a700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63101539d0 0x7f63100b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6315c58700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f631015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6316459700 1 -- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 msgr2=0x7f631015e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6316459700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f631015e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6316459700 1 -- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63101539d0 msgr2=0x7f63100b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6316459700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63101539d0 0x7f63100b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6316459700 1 -- 172.21.15.84:0/2043132305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c009a20 con 0x7f63100ccab0 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6316c5a700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63101539d0 0x7f63100b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6315c58700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f631015e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f6316459700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63100ccab0 0x7f631016aeb0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f630c00c0c0 tx=0x7f630c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f63067fc700 1 -- 172.21.15.84:0/2043132305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c00cd60 con 0x7f63100ccab0 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f63067fc700 1 -- 172.21.15.84:0/2043132305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c00f040 con 0x7f63100ccab0 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f631745b700 1 -- 172.21.15.84:0/2043132305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6308009420 con 0x7f63100ccab0 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f63067fc700 1 -- 172.21.15.84:0/2043132305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c014690 con 0x7f63100ccab0 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.506+0000 7f631745b700 1 -- 172.21.15.84:0/2043132305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631016a6b0 con 0x7f63100ccab0 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.508+0000 7f63067fc700 1 -- 172.21.15.84:0/2043132305 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f630c014a00 con 0x7f63100ccab0 2023-10-06T03:02:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.509+0000 7f63067fc700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62f4066f30 0x7f62f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.509+0000 7f63067fc700 1 -- 172.21.15.84:0/2043132305 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f630c0856d0 con 0x7f63100ccab0 2023-10-06T03:02:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.509+0000 7f6315c58700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62f4066f30 0x7f62f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.509+0000 7f6315c58700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62f4066f30 0x7f62f40693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f63000058d0 tx=0x7f6300009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.510+0000 7f63219b5b80 1 Processor -- start 2023-10-06T03:02:10.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.510+0000 7f63219b5b80 1 -- start start 2023-10-06T03:02:10.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596def30 0x5639596b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596bf3a0 0x5639596ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596c0af0 0x5639596ba820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f63219b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563959614b50 con 0x5639596c0af0 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f63219b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563959612350 con 0x5639596def30 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f63219b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x56395960e140 con 0x5639596bf3a0 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316c5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596c0af0 0x5639596ba820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316c5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596c0af0 0x5639596ba820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47716/0 (socket says 172.21.15.84:47716) 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316c5a700 1 -- 172.21.15.84:0/3740529047 learned_addr learned my addr 172.21.15.84:0/3740529047 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6315c58700 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596bf3a0 0x5639596ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316459700 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596def30 0x5639596b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316c5a700 1 -- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596bf3a0 msgr2=0x5639596ba2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316c5a700 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596bf3a0 0x5639596ba2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316c5a700 1 -- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596def30 msgr2=0x5639596b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316c5a700 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596def30 0x5639596b9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316c5a700 1 -- 172.21.15.84:0/3740529047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639594a8350 con 0x5639596c0af0 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316459700 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596def30 0x5639596b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6315c58700 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596bf3a0 0x5639596ba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.511+0000 7f6316c5a700 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596c0af0 0x5639596ba820 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f631015aa30 tx=0x7f6308017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdc2d9362fa032b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f62f37fe700 1 -- 172.21.15.84:0/3740529047 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308011900 con 0x5639596c0af0 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f62f37fe700 1 -- 172.21.15.84:0/3740529047 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308011a60 con 0x5639596c0af0 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f62f37fe700 1 -- 172.21.15.84:0/3740529047 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630801a660 con 0x5639596c0af0 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f63219b5b80 1 -- 172.21.15.84:0/3740529047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596c0af0 msgr2=0x5639596ba820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f63219b5b80 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596c0af0 0x5639596ba820 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f631015aa30 tx=0x7f6308017000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f63219b5b80 1 -- 172.21.15.84:0/3740529047 shutdown_connections 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f63219b5b80 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596def30 0x5639596b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f63219b5b80 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596c0af0 0x5639596ba820 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f63219b5b80 1 --2- 172.21.15.84:0/3740529047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596bf3a0 0x5639596ba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f63219b5b80 1 -- 172.21.15.84:0/3740529047 >> 172.21.15.84:0/3740529047 conn(0x5639596bef60 msgr2=0x5639596bf790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f63219b5b80 1 -- 172.21.15.84:0/3740529047 shutdown_connections 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.512+0000 7f63219b5b80 1 -- 172.21.15.84:0/3740529047 wait complete. 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.513+0000 7f63219b5b80 1 -- start start 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.513+0000 7f63219b5b80 1 Processor -- start 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x5639596d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x5639596d6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f63219b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639595b9970 con 0x5639596def30 2023-10-06T03:02:10.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f63219b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639595d4f80 con 0x5639596bf3a0 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f63219b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x563959490f10 con 0x5639596c0af0 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f63219b5b80 10 client.0 _ll_register_callbacks cb 0x563959681100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316c5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596d6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316c5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596d6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47724/0 (socket says 172.21.15.84:47724) 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316c5a700 1 -- 172.21.15.84:0/343256099 learned_addr learned my addr 172.21.15.84:0/343256099 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6315c58700 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x5639596d6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316459700 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x5639596d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316c5a700 1 -- 172.21.15.84:0/343256099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 msgr2=0x5639596d6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316c5a700 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x5639596d6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316c5a700 1 -- 172.21.15.84:0/343256099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 msgr2=0x5639596d5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316c5a700 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x5639596d5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316c5a700 1 -- 172.21.15.84:0/343256099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63100cd020 con 0x5639596def30 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316459700 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x5639596d5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f6316c5a700 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596d6d90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f63080093f0 tx=0x7f6308003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f37e902e267ae9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.514+0000 7f62f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f62f0ff9700 1 -- 172.21.15.84:0/343256099 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630801ad30 con 0x5639596def30 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f62f0ff9700 1 -- 172.21.15.84:0/343256099 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f630802fda0 con 0x5639596def30 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f63219b5b80 1 -- 172.21.15.84:0/343256099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639596b2a20 con 0x5639596def30 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f62f0ff9700 1 -- 172.21.15.84:0/343256099 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f630801ae90 con 0x5639596def30 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f63219b5b80 10 client.8889 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f63219b5b80 1 -- 172.21.15.84:0/343256099 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x56395944b0c0 con 0x5639596def30 2023-10-06T03:02:10.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f62f0ff9700 1 -- 172.21.15.84:0/343256099 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5639596b2a20 con 0x5639596def30 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f62f0ff9700 1 -- 172.21.15.84:0/343256099 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f630802c070 con 0x5639596def30 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f63219b5b80 10 client.8889 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f63219b5b80 10 client.8889 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f63219b5b80 20 client.8889 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f63219b5b80 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5639596e8950 0x5639596e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f63219b5b80 4 client.8889 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f63219b5b80 1 -- 172.21.15.84:0/343256099 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56395968f950 con 0x5639596e8950 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f6316459700 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5639596e8950 0x5639596e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f62f0ff9700 10 client.8889 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.515+0000 7f6316459700 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5639596e8950 0x5639596e8d20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d798aa37714801e server_cookie=656e1a972970a4ef in_seq=0 out_seq=0 2023-10-06T03:02:10.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f62f0ff9700 1 -- 172.21.15.84:0/343256099 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56395968f950 con 0x5639596e8950 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f62f0ff9700 10 client.8889 handle_command_reply: tid=0 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 client.8889 shutdown 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 -- 172.21.15.84:0/343256099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 msgr2=0x5639596d6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596d6d90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f63080093f0 tx=0x7f6308003050 comp rx=0 tx=0).stop 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 -- 172.21.15.84:0/343256099 shutdown_connections 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5639596e8950 0x5639596e8d20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x5639596d5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596d6d90 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f62f0ff9700 0 client.8889 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 --2- 172.21.15.84:0/343256099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x5639596d6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 -- 172.21.15.84:0/343256099 >> 172.21.15.84:0/343256099 conn(0x5639596bef60 msgr2=0x5639596de5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 -- 172.21.15.84:0/343256099 shutdown_connections 2023-10-06T03:02:10.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 1 -- 172.21.15.84:0/343256099 wait complete. 2023-10-06T03:02:10.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.516+0000 7f63219b5b80 20 client.8889 trim_cache size 0 max 16384 2023-10-06T03:02:10.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.533+0000 7f63219b5b80 1 Processor -- start 2023-10-06T03:02:10.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.533+0000 7f63219b5b80 1 -- start start 2023-10-06T03:02:10.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x5639596ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x5639596b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639596962c0 con 0x5639596def30 2023-10-06T03:02:10.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639596e96e0 con 0x5639596bf3a0 2023-10-06T03:02:10.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639596d44c0 con 0x5639596c0af0 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f6316c5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f6316c5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47740/0 (socket says 172.21.15.84:47740) 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f6316c5a700 1 -- 172.21.15.84:0/1078635108 learned_addr learned my addr 172.21.15.84:0/1078635108 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f6316c5a700 1 -- 172.21.15.84:0/1078635108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 msgr2=0x5639596b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f6316c5a700 1 --2- 172.21.15.84:0/1078635108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x5639596b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f6316c5a700 1 -- 172.21.15.84:0/1078635108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 msgr2=0x5639596ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f6316c5a700 1 --2- 172.21.15.84:0/1078635108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x5639596ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f6316c5a700 1 -- 172.21.15.84:0/1078635108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639595dc860 con 0x5639596def30 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f6316c5a700 1 --2- 172.21.15.84:0/1078635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b4a20 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f63080098e0 tx=0x7f630802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac18c650eca78422 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f62f3fff700 1 -- 172.21.15.84:0/1078635108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308006dd0 con 0x5639596def30 2023-10-06T03:02:10.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f62f3fff700 1 -- 172.21.15.84:0/1078635108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630801ad30 con 0x5639596def30 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f62f3fff700 1 -- 172.21.15.84:0/1078635108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308000e10 con 0x5639596def30 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 -- 172.21.15.84:0/1078635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 msgr2=0x5639596b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 --2- 172.21.15.84:0/1078635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b4a20 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f63080098e0 tx=0x7f630802a000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 -- 172.21.15.84:0/1078635108 shutdown_connections 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 --2- 172.21.15.84:0/1078635108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x5639596ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 --2- 172.21.15.84:0/1078635108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b4a20 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 --2- 172.21.15.84:0/1078635108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x5639596b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 -- 172.21.15.84:0/1078635108 >> 172.21.15.84:0/1078635108 conn(0x5639596bef60 msgr2=0x5639596e8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 -- 172.21.15.84:0/1078635108 shutdown_connections 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.534+0000 7f63219b5b80 1 -- 172.21.15.84:0/1078635108 wait complete. 2023-10-06T03:02:10.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.536+0000 7f63219b5b80 1 -- start start 2023-10-06T03:02:10.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.536+0000 7f63219b5b80 1 Processor -- start 2023-10-06T03:02:10.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x56395975fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x563959707e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x563959708910 con 0x5639596def30 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395976b9f0 con 0x5639596bf3a0 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639596ed2b0 con 0x5639596c0af0 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 10 client.0 _ll_register_callbacks cb 0x563959681100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316c5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316c5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47750/0 (socket says 172.21.15.84:47750) 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316c5a700 1 -- 172.21.15.84:0/2290581389 learned_addr learned my addr 172.21.15.84:0/2290581389 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316459700 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x56395975fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316c5a700 1 -- 172.21.15.84:0/2290581389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 msgr2=0x563959707e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6315c58700 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x563959707e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316c5a700 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x563959707e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316c5a700 1 -- 172.21.15.84:0/2290581389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 msgr2=0x56395975fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316c5a700 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x56395975fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316c5a700 1 -- 172.21.15.84:0/2290581389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56395944b0c0 con 0x5639596def30 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316c5a700 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b44e0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f6308027040 tx=0x7f630800d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ebf71a21a863a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f62f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f62f0ff9700 1 -- 172.21.15.84:0/2290581389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308046070 con 0x5639596def30 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f62f0ff9700 1 -- 172.21.15.84:0/2290581389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f6308038680 con 0x5639596def30 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 -- 172.21.15.84:0/2290581389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6308011a60 con 0x5639596def30 2023-10-06T03:02:10.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f62f0ff9700 1 -- 172.21.15.84:0/2290581389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6308025860 con 0x5639596def30 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 10 client.8895 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 -- 172.21.15.84:0/2290581389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x5639595c3550 con 0x5639596def30 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f62f0ff9700 1 -- 172.21.15.84:0/2290581389 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308011a60 con 0x5639596def30 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f62f0ff9700 1 -- 172.21.15.84:0/2290581389 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f6308049030 con 0x5639596def30 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 10 client.8895 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 10 client.8895 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 20 client.8895 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5639597083d0 0x5639596b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 4 client.8895 mds_command: new command op to 8529 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f63219b5b80 1 -- 172.21.15.84:0/2290581389 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x5639595b0ee0 con 0x5639597083d0 2023-10-06T03:02:10.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316459700 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5639597083d0 0x5639596b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f62f0ff9700 10 client.8895 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.537+0000 7f6316459700 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5639597083d0 0x5639596b4a20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf37ea2e63024e46 server_cookie=54924e70506f9b5e in_seq=0 out_seq=0 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f62f0ff9700 1 -- 172.21.15.84:0/2290581389 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5639595b0ee0 con 0x5639597083d0 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f62f0ff9700 10 client.8895 handle_command_reply: tid=0 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 client.8895 shutdown 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 -- 172.21.15.84:0/2290581389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 msgr2=0x5639596b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b44e0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f6308027040 tx=0x7f630800d000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 -- 172.21.15.84:0/2290581389 shutdown_connections 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5639597083d0 0x5639596b4a20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639596bf3a0 0x56395975fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639596def30 0x5639596b44e0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 --2- 172.21.15.84:0/2290581389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5639596c0af0 0x563959707e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 -- 172.21.15.84:0/2290581389 >> 172.21.15.84:0/2290581389 conn(0x5639596bef60 msgr2=0x5639596e9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f62f0ff9700 0 client.8895 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:10.547 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:02:10.538+0000 7fb0e2f47700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1) n(v3 rc2023-10-06T03:01:53.860530+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={7558=pAsLsXsFsx/pAsLsXsFsx@5},l=7558 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x5631ae0f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.860530+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-10-06T03:01:53.860530+0000 6=0+6)","error_str":""},"return_code":-61} 2023-10-06T03:02:10.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 -- 172.21.15.84:0/2290581389 shutdown_connections 2023-10-06T03:02:10.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 1 -- 172.21.15.84:0/2290581389 wait complete. 2023-10-06T03:02:10.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.538+0000 7f63219b5b80 20 client.8895 trim_cache size 0 max 16384 2023-10-06T03:02:10.548 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T03:02:10.538+0000 7facd113f700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-10-06T03:01:53.634533+0000 1=0+1) n(v2 rc2023-10-06T03:01:53.860530+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={7558=pAsLsXsFsx/pAsLsXsFsx@4},l=7558 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x561de2e1a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.634533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.860530+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.634533+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-10-06T03:01:53.860530+0000 4=0+4)","error_str":""},"return_code":-61} 2023-10-06T03:02:10.548 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:10.548 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2023-10-06T03:02:10.548 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:10.549 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2023-10-06T03:02:10.549 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:10.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 -- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62f4066f30 msgr2=0x7f62f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62f4066f30 0x7f62f40693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f63000058d0 tx=0x7f6300009040 comp rx=0 tx=0).stop 2023-10-06T03:02:10.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 -- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63100ccab0 msgr2=0x7f631016aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63100ccab0 0x7f631016aeb0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f630c00c0c0 tx=0x7f630c00b040 comp rx=0 tx=0).stop 2023-10-06T03:02:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 -- 172.21.15.84:0/2043132305 shutdown_connections 2023-10-06T03:02:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f62f4066f30 0x7f62f40693e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63101539d0 0x7f63100b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63100ccab0 0x7f631016aeb0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 --2- 172.21.15.84:0/2043132305 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63100d0a00 0x7f631015e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 -- 172.21.15.84:0/2043132305 >> 172.21.15.84:0/2043132305 conn(0x7f6310068100 msgr2=0x7f631015c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 -- 172.21.15.84:0/2043132305 shutdown_connections 2023-10-06T03:02:10.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.539+0000 7f631745b700 1 -- 172.21.15.84:0/2043132305 wait complete. 2023-10-06T03:02:10.551 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-10-06T03:02:10.539+0000 7fb0e8f53700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1) n(v4 rc2023-10-06T03:01:53.860530+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={7558=pAsLsXsFs/pAsLsXsFsx@9} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x5631ae366000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.860530+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-10-06T03:01:53.860530+0000 5=0+5)","error_str":""},"return_code":-61} 2023-10-06T03:02:10.551 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-10-06T03:02:10.540+0000 7facd714b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1) n(v1 rc2023-10-06T03:01:53.860530+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={7558=pAsLsXsFs/pAsLsXsFsx@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x561de2e1a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.635533+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-06T03:01:53.860530+0000 3=0+3)","error_str":""},"return_code":-61} 2023-10-06T03:02:10.551 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-10-06T03:02:10.540+0000 7fa223ad5700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1) n(v0 rc2023-10-06T03:01:53.635533+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7558=pAsLsXsFsx/pAsLsXsFsx@4},l=7558 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5599a5c9c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.635533+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-10-06T03:01:53.635533+0000 2=0+2)","error_str":""},"return_code":-61} 2023-10-06T03:02:10.551 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-10-06T03:02:10.540+0000 7fa223ad5700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={7558=pAsLsXsFsx/AsLsXsFsx@2},l=7558 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5599a5c9cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-10-06T03:02:10.552 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub pause 2023-10-06T03:02:10.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.668+0000 7f7d46cfa700 1 Processor -- start 2023-10-06T03:02:10.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.668+0000 7f7d46cfa700 1 -- start start 2023-10-06T03:02:10.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7d400cbb50 0x7f7d400ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400c6610 0x7f7d400ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d400b2e60 con 0x7f7d400b2a90 2023-10-06T03:02:10.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d400cf5d0 con 0x7f7d400cbb50 2023-10-06T03:02:10.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400cf8b0 con 0x7f7d400c6610 2023-10-06T03:02:10.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d45297700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400c6610 0x7f7d400ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3ffff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7d400cbb50 0x7f7d400ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d44a96700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f7d400b2a90 0x7f7d400cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:49208/0 (socket says 172.21.15.84:49208) 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d44a96700 1 -- 172.21.15.84:0/3734584034 learned_addr learned my addr 172.21.15.84:0/3734584034 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3ffff700 1 -- 172.21.15.84:0/3734584034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400c6610 msgr2=0x7f7d400ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/3734584034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400c6610 0x7f7d400ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3ffff700 1 -- 172.21.15.84:0/3734584034 >> v1:172.21.15.131:6789/0 conn(0x7f7d400b2a90 legacy=0x7f7d400cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3ffff700 1 -- 172.21.15.84:0/3734584034 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400cfb90 con 0x7f7d400cbb50 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3f7fe700 1 -- 172.21.15.84:0/3734584034 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607456415 0 0) 0x7f7d400b2e60 con 0x7f7d400b2a90 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d45297700 1 --2- 172.21.15.84:0/3734584034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400c6610 0x7f7d400ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/3734584034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d400cbb50 0x7f7d400ce850 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7d300098e0 tx=0x7f7d300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=872a2ab1a60b81ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3f7fe700 1 -- 172.21.15.84:0/3734584034 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000b640 con 0x7f7d400cbb50 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3f7fe700 1 -- 172.21.15.84:0/3734584034 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3000b7a0 con 0x7f7d400cbb50 2023-10-06T03:02:10.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d3f7fe700 1 -- 172.21.15.84:0/3734584034 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000bb40 con 0x7f7d400cbb50 2023-10-06T03:02:10.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 -- 172.21.15.84:0/3734584034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d400cbb50 msgr2=0x7f7d400ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 --2- 172.21.15.84:0/3734584034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d400cbb50 0x7f7d400ce850 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7d300098e0 tx=0x7f7d300091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 -- 172.21.15.84:0/3734584034 shutdown_connections 2023-10-06T03:02:10.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 --2- 172.21.15.84:0/3734584034 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400c6610 0x7f7d400ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 --2- 172.21.15.84:0/3734584034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d400cbb50 0x7f7d400ce850 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 -- 172.21.15.84:0/3734584034 >> 172.21.15.84:0/3734584034 conn(0x7f7d40099740 msgr2=0x7f7d4006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 -- 172.21.15.84:0/3734584034 shutdown_connections 2023-10-06T03:02:10.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.669+0000 7f7d46cfa700 1 -- 172.21.15.84:0/3734584034 wait complete. 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.671+0000 7f7d46cfa700 1 Processor -- start 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.671+0000 7f7d46cfa700 1 -- start start 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.671+0000 7f7d46cfa700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400b2a90 0x7f7d400c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.671+0000 7f7d46cfa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d400c6610 0x7f7d400c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.671+0000 7f7d46cfa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d400cbb50 0x7f7d40169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.671+0000 7f7d46cfa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400c9ba0 con 0x7f7d400cbb50 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.671+0000 7f7d46cfa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400c9e80 con 0x7f7d400c6610 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.671+0000 7f7d46cfa700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400ca160 con 0x7f7d400b2a90 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d45297700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d400cbb50 0x7f7d40169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d45297700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d400cbb50 0x7f7d40169cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47760/0 (socket says 172.21.15.84:47760) 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d45297700 1 -- 172.21.15.84:0/2068753429 learned_addr learned my addr 172.21.15.84:0/2068753429 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d400c6610 0x7f7d400c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d44a96700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400b2a90 0x7f7d400c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d45297700 1 -- 172.21.15.84:0/2068753429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400b2a90 msgr2=0x7f7d400c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d45297700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400b2a90 0x7f7d400c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d45297700 1 -- 172.21.15.84:0/2068753429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d400c6610 msgr2=0x7f7d400c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d45297700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d400c6610 0x7f7d400c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d45297700 1 -- 172.21.15.84:0/2068753429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38009a20 con 0x7f7d400cbb50 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d45297700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d400cbb50 0x7f7d40169cc0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009fc0 tx=0x7f7d3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d3cff9700 1 -- 172.21.15.84:0/2068753429 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800cbd0 con 0x7f7d400cbb50 2023-10-06T03:02:10.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d3cff9700 1 -- 172.21.15.84:0/2068753429 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3800f040 con 0x7f7d400cbb50 2023-10-06T03:02:10.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d46cfa700 1 -- 172.21.15.84:0/2068753429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d30009420 con 0x7f7d400cbb50 2023-10-06T03:02:10.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d3cff9700 1 -- 172.21.15.84:0/2068753429 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38014480 con 0x7f7d400cbb50 2023-10-06T03:02:10.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.672+0000 7f7d46cfa700 1 -- 172.21.15.84:0/2068753429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d400c77c0 con 0x7f7d400cbb50 2023-10-06T03:02:10.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.673+0000 7f7d3cff9700 1 -- 172.21.15.84:0/2068753429 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d38003020 con 0x7f7d400cbb50 2023-10-06T03:02:10.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.674+0000 7f7d3cff9700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d20066f30 0x7f7d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.674+0000 7f7d3cff9700 1 -- 172.21.15.84:0/2068753429 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7d38085130 con 0x7f7d400cbb50 2023-10-06T03:02:10.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.674+0000 7f7d44a96700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d20066f30 0x7f7d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.674+0000 7f7d44a96700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d20066f30 0x7f7d200693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7d400b5140 tx=0x7f7d28007d20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.676+0000 7f7d4fff2b80 1 Processor -- start 2023-10-06T03:02:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.676+0000 7f7d4fff2b80 1 -- start start 2023-10-06T03:02:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.676+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 0x559021b49c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.676+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b99700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.676+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b99c40 0x559021b9a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.676+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559021aa0ab0 con 0x559021b4ad00 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.676+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559021a9e2b0 con 0x559021b49880 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.676+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559021a9a0a0 con 0x559021b99c40 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d3ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b99700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d3ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b99700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47762/0 (socket says 172.21.15.84:47762) 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d3ffff700 1 -- 172.21.15.84:0/2427510750 learned_addr learned my addr 172.21.15.84:0/2427510750 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d44a96700 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 0x559021b49c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d45297700 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b99c40 0x559021b9a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d3ffff700 1 -- 172.21.15.84:0/2427510750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b99c40 msgr2=0x559021b9a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b99c40 0x559021b9a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d3ffff700 1 -- 172.21.15.84:0/2427510750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 msgr2=0x559021b49c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 0x559021b49c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d3ffff700 1 -- 172.21.15.84:0/2427510750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590219342b0 con 0x559021b4ad00 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d44a96700 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 0x559021b49c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b99700 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f7d40088fe0 tx=0x7f7d30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec8d4310aa3c093 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d35ffb700 1 -- 172.21.15.84:0/2427510750 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30021070 con 0x559021b4ad00 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d35ffb700 1 -- 172.21.15.84:0/2427510750 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d30000c90 con 0x559021b4ad00 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.677+0000 7f7d35ffb700 1 -- 172.21.15.84:0/2427510750 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000bb40 con 0x559021b4ad00 2023-10-06T03:02:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/2427510750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 msgr2=0x559021b99700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b99700 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f7d40088fe0 tx=0x7f7d30017000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/2427510750 shutdown_connections 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 0x559021b49c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b99c40 0x559021b9a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/2427510750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b99700 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/2427510750 >> 172.21.15.84:0/2427510750 conn(0x559021b4b1a0 msgr2=0x559021b4b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/2427510750 shutdown_connections 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/2427510750 wait complete. 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.678+0000 7f7d4fff2b80 1 -- start start 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d4fff2b80 1 Processor -- start 2023-10-06T03:02:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b49880 0x559021b92150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b4ad00 0x559021b8a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b99c40 0x559021ba1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559021a458d0 con 0x559021b49880 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559021a60ee0 con 0x559021b99c40 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55902191ce70 con 0x559021b4ad00 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d4fff2b80 10 client.0 _ll_register_callbacks cb 0x559021b0ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d44a96700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b49880 0x559021b92150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d44a96700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b49880 0x559021b92150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47766/0 (socket says 172.21.15.84:47766) 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.679+0000 7f7d44a96700 1 -- 172.21.15.84:0/255208652 learned_addr learned my addr 172.21.15.84:0/255208652 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d45297700 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b99c40 0x559021ba1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b4ad00 0x559021b8a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d44a96700 1 -- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b4ad00 msgr2=0x559021b8a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d44a96700 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b4ad00 0x559021b8a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d44a96700 1 -- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b99c40 msgr2=0x559021ba1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d44a96700 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b99c40 0x559021ba1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d44a96700 1 -- 172.21.15.84:0/255208652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d400cfb90 con 0x559021b49880 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b4ad00 0x559021b8a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d45297700 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b99c40 0x559021ba1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d44a96700 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b49880 0x559021b92150 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f7d280135c0 tx=0x7f7d28014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9544f7427078e561 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d1effd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d1effd700 1 -- 172.21.15.84:0/255208652 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28013e50 con 0x559021b49880 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d1effd700 1 -- 172.21.15.84:0/255208652 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7d2801b070 con 0x559021b49880 2023-10-06T03:02:10.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/255208652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559021b3e980 con 0x559021b49880 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d1effd700 1 -- 172.21.15.84:0/255208652 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d2802c3b0 con 0x559021b49880 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d4fff2b80 10 client.8904 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/255208652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x5590218d7020 con 0x559021b49880 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d1effd700 1 -- 172.21.15.84:0/255208652 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559021b3e980 con 0x559021b49880 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d1effd700 1 -- 172.21.15.84:0/255208652 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f7d2802c510 con 0x559021b49880 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d4fff2b80 10 client.8904 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d4fff2b80 10 client.8904 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d4fff2b80 20 client.8904 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559021b72d80 0x559021b44a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d4fff2b80 4 client.8904 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:10.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.680+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/255208652 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559021b1b8b0 con 0x559021b72d80 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559021b72d80 0x559021b44a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d1effd700 10 client.8904 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559021b72d80 0x559021b44a50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cacfe41702086c server_cookie=7a034492f14171 in_seq=0 out_seq=0 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d1effd700 1 -- 172.21.15.84:0/255208652 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559021b1b8b0 con 0x559021b72d80 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d1effd700 10 client.8904 handle_command_reply: tid=0 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d4fff2b80 1 client.8904 shutdown 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/255208652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b49880 msgr2=0x559021b92150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b49880 0x559021b92150 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f7d280135c0 tx=0x7f7d28014000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/255208652 shutdown_connections 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.681+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559021b72d80 0x559021b44a50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.682+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b99c40 0x559021ba1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.682+0000 7f7d1effd700 0 client.8904 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.682+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b49880 0x559021b92150 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.682+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/255208652 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b4ad00 0x559021b8a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.682+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/255208652 >> 172.21.15.84:0/255208652 conn(0x559021b4b1a0 msgr2=0x559021b4a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.682+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/255208652 shutdown_connections 2023-10-06T03:02:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.682+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/255208652 wait complete. 2023-10-06T03:02:10.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.682+0000 7f7d4fff2b80 20 client.8904 trim_cache size 0 max 16384 2023-10-06T03:02:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.697+0000 7f7d4fff2b80 1 Processor -- start 2023-10-06T03:02:10.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.697+0000 7f7d4fff2b80 1 -- start start 2023-10-06T03:02:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 0x559021b44a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b44f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b99c40 0x559021b93f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559021b8a1e0 con 0x559021b4ad00 2023-10-06T03:02:10.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559021b8eca0 con 0x559021b49880 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559021b44660 con 0x559021b99c40 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d3ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b44f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d3ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b44f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47770/0 (socket says 172.21.15.84:47770) 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d3ffff700 1 -- 172.21.15.84:0/4221555116 learned_addr learned my addr 172.21.15.84:0/4221555116 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d3ffff700 1 -- 172.21.15.84:0/4221555116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b99c40 msgr2=0x559021b93f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/4221555116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b99c40 0x559021b93f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d3ffff700 1 -- 172.21.15.84:0/4221555116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 msgr2=0x559021b44a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/4221555116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 0x559021b44a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d3ffff700 1 -- 172.21.15.84:0/4221555116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559021a687c0 con 0x559021b4ad00 2023-10-06T03:02:10.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/4221555116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b44f90 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f7d300098e0 tx=0x7f7d30014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817283410446841d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d367fc700 1 -- 172.21.15.84:0/4221555116 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30021040 con 0x559021b4ad00 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d367fc700 1 -- 172.21.15.84:0/4221555116 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3002b040 con 0x559021b4ad00 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.698+0000 7f7d367fc700 1 -- 172.21.15.84:0/4221555116 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000b430 con 0x559021b4ad00 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/4221555116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 msgr2=0x559021b44f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/4221555116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b44f90 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f7d300098e0 tx=0x7f7d30014000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/4221555116 shutdown_connections 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/4221555116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b49880 0x559021b44a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/4221555116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b99c40 0x559021b93f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/4221555116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b4ad00 0x559021b44f90 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/4221555116 >> 172.21.15.84:0/4221555116 conn(0x559021b4b1a0 msgr2=0x559021b4b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/4221555116 shutdown_connections 2023-10-06T03:02:10.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/4221555116 wait complete. 2023-10-06T03:02:10.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.699+0000 7f7d4fff2b80 1 -- start start 2023-10-06T03:02:10.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.700+0000 7f7d4fff2b80 1 Processor -- start 2023-10-06T03:02:10.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.700+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b49880 0x559021b90b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.700+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b4ad00 0x559021ba56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.700+0000 7f7d4fff2b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b99c40 0x559021ba5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.700+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x559021b8fe20 con 0x559021b99c40 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.700+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559021ba6430 con 0x559021b4ad00 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.700+0000 7f7d4fff2b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x559021b45030 con 0x559021b49880 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.700+0000 7f7d4fff2b80 10 client.0 _ll_register_callbacks cb 0x559021b0ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d45297700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b99c40 0x559021ba5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d45297700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b99c40 0x559021ba5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47780/0 (socket says 172.21.15.84:47780) 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d45297700 1 -- 172.21.15.84:0/3364783868 learned_addr learned my addr 172.21.15.84:0/3364783868 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d44a96700 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b49880 0x559021b90b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b4ad00 0x559021ba56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d45297700 1 -- 172.21.15.84:0/3364783868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b49880 msgr2=0x559021b90b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d45297700 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b49880 0x559021b90b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d45297700 1 -- 172.21.15.84:0/3364783868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b4ad00 msgr2=0x559021ba56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d45297700 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b4ad00 0x559021ba56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d45297700 1 -- 172.21.15.84:0/3364783868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590219342b0 con 0x559021b99c40 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d3ffff700 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b4ad00 0x559021ba56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d45297700 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b99c40 0x559021ba5be0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f7d38055a80 tx=0x7f7d380832d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571ad1946700f25f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d1effd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d1effd700 1 -- 172.21.15.84:0/3364783868 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38071070 con 0x559021b99c40 2023-10-06T03:02:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d1effd700 1 -- 172.21.15.84:0/3364783868 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7d38058fd0 con 0x559021b99c40 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/3364783868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d30000c90 con 0x559021b99c40 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d1effd700 1 -- 172.21.15.84:0/3364783868 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d3806c1d0 con 0x559021b99c40 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d4fff2b80 10 client.8910 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/3364783868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x559021a4f4b0 con 0x559021b99c40 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d1effd700 1 -- 172.21.15.84:0/3364783868 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d38060080 con 0x559021b99c40 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d1effd700 1 -- 172.21.15.84:0/3364783868 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f7d38055270 con 0x559021b99c40 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d4fff2b80 10 client.8910 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d4fff2b80 10 client.8910 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d4fff2b80 20 client.8910 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559021bf5c90 0x559021b45ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d4fff2b80 4 client.8910 mds_command: new command op to 8529 tid=0[{"prefix": "scrub pause"}] 2023-10-06T03:02:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.701+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/3364783868 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x559021a3ce40 con 0x559021bf5c90 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d44a96700 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559021bf5c90 0x559021b45ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d1effd700 10 client.8910 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d44a96700 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559021bf5c90 0x559021b45ba0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc5df22b262df4a server_cookie=984e53019b202ab4 in_seq=0 out_seq=0 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d1effd700 1 -- 172.21.15.84:0/3364783868 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x559021a3ce40 con 0x559021bf5c90 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d1effd700 10 client.8910 handle_command_reply: tid=0 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 client.8910 shutdown 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/3364783868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b99c40 msgr2=0x559021ba5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b99c40 0x559021ba5be0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f7d38055a80 tx=0x7f7d380832d0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/3364783868 shutdown_connections 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x559021bf5c90 0x559021b45ba0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559021b99c40 0x559021ba5be0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559021b49880 0x559021b90b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 --2- 172.21.15.84:0/3364783868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559021b4ad00 0x559021ba56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d1effd700 0 client.8910 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/3364783868 >> 172.21.15.84:0/3364783868 conn(0x559021b4b1a0 msgr2=0x559021b4b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/3364783868 shutdown_connections 2023-10-06T03:02:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 1 -- 172.21.15.84:0/3364783868 wait complete. 2023-10-06T03:02:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.702+0000 7f7d4fff2b80 20 client.8910 trim_cache size 0 max 16384 2023-10-06T03:02:10.712 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:10.712 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:02:10.713 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 -- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d20066f30 msgr2=0x7f7d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d20066f30 0x7f7d200693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7d400b5140 tx=0x7f7d28007d20 comp rx=0 tx=0).stop 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 -- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d400cbb50 msgr2=0x7f7d40169cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d400cbb50 0x7f7d40169cc0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009fc0 tx=0x7f7d3800b040 comp rx=0 tx=0).stop 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 -- 172.21.15.84:0/2068753429 shutdown_connections 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7d20066f30 0x7f7d200693e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d400cbb50 0x7f7d40169cc0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7d400b2a90 0x7f7d400c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 --2- 172.21.15.84:0/2068753429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d400c6610 0x7f7d400c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 -- 172.21.15.84:0/2068753429 >> 172.21.15.84:0/2068753429 conn(0x7f7d40099740 msgr2=0x7f7d40158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 -- 172.21.15.84:0/2068753429 shutdown_connections 2023-10-06T03:02:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.703+0000 7f7d46cfa700 1 -- 172.21.15.84:0/2068753429 wait complete. 2023-10-06T03:02:10.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2023-10-06T03:02:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.830+0000 7f842a4e4700 1 Processor -- start 2023-10-06T03:02:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.830+0000 7f842a4e4700 1 -- start start 2023-10-06T03:02:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.831+0000 7f842a4e4700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84240b2a90 0x7f84240cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.831+0000 7f842a4e4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240cbdf0 con 0x7f84240c6610 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.831+0000 7f842a4e4700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240b2e60 con 0x7f84240cb980 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.831+0000 7f842a4e4700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84240cf5d0 con 0x7f84240b2a90 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.831+0000 7f8428a81700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f84240c6610 0x7f84241631a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58434/0 (socket says 172.21.15.84:58434) 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.831+0000 7f8428a81700 1 -- 172.21.15.84:0/615474064 learned_addr learned my addr 172.21.15.84:0/615474064 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.831+0000 7f8423fff700 1 --2- 172.21.15.84:0/615474064 >> v2:172.21.15.131:3300/0 conn(0x7f84240b2a90 0x7f84240cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.831+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670445947 0 0) 0x7f84240cbdf0 con 0x7f84240c6610 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.831+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f840c003570 con 0x7f84240c6610 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 202784367 0 0) 0x7f840c003570 con 0x7f84240c6610 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 >> v2:172.21.15.131:3300/0 conn(0x7f84240b2a90 msgr2=0x7f84240cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 --2- 172.21.15.84:0/615474064 >> v2:172.21.15.131:3300/0 conn(0x7f84240b2a90 0x7f84240cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 >> v1:172.21.15.131:6789/0 conn(0x7f84240cb980 legacy=0x7f84240ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240cf8b0 con 0x7f84240c6610 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f841c0017f0 con 0x7f84240c6610 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 >> v1:172.21.15.84:6789/0 conn(0x7f84240c6610 legacy=0x7f84241631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c003a60 0x7f840c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f840c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f840c0051c0 0x7f840c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84240cf5d0 con 0x7f840c004810 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c00c160 con 0x7f840c003a60 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c00c320 con 0x7f840c0051c0 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f84237fe700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f840c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8423fff700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c003a60 0x7f840c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8428a81700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f840c0051c0 0x7f840c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f84237fe700 1 -- 172.21.15.84:0/615474064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f840c0051c0 msgr2=0x7f840c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f84237fe700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f840c0051c0 0x7f840c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f84237fe700 1 -- 172.21.15.84:0/615474064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c003a60 msgr2=0x7f840c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f84237fe700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c003a60 0x7f840c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f84237fe700 1 -- 172.21.15.84:0/615474064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c003570 con 0x7f840c004810 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8428a81700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f840c0051c0 0x7f840c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8428a81700 1 -- 172.21.15.84:0/615474064 reap_dead start 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f84237fe700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f840c004c80 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f84180018b0 tx=0x7f8418007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd971d8aa1cf7ad8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.832+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418012420 con 0x7f840c004810 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.833+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84180125a0 con 0x7f840c004810 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.833+0000 7f8422ffd700 1 -- 172.21.15.84:0/615474064 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418012960 con 0x7f840c004810 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.833+0000 7f842a4e4700 1 -- 172.21.15.84:0/615474064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 msgr2=0x7f840c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.833+0000 7f842a4e4700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f840c004c80 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f84180018b0 tx=0x7f8418007d30 comp rx=0 tx=0).stop 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.833+0000 7f842a4e4700 1 -- 172.21.15.84:0/615474064 shutdown_connections 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.833+0000 7f842a4e4700 1 --2- 172.21.15.84:0/615474064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f840c004c80 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.833+0000 7f842a4e4700 1 -- 172.21.15.84:0/615474064 >> 172.21.15.84:0/615474064 conn(0x7f8424099740 msgr2=0x7f842406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.833+0000 7f842a4e4700 1 -- 172.21.15.84:0/615474064 shutdown_connections 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.833+0000 7f842a4e4700 1 -- 172.21.15.84:0/615474064 wait complete. 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.834+0000 7f842a4e4700 1 Processor -- start 2023-10-06T03:02:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.834+0000 7f842a4e4700 1 -- start start 2023-10-06T03:02:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f842a4e4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f842409b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f842a4e4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8424156c10 0x7f8424068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f842a4e4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8424157080 0x7f8424068cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f842a4e4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842409b1f0 con 0x7f840c004810 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f842a4e4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842416d810 con 0x7f8424156c10 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f842a4e4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842409a8c0 con 0x7f8424157080 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f842409b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f842409b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47810/0 (socket says 172.21.15.84:47810) 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8423fff700 1 -- 172.21.15.84:0/3550606292 learned_addr learned my addr 172.21.15.84:0/3550606292 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f84237fe700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8424156c10 0x7f8424068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8428a81700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8424157080 0x7f8424068cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8423fff700 1 -- 172.21.15.84:0/3550606292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8424157080 msgr2=0x7f8424068cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8423fff700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8424157080 0x7f8424068cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8423fff700 1 -- 172.21.15.84:0/3550606292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8424156c10 msgr2=0x7f8424068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8423fff700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8424156c10 0x7f8424068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8423fff700 1 -- 172.21.15.84:0/3550606292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842409aba0 con 0x7f840c004810 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.835+0000 7f8423fff700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f842409b680 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f8414011b60 tx=0x7f8414009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.836+0000 7f840bfff700 1 -- 172.21.15.84:0/3550606292 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414005c10 con 0x7f840c004810 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.836+0000 7f840bfff700 1 -- 172.21.15.84:0/3550606292 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8414005d70 con 0x7f840c004810 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.836+0000 7f840bfff700 1 -- 172.21.15.84:0/3550606292 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400fa60 con 0x7f840c004810 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.836+0000 7f842a4e4700 1 -- 172.21.15.84:0/3550606292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842409ae80 con 0x7f840c004810 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.836+0000 7f842a4e4700 1 -- 172.21.15.84:0/3550606292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842416cae0 con 0x7f840c004810 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.837+0000 7f840bfff700 1 -- 172.21.15.84:0/3550606292 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8414006050 con 0x7f840c004810 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.837+0000 7f840bfff700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8410066f30 0x7f84100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.837+0000 7f840bfff700 1 -- 172.21.15.84:0/3550606292 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f8414085170 con 0x7f840c004810 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.837+0000 7f84237fe700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8410066f30 0x7f84100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.838+0000 7f84237fe700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8410066f30 0x7f84100693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f842409a470 tx=0x7f8418015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f84337dcb80 1 Processor -- start 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f84337dcb80 1 -- start start 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d060753c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060754d10 0x55d0607a3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0607a3c50 0x55d0607a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f84337dcb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0606aaac0 con 0x55d060753890 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f84337dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0606a82c0 con 0x55d0607a3c50 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f84337dcb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d0606a40b0 con 0x55d060754d10 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f8423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d060753c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f8423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d060753c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47822/0 (socket says 172.21.15.84:47822) 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f8423fff700 1 -- 172.21.15.84:0/4049555223 learned_addr learned my addr 172.21.15.84:0/4049555223 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f8428a81700 1 --2- 172.21.15.84:0/4049555223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0607a3c50 0x55d0607a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.840+0000 7f84237fe700 1 --2- 172.21.15.84:0/4049555223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060754d10 0x55d0607a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f8423fff700 1 -- 172.21.15.84:0/4049555223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060754d10 msgr2=0x55d0607a3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f8423fff700 1 --2- 172.21.15.84:0/4049555223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060754d10 0x55d0607a3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f8423fff700 1 -- 172.21.15.84:0/4049555223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0607a3c50 msgr2=0x55d0607a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f8423fff700 1 --2- 172.21.15.84:0/4049555223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0607a3c50 0x55d0607a40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f8423fff700 1 -- 172.21.15.84:0/4049555223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d06053e2c0 con 0x55d060753890 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f8423fff700 1 --2- 172.21.15.84:0/4049555223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d060753c60 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f8414012010 tx=0x7f8414083270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9053da62a13d733 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f84097fa700 1 -- 172.21.15.84:0/4049555223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414058f70 con 0x55d060753890 2023-10-06T03:02:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f84097fa700 1 -- 172.21.15.84:0/4049555223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841405ccc0 con 0x55d060753890 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f84097fa700 1 -- 172.21.15.84:0/4049555223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84140540c0 con 0x55d060753890 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f84337dcb80 1 -- 172.21.15.84:0/4049555223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 msgr2=0x55d060753c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.841+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4049555223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d060753c60 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f8414012010 tx=0x7f8414083270 comp rx=0 tx=0).stop 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.842+0000 7f84337dcb80 1 -- 172.21.15.84:0/4049555223 shutdown_connections 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.842+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4049555223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0607a3c50 0x55d0607a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.842+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4049555223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d060753c60 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.842+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4049555223 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060754d10 0x55d0607a3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.842+0000 7f84337dcb80 1 -- 172.21.15.84:0/4049555223 >> 172.21.15.84:0/4049555223 conn(0x55d0607551b0 msgr2=0x55d060755580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.842+0000 7f84337dcb80 1 -- 172.21.15.84:0/4049555223 shutdown_connections 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.842+0000 7f84337dcb80 1 -- 172.21.15.84:0/4049555223 wait complete. 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.842+0000 7f84337dcb80 1 -- start start 2023-10-06T03:02:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.842+0000 7f84337dcb80 1 Processor -- start 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060753890 0x55d06077ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060754d10 0x55d06079c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 0x55d06079c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84337dcb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d06064f8e0 con 0x55d060754d10 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84337dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d06066aef0 con 0x55d060753890 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84337dcb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d060526e80 con 0x55d0607a3c50 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84337dcb80 10 client.0 _ll_register_callbacks cb 0x55d060716ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84237fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060754d10 0x55d06079c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84237fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060754d10 0x55d06079c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47832/0 (socket says 172.21.15.84:47832) 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84237fe700 1 -- 172.21.15.84:0/4196678614 learned_addr learned my addr 172.21.15.84:0/4196678614 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f8423fff700 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060753890 0x55d06077ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f8428a81700 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 0x55d06079c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84237fe700 1 -- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 msgr2=0x55d06079c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84237fe700 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 0x55d06079c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84237fe700 1 -- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060753890 msgr2=0x55d06077ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84237fe700 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060753890 0x55d06077ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f84237fe700 1 -- 172.21.15.84:0/4196678614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842416cae0 con 0x55d060754d10 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f8423fff700 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060753890 0x55d06077ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.843+0000 7f8428a81700 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 0x55d06079c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84237fe700 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060754d10 0x55d06079c2d0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c130 tx=0x7f8418022070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279921e5ce9ce8c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84027fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84027fc700 1 -- 172.21.15.84:0/4196678614 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418033480 con 0x55d060754d10 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84027fc700 1 -- 172.21.15.84:0/4196678614 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f84180335e0 con 0x55d060754d10 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84337dcb80 1 -- 172.21.15.84:0/4196678614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d060748990 con 0x55d060754d10 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84027fc700 1 -- 172.21.15.84:0/4196678614 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84180339b0 con 0x55d060754d10 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84337dcb80 10 client.8922 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84337dcb80 1 -- 172.21.15.84:0/4196678614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55d0604e1030 con 0x55d060754d10 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84027fc700 1 -- 172.21.15.84:0/4196678614 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d060748990 con 0x55d060754d10 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84027fc700 1 -- 172.21.15.84:0/4196678614 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f8418033b10 con 0x55d060754d10 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84337dcb80 10 client.8922 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84337dcb80 10 client.8922 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84337dcb80 20 client.8922 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55d06079b860 0x55d060793610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84337dcb80 4 client.8922 mds_command: new command op to 8526 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f84337dcb80 1 -- 172.21.15.84:0/4196678614 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0607258c0 con 0x55d06079b860 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.844+0000 7f8423fff700 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55d06079b860 0x55d060793610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84027fc700 10 client.8922 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f8423fff700 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55d06079b860 0x55d060793610 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2cfe1ad0892d2338 server_cookie=54de2820b6c1da31 in_seq=0 out_seq=0 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84027fc700 1 -- 172.21.15.84:0/4196678614 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d0607258c0 con 0x55d06079b860 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84027fc700 10 client.8922 handle_command_reply: tid=0 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 client.8922 shutdown 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 -- 172.21.15.84:0/4196678614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060754d10 msgr2=0x55d06079c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060754d10 0x55d06079c2d0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c130 tx=0x7f8418022070 comp rx=0 tx=0).stop 2023-10-06T03:02:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 -- 172.21.15.84:0/4196678614 shutdown_connections 2023-10-06T03:02:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55d06079b860 0x55d060793610 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060753890 0x55d06077ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 0x55d06079c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4196678614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060754d10 0x55d06079c2d0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84027fc700 0 client.8922 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 -- 172.21.15.84:0/4196678614 >> 172.21.15.84:0/4196678614 conn(0x55d0607551b0 msgr2=0x55d060797460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 -- 172.21.15.84:0/4196678614 shutdown_connections 2023-10-06T03:02:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 1 -- 172.21.15.84:0/4196678614 wait complete. 2023-10-06T03:02:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.845+0000 7f84337dcb80 20 client.8922 trim_cache size 0 max 16384 2023-10-06T03:02:10.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.861+0000 7f84337dcb80 1 Processor -- start 2023-10-06T03:02:10.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.861+0000 7f84337dcb80 1 -- start start 2023-10-06T03:02:10.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d06077b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 0x55d06079df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 0x55d06079e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f84337dcb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d06071bde0 con 0x55d060753890 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f84337dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0607946d0 con 0x55d060754d10 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f84337dcb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d060752240 con 0x55d0607a3c50 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f8423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d06077b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f8423fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d06077b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47846/0 (socket says 172.21.15.84:47846) 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f8423fff700 1 -- 172.21.15.84:0/4276151532 learned_addr learned my addr 172.21.15.84:0/4276151532 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f8423fff700 1 -- 172.21.15.84:0/4276151532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 msgr2=0x55d06079e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f8423fff700 1 --2- 172.21.15.84:0/4276151532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 0x55d06079e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f8423fff700 1 -- 172.21.15.84:0/4276151532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 msgr2=0x55d06079df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.862+0000 7f8423fff700 1 --2- 172.21.15.84:0/4276151532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 0x55d06079df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f8423fff700 1 -- 172.21.15.84:0/4276151532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0606727d0 con 0x55d060753890 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f8423fff700 1 --2- 172.21.15.84:0/4276151532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d06077b9d0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f8414009890 tx=0x7f8414071040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9002b57c83a98ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f8409ffb700 1 -- 172.21.15.84:0/4276151532 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414058f70 con 0x55d060753890 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f8409ffb700 1 -- 172.21.15.84:0/4276151532 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8414055d20 con 0x55d060753890 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f8409ffb700 1 -- 172.21.15.84:0/4276151532 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414056190 con 0x55d060753890 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f84337dcb80 1 -- 172.21.15.84:0/4276151532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 msgr2=0x55d06077b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4276151532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d06077b9d0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f8414009890 tx=0x7f8414071040 comp rx=0 tx=0).stop 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f84337dcb80 1 -- 172.21.15.84:0/4276151532 shutdown_connections 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4276151532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d0607a3c50 0x55d06079e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4276151532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d060753890 0x55d06077b9d0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f84337dcb80 1 --2- 172.21.15.84:0/4276151532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 0x55d06079df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f84337dcb80 1 -- 172.21.15.84:0/4276151532 >> 172.21.15.84:0/4276151532 conn(0x55d0607551b0 msgr2=0x55d060756cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f84337dcb80 1 -- 172.21.15.84:0/4276151532 shutdown_connections 2023-10-06T03:02:10.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.863+0000 7f84337dcb80 1 -- 172.21.15.84:0/4276151532 wait complete. 2023-10-06T03:02:10.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.864+0000 7f84337dcb80 1 -- start start 2023-10-06T03:02:10.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.864+0000 7f84337dcb80 1 Processor -- start 2023-10-06T03:02:10.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060753890 0x55d06077b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 0x55d06077bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84337dcb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0607a3c50 0x55d0607f7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84337dcb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0608012f0 con 0x55d0607a3c50 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84337dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d060783f10 con 0x55d060754d10 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84337dcb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d0607ad350 con 0x55d060753890 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84337dcb80 10 client.0 _ll_register_callbacks cb 0x55d060716ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8428a81700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0607a3c50 0x55d0607f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8428a81700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0607a3c50 0x55d0607f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47854/0 (socket says 172.21.15.84:47854) 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8428a81700 1 -- 172.21.15.84:0/148656659 learned_addr learned my addr 172.21.15.84:0/148656659 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8423fff700 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060753890 0x55d06077b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84237fe700 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 0x55d06077bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8428a81700 1 -- 172.21.15.84:0/148656659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060753890 msgr2=0x55d06077b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8428a81700 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060753890 0x55d06077b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8428a81700 1 -- 172.21.15.84:0/148656659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 msgr2=0x55d06077bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8428a81700 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 0x55d06077bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8428a81700 1 -- 172.21.15.84:0/148656659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d06053e2c0 con 0x55d0607a3c50 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84237fe700 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 0x55d06077bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f8428a81700 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0607a3c50 0x55d0607f7480 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f84240cdec0 tx=0x7f841c006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b40c0df23a753d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84027fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84027fc700 1 -- 172.21.15.84:0/148656659 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c004e90 con 0x55d0607a3c50 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84027fc700 1 -- 172.21.15.84:0/148656659 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f841c013b50 con 0x55d0607a3c50 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.865+0000 7f84337dcb80 1 -- 172.21.15.84:0/148656659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f841405ccc0 con 0x55d0607a3c50 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84027fc700 1 -- 172.21.15.84:0/148656659 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f841c016450 con 0x55d0607a3c50 2023-10-06T03:02:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 10 client.8928 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 1 -- 172.21.15.84:0/148656659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55d0606594c0 con 0x55d0607a3c50 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84027fc700 1 -- 172.21.15.84:0/148656659 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841405ccc0 con 0x55d0607a3c50 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84027fc700 1 -- 172.21.15.84:0/148656659 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7f841c01f3f0 con 0x55d0607a3c50 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 10 client.8928 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 10 client.8928 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 20 client.8928 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55d060797210 0x55d0607f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 4 client.8928 mds_command: new command op to 8526 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 1 -- 172.21.15.84:0/148656659 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d060646e50 con 0x55d060797210 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f8423fff700 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55d060797210 0x55d0607f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f8423fff700 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55d060797210 0x55d0607f79c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78551705d3627d69 server_cookie=46ceffd064c1c53 in_seq=0 out_seq=0 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84027fc700 10 client.8928 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84027fc700 1 -- 172.21.15.84:0/148656659 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55d060646e50 con 0x55d060797210 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84027fc700 10 client.8928 handle_command_reply: tid=0 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 1 client.8928 shutdown 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 1 -- 172.21.15.84:0/148656659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0607a3c50 msgr2=0x55d0607f7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0607a3c50 0x55d0607f7480 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f84240cdec0 tx=0x7f841c006040 comp rx=0 tx=0).stop 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.866+0000 7f84337dcb80 1 -- 172.21.15.84:0/148656659 shutdown_connections 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f84337dcb80 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x55d060797210 0x55d0607f79c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f84337dcb80 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d0607a3c50 0x55d0607f7480 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f84337dcb80 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55d060753890 0x55d06077b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f84027fc700 0 client.8928 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f84337dcb80 1 --2- 172.21.15.84:0/148656659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d060754d10 0x55d06077bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f84337dcb80 1 -- 172.21.15.84:0/148656659 >> 172.21.15.84:0/148656659 conn(0x55d0607551b0 msgr2=0x55d060751050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f84337dcb80 1 -- 172.21.15.84:0/148656659 shutdown_connections 2023-10-06T03:02:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f84337dcb80 1 -- 172.21.15.84:0/148656659 wait complete. 2023-10-06T03:02:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f84337dcb80 20 client.8928 trim_cache size 0 max 16384 2023-10-06T03:02:10.876 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:10.876 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:02:10.876 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:10.877 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:10.877 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:10.877 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:10.877 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:10.877 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:10.877 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:10.877 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 -- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8410066f30 msgr2=0x7f84100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8410066f30 0x7f84100693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f842409a470 tx=0x7f8418015000 comp rx=0 tx=0).stop 2023-10-06T03:02:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 -- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 msgr2=0x7f842409b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f842409b680 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f8414011b60 tx=0x7f8414009120 comp rx=0 tx=0).stop 2023-10-06T03:02:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 -- 172.21.15.84:0/3550606292 shutdown_connections 2023-10-06T03:02:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8410066f30 0x7f84100693e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8424157080 0x7f8424068cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f840c004810 0x7f842409b680 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 --2- 172.21.15.84:0/3550606292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8424156c10 0x7f8424068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 -- 172.21.15.84:0/3550606292 >> 172.21.15.84:0/3550606292 conn(0x7f8424099740 msgr2=0x7f8424063450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 -- 172.21.15.84:0/3550606292 shutdown_connections 2023-10-06T03:02:10.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.867+0000 7f842a4e4700 1 -- 172.21.15.84:0/3550606292 wait complete. 2023-10-06T03:02:10.880 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:10.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2023-10-06T03:02:10.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.995+0000 7fc2ffb7c700 1 Processor -- start 2023-10-06T03:02:10.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.995+0000 7fc2ffb7c700 1 -- start start 2023-10-06T03:02:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2ffb7c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2f80b2a90 0x7fc2f80cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2ffb7c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc2f80cb980 0x7fc2f80ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2ffb7c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80cbdf0 con 0x7fc2f80ced90 2023-10-06T03:02:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2ffb7c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80b2e60 con 0x7fc2f80b2a90 2023-10-06T03:02:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2ffb7c700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80cf5d0 con 0x7fc2f80cb980 2023-10-06T03:02:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd918700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2f80b2a90 0x7fc2f80cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd918700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2f80b2a90 0x7fc2f80cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47870/0 (socket says 172.21.15.84:47870) 2023-10-06T03:02:10.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd918700 1 -- 172.21.15.84:0/1163219735 learned_addr learned my addr 172.21.15.84:0/1163219735 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd117700 1 --2- 172.21.15.84:0/1163219735 >> v2:172.21.15.131:3300/0 conn(0x7fc2f80cb980 0x7fc2f80ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd918700 1 -- 172.21.15.84:0/1163219735 >> v2:172.21.15.131:3300/0 conn(0x7fc2f80cb980 msgr2=0x7fc2f80ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd918700 1 --2- 172.21.15.84:0/1163219735 >> v2:172.21.15.131:3300/0 conn(0x7fc2f80cb980 0x7fc2f80ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd918700 1 -- 172.21.15.84:0/1163219735 >> v1:172.21.15.131:6789/0 conn(0x7fc2f80ced90 legacy=0x7fc2f80c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd918700 1 -- 172.21.15.84:0/1163219735 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80cf8b0 con 0x7fc2f80b2a90 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd117700 1 --2- 172.21.15.84:0/1163219735 >> v2:172.21.15.131:3300/0 conn(0x7fc2f80cb980 0x7fc2f80ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.996+0000 7fc2fd918700 1 --2- 172.21.15.84:0/1163219735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80b2a90 0x7fc2f80cb440 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8088cd0 tx=0x7fc2f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3b300f88b8bde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2fc916700 1 -- 172.21.15.84:0/1163219735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400e070 con 0x7fc2f80b2a90 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2fc916700 1 -- 172.21.15.84:0/1163219735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400bad0 con 0x7fc2f80b2a90 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2fc916700 1 -- 172.21.15.84:0/1163219735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40092e0 con 0x7fc2f80b2a90 2023-10-06T03:02:10.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/1163219735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80b2a90 msgr2=0x7fc2f80cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2ffb7c700 1 --2- 172.21.15.84:0/1163219735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80b2a90 0x7fc2f80cb440 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8088cd0 tx=0x7fc2f4009840 comp rx=0 tx=0).stop 2023-10-06T03:02:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/1163219735 shutdown_connections 2023-10-06T03:02:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2ffb7c700 1 --2- 172.21.15.84:0/1163219735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80b2a90 0x7fc2f80cb440 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2ffb7c700 1 --2- 172.21.15.84:0/1163219735 >> v2:172.21.15.131:3300/0 conn(0x7fc2f80cb980 0x7fc2f80ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/1163219735 >> 172.21.15.84:0/1163219735 conn(0x7fc2f8099740 msgr2=0x7fc2f806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/1163219735 shutdown_connections 2023-10-06T03:02:11.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.997+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/1163219735 wait complete. 2023-10-06T03:02:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.998+0000 7fc2ffb7c700 1 Processor -- start 2023-10-06T03:02:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.998+0000 7fc2ffb7c700 1 -- start start 2023-10-06T03:02:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2ffb7c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f80b2a90 0x7fc2f809be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2ffb7c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80cb980 0x7fc2f809ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2ffb7c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80ced90 0x7fc2f814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2ffb7c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f809c9d0 con 0x7fc2f80cb980 2023-10-06T03:02:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2ffb7c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f809c410 con 0x7fc2f80b2a90 2023-10-06T03:02:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2ffb7c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f809c6f0 con 0x7fc2f80ced90 2023-10-06T03:02:11.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd117700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80cb980 0x7fc2f809ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd117700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80cb980 0x7fc2f809ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47878/0 (socket says 172.21.15.84:47878) 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd117700 1 -- 172.21.15.84:0/2870407447 learned_addr learned my addr 172.21.15.84:0/2870407447 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fe119700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80ced90 0x7fc2f814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd918700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f80b2a90 0x7fc2f809be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd117700 1 -- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80ced90 msgr2=0x7fc2f814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd117700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80ced90 0x7fc2f814adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd117700 1 -- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f80b2a90 msgr2=0x7fc2f809be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd117700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f80b2a90 0x7fc2f809be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd117700 1 -- 172.21.15.84:0/2870407447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4009ae0 con 0x7fc2f80cb980 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fe119700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80ced90 0x7fc2f814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:11.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd918700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f80b2a90 0x7fc2f809be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2fd117700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80cb980 0x7fc2f809ae10 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800e8d0 tx=0x7fc2e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2edffb700 1 -- 172.21.15.84:0/2870407447 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800ee70 con 0x7fc2f80cb980 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2edffb700 1 -- 172.21.15.84:0/2870407447 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800c5e0 con 0x7fc2f80cb980 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2edffb700 1 -- 172.21.15.84:0/2870407447 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800c980 con 0x7fc2f80cb980 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/2870407447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f815c040 con 0x7fc2f80cb980 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:10.999+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/2870407447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f809b350 con 0x7fc2f80cb980 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.001+0000 7fc2edffb700 1 -- 172.21.15.84:0/2870407447 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2e8013410 con 0x7fc2f80cb980 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.002+0000 7fc2edffb700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.002+0000 7fc2edffb700 1 -- 172.21.15.84:0/2870407447 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc2e80848a0 con 0x7fc2f80cb980 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.002+0000 7fc2fd918700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.002+0000 7fc2fd918700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009fd0 tx=0x7fc2f4018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.004+0000 7fc308e74b80 1 Processor -- start 2023-10-06T03:02:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.004+0000 7fc308e74b80 1 -- start start 2023-10-06T03:02:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.004+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513578890 0x55c513578c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.004+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 0x55c5135c8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.004+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c5135c8c50 0x55c5135c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.004+0000 7fc308e74b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5134cfac0 con 0x55c513578890 2023-10-06T03:02:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.004+0000 7fc308e74b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5134cd2c0 con 0x55c513579d10 2023-10-06T03:02:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.004+0000 7fc308e74b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c5134c90b0 con 0x55c5135c8c50 2023-10-06T03:02:11.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd918700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513578890 0x55c513578c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd918700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513578890 0x55c513578c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47894/0 (socket says 172.21.15.84:47894) 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd918700 1 -- 172.21.15.84:0/1817429532 learned_addr learned my addr 172.21.15.84:0/1817429532 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd117700 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 0x55c5135c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fe119700 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c5135c8c50 0x55c5135c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd918700 1 -- 172.21.15.84:0/1817429532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c5135c8c50 msgr2=0x55c5135c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd918700 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c5135c8c50 0x55c5135c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd918700 1 -- 172.21.15.84:0/1817429532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 msgr2=0x55c5135c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd918700 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 0x55c5135c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd918700 1 -- 172.21.15.84:0/1817429532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5133632c0 con 0x55c513578890 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd117700 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 0x55c5135c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2fd918700 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513578890 0x55c513578c60 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400b770 tx=0x7fc2f401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c3e69cd7a4bc4c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2daffd700 1 -- 172.21.15.84:0/1817429532 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400bcf0 con 0x55c513578890 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2daffd700 1 -- 172.21.15.84:0/1817429532 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4007e30 con 0x55c513578890 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.005+0000 7fc2daffd700 1 -- 172.21.15.84:0/1817429532 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f402b450 con 0x55c513578890 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 -- 172.21.15.84:0/1817429532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513578890 msgr2=0x55c513578c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513578890 0x55c513578c60 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400b770 tx=0x7fc2f401f000 comp rx=0 tx=0).stop 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 -- 172.21.15.84:0/1817429532 shutdown_connections 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c5135c8c50 0x55c5135c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513578890 0x55c513578c60 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1817429532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 0x55c5135c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 -- 172.21.15.84:0/1817429532 >> 172.21.15.84:0/1817429532 conn(0x55c51357a1b0 msgr2=0x55c51357a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 -- 172.21.15.84:0/1817429532 shutdown_connections 2023-10-06T03:02:11.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 -- 172.21.15.84:0/1817429532 wait complete. 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 -- start start 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.006+0000 7fc308e74b80 1 Processor -- start 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513578890 0x55c5135b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513579d10 0x55c5135b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc308e74b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5134748e0 con 0x55c5135c8c50 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc308e74b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c51348fef0 con 0x55c513578890 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc308e74b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c51334be80 con 0x55c513579d10 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc308e74b80 10 client.0 _ll_register_callbacks cb 0x55c51353bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc2fe119700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc2fe119700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135b6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47906/0 (socket says 172.21.15.84:47906) 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.007+0000 7fc2fe119700 1 -- 172.21.15.84:0/3350067023 learned_addr learned my addr 172.21.15.84:0/3350067023 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2fd918700 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513578890 0x55c5135b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2fd117700 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513579d10 0x55c5135b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2fe119700 1 -- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513579d10 msgr2=0x55c5135b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2fe119700 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513579d10 0x55c5135b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2fe119700 1 -- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513578890 msgr2=0x55c5135b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2fe119700 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513578890 0x55c5135b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2fe119700 1 -- 172.21.15.84:0/3350067023 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f80cf8b0 con 0x55c5135c8c50 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2fe119700 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135b6fa0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000e520 tx=0x7fc2f0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0ea6cab998e8d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:11.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2d3fff700 1 -- 172.21.15.84:0/3350067023 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f000b070 con 0x55c5135c8c50 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2d3fff700 1 -- 172.21.15.84:0/3350067023 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc2f0013440 con 0x55c5135c8c50 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc308e74b80 1 -- 172.21.15.84:0/3350067023 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c51356d990 con 0x55c5135c8c50 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2d3fff700 1 -- 172.21.15.84:0/3350067023 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2f0013810 con 0x55c5135c8c50 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc308e74b80 10 client.8940 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc308e74b80 1 -- 172.21.15.84:0/3350067023 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55c513306030 con 0x55c5135c8c50 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2d3fff700 1 -- 172.21.15.84:0/3350067023 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c51356d990 con 0x55c5135c8c50 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc2d3fff700 1 -- 172.21.15.84:0/3350067023 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fc2f0013970 con 0x55c5135c8c50 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc308e74b80 10 client.8940 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc308e74b80 10 client.8940 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc308e74b80 20 client.8940 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc308e74b80 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c5135d2290 0x55c5135d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc308e74b80 4 client.8940 mds_command: new command op to 6782 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.008+0000 7fc308e74b80 1 -- 172.21.15.84:0/3350067023 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c51354a8c0 con 0x55c5135d2290 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.009+0000 7fc2fd918700 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c5135d2290 0x55c5135d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.009+0000 7fc2d3fff700 10 client.8940 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.009+0000 7fc2fd918700 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c5135d2290 0x55c5135d2660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ddde3faadcdb7d8 server_cookie=1365bc20aaad5871 in_seq=0 out_seq=0 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc2d3fff700 1 -- 172.21.15.84:0/3350067023 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c51354a8c0 con 0x55c5135d2290 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc2d3fff700 10 client.8940 handle_command_reply: tid=0 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 client.8940 shutdown 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 -- 172.21.15.84:0/3350067023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 msgr2=0x55c5135b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135b6fa0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000e520 tx=0x7fc2f0009040 comp rx=0 tx=0).stop 2023-10-06T03:02:11.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 -- 172.21.15.84:0/3350067023 shutdown_connections 2023-10-06T03:02:11.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513578890 0x55c5135b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c5135d2290 0x55c5135d2660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135b6fa0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc2d3fff700 0 client.8940 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 --2- 172.21.15.84:0/3350067023 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513579d10 0x55c5135b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 -- 172.21.15.84:0/3350067023 >> 172.21.15.84:0/3350067023 conn(0x55c51357a1b0 msgr2=0x55c51357bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 -- 172.21.15.84:0/3350067023 shutdown_connections 2023-10-06T03:02:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 1 -- 172.21.15.84:0/3350067023 wait complete. 2023-10-06T03:02:11.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.010+0000 7fc308e74b80 20 client.8940 trim_cache size 0 max 16384 2023-10-06T03:02:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.026+0000 7fc308e74b80 1 Processor -- start 2023-10-06T03:02:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.026+0000 7fc308e74b80 1 -- start start 2023-10-06T03:02:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513578890 0x55c5135c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513579d10 0x55c5135be420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c5135c8c50 0x55c5135bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc308e74b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5135c8a40 con 0x55c513579d10 2023-10-06T03:02:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc308e74b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5135781b0 con 0x55c5135c8c50 2023-10-06T03:02:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc308e74b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c513577730 con 0x55c513578890 2023-10-06T03:02:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2fd117700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513579d10 0x55c5135be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2fd117700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513579d10 0x55c5135be420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47922/0 (socket says 172.21.15.84:47922) 2023-10-06T03:02:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2fd117700 1 -- 172.21.15.84:0/475897245 learned_addr learned my addr 172.21.15.84:0/475897245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2fd117700 1 -- 172.21.15.84:0/475897245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513578890 msgr2=0x55c5135c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2fd117700 1 --2- 172.21.15.84:0/475897245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513578890 0x55c5135c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2fd117700 1 -- 172.21.15.84:0/475897245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c5135c8c50 msgr2=0x55c5135bcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2fd117700 1 --2- 172.21.15.84:0/475897245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c5135c8c50 0x55c5135bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2fd117700 1 -- 172.21.15.84:0/475897245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5134977d0 con 0x55c513579d10 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2fd117700 1 --2- 172.21.15.84:0/475897245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513579d10 0x55c5135be420 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80519f0 tx=0x7fc2e8084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d087e2afd3fb33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2db7fe700 1 -- 172.21.15.84:0/475897245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e805c490 con 0x55c513579d10 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2db7fe700 1 -- 172.21.15.84:0/475897245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e806b070 con 0x55c513579d10 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.027+0000 7fc2db7fe700 1 -- 172.21.15.84:0/475897245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800cdb0 con 0x55c513579d10 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 -- 172.21.15.84:0/475897245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513579d10 msgr2=0x55c5135be420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 --2- 172.21.15.84:0/475897245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513579d10 0x55c5135be420 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80519f0 tx=0x7fc2e8084040 comp rx=0 tx=0).stop 2023-10-06T03:02:11.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 -- 172.21.15.84:0/475897245 shutdown_connections 2023-10-06T03:02:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 --2- 172.21.15.84:0/475897245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c5135c8c50 0x55c5135bcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 --2- 172.21.15.84:0/475897245 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513578890 0x55c5135c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 --2- 172.21.15.84:0/475897245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c513579d10 0x55c5135be420 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 -- 172.21.15.84:0/475897245 >> 172.21.15.84:0/475897245 conn(0x55c51357a1b0 msgr2=0x55c513579200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 -- 172.21.15.84:0/475897245 shutdown_connections 2023-10-06T03:02:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 -- 172.21.15.84:0/475897245 wait complete. 2023-10-06T03:02:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.028+0000 7fc308e74b80 1 -- start start 2023-10-06T03:02:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.029+0000 7fc308e74b80 1 Processor -- start 2023-10-06T03:02:11.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.029+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513578890 0x55c51359b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.029+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 0x55c51359f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.029+0000 7fc308e74b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.029+0000 7fc308e74b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5136190a0 con 0x55c5135c8c50 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.029+0000 7fc308e74b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5135c1c40 con 0x55c513579d10 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.029+0000 7fc308e74b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c51359d290 con 0x55c513578890 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.029+0000 7fc308e74b80 10 client.0 _ll_register_callbacks cb 0x55c51353bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fe119700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fe119700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47928/0 (socket says 172.21.15.84:47928) 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fe119700 1 -- 172.21.15.84:0/1875048941 learned_addr learned my addr 172.21.15.84:0/1875048941 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fd918700 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513578890 0x55c51359b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fd117700 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 0x55c51359f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fe119700 1 -- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513578890 msgr2=0x55c51359b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fe119700 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513578890 0x55c51359b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fe119700 1 -- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 msgr2=0x55c51359f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fe119700 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 0x55c51359f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fe119700 1 -- 172.21.15.84:0/1875048941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f809b350 con 0x55c5135c8c50 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2fe119700 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135c0eb0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0007dd0 tx=0x7fc2f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742e0771a31efab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2d3fff700 1 -- 172.21.15.84:0/1875048941 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0013810 con 0x55c5135c8c50 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2d3fff700 1 -- 172.21.15.84:0/1875048941 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc2f0013970 con 0x55c5135c8c50 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc308e74b80 1 -- 172.21.15.84:0/1875048941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc2f4007e30 con 0x55c5135c8c50 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2d3fff700 1 -- 172.21.15.84:0/1875048941 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2f001a500 con 0x55c5135c8c50 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc308e74b80 10 client.8946 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc308e74b80 1 -- 172.21.15.84:0/1875048941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55c51347e4c0 con 0x55c5135c8c50 2023-10-06T03:02:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2d3fff700 1 -- 172.21.15.84:0/1875048941 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4007e30 con 0x55c5135c8c50 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc2d3fff700 1 -- 172.21.15.84:0/1875048941 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fc2f001a660 con 0x55c5135c8c50 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc308e74b80 10 client.8946 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc308e74b80 10 client.8946 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.030+0000 7fc308e74b80 20 client.8946 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c51359ccd0 0x55c5135c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 4 client.8946 mds_command: new command op to 6782 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 -- 172.21.15.84:0/1875048941 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c51346be50 con 0x55c51359ccd0 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc2fd918700 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c51359ccd0 0x55c5135c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc2d3fff700 10 client.8946 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc2fd918700 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c51359ccd0 0x55c5135c13f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b06c117f4c340f83 server_cookie=b5e1c6b11bf2c9eb in_seq=0 out_seq=0 2023-10-06T03:02:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc2d3fff700 1 -- 172.21.15.84:0/1875048941 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55c51346be50 con 0x55c51359ccd0 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc2d3fff700 10 client.8946 handle_command_reply: tid=0 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 client.8946 shutdown 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 -- 172.21.15.84:0/1875048941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 msgr2=0x55c5135c0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135c0eb0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0007dd0 tx=0x7fc2f0017000 comp rx=0 tx=0).stop 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 -- 172.21.15.84:0/1875048941 shutdown_connections 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55c51359ccd0 0x55c5135c13f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5135c8c50 0x55c5135c0eb0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc2d3fff700 0 client.8946 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c513578890 0x55c51359b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 --2- 172.21.15.84:0/1875048941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c513579d10 0x55c51359f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.031+0000 7fc308e74b80 1 -- 172.21.15.84:0/1875048941 >> 172.21.15.84:0/1875048941 conn(0x55c51357a1b0 msgr2=0x55c5135be420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc308e74b80 1 -- 172.21.15.84:0/1875048941 shutdown_connections 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc308e74b80 1 -- 172.21.15.84:0/1875048941 wait complete. 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc308e74b80 20 client.8946 trim_cache size 0 max 16384 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:11.040 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:11.041 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:11.041 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 msgr2=0x7fc2dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009fd0 tx=0x7fc2f4018000 comp rx=0 tx=0).stop 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80cb980 msgr2=0x7fc2f809ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80cb980 0x7fc2f809ae10 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800e8d0 tx=0x7fc2e8008040 comp rx=0 tx=0).stop 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/2870407447 shutdown_connections 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc2dc066f30 0x7fc2dc0693e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2f80b2a90 0x7fc2f809be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2f80ced90 0x7fc2f814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 --2- 172.21.15.84:0/2870407447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2f80cb980 0x7fc2f809ae10 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/2870407447 >> 172.21.15.84:0/2870407447 conn(0x7fc2f8099740 msgr2=0x7fc2f8159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/2870407447 shutdown_connections 2023-10-06T03:02:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.032+0000 7fc2ffb7c700 1 -- 172.21.15.84:0/2870407447 wait complete. 2023-10-06T03:02:11.044 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:11.044 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-10-06T03:02:11.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.159+0000 7fdc6359e700 1 Processor -- start 2023-10-06T03:02:11.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.159+0000 7fdc6359e700 1 -- start start 2023-10-06T03:02:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc6359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2660 0x7fdc640cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc6359e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc640cf1f0 0x7fdc640cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc6359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc640cc9b0 con 0x7fdc640b2a30 2023-10-06T03:02:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc6359e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc640cbda0 con 0x7fdc640cf1f0 2023-10-06T03:02:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc6359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640cc080 con 0x7fdc640b2660 2023-10-06T03:02:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc61d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdc640b2a30 0x7fdc640ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58440/0 (socket says 172.21.15.84:58440) 2023-10-06T03:02:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc61d9b700 1 -- 172.21.15.84:0/2621597480 learned_addr learned my addr 172.21.15.84:0/2621597480 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/2621597480 >> v2:172.21.15.131:3300/0 conn(0x7fdc640cf1f0 0x7fdc640cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc6259c700 1 --2- 172.21.15.84:0/2621597480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2660 0x7fdc640cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc6159a700 1 -- 172.21.15.84:0/2621597480 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467378780 0 0) 0x7fdc640cc9b0 con 0x7fdc640b2a30 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.160+0000 7fdc6159a700 1 -- 172.21.15.84:0/2621597480 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc4c003570 con 0x7fdc640b2a30 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6259c700 1 -- 172.21.15.84:0/2621597480 >> v2:172.21.15.131:3300/0 conn(0x7fdc640cf1f0 msgr2=0x7fdc640cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6259c700 1 --2- 172.21.15.84:0/2621597480 >> v2:172.21.15.131:3300/0 conn(0x7fdc640cf1f0 0x7fdc640cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6159a700 1 -- 172.21.15.84:0/2621597480 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3176157992 0 0) 0x7fdc4c003570 con 0x7fdc640b2a30 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6259c700 1 -- 172.21.15.84:0/2621597480 >> v1:172.21.15.84:6789/0 conn(0x7fdc640b2a30 legacy=0x7fdc640ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6259c700 1 -- 172.21.15.84:0/2621597480 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640cc360 con 0x7fdc640b2660 2023-10-06T03:02:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6259c700 1 --2- 172.21.15.84:0/2621597480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2660 0x7fdc640cccf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0098d0 tx=0x7fdc5c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7f87f7f37159132 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6159a700 1 -- 172.21.15.84:0/2621597480 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58001470 con 0x7fdc640b2660 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6159a700 1 -- 172.21.15.84:0/2621597480 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c011420 con 0x7fdc640b2660 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6159a700 1 -- 172.21.15.84:0/2621597480 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0117c0 con 0x7fdc640b2660 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6359e700 1 -- 172.21.15.84:0/2621597480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2660 msgr2=0x7fdc640cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6359e700 1 --2- 172.21.15.84:0/2621597480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2660 0x7fdc640cccf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0098d0 tx=0x7fdc5c009120 comp rx=0 tx=0).stop 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6359e700 1 -- 172.21.15.84:0/2621597480 shutdown_connections 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6359e700 1 --2- 172.21.15.84:0/2621597480 >> v2:172.21.15.131:3300/0 conn(0x7fdc640cf1f0 0x7fdc640cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6359e700 1 --2- 172.21.15.84:0/2621597480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2660 0x7fdc640cccf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.161+0000 7fdc6359e700 1 -- 172.21.15.84:0/2621597480 >> 172.21.15.84:0/2621597480 conn(0x7fdc64099560 msgr2=0x7fdc6406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.162+0000 7fdc6359e700 1 -- 172.21.15.84:0/2621597480 shutdown_connections 2023-10-06T03:02:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.162+0000 7fdc6359e700 1 -- 172.21.15.84:0/2621597480 wait complete. 2023-10-06T03:02:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc6359e700 1 Processor -- start 2023-10-06T03:02:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc6359e700 1 -- start start 2023-10-06T03:02:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc6359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc640b2660 0x7fdc640b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc6359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2a30 0x7fdc64144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc6359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc640cf1f0 0x7fdc640c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc6359e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640b4dd0 con 0x7fdc640cf1f0 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc6359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc64153690 con 0x7fdc640b2660 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc6359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640c75f0 con 0x7fdc640b2a30 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc62d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc640cf1f0 0x7fdc640c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc62d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc640cf1f0 0x7fdc640c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47940/0 (socket says 172.21.15.84:47940) 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc62d9d700 1 -- 172.21.15.84:0/3165011473 learned_addr learned my addr 172.21.15.84:0/3165011473 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.163+0000 7fdc6259c700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc640b2660 0x7fdc640b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2a30 0x7fdc64144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc62d9d700 1 -- 172.21.15.84:0/3165011473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2a30 msgr2=0x7fdc64144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2a30 0x7fdc64144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc62d9d700 1 -- 172.21.15.84:0/3165011473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc640b2660 msgr2=0x7fdc640b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc640b2660 0x7fdc640b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc62d9d700 1 -- 172.21.15.84:0/3165011473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0093c0 con 0x7fdc640cf1f0 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc640cf1f0 0x7fdc640c9280 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009e90 tx=0x7fdc5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc527fc700 1 -- 172.21.15.84:0/3165011473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400cb70 con 0x7fdc640cf1f0 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc527fc700 1 -- 172.21.15.84:0/3165011473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5400f040 con 0x7fdc640cf1f0 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc6359e700 1 -- 172.21.15.84:0/3165011473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc640b4530 con 0x7fdc640cf1f0 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc527fc700 1 -- 172.21.15.84:0/3165011473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54014480 con 0x7fdc640cf1f0 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.164+0000 7fdc6359e700 1 -- 172.21.15.84:0/3165011473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc640b4af0 con 0x7fdc640cf1f0 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.166+0000 7fdc527fc700 1 -- 172.21.15.84:0/3165011473 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc54014830 con 0x7fdc640cf1f0 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.166+0000 7fdc527fc700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc44066f30 0x7fdc440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.166+0000 7fdc527fc700 1 -- 172.21.15.84:0/3165011473 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdc540855e0 con 0x7fdc640cf1f0 2023-10-06T03:02:11.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.166+0000 7fdc6259c700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc44066f30 0x7fdc440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.167+0000 7fdc6259c700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc44066f30 0x7fdc440693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009160 tx=0x7fdc5c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.168+0000 7fdc72210b80 1 Processor -- start 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.168+0000 7fdc72210b80 1 -- start start 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a4998fea0 0x555a4996ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49970310 0x555a4996b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 0x555a4996b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc72210b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a498c5ac0 con 0x555a49970310 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc72210b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a498c32c0 con 0x555a49971a60 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc72210b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a498bf0b0 con 0x555a4998fea0 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc61d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49970310 0x555a4996b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc61d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49970310 0x555a4996b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47946/0 (socket says 172.21.15.84:47946) 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc61d9b700 1 -- 172.21.15.84:0/750065707 learned_addr learned my addr 172.21.15.84:0/750065707 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 0x555a4996b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc6259c700 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a4998fea0 0x555a4996ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc61d9b700 1 -- 172.21.15.84:0/750065707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a4998fea0 msgr2=0x555a4996ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a4998fea0 0x555a4996ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc61d9b700 1 -- 172.21.15.84:0/750065707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 msgr2=0x555a4996b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 0x555a4996b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc61d9b700 1 -- 172.21.15.84:0/750065707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a497592c0 con 0x555a49970310 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 0x555a4996b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.169+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49970310 0x555a4996b250 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fdc58004d40 tx=0x7fdc58000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a5f8d7d251d1d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc437fe700 1 -- 172.21.15.84:0/750065707 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800fbb0 con 0x555a49970310 2023-10-06T03:02:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc437fe700 1 -- 172.21.15.84:0/750065707 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5800fd10 con 0x555a49970310 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc437fe700 1 -- 172.21.15.84:0/750065707 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580125a0 con 0x555a49970310 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc72210b80 1 -- 172.21.15.84:0/750065707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49970310 msgr2=0x555a4996b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc72210b80 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49970310 0x555a4996b250 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fdc58004d40 tx=0x7fdc58000bc0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc72210b80 1 -- 172.21.15.84:0/750065707 shutdown_connections 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc72210b80 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 0x555a4996b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc72210b80 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a4998fea0 0x555a4996ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc72210b80 1 --2- 172.21.15.84:0/750065707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49970310 0x555a4996b250 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc72210b80 1 -- 172.21.15.84:0/750065707 >> 172.21.15.84:0/750065707 conn(0x555a4996fed0 msgr2=0x555a49970700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc72210b80 1 -- 172.21.15.84:0/750065707 shutdown_connections 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.170+0000 7fdc72210b80 1 -- 172.21.15.84:0/750065707 wait complete. 2023-10-06T03:02:11.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.171+0000 7fdc72210b80 1 -- start start 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.171+0000 7fdc72210b80 1 Processor -- start 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a49997ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 0x555a49990270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc72210b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4986a8e0 con 0x555a49971a60 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc72210b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a49885ef0 con 0x555a4998fea0 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc72210b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a49741e80 con 0x555a49970310 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc72210b80 10 client.0 _ll_register_callbacks cb 0x555a49932070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc61d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc61d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47958/0 (socket says 172.21.15.84:47958) 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc61d9b700 1 -- 172.21.15.84:0/2968490707 learned_addr learned my addr 172.21.15.84:0/2968490707 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 0x555a49990270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc6259c700 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a49997ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc61d9b700 1 -- 172.21.15.84:0/2968490707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 msgr2=0x555a49997ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a49997ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc61d9b700 1 -- 172.21.15.84:0/2968490707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 msgr2=0x555a49990270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 0x555a49990270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc61d9b700 1 -- 172.21.15.84:0/2968490707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc640b4af0 con 0x555a49971a60 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b6350 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fdc58001ed0 tx=0x7fdc58007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c8c9c7f54d5d7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.172+0000 7fdc40ff9700 1 -- 172.21.15.84:0/2968490707 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58001390 con 0x555a49971a60 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc40ff9700 1 -- 172.21.15.84:0/2968490707 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdc5800fe80 con 0x555a49971a60 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc72210b80 1 -- 172.21.15.84:0/2968490707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a49963990 con 0x555a49971a60 2023-10-06T03:02:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc40ff9700 1 -- 172.21.15.84:0/2968490707 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc58012d30 con 0x555a49971a60 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc72210b80 10 client.8958 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc72210b80 1 -- 172.21.15.84:0/2968490707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x7fdc580048f0 con 0x555a49971a60 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc40ff9700 1 -- 172.21.15.84:0/2968490707 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555a49963990 con 0x555a49971a60 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc40ff9700 1 -- 172.21.15.84:0/2968490707 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fdc5801c070 con 0x555a49971a60 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc72210b80 10 client.8958 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc72210b80 10 client.8958 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc72210b80 20 client.8958 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x555a499b8730 0x555a499b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc72210b80 4 client.8958 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc72210b80 1 -- 172.21.15.84:0/2968490707 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a499408c0 con 0x555a499b8730 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc6259c700 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x555a499b8730 0x555a499b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc40ff9700 10 client.8958 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.173+0000 7fdc6259c700 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x555a499b8730 0x555a499b8b30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8840d1ee9206d9 server_cookie=e5d407206ef36ec7 in_seq=0 out_seq=0 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc40ff9700 1 -- 172.21.15.84:0/2968490707 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555a499408c0 con 0x555a499b8730 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc40ff9700 10 client.8958 handle_command_reply: tid=0 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 client.8958 shutdown 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 -- 172.21.15.84:0/2968490707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 msgr2=0x555a499b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b6350 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fdc58001ed0 tx=0x7fdc58007000 comp rx=0 tx=0).stop 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 -- 172.21.15.84:0/2968490707 shutdown_connections 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x555a499b8730 0x555a499b8b30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 0x555a49990270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a49997ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc40ff9700 0 client.8958 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2968490707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b6350 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 -- 172.21.15.84:0/2968490707 >> 172.21.15.84:0/2968490707 conn(0x555a4996fed0 msgr2=0x555a4996ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 -- 172.21.15.84:0/2968490707 shutdown_connections 2023-10-06T03:02:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 1 -- 172.21.15.84:0/2968490707 wait complete. 2023-10-06T03:02:11.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.174+0000 7fdc72210b80 20 client.8958 trim_cache size 0 max 16384 2023-10-06T03:02:11.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.190+0000 7fdc72210b80 1 Processor -- start 2023-10-06T03:02:11.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.190+0000 7fdc72210b80 1 -- start start 2023-10-06T03:02:11.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a4999d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 0x555a499b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc72210b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a4996c960 con 0x555a49971a60 2023-10-06T03:02:11.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc72210b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a49972060 con 0x555a4998fea0 2023-10-06T03:02:11.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc72210b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a499c7590 con 0x555a49970310 2023-10-06T03:02:11.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc61d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc61d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47966/0 (socket says 172.21.15.84:47966) 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc61d9b700 1 -- 172.21.15.84:0/2256692640 learned_addr learned my addr 172.21.15.84:0/2256692640 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 0x555a499b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc6259c700 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a4999d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc61d9b700 1 -- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 msgr2=0x555a4999d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a4999d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc61d9b700 1 -- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 msgr2=0x555a499b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 0x555a499b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc61d9b700 1 -- 172.21.15.84:0/2256692640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a496fc030 con 0x555a49971a60 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc6259c700 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a4999d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 0x555a499b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:11.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b5d70 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800f790 tx=0x7fdc58021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff4846a9c73da05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc43fff700 1 -- 172.21.15.84:0/2256692640 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58001b10 con 0x555a49971a60 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc43fff700 1 -- 172.21.15.84:0/2256692640 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5800b070 con 0x555a49971a60 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.191+0000 7fdc43fff700 1 -- 172.21.15.84:0/2256692640 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800fe80 con 0x555a49971a60 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.192+0000 7fdc72210b80 1 -- 172.21.15.84:0/2256692640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 msgr2=0x555a499b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.192+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b5d70 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800f790 tx=0x7fdc58021000 comp rx=0 tx=0).stop 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.192+0000 7fdc72210b80 1 -- 172.21.15.84:0/2256692640 shutdown_connections 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.192+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a4998fea0 0x555a499b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.192+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a4999d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.192+0000 7fdc72210b80 1 --2- 172.21.15.84:0/2256692640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a49971a60 0x555a499b5d70 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.192+0000 7fdc72210b80 1 -- 172.21.15.84:0/2256692640 >> 172.21.15.84:0/2256692640 conn(0x555a4996fed0 msgr2=0x555a49965450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.192+0000 7fdc72210b80 1 -- 172.21.15.84:0/2256692640 shutdown_connections 2023-10-06T03:02:11.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.192+0000 7fdc72210b80 1 -- 172.21.15.84:0/2256692640 wait complete. 2023-10-06T03:02:11.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.193+0000 7fdc72210b80 1 -- start start 2023-10-06T03:02:11.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.193+0000 7fdc72210b80 1 Processor -- start 2023-10-06T03:02:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.193+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a49991910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.193+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 0x555a49a1a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.193+0000 7fdc72210b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a4998fea0 0x555a49965450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.193+0000 7fdc72210b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a499b9330 con 0x555a4998fea0 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.193+0000 7fdc72210b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a499960e0 con 0x555a49971a60 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc72210b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a4996b730 con 0x555a49970310 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc72210b80 10 client.0 _ll_register_callbacks cb 0x555a49932070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc62d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a4998fea0 0x555a49965450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc62d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a4998fea0 0x555a49965450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47980/0 (socket says 172.21.15.84:47980) 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc62d9d700 1 -- 172.21.15.84:0/162229866 learned_addr learned my addr 172.21.15.84:0/162229866 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc6259c700 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a49991910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc61d9b700 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 0x555a49a1a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc62d9d700 1 -- 172.21.15.84:0/162229866 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 msgr2=0x555a49991910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a49991910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc62d9d700 1 -- 172.21.15.84:0/162229866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 msgr2=0x555a49a1a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 0x555a49a1a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc62d9d700 1 -- 172.21.15.84:0/162229866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc580048f0 con 0x555a4998fea0 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc62d9d700 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a4998fea0 0x555a49965450 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fdc54052690 tx=0x7fdc54085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c302cdb8ce20afc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc40ff9700 1 -- 172.21.15.84:0/162229866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc540563f0 con 0x555a4998fea0 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc40ff9700 1 -- 172.21.15.84:0/162229866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdc54056550 con 0x555a4998fea0 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc72210b80 1 -- 172.21.15.84:0/162229866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc5800fd10 con 0x555a4998fea0 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc40ff9700 1 -- 172.21.15.84:0/162229866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc54055890 con 0x555a4998fea0 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc72210b80 10 client.8964 fetch_fsmap learned FSMap version 108 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc72210b80 1 -- 172.21.15.84:0/162229866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x555a4988d7d0 con 0x555a4998fea0 2023-10-06T03:02:11.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc40ff9700 1 -- 172.21.15.84:0/162229866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5800fd10 con 0x555a4998fea0 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.194+0000 7fdc40ff9700 1 -- 172.21.15.84:0/162229866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 108) v1 ==== 3136+0+0 (secure 0 0 0) 0x7fdc5405cca0 con 0x555a4998fea0 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 10 client.8964 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 10 client.8964 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 20 client.8964 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x555a49965990 0x555a499706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 4 client.8964 mds_command: new command op to 8529 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 -- 172.21.15.84:0/162229866 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555a49861e50 con 0x555a49965990 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc6259c700 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x555a49965990 0x555a499706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc40ff9700 10 client.8964 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc6259c700 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x555a49965990 0x555a499706e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecc8f26f462a71b server_cookie=8f5a680c3362960e in_seq=0 out_seq=0 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc40ff9700 1 -- 172.21.15.84:0/162229866 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x555a49861e50 con 0x555a49965990 2023-10-06T03:02:11.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc40ff9700 10 client.8964 handle_command_reply: tid=0 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 client.8964 shutdown 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 -- 172.21.15.84:0/162229866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a4998fea0 msgr2=0x555a49965450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a4998fea0 0x555a49965450 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fdc54052690 tx=0x7fdc54085040 comp rx=0 tx=0).stop 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 -- 172.21.15.84:0/162229866 shutdown_connections 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x555a49965990 0x555a499706e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555a4998fea0 0x555a49965450 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc40ff9700 0 client.8964 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555a49970310 0x555a49991910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 --2- 172.21.15.84:0/162229866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555a49971a60 0x555a49a1a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 -- 172.21.15.84:0/162229866 >> 172.21.15.84:0/162229866 conn(0x555a4996fed0 msgr2=0x555a499b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 -- 172.21.15.84:0/162229866 shutdown_connections 2023-10-06T03:02:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.195+0000 7fdc72210b80 1 -- 172.21.15.84:0/162229866 wait complete. 2023-10-06T03:02:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc72210b80 20 client.8964 trim_cache size 0 max 16384 2023-10-06T03:02:11.204 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:11.204 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:02:11.204 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:11.204 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:11.204 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:11.204 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:11.204 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:11.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:11.205 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:11.205 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 -- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc44066f30 msgr2=0x7fdc440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc44066f30 0x7fdc440693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009160 tx=0x7fdc5c016000 comp rx=0 tx=0).stop 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 -- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc640cf1f0 msgr2=0x7fdc640c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc640cf1f0 0x7fdc640c9280 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009e90 tx=0x7fdc5400b040 comp rx=0 tx=0).stop 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 -- 172.21.15.84:0/3165011473 shutdown_connections 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc44066f30 0x7fdc440693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc640b2660 0x7fdc640b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc640cf1f0 0x7fdc640c9280 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 --2- 172.21.15.84:0/3165011473 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc640b2a30 0x7fdc64144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 -- 172.21.15.84:0/3165011473 >> 172.21.15.84:0/3165011473 conn(0x7fdc64099560 msgr2=0x7fdc6406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 -- 172.21.15.84:0/3165011473 shutdown_connections 2023-10-06T03:02:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.196+0000 7fdc6359e700 1 -- 172.21.15.84:0/3165011473 wait complete. 2023-10-06T03:02:11.208 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:11.208 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:11.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.322+0000 7ff5749ed700 1 Processor -- start 2023-10-06T03:02:11.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.322+0000 7ff5749ed700 1 -- start start 2023-10-06T03:02:11.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff5749ed700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 0x7ff5700aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff5749ed700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff5700b49e0 0x7ff5700aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff5749ed700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5700b0ca0 con 0x7ff5700b07a0 2023-10-06T03:02:11.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff5749ed700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5700b0f80 con 0x7ff5700b49e0 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff5749ed700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700b1260 con 0x7ff5701595a0 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56e59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 0x7ff5700aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56dd9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff5700b49e0 0x7ff5700aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56ed9d700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff5700b07a0 0x7ff5700b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:49234/0 (socket says 172.21.15.84:49234) 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56dd9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff5700b49e0 0x7ff5700aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:32810/0 (socket says 172.21.15.84:32810) 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56ed9d700 1 -- 172.21.15.84:0/3889454496 learned_addr learned my addr 172.21.15.84:0/3889454496 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56e59c700 1 --2- 172.21.15.84:0/3889454496 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 0x7ff5700aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:48628/0 (socket says 172.21.15.84:48628) 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56dd9b700 1 -- 172.21.15.84:0/3889454496 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 msgr2=0x7ff5700aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56dd9b700 1 --2- 172.21.15.84:0/3889454496 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 0x7ff5700aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56dd9b700 1 -- 172.21.15.84:0/3889454496 >> v1:172.21.15.131:6789/0 conn(0x7ff5700b07a0 legacy=0x7ff5700b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.323+0000 7ff56dd9b700 1 -- 172.21.15.84:0/3889454496 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700b1540 con 0x7ff5700b49e0 2023-10-06T03:02:11.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff56dd9b700 1 --2- 172.21.15.84:0/3889454496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5700b49e0 0x7ff5700aaab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff5640098e0 tx=0x7ff5640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5b187fcde25ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff56d59a700 1 -- 172.21.15.84:0/3889454496 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400b640 con 0x7ff5700b49e0 2023-10-06T03:02:11.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff56d59a700 1 -- 172.21.15.84:0/3889454496 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400b7a0 con 0x7ff5700b49e0 2023-10-06T03:02:11.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff56d59a700 1 -- 172.21.15.84:0/3889454496 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400bb40 con 0x7ff5700b49e0 2023-10-06T03:02:11.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff5749ed700 1 -- 172.21.15.84:0/3889454496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5700b49e0 msgr2=0x7ff5700aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff5749ed700 1 --2- 172.21.15.84:0/3889454496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5700b49e0 0x7ff5700aaab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff5640098e0 tx=0x7ff5640091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff5749ed700 1 -- 172.21.15.84:0/3889454496 shutdown_connections 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff5749ed700 1 --2- 172.21.15.84:0/3889454496 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 0x7ff5700aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff5749ed700 1 --2- 172.21.15.84:0/3889454496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5700b49e0 0x7ff5700aaab0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff5749ed700 1 -- 172.21.15.84:0/3889454496 >> 172.21.15.84:0/3889454496 conn(0x7ff570099830 msgr2=0x7ff57006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff5749ed700 1 -- 172.21.15.84:0/3889454496 shutdown_connections 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.324+0000 7ff5749ed700 1 -- 172.21.15.84:0/3889454496 wait complete. 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.325+0000 7ff5749ed700 1 Processor -- start 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.325+0000 7ff5749ed700 1 -- start start 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff5749ed700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5700b07a0 0x7ff57015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff5749ed700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5700b49e0 0x7ff570169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff5749ed700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 0x7ff57016a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff5749ed700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57015e5d0 con 0x7ff5700b07a0 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff5749ed700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57015d9c0 con 0x7ff5700b49e0 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff5749ed700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57015dca0 con 0x7ff5701595a0 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff56e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5700b07a0 0x7ff57015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff56e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5700b07a0 0x7ff57015c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47994/0 (socket says 172.21.15.84:47994) 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff56e59c700 1 -- 172.21.15.84:0/1220110009 learned_addr learned my addr 172.21.15.84:0/1220110009 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff56ed9d700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 0x7ff57016a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.326+0000 7ff56dd9b700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5700b49e0 0x7ff570169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff56e59c700 1 -- 172.21.15.84:0/1220110009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 msgr2=0x7ff57016a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff56e59c700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 0x7ff57016a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff56e59c700 1 -- 172.21.15.84:0/1220110009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5700b49e0 msgr2=0x7ff570169d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff56e59c700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5700b49e0 0x7ff570169d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff56e59c700 1 -- 172.21.15.84:0/1220110009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009420 con 0x7ff5700b07a0 2023-10-06T03:02:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff56e59c700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5700b07a0 0x7ff57015c4f0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7ff56000ea00 tx=0x7ff560009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff55e7fc700 1 -- 172.21.15.84:0/1220110009 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56000c6a0 con 0x7ff5700b07a0 2023-10-06T03:02:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff55e7fc700 1 -- 172.21.15.84:0/1220110009 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56000c800 con 0x7ff5700b07a0 2023-10-06T03:02:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57015df80 con 0x7ff5700b07a0 2023-10-06T03:02:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff55e7fc700 1 -- 172.21.15.84:0/1220110009 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56000cb80 con 0x7ff5700b07a0 2023-10-06T03:02:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.327+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57015f0b0 con 0x7ff5700b07a0 2023-10-06T03:02:11.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.328+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff570064ad0 con 0x7ff5700b07a0 2023-10-06T03:02:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.328+0000 7ff55e7fc700 1 -- 172.21.15.84:0/1220110009 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff560013470 con 0x7ff5700b07a0 2023-10-06T03:02:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.329+0000 7ff55e7fc700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff550066f30 0x7ff5500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.329+0000 7ff55e7fc700 1 -- 172.21.15.84:0/1220110009 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff560084dd0 con 0x7ff5700b07a0 2023-10-06T03:02:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.329+0000 7ff56dd9b700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff550066f30 0x7ff5500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.329+0000 7ff56dd9b700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff550066f30 0x7ff5500693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff5700b4df0 tx=0x7ff564017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.333+0000 7ff55e7fc700 1 -- 172.21.15.84:0/1220110009 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff560051d60 con 0x7ff5700b07a0 2023-10-06T03:02:11.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.559+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5700b1820 con 0x7ff5700b07a0 2023-10-06T03:02:11.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.560+0000 7ff55e7fc700 1 -- 172.21.15.84:0/1220110009 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4638 (secure 0 0 0) 0x7ff560021090 con 0x7ff5700b07a0 2023-10-06T03:02:11.560 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:11.560 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":108,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:07.213672+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff550066f30 msgr2=0x7ff5500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff550066f30 0x7ff5500693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff5700b4df0 tx=0x7ff564017000 comp rx=0 tx=0).stop 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5700b07a0 msgr2=0x7ff57015c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5700b07a0 0x7ff57015c4f0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7ff56000ea00 tx=0x7ff560009120 comp rx=0 tx=0).stop 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 shutdown_connections 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff550066f30 0x7ff5500693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5701595a0 0x7ff57016a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5700b07a0 0x7ff57015c4f0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 --2- 172.21.15.84:0/1220110009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5700b49e0 0x7ff570169d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 >> 172.21.15.84:0/1220110009 conn(0x7ff570099830 msgr2=0x7ff570158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 shutdown_connections 2023-10-06T03:02:11.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.562+0000 7ff5749ed700 1 -- 172.21.15.84:0/1220110009 wait complete. 2023-10-06T03:02:11.564 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 108 2023-10-06T03:02:11.574 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:11.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:11.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.688+0000 7fa8352b2700 1 Processor -- start 2023-10-06T03:02:11.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.688+0000 7fa8352b2700 1 -- start start 2023-10-06T03:02:11.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa8352b2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830153c70 0x7fa830068600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa8352b2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa8300cbfd0 0x7fa830068b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa8352b2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa830157660 con 0x7fa830156690 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa8352b2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83006eb90 con 0x7fa8300cbfd0 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa8352b2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa830157380 con 0x7fa830153c70 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa834ab1700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa830156690 0x7fa830156af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:58454/0 (socket says 172.21.15.84:58454) 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa834ab1700 1 -- 172.21.15.84:0/2561645283 learned_addr learned my addr 172.21.15.84:0/2561645283 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa82ffff700 1 --2- 172.21.15.84:0/2561645283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830153c70 0x7fa830068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa82f7fe700 1 --2- 172.21.15.84:0/2561645283 >> v2:172.21.15.131:3300/0 conn(0x7fa8300cbfd0 0x7fa830068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa82effd700 1 -- 172.21.15.84:0/2561645283 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426633788 0 0) 0x7fa830157660 con 0x7fa830156690 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.689+0000 7fa82effd700 1 -- 172.21.15.84:0/2561645283 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa818003570 con 0x7fa830156690 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82effd700 1 -- 172.21.15.84:0/2561645283 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3742158924 0 0) 0x7fa818003570 con 0x7fa830156690 2023-10-06T03:02:11.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82ffff700 1 -- 172.21.15.84:0/2561645283 >> v2:172.21.15.131:3300/0 conn(0x7fa8300cbfd0 msgr2=0x7fa830068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82ffff700 1 --2- 172.21.15.84:0/2561645283 >> v2:172.21.15.131:3300/0 conn(0x7fa8300cbfd0 0x7fa830068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82ffff700 1 -- 172.21.15.84:0/2561645283 >> v1:172.21.15.84:6789/0 conn(0x7fa830156690 legacy=0x7fa830156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82ffff700 1 -- 172.21.15.84:0/2561645283 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300cb4f0 con 0x7fa830153c70 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82f7fe700 1 --2- 172.21.15.84:0/2561645283 >> v2:172.21.15.131:3300/0 conn(0x7fa8300cbfd0 0x7fa830068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82ffff700 1 --2- 172.21.15.84:0/2561645283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830153c70 0x7fa830068600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8200098e0 tx=0x7fa8200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=416b349044e42b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82effd700 1 -- 172.21.15.84:0/2561645283 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280017f0 con 0x7fa830153c70 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82effd700 1 -- 172.21.15.84:0/2561645283 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa820011420 con 0x7fa830153c70 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.690+0000 7fa82effd700 1 -- 172.21.15.84:0/2561645283 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8200117c0 con 0x7fa830153c70 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.691+0000 7fa8352b2700 1 -- 172.21.15.84:0/2561645283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830153c70 msgr2=0x7fa830068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.691+0000 7fa8352b2700 1 --2- 172.21.15.84:0/2561645283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830153c70 0x7fa830068600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8200098e0 tx=0x7fa8200091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.691+0000 7fa8352b2700 1 -- 172.21.15.84:0/2561645283 shutdown_connections 2023-10-06T03:02:11.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.691+0000 7fa8352b2700 1 --2- 172.21.15.84:0/2561645283 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830153c70 0x7fa830068600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.691+0000 7fa8352b2700 1 --2- 172.21.15.84:0/2561645283 >> v2:172.21.15.131:3300/0 conn(0x7fa8300cbfd0 0x7fa830068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.691+0000 7fa8352b2700 1 -- 172.21.15.84:0/2561645283 >> 172.21.15.84:0/2561645283 conn(0x7fa8300c9c50 msgr2=0x7fa83006db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.691+0000 7fa8352b2700 1 -- 172.21.15.84:0/2561645283 shutdown_connections 2023-10-06T03:02:11.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.691+0000 7fa8352b2700 1 -- 172.21.15.84:0/2561645283 wait complete. 2023-10-06T03:02:11.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.692+0000 7fa8352b2700 1 Processor -- start 2023-10-06T03:02:11.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.692+0000 7fa8352b2700 1 -- start start 2023-10-06T03:02:11.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa8352b2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8300cbfd0 0x7fa830158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa8352b2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa830153c70 0x7fa830151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa8352b2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830156690 0x7fa8300ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa8352b2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa830158570 con 0x7fa8300cbfd0 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa8352b2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa830151940 con 0x7fa830153c70 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa8352b2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa830157960 con 0x7fa830156690 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8300cbfd0 0x7fa830158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8300cbfd0 0x7fa830158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47996/0 (socket says 172.21.15.84:47996) 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82ffff700 1 -- 172.21.15.84:0/785462549 learned_addr learned my addr 172.21.15.84:0/785462549 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa834ab1700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830156690 0x7fa8300ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82f7fe700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa830153c70 0x7fa830151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82ffff700 1 -- 172.21.15.84:0/785462549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830156690 msgr2=0x7fa8300ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82ffff700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830156690 0x7fa8300ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82ffff700 1 -- 172.21.15.84:0/785462549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa830153c70 msgr2=0x7fa830151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82ffff700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa830153c70 0x7fa830151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82ffff700 1 -- 172.21.15.84:0/785462549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa824009420 con 0x7fa8300cbfd0 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82f7fe700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa830153c70 0x7fa830151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa82ffff700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8300cbfd0 0x7fa830158a00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa8200093f0 tx=0x7fa820016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa817fff700 1 -- 172.21.15.84:0/785462549 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820006b30 con 0x7fa8300cbfd0 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.693+0000 7fa817fff700 1 -- 172.21.15.84:0/785462549 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa820000d10 con 0x7fa8300cbfd0 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.694+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa820009420 con 0x7fa8300cbfd0 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.694+0000 7fa817fff700 1 -- 172.21.15.84:0/785462549 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82001a450 con 0x7fa8300cbfd0 2023-10-06T03:02:11.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.694+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa830157f20 con 0x7fa8300cbfd0 2023-10-06T03:02:11.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.694+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa830158850 con 0x7fa8300cbfd0 2023-10-06T03:02:11.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.695+0000 7fa817fff700 1 -- 172.21.15.84:0/785462549 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa82001a880 con 0x7fa8300cbfd0 2023-10-06T03:02:11.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.695+0000 7fa817fff700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa81c066f30 0x7fa81c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:11.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.695+0000 7fa817fff700 1 -- 172.21.15.84:0/785462549 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fa820086000 con 0x7fa8300cbfd0 2023-10-06T03:02:11.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.695+0000 7fa82f7fe700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa81c066f30 0x7fa81c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:11.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.696+0000 7fa82f7fe700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa81c066f30 0x7fa81c0693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa8240093f0 tx=0x7fa824008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:11.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.700+0000 7fa817fff700 1 -- 172.21.15.84:0/785462549 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa820052f90 con 0x7fa8300cbfd0 2023-10-06T03:02:11.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.959+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa830158f40 con 0x7fa8300cbfd0 2023-10-06T03:02:11.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.959+0000 7fa817fff700 1 -- 172.21.15.84:0/785462549 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7fa8200565b0 con 0x7fa8300cbfd0 2023-10-06T03:02:11.960 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:11.960 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":449,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":698400,"bytes_used":2451828736,"bytes_avail":770642284544,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":10152,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":108,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2023-10-06T03:01:35.887134+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:11.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa81c066f30 msgr2=0x7fa81c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa81c066f30 0x7fa81c0693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa8240093f0 tx=0x7fa824008040 comp rx=0 tx=0).stop 2023-10-06T03:02:11.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8300cbfd0 msgr2=0x7fa830158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:11.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8300cbfd0 0x7fa830158a00 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa8200093f0 tx=0x7fa820016000 comp rx=0 tx=0).stop 2023-10-06T03:02:11.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 shutdown_connections 2023-10-06T03:02:11.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa81c066f30 0x7fa81c0693e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa830156690 0x7fa8300ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8300cbfd0 0x7fa830158a00 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 --2- 172.21.15.84:0/785462549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa830153c70 0x7fa830151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:11.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 >> 172.21.15.84:0/785462549 conn(0x7fa8300c9c50 msgr2=0x7fa8300c2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:11.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 shutdown_connections 2023-10-06T03:02:11.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:11.961+0000 7fa8352b2700 1 -- 172.21.15.84:0/785462549 wait complete. 2023-10-06T03:02:11.973 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T03:02:12.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:13.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.094+0000 7fbee00ef700 1 Processor -- start 2023-10-06T03:02:13.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.094+0000 7fbee00ef700 1 -- start start 2023-10-06T03:02:13.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbee00ef700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbed80ca3b0 0x7fbed81582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbee00ef700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbed80adba0 0x7fbed80ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbee00ef700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbed80ce710 0x7fbed815af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbee00ef700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed80cbbd0 con 0x7fbed80adba0 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbee00ef700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed8157e20 con 0x7fbed80ca3b0 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbee00ef700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80ceb50 con 0x7fbed80ce710 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedd68a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbed80adba0 0x7fbed80ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedd68a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbed80adba0 0x7fbed80ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39038/0 (socket says 172.21.15.84:39038) 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedd68a700 1 -- 172.21.15.84:0/2357871116 learned_addr learned my addr 172.21.15.84:0/2357871116 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedde8b700 1 --2- 172.21.15.84:0/2357871116 >> v2:172.21.15.131:3300/0 conn(0x7fbed80ca3b0 0x7fbed81582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbede68c700 1 --2- 172.21.15.84:0/2357871116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbed80ce710 0x7fbed815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedd68a700 1 -- 172.21.15.84:0/2357871116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbed80ce710 msgr2=0x7fbed815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedd68a700 1 --2- 172.21.15.84:0/2357871116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbed80ce710 0x7fbed815af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedd68a700 1 -- 172.21.15.84:0/2357871116 >> v2:172.21.15.131:3300/0 conn(0x7fbed80ca3b0 msgr2=0x7fbed81582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedd68a700 1 --2- 172.21.15.84:0/2357871116 >> v2:172.21.15.131:3300/0 conn(0x7fbed80ca3b0 0x7fbed81582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedd68a700 1 -- 172.21.15.84:0/2357871116 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed80cb610 con 0x7fbed80adba0 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedd68a700 1 --2- 172.21.15.84:0/2357871116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80adba0 0x7fbed80ce1d0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fbed806f300 tx=0x7fbec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4714ff79cace5521 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedce89700 1 -- 172.21.15.84:0/2357871116 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800b860 con 0x7fbed80adba0 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedce89700 1 -- 172.21.15.84:0/2357871116 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec800b9c0 con 0x7fbed80adba0 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.095+0000 7fbedce89700 1 -- 172.21.15.84:0/2357871116 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800bd60 con 0x7fbed80adba0 2023-10-06T03:02:13.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.096+0000 7fbee00ef700 1 -- 172.21.15.84:0/2357871116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80adba0 msgr2=0x7fbed80ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.096+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2357871116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80adba0 0x7fbed80ce1d0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fbed806f300 tx=0x7fbec8009250 comp rx=0 tx=0).stop 2023-10-06T03:02:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.096+0000 7fbee00ef700 1 -- 172.21.15.84:0/2357871116 shutdown_connections 2023-10-06T03:02:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.096+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2357871116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbed80ce710 0x7fbed815af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.096+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2357871116 >> v2:172.21.15.131:3300/0 conn(0x7fbed80ca3b0 0x7fbed81582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.096+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2357871116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80adba0 0x7fbed80ce1d0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.096+0000 7fbee00ef700 1 -- 172.21.15.84:0/2357871116 >> 172.21.15.84:0/2357871116 conn(0x7fbed8070810 msgr2=0x7fbed8070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.096+0000 7fbee00ef700 1 -- 172.21.15.84:0/2357871116 shutdown_connections 2023-10-06T03:02:13.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.096+0000 7fbee00ef700 1 -- 172.21.15.84:0/2357871116 wait complete. 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.097+0000 7fbee00ef700 1 Processor -- start 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.097+0000 7fbee00ef700 1 -- start start 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbee00ef700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbed80adba0 0x7fbed8152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbee00ef700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80ca3b0 0x7fbed80c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbee00ef700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbed80ce710 0x7fbed80b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbee00ef700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80c74d0 con 0x7fbed80ca3b0 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbee00ef700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80c3740 con 0x7fbed80adba0 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbee00ef700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80c3a20 con 0x7fbed80ce710 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbedd68a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80ca3b0 0x7fbed80c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbedd68a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80ca3b0 0x7fbed80c2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39048/0 (socket says 172.21.15.84:39048) 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbedd68a700 1 -- 172.21.15.84:0/2073315444 learned_addr learned my addr 172.21.15.84:0/2073315444 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbedd68a700 1 -- 172.21.15.84:0/2073315444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbed80ce710 msgr2=0x7fbed80b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbedd68a700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbed80ce710 0x7fbed80b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbedd68a700 1 -- 172.21.15.84:0/2073315444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbed80adba0 msgr2=0x7fbed8152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbedd68a700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbed80adba0 0x7fbed8152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbedd68a700 1 -- 172.21.15.84:0/2073315444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80094f0 con 0x7fbed80ca3b0 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbedd68a700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80ca3b0 0x7fbed80c2e40 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fbed80cdfe0 tx=0x7fbec8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.098+0000 7fbecdffb700 1 -- 172.21.15.84:0/2073315444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800bcd0 con 0x7fbed80ca3b0 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.099+0000 7fbecdffb700 1 -- 172.21.15.84:0/2073315444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec801a630 con 0x7fbed80ca3b0 2023-10-06T03:02:13.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.099+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed80c3d00 con 0x7fbed80ca3b0 2023-10-06T03:02:13.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.099+0000 7fbecdffb700 1 -- 172.21.15.84:0/2073315444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec801a9f0 con 0x7fbed80ca3b0 2023-10-06T03:02:13.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.099+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed8153390 con 0x7fbed80ca3b0 2023-10-06T03:02:13.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.100+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed8064ad0 con 0x7fbed80ca3b0 2023-10-06T03:02:13.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.100+0000 7fbecdffb700 1 -- 172.21.15.84:0/2073315444 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbec80233e0 con 0x7fbed80ca3b0 2023-10-06T03:02:13.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.100+0000 7fbecdffb700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbebc066f30 0x7fbebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.100+0000 7fbecdffb700 1 -- 172.21.15.84:0/2073315444 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fbec8086270 con 0x7fbed80ca3b0 2023-10-06T03:02:13.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.100+0000 7fbedde8b700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbebc066f30 0x7fbebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.101+0000 7fbedde8b700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbebc066f30 0x7fbebc0693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009a40 tx=0x7fbed4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:13.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.105+0000 7fbecdffb700 1 -- 172.21.15.84:0/2073315444 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbec8053200 con 0x7fbed80ca3b0 2023-10-06T03:02:13.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.333+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbed80cb8f0 con 0x7fbed80ca3b0 2023-10-06T03:02:13.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.333+0000 7fbecdffb700 1 -- 172.21.15.84:0/2073315444 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4640 (secure 0 0 0) 0x7fbec8056820 con 0x7fbed80ca3b0 2023-10-06T03:02:13.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:13.334 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":109,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:12.226018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:13.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbebc066f30 msgr2=0x7fbebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbebc066f30 0x7fbebc0693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009a40 tx=0x7fbed4008040 comp rx=0 tx=0).stop 2023-10-06T03:02:13.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80ca3b0 msgr2=0x7fbed80c2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80ca3b0 0x7fbed80c2e40 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fbed80cdfe0 tx=0x7fbec8017000 comp rx=0 tx=0).stop 2023-10-06T03:02:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 shutdown_connections 2023-10-06T03:02:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbebc066f30 0x7fbebc0693e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbed80adba0 0x7fbed8152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbed80ce710 0x7fbed80b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 --2- 172.21.15.84:0/2073315444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbed80ca3b0 0x7fbed80c2e40 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.335+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 >> 172.21.15.84:0/2073315444 conn(0x7fbed8070810 msgr2=0x7fbed8157090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.336+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 shutdown_connections 2023-10-06T03:02:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.336+0000 7fbee00ef700 1 -- 172.21.15.84:0/2073315444 wait complete. 2023-10-06T03:02:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 109 2023-10-06T03:02:13.347 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:13.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:13.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.460+0000 7f1d41c2e700 1 Processor -- start 2023-10-06T03:02:13.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.460+0000 7f1d41c2e700 1 -- start start 2023-10-06T03:02:13.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d41c2e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1d3c1595a0 0x7f1d3c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d41c2e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b49e0 0x7f1d3c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d41c2e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c0b0ca0 con 0x7f1d3c0b07a0 2023-10-06T03:02:13.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d41c2e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c0b0f80 con 0x7f1d3c1595a0 2023-10-06T03:02:13.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d41c2e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0b1260 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d3b7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1d3c1595a0 0x7f1d3c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d33fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b49e0 0x7f1d3c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d3bfff700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f1d3c0b07a0 0x7f1d3c0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:46030/0 (socket says 172.21.15.84:46030) 2023-10-06T03:02:13.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d3bfff700 1 -- 172.21.15.84:0/2161575172 learned_addr learned my addr 172.21.15.84:0/2161575172 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/2161575172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b49e0 msgr2=0x7f1d3c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.461+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/2161575172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b49e0 0x7f1d3c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/2161575172 >> v1:172.21.15.131:6789/0 conn(0x7f1d3c0b07a0 legacy=0x7f1d3c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d3b7fe700 1 -- 172.21.15.84:0/2161575172 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0b1540 con 0x7f1d3c1595a0 2023-10-06T03:02:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d3affd700 1 -- 172.21.15.84:0/2161575172 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373035415 0 0) 0x7f1d3c0b0ca0 con 0x7f1d3c0b07a0 2023-10-06T03:02:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d33fff700 1 --2- 172.21.15.84:0/2161575172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b49e0 0x7f1d3c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/2161575172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c1595a0 0x7f1d3c0aa570 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0098d0 tx=0x7f1d2c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a64f70593976bc82 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:13.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d3affd700 1 -- 172.21.15.84:0/2161575172 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c005c10 con 0x7f1d3c1595a0 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d3affd700 1 -- 172.21.15.84:0/2161575172 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c005d70 con 0x7f1d3c1595a0 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d3affd700 1 -- 172.21.15.84:0/2161575172 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c006280 con 0x7f1d3c1595a0 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d41c2e700 1 -- 172.21.15.84:0/2161575172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c1595a0 msgr2=0x7f1d3c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d41c2e700 1 --2- 172.21.15.84:0/2161575172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c1595a0 0x7f1d3c0aa570 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0098d0 tx=0x7f1d2c009120 comp rx=0 tx=0).stop 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d41c2e700 1 -- 172.21.15.84:0/2161575172 shutdown_connections 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d41c2e700 1 --2- 172.21.15.84:0/2161575172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c1595a0 0x7f1d3c0aa570 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d41c2e700 1 --2- 172.21.15.84:0/2161575172 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c0b49e0 0x7f1d3c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d41c2e700 1 -- 172.21.15.84:0/2161575172 >> 172.21.15.84:0/2161575172 conn(0x7f1d3c099830 msgr2=0x7f1d3c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.462+0000 7f1d41c2e700 1 -- 172.21.15.84:0/2161575172 shutdown_connections 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.463+0000 7f1d41c2e700 1 -- 172.21.15.84:0/2161575172 wait complete. 2023-10-06T03:02:13.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.464+0000 7f1d41c2e700 1 Processor -- start 2023-10-06T03:02:13.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.464+0000 7f1d41c2e700 1 -- start start 2023-10-06T03:02:13.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.464+0000 7f1d41c2e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c0b07a0 0x7f1d3c14aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.464+0000 7f1d41c2e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b49e0 0x7f1d3c09a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.464+0000 7f1d41c2e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c1595a0 0x7f1d3c09ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.464+0000 7f1d41c2e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15bd00 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.464+0000 7f1d41c2e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c14af50 con 0x7f1d3c0b07a0 2023-10-06T03:02:13.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.464+0000 7f1d41c2e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15bf10 con 0x7f1d3c1595a0 2023-10-06T03:02:13.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d33fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b49e0 0x7f1d3c09a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d33fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b49e0 0x7f1d3c09a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39058/0 (socket says 172.21.15.84:39058) 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d33fff700 1 -- 172.21.15.84:0/3670843826 learned_addr learned my addr 172.21.15.84:0/3670843826 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d3bfff700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c1595a0 0x7f1d3c09ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c0b07a0 0x7f1d3c14aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d33fff700 1 -- 172.21.15.84:0/3670843826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c1595a0 msgr2=0x7f1d3c09ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d33fff700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c1595a0 0x7f1d3c09ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d33fff700 1 -- 172.21.15.84:0/3670843826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c0b07a0 msgr2=0x7f1d3c14aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d33fff700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c0b07a0 0x7f1d3c14aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d33fff700 1 -- 172.21.15.84:0/3670843826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d24009420 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c0b07a0 0x7f1d3c14aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d33fff700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b49e0 0x7f1d3c09a950 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400ecb0 tx=0x7f1d240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d337fe700 1 -- 172.21.15.84:0/3670843826 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2400ee60 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d337fe700 1 -- 172.21.15.84:0/3670843826 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2400cbe0 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c0093c0 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d337fe700 1 -- 172.21.15.84:0/3670843826 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24013470 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.465+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c15c4d0 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.466+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c0ccc20 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.467+0000 7f1d337fe700 1 -- 172.21.15.84:0/3670843826 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d24013820 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.467+0000 7f1d337fe700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d1c066f30 0x7f1d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:13.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.467+0000 7f1d337fe700 1 -- 172.21.15.84:0/3670843826 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1d24084c60 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.467+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d1c066f30 0x7f1d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:13.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.467+0000 7f1d3b7fe700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d1c066f30 0x7f1d1c0693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009160 tx=0x7f1d2c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:13.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.471+0000 7f1d337fe700 1 -- 172.21.15.84:0/3670843826 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d24051bf0 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.729+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1d3c064ad0 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.729+0000 7f1d337fe700 1 -- 172.21.15.84:0/3670843826 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1602 (secure 0 0 0) 0x7f1d24021660 con 0x7f1d3c0b49e0 2023-10-06T03:02:13.730 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:13.730 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":451,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":698400,"bytes_used":2451828736,"bytes_avail":770642284544,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9555,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":109,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2023-10-06T03:01:35.887134+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d1c066f30 msgr2=0x7f1d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d1c066f30 0x7f1d1c0693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009160 tx=0x7f1d2c016000 comp rx=0 tx=0).stop 2023-10-06T03:02:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b49e0 msgr2=0x7f1d3c09a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b49e0 0x7f1d3c09a950 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400ecb0 tx=0x7f1d240091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 shutdown_connections 2023-10-06T03:02:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d1c066f30 0x7f1d1c0693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d3c0b07a0 0x7f1d3c14aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d3c1595a0 0x7f1d3c09ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 --2- 172.21.15.84:0/3670843826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d3c0b49e0 0x7f1d3c09a950 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 >> 172.21.15.84:0/3670843826 conn(0x7f1d3c099830 msgr2=0x7f1d3c0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 shutdown_connections 2023-10-06T03:02:13.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:13.731+0000 7f1d41c2e700 1 -- 172.21.15.84:0/3670843826 wait complete. 2023-10-06T03:02:13.743 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T03:02:14.233 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:02:14.232+0000 7fedc1127700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T03:02:14.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.861+0000 7fb4150bb700 1 Processor -- start 2023-10-06T03:02:14.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.861+0000 7fb4150bb700 1 -- start start 2023-10-06T03:02:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb4150bb700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb410157080 0x7fb4100cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb4150bb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb410157450 0x7fb41006d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb4150bb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 0x7fb4100c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb4150bb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41015b210 con 0x7fb410157450 2023-10-06T03:02:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb4150bb700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41006db20 con 0x7fb410157080 2023-10-06T03:02:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb4150bb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100ce4f0 con 0x7fb41015b6a0 2023-10-06T03:02:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb410157450 0x7fb41006d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb410157450 0x7fb41006d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39062/0 (socket says 172.21.15.84:39062) 2023-10-06T03:02:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40f7fe700 1 -- 172.21.15.84:0/689801760 learned_addr learned my addr 172.21.15.84:0/689801760 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40ffff700 1 --2- 172.21.15.84:0/689801760 >> v2:172.21.15.131:3300/0 conn(0x7fb410157080 0x7fb4100cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb4148ba700 1 --2- 172.21.15.84:0/689801760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 0x7fb4100c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40f7fe700 1 -- 172.21.15.84:0/689801760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 msgr2=0x7fb4100c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40f7fe700 1 --2- 172.21.15.84:0/689801760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 0x7fb4100c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40f7fe700 1 -- 172.21.15.84:0/689801760 >> v2:172.21.15.131:3300/0 conn(0x7fb410157080 msgr2=0x7fb4100cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40f7fe700 1 --2- 172.21.15.84:0/689801760 >> v2:172.21.15.131:3300/0 conn(0x7fb410157080 0x7fb4100cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40f7fe700 1 -- 172.21.15.84:0/689801760 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4100ce7d0 con 0x7fb410157450 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.862+0000 7fb40ffff700 1 --2- 172.21.15.84:0/689801760 >> v2:172.21.15.131:3300/0 conn(0x7fb410157080 0x7fb4100cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb40f7fe700 1 --2- 172.21.15.84:0/689801760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157450 0x7fb41006d5e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fb41006ebd0 tx=0x7fb404009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f1a6805411b31c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb40effd700 1 -- 172.21.15.84:0/689801760 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400b860 con 0x7fb410157450 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb40effd700 1 -- 172.21.15.84:0/689801760 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40400b9c0 con 0x7fb410157450 2023-10-06T03:02:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb40effd700 1 -- 172.21.15.84:0/689801760 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400bd60 con 0x7fb410157450 2023-10-06T03:02:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb4150bb700 1 -- 172.21.15.84:0/689801760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157450 msgr2=0x7fb41006d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb4150bb700 1 --2- 172.21.15.84:0/689801760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157450 0x7fb41006d5e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fb41006ebd0 tx=0x7fb404009250 comp rx=0 tx=0).stop 2023-10-06T03:02:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb4150bb700 1 -- 172.21.15.84:0/689801760 shutdown_connections 2023-10-06T03:02:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb4150bb700 1 --2- 172.21.15.84:0/689801760 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 0x7fb4100c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb4150bb700 1 --2- 172.21.15.84:0/689801760 >> v2:172.21.15.131:3300/0 conn(0x7fb410157080 0x7fb4100cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb4150bb700 1 --2- 172.21.15.84:0/689801760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157450 0x7fb41006d5e0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb4150bb700 1 -- 172.21.15.84:0/689801760 >> 172.21.15.84:0/689801760 conn(0x7fb41006b540 msgr2=0x7fb41006b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb4150bb700 1 -- 172.21.15.84:0/689801760 shutdown_connections 2023-10-06T03:02:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.863+0000 7fb4150bb700 1 -- 172.21.15.84:0/689801760 wait complete. 2023-10-06T03:02:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.864+0000 7fb4150bb700 1 Processor -- start 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb4150bb700 1 -- start start 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb4150bb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157080 0x7fb41014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb4150bb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb410157450 0x7fb4100c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb4150bb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 0x7fb4100c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb4150bb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41006a000 con 0x7fb410157080 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb4150bb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100ca1f0 con 0x7fb410157450 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb4150bb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41014b1f0 con 0x7fb41015b6a0 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb40ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157080 0x7fb41014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb40ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157080 0x7fb41014acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39066/0 (socket says 172.21.15.84:39066) 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.865+0000 7fb40ffff700 1 -- 172.21.15.84:0/2920353708 learned_addr learned my addr 172.21.15.84:0/2920353708 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb40f7fe700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb410157450 0x7fb4100c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb4148ba700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 0x7fb4100c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb40ffff700 1 -- 172.21.15.84:0/2920353708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 msgr2=0x7fb4100c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb40ffff700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 0x7fb4100c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb40ffff700 1 -- 172.21.15.84:0/2920353708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb410157450 msgr2=0x7fb4100c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb40ffff700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb410157450 0x7fb4100c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb40ffff700 1 -- 172.21.15.84:0/2920353708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040094f0 con 0x7fb410157080 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb4148ba700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 0x7fb4100c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb40ffff700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157080 0x7fb41014acb0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c880 tx=0x7fb400008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb3f7fff700 1 -- 172.21.15.84:0/2920353708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400011600 con 0x7fb410157080 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb3f7fff700 1 -- 172.21.15.84:0/2920353708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400011760 con 0x7fb410157080 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb3f7fff700 1 -- 172.21.15.84:0/2920353708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400011b00 con 0x7fb410157080 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4100693f0 con 0x7fb410157080 2023-10-06T03:02:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.866+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4100699b0 con 0x7fb410157080 2023-10-06T03:02:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.867+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41005f270 con 0x7fb410157080 2023-10-06T03:02:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.867+0000 7fb3f7fff700 1 -- 172.21.15.84:0/2920353708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb400018350 con 0x7fb410157080 2023-10-06T03:02:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.868+0000 7fb3f7fff700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3fc066f30 0x7fb3fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.868+0000 7fb3f7fff700 1 -- 172.21.15.84:0/2920353708 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fb400084790 con 0x7fb410157080 2023-10-06T03:02:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.868+0000 7fb40f7fe700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3fc066f30 0x7fb3fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.868+0000 7fb40f7fe700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3fc066f30 0x7fb3fc0693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb41006ebd0 tx=0x7fb404017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:14.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:14.872+0000 7fb3f7fff700 1 -- 172.21.15.84:0/2920353708 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4000551b0 con 0x7fb410157080 2023-10-06T03:02:15.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.096+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb41015aea0 con 0x7fb410157080 2023-10-06T03:02:15.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.097+0000 7fb3f7fff700 1 -- 172.21.15.84:0/2920353708 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4641 (secure 0 0 0) 0x7fb400054d40 con 0x7fb410157080 2023-10-06T03:02:15.097 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:15.097 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":110,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:14.232903+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3fc066f30 msgr2=0x7fb3fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3fc066f30 0x7fb3fc0693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb41006ebd0 tx=0x7fb404017000 comp rx=0 tx=0).stop 2023-10-06T03:02:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157080 msgr2=0x7fb41014acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157080 0x7fb41014acb0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c880 tx=0x7fb400008040 comp rx=0 tx=0).stop 2023-10-06T03:02:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 shutdown_connections 2023-10-06T03:02:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb3fc066f30 0x7fb3fc0693e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41015b6a0 0x7fb4100c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb410157080 0x7fb41014acb0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 --2- 172.21.15.84:0/2920353708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb410157450 0x7fb4100c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 >> 172.21.15.84:0/2920353708 conn(0x7fb41006b540 msgr2=0x7fb4100b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 shutdown_connections 2023-10-06T03:02:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.099+0000 7fb4150bb700 1 -- 172.21.15.84:0/2920353708 wait complete. 2023-10-06T03:02:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 110 2023-10-06T03:02:15.111 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:15.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:15.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.223+0000 7fd6a867a700 1 Processor -- start 2023-10-06T03:02:15.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.223+0000 7fd6a867a700 1 -- start start 2023-10-06T03:02:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a867a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd6a00ad250 0x7fd6a00cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a867a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad620 0x7fd6a015d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a867a700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6a015d980 0x7fd6a0068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a867a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a015de20 con 0x7fd6a00ad250 2023-10-06T03:02:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a867a700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a00ced30 con 0x7fd6a015d980 2023-10-06T03:02:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a867a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00cf010 con 0x7fd6a00ad620 2023-10-06T03:02:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a6416700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd6a00ad250 0x7fd6a00cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a6416700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd6a00ad250 0x7fd6a00cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39074/0 (socket says 172.21.15.84:39074) 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a6416700 1 -- 172.21.15.84:0/3671004103 learned_addr learned my addr 172.21.15.84:0/3671004103 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a6c17700 1 --2- 172.21.15.84:0/3671004103 >> v2:172.21.15.131:3300/0 conn(0x7fd6a015d980 0x7fd6a0068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.224+0000 7fd6a5c15700 1 --2- 172.21.15.84:0/3671004103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad620 0x7fd6a015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a6416700 1 -- 172.21.15.84:0/3671004103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad620 msgr2=0x7fd6a015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a6416700 1 --2- 172.21.15.84:0/3671004103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad620 0x7fd6a015d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a6416700 1 -- 172.21.15.84:0/3671004103 >> v2:172.21.15.131:3300/0 conn(0x7fd6a015d980 msgr2=0x7fd6a0068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a6416700 1 --2- 172.21.15.84:0/3671004103 >> v2:172.21.15.131:3300/0 conn(0x7fd6a015d980 0x7fd6a0068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a6416700 1 -- 172.21.15.84:0/3671004103 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a00ccad0 con 0x7fd6a00ad250 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a6416700 1 --2- 172.21.15.84:0/3671004103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad250 0x7fd6a00cd2d0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fd6a006f5e0 tx=0x7fd69c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7f6efd32a49c52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a5414700 1 -- 172.21.15.84:0/3671004103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c005c10 con 0x7fd6a00ad250 2023-10-06T03:02:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a5414700 1 -- 172.21.15.84:0/3671004103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c005d70 con 0x7fd6a00ad250 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a5414700 1 -- 172.21.15.84:0/3671004103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00b880 con 0x7fd6a00ad250 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a867a700 1 -- 172.21.15.84:0/3671004103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad250 msgr2=0x7fd6a00cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a867a700 1 --2- 172.21.15.84:0/3671004103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad250 0x7fd6a00cd2d0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fd6a006f5e0 tx=0x7fd69c009220 comp rx=0 tx=0).stop 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a867a700 1 -- 172.21.15.84:0/3671004103 shutdown_connections 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a867a700 1 --2- 172.21.15.84:0/3671004103 >> v2:172.21.15.131:3300/0 conn(0x7fd6a015d980 0x7fd6a0068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a867a700 1 --2- 172.21.15.84:0/3671004103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad250 0x7fd6a00cd2d0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a867a700 1 --2- 172.21.15.84:0/3671004103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad620 0x7fd6a015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a867a700 1 -- 172.21.15.84:0/3671004103 >> 172.21.15.84:0/3671004103 conn(0x7fd6a0067dd0 msgr2=0x7fd6a00ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a867a700 1 -- 172.21.15.84:0/3671004103 shutdown_connections 2023-10-06T03:02:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.225+0000 7fd6a867a700 1 -- 172.21.15.84:0/3671004103 wait complete. 2023-10-06T03:02:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a867a700 1 Processor -- start 2023-10-06T03:02:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a867a700 1 -- start start 2023-10-06T03:02:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a867a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad250 0x7fd6a00c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a867a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad620 0x7fd6a016a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a867a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a015d980 0x7fd6a016a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a867a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00af790 con 0x7fd6a00ad620 2023-10-06T03:02:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a867a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a015a3b0 con 0x7fd6a015d980 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a867a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00c67e0 con 0x7fd6a00ad250 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a5c15700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad620 0x7fd6a016a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a5c15700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad620 0x7fd6a016a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39080/0 (socket says 172.21.15.84:39080) 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.227+0000 7fd6a5c15700 1 -- 172.21.15.84:0/1106798696 learned_addr learned my addr 172.21.15.84:0/1106798696 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a6416700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad250 0x7fd6a00c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a6c17700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a015d980 0x7fd6a016a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a5c15700 1 -- 172.21.15.84:0/1106798696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad250 msgr2=0x7fd6a00c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a5c15700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad250 0x7fd6a00c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a5c15700 1 -- 172.21.15.84:0/1106798696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a015d980 msgr2=0x7fd6a016a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a5c15700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a015d980 0x7fd6a016a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a5c15700 1 -- 172.21.15.84:0/1106798696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c009480 con 0x7fd6a00ad620 2023-10-06T03:02:15.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a6416700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad250 0x7fd6a00c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a5c15700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad620 0x7fd6a016a300 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fd69000d7e0 tx=0x7fd690008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6967fc700 1 -- 172.21.15.84:0/1106798696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900125f0 con 0x7fd6a00ad620 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6967fc700 1 -- 172.21.15.84:0/1106798696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd690012770 con 0x7fd6a00ad620 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a00c6a80 con 0x7fd6a00ad620 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6967fc700 1 -- 172.21.15.84:0/1106798696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690012b30 con 0x7fd6a00ad620 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.228+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a00b2030 con 0x7fd6a00ad620 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.229+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a0064ad0 con 0x7fd6a00ad620 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.229+0000 7fd6967fc700 1 -- 172.21.15.84:0/1106798696 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd69001e460 con 0x7fd6a00ad620 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.230+0000 7fd6967fc700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd684066f30 0x7fd6840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.230+0000 7fd6a6416700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd684066f30 0x7fd6840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.230+0000 7fd6967fc700 1 -- 172.21.15.84:0/1106798696 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fd690084e60 con 0x7fd6a00ad620 2023-10-06T03:02:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.230+0000 7fd6a6416700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd684066f30 0x7fd6840693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd6a015c5e0 tx=0x7fd69c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.234+0000 7fd6967fc700 1 -- 172.21.15.84:0/1106798696 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd690051d50 con 0x7fd6a00ad620 2023-10-06T03:02:15.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.492+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd6a00af8d0 con 0x7fd6a00ad620 2023-10-06T03:02:15.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.493+0000 7fd6967fc700 1 -- 172.21.15.84:0/1106798696 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1931 (secure 0 0 0) 0x7fd690055370 con 0x7fd6a00ad620 2023-10-06T03:02:15.493 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:15.493 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":453,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":698974,"bytes_used":2451828736,"bytes_avail":770642284544,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9811,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":111,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-10-06T03:02:13.895012+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd684066f30 msgr2=0x7fd6840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd684066f30 0x7fd6840693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd6a015c5e0 tx=0x7fd69c016000 comp rx=0 tx=0).stop 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad620 msgr2=0x7fd6a016a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad620 0x7fd6a016a300 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fd69000d7e0 tx=0x7fd690008040 comp rx=0 tx=0).stop 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 shutdown_connections 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd684066f30 0x7fd6840693e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a015d980 0x7fd6a016a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6a00ad250 0x7fd6a00c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 --2- 172.21.15.84:0/1106798696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a00ad620 0x7fd6a016a300 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 >> 172.21.15.84:0/1106798696 conn(0x7fd6a0067dd0 msgr2=0x7fd6a006b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 shutdown_connections 2023-10-06T03:02:15.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.495+0000 7fd6a867a700 1 -- 172.21.15.84:0/1106798696 wait complete. 2023-10-06T03:02:15.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]'} 2023-10-06T03:02:15.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub abort 2023-10-06T03:02:15.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.622+0000 7f83738c3700 1 Processor -- start 2023-10-06T03:02:15.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.622+0000 7f83738c3700 1 -- start start 2023-10-06T03:02:15.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.622+0000 7f83738c3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0b2a90 0x7f836c0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.622+0000 7f83738c3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f836c0cb980 0x7f836c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f83738c3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c0cbdf0 con 0x7f836c0ced90 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f83738c3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c0b2e60 con 0x7f836c0cb980 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f83738c3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0cf5d0 con 0x7f836c0b2a90 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8370e5e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f836c0cb980 0x7f836c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8371e60700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f836c0ced90 0x7f836c0c5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37212/0 (socket says 172.21.15.84:37212) 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8371e60700 1 -- 172.21.15.84:0/1762129727 learned_addr learned my addr 172.21.15.84:0/1762129727 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f837165f700 1 --2- 172.21.15.84:0/1762129727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0b2a90 0x7f836c0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8370e5e700 1 -- 172.21.15.84:0/1762129727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0b2a90 msgr2=0x7f836c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8370e5e700 1 --2- 172.21.15.84:0/1762129727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0b2a90 0x7f836c0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8370e5e700 1 -- 172.21.15.84:0/1762129727 >> v1:172.21.15.84:6789/0 conn(0x7f836c0ced90 legacy=0x7f836c0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8363fff700 1 -- 172.21.15.84:0/1762129727 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637249673 0 0) 0x7f836c0cbdf0 con 0x7f836c0ced90 2023-10-06T03:02:15.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8370e5e700 1 -- 172.21.15.84:0/1762129727 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0cf8b0 con 0x7f836c0cb980 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8370e5e700 1 --2- 172.21.15.84:0/1762129727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0cb980 0x7f836c0ce850 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f835c0098e0 tx=0x7f835c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefddc247d0c1755 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8363fff700 1 -- 172.21.15.84:0/1762129727 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c009e80 con 0x7f836c0cb980 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8363fff700 1 -- 172.21.15.84:0/1762129727 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c00b860 con 0x7f836c0cb980 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.623+0000 7f8363fff700 1 -- 172.21.15.84:0/1762129727 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00bbe0 con 0x7f836c0cb980 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.624+0000 7f83738c3700 1 -- 172.21.15.84:0/1762129727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0cb980 msgr2=0x7f836c0ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.624+0000 7f83738c3700 1 --2- 172.21.15.84:0/1762129727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0cb980 0x7f836c0ce850 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f835c0098e0 tx=0x7f835c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.624+0000 7f83738c3700 1 -- 172.21.15.84:0/1762129727 shutdown_connections 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.624+0000 7f83738c3700 1 --2- 172.21.15.84:0/1762129727 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0b2a90 0x7f836c0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.624+0000 7f83738c3700 1 --2- 172.21.15.84:0/1762129727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0cb980 0x7f836c0ce850 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.624+0000 7f83738c3700 1 -- 172.21.15.84:0/1762129727 >> 172.21.15.84:0/1762129727 conn(0x7f836c099740 msgr2=0x7f836c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.624+0000 7f83738c3700 1 -- 172.21.15.84:0/1762129727 shutdown_connections 2023-10-06T03:02:15.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.624+0000 7f83738c3700 1 -- 172.21.15.84:0/1762129727 wait complete. 2023-10-06T03:02:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.625+0000 7f83738c3700 1 Processor -- start 2023-10-06T03:02:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.625+0000 7f83738c3700 1 -- start start 2023-10-06T03:02:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f83738c3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f836c0b2a90 0x7f836c0ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f83738c3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0cb980 0x7f836c15d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f83738c3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0ced90 0x7f836c069390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f83738c3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c7c90 con 0x7f836c0ced90 2023-10-06T03:02:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f83738c3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c15ddc0 con 0x7f836c0b2a90 2023-10-06T03:02:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f83738c3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c169600 con 0x7f836c0cb980 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f8371e60700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0ced90 0x7f836c069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f8371e60700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0ced90 0x7f836c069390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39090/0 (socket says 172.21.15.84:39090) 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f8371e60700 1 -- 172.21.15.84:0/3910019695 learned_addr learned my addr 172.21.15.84:0/3910019695 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f8370e5e700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0cb980 0x7f836c15d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f837165f700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f836c0b2a90 0x7f836c0ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f8371e60700 1 -- 172.21.15.84:0/3910019695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0cb980 msgr2=0x7f836c15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f8371e60700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0cb980 0x7f836c15d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f8371e60700 1 -- 172.21.15.84:0/3910019695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f836c0b2a90 msgr2=0x7f836c0ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f8371e60700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f836c0b2a90 0x7f836c0ca7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.626+0000 7f8371e60700 1 -- 172.21.15.84:0/3910019695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c009420 con 0x7f836c0ced90 2023-10-06T03:02:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.627+0000 7f8371e60700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0ced90 0x7f836c069390 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f836400c530 tx=0x7f8364007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.627+0000 7f83617fa700 1 -- 172.21.15.84:0/3910019695 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364005b30 con 0x7f836c0ced90 2023-10-06T03:02:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.627+0000 7f83617fa700 1 -- 172.21.15.84:0/3910019695 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364005c90 con 0x7f836c0ced90 2023-10-06T03:02:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.627+0000 7f83738c3700 1 -- 172.21.15.84:0/3910019695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c15e340 con 0x7f836c0ced90 2023-10-06T03:02:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.627+0000 7f83617fa700 1 -- 172.21.15.84:0/3910019695 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364007320 con 0x7f836c0ced90 2023-10-06T03:02:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.627+0000 7f83738c3700 1 -- 172.21.15.84:0/3910019695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c0c7640 con 0x7f836c0ced90 2023-10-06T03:02:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.628+0000 7f83617fa700 1 -- 172.21.15.84:0/3910019695 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f836401b3b0 con 0x7f836c0ced90 2023-10-06T03:02:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.628+0000 7f83617fa700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8350066f30 0x7f83500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.629+0000 7f83617fa700 1 -- 172.21.15.84:0/3910019695 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f8364083dd0 con 0x7f836c0ced90 2023-10-06T03:02:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.629+0000 7f837165f700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8350066f30 0x7f83500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.629+0000 7f837165f700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8350066f30 0x7f83500693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f83680075e0 tx=0x7f83680097f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.630+0000 7f837cbbbb80 1 Processor -- start 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.630+0000 7f837cbbbb80 1 -- start start 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.631+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x557890909c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.631+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55789090ad00 0x557890959700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.631+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890959c40 0x55789095a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.631+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557890860ab0 con 0x557890909880 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.631+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789085e2b0 con 0x557890959c40 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.631+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55789085a0a0 con 0x55789090ad00 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.631+0000 7f837165f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x557890909c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.631+0000 7f837165f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x557890909c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39102/0 (socket says 172.21.15.84:39102) 2023-10-06T03:02:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.631+0000 7f837165f700 1 -- 172.21.15.84:0/1770429175 learned_addr learned my addr 172.21.15.84:0/1770429175 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837165f700 1 -- 172.21.15.84:0/1770429175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55789090ad00 msgr2=0x557890959700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837165f700 1 --2- 172.21.15.84:0/1770429175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55789090ad00 0x557890959700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837165f700 1 -- 172.21.15.84:0/1770429175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890959c40 msgr2=0x55789095a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837165f700 1 --2- 172.21.15.84:0/1770429175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890959c40 0x55789095a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837165f700 1 -- 172.21.15.84:0/1770429175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578906f42b0 con 0x557890909880 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837165f700 1 --2- 172.21.15.84:0/1770429175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x557890909c50 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f83680168e0 tx=0x7f8368016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0be35ae6c7a6b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f83567fc700 1 -- 172.21.15.84:0/1770429175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368014860 con 0x557890909880 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f83567fc700 1 -- 172.21.15.84:0/1770429175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83680149c0 con 0x557890909880 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f83567fc700 1 -- 172.21.15.84:0/1770429175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368014d60 con 0x557890909880 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1770429175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 msgr2=0x557890909c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1770429175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x557890909c50 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f83680168e0 tx=0x7f8368016000 comp rx=0 tx=0).stop 2023-10-06T03:02:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1770429175 shutdown_connections 2023-10-06T03:02:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1770429175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890959c40 0x55789095a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1770429175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x557890909c50 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1770429175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55789090ad00 0x557890959700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1770429175 >> 172.21.15.84:0/1770429175 conn(0x55789090b1a0 msgr2=0x55789090b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.632+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1770429175 shutdown_connections 2023-10-06T03:02:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.633+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1770429175 wait complete. 2023-10-06T03:02:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.633+0000 7f837cbbbb80 1 -- start start 2023-10-06T03:02:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.633+0000 7f837cbbbb80 1 Processor -- start 2023-10-06T03:02:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 0x5578909636f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55789090ad00 0x557890947a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 0x5578909322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578908058d0 con 0x55789090ad00 2023-10-06T03:02:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557890820ee0 con 0x557890909880 2023-10-06T03:02:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578906dce70 con 0x557890959c40 2023-10-06T03:02:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f837cbbbb80 10 client.0 _ll_register_callbacks cb 0x5578908cceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f8370e5e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55789090ad00 0x557890947a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f8370e5e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55789090ad00 0x557890947a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39106/0 (socket says 172.21.15.84:39106) 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f8370e5e700 1 -- 172.21.15.84:0/2002627078 learned_addr learned my addr 172.21.15.84:0/2002627078 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f837165f700 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 0x5578909636f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f8371e60700 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 0x5578909322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f8370e5e700 1 -- 172.21.15.84:0/2002627078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 msgr2=0x5578909322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f8370e5e700 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 0x5578909322d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f8370e5e700 1 -- 172.21.15.84:0/2002627078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 msgr2=0x5578909636f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f8370e5e700 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 0x5578909636f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.634+0000 7f8370e5e700 1 -- 172.21.15.84:0/2002627078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83680164c0 con 0x55789090ad00 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f8370e5e700 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55789090ad00 0x557890947a50 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f836c088fe0 tx=0x7f835c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99201958b0424757 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f834b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f834b7fe700 1 -- 172.21.15.84:0/2002627078 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c020070 con 0x55789090ad00 2023-10-06T03:02:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f834b7fe700 1 -- 172.21.15.84:0/2002627078 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f835c025470 con 0x55789090ad00 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837cbbbb80 1 -- 172.21.15.84:0/2002627078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578908fe980 con 0x55789090ad00 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f834b7fe700 1 -- 172.21.15.84:0/2002627078 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f835c00bbe0 con 0x55789090ad00 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837cbbbb80 10 client.9009 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837cbbbb80 1 -- 172.21.15.84:0/2002627078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x557890697020 con 0x55789090ad00 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f834b7fe700 1 -- 172.21.15.84:0/2002627078 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578908fe980 con 0x55789090ad00 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f834b7fe700 1 -- 172.21.15.84:0/2002627078 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f835c025840 con 0x55789090ad00 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837cbbbb80 10 client.9009 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837cbbbb80 10 client.9009 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837cbbbb80 20 client.9009 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557890963eb0 0x557890951140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837cbbbb80 4 client.9009 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837cbbbb80 1 -- 172.21.15.84:0/2002627078 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578908db8b0 con 0x557890963eb0 2023-10-06T03:02:15.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.635+0000 7f837165f700 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557890963eb0 0x557890951140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837165f700 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557890963eb0 0x557890951140 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cf696fc0e8d470a server_cookie=41a321c673715f28 in_seq=0 out_seq=0 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f834b7fe700 10 client.9009 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f834b7fe700 1 -- 172.21.15.84:0/2002627078 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5578908db8b0 con 0x557890963eb0 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f834b7fe700 10 client.9009 handle_command_reply: tid=0 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837cbbbb80 1 client.9009 shutdown 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837cbbbb80 1 -- 172.21.15.84:0/2002627078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55789090ad00 msgr2=0x557890947a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55789090ad00 0x557890947a50 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f836c088fe0 tx=0x7f835c017000 comp rx=0 tx=0).stop 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837cbbbb80 1 -- 172.21.15.84:0/2002627078 shutdown_connections 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557890963eb0 0x557890951140 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 0x5578909636f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 0x5578909322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/2002627078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55789090ad00 0x557890947a50 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f837cbbbb80 1 -- 172.21.15.84:0/2002627078 >> 172.21.15.84:0/2002627078 conn(0x55789090b1a0 msgr2=0x557890953340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.636+0000 7f834b7fe700 0 client.9009 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.637+0000 7f837cbbbb80 1 -- 172.21.15.84:0/2002627078 shutdown_connections 2023-10-06T03:02:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.637+0000 7f837cbbbb80 1 -- 172.21.15.84:0/2002627078 wait complete. 2023-10-06T03:02:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.637+0000 7f837cbbbb80 20 client.9009 trim_cache size 0 max 16384 2023-10-06T03:02:15.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.652+0000 7f837cbbbb80 1 Processor -- start 2023-10-06T03:02:15.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.652+0000 7f837cbbbb80 1 -- start start 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 0x557890947ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55789090ad00 0x55789094a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890959c40 0x55789094a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557890955c60 con 0x557890959c40 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578908e9320 con 0x557890909880 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557890906cf0 con 0x55789090ad00 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8371e60700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890959c40 0x55789094a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8371e60700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890959c40 0x55789094a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39110/0 (socket says 172.21.15.84:39110) 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8371e60700 1 -- 172.21.15.84:0/1256691024 learned_addr learned my addr 172.21.15.84:0/1256691024 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8371e60700 1 -- 172.21.15.84:0/1256691024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55789090ad00 msgr2=0x55789094a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8371e60700 1 --2- 172.21.15.84:0/1256691024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55789090ad00 0x55789094a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f837165f700 1 --2- 172.21.15.84:0/1256691024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 0x557890947ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8371e60700 1 -- 172.21.15.84:0/1256691024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 msgr2=0x557890947ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8371e60700 1 --2- 172.21.15.84:0/1256691024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 0x557890947ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8371e60700 1 -- 172.21.15.84:0/1256691024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578908287c0 con 0x557890959c40 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8371e60700 1 --2- 172.21.15.84:0/1256691024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890959c40 0x55789094a930 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f8364007d70 tx=0x7f8364081ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80687b829569ca7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8356ffd700 1 -- 172.21.15.84:0/1256691024 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364057bd0 con 0x557890959c40 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8356ffd700 1 -- 172.21.15.84:0/1256691024 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836405b920 con 0x557890959c40 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.653+0000 7f8356ffd700 1 -- 172.21.15.84:0/1256691024 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364007750 con 0x557890959c40 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1256691024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890959c40 msgr2=0x55789094a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1256691024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890959c40 0x55789094a930 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f8364007d70 tx=0x7f8364081ed0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1256691024 shutdown_connections 2023-10-06T03:02:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1256691024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557890909880 0x557890947ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1256691024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890959c40 0x55789094a930 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1256691024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55789090ad00 0x55789094a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1256691024 >> 172.21.15.84:0/1256691024 conn(0x55789090b1a0 msgr2=0x5578909022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1256691024 shutdown_connections 2023-10-06T03:02:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1256691024 wait complete. 2023-10-06T03:02:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.654+0000 7f837cbbbb80 1 -- start start 2023-10-06T03:02:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.655+0000 7f837cbbbb80 1 Processor -- start 2023-10-06T03:02:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.655+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x55789094a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.655+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55789090ad00 0x55789094a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.655+0000 7f837cbbbb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 0x5578909b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.655+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557890957cb0 con 0x557890909880 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.655+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55789094f900 con 0x55789090ad00 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.655+0000 7f837cbbbb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557890962aa0 con 0x557890959c40 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837cbbbb80 10 client.0 _ll_register_callbacks cb 0x5578908cceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837165f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x55789094a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837165f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x55789094a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39124/0 (socket says 172.21.15.84:39124) 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837165f700 1 -- 172.21.15.84:0/1096616235 learned_addr learned my addr 172.21.15.84:0/1096616235 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f8370e5e700 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55789090ad00 0x55789094a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f8371e60700 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 0x5578909b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837165f700 1 -- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 msgr2=0x5578909b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837165f700 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 0x5578909b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837165f700 1 -- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55789090ad00 msgr2=0x55789094a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837165f700 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55789090ad00 0x55789094a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837165f700 1 -- 172.21.15.84:0/1096616235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c0c7640 con 0x557890909880 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f8371e60700 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 0x5578909b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f8370e5e700 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55789090ad00 0x55789094a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837165f700 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x55789094a3f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f83680168b0 tx=0x7f8368036250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5875cd89da75da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f834b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f834b7fe700 1 -- 172.21.15.84:0/1096616235 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368033070 con 0x557890909880 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1096616235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f83680149c0 con 0x557890909880 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f834b7fe700 1 -- 172.21.15.84:0/1096616235 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f8368014d40 con 0x557890909880 2023-10-06T03:02:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f834b7fe700 1 -- 172.21.15.84:0/1096616235 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8368021820 con 0x557890909880 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837cbbbb80 10 client.9015 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1096616235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55789080f4b0 con 0x557890909880 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f834b7fe700 1 -- 172.21.15.84:0/1096616235 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83680149c0 con 0x557890909880 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.656+0000 7f834b7fe700 1 -- 172.21.15.84:0/1096616235 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f83680169c0 con 0x557890909880 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 10 client.9015 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 10 client.9015 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 20 client.9015 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5578909623f0 0x5578909b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 4 client.9015 mds_command: new command op to 8529 tid=0[{"prefix": "scrub abort"}] 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1096616235 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x5578907fce40 con 0x5578909623f0 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f8370e5e700 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5578909623f0 0x5578909b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f834b7fe700 10 client.9015 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f8370e5e700 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5578909623f0 0x5578909b6740 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32b707c251e17d0b server_cookie=158a8bba9f8d2b28 in_seq=0 out_seq=0 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f834b7fe700 1 -- 172.21.15.84:0/1096616235 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5578907fce40 con 0x5578909623f0 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f834b7fe700 10 client.9015 handle_command_reply: tid=0 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 client.9015 shutdown 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1096616235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 msgr2=0x55789094a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x55789094a3f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f83680168b0 tx=0x7f8368036250 comp rx=0 tx=0).stop 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1096616235 shutdown_connections 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5578909623f0 0x5578909b6740 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557890959c40 0x5578909b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557890909880 0x55789094a3f0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f834b7fe700 0 client.9015 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 --2- 172.21.15.84:0/1096616235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55789090ad00 0x55789094a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.657+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1096616235 >> 172.21.15.84:0/1096616235 conn(0x55789090b1a0 msgr2=0x5578909022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1096616235 shutdown_connections 2023-10-06T03:02:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f837cbbbb80 1 -- 172.21.15.84:0/1096616235 wait complete. 2023-10-06T03:02:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f837cbbbb80 20 client.9015 trim_cache size 0 max 16384 2023-10-06T03:02:15.665 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:15.665 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:02:15.665 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 -- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8350066f30 msgr2=0x7f83500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8350066f30 0x7f83500693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f83680075e0 tx=0x7f83680097f0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 -- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0ced90 msgr2=0x7f836c069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0ced90 0x7f836c069390 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f836400c530 tx=0x7f8364007f90 comp rx=0 tx=0).stop 2023-10-06T03:02:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 -- 172.21.15.84:0/3910019695 shutdown_connections 2023-10-06T03:02:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f8350066f30 0x7f83500693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f836c0b2a90 0x7f836c0ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0ced90 0x7f836c069390 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 --2- 172.21.15.84:0/3910019695 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f836c0cb980 0x7f836c15d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 -- 172.21.15.84:0/3910019695 >> 172.21.15.84:0/3910019695 conn(0x7f836c099740 msgr2=0x7f836c158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 -- 172.21.15.84:0/3910019695 shutdown_connections 2023-10-06T03:02:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.658+0000 7f83738c3700 1 -- 172.21.15.84:0/3910019695 wait complete. 2023-10-06T03:02:15.670 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2023-10-06T03:02:15.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.786+0000 7f234f219700 1 Processor -- start 2023-10-06T03:02:15.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.786+0000 7f234f219700 1 -- start start 2023-10-06T03:02:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.787+0000 7f234f219700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b0830 0x7f23480c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.787+0000 7f234f219700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23480cdd00 con 0x7f23480c3fb0 2023-10-06T03:02:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.787+0000 7f234f219700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23480cd0f0 con 0x7f23480b0460 2023-10-06T03:02:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.787+0000 7f234f219700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c4430 con 0x7f23480b0830 2023-10-06T03:02:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.787+0000 7f234ea18700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f23480c3fb0 0x7f23480c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37220/0 (socket says 172.21.15.84:37220) 2023-10-06T03:02:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.787+0000 7f234ea18700 1 -- 172.21.15.84:0/518134601 learned_addr learned my addr 172.21.15.84:0/518134601 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:15.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234da16700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b0830 0x7f23480c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042405822 0 0) 0x7f23480cdd00 con 0x7f23480c3fb0 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2330003570 con 0x7f23480c3fb0 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1429547730 0 0) 0x7f2330003570 con 0x7f23480c3fb0 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b0830 msgr2=0x7f23480c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b0830 0x7f23480c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 >> v1:172.21.15.131:6789/0 conn(0x7f23480b0460 legacy=0x7f23480cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480cd3d0 con 0x7f23480c3fb0 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f23400017f0 con 0x7f23480c3fb0 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 >> v1:172.21.15.84:6789/0 conn(0x7f23480c3fb0 legacy=0x7f23480c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f2330003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b0830 0x7f2330004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2330004d50 0x7f23300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c4430 con 0x7f2330003a90 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233000bb70 con 0x7f2330004d50 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233000bd30 con 0x7f23480b0830 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234e217700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f2330003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234da16700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b0830 0x7f2330004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234ea18700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2330004d50 0x7f23300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234e217700 1 -- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b0830 msgr2=0x7f2330004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234e217700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b0830 0x7f2330004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234e217700 1 -- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2330004d50 msgr2=0x7f23300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234e217700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2330004d50 0x7f23300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.788+0000 7f234e217700 1 -- 172.21.15.84:0/518134601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330003570 con 0x7f2330003a90 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234e217700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f2330003ea0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f23380018b0 tx=0x7f2338007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b2631d564c3f3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338012420 con 0x7f2330003a90 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2338012580 con 0x7f2330003a90 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234d215700 1 -- 172.21.15.84:0/518134601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338012920 con 0x7f2330003a90 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234f219700 1 -- 172.21.15.84:0/518134601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 msgr2=0x7f2330003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234f219700 1 --2- 172.21.15.84:0/518134601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f2330003ea0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f23380018b0 tx=0x7f2338007d30 comp rx=0 tx=0).stop 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234ea18700 1 -- 172.21.15.84:0/518134601 reap_dead start 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234f219700 1 -- 172.21.15.84:0/518134601 shutdown_connections 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234f219700 1 -- 172.21.15.84:0/518134601 >> 172.21.15.84:0/518134601 conn(0x7f2348096a70 msgr2=0x7f2348096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234f219700 1 -- 172.21.15.84:0/518134601 shutdown_connections 2023-10-06T03:02:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.789+0000 7f234f219700 1 -- 172.21.15.84:0/518134601 wait complete. 2023-10-06T03:02:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.790+0000 7f234f219700 1 Processor -- start 2023-10-06T03:02:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.790+0000 7f234f219700 1 -- start start 2023-10-06T03:02:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234f219700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f23480c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234f219700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b1920 0x7f234814a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234f219700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f234814ac80 0x7f234814b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234f219700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2348157590 con 0x7f2330003a90 2023-10-06T03:02:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234f219700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2348159bd0 con 0x7f234814ac80 2023-10-06T03:02:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234f219700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480b1e00 con 0x7f23480b1920 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234e217700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f23480c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234e217700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f23480c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39140/0 (socket says 172.21.15.84:39140) 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234e217700 1 -- 172.21.15.84:0/2949342583 learned_addr learned my addr 172.21.15.84:0/2949342583 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234da16700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b1920 0x7f234814a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.791+0000 7f234ea18700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f234814ac80 0x7f234814b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234e217700 1 -- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b1920 msgr2=0x7f234814a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234e217700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b1920 0x7f234814a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234e217700 1 -- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f234814ac80 msgr2=0x7f234814b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234e217700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f234814ac80 0x7f234814b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234e217700 1 -- 172.21.15.84:0/2949342583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480b20e0 con 0x7f2330003a90 2023-10-06T03:02:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234ea18700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f234814ac80 0x7f234814b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234da16700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b1920 0x7f234814a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234e217700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f23480c76e0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f233800c3f0 tx=0x7f2338015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f23467fc700 1 -- 172.21.15.84:0/2949342583 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338001200 con 0x7f2330003a90 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f23467fc700 1 -- 172.21.15.84:0/2949342583 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2338012c90 con 0x7f2330003a90 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234f219700 1 -- 172.21.15.84:0/2949342583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23480b23c0 con 0x7f2330003a90 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f23467fc700 1 -- 172.21.15.84:0/2949342583 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338012920 con 0x7f2330003a90 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.792+0000 7f234f219700 1 -- 172.21.15.84:0/2949342583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23480c7c20 con 0x7f2330003a90 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.793+0000 7f23467fc700 1 -- 172.21.15.84:0/2949342583 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2338006a30 con 0x7f2330003a90 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.794+0000 7f23467fc700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2334066f60 0x7f2334069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.794+0000 7f23467fc700 1 -- 172.21.15.84:0/2949342583 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f2338085f60 con 0x7f2330003a90 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.794+0000 7f234da16700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2334066f60 0x7f2334069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.794+0000 7f234da16700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2334066f60 0x7f2334069410 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f233c006d00 tx=0x7f233c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f2359773b80 1 Processor -- start 2023-10-06T03:02:15.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f2359773b80 1 -- start start 2023-10-06T03:02:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f2359773b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb3399d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f2359773b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb339f310 0x561fb339a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f2359773b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33a0a60 0x561fb339a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f2359773b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb32f4ac0 con 0x561fb33a0a60 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f2359773b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb32f22c0 con 0x561fb33beea0 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f2359773b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fb32ee0b0 con 0x561fb339f310 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f234ea18700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33a0a60 0x561fb339a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f234ea18700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33a0a60 0x561fb339a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39152/0 (socket says 172.21.15.84:39152) 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.796+0000 7f234ea18700 1 -- 172.21.15.84:0/2049600289 learned_addr learned my addr 172.21.15.84:0/2049600289 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f234da16700 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb339f310 0x561fb339a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f234ea18700 1 -- 172.21.15.84:0/2049600289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb339f310 msgr2=0x561fb339a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f234e217700 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb3399d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f234ea18700 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb339f310 0x561fb339a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f234ea18700 1 -- 172.21.15.84:0/2049600289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 msgr2=0x561fb3399d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f234ea18700 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb3399d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f234ea18700 1 -- 172.21.15.84:0/2049600289 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fb31882c0 con 0x561fb33a0a60 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f234e217700 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb3399d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f234ea18700 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33a0a60 0x561fb339a790 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f2348159ba0 tx=0x7f2340006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947d9ff1352b342b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f232f7fe700 1 -- 172.21.15.84:0/2049600289 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234001a070 con 0x561fb33a0a60 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f232f7fe700 1 -- 172.21.15.84:0/2049600289 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340007800 con 0x561fb33a0a60 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.797+0000 7f232f7fe700 1 -- 172.21.15.84:0/2049600289 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340015470 con 0x561fb33a0a60 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 -- 172.21.15.84:0/2049600289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33a0a60 msgr2=0x561fb339a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33a0a60 0x561fb339a790 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f2348159ba0 tx=0x7f2340006040 comp rx=0 tx=0).stop 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 -- 172.21.15.84:0/2049600289 shutdown_connections 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb3399d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33a0a60 0x561fb339a790 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 --2- 172.21.15.84:0/2049600289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb339f310 0x561fb339a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 -- 172.21.15.84:0/2049600289 >> 172.21.15.84:0/2049600289 conn(0x561fb339eed0 msgr2=0x561fb339f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 -- 172.21.15.84:0/2049600289 shutdown_connections 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 -- 172.21.15.84:0/2049600289 wait complete. 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 -- start start 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.798+0000 7f2359773b80 1 Processor -- start 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f2359773b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb33b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f2359773b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb33cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f2359773b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb33cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f2359773b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb32998e0 con 0x561fb339f310 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f2359773b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb32b4ef0 con 0x561fb33beea0 2023-10-06T03:02:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f2359773b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fb3170e80 con 0x561fb33a0a60 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f2359773b80 10 client.0 _ll_register_callbacks cb 0x561fb3361070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f234e217700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb33b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f234e217700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb33b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39168/0 (socket says 172.21.15.84:39168) 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f234e217700 1 -- 172.21.15.84:0/2544392316 learned_addr learned my addr 172.21.15.84:0/2544392316 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f234ea18700 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb33cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.799+0000 7f234da16700 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb33cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f234e217700 1 -- 172.21.15.84:0/2544392316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 msgr2=0x561fb33cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f234e217700 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb33cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f234e217700 1 -- 172.21.15.84:0/2544392316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 msgr2=0x561fb33cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f234e217700 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb33cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f234e217700 1 -- 172.21.15.84:0/2544392316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23480cd3d0 con 0x561fb339f310 2023-10-06T03:02:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f234e217700 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb33b5470 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f233800d010 tx=0x7f2338084060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3962a1148ef0cb96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f232cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f232cff9700 1 -- 172.21.15.84:0/2544392316 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233806e070 con 0x561fb339f310 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f232cff9700 1 -- 172.21.15.84:0/2544392316 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f233805dab0 con 0x561fb339f310 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f2359773b80 1 -- 172.21.15.84:0/2544392316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fb3392990 con 0x561fb339f310 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f232cff9700 1 -- 172.21.15.84:0/2544392316 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2338012e00 con 0x561fb339f310 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f2359773b80 10 client.9027 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f2359773b80 1 -- 172.21.15.84:0/2544392316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x561fb312b030 con 0x561fb339f310 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f232cff9700 1 -- 172.21.15.84:0/2544392316 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2338082070 con 0x561fb339f310 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f232cff9700 1 -- 172.21.15.84:0/2544392316 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f2338056d70 con 0x561fb339f310 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f2359773b80 10 client.9027 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f2359773b80 10 client.9027 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f2359773b80 20 client.9027 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f2359773b80 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x561fb33b7240 0x561fb33b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f2359773b80 4 client.9027 mds_command: new command op to 8526 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f2359773b80 1 -- 172.21.15.84:0/2544392316 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fb336f8c0 con 0x561fb33b7240 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.800+0000 7f234da16700 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x561fb33b7240 0x561fb33b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f232cff9700 10 client.9027 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f234da16700 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x561fb33b7240 0x561fb33b7680 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df6994a31b98176b server_cookie=53244d961c338b3d in_seq=0 out_seq=0 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f232cff9700 1 -- 172.21.15.84:0/2544392316 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561fb336f8c0 con 0x561fb33b7240 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f232cff9700 10 client.9027 handle_command_reply: tid=0 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f2359773b80 1 client.9027 shutdown 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f2359773b80 1 -- 172.21.15.84:0/2544392316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 msgr2=0x561fb33b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f2359773b80 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb33b5470 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f233800d010 tx=0x7f2338084060 comp rx=0 tx=0).stop 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f2359773b80 1 -- 172.21.15.84:0/2544392316 shutdown_connections 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f2359773b80 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x561fb33b7240 0x561fb33b7680 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f2359773b80 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb33cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f2359773b80 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb33b5470 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f232cff9700 0 client.9027 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f2359773b80 1 --2- 172.21.15.84:0/2544392316 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb33cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.801+0000 7f2359773b80 1 -- 172.21.15.84:0/2544392316 >> 172.21.15.84:0/2544392316 conn(0x561fb339eed0 msgr2=0x561fb339fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.802+0000 7f2359773b80 1 -- 172.21.15.84:0/2544392316 shutdown_connections 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.802+0000 7f2359773b80 1 -- 172.21.15.84:0/2544392316 wait complete. 2023-10-06T03:02:15.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.802+0000 7f2359773b80 20 client.9027 trim_cache size 0 max 16384 2023-10-06T03:02:15.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.817+0000 7f2359773b80 1 Processor -- start 2023-10-06T03:02:15.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f2359773b80 1 -- start start 2023-10-06T03:02:15.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f2359773b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb339f310 0x561fb33cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f2359773b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb339d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f2359773b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33beea0 0x561fb339de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f2359773b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb339bb30 con 0x561fb33beea0 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f2359773b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb33b4a30 con 0x561fb339f310 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f2359773b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fb337d330 con 0x561fb33a0a60 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f234ea18700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33beea0 0x561fb339de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f234ea18700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33beea0 0x561fb339de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39174/0 (socket says 172.21.15.84:39174) 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.818+0000 7f234ea18700 1 -- 172.21.15.84:0/2979992123 learned_addr learned my addr 172.21.15.84:0/2979992123 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234e217700 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb339f310 0x561fb33cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234da16700 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb339d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234ea18700 1 -- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 msgr2=0x561fb339d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234ea18700 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb339d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234ea18700 1 -- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb339f310 msgr2=0x561fb33cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234ea18700 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb339f310 0x561fb33cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234ea18700 1 -- 172.21.15.84:0/2979992123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fb32bc7d0 con 0x561fb33beea0 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234e217700 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb339f310 0x561fb33cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234da16700 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb339d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f234ea18700 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33beea0 0x561fb339de80 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x561fb33cbb30 tx=0x7f2340016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e90bf5067bddfc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f232ffff700 1 -- 172.21.15.84:0/2979992123 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234001a070 con 0x561fb33beea0 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f232ffff700 1 -- 172.21.15.84:0/2979992123 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340001b20 con 0x561fb33beea0 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.819+0000 7f232ffff700 1 -- 172.21.15.84:0/2979992123 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400158a0 con 0x561fb33beea0 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 -- 172.21.15.84:0/2979992123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33beea0 msgr2=0x561fb339de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33beea0 0x561fb339de80 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x561fb33cbb30 tx=0x7f2340016000 comp rx=0 tx=0).stop 2023-10-06T03:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 -- 172.21.15.84:0/2979992123 shutdown_connections 2023-10-06T03:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb339f310 0x561fb33cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb33beea0 0x561fb339de80 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 --2- 172.21.15.84:0/2979992123 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb339d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 -- 172.21.15.84:0/2979992123 >> 172.21.15.84:0/2979992123 conn(0x561fb339eed0 msgr2=0x561fb3394bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 -- 172.21.15.84:0/2979992123 shutdown_connections 2023-10-06T03:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 -- 172.21.15.84:0/2979992123 wait complete. 2023-10-06T03:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 -- start start 2023-10-06T03:02:15.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.820+0000 7f2359773b80 1 Processor -- start 2023-10-06T03:02:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f2359773b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb3399df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f2359773b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb34396b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f2359773b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb343e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f2359773b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb3431670 con 0x561fb339f310 2023-10-06T03:02:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f2359773b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fb343a360 con 0x561fb33beea0 2023-10-06T03:02:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f2359773b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x561fb344dcf0 con 0x561fb33a0a60 2023-10-06T03:02:15.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f2359773b80 10 client.0 _ll_register_callbacks cb 0x561fb3361070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234e217700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb3399df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234e217700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb3399df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39186/0 (socket says 172.21.15.84:39186) 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234e217700 1 -- 172.21.15.84:0/1989466533 learned_addr learned my addr 172.21.15.84:0/1989466533 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234ea18700 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb343e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234da16700 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb34396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234e217700 1 -- 172.21.15.84:0/1989466533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 msgr2=0x561fb34396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234e217700 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb34396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234e217700 1 -- 172.21.15.84:0/1989466533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 msgr2=0x561fb343e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234e217700 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb343e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.821+0000 7f234e217700 1 -- 172.21.15.84:0/1989466533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fb31882c0 con 0x561fb339f310 2023-10-06T03:02:15.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f234e217700 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb3399df0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f2338012fd0 tx=0x7f233806a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4bcdba1631b23b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f232cff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f232cff9700 1 -- 172.21.15.84:0/1989466533 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233806e040 con 0x561fb339f310 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f232cff9700 1 -- 172.21.15.84:0/1989466533 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f2338057e30 con 0x561fb339f310 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f2359773b80 1 -- 172.21.15.84:0/1989466533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2340007800 con 0x561fb339f310 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f232cff9700 1 -- 172.21.15.84:0/1989466533 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2338056b10 con 0x561fb339f310 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f2359773b80 10 client.9033 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f2359773b80 1 -- 172.21.15.84:0/1989466533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x561fb32a34c0 con 0x561fb339f310 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f232cff9700 1 -- 172.21.15.84:0/1989466533 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340007800 con 0x561fb339f310 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f232cff9700 1 -- 172.21.15.84:0/1989466533 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f2338056d70 con 0x561fb339f310 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f2359773b80 10 client.9033 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f2359773b80 10 client.9033 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:15.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f2359773b80 20 client.9033 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f2359773b80 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x561fb343ebb0 0x561fb339f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f2359773b80 4 client.9033 mds_command: new command op to 8526 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f2359773b80 1 -- 172.21.15.84:0/1989466533 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561fb3290e50 con 0x561fb343ebb0 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.822+0000 7f234da16700 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x561fb343ebb0 0x561fb339f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f232cff9700 10 client.9033 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f234da16700 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x561fb343ebb0 0x561fb339f6e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eda37eefdb3b4745 server_cookie=d4626e3042da15dd in_seq=0 out_seq=0 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f232cff9700 1 -- 172.21.15.84:0/1989466533 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x561fb3290e50 con 0x561fb343ebb0 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f232cff9700 10 client.9033 handle_command_reply: tid=0 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 client.9033 shutdown 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 -- 172.21.15.84:0/1989466533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 msgr2=0x561fb3399df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb3399df0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f2338012fd0 tx=0x7f233806a000 comp rx=0 tx=0).stop 2023-10-06T03:02:15.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 -- 172.21.15.84:0/1989466533 shutdown_connections 2023-10-06T03:02:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x561fb343ebb0 0x561fb339f6e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fb33beea0 0x561fb343e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561fb339f310 0x561fb3399df0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f232cff9700 0 client.9033 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 --2- 172.21.15.84:0/1989466533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x561fb33a0a60 0x561fb34396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 -- 172.21.15.84:0/1989466533 >> 172.21.15.84:0/1989466533 conn(0x561fb339eed0 msgr2=0x561fb33cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 -- 172.21.15.84:0/1989466533 shutdown_connections 2023-10-06T03:02:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 1 -- 172.21.15.84:0/1989466533 wait complete. 2023-10-06T03:02:15.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.823+0000 7f2359773b80 20 client.9033 trim_cache size 0 max 16384 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:15.832 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:15.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 -- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2334066f60 msgr2=0x7f2334069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2334066f60 0x7f2334069410 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f233c006d00 tx=0x7f233c008040 comp rx=0 tx=0).stop 2023-10-06T03:02:15.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 -- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 msgr2=0x7f23480c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f23480c76e0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f233800c3f0 tx=0x7f2338015000 comp rx=0 tx=0).stop 2023-10-06T03:02:15.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 -- 172.21.15.84:0/2949342583 shutdown_connections 2023-10-06T03:02:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2334066f60 0x7f2334069410 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f234814ac80 0x7f234814b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2330003a90 0x7f23480c76e0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 --2- 172.21.15.84:0/2949342583 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23480b1920 0x7f234814a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 -- 172.21.15.84:0/2949342583 >> 172.21.15.84:0/2949342583 conn(0x7f2348096a70 msgr2=0x7f2348159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 -- 172.21.15.84:0/2949342583 shutdown_connections 2023-10-06T03:02:15.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.824+0000 7f234f219700 1 -- 172.21.15.84:0/2949342583 wait complete. 2023-10-06T03:02:15.835 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:15.835 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2023-10-06T03:02:15.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.951+0000 7fdf8d326700 1 Processor -- start 2023-10-06T03:02:15.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.951+0000 7fdf8d326700 1 -- start start 2023-10-06T03:02:15.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf8d326700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880cbb50 0x7fdf880ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf8d326700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf880c6610 0x7fdf880ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf8d326700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf880b2e60 con 0x7fdf880b2a90 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf8d326700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf880cf5d0 con 0x7fdf880c6610 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf8d326700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880cf8b0 con 0x7fdf880cbb50 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf7e7fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880cbb50 0x7fdf880ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf877fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf880c6610 0x7fdf880ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf877fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdf880c6610 0x7fdf880ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:39176/0 (socket says 172.21.15.84:39176) 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf7e7fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880cbb50 0x7fdf880ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:59308/0 (socket says 172.21.15.84:59308) 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.952+0000 7fdf877fe700 1 -- 172.21.15.84:0/3121067240 learned_addr learned my addr 172.21.15.84:0/3121067240 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf867fc700 1 -- 172.21.15.84:0/3121067240 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655589658 0 0) 0x7fdf880b2e60 con 0x7fdf880b2a90 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf867fc700 1 -- 172.21.15.84:0/3121067240 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf74003570 con 0x7fdf880b2a90 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf7e7fc700 1 -- 172.21.15.84:0/3121067240 >> v2:172.21.15.131:3300/0 conn(0x7fdf880c6610 msgr2=0x7fdf880ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf7e7fc700 1 --2- 172.21.15.84:0/3121067240 >> v2:172.21.15.131:3300/0 conn(0x7fdf880c6610 0x7fdf880ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf7e7fc700 1 -- 172.21.15.84:0/3121067240 >> v1:172.21.15.131:6789/0 conn(0x7fdf880b2a90 legacy=0x7fdf880cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf7e7fc700 1 -- 172.21.15.84:0/3121067240 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf880cfb90 con 0x7fdf880cbb50 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf7e7fc700 1 --2- 172.21.15.84:0/3121067240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880cbb50 0x7fdf880ce850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf700098e0 tx=0x7fdf700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f3ddcc6500770 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf867fc700 1 -- 172.21.15.84:0/3121067240 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70011630 con 0x7fdf880cbb50 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf867fc700 1 -- 172.21.15.84:0/3121067240 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf70011790 con 0x7fdf880cbb50 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.953+0000 7fdf867fc700 1 -- 172.21.15.84:0/3121067240 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70011b30 con 0x7fdf880cbb50 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.954+0000 7fdf8d326700 1 -- 172.21.15.84:0/3121067240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880cbb50 msgr2=0x7fdf880ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.954+0000 7fdf8d326700 1 --2- 172.21.15.84:0/3121067240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880cbb50 0x7fdf880ce850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf700098e0 tx=0x7fdf700091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.954+0000 7fdf8d326700 1 -- 172.21.15.84:0/3121067240 shutdown_connections 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.954+0000 7fdf8d326700 1 --2- 172.21.15.84:0/3121067240 >> v2:172.21.15.131:3300/0 conn(0x7fdf880c6610 0x7fdf880ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.954+0000 7fdf8d326700 1 --2- 172.21.15.84:0/3121067240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880cbb50 0x7fdf880ce850 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.954+0000 7fdf8d326700 1 -- 172.21.15.84:0/3121067240 >> 172.21.15.84:0/3121067240 conn(0x7fdf88099740 msgr2=0x7fdf8806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.954+0000 7fdf8d326700 1 -- 172.21.15.84:0/3121067240 shutdown_connections 2023-10-06T03:02:15.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.954+0000 7fdf8d326700 1 -- 172.21.15.84:0/3121067240 wait complete. 2023-10-06T03:02:15.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.955+0000 7fdf8d326700 1 Processor -- start 2023-10-06T03:02:15.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.955+0000 7fdf8d326700 1 -- start start 2023-10-06T03:02:15.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf8d326700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf880b2a90 0x7fdf8809b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf8d326700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880c6610 0x7fdf8809c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf8d326700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf880cbb50 0x7fdf8814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf8d326700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8809a150 con 0x7fdf880b2a90 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf8d326700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8809a430 con 0x7fdf880cbb50 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf8d326700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8809a710 con 0x7fdf880c6610 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf86ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf880b2a90 0x7fdf8809b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf86ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf880b2a90 0x7fdf8809b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39196/0 (socket says 172.21.15.84:39196) 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf86ffd700 1 -- 172.21.15.84:0/1080298250 learned_addr learned my addr 172.21.15.84:0/1080298250 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf877fe700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf880cbb50 0x7fdf8814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf7e7fc700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880c6610 0x7fdf8809c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf86ffd700 1 -- 172.21.15.84:0/1080298250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880c6610 msgr2=0x7fdf8809c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880c6610 0x7fdf8809c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf86ffd700 1 -- 172.21.15.84:0/1080298250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf880cbb50 msgr2=0x7fdf8814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf880cbb50 0x7fdf8814ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf86ffd700 1 -- 172.21.15.84:0/1080298250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70009420 con 0x7fdf880b2a90 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf880b2a90 0x7fdf8809b1f0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800c7c0 tx=0x7fdf78007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.956+0000 7fdf7f7fe700 1 -- 172.21.15.84:0/1080298250 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78011680 con 0x7fdf880b2a90 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.957+0000 7fdf7f7fe700 1 -- 172.21.15.84:0/1080298250 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf780117e0 con 0x7fdf880b2a90 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.957+0000 7fdf8d326700 1 -- 172.21.15.84:0/1080298250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8809a9f0 con 0x7fdf880b2a90 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.957+0000 7fdf7f7fe700 1 -- 172.21.15.84:0/1080298250 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78011ba0 con 0x7fdf880b2a90 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.957+0000 7fdf8d326700 1 -- 172.21.15.84:0/1080298250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8809c810 con 0x7fdf880b2a90 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.958+0000 7fdf7f7fe700 1 -- 172.21.15.84:0/1080298250 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf78012440 con 0x7fdf880b2a90 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.958+0000 7fdf7f7fe700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf68066f30 0x7fdf680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.958+0000 7fdf7e7fc700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf68066f30 0x7fdf680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.958+0000 7fdf7f7fe700 1 -- 172.21.15.84:0/1080298250 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdf780847f0 con 0x7fdf880b2a90 2023-10-06T03:02:15.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.959+0000 7fdf7e7fc700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf68066f30 0x7fdf680693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdf88063630 tx=0x7fdf70017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.960+0000 7fdf9661eb80 1 Processor -- start 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.960+0000 7fdf9661eb80 1 -- start start 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c2124c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c2174710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c21750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9c207bac0 con 0x55f9c2174c50 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9c20792c0 con 0x55f9c2125d10 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9c20750b0 con 0x55f9c2124890 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c21750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c21750a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39204/0 (socket says 172.21.15.84:39204) 2023-10-06T03:02:15.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf877fe700 1 -- 172.21.15.84:0/56541943 learned_addr learned my addr 172.21.15.84:0/56541943 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf7e7fc700 1 --2- 172.21.15.84:0/56541943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c2174710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/56541943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c2124c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf877fe700 1 -- 172.21.15.84:0/56541943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 msgr2=0x55f9c2124c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf877fe700 1 --2- 172.21.15.84:0/56541943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c2124c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf877fe700 1 -- 172.21.15.84:0/56541943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 msgr2=0x55f9c2174710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.961+0000 7fdf877fe700 1 --2- 172.21.15.84:0/56541943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c2174710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf877fe700 1 -- 172.21.15.84:0/56541943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9c1f0f2c0 con 0x55f9c2174c50 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf877fe700 1 --2- 172.21.15.84:0/56541943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c21750a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009e50 tx=0x7fdf8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9222eb679c9063dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf67fff700 1 -- 172.21.15.84:0/56541943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80007db0 con 0x55f9c2174c50 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf67fff700 1 -- 172.21.15.84:0/56541943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8000f070 con 0x55f9c2174c50 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf67fff700 1 -- 172.21.15.84:0/56541943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80014640 con 0x55f9c2174c50 2023-10-06T03:02:15.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf9661eb80 1 -- 172.21.15.84:0/56541943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 msgr2=0x55f9c21750a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/56541943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c21750a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009e50 tx=0x7fdf8000b040 comp rx=0 tx=0).stop 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf9661eb80 1 -- 172.21.15.84:0/56541943 shutdown_connections 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/56541943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c21750a0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/56541943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c2124c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/56541943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c2174710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.962+0000 7fdf9661eb80 1 -- 172.21.15.84:0/56541943 >> 172.21.15.84:0/56541943 conn(0x55f9c21261b0 msgr2=0x55f9c2126580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.963+0000 7fdf9661eb80 1 -- 172.21.15.84:0/56541943 shutdown_connections 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.963+0000 7fdf9661eb80 1 -- 172.21.15.84:0/56541943 wait complete. 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.963+0000 7fdf9661eb80 1 -- start start 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.963+0000 7fdf9661eb80 1 Processor -- start 2023-10-06T03:02:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c217eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c217f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c216b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9c20208e0 con 0x55f9c2174c50 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9c203bef0 con 0x55f9c2125d10 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9c1ef7e80 con 0x55f9c2124890 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf9661eb80 10 client.0 _ll_register_callbacks cb 0x55f9c20e7ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c216b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c216b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39212/0 (socket says 172.21.15.84:39212) 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf877fe700 1 -- 172.21.15.84:0/949947921 learned_addr learned my addr 172.21.15.84:0/949947921 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c217eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf7e7fc700 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c217f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf877fe700 1 -- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 msgr2=0x55f9c217eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf877fe700 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c217eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf877fe700 1 -- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 msgr2=0x55f9c217f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf877fe700 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c217f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf877fe700 1 -- 172.21.15.84:0/949947921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf80009b80 con 0x55f9c2174c50 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.964+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c217eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf877fe700 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c216b5b0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdf80007a70 tx=0x7fdf80019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d84b3555038c01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf657fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf657fa700 1 -- 172.21.15.84:0/949947921 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80014cd0 con 0x55f9c2174c50 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf657fa700 1 -- 172.21.15.84:0/949947921 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdf80014e30 con 0x55f9c2174c50 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf9661eb80 1 -- 172.21.15.84:0/949947921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9c2119990 con 0x55f9c2174c50 2023-10-06T03:02:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf657fa700 1 -- 172.21.15.84:0/949947921 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf8001e640 con 0x55f9c2174c50 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf9661eb80 10 client.9042 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf9661eb80 1 -- 172.21.15.84:0/949947921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55f9c1eb2030 con 0x55f9c2174c50 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf657fa700 1 -- 172.21.15.84:0/949947921 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9c2119990 con 0x55f9c2174c50 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf657fa700 1 -- 172.21.15.84:0/949947921 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fdf8001e7a0 con 0x55f9c2174c50 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf9661eb80 10 client.9042 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf9661eb80 10 client.9042 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf9661eb80 20 client.9042 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55f9c211fda0 0x55f9c2164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf9661eb80 4 client.9042 mds_command: new command op to 6782 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf9661eb80 1 -- 172.21.15.84:0/949947921 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9c20f68c0 con 0x55f9c211fda0 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.965+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55f9c211fda0 0x55f9c2164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.966+0000 7fdf657fa700 10 client.9042 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.966+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55f9c211fda0 0x55f9c2164bb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8325d9b0c7589096 server_cookie=92b45ed734add12c in_seq=0 out_seq=0 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.966+0000 7fdf657fa700 1 -- 172.21.15.84:0/949947921 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f9c20f68c0 con 0x55f9c211fda0 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.966+0000 7fdf657fa700 10 client.9042 handle_command_reply: tid=0 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.966+0000 7fdf9661eb80 1 client.9042 shutdown 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 -- 172.21.15.84:0/949947921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 msgr2=0x55f9c216b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c216b5b0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdf80007a70 tx=0x7fdf80019000 comp rx=0 tx=0).stop 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 -- 172.21.15.84:0/949947921 shutdown_connections 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55f9c211fda0 0x55f9c2164bb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2174c50 0x55f9c216b5b0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c217eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf657fa700 0 client.9042 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/949947921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c217f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 -- 172.21.15.84:0/949947921 >> 172.21.15.84:0/949947921 conn(0x55f9c21261b0 msgr2=0x55f9c2125200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 -- 172.21.15.84:0/949947921 shutdown_connections 2023-10-06T03:02:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 1 -- 172.21.15.84:0/949947921 wait complete. 2023-10-06T03:02:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.967+0000 7fdf9661eb80 20 client.9042 trim_cache size 0 max 16384 2023-10-06T03:02:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.982+0000 7fdf9661eb80 1 Processor -- start 2023-10-06T03:02:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf9661eb80 1 -- start start 2023-10-06T03:02:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c211fda0 0x55f9c2171aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c2171fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2125d10 0x55f9c21208d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9c2125ae0 con 0x55f9c2125d10 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9c216e6e0 con 0x55f9c211fda0 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9c21743c0 con 0x55f9c2124890 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2125d10 0x55f9c21208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf877fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2125d10 0x55f9c21208d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39228/0 (socket says 172.21.15.84:39228) 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.983+0000 7fdf877fe700 1 -- 172.21.15.84:0/2357641237 learned_addr learned my addr 172.21.15.84:0/2357641237 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf877fe700 1 -- 172.21.15.84:0/2357641237 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 msgr2=0x55f9c2171fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf877fe700 1 --2- 172.21.15.84:0/2357641237 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c2171fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf877fe700 1 -- 172.21.15.84:0/2357641237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c211fda0 msgr2=0x55f9c2171aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/2357641237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c211fda0 0x55f9c2171aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf877fe700 1 --2- 172.21.15.84:0/2357641237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c211fda0 0x55f9c2171aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf877fe700 1 -- 172.21.15.84:0/2357641237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9c20437d0 con 0x55f9c2125d10 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf877fe700 1 --2- 172.21.15.84:0/2357641237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2125d10 0x55f9c21208d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009010 tx=0x7fdf80021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e469bd4aa2719377 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf7cff9700 1 -- 172.21.15.84:0/2357641237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8001ecb0 con 0x55f9c2125d10 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf7cff9700 1 -- 172.21.15.84:0/2357641237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80007000 con 0x55f9c2125d10 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf7cff9700 1 -- 172.21.15.84:0/2357641237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80007b20 con 0x55f9c2125d10 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf9661eb80 1 -- 172.21.15.84:0/2357641237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2125d10 msgr2=0x55f9c21208d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/2357641237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2125d10 0x55f9c21208d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009010 tx=0x7fdf80021070 comp rx=0 tx=0).stop 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf9661eb80 1 -- 172.21.15.84:0/2357641237 shutdown_connections 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/2357641237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c211fda0 0x55f9c2171aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/2357641237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c2125d10 0x55f9c21208d0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/2357641237 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c2171fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf9661eb80 1 -- 172.21.15.84:0/2357641237 >> 172.21.15.84:0/2357641237 conn(0x55f9c21261b0 msgr2=0x55f9c2121980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf9661eb80 1 -- 172.21.15.84:0/2357641237 shutdown_connections 2023-10-06T03:02:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.984+0000 7fdf9661eb80 1 -- 172.21.15.84:0/2357641237 wait complete. 2023-10-06T03:02:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.985+0000 7fdf9661eb80 1 -- start start 2023-10-06T03:02:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.985+0000 7fdf9661eb80 1 Processor -- start 2023-10-06T03:02:15.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c211fda0 0x55f9c21cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c214c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf9661eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c214cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9c2172e70 con 0x55f9c211fda0 2023-10-06T03:02:15.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9c218b040 con 0x55f9c2125d10 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf9661eb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9c2164eb0 con 0x55f9c2124890 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf9661eb80 10 client.0 _ll_register_callbacks cb 0x55f9c20e7ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf86ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c211fda0 0x55f9c21cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf86ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c211fda0 0x55f9c21cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39244/0 (socket says 172.21.15.84:39244) 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf86ffd700 1 -- 172.21.15.84:0/401059756 learned_addr learned my addr 172.21.15.84:0/401059756 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf86ffd700 1 -- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 msgr2=0x55f9c214c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c214c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf86ffd700 1 -- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 msgr2=0x55f9c214cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c214cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf86ffd700 1 -- 172.21.15.84:0/401059756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9c1eb2030 con 0x55f9c211fda0 2023-10-06T03:02:15.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf86ffd700 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c211fda0 0x55f9c21cf930 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fdf78051920 tx=0x7fdf7801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e4aa286b2f5726 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf657fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf657fa700 1 -- 172.21.15.84:0/401059756 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf780182b0 con 0x55f9c211fda0 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf9661eb80 1 -- 172.21.15.84:0/401059756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf8000f070 con 0x55f9c211fda0 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.986+0000 7fdf657fa700 1 -- 172.21.15.84:0/401059756 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdf78018410 con 0x55f9c211fda0 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf657fa700 1 -- 172.21.15.84:0/401059756 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf78055890 con 0x55f9c211fda0 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf9661eb80 10 client.9048 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf9661eb80 1 -- 172.21.15.84:0/401059756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55f9c202a4c0 con 0x55f9c211fda0 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf657fa700 1 -- 172.21.15.84:0/401059756 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8000f070 con 0x55f9c211fda0 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf657fa700 1 -- 172.21.15.84:0/401059756 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fdf78054910 con 0x55f9c211fda0 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf9661eb80 10 client.9048 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf9661eb80 10 client.9048 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf9661eb80 20 client.9048 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55f9c2174c50 0x55f9c217d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf9661eb80 4 client.9048 mds_command: new command op to 6782 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf9661eb80 1 -- 172.21.15.84:0/401059756 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f9c2017e50 con 0x55f9c2174c50 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf7e7fc700 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55f9c2174c50 0x55f9c217d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf657fa700 10 client.9048 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.987+0000 7fdf7e7fc700 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55f9c2174c50 0x55f9c217d5e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=674eb569a3971f35 server_cookie=af61aa33ac564e79 in_seq=0 out_seq=0 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf657fa700 1 -- 172.21.15.84:0/401059756 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55f9c2017e50 con 0x55f9c2174c50 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf657fa700 10 client.9048 handle_command_reply: tid=0 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 client.9048 shutdown 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 -- 172.21.15.84:0/401059756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c211fda0 msgr2=0x55f9c21cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c211fda0 0x55f9c21cf930 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fdf78051920 tx=0x7fdf7801d040 comp rx=0 tx=0).stop 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 -- 172.21.15.84:0/401059756 shutdown_connections 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9c2125d10 0x55f9c214cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55f9c2174c50 0x55f9c217d5e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f9c211fda0 0x55f9c21cf930 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 --2- 172.21.15.84:0/401059756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55f9c2124890 0x55f9c214c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf657fa700 0 client.9048 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 -- 172.21.15.84:0/401059756 >> 172.21.15.84:0/401059756 conn(0x55f9c21261b0 msgr2=0x55f9c21699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 -- 172.21.15.84:0/401059756 shutdown_connections 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 1 -- 172.21.15.84:0/401059756 wait complete. 2023-10-06T03:02:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf9661eb80 20 client.9048 trim_cache size 0 max 16384 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:15.996 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:15.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf8d326700 1 -- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf68066f30 msgr2=0x7fdf680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf8d326700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf68066f30 0x7fdf680693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdf88063630 tx=0x7fdf70017000 comp rx=0 tx=0).stop 2023-10-06T03:02:15.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf8d326700 1 -- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf880b2a90 msgr2=0x7fdf8809b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.988+0000 7fdf8d326700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf880b2a90 0x7fdf8809b1f0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800c7c0 tx=0x7fdf78007e00 comp rx=0 tx=0).stop 2023-10-06T03:02:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.989+0000 7fdf8d326700 1 -- 172.21.15.84:0/1080298250 shutdown_connections 2023-10-06T03:02:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.989+0000 7fdf8d326700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdf68066f30 0x7fdf680693e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.989+0000 7fdf8d326700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf880cbb50 0x7fdf8814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.989+0000 7fdf8d326700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf880b2a90 0x7fdf8809b1f0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.989+0000 7fdf8d326700 1 --2- 172.21.15.84:0/1080298250 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdf880c6610 0x7fdf8809c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.989+0000 7fdf8d326700 1 -- 172.21.15.84:0/1080298250 >> 172.21.15.84:0/1080298250 conn(0x7fdf88099740 msgr2=0x7fdf880cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.989+0000 7fdf8d326700 1 -- 172.21.15.84:0/1080298250 shutdown_connections 2023-10-06T03:02:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:15.989+0000 7fdf8d326700 1 -- 172.21.15.84:0/1080298250 wait complete. 2023-10-06T03:02:16.000 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:16.001 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-10-06T03:02:16.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.116+0000 7f1d8ffff700 1 Processor -- start 2023-10-06T03:02:16.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.116+0000 7f1d8ffff700 1 -- start start 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.117+0000 7f1d8ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900cd400 0x7f1d900ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.117+0000 7f1d8ffff700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d900cc9b0 con 0x7f1d900b2660 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.117+0000 7f1d8ffff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d900cbda0 con 0x7f1d900b2a30 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.117+0000 7f1d8ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d900cc080 con 0x7f1d900cd400 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.117+0000 7f1d8effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1d900b2660 0x7f1d900cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37226/0 (socket says 172.21.15.84:37226) 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.117+0000 7f1d8effd700 1 -- 172.21.15.84:0/2187158321 learned_addr learned my addr 172.21.15.84:0/2187158321 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.117+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333479899 0 0) 0x7f1d900cc9b0 con 0x7f1d900b2660 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.117+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d7c003570 con 0x7f1d900b2660 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.117+0000 7f1d867fc700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900cd400 0x7f1d900ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3270995260 0 0) 0x7f1d7c003570 con 0x7f1d900b2660 2023-10-06T03:02:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900cd400 msgr2=0x7f1d900ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900cd400 0x7f1d900ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 >> v1:172.21.15.131:6789/0 conn(0x7f1d900b2a30 legacy=0x7f1d900c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900cc360 con 0x7f1d900b2660 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f1d800015f0 con 0x7f1d900b2660 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 >> v1:172.21.15.84:6789/0 conn(0x7f1d900b2660 legacy=0x7f1d900cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7c003a90 0x7f1d7c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7c004810 0x7f1d7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d7c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d900cc080 con 0x7f1d7c005210 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c00c0e0 con 0x7f1d7c003a90 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c00c2a0 con 0x7f1d7c004810 2023-10-06T03:02:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d867fc700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900cd400 0x7f1d900ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d7c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8effd700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7c003a90 0x7f1d7c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d867fc700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7c004810 0x7f1d7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7c004810 msgr2=0x7f1d7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d7c004810 0x7f1d7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7c003a90 msgr2=0x7f1d7c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7c003a90 0x7f1d7c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/2187158321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c003570 con 0x7f1d7c005210 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8effd700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d7c003a90 0x7f1d7c003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d7c00ba60 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f1d88001f90 tx=0x7f1d88001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9fa767a4d368af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88001950 con 0x7f1d7c005210 2023-10-06T03:02:16.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8800c8b0 con 0x7f1d7c005210 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.118+0000 7f1d8e7fc700 1 -- 172.21.15.84:0/2187158321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8800cc50 con 0x7f1d7c005210 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.119+0000 7f1d8ffff700 1 -- 172.21.15.84:0/2187158321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 msgr2=0x7f1d7c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.119+0000 7f1d8ffff700 1 --2- 172.21.15.84:0/2187158321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d7c00ba60 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f1d88001f90 tx=0x7f1d88001640 comp rx=0 tx=0).stop 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.119+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/2187158321 reap_dead start 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.119+0000 7f1d8ffff700 1 -- 172.21.15.84:0/2187158321 shutdown_connections 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.119+0000 7f1d8ffff700 1 -- 172.21.15.84:0/2187158321 >> 172.21.15.84:0/2187158321 conn(0x7f1d90099560 msgr2=0x7f1d9006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.119+0000 7f1d8ffff700 1 -- 172.21.15.84:0/2187158321 shutdown_connections 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.119+0000 7f1d8ffff700 1 -- 172.21.15.84:0/2187158321 wait complete. 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.120+0000 7f1d8ffff700 1 Processor -- start 2023-10-06T03:02:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.120+0000 7f1d8ffff700 1 -- start start 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d900ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8ffff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900b52e0 0x7f1d9015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900b5750 0x7f1d9015d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8ffff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9015bfe0 con 0x7f1d7c005210 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8ffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d900b4e50 con 0x7f1d900b5750 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8ffff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d900ca6a0 con 0x7f1d900b52e0 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d900ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d900ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39256/0 (socket says 172.21.15.84:39256) 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8effd700 1 -- 172.21.15.84:0/1573757103 learned_addr learned my addr 172.21.15.84:0/1573757103 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d867fc700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900b52e0 0x7f1d9015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900b5750 0x7f1d9015d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8effd700 1 -- 172.21.15.84:0/1573757103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900b52e0 msgr2=0x7f1d9015cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8effd700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900b52e0 0x7f1d9015cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8effd700 1 -- 172.21.15.84:0/1573757103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900b5750 msgr2=0x7f1d9015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8effd700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900b5750 0x7f1d9015d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8effd700 1 -- 172.21.15.84:0/1573757103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900b4240 con 0x7f1d7c005210 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.121+0000 7f1d8effd700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d900ca160 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f1d80002ee0 tx=0x7f1d80009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.122+0000 7f1d877fe700 1 -- 172.21.15.84:0/1573757103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80007e60 con 0x7f1d7c005210 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.122+0000 7f1d877fe700 1 -- 172.21.15.84:0/1573757103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80010040 con 0x7f1d7c005210 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.122+0000 7f1d877fe700 1 -- 172.21.15.84:0/1573757103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80001da0 con 0x7f1d7c005210 2023-10-06T03:02:16.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.122+0000 7f1d8ffff700 1 -- 172.21.15.84:0/1573757103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d900b4520 con 0x7f1d7c005210 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.122+0000 7f1d8ffff700 1 -- 172.21.15.84:0/1573757103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d900b4ae0 con 0x7f1d7c005210 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.123+0000 7f1d877fe700 1 -- 172.21.15.84:0/1573757103 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d800074f0 con 0x7f1d7c005210 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.123+0000 7f1d877fe700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d70066f30 0x7f1d700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.123+0000 7f1d877fe700 1 -- 172.21.15.84:0/1573757103 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1d80083c60 con 0x7f1d7c005210 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.123+0000 7f1d867fc700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d70066f30 0x7f1d700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.124+0000 7f1d867fc700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d70066f30 0x7f1d700693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006b90 tx=0x7f1d78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.125+0000 7f1d9e5f0b80 1 Processor -- start 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d9e5f0b80 1 -- start start 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded2aaea0 0x55aded285d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28b310 0x55aded286250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28ca60 0x55aded286790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aded1e0ac0 con 0x55aded28ca60 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aded1de2c0 con 0x55aded28b310 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aded1da0b0 con 0x55aded2aaea0 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28ca60 0x55aded286790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28ca60 0x55aded286790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39268/0 (socket says 172.21.15.84:39268) 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.126+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/2581281317 learned_addr learned my addr 172.21.15.84:0/2581281317 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d867fc700 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28b310 0x55aded286250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d8effd700 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded2aaea0 0x55aded285d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/2581281317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded2aaea0 msgr2=0x55aded285d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded2aaea0 0x55aded285d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/2581281317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28b310 msgr2=0x55aded286250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28b310 0x55aded286250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/2581281317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aded0742c0 con 0x55aded28ca60 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d8effd700 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded2aaea0 0x55aded285d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28ca60 0x55aded286790 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c0b0 tx=0x7f1d88015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b1af761c26c519 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d6ffff700 1 -- 172.21.15.84:0/2581281317 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88001950 con 0x55aded28ca60 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d6ffff700 1 -- 172.21.15.84:0/2581281317 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88023070 con 0x55aded28ca60 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.127+0000 7f1d6ffff700 1 -- 172.21.15.84:0/2581281317 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8800c6d0 con 0x55aded28ca60 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/2581281317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28ca60 msgr2=0x55aded286790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28ca60 0x55aded286790 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c0b0 tx=0x7f1d88015000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/2581281317 shutdown_connections 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28ca60 0x55aded286790 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded2aaea0 0x55aded285d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/2581281317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28b310 0x55aded286250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/2581281317 >> 172.21.15.84:0/2581281317 conn(0x55aded28aed0 msgr2=0x55aded28b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/2581281317 shutdown_connections 2023-10-06T03:02:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/2581281317 wait complete. 2023-10-06T03:02:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 -- start start 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.128+0000 7f1d9e5f0b80 1 Processor -- start 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.129+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28b310 0x55aded299ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.129+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded2d2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.129+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded2aaea0 0x55aded2d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.129+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aded1858e0 con 0x55aded2aaea0 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.129+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aded1a0ef0 con 0x55aded28ca60 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.129+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aded05ce80 con 0x55aded28b310 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.129+0000 7f1d9e5f0b80 10 client.0 _ll_register_callbacks cb 0x55aded24d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.129+0000 7f1d8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded2aaea0 0x55aded2d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d8f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded2aaea0 0x55aded2d47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39272/0 (socket says 172.21.15.84:39272) 2023-10-06T03:02:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/4120092220 learned_addr learned my addr 172.21.15.84:0/4120092220 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d8effd700 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28b310 0x55aded299ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d867fc700 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded2d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/4120092220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28b310 msgr2=0x55aded299ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28b310 0x55aded299ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/4120092220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 msgr2=0x55aded2d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded2d2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d8f7fe700 1 -- 172.21.15.84:0/4120092220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c003570 con 0x55aded2aaea0 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d867fc700 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded2d2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded2aaea0 0x55aded2d47e0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f1d88001220 tx=0x7f1d88021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37f5bca0eccb24b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/4120092220 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88006ba0 con 0x55aded2aaea0 2023-10-06T03:02:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/4120092220 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1d88006d00 con 0x55aded2aaea0 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/4120092220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aded27e990 con 0x55aded2aaea0 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/4120092220 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d88012720 con 0x55aded2aaea0 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d9e5f0b80 10 client.9060 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/4120092220 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55aded017030 con 0x55aded2aaea0 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/4120092220 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aded27e990 con 0x55aded2aaea0 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/4120092220 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f1d8800c0e0 con 0x55aded2aaea0 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d9e5f0b80 10 client.9060 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d9e5f0b80 10 client.9060 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d9e5f0b80 20 client.9060 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55aded2d4d20 0x55aded285ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d9e5f0b80 4 client.9060 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.130+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/4120092220 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aded25b8c0 con 0x55aded2d4d20 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.131+0000 7f1d8effd700 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55aded2d4d20 0x55aded285ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.131+0000 7f1d6d7fa700 10 client.9060 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.131+0000 7f1d8effd700 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55aded2d4d20 0x55aded285ca0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5460c87d6a9389ed server_cookie=eb45e772c7a84210 in_seq=0 out_seq=0 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.131+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/4120092220 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55aded25b8c0 con 0x55aded2d4d20 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.131+0000 7f1d6d7fa700 10 client.9060 handle_command_reply: tid=0 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.131+0000 7f1d9e5f0b80 1 client.9060 shutdown 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.131+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/4120092220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded2aaea0 msgr2=0x55aded2d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.131+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded2aaea0 0x55aded2d47e0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f1d88001220 tx=0x7f1d88021070 comp rx=0 tx=0).stop 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/4120092220 shutdown_connections 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55aded2d4d20 0x55aded285ca0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded2aaea0 0x55aded2d47e0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28b310 0x55aded299ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/4120092220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded2d2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d6d7fa700 0 client.9060 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/4120092220 >> 172.21.15.84:0/4120092220 conn(0x55aded28aed0 msgr2=0x55aded28bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/4120092220 shutdown_connections 2023-10-06T03:02:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/4120092220 wait complete. 2023-10-06T03:02:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.132+0000 7f1d9e5f0b80 20 client.9060 trim_cache size 0 max 16384 2023-10-06T03:02:16.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.147+0000 7f1d9e5f0b80 1 Processor -- start 2023-10-06T03:02:16.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.147+0000 7f1d9e5f0b80 1 -- start start 2023-10-06T03:02:16.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28aed0 0x55aded28bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded289760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded289ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aded2aab60 con 0x55aded28b310 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aded2ab270 con 0x55aded28ca60 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aded27e750 con 0x55aded28aed0 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d867fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded289760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d867fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded289760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39282/0 (socket says 172.21.15.84:39282) 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d867fc700 1 -- 172.21.15.84:0/690431337 learned_addr learned my addr 172.21.15.84:0/690431337 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d8effd700 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28aed0 0x55aded28bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.148+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded289ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d867fc700 1 -- 172.21.15.84:0/690431337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28aed0 msgr2=0x55aded28bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d867fc700 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28aed0 0x55aded28bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d867fc700 1 -- 172.21.15.84:0/690431337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 msgr2=0x55aded289ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d867fc700 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded289ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d867fc700 1 -- 172.21.15.84:0/690431337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aded1a87d0 con 0x55aded28b310 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded289ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d867fc700 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded289760 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006fd0 tx=0x7f1d78019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edac0de0bed9aa52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d84ff9700 1 -- 172.21.15.84:0/690431337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780157d0 con 0x55aded28b310 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d84ff9700 1 -- 172.21.15.84:0/690431337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7800c040 con 0x55aded28b310 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d84ff9700 1 -- 172.21.15.84:0/690431337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78015b80 con 0x55aded28b310 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/690431337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 msgr2=0x55aded289760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded289760 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006fd0 tx=0x7f1d78019000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/690431337 shutdown_connections 2023-10-06T03:02:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28ca60 0x55aded289ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28aed0 0x55aded28bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/690431337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded289760 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.149+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/690431337 >> 172.21.15.84:0/690431337 conn(0x55aded2b9d50 msgr2=0x55aded28a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.150+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/690431337 shutdown_connections 2023-10-06T03:02:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.150+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/690431337 wait complete. 2023-10-06T03:02:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.150+0000 7f1d9e5f0b80 1 -- start start 2023-10-06T03:02:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.150+0000 7f1d9e5f0b80 1 Processor -- start 2023-10-06T03:02:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28aed0 0x55aded285b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded31fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d9e5f0b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28ca60 0x55aded289760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aded2af250 con 0x55aded28b310 2023-10-06T03:02:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aded2b12b0 con 0x55aded28aed0 2023-10-06T03:02:16.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d9e5f0b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aded2b5be0 con 0x55aded28ca60 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d9e5f0b80 10 client.0 _ll_register_callbacks cb 0x55aded24d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d867fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded31fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d867fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded31fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39284/0 (socket says 172.21.15.84:39284) 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d867fc700 1 -- 172.21.15.84:0/722031088 learned_addr learned my addr 172.21.15.84:0/722031088 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28ca60 0x55aded289760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d8effd700 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28aed0 0x55aded285b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d867fc700 1 -- 172.21.15.84:0/722031088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28ca60 msgr2=0x55aded289760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d867fc700 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28ca60 0x55aded289760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d867fc700 1 -- 172.21.15.84:0/722031088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28aed0 msgr2=0x55aded285b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d867fc700 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28aed0 0x55aded285b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d867fc700 1 -- 172.21.15.84:0/722031088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d78012740 con 0x55aded28b310 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.151+0000 7f1d8f7fe700 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28ca60 0x55aded289760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d867fc700 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded31fa20 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f1d900b6310 tx=0x7f1d78027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1af1500d45f0d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/722031088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78033070 con 0x55aded28b310 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/722031088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1d78038460 con 0x55aded28b310 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/722031088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d88023070 con 0x55aded28b310 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/722031088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d78038870 con 0x55aded28b310 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d9e5f0b80 10 client.9066 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/722031088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55aded18f4c0 con 0x55aded28b310 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/722031088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88023070 con 0x55aded28b310 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/722031088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f1d7802a030 con 0x55aded28b310 2023-10-06T03:02:16.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d9e5f0b80 10 client.9066 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d9e5f0b80 10 client.9066 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d9e5f0b80 20 client.9066 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55aded2aaea0 0x55aded289ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d9e5f0b80 4 client.9066 mds_command: new command op to 8529 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/722031088 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aded17ce50 con 0x55aded2aaea0 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d8effd700 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55aded2aaea0 0x55aded289ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d6d7fa700 10 client.9066 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.152+0000 7f1d8effd700 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55aded2aaea0 0x55aded289ca0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=768ec73d553bd23 server_cookie=ce53ddf28ed4a3ba in_seq=0 out_seq=0 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d6d7fa700 1 -- 172.21.15.84:0/722031088 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55aded17ce50 con 0x55aded2aaea0 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d6d7fa700 10 client.9066 handle_command_reply: tid=0 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 client.9066 shutdown 2023-10-06T03:02:16.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/722031088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 msgr2=0x55aded31fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded31fa20 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f1d900b6310 tx=0x7f1d78027000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/722031088 shutdown_connections 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x55aded2aaea0 0x55aded289ca0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aded28aed0 0x55aded285b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d6d7fa700 0 client.9066 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55aded28ca60 0x55aded289760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 --2- 172.21.15.84:0/722031088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aded28b310 0x55aded31fa20 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/722031088 >> 172.21.15.84:0/722031088 conn(0x55aded2b9d50 msgr2=0x55aded2809b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/722031088 shutdown_connections 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 1 -- 172.21.15.84:0/722031088 wait complete. 2023-10-06T03:02:16.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d9e5f0b80 20 client.9066 trim_cache size 0 max 16384 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:16.162 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d8ffff700 1 -- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d70066f30 msgr2=0x7f1d700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d8ffff700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d70066f30 0x7f1d700693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006b90 tx=0x7f1d78008040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d8ffff700 1 -- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 msgr2=0x7f1d900ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d8ffff700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d900ca160 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f1d80002ee0 tx=0x7f1d80009040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d8ffff700 1 -- 172.21.15.84:0/1573757103 shutdown_connections 2023-10-06T03:02:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d8ffff700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1d70066f30 0x7f1d700693e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d8ffff700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900b5750 0x7f1d9015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d8ffff700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d7c005210 0x7f1d900ca160 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.153+0000 7f1d8ffff700 1 --2- 172.21.15.84:0/1573757103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1d900b52e0 0x7f1d9015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.154+0000 7f1d8ffff700 1 -- 172.21.15.84:0/1573757103 >> 172.21.15.84:0/1573757103 conn(0x7f1d90099560 msgr2=0x7f1d90068150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.154+0000 7f1d8ffff700 1 -- 172.21.15.84:0/1573757103 shutdown_connections 2023-10-06T03:02:16.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.154+0000 7f1d8ffff700 1 -- 172.21.15.84:0/1573757103 wait complete. 2023-10-06T03:02:16.165 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:16.165 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2023-10-06T03:02:16.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.282+0000 7f029f812700 1 Processor -- start 2023-10-06T03:02:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.282+0000 7f029f812700 1 -- start start 2023-10-06T03:02:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.283+0000 7f029f812700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f02980cbb50 0x7f02980ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.283+0000 7f029f812700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02980b2e60 con 0x7f02980b2a90 2023-10-06T03:02:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.283+0000 7f029f812700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02980cf5d0 con 0x7f02980c6610 2023-10-06T03:02:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.283+0000 7f029f812700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02980cf8b0 con 0x7f02980cbb50 2023-10-06T03:02:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.283+0000 7f029d5ae700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f02980b2a90 0x7f02980cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37234/0 (socket says 172.21.15.84:37234) 2023-10-06T03:02:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.283+0000 7f029d5ae700 1 -- 172.21.15.84:0/4009954764 learned_addr learned my addr 172.21.15.84:0/4009954764 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.283+0000 7f029cdad700 1 --2- 172.21.15.84:0/4009954764 >> v2:172.21.15.131:3300/0 conn(0x7f02980cbb50 0x7f02980ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.283+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558175652 0 0) 0x7f02980b2e60 con 0x7f02980b2a90 2023-10-06T03:02:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.283+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0284003570 con 0x7f02980b2a90 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130577756 0 0) 0x7f02980cf5d0 con 0x7f02980c6610 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02980b2e60 con 0x7f02980c6610 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567169690 0 0) 0x7f0284003570 con 0x7f02980b2a90 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 >> v2:172.21.15.131:3300/0 conn(0x7f02980cbb50 msgr2=0x7f02980ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 --2- 172.21.15.84:0/4009954764 >> v2:172.21.15.131:3300/0 conn(0x7f02980cbb50 0x7f02980ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 >> v1:172.21.15.131:6789/0 conn(0x7f02980c6610 legacy=0x7f02980ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02980cfb90 con 0x7f02980b2a90 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f02940015f0 con 0x7f02980b2a90 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 >> v1:172.21.15.84:6789/0 conn(0x7f02980b2a90 legacy=0x7f02980cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284003c40 0x7f0284004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284004810 0x7f0284004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0284005280 0x7f028400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02980cf8b0 con 0x7f0284004810 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028400c250 con 0x7f0284003c40 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028400c410 con 0x7f0284005280 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029cdad700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284004810 0x7f0284004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029d5ae700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284003c40 0x7f0284004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029ddaf700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0284005280 0x7f028400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029cdad700 1 -- 172.21.15.84:0/4009954764 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0284005280 msgr2=0x7f028400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029cdad700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0284005280 0x7f028400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029cdad700 1 -- 172.21.15.84:0/4009954764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284003c40 msgr2=0x7f0284004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029cdad700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284003c40 0x7f0284004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029cdad700 1 -- 172.21.15.84:0/4009954764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284003570 con 0x7f0284004810 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029ddaf700 1 -- 172.21.15.84:0/4009954764 reap_dead start 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f029cdad700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284004810 0x7f0284004c80 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f0288009c00 tx=0x7f02880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d18ed88aac6c1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028800e710 con 0x7f0284004810 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028800e870 con 0x7f0284004810 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.284+0000 7f028ffff700 1 -- 172.21.15.84:0/4009954764 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028800ec30 con 0x7f0284004810 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.285+0000 7f029f812700 1 -- 172.21.15.84:0/4009954764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284004810 msgr2=0x7f0284004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.285+0000 7f029f812700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284004810 0x7f0284004c80 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f0288009c00 tx=0x7f02880091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.285+0000 7f029f812700 1 -- 172.21.15.84:0/4009954764 shutdown_connections 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.285+0000 7f029f812700 1 --2- 172.21.15.84:0/4009954764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0284004810 0x7f0284004c80 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.285+0000 7f029f812700 1 -- 172.21.15.84:0/4009954764 >> 172.21.15.84:0/4009954764 conn(0x7f0298099740 msgr2=0x7f029806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.285+0000 7f029f812700 1 -- 172.21.15.84:0/4009954764 shutdown_connections 2023-10-06T03:02:16.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.285+0000 7f029f812700 1 -- 172.21.15.84:0/4009954764 wait complete. 2023-10-06T03:02:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.286+0000 7f029f812700 1 Processor -- start 2023-10-06T03:02:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.286+0000 7f029f812700 1 -- start start 2023-10-06T03:02:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029f812700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284004810 0x7f029809a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029f812700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f029809df50 0x7f029809c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029f812700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02981428a0 0x7f0298156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029f812700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029809ceb0 con 0x7f02981428a0 2023-10-06T03:02:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029f812700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029809d190 con 0x7f0284004810 2023-10-06T03:02:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029f812700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029809d470 con 0x7f029809df50 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029ddaf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02981428a0 0x7f0298156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029ddaf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02981428a0 0x7f0298156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39298/0 (socket says 172.21.15.84:39298) 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029ddaf700 1 -- 172.21.15.84:0/848010904 learned_addr learned my addr 172.21.15.84:0/848010904 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029cdad700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f029809df50 0x7f029809c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029d5ae700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284004810 0x7f029809a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029ddaf700 1 -- 172.21.15.84:0/848010904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f029809df50 msgr2=0x7f029809c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029ddaf700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f029809df50 0x7f029809c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029ddaf700 1 -- 172.21.15.84:0/848010904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284004810 msgr2=0x7f029809a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029ddaf700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284004810 0x7f029809a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029ddaf700 1 -- 172.21.15.84:0/848010904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029809d750 con 0x7f02981428a0 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.287+0000 7f029ddaf700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02981428a0 0x7f0298156880 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f0290001460 tx=0x7f0290009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.288+0000 7f028d7fa700 1 -- 172.21.15.84:0/848010904 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900032e0 con 0x7f02981428a0 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.288+0000 7f028d7fa700 1 -- 172.21.15.84:0/848010904 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290003440 con 0x7f02981428a0 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.288+0000 7f028d7fa700 1 -- 172.21.15.84:0/848010904 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290001930 con 0x7f02981428a0 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.288+0000 7f029f812700 1 -- 172.21.15.84:0/848010904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029809da30 con 0x7f02981428a0 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.288+0000 7f029f812700 1 -- 172.21.15.84:0/848010904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0298142d20 con 0x7f02981428a0 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.289+0000 7f028d7fa700 1 -- 172.21.15.84:0/848010904 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0290001ca0 con 0x7f02981428a0 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.289+0000 7f028d7fa700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f027c066f30 0x7f027c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.289+0000 7f028d7fa700 1 -- 172.21.15.84:0/848010904 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f0290084810 con 0x7f02981428a0 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.289+0000 7f029d5ae700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f027c066f30 0x7f027c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.290+0000 7f029d5ae700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f027c066f30 0x7f027c0693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f029804cc40 tx=0x7f0294009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.291+0000 7f02a8b0ab80 1 Processor -- start 2023-10-06T03:02:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.291+0000 7f02a8b0ab80 1 -- start start 2023-10-06T03:02:16.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b2890 0x555fdc1b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b3d10 0x555fdc202710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc2030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fdc109ac0 con 0x555fdc1b2890 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fdc1072c0 con 0x555fdc1b3d10 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fdc1030b0 con 0x555fdc202c50 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f029d5ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b2890 0x555fdc1b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f029d5ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b2890 0x555fdc1b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39306/0 (socket says 172.21.15.84:39306) 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f029d5ae700 1 -- 172.21.15.84:0/2864872094 learned_addr learned my addr 172.21.15.84:0/2864872094 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f029cdad700 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b3d10 0x555fdc202710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f029d5ae700 1 -- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 msgr2=0x555fdc2030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f029ddaf700 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc2030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.292+0000 7f029d5ae700 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc2030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f029d5ae700 1 -- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b3d10 msgr2=0x555fdc202710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f029d5ae700 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b3d10 0x555fdc202710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f029d5ae700 1 -- 172.21.15.84:0/2864872094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fdbf9d2c0 con 0x555fdc1b2890 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f029cdad700 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b3d10 0x555fdc202710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f029ddaf700 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc2030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f029d5ae700 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b2890 0x555fdc1b2c60 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f02940076e0 tx=0x7f0294015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e59b7060ead999 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02827fc700 1 -- 172.21.15.84:0/2864872094 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940144d0 con 0x555fdc1b2890 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02827fc700 1 -- 172.21.15.84:0/2864872094 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294014630 con 0x555fdc1b2890 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02827fc700 1 -- 172.21.15.84:0/2864872094 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940149f0 con 0x555fdc1b2890 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2864872094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b2890 msgr2=0x555fdc1b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b2890 0x555fdc1b2c60 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f02940076e0 tx=0x7f0294015000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2864872094 shutdown_connections 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc2030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b2890 0x555fdc1b2c60 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2864872094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b3d10 0x555fdc202710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2864872094 >> 172.21.15.84:0/2864872094 conn(0x555fdc1b41b0 msgr2=0x555fdc1b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2864872094 shutdown_connections 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.293+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2864872094 wait complete. 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.294+0000 7f02a8b0ab80 1 -- start start 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.294+0000 7f02a8b0ab80 1 Processor -- start 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc2098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b3d10 0x555fdc1add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc1ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fdc0ae8e0 con 0x555fdc1b3d10 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fdc0c9ef0 con 0x555fdc1b2890 2023-10-06T03:02:16.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fdbf85e80 con 0x555fdc202c50 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f02a8b0ab80 10 client.0 _ll_register_callbacks cb 0x555fdc175ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029cdad700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b3d10 0x555fdc1add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029cdad700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b3d10 0x555fdc1add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39310/0 (socket says 172.21.15.84:39310) 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029cdad700 1 -- 172.21.15.84:0/2267646121 learned_addr learned my addr 172.21.15.84:0/2267646121 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029d5ae700 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc2098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029ddaf700 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc1ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029cdad700 1 -- 172.21.15.84:0/2267646121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 msgr2=0x555fdc1ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029cdad700 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc1ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029cdad700 1 -- 172.21.15.84:0/2267646121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 msgr2=0x555fdc2098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029cdad700 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc2098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029cdad700 1 -- 172.21.15.84:0/2267646121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029400f040 con 0x555fdc1b3d10 2023-10-06T03:02:16.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.295+0000 7f029ddaf700 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc1ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f029cdad700 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b3d10 0x555fdc1add10 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f028400c220 tx=0x7f028801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93965de29bbbd20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02777fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02777fe700 1 -- 172.21.15.84:0/2267646121 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028802b070 con 0x555fdc1b3d10 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02777fe700 1 -- 172.21.15.84:0/2267646121 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f0288013680 con 0x555fdc1b3d10 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2267646121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555fdc1a7990 con 0x555fdc1b3d10 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02777fe700 1 -- 172.21.15.84:0/2267646121 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0288006c90 con 0x555fdc1b3d10 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02a8b0ab80 10 client.9078 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2267646121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x555fdbf40030 con 0x555fdc1b3d10 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02777fe700 1 -- 172.21.15.84:0/2267646121 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555fdc1a7990 con 0x555fdc1b3d10 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02777fe700 1 -- 172.21.15.84:0/2267646121 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f028802e020 con 0x555fdc1b3d10 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02a8b0ab80 10 client.9078 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02a8b0ab80 10 client.9078 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02a8b0ab80 20 client.9078 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x555fdc1e0f20 0x555fdc1ddd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02a8b0ab80 4 client.9078 mds_command: new command op to 8526 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2267646121 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555fdc1848c0 con 0x555fdc1e0f20 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.296+0000 7f029d5ae700 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x555fdc1e0f20 0x555fdc1ddd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f029d5ae700 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x555fdc1e0f20 0x555fdc1ddd20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3626817c5b64de55 server_cookie=62347385ba486211 in_seq=0 out_seq=0 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02777fe700 10 client.9078 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02777fe700 1 -- 172.21.15.84:0/2267646121 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555fdc1848c0 con 0x555fdc1e0f20 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02777fe700 10 client.9078 handle_command_reply: tid=0 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 client.9078 shutdown 2023-10-06T03:02:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2267646121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b3d10 msgr2=0x555fdc1add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b3d10 0x555fdc1add10 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f028400c220 tx=0x7f028801a000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2267646121 shutdown_connections 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x555fdc1e0f20 0x555fdc1ddd20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc2098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc202c50 0x555fdc1ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02777fe700 0 client.9078 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2267646121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc1b3d10 0x555fdc1add10 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2267646121 >> 172.21.15.84:0/2267646121 conn(0x555fdc1b41b0 msgr2=0x555fdc1b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2267646121 shutdown_connections 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2267646121 wait complete. 2023-10-06T03:02:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.297+0000 7f02a8b0ab80 20 client.9078 trim_cache size 0 max 16384 2023-10-06T03:02:16.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.313+0000 7f02a8b0ab80 1 Processor -- start 2023-10-06T03:02:16.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.313+0000 7f02a8b0ab80 1 -- start start 2023-10-06T03:02:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc1ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 0x555fdc1f6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc1f6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fdc202990 con 0x555fdc202c50 2023-10-06T03:02:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fdc20b6f0 con 0x555fdc1b2890 2023-10-06T03:02:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fdc1e2770 con 0x555fdc1b3d10 2023-10-06T03:02:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029ddaf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc1f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029ddaf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc1f6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39322/0 (socket says 172.21.15.84:39322) 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029ddaf700 1 -- 172.21.15.84:0/1225920597 learned_addr learned my addr 172.21.15.84:0/1225920597 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029d5ae700 1 --2- 172.21.15.84:0/1225920597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc1ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029cdad700 1 --2- 172.21.15.84:0/1225920597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 0x555fdc1f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029ddaf700 1 -- 172.21.15.84:0/1225920597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 msgr2=0x555fdc1f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029ddaf700 1 --2- 172.21.15.84:0/1225920597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 0x555fdc1f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029ddaf700 1 -- 172.21.15.84:0/1225920597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 msgr2=0x555fdc1ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029ddaf700 1 --2- 172.21.15.84:0/1225920597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc1ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029ddaf700 1 -- 172.21.15.84:0/1225920597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fdc0d17d0 con 0x555fdc202c50 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.314+0000 7f029ddaf700 1 --2- 172.21.15.84:0/1225920597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc1f6880 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f029000c2f0 tx=0x7f0290084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2048d7a89b9fcd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f0282ffd700 1 -- 172.21.15.84:0/1225920597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290055470 con 0x555fdc202c50 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f0282ffd700 1 -- 172.21.15.84:0/1225920597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290058610 con 0x555fdc202c50 2023-10-06T03:02:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f0282ffd700 1 -- 172.21.15.84:0/1225920597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029005c360 con 0x555fdc202c50 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/1225920597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 msgr2=0x555fdc1f6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/1225920597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc1f6880 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f029000c2f0 tx=0x7f0290084040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/1225920597 shutdown_connections 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/1225920597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc1ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/1225920597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc1f6880 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/1225920597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 0x555fdc1f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/1225920597 >> 172.21.15.84:0/1225920597 conn(0x555fdc1b41b0 msgr2=0x555fdc209790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/1225920597 shutdown_connections 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.315+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/1225920597 wait complete. 2023-10-06T03:02:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.316+0000 7f02a8b0ab80 1 -- start start 2023-10-06T03:02:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.316+0000 7f02a8b0ab80 1 Processor -- start 2023-10-06T03:02:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc266e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 0x555fdc212270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc2127b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fdc268990 con 0x555fdc202c50 2023-10-06T03:02:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fdc1b06c0 con 0x555fdc1b2890 2023-10-06T03:02:16.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fdc1ab490 con 0x555fdc1b3d10 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 10 client.0 _ll_register_callbacks cb 0x555fdc175ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029ddaf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc2127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029ddaf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc2127b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39326/0 (socket says 172.21.15.84:39326) 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029ddaf700 1 -- 172.21.15.84:0/2417334868 learned_addr learned my addr 172.21.15.84:0/2417334868 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029cdad700 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 0x555fdc212270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029d5ae700 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc266e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029ddaf700 1 -- 172.21.15.84:0/2417334868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 msgr2=0x555fdc212270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029ddaf700 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 0x555fdc212270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029ddaf700 1 -- 172.21.15.84:0/2417334868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 msgr2=0x555fdc266e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029ddaf700 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc266e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029ddaf700 1 -- 172.21.15.84:0/2417334868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0298142d20 con 0x555fdc202c50 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f029ddaf700 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc2127b0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f0290055170 tx=0x7f0290015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25065cbd754c708e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02777fe700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02777fe700 1 -- 172.21.15.84:0/2417334868 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029005c360 con 0x555fdc202c50 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02777fe700 1 -- 172.21.15.84:0/2417334868 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f02900535b0 con 0x555fdc202c50 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2417334868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0294014630 con 0x555fdc202c50 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02777fe700 1 -- 172.21.15.84:0/2417334868 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0290054b70 con 0x555fdc202c50 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 10 client.9084 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.317+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2417334868 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x555fdc0b84c0 con 0x555fdc202c50 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02777fe700 1 -- 172.21.15.84:0/2417334868 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294014630 con 0x555fdc202c50 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02777fe700 1 -- 172.21.15.84:0/2417334868 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f0290063020 con 0x555fdc202c50 2023-10-06T03:02:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 10 client.9084 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 10 client.9084 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 20 client.9084 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x555fdc212cf0 0x555fdc1f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 4 client.9084 mds_command: new command op to 8526 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2417334868 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555fdc0a5e50 con 0x555fdc212cf0 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f029d5ae700 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x555fdc212cf0 0x555fdc1f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02777fe700 10 client.9084 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f029d5ae700 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x555fdc212cf0 0x555fdc1f2a10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=beccb33ce6e6d789 server_cookie=6a9da3cb7c6430ee in_seq=0 out_seq=0 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02777fe700 1 -- 172.21.15.84:0/2417334868 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x555fdc0a5e50 con 0x555fdc212cf0 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02777fe700 10 client.9084 handle_command_reply: tid=0 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 client.9084 shutdown 2023-10-06T03:02:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2417334868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 msgr2=0x555fdc2127b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc2127b0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f0290055170 tx=0x7f0290015000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2417334868 shutdown_connections 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x555fdc212cf0 0x555fdc1f2a10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555fdc1b2890 0x555fdc266e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555fdc202c50 0x555fdc2127b0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02777fe700 0 client.9084 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 --2- 172.21.15.84:0/2417334868 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555fdc1b3d10 0x555fdc212270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.318+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2417334868 >> 172.21.15.84:0/2417334868 conn(0x555fdc1b41b0 msgr2=0x555fdc209790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2417334868 shutdown_connections 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f02a8b0ab80 1 -- 172.21.15.84:0/2417334868 wait complete. 2023-10-06T03:02:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f02a8b0ab80 20 client.9084 trim_cache size 0 max 16384 2023-10-06T03:02:16.327 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:16.327 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:02:16.327 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:16.327 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:16.327 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:16.327 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:16.327 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:16.327 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:16.327 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:16.328 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 -- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f027c066f30 msgr2=0x7f027c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f027c066f30 0x7f027c0693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f029804cc40 tx=0x7f0294009040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 -- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02981428a0 msgr2=0x7f0298156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02981428a0 0x7f0298156880 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f0290001460 tx=0x7f0290009040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 -- 172.21.15.84:0/848010904 shutdown_connections 2023-10-06T03:02:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f027c066f30 0x7f027c0693e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284004810 0x7f029809a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02981428a0 0x7f0298156880 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 --2- 172.21.15.84:0/848010904 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f029809df50 0x7f029809c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 -- 172.21.15.84:0/848010904 >> 172.21.15.84:0/848010904 conn(0x7f0298099740 msgr2=0x7f0298158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 -- 172.21.15.84:0/848010904 shutdown_connections 2023-10-06T03:02:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.319+0000 7f029f812700 1 -- 172.21.15.84:0/848010904 wait complete. 2023-10-06T03:02:16.331 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:16.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2023-10-06T03:02:16.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.447+0000 7f793ddfc700 1 Processor -- start 2023-10-06T03:02:16.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.447+0000 7f793ddfc700 1 -- start start 2023-10-06T03:02:16.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f793ddfc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79380b2a90 0x7f79380cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f793ddfc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f79380c6610 0x7f79380cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f793ddfc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79380cbdf0 con 0x7f79380cb980 2023-10-06T03:02:16.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f793ddfc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79380b2e60 con 0x7f79380b2a90 2023-10-06T03:02:16.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f793ddfc700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79380cf5d0 con 0x7f79380c6610 2023-10-06T03:02:16.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f79377fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79380b2a90 0x7f79380cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f7936ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f79380cb980 0x7f79380ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37242/0 (socket says 172.21.15.84:37242) 2023-10-06T03:02:16.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f7936ffd700 1 -- 172.21.15.84:0/3778748326 learned_addr learned my addr 172.21.15.84:0/3778748326 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f79377fe700 1 -- 172.21.15.84:0/3778748326 >> v2:172.21.15.131:3300/0 conn(0x7f79380c6610 msgr2=0x7f79380cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f79377fe700 1 --2- 172.21.15.84:0/3778748326 >> v2:172.21.15.131:3300/0 conn(0x7f79380c6610 0x7f79380cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f79377fe700 1 -- 172.21.15.84:0/3778748326 >> v1:172.21.15.84:6789/0 conn(0x7f79380cb980 legacy=0x7f79380ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f79377fe700 1 -- 172.21.15.84:0/3778748326 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79380cf8b0 con 0x7f79380b2a90 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.448+0000 7f79367fc700 1 -- 172.21.15.84:0/3778748326 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233313722 0 0) 0x7f79380cbdf0 con 0x7f79380cb980 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f79377fe700 1 --2- 172.21.15.84:0/3778748326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 0x7f79380cb440 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f7928009eb0 tx=0x7f7928009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50180de9764e944 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f79367fc700 1 -- 172.21.15.84:0/3778748326 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800e070 con 0x7f79380b2a90 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f79367fc700 1 -- 172.21.15.84:0/3778748326 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792800bbf0 con 0x7f79380b2a90 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f79367fc700 1 -- 172.21.15.84:0/3778748326 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928012430 con 0x7f79380b2a90 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f793ddfc700 1 -- 172.21.15.84:0/3778748326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 msgr2=0x7f79380cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f793ddfc700 1 --2- 172.21.15.84:0/3778748326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 0x7f79380cb440 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f7928009eb0 tx=0x7f7928009780 comp rx=0 tx=0).stop 2023-10-06T03:02:16.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f793ddfc700 1 -- 172.21.15.84:0/3778748326 shutdown_connections 2023-10-06T03:02:16.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f793ddfc700 1 --2- 172.21.15.84:0/3778748326 >> v2:172.21.15.131:3300/0 conn(0x7f79380c6610 0x7f79380cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f793ddfc700 1 --2- 172.21.15.84:0/3778748326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 0x7f79380cb440 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f793ddfc700 1 -- 172.21.15.84:0/3778748326 >> 172.21.15.84:0/3778748326 conn(0x7f7938099740 msgr2=0x7f793806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f793ddfc700 1 -- 172.21.15.84:0/3778748326 shutdown_connections 2023-10-06T03:02:16.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.449+0000 7f793ddfc700 1 -- 172.21.15.84:0/3778748326 wait complete. 2023-10-06T03:02:16.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f793ddfc700 1 Processor -- start 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f793ddfc700 1 -- start start 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f793ddfc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 0x7f7938158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f793ddfc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79380c6610 0x7f793815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f793ddfc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79380cb980 0x7f793815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f793ddfc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79380c8850 con 0x7f79380b2a90 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f793ddfc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793809b130 con 0x7f79380c6610 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f793ddfc700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793809b410 con 0x7f79380cb980 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f79377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 0x7f7938158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f79377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 0x7f7938158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39338/0 (socket says 172.21.15.84:39338) 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.451+0000 7f79377fe700 1 -- 172.21.15.84:0/3924613395 learned_addr learned my addr 172.21.15.84:0/3924613395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f7936ffd700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79380c6610 0x7f793815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f79377fe700 1 -- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79380cb980 msgr2=0x7f793815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f7937fff700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79380cb980 0x7f793815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f79377fe700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79380cb980 0x7f793815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f79377fe700 1 -- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79380c6610 msgr2=0x7f793815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f79377fe700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79380c6610 0x7f793815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f79377fe700 1 -- 172.21.15.84:0/3924613395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928009a20 con 0x7f79380b2a90 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f7937fff700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79380cb980 0x7f793815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f7936ffd700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79380c6610 0x7f793815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f79377fe700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 0x7f7938158420 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f792800b6c0 tx=0x7f7928017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f791f7fe700 1 -- 172.21.15.84:0/3924613395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928012de0 con 0x7f79380b2a90 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f791f7fe700 1 -- 172.21.15.84:0/3924613395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79280263f0 con 0x7f79380b2a90 2023-10-06T03:02:16.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f791f7fe700 1 -- 172.21.15.84:0/3924613395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79280267b0 con 0x7f79380b2a90 2023-10-06T03:02:16.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f793ddfc700 1 -- 172.21.15.84:0/3924613395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793809b6f0 con 0x7f79380b2a90 2023-10-06T03:02:16.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.452+0000 7f793ddfc700 1 -- 172.21.15.84:0/3924613395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7938158960 con 0x7f79380b2a90 2023-10-06T03:02:16.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.453+0000 7f791f7fe700 1 -- 172.21.15.84:0/3924613395 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7928026ba0 con 0x7f79380b2a90 2023-10-06T03:02:16.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.454+0000 7f791f7fe700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7924066f30 0x7f79240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.454+0000 7f791f7fe700 1 -- 172.21.15.84:0/3924613395 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7928086530 con 0x7f79380b2a90 2023-10-06T03:02:16.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.454+0000 7f7936ffd700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7924066f30 0x7f79240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.454+0000 7f7936ffd700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7924066f30 0x7f79240693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f79380ca5c0 tx=0x7f792c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.456+0000 7f79470f4b80 1 Processor -- start 2023-10-06T03:02:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.456+0000 7f79470f4b80 1 -- start start 2023-10-06T03:02:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.456+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcee890 0x55e2edceec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.456+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcefd10 0x55e2edd3e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.456+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd3f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f79470f4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2edc45ac0 con 0x55e2edd3ec50 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f79470f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2edc432c0 con 0x55e2edcee890 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f79470f4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2edc3f0b0 con 0x55e2edcefd10 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7937fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd3f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7937fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd3f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39348/0 (socket says 172.21.15.84:39348) 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7937fff700 1 -- 172.21.15.84:0/733506612 learned_addr learned my addr 172.21.15.84:0/733506612 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f79377fe700 1 --2- 172.21.15.84:0/733506612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcee890 0x55e2edceec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7936ffd700 1 --2- 172.21.15.84:0/733506612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcefd10 0x55e2edd3e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7937fff700 1 -- 172.21.15.84:0/733506612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcefd10 msgr2=0x55e2edd3e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7937fff700 1 --2- 172.21.15.84:0/733506612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcefd10 0x55e2edd3e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7937fff700 1 -- 172.21.15.84:0/733506612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcee890 msgr2=0x55e2edceec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7937fff700 1 --2- 172.21.15.84:0/733506612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcee890 0x55e2edceec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7937fff700 1 -- 172.21.15.84:0/733506612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2edad92c0 con 0x55e2edd3ec50 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f7937fff700 1 --2- 172.21.15.84:0/733506612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd3f0a0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f793000aa80 tx=0x7f7930008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5bb39f9f6d2afe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f791cff9700 1 -- 172.21.15.84:0/733506612 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793000a030 con 0x55e2edd3ec50 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f791cff9700 1 -- 172.21.15.84:0/733506612 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793000c7f0 con 0x55e2edd3ec50 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.457+0000 7f791cff9700 1 -- 172.21.15.84:0/733506612 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793000cb90 con 0x55e2edd3ec50 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.458+0000 7f79470f4b80 1 -- 172.21.15.84:0/733506612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 msgr2=0x55e2edd3f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.458+0000 7f79470f4b80 1 --2- 172.21.15.84:0/733506612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd3f0a0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f793000aa80 tx=0x7f7930008040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.458+0000 7f79470f4b80 1 -- 172.21.15.84:0/733506612 shutdown_connections 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.458+0000 7f79470f4b80 1 --2- 172.21.15.84:0/733506612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcee890 0x55e2edceec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.458+0000 7f79470f4b80 1 --2- 172.21.15.84:0/733506612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd3f0a0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.458+0000 7f79470f4b80 1 --2- 172.21.15.84:0/733506612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcefd10 0x55e2edd3e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.458+0000 7f79470f4b80 1 -- 172.21.15.84:0/733506612 >> 172.21.15.84:0/733506612 conn(0x55e2edcf01b0 msgr2=0x55e2edcf0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.458+0000 7f79470f4b80 1 -- 172.21.15.84:0/733506612 shutdown_connections 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.458+0000 7f79470f4b80 1 -- 172.21.15.84:0/733506612 wait complete. 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.459+0000 7f79470f4b80 1 -- start start 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.459+0000 7f79470f4b80 1 Processor -- start 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.459+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcee890 0x55e2edd06cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.459+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd07230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.459+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd1da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f79470f4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2edbea8e0 con 0x55e2edd3ec50 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f79470f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2edc05ef0 con 0x55e2edcefd10 2023-10-06T03:02:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f79470f4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2edac1e80 con 0x55e2edcee890 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f79470f4b80 10 client.0 _ll_register_callbacks cb 0x55e2edcb1ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7937fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd1da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7937fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd1da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39354/0 (socket says 172.21.15.84:39354) 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7937fff700 1 -- 172.21.15.84:0/4232964127 learned_addr learned my addr 172.21.15.84:0/4232964127 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7936ffd700 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd07230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f79377fe700 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcee890 0x55e2edd06cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7937fff700 1 -- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcee890 msgr2=0x55e2edd06cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7937fff700 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcee890 0x55e2edd06cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7937fff700 1 -- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 msgr2=0x55e2edd07230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7937fff700 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd07230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7937fff700 1 -- 172.21.15.84:0/4232964127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793000a600 con 0x55e2edd3ec50 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7937fff700 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd1da70 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f793000a560 tx=0x7f7930017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893967380a6e256 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7915ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7915ffb700 1 -- 172.21.15.84:0/4232964127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930012680 con 0x55e2edd3ec50 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7915ffb700 1 -- 172.21.15.84:0/4232964127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f79300127e0 con 0x55e2edd3ec50 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f79470f4b80 1 -- 172.21.15.84:0/4232964127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2edce3990 con 0x55e2edd3ec50 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f7915ffb700 1 -- 172.21.15.84:0/4232964127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7930012bb0 con 0x55e2edd3ec50 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f79470f4b80 10 client.9099 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.460+0000 7f79470f4b80 1 -- 172.21.15.84:0/4232964127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55e2eda7c030 con 0x55e2edd3ec50 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f7915ffb700 1 -- 172.21.15.84:0/4232964127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e2edce3990 con 0x55e2edd3ec50 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f7915ffb700 1 -- 172.21.15.84:0/4232964127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f7930012d10 con 0x55e2edd3ec50 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f79470f4b80 10 client.9099 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f79470f4b80 10 client.9099 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f79470f4b80 20 client.9099 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f79470f4b80 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55e2edd1e4a0 0x55e2edd19830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f79470f4b80 4 client.9099 mds_command: new command op to 6782 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f79470f4b80 1 -- 172.21.15.84:0/4232964127 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2edcc08c0 con 0x55e2edd1e4a0 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f79377fe700 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55e2edd1e4a0 0x55e2edd19830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f7915ffb700 10 client.9099 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.461+0000 7f79377fe700 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55e2edd1e4a0 0x55e2edd19830 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c117c0def892f25e server_cookie=4a57fd2983fcbd5a in_seq=0 out_seq=0 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f7915ffb700 1 -- 172.21.15.84:0/4232964127 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e2edcc08c0 con 0x55e2edd1e4a0 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f7915ffb700 10 client.9099 handle_command_reply: tid=0 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 client.9099 shutdown 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 -- 172.21.15.84:0/4232964127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 msgr2=0x55e2edd1da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd1da70 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f793000a560 tx=0x7f7930017000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 -- 172.21.15.84:0/4232964127 shutdown_connections 2023-10-06T03:02:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55e2edd1e4a0 0x55e2edd19830 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edd3ec50 0x55e2edd1da70 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f7915ffb700 0 client.9099 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edcee890 0x55e2edd06cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 --2- 172.21.15.84:0/4232964127 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd07230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 -- 172.21.15.84:0/4232964127 >> 172.21.15.84:0/4232964127 conn(0x55e2edcf01b0 msgr2=0x55e2edcef200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 -- 172.21.15.84:0/4232964127 shutdown_connections 2023-10-06T03:02:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.462+0000 7f79470f4b80 1 -- 172.21.15.84:0/4232964127 wait complete. 2023-10-06T03:02:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.463+0000 7f79470f4b80 20 client.9099 trim_cache size 0 max 16384 2023-10-06T03:02:16.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.478+0000 7f79470f4b80 1 Processor -- start 2023-10-06T03:02:16.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.478+0000 7f79470f4b80 1 -- start start 2023-10-06T03:02:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd916b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd1a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 0x55e2edd1adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79470f4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2edcef200 con 0x55e2edcee890 2023-10-06T03:02:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79470f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2edd57ef0 con 0x55e2edcefd10 2023-10-06T03:02:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79470f4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2edd33f70 con 0x55e2edd3ec50 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd916b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39360/0 (socket says 172.21.15.84:39360) 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79377fe700 1 -- 172.21.15.84:0/1476980661 learned_addr learned my addr 172.21.15.84:0/1476980661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f7937fff700 1 --2- 172.21.15.84:0/1476980661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 0x55e2edd1adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f7936ffd700 1 --2- 172.21.15.84:0/1476980661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd1a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79377fe700 1 -- 172.21.15.84:0/1476980661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 msgr2=0x55e2edd1adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79377fe700 1 --2- 172.21.15.84:0/1476980661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 0x55e2edd1adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79377fe700 1 -- 172.21.15.84:0/1476980661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 msgr2=0x55e2edd1a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79377fe700 1 --2- 172.21.15.84:0/1476980661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd1a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.479+0000 7f79377fe700 1 -- 172.21.15.84:0/1476980661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2edc0d7d0 con 0x55e2edcee890 2023-10-06T03:02:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79377fe700 1 --2- 172.21.15.84:0/1476980661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd916b0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f79280094d0 tx=0x7f7928031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e214a6ebef3fba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f791d7fa700 1 -- 172.21.15.84:0/1476980661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800e040 con 0x55e2edcee890 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f791d7fa700 1 -- 172.21.15.84:0/1476980661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792806d070 con 0x55e2edcee890 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f791d7fa700 1 -- 172.21.15.84:0/1476980661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792805a330 con 0x55e2edcee890 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79470f4b80 1 -- 172.21.15.84:0/1476980661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 msgr2=0x55e2edd916b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79470f4b80 1 --2- 172.21.15.84:0/1476980661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd916b0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f79280094d0 tx=0x7f7928031040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79470f4b80 1 -- 172.21.15.84:0/1476980661 shutdown_connections 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79470f4b80 1 --2- 172.21.15.84:0/1476980661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 0x55e2edd1adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79470f4b80 1 --2- 172.21.15.84:0/1476980661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd916b0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79470f4b80 1 --2- 172.21.15.84:0/1476980661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd1a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79470f4b80 1 -- 172.21.15.84:0/1476980661 >> 172.21.15.84:0/1476980661 conn(0x55e2edcf01b0 msgr2=0x55e2edceba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79470f4b80 1 -- 172.21.15.84:0/1476980661 shutdown_connections 2023-10-06T03:02:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.480+0000 7f79470f4b80 1 -- 172.21.15.84:0/1476980661 wait complete. 2023-10-06T03:02:16.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.481+0000 7f79470f4b80 1 -- start start 2023-10-06T03:02:16.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.481+0000 7f79470f4b80 1 Processor -- start 2023-10-06T03:02:16.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd327f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd8e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 0x55e2edd16b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2edd4f7d0 con 0x55e2edcee890 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2edd17550 con 0x55e2edcefd10 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e2edd4f340 con 0x55e2edd3ec50 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 10 client.0 _ll_register_callbacks cb 0x55e2edcb1ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79377fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd327f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39364/0 (socket says 172.21.15.84:39364) 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79377fe700 1 -- 172.21.15.84:0/3692657200 learned_addr learned my addr 172.21.15.84:0/3692657200 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f7937fff700 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 0x55e2edd16b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f7936ffd700 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd8e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79377fe700 1 -- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 msgr2=0x55e2edd16b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79377fe700 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 0x55e2edd16b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79377fe700 1 -- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 msgr2=0x55e2edd8e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79377fe700 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd8e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79377fe700 1 -- 172.21.15.84:0/3692657200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792805a040 con 0x55e2edcee890 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79377fe700 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd327f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f7928057070 tx=0x7f7928070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efce1fc3cbe9e76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f7915ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f7915ffb700 1 -- 172.21.15.84:0/3692657200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800e070 con 0x55e2edcee890 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f7915ffb700 1 -- 172.21.15.84:0/3692657200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7928071030 con 0x55e2edcee890 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 1 -- 172.21.15.84:0/3692657200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f793000c7f0 con 0x55e2edcee890 2023-10-06T03:02:16.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f7915ffb700 1 -- 172.21.15.84:0/3692657200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7928084280 con 0x55e2edcee890 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 10 client.9105 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.482+0000 7f79470f4b80 1 -- 172.21.15.84:0/3692657200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55e2edbf44c0 con 0x55e2edcee890 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f7915ffb700 1 -- 172.21.15.84:0/3692657200 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793000c7f0 con 0x55e2edcee890 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f7915ffb700 1 -- 172.21.15.84:0/3692657200 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f7928057340 con 0x55e2edcee890 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f79470f4b80 10 client.9105 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f79470f4b80 10 client.9105 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f79470f4b80 20 client.9105 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f79470f4b80 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55e2edd9daf0 0x55e2edd9dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f79470f4b80 4 client.9105 mds_command: new command op to 6782 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f79470f4b80 1 -- 172.21.15.84:0/3692657200 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e2edbe1e50 con 0x55e2edd9daf0 2023-10-06T03:02:16.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f7936ffd700 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55e2edd9daf0 0x55e2edd9dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f7915ffb700 10 client.9105 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f7936ffd700 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55e2edd9daf0 0x55e2edd9dec0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f242560179336b91 server_cookie=64f3ffed8a8032f3 in_seq=0 out_seq=0 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f7915ffb700 1 -- 172.21.15.84:0/3692657200 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55e2edbe1e50 con 0x55e2edd9daf0 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f7915ffb700 10 client.9105 handle_command_reply: tid=0 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.483+0000 7f79470f4b80 1 client.9105 shutdown 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 -- 172.21.15.84:0/3692657200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 msgr2=0x55e2edd327f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd327f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f7928057070 tx=0x7f7928070000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 -- 172.21.15.84:0/3692657200 shutdown_connections 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x55e2edd9daf0 0x55e2edd9dec0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55e2edd3ec50 0x55e2edd16b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f7915ffb700 0 client.9105 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e2edcee890 0x55e2edd327f0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 --2- 172.21.15.84:0/3692657200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2edcefd10 0x55e2edd8e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 -- 172.21.15.84:0/3692657200 >> 172.21.15.84:0/3692657200 conn(0x55e2edcf01b0 msgr2=0x55e2edceba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 -- 172.21.15.84:0/3692657200 shutdown_connections 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 1 -- 172.21.15.84:0/3692657200 wait complete. 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f79470f4b80 20 client.9105 trim_cache size 0 max 16384 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:16.492 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:16.493 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:16.493 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:16.493 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:16.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:16.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:16.493 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 -- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7924066f30 msgr2=0x7f79240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7924066f30 0x7f79240693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f79380ca5c0 tx=0x7f792c009040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 -- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 msgr2=0x7f7938158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 0x7f7938158420 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f792800b6c0 tx=0x7f7928017000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 -- 172.21.15.84:0/3924613395 shutdown_connections 2023-10-06T03:02:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7924066f30 0x7f79240693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79380cb980 0x7f793815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79380b2a90 0x7f7938158420 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 --2- 172.21.15.84:0/3924613395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79380c6610 0x7f793815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 -- 172.21.15.84:0/3924613395 >> 172.21.15.84:0/3924613395 conn(0x7f7938099740 msgr2=0x7f7938069930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 -- 172.21.15.84:0/3924613395 shutdown_connections 2023-10-06T03:02:16.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.484+0000 7f793ddfc700 1 -- 172.21.15.84:0/3924613395 wait complete. 2023-10-06T03:02:16.496 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:16.496 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-10-06T03:02:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.611+0000 7ff010635700 1 Processor -- start 2023-10-06T03:02:16.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.611+0000 7ff010635700 1 -- start start 2023-10-06T03:02:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff010635700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff00806d650 0x7ff0080c6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff010635700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0080ae0a0 0x7ff008069540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff010635700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0080c7080 con 0x7ff008157c30 2023-10-06T03:02:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff010635700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0080c7360 con 0x7ff0080ae0a0 2023-10-06T03:02:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff010635700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c7640 con 0x7ff00806d650 2023-10-06T03:02:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00ebd2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0080ae0a0 0x7ff008069540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00ebd2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0080ae0a0 0x7ff008069540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39376/0 (socket says 172.21.15.84:39376) 2023-10-06T03:02:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00ebd2700 1 -- 172.21.15.84:0/862924543 learned_addr learned my addr 172.21.15.84:0/862924543 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/862924543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff00806d650 0x7ff0080c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00ebd2700 1 -- 172.21.15.84:0/862924543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff00806d650 msgr2=0x7ff0080c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/862924543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff00806d650 0x7ff0080c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00ebd2700 1 -- 172.21.15.84:0/862924543 >> v1:172.21.15.131:6789/0 conn(0x7ff008157c30 legacy=0x7ff0080ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00ebd2700 1 -- 172.21.15.84:0/862924543 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080c7920 con 0x7ff0080ae0a0 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/862924543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff00806d650 0x7ff0080c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.612+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/862924543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0080ae0a0 0x7ff008069540 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7ff000009f20 tx=0x7ff000009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cabdcb09b9d71c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff00d3cf700 1 -- 172.21.15.84:0/862924543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000e070 con 0x7ff0080ae0a0 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff00d3cf700 1 -- 172.21.15.84:0/862924543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00000ba80 con 0x7ff0080ae0a0 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff00d3cf700 1 -- 172.21.15.84:0/862924543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000092e0 con 0x7ff0080ae0a0 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff010635700 1 -- 172.21.15.84:0/862924543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0080ae0a0 msgr2=0x7ff008069540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff010635700 1 --2- 172.21.15.84:0/862924543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0080ae0a0 0x7ff008069540 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7ff000009f20 tx=0x7ff000009840 comp rx=0 tx=0).stop 2023-10-06T03:02:16.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff010635700 1 -- 172.21.15.84:0/862924543 shutdown_connections 2023-10-06T03:02:16.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff010635700 1 --2- 172.21.15.84:0/862924543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0080ae0a0 0x7ff008069540 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff010635700 1 --2- 172.21.15.84:0/862924543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff00806d650 0x7ff0080c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff010635700 1 -- 172.21.15.84:0/862924543 >> 172.21.15.84:0/862924543 conn(0x7ff0080cc0d0 msgr2=0x7ff0080cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff010635700 1 -- 172.21.15.84:0/862924543 shutdown_connections 2023-10-06T03:02:16.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.613+0000 7ff010635700 1 -- 172.21.15.84:0/862924543 wait complete. 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.614+0000 7ff010635700 1 Processor -- start 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.614+0000 7ff010635700 1 -- start start 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff010635700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00806d650 0x7ff008156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff010635700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0080ae0a0 0x7ff00813aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff010635700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff008157c30 0x7ff00813af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff010635700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff008140ce0 con 0x7ff008157c30 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff010635700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff008156ad0 con 0x7ff00806d650 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff010635700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080b17f0 con 0x7ff0080ae0a0 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff00ebd2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff008157c30 0x7ff00813af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff00ebd2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff008157c30 0x7ff00813af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39382/0 (socket says 172.21.15.84:39382) 2023-10-06T03:02:16.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff00ebd2700 1 -- 172.21.15.84:0/3790399469 learned_addr learned my addr 172.21.15.84:0/3790399469 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00806d650 0x7ff008156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.615+0000 7ff00dbd0700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0080ae0a0 0x7ff00813aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7ff00ebd2700 1 -- 172.21.15.84:0/3790399469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0080ae0a0 msgr2=0x7ff00813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0080ae0a0 0x7ff00813aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7ff00ebd2700 1 -- 172.21.15.84:0/3790399469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00806d650 msgr2=0x7ff008156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00806d650 0x7ff008156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7ff00ebd2700 1 -- 172.21.15.84:0/3790399469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000009ae0 con 0x7ff008157c30 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7ff00dbd0700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0080ae0a0 0x7ff00813aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff008157c30 0x7ff00813af50 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7ff0080650e0 tx=0x7ff000018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7feffe7fc700 1 -- 172.21.15.84:0/3790399469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000032f0 con 0x7ff008157c30 2023-10-06T03:02:16.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7feffe7fc700 1 -- 172.21.15.84:0/3790399469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000008dd0 con 0x7ff008157c30 2023-10-06T03:02:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7ff010635700 1 -- 172.21.15.84:0/3790399469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0080b0f50 con 0x7ff008157c30 2023-10-06T03:02:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7feffe7fc700 1 -- 172.21.15.84:0/3790399469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000026690 con 0x7ff008157c30 2023-10-06T03:02:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.616+0000 7ff010635700 1 -- 172.21.15.84:0/3790399469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0080b1510 con 0x7ff008157c30 2023-10-06T03:02:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.617+0000 7feffe7fc700 1 -- 172.21.15.84:0/3790399469 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff000003040 con 0x7ff008157c30 2023-10-06T03:02:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.618+0000 7feffe7fc700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefec066f30 0x7fefec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.618+0000 7feffe7fc700 1 -- 172.21.15.84:0/3790399469 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff0000866f0 con 0x7ff008157c30 2023-10-06T03:02:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.618+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefec066f30 0x7fefec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.618+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefec066f30 0x7fefec0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff004006f00 tx=0x7ff004008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.620+0000 7ff01992db80 1 Processor -- start 2023-10-06T03:02:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.620+0000 7ff01992db80 1 -- start start 2023-10-06T03:02:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.620+0000 7ff01992db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c22c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.620+0000 7ff01992db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c72710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.620+0000 7ff01992db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 0x562533c730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.620+0000 7ff01992db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562533b79ac0 con 0x562533c22890 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.620+0000 7ff01992db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562533b772c0 con 0x562533c72c50 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.620+0000 7ff01992db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562533b730b0 con 0x562533c23d10 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.620+0000 7ff00e3d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c22c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00e3d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c22c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39394/0 (socket says 172.21.15.84:39394) 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00e3d1700 1 -- 172.21.15.84:0/1180873389 learned_addr learned my addr 172.21.15.84:0/1180873389 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00dbd0700 1 --2- 172.21.15.84:0/1180873389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c72710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00e3d1700 1 -- 172.21.15.84:0/1180873389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 msgr2=0x562533c72710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/1180873389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c72710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/1180873389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 0x562533c730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00e3d1700 1 -- 172.21.15.84:0/1180873389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 msgr2=0x562533c730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/1180873389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 0x562533c730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00e3d1700 1 -- 172.21.15.84:0/1180873389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562533a0d2c0 con 0x562533c22890 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/1180873389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c22c60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7ff004011b60 tx=0x7ff004018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d21231c008d3247 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7fefeb7fe700 1 -- 172.21.15.84:0/1180873389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0040159a0 con 0x562533c22890 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7fefeb7fe700 1 -- 172.21.15.84:0/1180873389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff004015b00 con 0x562533c22890 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.621+0000 7fefeb7fe700 1 -- 172.21.15.84:0/1180873389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff004015c70 con 0x562533c22890 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 -- 172.21.15.84:0/1180873389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 msgr2=0x562533c22c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 --2- 172.21.15.84:0/1180873389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c22c60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7ff004011b60 tx=0x7ff004018000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 -- 172.21.15.84:0/1180873389 shutdown_connections 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 --2- 172.21.15.84:0/1180873389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 0x562533c730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 --2- 172.21.15.84:0/1180873389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c22c60 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 --2- 172.21.15.84:0/1180873389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c72710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 -- 172.21.15.84:0/1180873389 >> 172.21.15.84:0/1180873389 conn(0x562533c241b0 msgr2=0x562533c24580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 -- 172.21.15.84:0/1180873389 shutdown_connections 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 -- 172.21.15.84:0/1180873389 wait complete. 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 -- start start 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.622+0000 7ff01992db80 1 Processor -- start 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff01992db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c22890 0x562533c623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff01992db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c6b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff01992db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c6bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff01992db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562533b1e8e0 con 0x562533c72c50 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff01992db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562533b39ef0 con 0x562533c22890 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff01992db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625339f5e80 con 0x562533c23d10 2023-10-06T03:02:16.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff01992db80 10 client.0 _ll_register_callbacks cb 0x562533be5ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff00ebd2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c6bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff00ebd2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c6bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39408/0 (socket says 172.21.15.84:39408) 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.623+0000 7ff00ebd2700 1 -- 172.21.15.84:0/4270080743 learned_addr learned my addr 172.21.15.84:0/4270080743 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff00dbd0700 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c6b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c22890 0x562533c623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff00ebd2700 1 -- 172.21.15.84:0/4270080743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 msgr2=0x562533c6b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c6b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff00ebd2700 1 -- 172.21.15.84:0/4270080743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c22890 msgr2=0x562533c623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c22890 0x562533c623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff00ebd2700 1 -- 172.21.15.84:0/4270080743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00400e040 con 0x562533c72c50 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c6bac0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff000057040 tx=0x7ff000084890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90535964ded8e5c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7fefe8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7fefe8ff9700 1 -- 172.21.15.84:0/4270080743 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000e040 con 0x562533c72c50 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7fefe8ff9700 1 -- 172.21.15.84:0/4270080743 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff00005a590 con 0x562533c72c50 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff01992db80 1 -- 172.21.15.84:0/4270080743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562533c17990 con 0x562533c72c50 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7fefe8ff9700 1 -- 172.21.15.84:0/4270080743 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff000008f40 con 0x562533c72c50 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff01992db80 10 client.9117 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff01992db80 1 -- 172.21.15.84:0/4270080743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x5625339b0030 con 0x562533c72c50 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7fefe8ff9700 1 -- 172.21.15.84:0/4270080743 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562533c17990 con 0x562533c72c50 2023-10-06T03:02:16.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7fefe8ff9700 1 -- 172.21.15.84:0/4270080743 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7ff000056830 con 0x562533c72c50 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff01992db80 10 client.9117 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff01992db80 10 client.9117 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff01992db80 20 client.9117 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff01992db80 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x562533c69d70 0x562533c6a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff01992db80 4 client.9117 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff01992db80 1 -- 172.21.15.84:0/4270080743 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562533bf48c0 con 0x562533c69d70 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.624+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x562533c69d70 0x562533c6a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7fefe8ff9700 10 client.9117 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x562533c69d70 0x562533c6a170 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61f235ecc19d4893 server_cookie=960ce9c77b5f0fa0 in_seq=0 out_seq=0 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7fefe8ff9700 1 -- 172.21.15.84:0/4270080743 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562533bf48c0 con 0x562533c69d70 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7fefe8ff9700 10 client.9117 handle_command_reply: tid=0 2023-10-06T03:02:16.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff01992db80 1 client.9117 shutdown 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff01992db80 1 -- 172.21.15.84:0/4270080743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 msgr2=0x562533c6bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff01992db80 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c6bac0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff000057040 tx=0x7ff000084890 comp rx=0 tx=0).stop 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff01992db80 1 -- 172.21.15.84:0/4270080743 shutdown_connections 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff01992db80 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x562533c69d70 0x562533c6a170 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff01992db80 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c22890 0x562533c623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff01992db80 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c6bac0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7fefe8ff9700 0 client.9117 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff01992db80 1 --2- 172.21.15.84:0/4270080743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c6b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.625+0000 7ff01992db80 1 -- 172.21.15.84:0/4270080743 >> 172.21.15.84:0/4270080743 conn(0x562533c241b0 msgr2=0x562533c23200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.626+0000 7ff01992db80 1 -- 172.21.15.84:0/4270080743 shutdown_connections 2023-10-06T03:02:16.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.626+0000 7ff01992db80 1 -- 172.21.15.84:0/4270080743 wait complete. 2023-10-06T03:02:16.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.626+0000 7ff01992db80 20 client.9117 trim_cache size 0 max 16384 2023-10-06T03:02:16.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.642+0000 7ff01992db80 1 Processor -- start 2023-10-06T03:02:16.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.642+0000 7ff01992db80 1 -- start start 2023-10-06T03:02:16.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.642+0000 7ff01992db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c22890 0x562533c7e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.642+0000 7ff01992db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c23d10 0x562533c621b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.642+0000 7ff01992db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c60ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.642+0000 7ff01992db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562533c66dd0 con 0x562533c72c50 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.642+0000 7ff01992db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562533c20d70 con 0x562533c23d10 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.642+0000 7ff01992db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562533c62e60 con 0x562533c22890 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00ebd2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c60ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00ebd2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c60ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39424/0 (socket says 172.21.15.84:39424) 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00ebd2700 1 -- 172.21.15.84:0/2956464858 learned_addr learned my addr 172.21.15.84:0/2956464858 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c22890 0x562533c7e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00dbd0700 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c23d10 0x562533c621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00ebd2700 1 -- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c22890 msgr2=0x562533c7e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c22890 0x562533c7e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00ebd2700 1 -- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c23d10 msgr2=0x562533c621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c23d10 0x562533c621b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00ebd2700 1 -- 172.21.15.84:0/2956464858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562533b417d0 con 0x562533c72c50 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c22890 0x562533c7e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00dbd0700 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c23d10 0x562533c621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c60ef0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7ff000053d60 tx=0x7ff000080000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214dccc9f048f434 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7fefebfff700 1 -- 172.21.15.84:0/2956464858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000e070 con 0x562533c72c50 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7fefebfff700 1 -- 172.21.15.84:0/2956464858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000008f40 con 0x562533c72c50 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.643+0000 7fefebfff700 1 -- 172.21.15.84:0/2956464858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00005a590 con 0x562533c72c50 2023-10-06T03:02:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 -- 172.21.15.84:0/2956464858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 msgr2=0x562533c60ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c60ef0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7ff000053d60 tx=0x7ff000080000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 -- 172.21.15.84:0/2956464858 shutdown_connections 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c72c50 0x562533c60ef0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c22890 0x562533c7e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 --2- 172.21.15.84:0/2956464858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c23d10 0x562533c621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 -- 172.21.15.84:0/2956464858 >> 172.21.15.84:0/2956464858 conn(0x562533c241b0 msgr2=0x562533c23200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 -- 172.21.15.84:0/2956464858 shutdown_connections 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 -- 172.21.15.84:0/2956464858 wait complete. 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 -- start start 2023-10-06T03:02:16.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.644+0000 7ff01992db80 1 Processor -- start 2023-10-06T03:02:16.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff01992db80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c4a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff01992db80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c6da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff01992db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 0x562533c7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff01992db80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562533c6df80 con 0x562533c22890 2023-10-06T03:02:16.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff01992db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562533c7c2b0 con 0x562533c72c50 2023-10-06T03:02:16.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff01992db80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x562533c4ae00 con 0x562533c23d10 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff01992db80 10 client.0 _ll_register_callbacks cb 0x562533be5ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00e3d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c4a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00e3d1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c4a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39432/0 (socket says 172.21.15.84:39432) 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00e3d1700 1 -- 172.21.15.84:0/1213246386 learned_addr learned my addr 172.21.15.84:0/1213246386 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00ebd2700 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 0x562533c7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00dbd0700 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c6da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00e3d1700 1 -- 172.21.15.84:0/1213246386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 msgr2=0x562533c6da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c6da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00e3d1700 1 -- 172.21.15.84:0/1213246386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 msgr2=0x562533c7b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 0x562533c7b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.645+0000 7ff00e3d1700 1 -- 172.21.15.84:0/1213246386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625339b0030 con 0x562533c22890 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff00e3d1700 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c4a800 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7ff004011920 tx=0x7ff00402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8433e344444dd0ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7fefe8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7fefe8ff9700 1 -- 172.21.15.84:0/1213246386 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff004030040 con 0x562533c22890 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7fefe8ff9700 1 -- 172.21.15.84:0/1213246386 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7ff004015d40 con 0x562533c22890 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff01992db80 1 -- 172.21.15.84:0/1213246386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff004015b00 con 0x562533c22890 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7fefe8ff9700 1 -- 172.21.15.84:0/1213246386 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff004034250 con 0x562533c22890 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff01992db80 10 client.9123 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff01992db80 1 -- 172.21.15.84:0/1213246386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x562533b284c0 con 0x562533c22890 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7fefe8ff9700 1 -- 172.21.15.84:0/1213246386 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff004015b00 con 0x562533c22890 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7fefe8ff9700 1 -- 172.21.15.84:0/1213246386 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7ff004005c10 con 0x562533c22890 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff01992db80 10 client.9123 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:16.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff01992db80 10 client.9123 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff01992db80 20 client.9123 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff01992db80 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x562533c7bbe0 0x562533c60da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff01992db80 4 client.9123 mds_command: new command op to 8529 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff01992db80 1 -- 172.21.15.84:0/1213246386 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562533b15e50 con 0x562533c7bbe0 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.646+0000 7ff00dbd0700 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x562533c7bbe0 0x562533c60da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7fefe8ff9700 10 client.9123 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff00dbd0700 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x562533c7bbe0 0x562533c60da0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bcb21257ab030b0 server_cookie=8f84917d52c7a589 in_seq=0 out_seq=0 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7fefe8ff9700 1 -- 172.21.15.84:0/1213246386 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x562533b15e50 con 0x562533c7bbe0 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7fefe8ff9700 10 client.9123 handle_command_reply: tid=0 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 client.9123 shutdown 2023-10-06T03:02:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 -- 172.21.15.84:0/1213246386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 msgr2=0x562533c4a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c4a800 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7ff004011920 tx=0x7ff00402c040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 -- 172.21.15.84:0/1213246386 shutdown_connections 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x562533c7bbe0 0x562533c60da0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562533c72c50 0x562533c7b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562533c22890 0x562533c4a800 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 --2- 172.21.15.84:0/1213246386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562533c23d10 0x562533c6da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7fefe8ff9700 0 client.9123 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 -- 172.21.15.84:0/1213246386 >> 172.21.15.84:0/1213246386 conn(0x562533c241b0 msgr2=0x562533c24580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 -- 172.21.15.84:0/1213246386 shutdown_connections 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 1 -- 172.21.15.84:0/1213246386 wait complete. 2023-10-06T03:02:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.647+0000 7ff01992db80 20 client.9123 trim_cache size 0 max 16384 2023-10-06T03:02:16.656 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:16.656 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T03:02:16.656 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:16.656 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:16.656 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:16.656 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:16.656 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:16.656 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:16.656 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:16.657 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 -- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefec066f30 msgr2=0x7fefec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefec066f30 0x7fefec0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff004006f00 tx=0x7ff004008040 comp rx=0 tx=0).stop 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 -- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff008157c30 msgr2=0x7ff00813af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff008157c30 0x7ff00813af50 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7ff0080650e0 tx=0x7ff000018000 comp rx=0 tx=0).stop 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 -- 172.21.15.84:0/3790399469 shutdown_connections 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fefec066f30 0x7fefec0693e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00806d650 0x7ff008156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff008157c30 0x7ff00813af50 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 --2- 172.21.15.84:0/3790399469 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0080ae0a0 0x7ff00813aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 -- 172.21.15.84:0/3790399469 >> 172.21.15.84:0/3790399469 conn(0x7ff0080cc0d0 msgr2=0x7ff008158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 -- 172.21.15.84:0/3790399469 shutdown_connections 2023-10-06T03:02:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.648+0000 7ff010635700 1 -- 172.21.15.84:0/3790399469 wait complete. 2023-10-06T03:02:16.660 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:16.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:16.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.773+0000 7f26c56df700 1 Processor -- start 2023-10-06T03:02:16.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.774+0000 7f26c56df700 1 -- start start 2023-10-06T03:02:16.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.774+0000 7f26c56df700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b49e0 0x7f26c00aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.774+0000 7f26c56df700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f26c00b07a0 0x7f26c00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.774+0000 7f26c56df700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c00b0ca0 con 0x7f26c01595a0 2023-10-06T03:02:16.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.774+0000 7f26c56df700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c00b0f80 con 0x7f26c00b07a0 2023-10-06T03:02:16.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.774+0000 7f26c56df700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00b1260 con 0x7f26c00b49e0 2023-10-06T03:02:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26b67fc700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b49e0 0x7f26c00aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26bf7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f26c00b07a0 0x7f26c00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26bf7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f26c00b07a0 0x7f26c00b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:39430/0 (socket says 172.21.15.84:39430) 2023-10-06T03:02:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26bf7fe700 1 -- 172.21.15.84:0/3566963348 learned_addr learned my addr 172.21.15.84:0/3566963348 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26beffd700 1 --1- 172.21.15.84:0/3566963348 >> v1:172.21.15.131:6789/0 conn(0x7f26c01595a0 0x7f26c00aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:46086/0 (socket says 172.21.15.84:46086) 2023-10-06T03:02:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26bf7fe700 1 -- 172.21.15.84:0/3566963348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b49e0 msgr2=0x7f26c00aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26bf7fe700 1 --2- 172.21.15.84:0/3566963348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b49e0 0x7f26c00aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26bf7fe700 1 -- 172.21.15.84:0/3566963348 >> v1:172.21.15.131:6789/0 conn(0x7f26c01595a0 legacy=0x7f26c00aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26be7fc700 1 -- 172.21.15.84:0/3566963348 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127548806 0 0) 0x7f26c00b0ca0 con 0x7f26c01595a0 2023-10-06T03:02:16.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26bf7fe700 1 -- 172.21.15.84:0/3566963348 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c00b1540 con 0x7f26c00b07a0 2023-10-06T03:02:16.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.775+0000 7f26bf7fe700 1 --2- 172.21.15.84:0/3566963348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c00b07a0 0x7f26c00b1c00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009f20 tx=0x7f26b8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d43f72d1d23d674 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26be7fc700 1 -- 172.21.15.84:0/3566963348 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800e070 con 0x7f26c00b07a0 2023-10-06T03:02:16.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26be7fc700 1 -- 172.21.15.84:0/3566963348 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b800b9d0 con 0x7f26c00b07a0 2023-10-06T03:02:16.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26be7fc700 1 -- 172.21.15.84:0/3566963348 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b80092e0 con 0x7f26c00b07a0 2023-10-06T03:02:16.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26c56df700 1 -- 172.21.15.84:0/3566963348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c00b07a0 msgr2=0x7f26c00b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26c56df700 1 --2- 172.21.15.84:0/3566963348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c00b07a0 0x7f26c00b1c00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009f20 tx=0x7f26b8009840 comp rx=0 tx=0).stop 2023-10-06T03:02:16.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26c56df700 1 -- 172.21.15.84:0/3566963348 shutdown_connections 2023-10-06T03:02:16.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26c56df700 1 --2- 172.21.15.84:0/3566963348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c00b07a0 0x7f26c00b1c00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26c56df700 1 --2- 172.21.15.84:0/3566963348 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b49e0 0x7f26c00aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26c56df700 1 -- 172.21.15.84:0/3566963348 >> 172.21.15.84:0/3566963348 conn(0x7f26c0099830 msgr2=0x7f26c006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:16.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26c56df700 1 -- 172.21.15.84:0/3566963348 shutdown_connections 2023-10-06T03:02:16.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.776+0000 7f26c56df700 1 -- 172.21.15.84:0/3566963348 wait complete. 2023-10-06T03:02:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.777+0000 7f26c56df700 1 Processor -- start 2023-10-06T03:02:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.777+0000 7f26c56df700 1 -- start start 2023-10-06T03:02:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26c56df700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b07a0 0x7f26c015b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26c56df700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c00b49e0 0x7f26c0158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26c56df700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c01595a0 0x7f26c015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26c56df700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00af1a0 con 0x7f26c00b49e0 2023-10-06T03:02:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26c56df700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c015a330 con 0x7f26c01595a0 2023-10-06T03:02:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26c56df700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c015ab70 con 0x7f26c00b07a0 2023-10-06T03:02:16.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26b67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c00b49e0 0x7f26c0158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26b67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c00b49e0 0x7f26c0158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39444/0 (socket says 172.21.15.84:39444) 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26b67fc700 1 -- 172.21.15.84:0/1316316554 learned_addr learned my addr 172.21.15.84:0/1316316554 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26beffd700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b07a0 0x7f26c015b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.778+0000 7f26bf7fe700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c01595a0 0x7f26c015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26b67fc700 1 -- 172.21.15.84:0/1316316554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b07a0 msgr2=0x7f26c015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26b67fc700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b07a0 0x7f26c015b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26b67fc700 1 -- 172.21.15.84:0/1316316554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c01595a0 msgr2=0x7f26c015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26b67fc700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c01595a0 0x7f26c015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26b67fc700 1 -- 172.21.15.84:0/1316316554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8009ae0 con 0x7f26c00b49e0 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26b67fc700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c00b49e0 0x7f26c0158af0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f26a800ecb0 tx=0x7f26a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26b77fe700 1 -- 172.21.15.84:0/1316316554 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a800c850 con 0x7f26c00b49e0 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26b77fe700 1 -- 172.21.15.84:0/1316316554 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a800c9b0 con 0x7f26c00b49e0 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c015d0c0 con 0x7f26c00b49e0 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26b77fe700 1 -- 172.21.15.84:0/1316316554 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a800cd50 con 0x7f26c00b49e0 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.779+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c015a520 con 0x7f26c00b49e0 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.780+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c015ad20 con 0x7f26c00b49e0 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.780+0000 7f26b77fe700 1 -- 172.21.15.84:0/1316316554 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26a8013680 con 0x7f26c00b49e0 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.781+0000 7f26b77fe700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26a0066f30 0x7f26a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.781+0000 7f26b77fe700 1 -- 172.21.15.84:0/1316316554 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f26a8084a70 con 0x7f26c00b49e0 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.781+0000 7f26beffd700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26a0066f30 0x7f26a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.781+0000 7f26beffd700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26a0066f30 0x7f26a00693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f26b0007fd0 tx=0x7f26b0007f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:16.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:16.785+0000 7f26b77fe700 1 -- 172.21.15.84:0/1316316554 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26c015ad20 con 0x7f26c00b49e0 2023-10-06T03:02:17.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.013+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26c015ace0 con 0x7f26c00b49e0 2023-10-06T03:02:17.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.013+0000 7f26b77fe700 1 -- 172.21.15.84:0/1316316554 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7f26a8021090 con 0x7f26c00b49e0 2023-10-06T03:02:17.014 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:17.014 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26a0066f30 msgr2=0x7f26a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26a0066f30 0x7f26a00693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f26b0007fd0 tx=0x7f26b0007f40 comp rx=0 tx=0).stop 2023-10-06T03:02:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c00b49e0 msgr2=0x7f26c0158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c00b49e0 0x7f26c0158af0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f26a800ecb0 tx=0x7f26a80091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 shutdown_connections 2023-10-06T03:02:17.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f26a0066f30 0x7f26a00693e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c01595a0 0x7f26c015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26c00b07a0 0x7f26c015b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 --2- 172.21.15.84:0/1316316554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26c00b49e0 0x7f26c0158af0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 >> 172.21.15.84:0/1316316554 conn(0x7f26c0099830 msgr2=0x7f26c00b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 shutdown_connections 2023-10-06T03:02:17.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.015+0000 7f26c56df700 1 -- 172.21.15.84:0/1316316554 wait complete. 2023-10-06T03:02:17.018 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:17.028 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:17.028 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:17.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.140+0000 7f0c1df04700 1 Processor -- start 2023-10-06T03:02:17.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.140+0000 7f0c1df04700 1 -- start start 2023-10-06T03:02:17.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.141+0000 7f0c1df04700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c181595a0 0x7f0c180aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.141+0000 7f0c1df04700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0c180b07a0 0x7f0c180b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.141+0000 7f0c1df04700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c180b0ca0 con 0x7f0c180b49e0 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.141+0000 7f0c1df04700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c180b0f80 con 0x7f0c181595a0 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.141+0000 7f0c1df04700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c180b1260 con 0x7f0c180b07a0 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.141+0000 7f0c177fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c181595a0 0x7f0c180aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.141+0000 7f0c177fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c181595a0 0x7f0c180aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39460/0 (socket says 172.21.15.84:39460) 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.141+0000 7f0c177fe700 1 -- 172.21.15.84:0/2557540417 learned_addr learned my addr 172.21.15.84:0/2557540417 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.141+0000 7f0c17fff700 1 --2- 172.21.15.84:0/2557540417 >> v2:172.21.15.131:3300/0 conn(0x7f0c180b07a0 0x7f0c180b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c177fe700 1 -- 172.21.15.84:0/2557540417 >> v2:172.21.15.131:3300/0 conn(0x7f0c180b07a0 msgr2=0x7f0c180b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c177fe700 1 --2- 172.21.15.84:0/2557540417 >> v2:172.21.15.131:3300/0 conn(0x7f0c180b07a0 0x7f0c180b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c177fe700 1 -- 172.21.15.84:0/2557540417 >> v1:172.21.15.131:6789/0 conn(0x7f0c180b49e0 legacy=0x7f0c180aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c177fe700 1 -- 172.21.15.84:0/2557540417 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180b1540 con 0x7f0c181595a0 2023-10-06T03:02:17.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c17fff700 1 --2- 172.21.15.84:0/2557540417 >> v2:172.21.15.131:3300/0 conn(0x7f0c180b07a0 0x7f0c180b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c177fe700 1 --2- 172.21.15.84:0/2557540417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c181595a0 0x7f0c180aa570 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009f70 tx=0x7f0c08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40afb6ed9d67b21a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c167fc700 1 -- 172.21.15.84:0/2557540417 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0800e070 con 0x7f0c181595a0 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c167fc700 1 -- 172.21.15.84:0/2557540417 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0800ba90 con 0x7f0c181595a0 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c167fc700 1 -- 172.21.15.84:0/2557540417 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080092e0 con 0x7f0c181595a0 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c1df04700 1 -- 172.21.15.84:0/2557540417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c181595a0 msgr2=0x7f0c180aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c1df04700 1 --2- 172.21.15.84:0/2557540417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c181595a0 0x7f0c180aa570 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009f70 tx=0x7f0c08009840 comp rx=0 tx=0).stop 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c1df04700 1 -- 172.21.15.84:0/2557540417 shutdown_connections 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c1df04700 1 --2- 172.21.15.84:0/2557540417 >> v2:172.21.15.131:3300/0 conn(0x7f0c180b07a0 0x7f0c180b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c1df04700 1 --2- 172.21.15.84:0/2557540417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c181595a0 0x7f0c180aa570 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c1df04700 1 -- 172.21.15.84:0/2557540417 >> 172.21.15.84:0/2557540417 conn(0x7f0c18099830 msgr2=0x7f0c1806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c1df04700 1 -- 172.21.15.84:0/2557540417 shutdown_connections 2023-10-06T03:02:17.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.142+0000 7f0c1df04700 1 -- 172.21.15.84:0/2557540417 wait complete. 2023-10-06T03:02:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c1df04700 1 Processor -- start 2023-10-06T03:02:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c1df04700 1 -- start start 2023-10-06T03:02:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c1df04700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c180b07a0 0x7f0c1809dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c1df04700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180b49e0 0x7f0c1809cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c1df04700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c181595a0 0x7f0c18157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c1df04700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180ae9c0 con 0x7f0c180b49e0 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c1df04700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1809d490 con 0x7f0c181595a0 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c1df04700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1809d730 con 0x7f0c180b07a0 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c16ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180b49e0 0x7f0c1809cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c16ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180b49e0 0x7f0c1809cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39474/0 (socket says 172.21.15.84:39474) 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.144+0000 7f0c16ffd700 1 -- 172.21.15.84:0/1127144130 learned_addr learned my addr 172.21.15.84:0/1127144130 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c17fff700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c181595a0 0x7f0c18157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c177fe700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c180b07a0 0x7f0c1809dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c16ffd700 1 -- 172.21.15.84:0/1127144130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c180b07a0 msgr2=0x7f0c1809dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c16ffd700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c180b07a0 0x7f0c1809dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c16ffd700 1 -- 172.21.15.84:0/1127144130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c181595a0 msgr2=0x7f0c18157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c16ffd700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c181595a0 0x7f0c18157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c16ffd700 1 -- 172.21.15.84:0/1127144130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c08009ae0 con 0x7f0c180b49e0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c16ffd700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180b49e0 0x7f0c1809cf50 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00c790 tx=0x7f0c0c007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0bff7fe700 1 -- 172.21.15.84:0/1127144130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011590 con 0x7f0c180b49e0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0bff7fe700 1 -- 172.21.15.84:0/1127144130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c011710 con 0x7f0c180b49e0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0bff7fe700 1 -- 172.21.15.84:0/1127144130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011ad0 con 0x7f0c180b49e0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c180ae370 con 0x7f0c180b49e0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.145+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c180ae040 con 0x7f0c180b49e0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.146+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c180aeb70 con 0x7f0c180b49e0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.146+0000 7f0bff7fe700 1 -- 172.21.15.84:0/1127144130 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c0c01b3b0 con 0x7f0c180b49e0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.147+0000 7f0bff7fe700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0c04066f30 0x7f0c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.147+0000 7f0bff7fe700 1 -- 172.21.15.84:0/1127144130 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f0c0c083b80 con 0x7f0c180b49e0 2023-10-06T03:02:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.147+0000 7f0c177fe700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0c04066f30 0x7f0c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.147+0000 7f0c177fe700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0c04066f30 0x7f0c040693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009880 tx=0x7f0c08018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.151+0000 7f0bff7fe700 1 -- 172.21.15.84:0/1127144130 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c180aeb70 con 0x7f0c180b49e0 2023-10-06T03:02:17.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.410+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0c180cc480 con 0x7f0c180b49e0 2023-10-06T03:02:17.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.411+0000 7f0bff7fe700 1 -- 172.21.15.84:0/1127144130 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1931 (secure 0 0 0) 0x7f0c0c017020 con 0x7f0c180b49e0 2023-10-06T03:02:17.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:17.412 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":455,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":698974,"bytes_used":2451828736,"bytes_avail":770642284544,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6654,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":111,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-10-06T03:02:13.895012+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0c04066f30 msgr2=0x7f0c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0c04066f30 0x7f0c040693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009880 tx=0x7f0c08018000 comp rx=0 tx=0).stop 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180b49e0 msgr2=0x7f0c1809cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180b49e0 0x7f0c1809cf50 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00c790 tx=0x7f0c0c007f20 comp rx=0 tx=0).stop 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 shutdown_connections 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0c04066f30 0x7f0c040693e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c181595a0 0x7f0c18157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0c180b07a0 0x7f0c1809dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 --2- 172.21.15.84:0/1127144130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180b49e0 0x7f0c1809cf50 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 >> 172.21.15.84:0/1127144130 conn(0x7f0c18099830 msgr2=0x7f0c180cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 shutdown_connections 2023-10-06T03:02:17.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.413+0000 7f0c1df04700 1 -- 172.21.15.84:0/1127144130 wait complete. 2023-10-06T03:02:17.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]'} 2023-10-06T03:02:17.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub resume 2023-10-06T03:02:17.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.540+0000 7fa38cd90700 1 Processor -- start 2023-10-06T03:02:17.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.540+0000 7fa38cd90700 1 -- start start 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa38cd90700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3880cbb50 0x7fa3880ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa38cd90700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880c6610 0x7fa3880ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa38cd90700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3880b2e60 con 0x7fa3880b2a90 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa38cd90700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3880cf5d0 con 0x7fa3880cbb50 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa38cd90700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3880cf8b0 con 0x7fa3880c6610 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa37dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3880cbb50 0x7fa3880ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa37dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3880cbb50 0x7fa3880ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39478/0 (socket says 172.21.15.84:39478) 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa37dd9b700 1 -- 172.21.15.84:0/2196615515 learned_addr learned my addr 172.21.15.84:0/2196615515 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa386d9d700 1 --2- 172.21.15.84:0/2196615515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880c6610 0x7fa3880ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa37dd9b700 1 -- 172.21.15.84:0/2196615515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880c6610 msgr2=0x7fa3880ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/2196615515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880c6610 0x7fa3880ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa37dd9b700 1 -- 172.21.15.84:0/2196615515 >> v1:172.21.15.131:6789/0 conn(0x7fa3880b2a90 legacy=0x7fa3880cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa37dd9b700 1 -- 172.21.15.84:0/2196615515 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3880cfb90 con 0x7fa3880cbb50 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.541+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/2196615515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880cbb50 0x7fa3880ce850 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fa3700099b0 tx=0x7fa370009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfb2759afbfe234 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa385d9b700 1 -- 172.21.15.84:0/2196615515 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000b860 con 0x7fa3880cbb50 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa385d9b700 1 -- 172.21.15.84:0/2196615515 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000b9c0 con 0x7fa3880cbb50 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa385d9b700 1 -- 172.21.15.84:0/2196615515 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000bd60 con 0x7fa3880cbb50 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa38cd90700 1 -- 172.21.15.84:0/2196615515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880cbb50 msgr2=0x7fa3880ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa38cd90700 1 --2- 172.21.15.84:0/2196615515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880cbb50 0x7fa3880ce850 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fa3700099b0 tx=0x7fa370009250 comp rx=0 tx=0).stop 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa38cd90700 1 -- 172.21.15.84:0/2196615515 shutdown_connections 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa38cd90700 1 --2- 172.21.15.84:0/2196615515 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880c6610 0x7fa3880ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa38cd90700 1 --2- 172.21.15.84:0/2196615515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880cbb50 0x7fa3880ce850 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa38cd90700 1 -- 172.21.15.84:0/2196615515 >> 172.21.15.84:0/2196615515 conn(0x7fa388099740 msgr2=0x7fa38806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa38cd90700 1 -- 172.21.15.84:0/2196615515 shutdown_connections 2023-10-06T03:02:17.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.542+0000 7fa38cd90700 1 -- 172.21.15.84:0/2196615515 wait complete. 2023-10-06T03:02:17.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.543+0000 7fa38cd90700 1 Processor -- start 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.543+0000 7fa38cd90700 1 -- start start 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa38cd90700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880b2a90 0x7fa388158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa38cd90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880c6610 0x7fa38815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa38cd90700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880cbb50 0x7fa38815e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa38cd90700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3880c9970 con 0x7fa3880c6610 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa38cd90700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3880c8d60 con 0x7fa3880b2a90 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa38cd90700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3880c9040 con 0x7fa3880cbb50 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa37dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880c6610 0x7fa38815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa37dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880c6610 0x7fa38815d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39490/0 (socket says 172.21.15.84:39490) 2023-10-06T03:02:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa37dd9b700 1 -- 172.21.15.84:0/942687779 learned_addr learned my addr 172.21.15.84:0/942687779 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa386d9d700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880cbb50 0x7fa38815e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa38659c700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880b2a90 0x7fa388158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa37dd9b700 1 -- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880cbb50 msgr2=0x7fa38815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880cbb50 0x7fa38815e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa37dd9b700 1 -- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880b2a90 msgr2=0x7fa388158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880b2a90 0x7fa388158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa37dd9b700 1 -- 172.21.15.84:0/942687779 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700094f0 con 0x7fa3880c6610 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa386d9d700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880cbb50 0x7fa38815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.544+0000 7fa38659c700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880b2a90 0x7fa388158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:17.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.545+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880c6610 0x7fa38815d110 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fa388088fe0 tx=0x7fa370017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.545+0000 7fa37effd700 1 -- 172.21.15.84:0/942687779 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370024440 con 0x7fa3880c6610 2023-10-06T03:02:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.545+0000 7fa37effd700 1 -- 172.21.15.84:0/942687779 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3700245a0 con 0x7fa3880c6610 2023-10-06T03:02:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.545+0000 7fa38cd90700 1 -- 172.21.15.84:0/942687779 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3880c9320 con 0x7fa3880c6610 2023-10-06T03:02:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.545+0000 7fa37effd700 1 -- 172.21.15.84:0/942687779 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370024940 con 0x7fa3880c6610 2023-10-06T03:02:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.545+0000 7fa38cd90700 1 -- 172.21.15.84:0/942687779 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38815d650 con 0x7fa3880c6610 2023-10-06T03:02:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.546+0000 7fa37effd700 1 -- 172.21.15.84:0/942687779 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa37001a420 con 0x7fa3880c6610 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.547+0000 7fa37effd700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa368066f30 0x7fa3680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.547+0000 7fa37effd700 1 -- 172.21.15.84:0/942687779 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fa370086590 con 0x7fa3880c6610 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.547+0000 7fa38659c700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa368066f30 0x7fa3680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.547+0000 7fa38659c700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa368066f30 0x7fa3680693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa3780018f0 tx=0x7fa378009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.549+0000 7fa396088b80 1 Processor -- start 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.549+0000 7fa396088b80 1 -- start start 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa396088b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8186890 0x5582d8186c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa396088b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81d6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa396088b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 0x5582d81d70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa396088b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d80ddac0 con 0x5582d8187d10 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa396088b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d80db2c0 con 0x5582d81d6c50 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa396088b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582d80d70b0 con 0x5582d8186890 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa37dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81d6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa37dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81d6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39500/0 (socket says 172.21.15.84:39500) 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa37dd9b700 1 -- 172.21.15.84:0/3589391108 learned_addr learned my addr 172.21.15.84:0/3589391108 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa38659c700 1 --2- 172.21.15.84:0/3589391108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8186890 0x5582d8186c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa386d9d700 1 --2- 172.21.15.84:0/3589391108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 0x5582d81d70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa37dd9b700 1 -- 172.21.15.84:0/3589391108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8186890 msgr2=0x5582d8186c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/3589391108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8186890 0x5582d8186c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa37dd9b700 1 -- 172.21.15.84:0/3589391108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 msgr2=0x5582d81d70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/3589391108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 0x5582d81d70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa37dd9b700 1 -- 172.21.15.84:0/3589391108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582d7f712c0 con 0x5582d8187d10 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/3589391108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81d6710 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fa370084860 tx=0x7fa370084730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cb1d42deb2207c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa3677fe700 1 -- 172.21.15.84:0/3589391108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370057260 con 0x5582d8187d10 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa3677fe700 1 -- 172.21.15.84:0/3589391108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37005a4b0 con 0x5582d8187d10 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.550+0000 7fa3677fe700 1 -- 172.21.15.84:0/3589391108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37005e200 con 0x5582d8187d10 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.551+0000 7fa396088b80 1 -- 172.21.15.84:0/3589391108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 msgr2=0x5582d81d6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.551+0000 7fa396088b80 1 --2- 172.21.15.84:0/3589391108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81d6710 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fa370084860 tx=0x7fa370084730 comp rx=0 tx=0).stop 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.551+0000 7fa396088b80 1 -- 172.21.15.84:0/3589391108 shutdown_connections 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.551+0000 7fa396088b80 1 --2- 172.21.15.84:0/3589391108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 0x5582d81d70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.551+0000 7fa396088b80 1 --2- 172.21.15.84:0/3589391108 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8186890 0x5582d8186c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.551+0000 7fa396088b80 1 --2- 172.21.15.84:0/3589391108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81d6710 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.551+0000 7fa396088b80 1 -- 172.21.15.84:0/3589391108 >> 172.21.15.84:0/3589391108 conn(0x5582d81881b0 msgr2=0x5582d8188580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.551+0000 7fa396088b80 1 -- 172.21.15.84:0/3589391108 shutdown_connections 2023-10-06T03:02:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.551+0000 7fa396088b80 1 -- 172.21.15.84:0/3589391108 wait complete. 2023-10-06T03:02:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.552+0000 7fa396088b80 1 -- start start 2023-10-06T03:02:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.552+0000 7fa396088b80 1 Processor -- start 2023-10-06T03:02:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.552+0000 7fa396088b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8186890 0x5582d81af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.552+0000 7fa396088b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 0x5582d81cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.552+0000 7fa396088b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 0x5582d81d3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.552+0000 7fa396088b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d80828e0 con 0x5582d8186890 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.552+0000 7fa396088b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d809def0 con 0x5582d81d6c50 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.552+0000 7fa396088b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582d7f59e80 con 0x5582d8187d10 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa396088b80 10 client.0 _ll_register_callbacks cb 0x5582d8149ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa38659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8186890 0x5582d81af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa38659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8186890 0x5582d81af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39512/0 (socket says 172.21.15.84:39512) 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa38659c700 1 -- 172.21.15.84:0/1335533010 learned_addr learned my addr 172.21.15.84:0/1335533010 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa386d9d700 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 0x5582d81d3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 0x5582d81cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa38659c700 1 -- 172.21.15.84:0/1335533010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 msgr2=0x5582d81cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa38659c700 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 0x5582d81cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa38659c700 1 -- 172.21.15.84:0/1335533010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 msgr2=0x5582d81d3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa38659c700 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 0x5582d81d3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa38659c700 1 -- 172.21.15.84:0/1335533010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38815d650 con 0x5582d8186890 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 0x5582d81cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa38659c700 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8186890 0x5582d81af8e0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fa37800ef20 tx=0x7fa378017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9359d1918e37f53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa364ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa364ff9700 1 -- 172.21.15.84:0/1335533010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378015c60 con 0x5582d8186890 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa364ff9700 1 -- 172.21.15.84:0/1335533010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fa378023dd0 con 0x5582d8186890 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa396088b80 1 -- 172.21.15.84:0/1335533010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582d817b990 con 0x5582d8186890 2023-10-06T03:02:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa364ff9700 1 -- 172.21.15.84:0/1335533010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa378013420 con 0x5582d8186890 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa396088b80 10 client.9144 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa396088b80 1 -- 172.21.15.84:0/1335533010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x5582d7f14030 con 0x5582d8186890 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.553+0000 7fa364ff9700 1 -- 172.21.15.84:0/1335533010 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582d817b990 con 0x5582d8186890 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa364ff9700 1 -- 172.21.15.84:0/1335533010 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fa378013580 con 0x5582d8186890 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa396088b80 10 client.9144 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa396088b80 10 client.9144 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa396088b80 20 client.9144 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa396088b80 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5582d81d2370 0x5582d81c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa396088b80 4 client.9144 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa396088b80 1 -- 172.21.15.84:0/1335533010 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582d81588c0 con 0x5582d81d2370 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5582d81d2370 0x5582d81c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa364ff9700 10 client.9144 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5582d81d2370 0x5582d81c6e60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f227a94e4b1de6b8 server_cookie=c8ca60c99a0a7532 in_seq=0 out_seq=0 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa364ff9700 1 -- 172.21.15.84:0/1335533010 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5582d81588c0 con 0x5582d81d2370 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa364ff9700 10 client.9144 handle_command_reply: tid=0 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.554+0000 7fa396088b80 1 client.9144 shutdown 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 -- 172.21.15.84:0/1335533010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8186890 msgr2=0x5582d81af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8186890 0x5582d81af8e0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fa37800ef20 tx=0x7fa378017040 comp rx=0 tx=0).stop 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 -- 172.21.15.84:0/1335533010 shutdown_connections 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5582d81d2370 0x5582d81c6e60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d81d6c50 0x5582d81d3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8186890 0x5582d81af8e0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 --2- 172.21.15.84:0/1335533010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 0x5582d81cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa364ff9700 0 client.9144 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 -- 172.21.15.84:0/1335533010 >> 172.21.15.84:0/1335533010 conn(0x5582d81881b0 msgr2=0x5582d8187200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 -- 172.21.15.84:0/1335533010 shutdown_connections 2023-10-06T03:02:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 1 -- 172.21.15.84:0/1335533010 wait complete. 2023-10-06T03:02:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.555+0000 7fa396088b80 20 client.9144 trim_cache size 0 max 16384 2023-10-06T03:02:17.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.570+0000 7fa396088b80 1 Processor -- start 2023-10-06T03:02:17.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa396088b80 1 -- start start 2023-10-06T03:02:17.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa396088b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 0x5582d81ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa396088b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa396088b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d81d6c50 0x5582d81828d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa396088b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d81ca020 con 0x5582d8187d10 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa396088b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d81663d0 con 0x5582d8186890 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa396088b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582d81d0ca0 con 0x5582d81d6c50 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa37dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa37dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39518/0 (socket says 172.21.15.84:39518) 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.571+0000 7fa37dd9b700 1 -- 172.21.15.84:0/1170649018 learned_addr learned my addr 172.21.15.84:0/1170649018 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa386d9d700 1 --2- 172.21.15.84:0/1170649018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d81d6c50 0x5582d81828d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa38659c700 1 --2- 172.21.15.84:0/1170649018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 0x5582d81ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa37dd9b700 1 -- 172.21.15.84:0/1170649018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d81d6c50 msgr2=0x5582d81828d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/1170649018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d81d6c50 0x5582d81828d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa37dd9b700 1 -- 172.21.15.84:0/1170649018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 msgr2=0x5582d81ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/1170649018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 0x5582d81ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa37dd9b700 1 -- 172.21.15.84:0/1170649018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582d80a57d0 con 0x5582d8187d10 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/1170649018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81aed40 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fa370056f60 tx=0x7fa37001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122b766bfe29d382 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa367fff700 1 -- 172.21.15.84:0/1170649018 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37005e200 con 0x5582d8187d10 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa367fff700 1 -- 172.21.15.84:0/1170649018 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa370057260 con 0x5582d8187d10 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa367fff700 1 -- 172.21.15.84:0/1170649018 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3700553a0 con 0x5582d8187d10 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa396088b80 1 -- 172.21.15.84:0/1170649018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 msgr2=0x5582d81aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa396088b80 1 --2- 172.21.15.84:0/1170649018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81aed40 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fa370056f60 tx=0x7fa37001e040 comp rx=0 tx=0).stop 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa396088b80 1 -- 172.21.15.84:0/1170649018 shutdown_connections 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.572+0000 7fa396088b80 1 --2- 172.21.15.84:0/1170649018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 0x5582d81ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.573+0000 7fa396088b80 1 --2- 172.21.15.84:0/1170649018 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d81d6c50 0x5582d81828d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.573+0000 7fa396088b80 1 --2- 172.21.15.84:0/1170649018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d8187d10 0x5582d81aed40 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.573+0000 7fa396088b80 1 -- 172.21.15.84:0/1170649018 >> 172.21.15.84:0/1170649018 conn(0x5582d81881b0 msgr2=0x5582d8187200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.573+0000 7fa396088b80 1 -- 172.21.15.84:0/1170649018 shutdown_connections 2023-10-06T03:02:17.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.573+0000 7fa396088b80 1 -- 172.21.15.84:0/1170649018 wait complete. 2023-10-06T03:02:17.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.573+0000 7fa396088b80 1 -- start start 2023-10-06T03:02:17.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.573+0000 7fa396088b80 1 Processor -- start 2023-10-06T03:02:17.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa396088b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 0x5582d822fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa396088b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 0x5582d81ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa396088b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d81d6c50 0x5582d81aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa396088b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d81c3c40 con 0x5582d81d6c50 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa396088b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582d8230150 con 0x5582d8186890 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa396088b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582d8232ce0 con 0x5582d8187d10 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa396088b80 10 client.0 _ll_register_callbacks cb 0x5582d8149ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa386d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d81d6c50 0x5582d81aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa386d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d81d6c50 0x5582d81aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39522/0 (socket says 172.21.15.84:39522) 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa386d9d700 1 -- 172.21.15.84:0/2338844683 learned_addr learned my addr 172.21.15.84:0/2338844683 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa37dd9b700 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 0x5582d81ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa38659c700 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 0x5582d822fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa386d9d700 1 -- 172.21.15.84:0/2338844683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 msgr2=0x5582d81ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa386d9d700 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 0x5582d81ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa386d9d700 1 -- 172.21.15.84:0/2338844683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 msgr2=0x5582d822fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa386d9d700 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 0x5582d822fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.574+0000 7fa386d9d700 1 -- 172.21.15.84:0/2338844683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582d7f712c0 con 0x5582d81d6c50 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa386d9d700 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d81d6c50 0x5582d81aed40 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fa380009880 tx=0x7fa38000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac42e89c0878601 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa364ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa364ff9700 1 -- 172.21.15.84:0/2338844683 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380009e40 con 0x5582d81d6c50 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa364ff9700 1 -- 172.21.15.84:0/2338844683 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fa380007d20 con 0x5582d81d6c50 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa396088b80 1 -- 172.21.15.84:0/2338844683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa37005a4b0 con 0x5582d81d6c50 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa364ff9700 1 -- 172.21.15.84:0/2338844683 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa380018630 con 0x5582d81d6c50 2023-10-06T03:02:17.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa396088b80 10 client.9150 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa396088b80 1 -- 172.21.15.84:0/2338844683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x5582d808c4c0 con 0x5582d81d6c50 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa364ff9700 1 -- 172.21.15.84:0/2338844683 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37005a4b0 con 0x5582d81d6c50 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa364ff9700 1 -- 172.21.15.84:0/2338844683 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fa380014050 con 0x5582d81d6c50 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa396088b80 10 client.9150 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa396088b80 10 client.9150 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa396088b80 20 client.9150 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa396088b80 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5582d8232630 0x5582d8236060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa396088b80 4 client.9150 mds_command: new command op to 8529 tid=0[{"prefix": "scrub resume"}] 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa396088b80 1 -- 172.21.15.84:0/2338844683 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x5582d8079e50 con 0x5582d8232630 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa38659c700 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5582d8232630 0x5582d8236060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa364ff9700 10 client.9150 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.575+0000 7fa38659c700 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5582d8232630 0x5582d8236060 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c7c4f65b8c8dea server_cookie=67ec361de9fab184 in_seq=0 out_seq=0 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa364ff9700 1 -- 172.21.15.84:0/2338844683 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5582d8079e50 con 0x5582d8232630 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa364ff9700 10 client.9150 handle_command_reply: tid=0 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 client.9150 shutdown 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 -- 172.21.15.84:0/2338844683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d81d6c50 msgr2=0x5582d81aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d81d6c50 0x5582d81aed40 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fa380009880 tx=0x7fa38000b040 comp rx=0 tx=0).stop 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 -- 172.21.15.84:0/2338844683 shutdown_connections 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x5582d8232630 0x5582d8236060 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582d8186890 0x5582d822fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa364ff9700 0 client.9150 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:17.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5582d81d6c50 0x5582d81aed40 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 --2- 172.21.15.84:0/2338844683 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5582d8187d10 0x5582d81ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 -- 172.21.15.84:0/2338844683 >> 172.21.15.84:0/2338844683 conn(0x5582d81881b0 msgr2=0x5582d81b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 -- 172.21.15.84:0/2338844683 shutdown_connections 2023-10-06T03:02:17.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 1 -- 172.21.15.84:0/2338844683 wait complete. 2023-10-06T03:02:17.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa396088b80 20 client.9150 trim_cache size 0 max 16384 2023-10-06T03:02:17.584 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:17.584 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0 2023-10-06T03:02:17.584 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa38cd90700 1 -- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa368066f30 msgr2=0x7fa3680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa38cd90700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa368066f30 0x7fa3680693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa3780018f0 tx=0x7fa378009040 comp rx=0 tx=0).stop 2023-10-06T03:02:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa38cd90700 1 -- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880c6610 msgr2=0x7fa38815d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.576+0000 7fa38cd90700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880c6610 0x7fa38815d110 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fa388088fe0 tx=0x7fa370017000 comp rx=0 tx=0).stop 2023-10-06T03:02:17.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.577+0000 7fa38cd90700 1 -- 172.21.15.84:0/942687779 shutdown_connections 2023-10-06T03:02:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.577+0000 7fa38cd90700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa368066f30 0x7fa3680693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.577+0000 7fa38cd90700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3880b2a90 0x7fa388158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.577+0000 7fa38cd90700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa3880cbb50 0x7fa38815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.577+0000 7fa38cd90700 1 --2- 172.21.15.84:0/942687779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3880c6610 0x7fa38815d110 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.577+0000 7fa38cd90700 1 -- 172.21.15.84:0/942687779 >> 172.21.15.84:0/942687779 conn(0x7fa388099740 msgr2=0x7fa388063450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.577+0000 7fa38cd90700 1 -- 172.21.15.84:0/942687779 shutdown_connections 2023-10-06T03:02:17.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.577+0000 7fa38cd90700 1 -- 172.21.15.84:0/942687779 wait complete. 2023-10-06T03:02:17.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2023-10-06T03:02:17.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.703+0000 7f3cfcf51700 1 Processor -- start 2023-10-06T03:02:17.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.703+0000 7f3cfcf51700 1 -- start start 2023-10-06T03:02:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cfcf51700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf81539d0 0x7f3cf815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cfcf51700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3cf80ccab0 0x7f3cf80d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cfcf51700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf80d0c90 con 0x7f3cf80d0830 2023-10-06T03:02:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cfcf51700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf80cdc30 con 0x7f3cf80ccab0 2023-10-06T03:02:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cfcf51700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80cb500 con 0x7f3cf81539d0 2023-10-06T03:02:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cf7fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3cf80d0830 0x7f3cf815cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37250/0 (socket says 172.21.15.84:37250) 2023-10-06T03:02:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cf7fff700 1 -- 172.21.15.84:0/2051407927 learned_addr learned my addr 172.21.15.84:0/2051407927 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf81539d0 0x7f3cf815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971438155 0 0) 0x7f3cf0001490 con 0x7f3cf80d0830 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/2051407927 >> v2:172.21.15.131:3300/0 conn(0x7f3cf80ccab0 0x7f3cf80d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.704+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce0003570 con 0x7f3cf80d0830 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3642295980 0 0) 0x7f3ce0003570 con 0x7f3cf80d0830 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf81539d0 msgr2=0x7f3cf815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf81539d0 0x7f3cf815a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 >> v2:172.21.15.131:3300/0 conn(0x7f3cf80ccab0 msgr2=0x7f3cf80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 --2- 172.21.15.84:0/2051407927 >> v2:172.21.15.131:3300/0 conn(0x7f3cf80ccab0 0x7f3cf80d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf815a8f0 con 0x7f3cf80d0830 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f3cf0001980 con 0x7f3cf80d0830 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 >> v1:172.21.15.84:6789/0 conn(0x7f3cf80d0830 legacy=0x7f3cf815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce0003a60 0x7f3ce0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf81539d0 0x7f3ce0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce0004d50 0x7f3ce00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80cdc30 con 0x7f3ce0003a60 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80cb500 con 0x7f3ce0004d50 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce000ba60 con 0x7f3cf81539d0 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce0003a60 0x7f3ce0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf81539d0 0x7f3ce0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce0004d50 0x7f3ce00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf77fe700 1 -- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf81539d0 msgr2=0x7f3ce0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf81539d0 0x7f3ce0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf77fe700 1 -- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce0004d50 msgr2=0x7f3ce00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce0004d50 0x7f3ce00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf77fe700 1 -- 172.21.15.84:0/2051407927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0003570 con 0x7f3ce0003a60 2023-10-06T03:02:17.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce0003a60 0x7f3ce0003e70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009c00 tx=0x7f3ce80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bd4da9e976d66d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800e6b0 con 0x7f3ce0003a60 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce800e810 con 0x7f3ce0003a60 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.705+0000 7f3cf67fc700 1 -- 172.21.15.84:0/2051407927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800ebd0 con 0x7f3ce0003a60 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.706+0000 7f3cfcf51700 1 -- 172.21.15.84:0/2051407927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce0003a60 msgr2=0x7f3ce0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.706+0000 7f3cfcf51700 1 --2- 172.21.15.84:0/2051407927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce0003a60 0x7f3ce0003e70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009c00 tx=0x7f3ce80091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.706+0000 7f3cf7fff700 1 -- 172.21.15.84:0/2051407927 reap_dead start 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.706+0000 7f3cfcf51700 1 -- 172.21.15.84:0/2051407927 shutdown_connections 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.706+0000 7f3cfcf51700 1 -- 172.21.15.84:0/2051407927 >> 172.21.15.84:0/2051407927 conn(0x7f3cf8068100 msgr2=0x7f3cf80684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.706+0000 7f3cfcf51700 1 -- 172.21.15.84:0/2051407927 shutdown_connections 2023-10-06T03:02:17.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.706+0000 7f3cfcf51700 1 -- 172.21.15.84:0/2051407927 wait complete. 2023-10-06T03:02:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.707+0000 7f3cfcf51700 1 Processor -- start 2023-10-06T03:02:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.707+0000 7f3cfcf51700 1 -- start start 2023-10-06T03:02:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cfcf51700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce0003a60 0x7f3cf8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cfcf51700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf8156f10 0x7f3cf80c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cfcf51700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf80b0fd0 0x7f3cf80b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cfcf51700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80c8540 con 0x7f3cf8156f10 2023-10-06T03:02:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cfcf51700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf8157380 con 0x7f3ce0003a60 2023-10-06T03:02:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cfcf51700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80c8310 con 0x7f3cf80b0fd0 2023-10-06T03:02:17.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf8156f10 0x7f3cf80c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf8156f10 0x7f3cf80c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39534/0 (socket says 172.21.15.84:39534) 2023-10-06T03:02:17.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/167991166 learned_addr learned my addr 172.21.15.84:0/167991166 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce0003a60 0x7f3cf8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf80b0fd0 0x7f3cf80b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/167991166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf80b0fd0 msgr2=0x7f3cf80b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf80b0fd0 0x7f3cf80b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/167991166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce0003a60 msgr2=0x7f3cf8151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce0003a60 0x7f3cf8151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/167991166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80b1980 con 0x7f3cf8156f10 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf80b0fd0 0x7f3cf80b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.708+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf8156f10 0x7f3cf80c7dd0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f3cec011d70 tx=0x7f3cec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.709+0000 7f3cdf7fe700 1 -- 172.21.15.84:0/167991166 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec009e20 con 0x7f3cf8156f10 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.709+0000 7f3cdf7fe700 1 -- 172.21.15.84:0/167991166 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec00fcd0 con 0x7f3cf8156f10 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.709+0000 7f3cdf7fe700 1 -- 172.21.15.84:0/167991166 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec014650 con 0x7f3cf8156f10 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.709+0000 7f3cfcf51700 1 -- 172.21.15.84:0/167991166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf80b4c90 con 0x7f3cf8156f10 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.709+0000 7f3cfcf51700 1 -- 172.21.15.84:0/167991166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf80b4640 con 0x7f3cf8156f10 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.710+0000 7f3cdf7fe700 1 -- 172.21.15.84:0/167991166 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cec014a80 con 0x7f3cf8156f10 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.710+0000 7f3cdf7fe700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ce4066f30 0x7f3ce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.710+0000 7f3cdf7fe700 1 -- 172.21.15.84:0/167991166 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f3cec018030 con 0x7f3cf8156f10 2023-10-06T03:02:17.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.710+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ce4066f30 0x7f3ce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.711+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ce4066f30 0x7f3ce40693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80091e0 tx=0x7f3ce801a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.712+0000 7f3d074abb80 1 Processor -- start 2023-10-06T03:02:17.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3d074abb80 1 -- start start 2023-10-06T03:02:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a2154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215a310 0x5633a2155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215ba60 0x5633a2155790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3d074abb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633a20afac0 con 0x5633a215ba60 2023-10-06T03:02:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3d074abb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633a20ad2c0 con 0x5633a2179ea0 2023-10-06T03:02:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3d074abb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633a20a90b0 con 0x5633a215a310 2023-10-06T03:02:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3cf7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215ba60 0x5633a2155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3cf7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215ba60 0x5633a2155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39540/0 (socket says 172.21.15.84:39540) 2023-10-06T03:02:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.713+0000 7f3cf7fff700 1 -- 172.21.15.84:0/2275996021 learned_addr learned my addr 172.21.15.84:0/2275996021 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215a310 0x5633a2155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a2154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cf7fff700 1 -- 172.21.15.84:0/2275996021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215a310 msgr2=0x5633a2155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215a310 0x5633a2155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cf7fff700 1 -- 172.21.15.84:0/2275996021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 msgr2=0x5633a2154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a2154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cf7fff700 1 -- 172.21.15.84:0/2275996021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633a1f432c0 con 0x5633a215ba60 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a2154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215ba60 0x5633a2155790 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80d02c0 tx=0x7f3cf0006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1eac7e6722c345a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cdcff9700 1 -- 172.21.15.84:0/2275996021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0019070 con 0x5633a215ba60 2023-10-06T03:02:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cdcff9700 1 -- 172.21.15.84:0/2275996021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0001590 con 0x5633a215ba60 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.714+0000 7f3cdcff9700 1 -- 172.21.15.84:0/2275996021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000ab80 con 0x5633a215ba60 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 -- 172.21.15.84:0/2275996021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215ba60 msgr2=0x5633a2155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215ba60 0x5633a2155790 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80d02c0 tx=0x7f3cf0006040 comp rx=0 tx=0).stop 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 -- 172.21.15.84:0/2275996021 shutdown_connections 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a2154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215ba60 0x5633a2155790 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2275996021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215a310 0x5633a2155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 -- 172.21.15.84:0/2275996021 >> 172.21.15.84:0/2275996021 conn(0x5633a2159ed0 msgr2=0x5633a215a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 -- 172.21.15.84:0/2275996021 shutdown_connections 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 -- 172.21.15.84:0/2275996021 wait complete. 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.715+0000 7f3d074abb80 1 -- start start 2023-10-06T03:02:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3d074abb80 1 Processor -- start 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a21aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a21a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a217aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3d074abb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633a20548e0 con 0x5633a215a310 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3d074abb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633a206fef0 con 0x5633a2179ea0 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3d074abb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633a1f2be80 con 0x5633a215ba60 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3cf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a21aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3d074abb80 10 client.0 _ll_register_callbacks cb 0x5633a211c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3cf77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a21aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39556/0 (socket says 172.21.15.84:39556) 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.716+0000 7f3cf77fe700 1 -- 172.21.15.84:0/2686733906 learned_addr learned my addr 172.21.15.84:0/2686733906 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a21a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a217aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cf77fe700 1 -- 172.21.15.84:0/2686733906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 msgr2=0x5633a21a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a21a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cf77fe700 1 -- 172.21.15.84:0/2686733906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 msgr2=0x5633a217aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a217aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cf77fe700 1 -- 172.21.15.84:0/2686733906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf000f040 con 0x5633a215a310 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a217aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a21aeea0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800e4b0 tx=0x7f3ce801f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a2236acd016b9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/2686733906 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8013ad0 con 0x5633a215a310 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/2686733906 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f3ce8013c30 con 0x5633a215a310 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3d074abb80 1 -- 172.21.15.84:0/2686733906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633a214d990 con 0x5633a215a310 2023-10-06T03:02:17.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/2686733906 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ce8005a00 con 0x5633a215a310 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3d074abb80 10 client.9162 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3d074abb80 1 -- 172.21.15.84:0/2686733906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x5633a1ee6030 con 0x5633a215a310 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.717+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/2686733906 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633a214d990 con 0x5633a215a310 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/2686733906 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f3ce8005b60 con 0x5633a215a310 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3d074abb80 10 client.9162 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3d074abb80 10 client.9162 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3d074abb80 20 client.9162 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5633a21af3e0 0x5633a217afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3d074abb80 4 client.9162 mds_command: new command op to 8526 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3d074abb80 1 -- 172.21.15.84:0/2686733906 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633a212a8c0 con 0x5633a21af3e0 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5633a21af3e0 0x5633a217afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3cd5ffb700 10 client.9162 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.718+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5633a21af3e0 0x5633a217afc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9058188ece3eb4a server_cookie=f27f79ca542f9eea in_seq=0 out_seq=0 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/2686733906 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5633a212a8c0 con 0x5633a21af3e0 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3cd5ffb700 10 client.9162 handle_command_reply: tid=0 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 client.9162 shutdown 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 -- 172.21.15.84:0/2686733906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 msgr2=0x5633a21aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a21aeea0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800e4b0 tx=0x7f3ce801f050 comp rx=0 tx=0).stop 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 -- 172.21.15.84:0/2686733906 shutdown_connections 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5633a21af3e0 0x5633a217afc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2179ea0 0x5633a217aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3cd5ffb700 0 client.9162 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a21aeea0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 --2- 172.21.15.84:0/2686733906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a21a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 -- 172.21.15.84:0/2686733906 >> 172.21.15.84:0/2686733906 conn(0x5633a2159ed0 msgr2=0x5633a2154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 -- 172.21.15.84:0/2686733906 shutdown_connections 2023-10-06T03:02:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 1 -- 172.21.15.84:0/2686733906 wait complete. 2023-10-06T03:02:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.719+0000 7f3d074abb80 20 client.9162 trim_cache size 0 max 16384 2023-10-06T03:02:17.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.735+0000 7f3d074abb80 1 Processor -- start 2023-10-06T03:02:17.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.735+0000 7f3d074abb80 1 -- start start 2023-10-06T03:02:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 0x5633a219fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a215a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a215ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3d074abb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633a21383d0 con 0x5633a215a310 2023-10-06T03:02:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3d074abb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633a21598f0 con 0x5633a2159ed0 2023-10-06T03:02:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3d074abb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633a2157900 con 0x5633a215ba60 2023-10-06T03:02:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a215a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a215a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39564/0 (socket says 172.21.15.84:39564) 2023-10-06T03:02:17.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/3019819139 learned_addr learned my addr 172.21.15.84:0/3019819139 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/3019819139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 0x5633a219fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/3019819139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a215ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/3019819139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 msgr2=0x5633a215ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/3019819139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a215ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/3019819139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 msgr2=0x5633a219fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/3019819139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 0x5633a219fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/3019819139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633a20777d0 con 0x5633a215a310 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/3019819139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a215a6e0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f3cec014840 tx=0x7f3cec06a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4581ef79151b71df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cdd7fa700 1 -- 172.21.15.84:0/3019819139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec055f40 con 0x5633a215a310 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cdd7fa700 1 -- 172.21.15.84:0/3019819139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec059190 con 0x5633a215a310 2023-10-06T03:02:17.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.736+0000 7f3cdd7fa700 1 -- 172.21.15.84:0/3019819139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec05cee0 con 0x5633a215a310 2023-10-06T03:02:17.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 -- 172.21.15.84:0/3019819139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 msgr2=0x5633a215a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 --2- 172.21.15.84:0/3019819139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a215a6e0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f3cec014840 tx=0x7f3cec06a040 comp rx=0 tx=0).stop 2023-10-06T03:02:17.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 -- 172.21.15.84:0/3019819139 shutdown_connections 2023-10-06T03:02:17.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 --2- 172.21.15.84:0/3019819139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 0x5633a219fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 --2- 172.21.15.84:0/3019819139 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a215ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 --2- 172.21.15.84:0/3019819139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a215a6e0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 -- 172.21.15.84:0/3019819139 >> 172.21.15.84:0/3019819139 conn(0x5633a2156730 msgr2=0x5633a21a1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 -- 172.21.15.84:0/3019819139 shutdown_connections 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 -- 172.21.15.84:0/3019819139 wait complete. 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 -- start start 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.737+0000 7f3d074abb80 1 Processor -- start 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 0x5633a21857b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a2204f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3d074abb80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a214f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3d074abb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633a217d490 con 0x5633a215a310 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3d074abb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633a2158e30 con 0x5633a2159ed0 2023-10-06T03:02:17.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3d074abb80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633a2159080 con 0x5633a215ba60 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3d074abb80 10 client.0 _ll_register_callbacks cb 0x7f3ce8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3cf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a2204f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3cf6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a2204f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39572/0 (socket says 172.21.15.84:39572) 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/870026546 learned_addr learned my addr 172.21.15.84:0/870026546 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 0x5633a21857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.738+0000 7f3cf7fff700 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a214f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/870026546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 msgr2=0x5633a214f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a214f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/870026546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 msgr2=0x5633a21857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 0x5633a21857b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cf6ffd700 1 -- 172.21.15.84:0/870026546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf80b4640 con 0x5633a215a310 2023-10-06T03:02:17.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cf6ffd700 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a2204f40 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f3cec055c40 tx=0x7f3cec058070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538bfb5d4818ddd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/870026546 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec05e070 con 0x5633a215a310 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/870026546 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f3cec05cee0 con 0x5633a215a310 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3d074abb80 1 -- 172.21.15.84:0/870026546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3cf0001590 con 0x5633a215a310 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/870026546 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cec014840 con 0x5633a215a310 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3d074abb80 10 client.9168 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3d074abb80 1 -- 172.21.15.84:0/870026546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x5633a205e4c0 con 0x5633a215a310 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/870026546 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0001590 con 0x5633a215a310 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/870026546 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7f3cec06c1a0 con 0x5633a215a310 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3d074abb80 10 client.9168 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:17.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3d074abb80 10 client.9168 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3d074abb80 20 client.9168 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3d074abb80 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5633a2179ea0 0x5633a214fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3d074abb80 4 client.9168 mds_command: new command op to 8526 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3d074abb80 1 -- 172.21.15.84:0/870026546 --> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5633a204be50 con 0x5633a2179ea0 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.739+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5633a2179ea0 0x5633a214fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3cd5ffb700 10 client.9168 ms_handle_connect on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3cf77fe700 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5633a2179ea0 0x5633a214fcc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=319f749e70c58784 server_cookie=bed1965e688aa3bd in_seq=0 out_seq=0 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3cd5ffb700 1 -- 172.21.15.84:0/870026546 <== mds.1 v2:172.21.15.84:6834/3850699528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5633a204be50 con 0x5633a2179ea0 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3cd5ffb700 10 client.9168 handle_command_reply: tid=0 2023-10-06T03:02:17.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 client.9168 shutdown 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 -- 172.21.15.84:0/870026546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 msgr2=0x5633a2204f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a2204f40 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f3cec055c40 tx=0x7f3cec058070 comp rx=0 tx=0).stop 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 -- 172.21.15.84:0/870026546 shutdown_connections 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.84:6834/3850699528,v1:172.21.15.84:6836/3850699528] conn(0x5633a2179ea0 0x5633a214fcc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633a2159ed0 0x5633a21857b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5633a215ba60 0x5633a214f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 --2- 172.21.15.84:0/870026546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5633a215a310 0x5633a2204f40 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3cd5ffb700 0 client.9168 ms_handle_reset on v2:172.21.15.84:6834/3850699528 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 -- 172.21.15.84:0/870026546 >> 172.21.15.84:0/870026546 conn(0x5633a2156730 msgr2=0x5633a219f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 -- 172.21.15.84:0/870026546 shutdown_connections 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 1 -- 172.21.15.84:0/870026546 wait complete. 2023-10-06T03:02:17.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3d074abb80 20 client.9168 trim_cache size 0 max 16384 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:17.748 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3cfcf51700 1 -- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ce4066f30 msgr2=0x7f3ce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3cfcf51700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ce4066f30 0x7f3ce40693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80091e0 tx=0x7f3ce801a000 comp rx=0 tx=0).stop 2023-10-06T03:02:17.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3cfcf51700 1 -- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf8156f10 msgr2=0x7f3cf80c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.740+0000 7f3cfcf51700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf8156f10 0x7f3cf80c7dd0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f3cec011d70 tx=0x7f3cec0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.741+0000 7f3cfcf51700 1 -- 172.21.15.84:0/167991166 shutdown_connections 2023-10-06T03:02:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.741+0000 7f3cfcf51700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ce4066f30 0x7f3ce40693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.741+0000 7f3cfcf51700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ce0003a60 0x7f3cf8151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.741+0000 7f3cfcf51700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3cf80b0fd0 0x7f3cf80b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.741+0000 7f3cfcf51700 1 --2- 172.21.15.84:0/167991166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cf8156f10 0x7f3cf80c7dd0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.741+0000 7f3cfcf51700 1 -- 172.21.15.84:0/167991166 >> 172.21.15.84:0/167991166 conn(0x7f3cf8068100 msgr2=0x7f3cf80ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.741+0000 7f3cfcf51700 1 -- 172.21.15.84:0/167991166 shutdown_connections 2023-10-06T03:02:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.741+0000 7f3cfcf51700 1 -- 172.21.15.84:0/167991166 wait complete. 2023-10-06T03:02:17.752 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:17.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2023-10-06T03:02:17.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.869+0000 7fe599c3b700 1 Processor -- start 2023-10-06T03:02:17.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.869+0000 7fe599c3b700 1 -- start start 2023-10-06T03:02:17.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe599c3b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe5940b2a30 0x7fe594164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe599c3b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940cc9b0 con 0x7fe5940cd400 2023-10-06T03:02:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe599c3b700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940cbda0 con 0x7fe5940b2660 2023-10-06T03:02:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe599c3b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5940cc080 con 0x7fe5940b2a30 2023-10-06T03:02:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe59943a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe5940b2a30 0x7fe594164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe593fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe5940cd400 0x7fe5940ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37256/0 (socket says 172.21.15.84:37256) 2023-10-06T03:02:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe59943a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe5940b2a30 0x7fe594164360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39584/0 (socket says 172.21.15.84:39584) 2023-10-06T03:02:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe593fff700 1 -- 172.21.15.84:0/79988164 learned_addr learned my addr 172.21.15.84:0/79988164 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe59943a700 1 -- 172.21.15.84:0/79988164 >> v1:172.21.15.131:6789/0 conn(0x7fe5940b2660 legacy=0x7fe5940cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe59943a700 1 -- 172.21.15.84:0/79988164 >> v1:172.21.15.84:6789/0 conn(0x7fe5940cd400 legacy=0x7fe5940ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe59943a700 1 -- 172.21.15.84:0/79988164 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940cc360 con 0x7fe5940b2a30 2023-10-06T03:02:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe5937fe700 1 -- 172.21.15.84:0/79988164 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017000957 0 0) 0x7fe5940cc9b0 con 0x7fe5940cd400 2023-10-06T03:02:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe59943a700 1 --2- 172.21.15.84:0/79988164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 0x7fe594164360 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009e60 tx=0x7fe58c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815a53609cc8cb9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.870+0000 7fe5937fe700 1 -- 172.21.15.84:0/79988164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c00e070 con 0x7fe5940b2a30 2023-10-06T03:02:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.871+0000 7fe5937fe700 1 -- 172.21.15.84:0/79988164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c00bc30 con 0x7fe5940b2a30 2023-10-06T03:02:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.871+0000 7fe5937fe700 1 -- 172.21.15.84:0/79988164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c012430 con 0x7fe5940b2a30 2023-10-06T03:02:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.871+0000 7fe599c3b700 1 -- 172.21.15.84:0/79988164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 msgr2=0x7fe594164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.871+0000 7fe599c3b700 1 --2- 172.21.15.84:0/79988164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 0x7fe594164360 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009e60 tx=0x7fe58c009780 comp rx=0 tx=0).stop 2023-10-06T03:02:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.871+0000 7fe599c3b700 1 -- 172.21.15.84:0/79988164 shutdown_connections 2023-10-06T03:02:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.871+0000 7fe599c3b700 1 --2- 172.21.15.84:0/79988164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 0x7fe594164360 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.871+0000 7fe599c3b700 1 -- 172.21.15.84:0/79988164 >> 172.21.15.84:0/79988164 conn(0x7fe594099560 msgr2=0x7fe59406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.871+0000 7fe599c3b700 1 -- 172.21.15.84:0/79988164 shutdown_connections 2023-10-06T03:02:17.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.871+0000 7fe599c3b700 1 -- 172.21.15.84:0/79988164 wait complete. 2023-10-06T03:02:17.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.872+0000 7fe599c3b700 1 Processor -- start 2023-10-06T03:02:17.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.872+0000 7fe599c3b700 1 -- start start 2023-10-06T03:02:17.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe599c3b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5940b2660 0x7fe594159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe599c3b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 0x7fe5941530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe599c3b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5940cd400 0x7fe5940b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe599c3b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59415cfb0 con 0x7fe5940b2a30 2023-10-06T03:02:17.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe599c3b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940c80c0 con 0x7fe5940b2660 2023-10-06T03:02:17.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe599c3b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940c74f0 con 0x7fe5940cd400 2023-10-06T03:02:17.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe593fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 0x7fe5941530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe593fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 0x7fe5941530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39592/0 (socket says 172.21.15.84:39592) 2023-10-06T03:02:17.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe593fff700 1 -- 172.21.15.84:0/1787305881 learned_addr learned my addr 172.21.15.84:0/1787305881 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe598c39700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5940b2660 0x7fe594159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe59943a700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5940cd400 0x7fe5940b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe593fff700 1 -- 172.21.15.84:0/1787305881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5940cd400 msgr2=0x7fe5940b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe593fff700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5940cd400 0x7fe5940b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe593fff700 1 -- 172.21.15.84:0/1787305881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5940b2660 msgr2=0x7fe594159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.873+0000 7fe593fff700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5940b2660 0x7fe594159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.874+0000 7fe593fff700 1 -- 172.21.15.84:0/1787305881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c009a20 con 0x7fe5940b2a30 2023-10-06T03:02:17.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.874+0000 7fe593fff700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 0x7fe5941530f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fe58000c810 tx=0x7fe580007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.874+0000 7fe590ff9700 1 -- 172.21.15.84:0/1787305881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580005c00 con 0x7fe5940b2a30 2023-10-06T03:02:17.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.874+0000 7fe590ff9700 1 -- 172.21.15.84:0/1787305881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580005d60 con 0x7fe5940b2a30 2023-10-06T03:02:17.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.874+0000 7fe599c3b700 1 -- 172.21.15.84:0/1787305881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5940c7790 con 0x7fe5940b2a30 2023-10-06T03:02:17.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.874+0000 7fe590ff9700 1 -- 172.21.15.84:0/1787305881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800072e0 con 0x7fe5940b2a30 2023-10-06T03:02:17.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.874+0000 7fe599c3b700 1 -- 172.21.15.84:0/1787305881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5940c7d50 con 0x7fe5940b2a30 2023-10-06T03:02:17.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.875+0000 7fe590ff9700 1 -- 172.21.15.84:0/1787305881 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe580007690 con 0x7fe5940b2a30 2023-10-06T03:02:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.876+0000 7fe590ff9700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe578066f30 0x7fe5780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.876+0000 7fe598c39700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe578066f30 0x7fe5780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.876+0000 7fe590ff9700 1 -- 172.21.15.84:0/1787305881 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe580083c80 con 0x7fe5940b2a30 2023-10-06T03:02:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.876+0000 7fe598c39700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe578066f30 0x7fe5780693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe588003a20 tx=0x7fe588007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.878+0000 7fe5a4195b80 1 Processor -- start 2023-10-06T03:02:17.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.878+0000 7fe5a4195b80 1 -- start start 2023-10-06T03:02:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe621ea0 0x564dfe5fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 0x564dfe5fd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe5fd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dfe557ac0 con 0x564dfe603a60 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dfe5552c0 con 0x564dfe602310 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dfe5510b0 con 0x564dfe621ea0 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe59943a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe5fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe59943a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe5fd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39596/0 (socket says 172.21.15.84:39596) 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe59943a700 1 -- 172.21.15.84:0/834534040 learned_addr learned my addr 172.21.15.84:0/834534040 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe593fff700 1 --2- 172.21.15.84:0/834534040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 0x564dfe5fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe598c39700 1 --2- 172.21.15.84:0/834534040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe621ea0 0x564dfe5fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe59943a700 1 -- 172.21.15.84:0/834534040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe621ea0 msgr2=0x564dfe5fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe59943a700 1 --2- 172.21.15.84:0/834534040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe621ea0 0x564dfe5fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe59943a700 1 -- 172.21.15.84:0/834534040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 msgr2=0x564dfe5fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe59943a700 1 --2- 172.21.15.84:0/834534040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 0x564dfe5fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe59943a700 1 -- 172.21.15.84:0/834534040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564dfe3eb2c0 con 0x564dfe603a60 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe59943a700 1 --2- 172.21.15.84:0/834534040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe5fd790 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe58c013000 tx=0x7fe58c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3efdb092076590 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe57dffb700 1 -- 172.21.15.84:0/834534040 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c021070 con 0x564dfe603a60 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe57dffb700 1 -- 172.21.15.84:0/834534040 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c00bda0 con 0x564dfe603a60 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.879+0000 7fe57dffb700 1 -- 172.21.15.84:0/834534040 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c012810 con 0x564dfe603a60 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 -- 172.21.15.84:0/834534040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 msgr2=0x564dfe5fd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/834534040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe5fd790 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe58c013000 tx=0x7fe58c019000 comp rx=0 tx=0).stop 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 -- 172.21.15.84:0/834534040 shutdown_connections 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/834534040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe5fd790 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/834534040 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe621ea0 0x564dfe5fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/834534040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 0x564dfe5fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 -- 172.21.15.84:0/834534040 >> 172.21.15.84:0/834534040 conn(0x564dfe601ed0 msgr2=0x564dfe602700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 -- 172.21.15.84:0/834534040 shutdown_connections 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 -- 172.21.15.84:0/834534040 wait complete. 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.880+0000 7fe5a4195b80 1 -- start start 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.881+0000 7fe5a4195b80 1 Processor -- start 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.881+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe602310 0x564dfe6581a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.881+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe603a60 0x564dfe654c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.881+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 0x564dfe657890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.881+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dfe4fc8e0 con 0x564dfe602310 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.881+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dfe517ef0 con 0x564dfe621ea0 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.881+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dfe3d3e80 con 0x564dfe603a60 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe5a4195b80 10 client.0 _ll_register_callbacks cb 0x564dfe5c4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe598c39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe602310 0x564dfe6581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe598c39700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe602310 0x564dfe6581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39604/0 (socket says 172.21.15.84:39604) 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe598c39700 1 -- 172.21.15.84:0/3957475029 learned_addr learned my addr 172.21.15.84:0/3957475029 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe593fff700 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe603a60 0x564dfe654c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe59943a700 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 0x564dfe657890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe598c39700 1 -- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe603a60 msgr2=0x564dfe654c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe598c39700 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe603a60 0x564dfe654c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe598c39700 1 -- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 msgr2=0x564dfe657890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe598c39700 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 0x564dfe657890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe598c39700 1 -- 172.21.15.84:0/3957475029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5940cc360 con 0x564dfe602310 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe598c39700 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe602310 0x564dfe6581a0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe5880148a0 tx=0x7fe588015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e2f0ced2d4ea9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe572ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe572ffd700 1 -- 172.21.15.84:0/3957475029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588021400 con 0x564dfe602310 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe572ffd700 1 -- 172.21.15.84:0/3957475029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe58801c040 con 0x564dfe602310 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe5a4195b80 1 -- 172.21.15.84:0/3957475029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564dfe5f5990 con 0x564dfe602310 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe572ffd700 1 -- 172.21.15.84:0/3957475029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe588021770 con 0x564dfe602310 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe5a4195b80 10 client.9183 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe5a4195b80 1 -- 172.21.15.84:0/3957475029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x564dfe38e030 con 0x564dfe602310 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.882+0000 7fe572ffd700 1 -- 172.21.15.84:0/3957475029 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564dfe5f5990 con 0x564dfe602310 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe572ffd700 1 -- 172.21.15.84:0/3957475029 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fe5880218d0 con 0x564dfe602310 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe5a4195b80 10 client.9183 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:17.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe5a4195b80 10 client.9183 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe5a4195b80 20 client.9183 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x564dfe659ff0 0x564dfe6205e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe5a4195b80 4 client.9183 mds_command: new command op to 6782 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe5a4195b80 1 -- 172.21.15.84:0/3957475029 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564dfe5d28c0 con 0x564dfe659ff0 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe593fff700 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x564dfe659ff0 0x564dfe6205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe572ffd700 10 client.9183 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.883+0000 7fe593fff700 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x564dfe659ff0 0x564dfe6205e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=124ddae6a1858e8e server_cookie=43a10f8cf784f1ba in_seq=0 out_seq=0 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe572ffd700 1 -- 172.21.15.84:0/3957475029 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564dfe5d28c0 con 0x564dfe659ff0 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe572ffd700 10 client.9183 handle_command_reply: tid=0 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 client.9183 shutdown 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 -- 172.21.15.84:0/3957475029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe602310 msgr2=0x564dfe6581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe602310 0x564dfe6581a0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe5880148a0 tx=0x7fe588015000 comp rx=0 tx=0).stop 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 -- 172.21.15.84:0/3957475029 shutdown_connections 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 0x564dfe657890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x564dfe659ff0 0x564dfe6205e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe602310 0x564dfe6581a0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/3957475029 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe603a60 0x564dfe654c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe572ffd700 0 client.9183 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 -- 172.21.15.84:0/3957475029 >> 172.21.15.84:0/3957475029 conn(0x564dfe601ed0 msgr2=0x564dfe5f7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 -- 172.21.15.84:0/3957475029 shutdown_connections 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 1 -- 172.21.15.84:0/3957475029 wait complete. 2023-10-06T03:02:17.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.884+0000 7fe5a4195b80 20 client.9183 trim_cache size 0 max 16384 2023-10-06T03:02:17.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.900+0000 7fe5a4195b80 1 Processor -- start 2023-10-06T03:02:17.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.900+0000 7fe5a4195b80 1 -- start start 2023-10-06T03:02:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 0x564dfe5f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe603a60 0x564dfe647910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe621ea0 0x564dfe5fdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dfe6002c0 con 0x564dfe621ea0 2023-10-06T03:02:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dfe622ac0 con 0x564dfe602310 2023-10-06T03:02:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dfe5d9230 con 0x564dfe603a60 2023-10-06T03:02:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe59943a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe621ea0 0x564dfe5fdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe59943a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe621ea0 0x564dfe5fdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39614/0 (socket says 172.21.15.84:39614) 2023-10-06T03:02:17.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe59943a700 1 -- 172.21.15.84:0/165584334 learned_addr learned my addr 172.21.15.84:0/165584334 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe598c39700 1 --2- 172.21.15.84:0/165584334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 0x564dfe5f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe59943a700 1 -- 172.21.15.84:0/165584334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe603a60 msgr2=0x564dfe647910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe59943a700 1 --2- 172.21.15.84:0/165584334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe603a60 0x564dfe647910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe59943a700 1 -- 172.21.15.84:0/165584334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 msgr2=0x564dfe5f7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe59943a700 1 --2- 172.21.15.84:0/165584334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 0x564dfe5f7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe59943a700 1 -- 172.21.15.84:0/165584334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564dfe51f7d0 con 0x564dfe621ea0 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe59943a700 1 --2- 172.21.15.84:0/165584334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe621ea0 0x564dfe5fdcd0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00b6c0 tx=0x7fe58c01e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12b3c593663af3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe57e7fc700 1 -- 172.21.15.84:0/165584334 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c021040 con 0x564dfe621ea0 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe57e7fc700 1 -- 172.21.15.84:0/165584334 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c001010 con 0x564dfe621ea0 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.901+0000 7fe57e7fc700 1 -- 172.21.15.84:0/165584334 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c012e30 con 0x564dfe621ea0 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 -- 172.21.15.84:0/165584334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe621ea0 msgr2=0x564dfe5fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/165584334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe621ea0 0x564dfe5fdcd0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00b6c0 tx=0x7fe58c01e050 comp rx=0 tx=0).stop 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 -- 172.21.15.84:0/165584334 shutdown_connections 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/165584334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe602310 0x564dfe5f7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/165584334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe621ea0 0x564dfe5fdcd0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/165584334 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe603a60 0x564dfe647910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 -- 172.21.15.84:0/165584334 >> 172.21.15.84:0/165584334 conn(0x564dfe601ed0 msgr2=0x564dfe622270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 -- 172.21.15.84:0/165584334 shutdown_connections 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 -- 172.21.15.84:0/165584334 wait complete. 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.902+0000 7fe5a4195b80 1 -- start start 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.903+0000 7fe5a4195b80 1 Processor -- start 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.903+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe602310 0x564dfe6207b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.903+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe6acde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.903+0000 7fe5a4195b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 0x564dfe6475b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.903+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dfe6301c0 con 0x564dfe603a60 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.903+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dfe6ada30 con 0x564dfe621ea0 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.903+0000 7fe5a4195b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x564dfe669780 con 0x564dfe602310 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 10 client.0 _ll_register_callbacks cb 0x564dfe5c4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe593fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe6acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe593fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe6acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39630/0 (socket says 172.21.15.84:39630) 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe593fff700 1 -- 172.21.15.84:0/694655809 learned_addr learned my addr 172.21.15.84:0/694655809 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe598c39700 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe602310 0x564dfe6207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe59943a700 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 0x564dfe6475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe593fff700 1 -- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe602310 msgr2=0x564dfe6207b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe593fff700 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe602310 0x564dfe6207b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe593fff700 1 -- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 msgr2=0x564dfe6475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe593fff700 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 0x564dfe6475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe593fff700 1 -- 172.21.15.84:0/694655809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564dfe3eb2c0 con 0x564dfe603a60 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe598c39700 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe602310 0x564dfe6207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe59943a700 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 0x564dfe6475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe593fff700 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe6acde0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fe58000ceb0 tx=0x7fe580081e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d015ff996841244 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe572ffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe572ffd700 1 -- 172.21.15.84:0/694655809 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580052d00 con 0x564dfe603a60 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe572ffd700 1 -- 172.21.15.84:0/694655809 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe580054bc0 con 0x564dfe603a60 2023-10-06T03:02:17.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 1 -- 172.21.15.84:0/694655809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe58c00bda0 con 0x564dfe603a60 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe572ffd700 1 -- 172.21.15.84:0/694655809 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe580053e50 con 0x564dfe603a60 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 10 client.9189 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 1 -- 172.21.15.84:0/694655809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x564dfe5064c0 con 0x564dfe603a60 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe572ffd700 1 -- 172.21.15.84:0/694655809 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c00bda0 con 0x564dfe603a60 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe572ffd700 1 -- 172.21.15.84:0/694655809 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fe58005b3c0 con 0x564dfe603a60 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 10 client.9189 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 10 client.9189 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.b 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 20 client.9189 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x564dfe647af0 0x564dfe62f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 4 client.9189 mds_command: new command op to 6782 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.904+0000 7fe5a4195b80 1 -- 172.21.15.84:0/694655809 --> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564dfe4f3e50 con 0x564dfe647af0 2023-10-06T03:02:17.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe598c39700 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x564dfe647af0 0x564dfe62f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe572ffd700 10 client.9189 ms_handle_connect on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe598c39700 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x564dfe647af0 0x564dfe62f310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1abb4e4193308081 server_cookie=bc4d1b7463595b84 in_seq=0 out_seq=0 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe572ffd700 1 -- 172.21.15.84:0/694655809 <== mds.2 v2:172.21.15.131:6833/3436673358 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x564dfe4f3e50 con 0x564dfe647af0 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe572ffd700 10 client.9189 handle_command_reply: tid=0 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 client.9189 shutdown 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 -- 172.21.15.84:0/694655809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 msgr2=0x564dfe6acde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe6acde0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fe58000ceb0 tx=0x7fe580081e00 comp rx=0 tx=0).stop 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 -- 172.21.15.84:0/694655809 shutdown_connections 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564dfe621ea0 0x564dfe6475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:6833/3436673358,v1:172.21.15.131:6835/3436673358] conn(0x564dfe647af0 0x564dfe62f310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x564dfe602310 0x564dfe6207b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 --2- 172.21.15.84:0/694655809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564dfe603a60 0x564dfe6acde0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe572ffd700 0 client.9189 ms_handle_reset on v2:172.21.15.131:6833/3436673358 2023-10-06T03:02:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 -- 172.21.15.84:0/694655809 >> 172.21.15.84:0/694655809 conn(0x564dfe601ed0 msgr2=0x564dfe5fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 -- 172.21.15.84:0/694655809 shutdown_connections 2023-10-06T03:02:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.905+0000 7fe5a4195b80 1 -- 172.21.15.84:0/694655809 wait complete. 2023-10-06T03:02:17.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe5a4195b80 20 client.9189 trim_cache size 0 max 16384 2023-10-06T03:02:17.915 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:17.915 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T03:02:17.916 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:17.916 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:17.916 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:17.916 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:17.916 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:17.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:17.916 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:17.916 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 -- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe578066f30 msgr2=0x7fe5780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe578066f30 0x7fe5780693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe588003a20 tx=0x7fe588007f10 comp rx=0 tx=0).stop 2023-10-06T03:02:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 -- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 msgr2=0x7fe5941530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 0x7fe5941530f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fe58000c810 tx=0x7fe580007db0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 -- 172.21.15.84:0/1787305881 shutdown_connections 2023-10-06T03:02:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe578066f30 0x7fe5780693e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5940b2660 0x7fe594159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe5940cd400 0x7fe5940b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 --2- 172.21.15.84:0/1787305881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5940b2a30 0x7fe5941530f0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 -- 172.21.15.84:0/1787305881 >> 172.21.15.84:0/1787305881 conn(0x7fe594099560 msgr2=0x7fe594153eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 -- 172.21.15.84:0/1787305881 shutdown_connections 2023-10-06T03:02:17.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:17.906+0000 7fe599c3b700 1 -- 172.21.15.84:0/1787305881 wait complete. 2023-10-06T03:02:17.919 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:17.920 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-10-06T03:02:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.035+0000 7fb016cf9700 1 Processor -- start 2023-10-06T03:02:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.035+0000 7fb016cf9700 1 -- start start 2023-10-06T03:02:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.036+0000 7fb016cf9700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb01006bff0 0x7fb010159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.036+0000 7fb016cf9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a460 0x7fb01015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.036+0000 7fb016cf9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01015d170 con 0x7fb01006a090 2023-10-06T03:02:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.036+0000 7fb016cf9700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01015a960 con 0x7fb01006bff0 2023-10-06T03:02:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.036+0000 7fb016cf9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01015d3c0 con 0x7fb01006a460 2023-10-06T03:02:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.036+0000 7fb014a95700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb01006a090 0x7fb01006b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37270/0 (socket says 172.21.15.84:37270) 2023-10-06T03:02:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.036+0000 7fb014a95700 1 -- 172.21.15.84:0/3122146907 learned_addr learned my addr 172.21.15.84:0/3122146907 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.036+0000 7fb007fff700 1 --2- 172.21.15.84:0/3122146907 >> v2:172.21.15.131:3300/0 conn(0x7fb01006bff0 0x7fb010159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.036+0000 7fb015296700 1 --2- 172.21.15.84:0/3122146907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a460 0x7fb01015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb0077fe700 1 -- 172.21.15.84:0/3122146907 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567063726 0 0) 0x7fb01015d170 con 0x7fb01006a090 2023-10-06T03:02:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb0077fe700 1 -- 172.21.15.84:0/3122146907 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faff8003570 con 0x7fb01006a090 2023-10-06T03:02:18.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb007fff700 1 -- 172.21.15.84:0/3122146907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a460 msgr2=0x7fb01015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb007fff700 1 --2- 172.21.15.84:0/3122146907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a460 0x7fb01015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb007fff700 1 -- 172.21.15.84:0/3122146907 >> v1:172.21.15.84:6789/0 conn(0x7fb01006a090 legacy=0x7fb01006b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb007fff700 1 -- 172.21.15.84:0/3122146907 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01015d6a0 con 0x7fb01006bff0 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb007fff700 1 --2- 172.21.15.84:0/3122146907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01006bff0 0x7fb010159ee0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb0000098e0 tx=0x7fb0000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d507ea56a140e88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb0077fe700 1 -- 172.21.15.84:0/3122146907 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000011630 con 0x7fb01006bff0 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb0077fe700 1 -- 172.21.15.84:0/3122146907 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb000011790 con 0x7fb01006bff0 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.037+0000 7fb0077fe700 1 -- 172.21.15.84:0/3122146907 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000011b30 con 0x7fb01006bff0 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.038+0000 7fb016cf9700 1 -- 172.21.15.84:0/3122146907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01006bff0 msgr2=0x7fb010159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.038+0000 7fb016cf9700 1 --2- 172.21.15.84:0/3122146907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01006bff0 0x7fb010159ee0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb0000098e0 tx=0x7fb0000091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.038+0000 7fb016cf9700 1 -- 172.21.15.84:0/3122146907 shutdown_connections 2023-10-06T03:02:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.038+0000 7fb016cf9700 1 --2- 172.21.15.84:0/3122146907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a460 0x7fb01015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.038+0000 7fb016cf9700 1 --2- 172.21.15.84:0/3122146907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01006bff0 0x7fb010159ee0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.038+0000 7fb016cf9700 1 -- 172.21.15.84:0/3122146907 >> 172.21.15.84:0/3122146907 conn(0x7fb0100ce330 msgr2=0x7fb0100ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.038+0000 7fb016cf9700 1 -- 172.21.15.84:0/3122146907 shutdown_connections 2023-10-06T03:02:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.038+0000 7fb016cf9700 1 -- 172.21.15.84:0/3122146907 wait complete. 2023-10-06T03:02:18.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.039+0000 7fb016cf9700 1 Processor -- start 2023-10-06T03:02:18.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.039+0000 7fb016cf9700 1 -- start start 2023-10-06T03:02:18.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb016cf9700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a090 0x7fb01016c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb016cf9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01006a460 0x7fb010068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb016cf9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb01006bff0 0x7fb010068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb016cf9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0100b3f40 con 0x7fb01006bff0 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb016cf9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb010069600 con 0x7fb01006a460 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb016cf9700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0100b1bb0 con 0x7fb01006a090 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb015296700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb01006bff0 0x7fb010068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb015296700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb01006bff0 0x7fb010068c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39638/0 (socket says 172.21.15.84:39638) 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb015296700 1 -- 172.21.15.84:0/235506900 learned_addr learned my addr 172.21.15.84:0/235506900 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb014a95700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a090 0x7fb01016c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb007fff700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01006a460 0x7fb010068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb015296700 1 -- 172.21.15.84:0/235506900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a090 msgr2=0x7fb01016c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb015296700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a090 0x7fb01016c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb015296700 1 -- 172.21.15.84:0/235506900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01006a460 msgr2=0x7fb010068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb015296700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01006a460 0x7fb010068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb015296700 1 -- 172.21.15.84:0/235506900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000009420 con 0x7fb01006bff0 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb014a95700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a090 0x7fb01016c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb015296700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb01006bff0 0x7fb010068c40 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb00800eab0 tx=0x7fb0080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb004ff9700 1 -- 172.21.15.84:0/235506900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800c850 con 0x7fb01006bff0 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb004ff9700 1 -- 172.21.15.84:0/235506900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00800c9d0 con 0x7fb01006bff0 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb016cf9700 1 -- 172.21.15.84:0/235506900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0100b1280 con 0x7fb01006bff0 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb004ff9700 1 -- 172.21.15.84:0/235506900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800cd90 con 0x7fb01006bff0 2023-10-06T03:02:18.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.040+0000 7fb016cf9700 1 -- 172.21.15.84:0/235506900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0100b1840 con 0x7fb01006bff0 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.042+0000 7fb004ff9700 1 -- 172.21.15.84:0/235506900 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb008013680 con 0x7fb01006bff0 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.042+0000 7fb004ff9700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faffc066f30 0x7faffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.042+0000 7fb004ff9700 1 -- 172.21.15.84:0/235506900 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fb008084bc0 con 0x7fb01006bff0 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.042+0000 7fb014a95700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faffc066f30 0x7faffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.043+0000 7fb014a95700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faffc066f30 0x7faffc0693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb00c005c50 tx=0x7fb00c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.044+0000 7fb01fff1b80 1 Processor -- start 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.044+0000 7fb01fff1b80 1 -- start start 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94e93c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94e94d10 0x557b94ee3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94ee3c50 0x557b94ee40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b94deaac0 con 0x557b94e94d10 2023-10-06T03:02:18.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b94de82c0 con 0x557b94ee3c50 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b94de40b0 con 0x557b94e93890 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb007fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94e94d10 0x557b94ee3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb007fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94e94d10 0x557b94ee3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39654/0 (socket says 172.21.15.84:39654) 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb007fff700 1 -- 172.21.15.84:0/1822703296 learned_addr learned my addr 172.21.15.84:0/1822703296 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb014a95700 1 --2- 172.21.15.84:0/1822703296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94e93c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb015296700 1 --2- 172.21.15.84:0/1822703296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94ee3c50 0x557b94ee40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb007fff700 1 -- 172.21.15.84:0/1822703296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 msgr2=0x557b94e93c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb007fff700 1 --2- 172.21.15.84:0/1822703296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94e93c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb007fff700 1 -- 172.21.15.84:0/1822703296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94ee3c50 msgr2=0x557b94ee40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb007fff700 1 --2- 172.21.15.84:0/1822703296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94ee3c50 0x557b94ee40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb007fff700 1 -- 172.21.15.84:0/1822703296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b94c7e2c0 con 0x557b94e94d10 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.045+0000 7fb007fff700 1 --2- 172.21.15.84:0/1822703296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94e94d10 0x557b94ee3710 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fb000009ed0 tx=0x7fb000017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6403c99cd9450b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7faff5ffb700 1 -- 172.21.15.84:0/1822703296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000021070 con 0x557b94e94d10 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7faff5ffb700 1 -- 172.21.15.84:0/1822703296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb000009230 con 0x557b94e94d10 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7faff5ffb700 1 -- 172.21.15.84:0/1822703296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000011900 con 0x557b94e94d10 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1822703296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94e94d10 msgr2=0x557b94ee3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1822703296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94e94d10 0x557b94ee3710 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fb000009ed0 tx=0x7fb000017000 comp rx=0 tx=0).stop 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1822703296 shutdown_connections 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1822703296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94ee3c50 0x557b94ee40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1822703296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94e93c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1822703296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94e94d10 0x557b94ee3710 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1822703296 >> 172.21.15.84:0/1822703296 conn(0x557b94e951b0 msgr2=0x557b94e95580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1822703296 shutdown_connections 2023-10-06T03:02:18.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.046+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1822703296 wait complete. 2023-10-06T03:02:18.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.047+0000 7fb01fff1b80 1 -- start start 2023-10-06T03:02:18.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.047+0000 7fb01fff1b80 1 Processor -- start 2023-10-06T03:02:18.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e93890 0x557b94ebc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e8edd0 0x557b94e8f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b94d8f8e0 con 0x557b94ee3c50 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b94daaef0 con 0x557b94e93890 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b94c66e80 con 0x557b94e8edd0 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb01fff1b80 10 client.0 _ll_register_callbacks cb 0x557b94e56ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb007fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb007fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39670/0 (socket says 172.21.15.84:39670) 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb007fff700 1 -- 172.21.15.84:0/4237442767 learned_addr learned my addr 172.21.15.84:0/4237442767 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb014a95700 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e93890 0x557b94ebc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb015296700 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e8edd0 0x557b94e8f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb007fff700 1 -- 172.21.15.84:0/4237442767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e8edd0 msgr2=0x557b94e8f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb007fff700 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e8edd0 0x557b94e8f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb007fff700 1 -- 172.21.15.84:0/4237442767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e93890 msgr2=0x557b94ebc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb007fff700 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e93890 0x557b94ebc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb007fff700 1 -- 172.21.15.84:0/4237442767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01015d6a0 con 0x557b94ee3c50 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb007fff700 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee18a0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fb000009200 tx=0x7fb000021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10471972969344f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fafeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fafeeffd700 1 -- 172.21.15.84:0/4237442767 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000011b10 con 0x557b94ee3c50 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fafeeffd700 1 -- 172.21.15.84:0/4237442767 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fb00002fda0 con 0x557b94ee3c50 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.048+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4237442767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b94e88990 con 0x557b94ee3c50 2023-10-06T03:02:18.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fafeeffd700 1 -- 172.21.15.84:0/4237442767 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb000025850 con 0x557b94ee3c50 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb01fff1b80 10 client.9201 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4237442767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x557b94c21030 con 0x557b94ee3c50 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fafeeffd700 1 -- 172.21.15.84:0/4237442767 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b94e88990 con 0x557b94ee3c50 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fafeeffd700 1 -- 172.21.15.84:0/4237442767 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fb00002c070 con 0x557b94ee3c50 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb01fff1b80 10 client.9201 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb01fff1b80 10 client.9201 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb01fff1b80 20 client.9201 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557b94edb5b0 0x557b94edb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb01fff1b80 4 client.9201 mds_command: new command op to 8529 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4237442767 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b94e658c0 con 0x557b94edb5b0 2023-10-06T03:02:18.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb014a95700 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557b94edb5b0 0x557b94edb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fafeeffd700 10 client.9201 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.049+0000 7fb014a95700 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557b94edb5b0 0x557b94edb9b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e305c7db14f4914f server_cookie=fb598028f477dacf in_seq=0 out_seq=0 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fafeeffd700 1 -- 172.21.15.84:0/4237442767 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557b94e658c0 con 0x557b94edb5b0 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fafeeffd700 10 client.9201 handle_command_reply: tid=0 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 client.9201 shutdown 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4237442767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 msgr2=0x557b94ee18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee18a0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fb000009200 tx=0x7fb000021000 comp rx=0 tx=0).stop 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4237442767 shutdown_connections 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557b94edb5b0 0x557b94edb9b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e93890 0x557b94ebc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e8edd0 0x557b94e8f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fafeeffd700 0 client.9201 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4237442767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee18a0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4237442767 >> 172.21.15.84:0/4237442767 conn(0x557b94e951b0 msgr2=0x557b94ed7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4237442767 shutdown_connections 2023-10-06T03:02:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4237442767 wait complete. 2023-10-06T03:02:18.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.050+0000 7fb01fff1b80 20 client.9201 trim_cache size 0 max 16384 2023-10-06T03:02:18.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.066+0000 7fb01fff1b80 1 Processor -- start 2023-10-06T03:02:18.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.066+0000 7fb01fff1b80 1 -- start start 2023-10-06T03:02:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.066+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 0x557b94edd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.066+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94ebb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.066+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.066+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b94ec3920 con 0x557b94ee3c50 2023-10-06T03:02:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.066+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b94ee33b0 con 0x557b94e8edd0 2023-10-06T03:02:18.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.066+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b94e6c230 con 0x557b94e93890 2023-10-06T03:02:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.066+0000 7fb015296700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb015296700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39672/0 (socket says 172.21.15.84:39672) 2023-10-06T03:02:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb015296700 1 -- 172.21.15.84:0/4193629388 learned_addr learned my addr 172.21.15.84:0/4193629388 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb014a95700 1 --2- 172.21.15.84:0/4193629388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 0x557b94edd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb007fff700 1 --2- 172.21.15.84:0/4193629388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94ebb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb015296700 1 -- 172.21.15.84:0/4193629388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 msgr2=0x557b94ebb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb015296700 1 --2- 172.21.15.84:0/4193629388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94ebb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb015296700 1 -- 172.21.15.84:0/4193629388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 msgr2=0x557b94edd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb015296700 1 --2- 172.21.15.84:0/4193629388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 0x557b94edd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb015296700 1 -- 172.21.15.84:0/4193629388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b94db27d0 con 0x557b94ee3c50 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb015296700 1 --2- 172.21.15.84:0/4193629388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee1780 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fb008055470 tx=0x7fb008058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6de2aee8c4da70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7faff67fc700 1 -- 172.21.15.84:0/4193629388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080589c0 con 0x557b94ee3c50 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7faff67fc700 1 -- 172.21.15.84:0/4193629388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00805c710 con 0x557b94ee3c50 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7faff67fc700 1 -- 172.21.15.84:0/4193629388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008053b10 con 0x557b94ee3c50 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4193629388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 msgr2=0x557b94ee1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.067+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4193629388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee1780 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fb008055470 tx=0x7fb008058040 comp rx=0 tx=0).stop 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.068+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4193629388 shutdown_connections 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.068+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4193629388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 0x557b94edd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.068+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4193629388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ee1780 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.068+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/4193629388 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94ebb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.068+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4193629388 >> 172.21.15.84:0/4193629388 conn(0x557b94e951b0 msgr2=0x557b94ed4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.068+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4193629388 shutdown_connections 2023-10-06T03:02:18.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.068+0000 7fb01fff1b80 1 -- 172.21.15.84:0/4193629388 wait complete. 2023-10-06T03:02:18.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.068+0000 7fb01fff1b80 1 -- start start 2023-10-06T03:02:18.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.068+0000 7fb01fff1b80 1 Processor -- start 2023-10-06T03:02:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 0x557b94f28ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94f3fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb01fff1b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ed3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b94ed4040 con 0x557b94ee3c50 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b94f402e0 con 0x557b94e8edd0 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb01fff1b80 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b94eda100 con 0x557b94e93890 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb01fff1b80 10 client.0 _ll_register_callbacks cb 0x557b94e56ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb015296700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ed3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb015296700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ed3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39680/0 (socket says 172.21.15.84:39680) 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb015296700 1 -- 172.21.15.84:0/1101891076 learned_addr learned my addr 172.21.15.84:0/1101891076 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb014a95700 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 0x557b94f28ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb007fff700 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94f3fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb015296700 1 -- 172.21.15.84:0/1101891076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 msgr2=0x557b94f3fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb015296700 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94f3fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb015296700 1 -- 172.21.15.84:0/1101891076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 msgr2=0x557b94f28ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb015296700 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 0x557b94f28ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.069+0000 7fb015296700 1 -- 172.21.15.84:0/1101891076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0100b1840 con 0x557b94ee3c50 2023-10-06T03:02:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb015296700 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ed3630 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fb008055420 tx=0x7fb00806b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1613e7611127dd56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fafeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-10-06T03:02:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fafeeffd700 1 -- 172.21.15.84:0/1101891076 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080557f0 con 0x557b94ee3c50 2023-10-06T03:02:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fafeeffd700 1 -- 172.21.15.84:0/1101891076 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fb0080589c0 con 0x557b94ee3c50 2023-10-06T03:02:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1101891076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb000009230 con 0x557b94ee3c50 2023-10-06T03:02:18.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fafeeffd700 1 -- 172.21.15.84:0/1101891076 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0080538b0 con 0x557b94ee3c50 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb01fff1b80 10 client.9207 fetch_fsmap learned FSMap version 111 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1101891076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x557b94d994c0 con 0x557b94ee3c50 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fafeeffd700 1 -- 172.21.15.84:0/1101891076 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb000009230 con 0x557b94ee3c50 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fafeeffd700 1 -- 172.21.15.84:0/1101891076 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 111) v1 ==== 3140+0+0 (secure 0 0 0) 0x7fb008071280 con 0x557b94ee3c50 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb01fff1b80 10 client.9207 fetch_fsmap finished waiting for FSMap version 111 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb01fff1b80 10 client.9207 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb01fff1b80 20 client.9207 populate_metadata read hostname 'smithi084' 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557b94ec3760 0x557b94eda590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb01fff1b80 4 client.9207 mds_command: new command op to 8529 tid=0[{"prefix": "scrub status"}] 2023-10-06T03:02:18.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1101891076 --> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557b94d86e50 con 0x557b94ec3760 2023-10-06T03:02:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb014a95700 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557b94ec3760 0x557b94eda590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fafeeffd700 10 client.9207 ms_handle_connect on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.070+0000 7fb014a95700 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557b94ec3760 0x557b94eda590 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37b1c06a0ed89911 server_cookie=402632ec171ac49e in_seq=0 out_seq=0 2023-10-06T03:02:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fafeeffd700 1 -- 172.21.15.84:0/1101891076 <== mds.0 v2:172.21.15.84:6835/868960356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x557b94d86e50 con 0x557b94ec3760 2023-10-06T03:02:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fafeeffd700 10 client.9207 handle_command_reply: tid=0 2023-10-06T03:02:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 client.9207 shutdown 2023-10-06T03:02:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1101891076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 msgr2=0x557b94ed3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ed3630 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fb008055420 tx=0x7fb00806b000 comp rx=0 tx=0).stop 2023-10-06T03:02:18.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1101891076 shutdown_connections 2023-10-06T03:02:18.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.84:6835/868960356,v1:172.21.15.84:6837/868960356] conn(0x557b94ec3760 0x557b94eda590 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b94e8edd0 0x557b94f28ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fafeeffd700 0 client.9207 ms_handle_reset on v2:172.21.15.84:6835/868960356 2023-10-06T03:02:18.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557b94ee3c50 0x557b94ed3630 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 --2- 172.21.15.84:0/1101891076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557b94e93890 0x557b94f3fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1101891076 >> 172.21.15.84:0/1101891076 conn(0x557b94e951b0 msgr2=0x557b94edcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1101891076 shutdown_connections 2023-10-06T03:02:18.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 1 -- 172.21.15.84:0/1101891076 wait complete. 2023-10-06T03:02:18.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb01fff1b80 20 client.9207 trim_cache size 0 max 16384 2023-10-06T03:02:18.082 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T03:02:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2023-10-06T03:02:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: "f7eda194-0ea0-4275-b5a6-c64177b22b0e": { 2023-10-06T03:02:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/d1/d2/d3", 2023-10-06T03:02:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "f7eda194-0ea0-4275-b5a6-c64177b22b0e", 2023-10-06T03:02:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2023-10-06T03:02:18.082 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:18.083 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-10-06T03:02:18.083 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 -- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faffc066f30 msgr2=0x7faffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faffc066f30 0x7faffc0693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb00c005c50 tx=0x7fb00c009040 comp rx=0 tx=0).stop 2023-10-06T03:02:18.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 -- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb01006bff0 msgr2=0x7fb010068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb01006bff0 0x7fb010068c40 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb00800eab0 tx=0x7fb0080091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 -- 172.21.15.84:0/235506900 shutdown_connections 2023-10-06T03:02:18.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faffc066f30 0x7faffc0693e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb01006bff0 0x7fb010068c40 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb01006a090 0x7fb01016c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 --2- 172.21.15.84:0/235506900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01006a460 0x7fb010068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.071+0000 7fb016cf9700 1 -- 172.21.15.84:0/235506900 >> 172.21.15.84:0/235506900 conn(0x7fb0100ce330 msgr2=0x7fb0101567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.072+0000 7fb016cf9700 1 -- 172.21.15.84:0/235506900 shutdown_connections 2023-10-06T03:02:18.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.072+0000 7fb016cf9700 1 -- 172.21.15.84:0/235506900 wait complete. 2023-10-06T03:02:18.086 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T03:02:18.086 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:18.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.199+0000 7f9a97081700 1 Processor -- start 2023-10-06T03:02:18.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.199+0000 7f9a97081700 1 -- start start 2023-10-06T03:02:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.200+0000 7f9a97081700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a9015db50 0x7f9a900cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.200+0000 7f9a97081700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9a900ad620 0x7f9a900ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.200+0000 7f9a97081700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a900ca640 con 0x7f9a900ad250 2023-10-06T03:02:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.200+0000 7f9a97081700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a900ced30 con 0x7f9a900ad620 2023-10-06T03:02:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.200+0000 7f9a97081700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900cf010 con 0x7f9a9015db50 2023-10-06T03:02:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.200+0000 7f9a94e1d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9a900ad250 0x7f9a9015d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37278/0 (socket says 172.21.15.84:37278) 2023-10-06T03:02:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.200+0000 7f9a94e1d700 1 -- 172.21.15.84:0/2704489509 learned_addr learned my addr 172.21.15.84:0/2704489509 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.200+0000 7f9a9561e700 1 --2- 172.21.15.84:0/2704489509 >> v2:172.21.15.131:3300/0 conn(0x7f9a900ad620 0x7f9a900ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.200+0000 7f9a87fff700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a9015db50 0x7f9a900cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255947785 0 0) 0x7f9a900ca640 con 0x7f9a900ad250 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a78003570 con 0x7f9a900ad250 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2913979220 0 0) 0x7f9a78003570 con 0x7f9a900ad250 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a9015db50 msgr2=0x7f9a900cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a9015db50 0x7f9a900cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 >> v2:172.21.15.131:3300/0 conn(0x7f9a900ad620 msgr2=0x7f9a900ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 --2- 172.21.15.84:0/2704489509 >> v2:172.21.15.131:3300/0 conn(0x7f9a900ad620 0x7f9a900ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a900ccad0 con 0x7f9a900ad250 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f9a8c001970 con 0x7f9a900ad250 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 >> v1:172.21.15.84:6789/0 conn(0x7f9a900ad250 legacy=0x7f9a9015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a78003a60 0x7f9a78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a9015db50 0x7f9a78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a78004d50 0x7f9a780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900ced30 con 0x7f9a78003a60 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900cf010 con 0x7f9a78004d50 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7800ba60 con 0x7f9a9015db50 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a94e1d700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a78003a60 0x7f9a78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a87fff700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a9015db50 0x7f9a78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a9561e700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a78004d50 0x7f9a780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a94e1d700 1 -- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a9015db50 msgr2=0x7f9a78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a94e1d700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a9015db50 0x7f9a78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a94e1d700 1 -- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a78004d50 msgr2=0x7f9a780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a94e1d700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a78004d50 0x7f9a780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a94e1d700 1 -- 172.21.15.84:0/2704489509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78003570 con 0x7f9a78003a60 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a9561e700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a78004d50 0x7f9a780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a87fff700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a9015db50 0x7f9a78004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.201+0000 7f9a94e1d700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a78003a60 0x7f9a78003e70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c6b0 tx=0x7f9a8c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be5edd2592a26ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c005b70 con 0x7f9a78003a60 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c005cf0 con 0x7f9a78003a60 2023-10-06T03:02:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a877fe700 1 -- 172.21.15.84:0/2704489509 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c007360 con 0x7f9a78003a60 2023-10-06T03:02:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a97081700 1 -- 172.21.15.84:0/2704489509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a78003a60 msgr2=0x7f9a78003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a97081700 1 --2- 172.21.15.84:0/2704489509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a78003a60 0x7f9a78003e70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c6b0 tx=0x7f9a8c007ca0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a9561e700 1 -- 172.21.15.84:0/2704489509 reap_dead start 2023-10-06T03:02:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a97081700 1 -- 172.21.15.84:0/2704489509 shutdown_connections 2023-10-06T03:02:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a97081700 1 -- 172.21.15.84:0/2704489509 >> 172.21.15.84:0/2704489509 conn(0x7f9a90067dd0 msgr2=0x7f9a900ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a97081700 1 -- 172.21.15.84:0/2704489509 shutdown_connections 2023-10-06T03:02:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.202+0000 7f9a97081700 1 -- 172.21.15.84:0/2704489509 wait complete. 2023-10-06T03:02:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.203+0000 7f9a97081700 1 Processor -- start 2023-10-06T03:02:18.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.203+0000 7f9a97081700 1 -- start start 2023-10-06T03:02:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a97081700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a78003a60 0x7f9a90169c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a97081700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a900b0630 0x7f9a9015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a97081700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a900b13a0 0x7f9a900b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a97081700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900c2cc0 con 0x7f9a900b13a0 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a97081700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900b1d40 con 0x7f9a900b0630 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a97081700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9016a280 con 0x7f9a78003a60 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a9561e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a900b13a0 0x7f9a900b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a9561e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a900b13a0 0x7f9a900b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39700/0 (socket says 172.21.15.84:39700) 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a9561e700 1 -- 172.21.15.84:0/2716521707 learned_addr learned my addr 172.21.15.84:0/2716521707 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a9561e700 1 -- 172.21.15.84:0/2716521707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a78003a60 msgr2=0x7f9a90169c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a9561e700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a78003a60 0x7f9a90169c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a9561e700 1 -- 172.21.15.84:0/2716521707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a900b0630 msgr2=0x7f9a9015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a9561e700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a900b0630 0x7f9a9015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.204+0000 7f9a9561e700 1 -- 172.21.15.84:0/2716521707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9016a560 con 0x7f9a900b13a0 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.205+0000 7f9a9561e700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a900b13a0 0x7f9a900b1800 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f9a90088890 tx=0x7f9a88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.205+0000 7f9a84ff9700 1 -- 172.21.15.84:0/2716521707 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88015740 con 0x7f9a900b13a0 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.205+0000 7f9a84ff9700 1 -- 172.21.15.84:0/2716521707 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a880158a0 con 0x7f9a900b13a0 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.205+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9016a840 con 0x7f9a900b13a0 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.205+0000 7f9a84ff9700 1 -- 172.21.15.84:0/2716521707 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88015c60 con 0x7f9a900b13a0 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.205+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9015b0f0 con 0x7f9a900b13a0 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.206+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a900c2e70 con 0x7f9a900b13a0 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.206+0000 7f9a84ff9700 1 -- 172.21.15.84:0/2716521707 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a8801f410 con 0x7f9a900b13a0 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.206+0000 7f9a84ff9700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a7c066f30 0x7f9a7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.207+0000 7f9a84ff9700 1 -- 172.21.15.84:0/2716521707 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f9a880844f0 con 0x7f9a900b13a0 2023-10-06T03:02:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.207+0000 7f9a94e1d700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a7c066f30 0x7f9a7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.207+0000 7f9a94e1d700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a7c066f30 0x7f9a7c0693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c6b0 tx=0x7f9a8c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.211+0000 7f9a84ff9700 1 -- 172.21.15.84:0/2716521707 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a900c2e70 con 0x7f9a900b13a0 2023-10-06T03:02:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.436+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a900c2e70 con 0x7f9a900b13a0 2023-10-06T03:02:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.437+0000 7f9a84ff9700 1 -- 172.21.15.84:0/2716521707 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7f9a900c2e70 con 0x7f9a900b13a0 2023-10-06T03:02:18.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:18.437 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:18.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a7c066f30 msgr2=0x7f9a7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a7c066f30 0x7f9a7c0693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00c6b0 tx=0x7f9a8c015000 comp rx=0 tx=0).stop 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a900b13a0 msgr2=0x7f9a900b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a900b13a0 0x7f9a900b1800 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f9a90088890 tx=0x7f9a88008040 comp rx=0 tx=0).stop 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 shutdown_connections 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9a7c066f30 0x7f9a7c0693e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a900b13a0 0x7f9a900b1800 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a78003a60 0x7f9a90169c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 --2- 172.21.15.84:0/2716521707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a900b0630 0x7f9a9015abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 >> 172.21.15.84:0/2716521707 conn(0x7f9a90067dd0 msgr2=0x7f9a9006b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 shutdown_connections 2023-10-06T03:02:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.439+0000 7f9a97081700 1 -- 172.21.15.84:0/2716521707 wait complete. 2023-10-06T03:02:18.441 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:18.451 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:18.451 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:18.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.563+0000 7f178dac1700 1 Processor -- start 2023-10-06T03:02:18.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.563+0000 7f178dac1700 1 -- start start 2023-10-06T03:02:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.564+0000 7f178dac1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17881594d0 0x7f17880a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.564+0000 7f178dac1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f17880675f0 0x7f1788067a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.564+0000 7f178dac1700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178806aae0 con 0x7f17880af600 2023-10-06T03:02:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.564+0000 7f178dac1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1788067fb0 con 0x7f17880675f0 2023-10-06T03:02:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.564+0000 7f178dac1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17880aa030 con 0x7f17881594d0 2023-10-06T03:02:18.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.564+0000 7f178d2c0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f17880675f0 0x7f1788067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.564+0000 7f178d2c0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f17880675f0 0x7f1788067a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39716/0 (socket says 172.21.15.84:39716) 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.564+0000 7f178d2c0700 1 -- 172.21.15.84:0/2033679402 learned_addr learned my addr 172.21.15.84:0/2033679402 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f178cabf700 1 --2- 172.21.15.84:0/2033679402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17881594d0 0x7f17880a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f178d2c0700 1 -- 172.21.15.84:0/2033679402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17881594d0 msgr2=0x7f17880a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f178d2c0700 1 --2- 172.21.15.84:0/2033679402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17881594d0 0x7f17880a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f178d2c0700 1 -- 172.21.15.84:0/2033679402 >> v1:172.21.15.131:6789/0 conn(0x7f17880af600 legacy=0x7f178806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f178d2c0700 1 -- 172.21.15.84:0/2033679402 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178806b680 con 0x7f17880675f0 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f178d2c0700 1 --2- 172.21.15.84:0/2033679402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880675f0 0x7f1788067a70 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f17800099b0 tx=0x7f1780009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbb2821a9a41276 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f177f7fe700 1 -- 172.21.15.84:0/2033679402 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178000b860 con 0x7f17880675f0 2023-10-06T03:02:18.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f177f7fe700 1 -- 172.21.15.84:0/2033679402 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178000b9c0 con 0x7f17880675f0 2023-10-06T03:02:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f177f7fe700 1 -- 172.21.15.84:0/2033679402 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178000bd60 con 0x7f17880675f0 2023-10-06T03:02:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.565+0000 7f178dac1700 1 -- 172.21.15.84:0/2033679402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880675f0 msgr2=0x7f1788067a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.566+0000 7f178dac1700 1 --2- 172.21.15.84:0/2033679402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880675f0 0x7f1788067a70 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f17800099b0 tx=0x7f1780009250 comp rx=0 tx=0).stop 2023-10-06T03:02:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.566+0000 7f178dac1700 1 -- 172.21.15.84:0/2033679402 shutdown_connections 2023-10-06T03:02:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.566+0000 7f178dac1700 1 --2- 172.21.15.84:0/2033679402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880675f0 0x7f1788067a70 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.566+0000 7f178dac1700 1 --2- 172.21.15.84:0/2033679402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17881594d0 0x7f17880a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.566+0000 7f178dac1700 1 -- 172.21.15.84:0/2033679402 >> 172.21.15.84:0/2033679402 conn(0x7f17880691d0 msgr2=0x7f17880aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.566+0000 7f178dac1700 1 -- 172.21.15.84:0/2033679402 shutdown_connections 2023-10-06T03:02:18.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.566+0000 7f178dac1700 1 -- 172.21.15.84:0/2033679402 wait complete. 2023-10-06T03:02:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.567+0000 7f178dac1700 1 Processor -- start 2023-10-06T03:02:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.567+0000 7f178dac1700 1 -- start start 2023-10-06T03:02:18.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178dac1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17880675f0 0x7f1788146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178dac1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880af600 0x7f17880c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178dac1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17881594d0 0x7f17880c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178dac1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178815dfb0 con 0x7f17880af600 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178dac1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178815e290 con 0x7f17881594d0 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178dac1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17880c1ea0 con 0x7f17880675f0 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880af600 0x7f17880c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880af600 0x7f17880c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39718/0 (socket says 172.21.15.84:39718) 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177ffff700 1 -- 172.21.15.84:0/597863440 learned_addr learned my addr 172.21.15.84:0/597863440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178cabf700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17880675f0 0x7f1788146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177ffff700 1 -- 172.21.15.84:0/597863440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17880675f0 msgr2=0x7f1788146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177ffff700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17880675f0 0x7f1788146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177ffff700 1 -- 172.21.15.84:0/597863440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17881594d0 msgr2=0x7f17880c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178d2c0700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17881594d0 0x7f17880c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177ffff700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17881594d0 0x7f17880c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177ffff700 1 -- 172.21.15.84:0/597863440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17800094f0 con 0x7f17880af600 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178cabf700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17880675f0 0x7f1788146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177ffff700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880af600 0x7f17880c4770 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f177800c590 tx=0x7f177800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177cff9700 1 -- 172.21.15.84:0/597863440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778011590 con 0x7f17880af600 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177cff9700 1 -- 172.21.15.84:0/597863440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17780116f0 con 0x7f17880af600 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f177cff9700 1 -- 172.21.15.84:0/597863440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778011ab0 con 0x7f17880af600 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17880c2180 con 0x7f17880af600 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.568+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17881471e0 con 0x7f17880af600 2023-10-06T03:02:18.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.569+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17880c26a0 con 0x7f17880af600 2023-10-06T03:02:18.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.570+0000 7f177cff9700 1 -- 172.21.15.84:0/597863440 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f177801b3b0 con 0x7f17880af600 2023-10-06T03:02:18.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.570+0000 7f177cff9700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1774066f30 0x7f17740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:18.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.570+0000 7f177cff9700 1 -- 172.21.15.84:0/597863440 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1778083dc0 con 0x7f17880af600 2023-10-06T03:02:18.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.570+0000 7f178cabf700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1774066f30 0x7f17740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:18.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.570+0000 7f178cabf700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1774066f30 0x7f17740693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1784007460 tx=0x7f178400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:18.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.574+0000 7f177cff9700 1 -- 172.21.15.84:0/597863440 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17880c26a0 con 0x7f17880af600 2023-10-06T03:02:18.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.831+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f17880c26a0 con 0x7f17880af600 2023-10-06T03:02:18.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.832+0000 7f177cff9700 1 -- 172.21.15.84:0/597863440 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1972 (secure 0 0 0) 0x7f17880c26a0 con 0x7f17880af600 2023-10-06T03:02:18.833 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:18.833 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":456,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":698974,"bytes_used":2451828736,"bytes_avail":770642284544,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6654,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":111,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T03:02:17.895681+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:18.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1774066f30 msgr2=0x7f17740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1774066f30 0x7f17740693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1784007460 tx=0x7f178400b040 comp rx=0 tx=0).stop 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880af600 msgr2=0x7f17880c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880af600 0x7f17880c4770 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f177800c590 tx=0x7f177800c950 comp rx=0 tx=0).stop 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 shutdown_connections 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1774066f30 0x7f17740693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17881594d0 0x7f17880c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17880675f0 0x7f1788146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 --2- 172.21.15.84:0/597863440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17880af600 0x7f17880c4770 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 >> 172.21.15.84:0/597863440 conn(0x7f17880691d0 msgr2=0x7f17880afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 shutdown_connections 2023-10-06T03:02:18.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:18.834+0000 7f178dac1700 1 -- 172.21.15.84:0/597863440 wait complete. 2023-10-06T03:02:18.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-10-06T03:02:19.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:19.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.972+0000 7f2a3fdca700 1 Processor -- start 2023-10-06T03:02:19.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.973+0000 7f2a3fdca700 1 -- start start 2023-10-06T03:02:19.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.973+0000 7f2a3fdca700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a380b49e0 0x7f2a380aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:19.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.973+0000 7f2a3fdca700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a380b07a0 0x7f2a380b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:19.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.973+0000 7f2a3fdca700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a380b0ca0 con 0x7f2a381595a0 2023-10-06T03:02:19.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.973+0000 7f2a3fdca700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380b0f80 con 0x7f2a380b49e0 2023-10-06T03:02:19.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.973+0000 7f2a3fdca700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380b1260 con 0x7f2a380b07a0 2023-10-06T03:02:19.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3e367700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a380b07a0 0x7f2a380b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:19.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3d365700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a380b49e0 0x7f2a380aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:19.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3db66700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2a381595a0 0x7f2a380aa570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:46118/0 (socket says 172.21.15.84:46118) 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3db66700 1 -- 172.21.15.84:0/303307735 learned_addr learned my addr 172.21.15.84:0/303307735 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3d365700 1 -- 172.21.15.84:0/303307735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a380b07a0 msgr2=0x7f2a380b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3d365700 1 --2- 172.21.15.84:0/303307735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a380b07a0 0x7f2a380b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3d365700 1 -- 172.21.15.84:0/303307735 >> v1:172.21.15.131:6789/0 conn(0x7f2a381595a0 legacy=0x7f2a380aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3cb64700 1 -- 172.21.15.84:0/303307735 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684805010 0 0) 0x7f2a380b0ca0 con 0x7f2a381595a0 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3d365700 1 -- 172.21.15.84:0/303307735 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380b1540 con 0x7f2a380b49e0 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3e367700 1 --2- 172.21.15.84:0/303307735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a380b07a0 0x7f2a380b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.974+0000 7f2a3d365700 1 --2- 172.21.15.84:0/303307735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 0x7f2a380aac80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009910 tx=0x7f2a2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a36ccfb1ebc4fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3cb64700 1 -- 172.21.15.84:0/303307735 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00b640 con 0x7f2a380b49e0 2023-10-06T03:02:19.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3cb64700 1 -- 172.21.15.84:0/303307735 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00b7a0 con 0x7f2a380b49e0 2023-10-06T03:02:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3cb64700 1 -- 172.21.15.84:0/303307735 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00bb60 con 0x7f2a380b49e0 2023-10-06T03:02:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3fdca700 1 -- 172.21.15.84:0/303307735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 msgr2=0x7f2a380aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3fdca700 1 --2- 172.21.15.84:0/303307735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 0x7f2a380aac80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009910 tx=0x7f2a2c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3fdca700 1 -- 172.21.15.84:0/303307735 shutdown_connections 2023-10-06T03:02:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3fdca700 1 --2- 172.21.15.84:0/303307735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a380b07a0 0x7f2a380b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3fdca700 1 --2- 172.21.15.84:0/303307735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 0x7f2a380aac80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3fdca700 1 -- 172.21.15.84:0/303307735 >> 172.21.15.84:0/303307735 conn(0x7f2a38099830 msgr2=0x7f2a3806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3fdca700 1 -- 172.21.15.84:0/303307735 shutdown_connections 2023-10-06T03:02:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.975+0000 7f2a3fdca700 1 -- 172.21.15.84:0/303307735 wait complete. 2023-10-06T03:02:19.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.976+0000 7f2a3fdca700 1 Processor -- start 2023-10-06T03:02:19.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.976+0000 7f2a3fdca700 1 -- start start 2023-10-06T03:02:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3fdca700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a380b07a0 0x7f2a3809d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3fdca700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 0x7f2a3814a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3fdca700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a381595a0 0x7f2a3809b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3fdca700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3815b9d0 con 0x7f2a380b07a0 2023-10-06T03:02:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3fdca700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3809dbf0 con 0x7f2a380b49e0 2023-10-06T03:02:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3fdca700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3809ded0 con 0x7f2a381595a0 2023-10-06T03:02:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3db66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a380b07a0 0x7f2a3809d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3db66700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a380b07a0 0x7f2a3809d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39722/0 (socket says 172.21.15.84:39722) 2023-10-06T03:02:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3db66700 1 -- 172.21.15.84:0/634127920 learned_addr learned my addr 172.21.15.84:0/634127920 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3d365700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 0x7f2a3814a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.977+0000 7f2a3e367700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a381595a0 0x7f2a3809b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3db66700 1 -- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a381595a0 msgr2=0x7f2a3809b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3db66700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a381595a0 0x7f2a3809b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3db66700 1 -- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 msgr2=0x7f2a3814a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3db66700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 0x7f2a3814a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3db66700 1 -- 172.21.15.84:0/634127920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a30009420 con 0x7f2a380b07a0 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3e367700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a381595a0 0x7f2a3809b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3d365700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 0x7f2a3814a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3db66700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a380b07a0 0x7f2a3809d500 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800cc10 tx=0x7f2a28001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a35ffb700 1 -- 172.21.15.84:0/634127920 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2800a990 con 0x7f2a380b07a0 2023-10-06T03:02:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a35ffb700 1 -- 172.21.15.84:0/634127920 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2800ab10 con 0x7f2a380b07a0 2023-10-06T03:02:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c009420 con 0x7f2a380b07a0 2023-10-06T03:02:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a35ffb700 1 -- 172.21.15.84:0/634127920 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28012400 con 0x7f2a380b07a0 2023-10-06T03:02:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.978+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3815b660 con 0x7f2a380b07a0 2023-10-06T03:02:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.979+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a38064ad0 con 0x7f2a380b07a0 2023-10-06T03:02:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.979+0000 7f2a35ffb700 1 -- 172.21.15.84:0/634127920 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a28012830 con 0x7f2a380b07a0 2023-10-06T03:02:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.980+0000 7f2a35ffb700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a24066f30 0x7f2a240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:19.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.980+0000 7f2a35ffb700 1 -- 172.21.15.84:0/634127920 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f2a28084bf0 con 0x7f2a380b07a0 2023-10-06T03:02:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.980+0000 7f2a3d365700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a24066f30 0x7f2a240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.980+0000 7f2a3d365700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a24066f30 0x7f2a240693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009910 tx=0x7f2a2c017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:19.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:19.984+0000 7f2a35ffb700 1 -- 172.21.15.84:0/634127920 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a28051c00 con 0x7f2a380b07a0 2023-10-06T03:02:20.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.209+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a380b1820 con 0x7f2a380b07a0 2023-10-06T03:02:20.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.209+0000 7f2a35ffb700 1 -- 172.21.15.84:0/634127920 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7f2a28055220 con 0x7f2a380b07a0 2023-10-06T03:02:20.210 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:20.210 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a24066f30 msgr2=0x7f2a240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a24066f30 0x7f2a240693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009910 tx=0x7f2a2c017000 comp rx=0 tx=0).stop 2023-10-06T03:02:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a380b07a0 msgr2=0x7f2a3809d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:20.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a380b07a0 0x7f2a3809d500 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800cc10 tx=0x7f2a28001a20 comp rx=0 tx=0).stop 2023-10-06T03:02:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 shutdown_connections 2023-10-06T03:02:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2a24066f30 0x7f2a240693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a381595a0 0x7f2a3809b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a380b07a0 0x7f2a3809d500 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 --2- 172.21.15.84:0/634127920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a380b49e0 0x7f2a3814a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.211+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 >> 172.21.15.84:0/634127920 conn(0x7f2a38099830 msgr2=0x7f2a38069390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.212+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 shutdown_connections 2023-10-06T03:02:20.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.212+0000 7f2a3fdca700 1 -- 172.21.15.84:0/634127920 wait complete. 2023-10-06T03:02:20.214 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:20.224 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:20.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.336+0000 7faeea05b700 1 Processor -- start 2023-10-06T03:02:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.336+0000 7faeea05b700 1 -- start start 2023-10-06T03:02:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.337+0000 7faeea05b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee40b2620 0x7faee40b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.337+0000 7faeea05b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faee40b29f0 0x7faee4159160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.337+0000 7faeea05b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faee41596a0 0x7faee4068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.337+0000 7faeea05b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee40cbfe0 con 0x7faee40b29f0 2023-10-06T03:02:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.337+0000 7faeea05b700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee40cb3d0 con 0x7faee41596a0 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.337+0000 7faeea05b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40cb6b0 con 0x7faee40b2620 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.337+0000 7faee2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faee40b29f0 0x7faee4159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.337+0000 7faee2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faee40b29f0 0x7faee4159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39732/0 (socket says 172.21.15.84:39732) 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.337+0000 7faee2ffd700 1 -- 172.21.15.84:0/2562594814 learned_addr learned my addr 172.21.15.84:0/2562594814 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee37fe700 1 --2- 172.21.15.84:0/2562594814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee40b2620 0x7faee40b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee3fff700 1 --2- 172.21.15.84:0/2562594814 >> v2:172.21.15.131:3300/0 conn(0x7faee41596a0 0x7faee4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee2ffd700 1 -- 172.21.15.84:0/2562594814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee40b2620 msgr2=0x7faee40b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee2ffd700 1 --2- 172.21.15.84:0/2562594814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee40b2620 0x7faee40b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee2ffd700 1 -- 172.21.15.84:0/2562594814 >> v2:172.21.15.131:3300/0 conn(0x7faee41596a0 msgr2=0x7faee4068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee2ffd700 1 --2- 172.21.15.84:0/2562594814 >> v2:172.21.15.131:3300/0 conn(0x7faee41596a0 0x7faee4068580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee2ffd700 1 -- 172.21.15.84:0/2562594814 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40cb990 con 0x7faee40b29f0 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee37fe700 1 --2- 172.21.15.84:0/2562594814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee40b2620 0x7faee40b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee3fff700 1 --2- 172.21.15.84:0/2562594814 >> v2:172.21.15.131:3300/0 conn(0x7faee41596a0 0x7faee4068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee2ffd700 1 --2- 172.21.15.84:0/2562594814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b29f0 0x7faee4159160 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7faee40cbf50 tx=0x7faed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b256a3a5e2efeaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee27fc700 1 -- 172.21.15.84:0/2562594814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800b860 con 0x7faee40b29f0 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee27fc700 1 -- 172.21.15.84:0/2562594814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed800b9c0 con 0x7faee40b29f0 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.338+0000 7faee27fc700 1 -- 172.21.15.84:0/2562594814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800bd60 con 0x7faee40b29f0 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.339+0000 7faeea05b700 1 -- 172.21.15.84:0/2562594814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b29f0 msgr2=0x7faee4159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.339+0000 7faeea05b700 1 --2- 172.21.15.84:0/2562594814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b29f0 0x7faee4159160 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7faee40cbf50 tx=0x7faed8009250 comp rx=0 tx=0).stop 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.339+0000 7faeea05b700 1 -- 172.21.15.84:0/2562594814 shutdown_connections 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.339+0000 7faeea05b700 1 --2- 172.21.15.84:0/2562594814 >> v2:172.21.15.131:3300/0 conn(0x7faee41596a0 0x7faee4068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.339+0000 7faeea05b700 1 --2- 172.21.15.84:0/2562594814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee40b2620 0x7faee40b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.339+0000 7faeea05b700 1 --2- 172.21.15.84:0/2562594814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b29f0 0x7faee4159160 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.339+0000 7faeea05b700 1 -- 172.21.15.84:0/2562594814 >> 172.21.15.84:0/2562594814 conn(0x7faee406ed20 msgr2=0x7faee406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.339+0000 7faeea05b700 1 -- 172.21.15.84:0/2562594814 shutdown_connections 2023-10-06T03:02:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.339+0000 7faeea05b700 1 -- 172.21.15.84:0/2562594814 wait complete. 2023-10-06T03:02:20.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.340+0000 7faeea05b700 1 Processor -- start 2023-10-06T03:02:20.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.340+0000 7faeea05b700 1 -- start start 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faeea05b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b2620 0x7faee4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faeea05b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faee40b29f0 0x7faee41457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faeea05b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee41596a0 0x7faee40b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faeea05b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee41575b0 con 0x7faee40b2620 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faeea05b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee4157f80 con 0x7faee40b29f0 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faeea05b700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee41564a0 con 0x7faee41596a0 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b2620 0x7faee4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b2620 0x7faee4157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39746/0 (socket says 172.21.15.84:39746) 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee37fe700 1 -- 172.21.15.84:0/3241233016 learned_addr learned my addr 172.21.15.84:0/3241233016 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee2ffd700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faee40b29f0 0x7faee41457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee3fff700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee41596a0 0x7faee40b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee37fe700 1 -- 172.21.15.84:0/3241233016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee41596a0 msgr2=0x7faee40b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee37fe700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee41596a0 0x7faee40b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee37fe700 1 -- 172.21.15.84:0/3241233016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faee40b29f0 msgr2=0x7faee41457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee37fe700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faee40b29f0 0x7faee41457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee37fe700 1 -- 172.21.15.84:0/3241233016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80094f0 con 0x7faee40b2620 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faee37fe700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b2620 0x7faee4157a40 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7faed400a4d0 tx=0x7faed40078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faecb7fe700 1 -- 172.21.15.84:0/3241233016 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4008590 con 0x7faee40b2620 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faecb7fe700 1 -- 172.21.15.84:0/3241233016 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed40086f0 con 0x7faee40b2620 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee4156c80 con 0x7faee40b2620 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faecb7fe700 1 -- 172.21.15.84:0/3241233016 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4008a90 con 0x7faee40b2620 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.341+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee4157240 con 0x7faee40b2620 2023-10-06T03:02:20.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.342+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee4064ad0 con 0x7faee40b2620 2023-10-06T03:02:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.343+0000 7faecb7fe700 1 -- 172.21.15.84:0/3241233016 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faed4014410 con 0x7faee40b2620 2023-10-06T03:02:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.343+0000 7faecb7fe700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faed0066fb0 0x7faed0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.343+0000 7faecb7fe700 1 -- 172.21.15.84:0/3241233016 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7faed40854d0 con 0x7faee40b2620 2023-10-06T03:02:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.343+0000 7faee2ffd700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faed0066fb0 0x7faed0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:20.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.344+0000 7faee2ffd700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faed0066fb0 0x7faed0069460 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7faee40cbf50 tx=0x7faed8017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:20.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.347+0000 7faecb7fe700 1 -- 172.21.15.84:0/3241233016 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faed40523c0 con 0x7faee40b2620 2023-10-06T03:02:20.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.604+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7faee40cbc70 con 0x7faee40b2620 2023-10-06T03:02:20.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.604+0000 7faecb7fe700 1 -- 172.21.15.84:0/3241233016 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1972 (secure 0 0 0) 0x7faed40559e0 con 0x7faee40b2620 2023-10-06T03:02:20.605 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:20.605 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":458,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2451845120,"bytes_avail":770642268160,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7337,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":111,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T03:02:17.895681+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faed0066fb0 msgr2=0x7faed0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faed0066fb0 0x7faed0069460 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7faee40cbf50 tx=0x7faed8017000 comp rx=0 tx=0).stop 2023-10-06T03:02:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b2620 msgr2=0x7faee4157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b2620 0x7faee4157a40 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7faed400a4d0 tx=0x7faed40078d0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 shutdown_connections 2023-10-06T03:02:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7faed0066fb0 0x7faed0069460 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faee41596a0 0x7faee40b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee40b2620 0x7faee4157a40 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 --2- 172.21.15.84:0/3241233016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faee40b29f0 0x7faee41457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 >> 172.21.15.84:0/3241233016 conn(0x7faee406ed20 msgr2=0x7faee415b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 shutdown_connections 2023-10-06T03:02:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:20.606+0000 7faeea05b700 1 -- 172.21.15.84:0/3241233016 wait complete. 2023-10-06T03:02:20.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-10-06T03:02:21.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:21.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.735+0000 7fc169fc3700 1 Processor -- start 2023-10-06T03:02:21.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.735+0000 7fc169fc3700 1 -- start start 2023-10-06T03:02:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc169fc3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1641595a0 0x7fc1640aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc169fc3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1640b0ca0 con 0x7fc1640b07a0 2023-10-06T03:02:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc169fc3700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1640b0f80 con 0x7fc1640b49e0 2023-10-06T03:02:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc169fc3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1640b1260 con 0x7fc1641595a0 2023-10-06T03:02:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc1637fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1641595a0 0x7fc1640aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc163fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc1640b07a0 0x7fc1640b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37294/0 (socket says 172.21.15.84:37294) 2023-10-06T03:02:21.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc163fff700 1 -- 172.21.15.84:0/1252318223 learned_addr learned my addr 172.21.15.84:0/1252318223 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc1637fe700 1 -- 172.21.15.84:0/1252318223 >> v1:172.21.15.131:6789/0 conn(0x7fc1640b49e0 legacy=0x7fc1640aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc1637fe700 1 -- 172.21.15.84:0/1252318223 >> v1:172.21.15.84:6789/0 conn(0x7fc1640b07a0 legacy=0x7fc1640b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc1637fe700 1 -- 172.21.15.84:0/1252318223 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640b1540 con 0x7fc1641595a0 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc1627fc700 1 -- 172.21.15.84:0/1252318223 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271822108 0 0) 0x7fc1640b0ca0 con 0x7fc1640b07a0 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.736+0000 7fc1637fe700 1 --2- 172.21.15.84:0/1252318223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 0x7fc1640aa570 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fc154009ee0 tx=0x7fc154009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54254b59e85832ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc1627fc700 1 -- 172.21.15.84:0/1252318223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400e070 con 0x7fc1641595a0 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc1627fc700 1 -- 172.21.15.84:0/1252318223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400bc10 con 0x7fc1641595a0 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc1627fc700 1 -- 172.21.15.84:0/1252318223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154012430 con 0x7fc1641595a0 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc169fc3700 1 -- 172.21.15.84:0/1252318223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 msgr2=0x7fc1640aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc169fc3700 1 --2- 172.21.15.84:0/1252318223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 0x7fc1640aa570 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fc154009ee0 tx=0x7fc154009780 comp rx=0 tx=0).stop 2023-10-06T03:02:21.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc169fc3700 1 -- 172.21.15.84:0/1252318223 shutdown_connections 2023-10-06T03:02:21.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc169fc3700 1 --2- 172.21.15.84:0/1252318223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 0x7fc1640aa570 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:21.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc169fc3700 1 -- 172.21.15.84:0/1252318223 >> 172.21.15.84:0/1252318223 conn(0x7fc164099830 msgr2=0x7fc16406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:21.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc169fc3700 1 -- 172.21.15.84:0/1252318223 shutdown_connections 2023-10-06T03:02:21.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.737+0000 7fc169fc3700 1 -- 172.21.15.84:0/1252318223 wait complete. 2023-10-06T03:02:21.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.738+0000 7fc169fc3700 1 Processor -- start 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.738+0000 7fc169fc3700 1 -- start start 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc169fc3700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1640b07a0 0x7fc164169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc169fc3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1640b49e0 0x7fc16415b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc169fc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 0x7fc1641588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc169fc3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16415bc80 con 0x7fc1641595a0 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc169fc3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16415bf60 con 0x7fc1640b49e0 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc169fc3700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16415c240 con 0x7fc1640b07a0 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc163fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 0x7fc1641588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc163fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 0x7fc1641588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39766/0 (socket says 172.21.15.84:39766) 2023-10-06T03:02:21.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc163fff700 1 -- 172.21.15.84:0/2295591147 learned_addr learned my addr 172.21.15.84:0/2295591147 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.739+0000 7fc162ffd700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1640b49e0 0x7fc16415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc1637fe700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1640b07a0 0x7fc164169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc163fff700 1 -- 172.21.15.84:0/2295591147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1640b07a0 msgr2=0x7fc164169d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc163fff700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1640b07a0 0x7fc164169d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc163fff700 1 -- 172.21.15.84:0/2295591147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1640b49e0 msgr2=0x7fc16415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc163fff700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1640b49e0 0x7fc16415b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc163fff700 1 -- 172.21.15.84:0/2295591147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154009a20 con 0x7fc1641595a0 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc163fff700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 0x7fc1641588c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c7e0 tx=0x7fc15c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc14b7fe700 1 -- 172.21.15.84:0/2295591147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c005c00 con 0x7fc1641595a0 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc14b7fe700 1 -- 172.21.15.84:0/2295591147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c005d60 con 0x7fc1641595a0 2023-10-06T03:02:21.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16415c520 con 0x7fc1641595a0 2023-10-06T03:02:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc14b7fe700 1 -- 172.21.15.84:0/2295591147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c004a80 con 0x7fc1641595a0 2023-10-06T03:02:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.740+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc164158e00 con 0x7fc1641595a0 2023-10-06T03:02:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.741+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc164064ad0 con 0x7fc1641595a0 2023-10-06T03:02:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.741+0000 7fc14b7fe700 1 -- 172.21.15.84:0/2295591147 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc15c005030 con 0x7fc1641595a0 2023-10-06T03:02:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.741+0000 7fc14b7fe700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc150066f30 0x7fc1500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.742+0000 7fc14b7fe700 1 -- 172.21.15.84:0/2295591147 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc15c083c60 con 0x7fc1641595a0 2023-10-06T03:02:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.742+0000 7fc1637fe700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc150066f30 0x7fc1500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:21.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.742+0000 7fc1637fe700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc150066f30 0x7fc1500693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc1540097c0 tx=0x7fc154018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:21.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.746+0000 7fc14b7fe700 1 -- 172.21.15.84:0/2295591147 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc15c04b5a0 con 0x7fc1641595a0 2023-10-06T03:02:21.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.974+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1640b1820 con 0x7fc1641595a0 2023-10-06T03:02:21.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.975+0000 7fc14b7fe700 1 -- 172.21.15.84:0/2295591147 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7fc15c050bf0 con 0x7fc1641595a0 2023-10-06T03:02:21.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:21.975 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:21.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc150066f30 msgr2=0x7fc1500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc150066f30 0x7fc1500693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc1540097c0 tx=0x7fc154018000 comp rx=0 tx=0).stop 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 msgr2=0x7fc1641588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 0x7fc1641588c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c7e0 tx=0x7fc15c007d90 comp rx=0 tx=0).stop 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 shutdown_connections 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc150066f30 0x7fc1500693e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1641595a0 0x7fc1641588c0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1640b07a0 0x7fc164169d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 --2- 172.21.15.84:0/2295591147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1640b49e0 0x7fc16415b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 >> 172.21.15.84:0/2295591147 conn(0x7fc164099830 msgr2=0x7fc1640b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:21.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 shutdown_connections 2023-10-06T03:02:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:21.977+0000 7fc169fc3700 1 -- 172.21.15.84:0/2295591147 wait complete. 2023-10-06T03:02:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:21.989 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:21.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:22.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.101+0000 7f261b95f700 1 Processor -- start 2023-10-06T03:02:22.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.101+0000 7f261b95f700 1 -- start start 2023-10-06T03:02:22.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f261b95f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26140caad0 0x7f261406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f261b95f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261406ed10 con 0x7f261415caf0 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f261b95f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26140cb8b0 con 0x7f26140675f0 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f261b95f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140cbb90 con 0x7f26140caad0 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f2618efa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26140caad0 0x7f261406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f26196fb700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f261415caf0 0x7f26140caff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:37300/0 (socket says 172.21.15.84:37300) 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f26196fb700 1 -- 172.21.15.84:0/4279526983 learned_addr learned my addr 172.21.15.84:0/4279526983 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f2618efa700 1 -- 172.21.15.84:0/4279526983 >> v1:172.21.15.131:6789/0 conn(0x7f26140675f0 legacy=0x7f26140679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f2618efa700 1 -- 172.21.15.84:0/4279526983 >> v1:172.21.15.84:6789/0 conn(0x7f261415caf0 legacy=0x7f26140caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f2618efa700 1 -- 172.21.15.84:0/4279526983 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261406e6c0 con 0x7f26140caad0 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f260bfff700 1 -- 172.21.15.84:0/4279526983 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962249387 0 0) 0x7f261406ed10 con 0x7f261415caf0 2023-10-06T03:02:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.102+0000 7f2618efa700 1 --2- 172.21.15.84:0/4279526983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140caad0 0x7f261406f1a0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f26040098e0 tx=0x7f26040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90556a30ee0a24c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f260bfff700 1 -- 172.21.15.84:0/4279526983 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2604009e80 con 0x7f26140caad0 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f260bfff700 1 -- 172.21.15.84:0/4279526983 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260400b820 con 0x7f26140caad0 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f260bfff700 1 -- 172.21.15.84:0/4279526983 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260400bba0 con 0x7f26140caad0 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f261b95f700 1 -- 172.21.15.84:0/4279526983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140caad0 msgr2=0x7f261406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f261b95f700 1 --2- 172.21.15.84:0/4279526983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140caad0 0x7f261406f1a0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f26040098e0 tx=0x7f26040091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f261b95f700 1 -- 172.21.15.84:0/4279526983 shutdown_connections 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f261b95f700 1 --2- 172.21.15.84:0/4279526983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26140caad0 0x7f261406f1a0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f261b95f700 1 -- 172.21.15.84:0/4279526983 >> 172.21.15.84:0/4279526983 conn(0x7f26140cdef0 msgr2=0x7f26140c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f261b95f700 1 -- 172.21.15.84:0/4279526983 shutdown_connections 2023-10-06T03:02:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.103+0000 7f261b95f700 1 -- 172.21.15.84:0/4279526983 wait complete. 2023-10-06T03:02:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.104+0000 7f261b95f700 1 Processor -- start 2023-10-06T03:02:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.104+0000 7f261b95f700 1 -- start start 2023-10-06T03:02:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f261b95f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140675f0 0x7f2614153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f261b95f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140caad0 0x7f261415cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f261b95f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261415caf0 0x7f261415d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f261b95f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261415c360 con 0x7f261415caf0 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f261b95f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614157b50 con 0x7f26140675f0 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f261b95f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261415bde0 con 0x7f26140caad0 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f2619efc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261415caf0 0x7f261415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f2619efc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261415caf0 0x7f261415d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39784/0 (socket says 172.21.15.84:39784) 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f2619efc700 1 -- 172.21.15.84:0/3802202312 learned_addr learned my addr 172.21.15.84:0/3802202312 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f26196fb700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140675f0 0x7f2614153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.105+0000 7f2618efa700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140caad0 0x7f261415cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f2619efc700 1 -- 172.21.15.84:0/3802202312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140caad0 msgr2=0x7f261415cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f2619efc700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140caad0 0x7f261415cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f2619efc700 1 -- 172.21.15.84:0/3802202312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140675f0 msgr2=0x7f2614153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f2619efc700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140675f0 0x7f2614153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f2619efc700 1 -- 172.21.15.84:0/3802202312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2604009420 con 0x7f261415caf0 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f2619efc700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261415caf0 0x7f261415d400 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f260c00bbe0 tx=0x7f260c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f26097fa700 1 -- 172.21.15.84:0/3802202312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0092e0 con 0x7f261415caf0 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f26097fa700 1 -- 172.21.15.84:0/3802202312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c00c7a0 con 0x7f261415caf0 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261415c080 con 0x7f261415caf0 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f26097fa700 1 -- 172.21.15.84:0/3802202312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00cb60 con 0x7f261415caf0 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.106+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26141577e0 con 0x7f261415caf0 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.107+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261415f2f0 con 0x7f261415caf0 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.107+0000 7f26097fa700 1 -- 172.21.15.84:0/3802202312 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f260c012070 con 0x7f261415caf0 2023-10-06T03:02:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.108+0000 7f26097fa700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.108+0000 7f26196fb700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.108+0000 7f26097fa700 1 -- 172.21.15.84:0/3802202312 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f260c084580 con 0x7f261415caf0 2023-10-06T03:02:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.108+0000 7f26196fb700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f261000c8f0 tx=0x7f2610009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:22.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.112+0000 7f26097fa700 1 -- 172.21.15.84:0/3802202312 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f260c051510 con 0x7f261415caf0 2023-10-06T03:02:22.169 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:02:22.168+0000 7fedc1127700 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T03:02:22.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.377+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2614064ad0 con 0x7f261415caf0 2023-10-06T03:02:22.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.378+0000 7f26097fa700 1 -- 172.21.15.84:0/3802202312 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1952 (secure 0 0 0) 0x7f260c054b30 con 0x7f261415caf0 2023-10-06T03:02:22.379 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:22.379 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":460,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2451845120,"bytes_avail":770642268160,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":111,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T03:02:17.895681+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:22.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 msgr2=0x7f25f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f261000c8f0 tx=0x7f2610009040 comp rx=0 tx=0).stop 2023-10-06T03:02:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261415caf0 msgr2=0x7f261415d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261415caf0 0x7f261415d400 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f260c00bbe0 tx=0x7f260c009840 comp rx=0 tx=0).stop 2023-10-06T03:02:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 shutdown_connections 2023-10-06T03:02:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f25f8066f30 0x7f25f80693e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26140675f0 0x7f2614153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f261415caf0 0x7f261415d400 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 --2- 172.21.15.84:0/3802202312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f26140caad0 0x7f261415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 >> 172.21.15.84:0/3802202312 conn(0x7f26140cdef0 msgr2=0x7f26141561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:22.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 shutdown_connections 2023-10-06T03:02:22.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:22.380+0000 7f261b95f700 1 -- 172.21.15.84:0/3802202312 wait complete. 2023-10-06T03:02:22.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-10-06T03:02:23.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:23.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.512+0000 7f60aa8ce700 1 Processor -- start 2023-10-06T03:02:23.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.512+0000 7f60aa8ce700 1 -- start start 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.513+0000 7f60aa8ce700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f60a4069720 0x7f60a4069af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.513+0000 7f60aa8ce700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a406e710 con 0x7f60a40adaa0 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.513+0000 7f60aa8ce700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a406db00 con 0x7f60a406d390 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.513+0000 7f60aa8ce700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a40cd040 con 0x7f60a4069720 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.513+0000 7f60a37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f60a40adaa0 0x7f60a40aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35590/0 (socket says 172.21.15.84:35590) 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.513+0000 7f60a37fe700 1 -- 172.21.15.84:0/3971364244 learned_addr learned my addr 172.21.15.84:0/3971364244 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a3fff700 1 --2- 172.21.15.84:0/3971364244 >> v2:172.21.15.131:3300/0 conn(0x7f60a4069720 0x7f60a4069af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893286733 0 0) 0x7f60a406e710 con 0x7f60a40adaa0 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f608c003570 con 0x7f60a40adaa0 2023-10-06T03:02:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231817732 0 0) 0x7f60a406db00 con 0x7f60a406d390 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a406e710 con 0x7f60a406d390 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 218070048 0 0) 0x7f608c003570 con 0x7f60a40adaa0 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 >> v2:172.21.15.131:3300/0 conn(0x7f60a4069720 msgr2=0x7f60a4069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 --2- 172.21.15.84:0/3971364244 >> v2:172.21.15.131:3300/0 conn(0x7f60a4069720 0x7f60a4069af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 >> v1:172.21.15.131:6789/0 conn(0x7f60a406d390 legacy=0x7f60a406eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a406dde0 con 0x7f60a40adaa0 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f6098001470 con 0x7f60a40adaa0 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 >> v1:172.21.15.84:6789/0 conn(0x7f60a40adaa0 legacy=0x7f60a40aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c003bf0 0x7f608c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c004810 0x7f608c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c0051c0 0x7f608c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40cd040 con 0x7f608c003bf0 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c00c0b0 con 0x7f608c0051c0 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c00c270 con 0x7f608c004810 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a3fff700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c003bf0 0x7f608c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a8e6b700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c0051c0 0x7f608c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a37fe700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c004810 0x7f608c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a3fff700 1 -- 172.21.15.84:0/3971364244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c004810 msgr2=0x7f608c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a3fff700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f608c004810 0x7f608c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a3fff700 1 -- 172.21.15.84:0/3971364244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c0051c0 msgr2=0x7f608c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a3fff700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c0051c0 0x7f608c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a8e6b700 1 -- 172.21.15.84:0/3971364244 reap_dead start 2023-10-06T03:02:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.514+0000 7f60a3fff700 1 -- 172.21.15.84:0/3971364244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c003570 con 0x7f608c003bf0 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60a3fff700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c003bf0 0x7f608c003fe0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f6094009c00 tx=0x7f60940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2c01e769b2c470 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400e710 con 0x7f608c003bf0 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609400e870 con 0x7f608c003bf0 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60a2ffd700 1 -- 172.21.15.84:0/3971364244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609400ec30 con 0x7f608c003bf0 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60aa8ce700 1 -- 172.21.15.84:0/3971364244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c003bf0 msgr2=0x7f608c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60aa8ce700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c003bf0 0x7f608c003fe0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f6094009c00 tx=0x7f60940091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60aa8ce700 1 -- 172.21.15.84:0/3971364244 shutdown_connections 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60aa8ce700 1 --2- 172.21.15.84:0/3971364244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f608c003bf0 0x7f608c003fe0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60aa8ce700 1 -- 172.21.15.84:0/3971364244 >> 172.21.15.84:0/3971364244 conn(0x7f60a40680c0 msgr2=0x7f60a40cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60aa8ce700 1 -- 172.21.15.84:0/3971364244 shutdown_connections 2023-10-06T03:02:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.515+0000 7f60aa8ce700 1 -- 172.21.15.84:0/3971364244 wait complete. 2023-10-06T03:02:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.516+0000 7f60aa8ce700 1 Processor -- start 2023-10-06T03:02:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60aa8ce700 1 -- start start 2023-10-06T03:02:23.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60aa8ce700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c003bf0 0x7f60a4142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60aa8ce700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60a41557e0 0x7f60a40c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60aa8ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60a4155c50 0x7f60a40c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60aa8ce700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40c2f10 con 0x7f60a4155c50 2023-10-06T03:02:23.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60aa8ce700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40c7270 con 0x7f608c003bf0 2023-10-06T03:02:23.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60aa8ce700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40bfc90 con 0x7f60a41557e0 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60a8e6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60a4155c50 0x7f60a40c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60a8e6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60a4155c50 0x7f60a40c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50752/0 (socket says 172.21.15.84:50752) 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.517+0000 7f60a8e6b700 1 -- 172.21.15.84:0/1830122721 learned_addr learned my addr 172.21.15.84:0/1830122721 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60a3fff700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c003bf0 0x7f60a4142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60a37fe700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60a41557e0 0x7f60a40c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60a8e6b700 1 -- 172.21.15.84:0/1830122721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60a41557e0 msgr2=0x7f60a40c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60a8e6b700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60a41557e0 0x7f60a40c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60a8e6b700 1 -- 172.21.15.84:0/1830122721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c003bf0 msgr2=0x7f60a4142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60a8e6b700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c003bf0 0x7f60a4142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60a8e6b700 1 -- 172.21.15.84:0/1830122721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40bff70 con 0x7f60a4155c50 2023-10-06T03:02:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60a3fff700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c003bf0 0x7f60a4142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60a8e6b700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60a4155c50 0x7f60a40c7c40 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f60a40ade70 tx=0x7f609c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f608bfff700 1 -- 172.21.15.84:0/1830122721 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c017070 con 0x7f60a4155c50 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f608bfff700 1 -- 172.21.15.84:0/1830122721 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c006ba0 con 0x7f60a4155c50 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f608bfff700 1 -- 172.21.15.84:0/1830122721 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0032e0 con 0x7f60a4155c50 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a40c0250 con 0x7f60a4155c50 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.518+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a416d2a0 con 0x7f60a4155c50 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.519+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a4069e30 con 0x7f60a4155c50 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.519+0000 7f608bfff700 1 -- 172.21.15.84:0/1830122721 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f609c001680 con 0x7f60a4155c50 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.520+0000 7f608bfff700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6090066f30 0x7f60900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.520+0000 7f608bfff700 1 -- 172.21.15.84:0/1830122721 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f609c0841b0 con 0x7f60a4155c50 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.520+0000 7f60a3fff700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6090066f30 0x7f60900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.520+0000 7f60a3fff700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6090066f30 0x7f60900693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f60940091e0 tx=0x7f609401a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.524+0000 7f608bfff700 1 -- 172.21.15.84:0/1830122721 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f609c054bd0 con 0x7f60a4155c50 2023-10-06T03:02:23.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.748+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a40b2060 con 0x7f60a4155c50 2023-10-06T03:02:23.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.748+0000 7f608bfff700 1 -- 172.21.15.84:0/1830122721 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7f609c054760 con 0x7f60a4155c50 2023-10-06T03:02:23.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:23.749 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6090066f30 msgr2=0x7f60900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6090066f30 0x7f60900693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f60940091e0 tx=0x7f609401a000 comp rx=0 tx=0).stop 2023-10-06T03:02:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60a4155c50 msgr2=0x7f60a40c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60a4155c50 0x7f60a40c7c40 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f60a40ade70 tx=0x7f609c009040 comp rx=0 tx=0).stop 2023-10-06T03:02:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 shutdown_connections 2023-10-06T03:02:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6090066f30 0x7f60900693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f608c003bf0 0x7f60a4142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60a4155c50 0x7f60a40c7c40 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 --2- 172.21.15.84:0/1830122721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60a41557e0 0x7f60a40c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 >> 172.21.15.84:0/1830122721 conn(0x7f60a40680c0 msgr2=0x7f60a40c5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 shutdown_connections 2023-10-06T03:02:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.750+0000 7f60aa8ce700 1 -- 172.21.15.84:0/1830122721 wait complete. 2023-10-06T03:02:23.752 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:23.762 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:23.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:23.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.876+0000 7fb1b759e700 1 Processor -- start 2023-10-06T03:02:23.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.876+0000 7fb1b759e700 1 -- start start 2023-10-06T03:02:23.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b80cd370 0x7fb1b80ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b759e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb1b80c6260 0x7fb1b80cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b759e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b80cc840 con 0x7fb1b81594b0 2023-10-06T03:02:23.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b759e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b80cbc70 con 0x7fb1b80c6260 2023-10-06T03:02:23.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80cf440 con 0x7fb1b80cd370 2023-10-06T03:02:23.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb1b81594b0 0x7fb1b80ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35604/0 (socket says 172.21.15.84:35604) 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b659c700 1 -- 172.21.15.84:0/966784986 learned_addr learned my addr 172.21.15.84:0/966784986 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516029715 0 0) 0x7fb1b80cc840 con 0x7fb1b81594b0 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a4003570 con 0x7fb1b81594b0 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1add9b700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b80cd370 0x7fb1b80ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b6d9d700 1 --2- 172.21.15.84:0/966784986 >> v2:172.21.15.131:3300/0 conn(0x7fb1b80c6260 0x7fb1b80cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 670006085 0 0) 0x7fb1a4003570 con 0x7fb1b81594b0 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b80cd370 msgr2=0x7fb1b80ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b5d9b700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b80cd370 0x7fb1b80ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 >> v2:172.21.15.131:3300/0 conn(0x7fb1b80c6260 msgr2=0x7fb1b80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.877+0000 7fb1b5d9b700 1 --2- 172.21.15.84:0/966784986 >> v2:172.21.15.131:3300/0 conn(0x7fb1b80c6260 0x7fb1b80cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80cbf10 con 0x7fb1b81594b0 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fb1a80015f0 con 0x7fb1b81594b0 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 >> v1:172.21.15.84:6789/0 conn(0x7fb1b81594b0 legacy=0x7fb1b80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a4004810 0x7fb1a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b80cd370 0x7fb1a4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80cbc70 con 0x7fb1a4003a60 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80cf440 con 0x7fb1a4004810 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a400bc20 con 0x7fb1b80cd370 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b659c700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1add9b700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a4004810 0x7fb1a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b6d9d700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b80cd370 0x7fb1a4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b659c700 1 -- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b80cd370 msgr2=0x7fb1a4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b659c700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b80cd370 0x7fb1a4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b659c700 1 -- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a4004810 msgr2=0x7fb1a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b659c700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a4004810 0x7fb1a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b659c700 1 -- 172.21.15.84:0/966784986 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4003570 con 0x7fb1a4003a60 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b659c700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1a4003e70 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800c3c0 tx=0x7fb1a8007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bcad5bad424ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800cc90 con 0x7fb1a4003a60 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a800ce10 con 0x7fb1a4003a60 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.878+0000 7fb1b5d9b700 1 -- 172.21.15.84:0/966784986 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8007320 con 0x7fb1a4003a60 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.879+0000 7fb1b759e700 1 -- 172.21.15.84:0/966784986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 msgr2=0x7fb1a4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.879+0000 7fb1b759e700 1 --2- 172.21.15.84:0/966784986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1a4003e70 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800c3c0 tx=0x7fb1a8007920 comp rx=0 tx=0).stop 2023-10-06T03:02:23.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.879+0000 7fb1b6d9d700 1 -- 172.21.15.84:0/966784986 reap_dead start 2023-10-06T03:02:23.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.879+0000 7fb1b759e700 1 -- 172.21.15.84:0/966784986 shutdown_connections 2023-10-06T03:02:23.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.879+0000 7fb1b759e700 1 -- 172.21.15.84:0/966784986 >> 172.21.15.84:0/966784986 conn(0x7fb1b8099600 msgr2=0x7fb1b806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:23.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.879+0000 7fb1b759e700 1 -- 172.21.15.84:0/966784986 shutdown_connections 2023-10-06T03:02:23.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.879+0000 7fb1b759e700 1 -- 172.21.15.84:0/966784986 wait complete. 2023-10-06T03:02:23.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.880+0000 7fb1b759e700 1 Processor -- start 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.880+0000 7fb1b759e700 1 -- start start 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1b816ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b759e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b815d490 0x7fb1b80c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1b80c8b00 0x7fb1b8154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b759e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8159880 con 0x7fb1a4003a60 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8159ad0 con 0x7fb1b80c8b00 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b759e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8159db0 con 0x7fb1b815d490 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1b816ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1b816ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50764/0 (socket says 172.21.15.84:50764) 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b659c700 1 -- 172.21.15.84:0/2805083430 learned_addr learned my addr 172.21.15.84:0/2805083430 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:23.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b6d9d700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1b80c8b00 0x7fb1b8154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1add9b700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b815d490 0x7fb1b80c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b659c700 1 -- 172.21.15.84:0/2805083430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b815d490 msgr2=0x7fb1b80c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b659c700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b815d490 0x7fb1b80c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b659c700 1 -- 172.21.15.84:0/2805083430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1b80c8b00 msgr2=0x7fb1b8154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b659c700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1b80c8b00 0x7fb1b8154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b659c700 1 -- 172.21.15.84:0/2805083430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b815a090 con 0x7fb1a4003a60 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1add9b700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b815d490 0x7fb1b80c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1b659c700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1b816ce60 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40057a0 tx=0x7fb1a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1aeffd700 1 -- 172.21.15.84:0/2805083430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800cc90 con 0x7fb1a4003a60 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.881+0000 7fb1aeffd700 1 -- 172.21.15.84:0/2805083430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a800c9e0 con 0x7fb1a4003a60 2023-10-06T03:02:23.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.882+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b815a370 con 0x7fb1a4003a60 2023-10-06T03:02:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.882+0000 7fb1aeffd700 1 -- 172.21.15.84:0/2805083430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8001da0 con 0x7fb1a4003a60 2023-10-06T03:02:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.882+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b816d3a0 con 0x7fb1a4003a60 2023-10-06T03:02:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.883+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b815a810 con 0x7fb1a4003a60 2023-10-06T03:02:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.883+0000 7fb1aeffd700 1 -- 172.21.15.84:0/2805083430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1a8005c10 con 0x7fb1a4003a60 2023-10-06T03:02:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.883+0000 7fb1aeffd700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb198066f30 0x7fb1980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.883+0000 7fb1add9b700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb198066f30 0x7fb1980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.883+0000 7fb1aeffd700 1 -- 172.21.15.84:0/2805083430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fb1a80852b0 con 0x7fb1a4003a60 2023-10-06T03:02:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.884+0000 7fb1add9b700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb198066f30 0x7fb1980693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0006ea0 tx=0x7fb1a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:23.888+0000 7fb1aeffd700 1 -- 172.21.15.84:0/2805083430 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1a8052240 con 0x7fb1a4003a60 2023-10-06T03:02:24.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.147+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb1b815a9c0 con 0x7fb1a4003a60 2023-10-06T03:02:24.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.147+0000 7fb1aeffd700 1 -- 172.21.15.84:0/2805083430 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1952 (secure 0 0 0) 0x7fb1a8002d40 con 0x7fb1a4003a60 2023-10-06T03:02:24.148 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:24.148 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":461,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2451845120,"bytes_avail":770642268160,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":111,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T03:02:17.895681+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:24.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb198066f30 msgr2=0x7fb1980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb198066f30 0x7fb1980693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0006ea0 tx=0x7fb1a0008040 comp rx=0 tx=0).stop 2023-10-06T03:02:24.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 msgr2=0x7fb1b816ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1b816ce60 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40057a0 tx=0x7fb1a8015000 comp rx=0 tx=0).stop 2023-10-06T03:02:24.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 shutdown_connections 2023-10-06T03:02:24.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb198066f30 0x7fb1980693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1b80c8b00 0x7fb1b8154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a4003a60 0x7fb1b816ce60 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 --2- 172.21.15.84:0/2805083430 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1b815d490 0x7fb1b80c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 >> 172.21.15.84:0/2805083430 conn(0x7fb1b8099600 msgr2=0x7fb1b80b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:24.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 shutdown_connections 2023-10-06T03:02:24.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:24.149+0000 7fb1b759e700 1 -- 172.21.15.84:0/2805083430 wait complete. 2023-10-06T03:02:24.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-10-06T03:02:25.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:25.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.284+0000 7f2189171700 1 Processor -- start 2023-10-06T03:02:25.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.284+0000 7f2189171700 1 -- start start 2023-10-06T03:02:25.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.285+0000 7f2189171700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 0x7f21840aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.285+0000 7f2189171700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21840b07a0 0x7f21840b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.285+0000 7f2189171700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21840b0ca0 con 0x7f21840b49e0 2023-10-06T03:02:25.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.285+0000 7f2189171700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21840b0f80 con 0x7f21840b07a0 2023-10-06T03:02:25.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.285+0000 7f2189171700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21840b1260 con 0x7f21841595a0 2023-10-06T03:02:25.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f2182d9d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 0x7f21840aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f218359e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21840b07a0 0x7f21840b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f217a59c700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f21840b49e0 0x7f21840aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:52498/0 (socket says 172.21.15.84:52498) 2023-10-06T03:02:25.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f217a59c700 1 -- 172.21.15.84:0/1047541991 learned_addr learned my addr 172.21.15.84:0/1047541991 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:25.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f218259c700 1 -- 172.21.15.84:0/1047541991 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339977983 0 0) 0x7f21840b0ca0 con 0x7f21840b49e0 2023-10-06T03:02:25.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f218259c700 1 -- 172.21.15.84:0/1047541991 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2170003570 con 0x7f21840b49e0 2023-10-06T03:02:25.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f2182d9d700 1 -- 172.21.15.84:0/1047541991 >> v2:172.21.15.131:3300/0 conn(0x7f21840b07a0 msgr2=0x7f21840b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:25.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f2182d9d700 1 --2- 172.21.15.84:0/1047541991 >> v2:172.21.15.131:3300/0 conn(0x7f21840b07a0 0x7f21840b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f2182d9d700 1 -- 172.21.15.84:0/1047541991 >> v1:172.21.15.131:6789/0 conn(0x7f21840b49e0 legacy=0x7f21840aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f2182d9d700 1 -- 172.21.15.84:0/1047541991 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840b1540 con 0x7f21841595a0 2023-10-06T03:02:25.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f218359e700 1 --2- 172.21.15.84:0/1047541991 >> v2:172.21.15.131:3300/0 conn(0x7f21840b07a0 0x7f21840b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:25.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.286+0000 7f2182d9d700 1 --2- 172.21.15.84:0/1047541991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 0x7f21840aa570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21740098d0 tx=0x7f2174009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe659f9b0a108c89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f218259c700 1 -- 172.21.15.84:0/1047541991 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174005c10 con 0x7f21841595a0 2023-10-06T03:02:25.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f218259c700 1 -- 172.21.15.84:0/1047541991 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174005d70 con 0x7f21841595a0 2023-10-06T03:02:25.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f218259c700 1 -- 172.21.15.84:0/1047541991 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174006260 con 0x7f21841595a0 2023-10-06T03:02:25.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f2189171700 1 -- 172.21.15.84:0/1047541991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 msgr2=0x7f21840aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f2189171700 1 --2- 172.21.15.84:0/1047541991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 0x7f21840aa570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21740098d0 tx=0x7f2174009120 comp rx=0 tx=0).stop 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f2189171700 1 -- 172.21.15.84:0/1047541991 shutdown_connections 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f2189171700 1 --2- 172.21.15.84:0/1047541991 >> v2:172.21.15.131:3300/0 conn(0x7f21840b07a0 0x7f21840b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f2189171700 1 --2- 172.21.15.84:0/1047541991 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 0x7f21840aa570 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f2189171700 1 -- 172.21.15.84:0/1047541991 >> 172.21.15.84:0/1047541991 conn(0x7f2184099830 msgr2=0x7f218406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f2189171700 1 -- 172.21.15.84:0/1047541991 shutdown_connections 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.287+0000 7f2189171700 1 -- 172.21.15.84:0/1047541991 wait complete. 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.288+0000 7f2189171700 1 Processor -- start 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2189171700 1 -- start start 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2189171700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21840b07a0 0x7f21840ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2189171700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21840b49e0 0x7f21840ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2189171700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 0x7f2184169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2189171700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218409b210 con 0x7f21840b07a0 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2189171700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184159160 con 0x7f21840b49e0 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2189171700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21840abe50 con 0x7f21841595a0 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2182d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21840b07a0 0x7f21840ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2182d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21840b07a0 0x7f21840ab3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50772/0 (socket says 172.21.15.84:50772) 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f2182d9d700 1 -- 172.21.15.84:0/3912572824 learned_addr learned my addr 172.21.15.84:0/3912572824 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f218359e700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 0x7f2184169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.289+0000 7f217a59c700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21840b49e0 0x7f21840ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f2182d9d700 1 -- 172.21.15.84:0/3912572824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 msgr2=0x7f2184169910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f2182d9d700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 0x7f2184169910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f2182d9d700 1 -- 172.21.15.84:0/3912572824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21840b49e0 msgr2=0x7f21840ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f2182d9d700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21840b49e0 0x7f21840ab910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f2182d9d700 1 -- 172.21.15.84:0/3912572824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c009a20 con 0x7f21840b07a0 2023-10-06T03:02:25.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f2182d9d700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21840b07a0 0x7f21840ab3d0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f2174009ec0 tx=0x7f2174016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f217b7fe700 1 -- 172.21.15.84:0/3912572824 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217401d910 con 0x7f21840b07a0 2023-10-06T03:02:25.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f217b7fe700 1 -- 172.21.15.84:0/3912572824 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217401da90 con 0x7f21840b07a0 2023-10-06T03:02:25.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f217b7fe700 1 -- 172.21.15.84:0/3912572824 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217401de50 con 0x7f21840b07a0 2023-10-06T03:02:25.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21740093c0 con 0x7f21840b07a0 2023-10-06T03:02:25.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.290+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21840ac400 con 0x7f21840b07a0 2023-10-06T03:02:25.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.291+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2184064ad0 con 0x7f21840b07a0 2023-10-06T03:02:25.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.291+0000 7f217b7fe700 1 -- 172.21.15.84:0/3912572824 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f217401b690 con 0x7f21840b07a0 2023-10-06T03:02:25.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.292+0000 7f217b7fe700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.292+0000 7f217a59c700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.292+0000 7f217b7fe700 1 -- 172.21.15.84:0/3912572824 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f2174086400 con 0x7f21840b07a0 2023-10-06T03:02:25.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.292+0000 7f217a59c700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2164066f30 0x7f21640693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f21840cfa00 tx=0x7f216c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.296+0000 7f217b7fe700 1 -- 172.21.15.84:0/3912572824 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2174053450 con 0x7f21840b07a0 2023-10-06T03:02:25.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.522+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21840b1820 con 0x7f21840b07a0 2023-10-06T03:02:25.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.522+0000 7f217b7fe700 1 -- 172.21.15.84:0/3912572824 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7f2174056a70 con 0x7f21840b07a0 2023-10-06T03:02:25.523 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:25.523 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2164066f30 msgr2=0x7f21640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2164066f30 0x7f21640693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f21840cfa00 tx=0x7f216c009040 comp rx=0 tx=0).stop 2023-10-06T03:02:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21840b07a0 msgr2=0x7f21840ab3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21840b07a0 0x7f21840ab3d0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f2174009ec0 tx=0x7f2174016000 comp rx=0 tx=0).stop 2023-10-06T03:02:25.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 shutdown_connections 2023-10-06T03:02:25.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2164066f30 0x7f21640693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21841595a0 0x7f2184169910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21840b07a0 0x7f21840ab3d0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 --2- 172.21.15.84:0/3912572824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21840b49e0 0x7f21840ab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 >> 172.21.15.84:0/3912572824 conn(0x7f2184099830 msgr2=0x7f2184068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:25.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 shutdown_connections 2023-10-06T03:02:25.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.524+0000 7f2189171700 1 -- 172.21.15.84:0/3912572824 wait complete. 2023-10-06T03:02:25.526 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:25.536 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:25.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:25.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.649+0000 7f2fbb59e700 1 Processor -- start 2023-10-06T03:02:25.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.649+0000 7f2fbb59e700 1 -- start start 2023-10-06T03:02:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbb59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2fbc159480 0x7f2fbc0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbb59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2fbc0b2140 0x7f2fbc0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbb59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0cb7e0 con 0x7f2fbc0b3610 2023-10-06T03:02:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbb59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b08a0 con 0x7f2fbc0b2140 2023-10-06T03:02:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbb59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0cb190 con 0x7f2fbc159480 2023-10-06T03:02:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2fbc0b2140 0x7f2fbc0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2fbc0b2140 0x7f2fbc0b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50776/0 (socket says 172.21.15.84:50776) 2023-10-06T03:02:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbad9d700 1 -- 172.21.15.84:0/1475534979 learned_addr learned my addr 172.21.15.84:0/1475534979 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:25.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fba59c700 1 --2- 172.21.15.84:0/1475534979 >> v2:172.21.15.131:3300/0 conn(0x7f2fbc159480 0x7f2fbc0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbad9d700 1 -- 172.21.15.84:0/1475534979 >> v2:172.21.15.131:3300/0 conn(0x7f2fbc159480 msgr2=0x7f2fbc0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbad9d700 1 --2- 172.21.15.84:0/1475534979 >> v2:172.21.15.131:3300/0 conn(0x7f2fbc159480 0x7f2fbc0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbad9d700 1 -- 172.21.15.84:0/1475534979 >> v1:172.21.15.131:6789/0 conn(0x7f2fbc0b3610 legacy=0x7f2fbc0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.650+0000 7f2fbad9d700 1 -- 172.21.15.84:0/1475534979 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0cb470 con 0x7f2fbc0b2140 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fbad9d700 1 --2- 172.21.15.84:0/1475534979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b2140 0x7f2fbc0b2560 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc06fa30 tx=0x7f2fb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47e1cb25526bb7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fb959a700 1 -- 172.21.15.84:0/1475534979 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400b820 con 0x7f2fbc0b2140 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fb959a700 1 -- 172.21.15.84:0/1475534979 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb400b980 con 0x7f2fbc0b2140 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fb959a700 1 -- 172.21.15.84:0/1475534979 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400bd20 con 0x7f2fbc0b2140 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fbb59e700 1 -- 172.21.15.84:0/1475534979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b2140 msgr2=0x7f2fbc0b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fbb59e700 1 --2- 172.21.15.84:0/1475534979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b2140 0x7f2fbc0b2560 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc06fa30 tx=0x7f2fb4009250 comp rx=0 tx=0).stop 2023-10-06T03:02:25.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fbb59e700 1 -- 172.21.15.84:0/1475534979 shutdown_connections 2023-10-06T03:02:25.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fbb59e700 1 --2- 172.21.15.84:0/1475534979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b2140 0x7f2fbc0b2560 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fbb59e700 1 --2- 172.21.15.84:0/1475534979 >> v2:172.21.15.131:3300/0 conn(0x7f2fbc159480 0x7f2fbc0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fbb59e700 1 -- 172.21.15.84:0/1475534979 >> 172.21.15.84:0/1475534979 conn(0x7f2fbc06ed20 msgr2=0x7f2fbc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:25.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fbb59e700 1 -- 172.21.15.84:0/1475534979 shutdown_connections 2023-10-06T03:02:25.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.651+0000 7f2fbb59e700 1 -- 172.21.15.84:0/1475534979 wait complete. 2023-10-06T03:02:25.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.652+0000 7f2fbb59e700 1 Processor -- start 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.652+0000 7f2fbb59e700 1 -- start start 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fbb59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fbc0b2140 0x7f2fbc14b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fbb59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b3610 0x7f2fbc15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fbb59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2fbc159480 0x7f2fbc15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fbb59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c5d40 con 0x7f2fbc0b3610 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fbb59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c5130 con 0x7f2fbc0b2140 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fbb59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c5410 con 0x7f2fbc159480 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fb9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b3610 0x7f2fbc15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fb9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b3610 0x7f2fbc15bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50790/0 (socket says 172.21.15.84:50790) 2023-10-06T03:02:25.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fb9d9b700 1 -- 172.21.15.84:0/4044263098 learned_addr learned my addr 172.21.15.84:0/4044263098 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fba59c700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fbc0b2140 0x7f2fbc14b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.653+0000 7f2fbad9d700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2fbc159480 0x7f2fbc15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2fb9d9b700 1 -- 172.21.15.84:0/4044263098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2fbc159480 msgr2=0x7f2fbc15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2fb9d9b700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2fbc159480 0x7f2fbc15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2fb9d9b700 1 -- 172.21.15.84:0/4044263098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fbc0b2140 msgr2=0x7f2fbc14b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2fb9d9b700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fbc0b2140 0x7f2fbc14b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2fb9d9b700 1 -- 172.21.15.84:0/4044263098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb40094f0 con 0x7f2fbc0b3610 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2fb9d9b700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b3610 0x7f2fbc15bbf0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000c5d0 tx=0x7f2fb0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2faa7fc700 1 -- 172.21.15.84:0/4044263098 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011590 con 0x7f2fbc0b3610 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2faa7fc700 1 -- 172.21.15.84:0/4044263098 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb0011710 con 0x7f2fbc0b3610 2023-10-06T03:02:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc0c56f0 con 0x7f2fbc0b3610 2023-10-06T03:02:25.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2faa7fc700 1 -- 172.21.15.84:0/4044263098 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011ad0 con 0x7f2fbc0b3610 2023-10-06T03:02:25.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.654+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc14bb70 con 0x7f2fbc0b3610 2023-10-06T03:02:25.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.655+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc05f270 con 0x7f2fbc0b3610 2023-10-06T03:02:25.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.655+0000 7f2faa7fc700 1 -- 172.21.15.84:0/4044263098 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fb001c460 con 0x7f2fbc0b3610 2023-10-06T03:02:25.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.656+0000 7f2faa7fc700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f9c066f30 0x7f2f9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.656+0000 7f2faa7fc700 1 -- 172.21.15.84:0/4044263098 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f2fb0084490 con 0x7f2fbc0b3610 2023-10-06T03:02:25.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.656+0000 7f2fba59c700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f9c066f30 0x7f2f9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.656+0000 7f2fba59c700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f9c066f30 0x7f2f9c0693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc15c810 tx=0x7f2fac0097e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.660+0000 7f2faa7fc700 1 -- 172.21.15.84:0/4044263098 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fb0051420 con 0x7f2fbc0b3610 2023-10-06T03:02:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.917+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2fbc159850 con 0x7f2fbc0b3610 2023-10-06T03:02:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.917+0000 7f2faa7fc700 1 -- 172.21.15.84:0/4044263098 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1970 (secure 0 0 0) 0x7f2fb0054a40 con 0x7f2fbc0b3610 2023-10-06T03:02:25.919 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:25.919 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":463,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2451845120,"bytes_avail":770642268160,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":111,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2023-10-06T03:02:23.897073+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f9c066f30 msgr2=0x7f2f9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f9c066f30 0x7f2f9c0693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc15c810 tx=0x7f2fac0097e0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b3610 msgr2=0x7f2fbc15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b3610 0x7f2fbc15bbf0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000c5d0 tx=0x7f2fb0007f60 comp rx=0 tx=0).stop 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 shutdown_connections 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f9c066f30 0x7f2f9c0693e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fbc0b2140 0x7f2fbc14b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2fbc159480 0x7f2fbc15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 --2- 172.21.15.84:0/4044263098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fbc0b3610 0x7f2fbc15bbf0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 >> 172.21.15.84:0/4044263098 conn(0x7f2fbc06ed20 msgr2=0x7f2fbc0ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:25.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 shutdown_connections 2023-10-06T03:02:25.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:25.919+0000 7f2fbb59e700 1 -- 172.21.15.84:0/4044263098 wait complete. 2023-10-06T03:02:25.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'b': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2023-10-06T03:02:26.933 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.057+0000 7fe7b30f7700 1 Processor -- start 2023-10-06T03:02:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.057+0000 7fe7b30f7700 1 -- start start 2023-10-06T03:02:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.058+0000 7fe7b30f7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe7ac156390 0x7fe7ac0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.058+0000 7fe7b30f7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac06c780 con 0x7fe7ac0cc750 2023-10-06T03:02:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.058+0000 7fe7b30f7700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac06c9e0 con 0x7fe7ac06c370 2023-10-06T03:02:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.058+0000 7fe7b30f7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac0ccbd0 con 0x7fe7ac156390 2023-10-06T03:02:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.058+0000 7fe7b0e93700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe7ac156390 0x7fe7ac0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.058+0000 7fe7a3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe7ac0cc750 0x7fe7ac06bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35616/0 (socket says 172.21.15.84:35616) 2023-10-06T03:02:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.058+0000 7fe7a3fff700 1 -- 172.21.15.84:0/140742312 learned_addr learned my addr 172.21.15.84:0/140742312 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.059+0000 7fe7b0e93700 1 -- 172.21.15.84:0/140742312 >> v1:172.21.15.131:6789/0 conn(0x7fe7ac06c370 legacy=0x7fe7ac0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.059+0000 7fe7b0e93700 1 -- 172.21.15.84:0/140742312 >> v1:172.21.15.84:6789/0 conn(0x7fe7ac0cc750 legacy=0x7fe7ac06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.059+0000 7fe7b0e93700 1 -- 172.21.15.84:0/140742312 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac156b60 con 0x7fe7ac156390 2023-10-06T03:02:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.059+0000 7fe7a37fe700 1 -- 172.21.15.84:0/140742312 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889532176 0 0) 0x7fe7ac06c780 con 0x7fe7ac0cc750 2023-10-06T03:02:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.059+0000 7fe7b0e93700 1 --2- 172.21.15.84:0/140742312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac156390 0x7fe7ac0cc210 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009e60 tx=0x7fe7a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e082f01466b75a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.059+0000 7fe7a37fe700 1 -- 172.21.15.84:0/140742312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800e070 con 0x7fe7ac156390 2023-10-06T03:02:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.059+0000 7fe7a37fe700 1 -- 172.21.15.84:0/140742312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a800bbf0 con 0x7fe7ac156390 2023-10-06T03:02:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.059+0000 7fe7a37fe700 1 -- 172.21.15.84:0/140742312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8012430 con 0x7fe7ac156390 2023-10-06T03:02:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.060+0000 7fe7b30f7700 1 -- 172.21.15.84:0/140742312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac156390 msgr2=0x7fe7ac0cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.060+0000 7fe7b30f7700 1 --2- 172.21.15.84:0/140742312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac156390 0x7fe7ac0cc210 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009e60 tx=0x7fe7a8009780 comp rx=0 tx=0).stop 2023-10-06T03:02:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.060+0000 7fe7b30f7700 1 -- 172.21.15.84:0/140742312 shutdown_connections 2023-10-06T03:02:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.060+0000 7fe7b30f7700 1 --2- 172.21.15.84:0/140742312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac156390 0x7fe7ac0cc210 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.060+0000 7fe7b30f7700 1 -- 172.21.15.84:0/140742312 >> 172.21.15.84:0/140742312 conn(0x7fe7ac0cdef0 msgr2=0x7fe7ac0c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.060+0000 7fe7b30f7700 1 -- 172.21.15.84:0/140742312 shutdown_connections 2023-10-06T03:02:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.060+0000 7fe7b30f7700 1 -- 172.21.15.84:0/140742312 wait complete. 2023-10-06T03:02:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.061+0000 7fe7b30f7700 1 Processor -- start 2023-10-06T03:02:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.061+0000 7fe7b30f7700 1 -- start start 2023-10-06T03:02:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7b30f7700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7ac06c370 0x7fe7ac0a7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7b30f7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac0cc750 0x7fe7ac16afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7b30f7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ac156390 0x7fe7ac147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7b30f7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0a5800 con 0x7fe7ac0cc750 2023-10-06T03:02:27.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7b30f7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac16b510 con 0x7fe7ac156390 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7b30f7700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0a54d0 con 0x7fe7ac06c370 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac0cc750 0x7fe7ac16afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac0cc750 0x7fe7ac16afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50816/0 (socket says 172.21.15.84:50816) 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7a3fff700 1 -- 172.21.15.84:0/2587258217 learned_addr learned my addr 172.21.15.84:0/2587258217 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7a3fff700 1 -- 172.21.15.84:0/2587258217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7ac06c370 msgr2=0x7fe7ac0a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7b0e93700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7ac06c370 0x7fe7ac0a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7b1694700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ac156390 0x7fe7ac147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7a3fff700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7ac06c370 0x7fe7ac0a7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7a3fff700 1 -- 172.21.15.84:0/2587258217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ac156390 msgr2=0x7fe7ac147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7a3fff700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ac156390 0x7fe7ac147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7a3fff700 1 -- 172.21.15.84:0/2587258217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8009a20 con 0x7fe7ac0cc750 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.062+0000 7fe7a3fff700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac0cc750 0x7fe7ac16afd0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c7e0 tx=0x7fe79c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.063+0000 7fe7a0ff9700 1 -- 172.21.15.84:0/2587258217 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c005b30 con 0x7fe7ac0cc750 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.063+0000 7fe7a0ff9700 1 -- 172.21.15.84:0/2587258217 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c005c90 con 0x7fe7ac0cc750 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.063+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac16b790 con 0x7fe7ac0cc750 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.063+0000 7fe7a0ff9700 1 -- 172.21.15.84:0/2587258217 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c007300 con 0x7fe7ac0cc750 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.063+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac16bd50 con 0x7fe7ac0cc750 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.064+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac064ad0 con 0x7fe7ac0cc750 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.064+0000 7fe7a0ff9700 1 -- 172.21.15.84:0/2587258217 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe79c01b400 con 0x7fe7ac0cc750 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.064+0000 7fe7a0ff9700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe798066f30 0x7fe7980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.064+0000 7fe7a0ff9700 1 -- 172.21.15.84:0/2587258217 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe79c084330 con 0x7fe7ac0cc750 2023-10-06T03:02:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.064+0000 7fe7b0e93700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe798066f30 0x7fe7980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.065+0000 7fe7b0e93700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe798066f30 0x7fe7980693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099f0 tx=0x7fe7a8018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.069+0000 7fe7a0ff9700 1 -- 172.21.15.84:0/2587258217 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe79c051340 con 0x7fe7ac0cc750 2023-10-06T03:02:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.298+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7ac0c7bf0 con 0x7fe7ac0cc750 2023-10-06T03:02:27.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.298+0000 7fe7a0ff9700 1 -- 172.21.15.84:0/2587258217 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7fe79c054960 con 0x7fe7ac0cc750 2023-10-06T03:02:27.300 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:27.300 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.300+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe798066f30 msgr2=0x7fe7980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.300+0000 7fe7b30f7700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe798066f30 0x7fe7980693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099f0 tx=0x7fe7a8018000 comp rx=0 tx=0).stop 2023-10-06T03:02:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.300+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac0cc750 msgr2=0x7fe7ac16afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.300+0000 7fe7b30f7700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac0cc750 0x7fe7ac16afd0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c7e0 tx=0x7fe79c007df0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.300+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 shutdown_connections 2023-10-06T03:02:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.300+0000 7fe7b30f7700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fe798066f30 0x7fe7980693e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.300+0000 7fe7b30f7700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ac156390 0x7fe7ac147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.300+0000 7fe7b30f7700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7ac06c370 0x7fe7ac0a7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.300+0000 7fe7b30f7700 1 --2- 172.21.15.84:0/2587258217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac0cc750 0x7fe7ac16afd0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.301+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 >> 172.21.15.84:0/2587258217 conn(0x7fe7ac0cdef0 msgr2=0x7fe7ac154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.301+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 shutdown_connections 2023-10-06T03:02:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.301+0000 7fe7b30f7700 1 -- 172.21.15.84:0/2587258217 wait complete. 2023-10-06T03:02:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:27.314 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:27.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:27.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.427+0000 7f1154856700 1 Processor -- start 2023-10-06T03:02:27.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.427+0000 7f1154856700 1 -- start start 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f1154856700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1150159480 0x7f11500b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f1154856700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11500b3610 0x7f11500cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f1154856700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11500cb7e0 con 0x7f11500cc1b0 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f1154856700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11500b08a0 con 0x7f1150159480 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f1154856700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11500cb190 con 0x7f11500b3610 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f114f59e700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f11500cc1b0 0x7f11500b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:52522/0 (socket says 172.21.15.84:52522) 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f114e59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11500b3610 0x7f11500cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f114ed9d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1150159480 0x7f11500b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f114f59e700 1 -- 172.21.15.84:0/1608436802 learned_addr learned my addr 172.21.15.84:0/1608436802 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:27.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f114ed9d700 1 -- 172.21.15.84:0/1608436802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11500b3610 msgr2=0x7f11500cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f114ed9d700 1 --2- 172.21.15.84:0/1608436802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11500b3610 0x7f11500cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f114ed9d700 1 -- 172.21.15.84:0/1608436802 >> v1:172.21.15.131:6789/0 conn(0x7f11500cc1b0 legacy=0x7f11500b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f114ed9d700 1 -- 172.21.15.84:0/1608436802 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500cb470 con 0x7f1150159480 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.428+0000 7f114e59c700 1 --2- 172.21.15.84:0/1608436802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11500b3610 0x7f11500cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f114ed9d700 1 --2- 172.21.15.84:0/1608436802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1150159480 0x7f11500b30d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f11400098e0 tx=0x7f11400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aee125ccc36f532f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f114dd9b700 1 -- 172.21.15.84:0/1608436802 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114000b640 con 0x7f1150159480 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f114dd9b700 1 -- 172.21.15.84:0/1608436802 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114000b7a0 con 0x7f1150159480 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f114dd9b700 1 -- 172.21.15.84:0/1608436802 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114000bb40 con 0x7f1150159480 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f1154856700 1 -- 172.21.15.84:0/1608436802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1150159480 msgr2=0x7f11500b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f1154856700 1 --2- 172.21.15.84:0/1608436802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1150159480 0x7f11500b30d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f11400098e0 tx=0x7f11400091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f1154856700 1 -- 172.21.15.84:0/1608436802 shutdown_connections 2023-10-06T03:02:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f1154856700 1 --2- 172.21.15.84:0/1608436802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1150159480 0x7f11500b30d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f1154856700 1 --2- 172.21.15.84:0/1608436802 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f11500b3610 0x7f11500cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f1154856700 1 -- 172.21.15.84:0/1608436802 >> 172.21.15.84:0/1608436802 conn(0x7f115006ed20 msgr2=0x7f115006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f1154856700 1 -- 172.21.15.84:0/1608436802 shutdown_connections 2023-10-06T03:02:27.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.429+0000 7f1154856700 1 -- 172.21.15.84:0/1608436802 wait complete. 2023-10-06T03:02:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.430+0000 7f1154856700 1 Processor -- start 2023-10-06T03:02:27.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f1154856700 1 -- start start 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f1154856700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11500b3610 0x7f115016a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f1154856700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11500cc1b0 0x7f11501546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f1154856700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1150159480 0x7f115016cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f1154856700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11501699c0 con 0x7f11500b3610 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f1154856700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150169f40 con 0x7f11500cc1b0 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f1154856700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1150169bf0 con 0x7f1150159480 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f114ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11500b3610 0x7f115016a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f114ed9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11500b3610 0x7f115016a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50818/0 (socket says 172.21.15.84:50818) 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.431+0000 7f114ed9d700 1 -- 172.21.15.84:0/917156675 learned_addr learned my addr 172.21.15.84:0/917156675 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:27.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f114f59e700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1150159480 0x7f115016cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f114e59c700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11500cc1b0 0x7f11501546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f114ed9d700 1 -- 172.21.15.84:0/917156675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1150159480 msgr2=0x7f115016cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f114ed9d700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1150159480 0x7f115016cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f114ed9d700 1 -- 172.21.15.84:0/917156675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11500cc1b0 msgr2=0x7f11501546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f114ed9d700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11500cc1b0 0x7f11501546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f114ed9d700 1 -- 172.21.15.84:0/917156675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144009420 con 0x7f11500b3610 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f114ed9d700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11500b3610 0x7f115016a3d0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f1140009f80 tx=0x7f1140017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f1136ffd700 1 -- 172.21.15.84:0/917156675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114000bb20 con 0x7f11500b3610 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f1136ffd700 1 -- 172.21.15.84:0/917156675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1140011420 con 0x7f11500b3610 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1140009420 con 0x7f11500b3610 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f1136ffd700 1 -- 172.21.15.84:0/917156675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1140011800 con 0x7f11500b3610 2023-10-06T03:02:27.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.432+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115016dca0 con 0x7f11500b3610 2023-10-06T03:02:27.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.433+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115016a220 con 0x7f11500b3610 2023-10-06T03:02:27.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.433+0000 7f1136ffd700 1 -- 172.21.15.84:0/917156675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1140011c30 con 0x7f11500b3610 2023-10-06T03:02:27.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.434+0000 7f1136ffd700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.434+0000 7f1136ffd700 1 -- 172.21.15.84:0/917156675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f11400862e0 con 0x7f11500b3610 2023-10-06T03:02:27.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.434+0000 7f114e59c700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.434+0000 7f114e59c700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f11440093f0 tx=0x7f1144008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.438+0000 7f1136ffd700 1 -- 172.21.15.84:0/917156675 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1140053270 con 0x7f11500b3610 2023-10-06T03:02:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.697+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f115005f270 con 0x7f11500b3610 2023-10-06T03:02:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.698+0000 7f1136ffd700 1 -- 172.21.15.84:0/917156675 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1970 (secure 0 0 0) 0x7f1140056890 con 0x7f11500b3610 2023-10-06T03:02:27.700 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:27.700 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":465,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2451845120,"bytes_avail":770642268160,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":111,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2023-10-06T03:02:23.897073+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 msgr2=0x7f113c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f11440093f0 tx=0x7f1144008040 comp rx=0 tx=0).stop 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11500b3610 msgr2=0x7f115016a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11500b3610 0x7f115016a3d0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f1140009f80 tx=0x7f1140017000 comp rx=0 tx=0).stop 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 shutdown_connections 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f113c066f30 0x7f113c0693e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1150159480 0x7f115016cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11500b3610 0x7f115016a3d0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 --2- 172.21.15.84:0/917156675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11500cc1b0 0x7f11501546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 >> 172.21.15.84:0/917156675 conn(0x7f115006ed20 msgr2=0x7f1150157150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 shutdown_connections 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:27.700+0000 7f1154856700 1 -- 172.21.15.84:0/917156675 wait complete. 2023-10-06T03:02:27.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'b': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2023-10-06T03:02:28.714 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:28.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.828+0000 7f7424a11700 1 Processor -- start 2023-10-06T03:02:28.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.828+0000 7f7424a11700 1 -- start start 2023-10-06T03:02:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.829+0000 7f7424a11700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f74201595a0 0x7f74200aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.829+0000 7f7424a11700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f74200b07a0 0x7f74200b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.829+0000 7f7424a11700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74200b0ca0 con 0x7f74200b49e0 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.829+0000 7f7424a11700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74200b0f80 con 0x7f74201595a0 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.829+0000 7f7424a11700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74200b1260 con 0x7f74200b07a0 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.829+0000 7f741e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f74201595a0 0x7f74200aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.829+0000 7f7417fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f74200b49e0 0x7f74200aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35628/0 (socket says 172.21.15.84:35628) 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.829+0000 7f7417fff700 1 -- 172.21.15.84:0/73071400 learned_addr learned my addr 172.21.15.84:0/73071400 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741ed9d700 1 --2- 172.21.15.84:0/73071400 >> v2:172.21.15.131:3300/0 conn(0x7f74200b07a0 0x7f74200b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741e59c700 1 -- 172.21.15.84:0/73071400 >> v2:172.21.15.131:3300/0 conn(0x7f74200b07a0 msgr2=0x7f74200b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741e59c700 1 --2- 172.21.15.84:0/73071400 >> v2:172.21.15.131:3300/0 conn(0x7f74200b07a0 0x7f74200b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741e59c700 1 -- 172.21.15.84:0/73071400 >> v1:172.21.15.84:6789/0 conn(0x7f74200b49e0 legacy=0x7f74200aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741e59c700 1 -- 172.21.15.84:0/73071400 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200b1540 con 0x7f74201595a0 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741dd9b700 1 -- 172.21.15.84:0/73071400 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569713023 0 0) 0x7f74200b0ca0 con 0x7f74200b49e0 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741e59c700 1 --2- 172.21.15.84:0/73071400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74201595a0 0x7f74200aa570 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f74100098d0 tx=0x7f7410009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ad4ed4d5728d0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741dd9b700 1 -- 172.21.15.84:0/73071400 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410009e70 con 0x7f74201595a0 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741dd9b700 1 -- 172.21.15.84:0/73071400 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410005c10 con 0x7f74201595a0 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f741dd9b700 1 -- 172.21.15.84:0/73071400 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741000b610 con 0x7f74201595a0 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f7424a11700 1 -- 172.21.15.84:0/73071400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74201595a0 msgr2=0x7f74200aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f7424a11700 1 --2- 172.21.15.84:0/73071400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74201595a0 0x7f74200aa570 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f74100098d0 tx=0x7f7410009120 comp rx=0 tx=0).stop 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f7424a11700 1 -- 172.21.15.84:0/73071400 shutdown_connections 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f7424a11700 1 --2- 172.21.15.84:0/73071400 >> v2:172.21.15.131:3300/0 conn(0x7f74200b07a0 0x7f74200b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f7424a11700 1 --2- 172.21.15.84:0/73071400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74201595a0 0x7f74200aa570 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.830+0000 7f7424a11700 1 -- 172.21.15.84:0/73071400 >> 172.21.15.84:0/73071400 conn(0x7f7420099830 msgr2=0x7f742006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:28.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.831+0000 7f7424a11700 1 -- 172.21.15.84:0/73071400 shutdown_connections 2023-10-06T03:02:28.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.831+0000 7f7424a11700 1 -- 172.21.15.84:0/73071400 wait complete. 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f7424a11700 1 Processor -- start 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f7424a11700 1 -- start start 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f7424a11700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200b07a0 0x7f742016cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f7424a11700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74200b49e0 0x7f742009a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f7424a11700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74201595a0 0x7f742009ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f7424a11700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742009b6c0 con 0x7f74200b07a0 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f7424a11700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742015ab70 con 0x7f74201595a0 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f7424a11700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742015ae10 con 0x7f74200b49e0 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f741e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200b07a0 0x7f742016cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f741e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200b07a0 0x7f742016cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50838/0 (socket says 172.21.15.84:50838) 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.832+0000 7f741e59c700 1 -- 172.21.15.84:0/2494877020 learned_addr learned my addr 172.21.15.84:0/2494877020 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f741ed9d700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74201595a0 0x7f742009ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f7417fff700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74200b49e0 0x7f742009a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f741e59c700 1 -- 172.21.15.84:0/2494877020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74200b49e0 msgr2=0x7f742009a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f741e59c700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74200b49e0 0x7f742009a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f741e59c700 1 -- 172.21.15.84:0/2494877020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74201595a0 msgr2=0x7f742009ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f741e59c700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74201595a0 0x7f742009ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f741e59c700 1 -- 172.21.15.84:0/2494877020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100093c0 con 0x7f74200b07a0 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f7417fff700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74200b49e0 0x7f742009a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f741e59c700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200b07a0 0x7f742016cdc0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7410009160 tx=0x7f7410016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f74167fc700 1 -- 172.21.15.84:0/2494877020 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410006290 con 0x7f74200b07a0 2023-10-06T03:02:28.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f74167fc700 1 -- 172.21.15.84:0/2494877020 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74100063f0 con 0x7f74200b07a0 2023-10-06T03:02:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742015b0f0 con 0x7f74200b07a0 2023-10-06T03:02:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f74167fc700 1 -- 172.21.15.84:0/2494877020 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100067b0 con 0x7f74200b07a0 2023-10-06T03:02:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.833+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742015b6b0 con 0x7f74200b07a0 2023-10-06T03:02:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.834+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742016a030 con 0x7f74200b07a0 2023-10-06T03:02:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.834+0000 7f74167fc700 1 -- 172.21.15.84:0/2494877020 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f741001b690 con 0x7f74200b07a0 2023-10-06T03:02:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.835+0000 7f74167fc700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7400066f30 0x7f74000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.835+0000 7f74167fc700 1 -- 172.21.15.84:0/2494877020 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f7410086930 con 0x7f74200b07a0 2023-10-06T03:02:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.835+0000 7f7417fff700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7400066f30 0x7f74000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.835+0000 7f7417fff700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7400066f30 0x7f74000693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f742015d110 tx=0x7f7408009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:28.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:28.839+0000 7f74167fc700 1 -- 172.21.15.84:0/2494877020 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74100538c0 con 0x7f74200b07a0 2023-10-06T03:02:29.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.061+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f742006a290 con 0x7f74200b07a0 2023-10-06T03:02:29.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.061+0000 7f74167fc700 1 -- 172.21.15.84:0/2494877020 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7f7410056ee0 con 0x7f74200b07a0 2023-10-06T03:02:29.063 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:29.063 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:29.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7400066f30 msgr2=0x7f74000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7400066f30 0x7f74000693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f742015d110 tx=0x7f7408009040 comp rx=0 tx=0).stop 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200b07a0 msgr2=0x7f742016cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200b07a0 0x7f742016cdc0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7410009160 tx=0x7f7410016000 comp rx=0 tx=0).stop 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 shutdown_connections 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7400066f30 0x7f74000693e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74201595a0 0x7f742009ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200b07a0 0x7f742016cdc0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 --2- 172.21.15.84:0/2494877020 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74200b49e0 0x7f742009a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 >> 172.21.15.84:0/2494877020 conn(0x7f7420099830 msgr2=0x7f74200b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 shutdown_connections 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.063+0000 7f7424a11700 1 -- 172.21.15.84:0/2494877020 wait complete. 2023-10-06T03:02:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:29.077 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'b'] 2023-10-06T03:02:29.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:29.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.187+0000 7fc769902700 1 Processor -- start 2023-10-06T03:02:29.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.187+0000 7fc769902700 1 -- start start 2023-10-06T03:02:29.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.188+0000 7fc769902700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ca3b0 0x7fc7641582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.188+0000 7fc769902700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7640ce8e0 0x7fc76415af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.188+0000 7fc769902700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc764157e20 con 0x7fc7640adba0 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.188+0000 7fc769902700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7640cbbd0 con 0x7fc7640ce8e0 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.188+0000 7fc769902700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640cb610 con 0x7fc7640ca3b0 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.188+0000 7fc7637fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7640ce8e0 0x7fc76415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.188+0000 7fc7637fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7640ce8e0 0x7fc76415af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50846/0 (socket says 172.21.15.84:50846) 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.188+0000 7fc7637fe700 1 -- 172.21.15.84:0/3318496440 learned_addr learned my addr 172.21.15.84:0/3318496440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc762ffd700 1 --2- 172.21.15.84:0/3318496440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ca3b0 0x7fc7641582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc7637fe700 1 -- 172.21.15.84:0/3318496440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ca3b0 msgr2=0x7fc7641582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:29.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc7637fe700 1 --2- 172.21.15.84:0/3318496440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ca3b0 0x7fc7641582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc7637fe700 1 -- 172.21.15.84:0/3318496440 >> v1:172.21.15.131:6789/0 conn(0x7fc7640adba0 legacy=0x7fc7640ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc7637fe700 1 -- 172.21.15.84:0/3318496440 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640cb8f0 con 0x7fc7640ce8e0 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc7637fe700 1 --2- 172.21.15.84:0/3318496440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640ce8e0 0x7fc76415af10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009f20 tx=0x7fc75c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1c758c4e61a426 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc7627fc700 1 -- 172.21.15.84:0/3318496440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00e070 con 0x7fc7640ce8e0 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc7627fc700 1 -- 172.21.15.84:0/3318496440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c00ba40 con 0x7fc7640ce8e0 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc7627fc700 1 -- 172.21.15.84:0/3318496440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0092e0 con 0x7fc7640ce8e0 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc769902700 1 -- 172.21.15.84:0/3318496440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640ce8e0 msgr2=0x7fc76415af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc769902700 1 --2- 172.21.15.84:0/3318496440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640ce8e0 0x7fc76415af10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009f20 tx=0x7fc75c009840 comp rx=0 tx=0).stop 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc769902700 1 -- 172.21.15.84:0/3318496440 shutdown_connections 2023-10-06T03:02:29.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc769902700 1 --2- 172.21.15.84:0/3318496440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640ce8e0 0x7fc76415af10 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc769902700 1 --2- 172.21.15.84:0/3318496440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ca3b0 0x7fc7641582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.189+0000 7fc769902700 1 -- 172.21.15.84:0/3318496440 >> 172.21.15.84:0/3318496440 conn(0x7fc764070810 msgr2=0x7fc764070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:29.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.190+0000 7fc769902700 1 -- 172.21.15.84:0/3318496440 shutdown_connections 2023-10-06T03:02:29.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.190+0000 7fc769902700 1 -- 172.21.15.84:0/3318496440 wait complete. 2023-10-06T03:02:29.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.191+0000 7fc769902700 1 Processor -- start 2023-10-06T03:02:29.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.191+0000 7fc769902700 1 -- start start 2023-10-06T03:02:29.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.191+0000 7fc769902700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640adba0 0x7fc7641680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.191+0000 7fc769902700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7640ca3b0 0x7fc764150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.191+0000 7fc769902700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ce8e0 0x7fc764158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.191+0000 7fc769902700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640b3e10 con 0x7fc7640adba0 2023-10-06T03:02:29.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.191+0000 7fc769902700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc764168600 con 0x7fc7640ca3b0 2023-10-06T03:02:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.191+0000 7fc769902700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640b3190 con 0x7fc7640ce8e0 2023-10-06T03:02:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.191+0000 7fc762ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640adba0 0x7fc7641680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc762ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640adba0 0x7fc7641680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50850/0 (socket says 172.21.15.84:50850) 2023-10-06T03:02:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc762ffd700 1 -- 172.21.15.84:0/517028217 learned_addr learned my addr 172.21.15.84:0/517028217 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc7637fe700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ce8e0 0x7fc764158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc75a7fc700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7640ca3b0 0x7fc764150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc762ffd700 1 -- 172.21.15.84:0/517028217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ce8e0 msgr2=0x7fc764158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc762ffd700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ce8e0 0x7fc764158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc762ffd700 1 -- 172.21.15.84:0/517028217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7640ca3b0 msgr2=0x7fc764150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc762ffd700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7640ca3b0 0x7fc764150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc762ffd700 1 -- 172.21.15.84:0/517028217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c009ae0 con 0x7fc7640adba0 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc762ffd700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640adba0 0x7fc7641680c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fc75400c880 tx=0x7fc754008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc75b7fe700 1 -- 172.21.15.84:0/517028217 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754011600 con 0x7fc7640adba0 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc75b7fe700 1 -- 172.21.15.84:0/517028217 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc754011760 con 0x7fc7640adba0 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc75b7fe700 1 -- 172.21.15.84:0/517028217 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754011b00 con 0x7fc7640adba0 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7640b3470 con 0x7fc7640adba0 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.192+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7640c2eb0 con 0x7fc7640adba0 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.193+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7640b3bf0 con 0x7fc7640adba0 2023-10-06T03:02:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.193+0000 7fc75b7fe700 1 -- 172.21.15.84:0/517028217 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc754018360 con 0x7fc7640adba0 2023-10-06T03:02:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.194+0000 7fc75b7fe700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc744066f30 0x7fc7440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.194+0000 7fc75b7fe700 1 -- 172.21.15.84:0/517028217 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fc7540846c0 con 0x7fc7640adba0 2023-10-06T03:02:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.194+0000 7fc75a7fc700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc744066f30 0x7fc7440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.194+0000 7fc75a7fc700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc744066f30 0x7fc7440693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009af0 tx=0x7fc74c009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.198+0000 7fc75b7fe700 1 -- 172.21.15.84:0/517028217 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc754051650 con 0x7fc7640adba0 2023-10-06T03:02:29.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.456+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc76415a740 con 0x7fc7640adba0 2023-10-06T03:02:29.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.456+0000 7fc75b7fe700 1 -- 172.21.15.84:0/517028217 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1829 (secure 0 0 0) 0x7fc754015740 con 0x7fc7640adba0 2023-10-06T03:02:29.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:29.459 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":467,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1696560893,"num_in_osds":8,"osd_in_since":1696560884,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":70,"data_bytes":704416,"bytes_used":2451845120,"bytes_avail":770642268160,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":111,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"b","status":"up:active","gid":6782},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8526},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8529}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2023-10-06T03:02:27.897750+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:29.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc744066f30 msgr2=0x7fc7440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc744066f30 0x7fc7440693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009af0 tx=0x7fc74c009060 comp rx=0 tx=0).stop 2023-10-06T03:02:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640adba0 msgr2=0x7fc7641680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640adba0 0x7fc7641680c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fc75400c880 tx=0x7fc754008040 comp rx=0 tx=0).stop 2023-10-06T03:02:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 shutdown_connections 2023-10-06T03:02:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc744066f30 0x7fc7440693e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc7640ce8e0 0x7fc764158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640adba0 0x7fc7641680c0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 --2- 172.21.15.84:0/517028217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7640ca3b0 0x7fc764150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 >> 172.21.15.84:0/517028217 conn(0x7fc764070810 msgr2=0x7fc764153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:29.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 shutdown_connections 2023-10-06T03:02:29.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.458+0000 7fc769902700 1 -- 172.21.15.84:0/517028217 wait complete. 2023-10-06T03:02:29.472 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T03:02:29.472 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:02:29.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:02:29.515 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:02:29.554 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:02:29.555 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:02:29.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:29.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:02:29.596 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:02:29.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:29.597 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:02:29.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.807+0000 7fdc83e3f700 1 Processor -- start 2023-10-06T03:02:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.807+0000 7fdc83e3f700 1 -- start start 2023-10-06T03:02:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.808+0000 7fdc83e3f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c159b10 0x7fdc7c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.808+0000 7fdc83e3f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc7c0ca6b0 0x7fdc7c0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.808+0000 7fdc83e3f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c068d50 con 0x7fdc7c0cb630 2023-10-06T03:02:29.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.808+0000 7fdc83e3f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7c154060 con 0x7fdc7c0ca6b0 2023-10-06T03:02:29.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.808+0000 7fdc83e3f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c15a4a0 con 0x7fdc7c159b10 2023-10-06T03:02:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.808+0000 7fdc823dc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc7c0ca6b0 0x7fdc7c0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.808+0000 7fdc813da700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c159b10 0x7fdc7c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.808+0000 7fdc823dc700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc7c0ca6b0 0x7fdc7c0caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:54578/0 (socket says 172.21.15.84:54578) 2023-10-06T03:02:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc823dc700 1 -- 172.21.15.84:0/2064206495 learned_addr learned my addr 172.21.15.84:0/2064206495 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc823dc700 1 -- 172.21.15.84:0/2064206495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c159b10 msgr2=0x7fdc7c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc823dc700 1 --2- 172.21.15.84:0/2064206495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c159b10 0x7fdc7c159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc823dc700 1 -- 172.21.15.84:0/2064206495 >> v1:172.21.15.131:6789/0 conn(0x7fdc7c0cb630 legacy=0x7fdc7c0691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc823dc700 1 -- 172.21.15.84:0/2064206495 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c15a6b0 con 0x7fdc7c0ca6b0 2023-10-06T03:02:29.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc813da700 1 --2- 172.21.15.84:0/2064206495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c159b10 0x7fdc7c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc823dc700 1 --2- 172.21.15.84:0/2064206495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc7c0ca6b0 0x7fdc7c0caaf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdc740099b0 tx=0x7fdc74009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77fa9a2beb56d808 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc80bd9700 1 -- 172.21.15.84:0/2064206495 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74009ea0 con 0x7fdc7c0ca6b0 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc80bd9700 1 -- 172.21.15.84:0/2064206495 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7400b860 con 0x7fdc7c0ca6b0 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.809+0000 7fdc80bd9700 1 -- 172.21.15.84:0/2064206495 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400bc00 con 0x7fdc7c0ca6b0 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.810+0000 7fdc83e3f700 1 -- 172.21.15.84:0/2064206495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc7c0ca6b0 msgr2=0x7fdc7c0caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.810+0000 7fdc83e3f700 1 --2- 172.21.15.84:0/2064206495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc7c0ca6b0 0x7fdc7c0caaf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdc740099b0 tx=0x7fdc74009250 comp rx=0 tx=0).stop 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.810+0000 7fdc83e3f700 1 -- 172.21.15.84:0/2064206495 shutdown_connections 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.810+0000 7fdc83e3f700 1 --2- 172.21.15.84:0/2064206495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc7c0ca6b0 0x7fdc7c0caaf0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.810+0000 7fdc83e3f700 1 --2- 172.21.15.84:0/2064206495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c159b10 0x7fdc7c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.810+0000 7fdc83e3f700 1 -- 172.21.15.84:0/2064206495 >> 172.21.15.84:0/2064206495 conn(0x7fdc7c070810 msgr2=0x7fdc7c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.810+0000 7fdc83e3f700 1 -- 172.21.15.84:0/2064206495 shutdown_connections 2023-10-06T03:02:29.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.810+0000 7fdc83e3f700 1 -- 172.21.15.84:0/2064206495 wait complete. 2023-10-06T03:02:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.811+0000 7fdc83e3f700 1 Processor -- start 2023-10-06T03:02:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.811+0000 7fdc83e3f700 1 -- start start 2023-10-06T03:02:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc83e3f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc7c0ca6b0 0x7fdc7c155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc83e3f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c0cb630 0x7fdc7c0c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc83e3f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc7c159b10 0x7fdc7c0b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc83e3f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0b2580 con 0x7fdc7c159b10 2023-10-06T03:02:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc83e3f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c16abf0 con 0x7fdc7c0ca6b0 2023-10-06T03:02:29.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc83e3f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c16aed0 con 0x7fdc7c0cb630 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc823dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc7c159b10 0x7fdc7c0b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc823dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc7c159b10 0x7fdc7c0b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50864/0 (socket says 172.21.15.84:50864) 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc823dc700 1 -- 172.21.15.84:0/901721311 learned_addr learned my addr 172.21.15.84:0/901721311 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc81bdb700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc7c0ca6b0 0x7fdc7c155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc813da700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c0cb630 0x7fdc7c0c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc823dc700 1 -- 172.21.15.84:0/901721311 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c0cb630 msgr2=0x7fdc7c0c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc823dc700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c0cb630 0x7fdc7c0c1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc823dc700 1 -- 172.21.15.84:0/901721311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc7c0ca6b0 msgr2=0x7fdc7c155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc823dc700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc7c0ca6b0 0x7fdc7c155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc823dc700 1 -- 172.21.15.84:0/901721311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c009420 con 0x7fdc7c159b10 2023-10-06T03:02:29.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc823dc700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc7c159b10 0x7fdc7c0b2a10 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0cdfe0 tx=0x7fdc74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc71ffb700 1 -- 172.21.15.84:0/901721311 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400bbe0 con 0x7fdc7c159b10 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc71ffb700 1 -- 172.21.15.84:0/901721311 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc74011420 con 0x7fdc7c159b10 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.812+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc740094f0 con 0x7fdc7c159b10 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.813+0000 7fdc71ffb700 1 -- 172.21.15.84:0/901721311 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740117e0 con 0x7fdc7c159b10 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.813+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c0b1e70 con 0x7fdc7c159b10 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.814+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c0b2730 con 0x7fdc7c159b10 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.814+0000 7fdc71ffb700 1 -- 172.21.15.84:0/901721311 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc74011bd0 con 0x7fdc7c159b10 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.814+0000 7fdc71ffb700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc60066f30 0x7fdc600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.815+0000 7fdc71ffb700 1 -- 172.21.15.84:0/901721311 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdc74086240 con 0x7fdc7c159b10 2023-10-06T03:02:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.815+0000 7fdc81bdb700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc60066f30 0x7fdc600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.815+0000 7fdc81bdb700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc60066f30 0x7fdc600693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdc78007fd0 tx=0x7fdc78001630 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:29.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:29.819+0000 7fdc71ffb700 1 -- 172.21.15.84:0/901721311 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc7c0b2730 con 0x7fdc7c159b10 2023-10-06T03:02:30.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.047+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc7c064ad0 con 0x7fdc7c159b10 2023-10-06T03:02:30.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.048+0000 7fdc71ffb700 1 -- 172.21.15.84:0/901721311 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7fdc740531d0 con 0x7fdc7c159b10 2023-10-06T03:02:30.050 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:30.050 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:30.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc60066f30 msgr2=0x7fdc600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc60066f30 0x7fdc600693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdc78007fd0 tx=0x7fdc78001630 comp rx=0 tx=0).stop 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc7c159b10 msgr2=0x7fdc7c0b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc7c159b10 0x7fdc7c0b2a10 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0cdfe0 tx=0x7fdc74017000 comp rx=0 tx=0).stop 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 shutdown_connections 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fdc60066f30 0x7fdc600693e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc7c0ca6b0 0x7fdc7c155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc7c159b10 0x7fdc7c0b2a10 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 --2- 172.21.15.84:0/901721311 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc7c0cb630 0x7fdc7c0c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 >> 172.21.15.84:0/901721311 conn(0x7fdc7c070810 msgr2=0x7fdc7c0cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 shutdown_connections 2023-10-06T03:02:30.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.050+0000 7fdc83e3f700 1 -- 172.21.15.84:0/901721311 wait complete. 2023-10-06T03:02:30.053 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:30.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:30.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.175+0000 7f766e4f4700 1 Processor -- start 2023-10-06T03:02:30.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.175+0000 7f766e4f4700 1 -- start start 2023-10-06T03:02:30.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.176+0000 7f766e4f4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76681595a0 0x7f76680aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.176+0000 7f766e4f4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76680b07a0 0x7f76680b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.176+0000 7f766e4f4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76680b0ca0 con 0x7f76680b49e0 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.176+0000 7f766e4f4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76680b0f80 con 0x7f76680b07a0 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.176+0000 7f766e4f4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680b1260 con 0x7f76681595a0 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.176+0000 7f766ca91700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76680b07a0 0x7f76680b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.176+0000 7f76677fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f76680b49e0 0x7f76680aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35630/0 (socket says 172.21.15.84:35630) 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.176+0000 7f76677fe700 1 -- 172.21.15.84:0/109439882 learned_addr learned my addr 172.21.15.84:0/109439882 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f7667fff700 1 --2- 172.21.15.84:0/109439882 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76681595a0 0x7f76680aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f766ca91700 1 -- 172.21.15.84:0/109439882 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76681595a0 msgr2=0x7f76680aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f7666ffd700 1 -- 172.21.15.84:0/109439882 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172152392 0 0) 0x7f76680b0ca0 con 0x7f76680b49e0 2023-10-06T03:02:30.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f766ca91700 1 --2- 172.21.15.84:0/109439882 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76681595a0 0x7f76680aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f766ca91700 1 -- 172.21.15.84:0/109439882 >> v1:172.21.15.84:6789/0 conn(0x7f76680b49e0 legacy=0x7f76680aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f766ca91700 1 -- 172.21.15.84:0/109439882 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680b1540 con 0x7f76680b07a0 2023-10-06T03:02:30.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f766ca91700 1 --2- 172.21.15.84:0/109439882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b07a0 0x7f76680b1c00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f7660009e60 tx=0x7f7660009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6086fe4e7b2917cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:30.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f7666ffd700 1 -- 172.21.15.84:0/109439882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766000e070 con 0x7f76680b07a0 2023-10-06T03:02:30.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f7666ffd700 1 -- 172.21.15.84:0/109439882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766000bc30 con 0x7f76680b07a0 2023-10-06T03:02:30.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.177+0000 7f7666ffd700 1 -- 172.21.15.84:0/109439882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660012430 con 0x7f76680b07a0 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.178+0000 7f766e4f4700 1 -- 172.21.15.84:0/109439882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b07a0 msgr2=0x7f76680b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.178+0000 7f766e4f4700 1 --2- 172.21.15.84:0/109439882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b07a0 0x7f76680b1c00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f7660009e60 tx=0x7f7660009780 comp rx=0 tx=0).stop 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.178+0000 7f766e4f4700 1 -- 172.21.15.84:0/109439882 shutdown_connections 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.178+0000 7f766e4f4700 1 --2- 172.21.15.84:0/109439882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b07a0 0x7f76680b1c00 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.178+0000 7f766e4f4700 1 --2- 172.21.15.84:0/109439882 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76681595a0 0x7f76680aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.178+0000 7f766e4f4700 1 -- 172.21.15.84:0/109439882 >> 172.21.15.84:0/109439882 conn(0x7f7668099830 msgr2=0x7f766806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.178+0000 7f766e4f4700 1 -- 172.21.15.84:0/109439882 shutdown_connections 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.178+0000 7f766e4f4700 1 -- 172.21.15.84:0/109439882 wait complete. 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.179+0000 7f766e4f4700 1 Processor -- start 2023-10-06T03:02:30.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.179+0000 7f766e4f4700 1 -- start start 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f766e4f4700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76680b07a0 0x7f76680acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f766e4f4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b49e0 0x7f766816db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f766e4f4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76681595a0 0x7f766809d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f766e4f4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766816e0a0 con 0x7f76680b49e0 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f766e4f4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76680ad240 con 0x7f76681595a0 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f766e4f4700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680ad520 con 0x7f76680b07a0 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f76677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b49e0 0x7f766816db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f76677fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b49e0 0x7f766816db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50880/0 (socket says 172.21.15.84:50880) 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f76677fe700 1 -- 172.21.15.84:0/1168211995 learned_addr learned my addr 172.21.15.84:0/1168211995 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f7667fff700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76680b07a0 0x7f76680acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f766ca91700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76681595a0 0x7f766809d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f76677fe700 1 -- 172.21.15.84:0/1168211995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76680b07a0 msgr2=0x7f76680acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f76677fe700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76680b07a0 0x7f76680acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f76677fe700 1 -- 172.21.15.84:0/1168211995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76681595a0 msgr2=0x7f766809d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f76677fe700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76681595a0 0x7f766809d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.180+0000 7f76677fe700 1 -- 172.21.15.84:0/1168211995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7660009a20 con 0x7f76680b49e0 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.181+0000 7f76677fe700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b49e0 0x7f766816db60 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c810 tx=0x7f765c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.181+0000 7f764ffff700 1 -- 172.21.15.84:0/1168211995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c005c00 con 0x7f76680b49e0 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.181+0000 7f764ffff700 1 -- 172.21.15.84:0/1168211995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c005d60 con 0x7f76680b49e0 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.181+0000 7f764ffff700 1 -- 172.21.15.84:0/1168211995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c007300 con 0x7f76680b49e0 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.181+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76680ad800 con 0x7f76680b49e0 2023-10-06T03:02:30.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.181+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76680addc0 con 0x7f76680b49e0 2023-10-06T03:02:30.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.182+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76680adfe0 con 0x7f76680b49e0 2023-10-06T03:02:30.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.182+0000 7f764ffff700 1 -- 172.21.15.84:0/1168211995 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f765c01b3b0 con 0x7f76680b49e0 2023-10-06T03:02:30.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.183+0000 7f764ffff700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7654066f30 0x7f76540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.183+0000 7f7667fff700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7654066f30 0x7f76540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.183+0000 7f764ffff700 1 -- 172.21.15.84:0/1168211995 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f765c083cd0 con 0x7f76680b49e0 2023-10-06T03:02:30.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.183+0000 7f7667fff700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7654066f30 0x7f76540693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f76580061f0 tx=0x7f7658008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:30.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.187+0000 7f764ffff700 1 -- 172.21.15.84:0/1168211995 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f765c050c60 con 0x7f76680b49e0 2023-10-06T03:02:30.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.376+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7668064ad0 con 0x7f76680b49e0 2023-10-06T03:02:30.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.377+0000 7f764ffff700 1 -- 172.21.15.84:0/1168211995 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17182 (secure 0 0 0) 0x7f765c017020 con 0x7f76680b49e0 2023-10-06T03:02:30.379 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:30.379 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":108,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:01:52.175416+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:39.801172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:41.118752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.e","mappings":[{"from":0,"to":5}]},{"pgid":"17.30","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:30.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7654066f30 msgr2=0x7f76540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7654066f30 0x7f76540693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f76580061f0 tx=0x7f7658008040 comp rx=0 tx=0).stop 2023-10-06T03:02:30.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b49e0 msgr2=0x7f766816db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b49e0 0x7f766816db60 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c810 tx=0x7f765c007db0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 shutdown_connections 2023-10-06T03:02:30.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f7654066f30 0x7f76540693e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76681595a0 0x7f766809d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f76680b07a0 0x7f76680acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 --2- 172.21.15.84:0/1168211995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76680b49e0 0x7f766816db60 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.379+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 >> 172.21.15.84:0/1168211995 conn(0x7f7668099830 msgr2=0x7f76680b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:30.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.380+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 shutdown_connections 2023-10-06T03:02:30.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.380+0000 7f766e4f4700 1 -- 172.21.15.84:0/1168211995 wait complete. 2023-10-06T03:02:30.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T02:54:53.838905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T02:55:00.613030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:01:39.801172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:01:41.118752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:02:30.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:02:30.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.509+0000 7f128639c700 1 Processor -- start 2023-10-06T03:02:30.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.509+0000 7f128639c700 1 -- start start 2023-10-06T03:02:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f128639c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f12800b2660 0x7f12800cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f128639c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12800cc9b0 con 0x7f12800cf1f0 2023-10-06T03:02:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f128639c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12800cbda0 con 0x7f12800b2a30 2023-10-06T03:02:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f128639c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12800cc080 con 0x7f12800b2660 2023-10-06T03:02:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f128539a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f12800b2660 0x7f12800cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f1285b9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f12800cf1f0 0x7f12800c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35642/0 (socket says 172.21.15.84:35642) 2023-10-06T03:02:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f1285b9b700 1 -- 172.21.15.84:0/3359096042 learned_addr learned my addr 172.21.15.84:0/3359096042 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f1277fff700 1 -- 172.21.15.84:0/3359096042 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379233322 0 0) 0x7f12800cc9b0 con 0x7f12800cf1f0 2023-10-06T03:02:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f1277fff700 1 -- 172.21.15.84:0/3359096042 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f126c003570 con 0x7f12800cf1f0 2023-10-06T03:02:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f128539a700 1 -- 172.21.15.84:0/3359096042 >> v1:172.21.15.131:6789/0 conn(0x7f12800b2a30 legacy=0x7f12800ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f128539a700 1 -- 172.21.15.84:0/3359096042 >> v1:172.21.15.84:6789/0 conn(0x7f12800cf1f0 legacy=0x7f12800c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.510+0000 7f128539a700 1 -- 172.21.15.84:0/3359096042 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12800cc360 con 0x7f12800b2660 2023-10-06T03:02:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f128539a700 1 --2- 172.21.15.84:0/3359096042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2660 0x7f12800cccf0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f127c0098d0 tx=0x7f127c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335a7140a019761e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f1277fff700 1 -- 172.21.15.84:0/3359096042 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c005c10 con 0x7f12800b2660 2023-10-06T03:02:30.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f1277fff700 1 -- 172.21.15.84:0/3359096042 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c005d70 con 0x7f12800b2660 2023-10-06T03:02:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f1277fff700 1 -- 172.21.15.84:0/3359096042 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c006280 con 0x7f12800b2660 2023-10-06T03:02:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f128639c700 1 -- 172.21.15.84:0/3359096042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2660 msgr2=0x7f12800cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f128639c700 1 --2- 172.21.15.84:0/3359096042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2660 0x7f12800cccf0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f127c0098d0 tx=0x7f127c009120 comp rx=0 tx=0).stop 2023-10-06T03:02:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f128639c700 1 -- 172.21.15.84:0/3359096042 shutdown_connections 2023-10-06T03:02:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f128639c700 1 --2- 172.21.15.84:0/3359096042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2660 0x7f12800cccf0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f128639c700 1 -- 172.21.15.84:0/3359096042 >> 172.21.15.84:0/3359096042 conn(0x7f1280099560 msgr2=0x7f128006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f128639c700 1 -- 172.21.15.84:0/3359096042 shutdown_connections 2023-10-06T03:02:30.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.511+0000 7f128639c700 1 -- 172.21.15.84:0/3359096042 wait complete. 2023-10-06T03:02:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.512+0000 7f128639c700 1 Processor -- start 2023-10-06T03:02:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.512+0000 7f128639c700 1 -- start start 2023-10-06T03:02:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.513+0000 7f128639c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800b2660 0x7f128015d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.513+0000 7f128639c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2a30 0x7f1280169470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.513+0000 7f128639c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12800cf1f0 0x7f128015b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.513+0000 7f128639c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280159c00 con 0x7f12800b2a30 2023-10-06T03:02:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.513+0000 7f128639c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280159ee0 con 0x7f12800b2660 2023-10-06T03:02:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.513+0000 7f128639c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1280169ca0 con 0x7f12800cf1f0 2023-10-06T03:02:30.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.513+0000 7f1284b99700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2a30 0x7f1280169470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.513+0000 7f1284b99700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2a30 0x7f1280169470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50896/0 (socket says 172.21.15.84:50896) 2023-10-06T03:02:30.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.513+0000 7f1284b99700 1 -- 172.21.15.84:0/3791148384 learned_addr learned my addr 172.21.15.84:0/3791148384 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:30.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f128539a700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800b2660 0x7f128015d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f1285b9b700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12800cf1f0 0x7f128015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f1284b99700 1 -- 172.21.15.84:0/3791148384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12800cf1f0 msgr2=0x7f128015b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f1284b99700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12800cf1f0 0x7f128015b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f1284b99700 1 -- 172.21.15.84:0/3791148384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800b2660 msgr2=0x7f128015d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f1284b99700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800b2660 0x7f128015d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f1284b99700 1 -- 172.21.15.84:0/3791148384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0093c0 con 0x7f12800b2a30 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f1284b99700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2a30 0x7f1280169470 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f127000b7e0 tx=0x7f12700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f12757fa700 1 -- 172.21.15.84:0/3791148384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000f510 con 0x7f12800b2a30 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f12757fa700 1 -- 172.21.15.84:0/3791148384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127000f670 con 0x7f12800b2a30 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1280169f80 con 0x7f12800b2a30 2023-10-06T03:02:30.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f12757fa700 1 -- 172.21.15.84:0/3791148384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000fa10 con 0x7f12800b2a30 2023-10-06T03:02:30.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.514+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12801699b0 con 0x7f12800b2a30 2023-10-06T03:02:30.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.515+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128015a050 con 0x7f12800b2a30 2023-10-06T03:02:30.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.515+0000 7f12757fa700 1 -- 172.21.15.84:0/3791148384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f127001a400 con 0x7f12800b2a30 2023-10-06T03:02:30.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.516+0000 7f12757fa700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1264066f30 0x7f12640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.516+0000 7f12757fa700 1 -- 172.21.15.84:0/3791148384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f12700842f0 con 0x7f12800b2a30 2023-10-06T03:02:30.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.516+0000 7f128539a700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1264066f30 0x7f12640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.516+0000 7f128539a700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1264066f30 0x7f12640693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f127c009390 tx=0x7f127c015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:30.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.520+0000 7f12757fa700 1 -- 172.21.15.84:0/3791148384 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1270051300 con 0x7f12800b2a30 2023-10-06T03:02:30.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.701+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f128005f270 con 0x7f12800b2a30 2023-10-06T03:02:30.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.702+0000 7f12757fa700 1 -- 172.21.15.84:0/3791148384 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1270054920 con 0x7f12800b2a30 2023-10-06T03:02:30.703 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-10-06T03:02:30.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.703+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1264066f30 msgr2=0x7f12640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.703+0000 7f128639c700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1264066f30 0x7f12640693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f127c009390 tx=0x7f127c015000 comp rx=0 tx=0).stop 2023-10-06T03:02:30.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.703+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2a30 msgr2=0x7f1280169470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.703+0000 7f128639c700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2a30 0x7f1280169470 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f127000b7e0 tx=0x7f12700091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.704+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 shutdown_connections 2023-10-06T03:02:30.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.704+0000 7f128639c700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1264066f30 0x7f12640693e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.704+0000 7f128639c700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800b2660 0x7f128015d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.704+0000 7f128639c700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f12800cf1f0 0x7f128015b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.704+0000 7f128639c700 1 --2- 172.21.15.84:0/3791148384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12800b2a30 0x7f1280169470 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.704+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 >> 172.21.15.84:0/3791148384 conn(0x7f1280099560 msgr2=0x7f1280068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:30.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.704+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 shutdown_connections 2023-10-06T03:02:30.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.704+0000 7f128639c700 1 -- 172.21.15.84:0/3791148384 wait complete. 2023-10-06T03:02:30.717 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:02:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.832+0000 7f4756ccb700 1 Processor -- start 2023-10-06T03:02:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.832+0000 7f4756ccb700 1 -- start start 2023-10-06T03:02:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f4756ccb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4750159510 0x7f47500cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f4756ccb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500cbf20 con 0x7f47500cbae0 2023-10-06T03:02:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f4756ccb700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500cf610 con 0x7f47501598e0 2023-10-06T03:02:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f4756ccb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47500cf8f0 con 0x7f4750159510 2023-10-06T03:02:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f4754a67700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4750159510 0x7f47500cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f4755268700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f47500cbae0 0x7f47500c56d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35648/0 (socket says 172.21.15.84:35648) 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f4755268700 1 -- 172.21.15.84:0/2881108778 learned_addr learned my addr 172.21.15.84:0/2881108778 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f4754a67700 1 -- 172.21.15.84:0/2881108778 >> v1:172.21.15.131:6789/0 conn(0x7f47501598e0 legacy=0x7f47500ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f4754a67700 1 -- 172.21.15.84:0/2881108778 >> v1:172.21.15.84:6789/0 conn(0x7f47500cbae0 legacy=0x7f47500c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f4754a67700 1 -- 172.21.15.84:0/2881108778 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500cfbd0 con 0x7f4750159510 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.833+0000 7f47477fe700 1 -- 172.21.15.84:0/2881108778 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507612199 0 0) 0x7f47500cbf20 con 0x7f47500cbae0 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f4754a67700 1 --2- 172.21.15.84:0/2881108778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 0x7f47500cb5a0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f474c009e60 tx=0x7f474c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328e2d85de6571e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f47477fe700 1 -- 172.21.15.84:0/2881108778 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00e070 con 0x7f4750159510 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f47477fe700 1 -- 172.21.15.84:0/2881108778 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c00bbf0 con 0x7f4750159510 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f47477fe700 1 -- 172.21.15.84:0/2881108778 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c012430 con 0x7f4750159510 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f4756ccb700 1 -- 172.21.15.84:0/2881108778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 msgr2=0x7f47500cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f4756ccb700 1 --2- 172.21.15.84:0/2881108778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 0x7f47500cb5a0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f474c009e60 tx=0x7f474c009780 comp rx=0 tx=0).stop 2023-10-06T03:02:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f4756ccb700 1 -- 172.21.15.84:0/2881108778 shutdown_connections 2023-10-06T03:02:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f4756ccb700 1 --2- 172.21.15.84:0/2881108778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 0x7f47500cb5a0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f4756ccb700 1 -- 172.21.15.84:0/2881108778 >> 172.21.15.84:0/2881108778 conn(0x7f4750089e90 msgr2=0x7f47500997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f4756ccb700 1 -- 172.21.15.84:0/2881108778 shutdown_connections 2023-10-06T03:02:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.834+0000 7f4756ccb700 1 -- 172.21.15.84:0/2881108778 wait complete. 2023-10-06T03:02:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.835+0000 7f4756ccb700 1 Processor -- start 2023-10-06T03:02:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4756ccb700 1 -- start start 2023-10-06T03:02:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4756ccb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47500cbae0 0x7f47500c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4756ccb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 0x7f475016ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4756ccb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47501598e0 0x7f47500b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4756ccb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475016b060 con 0x7f4750159510 2023-10-06T03:02:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4756ccb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47500b4e50 con 0x7f47500cbae0 2023-10-06T03:02:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4756ccb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47500b50f0 con 0x7f47501598e0 2023-10-06T03:02:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4747fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 0x7f475016ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4747fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 0x7f475016ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50904/0 (socket says 172.21.15.84:50904) 2023-10-06T03:02:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.836+0000 7f4747fff700 1 -- 172.21.15.84:0/981844934 learned_addr learned my addr 172.21.15.84:0/981844934 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4754a67700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47500cbae0 0x7f47500c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4755268700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47501598e0 0x7f47500b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4747fff700 1 -- 172.21.15.84:0/981844934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47501598e0 msgr2=0x7f47500b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4747fff700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47501598e0 0x7f47500b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4747fff700 1 -- 172.21.15.84:0/981844934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47500cbae0 msgr2=0x7f47500c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4747fff700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47500cbae0 0x7f47500c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4747fff700 1 -- 172.21.15.84:0/981844934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c009a20 con 0x7f4750159510 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4754a67700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47500cbae0 0x7f47500c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4747fff700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 0x7f475016ab20 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f474000b510 tx=0x7f47400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4744ff9700 1 -- 172.21.15.84:0/981844934 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474000f510 con 0x7f4750159510 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4744ff9700 1 -- 172.21.15.84:0/981844934 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474000f670 con 0x7f4750159510 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47500b39b0 con 0x7f4750159510 2023-10-06T03:02:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4744ff9700 1 -- 172.21.15.84:0/981844934 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474000fa30 con 0x7f4750159510 2023-10-06T03:02:30.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.837+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47500b5390 con 0x7f4750159510 2023-10-06T03:02:30.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.838+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4750064ad0 con 0x7f4750159510 2023-10-06T03:02:30.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.839+0000 7f4744ff9700 1 -- 172.21.15.84:0/981844934 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f474001a400 con 0x7f4750159510 2023-10-06T03:02:30.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.839+0000 7f4744ff9700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f473c066f30 0x7f473c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:30.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.839+0000 7f4744ff9700 1 -- 172.21.15.84:0/981844934 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f4740084300 con 0x7f4750159510 2023-10-06T03:02:30.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.839+0000 7f4754a67700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f473c066f30 0x7f473c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:30.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.839+0000 7f4754a67700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f473c066f30 0x7f473c0693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f474c0097c0 tx=0x7f474c018000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:30.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:30.843+0000 7f4744ff9700 1 -- 172.21.15.84:0/981844934 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47400513c0 con 0x7f4750159510 2023-10-06T03:02:31.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.026+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47500cfeb0 con 0x7f4750159510 2023-10-06T03:02:31.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.026+0000 7f4744ff9700 1 -- 172.21.15.84:0/981844934 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47400549e0 con 0x7f4750159510 2023-10-06T03:02:31.028 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 8 2023-10-06T03:02:31.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f473c066f30 msgr2=0x7f473c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f473c066f30 0x7f473c0693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f474c0097c0 tx=0x7f474c018000 comp rx=0 tx=0).stop 2023-10-06T03:02:31.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 msgr2=0x7f475016ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 0x7f475016ab20 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f474000b510 tx=0x7f47400090f0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 shutdown_connections 2023-10-06T03:02:31.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f473c066f30 0x7f473c0693e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47500cbae0 0x7f47500c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47501598e0 0x7f47500b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 --2- 172.21.15.84:0/981844934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4750159510 0x7f475016ab20 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 >> 172.21.15.84:0/981844934 conn(0x7f4750089e90 msgr2=0x7f47500683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 shutdown_connections 2023-10-06T03:02:31.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.029+0000 7f4756ccb700 1 -- 172.21.15.84:0/981844934 wait complete. 2023-10-06T03:02:31.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:02:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.157+0000 7f42a08e0700 1 Processor -- start 2023-10-06T03:02:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.157+0000 7f42a08e0700 1 -- start start 2023-10-06T03:02:31.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f42a08e0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c159510 0x7f429c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f42a08e0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f429c1598e0 0x7f429c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f42a08e0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f429c0ce820 0x7f429c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f42a08e0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c0cf610 con 0x7f429c0ce820 2023-10-06T03:02:31.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f42a08e0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c0cf8f0 con 0x7f429c1598e0 2023-10-06T03:02:31.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f42a08e0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0cfbd0 con 0x7f429c159510 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f429ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f429c0ce820 0x7f429c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f429ad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f429c0ce820 0x7f429c0cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50908/0 (socket says 172.21.15.84:50908) 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f429ad9d700 1 -- 172.21.15.84:0/3591460210 learned_addr learned my addr 172.21.15.84:0/3591460210 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f429a59c700 1 --2- 172.21.15.84:0/3591460210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c159510 0x7f429c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f4299d9b700 1 --2- 172.21.15.84:0/3591460210 >> v2:172.21.15.131:3300/0 conn(0x7f429c1598e0 0x7f429c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f429ad9d700 1 -- 172.21.15.84:0/3591460210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c159510 msgr2=0x7f429c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f429ad9d700 1 --2- 172.21.15.84:0/3591460210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c159510 0x7f429c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f429ad9d700 1 -- 172.21.15.84:0/3591460210 >> v2:172.21.15.131:3300/0 conn(0x7f429c1598e0 msgr2=0x7f429c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f429ad9d700 1 --2- 172.21.15.84:0/3591460210 >> v2:172.21.15.131:3300/0 conn(0x7f429c1598e0 0x7f429c0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.158+0000 7f429ad9d700 1 -- 172.21.15.84:0/3591460210 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c0cfeb0 con 0x7f429c0ce820 2023-10-06T03:02:31.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f429ad9d700 1 --2- 172.21.15.84:0/3591460210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 0x7f429c0cec40 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f429c089360 tx=0x7f4294009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacb34a69ab1cc22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f429959a700 1 -- 172.21.15.84:0/3591460210 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429400e070 con 0x7f429c0ce820 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f429959a700 1 -- 172.21.15.84:0/3591460210 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429400b970 con 0x7f429c0ce820 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f429959a700 1 -- 172.21.15.84:0/3591460210 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42940092e0 con 0x7f429c0ce820 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f42a08e0700 1 -- 172.21.15.84:0/3591460210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 msgr2=0x7f429c0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f42a08e0700 1 --2- 172.21.15.84:0/3591460210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 0x7f429c0cec40 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f429c089360 tx=0x7f4294009840 comp rx=0 tx=0).stop 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f42a08e0700 1 -- 172.21.15.84:0/3591460210 shutdown_connections 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f42a08e0700 1 --2- 172.21.15.84:0/3591460210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 0x7f429c0cec40 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f42a08e0700 1 --2- 172.21.15.84:0/3591460210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c159510 0x7f429c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f42a08e0700 1 --2- 172.21.15.84:0/3591460210 >> v2:172.21.15.131:3300/0 conn(0x7f429c1598e0 0x7f429c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f42a08e0700 1 -- 172.21.15.84:0/3591460210 >> 172.21.15.84:0/3591460210 conn(0x7f429c089e90 msgr2=0x7f429c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f42a08e0700 1 -- 172.21.15.84:0/3591460210 shutdown_connections 2023-10-06T03:02:31.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.159+0000 7f42a08e0700 1 -- 172.21.15.84:0/3591460210 wait complete. 2023-10-06T03:02:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.160+0000 7f42a08e0700 1 Processor -- start 2023-10-06T03:02:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.160+0000 7f42a08e0700 1 -- start start 2023-10-06T03:02:31.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f42a08e0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 0x7f429c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f42a08e0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f429c159510 0x7f429c0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f42a08e0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c1598e0 0x7f429c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f42a08e0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0b37f0 con 0x7f429c0ce820 2023-10-06T03:02:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f42a08e0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0b3a60 con 0x7f429c159510 2023-10-06T03:02:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f42a08e0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0b3d40 con 0x7f429c1598e0 2023-10-06T03:02:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f429a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 0x7f429c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f429a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 0x7f429c0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50922/0 (socket says 172.21.15.84:50922) 2023-10-06T03:02:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f429a59c700 1 -- 172.21.15.84:0/2373550129 learned_addr learned my addr 172.21.15.84:0/2373550129 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:31.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f429ad9d700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c1598e0 0x7f429c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.161+0000 7f4299d9b700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f429c159510 0x7f429c0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f429a59c700 1 -- 172.21.15.84:0/2373550129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c1598e0 msgr2=0x7f429c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f429a59c700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c1598e0 0x7f429c0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f429a59c700 1 -- 172.21.15.84:0/2373550129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f429c159510 msgr2=0x7f429c0c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f429a59c700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f429c159510 0x7f429c0c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f429a59c700 1 -- 172.21.15.84:0/2373550129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4294009ae0 con 0x7f429c0ce820 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f429a59c700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 0x7f429c0c9650 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f428c00ec80 tx=0x7f428c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f428a7fc700 1 -- 172.21.15.84:0/2373550129 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00c850 con 0x7f429c0ce820 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f428a7fc700 1 -- 172.21.15.84:0/2373550129 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c00c9b0 con 0x7f429c0ce820 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c0b4020 con 0x7f429c0ce820 2023-10-06T03:02:31.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f428a7fc700 1 -- 172.21.15.84:0/2373550129 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00cd50 con 0x7f429c0ce820 2023-10-06T03:02:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.162+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c148430 con 0x7f429c0ce820 2023-10-06T03:02:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.163+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c064ad0 con 0x7f429c0ce820 2023-10-06T03:02:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.163+0000 7f428a7fc700 1 -- 172.21.15.84:0/2373550129 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f428c013680 con 0x7f429c0ce820 2023-10-06T03:02:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.164+0000 7f428a7fc700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f427c066f30 0x7f427c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.164+0000 7f4299d9b700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f427c066f30 0x7f427c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.164+0000 7f428a7fc700 1 -- 172.21.15.84:0/2373550129 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f428c084a40 con 0x7f429c0ce820 2023-10-06T03:02:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.164+0000 7f4299d9b700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f427c066f30 0x7f427c0693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f429c153110 tx=0x7f42900091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.168+0000 7f428a7fc700 1 -- 172.21.15.84:0/2373550129 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f428c086e60 con 0x7f429c0ce820 2023-10-06T03:02:31.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.350+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f429c0cf180 con 0x7f429c0ce820 2023-10-06T03:02:31.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.350+0000 7f428a7fc700 1 -- 172.21.15.84:0/2373550129 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7f428c0519d0 con 0x7f429c0ce820 2023-10-06T03:02:31.352 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-10-06T03:02:31.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f427c066f30 msgr2=0x7f427c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f427c066f30 0x7f427c0693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f429c153110 tx=0x7f42900091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 msgr2=0x7f429c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 0x7f429c0c9650 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f428c00ec80 tx=0x7f428c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 shutdown_connections 2023-10-06T03:02:31.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f427c066f30 0x7f427c0693e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f429c1598e0 0x7f429c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429c0ce820 0x7f429c0c9650 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 --2- 172.21.15.84:0/2373550129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f429c159510 0x7f429c0c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.352+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 >> 172.21.15.84:0/2373550129 conn(0x7f429c089e90 msgr2=0x7f429c14b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.353+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 shutdown_connections 2023-10-06T03:02:31.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.353+0000 7f42a08e0700 1 -- 172.21.15.84:0/2373550129 wait complete. 2023-10-06T03:02:31.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:02:31.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.480+0000 7fac10c2f700 1 Processor -- start 2023-10-06T03:02:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.480+0000 7fac10c2f700 1 -- start start 2023-10-06T03:02:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac10c2f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fac0c159510 0x7fac0c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac10c2f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c0cbf20 con 0x7fac0c1598e0 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac10c2f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c0cf610 con 0x7fac0c0cbae0 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac10c2f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c0cf8f0 con 0x7fac0c159510 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac01d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fac0c1598e0 0x7fac0c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35664/0 (socket says 172.21.15.84:35664) 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac01d9b700 1 -- 172.21.15.84:0/473764696 learned_addr learned my addr 172.21.15.84:0/473764696 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac0a59c700 1 --2- 172.21.15.84:0/473764696 >> v2:172.21.15.131:3300/0 conn(0x7fac0c159510 0x7fac0c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314893437 0 0) 0x7fac0c0cbf20 con 0x7fac0c1598e0 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf8003570 con 0x7fac0c1598e0 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4165928597 0 0) 0x7fabf8003570 con 0x7fac0c1598e0 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.481+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 >> v2:172.21.15.131:3300/0 conn(0x7fac0c159510 msgr2=0x7fac0c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 --2- 172.21.15.84:0/473764696 >> v2:172.21.15.131:3300/0 conn(0x7fac0c159510 0x7fac0c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 >> v1:172.21.15.131:6789/0 conn(0x7fac0c0cbae0 legacy=0x7fac0c0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0cfbd0 con 0x7fac0c1598e0 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fabf4001470 con 0x7fac0c1598e0 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 >> v1:172.21.15.84:6789/0 conn(0x7fac0c1598e0 legacy=0x7fac0c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fabf8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf8004810 0x7fabf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabf80051c0 0x7fabf800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0cf8f0 con 0x7fabf8003a60 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf800c0d0 con 0x7fabf80051c0 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf800c290 con 0x7fabf8004810 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac0a59c700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fabf8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac0ad9d700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabf80051c0 0x7fabf800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac01d9b700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf8004810 0x7fabf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac0a59c700 1 -- 172.21.15.84:0/473764696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf8004810 msgr2=0x7fabf8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac0a59c700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fabf8004810 0x7fabf8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac0a59c700 1 -- 172.21.15.84:0/473764696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabf80051c0 msgr2=0x7fabf800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac0a59c700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabf80051c0 0x7fabf800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac0ad9d700 1 -- 172.21.15.84:0/473764696 reap_dead start 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac0a59c700 1 -- 172.21.15.84:0/473764696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf8003570 con 0x7fabf8003a60 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac0a59c700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fabf8003e70 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009c00 tx=0x7fabfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8ec1ef7a8363b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00e710 con 0x7fabf8003a60 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc00e870 con 0x7fabf8003a60 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.482+0000 7fac09d9b700 1 -- 172.21.15.84:0/473764696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00ec30 con 0x7fabf8003a60 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.483+0000 7fac10c2f700 1 -- 172.21.15.84:0/473764696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 msgr2=0x7fabf8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.483+0000 7fac10c2f700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fabf8003e70 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009c00 tx=0x7fabfc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.483+0000 7fac10c2f700 1 -- 172.21.15.84:0/473764696 shutdown_connections 2023-10-06T03:02:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.483+0000 7fac10c2f700 1 --2- 172.21.15.84:0/473764696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fabf8003e70 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.483+0000 7fac10c2f700 1 -- 172.21.15.84:0/473764696 >> 172.21.15.84:0/473764696 conn(0x7fac0c089e90 msgr2=0x7fac0c0997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.483+0000 7fac10c2f700 1 -- 172.21.15.84:0/473764696 shutdown_connections 2023-10-06T03:02:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.483+0000 7fac10c2f700 1 -- 172.21.15.84:0/473764696 wait complete. 2023-10-06T03:02:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.484+0000 7fac10c2f700 1 Processor -- start 2023-10-06T03:02:31.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.484+0000 7fac10c2f700 1 -- start start 2023-10-06T03:02:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac10c2f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fac0c146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac10c2f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac0c169a50 0x7fac0c0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac10c2f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c0c8550 0x7fac0c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac10c2f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0b3c20 con 0x7fabf8003a60 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac10c2f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0c8ad0 con 0x7fac0c0c8550 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac10c2f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0b32f0 con 0x7fac0c169a50 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac0a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fac0c146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac0a59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fac0c146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50942/0 (socket says 172.21.15.84:50942) 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac0a59c700 1 -- 172.21.15.84:0/2597722386 learned_addr learned my addr 172.21.15.84:0/2597722386 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac0a59c700 1 -- 172.21.15.84:0/2597722386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac0c169a50 msgr2=0x7fac0c0c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac0a59c700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac0c169a50 0x7fac0c0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac0a59c700 1 -- 172.21.15.84:0/2597722386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c0c8550 msgr2=0x7fac0c0c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac0a59c700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c0c8550 0x7fac0c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac0a59c700 1 -- 172.21.15.84:0/2597722386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0b35d0 con 0x7fabf8003a60 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac0a59c700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fac0c146e30 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c0a0 tx=0x7fabfc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac02ffd700 1 -- 172.21.15.84:0/2597722386 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc022070 con 0x7fabf8003a60 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac02ffd700 1 -- 172.21.15.84:0/2597722386 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc00e9e0 con 0x7fabf8003a60 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c0b38b0 con 0x7fabf8003a60 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac02ffd700 1 -- 172.21.15.84:0/2597722386 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc01c450 con 0x7fabf8003a60 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.485+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c0b5c90 con 0x7fabf8003a60 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.486+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c064ad0 con 0x7fabf8003a60 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.487+0000 7fac02ffd700 1 -- 172.21.15.84:0/2597722386 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabfc01c880 con 0x7fabf8003a60 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.487+0000 7fac02ffd700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabec066f30 0x7fabec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.487+0000 7fac02ffd700 1 -- 172.21.15.84:0/2597722386 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fabfc085ec0 con 0x7fabf8003a60 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.487+0000 7fac01d9b700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabec066f30 0x7fabec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.487+0000 7fac01d9b700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabec066f30 0x7fabec0693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fabf4000c00 tx=0x7fabf4001500 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.491+0000 7fac02ffd700 1 -- 172.21.15.84:0/2597722386 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabfc052f00 con 0x7fabf8003a60 2023-10-06T03:02:31.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.674+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac0c0cfeb0 con 0x7fabf8003a60 2023-10-06T03:02:31.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.675+0000 7fac02ffd700 1 -- 172.21.15.84:0/2597722386 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabfc0170a0 con 0x7fabf8003a60 2023-10-06T03:02:31.676 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabec066f30 msgr2=0x7fabec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabec066f30 0x7fabec0693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fabf4000c00 tx=0x7fabf4001500 comp rx=0 tx=0).stop 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 msgr2=0x7fac0c146e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fac0c146e30 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c0a0 tx=0x7fabfc01a000 comp rx=0 tx=0).stop 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 shutdown_connections 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fabec066f30 0x7fabec0693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac0c0c8550 0x7fac0c0c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf8003a60 0x7fac0c146e30 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 --2- 172.21.15.84:0/2597722386 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac0c169a50 0x7fac0c0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 >> 172.21.15.84:0/2597722386 conn(0x7fac0c089e90 msgr2=0x7fac0c0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 shutdown_connections 2023-10-06T03:02:31.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.677+0000 7fac10c2f700 1 -- 172.21.15.84:0/2597722386 wait complete. 2023-10-06T03:02:31.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:31.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.803+0000 7f2b90b49700 1 Processor -- start 2023-10-06T03:02:31.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.803+0000 7f2b90b49700 1 -- start start 2023-10-06T03:02:31.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.804+0000 7f2b90b49700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b8c1595a0 0x7f2b8c0aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.804+0000 7f2b90b49700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2b8c0b49e0 0x7f2b8c0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.804+0000 7f2b90b49700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c0b0ca0 con 0x7f2b8c0b07a0 2023-10-06T03:02:31.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.804+0000 7f2b90b49700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c0b0f80 con 0x7f2b8c1595a0 2023-10-06T03:02:31.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.804+0000 7f2b90b49700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c0b1260 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.804+0000 7f2b8a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b8c1595a0 0x7f2b8c0aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.804+0000 7f2b8ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2b8c0b07a0 0x7f2b8c0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35668/0 (socket says 172.21.15.84:35668) 2023-10-06T03:02:31.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.804+0000 7f2b8ad9d700 1 -- 172.21.15.84:0/1793567262 learned_addr learned my addr 172.21.15.84:0/1793567262 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.804+0000 7f2b81d9b700 1 --2- 172.21.15.84:0/1793567262 >> v2:172.21.15.131:3300/0 conn(0x7f2b8c0b49e0 0x7f2b8c0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b8a59c700 1 -- 172.21.15.84:0/1793567262 >> v2:172.21.15.131:3300/0 conn(0x7f2b8c0b49e0 msgr2=0x7f2b8c0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b8a59c700 1 --2- 172.21.15.84:0/1793567262 >> v2:172.21.15.131:3300/0 conn(0x7f2b8c0b49e0 0x7f2b8c0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b8a59c700 1 -- 172.21.15.84:0/1793567262 >> v1:172.21.15.84:6789/0 conn(0x7f2b8c0b07a0 legacy=0x7f2b8c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b8a59c700 1 -- 172.21.15.84:0/1793567262 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c0b1540 con 0x7f2b8c1595a0 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b8a59c700 1 --2- 172.21.15.84:0/1793567262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c1595a0 0x7f2b8c0aa570 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0098d0 tx=0x7f2b7c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fedad5c7a7cd88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b89d9b700 1 -- 172.21.15.84:0/1793567262 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c009e70 con 0x7f2b8c1595a0 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b89d9b700 1 -- 172.21.15.84:0/1793567262 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c005c10 con 0x7f2b8c1595a0 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b89d9b700 1 -- 172.21.15.84:0/1793567262 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00b610 con 0x7f2b8c1595a0 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b90b49700 1 -- 172.21.15.84:0/1793567262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c1595a0 msgr2=0x7f2b8c0aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b90b49700 1 --2- 172.21.15.84:0/1793567262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c1595a0 0x7f2b8c0aa570 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0098d0 tx=0x7f2b7c009120 comp rx=0 tx=0).stop 2023-10-06T03:02:31.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b90b49700 1 -- 172.21.15.84:0/1793567262 shutdown_connections 2023-10-06T03:02:31.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b90b49700 1 --2- 172.21.15.84:0/1793567262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c1595a0 0x7f2b8c0aa570 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b90b49700 1 --2- 172.21.15.84:0/1793567262 >> v2:172.21.15.131:3300/0 conn(0x7f2b8c0b49e0 0x7f2b8c0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b90b49700 1 -- 172.21.15.84:0/1793567262 >> 172.21.15.84:0/1793567262 conn(0x7f2b8c099830 msgr2=0x7f2b8c06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b90b49700 1 -- 172.21.15.84:0/1793567262 shutdown_connections 2023-10-06T03:02:31.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.805+0000 7f2b90b49700 1 -- 172.21.15.84:0/1793567262 wait complete. 2023-10-06T03:02:31.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.807+0000 7f2b90b49700 1 Processor -- start 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.807+0000 7f2b90b49700 1 -- start start 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.807+0000 7f2b90b49700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0b07a0 0x7f2b8c154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.807+0000 7f2b90b49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0b49e0 0x7f2b8c0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.807+0000 7f2b90b49700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c1595a0 0x7f2b8c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.807+0000 7f2b90b49700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0ce9d0 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.807+0000 7f2b90b49700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0cddc0 con 0x7f2b8c1595a0 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.807+0000 7f2b90b49700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0ce0a0 con 0x7f2b8c0b07a0 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.807+0000 7f2b81d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0b49e0 0x7f2b8c0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b81d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0b49e0 0x7f2b8c0cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50960/0 (socket says 172.21.15.84:50960) 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b81d9b700 1 -- 172.21.15.84:0/1321040919 learned_addr learned my addr 172.21.15.84:0/1321040919 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:31.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b8ad9d700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c1595a0 0x7f2b8c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b8a59c700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0b07a0 0x7f2b8c154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b81d9b700 1 -- 172.21.15.84:0/1321040919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0b07a0 msgr2=0x7f2b8c154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b81d9b700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0b07a0 0x7f2b8c154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b81d9b700 1 -- 172.21.15.84:0/1321040919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c1595a0 msgr2=0x7f2b8c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b81d9b700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c1595a0 0x7f2b8c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b81d9b700 1 -- 172.21.15.84:0/1321040919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0093c0 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b8ad9d700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c1595a0 0x7f2b8c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b81d9b700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0b49e0 0x7f2b8c0cee60 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400d890 tx=0x7f2b74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b82ffd700 1 -- 172.21.15.84:0/1321040919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74012630 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b82ffd700 1 -- 172.21.15.84:0/1321040919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74012790 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c0ce380 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b82ffd700 1 -- 172.21.15.84:0/1321040919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74012b50 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.808+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c1554e0 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.809+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c064ad0 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.809+0000 7f2b82ffd700 1 -- 172.21.15.84:0/1321040919 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b7401d400 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.810+0000 7f2b82ffd700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2b6c066f30 0x7f2b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.810+0000 7f2b82ffd700 1 -- 172.21.15.84:0/1321040919 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f2b74084cb0 con 0x7f2b8c0b49e0 2023-10-06T03:02:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.810+0000 7f2b8a59c700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2b6c066f30 0x7f2b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.810+0000 7f2b8a59c700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2b6c066f30 0x7f2b6c0693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009160 tx=0x7f2b7c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:31.814+0000 7f2b82ffd700 1 -- 172.21.15.84:0/1321040919 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b74051c40 con 0x7f2b8c0b49e0 2023-10-06T03:02:32.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.039+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b8c0ceb10 con 0x7f2b8c0b49e0 2023-10-06T03:02:32.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.040+0000 7f2b82ffd700 1 -- 172.21.15.84:0/1321040919 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7f2b74055260 con 0x7f2b8c0b49e0 2023-10-06T03:02:32.042 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:32.042 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:32.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2b6c066f30 msgr2=0x7f2b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2b6c066f30 0x7f2b6c0693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009160 tx=0x7f2b7c016000 comp rx=0 tx=0).stop 2023-10-06T03:02:32.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0b49e0 msgr2=0x7f2b8c0cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0b49e0 0x7f2b8c0cee60 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400d890 tx=0x7f2b74008040 comp rx=0 tx=0).stop 2023-10-06T03:02:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 shutdown_connections 2023-10-06T03:02:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2b6c066f30 0x7f2b6c0693e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b8c1595a0 0x7f2b8c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2b8c0b07a0 0x7f2b8c154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 --2- 172.21.15.84:0/1321040919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b8c0b49e0 0x7f2b8c0cee60 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 >> 172.21.15.84:0/1321040919 conn(0x7f2b8c099830 msgr2=0x7f2b8c157570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 shutdown_connections 2023-10-06T03:02:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.042+0000 7f2b90b49700 1 -- 172.21.15.84:0/1321040919 wait complete. 2023-10-06T03:02:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:32.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:32.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.168+0000 7f046130c700 1 Processor -- start 2023-10-06T03:02:32.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.168+0000 7f046130c700 1 -- start start 2023-10-06T03:02:32.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.169+0000 7f046130c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0ce8e0 0x7f045c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.169+0000 7f046130c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c157e20 con 0x7f045c0ca3b0 2023-10-06T03:02:32.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.169+0000 7f046130c700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c0cb610 con 0x7f045c0adba0 2023-10-06T03:02:32.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.169+0000 7f046130c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0cbbd0 con 0x7f045c0ce8e0 2023-10-06T03:02:32.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.169+0000 7f045affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f045c0ca3b0 0x7f045c1582b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:35678/0 (socket says 172.21.15.84:35678) 2023-10-06T03:02:32.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.169+0000 7f045affd700 1 -- 172.21.15.84:0/3772690088 learned_addr learned my addr 172.21.15.84:0/3772690088 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:32.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.169+0000 7f045b7fe700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0ce8e0 0x7f045c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815135024 0 0) 0x7f045c157e20 con 0x7f045c0ca3b0 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0448003570 con 0x7f045c0ca3b0 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3330667710 0 0) 0x7f0448003570 con 0x7f045c0ca3b0 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0ce8e0 msgr2=0x7f045c15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0ce8e0 0x7f045c15af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 >> v1:172.21.15.131:6789/0 conn(0x7f045c0adba0 legacy=0x7f045c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0cb8f0 con 0x7f045c0ca3b0 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f044c001470 con 0x7f045c0ca3b0 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 >> v1:172.21.15.84:6789/0 conn(0x7f045c0ca3b0 legacy=0x7f045c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0448003a90 0x7f0448003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f0448004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0ce8e0 0x7f04480051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0cbbd0 con 0x7f0448004810 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044800bb60 con 0x7f0448003a90 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044800bd20 con 0x7f045c0ce8e0 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f04527fc700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f0448004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045affd700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0448003a90 0x7f0448003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f045b7fe700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0ce8e0 0x7f04480051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f04527fc700 1 -- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0ce8e0 msgr2=0x7f04480051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f04527fc700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0ce8e0 0x7f04480051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f04527fc700 1 -- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0448003a90 msgr2=0x7f0448003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f04527fc700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0448003a90 0x7f0448003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.170+0000 7f04527fc700 1 -- 172.21.15.84:0/3772690088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448003570 con 0x7f0448004810 2023-10-06T03:02:32.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.171+0000 7f04527fc700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f0448004c80 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f0444001880 tx=0x7f0444007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5799eca31996f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.172+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444012420 con 0x7f0448004810 2023-10-06T03:02:32.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.172+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0444012580 con 0x7f0448004810 2023-10-06T03:02:32.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.172+0000 7f045a7fc700 1 -- 172.21.15.84:0/3772690088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444012920 con 0x7f0448004810 2023-10-06T03:02:32.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.173+0000 7f046130c700 1 -- 172.21.15.84:0/3772690088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 msgr2=0x7f0448004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.173+0000 7f046130c700 1 --2- 172.21.15.84:0/3772690088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f0448004c80 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f0444001880 tx=0x7f0444007d30 comp rx=0 tx=0).stop 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.173+0000 7f045b7fe700 1 -- 172.21.15.84:0/3772690088 reap_dead start 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.173+0000 7f046130c700 1 -- 172.21.15.84:0/3772690088 shutdown_connections 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.173+0000 7f046130c700 1 -- 172.21.15.84:0/3772690088 >> 172.21.15.84:0/3772690088 conn(0x7f045c070810 msgr2=0x7f045c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.173+0000 7f046130c700 1 -- 172.21.15.84:0/3772690088 shutdown_connections 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.173+0000 7f046130c700 1 -- 172.21.15.84:0/3772690088 wait complete. 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.174+0000 7f046130c700 1 Processor -- start 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.174+0000 7f046130c700 1 -- start start 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f046130c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f045c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f046130c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f045c152460 0x7f045c151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f046130c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0c5cd0 0x7f045c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f046130c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0b1ff0 con 0x7f0448004810 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f046130c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c152cf0 con 0x7f045c152460 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f046130c700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0b23b0 con 0x7f045c0c5cd0 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f045c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f045c0b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50976/0 (socket says 172.21.15.84:50976) 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045affd700 1 -- 172.21.15.84:0/2472115381 learned_addr learned my addr 172.21.15.84:0/2472115381 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f04527fc700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f045c152460 0x7f045c151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045b7fe700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0c5cd0 0x7f045c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045affd700 1 -- 172.21.15.84:0/2472115381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0c5cd0 msgr2=0x7f045c0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045affd700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0c5cd0 0x7f045c0c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045affd700 1 -- 172.21.15.84:0/2472115381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f045c152460 msgr2=0x7f045c151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045affd700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f045c152460 0x7f045c151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045affd700 1 -- 172.21.15.84:0/2472115381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0c6660 con 0x7f0448004810 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f04527fc700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f045c152460 0x7f045c151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f045affd700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f045c0b10c0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f044c007390 tx=0x7f044c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f04537fe700 1 -- 172.21.15.84:0/2472115381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c018030 con 0x7f0448004810 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f04537fe700 1 -- 172.21.15.84:0/2472115381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c00f920 con 0x7f0448004810 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c0b1750 con 0x7f0448004810 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f04537fe700 1 -- 172.21.15.84:0/2472115381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00fcc0 con 0x7f0448004810 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.175+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c0b1d10 con 0x7f0448004810 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.176+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c064ad0 con 0x7f0448004810 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.177+0000 7f04537fe700 1 -- 172.21.15.84:0/2472115381 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f044c01b070 con 0x7f0448004810 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.177+0000 7f04537fe700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f043c066f30 0x7f043c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.177+0000 7f04537fe700 1 -- 172.21.15.84:0/2472115381 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f044c019070 con 0x7f0448004810 2023-10-06T03:02:32.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.177+0000 7f04527fc700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f043c066f30 0x7f043c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.177+0000 7f04527fc700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f043c066f30 0x7f043c0693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0444008fd0 tx=0x7f0444015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.181+0000 7f04537fe700 1 -- 172.21.15.84:0/2472115381 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f044c0516e0 con 0x7f0448004810 2023-10-06T03:02:32.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.369+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f045c157ab0 con 0x7f0448004810 2023-10-06T03:02:32.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.369+0000 7f04537fe700 1 -- 172.21.15.84:0/2472115381 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17182 (secure 0 0 0) 0x7f044c054d00 con 0x7f0448004810 2023-10-06T03:02:32.371 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:32.371 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":108,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:01:52.175416+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:39.801172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:41.118752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.e","mappings":[{"from":0,"to":5}]},{"pgid":"17.30","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:32.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.371+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f043c066f30 msgr2=0x7f043c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.371+0000 7f046130c700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f043c066f30 0x7f043c0693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0444008fd0 tx=0x7f0444015000 comp rx=0 tx=0).stop 2023-10-06T03:02:32.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.371+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 msgr2=0x7f045c0b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.371+0000 7f046130c700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f045c0b10c0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f044c007390 tx=0x7f044c001e50 comp rx=0 tx=0).stop 2023-10-06T03:02:32.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.371+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 shutdown_connections 2023-10-06T03:02:32.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.372+0000 7f046130c700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f043c066f30 0x7f043c0693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.372+0000 7f046130c700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f045c0c5cd0 0x7f045c0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.372+0000 7f046130c700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0448004810 0x7f045c0b10c0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.372+0000 7f046130c700 1 --2- 172.21.15.84:0/2472115381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f045c152460 0x7f045c151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.372+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 >> 172.21.15.84:0/2472115381 conn(0x7f045c070810 msgr2=0x7f045c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:32.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.372+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 shutdown_connections 2023-10-06T03:02:32.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.372+0000 7f046130c700 1 -- 172.21.15.84:0/2472115381 wait complete. 2023-10-06T03:02:32.385 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:02:32.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:32.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.498+0000 7f86df59e700 1 Processor -- start 2023-10-06T03:02:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.498+0000 7f86df59e700 1 -- start start 2023-10-06T03:02:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86df59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e0159480 0x7f86e00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86df59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f86e00b3610 0x7f86e00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86df59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86e00cc1b0 0x7f86e00b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86df59e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00cb7e0 con 0x7f86e00cc1b0 2023-10-06T03:02:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86df59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e00b08a0 con 0x7f86e00b3610 2023-10-06T03:02:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86df59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00cb190 con 0x7f86e0159480 2023-10-06T03:02:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86ded9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86e00cc1b0 0x7f86e00b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86ded9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86e00cc1b0 0x7f86e00b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43072/0 (socket says 172.21.15.84:43072) 2023-10-06T03:02:32.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86ded9d700 1 -- 172.21.15.84:0/1700823329 learned_addr learned my addr 172.21.15.84:0/1700823329 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:32.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86ddd9b700 1 --2- 172.21.15.84:0/1700823329 >> v2:172.21.15.131:3300/0 conn(0x7f86e00b3610 0x7f86e00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86ded9d700 1 -- 172.21.15.84:0/1700823329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e0159480 msgr2=0x7f86e00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:32.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86de59c700 1 --2- 172.21.15.84:0/1700823329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e0159480 0x7f86e00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86ded9d700 1 --2- 172.21.15.84:0/1700823329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e0159480 0x7f86e00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86ded9d700 1 -- 172.21.15.84:0/1700823329 >> v2:172.21.15.131:3300/0 conn(0x7f86e00b3610 msgr2=0x7f86e00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:32.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86ded9d700 1 --2- 172.21.15.84:0/1700823329 >> v2:172.21.15.131:3300/0 conn(0x7f86e00b3610 0x7f86e00cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.499+0000 7f86ded9d700 1 -- 172.21.15.84:0/1700823329 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00cb470 con 0x7f86e00cc1b0 2023-10-06T03:02:32.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86ddd9b700 1 --2- 172.21.15.84:0/1700823329 >> v2:172.21.15.131:3300/0 conn(0x7f86e00b3610 0x7f86e00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86de59c700 1 --2- 172.21.15.84:0/1700823329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e0159480 0x7f86e00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86ded9d700 1 --2- 172.21.15.84:0/1700823329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00cc1b0 0x7f86e00b2140 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f86e0069160 tx=0x7f86d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7e7b5acbb0ae2a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86dd59a700 1 -- 172.21.15.84:0/1700823329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000b860 con 0x7f86e00cc1b0 2023-10-06T03:02:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86dd59a700 1 -- 172.21.15.84:0/1700823329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d000b9c0 con 0x7f86e00cc1b0 2023-10-06T03:02:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86dd59a700 1 -- 172.21.15.84:0/1700823329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000bd60 con 0x7f86e00cc1b0 2023-10-06T03:02:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86df59e700 1 -- 172.21.15.84:0/1700823329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00cc1b0 msgr2=0x7f86e00b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86df59e700 1 --2- 172.21.15.84:0/1700823329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00cc1b0 0x7f86e00b2140 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f86e0069160 tx=0x7f86d0009250 comp rx=0 tx=0).stop 2023-10-06T03:02:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86df59e700 1 -- 172.21.15.84:0/1700823329 shutdown_connections 2023-10-06T03:02:32.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86df59e700 1 --2- 172.21.15.84:0/1700823329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00cc1b0 0x7f86e00b2140 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86df59e700 1 --2- 172.21.15.84:0/1700823329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e0159480 0x7f86e00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86df59e700 1 --2- 172.21.15.84:0/1700823329 >> v2:172.21.15.131:3300/0 conn(0x7f86e00b3610 0x7f86e00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86df59e700 1 -- 172.21.15.84:0/1700823329 >> 172.21.15.84:0/1700823329 conn(0x7f86e006ed20 msgr2=0x7f86e006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86df59e700 1 -- 172.21.15.84:0/1700823329 shutdown_connections 2023-10-06T03:02:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.500+0000 7f86df59e700 1 -- 172.21.15.84:0/1700823329 wait complete. 2023-10-06T03:02:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86df59e700 1 Processor -- start 2023-10-06T03:02:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86df59e700 1 -- start start 2023-10-06T03:02:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86df59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00b3610 0x7f86e01556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86df59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e00cc1b0 0x7f86e015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86df59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e0159480 0x7f86e00c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86df59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e015e310 con 0x7f86e00b3610 2023-10-06T03:02:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86df59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e015e5f0 con 0x7f86e0159480 2023-10-06T03:02:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86df59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e015e8d0 con 0x7f86e00cc1b0 2023-10-06T03:02:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86de59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00b3610 0x7f86e01556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86de59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00b3610 0x7f86e01556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43076/0 (socket says 172.21.15.84:43076) 2023-10-06T03:02:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86de59c700 1 -- 172.21.15.84:0/2039724592 learned_addr learned my addr 172.21.15.84:0/2039724592 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.502+0000 7f86ded9d700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e0159480 0x7f86e00c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86ddd9b700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e00cc1b0 0x7f86e015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86de59c700 1 -- 172.21.15.84:0/2039724592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e00cc1b0 msgr2=0x7f86e015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86de59c700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e00cc1b0 0x7f86e015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86de59c700 1 -- 172.21.15.84:0/2039724592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e0159480 msgr2=0x7f86e00c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86de59c700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e0159480 0x7f86e00c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86de59c700 1 -- 172.21.15.84:0/2039724592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d00094f0 con 0x7f86e00b3610 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86de59c700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00b3610 0x7f86e01556c0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f86d800cfb0 tx=0x7f86d8007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86ce7fc700 1 -- 172.21.15.84:0/2039724592 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800ae30 con 0x7f86e00b3610 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86ce7fc700 1 -- 172.21.15.84:0/2039724592 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8016420 con 0x7f86e00b3610 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00cea90 con 0x7f86e00b3610 2023-10-06T03:02:32.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86ce7fc700 1 -- 172.21.15.84:0/2039724592 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80167e0 con 0x7f86e00b3610 2023-10-06T03:02:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.503+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e0155c00 con 0x7f86e00b3610 2023-10-06T03:02:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.504+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e00ce900 con 0x7f86e00b3610 2023-10-06T03:02:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.504+0000 7f86ce7fc700 1 -- 172.21.15.84:0/2039724592 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86d8016bd0 con 0x7f86e00b3610 2023-10-06T03:02:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.505+0000 7f86ce7fc700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f86c0066f30 0x7f86c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.505+0000 7f86ce7fc700 1 -- 172.21.15.84:0/2039724592 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f86d8012070 con 0x7f86e00b3610 2023-10-06T03:02:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.505+0000 7f86ddd9b700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f86c0066f30 0x7f86c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.505+0000 7f86ddd9b700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f86c0066f30 0x7f86c00693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f86e00cbfc0 tx=0x7f86d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.509+0000 7f86ce7fc700 1 -- 172.21.15.84:0/2039724592 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86d804e5a0 con 0x7f86e00b3610 2023-10-06T03:02:32.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.734+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86e00cee00 con 0x7f86e00b3610 2023-10-06T03:02:32.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.734+0000 7f86ce7fc700 1 -- 172.21.15.84:0/2039724592 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7f86d8052090 con 0x7f86e00b3610 2023-10-06T03:02:32.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:32.736 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f86c0066f30 msgr2=0x7f86c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f86c0066f30 0x7f86c00693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f86e00cbfc0 tx=0x7f86d4008040 comp rx=0 tx=0).stop 2023-10-06T03:02:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00b3610 msgr2=0x7f86e01556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00b3610 0x7f86e01556c0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f86d800cfb0 tx=0x7f86d8007870 comp rx=0 tx=0).stop 2023-10-06T03:02:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 shutdown_connections 2023-10-06T03:02:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f86c0066f30 0x7f86c00693e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e0159480 0x7f86e00c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86e00b3610 0x7f86e01556c0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 --2- 172.21.15.84:0/2039724592 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86e00cc1b0 0x7f86e015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 >> 172.21.15.84:0/2039724592 conn(0x7f86e006ed20 msgr2=0x7f86e00cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 shutdown_connections 2023-10-06T03:02:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.736+0000 7f86df59e700 1 -- 172.21.15.84:0/2039724592 wait complete. 2023-10-06T03:02:32.739 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:32.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.862+0000 7f2f98557700 1 Processor -- start 2023-10-06T03:02:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.862+0000 7f2f98557700 1 -- start start 2023-10-06T03:02:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.863+0000 7f2f98557700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2f901595a0 0x7f2f900aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.863+0000 7f2f98557700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b49e0 0x7f2f900aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.863+0000 7f2f98557700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900b0ca0 con 0x7f2f900b07a0 2023-10-06T03:02:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.863+0000 7f2f98557700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f900b0f80 con 0x7f2f901595a0 2023-10-06T03:02:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.863+0000 7f2f98557700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900b1260 con 0x7f2f900b49e0 2023-10-06T03:02:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f962f3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2f901595a0 0x7f2f900aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f95af2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b49e0 0x7f2f900aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f96af4700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2f900b07a0 0x7f2f900b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:54640/0 (socket says 172.21.15.84:54640) 2023-10-06T03:02:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f95af2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b49e0 0x7f2f900aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:34892/0 (socket says 172.21.15.84:34892) 2023-10-06T03:02:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f962f3700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2f901595a0 0x7f2f900aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:34102/0 (socket says 172.21.15.84:34102) 2023-10-06T03:02:32.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f96af4700 1 -- 172.21.15.84:0/3807306323 learned_addr learned my addr 172.21.15.84:0/3807306323 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f95af2700 1 -- 172.21.15.84:0/3807306323 >> v2:172.21.15.131:3300/0 conn(0x7f2f901595a0 msgr2=0x7f2f900aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:32.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f95af2700 1 --2- 172.21.15.84:0/3807306323 >> v2:172.21.15.131:3300/0 conn(0x7f2f901595a0 0x7f2f900aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f95af2700 1 -- 172.21.15.84:0/3807306323 >> v1:172.21.15.131:6789/0 conn(0x7f2f900b07a0 legacy=0x7f2f900b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f95af2700 1 -- 172.21.15.84:0/3807306323 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900b1540 con 0x7f2f900b49e0 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f962f3700 1 --2- 172.21.15.84:0/3807306323 >> v2:172.21.15.131:3300/0 conn(0x7f2f901595a0 0x7f2f900aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f95af2700 1 --2- 172.21.15.84:0/3807306323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b49e0 0x7f2f900aaab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f800098e0 tx=0x7f2f800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad8a6c71ffbbd24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.864+0000 7f2f952f1700 1 -- 172.21.15.84:0/3807306323 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000b640 con 0x7f2f900b49e0 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f952f1700 1 -- 172.21.15.84:0/3807306323 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000b7a0 con 0x7f2f900b49e0 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f952f1700 1 -- 172.21.15.84:0/3807306323 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000bb40 con 0x7f2f900b49e0 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f98557700 1 -- 172.21.15.84:0/3807306323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b49e0 msgr2=0x7f2f900aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f98557700 1 --2- 172.21.15.84:0/3807306323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b49e0 0x7f2f900aaab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f800098e0 tx=0x7f2f800091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f98557700 1 -- 172.21.15.84:0/3807306323 shutdown_connections 2023-10-06T03:02:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f98557700 1 --2- 172.21.15.84:0/3807306323 >> v2:172.21.15.131:3300/0 conn(0x7f2f901595a0 0x7f2f900aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f98557700 1 --2- 172.21.15.84:0/3807306323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b49e0 0x7f2f900aaab0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f98557700 1 -- 172.21.15.84:0/3807306323 >> 172.21.15.84:0/3807306323 conn(0x7f2f90099830 msgr2=0x7f2f9006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f98557700 1 -- 172.21.15.84:0/3807306323 shutdown_connections 2023-10-06T03:02:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.865+0000 7f2f98557700 1 -- 172.21.15.84:0/3807306323 wait complete. 2023-10-06T03:02:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.866+0000 7f2f98557700 1 Processor -- start 2023-10-06T03:02:32.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.866+0000 7f2f98557700 1 -- start start 2023-10-06T03:02:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f98557700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b07a0 0x7f2f90099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f98557700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f900b49e0 0x7f2f9015bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f98557700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f901595a0 0x7f2f90156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f98557700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9015c090 con 0x7f2f901595a0 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f98557700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9009b280 con 0x7f2f900b49e0 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f98557700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9009a670 con 0x7f2f900b07a0 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f96af4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f901595a0 0x7f2f90156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f96af4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f901595a0 0x7f2f90156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43090/0 (socket says 172.21.15.84:43090) 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f96af4700 1 -- 172.21.15.84:0/3904851944 learned_addr learned my addr 172.21.15.84:0/3904851944 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f962f3700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b07a0 0x7f2f90099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f95af2700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f900b49e0 0x7f2f9015bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f96af4700 1 -- 172.21.15.84:0/3904851944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b07a0 msgr2=0x7f2f90099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f96af4700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b07a0 0x7f2f90099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f96af4700 1 -- 172.21.15.84:0/3904851944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f900b49e0 msgr2=0x7f2f9015bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f96af4700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f900b49e0 0x7f2f9015bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.867+0000 7f2f96af4700 1 -- 172.21.15.84:0/3904851944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c009a20 con 0x7f2f901595a0 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.868+0000 7f2f96af4700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f901595a0 0x7f2f90156460 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c590 tx=0x7f2f88007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.868+0000 7f2f867fc700 1 -- 172.21.15.84:0/3904851944 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88005b30 con 0x7f2f901595a0 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.868+0000 7f2f867fc700 1 -- 172.21.15.84:0/3904851944 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88005cb0 con 0x7f2f901595a0 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.868+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f80009420 con 0x7f2f901595a0 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.868+0000 7f2f867fc700 1 -- 172.21.15.84:0/3904851944 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88007320 con 0x7f2f901595a0 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.868+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9009ac30 con 0x7f2f901595a0 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.869+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9009b410 con 0x7f2f901595a0 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.869+0000 7f2f867fc700 1 -- 172.21.15.84:0/3904851944 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f8801b3b0 con 0x7f2f901595a0 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.869+0000 7f2f867fc700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f74066f30 0x7f2f740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.870+0000 7f2f867fc700 1 -- 172.21.15.84:0/3904851944 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f2f88083c00 con 0x7f2f901595a0 2023-10-06T03:02:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.870+0000 7f2f962f3700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f74066f30 0x7f2f740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.870+0000 7f2f962f3700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f74066f30 0x7f2f740693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00f6a0 tx=0x7f2f8c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:32.874+0000 7f2f867fc700 1 -- 172.21.15.84:0/3904851944 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f8808a080 con 0x7f2f901595a0 2023-10-06T03:02:33.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.098+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f90064ad0 con 0x7f2f901595a0 2023-10-06T03:02:33.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.098+0000 7f2f867fc700 1 -- 172.21.15.84:0/3904851944 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4643 (secure 0 0 0) 0x7f2f88017020 con 0x7f2f901595a0 2023-10-06T03:02:33.100 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:33.100 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:42.160779+0000","modified":"2023-10-06T03:02:15.237526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8529,"mds_1":8526,"mds_2":6782},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6782":{"gid":6782,"name":"b","rank":2,"incarnation":105,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6835/3436673358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":3436673358},{"type":"v1","addr":"172.21.15.131:6835","nonce":3436673358}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8526":{"gid":8526,"name":"c","rank":1,"incarnation":103,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6836/3850699528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3850699528},{"type":"v1","addr":"172.21.15.84:6836","nonce":3850699528}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8529":{"gid":8529,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.84:6837/868960356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":868960356},{"type":"v1","addr":"172.21.15.84:6837","nonce":868960356}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T03:02:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f74066f30 msgr2=0x7f2f740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f74066f30 0x7f2f740693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00f6a0 tx=0x7f2f8c00b040 comp rx=0 tx=0).stop 2023-10-06T03:02:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f901595a0 msgr2=0x7f2f90156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f901595a0 0x7f2f90156460 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c590 tx=0x7f2f88007ef0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 shutdown_connections 2023-10-06T03:02:33.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2f74066f30 0x7f2f740693e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f901595a0 0x7f2f90156460 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f900b07a0 0x7f2f90099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 --2- 172.21.15.84:0/3904851944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f900b49e0 0x7f2f9015bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 >> 172.21.15.84:0/3904851944 conn(0x7f2f90099830 msgr2=0x7f2f90158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.100+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 shutdown_connections 2023-10-06T03:02:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.101+0000 7f2f98557700 1 -- 172.21.15.84:0/3904851944 wait complete. 2023-10-06T03:02:33.103 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 111 2023-10-06T03:02:33.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:33.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.225+0000 7fbac9035700 1 Processor -- start 2023-10-06T03:02:33.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.225+0000 7fbac9035700 1 -- start start 2023-10-06T03:02:33.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.226+0000 7fbac9035700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbac40ca3b0 0x7fbac41582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.226+0000 7fbac9035700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbac40ce8e0 0x7fbac415af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.226+0000 7fbac9035700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac4157e20 con 0x7fbac40adba0 2023-10-06T03:02:33.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.226+0000 7fbac9035700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40cbbd0 con 0x7fbac40ca3b0 2023-10-06T03:02:33.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.226+0000 7fbac9035700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40cb610 con 0x7fbac40ce8e0 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.226+0000 7fbac2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbac40ca3b0 0x7fbac41582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.226+0000 7fbac2d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbac40ca3b0 0x7fbac41582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43100/0 (socket says 172.21.15.84:43100) 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.226+0000 7fbac2d9d700 1 -- 172.21.15.84:0/2954236177 learned_addr learned my addr 172.21.15.84:0/2954236177 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.226+0000 7fbac359e700 1 --2- 172.21.15.84:0/2954236177 >> v2:172.21.15.131:3300/0 conn(0x7fbac40ce8e0 0x7fbac415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac2d9d700 1 -- 172.21.15.84:0/2954236177 >> v2:172.21.15.131:3300/0 conn(0x7fbac40ce8e0 msgr2=0x7fbac415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac2d9d700 1 --2- 172.21.15.84:0/2954236177 >> v2:172.21.15.131:3300/0 conn(0x7fbac40ce8e0 0x7fbac415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac2d9d700 1 -- 172.21.15.84:0/2954236177 >> v1:172.21.15.131:6789/0 conn(0x7fbac40adba0 legacy=0x7fbac40ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac2d9d700 1 -- 172.21.15.84:0/2954236177 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40cb8f0 con 0x7fbac40ca3b0 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac359e700 1 --2- 172.21.15.84:0/2954236177 >> v2:172.21.15.131:3300/0 conn(0x7fbac40ce8e0 0x7fbac415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac2d9d700 1 --2- 172.21.15.84:0/2954236177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40ca3b0 0x7fbac41582b0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fbac4155500 tx=0x7fbab4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936751bc7ab378bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac259c700 1 -- 172.21.15.84:0/2954236177 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab400b860 con 0x7fbac40ca3b0 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac259c700 1 -- 172.21.15.84:0/2954236177 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab400b9c0 con 0x7fbac40ca3b0 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac259c700 1 -- 172.21.15.84:0/2954236177 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab400bd60 con 0x7fbac40ca3b0 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac9035700 1 -- 172.21.15.84:0/2954236177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40ca3b0 msgr2=0x7fbac41582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac9035700 1 --2- 172.21.15.84:0/2954236177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40ca3b0 0x7fbac41582b0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fbac4155500 tx=0x7fbab4009250 comp rx=0 tx=0).stop 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac9035700 1 -- 172.21.15.84:0/2954236177 shutdown_connections 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac9035700 1 --2- 172.21.15.84:0/2954236177 >> v2:172.21.15.131:3300/0 conn(0x7fbac40ce8e0 0x7fbac415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac9035700 1 --2- 172.21.15.84:0/2954236177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40ca3b0 0x7fbac41582b0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac9035700 1 -- 172.21.15.84:0/2954236177 >> 172.21.15.84:0/2954236177 conn(0x7fbac4070810 msgr2=0x7fbac4070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac9035700 1 -- 172.21.15.84:0/2954236177 shutdown_connections 2023-10-06T03:02:33.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.227+0000 7fbac9035700 1 -- 172.21.15.84:0/2954236177 wait complete. 2023-10-06T03:02:33.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.229+0000 7fbac9035700 1 Processor -- start 2023-10-06T03:02:33.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.229+0000 7fbac9035700 1 -- start start 2023-10-06T03:02:33.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.229+0000 7fbac9035700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40adba0 0x7fbac414d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.229+0000 7fbac9035700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbac40ca3b0 0x7fbac4068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.229+0000 7fbac9035700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbac40ce8e0 0x7fbac40c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.229+0000 7fbac9035700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4069bf0 con 0x7fbac40adba0 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.229+0000 7fbac9035700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40b17c0 con 0x7fbac40ce8e0 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.229+0000 7fbac9035700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4068fe0 con 0x7fbac40ca3b0 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40adba0 0x7fbac414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac2d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40adba0 0x7fbac414d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43112/0 (socket says 172.21.15.84:43112) 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac2d9d700 1 -- 172.21.15.84:0/2304402329 learned_addr learned my addr 172.21.15.84:0/2304402329 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbaba59c700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbac40ca3b0 0x7fbac4068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac359e700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbac40ce8e0 0x7fbac40c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac2d9d700 1 -- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbac40ca3b0 msgr2=0x7fbac4068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac2d9d700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbac40ca3b0 0x7fbac4068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac2d9d700 1 -- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbac40ce8e0 msgr2=0x7fbac40c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac2d9d700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbac40ce8e0 0x7fbac40c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac2d9d700 1 -- 172.21.15.84:0/2304402329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab40094f0 con 0x7fbac40adba0 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbaba59c700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbac40ca3b0 0x7fbac4068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac359e700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbac40ce8e0 0x7fbac40c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac2d9d700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40adba0 0x7fbac414d710 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009290 tx=0x7fbab4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbabb7fe700 1 -- 172.21.15.84:0/2304402329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4011e60 con 0x7fbac40adba0 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbabb7fe700 1 -- 172.21.15.84:0/2304402329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab401f070 con 0x7fbac40adba0 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac40692c0 con 0x7fbac40adba0 2023-10-06T03:02:33.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbabb7fe700 1 -- 172.21.15.84:0/2304402329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab401a870 con 0x7fbac40adba0 2023-10-06T03:02:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.230+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac4069880 con 0x7fbac40adba0 2023-10-06T03:02:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.231+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac4064ad0 con 0x7fbac40adba0 2023-10-06T03:02:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.232+0000 7fbabb7fe700 1 -- 172.21.15.84:0/2304402329 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbab401abe0 con 0x7fbac40adba0 2023-10-06T03:02:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.232+0000 7fbabb7fe700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbaa4066f30 0x7fbaa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.232+0000 7fbabb7fe700 1 -- 172.21.15.84:0/2304402329 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fbab4021070 con 0x7fbac40adba0 2023-10-06T03:02:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.232+0000 7fbaba59c700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbaa4066f30 0x7fbaa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.232+0000 7fbaba59c700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbaa4066f30 0x7fbaa40693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbaac007fd0 tx=0x7fbaac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.236+0000 7fbabb7fe700 1 -- 172.21.15.84:0/2304402329 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbab40537f0 con 0x7fbac40adba0 2023-10-06T03:02:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.421+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbac4157ab0 con 0x7fbac40adba0 2023-10-06T03:02:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.422+0000 7fbabb7fe700 1 -- 172.21.15.84:0/2304402329 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17182 (secure 0 0 0) 0x7fbab4056e10 con 0x7fbac40adba0 2023-10-06T03:02:33.424 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:33.424 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":108,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:01:52.175416+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:39.801172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:41.118752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.e","mappings":[{"from":0,"to":5}]},{"pgid":"17.30","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:33.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbaa4066f30 msgr2=0x7fbaa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbaa4066f30 0x7fbaa40693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbaac007fd0 tx=0x7fbaac009040 comp rx=0 tx=0).stop 2023-10-06T03:02:33.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40adba0 msgr2=0x7fbac414d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40adba0 0x7fbac414d710 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009290 tx=0x7fbab4017000 comp rx=0 tx=0).stop 2023-10-06T03:02:33.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 shutdown_connections 2023-10-06T03:02:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbaa4066f30 0x7fbaa40693e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbac40ce8e0 0x7fbac40c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbac40adba0 0x7fbac414d710 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 --2- 172.21.15.84:0/2304402329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbac40ca3b0 0x7fbac4068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 >> 172.21.15.84:0/2304402329 conn(0x7fbac4070810 msgr2=0x7fbac4063450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 shutdown_connections 2023-10-06T03:02:33.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.424+0000 7fbac9035700 1 -- 172.21.15.84:0/2304402329 wait complete. 2023-10-06T03:02:33.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:02:33.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.550+0000 7fcd5128d700 1 Processor -- start 2023-10-06T03:02:33.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.550+0000 7fcd5128d700 1 -- start start 2023-10-06T03:02:33.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.551+0000 7fcd5128d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 0x7fcd4c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.551+0000 7fcd5128d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcd4c0ce710 0x7fcd4c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.551+0000 7fcd5128d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c0ceb70 con 0x7fcd4c0ca3b0 2023-10-06T03:02:33.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.551+0000 7fcd5128d700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c0cbbd0 con 0x7fcd4c0ce710 2023-10-06T03:02:33.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.551+0000 7fcd5128d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c157e20 con 0x7fcd4c0adba0 2023-10-06T03:02:33.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4b7fe700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcd4c0ce710 0x7fcd4c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4affd700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fcd4c0ca3b0 0x7fcd4c1582b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:54664/0 (socket says 172.21.15.84:54664) 2023-10-06T03:02:33.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4affd700 1 -- 172.21.15.84:0/423363964 learned_addr learned my addr 172.21.15.84:0/423363964 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd427fc700 1 --2- 172.21.15.84:0/423363964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 0x7fcd4c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4b7fe700 1 -- 172.21.15.84:0/423363964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 msgr2=0x7fcd4c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4b7fe700 1 --2- 172.21.15.84:0/423363964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 0x7fcd4c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4b7fe700 1 -- 172.21.15.84:0/423363964 >> v1:172.21.15.131:6789/0 conn(0x7fcd4c0ca3b0 legacy=0x7fcd4c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4b7fe700 1 -- 172.21.15.84:0/423363964 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0cb610 con 0x7fcd4c0ce710 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4a7fc700 1 -- 172.21.15.84:0/423363964 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467463956 0 0) 0x7fcd3c001110 con 0x7fcd4c0ca3b0 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4b7fe700 1 --2- 172.21.15.84:0/423363964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0ce710 0x7fcd4c15af10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009e60 tx=0x7fcd44009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=497004c20cd1f801 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4a7fc700 1 -- 172.21.15.84:0/423363964 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4400e070 con 0x7fcd4c0ce710 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.552+0000 7fcd4a7fc700 1 -- 172.21.15.84:0/423363964 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4400bb60 con 0x7fcd4c0ce710 2023-10-06T03:02:33.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.553+0000 7fcd4a7fc700 1 -- 172.21.15.84:0/423363964 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44012430 con 0x7fcd4c0ce710 2023-10-06T03:02:33.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.553+0000 7fcd5128d700 1 -- 172.21.15.84:0/423363964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0ce710 msgr2=0x7fcd4c15af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.553+0000 7fcd5128d700 1 --2- 172.21.15.84:0/423363964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0ce710 0x7fcd4c15af10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009e60 tx=0x7fcd44009780 comp rx=0 tx=0).stop 2023-10-06T03:02:33.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.553+0000 7fcd5128d700 1 -- 172.21.15.84:0/423363964 shutdown_connections 2023-10-06T03:02:33.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.553+0000 7fcd5128d700 1 --2- 172.21.15.84:0/423363964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0ce710 0x7fcd4c15af10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.553+0000 7fcd5128d700 1 --2- 172.21.15.84:0/423363964 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 0x7fcd4c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.553+0000 7fcd5128d700 1 -- 172.21.15.84:0/423363964 >> 172.21.15.84:0/423363964 conn(0x7fcd4c070810 msgr2=0x7fcd4c070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.553+0000 7fcd5128d700 1 -- 172.21.15.84:0/423363964 shutdown_connections 2023-10-06T03:02:33.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.553+0000 7fcd5128d700 1 -- 172.21.15.84:0/423363964 wait complete. 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.554+0000 7fcd5128d700 1 Processor -- start 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.554+0000 7fcd5128d700 1 -- start start 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd5128d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 0x7fcd4c14bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd5128d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0ca3b0 0x7fcd4c0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd5128d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c0ce710 0x7fcd4c0c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd5128d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c155530 con 0x7fcd4c0ce710 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd5128d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c155780 con 0x7fcd4c0ca3b0 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd5128d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c155a60 con 0x7fcd4c0adba0 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd4b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c0ce710 0x7fcd4c0c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd4b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c0ce710 0x7fcd4c0c1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43128/0 (socket says 172.21.15.84:43128) 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd4b7fe700 1 -- 172.21.15.84:0/3486522489 learned_addr learned my addr 172.21.15.84:0/3486522489 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:33.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd427fc700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0ca3b0 0x7fcd4c0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd4affd700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 0x7fcd4c14bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd4b7fe700 1 -- 172.21.15.84:0/3486522489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 msgr2=0x7fcd4c14bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd4b7fe700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 0x7fcd4c14bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd4b7fe700 1 -- 172.21.15.84:0/3486522489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0ca3b0 msgr2=0x7fcd4c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd4b7fe700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0ca3b0 0x7fcd4c0b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.555+0000 7fcd4b7fe700 1 -- 172.21.15.84:0/3486522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44009a20 con 0x7fcd4c0ce710 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.556+0000 7fcd4b7fe700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c0ce710 0x7fcd4c0c1d50 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0cdfe0 tx=0x7fcd44019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.556+0000 7fcd437fe700 1 -- 172.21.15.84:0/3486522489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44012ea0 con 0x7fcd4c0ce710 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.556+0000 7fcd437fe700 1 -- 172.21.15.84:0/3486522489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd44027470 con 0x7fcd4c0ce710 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.556+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c155d40 con 0x7fcd4c0ce710 2023-10-06T03:02:33.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.556+0000 7fcd437fe700 1 -- 172.21.15.84:0/3486522489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44027830 con 0x7fcd4c0ce710 2023-10-06T03:02:33.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.556+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c0b3c80 con 0x7fcd4c0ce710 2023-10-06T03:02:33.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.557+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c064ad0 con 0x7fcd4c0ce710 2023-10-06T03:02:33.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.557+0000 7fcd437fe700 1 -- 172.21.15.84:0/3486522489 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd44024070 con 0x7fcd4c0ce710 2023-10-06T03:02:33.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.558+0000 7fcd437fe700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcd2c066f30 0x7fcd2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.558+0000 7fcd437fe700 1 -- 172.21.15.84:0/3486522489 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fcd44086ec0 con 0x7fcd4c0ce710 2023-10-06T03:02:33.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.558+0000 7fcd4affd700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcd2c066f30 0x7fcd2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.558+0000 7fcd4affd700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcd2c066f30 0x7fcd2c0693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c006fc0 tx=0x7fcd3c007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.562+0000 7fcd437fe700 1 -- 172.21.15.84:0/3486522489 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd44053e50 con 0x7fcd4c0ce710 2023-10-06T03:02:33.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.784+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcd4c0cb8f0 con 0x7fcd4c0ce710 2023-10-06T03:02:33.786 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-10-06T03:02:33.785+0000 7fedbe922700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:02:33.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.789+0000 7fcd437fe700 1 -- 172.21.15.84:0/3486522489 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v112) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcd44057470 con 0x7fcd4c0ce710 2023-10-06T03:02:33.792 INFO:tasks.ceph.mds.a.smithi084.stderr: -9966> 2023-10-06T03:01:52.072+0000 7fb0e674e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-06T03:02:33.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcd2c066f30 msgr2=0x7fcd2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcd2c066f30 0x7fcd2c0693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c006fc0 tx=0x7fcd3c007b90 comp rx=0 tx=0).stop 2023-10-06T03:02:33.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c0ce710 msgr2=0x7fcd4c0c1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c0ce710 0x7fcd4c0c1d50 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0cdfe0 tx=0x7fcd44019000 comp rx=0 tx=0).stop 2023-10-06T03:02:33.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 shutdown_connections 2023-10-06T03:02:33.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcd2c066f30 0x7fcd2c0693e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd4c0ce710 0x7fcd4c0c1d50 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcd4c0adba0 0x7fcd4c14bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 --2- 172.21.15.84:0/3486522489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0ca3b0 0x7fcd4c0b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 >> 172.21.15.84:0/3486522489 conn(0x7fcd4c070810 msgr2=0x7fcd4c159a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 shutdown_connections 2023-10-06T03:02:33.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.792+0000 7fcd5128d700 1 -- 172.21.15.84:0/3486522489 wait complete. 2023-10-06T03:02:33.795 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:02:33.799 INFO:tasks.ceph.mds.c.smithi084.stderr: -1177> 2023-10-06T03:02:10.538+0000 7facd113f700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-10-06T03:01:53.634533+0000 1=0+1) n(v2 rc2023-10-06T03:01:53.860530+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={7558=pAsLsXsFsx/pAsLsXsFsx@4},l=7558 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x561de2e1a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.634533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.860530+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.634533+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-10-06T03:01:53.860530+0000 4=0+4)","error_str":""},"return_code":-61} 2023-10-06T03:02:33.799 INFO:tasks.ceph.mds.c.smithi084.stderr: -1057> 2023-10-06T03:02:10.540+0000 7facd714b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1) n(v1 rc2023-10-06T03:01:53.860530+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={7558=pAsLsXsFs/pAsLsXsFsx@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x561de2e1a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.635533+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-06T03:01:53.860530+0000 3=0+3)","error_str":""},"return_code":-61} 2023-10-06T03:02:33.800 INFO:tasks.ceph.mds.b.smithi131.stderr: -1068> 2023-10-06T03:02:10.540+0000 7fa223ad5700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1) n(v0 rc2023-10-06T03:01:53.635533+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7558=pAsLsXsFsx/pAsLsXsFsx@4},l=7558 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5599a5c9c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.635533+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.635533+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-10-06T03:01:53.635533+0000 2=0+2)","error_str":""},"return_code":-61} 2023-10-06T03:02:33.800 INFO:tasks.ceph.mds.b.smithi131.stderr: -1054> 2023-10-06T03:02:10.540+0000 7fa223ad5700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={7558=pAsLsXsFsx/AsLsXsFsx@2},l=7558 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5599a5c9cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-10-06T03:02:33.801 INFO:tasks.ceph.mds.a.smithi084.stderr: -2493> 2023-10-06T03:02:10.538+0000 7fb0e2f47700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1) n(v3 rc2023-10-06T03:01:53.860530+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={7558=pAsLsXsFsx/pAsLsXsFsx@5},l=7558 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x5631ae0f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.860530+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-10-06T03:01:53.860530+0000 6=0+6)","error_str":""},"return_code":-61} 2023-10-06T03:02:33.801 INFO:tasks.ceph.mds.a.smithi084.stderr: -2398> 2023-10-06T03:02:10.539+0000 7fb0e8f53700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1) n(v4 rc2023-10-06T03:01:53.860530+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={7558=pAsLsXsFs/pAsLsXsFsx@9} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x5631ae366000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-06T03:01:53.860530+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-10-06T03:01:53.633533+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-10-06T03:01:53.860530+0000 5=0+5)","error_str":""},"return_code":-61} 2023-10-06T03:02:33.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:02:33.822 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-10-06T03:02:33.822 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-10-06T03:02:33.824 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-10-06T03:02:33.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.927+0000 7fa749ef2700 1 Processor -- start 2023-10-06T03:02:33.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.927+0000 7fa749ef2700 1 -- start start 2023-10-06T03:02:33.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.928+0000 7fa749ef2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa744067840 0x7fa744158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.928+0000 7fa749ef2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa744067c10 0x7fa74415af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.928+0000 7fa749ef2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa744157aa0 con 0x7fa74415b4d0 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.928+0000 7fa749ef2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7440c9970 con 0x7fa744067c10 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.928+0000 7fa749ef2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74415bac0 con 0x7fa744067840 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.928+0000 7fa742ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa744067c10 0x7fa74415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.928+0000 7fa742ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa744067c10 0x7fa74415af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43156/0 (socket says 172.21.15.84:43156) 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.928+0000 7fa742ffd700 1 -- 172.21.15.84:0/1700363699 learned_addr learned my addr 172.21.15.84:0/1700363699 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.928+0000 7fa7437fe700 1 --2- 172.21.15.84:0/1700363699 >> v2:172.21.15.131:3300/0 conn(0x7fa744067840 0x7fa744158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa742ffd700 1 -- 172.21.15.84:0/1700363699 >> v2:172.21.15.131:3300/0 conn(0x7fa744067840 msgr2=0x7fa744158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa742ffd700 1 --2- 172.21.15.84:0/1700363699 >> v2:172.21.15.131:3300/0 conn(0x7fa744067840 0x7fa744158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa742ffd700 1 -- 172.21.15.84:0/1700363699 >> v1:172.21.15.131:6789/0 conn(0x7fa74415b4d0 legacy=0x7fa744140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa742ffd700 1 -- 172.21.15.84:0/1700363699 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744157d10 con 0x7fa744067c10 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa7437fe700 1 --2- 172.21.15.84:0/1700363699 >> v2:172.21.15.131:3300/0 conn(0x7fa744067840 0x7fa744158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa742ffd700 1 --2- 172.21.15.84:0/1700363699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067c10 0x7fa74415af90 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c9bb0 tx=0x7fa738009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9279c3f4267ae252 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa7427fc700 1 -- 172.21.15.84:0/1700363699 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73800b860 con 0x7fa744067c10 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa7427fc700 1 -- 172.21.15.84:0/1700363699 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73800b9c0 con 0x7fa744067c10 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa7427fc700 1 -- 172.21.15.84:0/1700363699 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73800bd60 con 0x7fa744067c10 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa749ef2700 1 -- 172.21.15.84:0/1700363699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067c10 msgr2=0x7fa74415af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa749ef2700 1 --2- 172.21.15.84:0/1700363699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067c10 0x7fa74415af90 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c9bb0 tx=0x7fa738009250 comp rx=0 tx=0).stop 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa749ef2700 1 -- 172.21.15.84:0/1700363699 shutdown_connections 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa749ef2700 1 --2- 172.21.15.84:0/1700363699 >> v2:172.21.15.131:3300/0 conn(0x7fa744067840 0x7fa744158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa749ef2700 1 --2- 172.21.15.84:0/1700363699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067c10 0x7fa74415af90 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa749ef2700 1 -- 172.21.15.84:0/1700363699 >> 172.21.15.84:0/1700363699 conn(0x7fa7440cd1e0 msgr2=0x7fa7440cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.929+0000 7fa749ef2700 1 -- 172.21.15.84:0/1700363699 shutdown_connections 2023-10-06T03:02:33.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.930+0000 7fa749ef2700 1 -- 172.21.15.84:0/1700363699 wait complete. 2023-10-06T03:02:33.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.931+0000 7fa749ef2700 1 Processor -- start 2023-10-06T03:02:33.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.931+0000 7fa749ef2700 1 -- start start 2023-10-06T03:02:33.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.931+0000 7fa749ef2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067840 0x7fa7440cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.931+0000 7fa749ef2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa744067c10 0x7fa74416da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.931+0000 7fa749ef2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74415b4d0 0x7fa74413d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.931+0000 7fa749ef2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74416df90 con 0x7fa744067840 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.931+0000 7fa749ef2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440c5e40 con 0x7fa744067c10 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.931+0000 7fa749ef2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74416e1c0 con 0x7fa74415b4d0 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa7437fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067840 0x7fa7440cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa7437fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067840 0x7fa7440cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43160/0 (socket says 172.21.15.84:43160) 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa7437fe700 1 -- 172.21.15.84:0/396199717 learned_addr learned my addr 172.21.15.84:0/396199717 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa742ffd700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa744067c10 0x7fa74416da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa743fff700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74415b4d0 0x7fa74413d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa7437fe700 1 -- 172.21.15.84:0/396199717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74415b4d0 msgr2=0x7fa74413d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa7437fe700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74415b4d0 0x7fa74413d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa7437fe700 1 -- 172.21.15.84:0/396199717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa744067c10 msgr2=0x7fa74416da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa7437fe700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa744067c10 0x7fa74416da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa7437fe700 1 -- 172.21.15.84:0/396199717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7380094f0 con 0x7fa744067840 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa7437fe700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067840 0x7fa7440cb7d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fa73400d1d0 tx=0x7fa734009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa72b7fe700 1 -- 172.21.15.84:0/396199717 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400dd10 con 0x7fa744067840 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa72b7fe700 1 -- 172.21.15.84:0/396199717 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400f040 con 0x7fa744067840 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74416e4a0 con 0x7fa744067840 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa72b7fe700 1 -- 172.21.15.84:0/396199717 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734015670 con 0x7fa744067840 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.932+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74413db00 con 0x7fa744067840 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.933+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74416e9c0 con 0x7fa744067840 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.933+0000 7fa72b7fe700 1 -- 172.21.15.84:0/396199717 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa734015a60 con 0x7fa744067840 2023-10-06T03:02:33.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.934+0000 7fa72b7fe700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa730066f30 0x7fa7300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.934+0000 7fa72b7fe700 1 -- 172.21.15.84:0/396199717 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6694+0+0 (secure 0 0 0) 0x7fa734084c70 con 0x7fa744067840 2023-10-06T03:02:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.934+0000 7fa742ffd700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa730066f30 0x7fa7300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.934+0000 7fa742ffd700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa730066f30 0x7fa7300693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c9bb0 tx=0x7fa738017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:33.938+0000 7fa72b7fe700 1 -- 172.21.15.84:0/396199717 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa73404e5a0 con 0x7fa744067840 2023-10-06T03:02:34.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.161+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa744064ad0 con 0x7fa744067840 2023-10-06T03:02:34.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.789+0000 7fa72b7fe700 1 -- 172.21.15.84:0/396199717 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v113) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa73401a0a0 con 0x7fa744067840 2023-10-06T03:02:34.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.791+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa730066f30 msgr2=0x7fa7300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:34.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.791+0000 7fa749ef2700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa730066f30 0x7fa7300693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c9bb0 tx=0x7fa738017000 comp rx=0 tx=0).stop 2023-10-06T03:02:34.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.791+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067840 msgr2=0x7fa7440cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:34.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.791+0000 7fa749ef2700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067840 0x7fa7440cb7d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fa73400d1d0 tx=0x7fa734009a90 comp rx=0 tx=0).stop 2023-10-06T03:02:34.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.792+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 shutdown_connections 2023-10-06T03:02:34.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.792+0000 7fa749ef2700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa730066f30 0x7fa7300693e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.792+0000 7fa749ef2700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74415b4d0 0x7fa74413d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.792+0000 7fa749ef2700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa744067840 0x7fa7440cb7d0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.792+0000 7fa749ef2700 1 --2- 172.21.15.84:0/396199717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa744067c10 0x7fa74416da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.792+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 >> 172.21.15.84:0/396199717 conn(0x7fa7440cd1e0 msgr2=0x7fa74413e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:34.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.793+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 shutdown_connections 2023-10-06T03:02:34.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.793+0000 7fa749ef2700 1 -- 172.21.15.84:0/396199717 wait complete. 2023-10-06T03:02:34.807 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.963+0000 7f99992ff700 1 Processor -- start 2023-10-06T03:02:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.963+0000 7f99992ff700 1 -- start start 2023-10-06T03:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.964+0000 7f99992ff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999406ed20 0x7f99940b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:34.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.964+0000 7f99992ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f999406f0f0 0x7f99940b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.964+0000 7f99992ff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f99940aee20 0x7f99940af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.964+0000 7f99992ff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999406fb80 con 0x7f999406f0f0 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.964+0000 7f99992ff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99940b2d20 con 0x7f99940aee20 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.964+0000 7f99992ff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99940b0450 con 0x7f999406ed20 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.964+0000 7f99927fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f999406f0f0 0x7f99940b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.964+0000 7f99927fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f999406f0f0 0x7f99940b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43164/0 (socket says 172.21.15.84:43164) 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.964+0000 7f99927fc700 1 -- 172.21.15.84:0/820840644 learned_addr learned my addr 172.21.15.84:0/820840644 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f9992ffd700 1 --2- 172.21.15.84:0/820840644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999406ed20 0x7f99940b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99927fc700 1 -- 172.21.15.84:0/820840644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999406ed20 msgr2=0x7f99940b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:34.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99937fe700 1 --2- 172.21.15.84:0/820840644 >> v2:172.21.15.131:3300/0 conn(0x7f99940aee20 0x7f99940af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99927fc700 1 --2- 172.21.15.84:0/820840644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999406ed20 0x7f99940b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99927fc700 1 -- 172.21.15.84:0/820840644 >> v2:172.21.15.131:3300/0 conn(0x7f99940aee20 msgr2=0x7f99940af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99927fc700 1 --2- 172.21.15.84:0/820840644 >> v2:172.21.15.131:3300/0 conn(0x7f99940aee20 0x7f99940af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99927fc700 1 -- 172.21.15.84:0/820840644 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99940af7c0 con 0x7f999406f0f0 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99937fe700 1 --2- 172.21.15.84:0/820840644 >> v2:172.21.15.131:3300/0 conn(0x7f99940aee20 0x7f99940af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99927fc700 1 --2- 172.21.15.84:0/820840644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 0x7f99940b08e0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f99940b1390 tx=0x7f9988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a1af167d578508 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f9991ffb700 1 -- 172.21.15.84:0/820840644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998800b860 con 0x7f999406f0f0 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f9991ffb700 1 -- 172.21.15.84:0/820840644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998800b9c0 con 0x7f999406f0f0 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f9991ffb700 1 -- 172.21.15.84:0/820840644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998800bd60 con 0x7f999406f0f0 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99992ff700 1 -- 172.21.15.84:0/820840644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 msgr2=0x7f99940b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:34.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99992ff700 1 --2- 172.21.15.84:0/820840644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 0x7f99940b08e0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f99940b1390 tx=0x7f9988009250 comp rx=0 tx=0).stop 2023-10-06T03:02:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99992ff700 1 -- 172.21.15.84:0/820840644 shutdown_connections 2023-10-06T03:02:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99992ff700 1 --2- 172.21.15.84:0/820840644 >> v2:172.21.15.131:3300/0 conn(0x7f99940aee20 0x7f99940af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99992ff700 1 --2- 172.21.15.84:0/820840644 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f999406ed20 0x7f99940b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99992ff700 1 --2- 172.21.15.84:0/820840644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 0x7f99940b08e0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.965+0000 7f99992ff700 1 -- 172.21.15.84:0/820840644 >> 172.21.15.84:0/820840644 conn(0x7f9994068330 msgr2=0x7f9994068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.966+0000 7f99992ff700 1 -- 172.21.15.84:0/820840644 shutdown_connections 2023-10-06T03:02:34.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.966+0000 7f99992ff700 1 -- 172.21.15.84:0/820840644 wait complete. 2023-10-06T03:02:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.967+0000 7f99992ff700 1 Processor -- start 2023-10-06T03:02:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.967+0000 7f99992ff700 1 -- start start 2023-10-06T03:02:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.967+0000 7f99992ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999406ed20 0x7f999416c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.967+0000 7f99992ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 0x7f99941580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.967+0000 7f99992ff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99940aee20 0x7f99940ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.967+0000 7f99992ff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99940a7ca0 con 0x7f999406f0f0 2023-10-06T03:02:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.967+0000 7f99992ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999415a120 con 0x7f999406ed20 2023-10-06T03:02:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.967+0000 7f99992ff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999415a400 con 0x7f99940aee20 2023-10-06T03:02:34.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99927fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 0x7f99941580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99927fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 0x7f99941580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43178/0 (socket says 172.21.15.84:43178) 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99927fc700 1 -- 172.21.15.84:0/3426674570 learned_addr learned my addr 172.21.15.84:0/3426674570 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99937fe700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99940aee20 0x7f99940ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f9992ffd700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999406ed20 0x7f999416c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99927fc700 1 -- 172.21.15.84:0/3426674570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99940aee20 msgr2=0x7f99940ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99927fc700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99940aee20 0x7f99940ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99927fc700 1 -- 172.21.15.84:0/3426674570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999406ed20 msgr2=0x7f999416c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99927fc700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999406ed20 0x7f999416c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99927fc700 1 -- 172.21.15.84:0/3426674570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880094f0 con 0x7f999406f0f0 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99927fc700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 0x7f99941580f0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f99940893c0 tx=0x7f9988017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f997affd700 1 -- 172.21.15.84:0/3426674570 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988011dc0 con 0x7f999406f0f0 2023-10-06T03:02:34.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f997affd700 1 -- 172.21.15.84:0/3426674570 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9988024440 con 0x7f999406f0f0 2023-10-06T03:02:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999415a6e0 con 0x7f999406f0f0 2023-10-06T03:02:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f997affd700 1 -- 172.21.15.84:0/3426674570 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988024800 con 0x7f999406f0f0 2023-10-06T03:02:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.968+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999415aca0 con 0x7f999406f0f0 2023-10-06T03:02:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.969+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999415ae90 con 0x7f999406f0f0 2023-10-06T03:02:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.970+0000 7f997affd700 1 -- 172.21.15.84:0/3426674570 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f998801a420 con 0x7f999406f0f0 2023-10-06T03:02:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.970+0000 7f997affd700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9980066f30 0x7f99800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.970+0000 7f997affd700 1 -- 172.21.15.84:0/3426674570 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6694+0+0 (secure 0 0 0) 0x7f9988086670 con 0x7f999406f0f0 2023-10-06T03:02:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.970+0000 7f9992ffd700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9980066f30 0x7f99800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:34.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.970+0000 7f9992ffd700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9980066f30 0x7f99800693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f998400f570 tx=0x7f9984007750 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:34.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:34.974+0000 7f997affd700 1 -- 172.21.15.84:0/3426674570 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9988053500 con 0x7f999406f0f0 2023-10-06T03:02:35.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.154+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9994064ad0 con 0x7f999406f0f0 2023-10-06T03:02:35.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.794+0000 7f997affd700 1 -- 172.21.15.84:0/3426674570 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9988056b20 con 0x7f999406f0f0 2023-10-06T03:02:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.798+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9980066f30 msgr2=0x7f99800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.798+0000 7f99992ff700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9980066f30 0x7f99800693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f998400f570 tx=0x7f9984007750 comp rx=0 tx=0).stop 2023-10-06T03:02:35.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.798+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 msgr2=0x7f99941580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.798+0000 7f99992ff700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 0x7f99941580f0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f99940893c0 tx=0x7f9988017000 comp rx=0 tx=0).stop 2023-10-06T03:02:35.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.799+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 shutdown_connections 2023-10-06T03:02:35.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.799+0000 7f99992ff700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9980066f30 0x7f99800693e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.799+0000 7f99992ff700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f999406ed20 0x7f999416c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.799+0000 7f99992ff700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f99940aee20 0x7f99940ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.799+0000 7f99992ff700 1 --2- 172.21.15.84:0/3426674570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999406f0f0 0x7f99941580f0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.799+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 >> 172.21.15.84:0/3426674570 conn(0x7f9994068330 msgr2=0x7f99940ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:35.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.800+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 shutdown_connections 2023-10-06T03:02:35.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.800+0000 7f99992ff700 1 -- 172.21.15.84:0/3426674570 wait complete. 2023-10-06T03:02:35.803 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:02:35.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:02:35.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.932+0000 7f95b0f3f700 1 Processor -- start 2023-10-06T03:02:35.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.932+0000 7f95b0f3f700 1 -- start start 2023-10-06T03:02:35.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.933+0000 7f95b0f3f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac06ed20 0x7f95ac0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.933+0000 7f95b0f3f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac0b2d20 con 0x7f95ac0aee20 2023-10-06T03:02:35.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.933+0000 7f95b0f3f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac0b0450 con 0x7f95ac06f0f0 2023-10-06T03:02:35.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.933+0000 7f95b0f3f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac06fb80 con 0x7f95ac06ed20 2023-10-06T03:02:35.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.933+0000 7f95aad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f95ac0aee20 0x7f95ac0af280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38504/0 (socket says 172.21.15.84:38504) 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.933+0000 7f95aad9d700 1 -- 172.21.15.84:0/3182800967 learned_addr learned my addr 172.21.15.84:0/3182800967 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.933+0000 7f95aa59c700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac06ed20 0x7f95ac0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.933+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106382471 0 0) 0x7f95ac0b2d20 con 0x7f95ac0aee20 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.933+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9598003570 con 0x7f95ac0aee20 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 976270971 0 0) 0x7f9598003570 con 0x7f95ac0aee20 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac06ed20 msgr2=0x7f95ac0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac06ed20 0x7f95ac0b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 >> v1:172.21.15.131:6789/0 conn(0x7f95ac06f0f0 legacy=0x7f95ac0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac0b2a40 con 0x7f95ac0aee20 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f95a40017f0 con 0x7f95ac0aee20 2023-10-06T03:02:35.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 >> v1:172.21.15.84:6789/0 conn(0x7f95ac0aee20 legacy=0x7f95ac0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac06ed20 0x7f9598003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9598003fd0 0x7f9598004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9598004d50 0x7f95980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959800bb10 con 0x7f9598004d50 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959800bc80 con 0x7f9598003fd0 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959800be40 con 0x7f95ac06ed20 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95aad9d700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9598004d50 0x7f95980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95aa59c700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac06ed20 0x7f9598003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a1d9b700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9598003fd0 0x7f9598004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95aad9d700 1 -- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac06ed20 msgr2=0x7f9598003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:35.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95aad9d700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac06ed20 0x7f9598003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95aad9d700 1 -- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9598003fd0 msgr2=0x7f9598004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95aad9d700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9598003fd0 0x7f9598004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95aad9d700 1 -- 172.21.15.84:0/3182800967 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598003570 con 0x7f9598004d50 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a1d9b700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9598003fd0 0x7f9598004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95aad9d700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9598004d50 0x7f95980051c0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f95a400a950 tx=0x7f95a40021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9dbd8d5b98957c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40070d0 con 0x7f9598004d50 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4007250 con 0x7f9598004d50 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.934+0000 7f95a9d9b700 1 -- 172.21.15.84:0/3182800967 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4007610 con 0x7f9598004d50 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.935+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3182800967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9598004d50 msgr2=0x7f95980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.935+0000 7f95b0f3f700 1 --2- 172.21.15.84:0/3182800967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9598004d50 0x7f95980051c0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f95a400a950 tx=0x7f95a40021f0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.935+0000 7f95aad9d700 1 -- 172.21.15.84:0/3182800967 reap_dead start 2023-10-06T03:02:35.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.935+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3182800967 shutdown_connections 2023-10-06T03:02:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.935+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3182800967 >> 172.21.15.84:0/3182800967 conn(0x7f95ac068330 msgr2=0x7f95ac068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.935+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3182800967 shutdown_connections 2023-10-06T03:02:35.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.935+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3182800967 wait complete. 2023-10-06T03:02:35.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.936+0000 7f95b0f3f700 1 Processor -- start 2023-10-06T03:02:35.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.936+0000 7f95b0f3f700 1 -- start start 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95b0f3f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95ac0c62c0 0x7f95ac16a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95b0f3f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac157730 0x7f95ac0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95b0f3f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95ac0c8560 0x7f95ac15f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95b0f3f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac157cd0 con 0x7f95ac0c62c0 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95b0f3f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac16a740 con 0x7f95ac0c8560 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95b0f3f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac0c7710 con 0x7f95ac157730 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95ac0c62c0 0x7f95ac16a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95ac0c62c0 0x7f95ac16a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43196/0 (socket says 172.21.15.84:43196) 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aa59c700 1 -- 172.21.15.84:0/3380619897 learned_addr learned my addr 172.21.15.84:0/3380619897 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95a1d9b700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac157730 0x7f95ac0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aad9d700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95ac0c8560 0x7f95ac15f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aa59c700 1 -- 172.21.15.84:0/3380619897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac157730 msgr2=0x7f95ac0c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aa59c700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac157730 0x7f95ac0c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aa59c700 1 -- 172.21.15.84:0/3380619897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95ac0c8560 msgr2=0x7f95ac15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aa59c700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95ac0c8560 0x7f95ac15f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aa59c700 1 -- 172.21.15.84:0/3380619897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac0c79f0 con 0x7f95ac0c62c0 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aad9d700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95ac0c8560 0x7f95ac15f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95aa59c700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95ac0c62c0 0x7f95ac16a200 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f959c006ac0 tx=0x7f959c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.937+0000 7f95a2ffd700 1 -- 172.21.15.84:0/3380619897 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c00fa10 con 0x7f95ac0c62c0 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.938+0000 7f95a2ffd700 1 -- 172.21.15.84:0/3380619897 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c00fb70 con 0x7f95ac0c62c0 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.938+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac0c7cd0 con 0x7f95ac0c62c0 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.938+0000 7f95a2ffd700 1 -- 172.21.15.84:0/3380619897 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c014440 con 0x7f95ac0c62c0 2023-10-06T03:02:35.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.938+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac0c6690 con 0x7f95ac0c62c0 2023-10-06T03:02:35.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.939+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac16cfa0 con 0x7f95ac0c62c0 2023-10-06T03:02:35.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.939+0000 7f95a2ffd700 1 -- 172.21.15.84:0/3380619897 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f959c014870 con 0x7f95ac0c62c0 2023-10-06T03:02:35.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.939+0000 7f95a2ffd700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f958c066fb0 0x7f958c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.939+0000 7f95a2ffd700 1 -- 172.21.15.84:0/3380619897 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6256+0+0 (secure 0 0 0) 0x7f959c018030 con 0x7f95ac0c62c0 2023-10-06T03:02:35.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.939+0000 7f95a1d9b700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f958c066fb0 0x7f958c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.940+0000 7f95a1d9b700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f958c066fb0 0x7f958c069460 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0b56e0 tx=0x7f9594009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:35.943+0000 7f95a2ffd700 1 -- 172.21.15.84:0/3380619897 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f959c052270 con 0x7f95ac0c62c0 2023-10-06T03:02:36.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.127+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95ac16d150 con 0x7f95ac0c62c0 2023-10-06T03:02:36.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.806+0000 7f95a2ffd700 1 -- 172.21.15.84:0/3380619897 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) v1 ==== 169+0+0 (secure 0 0 0) 0x7f959c055890 con 0x7f95ac0c62c0 2023-10-06T03:02:36.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f958c066fb0 msgr2=0x7f958c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f958c066fb0 0x7f958c069460 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0b56e0 tx=0x7f9594009040 comp rx=0 tx=0).stop 2023-10-06T03:02:36.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95ac0c62c0 msgr2=0x7f95ac16a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95ac0c62c0 0x7f95ac16a200 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f959c006ac0 tx=0x7f959c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 shutdown_connections 2023-10-06T03:02:36.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f958c066fb0 0x7f958c069460 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95ac0c8560 0x7f95ac15f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95ac0c62c0 0x7f95ac16a200 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 --2- 172.21.15.84:0/3380619897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95ac157730 0x7f95ac0c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.809+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 >> 172.21.15.84:0/3380619897 conn(0x7f95ac068330 msgr2=0x7f95ac0ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:36.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.810+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 shutdown_connections 2023-10-06T03:02:36.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.810+0000 7f95b0f3f700 1 -- 172.21.15.84:0/3380619897 wait complete. 2023-10-06T03:02:36.812 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-10-06T03:02:36.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:02:36.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.943+0000 7fc128a57700 1 Processor -- start 2023-10-06T03:02:36.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.943+0000 7fc128a57700 1 -- start start 2023-10-06T03:02:36.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc128a57700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc1240cbb50 0x7fc1240ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc128a57700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1240c6610 0x7fc1240ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc128a57700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1240b2e60 con 0x7fc1240b2a90 2023-10-06T03:02:36.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc128a57700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1240cf5d0 con 0x7fc1240cbb50 2023-10-06T03:02:36.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc128a57700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240cf8b0 con 0x7fc1240c6610 2023-10-06T03:02:36.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc12259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc1240b2a90 0x7fc1240cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38512/0 (socket says 172.21.15.84:38512) 2023-10-06T03:02:36.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc12259c700 1 -- 172.21.15.84:0/964521462 learned_addr learned my addr 172.21.15.84:0/964521462 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:36.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488629807 0 0) 0x7fc1240b2e60 con 0x7fc1240b2a90 2023-10-06T03:02:36.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc110003570 con 0x7fc1240b2a90 2023-10-06T03:02:36.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc119d9b700 1 --2- 172.21.15.84:0/964521462 >> v2:172.21.15.131:3300/0 conn(0x7fc1240cbb50 0x7fc1240ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.944+0000 7fc122d9d700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1240c6610 0x7fc1240ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3699454252 0 0) 0x7fc110003570 con 0x7fc1240b2a90 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1240c6610 msgr2=0x7fc1240ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1240c6610 0x7fc1240ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 >> v2:172.21.15.131:3300/0 conn(0x7fc1240cbb50 msgr2=0x7fc1240ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 --2- 172.21.15.84:0/964521462 >> v2:172.21.15.131:3300/0 conn(0x7fc1240cbb50 0x7fc1240ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1240cfb90 con 0x7fc1240b2a90 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fc1140015f0 con 0x7fc1240b2a90 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 >> v1:172.21.15.84:6789/0 conn(0x7fc1240b2a90 legacy=0x7fc1240cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1240c6610 0x7fc110003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc110003fe0 0x7fc110004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc110004d50 0x7fc1100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240cf5d0 con 0x7fc110003fe0 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240cf8b0 con 0x7fc110004d50 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11000ba90 con 0x7fc1240c6610 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc119d9b700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc110003fe0 0x7fc110004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc12259c700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1240c6610 0x7fc110003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc122d9d700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc110004d50 0x7fc1100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc119d9b700 1 -- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1240c6610 msgr2=0x7fc110003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc119d9b700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc1240c6610 0x7fc110003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc119d9b700 1 -- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc110004d50 msgr2=0x7fc1100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc119d9b700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc110004d50 0x7fc1100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc119d9b700 1 -- 172.21.15.84:0/964521462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc110003570 con 0x7fc110003fe0 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc119d9b700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc110003fe0 0x7fc110004810 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009c00 tx=0x7fc10c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cdfc5c41b0fd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00e6b0 con 0x7fc110003fe0 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c00e810 con 0x7fc110003fe0 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.945+0000 7fc121d9b700 1 -- 172.21.15.84:0/964521462 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00ebd0 con 0x7fc110003fe0 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.946+0000 7fc128a57700 1 -- 172.21.15.84:0/964521462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc110003fe0 msgr2=0x7fc110004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.946+0000 7fc128a57700 1 --2- 172.21.15.84:0/964521462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc110003fe0 0x7fc110004810 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009c00 tx=0x7fc10c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.946+0000 7fc122d9d700 1 -- 172.21.15.84:0/964521462 reap_dead start 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.946+0000 7fc128a57700 1 -- 172.21.15.84:0/964521462 shutdown_connections 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.946+0000 7fc128a57700 1 -- 172.21.15.84:0/964521462 >> 172.21.15.84:0/964521462 conn(0x7fc124099740 msgr2=0x7fc12406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.946+0000 7fc128a57700 1 -- 172.21.15.84:0/964521462 shutdown_connections 2023-10-06T03:02:36.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.946+0000 7fc128a57700 1 -- 172.21.15.84:0/964521462 wait complete. 2023-10-06T03:02:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.947+0000 7fc128a57700 1 Processor -- start 2023-10-06T03:02:36.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.947+0000 7fc128a57700 1 -- start start 2023-10-06T03:02:36.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc128a57700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc110003fe0 0x7fc12414adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc128a57700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc12415d5a0 0x7fc12416aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc128a57700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc124156d90 0x7fc12416afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc128a57700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12415c880 con 0x7fc124156d90 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc128a57700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12415d110 con 0x7fc12415d5a0 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc128a57700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12409dfb0 con 0x7fc110003fe0 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc122d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc124156d90 0x7fc12416afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc122d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc124156d90 0x7fc12416afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43214/0 (socket says 172.21.15.84:43214) 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc122d9d700 1 -- 172.21.15.84:0/1030920977 learned_addr learned my addr 172.21.15.84:0/1030920977 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc12259c700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc110003fe0 0x7fc12414adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc119d9b700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc12415d5a0 0x7fc12416aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc122d9d700 1 -- 172.21.15.84:0/1030920977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc110003fe0 msgr2=0x7fc12414adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc122d9d700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc110003fe0 0x7fc12414adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc122d9d700 1 -- 172.21.15.84:0/1030920977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc12415d5a0 msgr2=0x7fc12416aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc122d9d700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc12415d5a0 0x7fc12416aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc122d9d700 1 -- 172.21.15.84:0/1030920977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12415cac0 con 0x7fc124156d90 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc122d9d700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc124156d90 0x7fc12416afa0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fc1240cdec0 tx=0x7fc11c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.948+0000 7fc11affd700 1 -- 172.21.15.84:0/1030920977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00e040 con 0x7fc124156d90 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.949+0000 7fc11affd700 1 -- 172.21.15.84:0/1030920977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00f040 con 0x7fc124156d90 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.949+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12415cda0 con 0x7fc124156d90 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.949+0000 7fc11affd700 1 -- 172.21.15.84:0/1030920977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00fd70 con 0x7fc124156d90 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.949+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12414b330 con 0x7fc124156d90 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.949+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12415cf30 con 0x7fc124156d90 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.950+0000 7fc11affd700 1 -- 172.21.15.84:0/1030920977 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc11c015640 con 0x7fc124156d90 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.950+0000 7fc11affd700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc104066f30 0x7fc1040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.950+0000 7fc11affd700 1 -- 172.21.15.84:0/1030920977 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fc11c084c60 con 0x7fc124156d90 2023-10-06T03:02:36.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.950+0000 7fc12259c700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc104066f30 0x7fc1040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.951+0000 7fc12259c700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc104066f30 0x7fc1040693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc114000e50 tx=0x7fc114009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:36.955+0000 7fc11affd700 1 -- 172.21.15.84:0/1030920977 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc12415cf30 con 0x7fc124156d90 2023-10-06T03:02:37.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.137+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc12415cf30 con 0x7fc124156d90 2023-10-06T03:02:37.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.141+0000 7fc11affd700 1 -- 172.21.15.84:0/1030920977 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc12415cf30 con 0x7fc124156d90 2023-10-06T03:02:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc104066f30 msgr2=0x7fc1040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc104066f30 0x7fc1040693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc114000e50 tx=0x7fc114009040 comp rx=0 tx=0).stop 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc124156d90 msgr2=0x7fc12416afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc124156d90 0x7fc12416afa0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fc1240cdec0 tx=0x7fc11c00b040 comp rx=0 tx=0).stop 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 shutdown_connections 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc104066f30 0x7fc1040693e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc124156d90 0x7fc12416afa0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc110003fe0 0x7fc12414adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 --2- 172.21.15.84:0/1030920977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc12415d5a0 0x7fc12416aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 >> 172.21.15.84:0/1030920977 conn(0x7fc124099740 msgr2=0x7fc1240b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 shutdown_connections 2023-10-06T03:02:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.143+0000 7fc128a57700 1 -- 172.21.15.84:0/1030920977 wait complete. 2023-10-06T03:02:37.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2023-10-06T03:02:37.164 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:37.201 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:37.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.271+0000 7fa96eb45700 1 Processor -- start 2023-10-06T03:02:37.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.271+0000 7fa96eb45700 1 -- start start 2023-10-06T03:02:37.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.272+0000 7fa96eb45700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9680cbc70 0x7fa9680cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.272+0000 7fa96eb45700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa9680b2140 0x7fa9680b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.272+0000 7fa96eb45700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680cb7e0 con 0x7fa968159480 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.272+0000 7fa96eb45700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9680b08a0 con 0x7fa9680b2140 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.272+0000 7fa96eb45700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680cb190 con 0x7fa9680cbc70 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.272+0000 7fa96db43700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa968159480 0x7fa9680b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38518/0 (socket says 172.21.15.84:38518) 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.272+0000 7fa96db43700 1 -- 172.21.15.84:0/3519786320 learned_addr learned my addr 172.21.15.84:0/3519786320 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.272+0000 7fa96e344700 1 --2- 172.21.15.84:0/3519786320 >> v2:172.21.15.84:3300/0 conn(0x7fa9680b2140 0x7fa9680b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96cb41700 1 -- 172.21.15.84:0/3519786320 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790396360 0 0) 0x7fa9680cb7e0 con 0x7fa968159480 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96cb41700 1 -- 172.21.15.84:0/3519786320 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa954003570 con 0x7fa968159480 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96d342700 1 --2- 172.21.15.84:0/3519786320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9680cbc70 0x7fa9680cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:37.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96e344700 1 -- 172.21.15.84:0/3519786320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9680cbc70 msgr2=0x7fa9680cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96e344700 1 --2- 172.21.15.84:0/3519786320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9680cbc70 0x7fa9680cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96e344700 1 -- 172.21.15.84:0/3519786320 >> v1:172.21.15.84:6789/0 conn(0x7fa968159480 legacy=0x7fa9680b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96e344700 1 -- 172.21.15.84:0/3519786320 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680cb470 con 0x7fa9680b2140 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96d342700 1 --2- 172.21.15.84:0/3519786320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9680cbc70 0x7fa9680cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96e344700 1 --2- 172.21.15.84:0/3519786320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680b2140 0x7fa9680b25c0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fa9600098e0 tx=0x7fa9600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753c6339ca3d1d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96cb41700 1 -- 172.21.15.84:0/3519786320 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000b640 con 0x7fa9680b2140 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96cb41700 1 -- 172.21.15.84:0/3519786320 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000b7a0 con 0x7fa9680b2140 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96cb41700 1 -- 172.21.15.84:0/3519786320 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000bb40 con 0x7fa9680b2140 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96eb45700 1 -- 172.21.15.84:0/3519786320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680b2140 msgr2=0x7fa9680b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96eb45700 1 --2- 172.21.15.84:0/3519786320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680b2140 0x7fa9680b25c0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fa9600098e0 tx=0x7fa9600091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96eb45700 1 -- 172.21.15.84:0/3519786320 shutdown_connections 2023-10-06T03:02:37.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.273+0000 7fa96eb45700 1 --2- 172.21.15.84:0/3519786320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680b2140 0x7fa9680b25c0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.274+0000 7fa96eb45700 1 --2- 172.21.15.84:0/3519786320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa9680cbc70 0x7fa9680cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.274+0000 7fa96eb45700 1 -- 172.21.15.84:0/3519786320 >> 172.21.15.84:0/3519786320 conn(0x7fa96806ed20 msgr2=0x7fa96806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:37.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.274+0000 7fa96eb45700 1 -- 172.21.15.84:0/3519786320 shutdown_connections 2023-10-06T03:02:37.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.274+0000 7fa96eb45700 1 -- 172.21.15.84:0/3519786320 wait complete. 2023-10-06T03:02:37.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.275+0000 7fa96eb45700 1 Processor -- start 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.275+0000 7fa96eb45700 1 -- start start 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.275+0000 7fa96eb45700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9680b2140 0x7fa9680cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.275+0000 7fa96eb45700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680cbc70 0x7fa9681538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.275+0000 7fa96eb45700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa968159480 0x7fa9680c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.275+0000 7fa96eb45700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680b5df0 con 0x7fa9680cbc70 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.275+0000 7fa96eb45700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680ce4f0 con 0x7fa9680b2140 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.275+0000 7fa96eb45700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680ce7d0 con 0x7fa968159480 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.275+0000 7fa96d342700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680cbc70 0x7fa9681538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96d342700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680cbc70 0x7fa9681538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43228/0 (socket says 172.21.15.84:43228) 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96d342700 1 -- 172.21.15.84:0/2393272525 learned_addr learned my addr 172.21.15.84:0/2393272525 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96db43700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9680b2140 0x7fa9680cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:37.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96e344700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa968159480 0x7fa9680c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96d342700 1 -- 172.21.15.84:0/2393272525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa968159480 msgr2=0x7fa9680c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96d342700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa968159480 0x7fa9680c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96d342700 1 -- 172.21.15.84:0/2393272525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9680b2140 msgr2=0x7fa9680cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96d342700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9680b2140 0x7fa9680cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96d342700 1 -- 172.21.15.84:0/2393272525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960009420 con 0x7fa9680cbc70 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96db43700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9680b2140 0x7fa9680cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96d342700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680cbc70 0x7fa9681538d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c830 tx=0x7fa958008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa95dffb700 1 -- 172.21.15.84:0/2393272525 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958011600 con 0x7fa9680cbc70 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa95dffb700 1 -- 172.21.15.84:0/2393272525 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958011760 con 0x7fa9680cbc70 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9680ceab0 con 0x7fa9680cbc70 2023-10-06T03:02:37.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa95dffb700 1 -- 172.21.15.84:0/2393272525 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958011b20 con 0x7fa9680cbc70 2023-10-06T03:02:37.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.276+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9680cf070 con 0x7fa9680cbc70 2023-10-06T03:02:37.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.277+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9680cf290 con 0x7fa9680cbc70 2023-10-06T03:02:37.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.278+0000 7fa95dffb700 1 -- 172.21.15.84:0/2393272525 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa95800a3e0 con 0x7fa9680cbc70 2023-10-06T03:02:37.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.278+0000 7fa95dffb700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa94c066f30 0x7fa94c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:37.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.278+0000 7fa95dffb700 1 -- 172.21.15.84:0/2393272525 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fa958084a10 con 0x7fa9680cbc70 2023-10-06T03:02:37.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.278+0000 7fa96db43700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa94c066f30 0x7fa94c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:37.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.279+0000 7fa96db43700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa94c066f30 0x7fa94c0693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa964005c50 tx=0x7fa964009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:37.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.282+0000 7fa95dffb700 1 -- 172.21.15.84:0/2393272525 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa958051c30 con 0x7fa9680cbc70 2023-10-06T03:02:37.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.544+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) v1 -- 0x7fa96805f270 con 0x7fa9680cbc70 2023-10-06T03:02:37.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.802+0000 7fa95dffb700 1 -- 172.21.15.84:0/2393272525 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v389) v1 ==== 165+0+0 (secure 0 0 0) 0x7fa9580150e0 con 0x7fa9680cbc70 2023-10-06T03:02:37.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.804+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa94c066f30 msgr2=0x7fa94c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.804+0000 7fa96eb45700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa94c066f30 0x7fa94c0693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa964005c50 tx=0x7fa964009040 comp rx=0 tx=0).stop 2023-10-06T03:02:37.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.804+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680cbc70 msgr2=0x7fa9681538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.804+0000 7fa96eb45700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680cbc70 0x7fa9681538d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c830 tx=0x7fa958008040 comp rx=0 tx=0).stop 2023-10-06T03:02:37.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.804+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 shutdown_connections 2023-10-06T03:02:37.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.804+0000 7fa96eb45700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fa94c066f30 0x7fa94c0693e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.804+0000 7fa96eb45700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9680b2140 0x7fa9680cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.805+0000 7fa96eb45700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa968159480 0x7fa9680c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.805+0000 7fa96eb45700 1 --2- 172.21.15.84:0/2393272525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9680cbc70 0x7fa9681538d0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.805+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 >> 172.21.15.84:0/2393272525 conn(0x7fa96806ed20 msgr2=0x7fa968157410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:37.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.805+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 shutdown_connections 2023-10-06T03:02:37.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:37.805+0000 7fa96eb45700 1 -- 172.21.15.84:0/2393272525 wait complete. 2023-10-06T03:02:37.818 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-10-06T03:02:37.818 INFO:tasks.cephfs_test_runner: 2023-10-06T03:02:37.818 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T03:02:37.818 INFO:tasks.cephfs_test_runner:Ran 6 tests in 411.905s 2023-10-06T03:02:37.818 INFO:tasks.cephfs_test_runner: 2023-10-06T03:02:37.819 INFO:tasks.cephfs_test_runner:OK 2023-10-06T03:02:37.819 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T03:02:37.829 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T03:02:37.879 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T03:02:37.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:37.879 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:02:37.894 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:02:37.894 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:02:37.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:37.894 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:02:37.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:37.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:02:38.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:38.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-10-06T03:02:38.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:38.135 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-10-06T03:02:38.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:38.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-10-06T03:02:38.217 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2023-10-06T03:02:38.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:38.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:38.218 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:02:38.236 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:02:38.236 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:02:38.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:38.237 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:02:38.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:38.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:02:38.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:38.388 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2023-10-06T03:02:38.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:38.494 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2023-10-06T03:02:38.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:38.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2023-10-06T03:02:38.577 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2023-10-06T03:02:38.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:38.579 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T03:02:38.591 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T03:02:38.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.705+0000 7ff5db59e700 1 Processor -- start 2023-10-06T03:02:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.705+0000 7ff5db59e700 1 -- start start 2023-10-06T03:02:38.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5db59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5db59e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff5dc06f350 0x7ff5dc06d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5db59e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc06e080 con 0x7ff5dc06db70 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5db59e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc06ec00 con 0x7ff5dc06f350 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5db59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0ccd20 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5d9d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff5dc06f350 0x7ff5dc06d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5da59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5dad9d700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff5dc06db70 0x7ff5dc0cc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:54678/0 (socket says 172.21.15.84:54678) 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5da59c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:35084/0 (socket says 172.21.15.84:35084) 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5d9d9b700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff5dc06f350 0x7ff5dc06d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:34290/0 (socket says 172.21.15.84:34290) 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.706+0000 7ff5dad9d700 1 -- 172.21.15.84:0/4122681056 learned_addr learned my addr 172.21.15.84:0/4122681056 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5da59c700 1 -- 172.21.15.84:0/4122681056 >> v2:172.21.15.131:3300/0 conn(0x7ff5dc06f350 msgr2=0x7ff5dc06d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5da59c700 1 --2- 172.21.15.84:0/4122681056 >> v2:172.21.15.131:3300/0 conn(0x7ff5dc06f350 0x7ff5dc06d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5da59c700 1 -- 172.21.15.84:0/4122681056 >> v1:172.21.15.131:6789/0 conn(0x7ff5dc06db70 legacy=0x7ff5dc0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5da59c700 1 -- 172.21.15.84:0/4122681056 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc06e360 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5d9d9b700 1 --2- 172.21.15.84:0/4122681056 >> v2:172.21.15.131:3300/0 conn(0x7ff5dc06f350 0x7ff5dc06d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5d959a700 1 -- 172.21.15.84:0/4122681056 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126367226 0 0) 0x7ff5dc06e080 con 0x7ff5dc06db70 2023-10-06T03:02:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5da59c700 1 --2- 172.21.15.84:0/4122681056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0cb9b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009e60 tx=0x7ff5cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8f4926f5da4d1c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5d959a700 1 -- 172.21.15.84:0/4122681056 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00e070 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5d959a700 1 -- 172.21.15.84:0/4122681056 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc00bb60 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.707+0000 7ff5d959a700 1 -- 172.21.15.84:0/4122681056 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc012430 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.708+0000 7ff5db59e700 1 -- 172.21.15.84:0/4122681056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc0cb5e0 msgr2=0x7ff5dc0cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.708+0000 7ff5db59e700 1 --2- 172.21.15.84:0/4122681056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0cb9b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009e60 tx=0x7ff5cc009780 comp rx=0 tx=0).stop 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.708+0000 7ff5db59e700 1 -- 172.21.15.84:0/4122681056 shutdown_connections 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.708+0000 7ff5db59e700 1 --2- 172.21.15.84:0/4122681056 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0cb9b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.708+0000 7ff5db59e700 1 --2- 172.21.15.84:0/4122681056 >> v2:172.21.15.131:3300/0 conn(0x7ff5dc06f350 0x7ff5dc06d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.708+0000 7ff5db59e700 1 -- 172.21.15.84:0/4122681056 >> 172.21.15.84:0/4122681056 conn(0x7ff5dc0680c0 msgr2=0x7ff5dc0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.708+0000 7ff5db59e700 1 -- 172.21.15.84:0/4122681056 shutdown_connections 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.708+0000 7ff5db59e700 1 -- 172.21.15.84:0/4122681056 wait complete. 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.709+0000 7ff5db59e700 1 Processor -- start 2023-10-06T03:02:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.709+0000 7ff5db59e700 1 -- start start 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5db59e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc06db70 0x7ff5dc144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5db59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5db59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5dc0c5a40 0x7ff5dc14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5db59e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0afa30 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5db59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0aee20 con 0x7ff5dc0c5a40 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5db59e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0af100 con 0x7ff5dc06db70 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5d9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5d9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43238/0 (socket says 172.21.15.84:43238) 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5d9d9b700 1 -- 172.21.15.84:0/2871191166 learned_addr learned my addr 172.21.15.84:0/2871191166 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5da59c700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc06db70 0x7ff5dc144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5dad9d700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5dc0c5a40 0x7ff5dc14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5d9d9b700 1 -- 172.21.15.84:0/2871191166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc06db70 msgr2=0x7ff5dc144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5d9d9b700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc06db70 0x7ff5dc144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5d9d9b700 1 -- 172.21.15.84:0/2871191166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5dc0c5a40 msgr2=0x7ff5dc14d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5d9d9b700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5dc0c5a40 0x7ff5dc14d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5d9d9b700 1 -- 172.21.15.84:0/2871191166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0009420 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5d9d9b700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0c5500 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000ec80 tx=0x7ff5d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5ca7fc700 1 -- 172.21.15.84:0/2871191166 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000c920 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5ca7fc700 1 -- 172.21.15.84:0/2871191166 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d000ca80 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc009a20 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5ca7fc700 1 -- 172.21.15.84:0/2871191166 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000ce00 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.710+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc0af6c0 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.711+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc0afba0 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.712+0000 7ff5ca7fc700 1 -- 172.21.15.84:0/2871191166 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5d0013680 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.712+0000 7ff5ca7fc700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5bc066f30 0x7ff5bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.712+0000 7ff5ca7fc700 1 -- 172.21.15.84:0/2871191166 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7ff5d0084c20 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.712+0000 7ff5da59c700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5bc066f30 0x7ff5bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.713+0000 7ff5da59c700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5bc066f30 0x7ff5bc0693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097c0 tx=0x7ff5cc019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:38.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.716+0000 7ff5ca7fc700 1 -- 172.21.15.84:0/2871191166 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5d0051e40 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.907+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5dc05f270 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.908+0000 7ff5ca7fc700 1 -- 172.21.15.84:0/2871191166 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+14254 (secure 0 0 0) 0x7ff5d0017090 con 0x7ff5dc0cb5e0 2023-10-06T03:02:38.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:38.910 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:02:36.793959+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6837/868960356":"2023-10-07T03:02:33.785942+0000","172.21.15.84:6835/868960356":"2023-10-07T03:02:33.785942+0000","172.21.15.131:6835/3436673358":"2023-10-07T03:02:33.785913+0000","172.21.15.131:6833/3436673358":"2023-10-07T03:02:33.785913+0000","172.21.15.84:6836/3850699528":"2023-10-07T03:02:33.785933+0000","172.21.15.84:6834/3850699528":"2023-10-07T03:02:33.785933+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:38.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5bc066f30 msgr2=0x7ff5bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5bc066f30 0x7ff5bc0693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097c0 tx=0x7ff5cc019000 comp rx=0 tx=0).stop 2023-10-06T03:02:38.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5dc0cb5e0 msgr2=0x7ff5dc0c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0c5500 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000ec80 tx=0x7ff5d00091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 shutdown_connections 2023-10-06T03:02:38.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff5bc066f30 0x7ff5bc0693e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5dc0c5a40 0x7ff5dc14d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5dc06db70 0x7ff5dc144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 --2- 172.21.15.84:0/2871191166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5dc0cb5e0 0x7ff5dc0c5500 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 >> 172.21.15.84:0/2871191166 conn(0x7ff5dc0680c0 msgr2=0x7ff5dc0c1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:38.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 shutdown_connections 2023-10-06T03:02:38.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:38.910+0000 7ff5db59e700 1 -- 172.21.15.84:0/2871191166 wait complete. 2023-10-06T03:02:38.924 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:02:38.924 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:02:39.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.036+0000 7f4c98c49700 1 Processor -- start 2023-10-06T03:02:39.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.036+0000 7f4c98c49700 1 -- start start 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.037+0000 7f4c98c49700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c941594b0 0x7f4c94069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.037+0000 7f4c98c49700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4c9415d280 0x7f4c9415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.037+0000 7f4c98c49700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940aa690 con 0x7f4c94159880 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.037+0000 7f4c98c49700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940af9d0 con 0x7f4c9415d280 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.037+0000 7f4c98c49700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9415dc00 con 0x7f4c941594b0 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c92d9d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4c9415d280 0x7f4c9415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c9259c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c941594b0 0x7f4c94069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c92d9d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4c9415d280 0x7f4c9415d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:34302/0 (socket says 172.21.15.84:34302) 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c9259c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c941594b0 0x7f4c94069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.84:35090/0 (socket says 172.21.15.84:35090) 2023-10-06T03:02:39.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c92d9d700 1 -- 172.21.15.84:0/3414440209 learned_addr learned my addr 172.21.15.84:0/3414440209 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c89d9b700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f4c94159880 0x7f4c940af2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:54688/0 (socket says 172.21.15.84:54688) 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c92d9d700 1 -- 172.21.15.84:0/3414440209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c941594b0 msgr2=0x7f4c94069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c92d9d700 1 --2- 172.21.15.84:0/3414440209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c941594b0 0x7f4c94069f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c92d9d700 1 -- 172.21.15.84:0/3414440209 >> v1:172.21.15.131:6789/0 conn(0x7f4c94159880 legacy=0x7f4c940af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c92d9d700 1 -- 172.21.15.84:0/3414440209 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940a9a80 con 0x7f4c9415d280 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c9259c700 1 --2- 172.21.15.84:0/3414440209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c941594b0 0x7f4c94069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c91d9b700 1 -- 172.21.15.84:0/3414440209 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263512007 0 0) 0x7f4c940aa690 con 0x7f4c94159880 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c92d9d700 1 --2- 172.21.15.84:0/3414440209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c9415d280 0x7f4c9415d6c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009f20 tx=0x7f4c8c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4426ffa0a8165266 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c91d9b700 1 -- 172.21.15.84:0/3414440209 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00e070 con 0x7f4c9415d280 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c91d9b700 1 -- 172.21.15.84:0/3414440209 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c00b9d0 con 0x7f4c9415d280 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.038+0000 7f4c91d9b700 1 -- 172.21.15.84:0/3414440209 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0092e0 con 0x7f4c9415d280 2023-10-06T03:02:39.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.039+0000 7f4c98c49700 1 -- 172.21.15.84:0/3414440209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c9415d280 msgr2=0x7f4c9415d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.039+0000 7f4c98c49700 1 --2- 172.21.15.84:0/3414440209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c9415d280 0x7f4c9415d6c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009f20 tx=0x7f4c8c009840 comp rx=0 tx=0).stop 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.039+0000 7f4c98c49700 1 -- 172.21.15.84:0/3414440209 shutdown_connections 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.039+0000 7f4c98c49700 1 --2- 172.21.15.84:0/3414440209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c9415d280 0x7f4c9415d6c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.039+0000 7f4c98c49700 1 --2- 172.21.15.84:0/3414440209 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c941594b0 0x7f4c94069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.039+0000 7f4c98c49700 1 -- 172.21.15.84:0/3414440209 >> 172.21.15.84:0/3414440209 conn(0x7f4c940ccf30 msgr2=0x7f4c94069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.039+0000 7f4c98c49700 1 -- 172.21.15.84:0/3414440209 shutdown_connections 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.039+0000 7f4c98c49700 1 -- 172.21.15.84:0/3414440209 wait complete. 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.040+0000 7f4c98c49700 1 Processor -- start 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.040+0000 7f4c98c49700 1 -- start start 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c98c49700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c941594b0 0x7f4c941467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c98c49700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c94159880 0x7f4c940cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c98c49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c9415d280 0x7f4c940b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c98c49700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9415b250 con 0x7f4c9415d280 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c98c49700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940cbd00 con 0x7f4c941594b0 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c98c49700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940c8d50 con 0x7f4c94159880 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c92d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c9415d280 0x7f4c940b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c92d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c9415d280 0x7f4c940b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43244/0 (socket says 172.21.15.84:43244) 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c92d9d700 1 -- 172.21.15.84:0/4231199119 learned_addr learned my addr 172.21.15.84:0/4231199119 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c9259c700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c941594b0 0x7f4c941467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c89d9b700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c94159880 0x7f4c940cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c92d9d700 1 -- 172.21.15.84:0/4231199119 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c94159880 msgr2=0x7f4c940cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c92d9d700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c94159880 0x7f4c940cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c92d9d700 1 -- 172.21.15.84:0/4231199119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c941594b0 msgr2=0x7f4c941467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c92d9d700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c941594b0 0x7f4c941467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.041+0000 7f4c92d9d700 1 -- 172.21.15.84:0/4231199119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84009420 con 0x7f4c9415d280 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.042+0000 7f4c92d9d700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c9415d280 0x7f4c940b1280 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00b610 tx=0x7f4c8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.042+0000 7f4c8affd700 1 -- 172.21.15.84:0/4231199119 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c008c30 con 0x7f4c9415d280 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.042+0000 7f4c8affd700 1 -- 172.21.15.84:0/4231199119 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c008dd0 con 0x7f4c9415d280 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.042+0000 7f4c8affd700 1 -- 172.21.15.84:0/4231199119 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c01c660 con 0x7f4c9415d280 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.042+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c009ae0 con 0x7f4c9415d280 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.042+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9415b740 con 0x7f4c9415d280 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.043+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c94064ad0 con 0x7f4c9415d280 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.043+0000 7f4c8affd700 1 -- 172.21.15.84:0/4231199119 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c8c003040 con 0x7f4c9415d280 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.043+0000 7f4c8affd700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4c74066f30 0x7f4c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.043+0000 7f4c8affd700 1 -- 172.21.15.84:0/4231199119 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f4c8c085e30 con 0x7f4c9415d280 2023-10-06T03:02:39.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.043+0000 7f4c9259c700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4c74066f30 0x7f4c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.044+0000 7f4c9259c700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4c74066f30 0x7f4c740693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4c840093f0 tx=0x7f4c84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.048+0000 7f4c8affd700 1 -- 172.21.15.84:0/4231199119 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c8c053050 con 0x7f4c9415d280 2023-10-06T03:02:39.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.225+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c940a9d60 con 0x7f4c74066f30 2023-10-06T03:02:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.228+0000 7f4c8affd700 1 -- 172.21.15.84:0/4231199119 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73262 (secure 0 0 0) 0x7f4c940a9d60 con 0x7f4c74066f30 2023-10-06T03:02:39.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4c74066f30 msgr2=0x7f4c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4c74066f30 0x7f4c740693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4c840093f0 tx=0x7f4c84008040 comp rx=0 tx=0).stop 2023-10-06T03:02:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c9415d280 msgr2=0x7f4c940b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c9415d280 0x7f4c940b1280 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00b610 tx=0x7f4c8c018000 comp rx=0 tx=0).stop 2023-10-06T03:02:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 shutdown_connections 2023-10-06T03:02:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f4c74066f30 0x7f4c740693e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c941594b0 0x7f4c941467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c9415d280 0x7f4c940b1280 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 --2- 172.21.15.84:0/4231199119 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4c94159880 0x7f4c940cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 >> 172.21.15.84:0/4231199119 conn(0x7f4c940ccf30 msgr2=0x7f4c94154e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 shutdown_connections 2023-10-06T03:02:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.230+0000 7f4c98c49700 1 -- 172.21.15.84:0/4231199119 wait complete. 2023-10-06T03:02:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:02:39.243 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2023-10-06T03:02:37.899900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2394412,"kb_used_data":12012,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752580308,"statfs":{"total":773094113280,"available":770642235392,"internally_reserved":0,"allocated":12300288,"data_stored":6617755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-119711,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-240,"num_write_kb":-193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001363"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.365340+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T03:01:52.365340+0000","last_peered":"2023-10-06T03:01:52.365340+0000","last_clean":"2023-10-06T03:01:52.365340+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T03:01:52.365340+0000","last_undegraded":"2023-10-06T03:01:52.365340+0000","last_fullsized":"2023-10-06T03:01:52.365340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":82,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.177913+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T03:01:51.177913+0000","last_peered":"2023-10-06T03:01:51.177913+0000","last_clean":"2023-10-06T03:01:51.177913+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T03:01:51.177913+0000","last_undegraded":"2023-10-06T03:01:51.177913+0000","last_fullsized":"2023-10-06T03:01:51.177913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.178219+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T03:01:52.178219+0000","last_peered":"2023-10-06T03:01:52.178219+0000","last_clean":"2023-10-06T03:01:52.178219+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T03:01:52.178219+0000","last_undegraded":"2023-10-06T03:01:52.178219+0000","last_fullsized":"2023-10-06T03:01:52.178219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.178481+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T03:01:51.178481+0000","last_peered":"2023-10-06T03:01:51.178481+0000","last_clean":"2023-10-06T03:01:51.178481+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T03:01:51.178481+0000","last_undegraded":"2023-10-06T03:01:51.178481+0000","last_fullsized":"2023-10-06T03:01:51.178481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":236,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.177986+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T03:01:51.177986+0000","last_peered":"2023-10-06T03:01:51.177986+0000","last_clean":"2023-10-06T03:01:51.177986+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T03:01:51.177986+0000","last_undegraded":"2023-10-06T03:01:51.177986+0000","last_fullsized":"2023-10-06T03:01:51.177986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.177924+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T03:01:51.177924+0000","last_peered":"2023-10-06T03:01:51.177924+0000","last_clean":"2023-10-06T03:01:51.177924+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T03:01:51.177924+0000","last_undegraded":"2023-10-06T03:01:51.177924+0000","last_fullsized":"2023-10-06T03:01:51.177924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.178150+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T03:01:51.178150+0000","last_peered":"2023-10-06T03:01:51.178150+0000","last_clean":"2023-10-06T03:01:51.178150+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T03:01:51.178150+0000","last_undegraded":"2023-10-06T03:01:51.178150+0000","last_fullsized":"2023-10-06T03:01:51.178150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.365537+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T03:01:52.365537+0000","last_peered":"2023-10-06T03:01:52.365537+0000","last_clean":"2023-10-06T03:01:52.365537+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T03:01:52.365537+0000","last_undegraded":"2023-10-06T03:01:52.365537+0000","last_fullsized":"2023-10-06T03:01:52.365537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.180273+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T03:01:52.180273+0000","last_peered":"2023-10-06T03:01:52.180273+0000","last_clean":"2023-10-06T03:01:52.180273+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T03:01:52.180273+0000","last_undegraded":"2023-10-06T03:01:52.180273+0000","last_fullsized":"2023-10-06T03:01:52.180273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072656,"statfs":{"total":96636764160,"available":96330399744,"internally_reserved":0,"allocated":1941504,"data_stored":1239139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.69899999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.29899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.501}]},{"osd":2,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.67100000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34799999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46700000000000003,"15min":0.49199999999999999},"min":{"1min":0.376,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72399999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.498,"15min":0.51200000000000001},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.25600000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.72799999999999998},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":0.83299999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.308},"max":{"1min":0.70699999999999996,"5min":0.73699999999999999,"15min":0.75700000000000001},"last":0.42699999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.55900000000000005},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.79700000000000004},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298616,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073224,"statfs":{"total":96636764160,"available":96330981376,"internally_reserved":0,"allocated":1359872,"data_stored":655419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.58899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.29999999999999999},"max":{"1min":0.67900000000000005,"5min":0.86099999999999999,"15min":3.415},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.57199999999999995},"min":{"1min":0.38400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70099999999999996,"5min":0.746,"15min":1.4219999999999999},"last":0.437}]},{"osd":1,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.81999999999999995,"15min":1.546},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":1.6319999999999999},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.56499999999999995},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.79500000000000004,"15min":1.74},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55700000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":3.4830000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.68100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.80500000000000005,"15min":3.577},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.82099999999999995,"15min":1.9219999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.83399999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29999999999999999},"max":{"1min":0.80000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":677730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33400000000000002,"15min":0.38100000000000001},"min":{"1min":0.23000000000000001,"5min":0.193,"15min":0.19},"max":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":2.0209999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":1.0409999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35799999999999998,"15min":0.996},"min":{"1min":0.23300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":21.193999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.55900000000000005,"5min":0.60299999999999998,"15min":1.181},"last":0.35099999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.42599999999999999},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.628,"15min":2.0579999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.248},"max":{"1min":0.51500000000000001,"5min":0.61599999999999999,"15min":0.626},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78100000000000003,"5min":0.95699999999999996,"15min":1.02},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":1.2170000000000001},"min":{"1min":0.432,"5min":0.308,"15min":0.29799999999999999},"max":{"1min":0.80700000000000005,"5min":0.83599999999999997,"15min":21.135000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":1.2070000000000001},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71699999999999997,"5min":0.89800000000000002,"15min":21.085000000000001},"last":0.441},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.748,"5min":0.83999999999999997,"15min":1.2789999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.70799999999999996,"5min":1.016,"15min":1.016},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":1.2330000000000001},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":21.166},"last":0.46500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74099999999999999,"5min":0.875,"15min":1.2450000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.99099999999999999,"15min":0.997},"last":0.47999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303400,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068440,"statfs":{"total":96636764160,"available":96326082560,"internally_reserved":0,"allocated":2064384,"data_stored":1334262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32100000000000001,"15min":0.32900000000000001},"min":{"1min":0.23899999999999999,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":0.42899999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.34100000000000003,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52100000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36799999999999999,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49299999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.20799999999999999},"max":{"1min":0.38400000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"last":0.316}]},{"osd":3,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.29399999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38200000000000001,"15min":0.40100000000000002},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.46999999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.82399999999999995,"15min":0.89800000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.85599999999999998},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.39700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.755,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79800000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":0.90900000000000003,"15min":0.91200000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79900000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298616,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073224,"statfs":{"total":96636764160,"available":96330981376,"internally_reserved":0,"allocated":1359872,"data_stored":648565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32900000000000001,"15min":0.314},"min":{"1min":0.214,"5min":0.214,"15min":0.19700000000000001},"max":{"1min":0.49199999999999999,"5min":0.55100000000000005,"15min":0.69499999999999995},"last":0.247},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34999999999999998,"15min":0.32900000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.504,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.37,"15min":0.36099999999999999},"min":{"1min":0.246,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.58399999999999996,"15min":0.72399999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38100000000000001,"15min":0.373},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":1.0129999999999999},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.92100000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.63100000000000001,"15min":0.78900000000000003},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.375,"15min":0.35599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.73199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.621,"15min":0.57699999999999996},"min":{"1min":0.44400000000000001,"5min":0.39600000000000002,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":1.276,"15min":1.276},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67000000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.39900000000000002},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.077},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72799999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.747,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298684,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073156,"statfs":{"total":96636764160,"available":96330911744,"internally_reserved":0,"allocated":1429504,"data_stored":727759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.34799999999999998,"15min":0.42199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.16400000000000001},"max":{"1min":0.45500000000000002,"5min":0.60899999999999999,"15min":2.569},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.36799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45900000000000002,"5min":0.57499999999999996,"15min":2.1840000000000002},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33800000000000002,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.504,"5min":0.58799999999999997,"15min":2.3199999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.44900000000000001},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.64100000000000001,"15min":2.5979999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.60699999999999998,"15min":2.3439999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39800000000000002,"15min":0.46700000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":2.6269999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.628},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.85099999999999998,"15min":2.1240000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58899999999999997,"15min":0.64700000000000002},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":2.2240000000000002},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.65200000000000002},"min":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.80700000000000005,"5min":0.84699999999999998,"15min":2.2650000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":2.532},"last":0.628}]},{"osd":6,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":2.0840000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60499999999999998,"15min":0.67500000000000004},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":2.2930000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78500000000000003,"5min":0.90600000000000003,"15min":2.496},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.877,"15min":2.1549999999999998},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298600,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073240,"statfs":{"total":96636764160,"available":96330997760,"internally_reserved":0,"allocated":1343488,"data_stored":648217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66000000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.38400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.73999999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34100000000000003},"max":{"1min":0.69799999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.504},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.90500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.871,"15min":9.4440000000000008},"last":0.40500000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38300000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.54800000000000004,"15min":0.58999999999999997},"min":{"1min":0.38700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.61199999999999999},"min":{"1min":0.495,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.64900000000000002},"min":{"1min":0.51000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81200000000000006,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":686664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.498},"min":{"1min":0.42999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":1.0069999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63100000000000001,"5min":0.73899999999999999,"15min":1.167},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66000000000000003,"5min":0.74099999999999999,"15min":1.117},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.41399999999999998,"5min":0.34399999999999997,"15min":0.29499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.94399999999999995},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53200000000000003,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.76700000000000002,"15min":1.2},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.58099999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.1759999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":1.135},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69999999999999996,"5min":0.77600000000000002,"15min":1.208},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":0.66100000000000003,"5min":0.68600000000000005,"15min":0.78000000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":0.85399999999999998,"15min":0.87},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.28499999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":1.054},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.90100000000000002},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.751,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":1.008},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:02:39.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:02:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.358+0000 7fd9decbb700 1 Processor -- start 2023-10-06T03:02:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.358+0000 7fd9decbb700 1 -- start start 2023-10-06T03:02:39.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.359+0000 7fd9decbb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 0x7fd9d80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.359+0000 7fd9decbb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9d80b49e0 0x7fd9d80aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.359+0000 7fd9decbb700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80b0ca0 con 0x7fd9d80b07a0 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.359+0000 7fd9decbb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80b0f80 con 0x7fd9d80b49e0 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.359+0000 7fd9decbb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80b1260 con 0x7fd9d81595a0 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.359+0000 7fd9cffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9d80b49e0 0x7fd9d80aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.359+0000 7fd9cffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9d80b49e0 0x7fd9d80aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43260/0 (socket says 172.21.15.84:43260) 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.359+0000 7fd9cffff700 1 -- 172.21.15.84:0/3336716395 learned_addr learned my addr 172.21.15.84:0/3336716395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.359+0000 7fd9dca57700 1 --2- 172.21.15.84:0/3336716395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 0x7fd9d80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9cffff700 1 -- 172.21.15.84:0/3336716395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 msgr2=0x7fd9d80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9cffff700 1 --2- 172.21.15.84:0/3336716395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 0x7fd9d80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9cffff700 1 -- 172.21.15.84:0/3336716395 >> v1:172.21.15.131:6789/0 conn(0x7fd9d80b07a0 legacy=0x7fd9d80b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9cffff700 1 -- 172.21.15.84:0/3336716395 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80b1540 con 0x7fd9d80b49e0 2023-10-06T03:02:39.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9cffff700 1 --2- 172.21.15.84:0/3336716395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 0x7fd9d80aaab0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80099b0 tx=0x7fd9c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5355ddef079aaa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9cf7fe700 1 -- 172.21.15.84:0/3336716395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800b860 con 0x7fd9d80b49e0 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9cf7fe700 1 -- 172.21.15.84:0/3336716395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c800b9c0 con 0x7fd9d80b49e0 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9cf7fe700 1 -- 172.21.15.84:0/3336716395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800bd60 con 0x7fd9d80b49e0 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9decbb700 1 -- 172.21.15.84:0/3336716395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 msgr2=0x7fd9d80aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9decbb700 1 --2- 172.21.15.84:0/3336716395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 0x7fd9d80aaab0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80099b0 tx=0x7fd9c8009250 comp rx=0 tx=0).stop 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9decbb700 1 -- 172.21.15.84:0/3336716395 shutdown_connections 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9decbb700 1 --2- 172.21.15.84:0/3336716395 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 0x7fd9d80aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9decbb700 1 --2- 172.21.15.84:0/3336716395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 0x7fd9d80aaab0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9decbb700 1 -- 172.21.15.84:0/3336716395 >> 172.21.15.84:0/3336716395 conn(0x7fd9d8099830 msgr2=0x7fd9d806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9decbb700 1 -- 172.21.15.84:0/3336716395 shutdown_connections 2023-10-06T03:02:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.360+0000 7fd9decbb700 1 -- 172.21.15.84:0/3336716395 wait complete. 2023-10-06T03:02:39.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.361+0000 7fd9decbb700 1 Processor -- start 2023-10-06T03:02:39.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.362+0000 7fd9decbb700 1 -- start start 2023-10-06T03:02:39.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.362+0000 7fd9decbb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9d80b07a0 0x7fd9d80cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.362+0000 7fd9decbb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 0x7fd9d80c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.362+0000 7fd9decbb700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 0x7fd9d816a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.362+0000 7fd9decbb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80c5aa0 con 0x7fd9d80b49e0 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.362+0000 7fd9decbb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80c5d80 con 0x7fd9d80b07a0 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.362+0000 7fd9decbb700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80c6060 con 0x7fd9d81595a0 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 0x7fd9d80c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 0x7fd9d80c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43272/0 (socket says 172.21.15.84:43272) 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9cffff700 1 -- 172.21.15.84:0/823226957 learned_addr learned my addr 172.21.15.84:0/823226957 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9dca57700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9d80b07a0 0x7fd9d80cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9dd258700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 0x7fd9d816a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9cffff700 1 -- 172.21.15.84:0/823226957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 msgr2=0x7fd9d816a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9cffff700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 0x7fd9d816a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9cffff700 1 -- 172.21.15.84:0/823226957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9d80b07a0 msgr2=0x7fd9d80cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9cffff700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9d80b07a0 0x7fd9d80cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9cffff700 1 -- 172.21.15.84:0/823226957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80094f0 con 0x7fd9d80b49e0 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9cffff700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 0x7fd9d80c5270 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8067c60 tx=0x7fd9c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9ccff9700 1 -- 172.21.15.84:0/823226957 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8011e40 con 0x7fd9d80b49e0 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9ccff9700 1 -- 172.21.15.84:0/823226957 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8024440 con 0x7fd9d80b49e0 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d8169cb0 con 0x7fd9d80b49e0 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9ccff9700 1 -- 172.21.15.84:0/823226957 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8024800 con 0x7fd9d80b49e0 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.363+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d8169940 con 0x7fd9d80b49e0 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.364+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d8169ef0 con 0x7fd9d80b49e0 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.365+0000 7fd9ccff9700 1 -- 172.21.15.84:0/823226957 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9c801a420 con 0x7fd9d80b49e0 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.365+0000 7fd9ccff9700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9c4066f30 0x7fd9c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.365+0000 7fd9ccff9700 1 -- 172.21.15.84:0/823226957 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fd9c8086440 con 0x7fd9d80b49e0 2023-10-06T03:02:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.365+0000 7fd9dca57700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9c4066f30 0x7fd9c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.366+0000 7fd9dca57700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9c4066f30 0x7fd9c40693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40061f0 tx=0x7fd9d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.369+0000 7fd9ccff9700 1 -- 172.21.15.84:0/823226957 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9d8169ef0 con 0x7fd9d80b49e0 2023-10-06T03:02:39.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.554+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9d8169ef0 con 0x7fd9c4066f30 2023-10-06T03:02:39.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.557+0000 7fd9ccff9700 1 -- 172.21.15.84:0/823226957 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73262 (secure 0 0 0) 0x7fd9d8169ef0 con 0x7fd9c4066f30 2023-10-06T03:02:39.559 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9c4066f30 msgr2=0x7fd9c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9c4066f30 0x7fd9c40693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40061f0 tx=0x7fd9d4008040 comp rx=0 tx=0).stop 2023-10-06T03:02:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 msgr2=0x7fd9d80c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 0x7fd9d80c5270 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8067c60 tx=0x7fd9c8017000 comp rx=0 tx=0).stop 2023-10-06T03:02:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 shutdown_connections 2023-10-06T03:02:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd9c4066f30 0x7fd9c40693e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9d80b07a0 0x7fd9d80cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd9d81595a0 0x7fd9d816a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 --2- 172.21.15.84:0/823226957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9d80b49e0 0x7fd9d80c5270 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 >> 172.21.15.84:0/823226957 conn(0x7fd9d8099830 msgr2=0x7fd9d80afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 shutdown_connections 2023-10-06T03:02:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.560+0000 7fd9decbb700 1 -- 172.21.15.84:0/823226957 wait complete. 2023-10-06T03:02:39.563 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:02:39.573 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2023-10-06T03:02:37.899900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2394412,"kb_used_data":12012,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752580308,"statfs":{"total":773094113280,"available":770642235392,"internally_reserved":0,"allocated":12300288,"data_stored":6617755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-119711,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-240,"num_write_kb":-193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001363"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.365340+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T03:01:52.365340+0000","last_peered":"2023-10-06T03:01:52.365340+0000","last_clean":"2023-10-06T03:01:52.365340+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T03:01:52.365340+0000","last_undegraded":"2023-10-06T03:01:52.365340+0000","last_fullsized":"2023-10-06T03:01:52.365340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":82,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.177913+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T03:01:51.177913+0000","last_peered":"2023-10-06T03:01:51.177913+0000","last_clean":"2023-10-06T03:01:51.177913+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T03:01:51.177913+0000","last_undegraded":"2023-10-06T03:01:51.177913+0000","last_fullsized":"2023-10-06T03:01:51.177913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.178219+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T03:01:52.178219+0000","last_peered":"2023-10-06T03:01:52.178219+0000","last_clean":"2023-10-06T03:01:52.178219+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T03:01:52.178219+0000","last_undegraded":"2023-10-06T03:01:52.178219+0000","last_fullsized":"2023-10-06T03:01:52.178219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.178481+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T03:01:51.178481+0000","last_peered":"2023-10-06T03:01:51.178481+0000","last_clean":"2023-10-06T03:01:51.178481+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T03:01:51.178481+0000","last_undegraded":"2023-10-06T03:01:51.178481+0000","last_fullsized":"2023-10-06T03:01:51.178481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":236,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.177986+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T03:01:51.177986+0000","last_peered":"2023-10-06T03:01:51.177986+0000","last_clean":"2023-10-06T03:01:51.177986+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T03:01:51.177986+0000","last_undegraded":"2023-10-06T03:01:51.177986+0000","last_fullsized":"2023-10-06T03:01:51.177986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.177924+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T03:01:51.177924+0000","last_peered":"2023-10-06T03:01:51.177924+0000","last_clean":"2023-10-06T03:01:51.177924+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T03:01:51.177924+0000","last_undegraded":"2023-10-06T03:01:51.177924+0000","last_fullsized":"2023-10-06T03:01:51.177924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.178150+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T03:01:51.178150+0000","last_peered":"2023-10-06T03:01:51.178150+0000","last_clean":"2023-10-06T03:01:51.178150+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T03:01:51.178150+0000","last_undegraded":"2023-10-06T03:01:51.178150+0000","last_fullsized":"2023-10-06T03:01:51.178150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.365537+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T03:01:52.365537+0000","last_peered":"2023-10-06T03:01:52.365537+0000","last_clean":"2023-10-06T03:01:52.365537+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T03:01:52.365537+0000","last_undegraded":"2023-10-06T03:01:52.365537+0000","last_fullsized":"2023-10-06T03:01:52.365537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.180273+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T03:01:52.180273+0000","last_peered":"2023-10-06T03:01:52.180273+0000","last_clean":"2023-10-06T03:01:52.180273+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T03:01:52.180273+0000","last_undegraded":"2023-10-06T03:01:52.180273+0000","last_fullsized":"2023-10-06T03:01:52.180273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072656,"statfs":{"total":96636764160,"available":96330399744,"internally_reserved":0,"allocated":1941504,"data_stored":1239139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.69899999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.29899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.501}]},{"osd":2,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.67100000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34799999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46700000000000003,"15min":0.49199999999999999},"min":{"1min":0.376,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72399999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.498,"15min":0.51200000000000001},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.25600000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.72799999999999998},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":0.83299999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.308},"max":{"1min":0.70699999999999996,"5min":0.73699999999999999,"15min":0.75700000000000001},"last":0.42699999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.55900000000000005},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.79700000000000004},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298616,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073224,"statfs":{"total":96636764160,"available":96330981376,"internally_reserved":0,"allocated":1359872,"data_stored":655419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.58899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.29999999999999999},"max":{"1min":0.67900000000000005,"5min":0.86099999999999999,"15min":3.415},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.57199999999999995},"min":{"1min":0.38400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70099999999999996,"5min":0.746,"15min":1.4219999999999999},"last":0.437}]},{"osd":1,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.81999999999999995,"15min":1.546},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":1.6319999999999999},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.56499999999999995},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.79500000000000004,"15min":1.74},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55700000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":3.4830000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.68100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.80500000000000005,"15min":3.577},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.82099999999999995,"15min":1.9219999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.83399999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29999999999999999},"max":{"1min":0.80000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":677730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33400000000000002,"15min":0.38100000000000001},"min":{"1min":0.23000000000000001,"5min":0.193,"15min":0.19},"max":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":2.0209999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":1.0409999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35799999999999998,"15min":0.996},"min":{"1min":0.23300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":21.193999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.55900000000000005,"5min":0.60299999999999998,"15min":1.181},"last":0.35099999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.42599999999999999},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.628,"15min":2.0579999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.248},"max":{"1min":0.51500000000000001,"5min":0.61599999999999999,"15min":0.626},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78100000000000003,"5min":0.95699999999999996,"15min":1.02},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":1.2170000000000001},"min":{"1min":0.432,"5min":0.308,"15min":0.29799999999999999},"max":{"1min":0.80700000000000005,"5min":0.83599999999999997,"15min":21.135000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":1.2070000000000001},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71699999999999997,"5min":0.89800000000000002,"15min":21.085000000000001},"last":0.441},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.748,"5min":0.83999999999999997,"15min":1.2789999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.70799999999999996,"5min":1.016,"15min":1.016},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":1.2330000000000001},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":21.166},"last":0.46500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74099999999999999,"5min":0.875,"15min":1.2450000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.99099999999999999,"15min":0.997},"last":0.47999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303400,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068440,"statfs":{"total":96636764160,"available":96326082560,"internally_reserved":0,"allocated":2064384,"data_stored":1334262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32100000000000001,"15min":0.32900000000000001},"min":{"1min":0.23899999999999999,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":0.42899999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.34100000000000003,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52100000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36799999999999999,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49299999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.20799999999999999},"max":{"1min":0.38400000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"last":0.316}]},{"osd":3,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.29399999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38200000000000001,"15min":0.40100000000000002},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.46999999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.82399999999999995,"15min":0.89800000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.85599999999999998},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.39700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.755,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79800000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":0.90900000000000003,"15min":0.91200000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79900000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298616,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073224,"statfs":{"total":96636764160,"available":96330981376,"internally_reserved":0,"allocated":1359872,"data_stored":648565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32900000000000001,"15min":0.314},"min":{"1min":0.214,"5min":0.214,"15min":0.19700000000000001},"max":{"1min":0.49199999999999999,"5min":0.55100000000000005,"15min":0.69499999999999995},"last":0.247},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34999999999999998,"15min":0.32900000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.504,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.37,"15min":0.36099999999999999},"min":{"1min":0.246,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.58399999999999996,"15min":0.72399999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38100000000000001,"15min":0.373},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":1.0129999999999999},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.92100000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.63100000000000001,"15min":0.78900000000000003},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.375,"15min":0.35599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.73199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.621,"15min":0.57699999999999996},"min":{"1min":0.44400000000000001,"5min":0.39600000000000002,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":1.276,"15min":1.276},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67000000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.39900000000000002},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.077},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72799999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.747,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298684,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073156,"statfs":{"total":96636764160,"available":96330911744,"internally_reserved":0,"allocated":1429504,"data_stored":727759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.34799999999999998,"15min":0.42199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.16400000000000001},"max":{"1min":0.45500000000000002,"5min":0.60899999999999999,"15min":2.569},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.36799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45900000000000002,"5min":0.57499999999999996,"15min":2.1840000000000002},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33800000000000002,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.504,"5min":0.58799999999999997,"15min":2.3199999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.44900000000000001},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.64100000000000001,"15min":2.5979999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.60699999999999998,"15min":2.3439999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39800000000000002,"15min":0.46700000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":2.6269999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.628},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.85099999999999998,"15min":2.1240000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58899999999999997,"15min":0.64700000000000002},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":2.2240000000000002},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.65200000000000002},"min":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.80700000000000005,"5min":0.84699999999999998,"15min":2.2650000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":2.532},"last":0.628}]},{"osd":6,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":2.0840000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60499999999999998,"15min":0.67500000000000004},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":2.2930000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78500000000000003,"5min":0.90600000000000003,"15min":2.496},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.877,"15min":2.1549999999999998},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298600,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073240,"statfs":{"total":96636764160,"available":96330997760,"internally_reserved":0,"allocated":1343488,"data_stored":648217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66000000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.38400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.73999999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34100000000000003},"max":{"1min":0.69799999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.504},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.90500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.871,"15min":9.4440000000000008},"last":0.40500000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38300000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.54800000000000004,"15min":0.58999999999999997},"min":{"1min":0.38700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.61199999999999999},"min":{"1min":0.495,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.64900000000000002},"min":{"1min":0.51000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81200000000000006,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":686664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.498},"min":{"1min":0.42999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":1.0069999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63100000000000001,"5min":0.73899999999999999,"15min":1.167},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66000000000000003,"5min":0.74099999999999999,"15min":1.117},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.41399999999999998,"5min":0.34399999999999997,"15min":0.29499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.94399999999999995},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53200000000000003,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.76700000000000002,"15min":1.2},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.58099999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.1759999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":1.135},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69999999999999996,"5min":0.77600000000000002,"15min":1.208},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":0.66100000000000003,"5min":0.68600000000000005,"15min":0.78000000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":0.85399999999999998,"15min":0.87},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.28499999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":1.054},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.90100000000000002},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.751,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":1.008},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:02:39.575 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:02:39.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:02:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.688+0000 7fc83d2a2700 1 Processor -- start 2023-10-06T03:02:39.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.688+0000 7fc83d2a2700 1 -- start start 2023-10-06T03:02:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.689+0000 7fc83d2a2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc8380b07a0 0x7fc8380ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.689+0000 7fc83d2a2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380b0ca0 con 0x7fc8380b49e0 2023-10-06T03:02:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.689+0000 7fc83d2a2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380b0f80 con 0x7fc8381595a0 2023-10-06T03:02:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.689+0000 7fc83d2a2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8380ab390 con 0x7fc8380b07a0 2023-10-06T03:02:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.689+0000 7fc82e7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc8380b49e0 0x7fc8380aac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38534/0 (socket says 172.21.15.84:38534) 2023-10-06T03:02:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.689+0000 7fc82e7fc700 1 -- 172.21.15.84:0/2790922028 learned_addr learned my addr 172.21.15.84:0/2790922028 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.689+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007851361 0 0) 0x7fc8380b0ca0 con 0x7fc8380b49e0 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.689+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc824003570 con 0x7fc8380b49e0 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.689+0000 7fc8377fe700 1 --2- 172.21.15.84:0/2790922028 >> v2:172.21.15.131:3300/0 conn(0x7fc8380b07a0 0x7fc8380ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719867074 0 0) 0x7fc824003570 con 0x7fc8380b49e0 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 >> v2:172.21.15.131:3300/0 conn(0x7fc8380b07a0 msgr2=0x7fc8380ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 --2- 172.21.15.84:0/2790922028 >> v2:172.21.15.131:3300/0 conn(0x7fc8380b07a0 0x7fc8380ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 >> v1:172.21.15.131:6789/0 conn(0x7fc8381595a0 legacy=0x7fc8380aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380b1260 con 0x7fc8380b49e0 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fc820001470 con 0x7fc8380b49e0 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 >> v1:172.21.15.84:6789/0 conn(0x7fc8380b49e0 legacy=0x7fc8380aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc824003a60 0x7fc824003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc824004810 0x7fc824004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8240051c0 0x7fc82400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380ab390 con 0x7fc824004810 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82400c0d0 con 0x7fc824003a60 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82400c290 con 0x7fc8240051c0 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc82e7fc700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc824004810 0x7fc824004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc836ffd700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc824003a60 0x7fc824003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8377fe700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8240051c0 0x7fc82400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc82e7fc700 1 -- 172.21.15.84:0/2790922028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8240051c0 msgr2=0x7fc82400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc82e7fc700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8240051c0 0x7fc82400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc82e7fc700 1 -- 172.21.15.84:0/2790922028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc824003a60 msgr2=0x7fc824003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc82e7fc700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc824003a60 0x7fc824003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc82e7fc700 1 -- 172.21.15.84:0/2790922028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824003570 con 0x7fc824004810 2023-10-06T03:02:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8377fe700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc8240051c0 0x7fc82400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8377fe700 1 -- 172.21.15.84:0/2790922028 reap_dead start 2023-10-06T03:02:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc82e7fc700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc824004810 0x7fc824004c80 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fc838088e20 tx=0x7fc820001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34752f4f21470f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.690+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82000cc30 con 0x7fc824004810 2023-10-06T03:02:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.691+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82000cd90 con 0x7fc824004810 2023-10-06T03:02:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.691+0000 7fc8367fc700 1 -- 172.21.15.84:0/2790922028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820005b50 con 0x7fc824004810 2023-10-06T03:02:39.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.691+0000 7fc83d2a2700 1 -- 172.21.15.84:0/2790922028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc824004810 msgr2=0x7fc824004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.691+0000 7fc83d2a2700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc824004810 0x7fc824004c80 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fc838088e20 tx=0x7fc820001e50 comp rx=0 tx=0).stop 2023-10-06T03:02:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.691+0000 7fc83d2a2700 1 -- 172.21.15.84:0/2790922028 shutdown_connections 2023-10-06T03:02:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.691+0000 7fc83d2a2700 1 --2- 172.21.15.84:0/2790922028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc824004810 0x7fc824004c80 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.691+0000 7fc83d2a2700 1 -- 172.21.15.84:0/2790922028 >> 172.21.15.84:0/2790922028 conn(0x7fc838099830 msgr2=0x7fc83806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.691+0000 7fc83d2a2700 1 -- 172.21.15.84:0/2790922028 shutdown_connections 2023-10-06T03:02:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.691+0000 7fc83d2a2700 1 -- 172.21.15.84:0/2790922028 wait complete. 2023-10-06T03:02:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.692+0000 7fc83d2a2700 1 Processor -- start 2023-10-06T03:02:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.692+0000 7fc83d2a2700 1 -- start start 2023-10-06T03:02:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc83d2a2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc824004810 0x7fc8380ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc83d2a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8380af320 0x7fc8380cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc83d2a2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc838157a30 0x7fc838157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc83d2a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380ae8c0 con 0x7fc8380af320 2023-10-06T03:02:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc83d2a2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8381583c0 con 0x7fc838157a30 2023-10-06T03:02:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc83d2a2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380adcb0 con 0x7fc824004810 2023-10-06T03:02:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc82e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8380af320 0x7fc8380cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc82e7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8380af320 0x7fc8380cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43294/0 (socket says 172.21.15.84:43294) 2023-10-06T03:02:39.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc82e7fc700 1 -- 172.21.15.84:0/3601211768 learned_addr learned my addr 172.21.15.84:0/3601211768 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:39.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc836ffd700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc824004810 0x7fc8380ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc8377fe700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc838157a30 0x7fc838157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc82e7fc700 1 -- 172.21.15.84:0/3601211768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc824004810 msgr2=0x7fc8380ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc82e7fc700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc824004810 0x7fc8380ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc82e7fc700 1 -- 172.21.15.84:0/3601211768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc838157a30 msgr2=0x7fc838157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc82e7fc700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc838157a30 0x7fc838157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc82e7fc700 1 -- 172.21.15.84:0/3601211768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380adf90 con 0x7fc8380af320 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.693+0000 7fc836ffd700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc824004810 0x7fc8380ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.694+0000 7fc82e7fc700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8380af320 0x7fc8380cea70 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c0a0 tx=0x7fc820015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.694+0000 7fc82f7fe700 1 -- 172.21.15.84:0/3601211768 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82000cc30 con 0x7fc8380af320 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.694+0000 7fc82f7fe700 1 -- 172.21.15.84:0/3601211768 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82000c980 con 0x7fc8380af320 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.694+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8380ae270 con 0x7fc8380af320 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.694+0000 7fc82f7fe700 1 -- 172.21.15.84:0/3601211768 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820007320 con 0x7fc8380af320 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.694+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8380af790 con 0x7fc8380af320 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.695+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc838064ad0 con 0x7fc8380af320 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.695+0000 7fc82f7fe700 1 -- 172.21.15.84:0/3601211768 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc820007710 con 0x7fc8380af320 2023-10-06T03:02:39.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.695+0000 7fc82f7fe700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc818066f30 0x7fc8180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.695+0000 7fc82f7fe700 1 -- 172.21.15.84:0/3601211768 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fc8200859f0 con 0x7fc8380af320 2023-10-06T03:02:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.695+0000 7fc836ffd700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc818066f30 0x7fc8180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.696+0000 7fc836ffd700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc818066f30 0x7fc8180693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc828000c00 tx=0x7fc828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.700+0000 7fc82f7fe700 1 -- 172.21.15.84:0/3601211768 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc820052c10 con 0x7fc8380af320 2023-10-06T03:02:39.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.883+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8380aea00 con 0x7fc818066f30 2023-10-06T03:02:39.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.885+0000 7fc82f7fe700 1 -- 172.21.15.84:0/3601211768 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73262 (secure 0 0 0) 0x7fc828003d30 con 0x7fc818066f30 2023-10-06T03:02:39.888 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:39.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc818066f30 msgr2=0x7fc8180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc818066f30 0x7fc8180693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc828000c00 tx=0x7fc828009040 comp rx=0 tx=0).stop 2023-10-06T03:02:39.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8380af320 msgr2=0x7fc8380cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8380af320 0x7fc8380cea70 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c0a0 tx=0x7fc820015000 comp rx=0 tx=0).stop 2023-10-06T03:02:39.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 shutdown_connections 2023-10-06T03:02:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fc818066f30 0x7fc8180693e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc838157a30 0x7fc838157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc824004810 0x7fc8380ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 --2- 172.21.15.84:0/3601211768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8380af320 0x7fc8380cea70 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.887+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 >> 172.21.15.84:0/3601211768 conn(0x7fc838099830 msgr2=0x7fc8380aac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.888+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 shutdown_connections 2023-10-06T03:02:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:39.888+0000 7fc83d2a2700 1 -- 172.21.15.84:0/3601211768 wait complete. 2023-10-06T03:02:39.890 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:02:39.901 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2023-10-06T03:02:37.899900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2394412,"kb_used_data":12012,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752580308,"statfs":{"total":773094113280,"available":770642235392,"internally_reserved":0,"allocated":12300288,"data_stored":6617755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-119711,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-240,"num_write_kb":-193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001363"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.365340+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T03:01:52.365340+0000","last_peered":"2023-10-06T03:01:52.365340+0000","last_clean":"2023-10-06T03:01:52.365340+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T03:01:52.365340+0000","last_undegraded":"2023-10-06T03:01:52.365340+0000","last_fullsized":"2023-10-06T03:01:52.365340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":82,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.177913+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T03:01:51.177913+0000","last_peered":"2023-10-06T03:01:51.177913+0000","last_clean":"2023-10-06T03:01:51.177913+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T03:01:51.177913+0000","last_undegraded":"2023-10-06T03:01:51.177913+0000","last_fullsized":"2023-10-06T03:01:51.177913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.178219+0000","last_change":"2023-10-06T02:55:02.377938+0000","last_active":"2023-10-06T03:01:52.178219+0000","last_peered":"2023-10-06T03:01:52.178219+0000","last_clean":"2023-10-06T03:01:52.178219+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T03:01:52.178219+0000","last_undegraded":"2023-10-06T03:01:52.178219+0000","last_fullsized":"2023-10-06T03:01:52.178219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.178481+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T03:01:51.178481+0000","last_peered":"2023-10-06T03:01:51.178481+0000","last_clean":"2023-10-06T03:01:51.178481+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T03:01:51.178481+0000","last_undegraded":"2023-10-06T03:01:51.178481+0000","last_fullsized":"2023-10-06T03:01:51.178481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":236,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.177986+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T03:01:51.177986+0000","last_peered":"2023-10-06T03:01:51.177986+0000","last_clean":"2023-10-06T03:01:51.177986+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T03:01:51.177986+0000","last_undegraded":"2023-10-06T03:01:51.177986+0000","last_fullsized":"2023-10-06T03:01:51.177986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":83,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.177924+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T03:01:51.177924+0000","last_peered":"2023-10-06T03:01:51.177924+0000","last_clean":"2023-10-06T03:01:51.177924+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T03:01:51.177924+0000","last_undegraded":"2023-10-06T03:01:51.177924+0000","last_fullsized":"2023-10-06T03:01:51.177924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-10-06T03:01:51.178150+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T03:01:51.178150+0000","last_peered":"2023-10-06T03:01:51.178150+0000","last_clean":"2023-10-06T03:01:51.178150+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T03:01:51.178150+0000","last_undegraded":"2023-10-06T03:01:51.178150+0000","last_fullsized":"2023-10-06T03:01:51.178150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.365537+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T03:01:52.365537+0000","last_peered":"2023-10-06T03:01:52.365537+0000","last_clean":"2023-10-06T03:01:52.365537+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T03:01:52.365537+0000","last_undegraded":"2023-10-06T03:01:52.365537+0000","last_fullsized":"2023-10-06T03:01:52.365537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:45.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-10-06T03:01:52.180273+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T03:01:52.180273+0000","last_peered":"2023-10-06T03:01:52.180273+0000","last_clean":"2023-10-06T03:01:52.180273+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T03:01:52.180273+0000","last_undegraded":"2023-10-06T03:01:52.180273+0000","last_fullsized":"2023-10-06T03:01:52.180273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072656,"statfs":{"total":96636764160,"available":96330399744,"internally_reserved":0,"allocated":1941504,"data_stored":1239139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.69899999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.29899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.501}]},{"osd":2,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.67100000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34799999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46700000000000003,"15min":0.49199999999999999},"min":{"1min":0.376,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72399999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.498,"15min":0.51200000000000001},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.25600000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.72799999999999998},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":0.83299999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.308},"max":{"1min":0.70699999999999996,"5min":0.73699999999999999,"15min":0.75700000000000001},"last":0.42699999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.55900000000000005},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.79700000000000004},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298616,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073224,"statfs":{"total":96636764160,"available":96330981376,"internally_reserved":0,"allocated":1359872,"data_stored":655419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.58899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.29999999999999999},"max":{"1min":0.67900000000000005,"5min":0.86099999999999999,"15min":3.415},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.57199999999999995},"min":{"1min":0.38400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70099999999999996,"5min":0.746,"15min":1.4219999999999999},"last":0.437}]},{"osd":1,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.81999999999999995,"15min":1.546},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":1.6319999999999999},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.56499999999999995},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.79500000000000004,"15min":1.74},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55700000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":3.4830000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.68100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.80500000000000005,"15min":3.577},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.82099999999999995,"15min":1.9219999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.83399999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29999999999999999},"max":{"1min":0.80000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":677730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33400000000000002,"15min":0.38100000000000001},"min":{"1min":0.23000000000000001,"5min":0.193,"15min":0.19},"max":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":2.0209999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":1.0409999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35799999999999998,"15min":0.996},"min":{"1min":0.23300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":21.193999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.55900000000000005,"5min":0.60299999999999998,"15min":1.181},"last":0.35099999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.42599999999999999},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.628,"15min":2.0579999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.248},"max":{"1min":0.51500000000000001,"5min":0.61599999999999999,"15min":0.626},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78100000000000003,"5min":0.95699999999999996,"15min":1.02},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":1.2170000000000001},"min":{"1min":0.432,"5min":0.308,"15min":0.29799999999999999},"max":{"1min":0.80700000000000005,"5min":0.83599999999999997,"15min":21.135000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":1.2070000000000001},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71699999999999997,"5min":0.89800000000000002,"15min":21.085000000000001},"last":0.441},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.748,"5min":0.83999999999999997,"15min":1.2789999999999999},"last":0.44800000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.70799999999999996,"5min":1.016,"15min":1.016},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":1.2330000000000001},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":21.166},"last":0.46500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74099999999999999,"5min":0.875,"15min":1.2450000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.99099999999999999,"15min":0.997},"last":0.47999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303400,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068440,"statfs":{"total":96636764160,"available":96326082560,"internally_reserved":0,"allocated":2064384,"data_stored":1334262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32100000000000001,"15min":0.32900000000000001},"min":{"1min":0.23899999999999999,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":0.42899999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.34100000000000003,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52100000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36799999999999999,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49299999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.20799999999999999},"max":{"1min":0.38400000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"last":0.316}]},{"osd":3,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.29399999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38200000000000001,"15min":0.40100000000000002},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.46999999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.82399999999999995,"15min":0.89800000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.85599999999999998},"last":0.60599999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.39700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.755,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79800000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":0.90900000000000003,"15min":0.91200000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79900000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298616,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073224,"statfs":{"total":96636764160,"available":96330981376,"internally_reserved":0,"allocated":1359872,"data_stored":648565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32900000000000001,"15min":0.314},"min":{"1min":0.214,"5min":0.214,"15min":0.19700000000000001},"max":{"1min":0.49199999999999999,"5min":0.55100000000000005,"15min":0.69499999999999995},"last":0.247},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34999999999999998,"15min":0.32900000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.504,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.37,"15min":0.36099999999999999},"min":{"1min":0.246,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.58399999999999996,"15min":0.72399999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38100000000000001,"15min":0.373},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":1.0129999999999999},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.92100000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.63100000000000001,"15min":0.78900000000000003},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.375,"15min":0.35599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.73199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.621,"15min":0.57699999999999996},"min":{"1min":0.44400000000000001,"5min":0.39600000000000002,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":1.276,"15min":1.276},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67000000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.39900000000000002},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.077},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72799999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.747,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298684,"kb_used_data":1396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073156,"statfs":{"total":96636764160,"available":96330911744,"internally_reserved":0,"allocated":1429504,"data_stored":727759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.34799999999999998,"15min":0.42199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.16400000000000001},"max":{"1min":0.45500000000000002,"5min":0.60899999999999999,"15min":2.569},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.36799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45900000000000002,"5min":0.57499999999999996,"15min":2.1840000000000002},"last":0.32000000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33800000000000002,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.504,"5min":0.58799999999999997,"15min":2.3199999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.44900000000000001},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.64100000000000001,"15min":2.5979999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.60699999999999998,"15min":2.3439999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39800000000000002,"15min":0.46700000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":2.6269999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.628},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.85099999999999998,"15min":2.1240000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58899999999999997,"15min":0.64700000000000002},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":2.2240000000000002},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.65200000000000002},"min":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.80700000000000005,"5min":0.84699999999999998,"15min":2.2650000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":2.532},"last":0.628}]},{"osd":6,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":2.0840000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60499999999999998,"15min":0.67500000000000004},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":2.2930000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78500000000000003,"5min":0.90600000000000003,"15min":2.496},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.877,"15min":2.1549999999999998},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298600,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073240,"statfs":{"total":96636764160,"available":96330997760,"internally_reserved":0,"allocated":1343488,"data_stored":648217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66000000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.38400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.73999999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34100000000000003},"max":{"1min":0.69799999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.504},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.90500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.871,"15min":9.4440000000000008},"last":0.40500000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38300000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.54800000000000004,"15min":0.58999999999999997},"min":{"1min":0.38700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.61199999999999999},"min":{"1min":0.495,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.64900000000000002},"min":{"1min":0.51000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81200000000000006,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298656,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073184,"statfs":{"total":96636764160,"available":96330940416,"internally_reserved":0,"allocated":1400832,"data_stored":686664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.498},"min":{"1min":0.42999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":1.0069999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63100000000000001,"5min":0.73899999999999999,"15min":1.167},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66000000000000003,"5min":0.74099999999999999,"15min":1.117},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.41399999999999998,"5min":0.34399999999999997,"15min":0.29499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.94399999999999995},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53200000000000003,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.76700000000000002,"15min":1.2},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.58099999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.1759999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":1.135},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69999999999999996,"5min":0.77600000000000002,"15min":1.208},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":0.66100000000000003,"5min":0.68600000000000005,"15min":0.78000000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":0.85399999999999998,"15min":0.87},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.28499999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":1.054},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.90100000000000002},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.751,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":1.008},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:02:39.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.016+0000 7f0e67021700 1 Processor -- start 2023-10-06T03:02:40.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.016+0000 7f0e67021700 1 -- start start 2023-10-06T03:02:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e67021700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e601594b0 0x7f0e600ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e67021700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 0x7f0e600ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e67021700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0e600cef00 0x7f0e600c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e67021700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600cd610 con 0x7f0e601594b0 2023-10-06T03:02:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e67021700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600cc840 con 0x7f0e600cef00 2023-10-06T03:02:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e67021700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600cbc70 con 0x7f0e600cd1a0 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e6601f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e601594b0 0x7f0e600ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e6601f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e601594b0 0x7f0e600ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43308/0 (socket says 172.21.15.84:43308) 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e6601f700 1 -- 172.21.15.84:0/401094749 learned_addr learned my addr 172.21.15.84:0/401094749 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e6581e700 1 --2- 172.21.15.84:0/401094749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 0x7f0e600ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e66820700 1 --2- 172.21.15.84:0/401094749 >> v2:172.21.15.131:3300/0 conn(0x7f0e600cef00 0x7f0e600c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.017+0000 7f0e6601f700 1 -- 172.21.15.84:0/401094749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 msgr2=0x7f0e600ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e6601f700 1 --2- 172.21.15.84:0/401094749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 0x7f0e600ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e6601f700 1 -- 172.21.15.84:0/401094749 >> v2:172.21.15.131:3300/0 conn(0x7f0e600cef00 msgr2=0x7f0e600c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e6601f700 1 --2- 172.21.15.84:0/401094749 >> v2:172.21.15.131:3300/0 conn(0x7f0e600cef00 0x7f0e600c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e6601f700 1 -- 172.21.15.84:0/401094749 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600cbf10 con 0x7f0e601594b0 2023-10-06T03:02:40.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e6601f700 1 --2- 172.21.15.84:0/401094749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 0x7f0e600ccc60 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f0e600ca910 tx=0x7f0e5c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8414b9b849092a36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e6501d700 1 -- 172.21.15.84:0/401094749 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c005c10 con 0x7f0e601594b0 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e6501d700 1 -- 172.21.15.84:0/401094749 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c005d70 con 0x7f0e601594b0 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e6501d700 1 -- 172.21.15.84:0/401094749 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c00b8a0 con 0x7f0e601594b0 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e67021700 1 -- 172.21.15.84:0/401094749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 msgr2=0x7f0e600ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e67021700 1 --2- 172.21.15.84:0/401094749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 0x7f0e600ccc60 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f0e600ca910 tx=0x7f0e5c009220 comp rx=0 tx=0).stop 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e67021700 1 -- 172.21.15.84:0/401094749 shutdown_connections 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e67021700 1 --2- 172.21.15.84:0/401094749 >> v2:172.21.15.131:3300/0 conn(0x7f0e600cef00 0x7f0e600c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e67021700 1 --2- 172.21.15.84:0/401094749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 0x7f0e600ccc60 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e67021700 1 --2- 172.21.15.84:0/401094749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 0x7f0e600ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.018+0000 7f0e67021700 1 -- 172.21.15.84:0/401094749 >> 172.21.15.84:0/401094749 conn(0x7f0e60099600 msgr2=0x7f0e6006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.019+0000 7f0e67021700 1 -- 172.21.15.84:0/401094749 shutdown_connections 2023-10-06T03:02:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.019+0000 7f0e67021700 1 -- 172.21.15.84:0/401094749 wait complete. 2023-10-06T03:02:40.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e67021700 1 Processor -- start 2023-10-06T03:02:40.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e67021700 1 -- start start 2023-10-06T03:02:40.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e67021700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 0x7f0e601582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e67021700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600cef00 0x7f0e60154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e67021700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 0x7f0e600c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e67021700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c96e0 con 0x7f0e601594b0 2023-10-06T03:02:40.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e67021700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e601548b0 con 0x7f0e600cef00 2023-10-06T03:02:40.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e67021700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600ca0b0 con 0x7f0e600cd1a0 2023-10-06T03:02:40.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e66820700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 0x7f0e600c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e66820700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 0x7f0e600c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43312/0 (socket says 172.21.15.84:43312) 2023-10-06T03:02:40.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.020+0000 7f0e66820700 1 -- 172.21.15.84:0/1010190210 learned_addr learned my addr 172.21.15.84:0/1010190210 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:40.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e6581e700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600cef00 0x7f0e60154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e6601f700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 0x7f0e601582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e66820700 1 -- 172.21.15.84:0/1010190210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 msgr2=0x7f0e601582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e66820700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 0x7f0e601582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e66820700 1 -- 172.21.15.84:0/1010190210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600cef00 msgr2=0x7f0e60154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e66820700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600cef00 0x7f0e60154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e66820700 1 -- 172.21.15.84:0/1010190210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c009480 con 0x7f0e601594b0 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e66820700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 0x7f0e600c9b70 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f0e58007f20 tx=0x7f0e58009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e567fc700 1 -- 172.21.15.84:0/1010190210 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800eb90 con 0x7f0e601594b0 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e567fc700 1 -- 172.21.15.84:0/1010190210 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5800ed10 con 0x7f0e601594b0 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e601589d0 con 0x7f0e601594b0 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e567fc700 1 -- 172.21.15.84:0/1010190210 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58014670 con 0x7f0e601594b0 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.021+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e600c9090 con 0x7f0e601594b0 2023-10-06T03:02:40.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.022+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6005f270 con 0x7f0e601594b0 2023-10-06T03:02:40.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.022+0000 7f0e567fc700 1 -- 172.21.15.84:0/1010190210 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e580149e0 con 0x7f0e601594b0 2023-10-06T03:02:40.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.023+0000 7f0e567fc700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e44066f30 0x7f0e440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.023+0000 7f0e567fc700 1 -- 172.21.15.84:0/1010190210 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f0e58084ad0 con 0x7f0e601594b0 2023-10-06T03:02:40.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.023+0000 7f0e6601f700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e44066f30 0x7f0e440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.023+0000 7f0e6601f700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e44066f30 0x7f0e440693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c007fd0 tx=0x7f0e5c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.027+0000 7f0e567fc700 1 -- 172.21.15.84:0/1010190210 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e58051cf0 con 0x7f0e601594b0 2023-10-06T03:02:40.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.212+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e600cc1f0 con 0x7f0e601594b0 2023-10-06T03:02:40.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.213+0000 7f0e567fc700 1 -- 172.21.15.84:0/1010190210 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+14254 (secure 0 0 0) 0x7f0e58055310 con 0x7f0e601594b0 2023-10-06T03:02:40.215 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:40.215 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":111,"fsid":"3949ddc0-2086-4c8d-802f-a1ccf3555047","created":"2023-10-06T02:54:42.304811+0000","modified":"2023-10-06T03:02:36.793959+0000","last_up_change":"2023-10-06T02:54:53.775280+0000","last_in_change":"2023-10-06T02:54:44.696833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T02:54:53.838905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T02:55:00.613030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dfca9df4-043d-4160-b70d-bf7668e5b982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":90632},{"type":"v1","addr":"172.21.15.84:6809","nonce":90632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":90632},{"type":"v1","addr":"172.21.15.84:6811","nonce":90632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":90632},{"type":"v1","addr":"172.21.15.84:6815","nonce":90632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":90632},{"type":"v1","addr":"172.21.15.84:6813","nonce":90632}]},"public_addr":"172.21.15.84:6809/90632","cluster_addr":"172.21.15.84:6811/90632","heartbeat_back_addr":"172.21.15.84:6815/90632","heartbeat_front_addr":"172.21.15.84:6813/90632","state":["exists","up"]},{"osd":1,"uuid":"396db709-743f-4643-bcee-b9a1fa52d1b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":90643},{"type":"v1","addr":"172.21.15.84:6817","nonce":90643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":90643},{"type":"v1","addr":"172.21.15.84:6819","nonce":90643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":90643},{"type":"v1","addr":"172.21.15.84:6823","nonce":90643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":90643},{"type":"v1","addr":"172.21.15.84:6821","nonce":90643}]},"public_addr":"172.21.15.84:6817/90643","cluster_addr":"172.21.15.84:6819/90643","heartbeat_back_addr":"172.21.15.84:6823/90643","heartbeat_front_addr":"172.21.15.84:6821/90643","state":["exists","up"]},{"osd":2,"uuid":"1176651d-f222-4264-8e7a-149a1088fd92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":90631},{"type":"v1","addr":"172.21.15.84:6801","nonce":90631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":90631},{"type":"v1","addr":"172.21.15.84:6803","nonce":90631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":90631},{"type":"v1","addr":"172.21.15.84:6807","nonce":90631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":90631},{"type":"v1","addr":"172.21.15.84:6805","nonce":90631}]},"public_addr":"172.21.15.84:6801/90631","cluster_addr":"172.21.15.84:6803/90631","heartbeat_back_addr":"172.21.15.84:6807/90631","heartbeat_front_addr":"172.21.15.84:6805/90631","state":["exists","up"]},{"osd":3,"uuid":"c1da6611-16bc-4542-83ab-ca50875e9bfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":90648},{"type":"v1","addr":"172.21.15.84:6825","nonce":90648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":90648},{"type":"v1","addr":"172.21.15.84:6827","nonce":90648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":90648},{"type":"v1","addr":"172.21.15.84:6831","nonce":90648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":90648},{"type":"v1","addr":"172.21.15.84:6829","nonce":90648}]},"public_addr":"172.21.15.84:6825/90648","cluster_addr":"172.21.15.84:6827/90648","heartbeat_back_addr":"172.21.15.84:6831/90648","heartbeat_front_addr":"172.21.15.84:6829/90648","state":["exists","up"]},{"osd":4,"uuid":"8a93456a-cf71-4d0d-9d72-43bbc0cf6a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":90922},{"type":"v1","addr":"172.21.15.131:6801","nonce":90922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":90922},{"type":"v1","addr":"172.21.15.131:6803","nonce":90922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":90922},{"type":"v1","addr":"172.21.15.131:6807","nonce":90922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":90922},{"type":"v1","addr":"172.21.15.131:6805","nonce":90922}]},"public_addr":"172.21.15.131:6801/90922","cluster_addr":"172.21.15.131:6803/90922","heartbeat_back_addr":"172.21.15.131:6807/90922","heartbeat_front_addr":"172.21.15.131:6805/90922","state":["exists","up"]},{"osd":5,"uuid":"aa0d6b1c-60b0-4db0-ac46-130a1f4ff04e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":90923},{"type":"v1","addr":"172.21.15.131:6809","nonce":90923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":90923},{"type":"v1","addr":"172.21.15.131:6811","nonce":90923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":90923},{"type":"v1","addr":"172.21.15.131:6815","nonce":90923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":90923},{"type":"v1","addr":"172.21.15.131:6813","nonce":90923}]},"public_addr":"172.21.15.131:6809/90923","cluster_addr":"172.21.15.131:6811/90923","heartbeat_back_addr":"172.21.15.131:6815/90923","heartbeat_front_addr":"172.21.15.131:6813/90923","state":["exists","up"]},{"osd":6,"uuid":"9fa47ca3-7fc5-45e2-be9c-c719c312e400","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":90967},{"type":"v1","addr":"172.21.15.131:6825","nonce":90967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":90967},{"type":"v1","addr":"172.21.15.131:6827","nonce":90967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":90967},{"type":"v1","addr":"172.21.15.131:6831","nonce":90967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":90967},{"type":"v1","addr":"172.21.15.131:6829","nonce":90967}]},"public_addr":"172.21.15.131:6825/90967","cluster_addr":"172.21.15.131:6827/90967","heartbeat_back_addr":"172.21.15.131:6831/90967","heartbeat_front_addr":"172.21.15.131:6829/90967","state":["exists","up"]},{"osd":7,"uuid":"fe714779-3084-492d-9e94-004259b0e53a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":90924},{"type":"v1","addr":"172.21.15.131:6817","nonce":90924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":90924},{"type":"v1","addr":"172.21.15.131:6819","nonce":90924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":90924},{"type":"v1","addr":"172.21.15.131:6823","nonce":90924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":90924},{"type":"v1","addr":"172.21.15.131:6821","nonce":90924}]},"public_addr":"172.21.15.131:6817/90924","cluster_addr":"172.21.15.131:6819/90924","heartbeat_back_addr":"172.21.15.131:6823/90924","heartbeat_front_addr":"172.21.15.131:6821/90924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.825369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.870856+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.888431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.905734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.864963+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.915923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.942812+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T02:54:49.921337+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6837/868960356":"2023-10-07T03:02:33.785942+0000","172.21.15.84:6835/868960356":"2023-10-07T03:02:33.785942+0000","172.21.15.131:6835/3436673358":"2023-10-07T03:02:33.785913+0000","172.21.15.131:6833/3436673358":"2023-10-07T03:02:33.785913+0000","172.21.15.84:6836/3850699528":"2023-10-07T03:02:33.785933+0000","172.21.15.84:6834/3850699528":"2023-10-07T03:02:33.785933+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:40.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.215+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e44066f30 msgr2=0x7f0e440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.215+0000 7f0e67021700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e44066f30 0x7f0e440693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c007fd0 tx=0x7f0e5c016000 comp rx=0 tx=0).stop 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.215+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 msgr2=0x7f0e600c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.215+0000 7f0e67021700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 0x7f0e600c9b70 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f0e58007f20 tx=0x7f0e58009860 comp rx=0 tx=0).stop 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.215+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 shutdown_connections 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.215+0000 7f0e67021700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0e44066f30 0x7f0e440693e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.216+0000 7f0e67021700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e601594b0 0x7f0e600c9b70 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.216+0000 7f0e67021700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e600cd1a0 0x7f0e601582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.216+0000 7f0e67021700 1 --2- 172.21.15.84:0/1010190210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e600cef00 0x7f0e60154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.216+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 >> 172.21.15.84:0/1010190210 conn(0x7f0e60099600 msgr2=0x7f0e60069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:40.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.216+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 shutdown_connections 2023-10-06T03:02:40.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:40.216+0000 7f0e67021700 1 -- 172.21.15.84:0/1010190210 wait complete. 2023-10-06T03:02:41.230 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T03:02:41.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:02:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.354+0000 7f91cec67700 1 Processor -- start 2023-10-06T03:02:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.354+0000 7f91cec67700 1 -- start start 2023-10-06T03:02:41.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.355+0000 7f91cec67700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c806ed20 0x7f91c80b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.355+0000 7f91cec67700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91c806f0f0 0x7f91c80b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.355+0000 7f91cec67700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c80b2d20 con 0x7f91c80aee20 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.355+0000 7f91cec67700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c806fb80 con 0x7f91c806f0f0 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.355+0000 7f91cec67700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80b0450 con 0x7f91c806ed20 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.355+0000 7f91bffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91c806f0f0 0x7f91c80b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.355+0000 7f91bffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91c806f0f0 0x7f91c80b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43326/0 (socket says 172.21.15.84:43326) 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.355+0000 7f91bffff700 1 -- 172.21.15.84:0/1206386341 learned_addr learned my addr 172.21.15.84:0/1206386341 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91cca03700 1 --2- 172.21.15.84:0/1206386341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c806ed20 0x7f91c80b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91bffff700 1 -- 172.21.15.84:0/1206386341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c806ed20 msgr2=0x7f91c80b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91bffff700 1 --2- 172.21.15.84:0/1206386341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c806ed20 0x7f91c80b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91bffff700 1 -- 172.21.15.84:0/1206386341 >> v1:172.21.15.131:6789/0 conn(0x7f91c80aee20 legacy=0x7f91c80af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91bffff700 1 -- 172.21.15.84:0/1206386341 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c80b2a40 con 0x7f91c806f0f0 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91cca03700 1 --2- 172.21.15.84:0/1206386341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c806ed20 0x7f91c80b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91bffff700 1 --2- 172.21.15.84:0/1206386341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 0x7f91c80b08e0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f91b80099e0 tx=0x7f91b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce02732ecdabc9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91bf7fe700 1 -- 172.21.15.84:0/1206386341 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800b820 con 0x7f91c806f0f0 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91bf7fe700 1 -- 172.21.15.84:0/1206386341 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b800b980 con 0x7f91c806f0f0 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.356+0000 7f91bf7fe700 1 -- 172.21.15.84:0/1206386341 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800bd20 con 0x7f91c806f0f0 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.357+0000 7f91cec67700 1 -- 172.21.15.84:0/1206386341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 msgr2=0x7f91c80b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.357+0000 7f91cec67700 1 --2- 172.21.15.84:0/1206386341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 0x7f91c80b08e0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f91b80099e0 tx=0x7f91b8009250 comp rx=0 tx=0).stop 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.357+0000 7f91cec67700 1 -- 172.21.15.84:0/1206386341 shutdown_connections 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.357+0000 7f91cec67700 1 --2- 172.21.15.84:0/1206386341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c806ed20 0x7f91c80b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.357+0000 7f91cec67700 1 --2- 172.21.15.84:0/1206386341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 0x7f91c80b08e0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.357+0000 7f91cec67700 1 -- 172.21.15.84:0/1206386341 >> 172.21.15.84:0/1206386341 conn(0x7f91c8068330 msgr2=0x7f91c8068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.357+0000 7f91cec67700 1 -- 172.21.15.84:0/1206386341 shutdown_connections 2023-10-06T03:02:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.357+0000 7f91cec67700 1 -- 172.21.15.84:0/1206386341 wait complete. 2023-10-06T03:02:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.358+0000 7f91cec67700 1 Processor -- start 2023-10-06T03:02:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.358+0000 7f91cec67700 1 -- start start 2023-10-06T03:02:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cec67700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91c806ed20 0x7f91c80b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cec67700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 0x7f91c8148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cec67700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c80aee20 0x7f91c8148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cec67700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8149000 con 0x7f91c806f0f0 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cec67700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8159f10 con 0x7f91c806ed20 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cec67700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8159300 con 0x7f91c80aee20 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 0x7f91c8148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 0x7f91c8148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43332/0 (socket says 172.21.15.84:43332) 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bffff700 1 -- 172.21.15.84:0/2372895591 learned_addr learned my addr 172.21.15.84:0/2372895591 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cca03700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91c806ed20 0x7f91c80b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cd204700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c80aee20 0x7f91c8148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bffff700 1 -- 172.21.15.84:0/2372895591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c80aee20 msgr2=0x7f91c8148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bffff700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c80aee20 0x7f91c8148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bffff700 1 -- 172.21.15.84:0/2372895591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91c806ed20 msgr2=0x7f91c80b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bffff700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91c806ed20 0x7f91c80b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bffff700 1 -- 172.21.15.84:0/2372895591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80094f0 con 0x7f91c806f0f0 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cd204700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c80aee20 0x7f91c8148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bffff700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 0x7f91c8148580 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009290 tx=0x7f91b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bcff9700 1 -- 172.21.15.84:0/2372895591 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b8011e20 con 0x7f91c806f0f0 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bcff9700 1 -- 172.21.15.84:0/2372895591 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b801f070 con 0x7f91c806f0f0 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c81595e0 con 0x7f91c806f0f0 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.359+0000 7f91bcff9700 1 -- 172.21.15.84:0/2372895591 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80266d0 con 0x7f91c806f0f0 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.360+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c8159ba0 con 0x7f91c806f0f0 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.360+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91c8064ad0 con 0x7f91c806f0f0 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.361+0000 7f91bcff9700 1 -- 172.21.15.84:0/2372895591 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91b801a430 con 0x7f91c806f0f0 2023-10-06T03:02:41.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.361+0000 7f91bcff9700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f91b4066f30 0x7f91b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.361+0000 7f91bcff9700 1 -- 172.21.15.84:0/2372895591 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f91b8021070 con 0x7f91c806f0f0 2023-10-06T03:02:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.361+0000 7f91cca03700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f91b4066f30 0x7f91b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.361+0000 7f91bcff9700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7f91b406d990 0x7f91b406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.361+0000 7f91bcff9700 1 -- 172.21.15.84:0/2372895591 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91b4070490 con 0x7f91b406d990 2023-10-06T03:02:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.361+0000 7f91bcff9700 1 -- 172.21.15.84:0/2372895591 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91b8086b90 con 0x7f91c806f0f0 2023-10-06T03:02:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.361+0000 7f91cd204700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7f91b406d990 0x7f91b406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.362+0000 7f91cca03700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f91b4066f30 0x7f91b40693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f91c4006f00 tx=0x7f91c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.362+0000 7f91cd204700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7f91b406d990 0x7f91b406fdc0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.362+0000 7f91bcff9700 1 -- 172.21.15.84:0/2372895591 <== osd.0 v2:172.21.15.84:6808/90632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f91b4070490 con 0x7f91b406d990 2023-10-06T03:02:41.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.376+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 --> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f91c804bb80 con 0x7f91b406d990 2023-10-06T03:02:41.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.376+0000 7f91bcff9700 1 -- 172.21.15.84:0/2372895591 <== osd.0 v2:172.21.15.84:6808/90632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f91c804bb80 con 0x7f91b406d990 2023-10-06T03:02:41.378 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:41.378 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:02:41.378 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.376+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7f91b406d990 msgr2=0x7f91b406fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.376+0000 7f91cec67700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6808/90632,v1:172.21.15.84:6809/90632] conn(0x7f91b406d990 0x7f91b406fdc0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.376+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f91b4066f30 msgr2=0x7f91b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.377+0000 7f91cec67700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f91b4066f30 0x7f91b40693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f91c4006f00 tx=0x7f91c4008040 comp rx=0 tx=0).stop 2023-10-06T03:02:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.377+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 msgr2=0x7f91c8148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.377+0000 7f91cec67700 1 --2- 172.21.15.84:0/2372895591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c806f0f0 0x7f91c8148580 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009290 tx=0x7f91b8017000 comp rx=0 tx=0).stop 2023-10-06T03:02:41.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.377+0000 7f91cd204700 1 -- 172.21.15.84:0/2372895591 reap_dead start 2023-10-06T03:02:41.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.377+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 shutdown_connections 2023-10-06T03:02:41.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.377+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 >> 172.21.15.84:0/2372895591 conn(0x7f91c8068330 msgr2=0x7f91c80cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:41.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.377+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 shutdown_connections 2023-10-06T03:02:41.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.377+0000 7f91cec67700 1 -- 172.21.15.84:0/2372895591 wait complete. 2023-10-06T03:02:41.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T03:02:41.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.501+0000 7f244c961700 1 Processor -- start 2023-10-06T03:02:41.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.502+0000 7f244c961700 1 -- start start 2023-10-06T03:02:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.502+0000 7f244c961700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f24480aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.502+0000 7f244c961700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f24480b49e0 0x7f24480aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.502+0000 7f244c961700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f24480b07a0 0x7f24480b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.502+0000 7f244c961700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480b0ca0 con 0x7f24480b07a0 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.502+0000 7f244c961700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480b0f80 con 0x7f24480b49e0 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.502+0000 7f244c961700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480b1260 con 0x7f24481595a0 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.502+0000 7f2446d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f24480b07a0 0x7f24480b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.502+0000 7f2446d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f24480b07a0 0x7f24480b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43338/0 (socket says 172.21.15.84:43338) 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2446d9d700 1 -- 172.21.15.84:0/2801212298 learned_addr learned my addr 172.21.15.84:0/2801212298 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f244659c700 1 --2- 172.21.15.84:0/2801212298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f24480aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f243dd9b700 1 --2- 172.21.15.84:0/2801212298 >> v2:172.21.15.131:3300/0 conn(0x7f24480b49e0 0x7f24480aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2446d9d700 1 -- 172.21.15.84:0/2801212298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 msgr2=0x7f24480aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2446d9d700 1 --2- 172.21.15.84:0/2801212298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f24480aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2446d9d700 1 -- 172.21.15.84:0/2801212298 >> v2:172.21.15.131:3300/0 conn(0x7f24480b49e0 msgr2=0x7f24480aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2446d9d700 1 --2- 172.21.15.84:0/2801212298 >> v2:172.21.15.131:3300/0 conn(0x7f24480b49e0 0x7f24480aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2446d9d700 1 -- 172.21.15.84:0/2801212298 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480b1540 con 0x7f24480b07a0 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f243dd9b700 1 --2- 172.21.15.84:0/2801212298 >> v2:172.21.15.131:3300/0 conn(0x7f24480b49e0 0x7f24480aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f244659c700 1 --2- 172.21.15.84:0/2801212298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f24480aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2446d9d700 1 --2- 172.21.15.84:0/2801212298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b07a0 0x7f24480b38d0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f2448089060 tx=0x7f2440009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3f96f812a435a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2445d9b700 1 -- 172.21.15.84:0/2801212298 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000e070 con 0x7f24480b07a0 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2445d9b700 1 -- 172.21.15.84:0/2801212298 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244000ba50 con 0x7f24480b07a0 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f2445d9b700 1 -- 172.21.15.84:0/2801212298 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24400092e0 con 0x7f24480b07a0 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f244c961700 1 -- 172.21.15.84:0/2801212298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b07a0 msgr2=0x7f24480b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.503+0000 7f244c961700 1 --2- 172.21.15.84:0/2801212298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b07a0 0x7f24480b38d0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f2448089060 tx=0x7f2440009840 comp rx=0 tx=0).stop 2023-10-06T03:02:41.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.504+0000 7f244c961700 1 -- 172.21.15.84:0/2801212298 shutdown_connections 2023-10-06T03:02:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.504+0000 7f244c961700 1 --2- 172.21.15.84:0/2801212298 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b07a0 0x7f24480b38d0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.504+0000 7f244c961700 1 --2- 172.21.15.84:0/2801212298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f24480aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.504+0000 7f244c961700 1 --2- 172.21.15.84:0/2801212298 >> v2:172.21.15.131:3300/0 conn(0x7f24480b49e0 0x7f24480aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.504+0000 7f244c961700 1 -- 172.21.15.84:0/2801212298 >> 172.21.15.84:0/2801212298 conn(0x7f2448099830 msgr2=0x7f244806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.504+0000 7f244c961700 1 -- 172.21.15.84:0/2801212298 shutdown_connections 2023-10-06T03:02:41.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.504+0000 7f244c961700 1 -- 172.21.15.84:0/2801212298 wait complete. 2023-10-06T03:02:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.505+0000 7f244c961700 1 Processor -- start 2023-10-06T03:02:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.505+0000 7f244c961700 1 -- start start 2023-10-06T03:02:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f244c961700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24480b07a0 0x7f2448157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f244c961700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b49e0 0x7f244809c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f244c961700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f244809c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f244c961700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244809af80 con 0x7f24480b49e0 2023-10-06T03:02:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f244c961700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244809a090 con 0x7f24480b07a0 2023-10-06T03:02:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f244c961700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244809a370 con 0x7f24481595a0 2023-10-06T03:02:41.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b49e0 0x7f244809c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243dd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b49e0 0x7f244809c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43342/0 (socket says 172.21.15.84:43342) 2023-10-06T03:02:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243dd9b700 1 -- 172.21.15.84:0/3506625187 learned_addr learned my addr 172.21.15.84:0/3506625187 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f244659c700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24480b07a0 0x7f2448157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f2446d9d700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f244809c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243dd9b700 1 -- 172.21.15.84:0/3506625187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 msgr2=0x7f244809c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243dd9b700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f244809c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243dd9b700 1 -- 172.21.15.84:0/3506625187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24480b07a0 msgr2=0x7f2448157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243dd9b700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24480b07a0 0x7f2448157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243dd9b700 1 -- 172.21.15.84:0/3506625187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440009ae0 con 0x7f24480b49e0 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f2446d9d700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f244809c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243dd9b700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b49e0 0x7f244809c0f0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f243000c880 tx=0x7f2430008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243effd700 1 -- 172.21.15.84:0/3506625187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430011600 con 0x7f24480b49e0 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243effd700 1 -- 172.21.15.84:0/3506625187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430011760 con 0x7f24480b49e0 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f243effd700 1 -- 172.21.15.84:0/3506625187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430011ae0 con 0x7f24480b49e0 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244809a650 con 0x7f24480b49e0 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.506+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244809ac10 con 0x7f24480b49e0 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.507+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2448064ad0 con 0x7f24480b49e0 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.508+0000 7f243effd700 1 -- 172.21.15.84:0/3506625187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2430010350 con 0x7f24480b49e0 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.508+0000 7f243effd700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2428066f30 0x7f24280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.508+0000 7f243effd700 1 -- 172.21.15.84:0/3506625187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f24300845d0 con 0x7f24480b49e0 2023-10-06T03:02:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.508+0000 7f244659c700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2428066f30 0x7f24280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.509+0000 7f244659c700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2428066f30 0x7f24280693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f244815edc0 tx=0x7f2438008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.512+0000 7f243effd700 1 -- 172.21.15.84:0/3506625187 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24300517f0 con 0x7f24480b49e0 2023-10-06T03:02:41.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.692+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f244809b0c0 con 0x7f2428066f30 2023-10-06T03:02:41.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.692+0000 7f243effd700 1 -- 172.21.15.84:0/3506625187 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f244809b0c0 con 0x7f2428066f30 2023-10-06T03:02:41.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2428066f30 msgr2=0x7f24280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2428066f30 0x7f24280693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f244815edc0 tx=0x7f2438008040 comp rx=0 tx=0).stop 2023-10-06T03:02:41.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b49e0 msgr2=0x7f244809c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b49e0 0x7f244809c0f0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f243000c880 tx=0x7f2430008040 comp rx=0 tx=0).stop 2023-10-06T03:02:41.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 shutdown_connections 2023-10-06T03:02:41.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2428066f30 0x7f24280693e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24480b07a0 0x7f2448157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24481595a0 0x7f244809c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 --2- 172.21.15.84:0/3506625187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24480b49e0 0x7f244809c0f0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 >> 172.21.15.84:0/3506625187 conn(0x7f2448099830 msgr2=0x7f24480ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:41.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 shutdown_connections 2023-10-06T03:02:41.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.694+0000 7f244c961700 1 -- 172.21.15.84:0/3506625187 wait complete. 2023-10-06T03:02:41.697 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T03:02:41.707 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T03:02:41.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:02:41.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.825+0000 7ff5755a2700 1 Processor -- start 2023-10-06T03:02:41.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.825+0000 7ff5755a2700 1 -- start start 2023-10-06T03:02:41.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.826+0000 7ff5755a2700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff57006ed20 0x7ff5700b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.826+0000 7ff5755a2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5700b2d20 con 0x7ff57006f0f0 2023-10-06T03:02:41.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.826+0000 7ff5755a2700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5700b0450 con 0x7ff5700aee20 2023-10-06T03:02:41.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.826+0000 7ff5755a2700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57006fb80 con 0x7ff57006ed20 2023-10-06T03:02:41.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.826+0000 7ff56e7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff57006f0f0 0x7ff5700b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38548/0 (socket says 172.21.15.84:38548) 2023-10-06T03:02:41.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.826+0000 7ff56e7fc700 1 -- 172.21.15.84:0/3085203092 learned_addr learned my addr 172.21.15.84:0/3085203092 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:41.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56effd700 1 --2- 172.21.15.84:0/3085203092 >> v2:172.21.15.131:3300/0 conn(0x7ff57006ed20 0x7ff5700b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684265044 0 0) 0x7ff5700b2d20 con 0x7ff57006f0f0 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff558003570 con 0x7ff57006f0f0 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 189308094 0 0) 0x7ff558003570 con 0x7ff57006f0f0 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 >> v2:172.21.15.131:3300/0 conn(0x7ff57006ed20 msgr2=0x7ff5700b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 --2- 172.21.15.84:0/3085203092 >> v2:172.21.15.131:3300/0 conn(0x7ff57006ed20 0x7ff5700b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 >> v1:172.21.15.131:6789/0 conn(0x7ff5700aee20 legacy=0x7ff5700af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700b2a40 con 0x7ff57006f0f0 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7ff564001470 con 0x7ff57006f0f0 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 >> v1:172.21.15.84:6789/0 conn(0x7ff57006f0f0 legacy=0x7ff5700b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff558003a60 0x7ff558003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff558004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5580051c0 0x7ff55800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800c0a0 con 0x7ff558004810 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800c210 con 0x7ff5580051c0 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800c3d0 con 0x7ff558003a60 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56e7fc700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff558004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56effd700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff558003a60 0x7ff558003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56f7fe700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5580051c0 0x7ff55800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56e7fc700 1 -- 172.21.15.84:0/3085203092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff558003a60 msgr2=0x7ff558003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56e7fc700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff558003a60 0x7ff558003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56e7fc700 1 -- 172.21.15.84:0/3085203092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5580051c0 msgr2=0x7ff55800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56e7fc700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5580051c0 0x7ff55800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56f7fe700 1 -- 172.21.15.84:0/3085203092 reap_dead start 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56e7fc700 1 -- 172.21.15.84:0/3085203092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558003570 con 0x7ff558004810 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.827+0000 7ff56effd700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff558003a60 0x7ff558003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff56e7fc700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff558004c80 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c3c0 tx=0x7ff564001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ba42732fdb137 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400cc90 con 0x7ff558004810 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400cdf0 con 0x7ff558004810 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff56dffb700 1 -- 172.21.15.84:0/3085203092 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564005b50 con 0x7ff558004810 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff5755a2700 1 -- 172.21.15.84:0/3085203092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 msgr2=0x7ff558004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff5755a2700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff558004c80 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c3c0 tx=0x7ff564001e50 comp rx=0 tx=0).stop 2023-10-06T03:02:41.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff5755a2700 1 -- 172.21.15.84:0/3085203092 shutdown_connections 2023-10-06T03:02:41.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff5755a2700 1 --2- 172.21.15.84:0/3085203092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff558004c80 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff5755a2700 1 -- 172.21.15.84:0/3085203092 >> 172.21.15.84:0/3085203092 conn(0x7ff570068330 msgr2=0x7ff570068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:41.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff5755a2700 1 -- 172.21.15.84:0/3085203092 shutdown_connections 2023-10-06T03:02:41.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.828+0000 7ff5755a2700 1 -- 172.21.15.84:0/3085203092 wait complete. 2023-10-06T03:02:41.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.829+0000 7ff5755a2700 1 Processor -- start 2023-10-06T03:02:41.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.829+0000 7ff5755a2700 1 -- start start 2023-10-06T03:02:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff5755a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff5700a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff5755a2700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5700a8420 0x7ff5700ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff5755a2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5701690a0 0x7ff5700aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff5755a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700a7380 con 0x7ff558004810 2023-10-06T03:02:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff5755a2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700a7660 con 0x7ff5701690a0 2023-10-06T03:02:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff5755a2700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700a7940 con 0x7ff5700a8420 2023-10-06T03:02:41.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff56effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff5700a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff56effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff5700a6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43356/0 (socket says 172.21.15.84:43356) 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff56effd700 1 -- 172.21.15.84:0/2316137329 learned_addr learned my addr 172.21.15.84:0/2316137329 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff56e7fc700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5700a8420 0x7ff5700ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.830+0000 7ff56f7fe700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5701690a0 0x7ff5700aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff56effd700 1 -- 172.21.15.84:0/2316137329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5700a8420 msgr2=0x7ff5700ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff56effd700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5700a8420 0x7ff5700ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff56effd700 1 -- 172.21.15.84:0/2316137329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5701690a0 msgr2=0x7ff5700aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff56effd700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5701690a0 0x7ff5700aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff56effd700 1 -- 172.21.15.84:0/2316137329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700a7c20 con 0x7ff558004810 2023-10-06T03:02:41.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff56effd700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff5700a6da0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7ff560011700 tx=0x7ff560008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff556ffd700 1 -- 172.21.15.84:0/2316137329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560015670 con 0x7ff558004810 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff556ffd700 1 -- 172.21.15.84:0/2316137329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5600157d0 con 0x7ff558004810 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5700a7f00 con 0x7ff558004810 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff556ffd700 1 -- 172.21.15.84:0/2316137329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560015b90 con 0x7ff558004810 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.831+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff570169540 con 0x7ff558004810 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.832+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5700a77d0 con 0x7ff558004810 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.832+0000 7ff556ffd700 1 -- 172.21.15.84:0/2316137329 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff560013410 con 0x7ff558004810 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.832+0000 7ff556ffd700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff55c066f30 0x7ff55c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.833+0000 7ff556ffd700 1 -- 172.21.15.84:0/2316137329 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7ff560084c90 con 0x7ff558004810 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.833+0000 7ff56e7fc700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff55c066f30 0x7ff55c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.833+0000 7ff556ffd700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7ff55c06d990 0x7ff55c06fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.833+0000 7ff556ffd700 1 -- 172.21.15.84:0/2316137329 --> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff55c070490 con 0x7ff55c06d990 2023-10-06T03:02:41.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.833+0000 7ff556ffd700 1 -- 172.21.15.84:0/2316137329 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff560087270 con 0x7ff558004810 2023-10-06T03:02:41.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.833+0000 7ff56f7fe700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7ff55c06d990 0x7ff55c06fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.833+0000 7ff56e7fc700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff55c066f30 0x7ff55c0693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff570156f00 tx=0x7ff564015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.833+0000 7ff56f7fe700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7ff55c06d990 0x7ff55c06fdc0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.834+0000 7ff556ffd700 1 -- 172.21.15.84:0/2316137329 <== osd.1 v2:172.21.15.84:6816/90643 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff55c070490 con 0x7ff55c06d990 2023-10-06T03:02:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 --> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5700a87f0 con 0x7ff55c06d990 2023-10-06T03:02:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff556ffd700 1 -- 172.21.15.84:0/2316137329 <== osd.1 v2:172.21.15.84:6816/90643 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff5700a87f0 con 0x7ff55c06d990 2023-10-06T03:02:41.849 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:41.850 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:02:41.850 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7ff55c06d990 msgr2=0x7ff55c06fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6816/90643,v1:172.21.15.84:6817/90643] conn(0x7ff55c06d990 0x7ff55c06fdc0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff55c066f30 msgr2=0x7ff55c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7ff55c066f30 0x7ff55c0693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff570156f00 tx=0x7ff564015000 comp rx=0 tx=0).stop 2023-10-06T03:02:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 msgr2=0x7ff5700a6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 --2- 172.21.15.84:0/2316137329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558004810 0x7ff5700a6da0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7ff560011700 tx=0x7ff560008040 comp rx=0 tx=0).stop 2023-10-06T03:02:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff56f7fe700 1 -- 172.21.15.84:0/2316137329 reap_dead start 2023-10-06T03:02:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 shutdown_connections 2023-10-06T03:02:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 >> 172.21.15.84:0/2316137329 conn(0x7ff570068330 msgr2=0x7ff5700cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 shutdown_connections 2023-10-06T03:02:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.848+0000 7ff5755a2700 1 -- 172.21.15.84:0/2316137329 wait complete. 2023-10-06T03:02:41.861 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T03:02:41.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.975+0000 7f9529772700 1 Processor -- start 2023-10-06T03:02:41.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.975+0000 7f9529772700 1 -- start start 2023-10-06T03:02:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.976+0000 7f9529772700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95240b49e0 0x7f95240aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.976+0000 7f9529772700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95240b0ca0 con 0x7f95240b07a0 2023-10-06T03:02:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.976+0000 7f9529772700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95240b0f80 con 0x7f95241595a0 2023-10-06T03:02:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.976+0000 7f9529772700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240b1260 con 0x7f95240b49e0 2023-10-06T03:02:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.976+0000 7f95237fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f95240b07a0 0x7f95240b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38556/0 (socket says 172.21.15.84:38556) 2023-10-06T03:02:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.976+0000 7f95237fe700 1 -- 172.21.15.84:0/2499593897 learned_addr learned my addr 172.21.15.84:0/2499593897 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f951a7fc700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95240b49e0 0x7f95240aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694125417 0 0) 0x7f95240b0ca0 con 0x7f95240b07a0 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9510003570 con 0x7f95240b07a0 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2243634039 0 0) 0x7f9510003570 con 0x7f95240b07a0 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95240b49e0 msgr2=0x7f95240aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95240b49e0 0x7f95240aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 >> v1:172.21.15.131:6789/0 conn(0x7f95241595a0 legacy=0x7f95240aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240b1540 con 0x7f95240b07a0 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7f951c0017f0 con 0x7f95240b07a0 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 >> v1:172.21.15.84:6789/0 conn(0x7f95240b07a0 legacy=0x7f95240b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9510003a90 0x7f9510003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95240b49e0 0x7f9510004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f95100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95240b1260 con 0x7f9510004d50 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951000bb70 con 0x7f9510003a90 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951000bd30 con 0x7f95240b49e0 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95237fe700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f95100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f9522ffd700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9510003a90 0x7f9510003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f951a7fc700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95240b49e0 0x7f9510004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95237fe700 1 -- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95240b49e0 msgr2=0x7f9510004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95237fe700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95240b49e0 0x7f9510004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95237fe700 1 -- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9510003a90 msgr2=0x7f9510003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95237fe700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9510003a90 0x7f9510003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f95237fe700 1 -- 172.21.15.84:0/2499593897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510003570 con 0x7f9510004d50 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.977+0000 7f951a7fc700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f95240b49e0 0x7f9510004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f95237fe700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f95100051c0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f951c00a930 tx=0x7f951c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac203eaa417d709 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0070d0 con 0x7f9510004d50 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c007230 con 0x7f9510004d50 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f95227fc700 1 -- 172.21.15.84:0/2499593897 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0075d0 con 0x7f9510004d50 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f9529772700 1 -- 172.21.15.84:0/2499593897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 msgr2=0x7f95100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f9529772700 1 --2- 172.21.15.84:0/2499593897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f95100051c0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f951c00a930 tx=0x7f951c0021d0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f95237fe700 1 -- 172.21.15.84:0/2499593897 reap_dead start 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f9529772700 1 -- 172.21.15.84:0/2499593897 shutdown_connections 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f9529772700 1 -- 172.21.15.84:0/2499593897 >> 172.21.15.84:0/2499593897 conn(0x7f9524099830 msgr2=0x7f952406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:41.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f9529772700 1 -- 172.21.15.84:0/2499593897 shutdown_connections 2023-10-06T03:02:41.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.978+0000 7f9529772700 1 -- 172.21.15.84:0/2499593897 wait complete. 2023-10-06T03:02:41.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9529772700 1 Processor -- start 2023-10-06T03:02:41.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9529772700 1 -- start start 2023-10-06T03:02:41.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9529772700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f9524156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9529772700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f952415e730 0x7f952409a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9529772700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f952409ad10 0x7f952415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9529772700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952409b3f0 con 0x7f9510004d50 2023-10-06T03:02:41.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9529772700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524156500 con 0x7f952415e730 2023-10-06T03:02:41.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9529772700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952409b190 con 0x7f952409ad10 2023-10-06T03:02:41.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9522ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f9524156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9522ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f9524156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43384/0 (socket says 172.21.15.84:43384) 2023-10-06T03:02:41.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f9522ffd700 1 -- 172.21.15.84:0/2836716782 learned_addr learned my addr 172.21.15.84:0/2836716782 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:41.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.980+0000 7f951a7fc700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f952415e730 0x7f952409a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f95237fe700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f952409ad10 0x7f952415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f9522ffd700 1 -- 172.21.15.84:0/2836716782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f952409ad10 msgr2=0x7f952415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f9522ffd700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f952409ad10 0x7f952415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f9522ffd700 1 -- 172.21.15.84:0/2836716782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f952415e730 msgr2=0x7f952409a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f9522ffd700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f952415e730 0x7f952409a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f9522ffd700 1 -- 172.21.15.84:0/2836716782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524155bd0 con 0x7f9510004d50 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f9522ffd700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f9524156990 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f95140029a0 tx=0x7f9514007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f951b7fe700 1 -- 172.21.15.84:0/2836716782 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400f8d0 con 0x7f9510004d50 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f951b7fe700 1 -- 172.21.15.84:0/2836716782 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400fa30 con 0x7f9510004d50 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9524155eb0 con 0x7f9510004d50 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f951b7fe700 1 -- 172.21.15.84:0/2836716782 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400fdd0 con 0x7f9510004d50 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.981+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952415c340 con 0x7f9510004d50 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.982+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95240aff70 con 0x7f9510004d50 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.982+0000 7f951b7fe700 1 -- 172.21.15.84:0/2836716782 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9514013600 con 0x7f9510004d50 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.983+0000 7f951b7fe700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9504066f30 0x7f95040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.983+0000 7f951b7fe700 1 -- 172.21.15.84:0/2836716782 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f9514084b00 con 0x7f9510004d50 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.983+0000 7f951a7fc700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9504066f30 0x7f95040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:41.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.983+0000 7f951a7fc700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9504066f30 0x7f95040693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f950c0093f0 tx=0x7f950c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:41.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:41.987+0000 7f951b7fe700 1 -- 172.21.15.84:0/2836716782 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9514051d20 con 0x7f9510004d50 2023-10-06T03:02:42.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.173+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9524064ad0 con 0x7f9504066f30 2023-10-06T03:02:42.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.173+0000 7f951b7fe700 1 -- 172.21.15.84:0/2836716782 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9524064ad0 con 0x7f9504066f30 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.175+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9504066f30 msgr2=0x7f95040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.175+0000 7f9529772700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9504066f30 0x7f95040693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f950c0093f0 tx=0x7f950c008040 comp rx=0 tx=0).stop 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.175+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 msgr2=0x7f9524156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.175+0000 7f9529772700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f9524156990 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f95140029a0 tx=0x7f9514007d80 comp rx=0 tx=0).stop 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.176+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 shutdown_connections 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.176+0000 7f9529772700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f9504066f30 0x7f95040693e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.176+0000 7f9529772700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f952409ad10 0x7f952415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.176+0000 7f9529772700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9510004d50 0x7f9524156990 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.176+0000 7f9529772700 1 --2- 172.21.15.84:0/2836716782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f952415e730 0x7f952409a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.176+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 >> 172.21.15.84:0/2836716782 conn(0x7f9524099830 msgr2=0x7f9524068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.176+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 shutdown_connections 2023-10-06T03:02:42.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.176+0000 7f9529772700 1 -- 172.21.15.84:0/2836716782 wait complete. 2023-10-06T03:02:42.179 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T03:02:42.189 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T03:02:42.189 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:02:42.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.306+0000 7f1fb359e700 1 Processor -- start 2023-10-06T03:02:42.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.306+0000 7f1fb359e700 1 -- start start 2023-10-06T03:02:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb359e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1fb41539d0 0x7f1fb415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb359e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb40cdc30 con 0x7f1fb40ccab0 2023-10-06T03:02:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb359e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb40cb500 con 0x7f1fb40d0a00 2023-10-06T03:02:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb359e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb415a8f0 con 0x7f1fb41539d0 2023-10-06T03:02:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1fb41539d0 0x7f1fb415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb1d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1fb40ccab0 0x7f1fb40d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38572/0 (socket says 172.21.15.84:38572) 2023-10-06T03:02:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb1d9b700 1 -- 172.21.15.84:0/616763005 learned_addr learned my addr 172.21.15.84:0/616763005 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb259c700 1 -- 172.21.15.84:0/616763005 >> v1:172.21.15.131:6789/0 conn(0x7f1fb40d0a00 legacy=0x7f1fb40ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb259c700 1 -- 172.21.15.84:0/616763005 >> v1:172.21.15.84:6789/0 conn(0x7f1fb40ccab0 legacy=0x7f1fb40d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb259c700 1 -- 172.21.15.84:0/616763005 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40cd020 con 0x7f1fb41539d0 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb159a700 1 -- 172.21.15.84:0/616763005 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257599974 0 0) 0x7f1fb40cdc30 con 0x7f1fb40ccab0 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.307+0000 7f1fb259c700 1 --2- 172.21.15.84:0/616763005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb41539d0 0x7f1fb415a3b0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40098e0 tx=0x7f1fa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafb7131779e7deb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb159a700 1 -- 172.21.15.84:0/616763005 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4009e80 con 0x7f1fb41539d0 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb159a700 1 -- 172.21.15.84:0/616763005 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa400b820 con 0x7f1fb41539d0 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb159a700 1 -- 172.21.15.84:0/616763005 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400bba0 con 0x7f1fb41539d0 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb359e700 1 -- 172.21.15.84:0/616763005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb41539d0 msgr2=0x7f1fb415a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb359e700 1 --2- 172.21.15.84:0/616763005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb41539d0 0x7f1fb415a3b0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40098e0 tx=0x7f1fa40091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb359e700 1 -- 172.21.15.84:0/616763005 shutdown_connections 2023-10-06T03:02:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb359e700 1 --2- 172.21.15.84:0/616763005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb41539d0 0x7f1fb415a3b0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb359e700 1 -- 172.21.15.84:0/616763005 >> 172.21.15.84:0/616763005 conn(0x7f1fb4068100 msgr2=0x7f1fb40684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb359e700 1 -- 172.21.15.84:0/616763005 shutdown_connections 2023-10-06T03:02:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.308+0000 7f1fb359e700 1 -- 172.21.15.84:0/616763005 wait complete. 2023-10-06T03:02:42.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.309+0000 7f1fb359e700 1 Processor -- start 2023-10-06T03:02:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.309+0000 7f1fb359e700 1 -- start start 2023-10-06T03:02:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb40ccab0 0x7f1fb41515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb40d0a00 0x7f1fb40c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb41539d0 0x7f1fb40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb359e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40b3d70 con 0x7f1fb40d0a00 2023-10-06T03:02:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40b31a0 con 0x7f1fb40ccab0 2023-10-06T03:02:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40b3440 con 0x7f1fb41539d0 2023-10-06T03:02:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb40d0a00 0x7f1fb40c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb1d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb40d0a00 0x7f1fb40c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43400/0 (socket says 172.21.15.84:43400) 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb1d9b700 1 -- 172.21.15.84:0/3435525548 learned_addr learned my addr 172.21.15.84:0/3435525548 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb259c700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb40ccab0 0x7f1fb41515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb2d9d700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb41539d0 0x7f1fb40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb1d9b700 1 -- 172.21.15.84:0/3435525548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb41539d0 msgr2=0x7f1fb40b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb1d9b700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1fb41539d0 0x7f1fb40b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb1d9b700 1 -- 172.21.15.84:0/3435525548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb40ccab0 msgr2=0x7f1fb41515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb1d9b700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb40ccab0 0x7f1fb41515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb1d9b700 1 -- 172.21.15.84:0/3435525548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4009420 con 0x7f1fb40d0a00 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.310+0000 7f1fb259c700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb40ccab0 0x7f1fb41515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.311+0000 7f1fb1d9b700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb40d0a00 0x7f1fb40c7cc0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c5b0 tx=0x7f1fa8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.311+0000 7f1fa27fc700 1 -- 172.21.15.84:0/3435525548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8005b30 con 0x7f1fb40d0a00 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.311+0000 7f1fa27fc700 1 -- 172.21.15.84:0/3435525548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8005c90 con 0x7f1fb40d0a00 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.311+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb40b3720 con 0x7f1fb40d0a00 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.311+0000 7f1fa27fc700 1 -- 172.21.15.84:0/3435525548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8007300 con 0x7f1fb40d0a00 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.311+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb40b4200 con 0x7f1fb40d0a00 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.311+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fb405f270 con 0x7f1fb40d0a00 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.312+0000 7f1fa27fc700 1 -- 172.21.15.84:0/3435525548 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fa801b3b0 con 0x7f1fb40d0a00 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.312+0000 7f1fa27fc700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1f94066f30 0x7f1f940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.313+0000 7f1fa27fc700 1 -- 172.21.15.84:0/3435525548 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f1fa8083b60 con 0x7f1fb40d0a00 2023-10-06T03:02:42.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.313+0000 7f1fb259c700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1f94066f30 0x7f1f940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.313+0000 7f1fa27fc700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7f1f9406d990 0x7f1f9406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.313+0000 7f1fa27fc700 1 -- 172.21.15.84:0/3435525548 --> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f94070490 con 0x7f1f9406d990 2023-10-06T03:02:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.313+0000 7f1fa27fc700 1 -- 172.21.15.84:0/3435525548 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fa8088220 con 0x7f1fb40d0a00 2023-10-06T03:02:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.313+0000 7f1fb2d9d700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7f1f9406d990 0x7f1f9406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.313+0000 7f1fb259c700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1f94066f30 0x7f1f940693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40030c0 tx=0x7f1fa4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.313+0000 7f1fb2d9d700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7f1f9406d990 0x7f1f9406fdc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.314+0000 7f1fa27fc700 1 -- 172.21.15.84:0/3435525548 <== osd.2 v2:172.21.15.84:6800/90631 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1f94070490 con 0x7f1f9406d990 2023-10-06T03:02:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.327+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 --> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1fb40cd300 con 0x7f1f9406d990 2023-10-06T03:02:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.327+0000 7f1fa27fc700 1 -- 172.21.15.84:0/3435525548 <== osd.2 v2:172.21.15.84:6800/90631 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1fb40cd300 con 0x7f1f9406d990 2023-10-06T03:02:42.329 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:42.329 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:02:42.329 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7f1f9406d990 msgr2=0x7f1f9406fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6800/90631,v1:172.21.15.84:6801/90631] conn(0x7f1f9406d990 0x7f1f9406fdc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1f94066f30 msgr2=0x7f1f940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f1f94066f30 0x7f1f940693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40030c0 tx=0x7f1fa4016000 comp rx=0 tx=0).stop 2023-10-06T03:02:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb40d0a00 msgr2=0x7f1fb40c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 --2- 172.21.15.84:0/3435525548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fb40d0a00 0x7f1fb40c7cc0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c5b0 tx=0x7f1fa8001070 comp rx=0 tx=0).stop 2023-10-06T03:02:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb2d9d700 1 -- 172.21.15.84:0/3435525548 reap_dead start 2023-10-06T03:02:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 shutdown_connections 2023-10-06T03:02:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 >> 172.21.15.84:0/3435525548 conn(0x7f1fb4068100 msgr2=0x7f1fb4158110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 shutdown_connections 2023-10-06T03:02:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.328+0000 7f1fb359e700 1 -- 172.21.15.84:0/3435525548 wait complete. 2023-10-06T03:02:42.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T03:02:42.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.455+0000 7fd25119f700 1 Processor -- start 2023-10-06T03:02:42.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.455+0000 7fd25119f700 1 -- start start 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.455+0000 7fd25119f700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd24c159480 0x7fd24c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.455+0000 7fd25119f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0cb7e0 con 0x7fd24c0b2140 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.455+0000 7fd25119f700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0b08a0 con 0x7fd24c0b3610 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.455+0000 7fd25119f700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c0cb190 con 0x7fd24c159480 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd25099e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd24c0b2140 0x7fd24c0b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54360/0 (socket says 172.21.15.84:54360) 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd25099e700 1 -- 172.21.15.84:0/2844985634 learned_addr learned my addr 172.21.15.84:0/2844985634 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24bfff700 1 --2- 172.21.15.84:0/2844985634 >> v2:172.21.15.131:3300/0 conn(0x7fd24c159480 0x7fd24c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24affd700 1 -- 172.21.15.84:0/2844985634 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963863507 0 0) 0x7fd24c0cb7e0 con 0x7fd24c0b2140 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24affd700 1 -- 172.21.15.84:0/2844985634 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd234003570 con 0x7fd24c0b2140 2023-10-06T03:02:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24bfff700 1 -- 172.21.15.84:0/2844985634 >> v1:172.21.15.131:6789/0 conn(0x7fd24c0b3610 legacy=0x7fd24c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24bfff700 1 -- 172.21.15.84:0/2844985634 >> v1:172.21.15.84:6789/0 conn(0x7fd24c0b2140 legacy=0x7fd24c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24affd700 1 -- 172.21.15.84:0/2844985634 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 487555407 0 0) 0x7fd234003570 con 0x7fd24c0b2140 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24bfff700 1 -- 172.21.15.84:0/2844985634 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0cb470 con 0x7fd24c159480 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24bfff700 1 --2- 172.21.15.84:0/2844985634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c159480 0x7fd24c0b30d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0098e0 tx=0x7fd23c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9868da9ab62ee9af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24affd700 1 -- 172.21.15.84:0/2844985634 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2440017f0 con 0x7fd24c159480 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24affd700 1 -- 172.21.15.84:0/2844985634 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c011420 con 0x7fd24c159480 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.456+0000 7fd24affd700 1 -- 172.21.15.84:0/2844985634 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0117c0 con 0x7fd24c159480 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.457+0000 7fd25119f700 1 -- 172.21.15.84:0/2844985634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c159480 msgr2=0x7fd24c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.457+0000 7fd25119f700 1 --2- 172.21.15.84:0/2844985634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c159480 0x7fd24c0b30d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0098e0 tx=0x7fd23c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.457+0000 7fd25119f700 1 -- 172.21.15.84:0/2844985634 shutdown_connections 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.457+0000 7fd25119f700 1 --2- 172.21.15.84:0/2844985634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c159480 0x7fd24c0b30d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.457+0000 7fd25119f700 1 -- 172.21.15.84:0/2844985634 >> 172.21.15.84:0/2844985634 conn(0x7fd24c06ed20 msgr2=0x7fd24c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.457+0000 7fd25119f700 1 -- 172.21.15.84:0/2844985634 shutdown_connections 2023-10-06T03:02:42.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.457+0000 7fd25119f700 1 -- 172.21.15.84:0/2844985634 wait complete. 2023-10-06T03:02:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.458+0000 7fd25119f700 1 Processor -- start 2023-10-06T03:02:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.458+0000 7fd25119f700 1 -- start start 2023-10-06T03:02:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd25119f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0b2140 0x7fd24c0c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd25119f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd24c0b3610 0x7fd24c147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd25119f700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd24c159480 0x7fd24c0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd25119f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0ceeb0 con 0x7fd24c0b3610 2023-10-06T03:02:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd25119f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0c7a90 con 0x7fd24c0b2140 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd25119f700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0cebd0 con 0x7fd24c159480 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd24b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd24c0b3610 0x7fd24c147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd24b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd24c0b3610 0x7fd24c147550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39640/0 (socket says 172.21.15.84:39640) 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd24b7fe700 1 -- 172.21.15.84:0/659604614 learned_addr learned my addr 172.21.15.84:0/659604614 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd24bfff700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0b2140 0x7fd24c0c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd24b7fe700 1 -- 172.21.15.84:0/659604614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd24c159480 msgr2=0x7fd24c0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd24b7fe700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd24c159480 0x7fd24c0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd24b7fe700 1 -- 172.21.15.84:0/659604614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0b2140 msgr2=0x7fd24c0c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd24b7fe700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0b2140 0x7fd24c0c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.459+0000 7fd24b7fe700 1 -- 172.21.15.84:0/659604614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c009420 con 0x7fd24c0b3610 2023-10-06T03:02:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.460+0000 7fd24b7fe700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd24c0b3610 0x7fd24c147550 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fd24000c790 tx=0x7fd240007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.460+0000 7fd233fff700 1 -- 172.21.15.84:0/659604614 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240012630 con 0x7fd24c0b3610 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.460+0000 7fd233fff700 1 -- 172.21.15.84:0/659604614 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2400127b0 con 0x7fd24c0b3610 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.460+0000 7fd233fff700 1 -- 172.21.15.84:0/659604614 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240012b70 con 0x7fd24c0b3610 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.460+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c0c7440 con 0x7fd24c0b3610 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.460+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c147a90 con 0x7fd24c0b3610 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.461+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c0c7c40 con 0x7fd24c0b3610 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.461+0000 7fd233fff700 1 -- 172.21.15.84:0/659604614 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd24001b400 con 0x7fd24c0b3610 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.461+0000 7fd233fff700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd238066f30 0x7fd2380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.462+0000 7fd24bfff700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd238066f30 0x7fd2380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.462+0000 7fd233fff700 1 -- 172.21.15.84:0/659604614 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fd240084080 con 0x7fd24c0b3610 2023-10-06T03:02:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.462+0000 7fd24bfff700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd238066f30 0x7fd2380693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00a010 tx=0x7fd23c016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.466+0000 7fd233fff700 1 -- 172.21.15.84:0/659604614 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd24c0c7c40 con 0x7fd24c0b3610 2023-10-06T03:02:42.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.648+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd24c0c7c00 con 0x7fd238066f30 2023-10-06T03:02:42.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.648+0000 7fd233fff700 1 -- 172.21.15.84:0/659604614 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd24c0c7c00 con 0x7fd238066f30 2023-10-06T03:02:42.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd238066f30 msgr2=0x7fd2380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd238066f30 0x7fd2380693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00a010 tx=0x7fd23c016000 comp rx=0 tx=0).stop 2023-10-06T03:02:42.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd24c0b3610 msgr2=0x7fd24c147550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd24c0b3610 0x7fd24c147550 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fd24000c790 tx=0x7fd240007f60 comp rx=0 tx=0).stop 2023-10-06T03:02:42.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 shutdown_connections 2023-10-06T03:02:42.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fd238066f30 0x7fd2380693e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0b2140 0x7fd24c0c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd24c159480 0x7fd24c0cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 --2- 172.21.15.84:0/659604614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd24c0b3610 0x7fd24c147550 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 >> 172.21.15.84:0/659604614 conn(0x7fd24c06ed20 msgr2=0x7fd24c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 shutdown_connections 2023-10-06T03:02:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.650+0000 7fd25119f700 1 -- 172.21.15.84:0/659604614 wait complete. 2023-10-06T03:02:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T03:02:42.664 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T03:02:42.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:02:42.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.780+0000 7f057951d700 1 Processor -- start 2023-10-06T03:02:42.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.780+0000 7f057951d700 1 -- start start 2023-10-06T03:02:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f057951d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f057406ed20 0x7f05740b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f057951d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406f0f0 0x7f05740b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f057951d700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05740b2d20 con 0x7f05740aee20 2023-10-06T03:02:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f057951d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057406fb80 con 0x7f057406ed20 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f057951d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740b0450 con 0x7f057406f0f0 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f0572ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f057406ed20 0x7f05740b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f0572ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f057406ed20 0x7f05740b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39650/0 (socket says 172.21.15.84:39650) 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f0572ffd700 1 -- 172.21.15.84:0/3561047401 learned_addr learned my addr 172.21.15.84:0/3561047401 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f056a7fc700 1 --2- 172.21.15.84:0/3561047401 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406f0f0 0x7f05740b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f0572ffd700 1 -- 172.21.15.84:0/3561047401 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406f0f0 msgr2=0x7f05740b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f0572ffd700 1 --2- 172.21.15.84:0/3561047401 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406f0f0 0x7f05740b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f0572ffd700 1 -- 172.21.15.84:0/3561047401 >> v1:172.21.15.131:6789/0 conn(0x7f05740aee20 legacy=0x7f05740af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f0572ffd700 1 -- 172.21.15.84:0/3561047401 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740b2a40 con 0x7f057406ed20 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.781+0000 7f0572ffd700 1 --2- 172.21.15.84:0/3561047401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057406ed20 0x7f05740b23a0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f05640099e0 tx=0x7f0564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ceee423bbfaf6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f05727fc700 1 -- 172.21.15.84:0/3561047401 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400b7e0 con 0x7f057406ed20 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f05727fc700 1 -- 172.21.15.84:0/3561047401 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056400b940 con 0x7f057406ed20 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f05727fc700 1 -- 172.21.15.84:0/3561047401 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400bce0 con 0x7f057406ed20 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f057951d700 1 -- 172.21.15.84:0/3561047401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057406ed20 msgr2=0x7f05740b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f057951d700 1 --2- 172.21.15.84:0/3561047401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057406ed20 0x7f05740b23a0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f05640099e0 tx=0x7f0564009250 comp rx=0 tx=0).stop 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f057951d700 1 -- 172.21.15.84:0/3561047401 shutdown_connections 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f057951d700 1 --2- 172.21.15.84:0/3561047401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057406ed20 0x7f05740b23a0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f057951d700 1 --2- 172.21.15.84:0/3561047401 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406f0f0 0x7f05740b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f057951d700 1 -- 172.21.15.84:0/3561047401 >> 172.21.15.84:0/3561047401 conn(0x7f0574068330 msgr2=0x7f0574068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f057951d700 1 -- 172.21.15.84:0/3561047401 shutdown_connections 2023-10-06T03:02:42.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.782+0000 7f057951d700 1 -- 172.21.15.84:0/3561047401 wait complete. 2023-10-06T03:02:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.783+0000 7f057951d700 1 Processor -- start 2023-10-06T03:02:42.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.783+0000 7f057951d700 1 -- start start 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f057951d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406ed20 0x7f05740a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f057951d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f057406f0f0 0x7f05741568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f057951d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05740aee20 0x7f05740ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f057951d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740ad040 con 0x7f05740aee20 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f057951d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740aa1b0 con 0x7f057406f0f0 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f057951d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740aebf0 con 0x7f057406ed20 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f05737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05740aee20 0x7f05740ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f05737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05740aee20 0x7f05740ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39656/0 (socket says 172.21.15.84:39656) 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f05737fe700 1 -- 172.21.15.84:0/3114518860 learned_addr learned my addr 172.21.15.84:0/3114518860 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f056a7fc700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f057406f0f0 0x7f05741568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.784+0000 7f0572ffd700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406ed20 0x7f05740a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f05737fe700 1 -- 172.21.15.84:0/3114518860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406ed20 msgr2=0x7f05740a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f05737fe700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406ed20 0x7f05740a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f05737fe700 1 -- 172.21.15.84:0/3114518860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f057406f0f0 msgr2=0x7f05741568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f05737fe700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f057406f0f0 0x7f05741568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f05737fe700 1 -- 172.21.15.84:0/3114518860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640094f0 con 0x7f05740aee20 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f0572ffd700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f057406ed20 0x7f05740a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f05737fe700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05740aee20 0x7f05740ae6b0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c930 tx=0x7f056c0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f056b7fe700 1 -- 172.21.15.84:0/3114518860 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c00ce70 con 0x7f05740aee20 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f056b7fe700 1 -- 172.21.15.84:0/3114518860 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c00a7e0 con 0x7f05740aee20 2023-10-06T03:02:42.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05740ac710 con 0x7f05740aee20 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f056b7fe700 1 -- 172.21.15.84:0/3114518860 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c00aba0 con 0x7f05740aee20 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.785+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05740accd0 con 0x7f05740aee20 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.786+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0574064ad0 con 0x7f05740aee20 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.786+0000 7f056b7fe700 1 -- 172.21.15.84:0/3114518860 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f056c012420 con 0x7f05740aee20 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.786+0000 7f056b7fe700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0554066f30 0x7f05540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.787+0000 7f056b7fe700 1 -- 172.21.15.84:0/3114518860 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f056c084950 con 0x7f05740aee20 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.787+0000 7f0572ffd700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0554066f30 0x7f05540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.787+0000 7f056b7fe700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f055406d990 0x7f055406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.787+0000 7f056b7fe700 1 -- 172.21.15.84:0/3114518860 --> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0554070490 con 0x7f055406d990 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.787+0000 7f056b7fe700 1 -- 172.21.15.84:0/3114518860 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f056c089240 con 0x7f05740aee20 2023-10-06T03:02:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.787+0000 7f056a7fc700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f055406d990 0x7f055406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.787+0000 7f0572ffd700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0554066f30 0x7f05540693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f05640099e0 tx=0x7f0564016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.787+0000 7f056a7fc700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f055406d990 0x7f055406fdc0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.788+0000 7f056b7fe700 1 -- 172.21.15.84:0/3114518860 <== osd.3 v2:172.21.15.84:6824/90648 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0554070490 con 0x7f055406d990 2023-10-06T03:02:42.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.801+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 --> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f057404bb80 con 0x7f055406d990 2023-10-06T03:02:42.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.801+0000 7f056b7fe700 1 -- 172.21.15.84:0/3114518860 <== osd.3 v2:172.21.15.84:6824/90648 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f057404bb80 con 0x7f055406d990 2023-10-06T03:02:42.803 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:42.803 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:02:42.803 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:42.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f055406d990 msgr2=0x7f055406fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6824/90648,v1:172.21.15.84:6825/90648] conn(0x7f055406d990 0x7f055406fdc0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0554066f30 msgr2=0x7f05540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f0554066f30 0x7f05540693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f05640099e0 tx=0x7f0564016000 comp rx=0 tx=0).stop 2023-10-06T03:02:42.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05740aee20 msgr2=0x7f05740ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 --2- 172.21.15.84:0/3114518860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05740aee20 0x7f05740ae6b0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c930 tx=0x7f056c0026e0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f05737fe700 1 -- 172.21.15.84:0/3114518860 reap_dead start 2023-10-06T03:02:42.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 shutdown_connections 2023-10-06T03:02:42.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 >> 172.21.15.84:0/3114518860 conn(0x7f0574068330 msgr2=0x7f05740ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 shutdown_connections 2023-10-06T03:02:42.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.802+0000 7f057951d700 1 -- 172.21.15.84:0/3114518860 wait complete. 2023-10-06T03:02:42.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T03:02:42.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.927+0000 7f3efcec1700 1 Processor -- start 2023-10-06T03:02:42.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.927+0000 7f3efcec1700 1 -- start start 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.928+0000 7f3efcec1700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3ef8067840 0x7f3ef806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.928+0000 7f3efcec1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 0x7f3ef80c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.928+0000 7f3efcec1700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef80cc880 con 0x7f3ef8067c10 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.928+0000 7f3efcec1700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80c4060 con 0x7f3ef8067840 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.928+0000 7f3efcec1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80ccb00 con 0x7f3ef80cad90 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.928+0000 7f3ef659c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3ef8067840 0x7f3ef806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3eedd9b700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 0x7f3ef80c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef6d9d700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3ef8067c10 0x7f3ef80c1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:34772/0 (socket says 172.21.15.84:34772) 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef659c700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3ef8067840 0x7f3ef806eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.84:35508/0 (socket says 172.21.15.84:35508) 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef6d9d700 1 -- 172.21.15.84:0/1903733741 learned_addr learned my addr 172.21.15.84:0/1903733741 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef659c700 1 -- 172.21.15.84:0/1903733741 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 msgr2=0x7f3ef80c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef659c700 1 --2- 172.21.15.84:0/1903733741 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 0x7f3ef80c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef659c700 1 -- 172.21.15.84:0/1903733741 >> v1:172.21.15.131:6789/0 conn(0x7f3ef8067c10 legacy=0x7f3ef80c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef659c700 1 -- 172.21.15.84:0/1903733741 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80ccde0 con 0x7f3ef8067840 2023-10-06T03:02:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef659c700 1 --2- 172.21.15.84:0/1903733741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ef8067840 0x7f3ef806eed0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80098e0 tx=0x7f3ee80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5500e6440851242 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef5d9b700 1 -- 172.21.15.84:0/1903733741 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800b640 con 0x7f3ef8067840 2023-10-06T03:02:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef5d9b700 1 -- 172.21.15.84:0/1903733741 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800b7a0 con 0x7f3ef8067840 2023-10-06T03:02:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.929+0000 7f3ef5d9b700 1 -- 172.21.15.84:0/1903733741 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800bb40 con 0x7f3ef8067840 2023-10-06T03:02:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.930+0000 7f3efcec1700 1 -- 172.21.15.84:0/1903733741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ef8067840 msgr2=0x7f3ef806eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.930+0000 7f3efcec1700 1 --2- 172.21.15.84:0/1903733741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ef8067840 0x7f3ef806eed0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80098e0 tx=0x7f3ee80091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.930+0000 7f3efcec1700 1 -- 172.21.15.84:0/1903733741 shutdown_connections 2023-10-06T03:02:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.930+0000 7f3efcec1700 1 --2- 172.21.15.84:0/1903733741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ef8067840 0x7f3ef806eed0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.930+0000 7f3efcec1700 1 --2- 172.21.15.84:0/1903733741 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 0x7f3ef80c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.930+0000 7f3efcec1700 1 -- 172.21.15.84:0/1903733741 >> 172.21.15.84:0/1903733741 conn(0x7f3ef80691c0 msgr2=0x7f3ef80cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.930+0000 7f3efcec1700 1 -- 172.21.15.84:0/1903733741 shutdown_connections 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.930+0000 7f3efcec1700 1 -- 172.21.15.84:0/1903733741 wait complete. 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.931+0000 7f3efcec1700 1 Processor -- start 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.931+0000 7f3efcec1700 1 -- start start 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3efcec1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ef8067840 0x7f3ef806b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3efcec1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ef8067c10 0x7f3ef806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3efcec1700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 0x7f3ef80c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3efcec1700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80c42b0 con 0x7f3ef8067840 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3efcec1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8155fc0 con 0x7f3ef8067c10 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3efcec1700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef815b680 con 0x7f3ef80cad90 2023-10-06T03:02:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ef8067840 0x7f3ef806b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ef8067840 0x7f3ef806b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39662/0 (socket says 172.21.15.84:39662) 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef659c700 1 -- 172.21.15.84:0/2498353340 learned_addr learned my addr 172.21.15.84:0/2498353340 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef6d9d700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 0x7f3ef80c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3eedd9b700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ef8067c10 0x7f3ef806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef659c700 1 -- 172.21.15.84:0/2498353340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 msgr2=0x7f3ef80c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef659c700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 0x7f3ef80c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef659c700 1 -- 172.21.15.84:0/2498353340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ef8067c10 msgr2=0x7f3ef806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef659c700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ef8067c10 0x7f3ef806bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef659c700 1 -- 172.21.15.84:0/2498353340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee8009420 con 0x7f3ef8067840 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.932+0000 7f3ef659c700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ef8067840 0x7f3ef806b6f0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80713d0 tx=0x7f3ee8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.933+0000 7f3eeeffd700 1 -- 172.21.15.84:0/2498353340 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee801bda0 con 0x7f3ef8067840 2023-10-06T03:02:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.933+0000 7f3eeeffd700 1 -- 172.21.15.84:0/2498353340 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8011420 con 0x7f3ef8067840 2023-10-06T03:02:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.933+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef815b960 con 0x7f3ef8067840 2023-10-06T03:02:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.933+0000 7f3eeeffd700 1 -- 172.21.15.84:0/2498353340 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80117e0 con 0x7f3ef8067840 2023-10-06T03:02:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.933+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef80c4500 con 0x7f3ef8067840 2023-10-06T03:02:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.933+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef815be00 con 0x7f3ef8067840 2023-10-06T03:02:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.934+0000 7f3eeeffd700 1 -- 172.21.15.84:0/2498353340 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ee8011b50 con 0x7f3ef8067840 2023-10-06T03:02:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.934+0000 7f3eeeffd700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ed8066f30 0x7f3ed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.934+0000 7f3eeeffd700 1 -- 172.21.15.84:0/2498353340 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f3ee8085c40 con 0x7f3ef8067840 2023-10-06T03:02:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.934+0000 7f3eedd9b700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ed8066f30 0x7f3ed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.935+0000 7f3eedd9b700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ed8066f30 0x7f3ed80693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3ee00093f0 tx=0x7f3ee0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:42.938+0000 7f3eeeffd700 1 -- 172.21.15.84:0/2498353340 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ef815be00 con 0x7f3ef8067840 2023-10-06T03:02:43.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.120+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ef815be00 con 0x7f3ed8066f30 2023-10-06T03:02:43.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.120+0000 7f3eeeffd700 1 -- 172.21.15.84:0/2498353340 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3ef815be00 con 0x7f3ed8066f30 2023-10-06T03:02:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ed8066f30 msgr2=0x7f3ed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ed8066f30 0x7f3ed80693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3ee00093f0 tx=0x7f3ee0008040 comp rx=0 tx=0).stop 2023-10-06T03:02:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ef8067840 msgr2=0x7f3ef806b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ef8067840 0x7f3ef806b6f0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80713d0 tx=0x7f3ee8017000 comp rx=0 tx=0).stop 2023-10-06T03:02:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 shutdown_connections 2023-10-06T03:02:43.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3ed8066f30 0x7f3ed80693e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3ef80cad90 0x7f3ef80c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ef8067840 0x7f3ef806b6f0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 --2- 172.21.15.84:0/2498353340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ef8067c10 0x7f3ef806bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 >> 172.21.15.84:0/2498353340 conn(0x7f3ef80691c0 msgr2=0x7f3ef80aa650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.122+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 shutdown_connections 2023-10-06T03:02:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.123+0000 7f3efcec1700 1 -- 172.21.15.84:0/2498353340 wait complete. 2023-10-06T03:02:43.125 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T03:02:43.136 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T03:02:43.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:02:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.253+0000 7fb87234a700 1 Processor -- start 2023-10-06T03:02:43.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.253+0000 7fb87234a700 1 -- start start 2023-10-06T03:02:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb87234a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb86c0b23a0 0x7fb86c0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb87234a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0aee20 0x7fb86c0af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb87234a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c0b2d20 con 0x7fb86c06ed20 2023-10-06T03:02:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb87234a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c06fb80 con 0x7fb86c0b23a0 2023-10-06T03:02:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb87234a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0b2840 con 0x7fb86c0aee20 2023-10-06T03:02:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb86b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb86c0b23a0 0x7fb86c0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb86b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb86c0b23a0 0x7fb86c0b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39674/0 (socket says 172.21.15.84:39674) 2023-10-06T03:02:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb86bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb86c06ed20 0x7fb86c06f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54368/0 (socket says 172.21.15.84:54368) 2023-10-06T03:02:43.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb86b7fe700 1 -- 172.21.15.84:0/3245770387 learned_addr learned my addr 172.21.15.84:0/3245770387 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb8708e7700 1 --2- 172.21.15.84:0/3245770387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0aee20 0x7fb86c0af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb86b7fe700 1 -- 172.21.15.84:0/3245770387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0aee20 msgr2=0x7fb86c0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb86b7fe700 1 --2- 172.21.15.84:0/3245770387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0aee20 0x7fb86c0af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.254+0000 7fb86b7fe700 1 -- 172.21.15.84:0/3245770387 >> v1:172.21.15.84:6789/0 conn(0x7fb86c06ed20 legacy=0x7fb86c06f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb86b7fe700 1 -- 172.21.15.84:0/3245770387 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c0b0450 con 0x7fb86c0b23a0 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb8708e7700 1 --2- 172.21.15.84:0/3245770387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0aee20 0x7fb86c0af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb86b7fe700 1 --2- 172.21.15.84:0/3245770387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0b23a0 0x7fb86c0b08e0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fb8600099e0 tx=0x7fb860009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ea3490f09bd791 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb86affd700 1 -- 172.21.15.84:0/3245770387 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000b820 con 0x7fb86c0b23a0 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb86affd700 1 -- 172.21.15.84:0/3245770387 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86000b980 con 0x7fb86c0b23a0 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb86affd700 1 -- 172.21.15.84:0/3245770387 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000bd20 con 0x7fb86c0b23a0 2023-10-06T03:02:43.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb87234a700 1 -- 172.21.15.84:0/3245770387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0b23a0 msgr2=0x7fb86c0b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb87234a700 1 --2- 172.21.15.84:0/3245770387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0b23a0 0x7fb86c0b08e0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fb8600099e0 tx=0x7fb860009250 comp rx=0 tx=0).stop 2023-10-06T03:02:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb87234a700 1 -- 172.21.15.84:0/3245770387 shutdown_connections 2023-10-06T03:02:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb87234a700 1 --2- 172.21.15.84:0/3245770387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0aee20 0x7fb86c0af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb87234a700 1 --2- 172.21.15.84:0/3245770387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0b23a0 0x7fb86c0b08e0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb87234a700 1 -- 172.21.15.84:0/3245770387 >> 172.21.15.84:0/3245770387 conn(0x7fb86c068330 msgr2=0x7fb86c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb87234a700 1 -- 172.21.15.84:0/3245770387 shutdown_connections 2023-10-06T03:02:43.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.255+0000 7fb87234a700 1 -- 172.21.15.84:0/3245770387 wait complete. 2023-10-06T03:02:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.256+0000 7fb87234a700 1 Processor -- start 2023-10-06T03:02:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb87234a700 1 -- start start 2023-10-06T03:02:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb87234a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb86c06ed20 0x7fb86c159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb87234a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0aee20 0x7fb86c0cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb87234a700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0b23a0 0x7fb86c15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb87234a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c16ac80 con 0x7fb86c0aee20 2023-10-06T03:02:43.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb87234a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c16a070 con 0x7fb86c06ed20 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb87234a700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c16a350 con 0x7fb86c0b23a0 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb86b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0aee20 0x7fb86c0cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb86b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0aee20 0x7fb86c0cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39676/0 (socket says 172.21.15.84:39676) 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.257+0000 7fb86b7fe700 1 -- 172.21.15.84:0/1346143068 learned_addr learned my addr 172.21.15.84:0/1346143068 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb86bfff700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb86c06ed20 0x7fb86c159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb8708e7700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0b23a0 0x7fb86c15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb86b7fe700 1 -- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0b23a0 msgr2=0x7fb86c15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb86b7fe700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb86c0b23a0 0x7fb86c15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb86b7fe700 1 -- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb86c06ed20 msgr2=0x7fb86c159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb86b7fe700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb86c06ed20 0x7fb86c159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb86b7fe700 1 -- 172.21.15.84:0/1346143068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600094f0 con 0x7fb86c0aee20 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb86b7fe700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0aee20 0x7fb86c0cf880 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fb8600090b0 tx=0x7fb860017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb853fff700 1 -- 172.21.15.84:0/1346143068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860026480 con 0x7fb86c0aee20 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb853fff700 1 -- 172.21.15.84:0/1346143068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86001f070 con 0x7fb86c0aee20 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb853fff700 1 -- 172.21.15.84:0/1346143068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860026850 con 0x7fb86c0aee20 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c16a630 con 0x7fb86c0aee20 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.258+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c0cfdc0 con 0x7fb86c0aee20 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.259+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb86c064ad0 con 0x7fb86c0aee20 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.259+0000 7fb853fff700 1 -- 172.21.15.84:0/1346143068 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb86001a430 con 0x7fb86c0aee20 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.260+0000 7fb853fff700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb858066f30 0x7fb8580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.260+0000 7fb853fff700 1 -- 172.21.15.84:0/1346143068 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fb860021070 con 0x7fb86c0aee20 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.260+0000 7fb86bfff700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb858066f30 0x7fb8580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.260+0000 7fb853fff700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7fb85806d990 0x7fb85806fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.260+0000 7fb853fff700 1 -- 172.21.15.84:0/1346143068 --> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb858070490 con 0x7fb85806d990 2023-10-06T03:02:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.260+0000 7fb853fff700 1 -- 172.21.15.84:0/1346143068 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb860086910 con 0x7fb86c0aee20 2023-10-06T03:02:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.260+0000 7fb86bfff700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb858066f30 0x7fb8580693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb85c007fd0 tx=0x7fb85c007d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.260+0000 7fb8708e7700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7fb85806d990 0x7fb85806fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.261+0000 7fb8708e7700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7fb85806d990 0x7fb85806fdc0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.261+0000 7fb853fff700 1 -- 172.21.15.84:0/1346143068 <== osd.4 v2:172.21.15.131:6800/90922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb858070490 con 0x7fb85806d990 2023-10-06T03:02:43.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 --> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb86c0cffb0 con 0x7fb85806d990 2023-10-06T03:02:43.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb853fff700 1 -- 172.21.15.84:0/1346143068 <== osd.4 v2:172.21.15.131:6800/90922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb86c0cffb0 con 0x7fb85806d990 2023-10-06T03:02:43.277 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:43.277 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:02:43.277 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7fb85806d990 msgr2=0x7fb85806fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb87234a700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.131:6800/90922,v1:172.21.15.131:6801/90922] conn(0x7fb85806d990 0x7fb85806fdc0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb858066f30 msgr2=0x7fb8580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb87234a700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fb858066f30 0x7fb8580693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb85c007fd0 tx=0x7fb85c007d70 comp rx=0 tx=0).stop 2023-10-06T03:02:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0aee20 msgr2=0x7fb86c0cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb87234a700 1 --2- 172.21.15.84:0/1346143068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb86c0aee20 0x7fb86c0cf880 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fb8600090b0 tx=0x7fb860017000 comp rx=0 tx=0).stop 2023-10-06T03:02:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb8708e7700 1 -- 172.21.15.84:0/1346143068 reap_dead start 2023-10-06T03:02:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 shutdown_connections 2023-10-06T03:02:43.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.275+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 >> 172.21.15.84:0/1346143068 conn(0x7fb86c068330 msgr2=0x7fb86c0ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.276+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 shutdown_connections 2023-10-06T03:02:43.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.276+0000 7fb87234a700 1 -- 172.21.15.84:0/1346143068 wait complete. 2023-10-06T03:02:43.288 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T03:02:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.402+0000 7f573a631700 1 Processor -- start 2023-10-06T03:02:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.403+0000 7f573a631700 1 -- start start 2023-10-06T03:02:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.403+0000 7f573a631700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f57341595c0 0x7f573406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.403+0000 7f573a631700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f573406e9e0 0x7f57340675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.403+0000 7f573a631700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57340cde70 con 0x7f5734159990 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.403+0000 7f573a631700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573406ef60 con 0x7f573406e9e0 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.403+0000 7f573a631700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573406f240 con 0x7f57341595c0 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f57337fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f573406e9e0 0x7f57340675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f57337fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f573406e9e0 0x7f57340675f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39678/0 (socket says 172.21.15.84:39678) 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f57337fe700 1 -- 172.21.15.84:0/1018334052 learned_addr learned my addr 172.21.15.84:0/1018334052 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f5733fff700 1 --2- 172.21.15.84:0/1018334052 >> v2:172.21.15.131:3300/0 conn(0x7f57341595c0 0x7f573406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f57337fe700 1 -- 172.21.15.84:0/1018334052 >> v2:172.21.15.131:3300/0 conn(0x7f57341595c0 msgr2=0x7f573406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f57337fe700 1 --2- 172.21.15.84:0/1018334052 >> v2:172.21.15.131:3300/0 conn(0x7f57341595c0 0x7f573406e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f57337fe700 1 -- 172.21.15.84:0/1018334052 >> v1:172.21.15.131:6789/0 conn(0x7f5734159990 legacy=0x7f573406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f57337fe700 1 -- 172.21.15.84:0/1018334052 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57340b0190 con 0x7f573406e9e0 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f57337fe700 1 --2- 172.21.15.84:0/1018334052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f573406e9e0 0x7f57340675f0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f5734070610 tx=0x7f5728009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8444f692861e9111 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f5732ffd700 1 -- 172.21.15.84:0/1018334052 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728009e70 con 0x7f573406e9e0 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f5732ffd700 1 -- 172.21.15.84:0/1018334052 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572800b860 con 0x7f573406e9e0 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.404+0000 7f5732ffd700 1 -- 172.21.15.84:0/1018334052 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800bc00 con 0x7f573406e9e0 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.405+0000 7f573a631700 1 -- 172.21.15.84:0/1018334052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f573406e9e0 msgr2=0x7f57340675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.405+0000 7f573a631700 1 --2- 172.21.15.84:0/1018334052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f573406e9e0 0x7f57340675f0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f5734070610 tx=0x7f5728009250 comp rx=0 tx=0).stop 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.405+0000 7f573a631700 1 -- 172.21.15.84:0/1018334052 shutdown_connections 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.405+0000 7f573a631700 1 --2- 172.21.15.84:0/1018334052 >> v2:172.21.15.131:3300/0 conn(0x7f57341595c0 0x7f573406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.405+0000 7f573a631700 1 --2- 172.21.15.84:0/1018334052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f573406e9e0 0x7f57340675f0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.405+0000 7f573a631700 1 -- 172.21.15.84:0/1018334052 >> 172.21.15.84:0/1018334052 conn(0x7f5734069180 msgr2=0x7f57340cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.405+0000 7f573a631700 1 -- 172.21.15.84:0/1018334052 shutdown_connections 2023-10-06T03:02:43.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.405+0000 7f573a631700 1 -- 172.21.15.84:0/1018334052 wait complete. 2023-10-06T03:02:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.406+0000 7f573a631700 1 Processor -- start 2023-10-06T03:02:43.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.406+0000 7f573a631700 1 -- start start 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f573a631700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f573406e9e0 0x7f5734169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f573a631700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57341595c0 0x7f57340c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f573a631700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5734159990 0x7f57340c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f573a631700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573415a880 con 0x7f57341595c0 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f573a631700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57340c2260 con 0x7f5734159990 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f573a631700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57340c2530 con 0x7f573406e9e0 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f57337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57341595c0 0x7f57340c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f57337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57341595c0 0x7f57340c17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39682/0 (socket says 172.21.15.84:39682) 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f57337fe700 1 -- 172.21.15.84:0/1472330063 learned_addr learned my addr 172.21.15.84:0/1472330063 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f5733fff700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f573406e9e0 0x7f5734169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.407+0000 7f5738bce700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5734159990 0x7f57340c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f57337fe700 1 -- 172.21.15.84:0/1472330063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f573406e9e0 msgr2=0x7f5734169030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f57337fe700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f573406e9e0 0x7f5734169030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f57337fe700 1 -- 172.21.15.84:0/1472330063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5734159990 msgr2=0x7f57340c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f57337fe700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5734159990 0x7f57340c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f57337fe700 1 -- 172.21.15.84:0/1472330063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280094f0 con 0x7f57341595c0 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f57337fe700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57341595c0 0x7f57340c17e0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f5734070340 tx=0x7f5728017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f571bfff700 1 -- 172.21.15.84:0/1472330063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800bbe0 con 0x7f57341595c0 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f571bfff700 1 -- 172.21.15.84:0/1472330063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5728011420 con 0x7f57341595c0 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f571bfff700 1 -- 172.21.15.84:0/1472330063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280117e0 con 0x7f57341595c0 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5734159f50 con 0x7f57341595c0 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.408+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573415a510 con 0x7f57341595c0 2023-10-06T03:02:43.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.409+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573415a9f0 con 0x7f57341595c0 2023-10-06T03:02:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.409+0000 7f571bfff700 1 -- 172.21.15.84:0/1472330063 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5728011bd0 con 0x7f57341595c0 2023-10-06T03:02:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.410+0000 7f571bfff700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5720066f30 0x7f57200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.410+0000 7f571bfff700 1 -- 172.21.15.84:0/1472330063 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f5728085e80 con 0x7f57341595c0 2023-10-06T03:02:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.410+0000 7f5733fff700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5720066f30 0x7f57200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.410+0000 7f5733fff700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5720066f30 0x7f57200693e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5724009db0 tx=0x7f57240091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.414+0000 7f571bfff700 1 -- 172.21.15.84:0/1472330063 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57280530a0 con 0x7f57341595c0 2023-10-06T03:02:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.596+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5734064ad0 con 0x7f5720066f30 2023-10-06T03:02:43.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.597+0000 7f571bfff700 1 -- 172.21.15.84:0/1472330063 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5734064ad0 con 0x7f5720066f30 2023-10-06T03:02:43.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5720066f30 msgr2=0x7f57200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5720066f30 0x7f57200693e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5724009db0 tx=0x7f57240091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57341595c0 msgr2=0x7f57340c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57341595c0 0x7f57340c17e0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f5734070340 tx=0x7f5728017000 comp rx=0 tx=0).stop 2023-10-06T03:02:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 shutdown_connections 2023-10-06T03:02:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f5720066f30 0x7f57200693e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5734159990 0x7f57340c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f573406e9e0 0x7f5734169030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 --2- 172.21.15.84:0/1472330063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57341595c0 0x7f57340c17e0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.598+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 >> 172.21.15.84:0/1472330063 conn(0x7f5734069180 msgr2=0x7f57340b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.599+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 shutdown_connections 2023-10-06T03:02:43.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.599+0000 7f573a631700 1 -- 172.21.15.84:0/1472330063 wait complete. 2023-10-06T03:02:43.602 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T03:02:43.612 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T03:02:43.612 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:02:43.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.728+0000 7f288490d700 1 Processor -- start 2023-10-06T03:02:43.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.728+0000 7f288490d700 1 -- start start 2023-10-06T03:02:43.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.728+0000 7f288490d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28801593a0 0x7f28800b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.728+0000 7f288490d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28800b4490 0x7f28800cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.728+0000 7f288490d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28800ab200 con 0x7f2880159770 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.728+0000 7f288490d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28800b1660 con 0x7f28800b4490 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.728+0000 7f288490d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28800b0a50 con 0x7f28801593a0 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287f59e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28800b4490 0x7f28800cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2880159770 0x7f28800b3d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54372/0 (socket says 172.21.15.84:54372) 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287659c700 1 -- 172.21.15.84:0/1437927332 learned_addr learned my addr 172.21.15.84:0/1437927332 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287ed9d700 1 --2- 172.21.15.84:0/1437927332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28801593a0 0x7f28800b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287f59e700 1 -- 172.21.15.84:0/1437927332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28801593a0 msgr2=0x7f28800b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287f59e700 1 --2- 172.21.15.84:0/1437927332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28801593a0 0x7f28800b5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287f59e700 1 -- 172.21.15.84:0/1437927332 >> v1:172.21.15.84:6789/0 conn(0x7f2880159770 legacy=0x7f28800b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287e59c700 1 -- 172.21.15.84:0/1437927332 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004393322 0 0) 0x7f2868001110 con 0x7f2880159770 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287f59e700 1 -- 172.21.15.84:0/1437927332 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28800b0d30 con 0x7f28800b4490 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287ed9d700 1 --2- 172.21.15.84:0/1437927332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28801593a0 0x7f28800b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287f59e700 1 --2- 172.21.15.84:0/1437927332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28800b4490 0x7f28800cf3b0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f2878009e60 tx=0x7f2878009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c1bfe1db358707 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287e59c700 1 -- 172.21.15.84:0/1437927332 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800e070 con 0x7f28800b4490 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287e59c700 1 -- 172.21.15.84:0/1437927332 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287800bcc0 con 0x7f28800b4490 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.729+0000 7f287e59c700 1 -- 172.21.15.84:0/1437927332 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878012680 con 0x7f28800b4490 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.730+0000 7f288490d700 1 -- 172.21.15.84:0/1437927332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28800b4490 msgr2=0x7f28800cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.730+0000 7f288490d700 1 --2- 172.21.15.84:0/1437927332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28800b4490 0x7f28800cf3b0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f2878009e60 tx=0x7f2878009780 comp rx=0 tx=0).stop 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.730+0000 7f288490d700 1 -- 172.21.15.84:0/1437927332 shutdown_connections 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.730+0000 7f288490d700 1 --2- 172.21.15.84:0/1437927332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28800b4490 0x7f28800cf3b0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.730+0000 7f288490d700 1 --2- 172.21.15.84:0/1437927332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28801593a0 0x7f28800b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.730+0000 7f288490d700 1 -- 172.21.15.84:0/1437927332 >> 172.21.15.84:0/1437927332 conn(0x7f28800995c0 msgr2=0x7f288006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.730+0000 7f288490d700 1 -- 172.21.15.84:0/1437927332 shutdown_connections 2023-10-06T03:02:43.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.730+0000 7f288490d700 1 -- 172.21.15.84:0/1437927332 wait complete. 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.731+0000 7f288490d700 1 Processor -- start 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.731+0000 7f288490d700 1 -- start start 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f288490d700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28800b4490 0x7f2880144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f288490d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28801593a0 0x7f28800adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f288490d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880159770 0x7f28800ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f288490d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2880145370 con 0x7f2880159770 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f288490d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2880145650 con 0x7f28801593a0 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f288490d700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2880145930 con 0x7f28800b4490 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287f59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880159770 0x7f28800ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287f59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880159770 0x7f28800ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39708/0 (socket says 172.21.15.84:39708) 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287f59e700 1 -- 172.21.15.84:0/1454374643 learned_addr learned my addr 172.21.15.84:0/1454374643 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287ed9d700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28800b4490 0x7f2880144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287659c700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28801593a0 0x7f28800adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287f59e700 1 -- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28800b4490 msgr2=0x7f2880144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287f59e700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f28800b4490 0x7f2880144a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287f59e700 1 -- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28801593a0 msgr2=0x7f28800adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287f59e700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28801593a0 0x7f28800adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287f59e700 1 -- 172.21.15.84:0/1454374643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878009a20 con 0x7f2880159770 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f287f59e700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880159770 0x7f28800ae200 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f288006fcb0 tx=0x7f2878019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f28777fe700 1 -- 172.21.15.84:0/1454374643 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287801d630 con 0x7f2880159770 2023-10-06T03:02:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f28777fe700 1 -- 172.21.15.84:0/1454374643 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287801d7b0 con 0x7f2880159770 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f28777fe700 1 -- 172.21.15.84:0/1454374643 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287801db70 con 0x7f2880159770 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2880145c10 con 0x7f2880159770 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.732+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2880144f80 con 0x7f2880159770 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.733+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f288005f270 con 0x7f2880159770 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.734+0000 7f28777fe700 1 -- 172.21.15.84:0/1454374643 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2878024070 con 0x7f2880159770 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.734+0000 7f28777fe700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2860066f30 0x7f28600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.734+0000 7f28777fe700 1 -- 172.21.15.84:0/1454374643 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f2878087310 con 0x7f2880159770 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.734+0000 7f287ed9d700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2860066f30 0x7f28600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.734+0000 7f28777fe700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f286006d990 0x7f286006fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.734+0000 7f28777fe700 1 -- 172.21.15.84:0/1454374643 --> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2860070490 con 0x7f286006d990 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.734+0000 7f28777fe700 1 -- 172.21.15.84:0/1454374643 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28780876e0 con 0x7f2880159770 2023-10-06T03:02:43.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.734+0000 7f287ed9d700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2860066f30 0x7f28600693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2870008a50 tx=0x7f2870008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.734+0000 7f287659c700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f286006d990 0x7f286006fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.735+0000 7f287659c700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f286006d990 0x7f286006fdc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.736+0000 7f28777fe700 1 -- 172.21.15.84:0/1454374643 <== osd.5 v2:172.21.15.131:6808/90923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2860070490 con 0x7f286006d990 2023-10-06T03:02:43.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.749+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 --> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f288015a7f0 con 0x7f286006d990 2023-10-06T03:02:43.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f28777fe700 1 -- 172.21.15.84:0/1454374643 <== osd.5 v2:172.21.15.131:6808/90923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f288015a7f0 con 0x7f286006d990 2023-10-06T03:02:43.751 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:43.751 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:02:43.752 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:43.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f286006d990 msgr2=0x7f286006fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.131:6808/90923,v1:172.21.15.131:6809/90923] conn(0x7f286006d990 0x7f286006fdc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2860066f30 msgr2=0x7f28600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f2860066f30 0x7f28600693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2870008a50 tx=0x7f2870008040 comp rx=0 tx=0).stop 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880159770 msgr2=0x7f28800ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 --2- 172.21.15.84:0/1454374643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880159770 0x7f28800ae200 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f288006fcb0 tx=0x7f2878019000 comp rx=0 tx=0).stop 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f287f59e700 1 -- 172.21.15.84:0/1454374643 reap_dead start 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 shutdown_connections 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 >> 172.21.15.84:0/1454374643 conn(0x7f28800995c0 msgr2=0x7f288009af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 shutdown_connections 2023-10-06T03:02:43.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.750+0000 7f288490d700 1 -- 172.21.15.84:0/1454374643 wait complete. 2023-10-06T03:02:43.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T03:02:43.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.877+0000 7f382359e700 1 Processor -- start 2023-10-06T03:02:43.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.877+0000 7f382359e700 1 -- start start 2023-10-06T03:02:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f382359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3824159480 0x7f38240b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f382359e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f38240b2140 0x7f38240b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f382359e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38240cb7e0 con 0x7f38240b3610 2023-10-06T03:02:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f382359e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38240b08a0 con 0x7f38240b2140 2023-10-06T03:02:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f382359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38240cb190 con 0x7f3824159480 2023-10-06T03:02:43.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f382259c700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3824159480 0x7f38240b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f3822d9d700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f38240b2140 0x7f38240b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f3819d9b700 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f38240b3610 0x7f38240cbc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.84:34792/0 (socket says 172.21.15.84:34792) 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f3819d9b700 1 -- 172.21.15.84:0/1768981671 learned_addr learned my addr 172.21.15.84:0/1768981671 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f3822d9d700 1 -- 172.21.15.84:0/1768981671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3824159480 msgr2=0x7f38240b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f3822d9d700 1 --2- 172.21.15.84:0/1768981671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3824159480 0x7f38240b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f3822d9d700 1 -- 172.21.15.84:0/1768981671 >> v1:172.21.15.131:6789/0 conn(0x7f38240b3610 legacy=0x7f38240cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.878+0000 7f3822d9d700 1 -- 172.21.15.84:0/1768981671 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38240cb470 con 0x7f38240b2140 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f3822d9d700 1 --2- 172.21.15.84:0/1768981671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38240b2140 0x7f38240b25c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f381c009e60 tx=0x7f381c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86328a76a778fef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f3821d9b700 1 -- 172.21.15.84:0/1768981671 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00e070 con 0x7f38240b2140 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f3821d9b700 1 -- 172.21.15.84:0/1768981671 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00bb60 con 0x7f38240b2140 2023-10-06T03:02:43.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f3821d9b700 1 -- 172.21.15.84:0/1768981671 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c012430 con 0x7f38240b2140 2023-10-06T03:02:43.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f382359e700 1 -- 172.21.15.84:0/1768981671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38240b2140 msgr2=0x7f38240b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f382359e700 1 --2- 172.21.15.84:0/1768981671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38240b2140 0x7f38240b25c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f381c009e60 tx=0x7f381c009780 comp rx=0 tx=0).stop 2023-10-06T03:02:43.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f382359e700 1 -- 172.21.15.84:0/1768981671 shutdown_connections 2023-10-06T03:02:43.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f382359e700 1 --2- 172.21.15.84:0/1768981671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38240b2140 0x7f38240b25c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f382359e700 1 --2- 172.21.15.84:0/1768981671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3824159480 0x7f38240b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f382359e700 1 -- 172.21.15.84:0/1768981671 >> 172.21.15.84:0/1768981671 conn(0x7f382406ed20 msgr2=0x7f382406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f382359e700 1 -- 172.21.15.84:0/1768981671 shutdown_connections 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.879+0000 7f382359e700 1 -- 172.21.15.84:0/1768981671 wait complete. 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.880+0000 7f382359e700 1 Processor -- start 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f382359e700 1 -- start start 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f382359e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38240b2140 0x7f3824153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f382359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38240b3610 0x7f3824169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f382359e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3824159480 0x7f38240b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f382359e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824154510 con 0x7f3824159480 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f382359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38240c53a0 con 0x7f38240b3610 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f382359e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38240c4a70 con 0x7f38240b2140 2023-10-06T03:02:43.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f3822d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3824159480 0x7f38240b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f3822d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3824159480 0x7f38240b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39720/0 (socket says 172.21.15.84:39720) 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f3822d9d700 1 -- 172.21.15.84:0/3076681575 learned_addr learned my addr 172.21.15.84:0/3076681575 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f382259c700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38240b2140 0x7f3824153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.881+0000 7f3819d9b700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38240b3610 0x7f3824169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f3822d9d700 1 -- 172.21.15.84:0/3076681575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38240b2140 msgr2=0x7f3824153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f3822d9d700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38240b2140 0x7f3824153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f3822d9d700 1 -- 172.21.15.84:0/3076681575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38240b3610 msgr2=0x7f3824169400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f3822d9d700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38240b3610 0x7f3824169400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f3822d9d700 1 -- 172.21.15.84:0/3076681575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c009a20 con 0x7f3824159480 2023-10-06T03:02:43.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f3822d9d700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3824159480 0x7f38240b4490 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f3824069190 tx=0x7f381c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f381affd700 1 -- 172.21.15.84:0/3076681575 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c012ea0 con 0x7f3824159480 2023-10-06T03:02:43.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f381affd700 1 -- 172.21.15.84:0/3076681575 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c027470 con 0x7f3824159480 2023-10-06T03:02:43.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38240c4d50 con 0x7f3824159480 2023-10-06T03:02:43.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f381affd700 1 -- 172.21.15.84:0/3076681575 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c027850 con 0x7f3824159480 2023-10-06T03:02:43.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.882+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3824153f30 con 0x7f3824159480 2023-10-06T03:02:43.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.883+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3824068c60 con 0x7f3824159480 2023-10-06T03:02:43.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.883+0000 7f381affd700 1 -- 172.21.15.84:0/3076681575 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f381c024070 con 0x7f3824159480 2023-10-06T03:02:43.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.884+0000 7f381affd700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3804066f30 0x7f38040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.884+0000 7f381affd700 1 -- 172.21.15.84:0/3076681575 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f381c086f50 con 0x7f3824159480 2023-10-06T03:02:43.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.884+0000 7f382259c700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3804066f30 0x7f38040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.884+0000 7f382259c700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3804066f30 0x7f38040693e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f38240b5bf0 tx=0x7f38140091a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:43.888+0000 7f381affd700 1 -- 172.21.15.84:0/3076681575 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f381c054170 con 0x7f3824159480 2023-10-06T03:02:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.069+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f38240b2b00 con 0x7f3804066f30 2023-10-06T03:02:44.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.070+0000 7f381affd700 1 -- 172.21.15.84:0/3076681575 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38240b2b00 con 0x7f3804066f30 2023-10-06T03:02:44.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3804066f30 msgr2=0x7f38040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3804066f30 0x7f38040693e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f38240b5bf0 tx=0x7f38140091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3824159480 msgr2=0x7f38240b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3824159480 0x7f38240b4490 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f3824069190 tx=0x7f381c019000 comp rx=0 tx=0).stop 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 shutdown_connections 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f3804066f30 0x7f38040693e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3824159480 0x7f38240b4490 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38240b2140 0x7f3824153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 --2- 172.21.15.84:0/3076681575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38240b3610 0x7f3824169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 >> 172.21.15.84:0/3076681575 conn(0x7f382406ed20 msgr2=0x7f38240af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 shutdown_connections 2023-10-06T03:02:44.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.072+0000 7f382359e700 1 -- 172.21.15.84:0/3076681575 wait complete. 2023-10-06T03:02:44.075 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T03:02:44.085 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T03:02:44.085 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:02:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.202+0000 7f65c3fff700 1 Processor -- start 2023-10-06T03:02:44.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.202+0000 7f65c3fff700 1 -- start start 2023-10-06T03:02:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65c41539d0 0x7f65c415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c3fff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f65c40ccab0 0x7f65c40d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65c40d0830 0x7f65c415cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c3fff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c40cdc30 con 0x7f65c41539d0 2023-10-06T03:02:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c3fff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c40d0c70 con 0x7f65c40ccab0 2023-10-06T03:02:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c3fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c40cb500 con 0x7f65c40d0830 2023-10-06T03:02:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65c41539d0 0x7f65c415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65c41539d0 0x7f65c415a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39734/0 (socket says 172.21.15.84:39734) 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c2ffd700 1 -- 172.21.15.84:0/1149628820 learned_addr learned my addr 172.21.15.84:0/1149628820 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c37fe700 1 --2- 172.21.15.84:0/1149628820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65c40d0830 0x7f65c415cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c2ffd700 1 -- 172.21.15.84:0/1149628820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65c40d0830 msgr2=0x7f65c415cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65ba7fc700 1 --2- 172.21.15.84:0/1149628820 >> v2:172.21.15.131:3300/0 conn(0x7f65c40ccab0 0x7f65c40d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c2ffd700 1 --2- 172.21.15.84:0/1149628820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65c40d0830 0x7f65c415cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c2ffd700 1 -- 172.21.15.84:0/1149628820 >> v2:172.21.15.131:3300/0 conn(0x7f65c40ccab0 msgr2=0x7f65c40d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c2ffd700 1 --2- 172.21.15.84:0/1149628820 >> v2:172.21.15.131:3300/0 conn(0x7f65c40ccab0 0x7f65c40d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65c2ffd700 1 -- 172.21.15.84:0/1149628820 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c415a8f0 con 0x7f65c41539d0 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.203+0000 7f65ba7fc700 1 --2- 172.21.15.84:0/1149628820 >> v2:172.21.15.131:3300/0 conn(0x7f65c40ccab0 0x7f65c40d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c2ffd700 1 --2- 172.21.15.84:0/1149628820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c41539d0 0x7f65c415a3b0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f65c40d0290 tx=0x7f65b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42065dd05803e6d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c27fc700 1 -- 172.21.15.84:0/1149628820 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400b860 con 0x7f65c41539d0 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c27fc700 1 -- 172.21.15.84:0/1149628820 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b400b9c0 con 0x7f65c41539d0 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c27fc700 1 -- 172.21.15.84:0/1149628820 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400bd60 con 0x7f65c41539d0 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c3fff700 1 -- 172.21.15.84:0/1149628820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c41539d0 msgr2=0x7f65c415a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c3fff700 1 --2- 172.21.15.84:0/1149628820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c41539d0 0x7f65c415a3b0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f65c40d0290 tx=0x7f65b4009250 comp rx=0 tx=0).stop 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c3fff700 1 -- 172.21.15.84:0/1149628820 shutdown_connections 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c3fff700 1 --2- 172.21.15.84:0/1149628820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65c40d0830 0x7f65c415cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c3fff700 1 --2- 172.21.15.84:0/1149628820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c41539d0 0x7f65c415a3b0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c3fff700 1 --2- 172.21.15.84:0/1149628820 >> v2:172.21.15.131:3300/0 conn(0x7f65c40ccab0 0x7f65c40d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c3fff700 1 -- 172.21.15.84:0/1149628820 >> 172.21.15.84:0/1149628820 conn(0x7f65c4068100 msgr2=0x7f65c40684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c3fff700 1 -- 172.21.15.84:0/1149628820 shutdown_connections 2023-10-06T03:02:44.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.204+0000 7f65c3fff700 1 -- 172.21.15.84:0/1149628820 wait complete. 2023-10-06T03:02:44.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65c3fff700 1 Processor -- start 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65c3fff700 1 -- start start 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65c3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65c40ccab0 0x7f65c4153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65c3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c40d0830 0x7f65c40b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65c3fff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65c41539d0 0x7f65c4151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65c3fff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c40ca670 con 0x7f65c40d0830 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65c3fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c40b4fe0 con 0x7f65c40ccab0 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65c3fff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c40c9e10 con 0x7f65c41539d0 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65ba7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c40d0830 0x7f65c40b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65ba7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c40d0830 0x7f65c40b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39736/0 (socket says 172.21.15.84:39736) 2023-10-06T03:02:44.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.206+0000 7f65ba7fc700 1 -- 172.21.15.84:0/3021861522 learned_addr learned my addr 172.21.15.84:0/3021861522 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65c2ffd700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65c40ccab0 0x7f65c4153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65c37fe700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65c41539d0 0x7f65c4151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65ba7fc700 1 -- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65c41539d0 msgr2=0x7f65c4151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65ba7fc700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f65c41539d0 0x7f65c4151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65ba7fc700 1 -- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65c40ccab0 msgr2=0x7f65c4153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65ba7fc700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65c40ccab0 0x7f65c4153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65ba7fc700 1 -- 172.21.15.84:0/3021861522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40094f0 con 0x7f65c40d0830 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65ba7fc700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c40d0830 0x7f65c40b43b0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c880 tx=0x7f65ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65bb7fe700 1 -- 172.21.15.84:0/3021861522 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac011600 con 0x7f65c40d0830 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65bb7fe700 1 -- 172.21.15.84:0/3021861522 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac011760 con 0x7f65c40d0830 2023-10-06T03:02:44.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c40b4cb0 con 0x7f65c40d0830 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65bb7fe700 1 -- 172.21.15.84:0/3021861522 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac011b00 con 0x7f65c40d0830 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.207+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c40ca0b0 con 0x7f65c40d0830 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.208+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65c405f270 con 0x7f65c40d0830 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.208+0000 7f65bb7fe700 1 -- 172.21.15.84:0/3021861522 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65ac018350 con 0x7f65c40d0830 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.209+0000 7f65bb7fe700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f65a4066f30 0x7f65a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.209+0000 7f65c2ffd700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f65a4066f30 0x7f65a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.209+0000 7f65bb7fe700 1 -- 172.21.15.84:0/3021861522 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f65ac084340 con 0x7f65c40d0830 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.209+0000 7f65bb7fe700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f65a406d990 0x7f65a406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.209+0000 7f65bb7fe700 1 -- 172.21.15.84:0/3021861522 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65a4070490 con 0x7f65a406d990 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.209+0000 7f65bb7fe700 1 -- 172.21.15.84:0/3021861522 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65ac086980 con 0x7f65c40d0830 2023-10-06T03:02:44.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.209+0000 7f65c2ffd700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f65a4066f30 0x7f65a40693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f65c40d0290 tx=0x7f65b4017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.209+0000 7f65c37fe700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f65a406d990 0x7f65a406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.209+0000 7f65c37fe700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f65a406d990 0x7f65a406fdc0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.210+0000 7f65bb7fe700 1 -- 172.21.15.84:0/3021861522 <== osd.6 v2:172.21.15.131:6824/90967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f65a4070490 con 0x7f65a406d990 2023-10-06T03:02:44.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.224+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 --> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f65c40cd020 con 0x7f65a406d990 2023-10-06T03:02:44.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.224+0000 7f65bb7fe700 1 -- 172.21.15.84:0/3021861522 <== osd.6 v2:172.21.15.131:6824/90967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f65c40cd020 con 0x7f65a406d990 2023-10-06T03:02:44.226 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:44.226 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:02:44.226 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f65a406d990 msgr2=0x7f65a406fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.131:6824/90967,v1:172.21.15.131:6825/90967] conn(0x7f65a406d990 0x7f65a406fdc0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f65a4066f30 msgr2=0x7f65a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f65a4066f30 0x7f65a40693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f65c40d0290 tx=0x7f65b4017000 comp rx=0 tx=0).stop 2023-10-06T03:02:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c40d0830 msgr2=0x7f65c40b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 --2- 172.21.15.84:0/3021861522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65c40d0830 0x7f65c40b43b0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c880 tx=0x7f65ac008040 comp rx=0 tx=0).stop 2023-10-06T03:02:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c37fe700 1 -- 172.21.15.84:0/3021861522 reap_dead start 2023-10-06T03:02:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 shutdown_connections 2023-10-06T03:02:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 >> 172.21.15.84:0/3021861522 conn(0x7f65c4068100 msgr2=0x7f65c4069860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 shutdown_connections 2023-10-06T03:02:44.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.225+0000 7f65c3fff700 1 -- 172.21.15.84:0/3021861522 wait complete. 2023-10-06T03:02:44.238 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T03:02:44.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.352+0000 7f79d8f59700 1 Processor -- start 2023-10-06T03:02:44.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.352+0000 7f79d8f59700 1 -- start start 2023-10-06T03:02:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d8f59700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79d41595a0 0x7f79d40aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d8f59700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79d40b49e0 0x7f79d40aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d8f59700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d40b0ca0 con 0x7f79d40b07a0 2023-10-06T03:02:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d8f59700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d40b0f80 con 0x7f79d41595a0 2023-10-06T03:02:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d8f59700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40b1260 con 0x7f79d40b49e0 2023-10-06T03:02:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d259c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79d41595a0 0x7f79d40aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d2d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f79d40b07a0 0x7f79d40b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54382/0 (socket says 172.21.15.84:54382) 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d2d9d700 1 -- 172.21.15.84:0/3959067028 learned_addr learned my addr 172.21.15.84:0/3959067028 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d259c700 1 -- 172.21.15.84:0/3959067028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79d40b49e0 msgr2=0x7f79d40aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d259c700 1 --2- 172.21.15.84:0/3959067028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79d40b49e0 0x7f79d40aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d259c700 1 -- 172.21.15.84:0/3959067028 >> v1:172.21.15.84:6789/0 conn(0x7f79d40b07a0 legacy=0x7f79d40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d1d9b700 1 -- 172.21.15.84:0/3959067028 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428545457 0 0) 0x7f79d40b0ca0 con 0x7f79d40b07a0 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.353+0000 7f79d259c700 1 -- 172.21.15.84:0/3959067028 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40b1540 con 0x7f79d41595a0 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d259c700 1 --2- 172.21.15.84:0/3959067028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d41595a0 0x7f79d40aa570 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f79c40098d0 tx=0x7f79c4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52938beedf431b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d1d9b700 1 -- 172.21.15.84:0/3959067028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4009e70 con 0x7f79d41595a0 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d1d9b700 1 -- 172.21.15.84:0/3959067028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c4005c10 con 0x7f79d41595a0 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d1d9b700 1 -- 172.21.15.84:0/3959067028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400b650 con 0x7f79d41595a0 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d8f59700 1 -- 172.21.15.84:0/3959067028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d41595a0 msgr2=0x7f79d40aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d8f59700 1 --2- 172.21.15.84:0/3959067028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d41595a0 0x7f79d40aa570 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f79c40098d0 tx=0x7f79c4009120 comp rx=0 tx=0).stop 2023-10-06T03:02:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d8f59700 1 -- 172.21.15.84:0/3959067028 shutdown_connections 2023-10-06T03:02:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d8f59700 1 --2- 172.21.15.84:0/3959067028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d41595a0 0x7f79d40aa570 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d8f59700 1 --2- 172.21.15.84:0/3959067028 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79d40b49e0 0x7f79d40aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d8f59700 1 -- 172.21.15.84:0/3959067028 >> 172.21.15.84:0/3959067028 conn(0x7f79d4099830 msgr2=0x7f79d406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d8f59700 1 -- 172.21.15.84:0/3959067028 shutdown_connections 2023-10-06T03:02:44.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.354+0000 7f79d8f59700 1 -- 172.21.15.84:0/3959067028 wait complete. 2023-10-06T03:02:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.355+0000 7f79d8f59700 1 Processor -- start 2023-10-06T03:02:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79d8f59700 1 -- start start 2023-10-06T03:02:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79d8f59700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79d40b07a0 0x7f79d414a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79d8f59700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d40b49e0 0x7f79d409d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79d8f59700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d41595a0 0x7f79d40ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79d8f59700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d415a940 con 0x7f79d40b49e0 2023-10-06T03:02:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79d8f59700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4159d30 con 0x7f79d41595a0 2023-10-06T03:02:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79d8f59700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d415a010 con 0x7f79d40b07a0 2023-10-06T03:02:44.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d40b49e0 0x7f79d409d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d40b49e0 0x7f79d409d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39758/0 (socket says 172.21.15.84:39758) 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79c9d9b700 1 -- 172.21.15.84:0/2039235025 learned_addr learned my addr 172.21.15.84:0/2039235025 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79d259c700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79d40b07a0 0x7f79d414a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.356+0000 7f79d2d9d700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d41595a0 0x7f79d40ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79c9d9b700 1 -- 172.21.15.84:0/2039235025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79d40b07a0 msgr2=0x7f79d414a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79c9d9b700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79d40b07a0 0x7f79d414a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79c9d9b700 1 -- 172.21.15.84:0/2039235025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d41595a0 msgr2=0x7f79d40ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79c9d9b700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d41595a0 0x7f79d40ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79c9d9b700 1 -- 172.21.15.84:0/2039235025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40093c0 con 0x7f79d40b49e0 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79d2d9d700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d41595a0 0x7f79d40ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:44.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79c9d9b700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d40b49e0 0x7f79d409d7b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00b810 tx=0x7f79bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79caffd700 1 -- 172.21.15.84:0/2039235025 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00f510 con 0x7f79d40b49e0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79caffd700 1 -- 172.21.15.84:0/2039235025 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00f690 con 0x7f79d40b49e0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d415a2f0 con 0x7f79d40b49e0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79caffd700 1 -- 172.21.15.84:0/2039235025 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00fa50 con 0x7f79d40b49e0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.357+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d414ad20 con 0x7f79d40b49e0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.358+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d4064ad0 con 0x7f79d40b49e0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.358+0000 7f79caffd700 1 -- 172.21.15.84:0/2039235025 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79bc01a400 con 0x7f79d40b49e0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.359+0000 7f79caffd700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79b4066f30 0x7f79b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.359+0000 7f79caffd700 1 -- 172.21.15.84:0/2039235025 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f79bc0840e0 con 0x7f79d40b49e0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.359+0000 7f79d259c700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79b4066f30 0x7f79b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.359+0000 7f79d259c700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79b4066f30 0x7f79b40693e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009160 tx=0x7f79c4016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.363+0000 7f79caffd700 1 -- 172.21.15.84:0/2039235025 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79bc051380 con 0x7f79d40b49e0 2023-10-06T03:02:44.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.546+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f79d415aa80 con 0x7f79b4066f30 2023-10-06T03:02:44.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.547+0000 7f79caffd700 1 -- 172.21.15.84:0/2039235025 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f79d415aa80 con 0x7f79b4066f30 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.548+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79b4066f30 msgr2=0x7f79b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.548+0000 7f79d8f59700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79b4066f30 0x7f79b40693e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009160 tx=0x7f79c4016000 comp rx=0 tx=0).stop 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.548+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d40b49e0 msgr2=0x7f79d409d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.548+0000 7f79d8f59700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d40b49e0 0x7f79d409d7b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00b810 tx=0x7f79bc009250 comp rx=0 tx=0).stop 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.548+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 shutdown_connections 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.548+0000 7f79d8f59700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f79b4066f30 0x7f79b40693e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.548+0000 7f79d8f59700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d41595a0 0x7f79d40ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.548+0000 7f79d8f59700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f79d40b07a0 0x7f79d414a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.548+0000 7f79d8f59700 1 --2- 172.21.15.84:0/2039235025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79d40b49e0 0x7f79d409d7b0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.549+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 >> 172.21.15.84:0/2039235025 conn(0x7f79d4099830 msgr2=0x7f79d4158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.549+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 shutdown_connections 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.549+0000 7f79d8f59700 1 -- 172.21.15.84:0/2039235025 wait complete. 2023-10-06T03:02:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T03:02:44.562 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T03:02:44.562 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:02:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.679+0000 7fad15272700 1 Processor -- start 2023-10-06T03:02:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.680+0000 7fad15272700 1 -- start start 2023-10-06T03:02:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.680+0000 7fad15272700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad101593c0 0x7fad100a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.680+0000 7fad15272700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad100aaad0 con 0x7fad10159790 2023-10-06T03:02:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.680+0000 7fad15272700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad100a9ec0 con 0x7fad100af730 2023-10-06T03:02:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.680+0000 7fad15272700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad100aa1a0 con 0x7fad101593c0 2023-10-06T03:02:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.680+0000 7fad0effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fad101593c0 0x7fad100a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.680+0000 7fad0f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fad10159790 0x7fad10068600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54384/0 (socket says 172.21.15.84:54384) 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.681+0000 7fad0f7fe700 1 -- 172.21.15.84:0/2598733356 learned_addr learned my addr 172.21.15.84:0/2598733356 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.681+0000 7fad0effd700 1 -- 172.21.15.84:0/2598733356 >> v1:172.21.15.131:6789/0 conn(0x7fad100af730 legacy=0x7fad100ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.681+0000 7fad0effd700 1 -- 172.21.15.84:0/2598733356 >> v1:172.21.15.84:6789/0 conn(0x7fad10159790 legacy=0x7fad10068600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.681+0000 7fad0effd700 1 -- 172.21.15.84:0/2598733356 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad100aa480 con 0x7fad101593c0 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.681+0000 7fad0dffb700 1 -- 172.21.15.84:0/2598733356 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244972427 0 0) 0x7fad100aaad0 con 0x7fad10159790 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.681+0000 7fad0effd700 1 --2- 172.21.15.84:0/2598733356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad101593c0 0x7fad100a98e0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fad00009e90 tx=0x7fad00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27567e66a1afa8c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.681+0000 7fad0dffb700 1 -- 172.21.15.84:0/2598733356 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000e070 con 0x7fad101593c0 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.681+0000 7fad0dffb700 1 -- 172.21.15.84:0/2598733356 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0000bbf0 con 0x7fad101593c0 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.681+0000 7fad0dffb700 1 -- 172.21.15.84:0/2598733356 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00012430 con 0x7fad101593c0 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.682+0000 7fad15272700 1 -- 172.21.15.84:0/2598733356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad101593c0 msgr2=0x7fad100a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.682+0000 7fad15272700 1 --2- 172.21.15.84:0/2598733356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad101593c0 0x7fad100a98e0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fad00009e90 tx=0x7fad00009780 comp rx=0 tx=0).stop 2023-10-06T03:02:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.682+0000 7fad15272700 1 -- 172.21.15.84:0/2598733356 shutdown_connections 2023-10-06T03:02:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.682+0000 7fad15272700 1 --2- 172.21.15.84:0/2598733356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad101593c0 0x7fad100a98e0 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.682+0000 7fad15272700 1 -- 172.21.15.84:0/2598733356 >> 172.21.15.84:0/2598733356 conn(0x7fad1006dbe0 msgr2=0x7fad1006dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.682+0000 7fad15272700 1 -- 172.21.15.84:0/2598733356 shutdown_connections 2023-10-06T03:02:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.682+0000 7fad15272700 1 -- 172.21.15.84:0/2598733356 wait complete. 2023-10-06T03:02:44.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.683+0000 7fad15272700 1 Processor -- start 2023-10-06T03:02:44.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.683+0000 7fad15272700 1 -- start start 2023-10-06T03:02:44.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad15272700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fad100af730 0x7fad100cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad15272700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad101593c0 0x7fad100c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad15272700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad10159790 0x7fad100b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad15272700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad101509e0 con 0x7fad10159790 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad15272700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1016acf0 con 0x7fad101593c0 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad15272700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad100cb480 con 0x7fad100af730 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad10159790 0x7fad100b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad10159790 0x7fad100b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39770/0 (socket says 172.21.15.84:39770) 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0f7fe700 1 -- 172.21.15.84:0/2680380308 learned_addr learned my addr 172.21.15.84:0/2680380308 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0e7fc700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad101593c0 0x7fad100c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0effd700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fad100af730 0x7fad100cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0f7fe700 1 -- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fad100af730 msgr2=0x7fad100cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0f7fe700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fad100af730 0x7fad100cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0f7fe700 1 -- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad101593c0 msgr2=0x7fad100c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0f7fe700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad101593c0 0x7fad100c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0f7fe700 1 -- 172.21.15.84:0/2680380308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00009a20 con 0x7fad10159790 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0e7fc700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad101593c0 0x7fad100c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad0f7fe700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad10159790 0x7fad100b0e30 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fad0800c510 tx=0x7fad08007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7facf6ffd700 1 -- 172.21.15.84:0/2680380308 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08005b30 con 0x7fad10159790 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7facf6ffd700 1 -- 172.21.15.84:0/2680380308 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad08005cb0 con 0x7fad10159790 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad100cb760 con 0x7fad10159790 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7facf6ffd700 1 -- 172.21.15.84:0/2680380308 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08007320 con 0x7fad10159790 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.684+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad100cbda0 con 0x7fad10159790 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.685+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad10064ad0 con 0x7fad10159790 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.686+0000 7facf6ffd700 1 -- 172.21.15.84:0/2680380308 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad0801b3b0 con 0x7fad10159790 2023-10-06T03:02:44.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.686+0000 7facf6ffd700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7facfc066f30 0x7facfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.686+0000 7facf6ffd700 1 -- 172.21.15.84:0/2680380308 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fad08083a30 con 0x7fad10159790 2023-10-06T03:02:44.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.686+0000 7fad0effd700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7facfc066f30 0x7facfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.686+0000 7facf6ffd700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7facfc06d990 0x7facfc06fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.686+0000 7facf6ffd700 1 -- 172.21.15.84:0/2680380308 --> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facfc070490 con 0x7facfc06d990 2023-10-06T03:02:44.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.686+0000 7facf6ffd700 1 -- 172.21.15.84:0/2680380308 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad08088240 con 0x7fad10159790 2023-10-06T03:02:44.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.687+0000 7fad0effd700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7facfc066f30 0x7facfc0693e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fad00009fd0 tx=0x7fad00019000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.687+0000 7fad0e7fc700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7facfc06d990 0x7facfc06fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.687+0000 7fad0e7fc700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7facfc06d990 0x7facfc06fdc0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.688+0000 7facf6ffd700 1 -- 172.21.15.84:0/2680380308 <== osd.7 v2:172.21.15.131:6816/90924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7facfc070490 con 0x7facfc06d990 2023-10-06T03:02:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.701+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 --> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fad100aa760 con 0x7facfc06d990 2023-10-06T03:02:44.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7facf6ffd700 1 -- 172.21.15.84:0/2680380308 <== osd.7 v2:172.21.15.131:6816/90924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fad100aa760 con 0x7facfc06d990 2023-10-06T03:02:44.703 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-10-06T03:02:44.703 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:02:44.704 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-10-06T03:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7facfc06d990 msgr2=0x7facfc06fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.131:6816/90924,v1:172.21.15.131:6817/90924] conn(0x7facfc06d990 0x7facfc06fdc0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7facfc066f30 msgr2=0x7facfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7facfc066f30 0x7facfc0693e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fad00009fd0 tx=0x7fad00019000 comp rx=0 tx=0).stop 2023-10-06T03:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad10159790 msgr2=0x7fad100b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 --2- 172.21.15.84:0/2680380308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad10159790 0x7fad100b0e30 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fad0800c510 tx=0x7fad08007f30 comp rx=0 tx=0).stop 2023-10-06T03:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad0f7fe700 1 -- 172.21.15.84:0/2680380308 reap_dead start 2023-10-06T03:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 shutdown_connections 2023-10-06T03:02:44.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 >> 172.21.15.84:0/2680380308 conn(0x7fad1006dbe0 msgr2=0x7fad100ac9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 shutdown_connections 2023-10-06T03:02:44.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.702+0000 7fad15272700 1 -- 172.21.15.84:0/2680380308 wait complete. 2023-10-06T03:02:44.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T03:02:44.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.829+0000 7f6a29fa8700 1 Processor -- start 2023-10-06T03:02:44.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.829+0000 7f6a29fa8700 1 -- start start 2023-10-06T03:02:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a29fa8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a241595a0 0x7f6a240aa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a29fa8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a240b49e0 0x7f6a240aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a29fa8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a240b0ca0 con 0x7f6a240b07a0 2023-10-06T03:02:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a29fa8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a240b0f80 con 0x7f6a241595a0 2023-10-06T03:02:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a29fa8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240b1260 con 0x7f6a240b49e0 2023-10-06T03:02:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a237fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6a241595a0 0x7f6a240aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a23fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a240b07a0 0x7f6a240b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54392/0 (socket says 172.21.15.84:54392) 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a23fff700 1 -- 172.21.15.84:0/4220694309 learned_addr learned my addr 172.21.15.84:0/4220694309 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a237fe700 1 -- 172.21.15.84:0/4220694309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a240b49e0 msgr2=0x7f6a240aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a22ffd700 1 --2- 172.21.15.84:0/4220694309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a240b49e0 0x7f6a240aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a227fc700 1 -- 172.21.15.84:0/4220694309 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101095963 0 0) 0x7f6a240b0ca0 con 0x7f6a240b07a0 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a237fe700 1 --2- 172.21.15.84:0/4220694309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a240b49e0 0x7f6a240aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a237fe700 1 -- 172.21.15.84:0/4220694309 >> v1:172.21.15.84:6789/0 conn(0x7f6a240b07a0 legacy=0x7f6a240b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a237fe700 1 -- 172.21.15.84:0/4220694309 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240b1540 con 0x7f6a241595a0 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a237fe700 1 --2- 172.21.15.84:0/4220694309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a241595a0 0x7f6a240aa570 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009eb0 tx=0x7f6a14009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741c97eeb204f76f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.830+0000 7f6a227fc700 1 -- 172.21.15.84:0/4220694309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400e070 con 0x7f6a241595a0 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a227fc700 1 -- 172.21.15.84:0/4220694309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1400bc30 con 0x7f6a241595a0 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a227fc700 1 -- 172.21.15.84:0/4220694309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14012430 con 0x7f6a241595a0 2023-10-06T03:02:44.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a29fa8700 1 -- 172.21.15.84:0/4220694309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a241595a0 msgr2=0x7f6a240aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a29fa8700 1 --2- 172.21.15.84:0/4220694309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a241595a0 0x7f6a240aa570 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009eb0 tx=0x7f6a14009780 comp rx=0 tx=0).stop 2023-10-06T03:02:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a29fa8700 1 -- 172.21.15.84:0/4220694309 shutdown_connections 2023-10-06T03:02:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a29fa8700 1 --2- 172.21.15.84:0/4220694309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a241595a0 0x7f6a240aa570 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a29fa8700 1 --2- 172.21.15.84:0/4220694309 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a240b49e0 0x7f6a240aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a29fa8700 1 -- 172.21.15.84:0/4220694309 >> 172.21.15.84:0/4220694309 conn(0x7f6a24099830 msgr2=0x7f6a2406f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a29fa8700 1 -- 172.21.15.84:0/4220694309 shutdown_connections 2023-10-06T03:02:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.831+0000 7f6a29fa8700 1 -- 172.21.15.84:0/4220694309 wait complete. 2023-10-06T03:02:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.832+0000 7f6a29fa8700 1 Processor -- start 2023-10-06T03:02:44.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.832+0000 7f6a29fa8700 1 -- start start 2023-10-06T03:02:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a29fa8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a240b07a0 0x7f6a2414de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a29fa8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a240b49e0 0x7f6a2415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a29fa8700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a241595a0 0x7f6a2415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a29fa8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24155120 con 0x7f6a240b49e0 2023-10-06T03:02:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a29fa8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2414e370 con 0x7f6a240b07a0 2023-10-06T03:02:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a29fa8700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24153e40 con 0x7f6a241595a0 2023-10-06T03:02:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a22ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a240b49e0 0x7f6a2415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a22ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a240b49e0 0x7f6a2415a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39778/0 (socket says 172.21.15.84:39778) 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a22ffd700 1 -- 172.21.15.84:0/368130804 learned_addr learned my addr 172.21.15.84:0/368130804 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a23fff700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a241595a0 0x7f6a2415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a237fe700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a240b07a0 0x7f6a2414de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a22ffd700 1 -- 172.21.15.84:0/368130804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a241595a0 msgr2=0x7f6a2415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a22ffd700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a241595a0 0x7f6a2415a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a22ffd700 1 -- 172.21.15.84:0/368130804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a240b07a0 msgr2=0x7f6a2414de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a22ffd700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a240b07a0 0x7f6a2414de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a22ffd700 1 -- 172.21.15.84:0/368130804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a14009a20 con 0x7f6a240b49e0 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.833+0000 7f6a237fe700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a240b07a0 0x7f6a2414de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.834+0000 7f6a22ffd700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a240b49e0 0x7f6a2415a210 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c7d0 tx=0x7f6a18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.834+0000 7f6a0b7fe700 1 -- 172.21.15.84:0/368130804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18011600 con 0x7f6a240b49e0 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.834+0000 7f6a0b7fe700 1 -- 172.21.15.84:0/368130804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18011760 con 0x7f6a240b49e0 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.834+0000 7f6a0b7fe700 1 -- 172.21.15.84:0/368130804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18011b20 con 0x7f6a240b49e0 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.834+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a24154120 con 0x7f6a240b49e0 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.834+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a241546e0 con 0x7f6a240b49e0 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.835+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2415a050 con 0x7f6a240b49e0 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.835+0000 7f6a0b7fe700 1 -- 172.21.15.84:0/368130804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a180193f0 con 0x7f6a240b49e0 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.835+0000 7f6a0b7fe700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a10066f30 0x7f6a100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.835+0000 7f6a0b7fe700 1 -- 172.21.15.84:0/368130804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f6a180849f0 con 0x7f6a240b49e0 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.835+0000 7f6a237fe700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a10066f30 0x7f6a100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.836+0000 7f6a237fe700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a10066f30 0x7f6a100693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009eb0 tx=0x7f6a14017000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:44.840+0000 7f6a0b7fe700 1 -- 172.21.15.84:0/368130804 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a18051c10 con 0x7f6a240b49e0 2023-10-06T03:02:45.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.021+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a24064ad0 con 0x7f6a10066f30 2023-10-06T03:02:45.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.022+0000 7f6a0b7fe700 1 -- 172.21.15.84:0/368130804 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a24064ad0 con 0x7f6a10066f30 2023-10-06T03:02:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a10066f30 msgr2=0x7f6a100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a10066f30 0x7f6a100693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009eb0 tx=0x7f6a14017000 comp rx=0 tx=0).stop 2023-10-06T03:02:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a240b49e0 msgr2=0x7f6a2415a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a240b49e0 0x7f6a2415a210 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c7d0 tx=0x7f6a18008040 comp rx=0 tx=0).stop 2023-10-06T03:02:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 shutdown_connections 2023-10-06T03:02:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f6a10066f30 0x7f6a100693e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a240b07a0 0x7f6a2414de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6a241595a0 0x7f6a2415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 --2- 172.21.15.84:0/368130804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a240b49e0 0x7f6a2415a210 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 >> 172.21.15.84:0/368130804 conn(0x7f6a24099830 msgr2=0x7f6a24158b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:45.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 shutdown_connections 2023-10-06T03:02:45.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.024+0000 7f6a29fa8700 1 -- 172.21.15.84:0/368130804 wait complete. 2023-10-06T03:02:45.027 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T03:02:45.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:02:45.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.149+0000 7f75d654e700 1 Processor -- start 2023-10-06T03:02:45.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.149+0000 7f75d654e700 1 -- start start 2023-10-06T03:02:45.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.150+0000 7f75d654e700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f75d00cd180 0x7f75d00cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.150+0000 7f75d654e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75d00cb400 0x7f75d00cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.150+0000 7f75d654e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d015e060 con 0x7f75d0159e30 2023-10-06T03:02:45.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.150+0000 7f75d654e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d00cdb60 con 0x7f75d00cb400 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.150+0000 7f75d654e700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d015d4e0 con 0x7f75d00cd180 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.150+0000 7f75d4aeb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75d00cb400 0x7f75d00cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.150+0000 7f75d4aeb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75d00cb400 0x7f75d00cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39782/0 (socket says 172.21.15.84:39782) 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.150+0000 7f75d4aeb700 1 -- 172.21.15.84:0/271016459 learned_addr learned my addr 172.21.15.84:0/271016459 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.150+0000 7f75cf7fe700 1 --2- 172.21.15.84:0/271016459 >> v2:172.21.15.131:3300/0 conn(0x7f75d00cd180 0x7f75d00cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d4aeb700 1 -- 172.21.15.84:0/271016459 >> v2:172.21.15.131:3300/0 conn(0x7f75d00cd180 msgr2=0x7f75d00cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d4aeb700 1 --2- 172.21.15.84:0/271016459 >> v2:172.21.15.131:3300/0 conn(0x7f75d00cd180 0x7f75d00cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d4aeb700 1 -- 172.21.15.84:0/271016459 >> v1:172.21.15.131:6789/0 conn(0x7f75d0159e30 legacy=0x7f75d015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d4aeb700 1 -- 172.21.15.84:0/271016459 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d015d7c0 con 0x7f75d00cb400 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d4aeb700 1 --2- 172.21.15.84:0/271016459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 0x7f75d00cb820 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f75d00b5ba0 tx=0x7f75c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea4fef64a2c4507 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:45.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75ceffd700 1 -- 172.21.15.84:0/271016459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800e070 con 0x7f75d00cb400 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75ceffd700 1 -- 172.21.15.84:0/271016459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c800ba10 con 0x7f75d00cb400 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75ceffd700 1 -- 172.21.15.84:0/271016459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80092e0 con 0x7f75d00cb400 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d654e700 1 -- 172.21.15.84:0/271016459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 msgr2=0x7f75d00cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d654e700 1 --2- 172.21.15.84:0/271016459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 0x7f75d00cb820 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f75d00b5ba0 tx=0x7f75c8009840 comp rx=0 tx=0).stop 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d654e700 1 -- 172.21.15.84:0/271016459 shutdown_connections 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d654e700 1 --2- 172.21.15.84:0/271016459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 0x7f75d00cb820 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d654e700 1 --2- 172.21.15.84:0/271016459 >> v2:172.21.15.131:3300/0 conn(0x7f75d00cd180 0x7f75d00cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d654e700 1 -- 172.21.15.84:0/271016459 >> 172.21.15.84:0/271016459 conn(0x7f75d0070810 msgr2=0x7f75d0070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d654e700 1 -- 172.21.15.84:0/271016459 shutdown_connections 2023-10-06T03:02:45.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.151+0000 7f75d654e700 1 -- 172.21.15.84:0/271016459 wait complete. 2023-10-06T03:02:45.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.152+0000 7f75d654e700 1 Processor -- start 2023-10-06T03:02:45.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75d654e700 1 -- start start 2023-10-06T03:02:45.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75d654e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 0x7f75d00a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75d654e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75d00cd180 0x7f75d00c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75d654e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75d0159e30 0x7f75d00ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75d654e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00c9430 con 0x7f75d00cb400 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75d654e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00c85d0 con 0x7f75d0159e30 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75d654e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00c8820 con 0x7f75d00cd180 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 0x7f75d00a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75cffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 0x7f75d00a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39796/0 (socket says 172.21.15.84:39796) 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.153+0000 7f75cffff700 1 -- 172.21.15.84:0/4294930421 learned_addr learned my addr 172.21.15.84:0/4294930421 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75d4aeb700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75d0159e30 0x7f75d00ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75cf7fe700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75d00cd180 0x7f75d00c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75cffff700 1 -- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75d00cd180 msgr2=0x7f75d00c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75cffff700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75d00cd180 0x7f75d00c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75cffff700 1 -- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75d0159e30 msgr2=0x7f75d00ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75cffff700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75d0159e30 0x7f75d00ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75cffff700 1 -- 172.21.15.84:0/4294930421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8009ae0 con 0x7f75d00cb400 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75cf7fe700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75d00cd180 0x7f75d00c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75d4aeb700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75d0159e30 0x7f75d00ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75cffff700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 0x7f75d00a7450 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f75c000b5e0 tx=0x7f75c00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75b7fff700 1 -- 172.21.15.84:0/4294930421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c000f510 con 0x7f75d00cb400 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75b7fff700 1 -- 172.21.15.84:0/4294930421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c000f690 con 0x7f75d00cb400 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d00c8b00 con 0x7f75d00cb400 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75b7fff700 1 -- 172.21.15.84:0/4294930421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c000fa50 con 0x7f75d00cb400 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.154+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d00c90c0 con 0x7f75d00cb400 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.155+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d0159730 con 0x7f75d00cb400 2023-10-06T03:02:45.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.155+0000 7f75b7fff700 1 -- 172.21.15.84:0/4294930421 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75c001a400 con 0x7f75d00cb400 2023-10-06T03:02:45.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.156+0000 7f75b7fff700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75bc066f30 0x7f75bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.156+0000 7f75cf7fe700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75bc066f30 0x7f75bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.156+0000 7f75b7fff700 1 -- 172.21.15.84:0/4294930421 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f75c0084090 con 0x7f75d00cb400 2023-10-06T03:02:45.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.156+0000 7f75cf7fe700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75bc066f30 0x7f75bc0693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f75d00712a0 tx=0x7f75c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:45.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.160+0000 7f75b7fff700 1 -- 172.21.15.84:0/4294930421 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75c0054dc0 con 0x7f75d00cb400 2023-10-06T03:02:45.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.341+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75d0064ad0 con 0x7f75bc066f30 2023-10-06T03:02:45.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.344+0000 7f75b7fff700 1 -- 172.21.15.84:0/4294930421 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73097 (secure 0 0 0) 0x7f75d0064ad0 con 0x7f75bc066f30 2023-10-06T03:02:45.346 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:02:45.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.345+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75bc066f30 msgr2=0x7f75bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.345+0000 7f75d654e700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75bc066f30 0x7f75bc0693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f75d00712a0 tx=0x7f75c4008040 comp rx=0 tx=0).stop 2023-10-06T03:02:45.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 msgr2=0x7f75d00a7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 0x7f75d00a7450 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f75c000b5e0 tx=0x7f75c00090f0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 shutdown_connections 2023-10-06T03:02:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f75bc066f30 0x7f75bc0693e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75d0159e30 0x7f75d00ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75d00cb400 0x7f75d00a7450 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 --2- 172.21.15.84:0/4294930421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f75d00cd180 0x7f75d00c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 >> 172.21.15.84:0/4294930421 conn(0x7f75d0070810 msgr2=0x7f75d01569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 shutdown_connections 2023-10-06T03:02:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:02:45.346+0000 7f75d654e700 1 -- 172.21.15.84:0/4294930421 wait complete. 2023-10-06T03:02:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:02:45.359 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2023-10-06T03:02:43.900835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2398460,"kb_used_data":11964,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752576260,"statfs":{"total":773094113280,"available":770638090240,"internally_reserved":0,"allocated":12251136,"data_stored":6526927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.106885"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.256806+0000","last_change":"2023-10-06T02:55:02.378137+0000","last_active":"2023-10-06T03:02:38.256806+0000","last_peered":"2023-10-06T03:02:38.256806+0000","last_clean":"2023-10-06T03:02:38.256806+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T03:02:38.256806+0000","last_undegraded":"2023-10-06T03:02:38.256806+0000","last_fullsized":"2023-10-06T03:02:38.256806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":85,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T03:02:36.138327+0000","last_change":"2023-10-06T02:55:02.118756+0000","last_active":"2023-10-06T03:02:36.138327+0000","last_peered":"2023-10-06T03:02:36.138327+0000","last_clean":"2023-10-06T03:02:36.138327+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T03:02:36.138327+0000","last_undegraded":"2023-10-06T03:02:36.138327+0000","last_fullsized":"2023-10-06T03:02:36.138327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:43.408819+0000","last_change":"2023-10-06T03:02:43.408783+0000","last_active":"2023-10-06T03:02:43.408819+0000","last_peered":"2023-10-06T03:02:43.408819+0000","last_clean":"2023-10-06T03:02:43.408819+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T03:02:43.408819+0000","last_undegraded":"2023-10-06T03:02:43.408819+0000","last_fullsized":"2023-10-06T03:02:43.408819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:43.408642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:43.408642+0000","last_clean_scrub_stamp":"2023-10-06T03:02:43.408642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:00.702817+0000","scrub_duration":0.001646666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T03:02:36.138358+0000","last_change":"2023-10-06T02:55:02.118906+0000","last_active":"2023-10-06T03:02:36.138358+0000","last_peered":"2023-10-06T03:02:36.138358+0000","last_clean":"2023-10-06T03:02:36.138358+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T03:02:36.138358+0000","last_undegraded":"2023-10-06T03:02:36.138358+0000","last_fullsized":"2023-10-06T03:02:36.138358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:56:37.680359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":239,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T03:02:36.137138+0000","last_change":"2023-10-06T02:54:55.832734+0000","last_active":"2023-10-06T03:02:36.137138+0000","last_peered":"2023-10-06T03:02:36.137138+0000","last_clean":"2023-10-06T03:02:36.137138+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T03:02:36.137138+0000","last_undegraded":"2023-10-06T03:02:36.137138+0000","last_fullsized":"2023-10-06T03:02:36.137138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:54:54.783498+0000","last_clean_scrub_stamp":"2023-10-06T02:54:54.783498+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:09.890925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T03:02:36.137038+0000","last_change":"2023-10-06T02:55:02.118916+0000","last_active":"2023-10-06T03:02:36.137038+0000","last_peered":"2023-10-06T03:02:36.137038+0000","last_clean":"2023-10-06T03:02:36.137038+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T03:02:36.137038+0000","last_undegraded":"2023-10-06T03:02:36.137038+0000","last_fullsized":"2023-10-06T03:02:36.137038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:03:48.361271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":86,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T03:02:36.138134+0000","last_change":"2023-10-06T02:55:02.377879+0000","last_active":"2023-10-06T03:02:36.138134+0000","last_peered":"2023-10-06T03:02:36.138134+0000","last_clean":"2023-10-06T03:02:36.138134+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T03:02:36.138134+0000","last_undegraded":"2023-10-06T03:02:36.138134+0000","last_fullsized":"2023-10-06T03:02:36.138134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.005957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.254882+0000","last_change":"2023-10-06T02:55:02.118051+0000","last_active":"2023-10-06T03:02:38.254882+0000","last_peered":"2023-10-06T03:02:38.254882+0000","last_clean":"2023-10-06T03:02:38.254882+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T03:02:38.254882+0000","last_undegraded":"2023-10-06T03:02:38.254882+0000","last_fullsized":"2023-10-06T03:02:38.254882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-10-06T03:02:35.799874+0000","last_change":"2023-10-06T02:55:02.117506+0000","last_active":"2023-10-06T03:02:35.799874+0000","last_peered":"2023-10-06T03:02:35.799874+0000","last_clean":"2023-10-06T03:02:35.799874+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T03:02:35.799874+0000","last_undegraded":"2023-10-06T03:02:35.799874+0000","last_fullsized":"2023-10-06T03:02:35.799874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T02:55:01.096335+0000","last_clean_scrub_stamp":"2023-10-06T02:55:01.096335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:30.261814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":1259021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.69899999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.29899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.434}]},{"osd":2,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.67100000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34799999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46700000000000003,"15min":0.49199999999999999},"min":{"1min":0.376,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72399999999999998},"last":0.504},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.498,"15min":0.51200000000000001},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.25600000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.72799999999999998},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":0.83299999999999996},"last":0.626},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.308},"max":{"1min":0.70699999999999996,"5min":0.73699999999999999,"15min":0.75700000000000001},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.55900000000000005},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.79700000000000004},"last":0.71899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073200,"statfs":{"total":96636764160,"available":96330956800,"internally_reserved":0,"allocated":1384448,"data_stored":668653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.58899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.29999999999999999},"max":{"1min":0.67900000000000005,"5min":0.86099999999999999,"15min":3.415},"last":0.443},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.57199999999999995},"min":{"1min":0.38400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70099999999999996,"5min":0.746,"15min":1.4219999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.81999999999999995,"15min":1.546},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":1.6319999999999999},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.56499999999999995},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.79500000000000004,"15min":1.74},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55700000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":3.4830000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.68100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.80500000000000005,"15min":3.577},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.82099999999999995,"15min":1.9219999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.83399999999999996},"last":0.499},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29999999999999999},"max":{"1min":0.80000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":667642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33400000000000002,"15min":0.38100000000000001},"min":{"1min":0.23000000000000001,"5min":0.193,"15min":0.19},"max":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":2.0209999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":1.0409999999999999},"last":0.23000000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35799999999999998,"15min":0.996},"min":{"1min":0.23300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":21.193999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.55900000000000005,"5min":0.60299999999999998,"15min":1.181},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.42599999999999999},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.628,"15min":2.0579999999999998},"last":0.251},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.248},"max":{"1min":0.51500000000000001,"5min":0.61599999999999999,"15min":0.626},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78100000000000003,"5min":0.95699999999999996,"15min":1.02},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":1.2170000000000001},"min":{"1min":0.432,"5min":0.308,"15min":0.29799999999999999},"max":{"1min":0.80700000000000005,"5min":0.83599999999999997,"15min":21.135000000000002},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":1.2070000000000001},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71699999999999997,"5min":0.89800000000000002,"15min":21.085000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.748,"5min":0.83999999999999997,"15min":1.2789999999999999},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.70799999999999996,"5min":1.016,"15min":1.016},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":1.2330000000000001},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":21.166},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74099999999999999,"5min":0.875,"15min":1.2450000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.99099999999999999,"15min":0.997},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":1974272,"data_stored":1258010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.32100000000000001,"15min":0.32900000000000001},"min":{"1min":0.23899999999999999,"5min":0.20599999999999999,"15min":0.19600000000000001},"max":{"1min":0.42899999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.34100000000000003,"15min":0.33300000000000002},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.52100000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.26800000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36799999999999999,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.49299999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.20799999999999999},"max":{"1min":0.38400000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"last":0.28799999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.29399999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.38200000000000001,"15min":0.40100000000000002},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.22900000000000001},"max":{"1min":0.46999999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"last":0.34799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80900000000000005,"5min":0.82399999999999995,"15min":0.89800000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.42899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":0.82499999999999996,"15min":0.85599999999999998},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70599999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.39700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.755,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79800000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":0.90900000000000003,"15min":0.91200000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79900000000000004,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073200,"statfs":{"total":96636764160,"available":96330956800,"internally_reserved":0,"allocated":1384448,"data_stored":668653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32900000000000001,"15min":0.314},"min":{"1min":0.214,"5min":0.214,"15min":0.19700000000000001},"max":{"1min":0.49199999999999999,"5min":0.55100000000000005,"15min":0.69499999999999995},"last":0.215},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34999999999999998,"15min":0.32900000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.504,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.26700000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.37,"15min":0.36099999999999999},"min":{"1min":0.246,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.58399999999999996,"15min":0.72399999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38100000000000001,"15min":0.373},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":1.0129999999999999},"last":0.33200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.92100000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.63100000000000001,"15min":0.78900000000000003},"last":0.34599999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.375,"15min":0.35599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.73199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.621,"15min":0.57699999999999996},"min":{"1min":0.44400000000000001,"5min":0.39600000000000002,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":1.276,"15min":1.276},"last":0.55100000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67000000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.39900000000000002},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.077},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72799999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.747,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.47499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":667642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.34799999999999998,"15min":0.42199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.16400000000000001},"max":{"1min":0.45500000000000002,"5min":0.60899999999999999,"15min":2.569},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.36799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45900000000000002,"5min":0.57499999999999996,"15min":2.1840000000000002},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33800000000000002,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.504,"5min":0.58799999999999997,"15min":2.3199999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.44900000000000001},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.64100000000000001,"15min":2.5979999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.60699999999999998,"15min":2.3439999999999999},"last":0.377},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39800000000000002,"15min":0.46700000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":2.6269999999999998},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.628},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.85099999999999998,"15min":2.1240000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58899999999999997,"15min":0.64700000000000002},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":2.2240000000000002},"last":0.68600000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.65200000000000002},"min":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.80700000000000005,"5min":0.84699999999999998,"15min":2.2650000000000001},"last":0.629},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":2.532},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":2.0840000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60499999999999998,"15min":0.67500000000000004},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":2.2930000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78500000000000003,"5min":0.90600000000000003,"15min":2.496},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.877,"15min":2.1549999999999998},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073200,"statfs":{"total":96636764160,"available":96330956800,"internally_reserved":0,"allocated":1384448,"data_stored":668653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66000000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.38400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.73999999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34100000000000003},"max":{"1min":0.69799999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.497},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.90500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.871,"15min":9.4440000000000008},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42999999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.54800000000000004,"15min":0.58999999999999997},"min":{"1min":0.38700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80500000000000005},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.61199999999999999},"min":{"1min":0.495,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.64900000000000002},"min":{"1min":0.51000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81200000000000006,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.52500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073200,"statfs":{"total":96636764160,"available":96330956800,"internally_reserved":0,"allocated":1384448,"data_stored":668653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.498},"min":{"1min":0.42999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":1.0069999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63100000000000001,"5min":0.73899999999999999,"15min":1.167},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66000000000000003,"5min":0.74099999999999999,"15min":1.117},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.41399999999999998,"5min":0.34399999999999997,"15min":0.29499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.94399999999999995},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53200000000000003,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.76700000000000002,"15min":1.2},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.58099999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.1759999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":1.135},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69999999999999996,"5min":0.77600000000000002,"15min":1.208},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":0.66100000000000003,"5min":0.68600000000000005,"15min":0.78000000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":0.85399999999999998,"15min":0.87},"last":0.69799999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.28499999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":1.054},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.90100000000000002},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.751,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":1.008},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:02:45.364 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T02:55:01.096335+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=55, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=2, tm_sec=40, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:02:45.364 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T02:55:01.096335+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=55, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=2, tm_sec=40, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:02:45.364 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T02:55:01.096335+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=55, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=2, tm_sec=40, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:02:45.364 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T02:54:54.783498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=54, tm_sec=54, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=2, tm_sec=40, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:02:45.364 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T02:55:01.096335+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=55, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=2, tm_sec=40, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:02:45.364 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T02:55:01.096335+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=55, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=2, tm_sec=40, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:02:45.364 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T02:55:01.096335+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=55, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=2, tm_sec=40, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:02:45.365 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T02:55:01.096335+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=2, tm_min=55, tm_sec=1, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=2, tm_sec=40, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:02:45.365 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:03:05.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:03:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.484+0000 7f8a1bfff700 1 Processor -- start 2023-10-06T03:03:05.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.484+0000 7f8a1bfff700 1 -- start start 2023-10-06T03:03:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1bfff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a1c159480 0x7f8a1c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1bfff700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8a1c0b2140 0x7f8a1c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1bfff700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1c0cb7e0 con 0x7f8a1c0b3610 2023-10-06T03:03:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1bfff700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c0b08a0 con 0x7f8a1c159480 2023-10-06T03:03:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1bfff700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c0cb190 con 0x7f8a1c0b2140 2023-10-06T03:03:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a1c159480 0x7f8a1c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a1c159480 0x7f8a1c0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56416/0 (socket says 172.21.15.84:56416) 2023-10-06T03:03:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1affd700 1 -- 172.21.15.84:0/913929801 learned_addr learned my addr 172.21.15.84:0/913929801 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1b7fe700 1 --2- 172.21.15.84:0/913929801 >> v2:172.21.15.131:3300/0 conn(0x7f8a1c0b2140 0x7f8a1c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1affd700 1 -- 172.21.15.84:0/913929801 >> v2:172.21.15.131:3300/0 conn(0x7f8a1c0b2140 msgr2=0x7f8a1c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1affd700 1 --2- 172.21.15.84:0/913929801 >> v2:172.21.15.131:3300/0 conn(0x7f8a1c0b2140 0x7f8a1c0b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1affd700 1 -- 172.21.15.84:0/913929801 >> v1:172.21.15.131:6789/0 conn(0x7f8a1c0b3610 legacy=0x7f8a1c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1affd700 1 -- 172.21.15.84:0/913929801 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0cb470 con 0x7f8a1c159480 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a1affd700 1 --2- 172.21.15.84:0/913929801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 0x7f8a1c0b30d0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0ca830 tx=0x7f8a14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed5adab01a68bf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a19ffb700 1 -- 172.21.15.84:0/913929801 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400b820 con 0x7f8a1c159480 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a19ffb700 1 -- 172.21.15.84:0/913929801 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1400b980 con 0x7f8a1c159480 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.485+0000 7f8a19ffb700 1 -- 172.21.15.84:0/913929801 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400bd20 con 0x7f8a1c159480 2023-10-06T03:03:05.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.486+0000 7f8a1bfff700 1 -- 172.21.15.84:0/913929801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 msgr2=0x7f8a1c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.486+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/913929801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 0x7f8a1c0b30d0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0ca830 tx=0x7f8a14009250 comp rx=0 tx=0).stop 2023-10-06T03:03:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.486+0000 7f8a1bfff700 1 -- 172.21.15.84:0/913929801 shutdown_connections 2023-10-06T03:03:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.486+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/913929801 >> v2:172.21.15.131:3300/0 conn(0x7f8a1c0b2140 0x7f8a1c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.486+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/913929801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 0x7f8a1c0b30d0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.486+0000 7f8a1bfff700 1 -- 172.21.15.84:0/913929801 >> 172.21.15.84:0/913929801 conn(0x7f8a1c06ed20 msgr2=0x7f8a1c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.486+0000 7f8a1bfff700 1 -- 172.21.15.84:0/913929801 shutdown_connections 2023-10-06T03:03:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.486+0000 7f8a1bfff700 1 -- 172.21.15.84:0/913929801 wait complete. 2023-10-06T03:03:05.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.487+0000 7f8a1bfff700 1 Processor -- start 2023-10-06T03:03:05.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.487+0000 7f8a1bfff700 1 -- start start 2023-10-06T03:03:05.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a1c0b2140 0x7f8a1c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a1c0b3610 0x7f8a1c153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 0x7f8a1c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1bfff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c15b170 con 0x7f8a1c159480 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1bfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0c69b0 con 0x7f8a1c0b2140 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1bfff700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c15a560 con 0x7f8a1c0b3610 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 0x7f8a1c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 0x7f8a1c159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56420/0 (socket says 172.21.15.84:56420) 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1b7fe700 1 -- 172.21.15.84:0/2608367290 learned_addr learned my addr 172.21.15.84:0/2608367290 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1b7fe700 1 -- 172.21.15.84:0/2608367290 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a1c0b3610 msgr2=0x7f8a1c153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1b7fe700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a1c0b3610 0x7f8a1c153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1b7fe700 1 -- 172.21.15.84:0/2608367290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a1c0b2140 msgr2=0x7f8a1c15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1b7fe700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a1c0b2140 0x7f8a1c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1b7fe700 1 -- 172.21.15.84:0/2608367290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140094f0 con 0x7f8a1c159480 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.488+0000 7f8a1b7fe700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 0x7f8a1c159aa0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00ceb0 tx=0x7f8a0c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.489+0000 7f8a12ffd700 1 -- 172.21.15.84:0/2608367290 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c00ae40 con 0x7f8a1c159480 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.489+0000 7f8a12ffd700 1 -- 172.21.15.84:0/2608367290 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c016430 con 0x7f8a1c159480 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.489+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c15a840 con 0x7f8a1c159480 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.489+0000 7f8a12ffd700 1 -- 172.21.15.84:0/2608367290 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0167d0 con 0x7f8a1c159480 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.489+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c15ae00 con 0x7f8a1c159480 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.490+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1c05f270 con 0x7f8a1c159480 2023-10-06T03:03:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.490+0000 7f8a12ffd700 1 -- 172.21.15.84:0/2608367290 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a0c003020 con 0x7f8a1c159480 2023-10-06T03:03:05.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.490+0000 7f8a12ffd700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89fc066f30 0x7f89fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.490+0000 7f8a12ffd700 1 -- 172.21.15.84:0/2608367290 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7f8a0c012070 con 0x7f8a1c159480 2023-10-06T03:03:05.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.490+0000 7f8a1affd700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89fc066f30 0x7f89fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:05.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.491+0000 7f8a1affd700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89fc066f30 0x7f89fc0693e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0ca830 tx=0x7f8a14016000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:05.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.495+0000 7f8a12ffd700 1 -- 172.21.15.84:0/2608367290 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a0c056160 con 0x7f8a1c159480 2023-10-06T03:03:05.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.672+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 --> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a1c15b2b0 con 0x7f89fc066f30 2023-10-06T03:03:05.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.675+0000 7f8a12ffd700 1 -- 172.21.15.84:0/2608367290 <== mgr.4104 v2:172.21.15.84:6832/90399 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73323 (secure 0 0 0) 0x7f8a1c15b2b0 con 0x7f89fc066f30 2023-10-06T03:03:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:03:05.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89fc066f30 msgr2=0x7f89fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:05.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89fc066f30 0x7f89fc0693e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0ca830 tx=0x7f8a14016000 comp rx=0 tx=0).stop 2023-10-06T03:03:05.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 msgr2=0x7f8a1c159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:05.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 0x7f8a1c159aa0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00ceb0 tx=0x7f8a0c007870 comp rx=0 tx=0).stop 2023-10-06T03:03:05.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 shutdown_connections 2023-10-06T03:03:05.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7f89fc066f30 0x7f89fc0693e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a1c0b2140 0x7f8a1c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a1c159480 0x7f8a1c159aa0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/2608367290 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a1c0b3610 0x7f8a1c153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 >> 172.21.15.84:0/2608367290 conn(0x7f8a1c06ed20 msgr2=0x7f8a1c1549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:05.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 shutdown_connections 2023-10-06T03:03:05.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.677+0000 7f8a1bfff700 1 -- 172.21.15.84:0/2608367290 wait complete. 2023-10-06T03:03:05.680 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-10-06T03:03:05.690 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2023-10-06T03:03:03.905071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2398460,"kb_used_data":11964,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752576260,"statfs":{"total":773094113280,"available":770638090240,"internally_reserved":0,"allocated":12251136,"data_stored":6526927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002459"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:45.800250+0000","last_change":"2023-10-06T03:02:45.800223+0000","last_active":"2023-10-06T03:02:45.800250+0000","last_peered":"2023-10-06T03:02:45.800250+0000","last_clean":"2023-10-06T03:02:45.800250+0000","last_became_active":"2023-10-06T02:55:02.377675+0000","last_became_peered":"2023-10-06T02:55:02.377675+0000","last_unstale":"2023-10-06T03:02:45.800250+0000","last_undegraded":"2023-10-06T03:02:45.800250+0000","last_fullsized":"2023-10-06T03:02:45.800250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:45.800145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:45.800145+0000","last_clean_scrub_stamp":"2023-10-06T03:02:45.800145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:03.094320+0000","scrub_duration":0.001480784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:45.194608+0000","last_change":"2023-10-06T03:02:45.194580+0000","last_active":"2023-10-06T03:02:45.194608+0000","last_peered":"2023-10-06T03:02:45.194608+0000","last_clean":"2023-10-06T03:02:45.194608+0000","last_became_active":"2023-10-06T02:55:02.118442+0000","last_became_peered":"2023-10-06T02:55:02.118442+0000","last_unstale":"2023-10-06T03:02:45.194608+0000","last_undegraded":"2023-10-06T03:02:45.194608+0000","last_fullsized":"2023-10-06T03:02:45.194608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:45.194485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:45.194485+0000","last_clean_scrub_stamp":"2023-10-06T03:02:45.194485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:48.209176+0000","scrub_duration":0.001873336,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:43.408819+0000","last_change":"2023-10-06T03:02:43.408783+0000","last_active":"2023-10-06T03:02:43.408819+0000","last_peered":"2023-10-06T03:02:43.408819+0000","last_clean":"2023-10-06T03:02:43.408819+0000","last_became_active":"2023-10-06T02:55:02.377647+0000","last_became_peered":"2023-10-06T02:55:02.377647+0000","last_unstale":"2023-10-06T03:02:43.408819+0000","last_undegraded":"2023-10-06T03:02:43.408819+0000","last_fullsized":"2023-10-06T03:02:43.408819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:43.408642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:43.408642+0000","last_clean_scrub_stamp":"2023-10-06T03:02:43.408642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:00.702817+0000","scrub_duration":0.001646666,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:46.185100+0000","last_change":"2023-10-06T03:02:46.185073+0000","last_active":"2023-10-06T03:02:46.185100+0000","last_peered":"2023-10-06T03:02:46.185100+0000","last_clean":"2023-10-06T03:02:46.185100+0000","last_became_active":"2023-10-06T02:55:02.118444+0000","last_became_peered":"2023-10-06T02:55:02.118444+0000","last_unstale":"2023-10-06T03:02:46.185100+0000","last_undegraded":"2023-10-06T03:02:46.185100+0000","last_fullsized":"2023-10-06T03:02:46.185100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:46.184975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:46.184975+0000","last_clean_scrub_stamp":"2023-10-06T03:02:46.184975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:52.242021+0000","scrub_duration":0.001976383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"111'119","reported_seq":252,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:45.892243+0000","last_change":"2023-10-06T03:02:45.892202+0000","last_active":"2023-10-06T03:02:45.892243+0000","last_peered":"2023-10-06T03:02:45.892243+0000","last_clean":"2023-10-06T03:02:45.892243+0000","last_became_active":"2023-10-06T02:54:55.831736+0000","last_became_peered":"2023-10-06T02:54:55.831736+0000","last_unstale":"2023-10-06T03:02:45.892243+0000","last_undegraded":"2023-10-06T03:02:45.892243+0000","last_fullsized":"2023-10-06T03:02:45.892243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'119","last_scrub_stamp":"2023-10-06T03:02:45.892025+0000","last_deep_scrub":"111'119","last_deep_scrub_stamp":"2023-10-06T03:02:45.892025+0000","last_clean_scrub_stamp":"2023-10-06T03:02:45.892025+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:48.803614+0000","scrub_duration":0.007688627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:48.855340+0000","last_change":"2023-10-06T03:02:48.855310+0000","last_active":"2023-10-06T03:02:48.855340+0000","last_peered":"2023-10-06T03:02:48.855340+0000","last_clean":"2023-10-06T03:02:48.855340+0000","last_became_active":"2023-10-06T02:55:02.118610+0000","last_became_peered":"2023-10-06T02:55:02.118610+0000","last_unstale":"2023-10-06T03:02:48.855340+0000","last_undegraded":"2023-10-06T03:02:48.855340+0000","last_fullsized":"2023-10-06T03:02:48.855340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:48.855217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:48.855217+0000","last_clean_scrub_stamp":"2023-10-06T03:02:48.855217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:59.475824+0000","scrub_duration":0.001798458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:49.842980+0000","last_change":"2023-10-06T03:02:49.842945+0000","last_active":"2023-10-06T03:02:49.842980+0000","last_peered":"2023-10-06T03:02:49.842980+0000","last_clean":"2023-10-06T03:02:49.842980+0000","last_became_active":"2023-10-06T02:55:02.377603+0000","last_became_peered":"2023-10-06T02:55:02.377603+0000","last_unstale":"2023-10-06T03:02:49.842980+0000","last_undegraded":"2023-10-06T03:02:49.842980+0000","last_fullsized":"2023-10-06T03:02:49.842980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:49.842833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:49.842833+0000","last_clean_scrub_stamp":"2023-10-06T03:02:49.842833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:07:47.482176+0000","scrub_duration":0.0022233320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:47.764960+0000","last_change":"2023-10-06T03:02:47.764918+0000","last_active":"2023-10-06T03:02:47.764960+0000","last_peered":"2023-10-06T03:02:47.764960+0000","last_clean":"2023-10-06T03:02:47.764960+0000","last_became_active":"2023-10-06T02:55:02.117751+0000","last_became_peered":"2023-10-06T02:55:02.117751+0000","last_unstale":"2023-10-06T03:02:47.764960+0000","last_undegraded":"2023-10-06T03:02:47.764960+0000","last_fullsized":"2023-10-06T03:02:47.764960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:47.764813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:47.764813+0000","last_clean_scrub_stamp":"2023-10-06T03:02:47.764813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:44.189556+0000","scrub_duration":0.0022945940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T03:02:44.803391+0000","last_change":"2023-10-06T03:02:44.803364+0000","last_active":"2023-10-06T03:02:44.803391+0000","last_peered":"2023-10-06T03:02:44.803391+0000","last_clean":"2023-10-06T03:02:44.803391+0000","last_became_active":"2023-10-06T02:55:02.117223+0000","last_became_peered":"2023-10-06T02:55:02.117223+0000","last_unstale":"2023-10-06T03:02:44.803391+0000","last_undegraded":"2023-10-06T03:02:44.803391+0000","last_fullsized":"2023-10-06T03:02:44.803391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:44.803248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:44.803248+0000","last_clean_scrub_stamp":"2023-10-06T03:02:44.803248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:17.500865+0000","scrub_duration":0.001696246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":1259021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.31900000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.38900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81399999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.622}]},{"osd":1,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.69899999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52500000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.29899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.67100000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56000000000000005,"15min":0.57099999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34799999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.753,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.749,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.46700000000000003,"15min":0.49199999999999999},"min":{"1min":0.376,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.72399999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.498,"15min":0.51200000000000001},"min":{"1min":0.32700000000000001,"5min":0.30199999999999999,"15min":0.25600000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.72799999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":0.83299999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.54700000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.308},"max":{"1min":0.70699999999999996,"5min":0.73699999999999999,"15min":0.75700000000000001},"last":0.439}]},{"osd":6,"last update":"Fri Oct 6 03:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.55900000000000005},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.40699999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.79700000000000004},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574949,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073200,"statfs":{"total":96636764160,"available":96330956800,"internally_reserved":0,"allocated":1384448,"data_stored":668653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53900000000000003,"15min":0.58899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.29999999999999999},"max":{"1min":0.67900000000000005,"5min":0.86099999999999999,"15min":3.415},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.57199999999999995},"min":{"1min":0.38400000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70099999999999996,"5min":0.746,"15min":1.4219999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.55000000000000004},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.81999999999999995,"15min":1.546},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55700000000000005,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":1.6319999999999999},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.56499999999999995},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.79500000000000004,"15min":1.74},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55700000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70099999999999996,"5min":0.80300000000000005,"15min":3.4830000000000001},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57599999999999996,"15min":0.68100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.747,"5min":0.80500000000000005,"15min":3.577},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65700000000000003},"min":{"1min":0.44800000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76000000000000001,"5min":0.82099999999999995,"15min":1.9219999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53500000000000003,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55800000000000005,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.56000000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.83399999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.35499999999999998,"5min":0.34999999999999998,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":0.87,"15min":0.87},"last":0.38600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29999999999999999},"max":{"1min":0.80000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.495},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.40699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":667642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33400000000000002,"15min":0.38100000000000001},"min":{"1min":0.23000000000000001,"5min":0.193,"15min":0.19},"max":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":2.0209999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.36699999999999999},"min":{"1min":0.23400000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.52900000000000003,"5min":0.53600000000000003,"15min":1.0409999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35799999999999998,"15min":0.996},"min":{"1min":0.23300000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":21.193999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.55900000000000005,"5min":0.60299999999999998,"15min":1.181},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38400000000000001,"15min":0.42599999999999999},"min":{"1min":0.26600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.628,"15min":2.0579999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.28199999999999997,"5min":0.254,"15min":0.248},"max":{"1min":0.51500000000000001,"5min":0.61599999999999999,"15min":0.626},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78100000000000003,"5min":0.95699999999999996,"15min":1.02},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":1.2170000000000001},"min":{"1min":0.432,"5min":0.308,"15min":0.29799999999999999},"max":{"1min":0.80700000000000005,"5min":0.83599999999999997,"15min":21.135000000000002},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":1.2070000000000001},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71699999999999997,"5min":0.89800000000000002,"15min":21.085000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.748,"5min":0.83999999999999997,"15min":1.2789999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59899999999999998,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.70799999999999996,"5min":1.016,"15min":1.016},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":1.2330000000000001},"min":{"1min":0.40000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":21.166},"last":0.52200000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.74099999999999999,"5min":0.875,"15min":1.2450000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.441,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.99099999999999999,"15min":0.997},"last":0.54300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":1974272,"data_stored":1258010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.32900000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19600000000000001},"max":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.52100000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.313,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.22500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.48699999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.36599999999999999,"15min":0.37},"min":{"1min":0.26200000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.441,"5min":0.61099999999999999,"15min":0.61599999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.20799999999999999},"max":{"1min":0.46999999999999997,"5min":0.52800000000000002,"15min":0.53600000000000003},"last":0.32000000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35799999999999998,"15min":0.35999999999999999},"min":{"1min":0.254,"5min":0.23799999999999999,"15min":0.23699999999999999},"max":{"1min":0.52300000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38600000000000001,"15min":0.39900000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.22900000000000001},"max":{"1min":0.51200000000000001,"5min":0.59899999999999998,"15min":0.60699999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78600000000000003,"5min":0.82399999999999995,"15min":0.89800000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56799999999999995,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71199999999999997,"5min":0.79700000000000004,"15min":0.85599999999999998},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.44600000000000001,"5min":0.36099999999999999,"15min":0.34499999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.31},"max":{"1min":0.76700000000000002,"5min":0.78400000000000003,"15min":0.93400000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.38400000000000001},"max":{"1min":0.73899999999999999,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:03:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.44,"5min":0.42399999999999999,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.90900000000000003,"15min":0.91200000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.81899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073200,"statfs":{"total":96636764160,"available":96330956800,"internally_reserved":0,"allocated":1384448,"data_stored":668653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.32900000000000001,"15min":0.314},"min":{"1min":0.214,"5min":0.214,"15min":0.19700000000000001},"max":{"1min":0.49199999999999999,"5min":0.55100000000000005,"15min":0.69499999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34999999999999998,"15min":0.32900000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.504,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.40000000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.37,"15min":0.36099999999999999},"min":{"1min":0.246,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.58399999999999996,"15min":0.72399999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38100000000000001,"15min":0.373},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55500000000000005,"5min":0.57599999999999996,"15min":1.0129999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.92100000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.63100000000000001,"15min":0.78900000000000003},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.375,"15min":0.35599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38100000000000001},"max":{"1min":0.73199999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59999999999999998,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36599999999999999},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.621,"15min":0.57699999999999996},"min":{"1min":0.44400000000000001,"5min":0.39600000000000002,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":1.276,"15min":1.276},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67000000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.628},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.45700000000000002,"5min":0.42099999999999999,"15min":0.39900000000000002},"max":{"1min":0.78900000000000003,"5min":0.89500000000000002,"15min":1.077},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.625,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72799999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.60199999999999998},"min":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.747,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.69599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574949,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":667642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.34799999999999998,"15min":0.42199999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.16400000000000001},"max":{"1min":0.45500000000000002,"5min":0.60899999999999999,"15min":2.569},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.36799999999999999,"15min":0.42799999999999999},"min":{"1min":0.26900000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.45900000000000002,"5min":0.57499999999999996,"15min":2.1840000000000002},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33800000000000002,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.504,"5min":0.58799999999999997,"15min":2.3199999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.374,"15min":0.44900000000000001},"min":{"1min":0.248,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.64100000000000001,"15min":2.5979999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38500000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.60699999999999998,"15min":2.3439999999999999},"last":0.377},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39800000000000002,"15min":0.46700000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.63300000000000001,"15min":2.6269999999999998},"last":0.35699999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.628},"min":{"1min":0.35899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.85099999999999998,"15min":2.1240000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58899999999999997,"15min":0.64700000000000002},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":2.2240000000000002},"last":0.69599999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.65200000000000002},"min":{"1min":0.48699999999999999,"5min":0.39200000000000002,"15min":0.39000000000000001},"max":{"1min":0.80700000000000005,"5min":0.84699999999999998,"15min":2.2650000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":2.532},"last":0.625}]},{"osd":6,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59799999999999998,"15min":0.63600000000000001},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.38800000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":2.0840000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60499999999999998,"15min":0.67500000000000004},"min":{"1min":0.45800000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":2.2930000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78500000000000003,"5min":0.90600000000000003,"15min":2.496},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.64600000000000002},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.877,"15min":2.1549999999999998},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073200,"statfs":{"total":96636764160,"available":96330956800,"internally_reserved":0,"allocated":1384448,"data_stored":668653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53100000000000003,"15min":0.52000000000000002},"min":{"1min":0.32400000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66000000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.38400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.745,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.73799999999999999,"15min":0.73999999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54200000000000004,"15min":0.56299999999999994},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34100000000000003},"max":{"1min":0.69799999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.36699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59899999999999998,"15min":0.90500000000000003},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.77700000000000002,"5min":0.871,"15min":9.4440000000000008},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.378},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.54800000000000004,"15min":0.58999999999999997},"min":{"1min":0.38700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80500000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.61199999999999999},"min":{"1min":0.495,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82199999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 03:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.79000000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.64900000000000002},"min":{"1min":0.51000000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81200000000000006,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298640,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073200,"statfs":{"total":96636764160,"available":96330956800,"internally_reserved":0,"allocated":1384448,"data_stored":668653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.498},"min":{"1min":0.42999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":1.0069999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.52100000000000002},"min":{"1min":0.34200000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63100000000000001,"5min":0.73899999999999999,"15min":1.167},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.66000000000000003,"5min":0.74099999999999999,"15min":1.117},"last":0.755},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.41399999999999998,"5min":0.34399999999999997,"15min":0.29499999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.94399999999999995},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53200000000000003,"15min":0.55800000000000005},"min":{"1min":0.38300000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67900000000000005,"5min":0.76700000000000002,"15min":1.2},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.58099999999999996},"min":{"1min":0.35899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.1759999999999999},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.56000000000000005},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70499999999999996,"5min":0.73799999999999999,"15min":1.135},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.59599999999999997},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69999999999999996,"5min":0.77600000000000002,"15min":1.208},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.49199999999999999},"min":{"1min":0.30299999999999999,"5min":0.28199999999999997,"15min":0.26100000000000001},"max":{"1min":0.66100000000000003,"5min":0.68600000000000005,"15min":0.78000000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":0.85399999999999998,"15min":0.87},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32700000000000001,"15min":0.28499999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":1.054},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.90100000000000002},"last":0.72299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.57299999999999995},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.751,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.61799999999999999},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.78200000000000003,"15min":1.008},"last":0.80700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:03:05.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T03:03:05.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.805+0000 7fbec284e700 1 Processor -- start 2023-10-06T03:03:05.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.805+0000 7fbec284e700 1 -- start start 2023-10-06T03:03:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec284e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbebc0b2a30 0x7fbebc164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec284e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc0cc9b0 con 0x7fbebc0cd400 2023-10-06T03:03:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec284e700 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc0cbda0 con 0x7fbebc0b2660 2023-10-06T03:03:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec284e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc0cc080 con 0x7fbebc0b2a30 2023-10-06T03:03:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec204d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbebc0b2a30 0x7fbebc164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec104b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbebc0cd400 0x7fbebc0ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54702/0 (socket says 172.21.15.84:54702) 2023-10-06T03:03:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec104b700 1 -- 172.21.15.84:0/2859364987 learned_addr learned my addr 172.21.15.84:0/2859364987 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:03:05.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec204d700 1 -- 172.21.15.84:0/2859364987 >> v1:172.21.15.131:6789/0 conn(0x7fbebc0b2660 legacy=0x7fbebc0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec204d700 1 -- 172.21.15.84:0/2859364987 >> v1:172.21.15.84:6789/0 conn(0x7fbebc0cd400 legacy=0x7fbebc0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec204d700 1 -- 172.21.15.84:0/2859364987 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0cc360 con 0x7fbebc0b2a30 2023-10-06T03:03:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec084a700 1 -- 172.21.15.84:0/2859364987 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744649085 0 0) 0x7fbebc0cc9b0 con 0x7fbebc0cd400 2023-10-06T03:03:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec204d700 1 --2- 172.21.15.84:0/2859364987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0b2a30 0x7fbebc164360 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0098e0 tx=0x7fbeac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1367561cfcf010f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.806+0000 7fbec084a700 1 -- 172.21.15.84:0/2859364987 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac009e80 con 0x7fbebc0b2a30 2023-10-06T03:03:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.807+0000 7fbec084a700 1 -- 172.21.15.84:0/2859364987 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac00b820 con 0x7fbebc0b2a30 2023-10-06T03:03:05.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.807+0000 7fbec084a700 1 -- 172.21.15.84:0/2859364987 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac00bba0 con 0x7fbebc0b2a30 2023-10-06T03:03:05.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.807+0000 7fbec284e700 1 -- 172.21.15.84:0/2859364987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0b2a30 msgr2=0x7fbebc164360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.807+0000 7fbec284e700 1 --2- 172.21.15.84:0/2859364987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0b2a30 0x7fbebc164360 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0098e0 tx=0x7fbeac0091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.807+0000 7fbec284e700 1 -- 172.21.15.84:0/2859364987 shutdown_connections 2023-10-06T03:03:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.807+0000 7fbec284e700 1 --2- 172.21.15.84:0/2859364987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0b2a30 0x7fbebc164360 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.807+0000 7fbec284e700 1 -- 172.21.15.84:0/2859364987 >> 172.21.15.84:0/2859364987 conn(0x7fbebc099560 msgr2=0x7fbebc06f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.807+0000 7fbec284e700 1 -- 172.21.15.84:0/2859364987 shutdown_connections 2023-10-06T03:03:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.807+0000 7fbec284e700 1 -- 172.21.15.84:0/2859364987 wait complete. 2023-10-06T03:03:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.808+0000 7fbec284e700 1 Processor -- start 2023-10-06T03:03:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.808+0000 7fbec284e700 1 -- start start 2023-10-06T03:03:05.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec284e700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbebc0b2660 0x7fbebc16d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec284e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbebc0b2a30 0x7fbebc147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec284e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0cd400 0x7fbebc157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec284e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc16dc50 con 0x7fbebc0cd400 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec284e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0b4a50 con 0x7fbebc0b2a30 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec284e700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0c8270 con 0x7fbebc0b2660 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec204d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0cd400 0x7fbebc157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec204d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0cd400 0x7fbebc157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56444/0 (socket says 172.21.15.84:56444) 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec204d700 1 -- 172.21.15.84:0/543121621 learned_addr learned my addr 172.21.15.84:0/543121621 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec104b700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbebc0b2a30 0x7fbebc147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec204d700 1 -- 172.21.15.84:0/543121621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbebc0b2660 msgr2=0x7fbebc16d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec204d700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbebc0b2660 0x7fbebc16d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec204d700 1 -- 172.21.15.84:0/543121621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbebc0b2a30 msgr2=0x7fbebc147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec204d700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbebc0b2a30 0x7fbebc147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec204d700 1 -- 172.21.15.84:0/543121621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac009420 con 0x7fbebc0cd400 2023-10-06T03:03:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.809+0000 7fbec104b700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbebc0b2a30 0x7fbebc147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.810+0000 7fbec204d700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0cd400 0x7fbebc157e10 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0093f0 tx=0x7fbeac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.810+0000 7fbeb9ffb700 1 -- 172.21.15.84:0/543121621 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac01b450 con 0x7fbebc0cd400 2023-10-06T03:03:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.810+0000 7fbeb9ffb700 1 -- 172.21.15.84:0/543121621 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac020070 con 0x7fbebc0cd400 2023-10-06T03:03:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.810+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc0c8550 con 0x7fbebc0cd400 2023-10-06T03:03:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.810+0000 7fbeb9ffb700 1 -- 172.21.15.84:0/543121621 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac01b820 con 0x7fbebc0cd400 2023-10-06T03:03:05.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.810+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc0c8b10 con 0x7fbebc0cd400 2023-10-06T03:03:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.811+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc05f270 con 0x7fbebc0cd400 2023-10-06T03:03:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.811+0000 7fbeb9ffb700 1 -- 172.21.15.84:0/543121621 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbeac022030 con 0x7fbebc0cd400 2023-10-06T03:03:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.812+0000 7fbeb9ffb700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbea8066f30 0x7fbea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:05.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.812+0000 7fbeb9ffb700 1 -- 172.21.15.84:0/543121621 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fbeac086870 con 0x7fbebc0cd400 2023-10-06T03:03:05.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.812+0000 7fbec184c700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbea8066f30 0x7fbea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:05.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.812+0000 7fbec184c700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbea8066f30 0x7fbea80693e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400acf0 tx=0x7fbeb4009350 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:05.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:05.816+0000 7fbeb9ffb700 1 -- 172.21.15.84:0/543121621 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbeac0539f0 con 0x7fbebc0cd400 2023-10-06T03:03:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.000+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fbebc05f270 con 0x7fbebc0cd400 2023-10-06T03:03:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.004+0000 7fbeb9ffb700 1 -- 172.21.15.84:0/543121621 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbeac0539f0 con 0x7fbebc0cd400 2023-10-06T03:03:06.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.005+0000 7fbeb9ffb700 1 -- 172.21.15.84:0/543121621 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbeac057010 con 0x7fbebc0cd400 2023-10-06T03:03:06.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbea8066f30 msgr2=0x7fbea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbea8066f30 0x7fbea80693e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400acf0 tx=0x7fbeb4009350 comp rx=0 tx=0).stop 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0cd400 msgr2=0x7fbebc157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0cd400 0x7fbebc157e10 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0093f0 tx=0x7fbeac016000 comp rx=0 tx=0).stop 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 shutdown_connections 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fbea8066f30 0x7fbea80693e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbebc0cd400 0x7fbebc157e10 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbebc0b2660 0x7fbebc16d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 --2- 172.21.15.84:0/543121621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbebc0b2a30 0x7fbebc147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 >> 172.21.15.84:0/543121621 conn(0x7fbebc099560 msgr2=0x7fbebc069a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 shutdown_connections 2023-10-06T03:03:06.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.007+0000 7fbec284e700 1 -- 172.21.15.84:0/543121621 wait complete. 2023-10-06T03:03:06.020 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:03:06.021 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:06.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.133+0000 7fcbdbca0700 1 Processor -- start 2023-10-06T03:03:06.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.133+0000 7fcbdbca0700 1 -- start start 2023-10-06T03:03:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.134+0000 7fcbdbca0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd415caf0 0x7fcbd406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.134+0000 7fcbdbca0700 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcbd40caad0 0x7fcbd40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.134+0000 7fcbdbca0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd406ed10 con 0x7fcbd40675f0 2023-10-06T03:03:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.134+0000 7fcbdbca0700 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd40cb8b0 con 0x7fcbd40caad0 2023-10-06T03:03:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.134+0000 7fcbdbca0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40cbb90 con 0x7fcbd415caf0 2023-10-06T03:03:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.134+0000 7fcbda23d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcbd40675f0 0x7fcbd4067a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54710/0 (socket says 172.21.15.84:54710) 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.134+0000 7fcbda23d700 1 -- 172.21.15.84:0/2143396875 learned_addr learned my addr 172.21.15.84:0/2143396875 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd923b700 1 --2- 172.21.15.84:0/2143396875 >> v2:172.21.15.131:3300/0 conn(0x7fcbd40caad0 0x7fcbd40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd9a3c700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd415caf0 0x7fcbd406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721234732 0 0) 0x7fcbd406ed10 con 0x7fcbd40675f0 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc0003570 con 0x7fcbd40675f0 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3192216545 0 0) 0x7fcbc0003570 con 0x7fcbd40675f0 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd415caf0 msgr2=0x7fcbd406f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd415caf0 0x7fcbd406f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 >> v2:172.21.15.131:3300/0 conn(0x7fcbd40caad0 msgr2=0x7fcbd40caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 --2- 172.21.15.84:0/2143396875 >> v2:172.21.15.131:3300/0 conn(0x7fcbd40caad0 0x7fcbd40caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd406e6c0 con 0x7fcbd40675f0 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2135849775 0 0) 0x7fcbcc0017f0 con 0x7fcbd40675f0 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 >> v1:172.21.15.84:6789/0 conn(0x7fcbd40675f0 legacy=0x7fcbd4067a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbc0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbc0004810 0x7fcbc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd415caf0 0x7fcbc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40cb8b0 con 0x7fcbc0003a60 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40cbb90 con 0x7fcbc0004810 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc000bae0 con 0x7fcbd415caf0 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd9a3c700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbc0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd923b700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbc0004810 0x7fcbc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbda23d700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd415caf0 0x7fcbc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd9a3c700 1 -- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd415caf0 msgr2=0x7fcbc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd9a3c700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd415caf0 0x7fcbc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd9a3c700 1 -- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbc0004810 msgr2=0x7fcbc0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd9a3c700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbc0004810 0x7fcbc0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd9a3c700 1 -- 172.21.15.84:0/2143396875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0003570 con 0x7fcbc0003a60 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.135+0000 7fcbd923b700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbc0004810 0x7fcbc0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbd9a3c700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbc0003e70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009c00 tx=0x7fcbd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f95f5285dccf942 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000e710 con 0x7fcbc0003a60 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcbd000e870 con 0x7fcbc0003a60 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbd8a3a700 1 -- 172.21.15.84:0/2143396875 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000ec50 con 0x7fcbc0003a60 2023-10-06T03:03:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbdbca0700 1 -- 172.21.15.84:0/2143396875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 msgr2=0x7fcbc0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbdbca0700 1 --2- 172.21.15.84:0/2143396875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbc0003e70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009c00 tx=0x7fcbd00091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbda23d700 1 -- 172.21.15.84:0/2143396875 reap_dead start 2023-10-06T03:03:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbdbca0700 1 -- 172.21.15.84:0/2143396875 shutdown_connections 2023-10-06T03:03:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbdbca0700 1 -- 172.21.15.84:0/2143396875 >> 172.21.15.84:0/2143396875 conn(0x7fcbd40cdef0 msgr2=0x7fcbd40c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbdbca0700 1 -- 172.21.15.84:0/2143396875 shutdown_connections 2023-10-06T03:03:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.136+0000 7fcbdbca0700 1 -- 172.21.15.84:0/2143396875 wait complete. 2023-10-06T03:03:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.137+0000 7fcbdbca0700 1 Processor -- start 2023-10-06T03:03:06.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.137+0000 7fcbdbca0700 1 -- start start 2023-10-06T03:03:06.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbdbca0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbd40ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbdbca0700 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd40b01c0 0x7fcbd4154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbdbca0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbd406bbd0 0x7fcbd406c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbdbca0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40aecf0 con 0x7fcbc0003a60 2023-10-06T03:03:06.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbdbca0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40b0630 con 0x7fcbd406bbd0 2023-10-06T03:03:06.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbdbca0700 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd406c580 con 0x7fcbd40b01c0 2023-10-06T03:03:06.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd9a3c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbd40ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd9a3c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbd40ae390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56464/0 (socket says 172.21.15.84:56464) 2023-10-06T03:03:06.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd9a3c700 1 -- 172.21.15.84:0/4278050560 learned_addr learned my addr 172.21.15.84:0/4278050560 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbda23d700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbd406bbd0 0x7fcbd406c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd923b700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd40b01c0 0x7fcbd4154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd9a3c700 1 -- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd40b01c0 msgr2=0x7fcbd4154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd9a3c700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd40b01c0 0x7fcbd4154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd9a3c700 1 -- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbd406bbd0 msgr2=0x7fcbd406c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd9a3c700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbd406bbd0 0x7fcbd406c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd9a3c700 1 -- 172.21.15.84:0/4278050560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4159100 con 0x7fcbc0003a60 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbda23d700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbd406bbd0 0x7fcbd406c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.138+0000 7fcbd923b700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd40b01c0 0x7fcbd4154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.139+0000 7fcbd9a3c700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbd40ae390 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00137a0 tx=0x7fcbd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:06.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.139+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4278050560 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0022070 con 0x7fcbc0003a60 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.139+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4278050560 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcbd0013cf0 con 0x7fcbc0003a60 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.139+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd40b0850 con 0x7fcbc0003a60 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.139+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4278050560 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000e710 con 0x7fcbc0003a60 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.139+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd40b0e10 con 0x7fcbc0003a60 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.140+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd4064ad0 con 0x7fcbc0003a60 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.140+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4278050560 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbd001c910 con 0x7fcbc0003a60 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.141+0000 7fcbc9ffb700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcbb8066f30 0x7fcbb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.141+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4278050560 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5784+0+0 (secure 0 0 0) 0x7fcbd0085d80 con 0x7fcbc0003a60 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.141+0000 7fcbd923b700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcbb8066f30 0x7fcbb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.141+0000 7fcbd923b700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcbb8066f30 0x7fcbb80693e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4006d80 tx=0x7fcbc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:06.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.145+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4278050560 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbd0053020 con 0x7fcbc0003a60 2023-10-06T03:03:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.369+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbd406e9a0 con 0x7fcbc0003a60 2023-10-06T03:03:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.370+0000 7fcbc9ffb700 1 -- 172.21.15.84:0/4278050560 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+3539 (secure 0 0 0) 0x7fcbd0017df0 con 0x7fcbc0003a60 2023-10-06T03:03:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-10-06T03:03:06.372 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":113,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6779,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6834/3707788913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3707788913},{"type":"v1","addr":"172.21.15.131:6834","nonce":3707788913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7361,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2198674166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6833","nonce":2198674166},{"type":"v1","addr":"172.21.15.131:6835","nonce":2198674166}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":113},{"gid":9390,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/4086431444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":4086431444},{"type":"v1","addr":"172.21.15.84:6835","nonce":4086431444}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":113},{"gid":9393,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2214635717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2214635717},{"type":"v1","addr":"172.21.15.84:6837","nonce":2214635717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":113}],"filesystems":[]} 2023-10-06T03:03:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcbb8066f30 msgr2=0x7fcbb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcbb8066f30 0x7fcbb80693e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4006d80 tx=0x7fcbc4008040 comp rx=0 tx=0).stop 2023-10-06T03:03:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 msgr2=0x7fcbd40ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbd40ae390 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00137a0 tx=0x7fcbd00091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 shutdown_connections 2023-10-06T03:03:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:6832/90399,v1:172.21.15.84:6833/90399] conn(0x7fcbb8066f30 0x7fcbb80693e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbd406bbd0 0x7fcbd406c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbc0003a60 0x7fcbd40ae390 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 --2- 172.21.15.84:0/4278050560 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbd40b01c0 0x7fcbd4154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 >> 172.21.15.84:0/4278050560 conn(0x7fcbd40cdef0 msgr2=0x7fcbd40c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 shutdown_connections 2023-10-06T03:03:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-10-06T03:03:06.372+0000 7fcbdbca0700 1 -- 172.21.15.84:0/4278050560 wait complete. 2023-10-06T03:03:06.375 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 113 2023-10-06T03:03:06.385 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T03:03:06.385 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T03:03:06.386 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:03:06.386 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.394 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:03:06.394 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:03:06.394 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.443 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:03:06.443 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:03:06.443 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.454 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:03:06.454 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:03:06.454 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.504 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:03:06.504 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T03:03:06.505 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T03:03:06.505 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.530 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T03:03:06.530 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T03:03:06.530 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.596 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T03:03:06.597 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T03:03:06.597 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.659 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T03:03:06.660 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T03:03:06.660 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.724 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T03:03:06.725 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T03:03:06.725 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.771 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T03:03:06.771 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T03:03:06.771 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.803 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T03:03:06.803 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T03:03:06.803 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.883 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T03:03:06.884 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T03:03:06.884 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.958 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T03:03:06.958 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T03:03:06.959 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T03:03:06.959 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:06.983 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T03:03:06.983 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T03:03:06.985 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:07.026 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T03:03:07.026 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T03:03:07.027 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T03:03:07.027 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:07.037 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T03:03:07.037 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T03:03:07.037 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:07.078 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T03:03:07.078 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T03:03:07.078 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:03:07.129 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T03:03:07.130 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T03:03:07.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Scrub error on inode' | head -n 1 2023-10-06T03:03:07.157 INFO:teuthology.orchestra.run.smithi084.stdout:1696560902.1029825 mon.a (mon.0) 192 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:03:07.157 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T03:03:07.158 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Scrub error on inode' | head -n 1 2023-10-06T03:03:07.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Scrub error on inode' | head -n 1 2023-10-06T03:03:07.264 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:07.268 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:07.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Scrub error on inode' | head -n 1 2023-10-06T03:03:07.388 INFO:teuthology.orchestra.run.smithi084.stdout:1696560902.1029825 mon.a (mon.0) 192 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:03:07.389 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:03:07.389 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T03:03:07.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:03:07.619 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T03:03:07.753 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:03:07.754 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T03:03:07.822 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:03:07.822 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T03:03:07.898 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:03:07.898 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T03:03:08.068 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:03:08.068 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T03:03:08.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:03:08.169 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T03:03:08.233 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:03:08.233 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T03:03:08.295 INFO:tasks.ceph:Archiving mon data... 2023-10-06T03:03:08.296 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/data/mon.a.tgz 2023-10-06T03:03:08.296 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-10-06T03:03:08.311 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.7YJJJTTDlX 2023-10-06T03:03:08.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.7YJJJTTDlX 2023-10-06T03:03:08.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.7YJJJTTDlX 2023-10-06T03:03:08.556 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.7YJJJTTDlX is 455KB 2023-10-06T03:03:08.653 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.7YJJJTTDlX 2023-10-06T03:03:08.667 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/data/mon.b.tgz 2023-10-06T03:03:08.667 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-10-06T03:03:08.683 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.ytajACoVpZ 2023-10-06T03:03:08.683 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ytajACoVpZ 2023-10-06T03:03:08.848 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.ytajACoVpZ 2023-10-06T03:03:08.930 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.ytajACoVpZ is 475KB 2023-10-06T03:03:09.026 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.ytajACoVpZ 2023-10-06T03:03:09.040 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/data/mon.c.tgz 2023-10-06T03:03:09.041 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-10-06T03:03:09.094 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.W9yqqjlLK4 2023-10-06T03:03:09.094 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.W9yqqjlLK4 2023-10-06T03:03:09.249 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.W9yqqjlLK4 2023-10-06T03:03:09.330 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.W9yqqjlLK4 is 475KB 2023-10-06T03:03:09.425 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.W9yqqjlLK4 2023-10-06T03:03:09.440 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T03:03:09.440 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:03:09.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:03:09.503 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T03:03:09.503 DEBUG:teuthology.orchestra.run.smithi084:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:03:09.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:03:09.533 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:03:09.567 INFO:teuthology.orchestra.run.smithi131.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:03:09.573 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T03:03:09.575 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/remote/smithi084/crash 2023-10-06T03:03:09.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:03:09.604 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/remote/smithi131/crash 2023-10-06T03:03:09.605 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:03:09.636 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T03:03:09.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:09.649 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:09.725 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:09.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:09.773 INFO:tasks.ceph:Compressing logs... 2023-10-06T03:03:09.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:03:09.792 DEBUG:teuthology.orchestra.run.smithi131:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:03:15.808 INFO:tasks.ceph:Archiving logs... 2023-10-06T03:03:15.809 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/remote/smithi084/log 2023-10-06T03:03:15.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:03:17.060 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/remote/smithi131/log 2023-10-06T03:03:17.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:03:17.762 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T03:03:17.771 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T03:03:17.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:03:17.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:03:17.860 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T03:03:17.870 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T03:03:17.870 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:03:17.872 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:03:17.885 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2023-10-06T03:03:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2023-10-06T03:03:17.888 INFO:teuthology.orchestra.run.smithi084.stdout:210 Number of sources = 4 2023-10-06T03:03:17.888 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:03:17.888 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-10-06T03:03:17.888 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 21 -291us[ -291us] +/- 85ms 2023-10-06T03:03:17.888 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -298us[ -287us] +/- 74ms 2023-10-06T03:03:17.888 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +662us[ +673us] +/- 80ms 2023-10-06T03:03:17.888 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:03:17.890 INFO:teuthology.orchestra.run.smithi131.stdout:210 Number of sources = 4 2023-10-06T03:03:17.890 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:03:17.890 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-10-06T03:03:17.890 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 20 -286us[ -286us] +/- 85ms 2023-10-06T03:03:17.890 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 -284us[ -247us] +/- 74ms 2023-10-06T03:03:17.890 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +672us[ +708us] +/- 80ms 2023-10-06T03:03:17.891 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:03:17.891 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T03:03:17.902 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T03:03:17.902 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T03:03:17.942 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:03:18.051 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:03:18.141 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:03:18.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:03:18.172 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:03:18.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:03:18.202 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T03:03:18.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T03:03:18.243 INFO:teuthology.task.internal:Duration was 1178.363152 seconds 2023-10-06T03:03:18.243 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T03:03:18.291 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T03:03:18.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:03:18.294 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:03:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:03:18.337 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:03:18.711 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T03:03:18.711 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2023-10-06T03:03:18.712 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:03:18.730 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2023-10-06T03:03:18.730 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:03:18.769 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T03:03:18.770 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:03:18.772 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:03:18.851 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T03:03:18.851 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:03:18.856 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:03:18.964 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T03:03:18.974 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T03:03:18.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:03:18.998 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:03:19.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T03:03:19.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:03:19.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:03:19.062 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2023-10-06T03:03:19.087 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2023-10-06T03:03:19.100 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:03:19.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:03:19.130 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:03:19.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:03:19.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T03:03:19.166 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T03:03:19.166 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/remote/smithi084 2023-10-06T03:03:19.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:03:19.208 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169/remote/smithi131 2023-10-06T03:03:19.208 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:03:19.245 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T03:03:19.246 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:03:19.248 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:03:19.293 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T03:03:19.306 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T03:03:19.306 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T03:03:19.337 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T03:03:19.337 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:03:19.340 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:03:19.351 INFO:teuthology.orchestra.run.smithi084.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:03 /home/ubuntu/cephtest 2023-10-06T03:03:19.354 INFO:teuthology.orchestra.run.smithi131.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:03 /home/ubuntu/cephtest 2023-10-06T03:03:19.356 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T03:03:19.377 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T03:03:19.460 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T03:03:19.485 DEBUG:teuthology.nuke:shortname: smithi084 2023-10-06T03:03:19.486 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:03:19.506 DEBUG:teuthology.nuke:shortname: smithi131 2023-10-06T03:03:19.506 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:03:19.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:36:33.642162', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBITBtx/bAIfyuUxsJSZLm5tJ/nDGLxprgfTsd+TBPEy+03FL+DlHWu+7cPjzJhjwdIafE1YdQgc72qKkxh3BDiA='} 2023-10-06T03:03:19.526 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:36:33.643464', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBOUjOfNyhN4aTGrezCVYR0S/G4/6ct0vMeX2ZhrQNTNb8jS0cORCRQAZu85HmmxslxEVey2UnGO2BuePk6ORJ8='} 2023-10-06T03:03:19.554 INFO:teuthology.orchestra.console.smithi084:Power off 2023-10-06T03:03:19.555 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:03:19.576 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-10-06T03:03:19.576 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:03:19.590 INFO:teuthology.orchestra.console.smithi131:Power off 2023-10-06T03:03:19.590 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:03:19.598 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-10-06T03:03:19.611 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-10-06T03:03:19.612 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:03:19.632 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-06T03:03:23.599 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:03:23.634 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:03:23.708 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-10-06T03:03:23.742 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-06T03:03:27.712 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:03:27.744 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:03:27.821 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-10-06T03:03:27.853 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-06T03:03:31.822 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:03:31.854 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:03:31.931 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-10-06T03:03:31.963 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-06T03:03:32.033 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-10-06T03:03:32.064 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-10-06T03:03:32.169 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} duration: 1178.363151550293 failure_reason: '"1696560902.1029825 mon.a (mon.0) 192 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T03:03:32.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:03:32.261 INFO:teuthology.run:FAIL